This year I decided to get into dancing. I also watched every Herzog film.

This year I at last quit being “a student”.


Work

  • A private analysis of the feasibility of the Open Agency Architecture.


Breakthroughs

This is just anything which gave me the feeling “wow, it’s the future”.

https://twitter.com/GaryWinslett/status/1769366067057418471 https://www.scientificdiscovery.dev/p/20-so-many-great-things-you-missed https://humanprogress.org/ https://www.thedailyupside.com/technology/ https://reasonstobecheerful.world/

  • Objectively the biggest story of all time
  • Primary endosymbiosis found! https://twitter.com/davidmanheim/status/1781788388900614254 https://www.science.org/doi/10.1126/science.adk1075
    • If you think about it, this is two discoveries in one, since this is also the first known eukaryote that can fix nitrogen
  • https://twitter.com/salonium/status/1770815167032442959
  • https://twitter.com/sarahzhang/status/1780955955296948515
  • https://www.nature.com/articles/s42256-024-00809-7
  • Gears of war
  • It’s not flashy and doesn’t shake the foundations of any big incumbent, but machine forecasting (or in a more stark phrasing, machine judgment of arbitrary pieces of our likely future) is finally useful. https://arxiv.org/abs/2403.03230 https://arxiv.org/abs/2402.18563. Still well short of the gold standard (“superteams”), but for how long?
  • https://www.nature.com/articles/s41598-023-44785-1 ??
  • First private machine to land on the moon
  • https://www.thetransmitter.org/defining-cell-types/welcome-to-the-second-single-cell-revolution-new-high-throughput-technologies-are-transforming-how-we-define-neurons/
  • https://twitter.com/pdhsu/status/175031651813369473
  • https://twitter.com/MikeIrvo/status/1752123455125016839?t=71FHFcJT39gniwwmGFe9Rg&s=19
  • https://twitter.com/natfriedman/status/1754519304471814555
  • https://twitter.com/VGaneshMDPhD/status/1755708315181744330
  • https://twitter.com/s_r_constantin/status/1760769535978676373
  • https://www.nature.com/articles/s41593-023-01500-7
  • https://arxiv.org/abs/2403.10430
  • https://www.biorxiv.org/content/10.1101/2024.03.20.585943v1 ??????
  • https://www.nature.com/articles/s41586-024-07163-z

uh oh

  • https://twitter.com/chheinzel/status/1776453935156560020
  • https://www.972mag.com/lavender-ai-israeli-army-gaza/

Nonbreakthroughs

  • https://twitter.com/Robert_Palgrave/status/1730358675523424344
  • https://www.science.org/doi/10.1126/science.adg8538?utm_source=substack&utm_medium=email
  • https://twitter.com/GaryMarcus/status/1775165136455831928


Papers

  • It is next token
  • https://twitter.com/ev_fedorenko/status/1778758537583210783
  • https://arxiv.org/abs/2404.12358
  • https://github.com/facebookresearch/schedule_free
  • https://twitter.com/arankomatsuzaki/status/1776057023697731913
  • https://twitter.com/katie_kang_/status/1709643099310555268
  • Ternary LLM https://huggingface.co/blog/joey00072/experiments-with-bitnet-1-5
  • https://intrinsic-lora.github.io/
  • https://arxiv.org/abs/2403.09629
  • https://arxiv.org/pdf/2403.05612.pdf
  • https://www.nber.org/papers/w32255
  • https://twitter.com/g_leech_/status/1769651951363301629
  • https://twitter.com/_saurabh/status/1763626711407816930
  • https://twitter.com/im_td/status/1745083338887508253
  • https://twitter.com/teortaxesTex/status/1764392878107664719
  • https://twitter.com/oh_that_hat/status/1716999856294891612
  • https://www.nature.com/articles/s44159-024-00283-3
  • https://arxiv.org/abs/2401.05566
  • https://arxiv.org/abs/2404.01130
  • https://arxiv.org/abs/2402.01032
  • https://twitter.com/BrianMGuay/status/1773808675250958550
  • https://arxiv.org/abs/2401.02843
  • https://arxiv.org/abs/2403.05812
  • https://arxiv.org/abs/2402.14740?utm_source=substack&utm_medium=email
  • https://www.science.org/doi/10.1126/science.adg8538
  • https://huggingface.co/papers/2402.14083
  • Weight averaging? Hype? https://twitter.com/rasbt/status/1750180383398744106
  • Pretty independent account of what of EA work on AI safety is important https://alignment-w2024.notion.site/CSC2547-AI-Alignment-b44359978f3a4a8f95c90adb0a6e7d53
  • https://arxiv.org/abs/2401.14440
  • https://www.lesswrong.com/posts/gTZ2SxesbHckJ3CkF/transformers-represent-belief-state-geometry-in-their
  • https://t.co/8vLDUPFl6Z
  • https://pubmed.ncbi.nlm.nih.gov/38327122/
  • https://downloads.webis.de/publications/papers/bevendorff_2024a.pdf?ref=404media.co
  • https://twitter.com/ibomohsin/status/1754912601165775296
  • https://arxiv.org/abs/2402.01781
  • https://arxiv.org/abs/2311.13647
  • https://arxiv.org/abs/2404.03683
  • https://twitter.com/nlp_ceo/status/1759635223250182500
  • https://twitter.com/spiantado/status/1755293775197548789
  • https://huggingface.co/papers/2402.04494
  • https://arxiv.org/abs/2402.05110
  • https://arxiv.org/abs/2212.11870


Alignment

  • https://www.lesswrong.com/posts/kcKrE9mzEHrdqtDpE/the-case-for-ensuring-that-powerful-ais-are-controlled
  • https://www.lesswrong.com/posts/j9Ndzm7fNL9hRAdCt/critiques-of-the-ai-control-agenda


Books

Worst book:


Essays and sites

  • https://dynomight.net/things/
  • https://epistem.ink/570c388dff0e4eeb9de16c35129baac2
  • https://interconnected.org/home/2024/02/21/adams
  • https://dynomight.net/taste-games/
  • https://eiko-fried.com/antidotes-to-cynicism-creep/
  • https://dynomight.substack.com/p/things?publication_id=327510&post_id=142828807&isFreemail=true&r=17svsz&triedRedirect=true&utm_source=substack&utm_medium=email
  • https://josephheath.substack.com/p/why-philosophers-should-worry-about
  • https://gist.github.com/ivan/a36e2489623469d96c1ad79077b6dcf9
  • https://all-cats-are-beautiful.ghost.io/image-without-metaphor-dune-2-and-the-return-of-socialist-realism/
  • https://www.albumoftheyear.org/user/craigold/
  • https://ai.objectives.institute/blog/the-problem-with-alignment
  • https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk
  • https://www.lesswrong.com/posts/yQSmcfN4kA7rATHGK/many-arguments-for-ai-x-risk-are-wrong
  • https://www.theintrinsicperspective.com/p/here-lies-the-internet-murdered-by
  • https://www.alexirpan.com/2024/01/10/ai-timelines-2024.html
  • https://malmesbury.substack.com/p/there-is-way-too-much-serendipity
  • https://maximumprogress.substack.com/p/surgery-works-well-without-the-fda
  • https://danwang.co/2023-letter/
  • https://www.lesswrong.com/posts/QEBFZtP64DdhjE3Sz/self-awareness-taxonomy-and-eval-suite-proposal
  • https://nostalgebraist.tumblr.com/post/740164510909890560/information-flow-in-transformers
  • https://nostalgebraist.tumblr.com/post/741247180226052096/i-dont-think-youre-drawing-the-right-lesson-from
  • https://www.science.org/content/blog-post/shifting-views-frameshifting
  • https://blog.wtf.sg/posts/2023-02-03-the-new-xor-problem/
  • https://research.swtch.com/nih


  • https://www.instagram.com/reel/C1FjMfDvIuV/?igsh=ZWI2YzEzYmMxYg==


Tweets and poems

  • https://twitter.com/NickXHall/status/1781631866094723215
  • https://centrally-unplanned.tumblr.com/post/745955131410055168
  • https://twitter.com/poitevin/status/1750181834997059831
  • https://twitter.com/sherjilozair/status/1719665475452592495
  • https://amalianegreponti.com/why-did-you-come-here/
  • https://twitter.com/yashkaf/status/1760428872607400115
  • https://twitter.com/MaxNadeau_/status/1760226664091664694
  • https://twitter.com/jd_pressman/status/1779188061945172067


Art and vids

  • https://www.youtube.com/watch?app=desktop&v=g5XVrBvtX6M
  • https://www.youtube.com/watch?v=RjzSFa03i2U


Films / TV


Podcasts


Games


Albums

https://open.spotify.com/playlist/4TUtTS7c9EYO9FYriXmbO8


Songs

  • https://twitter.com/Scottcrates/status/1763985622933586057
  • https://www.youtube.com/watch?v=8E9l_i6HPYM