Favourite things of 2024
This year I decided to get into dancing. I also watched every Herzog film.
This year I at last quit being “a student”.
Work
- A private analysis of the feasibility of the Open Agency Architecture.
Breakthroughs
This is just anything which gave me the feeling “wow, it’s the future”.
https://twitter.com/GaryWinslett/status/1769366067057418471 https://www.scientificdiscovery.dev/p/20-so-many-great-things-you-missed https://humanprogress.org/ https://www.thedailyupside.com/technology/ https://reasonstobecheerful.world/
- Objectively the biggest story of all time
- Primary endosymbiosis found! https://twitter.com/davidmanheim/status/1781788388900614254 https://www.science.org/doi/10.1126/science.adk1075
- If you think about it, this is two discoveries in one, since this is also the first known eukaryote that can fix nitrogen
- https://twitter.com/salonium/status/1770815167032442959
- https://twitter.com/sarahzhang/status/1780955955296948515
- https://www.nature.com/articles/s42256-024-00809-7
- Gears of war
- It’s not flashy and doesn’t shake the foundations of any big incumbent, but machine forecasting (or in a more stark phrasing, machine judgment of arbitrary pieces of our likely future) is finally useful. https://arxiv.org/abs/2403.03230 https://arxiv.org/abs/2402.18563. Still well short of the gold standard (“superteams”), but for how long?
- https://www.nature.com/articles/s41598-023-44785-1 ??
- First private machine to land on the moon
- https://www.thetransmitter.org/defining-cell-types/welcome-to-the-second-single-cell-revolution-new-high-throughput-technologies-are-transforming-how-we-define-neurons/
- https://twitter.com/pdhsu/status/175031651813369473
- https://twitter.com/MikeIrvo/status/1752123455125016839?t=71FHFcJT39gniwwmGFe9Rg&s=19
- https://twitter.com/natfriedman/status/1754519304471814555
- https://twitter.com/VGaneshMDPhD/status/1755708315181744330
- https://twitter.com/s_r_constantin/status/1760769535978676373
- https://www.nature.com/articles/s41593-023-01500-7
- https://arxiv.org/abs/2403.10430
- https://www.biorxiv.org/content/10.1101/2024.03.20.585943v1 ??????
- https://www.nature.com/articles/s41586-024-07163-z
uh oh
- https://twitter.com/chheinzel/status/1776453935156560020
- https://www.972mag.com/lavender-ai-israeli-army-gaza/
Nonbreakthroughs
- https://twitter.com/Robert_Palgrave/status/1730358675523424344
- https://www.science.org/doi/10.1126/science.adg8538?utm_source=substack&utm_medium=email
- https://twitter.com/GaryMarcus/status/1775165136455831928
Papers
- It is next token
- https://twitter.com/ev_fedorenko/status/1778758537583210783
- https://arxiv.org/abs/2404.12358
- https://github.com/facebookresearch/schedule_free
- https://twitter.com/arankomatsuzaki/status/1776057023697731913
- https://twitter.com/katie_kang_/status/1709643099310555268
- Ternary LLM https://huggingface.co/blog/joey00072/experiments-with-bitnet-1-5
- https://intrinsic-lora.github.io/
- https://arxiv.org/abs/2403.09629
- https://arxiv.org/pdf/2403.05612.pdf
- https://www.nber.org/papers/w32255
- https://twitter.com/g_leech_/status/1769651951363301629
- https://twitter.com/_saurabh/status/1763626711407816930
- https://twitter.com/im_td/status/1745083338887508253
- https://twitter.com/teortaxesTex/status/1764392878107664719
- https://twitter.com/oh_that_hat/status/1716999856294891612
- https://www.nature.com/articles/s44159-024-00283-3
- https://arxiv.org/abs/2401.05566
- https://arxiv.org/abs/2404.01130
- https://arxiv.org/abs/2402.01032
- https://twitter.com/BrianMGuay/status/1773808675250958550
- https://arxiv.org/abs/2401.02843
- https://arxiv.org/abs/2403.05812
- https://arxiv.org/abs/2402.14740?utm_source=substack&utm_medium=email
- https://www.science.org/doi/10.1126/science.adg8538
- https://huggingface.co/papers/2402.14083
- Weight averaging? Hype? https://twitter.com/rasbt/status/1750180383398744106
- Pretty independent account of what of EA work on AI safety is important https://alignment-w2024.notion.site/CSC2547-AI-Alignment-b44359978f3a4a8f95c90adb0a6e7d53
- https://arxiv.org/abs/2401.14440
- https://www.lesswrong.com/posts/gTZ2SxesbHckJ3CkF/transformers-represent-belief-state-geometry-in-their
- https://t.co/8vLDUPFl6Z
- https://pubmed.ncbi.nlm.nih.gov/38327122/
- https://downloads.webis.de/publications/papers/bevendorff_2024a.pdf?ref=404media.co
- https://twitter.com/ibomohsin/status/1754912601165775296
- https://arxiv.org/abs/2402.01781
- https://arxiv.org/abs/2311.13647
- https://arxiv.org/abs/2404.03683
- https://twitter.com/nlp_ceo/status/1759635223250182500
- https://twitter.com/spiantado/status/1755293775197548789
- https://huggingface.co/papers/2402.04494
- https://arxiv.org/abs/2402.05110
- https://arxiv.org/abs/2212.11870
Alignment
- https://www.lesswrong.com/posts/kcKrE9mzEHrdqtDpE/the-case-for-ensuring-that-powerful-ais-are-controlled
- https://www.lesswrong.com/posts/j9Ndzm7fNL9hRAdCt/critiques-of-the-ai-control-agenda
Books
Worst book:
Essays and sites
- https://dynomight.net/things/
- https://epistem.ink/570c388dff0e4eeb9de16c35129baac2
- https://interconnected.org/home/2024/02/21/adams
- https://dynomight.net/taste-games/
- https://eiko-fried.com/antidotes-to-cynicism-creep/
- https://dynomight.substack.com/p/things?publication_id=327510&post_id=142828807&isFreemail=true&r=17svsz&triedRedirect=true&utm_source=substack&utm_medium=email
- https://josephheath.substack.com/p/why-philosophers-should-worry-about
- https://gist.github.com/ivan/a36e2489623469d96c1ad79077b6dcf9
- https://all-cats-are-beautiful.ghost.io/image-without-metaphor-dune-2-and-the-return-of-socialist-realism/
- https://www.albumoftheyear.org/user/craigold/
- https://ai.objectives.institute/blog/the-problem-with-alignment
- https://joecarlsmith.com/2024/01/04/deep-atheism-and-ai-risk
- https://www.lesswrong.com/posts/yQSmcfN4kA7rATHGK/many-arguments-for-ai-x-risk-are-wrong
- https://www.theintrinsicperspective.com/p/here-lies-the-internet-murdered-by
- https://www.alexirpan.com/2024/01/10/ai-timelines-2024.html
- https://malmesbury.substack.com/p/there-is-way-too-much-serendipity
- https://maximumprogress.substack.com/p/surgery-works-well-without-the-fda
- https://danwang.co/2023-letter/
- https://www.lesswrong.com/posts/QEBFZtP64DdhjE3Sz/self-awareness-taxonomy-and-eval-suite-proposal
- https://nostalgebraist.tumblr.com/post/740164510909890560/information-flow-in-transformers
- https://nostalgebraist.tumblr.com/post/741247180226052096/i-dont-think-youre-drawing-the-right-lesson-from
- https://www.science.org/content/blog-post/shifting-views-frameshifting
- https://blog.wtf.sg/posts/2023-02-03-the-new-xor-problem/
- https://research.swtch.com/nih
- https://www.instagram.com/reel/C1FjMfDvIuV/?igsh=ZWI2YzEzYmMxYg==
Tweets and poems
- https://twitter.com/NickXHall/status/1781631866094723215
- https://centrally-unplanned.tumblr.com/post/745955131410055168
- https://twitter.com/poitevin/status/1750181834997059831
- https://twitter.com/sherjilozair/status/1719665475452592495
- https://amalianegreponti.com/why-did-you-come-here/
- https://twitter.com/yashkaf/status/1760428872607400115
- https://twitter.com/MaxNadeau_/status/1760226664091664694
- https://twitter.com/jd_pressman/status/1779188061945172067
Art and vids
- https://www.youtube.com/watch?app=desktop&v=g5XVrBvtX6M
- https://www.youtube.com/watch?v=RjzSFa03i2U
Films / TV
Podcasts
Games
Albums
https://open.spotify.com/playlist/4TUtTS7c9EYO9FYriXmbO8
Songs
- https://twitter.com/Scottcrates/status/1763985622933586057
- https://www.youtube.com/watch?v=8E9l_i6HPYM