Learning is memory++

  • To build novel ideas, you need to fetch the base ideas into working memory, operate on them, and then store the result. If the base ideas are not recalled, the novel idea cannot be formed.

Memories decay

  • The probability of recalling something decays with time — steeply at first, then flattening out.
  • Approximately, 80% of what you learn today will be forgotten by the next week. The number is not made up — it survives contact with its source, Ebbinghaus (1885), and with a modern replication. But it is a worst case rather than a constant, and worth reading with the caveats attached.
0%20%40%60%20 min1 hr9 hr1 day2 days6 days31 days20 min — Ebbinghaus 1885: 58.2% saved1 hr — Ebbinghaus 1885: 44.2% saved9 hr — Ebbinghaus 1885: 35.8% saved1 day — Ebbinghaus 1885: 33.7% saved2 days — Ebbinghaus 1885: 27.8% saved6 days — Ebbinghaus 1885: 25.4% saved31 days — Ebbinghaus 1885: 21.1% saved20 min — Dros 2015: 47.2% saved1 hr — Dros 2015: 37.3% saved9 hr — Dros 2015: 27.6% saved1 day — Dros 2015: 31.7% saved2 days — Dros 2015: 23.0% saved6 days — Dros 2015: 16.8% saved31 days — Dros 2015: 4.1% saved25%17%Ebbinghaus (1885) — his data points, and the curve he fit to themMurre & Dros (2015) replication
Percentage of original learning time saved when relearning the same list, against time since learning (log scale). At six days, a quarter of the learning survives.
  • Hence, to effectively retain what has been learned, it is necessary periodically revise it.

Why spaced repetition?

  • Growing up, revision involved re-reading the entire syllabus before an exam. The revision of chapters would start from the least recently learned chapter to the most recent one. I repeated this until the paper was in front of me on exam day.
  • This “technique” is called massing, and though it feels better, literature suggests that spaced repetition is more focused and effective.
  • Spaced repetition techniques intend to “reset” the starting point of the forgetting curve. If you get a flashcard correct, the time between subsequent reviews will increase exponentially (and vice versa). In other words, a card is surfaced only when you are about to forget its contents.

Why anki?

  • Anki is a spaced repetition ecosystem. It has an amazing community encompassing it. Before making your own deck, I would urge you to go through the community created public decks here.
  • The community is fascinating and fun. While trying to create my own flashcard deck, I came across -
    • Annotated human anatomy image deck, like gray’s anatomy
    • deck for Instilling Novel habits (like avoiding sugar cravings) article
    • Audio-visual decks for language learning and learning poems,
    • add-on that allow you to run a slot machine everytime you get a card right (to gamify memory),
    • add-on that shows a jumpscare upon opening the app (apparently it helps with memory formation)
    • huggingface hosted datasets created after collecting years of anki usage (used to tune the spaced repetition algorithm presets).
  • Anki provides cross-platform support. To me, the ability to revise a deck anywhere using a phone was non-negotiable.
    • The AnkiDroid app solves this for android. It also provides a widget that shows the number of cards and the approximate amount of time it would take to revise them. Placing this on the home screen acts as a cue to complete the daily cards.
    • Cloud backups via AnkiWeb.
    • AnkiMCP to create cards via Claude Desktop, connected to anki via the AnkiDesktop add-on.

Anki Setup

  • claude + ankimcp to create cards, Ankidroid to practice anywhere.

  • Creating cards

    • The gold standard is creating cards manually. Using LLMs saves a lot of time, with revising the cards wherever the content is inaccurate.
    • Add custom fields
      • code for revising algorithms
      • graphs and images for visual relationships (e.g front: recall the relationship between retained knowledge and time, back: ebbinghaus_forgetting_curve.jpeg)
      • Making cards “atomic” is popular advice - in my experience, there are some concepts that NEED to be revised together. Imagine a tree graph formed by linking related concepts. Visiting and revising a parent node and its children together is more efficient than revising a parent, switching context and revising an unrelated node, and then coming back and revising the child. If a card is too atomic, the context switch cost accrued while revising unrelated cards is not productive. There is a happy medium to be achieved while creating the card.
    • Pretty formatting via custom html
    • tag cards liberally - by difficulty, core concept; flag to relearn or edit/delete the card.
  • Schedule

    • Revise daily, at a fixed time. I prefer doing it in the morning, after coffee.
    • 5-10 cards per day, 3 minutes per card. This can vary based on the type of cards. Having a hard time limit, 15 minutes - works better for me.
  • Effort

    • Set the card time limit to 3 minutes, and think hard. Do not see the answer until the time limit is reached. (like the Budget Forcing strategy used in LLM inference link)
    • Putting in effort helps forge neuronal pathways that embed the content into long term memory. Effort is everything!
    • The cards should be difficult enough to feel challenging, but easy enough to be recallable. Failing a card after 4-5 tries is a sign to re-learn the concept or break the card down to smaller constituent components.
  • I like to flag and edit cards, and replace them with cards that represent concepts with more clarity (elicits the feeling of something opaque rotating to become transparent). I find this to be an underrated benefit of spaced repetition, revisiting the same concept with a different lens is a way to understand the concept better.

What is worth remembering?

  • Knowledge is useful only if it is applied. Recreational learning is fun though.
  • data structures and algorithms
  • Instilling novel thought patterns and habits
    • e.g Front: <3 minutes ; Back: If a task should take less than 3 minutes to complete, I will just do it instead of postponing it
  • movie quotes, languages

Quickstart

Gaps

  • succesfully recalling a card containing a parent concept should update the child concepts as well - ref Fractional Implicit Revision - justin skycak / MathAcademy

Personal motivation

  • bad at memory
  • stigma of “rote” learning
  • compensate by rederiving, ineffective as scale increases
    • context overload
    • breaks flow while fetching
  • Memory athletes

Read More

Recommended

History of spaced repetition algorithms


P.S.
Remember who you are :)