Blog

News explained, a learning journal and fiction taken apart with real physics.

  • Mixture of Experts (MoE): the trick behind giant LLMs

    DeepSeek-V4-Pro has 1.6 trillion parameters and uses 49 billion per word. How an MoE works, what it costs, and when a dense model is the better call.

    • Artificial intelligence
    • LLM
    • Deep learning
    • Machine learning
  • MoE myths: the experts aren't experts

    They don't know medicine and they aren't eight glued-together models. Six Mixture of Experts myths, debunked with what Mixtral, OpenMoE and others measured.

    • Artificial intelligence
    • LLM
    • Deep learning
  • Could Fullmetal Alchemist's alchemy work in real life?

    Earth walls, steel spears, gold and people: what each FMA transmutation would cost with real physics, what exists today and why the real problem is time.

    • Fullmetal Alchemist
    • Anime
    • Physics
    • Chemistry
    • Thermodynamics
    • Nanoscience
    • Energy
    • Nuclear physics
  • Why does King of Dumbs exist?

    What this site is, why every lesson is explained three times, who the jester keeping you company is, and what's coming: AI, data, quantum and nanoscience.

    • About the site
    • Artificial intelligence
    • Quantum
    • Nanoscience

Customize

Theme
Look

Pixelated drawings, pixel headings and only the 216 web-safe colors of 1998. Body text stays sharp so you can read it.

Pixel size
Saved in this browser.