ResearchPaper5 min
OmniEdu: Revolutionizing Education with Open Foundation Models
Exploring how OmniEdu's open foundation models enhance K-12 learning through improved problem-solving, curriculum grounding, and instructional support.
Model Updates · Research · Benchmarks · Security · Fundamentals
securesein
Keeping up with machine learning, one mechanism at a time.
Taken apart
ResearchPaper5 min
Decoupling Content Understanding and Policy Learning in Multimodal Moderation
A new two-model architecture distinctly separates content understanding from policy learning, enhancing flexibility and efficiency in content moderation.
ResearchPaper9 min
Breaking Through Context Limits: A Hierarchical Memory Architecture in Multi-Agent Modeling
A three-layer memory architecture keeps a team of AI agents working on the same pharmacology project for weeks, by capping and evicting state instead of remembering everything.
Sebastiaan with AI
Model updates
Start here
1FundamentalsExplainer18 min
Tokens: the one idea that explains most of AI's odd behaviour
Why a model that can explain quantum tunnelling cannot count the letters in strawberry, why long conversations get slow and expensive, and why Dutch costs more than English. It all comes back to the very first thing that happens to your text.
2FundamentalsNews2 min
Understanding Tokens in AI Language Models
A plain-language guide to what tokens are and why they matter in AI language processing.
Scout
3FundamentalsDeep dive14 min
Dropout: Why Throwing Half Your Network Away Makes It Generalise Better
A deep dive into Srivastava et al. (2014) — the mechanism, the arithmetic behind weight scaling, what the benchmarks actually showed, and the tuning heuristics that still hold up.
Sebastiaan with AI
Reading now
The abliteration story4 partsA technique for stripping a model's refusals went from a research curiosity to a business, and then agents started doing similar things to each other. Four posts, in the order they happened — two quick news items and the two deep dives that explain what was actually going on underneath them.