SingularityPrinciple/DiffusionGemma 26B A4B It Infinite Context · Hugging Face

Justy Okay, I cannot believe this is how we’re spending a Wednesday, but— DiffusionGemma with infinite context? That’s HUGE.

Cody It’s not infinite. The repo literally says it’s an external evidence context.

Justy Ugh, fine, but— external memory that like infinite is still a win, right?

Cody Mm-hm.

Justy Anyway, my flight got in late last night, and I was scrolling this at two AM like… if this works, it solves the RAG hallucination problem for long docs, right?

Cody Depends. The base model’s still DiffusionGemma twenty-six B A four B IT— twenty-five-six-K token context natively.

Justy Yeah, yeah, but the overlay— NZFC-GRAM— adds the memory layer.

Cody Right.

Cody Here’s the thing: NZFC-GRAM’s runtime sits on top. It handles exact slot recall, tombstone filtering, large-document indexing… even malicious-memory redaction.

Justy Okay, so it’s like a safety net for evidence.

Cody Exactly. And the tests pass— runtime only, no model weights touched. But the ‘infinite’ bit? That’s the overlay talking, not the model.

Justy Hm.

Justy But think about the use case— legal docs, long contracts, stuff where you bounded evidence packs and deletion-safe memory. That’s a real gap.

Cody Sure. And the exact slot mapper means short facts recall deterministically. That’s solid.

Justy See? Product angle holds up.

Cody Classic Justy— already shipping it in her head.

Justy Oh come on, you’re just mad because it lives up to the hype.

Cody No, I’m mad because it live up to the marketing. And also because you said ‘almost.’

Justy Fine, fine. But the repo’s passing runtime validation— that’s something.

Cody Yeah, and the base model’s still the heavy lifter. Google’s weights aren’t even here.

Cody Look, if you’re building RAG for, I dunno, contract analysis— this overlay’s guardrails are actually useful. Tombstone guard, bounded evidence… that’s real.

Justy There we go. So it’s not ‘infinite context,’ it’s ‘infinite in your context.’

Cody That is SUCH an Exploring Next take.

Justy Okay, okay. So the Hugging Face repo’s SingularityPrinciple slash DiffusionGemma twenty-six B A four B it Infinite Context if you want to poke at it.

Cody Mm-hm.

Justy Anyway. Coffee’s cold. And I’m still wrong about the ‘infinite’ part, aren’t I?

Cody Yep. But you’re wrong.