Exploring Next
Exploring Next — Ep 477 w/ Justy & Cody — A $1,500 foundation model that rivals larger LLMs
Justy and Cody unpack Sapient's claim that HRM-Text, a one-billion-parameter foundation model trained from scratch for about fifteen hundred dollars, can compete with larger open models by changing the architecture and training objective.