Topic
Llama 3 2
4 episodes
-
Automating Knowledge Graph Population: Extracting Entities and Triples from Unstructured Text with an LLM MachineLearningMastery
Pippa and Tyler dig into a practical recipe for turning unstructured text into knowledge-graph quads with a local LLM, but keep the real question in view: whether the extraction pipeline is useful enough to trust, not just easy to demo. They focus on the article’s SPOC framing, JSON-mode prompting, and QuadStore loading, while poking at where this kind of setup gets brittle in the real world.
-
When is Your LLM Steerable?
A new paper investigates whether you can predict if a steering attempt will succeed by looking at the model's hidden states from just the first few tokens—before decoding the full response. The authors build ASTEER, a dataset of 1.4M steered generations labeled for success/failure across 150 concepts, then train a GBDT classifier on early hidden-state features to predict three outcomes: under-steer, success, or over-steer. The predictor hits ~0.7 macro-F1 on unseen concepts and cuts the cost of finding good steering strengths without expensive full rollouts.
-
Top 7 Small Language Models You Can Run on a Laptop MachineLearningMastery
Izzo and Boone explore seven small language models that run locally on laptops, diving deep into the technical trade-offs, hardware requirements, and real-world use cases. They break down everything from Phi-3.5 Mini's long-context capabilities to Llama 3.2's versatility, examining why local inference matters and how to choose the right model for your specific needs.
-
Self Hinting Language Models Enhance Reinforcement Learning
The paper explores how self-hinting language models can enhance reinforcement learning, particularly in overcoming the challenges faced when rewards are sparse. By introducing hints generated by the model itself during training, it reshapes the distribution of outcomes, allowing for better learning signals and improved performance on difficult prompts. This approach not only addresses existing limitations but also offers a novel way to adaptively guide the training process.