Tag: LLM training

Oct, 14 2026

Scaling Laws in Practice: When to Stop Training Large Language Models

Emily Fies

Learn how to determine the optimal stopping point for LLM training. We compare Kaplan and Chinchilla scaling laws, explain why overtraining is common in production, and provide practical metrics for saving compute.

Oct, 7 2026

Curriculum and Blending: How to Mix Datasets for Better Large Language Models

Emily Fies

Discover how curriculum learning and dataset blending optimize LLM training. Learn strategies for ordering data, measuring difficulty, and improving performance without extra compute.

Jun, 24 2026

How Large Language Models Learn Meaning and Grammar via Self-Supervision

Emily Fies

Discover how Large Language Models master language rules through self-supervised learning and attention mechanisms. We explain the role of queries, keys, values, and positional encoding in capturing syntax and semantics.

Mar, 1 2026

How Synthetic Data Generation Protects Privacy in LLM Training

Emily Fies

Synthetic data generation lets AI models learn from realistic fake data instead of real personal information. Using differential privacy and LLMs, organizations can train systems safely without violating HIPAA, GDPR, or risking data breaches.