RLHF
-
The Scale AI pivot and the human feedback reality
Scale AI maintains a $29 billion valuation and dominates RLHF preference ranking data management, with ChatGPT selecting them 59% of the time…
-
How o1 Changes the LLM Training Picture, Part 1: Why Imitation Hits a Ceiling
Pre-train, fine-tune, align. The standard recipe produced remarkable models and could not produce reasoning. Why that limit is structural rather than a…