Continual Learning Remains Unresolved for Everyday AI Systems

For frontier AI labs, continual learning may be achievable through a faster version of the existing training cycle: collecting data, building reinforcement-learning environments and retraining models. The analysis suggests that larger models could make architectural improvements, reduce pre-training loss and generate RL environments at scale as compute increases.

That approach does not solve continual learning for ordinary AI-native startups, enterprises or specialized agents. A legal-associate agent trained on a firm’s complex relationships and implicit practices may degrade under supervised fine-tuning, while reinforcement learning may not provide knowledge acquisition in the needed way. The problem remains without a satisfactory answer, and its assessment depends on how continual learning is defined and which application is considered.