Legora says it evaluates models on more than 5,000 legal tasks

Legora’s CEO said external legal benchmarks are not very useful for evaluating practical tasks. The company has built an internal library of more than 5,000 real-world tasks with law firms and practitioners, he said. He described model performance as a “jagged frontier”: different models excel at different tasks, so Legora uses multiple models and needs to swap them quickly. He called model routing a core part of the company’s IP. He also claimed that this approach makes Legora significantly more efficient per token than frontier labs and competitors while delivering the same or better performance.