For the first time, OpenAI is delivering three distinct LLM variants—Sol, Terra, and Luna—each with unique training, pricing, and capability thresholds. The primary focus lies on Sol’s performance against Claude Fable 5, Anthropic’s leading public model.

Sol operates at $5 per million input tokens and $30 output, while Fable 5 costs $10 and $50—pricing that now disadvantages it on several developer-critical benchmarks. Luna, the most affordable at $1 input and $6 output, already outperforms Anthropic’s Opus 4.8 in coding tasks. This pricing dynamic becomes critical by July 19.

Fable 5 has faced instability. An Amazon-backed jailbreak exposed it as a security risk on June 12, prompting a 19-day global outage. Anthropic reinstated it on July 1 with restricted access, later extending deadlines to July 19 to avoid subscriber losses.

This delay reflects a strategic move. If Fable 5 exits subscriptions after July 19, Opus 4.8 becomes Anthropic’s top-tier model—but Luna already surpasses it in coding efficiency at lower costs.

Head-to-head comparisons show tight competition. On the Coding Agent Index, Sol achieves 80 vs. Fable’s 77.2, using half the tokens and time at a third the cost. On Agents’ Last Exam (professional workflows), Sol reaches 53.6% vs. Fable’s 40.5%. In Terminal-Bench, Sol’s ultra mode scores 91.9% vs. 83.1% for Fable.

Testing the Models

Benchmarks often prioritize coding, but we tested other dimensions. Our experiments included creative writing, associative reasoning, and logic puzzles.

Creative Writing Test

Both models were given a prompt to send Jose Lanz into a time-travel paradox. Neither resolved the paradox correctly, but Fable 5’s narrative was more thematically cohesive, while Sol’s prose was mechanistically clear.

Fable 5’s “Lo Que Arde, Vuelve” used cultural specificity and a tighter causal loop, whereas Sol’s “The First Fire” prioritized explanatory clarity. Preference determines the winner—Fable for subtlety, Sol for transparency.

In associative thinking tests, Fable 5 embedded arguments within metaphors more effectively than Sol, which broke its metaphors to explain them.

Logic Puzzle Evaluation

Both models failed to solve a classic bridge-crossing puzzle correctly. Fable 5 provided detailed but flawed reasoning, while Sol repeated a cached solution.

Coding Performance

In a single-shot browser game test, Fable 5 delivered a playable prototype with dynamic elements and sound effects, while Sol’s output was static and unimpressive.

While benchmarks favor Fable 5 in varied contexts, Sol excels in pricing predictability and cost efficiency. Fable 5’s recurring deadline extensions and usage-based pricing create uncertainty.

Conclusion

Beyond coding, neither model impresses dramatically. Fable 5 offers broader utility, but the optimal choice depends on specific needs: Sol’s stable pricing vs. Fable 5’s feature-rich but volatile access.

Source link

Exit mobile version