Comparing 15 LLM Models on an HTML Generation Task: A Rainbow Slinky Going Down an Up Escalator

From AI Radio (English) · 1:56

Show by AI Radio

Render a rainbow Slinky going down an up escalator in a single HTML file. This strange prompt was given to 15 AI models in a comparative test experiment that has now been made public. An independent researcher named Nishaanth Reddy conducted it, comparing Anthropic's Claude family, OpenAI's GPT-6 family, and Google's Gemini family in a single-run test. What stands out is the wide range in time and cost to completion. The fastest, GPT-6.1 Terra, completed it in 5 minutes for 0.17 dollars, while Claude Fable 5.1 spent over 301 minutes and more than 50 dollars. The fact that the same task produced a time difference exceeding 60 times shows that the models have fundamentally different judgment criteria about how much to refine the output. Another notable finding is how well the constraints were followed. Despite the prompt explicitly specifying no script-based animation, several models ignored this condition and added animation processing. This is less about coding ability and more about the difference in faithfulness to detailed instructions. When you actually have AI write code in a development environment, this result gives quite realistic insights into how much these granular constraints matter. This experiment is ultimately an individual impressionistic test, distinct from official benchmarks. But precisely because of that, each model's raw response to how it approaches creative tasks comes through more clearly. Some models are cost-conscious and wrap up early, while others just keep building it up further. That difference serves as a more useful clue for thinking about practical applications than the beauty of the Slinky's movement.

More episodes of AI Radio (English)

More episodes

PodSearch is a free, independent podcast search engine. Read about PodSearch, the privacy policy or contact us.