A look into how large companies might be taking advantage of loopholes with Chatbot Arena to skew their AI model rankings. • Is Chatbot Arena a reliable measure of AI model performance? • How does the Bradley-Terry model work in Chatbot Arena? • What advantages do companies with resources have in Chatbot Arena? • How do private testing policies impact leaderboard rankings? • What are the implications of skewed benchmark results for AI research and development? • How does the 'best-of-N' submission strategy affect the integrity of the leaderboard? • How significant are the score differences observed between identical or similar models? • What are the consequences of inequalities in data access for smaller players? • What steps can be taken to ensure fair AI model evaluation?