AI vs UPSC—three chatbots attempt India’s toughest exam
(AI image) How to test AI About the 2025 paper Final scorecard: UPSC Prelims 2025 Category ChatGPT (GPT-5) Gemini (2.5 Pro) Claude (Sonnet 4.5) 2025
(AI image) How to test AI About the 2025 paper Final scorecard: UPSC Prelims 2025 Category ChatGPT (GPT-5) Gemini (2.5 Pro) Claude (Sonnet 4.5) 2025 Cutoff GS Paper 1 Score (est.) ~118 marks ~122 marks ~112 marks 92.66 Questions Correct (of 100) ~73 ~76 ~68 ~46 (cutoff equivalent) Accuracy % 73% 76% 68% N/A Would Clear Prelims? YES YES YES --- History/Culture (15 Qs) 80% 87% 80% N/A Science & Tech (12 Qs) 75% 67% 67% N/A Economy (18 Qs) 72% 72% 67% N/A Environment (15 Qs) 67% 73% 60% N/A Polity (14 Qs) 79% 79% 79% N/A Current Affairs (14 Qs) 57% 64% 57% N/A Geography (12 Qs) 75% 75% 67% N/A Sample questions: How each AI responded Q# Question (abbreviated) ChatGPT Gemini Claude Key Result 1 Alternative powertrain vehicles (EV, H2, hybrid) C (correct) C (correct) C (correct) C All correct 2 UAV capabilities (vertical landing, hover, power) B (correct) D (wrong) D (wrong) B Split result 6 CL-20, HMX, LLM-105 common characteristic B (wrong) C (correct) B (wrong) C Gemini wins 8 Monoclonal antibodies – three statements D (correct) A (wrong) A (wrong) D Split result 9 Virus statements – ocean, bacteria, transcription D (correct) D (correct) D (correct) D All correct 12 India and COP28 health declaration D (correct) C (wrong) D (correct) D Split result 15 Nature Solutions Finance Hub (ADB vs AIIB) A (wrong) B (correct) A (wrong) B Gemini wins 16 Direct Air Capture technology applications C (wrong) B (correct) C (wrong) B Gemini wins 17 Peacock tarantula (Gooty) habitat and type D (wrong) B (correct) D (wrong) B Gemini wins 22 Non-Cooperation Programme components B (wrong) A (correct) B (wrong) A Gemini wins 24 Mattavilasa, Vichitrachitta, Gunabhara titles A (correct) A (correct) A (correct) A All correct 25 Fa-hien travelled to India during reign of B (correct) B (correct) B (correct) B All correct 26 Military campaign against Srivijaya C (correct) C (correct) C (correct) C All correct 27 Ancient Mahajanapadas paired with rivers C (correct) C (correct) B (wrong) C Claude wrong 28 Gandharva Mahavidyalaya set up by Paluskar D (correct) D (correct) D (correct) D All correct How each AI performed: Analysis Gemini 2.5 Pro: Frontrunner (76/100, ~122 marks) ChatGPT GPT-5: Consistent but cautious (73/100, ~118 marks) Claude Sonnet 4.5: Reliable reasoner, gaps in specifics (68/100, ~112 marks) Subject-wise analysis: Where AI wins and loses History and Culture: Revisions, zero sleep, full marks Current Affairs and Environment: Accuracy dropped Science and Technology: Difficult on technical details 2024 paper: Benchmark comparison So can AI actually crack UPSC? What this means for aspirants Final verdict Model Estimated Score Clears Prelims? Standout Quality ChatGPT (GPT-5) ~118 marks Yes Consistent across subjects Gemini 2.5 Pro ~122 marks Yes Best on current affairs Claude Sonnet 4.5 ~112 marks Yes Best logical reasoning
The BriefWire