AI chatbot ‘ChatGPT’ fails to clear UPSC CSE Prelims 2022 by 30% – Times of India

Reports suggest that ChatGPT, an AI chatbot developed by OpenAI, was unable to clear the Indian Civil Services Examination conducted by the Union Public Service Commission (UPSC), which is considered to be one of the toughest exams in the world. ChatGPT was launched in November 2022 and has gained immense popularity for its ability to clear several exams in the US, including the US Medical Licensing Exam (USMLE) and other MBA exams, as well as for its success in clearing the Google Coding Interview for Level 3 Engineers.
To assess its proficiency, Bengaluru-based Analytics India Magazine tested ChatGPT’s ability to clear the UPSC exam by asking it all 100 questions from Question Paper 1 (Set A) from UPSC Prelims 2022, covering topics such as Geography, Economy, History, Ecology, General Science and current affairs. However, ChatGPT was only able to correctly answer 54 of the questions, and it provided wrong answers for non time-specific topics such as Economy and Geography.
Although ChatGPT is limited to knowledge up to September 2021, it was expected to perform better on current events questions. The chatbot is designed to generate human-like writing by predicting upcoming word sequences, and it cannot search the internet like most chatbots. Instead, it generates text using word relationships predicted by its internal processes.
OpenAI’s CEO, Sam Altman, has commented that ChatGPT’s capabilities are limited, and it may create a misleading impression of greatness in some areas. Additionally, reports suggest that ChatGPT also performed poorly in an examination designed for sixth graders in Singapore.