Sources: New Delhi, UPDATED: Aug 14, 2023 09:14 IST
A new study has shown that ChatGPT answered 52 per
cent of software engineering questions incorrectly as it failed to understand
the concepts behind them.
In Short
- A
study conducted by Purdue University revealed that ChatGPT answered 52 per
cent of software engineering questions inaccurately
- 77
per cent of responses were deemed 'verbose'.
- The
study found that the chatbot struggled to understand the concept behind
the questions and had limited reasoning abilities.
ChatGPT was launched in November 2022 and has been
making headlines for its sheer brilliance since then. Be it acing various
competitive exams, helping students with their assignments, turning a tutor in
some cases, composing music and poetry and a lot more, the AI chatbot has aced
various tests that people have put it through. However, all this time, there
has been one concern that particularly stood out - the accuracy of its
responses. And according to a new study, the chatbot's accuracy is once again
under the scanner as it failed to answer 52 per cent of software engineering
questions correctly.