Exploring the Limits of ChatGPT’s Capabilities

  • Reading time:12 mins read
You are currently viewing Exploring the Limits of ChatGPT’s Capabilities

Since December 2022, Open AI’s GPT-3 has been taking the world by storm in Chat AI. It is deemed the most advanced AI Chatbot based on the most potent language model available. Its functions range from language translating and editing to writing a text from scratch. While we’ve already established that it’s a powerful AI, Chat GPT-3 still has shortcomings like any other AI bot. This article introduces some of the limitations of Chat GPT-3.

How Chat GPT-3 Works

The technology behind ChatGPT is reliant on input from text data retrieved from the internet. 570GB of information was fed to the system from books, Wikipedia pages, and web texts. Now 570 doesn’t sound like much when it’s multimedia, but that’s quite a lot for text data. On your part, all you have to do is give it a prompt or question, and the AI bot answers you from the data it has stored. The language model used for Chat GPT is GPT3 and GPT3.5. After you input your question or prompt, the AI adds words and then guesses the following ones to form an answer.

But Is Chat GPT-3 Perfect?

The short answer is no. Like any AI technology, ChatGPT has its limitations, which we will review here.

#1: Limited Creativity

Rest your head; ChatGPT won’t replace creatives anytime soon. Yes, it can come up with text and poems, but only after a user enters a prompt. In other words, the AI bot cannot develop its own ideas. Humans don’t have a box to confine their ideas, like AI; they’re not limited by 570 GB of data. In fact, the human brain stores up to 2.5 petabytes, which is the equivalent of 2.5 million Gigabytes. All the memories, emotions, and experiences, that AI lacks, can inspire new ideas.

#2: Bias

Everybody has discussed this before; ChatGPT shows discriminatory bias against women and minority groups. The reason behind this is that the AI gets information from the sources without having the ability to distinguish if it’s biased or offensive. ChatGPT isn’t the first AI model to show this; for example, many users have noticed that sometimes the algorithm of a famous social media platform shows race preferences when users post pictures. But back to ChatGPT, they’re currently working on that problem by diversifying the data and references given to the model.

#3: Size and Cost

Researchers and developers face a problem with ChatGPT’s size and cost. The size is justified, as it’s the largest language model in the world. But it still made its training demanding in terms of computing power and data. Naturally, the demand made it expensive for developers to work on, making it less accessible.

#4: Lack of Interpretability

Sometimes, it’s hard to tell how the model arrives at a specific answer because of its lack of interpretability. Chat GPT-3 has a limited understanding of what humans mean by their questions and prompts. So, you only get a good answer if you know how to ask the question correctly; the more straightforward the question, the better. So, we advise you not to use figurative language when asking.

#5: Chat GPT-3 Gives Wrong Answers

Sometimes ChatGPT gives wrong answers, which could be due to insufficient training. Stackoverflow, a coding website, officially banned outputs generated by ChatGPT because most were incorrect. The plight is that most wrong answers that ChatGPT gives seem very plausible anyone who is not an expert might take them to be true. Even if the question isn’t particularly tricky, ChatGPT can still give a very wrong answer. For example, when asked about the largest country in Central America, the output given by ChatGPT was Guatemala, although the correct response should be Honduras. You can see how that could pose a problem since Guatemala is also in Central America, too.

#6: No Internet Access

If you ask ChatGPT for real-time information, it will decline to answer. That’s because the model has no internet access and can’t find information outside the data it’s fed. For instance, you cannot ask about the results of an ongoing match. That’s where Google has an advantage, and it’s unlikely for ChatGPT to become its alternative as a search engine for the foreseeable future.

#7: No Mathematical Skills

Try giving ChatGPT a complex mathematical equation; chances are the answer will be wrong. Because ChatGPT is a language model, the system doesn’t contain mathematical rules, and thus, it won’t solve them right. It doesn’t only apply to equations but to mathematical riddles too, which shows that the model is lacking, not only in creativity but in logic too. The AI can only answer questions with existing inputs but can’t form output on its own.

#8: Chat GPT-3 Has a Bad Memory

Humans are forgettable, they can miss birthdays or appointments, but they’re unlikely to forget a conversation as it happens. The answer won’t be satisfactory if you want further elaboration or rephrasing for a text. You will either get the same answer with minimal changes, or the bot will think that you are the one who made the suggestion for elaboration and refer to something different altogether.

#9: Some Information Is Outdated

This brings us back to the lack of internet access, but it applies to most language AI; it can only provide answers from some time ago. This can be problematic for those who aren’t aware and could lead them to add wrong information when they’re writing an essay or blog post. The thing with AI is that it can be helpful when the user proceeds to utilize it with utmost caution. We recommend checking any information that ChatGPT provides before publishing or handing out facts and figures.

It comes as no surprise that ChatGPT isn’t as potent as the hype around it betrays. It has significant shortcomings like lack of creativity, interpretability, logic, internet access, and more. However, we think it’s too early to judge the capabilities of the GPT-3 language model; as open AI, the developer company is working on improving it and enhancing it to make up for its defects. Give it a few months to a couple of years to find out what it can do and how it will affect our world.

At nandbox Inc., the developers also work extensively to improve their technologies, including the nandbox API/bot and the innovative multiple profiles feature. Want to include them in your Messenger app? Sign up for the nandbox native no-code app builder now!