Research Study Finds Chatbots Not Useful in Education
One of the research studies recently conducted by Shiri Melumad and Jin Ho Yoon fails to support this idea that their use of chatbots for education would eventually contribute to effective learning. Over 10,000 people participated in the experiment. They learned that they retained more information with traditional search than with chatbots.
Research Method
All participants were instructed to search for knowledge on a topic. The group where ChatGPT was used would comprise one, while the other group would use a conventional Google search engine. Then, they will summarize what they have learned from their research.
Study Results
Both groups showed a clear distinction in learning quality. Those who used chatbots did not learn as much regarding the particular topic. Summaries in terms of lengths were smaller by chatbot group and less detail compared to search participants' responses. As evaluated by independent raters, the responses of chatbot users were seen as ineffective and informative by majority.
The 'Effort' Principle in Learning
Investigators attribute these results to the amount of cognitive investment needed by each method. Standard search engine users did not have to undergo an active process of hovering, clicking multiple links, comparing information across materials, and self-interpretation. Such active engagement forms a stronger relying understanding of the material.
Chatbots, on the other hand, deliver messages directly, thus making research a passive endeavor and with lesser mental engagement from the user.
Recommendation on Usage of Chatbots
But then, the researchers would not advise that chatbots be entirely dispensed. They state that chatbots are good tools for very quick answers. But to keep information and discuss it thoroughly about a topic, self-study and conventional methods of research are more superior and effective.
