Assessing the Effectiveness of Chat GPT in English Language and Literature: An Experimental Investigation into AI-Generated Research Content

Abstract

ChatGPT is an artificial intelligence model, highly proficient in English language and literature. This research explored the functionality of ChatGPT in producing research-oriented texts of the English language and literature in higher education institutions. It consisted of careful analysis of the quality, coherence, and relevance of ChatGPT- produced- content in terms of its capability to develop research topics, abstracts, research methodologies and theoretical- framework -based data analysis, and conclusions.  Furthermore, the study focused on its role in academic context by drawing upon a comprehensive analysis of the strengths and limitations of ChatGPT in the research domain. Hence, the analysis consisted of scrutinizing the data for completeness, accuracy, and relevance of the content produced by ChatGPT administrating the CRAAP Test as the designed measure of performance of ChatGPT. Results showed a high proficiency of ChatGPT in originating research ideas and data explication but limiting response in composition of comprehensive abstract writing, research methodologies and principle design, especially when implementing practical implementation of overall research components. Furthermore, the study proposed that researchers should approach AI technology with a critical mindset. Contextually, the incorporation of human linguistic and literary expertise is recommended in utilization of ChatGPT in research studies and academic term papers. These measures will help maintain the quality and integrity of research and academic studies.