Task-Oriented Authoring Tool Using ChatGPT to Create Educational Textbooks

Abstract

The accelerated development of technology has led to the emergence of cutting-edge smart tools, such as artificial intelligence (AI) chatbots and machine learning algorithms, which possess substantial potential for improving learning and education. Conventional content creation tools frequently lack these sophisticated features, rendering the incorporation of AI, including OpenAI's ChatGPT, an appealing area to investigate. This study aims to assess the effectiveness, cognitive load, usability, and potential challenges of a task-oriented authoring tool integrated with ChatGPT for producing personalized educational content. Design considerations using the SDLC Waterfall Model and prompt engineering were discussed. The research involved a total of 25 participants: experts (n=5) and novice (n=20), who utilized the authoring tool to generate academic content. A 5-likert questionnaire that consisted of 41 items was designed to investigate the users’ agreement about the tool’s effectiveness, cognitive load, usability, and AI-associated challenges, with mean comparison and t-tests being used for analysis. The primary findings revealed overall positive impressions among users, particularly concerning the tool's efficiency and cognitive load management. Nevertheless, small differences in usability perceptions arose between experts and novices. These findings provide valuable insights for refining and augmenting AI-integrated authoring tools to better accommodate varying user requirements in the educational domain.