A Design Framework for Building Intelligent Tutoring Systems Based on Learning Science Principles

Date
2024-07-22
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

Intelligent Tutoring Systems (ITS) have gained popularity due to their ability to provide students with cost-effective and personalized learning experience. The development of Large Language Models (LLMs) offer great potential to revolutionize personalized education to autonomously create effective ITS without relying on manual, labor intensive processes. Our research introduces a novel design framework, named Conversational Learning with Analytical Step-by-Step Strategies (CLASS), which harnesses the potential of high-performance LLMs to construct advanced ITS. The CLASS framework empowers ITS with two critical capabilities. First, through a carefully curated scaffolding dataset, CLASS provides essential problem-solving capabilities, enabling it to provide tutor-like, step-by-step guidance to students. Second, by using a dynamic conversational dataset, CLASS facilitates natural language interactions, which fosters engaging student-tutor conversations. The CLASS framework also enhances the transparency of ITS, offering valuable insights into its internal decision-making process. This interpretability allows seamless integration of user feedback, thus facilitating continuous refinement and improvement. Additionally, we present a practical application of the CLASS framework through a proof-of-concept ITS, with a focus on introductory college-level biology content. A carefully constructed protocol was developed for the biology ITS's preliminary evaluation, examining aspects such as the factual accuracy and relevance of its responses. Experts in the field of biology offered favorable remarks, particularly highlighting its capability to break down questions into manageable subproblems and provide encouraging responses to students.

Description
Degree
Master of Science
Type
Thesis
Keywords
intelligent tutoring systems, learning science principles, large language models
Citation

Liu, Lucy. A Design Framework for Building Intelligent Tutoring Systems Based on Learning Science Principles. (2024). Masters thesis, Rice University. https://hdl.handle.net/1911/117762

Has part(s)
Forms part of
Published Version
Rights
Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
Link to license
Citable link to this page