WIP: Generative and Custom Chatbots in Computer Programming Education and Their Effectiveness A Systematic Literature Review

This work-in-progress research-to-practice paper describes a systematic literature review on the use of chatbots in programming courses. We scoped existing peer-reviewed and published articles focusing on the strength of custom-built chatbots and generative AI chatbots in computer engineering education - specifically, courses that employ C++, Java, and Python programming languages. The purpose of this work is to obtain in-depth information about chatbots, with a focus on their functionality, application, and effectiveness. We were also interested in the extent to which learning taxonomies and frameworks are integrated with chatbots. This study adopted the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) framework to review n=20 articles. Based on the reviews, we provide a set of guidelines on how learning taxonomies and instructional design frameworks can be mapped while developing or implementing chatbots in programming courses.