Data streaming architecture based on Apache Kafka and GitHub for tracking students' activity in higher education software development courses

Abstract

Data streamingarchitecture can be used to collect data and gain insights into the dynamics ofindividual orcollaborative software developmentactivitythat takes place in higher education courses. There isa place to further investigate streamingarchitecture in a given context. The code versioning platforms, such as GitHub,serving as data sourcesin the existing implementationsof data streaming architecturearelacking in practice.The goal of thispaper is to investigate the implementationof a custom data streamingarchitecturethat could be used to track real-time students’ analyticsin higher educationsoftware development courses. The solutionis based on Apache Kafka and GitHub platforms.Also, the architecture developed in the paper could be consideredwhen planning on integrating LMS(Learning Management System)as a visual web interface for students’ analytics.