IntelliMeet: Collaborative Mobile Framework for Automated Participation Assessment

Abstract

In this paper, we propose a framework for automated assessment of participation in classroom or professional meeting discussions using audio analysis. Participation is key to the success of businesses and schools; therefore, these establishments aim to measure, incentivise, and ultimately increase it. Currently, the assessment process is mostly subjective. The meeting chair or the teacher makes a subjective judgement on the level of participation by relying on memory or on recorded notes. The unreliability of this approach creates the need to propose objective tools through automation. We propose a collaborative framework using smart phones to capture multiple audio recordings of the meeting and merge them into a single audio-enhanced recording, offsetting audio volume differences in individual recordings due to varied distance from speakers. We use speech diarisation and speaker identification to segment the enhanced audio signal and recognise the identity of the participants in the discussion. We calculate participation statistics as percentages and present them to the discussion participants in graphical form, which helps keep the level balanced between participants. Our results validate the usefulness and potential of our framework in objectively estimating the participation level. The proposed framework is useful as a learning assessment tool and opens the door to automating minute taking when integrating speech recognition.