A combined EEG motor and speech imagery paradigm with automated successive halving for customizable command selection

Abstract

The classification performance of endogenous electroencephalogram (EEG) brain-computer interfaces (BCIs) can be improved by hybridizing the paradigm through the use of commands from multiple paradigms. Hybrid paradigms using motor imagery (MI) and speech imagery (SI) have shown promise, but there is a lack of research into: i) their effectiveness when compared to pure MI and SI for multiclass problems, and ii) automated command selection. This study investigates multiclass MI and SI hybrid paradigms and compares the results to those obtained using pure MI and SI. Performance was assessed using F1 score and accuracy. The performances of all possible hybrid paradigm designs were assessed. The analysis indicated that hybridization does not always guarantee improved performance when compared to the pure paradigms, and there is inter-subject variation in the best paradigm. This confirmed the need for automated subject-specific hybrid paradigm designs. An automated hybrid paradigm selection technique using successive halving (SH) for expedited computational times was developed and results were compared to those obtained using a standard grid search. The SH approach resulted in an improvement in F1 score of 21.09% and 36.86% compared to MI and SI and led to a reduction in computational times of 82.80% compared to grid search.