Digital spelling BCI based on visual-auditory associate stimulation

Brain-computer interfaces (BCI) provide direct and non-muscular communication methods for the people with severe motor impairments. Event-related potentials (ERPs) as efficient modals are commonly used in some of the BCI systems, including visual stimulus, auditory stimulus as well as tactile stimulus. In this experiment, the corresponding Chinese pronunciations were inserted into the visual Oddball series of 1-9 numbers to carry out the cross-sense stimuli of BCI. The experimental data analysis result proves that the P300 components produced by visual-auditory associate stimulation have higher amplitudes and shorter latencies than those produced by visual-only stimulus. For further analysis the constrained independent component analysis (cICA) method was applied when extracting the signal features of ERP and the support vector machine (SVM) method was used to BCI classification. Result proves that the ERPs produced by visual-auditory associate stimulation modal have better recognition efficiency than those in visual-only stimulation. It can relevant the capacity of information alteration in BCI and is worth to do more studies.