Various neurological diseases can disrupt the neuromuscular channels through which the brain communicates with the external world. In certain cases like hemorrhage in the anterior brain stem or degenerative neuromuscular diseases like amyotrophic lateral scleriosis (ALS), the patients suffer from a total motor paralysis [5]. This results in a condition known as locked-in syndrome, wherein the patient is awake and fully aware but cannot communicate with the outside world due to complete paralysis. For such "locked-in" patients, there is a need for an assistive technology that needs no muscular activity whatsoever.
A brain-computer interface (BCI) is a device that uses brain signals to provide a direct, nonmuscular communication channel between brain and the outside world [32, 31, 29]. The idea underlying BCIs is to measure electric, magnetic, or other physical manifestations of the brain activity and to translate these into commands for a computer or other devices [21, 15].
For patients with locked-in syndrome,the P300 event-related potential (ERP), evoked in scalp-recorded electroencephalography (EEG) by external stimuli, has proven to be a reliable response for controlling a BCI [9]. In this study we present comparison of some classification methods to classify an EEG signal based on the presence of P300 component.
1.1 BCI and P300
Types of BCIs can be broadly classified into two categories—those that use an external stimulus, and those that don’t [21]. In the first method, the external stimuli cause changes in neurophysiologic signals called event-related potentials (ERPs) [15, 22] which are used to identify a user’s response to the stimuli presented. In the second method, users generate certain detectable patterns of neurophysiologic signals by concentrating on a specific mental task. For example, imagination of hand movement can be used to modify activity in the motor cortex [15].
For recording the activity of the brain, the electroencephalogram (EEG) is the method of choice for a BCI due to their fast responsivity and covariation with cognitive processes [5]. Although invasive methods that use electrocorticography (ECoG) signals using implanted electrodes are more accurate, the non-invasive methods are more attractive because of their ease of use by patients; the non-invasive methods have also been shown to be comparable to implanted electrodes [30] when used with appropriate machine learning algorithms.
The EEG non-invasive recordings are done from a set of electrodes placed directly on the scalp using the International 10-20 system (Jasper, 1958) [25]. In this work, the data is obtained through non-invasive electroencephalographic (EEG) recordings. Moreover, the experiments are run on EEG data using only a subset of 8 electrodes that have already been found to be meaningful for P300 classification [30]. A smaller number of electrodes is also better for practical reasons of lower cost and higher usability for target patients. These 8 electrodes used for this work are ’F3’,’F4’,’C3’,’C4’,’P3’,’P4’,’O1’,’O2’.
A P300 ERP is characterized by a positive peak about 300ms after the stimulus onset [5, 22] (Figure 1.1). It is elicited when subjects encounter a rarely occurring, but expected, stimulus among the presented stimuli. If subjects are assigned the task of assigning a category to each of the stimuli in a series of stimuli of two types, and if one of the two types occurs rarely, a P300 ERP is seen in the EEG [20] for the rare stimuli. This experimental paradigm based on extensive research has been called ’oddball’ paradigm [20], the rarely occurring stimuli being the ’oddballs’.
Figure 1.1: P300 ERP. The image is taken from [8].
Farwell and Donchin utilized this characteristic of the P300 to design a BCI in 1988 [20] that is called a ’P300 Speller’. This first BCI of its kind lets a user type one letter at a time using the EEG signals captured through an electrode cap, and needs no muscular movement. There has been a lot of research following their work on improving their setup and many variations of the setup have emerged. As definitions for P300 speller paradigm vary in literature, it is made clear that for this work, each of these windows of EEG will be referred to as a ’subtrial’ and a set of row (column) flashings (six in number which contain one target row(column)) will be called a trial [20].
One of the main challenges in P300 classification is the low signal-to-noise ratio (SNR). As the EEG recorded from scalp contains a lot of noise from ongoing electrical activity in the brain, a P300 is hard to separate from the resulting noisy signal. The problem of low SNR is usually overcome by averaging together many subsequent trials which cancels out most of the noise, and makes P300 detection possible. But this approach of averaging comes at the cost of reduced communication rate. Farwell and Donchin reported in their pioneering work that it needed averaging of between 20 and 40 trials to achieve an accuracy of over 80% [20], with a communication rate of about 12 bits per min or about 2.3 characters per minute. Although their pioneering work did establish the feasibility of a P300 based speller, the communication rate was painfully slow for a practical use. This lead to much work in the last few decades which focused on improving the accuracy and communication speed of a P300-based BCI like P300 speller. So, one of the focus areas of this research has been the development of algorithms that can reduce the number of trials required to achieve a reliable P300-based BCI. But as it is amply demonstrated that averaging of trials stabilizes the P300 amplitude by removing noise, the challenge is also seen as improving single trial accuracy.
1.2 Related Work
The last few decades have seen a lot of research on P300 classification, with the eventual aim of achieving single-trial based reliable P300 BCI [21]. But a literature survey of this research does not show any single P300 classification method to be the state of the art. Krusienski, et al., [18] report the results of a comparison of different classifier algorithms, which shows that stepwise linear discriminant analysis (SWLDA) and support vector machines (SVMs) perform well compared to the other classifiers. In [19] by using SWLDA as the classification method, Krusienski, et al., achieved at least 60% accuracy for all participants. Three of the five participants performed above 90% accuracy with averaging about 15 trials. Sellers and Donchin [10] achieved comparable average results for healthy and ALS patients using SWLDA. Serby, et al., [13] used matched-filtering with independent component analysis (ICA) to achieve a communication rate of 5.45 symbols/min with an accuracy of 92.1% which averaged roughly 15 trials. When the detection was made in real-time by online testing with the same six subjects, the average communication rate achieved was 4.5 symbols/min with an accuracy of 79.5% which averaged roughly 18 trials. On the same lines, a survey of submissions to BCI Competition II and BCI Competition III shows that several very different approaches like SVM, ICA, LDA, peak-picking methods were able to achieve 100% accuracy using between 4 and 15 averaged trials [7, 16, 33] on the BCI Competition II data.
This short list shows that there are many different approaches that all work well, and also that one particular method is not clearly better than others. Then there are other challenges to P300 classification, namely subject-dependence of EEG and even a session-to-session variation in EEG responses of the same subject. A recent review of the BCI field by Mak, et al., [23] concludes that a lot more work is still needed to create a truly reliable P300 speller.
In this work, we use Principal Component Analysis (PCA) as a preprocessing method and use Linear Discriminant Analysis (LDA), Quadratic Discriminant Analysis (QDA) and neural networks for classification. PCA has been shown to work well for P300 classification [8, 12]. In [8], the author compared various blind source separation methods as preprocessing methods for P300 classification, and it was seen that PCA generally worked better than the other methods like Independent Component Analysis (ICA) and Maximum Noise Fraction (MNF) for P300 classification. This work builds upon the work done by Cashero [8] and tests if classification methods other that Support Vector Machines (SVM) will work well in conjunction with PCA for P300 classification.
Among the classification methods, the choice of LDA is also driven by success of this method and its variants like Stepwise LDA (SWLDA) for P300 classification. Although SWLDA has been shown to work very well for higher accuracy, it is an expensive method with high processing time and is therefore not considered suitable for an online P300 speller system [21]. Considering that, we have preferred to consider LDA which is lightweight and provides good performance generally for P300 classification. QDA is chosen to compare LDA with, and to see whether a linear or a nonlinear method works better for P300 classification. Our choice of Neural Networks (NN) as a method of study for P300 classification is primarily driven by our hypothesis that they should be a good choice for P300 classification. There have been studies employing Neural Networks for P300 classification [12, 26], and many have shown promise. There is very little work done using PCA and NN as a combination for P300 classification. As NN provide a lot of flexibility in terms of how the ’derived’ data is created based on flexibility in the number of hidden units, it could be a useful method for noisy data like EEG, especially if PCA provides a good set of source components. SVM is another method which has been shown to work well for P300 classification. We don’t include that in this study due to the fact that a study using PCA with SVM has already been covered in [8]. To keep our focus on the effect of PCA on these classification methods, we have tested only single trial accuracies.
The paper is laid out as follows. Section 2 develops the mathematical background for all the algorithms that are used in the experiments for this work. The classification methods, LDA, QDA, Neural Networks, and the optimization algorithm used for NN and PCA are developed in this section. Section 3 describes the datasets used and details the steps used in the experiments. Section 4 explains the experiments as they were performed and what was learned along the way, and the results of the experiments. Section 5 concludes by providing a summary of the findings and identifies avenues for future work.
2.1 LDA and QDA
LDA and QDA [14, 6] belong to a class of classification methods that model discriminant functions for each class and then classify a given data sample to the class with the largest value for its discriminant function. LDA and QDA model the posterior probabilities for the purpose of defining these discriminant functions. Representing a data sample by variable X and the class label by variable is the dimension of data sample X or equivalently represents the number of features or predictors in each sample
where there are K classes. We thus need the class posteriors p(C | X) for a given
is the class-conditional density of
be the prior probability of class
Applying the Bayes theorem gives us
While many different models can be used to model the class-conditional density, LDA and QDA use multivariate Gaussians to model each class density so that
where are Covariance matrix and the mean of the Gaussian distribution. If we assume that the classes have a common covariance matrix given by
is the class k samples and N is the total number of samples of all classes, then we get LDA. In comparing two classes k and l, it is sufficient to look at the log-ratio
Plugging in the as defined in (2), we get
which is an equation linear in x. So, equation (4) gives us a decision rule for LDA—if the log ratio is positive, the sample x is classified as belonging to class k and to class l if it is negative. The value being zero implies the decision boundary which is linear in x. It’s obvious that the linear
are an equivalent description of the decision rule for LDA. So, the class of a new sample x is simply
Now if we drop the assumption of a common covariance matrix for all classes, then the convenient cancellation of terms leading to (4) doesn’t happen and we get the quadratic discriminant functions (QDA),
The decision boundary in this case between each pair of classes k and l is described by a quadratic equation given by . Again, the class of a new sample x is obtained as
The LDA and QDA are also called Generative models, as they make the assumption of Gaussian distribution of the data, and base the classification of samples on that assumption. The parameters of the Gaussian distributions are estimated using the training data. Class priors are calculated based on the number of samples of each class present in the training data, as
where is the class k samples and N is the total number of samples of all classes. The class means are estimated as the means of the data of a particular class in the training data, so
where is the class of sample
. Similarly
is the covariance matrix for each class based on the data of that particular class in the training data.
2.2 Neural Networks
Neural Networks (NN) [14, 6] are primarily employed in machine learning as nonlinear regression and classification method. While there are many variations and flavors of NN like Recurrent NN, multilayer perceptron, etc., [14, 6, 34], we use a single hidden layer NN for this work. This basic neural net, sometimes called the single hidden layer back-propagation network, or two layer perceptron is a two-stage regression or classification model. It consists of an input layer, a hidden layer and an output layer.
In the case of K-class classification, there are K output units, and each of the K output units models the probability of class k so that
Derived features are created from linear combinations of the inputs, followed by a nonlinear activation function. The output
is modeled as a function of linear combinations of the
where is the activation function and is chosen to be a sigmoid defined as
the softmax function for this :
which results in a multilogit model, and produces positive estimates that add to one. Treating these outcomes as probabilities for the corresponding class, we use negative log-likelihood as the objective function to minimize. This negative log-likelihood objective function is defined as
where denotes the complete set of weights of the network, which consist of
component of the target indicator variable
training sample
. Finally, the corresponding classifier is defined as
With the sigmoid activation function and log-likelihood error function, the neural network model works as a linear logistic regression model in the hidden units, and all the parameters are estimated by maximum likelihood. But by using the nonlinear transformation , it becomes a non-linear model of inputs X. Another interesting aspect of this model is that the number of hidden units can be varied to adjust the non-linearity of the model. If there are no hidden units, the model becomes a simple linear logistic regression model over input data. In this work we use both linear and non-linear versions of the neural network model and call them LR and NLR respectively.
The error function can be minimized by variety of approaches. One of the standard approaches is the gradient descent, called back-propagation in the neural network setting. But a conjugate gradient method called Scaled Conjugate Gradient [24] has been more successful and faster for this optimization problem and we use that in this work and we use SCG for this work.
2.3 PCA
Principal Component Analysis, or PCA, [6, 28, 17] (also known as Karhunen-Loeve transform) is a technique that is widely used in pattern recognition and machine learning for dimensionality reduction and feature extraction. There are two commonly used derivations of PCA—one that maximizes variance of data, and the one that minimizes the projection error. We develop the maximum variance formulation.
Given a set of data samples , the goal of PCA is to project the data onto a space with dimensionality
, while maximizing the variance of the projected data. If
is the first direction of projection, the variance of the data projected on
is given by
So, the optimization problem becomes that of maximizing 12, or equivalently
which is a constrained optimization problem. Using a Lagrange multiplier
By setting the derivative of 15 with respect to equal to zero, we get
which means that must be an eigenvector of
with eigenvalue
, which also turns out to be a measure of the variance. So,
turns out to be a direction of projection that results in maximum variance in the projected data, and is called the first ’Principal Component’. The subsequent directions can be found inductively as follows. Given that we have up to
Principal Components, the next Principal Component v can be found by solving the following constrained optimization problem :
And this problem can be solved by creating the Lagrangian. Solving Equation 18 for all eigenvectors is equivalent to computing the singular value decomposition (SVD) of X [28, 17, 11]:
where . In this decomposition, the columns of V, the right singular vectors, are the eigenvectors of
[28, 17, 11] which provide us the required ’Principal Components’. Additionally, these column vectors are ordered by the variance they produce when data is projected onto them so that the first column of V is the first Principal Component, the second one the second and so on. In this work, we thus use SVD to derive the Principal Components for our experiments.
This Section describes the datasets used in this study, as also the methods and EEG recording equipment used. As data representation is an important part of any signal processing method, we also describe the data representation used in this study. A novel way of using channel-subtrials is also defined and explained.
3.1 Datasets
There are four subjects in the study. The EEG data for subjects 1 and 2 was recorded by BCI laboratory at Computer Science department at Colorado State University [2]. The data were recorded using the g.Tec g.GAMMAsys system [4] with a 8-electrode cap with electrodes located at Fz, Cz, Pz, Oz, P3, P4, O1, O2. This subset of electrodes has been found to be meaningful for P300 classifi-cation [30, 27]. Such small subsets of electrodes are also easier to use for a practical and easy-to-use BCI. Subject 2 was an able-bodied participant in the study, and subject 1 was a subject with C4 complete Spinal cord injury. C4 is a level of Cervical (neck) injury that results in significant loss of function at the biceps and shoulders. While the data for subject 2 was collected in the laboratory, the data for subject 1 was recorded at home.
Three sessions of data collection were performed with both subjects 1 and 2. The subjects count one of three target letters (’b’, ’d’, ’p’) during a session as various other non-target letters are randomly flashed on a screen. This data collection is done as per ’odd-ball’ paradigm and the probability of occurrence for the target letter in each session was 0.25. The data were sampled at 256 Hz, with an inter-stimulus-interval (ISI) of 1 second. One session consisted in recording 20 target and 60 non-target subtrials of 1000ms each of EEG data at 8 electrodes.
Data for subjects 3 and 4 is taken from BCI competition III (dataset II) [1]. These experiments being based on the P300 speller as proposed by Farwell and Donchin [20], the subjects were presented with a 6 by 6 matrix of characters. The subject’s task was to focus attention on characters in a word that was prescribed by the investigator (i.e., one character at a time). All rows and columns are successively and randomly intensified at a rate of 5.7Hz. The objective in this contest was to predict the correct character in each of the provided character selection ’epochs’ that consisted of 15 sequences—each sequence consisting of 12 flashings—6 rows and 6 columns. The data was collected and bandpass filtered from 0.1-60Hz and digitized at 240Hz. After intensification of a row/column, the matrix was blank for 75ms. Row/column intensifications were block randomized in blocks of 12. The sets of 12 intensifications were repeated 15 times for each character epoch (i.e., any specific row/column was intensified 15 times and thus there were 180 total intensifications for each character epoch). Each character epoch was followed by a 2.5 s period, and during this time the matrix was blank. While data for subjects 3 and 4 is recorded at 64 electrode locations, this work uses data only from 8 locations which is the same set of electrodes used for subjects 1 and 2—Fz, Cz, Pz, Oz, P3, P4, O1, O2.
3.2 Data Processing and Representation
The original data for all the four subjects comes as a continuous EEG for an entire recording. All the data was then bandpass-filtered from 0.23 Hz to 30 Hz. The data were then normalized for zero mean and unit variance. Figures 3.1 and 3.2 show a 4 second window of data before and after the bandpass filtering. The bandpass filtering was done using Butterworth bandpass filter [3]. This data is then sliced to separate the target and non-target subtrials for each channel. Each Dataset was thus reshaped into a matrix with each row representing a channel-subtrial- 256 datapoints as a time series for subjects 1 (sub1) and 2 (sub2), and 240 for subjects 3(sub3) and 4(sub4). The channel-subtrials used for classification therefore consist of one-second long windows after each stimulus onset that are extracted from the continuous signal in each data segment.
Figure 3.1: 4s Original Data sub1.
Figure 3.2: 4s Data sub1 after bandpassing.
Our approach for data representation involves considering a time series from each of the eight channels as a separate subtrial for the purpose of initial classification. What this means is that a subtrial that in the usual sense consists of eight different time series, one for each channel, is split into eight different subtrials in our data matrix. This is done with the view that P300 response is present in each of the eight channels considered although it varies in degree and has some phase difference, and that our preprocessing method should be able to get common sources to these responses at different channels. We call these channel subtrials. Once the training of the algorithm is done, and results for the test set are collected for each channel sub trial, these results are aggregated to arrive at a classification for the ’overall’ subtrial. This aggregation is done using a voting method.
The P300 data is generally unbalanced in positive and negative examples, as every trial contains many more negative examples than the positive ones in accordance with the ’odd-ball’ paradigm. This usually tends to bias a classifier in favor of the negative examples. So, an equal number of subtrials of target and non-target EEG were used for these experiments (20 for sub1 and sub2, and 30 for sub3 and sub4).
Experiments were designed to test and compare the various approaches selected for this work with and without PCA. So, the following workflow was followed.
1. Classification performance of the four classifiers—LDA, QDA, LR and NLR—was recorded on the raw data, i.e., the data that has not been transformed with PCA. In this, no feature selection is done, so that all the original features are used.
2. Then classification performance is tested after performing PCA on the data. There are two procedures in this set of experiments—one with forward selection of principal components across all the components, and one where forward selection is done on selected number of top components as per the magnitude of the singular values.
4.1 Without PCA
We start experiments by testing our four methods on the raw data, i.e., the data without PCA transformation for the four subjects. This would serve as a benchmark for the experiments to follow using the PCA. For these experiments and that follow, the following common approach was followed.
1. The datasets were randomly partitioned into training and test sets in the ratio of 80:20. As we consider channel-subtrials as separate subtrials during training and classification before voting, the data was partitioned to ensure we place complete set of 8 channel-subtrials belonging to a subtrial together either in the training or test sets.
2. The algorithms are trained on the data comprising the channel-subtrials, and tested on the test channel-subtrials.
3. The accuracies on the channel-subtrials from the 8 channels are aggregated together using the voting method to decide on the final class of the actual subtrial.
4. The above process is repeated 20 times and the accuracies over the 20 runs are averaged to obtain the final accuracies.
For NLR, the training set was partitioned to create a validation set. The accuracies on the validation set were used to choose the number of hidden units. In the pilot studies on all four subjects, a range of number of hidden units from 2 to the number of features was tested on the validation set. It was observed that the validation accuracies generally were the best at number of hidden units equal to the number of features in the dataset. So, throughout the experiments, number of hidden units for a dataset have been taken as number of features used for classification.
The accuracies obtained on the raw data for the four subjects is shown in Table 1. First thing to note is that QDA did not work for any of the subjects, the problem being that the covariance matrices became singular, that gave a runtime error. So, the accuracies for QDA have been left blank for raw data. The problem of sample covariance matrices being singular occurs when sample size is less than the number of features, which happens to be the case when using QDA on raw data. The same problem was not usually encountered in the case of LDA as the averaging of the sample covariance matrices of the two classes resulted in the average covariance matrix being non-singular. In the subsequent experiments, a small subset of features was always used, which ensured that this problem is not encountered.
Analyzing the results, we observe as generally expected in P300 classification that no single method is the best across all 4 subjects. LR works the best for subjects sub1 and sub4, but NLR also works the best for two subjects sub3 and sub4. It’s only for sub2 that neither of the NN versions, linear and nonlinear, work well. And it is LDA that works the best for sub2. So, across subjects, we can not generalize if linear or nonlinear methods are a clear winner. But for sub1, the performance of the linear version of NN, the LR, is far superior than the other methods. The best accuracies obtained for all the subjects are near 50% which is the expected accuracy for a random classifier for single trials [13, 8] except sub1 which gets a very high accuracy for single trials.
Table 1: Accuracies with all four methods (without PCA)
4.2 With PCA
The next step in our experiments was to use PCA for feature extraction. We start our experiments with PCA by getting the Principal Components (PCs) of the training data using SVD. Then we plot the projection of training data onto first 20 components for each of the four datasets. Looking at these projections, we choose the top 3 PCs through visual inspection—for sub1 these turned out to PCs 2,3, and 4. Projection of sub1 data onto a 3-dimensional subspace of these 3 PCs is shown in Figure 4.1.
After a similar analysis for subjects sub2, sub3 and sub4, we choose the top 3 components for each of them. Then using the chosen three components, we run our classification experiments. The results of these experiments are shown in Table 2.
Table 2: Accuracies for PCA-transformed data using only 3 visually chosen PCs
While this method improved the best accuracy for sub2 and sub4, for sub1 and sub3 the accuracies decreased with almost all the methods. Although the accuracy gains for sub2 and sub4 are impressive, this method is neither scientific nor desirable for a BCI because of its reliance on human intervention and visual judgment. Moreover, there is a limit to the number of PCs that we
Figure 4.1: sub1 data projected on 3-D subspace.
can inspect visually. But, it does show that if we are able to pick the right components, we could get accuracy gains for some subjects.
To make the process of choosing the PCs thorough and to automate the process, we use the method of ’forward selection’ (FS) of the PCs in each of the four algorithms. The forward selection is done using 3-fold cross-validation to choose the PCs that give the best accuracy for the validation set. A new PC is thus added to the set of PCs at each iteration. Finally, the minimal set that gives the best accuracy on the validation set is chosen. As this method is very expensive, we pick and test validation accuracies till only the top 50 components are chosen. This also ensures that data sample size being less than the dimensionality doesn’t give singular covariance matrices in the case of QDA. This method thus iterates through all the PCs at each iteration and picks the best PC at each iteration. The results of this method are shown in table 3.
The results using forward selection of Principal components are not found to be as encouraging as expected. The challenge lies in selecting the number of top components based on the validation accuracies. The method chooses the number of components that give the best validation accuracy, but this doesn’t necessarily work for the test data. The reason for that is the extreme noise in the
Table 3: Accuracies for PCA-transformed data with number of PCs chosen using forward selection(Number of Principal Components in braces)
data due to which the validation set accuracies don’t generalize well to test data. The FS would pick such components that might be modeling the noise of the validation set which obviously will throw the classifier off on the test data. Then there is also over-fitting of training data in the case of non-linear methods as can be seen for NLR. In addition to these problems, there is the matter of complexity and runtime. The FS is a very expensive method as each iteration of choosing a new component has to iterate through all the remaining set of components.
Considering the above pitfalls of the FS method, we need to try a different method for selecting a good subset of PCs. Looking back at the results of using top 3 PCs chosen visually from top 20 components, we try modifying the forward selection algorithm to select the components only from a set of an empirically chosen number, say n, of top PCs based on the magnitude of their singular values. This amounts to just considering the top n PCs as they are ordered already by magnitude of their singular values. As visually chosen 3 components had shown good results for 2 out of 4 subjects, we try n = {5, 10, 15, 20}. After looking at the results thus obtained, it was observed that using n = 5 works the best. The results of using FS on a restricted set of top 5 PCs is shown in table 4.
Table 4: Accuracies for PCA-transformed data choosing the best among only top 5 PCs (Number of Principal Components in braces)
The results obtained using FS on the restricted set of top 5 PCs show an improvement in accuracy for all the four subjects when compared with regular FS. The method gives overall best accuracies for sub2 and sub3. For sub4 also, the accuracy is better than all methods except visual selection of PCs which can be discounted as that’s not a practical method for an online BCI. So, discounting the visual selection method, we get best accuracies for three subjects out of four using this method of restricted FS. In addition, this method comes with greatly reduced data dimensionality. While FS selected as high as 18 PCs, this method needed no more than 4 components to achieve much
better results.
5.1 Summary of Results
As the experiments have shown and as is supported by the literature, the success of a method for P300 classification depends a lot on the subjects. While LR gave exceedingly good results for sub1 without PCA, sub3 had the best accuracy of all the methods with NLR + PCA (with restricted FS). NLR + PCA (with restricted FS) also gave the second best accuracy for sub1 at 60%.
For sub2, on the other hand, it was the linear version of NN—the LR (with restricted FS)—that gave the best accuracy. For sub4 alone, the visually chosen 3 PCs gave the best accuracy. But overall it’s clear that PCA did help in improving the accuracy of classification of single trials in all subjects but sub1. The best results except in the case of sub1 all came with a much reduced dimensionality of data—the dimensionality was a maximum of 4 for all these subjects. So, PCA feature selection not only increased the classification accuracy but also reduced the execution time of the algorithms by the resulting dimensionality reduction.
Among the wider distinction between linear and nonlinear methods, the results were split. While sub1 and sub2 got the best accuracies using linear LR, sub3 and sub4 got the best results with QDA and NLR—both nonlinear methods. The reason for this seems to be different data acquisition methods used for the two datasets. While sub1 and sub2 data was collected with an ISI of 1000ms, data for sub3 and sub4 was collected with an ISI of just 175ms. The short ISI resulted in the overlapping of P300 amplitude of the EEG which happens about 300ms with the new stimulus induced signal, which also explains why the grand average signal for sub3 and sub4 was not as similar to a P300 as it was for sub1 and sub2. The overlapping of signals from many stimuli seems like the reason that makes these two datasets more difficult to be linearly separable. Another observation is that the method of treating each channel-subtrial as a separate subtrial for the purpose of classification works well for P300. The hypothesis of PCA being able to extract the relevant source components from this channel-subtrial dataset is also validated by the results. Also for sub1 and sub2, the PCA captures the variance across channels into a component (it was the first PC for sub1). Then the classifier would ignore that component as it won’t give it any significant discriminatory value for the purpose of classification. Such variance was not that pronounced in the case of sub3 and sub4.
5.2 Future Work
This work has many avenues for future work. As discussed earlier, as the P300 classification depends a lot on the subjects, it would be useful to run these same experiments on data from more subjects to see how well the results generalize across subjects. Then for the same subjects other classification methods especially variants of LDA, such as Fisher’s linear discriminant (FLD), stepwise linear discriminant analysis (SWLDA), and regularized Discriminant Analysis, can be tried to see if the results could be further improved. Another interesting thing to try would be to compare our method of channel-subtrial based data with other methods of data representation in spatio-temporal and frequency domains. Also, the methods used in this work can be studied in more depth. For example, it’s well known that LDA and QDA require a certain minimum number of data samples for optimal performance. It would be interesting to see if and by how much could the performance further improve if more number of samples are used for training the classifiers used in this work. For NLR, we could also try multiple hidden layers to see how that would work for P300 classification.
[1] Bci competition iii challenge 2004 (http://www.bbci.de/competition/iii/desc_ii.pdf).
[2] Brain-computer interfaces laboratory, computer science department, colorado state university, usa (http://www.cs.colostate.edu/eeg/main/data/2011-12_bci_csu).
[3] Butterworth filter design, mathworks (http://www.mathworks.com/help/signal/ref/butter.html).
[4] g.tec g.gammasys active electrode system (http://www.gtec.at/products/electrodes-and- sensors/g.gammasys-specs-features).
[5] Kubler A, Kotchoubey B, Kaiser J, Wolpaw JR, and Birbaumer N. Brain-computer commu- nication: unlocking the locked in. Psychological Bulletin, American Psychological Association, vol 127, pp. 358-375, 2001.
[6] Christopher M. Bishop. Pattern Recognition and Machine Learning. Springer, 2006.
[7] V. Bostanov. Bci competition 2003-data sets ib and iib: feature extraction from eventrelated brain potentials with the continuous wavelet transform and the t-value scalogram. IEEE Trans. Biomed. Eng., vol. 51, pp. 1057-1061, 2004.
[8] Zachary Cashero. Comparison of EEG preprocessing methods to improve the classification of P300 trials, M.S Thesis. Department of Computer Science, Colorado State University, USA, 2011.
[9] Donchin E, Spencer KM, and Wijesinghe R. The mental prosthesis: Assessing the speed of a p300-based brain-computer interface. Rehabilitation Engineering, IEEE Transactions on , vol.8, no.2, pp. 174-179, 2000.
[10] Sellers EW and Donchin E. A p300-based brain-computer interface: Initial tests by als patients. Clinical Neurophysiology 117, pp. 538-548, 2006.
[11] Gene H. Golub and Charles F. Van Loan. Matrix computations (4th ed.). Johns Hopkins University Press Baltimore, MD, USA, 2013.
[12] Mirghasemi H, Fazel-Rezai R, and Shamsollahi MB. Analysis of p300 classifiers in brain com- puter interface speller. In the Proceedings of Conf Proc IEEE Eng Med Biol Soc. 2006;1:6205-8, 2006.
[13] Serby H, Yom-Tov E, and Inbar GF. An improved p300-based brain-computer interface. IEEE Trans Neural Syst Rehabil Eng, vol. 13, pp. 89-98, 2005.
[14] Trevor. Hastie, Robert. Tibshirani, and J Jerome H Friedman. The Elements of Statistical Learning. Springer New York, 2001.
[15] U. Hoffmann, J. Vesin, and T Ebrahimi. Recent advances in brain-computer interfaces. Multimedia Signal Processing, 2007. MMSP 2007. IEEE 9th Workshop on Recent advances in brain-computer interfaces, pp. 17-17, 2007.
[16] M. Kaper, P. Meinicke, U. Grossekathoefer, T. Lingner, , and H. Ritter. Bci competition 2003- data set iib: support vector machines for the p300 speller paradigm. IEEE Transactions on Biomedical Engineering, vol. 51, pp. 1073-1076, 2004.
[17] Michael Kirby. Geometric Data Analysis: An Empirical Approach to Dimensionality Reduction and the Study of Patterns. John Wiley & Sons, 2000.
[18] D. Krusienski, E. Sellers, F. Cabestaing, S. Bayoudh, D. McFarland, T. Vaughan, and J. Wol- paw. A comparison of classification techniques for the p300 speller. Journal of Neural Engineering, vol. 3, no. 4, pp. 299-305, 2006.
[19] D.J. Krusienski, E.W. Sellers, D.J. McFarland, T.M. Vaughan, and J.R. Wolpaw. Toward enhanced p300 speller performance. Journal of Neuroscience Methods, vol. 167, pp. 15-21, 2008.
[20] Farwell LA and Donchin E. Talking off the top of your head: Toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology, vol. 70, Issue 6, pp 510-523, 1988.
[21] Kun Li, Vanitha Narayan Raju, Ravi Sankar, Yael Arbel, and Emanuel Donchin. Advances and challenges in signal analysis for single trial p300-bci. Springer-Verlag, Berlin, pp. 88-94, 2011.
[22] Steven J. Luck. An introduction to the event-related potential technique. MIT Press, Cambridge, USA, 2005.
[23] J. N. Mak, Y. Arbel, J. W. Minett, L. M. McCane, B. Yuksel, D. Ryan, D. Thompson, L. Bianchi, and D. Erdogmus. Optimizing the p300-based brain-computer interface: current status, limitations and future directions. Journal of Neural Engineering, vol. 8, no. 2, 2011.
[24] Martin F. Moller. A scaled conjugate gradient algorithm for fast supervised learning. Neural Networks, vol. 6, pp. 525-533, 1993.
[25] Ernst Niedermeyer and Fernando Lopes da Silva. Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. Lippincott Williams and Wilkins, 2004.
[26] F. Piccione, F. Giorgi, P. Tonin, K. Priftis, S. Giove, S. Silvoni, G. Palmas, and F. Beverina. P300-based brain computer interface: Reliability and performance in healthy and paralysed participants. Clinical Neurophysiology 117, pp. 531-537, 2006.
[27] E.W. Sellers, D.J. Krusienski, D.J. McFarland, and J.R. Wolpaw. Towards brain-computer interfacing. Cambridge, MA: The MIT Press, pp. 31-42, 2007.
[28] Gilbert Strang. Introduction to Linear Algebra, volume 1. Wellesley-Cambridge Press, 2009.
[29] Vaughan TM, Heetderks WJ, Trejo LJ, Rymer WZ, Weinrich M, Moore MM, Kubler A, Dobkin BH, Birbaumer N, Donchin E, Wolpaw EW, and Wolpaw JR. Brain-computer interface technology: A review of the second international meeting. IEEE Transactions on Rehabilitation Engineering, vol. 11(2), pp. 94-109, 2003.
[30] J. R. Wolpaw and D. J. McFarland. Control of a two-dimensional movement signal by a non- invasive brain-computer interface in humans. Proceedings of the National Academy of Sciences of the United States of America, vol. 101(51), pp. 17849-17854, 2004.
[31] Jonathan R. Wolpaw, Niels Birbaumer, William J. Heetderks, Dennis J. McFarland, P. Hunter Peckham, Gerwin Schalk, Emanuel Donchin, Louis A. Quatrano, Charles J. Robinson, , and Theresa M. Vaughan. Brain-computer interface technology: A review of the first international meeting. IEEE Transactions on Rehabilitation Engineering, vol. 8(2), pp. 164-73, 2000.
[32] Jonathan R. Wolpaw, Niels Birbaumer, Dennis J. McFarland, Gert Pfurtscheller, and Theresa M. Vaughan. BrainâĂŞcomputer interfaces for communication and control. Neural Networks, vol. 6(4), pp. 525–533, 1993.
[33] N. Xu, X. Gao, B. Hong, X. Miao, S. Gao, , and F. Yang. Bci competition 2003-data set iib: Enhancing p300 wave detection using ica-based subspace projections for bci applications. IEEE Transactions on Biomedical Engineering, vol. 3, pp. 1067-1072, 2004.
[34] Guoqiang Peter Zhang. Neural networks for classification: a survey. Systems, Man, and Cybernetics, Part C: Applications and Reviews, IEEE Transactions on, vol.30, no.4, pp. 451-462, 2000.