A comparison of methods used to detect changes in neuronal discharge patterns
Introduction
In many neurophysiological studies, there is a need to detect the time of changes in neuronal discharge rates. A number of techniques are available but none is satisfactory. The cumulative sum (CUSUM) technique (Ellaway, 1978) is the most commonly employed method. In our hands (Butler et al., 1992a; Butler et al., 1992b and Forlano et al., 1993), and from anecdotal discussion with workers in other laboratories, this method has the following disadvantages.
The CUSUM technique was originally applied to the analyses of spike trains as a transformation of the peri-stimulus time histogram, and this remains a common use. However, if the histogram is derived from a small number of trials, or even single trials, as is usually the case when recording from `chronic animal' preparations, particular problems arise. For CUSUM to be proficient at detecting a change, there must be only small variation in the discharge interval in the control period. With single trial data from chronic recordings, CUSUM has a high incidence of failing to detect changes that are evident on inspection and requires constant manipulation of various parameters to produce an output that compares with a reasonable expectation based on visual inspection.
Finally, there is an obligatory delay between the time when the changes in neuronal discharge rate actually occurs and the detection of that change by the cusum. This is because the CUSUM must exceed some `window' (e.g. 3 S.D. from the mean discharge rate) before a change is detected. Many laboratories employ a `walk back' to the point that 1 S.D. was crossed. However the latency between the time of change and detection of that change will vary depending on the rate of rise of the CUSUM.
In response to these difficulties we tested our perception that visual inspection was more reliable than CUSUM (Butler et al., 1992a; Butler et al., 1992b). We found each researcher to be consistent in assessment of a range of data and for there to be consistency between researchers. Visual inspection has the advantage that it can detect not only latency of onset of change in state, but also offset, decrease in discharge and increase in discharge, all of which are beyond the capabilities of the CUSUM. However, visual inspection is open to biases, is difficult to quantify and is often discouraged by journal editors.
The aim of this paper was to test whether visual inspection was more reliable than CUSUM and the maximum likelihood method, whether visual inspection was consistent over a range of data and whether a Neural Network could model visual inspection.
Section snippets
Data recording
Activity of motor thalamic neurones (VPLo, area X, VLc, VLps of Olszewski, 1952) was recorded from a monkey (Macaca nemestrina) performing skilled wrist movements in response to a visual cue. This activity was recorded as part of a separate study (Butler et al., 1996). Two neurones whose discharge patterns were clearly related to movement were chosen for this study.
For the purpose of this paper the following description of the recording method follows. Animals were trained to sit quietly with
Detection of latency of change in neuronal discharge rate
For each of the four methods described above, a correlation coefficient (Pearson's r) was calculated between the onset latency obtained with each method and the `standard output'. For the cumulative sum and maximum likelihood, a correlation coefficient with visual inspection was also calculated in order to determine whether results obtained with these methods were better correlated with visual inspection by each one of the observers than with the standard output.
It was found that some analysis
Discussion
This study demonstrates that human observers can reliably detect changes in neuronal discharge and that an artificial Neural Network can reliably model their selection criteria. On the other hand, cumulative sums and maximum likelihood proved to be far less reliable than visual inspection as judged by the high level of agreement between the three observers.
Conclusion
The results from this study suggest that visual inspection is a reliable a method for detecting changes in neuronal discharge rate. It is superior to cumulative sums and maximum likelihood for this purpose. Artificial Neural Networks can reliably model visual inspection. Furthermore they can be successfully applied to the classification of neuronal discharge into discrete states and are worthy of further investigation to apply them to a wider range of neuronal discharge patterns, a larger
References (9)
- et al.
The relationship between monkey ventrolateral thalamic nucleus activity and knimatic parameters of wrist movement
Brain Res
(1996) Cumulative sum technique and its application to the analyses of peristimulus time histograms
Electromyogr Clin Neurophysiol
(1978)- et al.
The activity of monkey thalamic and motor cortical neurones in a skilled, ballistic movement
J Physiol (Lond)
(1992) - et al.
Sensory characteristics of monkey thalamic and motor cortex neurones
J Physiol (Lond)
(1992)
Cited by (18)
Evidence of multistability in a realistic computer simulation of hippocampus subfield CA1
2009, Behavioural Brain ResearchA nonparametric approach for detection of bursts in spike trains
2007, Journal of Neuroscience MethodsDetecting neuronal activity changes using an interspike interval algorithm compared with using visual inspection
2006, Journal of Neuroscience MethodsAutomatic detection of bursts in spike trains recorded from the thalamus of a monkey performing wrist movements
1999, Journal of Neuroscience MethodsUse of cumulative sum (CUSUM) test for detecting abrupt changes in the process dynamics
2007, International Journal of Reliability, Quality and Safety Engineering