Skip to main content

Augmented reality-based electrode guidance system for reliable electroencephalography

Abstract

Background

In longitudinal electroencephalography (EEG) studies, repeatable electrode positioning is essential for reliable EEG assessment. Conventional methods use anatomical landmarks as fiducial locations for the electrode placement. Since the landmarks are manually identified, the EEG assessment is inevitably unreliable because of individual variations among the subjects and the examiners. To overcome this unreliability, an augmented reality (AR) visualization-based electrode guidance system was proposed.

Methods

The proposed electrode guidance system is based on AR visualization to replace the manual electrode positioning. After scanning and registration of the facial surface of a subject by an RGB-D camera, the AR of the initial electrode positions as reference positions is overlapped with the current electrode positions in real time. Thus, it can guide the position of the subsequently placed electrodes with high repeatability.

Results

The experimental results with the phantom show that the repeatability of the electrode positioning was improved compared to that of the conventional 10–20 positioning system.

Conclusion

The proposed AR guidance system improves the electrode positioning performance with a cost-effective system, which uses only RGB-D camera. This system can be used as an alternative to the international 10–20 system.

Background

Electroencephalography (EEG) is a neuroimaging technique that is frequently used to measure the neural activity in the brain. The standardized positioning of electrodes is essential in longitudinal EEG studies to minimize the test–retest and inter-examiner variability [1, 2] because even a small positioning error on the scalp can cause large changes in the measured electric potentials [1]. Thus, it is necessary to maintain consistent electrode locations over long-term trials to facilitate reliable EEG assessments.

Several studies have been proposed to reproducibly position EEG electrodes. The international 10–20 system is the de-facto standard electrode-positioning method, which relies on the manual identification of four anatomical landmarks [3]. Several approaches were proposed using the anatomical landmarks of the international 10–20 system. Echallier and Perrin [4] proposed a computer-assisted electrode-positioning system. An ultrasonic digitizer was used to define a reference coordinate system based on the aforementioned four anatomical landmarks. Giacometti et al. [2] developed a cap for the standard electrode positioning, which enabled the measurement of both EEG and functional near-infrared spectroscopy (fNIRS). The cap was placed using the 10–10 system, which is an expanded version of the international 10–20 system. Tsuzuki et al. [5] proposed the MinR 10–20 system that used landmarks of nasion, right and left preauricular points and posterior point on the occipital protuberance. Xiao et al. [6] proposed a semi-automatic 10–20 identification method using the virtual 10–20 landmark determination in the computational space of reconstructed head surface. The virtual landmarks were identified using a visually guided navigation system, which used a magnetic digitizer.

These systems require manual identification of anatomical landmarks prior to the electrode positioning. Thus, they potentially include non-negligible human error because of the structural ambiguity of anatomical landmarks [7, 8].

To address this issue, Jeon and Chien [9] proposed a preliminary study for precise image-guided electrode placement. A vision-based position tracker and a laser scanner were used for electrode guidance. Based on the serial coordinate registration, without the manual 10–20 landmarks identification, precise electrode repositioning was demonstrated. In this study, a simple electrode-positioning system was proposed using an augmented reality (AR) visualization technique. Since the proposed method can support real-time registration using the face surface, it did not require the fiducials for the registration or a reference marker attached to the subject’s body.

A phantom study was conducted to evaluate the effectiveness of the proposed system compared with that of the international 10–20 system. Although several studies have examined AR visualization [10,11,12], to the best of the authors knowledge, this is the first EEG study to utilize an AR visualization technique for precise electrode positioning.

Methods

The international 10–20 system is a standard EEG electrode-positioning method, which is generally adopted in related fields [3, 7, 13,14,15]. Four landmarks are manually identified by clinicians for electrode positioning with the international 10–20 system: nasion, inion, and left/right preauricular points. The midline that connects the nasion to the inion and the central line that connects the left preauricular point to the right preauricular point are subsequently measured. Anterior–posterior planes and central coronal planes based on the two reference lines are determined. The electrodes are placed on lattice points, which are defined as intersections of the planes on the scalp at 10 and 20% intervals [3].

However, an unreliable EEG assessment can be generated by individual variations in positioning electrodes. To solve this problem, an AR-based electrode guidance system was developed. AR is a technique to superimpose a virtual object onto a real object [16]. In medical imaging, AR is used to visualize the medical information superimposed on the patients image. For example, in surgical navigation, the patients risk factors and target organ can be provided to the surgeon via AR during the surgery [17,18,19]. In this study, we visualize the electrode location using AR and improve the repeatability of the EEG electrode placement in the long-term EEG study.

Several techniques are essential for the AR environment, including marker tracking, tracker-camera calibration, and patient-to-image registration [20, 21]. In this study, an RGB-D camera (Realsense f200, Intel, California, USA) is used as the tracker. 3D point data of the subjects surface including a head and a face is acquired using the RGB-D camera and used for the surface registration. Since the RGB-D camera coordination is defined with respect to the subjects facial surface, the transformation between the current RGB-D camera coordination and the pre-acquired RGB-D camera coordination is calculated through the surface registration. Therefore, without using an optical tracking system or external marker, the positions of the initially placed electrodes (pre-acquired RGB-D image) are superimposed on the patients head (current RGB-D image) with respect to the subjects facial surface.

System overview

The proposed system uses an RGB-D camera to scan the electrodes and anatomical features. Specifically, a Realsense camera software development kit was used to interface the RGB-D camera and acquire the scanned 3D points. A visualization toolkit and a point cloud library were used to visualize the processed data and handle the 3D points, respectively [22]. The software was executed in a workstation equipped with an Intel Core i7 CPU, 32 GB RAM, and NVIDIA GeForce GTX 970 GPU.

System workflow

The workflow of the proposed system for electrode guidance is shown in Fig. 1, which consists of an initial scan and electrode guidance steps.

Fig. 1
figure 1

Workflow of the proposed electrode guidance system. In the initial scan step, \(A_{0}\) is the coordinate system of initial scan data, \(A_{i}\) is the current scanning coordinate system with an index of surface registration, i. By real-time surface registration, the transformation between the initial coordinate system and the current coordinate system is updated

Initial scan step

An electrode cap is initially positioned on the subjects head using the international 10–20 system. The head, including the facial surface and electrodes, is scanned using the RGB-D camera. Next, the facial surface and electrodes are separately segmented using an open-source software program (CloudCompare, France). The facial surface is used for surface registration, and the electrodes are used to set the initial electrode locations in the electrode guidance setup, which is visualized using AR.

Electrode guidance step

The subsequently placed electrodes are repositioned according to the AR guidance without using the international 10–20 system. To simultaneously track the facial surface of the subject and implement AR visualization, the scanning and registration should be processed in real time. More details on surface registration are described in the real-time surface registration section. The AR visualization simultaneously superimposes the initial electrode position over the current position current electrode position. Thus, the clinician can place the current electrodes at the position of the initially placed electrodes with high repeatability.

Real-time surface registration

To implement AR visualization with respect to the facial surface of the subject, the surface registration between the initial facial surface and the current scanning data is repeatedly performed. The surface registration is performed by using the iterative closest point (ICP) algorithm. The ICP algorithm solves for a transformation from the target to source coordinate systems using the surface data [23, 24]. In the proposed system, the initial facial surface, which is acquired from the initial scan step, is used as the source data, and the current scanning data are used as the target data. Although the initial and current scan data from the RGB-D camera are actually defined on the same coordinates, which are the image coordinates, they are separated into two different sets of coordinates: initial scan data and current scanning data coordinates. During the surface registration, the transformation between the coordinates of the initial scan data and current scanning data is continuously calculated, as shown in Fig. 1. For the real-time surface registration, the transformation of the prior registration result is used to update the initial facial surface, and the surface registration is processed between the updated initial facial surface and the current facial surface. The ICP-based surface registration is used to update the transformation, \(T_{A_{{i}\,-\,{1}}}^{A_{i}},\) which denotes a relationship between the current scan coordinate system and the initial scan coordinate system.

$$\begin{aligned} T_{A_{0}}^{A_{i}} = T_{A_{0}}^{A_{{i}\,-\,{1}}}\, T_{A_{{i}\,-\,{1}}}^{A_{i}}, \end{aligned}$$
(1)

where \({A_{0}}\) is the coordinate system of the initial scan data, \({A_{i}}\) is the current scanning coordinate system, and \(A_{{i}\,-\,{1}}\) is the previously updated initial coordinate system. To avoid the local minima problem and reduce the time taken for the ICP-based surface registration, \(T_{A_{0}}^{A_{{i}\,-\,{1}}}\) is used for the initial alignment.

The final transformation is applied; thus, the initial scan with respect to \({A_{0}}\) is transformed to \({A_{i}}\), as shown in Eq. (2):

$$\begin{aligned} {}_{}^{A_{i}}{\rho } = T_{A_{0}}^{A_{i}}\, {}_{}^{A_{0}}{\rho }, \end{aligned}$$
(2)

where \({}_{}^{A_{i}}{\rho }\) and \({}_{}^{A_{0}}{\rho }\) denote the updated initial electrode position data and initial electrode position data, respectively. During the surface registration, an ICP algorithm is continuously performed with more than 10,000 corresponding points, so a heavy computational cost entails. When scanning and surface registration are serially processed, the updating rate of the display is significantly reduced. Thus, we executed scanning and surface registration in parallel, as shown in Fig. 2, to increase the updating rate.

Fig. 2
figure 2

Pipeline of real-time surface registration

Experimental setup

Electrode positioning experiments were performed to verify the repeatability of the proposed electrode guidance system. The experimental setup to measure the electrode positioning error is shown in Fig. 3a. A commercial electrode cap with 64 channels (actiCAP, Easycap, Herrsching, Germany) was used. A head phantom including four anatomical landmarks was used as a subject for repeated trials (60 times).

Fig. 3
figure 3

a Experimental setup for the electrode positioning evaluation. b Labelled red target electrodes on an EEG cap. c Electrode guidance display (left) during and (right) after the positioning

Ten target electrodes were labelled on the EEG cap to measure the positioning error: AF3, AF4, FC3, FCz, FC4, CP3, CPz, Cp4, PO3, and PO4, as shown in Fig 3b. To measure the 3D coordinates of the electrode position, an optical tracking system (OTS) (Polaris Vicra, Northern Digital Inc., Waterloo, Canada) was used with a high tracking accuracy (root mean square 0.35 mm). An OTS marker was attached to the phantom to track the head phantom. The electrode positions with respect to the OTS marker on the phantom were acquired using a hand-held OTS probe. The OTS marker on the phantom was fixed and used as a reference coordinate system during the experiment. Three participants were involved in the experiment to place the electrode cap on the phantom. The initial positioning of electrodes was performed using the international 10–20 system, and the initial positions of the electrodes were used as the gold standard to calculate the positioning error. Then, each participant repositions the electrode cap 10 times using the proposed system and international 10–20 system. When the proposed system is used, an AR image of the initial electrode positions is shown, as shown in Fig. 3c. The positioning error is calculated for the 10 pre-defined electrode locations as follows:

$$\begin{aligned} Positioning\;error = \left| \left| {p}-{p'}\right| \right| \end{aligned}$$
(3)

where ||.|| denotes an absolute value, p denotes the coordinates of the measured target points from the electrode positioning methods such as the proposed method and conventional method, and \(p'\) is the gold standard electrode positions.

Results

Electrode positioning error

In the phantom study, the positioning error of the proposed system was compared with that of the international 10–20 system. The mean positioning error was 1.8 ± 1.06 mm for the proposed system and 3.24 ± 1.78 mm for the international 10–20 system. Figure 4 shows a comparison of the positioning errors at each target electrode. Both mean and standard deviation of all target positioning errors from the proposed system were smaller than those of the conventional system. In particular, the errors measured at the electrodes located on the frontal scalp, i.e., AF3, AF4, FC3, and FCz, were smaller than those measured at the relatively posterior electrodes. The results indicate that the repeatability of electrode positioning using the international 10–20 system is unreliable because of the individual variations of each clinician to locate electrodes, whereas the repeatability is improved in the proposed system.

Fig. 4
figure 4

Comparison of positioning error at each target electrode between the proposed system and the 10–20 system

A statistical analysis was performed using the OriginLab software (OriginPro 2015, Northampton, Massachusetts, USA). Kolmogorov–Smirnov normality test at the 0.001 significance level demonstrates that both experimental results were drawn from a normally distributed population. The independent t-test indicates that the positioning error of the proposed system is significantly different from that of the international 10–20 system (p < 0.001), as shown in Fig. 5.

Fig. 5
figure 5

Comparison of overall positioning error between the proposed system and the 10–20 system

Real-time registration performance

The registration error and computational time were measured over 50 times to evaluate the performance of the real-time surface registration throughout the experiments. The mean registration error was 0.37 mm, and the mean registration time was 0.16 s, which is equivalent to 6.25 frames/s with respect to the update rate of the display.

Discussion

In the proposed system, the surface registration is performed for AR visualization. The parallel pipeline enables one to visualize the scanning data that represent the initial electrode position in real time despite the high computational cost of the ICP. However, the ICP surface registration was performed with a single parameter condition throughout the experiments, which included the point-to-point error metric and uniform data sampling. Therefore, more investigations on the registration accuracy and resultant positioning precision with different parameter conditions are required.

Considering the system configuration, the conventional 10–20 positioning systems is simple and inexpensive, but an unreliable electrode positioning can occur from the manual identification of the anatomical landmarks [7, 8, 13,14,15]. To address this issue, an extra device such as a vision-based position tracker, a commercial ultrasonic digitizer or a magnetic digitizer has been used so far [4, 6, 9]. Compared to those system, only an RGB-D camera is necessary in the proposed system. An RGB-D camera is more cost-effective than a tracker or digitizer, and additional accessories are not required.

To verify the proposed system, three participants performed the experiments in 30 trials. Although the number of participants is small, our main concern is to address the inter-session variation issue. In a longitudinal EEG study, the manual identification of the anatomical landmarks can cause inter-session variations. The experiment focused on verifying the improvement in repeatability of the electrode positioning at each participant.

In the phantom study, the proposed system exhibited a smaller positioning error than the conventional system. The improved positioning precision is attributed to the exclusion of human error and the use of morphologically invariant anatomical surface information scanned by the RGB-D camera. In other words, the proposed system reduces the ambiguity of anatomical landmarks for electrode positioning. Conversely, the positioning errors measured in the frontal-scalp-located electrodes are smaller than those of the posterior-scalp-located electrodes. This tendency can result from the narrow field of view (FOV) of the RGB-D camera. The narrow FOV enables the proposed system to only guide the electrodes within the FOV.

The electrodes on the elastic EEG cap, which were used in the study, are also not rigidly fixed with respect to one another. Unexpected changes in their relative positions during the guidance can yield inaccurate positioning with respect to the electrodes that are not directly guided by the AR system. If a non-elastic EEG cap is used in the proposed system, the accuracy can be improved. The use of a stereo or multi-RGB-D camera system can also improve the accuracy of the proposed system.

Conclusion

In this study, an electrode guidance system with high repeatability of electrode positioning was proposed based on the AR visualization. The experimental results indicate that the proposed system outperforms the conventional methods in terms of repeatability. We also improved the performance with a cost-effective system by using only an RGB-D camera. Although the performance of the proposed system is limited by the narrow FOV and relatively low image resolution of the adopted RGB-D camera, this problem can be solved by using a high-resolution stereo camera system. We expect that the concept of the proposed system will be applied for standard EEG studies and similar applications such as a near-infrared spectroscopy measurement.

Abbreviations

EEG:

electroencephalography

fNIRS:

functional near-infrared spectroscopy

AR:

augmented reality

ICP:

iterative closest point

OTS:

optical tracking system

FOV:

field of view

References

  1. Atcherson SR, Gould HJ, Pousson MA, Prout TM. Variability of electrode positions using electrode caps. Brain Topogr. 2007;20:105–11.

    Article  Google Scholar 

  2. Giacometti P, Diamond SG. Compliant head probe for positioning electroencephalography electrodes and near-infrared spectroscopy optodes. J Biomed Opt. 2013;18:027005.

    Article  Google Scholar 

  3. Klem GH, Luüders HO, Jasper H, Elger C. The ten-twenty electrode system of the International Federation. Electroencephalogr Clin Neurophysiol. 1999;52:3–6.

    Google Scholar 

  4. Echallier J, Perrin F, Pernier J. Computer-assisted placement of electrodes on the human head. Electroencephalogr Clin Neurophysiol. 1992;82:160–3.

    Article  Google Scholar 

  5. Tsuzuki D, Watanabe H, Dan I, Taga G. Minr 10/20 system: quantitative and reproducible cranial landmark setting method for MRI based on minimum initial reference points. J Neurosci Methods. 2016;264:86–93.

    Article  Google Scholar 

  6. Xiao X, Zhu H, Liu WJ, Yu XT, Duan L, Li Z, Zhu CZ. Semi-automatic 10/20 identification method for MRI-free probe placement in transcranial brain mapping techniques. Front Neurosci. 2017;11:4.

    Article  Google Scholar 

  7. Jurcak V, Tsuzuki D, Dan I. 10/20, 10/10, and 10/5 systems revisited: their validity as relative head-surface-based positioning systems. Neuroimage. 2007;34:1600–11.

    Article  Google Scholar 

  8. Koessler L, Maillard L, Benhadid A, Vignal J-P, Braun M, Vespignani H. Spatial localization of EEG electrodes. Neurophysiol Clin. 2007;37:97–102.

    Article  Google Scholar 

  9. Jeon S, Chien J, Song C, Hong J. A preliminary study on precision image guidance for electrode placement in an EEG study. Brain Topogr. 2018;31:174–85.

    Article  Google Scholar 

  10. Mahmoud N, Grasa ÓG, Nicolau SA, Doignon C, Soler L, Marescaux J, Montiel J. On-patient see-through augmented reality based on visual SLAM. Int J Comput Assist Radiol Surg. 2017;12:1–11.

    Article  Google Scholar 

  11. Lee JD, Huang CH, Huang TC, Hsieh HY, Lee ST. Medical augment reality using a markerless registration framework. Expert Syst Appl. 2012;39:5286–94.

    Article  Google Scholar 

  12. de Farias Macedo MC, Junior ALA. Improving on-patient medical data visualization in a markerless augmented reality environment by volume clipping. In: 2014 27th SIBGRAPI conference on graphics, patterns and images (SIBGRAPI). New york: IEEE; 2014. p. 149–56.

  13. Lagerlund TD, Sharbrough FW, Jack CR, Erickson BJ, Strelow DC, Cicora KM, Busacker NE. Determination of 10–20 system electrode locations using magnetic resonance image scanning with markers. Electroencephalogr Clin Neurophysiol. 1993;86:7–14.

    Article  Google Scholar 

  14. He P, Estepp JR. A practical method for quickly determining electrode positions in high-density EEG studies. Neurosci Lett. 2013;541:73–6.

    Article  Google Scholar 

  15. Giacometti P, Perdue KL, Diamond SG. Algorithm to find high density EEG scalp coordinates and analysis of their correspondence to structural and functional regions of the brain. J Neurosci Methods. 2014;229:84–96.

    Article  Google Scholar 

  16. Azuma R, Baillot Y, Behringer R, Feiner S, Julier S, MacIntyre B. Recent advances in augmented reality. IEEE Comput Graph Appl. 2001;21:34–47.

    Article  Google Scholar 

  17. Shahidi R, Bax MR, Maurer CR, Johnson JA, Wilkinson EP, Wang B, West JB, Citardi MJ, Manwaring KH, Khadem R. Implementation, calibration and accuracy testing of an image-enhanced endoscopy system. IEEE Trans Med Imaging. 2002;21:1524–35.

    Article  Google Scholar 

  18. Oka M, Cho B, Matsumoto N, Hong J, Jinnouchi M, Ouchida R, Komune S, Hashizume M. A preregistered STAMP method for image-guided temporal bone surgery. Int J Comput Assist Radiol Surg. 2014;9:119–26.

    Article  Google Scholar 

  19. Fuchs H, Livingston MA, Raskar R, Keller K, Crawford JR, Rademacher P, Drake SH, Meyer AA. Augmented reality visualization for laparoscopic surgery. In: International conference on medical image computing and computer-assisted intervention. New York: Springer; 1998. p. 934–43.

  20. Choi H, Cho B, Masamune K, Hashizume M, Hong J. An effective visualization technique for depth perception in augmented reality-based surgical navigation. Int J Med Robot Comput Assist Surg. 2016;12:62–72.

    Article  Google Scholar 

  21. Zitova B, Flusser J. Image registration methods: a survey. Image Vis Comput. 2003;21:977–1000.

    Article  Google Scholar 

  22. Rusu RB, Cousins S. 3d is here: point cloud library (pcl). In: 2011 IEEE international conference on robotics and automation (ICRA). New York: IEEE; 2011. p. 1–4.

  23. Salvi J, Matabosch C, Fofi D, Forest J. A review of recent range image registration methods with accuracy evaluation. Image Vis Comput. 2007;25:578–96.

    Article  Google Scholar 

  24. Besl PJ, McKay ND. A method for registration of 3-D shapes. IEEE Trans Pattern Anal Mach Intell. 1992;14:239–56.

    Article  Google Scholar 

Download references

Authors’ contributions

CS designed and implemented the system of electrode guidance, and performed the data acquisition. SJ, SL and HH supported the system development. JK contributed to the experiments. JH designed and supervised the overall process of this study and highly contributed to the discussion of the results. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank all participants for the evaluation experiments in this study.

Competing interests

The authors declare that they have no competing interests.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Funding

This study was supported by the DGIST R&D Program of the Ministry of Science, ICT and Future Planning (18-BD-0401). This work was supported, in part, by the Health and Medical R&D Program of the Ministry of Health and Welfare of Korea (HI13C1634).

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jaesung Hong.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Song, C., Jeon, S., Lee, S. et al. Augmented reality-based electrode guidance system for reliable electroencephalography. BioMed Eng OnLine 17, 64 (2018). https://doi.org/10.1186/s12938-018-0500-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12938-018-0500-x

Keywords