1. Introduction
Magnetoencephalography (MEG) [
1] measures the magnetic fields generated by neural activity, offering high temporal and spatial resolution for studying brain dynamics, compared to functional magnetic resonance imaging and electroencephalography, respectively. Superconducting quantum interference device (SQUID)-MEG has been widely used for decades because of its high sensitivity. SQUID sensors require cryogenic cooling to detect subtle magnetic signals like 100 femtotesla. These sensors are kept in a fixed position within a dewar, which is filled with cryogens, typically at approximately 4 K. The need for large and rigid dewars to maintain cryogenic conditions often results in a sensor-to-scalp distance of 2–3 cm, which weakens the measured signal. The increased distance reduces the signal–to–noise ratio (SNR), potentially degrading the spatial resolution of source localization.
Over the past decade, improvements in laser stability, vapor-cell fabrication, and magnetic shielding have improved the practicality of optically pumped magnetometers (OPMs) for on-scalp MEG. By 2010, prototype OPM-MEG systems emerged, including wearable arrays that allow free-head movement, positioning this technology as an alternative or complement to SQUID-MEG [
2,
3]. OPM technology offers a more cost-effective and wearable solution, unlike the SQUID system, which relies on costly and volatile cryogen supply chains. As OPM sensors operate without cryogens, they can be positioned closer to the scalp, reducing the sensor-to-scalp distance and accounting for the head movements of individuals. Additionally, OPM systems feature a flexible sensor layout, allowing optimized sensor placement for specific head regions of interest. The bulky dewar helmet of SQUID systems limits participant movement, posing challenges for studies involving children, clinical populations with movement disorders, and motion-dependent experiments. Rapid advancements in OPM technology have expanded biomagnetic applications, including MEG applications [
4].
This study compares the two technologies crucial for advancing MEG applications in both research and clinical practice. A hardware-level comparison presents significant challenges, as it requires acquiring data under identical conditions while accounting for the unique capabilities of each system. Key factors include environmental noise and physiological brain activity, which may introduce artifacts unrelated to the task. Since these systems share the same purpose but use different underlying technologies, an effective comparison requires identifying a transformation that captures the strength of each technology and allows for comparison within a common framework.
1.1. Comparison Studies on SQUID-MEG and OPM-MEG Systems
Several studies have explored the comparison between SQUID-MEG and OPM-MEG systems. For instance, Hill et al. built whole-head OPM systems that provide whole-head coverage [
5]. The authors used a visuo-motor paradigm, acquiring data from their constructed 49-sensor helmet using both flexible and rigid helmets. The same paradigm was also recorded using a SQUID-MEG system with 275 gradiometers. Each participant underwent 18 scans, and the comparison was performed using the beamformer-based source reconstruction approach. Several metrics were used to evaluate sensor-space data, source-space reconstructed images, and source-space time series of neuronal activity. Marhl et al. recently compared the SQUID-MEG and OPM-MEG data of auditory-evoked fields [
6,
7]. Their study proposed a method for transforming data between MEG systems by computing the forward model of one system and applying it to the inverse problem of a second system. Unlike Hill et al. [
5], who focused on source-space analysis, Marhl et al. [
6] used the sensor space. Additionally, Nugent et al. performed a comparison based on simulation [
8].
1.2. Phantom-Based Studies
To quantitatively evaluate the MEG system performance, we developed a dry phantom that simulates neuronal activity in the human brain [
9]. This phantom comprises 50 triangular coils that generate small currents analogous to human brain dipole currents, known as equivalent current dipoles (ECDs). Analyzing the measured data from these coils allows for evaluating source localization accuracy and validating technological advancements in MEG systems [
10,
11]. Furthermore, multiple phantom-based MEG studies have demonstrated advanced data processing and localization methods. Multi-dipole phantoms, global-to-local optimization algorithms, and empirical mode decomposition have enhanced inverse solutions under challenging conditions [
12,
13,
14]. Several phantom experiments have also addressed specialized scenarios, including deep brain stimulation hardware interference and deeper or more complex source configurations, demonstrating the adaptability of MEG with proper artifact suppression and modeling [
15,
16]. Finally, integrating anatomical imaging into phantom experiments significantly reduces registration errors and enhances the overall localization accuracy, confirming the importance of structural–functional alignment in MEG performance evaluation [
17,
18]. Recently, OPMs have demonstrated substantial potential alongside traditional SQUIDs. These innovations were validated in controlled phantom experiments, as highlighted by Ito et al. [
19]. Boto et al. [
20] explored a triaxial OPM capable of measuring the full three-dimensional vector of neuromagnetic fields. This system was validated through wet phantom dipole simulations and in vivo measurements, exhibiting high precision with a minimal source-localization error of 5.17 mm. More recently, Bardouille et al. evaluated a cylindrical-shielded OPM-MEG system using a dry phantom, demonstrating that this system achieves approximately 3 mm localization error without significant bias, comparable to cryogenic SQUID and other OPM-MEG systems [
21].
1.3. Motivation and Study Outline
This study is driven by the effectiveness of phantom-based approaches in measuring MEG system performances, alongside the absence of a hardware-focused comparison of SQUID and OPM systems. We propose a comparison framework in a highly controlled setup between SQUID-MEG and OPM-MEG systems to address this gap, employing a dry phantom as described in [
9], owing to its well-characterized geometry and metallic conductivity which ensures greater measurement certainty than a wet phantom. A wet phantom provides a more human-like brain model, which introduces more uncertainty, as measuring the electric current path is more challenging. As this study focuses on the hardware-centric comparison of SQUID-OPM technologies, a dry phantom provides more reliable and controlled environments. As mentioned in [
22], insulating structures within a wet phantom can distort volume currents near the dipole, potentially compromising their effectiveness for absolute calibration. This is particularly problematic when the phantom is the ground truth for assessing source localization accuracy. Our primary objective is to compare SQUID-MEG and OPM-MEG systems while minimizing confounding factors, including non-task-related brain activity like eye movements and cardiac artifacts, shielding properties of the magnetically shielded room (MSR), and noise from nearby equipment or infrastructure, especially when the systems are not co-located. We eliminated subject variability and physiological artifacts by employing a carefully designed coil-based phantom to address these issues, ensuring consistency across the SQUID-MEG and OPM-MEG measurements. Additionally, we standardized environmental conditions by acquiring data for both systems within the same MSR on the same day, thereby controlling external noise. Moreover, this framework enables quantitative validation by establishing a ground-truth benchmark that can be applied to various MEG setups, including those from different manufacturers worldwide.
This paper is organized as follows:
Section 2 details the methodology for comparing SQUID-MEG and OPM-MEG systems using phantom-based measurements and analyzing the acquired data.
Section 3 presents the results, focusing on source localization accuracy by comparing calibrated and source-reconstructed ECDs. Finally,
Section 4 and
Section 5 discuss the results, concluding and drawing future perspectives.
3. Results
Figure 7 shows the recorded waveforms with the current amplitude
Ia of 10 µA after applying a high-pass filter and averaging.
Figure 7a shows data recorded by the SQUID-MEG system.
Figure 7b,c display data from the OPM-MEG system with the closest and lift-off positions, respectively. Each graph contains overlapping waveforms corresponding to individual sensors—202 and 90 waveforms for the SQUID- and OPM-MEG systems, respectively. The right column provides a magnified view of a specific time window from the corresponding graphs in the left column, focusing on the signals recorded during the activation of ECD44 to ECD49. As shown in these graphs, the signal from coil 50 disappeared because of accidental damage to its wiring. The sinusoidal waveforms generated by the remaining coils were obtained. The maximum amplitude of the observed signals was approximately 2.2 pT, 6.6 pT, and 1.7 pT in
Figure 7a,
Figure 7b, and
Figure 7c, respectively.
As described in
Section 2.3, all the measurements were completed in a day. To confirm the consistent environmental magnetic noise, we compared the magnetic noise recorded by the SQUID magnetometers simultaneously with the phantom signal shown in
Figure 7. A 3-axis SQUID vector magnetometer [
30] located 250 mm away from the top of the SQUID gradiometers was selected from the 16-channel SQUID magnetometers installed in the SQUID-MEG system. The noise spectra presented in
Figure 8 were obtained as the mean of the 3-channel SQUID magnetometers during the measurement.
Figure 8a–c correspond to those in
Figure 7. The noise trend of
Figure 8b, recorded during the OPM-MEG measurement at the closest sensor position, is slightly higher than that of the others below 1 Hz. This increase is presumed to be caused by the movement of magnetic objects, such as cars or elevators. However, this difference is considered negligible because we applied the high-pass filter before analyzing the data of the phantom measurements. No noticeable differences above 1 Hz were observed across the measurements, despite an approximately 5 h interval between the first and last recordings.
Figure 9 shows the magnetic field distribution generated by ECD49, located at the top of the phantom, with the current amplitude
Ia of 10 µA. The small circles in this figure indicate the relative positions of the sensors. The positive (+) and negative (−) signs are defined as outward and inward orientations, respectively. The data analysis timing corresponds to the first peak of the sinusoidal wave.
Figure 9a–c correspond to those in
Figure 7. A dipole pattern appears in all the datasets, but the magnetic field distribution differs noticeably. The area where the magnetic signal is observed expands in the order of
Figure 9a–c. Furthermore, the distance between the sensors detecting the maximum and minimum signals varies.
Figure 10 shows the source localization error defined as the displacements between the effectual and estimated ECD positions with the current amplitude
Ia of 10 µA and 100 µA. Since coil 50 was disconnected during the recordings, the height of the squares and the length of the error bars indicate the mean and expanded uncertainty, respectively, with a coverage factor of two across 49 ECDs. Comparing the results at the current amplitude, the source localization error with
Ia = 100 µA is smaller than that with
Ia = 10 µA across all the sensor arrangements. The source localization error with
Ia = 10 µA increases in the order of
Figure 10a–c.
Figure 7.
Butterfly plot of recorded signals from SQUID- and OPM-MEG sensors during the activation of the triangular phantom coils (ECD 1–49): (
a) SQUID-MEG system; (
b) OPM-MEG system (closest position); (
c) OPM-MEG system (lift-off position). The arrows indicate the analysis timing for ECD 49 as represented in
Figure 9.
Figure 7.
Butterfly plot of recorded signals from SQUID- and OPM-MEG sensors during the activation of the triangular phantom coils (ECD 1–49): (
a) SQUID-MEG system; (
b) OPM-MEG system (closest position); (
c) OPM-MEG system (lift-off position). The arrows indicate the analysis timing for ECD 49 as represented in
Figure 9.
Figure 8.
Noise spectra recorded by the SQUID magnetometers simultaneously with the phantom measurements using (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position).
Figure 8.
Noise spectra recorded by the SQUID magnetometers simultaneously with the phantom measurements using (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position).
Figure 9.
Magnetic field distribution from the 49th ECD recorded by each sensor configuration: (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position). Small circles indicate the relative position of the sensors.
Figure 9.
Magnetic field distribution from the 49th ECD recorded by each sensor configuration: (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position). Small circles indicate the relative position of the sensors.
Figure 10.
Source localization error defined as the displacement between the effectual and estimated ECD positions: (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position).
Figure 10.
Source localization error defined as the displacement between the effectual and estimated ECD positions: (a) SQUID-MEG system; (b) OPM-MEG system (closest position); (c) OPM-MEG system (lift-off position).
4. Discussion
As described in
Section 1, an advantage of OPM sensors is their ability to detect greater signal amplitude when positioned closer to the signal source. Comparing the two OPM sensor arrangements, the closest and lift-off positions, the observed signal amplitude in
Figure 7b was approximately four times greater than that in
Figure 7c. According to the Sarvas formula, the observable magnetic signal intensity is proportional to
d−2, where
d is the distance between the signal source and the observing point. The mean distances between each OPM sensor to the center of the conductive sphere model, indicated as circles and squares in
Figure 5, were 90.1 and 114.3 mm in
Figure 5b and
Figure 5c, respectively. Assuming that the ECDs in the phantom were distributed on the surface of the sphere with a radius of 65 mm, the mean distances between the ECDs and OPM sensors were derived as 25.1 and 49.3 mm, respectively. The sensor-to-source distance and signal intensity relationship aligned well with the Sarvas formula. These findings, therefore, demonstrate the advantage of using OPM sensors.
Compared to the SQUID-MEG system, the OPM-MEG system recorded signal amplitudes up to three times higher, as shown in
Figure 7. The mean distance between the ECDs and SQUID sensors was 54.6 mm, calculated by the method described above. The observed signal amplitude and sensor-to-source distance between the two MEG systems do not simply follow the
d−2 proportionality because of structural differences; SQUID sensors use first-order axial gradiometers. Therefore, the waveform and magnetic field distributions differ between
Figure 7a,b and
Figure 9a,b. In the SQUID-MEG system, strong signals were detected near the signal source (
Figure 8) because the gradiometer suppressed distant signals. Besides the increased signal amplitude from closer OPM sensor placement, it was found that the ratio of sensors detecting strong signals increased when using non-gradiometric detection sensors.
However, the estimated ECD displacement measured by the OPM-MEG system with the closest sensor position (3.48 ± 0.58 mm) in
Figure 10b was larger than that measured by the SQUID-MEG system (1.07 ± 0.17 mm) in
Figure 10a, despite the higher detected signal amplitude when the sensors were closer to the sources.
Several factors beyond signal intensity can limit source localization accuracy in MEG measurements. This study examined three major factors: SNR, the number of sensors used for localization, and the spatial coverage provided by the sensor array of the source signal.
First, the SNR is crucial to source estimation error. To investigate this relationship, we conducted recordings using a phantom signal with a ten-fold increase in applied current (100 µA) to increase the SNR in addition to the recording at 10 µA generating an ECD moment intensity emulating neuronal activity in the human brain. As shown in
Figure 10, the resulting displacements were 0.74 ± 0.07 and 2.77 ± 0.29 mm with the SQUID- and OPM-MEG systems with the closest sensor positions, respectively. Although these displacements were smaller than those recorded at 10 µA, the OPM-MEG system still exhibited larger localization errors than the SQUID-MEG system. Therefore, insufficient SNR in the OPM-MEG system was not the reason for the larger source estimation error.
Second, the source localization accuracy depends on the number of sensors used for the estimation. As described in
Section 2.3, the experiments used 202 and 90 sensors in the SQUID- and OPM-MEG systems, respectively. Although increasing the number of OPM sensors is expected to improve the source estimation accuracy, the maximum number of available OPM sensors in our laboratory was 90. Therefore, we re-estimated the ECDs using a different number of sensors in the SQUID-MEG system to examine the dependence of the source estimation accuracy on the number of sensors. We selected 32, 40, 48, 64, 80, 90, 96, 112, 128, 144, 160, and 184 sensors from the 202 sensors as uniformly as possible. For instance,
Figure 11 presents the selected 90-channel sensor array.
Figure 12 shows the source localization error with different numbers of sensors. The results for the 202-channel sensor array are identical to the data presented in
Figure 10a. The source localization error increases as the number of sensors decreases, particularly when the number of sensors is fewer than 112. Focusing on the comparison between the SQUID-MEG and OPM-MEG systems, the displacements of the ECD localization with 90-channel SQUID sensors were 1.56 ± 0.25 and 1.01 ± 0.09 mm for the applied currents of 10 µA and 100 µA, respectively. Although these displacements were larger than those obtained using the 202-channel SQUID sensors, the OPM-MEG system exhibited larger displacements than those of the SQUID-MEG system. Therefore, insufficient OPM sensors was not the major cause of the larger source estimation error, even with a good SNR. Additionally, the displacement of the ECD localization with 40-channel SQUID sensors was 3.13 ± 0.45 mm at 10 µA. This result suggests that the 40-channel SQUID-MEG system achieves source localization accuracy comparable to that of the 90-channel OPM-MEG system under the experimental and analytical conditions demonstrated in this study.
Third, the source localization accuracy is also influenced by the spatial coverage provided by the sensor array on the phantom source signal. As presented in
Figure 5b,c, some ECDs were positioned below the rim of the sensor array. Therefore, we re-calculated the mean and expanded uncertainty of the source localization error using the estimated results of 35 ECDs, excluding the data from 14 ECDs located below the rim of the sensor array.
Figure 13 shows the source localization error derived from the data of 35 ECDs. Comparing the results derived from the data of 49 ECDs shown in
Figure 10, the source localization error was slightly decreased when using sensor arrays (b) and (c) with a current amplitude of 10 µA. This result highlights the need for the careful design of the sensor arrangement to ensure the spatial coverage of the signal source, even though the OPM sensor can be easily moved and positioned closer to the scalp compared to the SQUID sensors. However, the OPM-MEG system still exhibited a larger source localization error than the SQUID-MEG system, as shown in
Figure 13.
As stated above, we investigated three major factors contributing to source localization error: SNR, the number of sensors used for estimation, and spatial coverage provided by the sensor array on the phantom source signal. Although the spatial coverage of the sensor array on the signal source can improve the source localization accuracy, none of the three factors emerged as the dominant determinant of localization accuracy in the experiments. Several additional factors may restrict the source localization accuracy of MEG systems. One possible reason is a calibration error in the OPM sensor array. Defining sensor arrangements (position and orientation) is essential for precise source estimation. We previously reported that calibrating sensor position, orientation, and sensitivity (converting coefficient from voltage to magnetic flux density) could improve source localization accuracy in biomagnetic measurement systems. This improvement has been demonstrated in a whole-head SQUID-MEG system [
29] and a magnetocardiography system using magnetoresistive sensors that operate at room temperature [
31]. The SQUID-MEG system sensor array used in this study was calibrated with multiple coils during installation ten years ago. Conversely, the OPM sensor arrangement was determined as the set containing the sensor positions (three-dimensional points, from which the depth of the sensor can be deduced) and the sensor orientation vectors. The values for each component of the sensor arrangement are provided by the constructor of the OPM-MEG system. Recent studies have shown that calibrating OPM sensor positions can improve source localization [
8,
32]. To improve OPM-MEG system performance, ongoing research focuses on refining sensor placement using our calibration technique.
The phantom-based approach offers a controlled environment where the amplitude, location, orientation, and timing of the source signal can be precisely set and repeated as needed without interference from physiological artifacts such as eye blinks, muscle activity, or cardioballistic noise. As OPM-MEG systems become widespread, researchers may seek to evaluate their performance under different sensor arrangements and/or numbers. This quantitative validation method provides a standardized benchmark for comparing MEG systems across different setups and constructors worldwide.