1. Introduction
Ensuring a high accuracy of scattering parameters (S-parameters) measurement using a vector network analyzer (VNA) is an important task when conducting research in the low-terahertz (low THz)-frequency band. When making measurements, we must always consider imperfections that exist in even the highest-quality test equipment and can cause less-than-ideal measurement results. Some factors that contribute to measurement errors are repeatable and predictable dependent on time and temperature and can be removed, while other errors are random and cannot be removed.
VNA measures the amplitude and phase of a signal interacting with a device-under-test (DUT); it operates in the frequency domain, providing frequency-dependent data [
1]. VNAs working at millimeter-wave and low THz frequencies are usually equipped with frequency extender modules fitted with standardized rectangular metal waveguides. The measurement quantities are the magnitude and phase of the propagating signals incident on and scattered from each port. The VNA forms ratios of these quantities to present S-parameters for the DUT.
The typical VNA architecture necessarily introduces several systematic errors. These are inevitable due to the possibility of different port impedances, measurement signal path losses, phase shifts, internal reflections, and factors, such as an imbalance in the directional couplers that form the test/stimulus ratios [
1,
2]. However, for these errors, the linearity condition can be accepted, and they can be corrected or reduced to acceptable values using the calibration procedure.
Random errors are inherently unpredictable, so they cannot be removed by calibration. The main contributors to random errors are instrument noise (for example, sampler noise and the IF noise floor), switch repeatability and connector repeatability. When using VNAs, noise errors can often be reduced by increasing the source power, narrowing the IF bandwidth, or using trace averaging over multiple sweeps. The proper care and handling of the RF connectors in the measurement system can minimize connector repeatability errors.
Drift errors occur when a test system’s performance changes after a calibration has been performed. These errors are caused primarily by temperature variation and can be removed by additional calibration. The rate of drift determines how frequently additional calibrations are needed. Establishing a test environment with a stable ambient temperature usually minimizes drift errors. Allowing equipment to warm up and stabilize before calibration and properly ventilating equipment helps reduce drift errors. A summary of the VNA errors is given in
Table 1. To calculate the uncertainties of VNA measurements, including drift of switch and error terms of the calibration, the METAS VNA Tools [
3] can be used.
VNA manufacturers’ usual recommendation is to give the instrument from one to two hours to warm up [
4,
5]. In this paper, the dependence of the measurement accuracy associated with the temperature drift error depending on the warm-up time of the device is given. Thus, in [
5], it was stated that the thermal drift of the VNA error was less than 0.02 dB after a 20 min warm-up time and less than 0.01 dB after a 1 h warm-up time. However, the results presented refer to the device without frequency extension modules, which, due to the design features that will be discussed later in this paper, are more susceptible to the influence of temperature drift.
In the available publications, we did not find an analysis of thermal drift errors of VNAs equipped with frequency extension modules. When conducting practical experiments using VNA, it is important to know the dependence of the measurement error on the time elapsed from the moment the device is turned on. It may be that, for low accuracy requirements, half an hour is sufficient, but for higher accuracy requirements, the device will need to warm up for two hours. A common approach to ensure low-temperature drift errors is to keep the VNA on permanently, but this mode is possible only if the measuring setup is unchanged. When operating the VNA in a university, it is often necessary to change the frequency modules and reconfigure the measuring layout, which leads to the need to turn off the device.
This paper’s purpose is a practical study of the influence of the warm-up time and, accordingly, the VNA temperature on the thermal drift errors. The results obtained make it possible to estimate the necessary time for warming up the VNA depending on the measurement requirements, making it possible to reduce the experiment duration without losing accuracy. The purpose of the warm-up is to achieve the thermal equilibrium of the system; therefore, the properties of the DUT will influence this process. If a very large DUT is used, the required warm-up time may increase. Nevertheless, the results obtained in the research can serve as a guide in most practical cases.
The remainder of this paper is organized as follows. In
Section 2, the VNA thermal drift errors and methods of their measurement are discussed. The experimental results are presented in
Section 3, and their discussion is detailed in
Section 4. Finally, the conclusions are formulated in
Section 5.
2. Measurement of Thermal Drift Errors
2.1. Thermal Drift Errors
The thermal drift cause is either the measurement signal path or the electronic circuits within the VNA and the extender heads. Temperature changes will produce small changes in physical dimensions through linear expansion. These changes can be significant at submillimeter-wave and THz frequencies [
2]. Small changes in signal path dimensions due to thermal expansion can lead to noticeable differences, particularly in phase. Let us consider an example. The coefficient of the linear thermal expansion of copper is 16.6 ppm/°C. Suppose that the waveguides used to connect the extender heads to the DUT are 10 cm long. Then, while changing the temperature by 5 °C, the waveguide length will increase by 8.5 μm, which at a frequency of 1 THz, will lead to a phase shift of 9.2°.
The flexible cables used to connect the extender heads to the VNA are exposed to ambient thermal fluctuation. Nonetheless, the effect of changing their length will not be as significant as that for waveguides and extender modules. Indeed, the signal frequency in these cables usually does not exceed 20 GHz, and when the temperature changes at 5 °C, as in the example considered above, the phase shift will not exceed 2° at a length of 1 m.
As we already mentioned, the effects of thermal drift can be reduced by allowing the VNA equipment to thermally stabilize before use. In practice, this means that the equipment should be switched on for several hours before calibration and measurements take place. As indicated in [
4], directly after power-up the cold instrument should be allowed to warm up for approximately an hour to attain thermal equilibrium. The manufacturer recommends giving the VNA at least two hours to warm up if a higher accuracy is required. Failing to carry this out will result in a noticeable “drift” in the measurement trace, usually if the laboratory temperature is cool. This is because the internal temperature in the VNA itself and the extender heads will considerably increase during the first two hours.
It is also essential to maintain a stable ambient temperature. Ideally, the network analyzer should be operated in a temperature-controlled laboratory to minimize the possibility of thermal fluctuation to these parts of the signal path. For Keysight VNAs, calibrated system performance is within the specifications if the ambient temperature at the time of the measurement is within 1 °C of the temperature at the calibration time [
4].
As we can see, the recommendations of equipment manufacturers lie in a wide range. Therefore, to ensure the quality of measurements, we need to know the warm-up time’s sufficiency. This is especially important when using millimeter-wave or THz extender heads. This study aims to address the accuracy of measuring DUT parameters in the millimeter and low-THz-frequency ranges depending on the warm-up time.
2.2. Experiment Setup
We used the Terahertz measurement facility’s services at the University of Birmingham [
6]. The centerpiece of the facility is the Keysight N5247B vector network analyzer (
Figure 1), manufactured by Keysight Technologies (Santa Rosa, CA, USA) [
7].
The VNA can measure the full two-port scattering parameters in the frequency range up to 1.1 THz using the frequency-converter units. We measured the thermal drift errors using the following three-vector network analyzer frequency extension modules manufactured by Virginia Diodes Inc. (VDI, Charlottesville, VA, USA): WR3.4, WR1.5, and WR1.0 [
8]. The choice of these modules was due to the desire to cover a wide frequency range and their design differences. The WR3.4 module is made in a mini-sized enclosure, and the WR1.5 and WR1.0 modules are made in a standard size enclosure [
9]. We wanted to find out if these design features lead to differences in the values of temperature drift. The characteristics of the modules are presented in
Table 2.
Stability is specified for 1 h after system warm-up in a stable environment with ideal cables. The recommended operating temperature range of the modules is from 20 °C to 30 °C. The modules are equipped with waveguides with UG-387/U-M flanges [
2]. Calibrations and measurements were made without the use of internal flange pins, in accordance with the manufacturer’s standard recommendations.
The THz measurement facility was not equipped with a temperature control; however, it was possible to maintain a stable ambient temperature within the recommended operating temperature limits 20–30 °C. The temperature variations during the measurement did not exceed 0.5 °C, and in the corresponding section, we will provide detailed temperature data. On the eve of the measurement, the device was calibrated using the appropriate standard calibration kit; the cables and modules did not change their position before and during the measurement. The measurements were made with a short-circuited waveguide from the calibration kit.
2.3. Calculation of Measurement Error
VNA measures scattering or S-parameters, which are complex matrix elements that show reflection/transmission characteristics (amplitude and phase) in the frequency domain. The ratio of received power to the transmitted power can be expressed through the magnitude of the input port voltage reflection coefficient
S11 [
1]:
where
a1 and
a2 are incident power waves at ports 1 and 2, respectively, and
b1 is reflected wave for port 1 (see
Figure 2). In a perfect termination case, the magnitudes of
b1 and
a1 are equal, and the magnitude |
S11|, expressed in dB, should be zero. In real conditions, each measurement of |
S11| will always be slightly greater or less than zero due to random errors in the measurement process. In our experiment, we used the magnitude and phase of this deviation to estimate the measurement error. Since reflection coefficient
S11 is a complex quantity, it is characterized by the complex value’s real and imaginary components or its magnitude and phase.
The entire frequency range from
f1 to
f2 is presented in the form of
n discrete frequencies with a step of:
Since we wished to estimate the temperature drift over the entire frequency range, at each time moment, we measured S11 for n discrete frequencies, which allowed us to statistically draw valid conclusions about the measurement accuracy. The measurements continued for three hours with an interval of ts = 10 min; therefore, the total number of measurements m was 3 × 60/10 + 1 = 19.
Figure 3 explains the process of calculating a measurement error for S
11 coefficient with coordinates in the complex plain
. Hereinafter, the superscript
j corresponds to the measurement serial number. It varies from 1 to
m, and the subscript
i corresponds to the number of the discrete frequencies and varies from 1 to
n. Coordinates (−1, 0) in the complex plane correspond to a zero measurement error of coefficient
S11. The zero error corresponds to the vector
, and each current measurement corresponds to the vector
.
The error vector for the current measurement that is, at time
and at frequency
, can be calculated as the difference between vectors:
We are interested in how the error, averaged over the entire frequency range, changes over time. To determine the average magnitude of the measurement error vector
at the time moment
j, we must average this magnitude over all
n frequencies:
However, in most cases, this averaging can lead to the appearance of a systematic error [
10]. For example, if the average value of the complex vector
is equal to zero (
), then each individual measured value of the magnitude is nonzero, and averaging the magnitude would give us a value that differs from the true value (
).
Therefore, in this paper, we expressed all complex-valued measurements in real and imaginary components before applying statistical techniques to analyze complex-valued data. The complex quantity
represents an error at the time moment of
jts, averaged over all
n frequencies:
The real component of
can be expressed as:
The mean of the imaginary component of the complex quantity
can be expressed as:
The magnitude of the complex quantity
is:
The standard deviation of
is equal to the sum of the standard deviations of its real and imaginary parts [
11]:
The phase
θ of the complex quantity
can be found from:
In the next section, we present the results of temperature drift measurements based on this approach.
2.4. Ambient and Device Temperature
The results of temperature measurements using Duratool Infrared Thermometer D03308 are presented in
Figure 4. The room temperature is given for measurement with WR3.4 module; when using WR1.0 and WR1.5 modules, it was not significantly different (±0.2 °C) from that shown in
Figure 3. In the considered example, over three hours of the experiment, it increased from 25.2 °C to 25.6 °C; these temperature variations are within the equipment manufacturer’s recommendations.
For definiteness, we measured the temperature on the flange that connects the waveguide to the extender head. This temperature does not give the exact value of the temperature of the VNA or frequency extender head. Nonetheless, since we are interested in the temperature change, this measurement is adequate for the experiment.
For three hours, the compact WR3.4 module temperature measured on the waveguide flange increased from 25.2 °C to 34.9 °C, while by the end of the first hour, it was 34.7 °C and almost reached a stable temperature exceeding the room temperature by 9.3–9.5 °C, and this difference remained almost unchanged. Fluctuations within ±0.1 °C can be attributed to the thermometer resolution since its minimum display scale value is 0.1 °C. The temperature of the full-size WR1.5 and WR1.0 modules grew more slowly and only after three hours their temperature became 34.9 °C, the same as that of the WR3.4 module.
3. Results
To understand how the measurement error changes over time, it is convenient to present the measurement results in a scatter plot on the complex plane. In
Figure 5, the distribution of measured
S11 is shown for four measurements made after 30 min, 60 min, 120 min, and 180 min from the beginning of the experiment with WR3.4 module. Each point in the figure represents the
S11 coefficient for one of the frequencies. The entire measurement range from 220 to 300 GHz was presented in 801 discrete frequencies with a step of 137.5 MHz as determined by (2).
As we have already noted, a zero error corresponds to
= (−1, 0). In
Figure 4, the line represents a sector of a circle with the magnitude |
S11| = 1. The distance of each measured value of S
11 from this circle corresponds to a measurement error of this coefficient’s magnitude. As can be seen from the figure, with increasing time, this error decreases. The phase measurement error corresponds to the angle of the measured
S11 to the axis
It decreases as the device warms up. From
Figure 5 we see that a standard deviation of the measurement error decreases over time; it is characterized by the size of the corresponding ellipse of the scatter of the measured values. The scatters vary if different modules are used, but the general patterns remain as shown in
Figure 5.
We calculated the magnitude of the measurement error, its standard deviation, and the phase error for all three modules used, depending on the time from the start of the experiment. The graphs for magnitude errors are shown in
Figure 6a–c, and numerical results in dB are shown in
Table 3. As can be seen from these graphs, the measurement error rapidly decreases within the first 30 min. In the first two cases (WR3.4 and WR1.5), it decreases to about 0.1 dB, and in the third case (WR1.0), it decreases to about 0.2 dB. This reduction in measurement error continues more smoothly until approximately two hours from the start of measurement. During this period, the error becomes 0.025–0.044 dB. In the range from two to three hours, this decrease continues slowly until 0.013–0.020 dB is reached.
The phase error measurements shown in
Table 3 demonstrate similar patterns. It should be noted that a significantly larger error was found when using the WR3.4 module. Perhaps this is because the length of the connecting waveguide, in this case, is 10 cm; in higher frequency modules, it is 4 cm. Temperature changes, in this case, have a more significant effect on the phase shift of the signal.