1. Introduction
In recent years, advances in liquid handling systems as a powerful tool for high-throughput assays have been witnessed in modern life science laboratories [
1,
2,
3], especially nucleic acid sequencing, which often analyzes samples deposited onto target locations on substrates microarray [
4,
5]. Tests have been performed at the reactive points of microarray received genetic samples [
6]. It is reported that about one-third of errors are generated during the sampling process by manual operations [
7]. Therefore, there is a need for sampling instruments that can deposit samples in target locations [
8]. Automatic liquid dispensing systems are necessary for the usage of dispensing samples to the target microarrayers precisely without contamination pollution.
There are many liquid handling systems developed recently [
9,
10,
11]. Das et al. [
12] presented a fluid dispensing system that had a range of 1 to 100 µL with an accuracy of 99.5% and a standard deviation of 150 nL. A peristaltic pump used independently should be calibrated because of the inaccurate and progressively lower volume due to the gradual deterioration of tubing elasticity. The system was based on a level sensing modular to control the volume of fluid before the peristaltic pump. The advantage of the proposed dispensing system was that the periodic calibration was not needed, because the peristaltic pump pulled the fluid to the intended application which eliminated the issue of lowering dispense volume over time. The individual components of the system can also be used for biomedical applications. Wu et al. [
13] presented a high-throughput automated sample processing system based on the principle of air displacement with an 8-channel pipetting arm. The platform could process 96 samples with a capacity of 10 to 350 µL simultaneously while meeting the standards set by the ISO-8655 [
14] and JJG 646-2006 [
15]. Tong et al. [
16] developed a nucleic acid analyzer with a microfluidic droplet-based real-time PCR assay integrated with an automated liquid handling robot. Nucleic acid analyzer is one kind of molecular diagnostic technique that involves nucleic acid extraction, amplification and detection. The proposed analyzer could achieve multiple operations including sample handling, nucleic acid extraction, PCR amplification and fluorescence detection of droplet array. The integrated system was adopted to a minimized size of 50 × 45 × 45 cm (length × width × height) with a cost reduction to CAD 900. In the past decades, Matrix assistant laser desorption ionization—Time of Flight Mass Spectrometer (MALDI-TOFMS) has been rapidly developed [
17]. MALDI-TOFMS has been widely used for a variety of applications in biology, sequencing, environmental pollution monitoring, clinical diagnosis and other fields [
18,
19,
20,
21]. Before the analytical process, liquid handling is necessary to transfer nanoliter samples to chip arrays with substrates on a dots matrix. After samples and substrates co-crystallize, analytes are irradiated by the laser of a MALDI-TOFMS that induces desorption and ionization of the molecules. Data are collected from multiple positions of a crystal for an average intensity value as shown in
Figure 1.
If the dispensing volume is too large, the signal of the detector will be oversaturated, which will affect the sensitivity of the detection; otherwise, it may result in poor responsiveness, even undetectable. Hence the volume of the dispensing liquid should be appropriate to cover the whole substrate dot to ensure co-crystallization without redundancy. Although an integrated robotic sample transfer device that could process fluid samples for mass spectrometry was invented, the system was open-loop controlled, leading to droplets not being generated precisely enough [
22]. A visual image recognition system was widely used to control the on-demand movements of motors to reduce positioning errors [
23,
24,
25,
26]. Hence, an automated droplet-on-demand dispensing system with closed-loop feedback control is required for the sample preparation of the MALDI-TOFMS [
27].
In this paper, a home-built, automated micro liquid dispensing system was developed and validated for the preparation of samples. The system can deliver precise amounts of small volumes, particularly nanoliter volumes, based on contacting droplet generation. An adapted controller was designed with the image process unit as the sensing signal. The control model ensured the volume to be dispensed precisely despite the liquid properties. The results showed that the proposed system was able to carry out sample preparations with reliability and robustness for the practical use of MALDI-TOFMS.
2. Materials and Methods
The proposed system contains three main units: the imaging-based unit, the signal processing unit and the feedback control unit [
28].
Figure 2 shows the block diagram of the control system. The contacting dispensing object has a pin tool on the
z-axis motor end with a camera adjacent to it. In this work, the camera is used for capturing the droplet shape of the dispensed liquid. A computer is embedded as the signal processing unit, which calculates the volume of the dispensed droplet based on the area obtained by the imaging unit. The image processing unit is used as the sensor of the control system. The feedback control unit was executed by the embedded computer regulating the downward velocity of the
z-axis motor through the Controller Area Network (CAN). The control strategy aims to minimize the error between the set-point volume of the droplet and the measurement obtained by the sensor, which is the image processing unit.
2.1. Momentum-Driven Droplet Image Acquisition
A solid coated pin has a slotted end, as shown in
Figure 2. First, the pin is immersed into samples. Then, the pin is moved upwards. During this process, the pin could hold a liquid droplet with surface tension. After picking up samples during dipping, the coated pin is then transferred to the top of a target surface. If the pin is properly positioned, it will move downward to the target surface at a predetermined speed to impart a downward momentum to the liquid drawn by the pin. The pin is halted in the travel when contacting the aimed surface. The liquid samples keep moving at their imparted speed because of the downward momentum, therefore, samples are expelled from the slot to the target surface. After lifting the pin, the liquid samples are deposited at the target location. The process is shown in
Figure 3. The dipping depth of the pin could be selected to obtain different quantities of samples. The downward velocity is varied according to the dispensing volume.
Pins are installed on the pin tool which is embodied in a three-axis robotic-positioning assembly. Springs fixed to the pin are used for cushioning the upward movement when being compressed against the upper wall. The volume of the liquid sample is related to the descent speed and dipping depth of the pin in the sample with the nature of its volatility, viscosity and the like. The overall structure of the pin tool is shown in
Figure 4. A camera set beside the pin tool captures the image of the dispensed droplet as soon as the pin moves to the initial
y-axis position.
2.2. Image Pre-Processing
The median filter is one of the predominant filters for smoothing signals [
29]. It has the advantage of simplicity and the ability to maintain edges which have led to extensive applications in the domain of image processing [
30].
where
identifies the original image and
represents the estimated image.
W is the window slide, which is processed as it slides through the image from the left edge to the right. In this work, a 10 × 10 window was used.
An algorithm based on the principle of least squares was used to obtain a suitable threshold (OTSU) [
31]. The basic idea of OTSU is to divide the histogram into two groups with a certain gray level as the threshold, and calculate the variance between the two groups. When the variance is maximized, the image is divided into two groups with the corresponding threshold.
Let the pixels of the given image be represented in L gray levels [1, 2, …,
S]. The total number of pixels is N:
The gray-level histogram is regarded as a probability distribution:
the pixels then are divided into two classes
C0 and
C1 by a threshold at level
k. The probabilities of class occurrence are given as follows:
where
C0 denotes pixels with level [1, …,
k] and
C1 denotes pixels with level [
k + 1, …,
S]. Means of the two classes are given as follows:
the mean gray level of the histogram at threshold
k is given:
for any choice of
k, the following relation can be verified as:
The discriminant criterion is used to evaluate the threshold at level
k, where:
The optimal threshold
k* maximizes
, so the maximum is sought as follows:
In a binary image, the object consists of non-zero pixels and 0 pixels as the background. B is a P × 1 cell array, P is the number of objects, and each cell is Q × Matrix of 2, corresponding to the coordinates of the object outline pixels. Each row in Q represents the location coordinates of the boundary pixels of the connected body (the first column is ordinate Y, the second column is transverse X), and Q is the number of boundary pixels. The outline of a binary graph object, including the outer outline and the inner edge, is obtained using the above algorithm. After the outline is recognized, the dispensing areas are calculated with pixels as units.
The shape of the dispensed fluid could be seen as a spherical cap composed of multi-layer stacked cylinders with radius
r and height
y, as shown in
Figure 5.
The function of the estimated volume using an approximation in multi-layer segmentation is as follows:
where
V is the volume of the dispensed fluid,
R is the radius of the sphere and
h is the height of the spherical cap. If the contact angle of the dispensed fluid is
θ, then:
the volume of the dispensed fluid is:
where
Dref is the distance in mm between two adjacent referent points,
Dpix is the total number of pixels between two adjacent referent points and
R0 is the radius in pixels of the dispensed area. Specially, when the contact angle is 90°, the volume is equal to that of a hemisphere. The whole process has been implemented successively during the dispensing procedure.
2.3. Incorporation with Feedback Control
The liquid dispensing system process is as follows: the pin dips into a reservoir of samples, draws liquid up into the pin tool, then travels to a certain position, and moves downward to the microchip at a predefined speed. The sample is expelled onto the surface of the microchip by the momentum of the liquid resulting from the abrupt halting. The next round of transfers is executed after the cleaning step is finished.
It has been found that the volume of the liquid sample expelled has a direct proportion to the downward velocity and dipping depth of the slotted pin in samples. The function is as follows:
where
v is the velocity and
h is the depth.
3. Results
The image pre-processing results are shown in
Figure 6. The original image is
Figure 6a. The filtered image is shown in
Figure 6b. It can be seen that the grayscale gradient of
Figure 6a is missing.
Figure 6c shows the results of the application to the filtered image. The outer outline and the inner edge are obtained using the above algorithm and shown in
Figure 6d. After the outline is recognized, the areas are calculated with pixels as units, as shown in
Figure 6e. The whole process has been implemented successively during the dispensing procedure. To determine the volume of the dispensed fluid, an image of reference points was taken to obtain
Dref and
Dpix.
To find the influencing factors of the volume, several experiments were carried out. A high-speed camera (OLYMPUS i-SPEED CDU) was used to capture the side image of a droplet to obtain the contact angle. Six different dipping depths of the sample were applied with various velocities. In this case, pure water was used as the sample,
Dref was 1.2 mm and
Dpix was 260 pixels. As the contact angle was about 90°, the volume was calculated as a hemisphere. The detailed parameters, averages of results and their Standard Deviation (SD) are listed as follows in
Table 1:
The average and standard deviation (SD) values of experiments using the same speed of 100 mm/s for a given dipping depth are listed in
Table 2:
The relationships between the proposed downward velocity and volumes of different dipping depths are shown in
Figure 7. As the velocity increased, the dispensed volume increased. At the same velocity, most dispensing volumes became larger as the pin was immersed deeper.
Samples of the automated micro liquid dispensing system are DNA/RNA extension products made by PCR (Polymerase Chain Reaction). There are mainly two types of fluid used by PCR, including oil phase buffer and droplet discrete phase. The commonly used oil phase buffer includes dimethyl silicone oil, fluorinated oil, mineral oil, glycerol, etc. Discrete phase is pure water or buffer commonly. To discuss the influence of the density and viscosity in dispensing process, pure water, calibrator, two kinds of samples were dispensed. Properties of them at room temperature 25 °C are listed in
Table 3.
Four kinds of fluid were dispensed at a velocity of 1000 mm/s with a dipping depth of 3 mm for ten times. Dispensing areas are listed in
Table 4 in pixels.
Dispensing areas of four kinds of liquid were similar, but differences were observed in side views of droplets as shown in
Figure 8.
The contact angles are 86.3°, 86.5°, 34.2° and 15.1°. After data fitting, contact angles of fluids with different densities and viscosities were obtained. As the density and viscosity increased, the contact angle of the droplet decreased, which led to a decrease in dispensing volumes, as shown in
Table 5. As each droplet covered the whole substrate area, there was no impact on final mass spectrometry detection.
Experiments were conducted to study the response time of the model-based feedback control system and open loop system in Matlab 2021b using pure water. The experimental results can be referred to as
Figure 9. This study indicates that the droplet generation assisted by model-based feedback control has a shorter response time and lower deviation compared to conventional passive droplet generation methods assisted by open loop control. In addition, we have tested more different setpoint volumes and compared the response performance of the model-based feedback control system and the open loop control system. The feedback control system can adjust the dipping depth adaptively so that the volume is about 100 nL. Without feedback control, the dipping depth is constant while the level of samples becomes lower after several tests, so the volume of the dispended fluid is less than 100 nL gradually. The robustness of our developed system is better.
To verify the proposed algorithm, a homebuilt automated liquid dispensing system was developed and discussed in the next section.
4. Discussion
The overall appearance of the system is shown in
Figure 10. The pin is designed for dispensing liquid with the range of 20 nL to 200 nL.
Users operate the system through the touch screen on the left side. The power switch and other interfaces are on the back of the instrument. The door on the right side of the instrument can be opened. The layout inside the door is shown in
Figure 11.
The system consists of a three-axis robotic arm with the pin tool on the
z-axis, a wash station, a sample supply site and the dispensed chip area. As in
Figure 11, the
X-axis and
Y-axis robot achieve the movements of the robotic arm in the horizontal direction with a repeatability of 10 µm, so it can precisely move pins onto the points of the microchip and sites of the samples. The
Z-axis robotic arm leads the pin tool moving up and down with a repeatability of 1 µm. The accelerated velocity, retarded velocity and velocity of the three-axis robotic arms are all adjustable. Parameters should be tuned appropriately before micro fluid dispensing. The camera set on the
Z-axis robotic arm is fixed, which has the function of autofocus. It captures images of dispended fluid automatically with the target site number stored while dispensing. The fourth part of the system is the chip location which accommodates up to 10 chips at the same time. The sizes of locations are consistent. The fifth part of the system is the sample tray which is capable of accommodating double 96-well plates. The wash station includes a diaphragm pump, clean and waste tanks, and a drying site with a vacuum pump. All parts of elements are controlled by a computer through a user interface software as shown in
Figure 12.
The initial page of the software is shown in
Figure 12a. The main functions in the initial page are Run, Record, Method, Maintenance and Setting accordingly. After the selection of the main function, the software will jump to the page of the corresponding function with main functions listed on the left slide. The function of Run is to display the dynamic process of dispensing. The function of Record is shown in
Figure 12d. Column 1 is the list of images of dispensing fluid, column 2 is the index of the target chip number, column 3 is the list of volumes, and column 4 is the function of zoom, which shows the enlarged image in column 5 if users want to seek more details. Part 6 of the record page is statistical information about the microfluid, including average volume and covariance. The Method page is shown in
Figure 12b. In this page, corresponding relationships are created with a given method name. Methods could be found and revised as well as deleted using buttons at the bottom of the page. The function of Maintenance is used to pour water into tanks or drain waste with operation instructions. The Setting page in
Figure 12c has the following functions: changing parameters, log view, initialization, advanced parameters setting, user management and password management. Passwords are only required when operating advanced parameters. Shortcuts on the top right of the initial page are State, Reset and Shut down. The state button will be flashing if the device is abnormal. After pressing the reset button, all parts of the device will undergo initialization. Shut down will be confirmed before all parts of the system be switched off.
The whole working process is as follows: The user first predetermines a method in the software with a set of transfer parameters. For example, the positions of samples located and the aimed chip map to be dispensed, as well as the volume of the liquid spot. The image data of fiducial marks are processed by the processing unit to determine the precise position of each sample deposition site on the chip. Then, a standard cleaning cycle is initiated which includes rinsing in the wash station and drying in the vacuum drying station. After that, the transfer process could be displayed. Samples are transferred from the sample well to chips while a live video as well as a graphic of the transfer status of the sample deposition are shown. The image of the dispensing sample and the information of the image are displayed. The model-based feedback control unit ensures that the volume is closed to the set value automatically, as the levels of the sample and distances between the pin tool and chip are changeable. There are redundant target spots on the chip to overcome the response time of the control strategy.
The volume of the dispended fluid has a range of 20 nL to 200 nL. To determine the proper volume to be used, the calibrator was tested using an Agena MassARRAY CPM96 (Agena Bioscience, San Diego, CA, USA). Different on-demand volumes were dispensed five times by 20 nL as a step from 20 nL to 200 nL. Results are shown in
Table 6.
The corresponding curves are shown in
Figure 13. When the volume was 20 nL, the peak of mass 8490 failed to appear. When the volume was 40 nL, the peak of mass 9980 was lost. As the dispensing volume became larger, intensities grew accordingly. When the volume was less than 60 nL, the intensity was lower than the target value of the calibrator, indicating that the co-crystallization was not enough. When the volume was greater than 80 nL, all intensities were relatively constant. Because the substrate was constant, the dispensing volume had to be larger than 80 nL to ensure that the samples and substrates were adequately mixed. In this study, 100 nL was selected as the default dispensing parameter.
When the dispensed volume was set as 100 nL, results and the corresponding Cross-Validations (CVs) of the dispensed chip are shown in
Table 7.
The dispensed samples all presented active peaks, and their CVs were less than 5%, which met the related standard. One of the mass spectrograms profile is shown in
Figure 14 which illustrated the distribution of peaks according to the mass-to-charge ratio.
Hearing loss (HL) is the most common sensory disorder, affecting one child in every 500 to 1000 at birth [
32]. Genetic causes are estimated to represent 50–70% of congenital deafness cases. Most hereditary HL cases are caused by mutations in nuclear genes [
33]. In this case, the deafness gene GJB2 is taken as the detection object. A total of 15 samples of PCR products were prepared, of which there were 2 samples with a known mutation site at GJB2_235delC. Samples were processed by the homebuilt system and results were investigated by Agena MassARRAY (Agena Bioscience, San Diego, CA, USA) for the simultaneous analysis of mitochondrial alterations.
It can be seen from
Table 8 that the home-built dispensing system with image processing feedback control algorithm proposed in this paper can not only better perform CV, but can also accurately identify the location of mass peaks of the mutation sample, which has a very important clinical application value.