Next Article in Journal
Susac Syndrome: Description of a Single-Centre Case Series
Next Article in Special Issue
Association between Leukemia Inhibitory Factor Gene Polymorphism and Clinical Outcomes among Young Women with Poor Ovarian Response to Assisted Reproductive Technology
Previous Article in Journal
Not to Rush—Laboratory Parameters and Procedural Complications in Patients Undergoing Left Atrial Appendage Closure
Previous Article in Special Issue
Technical Tips and Tricks after 10 Years of HyFoSy for Tubal Patency Testing
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Rupture Prediction for Microscopic Oocyte Images of Piezo Intracytoplasmic Sperm Injection by Principal Component Analysis

1
Advanced Medical Engineering Research Institute, University of Hyogo, Himeji 670-0836, Japan
2
School of Engineering, University of Hyogo, Himeji 671-2280, Japan
3
Reproduction Clinic Tokyo, Tokyo 105-7103, Japan
4
Graduate School of Information Science, University of Hyogo, Kobe 650-0047, Japan
*
Author to whom correspondence should be addressed.
J. Clin. Med. 2022, 11(21), 6546; https://doi.org/10.3390/jcm11216546
Submission received: 4 October 2022 / Revised: 24 October 2022 / Accepted: 29 October 2022 / Published: 4 November 2022
(This article belongs to the Special Issue Female Infertility: Advances in Diagnosis and Treatment)

Abstract

:
Assisted reproductive technology (ART) has progressed rapidly, resulting in a great improvement in the clinical pregnancy ratio. When applying the protocol of piezo intracytoplasmic sperm injection (Piezo-ICSI), it is very important to puncture the zona pellucida and the oocyte cytoplasmic membrane without rupturing the oocyte cytoplasmic membrane. Previous studies have shown that the poor extensibility of the oocyte cytoplasmic membrane might be closely related to rupture. However, no consensus has been reached regarding how the quality of the oocyte for extensible ability or rupture possibility affects the surfaces of the oocyte on the microscopic frames. We conducted this study to provide evidence that artificial intelligence (AI) techniques are superior for predicting the tendency of oocyte rupture before puncturing on Piezo-ICSI. To inspect it, we provided a retrospective trial of 38 rupture oocytes and 55 nonruptured oocytes. This study marked the highest accuracy of 91.4% for predicting oocytes rupture using the support-vector machine method of machine learning. We conclude that AI technologies might serve an important role and provide a significant benefit to ART.

1. Introduction

Recently, the Japan Society of Obstetrics and Gynecology, which investigates trends in assisted reproductive technology (ART), and the International Committee Monitoring Assisted Reproductive Technologies have reported that the number of individuals receiving infertility care in Japan has been increasing each year [1,2]. Intracytoplasmic sperm injection (ICSI) is an assisted reproduction technique [3] and consists of conventional ICSI and Piezo-ICSI, with the difference in how to puncture the membrane [4]. With conventional ICSI widely used, the tip of the injection pipette is sharp and pierces the zona pellucida of an oocyte and draws the oocyte cytoplasmic membrane. With Piezo-ICSI, the tip of the injection pipette is flat and punctures the zona pellucida and the oocyte cytoplasmic membrane without drawing the oocyte cytoplasmic membrane. Piezo-ICSI is the current established standard procedure and performed using small axial mechanical pulses with piezoelectric elements [5,6]. As compared with conventional ICSI, Piezo-ICSI has the representative disadvantage and includes: (1) difficulty to develop a system with consideration for the shape or the thickness of the injection pipette, (2) difficulty to control the stable piezo elements, (3) requires higher expenses. On the other hand, Piezo-ICSI has the advantage that the fine punctate vibration of a piezo-driven flat injection pipette allows for minimal distortion of the oocyte over conventional methods. This technology results in a high fertilization rate and low degeneration rate. However, during the puncturing process, the poor extensibility of the cytoplasmic membrane of the oocyte results in its rupture, causing degeneration [7,8]. In addition, there are many difficulties in predicting the possibility of rupture of the oocyte cytoplasmic membrane using only human visual estimation. Even well-trained embryologists recognize that it is difficult to judge membrane rupture for short-term events with the images before puncturing. The ICSI has a complicated procedure and it is reported that its standardization could contribute to a systematic review [9]. New techniques are needed to improve the success rate of ICSI more consistently by reducing human involvement. If the possibility of rupture can be suggested before puncturing, embryologists can carefully handle the puncture process. The integration between human technology and AI that exceeds human judgment will be useful in improving ICSI outcomes. For example, they face the problems that if the membrane is unintentionally ruptured, the oocytes are prone to degeneration. In addition, even if it does not denature after rupture of the membrane, the subsequent culture results will be poor. Therefore, we designed our study by applying image processing to establish evidence that the images before puncturing can predict the possibility of rupture of the oocyte cytoplasmic membrane.
Many human visual system models are being developed in the field of computer vision, which has pioneered artificial intelligence (AI) [10]. Several studies have previously addressed texture analysis based on feature distributions with local binary patterns (LBP) used for classification in computer vision [11,12,13]. A diagnostic-assisted tool was proposed in the field of ART, which is based on oocyte texture image processing [14]. Although currently AI applications in reproductive medicine [15] are being reviewed, the number of them is still rather small. We developed a support system to identify the optimal puncture position of the oocyte cytoplasmic membrane by applying LBP and investigated the mechanism of the endometrium in our previous works [16,17,18]. In addition, the computer intelligence technique was implemented for the first time and proved its efficacy in the field of reproductive medicine [19]. However, there is currently no evidence on the effects of the rupture of the oocyte cytoplasmic membrane on the image texture before puncturing. To our knowledge, this is the first trial investigating an association between the characteristics of a microscopic movie of oocytes before puncturing and the possibility of rupturing the oocyte cytoplasmic membrane. Our hypothesis was that the microscopic movie may include the potential to predict rupture. We conducted a retrospective clinical study to confirm this hypothesis.

2. Materials and Methods

2.1. Study Design and Oversight

The Institutional Review Board approved the protocol at the Reproduction Clinic Tokyo (1 September 2019; No. 2019-T-L-01) and the Graduate School of Information Science, University of Hyogo (28 April 2021; No. 202101). All subjects provided informed consent before enrollment. We conducted all study procedures in accordance with Good Clinical Practice guidelines and the Declaration of Helsinki. Subjects’ information was anonymized and deidentified before analysis.
We retrospectively collected and enrolled 93 oocytes assigned to Piezo-ICSI at the Reproduction Clinic Tokyo in 2019. Based on the presence of membrane rupture during membrane extension, as shown in Figure 1, oocytes were classified into two groups: rupture (n = 38) and nonrupture (n = 55). Finally, we analyzed the microscopic movie using the LBP method and the principal component analysis (PCA) method and applied a support-vector machine (SVM) method.

2.2. Procedure Recording Protocol

During Piezo-ICSI, the puncturing process for the oocytes was individually recorded with a microscope as moving images. The details of the digital recording for the microscopic movie were indicated as codecs of Windows Media Video (compression coding format developed by Microsoft, Redmond, WA, USA), with a pixel count of 960 pixels width, 540 pixels height, spectral resolution of red, green, and blue (RGB) color, radiometric resolution of 256 levels of color depth, temporal resolution of 30 frames per second (fps; indicating the frame rate), and exposure time of 30–120 s. A microscopic movie was captured as frames and provided as images, resulting in the handling of sequential images. Based on the raw image, the analyzed target region was provided as 380 pixels width and 370 pixels height, which is the maximum width and height to completely include all of the oocytes, respectively (Figure 2).

2.3. Feature Vectors

First, the images generated the feature vectors using LBP, a nonparametric approach to classification. Each pixel in the image binarized with a gray-scale value of 0 to 255 was compared with the neighborhood pixels in clockwise/counterclockwise in order. For a pixel value greater than the center, the value of 0 was encoded; otherwise, the value was 1. The LBP feature vector is represented by the following:
L B P x c , y c = i = 0 N 1 g p i p c 2 i i f   g p i p c 0 ;   g p i p c = 1 ,   e l s e ;   g p i p c = 0
where N is the sum of pixels surrounding the central pixels on a circular neighborhood, p i is the intensity value of the neighborhood pixel with index, and p c is the intensity value of the central pixel.
This study provides the number of pixel neighborhood, N = 8. Therefore, the histogram for all pixels of the eight-digit binary number leads to a 256-dimensional feature vector.
Second, we performed PCA for dimensionality reduction, which contributes to data compression. PCA is a multivariate analysis method that reduces information to a lower-dimensional space while preventing damage, as much as possible, to the information of multidimensional data [20,21]. This method enables many quantitative explanatory variables to be summarized into fewer indicators and synthetic variables. The feature vector x n is represented by:
x n = x n 1 , x n 2 , x n 3 , x n K T ,   n = 1 , 2 , , N
where N is the sum number of input images and K is the number of feature values. The mean of vector m and the mean of covariance matrix S are represented by:
m = 1 N n = 1 N x n
S = 1 N n = 1 N ( x n m ) ( x n m ) T
In the distribution of the input data in the feature vectors, the principal component is first defined by a straight line that passes through the mean and is in the direction of the largest spread. Next, the second principal component is defined by a straight line orthogonal to the first principal component, passing through the mean and in the direction of the second largest spread. Passing through the mean and in the direction of the large spread allows for the detection of the eigenvectors of the covariance matrix S . Therefore, using the covariance matrix S , the eigenvectors u j and the eigenvalues λ j are calculated by:
S u j = λ j u j
The selected number of eigenvectors u j in descending order is “ d ”, and the principal components with the number of dimensions “ d ” is found. For example, the eigenvectors u 1 and u 2 indicate the first and second components, respectively. In our experiments, we calculated the feature extractions using Python (Python Software Foundation, www.python.org). Python provides many libraries and algorithms for signal processing and machine learning. We used a machine with Intel Core i7-1065G7 CPU, 64 bit, 32-GB RAM.

2.4. SVM

SVM is one of the machine-learning models applied to classification and regression and can be used to determine the hyperplane, separating two classes of data from each other [22,23,24,25,26]. Characteristically, it includes a high generalization ability obtained by a separation hyperplane based on margin maximization, no local solution compared with conventional nonlinear models, and fast calculation by involving only a part of data. Margin maximization refers to the determination of the hyperplane identification boundary so that the distance to the support vector is maximized, which is the sample closest to the hyperplane. Nonlinear transformation is performed on the input data to obtain a separation plane in a high-dimensional space; however, the calculation quantity becomes enormous. Therefore, the calculation in the high-dimensional space is replaced by a calculation using the kernel function by the kernel trick, which avoids the mapping calculation while mapping at a higher order. The nonlinear kernel functions commonly include three kernels of Gaussian radical basis function (RBF) kernels, polynomial kernels, and sigmoid kernels. The discriminant function f x is represented by:
f x = sgn i = 1 M w i Φ x · Φ x i + b = sgn i = 1 M w i K x , x i + b
where sgn z is the signum function, Φ x is the nonlinear mapping function, w i is the vector of weight parameters, K x , x i is the kernel function, and b is the threshold. The linear kernel K l i n e r x 1 , x 2 and the nonlinear kernels, RBF K R B F x 1 , x 2 , polynomial function K p o l y x 1 , x 2 , and sigmoid function K s i g m o i d x 1 , x 2 , are represented by:
K l i n e r x 1 , x 2 = x 1 T x 2
K R B F x 1 , x 2 = exp γ x 1 x 2 2
K p o l y x 1 , x 2 = x 1 T x 2 + c d
K s i g m o i d x 1 , x 2 = tanh b x 1 T x 2 + c
where γ and d are the hyperparameters and c is the threshold. Finally, we evaluate our prediction model using a cross-validation method [27,28].
In the classification results, we represented the confusion matrix as true positive (TP; correctly predicted the ruptured oocyte as the ruptured oocyte), true negative (TN; correctly predicted the nonruptured oocyte as the nonruptured oocyte), false positive (FP; incorrectly predicted the nonruptured oocyte as the ruptured oocyte), and false negative (FN; incorrectly predicted the ruptured oocyte as the nonruptured oocyte). Accuracy was defined as the ratio of correctly predicted outcomes among all the frames sampled from the ruptured and nonruptured oocytes. Sensitivity was defined as the ratio of correctly predicted outcomes among all the frames sampled from the ruptured oocytes. Specificity was defined as the ratio of correctly predicted outcomes among all the frames sampled from the nonruptured oocytes. The accuracy, sensitivity, and specificity were considered as TP + TN derived from total number in this study (TP + TN + FP + FN), TP derived from TP + FN, and TN derived from TN + FP, respectively. The comparisons of ruptured and nonruptured oocytes is performed using the chi-squared test for categorical valuables [29,30,31]. Statistically significant was considered as p value < 0.05. Statistical data analyses were conducted with JMP Pro 16.0 (SAS Institute Inc., Cary, NC, USA).

3. Results

We evaluated the effectiveness of using the image texture to assess the oocyte cytoplasmic membrane before puncturing. This experiment provided microscopic movies of the ruptured oocytes (n = 38) and nonruptured oocytes (n = 55) based on the presence of membrane rupture during membrane extension.
The legends of N (from 1 to 5) are the numbers of sampling frames. SVM is applied to classify some dimensionality data from 1 to 11: (A) Linear kernel. (B) Nonlinear kernel of RBF. (C) Nonlinear kernel of polynomial function. (D) Nonlinear kernel of sigmoid function.
On the images that were captured frame by frame in the microscopic movie, we used the sampling frames (one to five frames by one step) from the previous frames to the first confirmed frame in chronological order, with an interval of more than five frames. This allowed the selection of a subset from within a data set to estimate the characteristics of the whole data set.
Upon extracting the feature vector, we applied LBP to a 3 × 3 pixel neighborhood. PCA provided the parameter search to classify the achievement of high accuracy on the dimensionality orders (1 to 11 dimensionality by one step). Therefore, we used 5115 data set (=93 oocytes × 5 frames × 11 dimensionality), which is the maximum data set. The evaluation provided a leave-one-oocyte-out cross-validation, in which one oocyte microscopic movie datum is extracted as a validation data set, and the remaining microscopic movie data are used as a training data set. This enables to avoid including one oocyte datum in both the testing data set and the training data set, although one oocyte used some frames in this experiment. One oocyte using one frame is the same as leave-one-out cross-validation.
Figure 3 shows our experimental results for leave-one-oocyte-out cross-validation in SVM using four kernels of linear (Figure 3A), nonlinear RBF (Figure 3B), nonlinear poly function (Figure 3C), and nonlinear sigmoid function (Figure 3D). We evaluated the accuracy, sensitivity, and specificity of the classification of the trained hyperplane. As shown in Figure 3C, this method allowed us to achieve overall high classification accuracy by SVM using the nonlinear kernel of the poly function. In this SVM evaluation of the accuracy with a nonlinear kernel of poly function, we investigated the top three highest classification accuracies: 91.4% (number of sampling frames: 3, dimensionality: 9), 90.32% (number of sampling frames: 2, dimensionality: 7), and 90.32% (number of sampling frames: 2, dimensionality: 11). We confirmed a statistically significant p value < 0.05 in the chi-square test by calculating the confusion matrix for assessment of classification with the highest accuracy.
Table 1 shows the classification accuracy, sensitivity, and specificity of two cases of two and three sampling frames in nonlinear poly function SVM. A larger dimensionality was confirmed to lead to higher performance of accuracy. Table 2 shows the mean and standard deviation (SD) of the classification accuracy by sampling frames, and the amount of change indicates the value compared with the smaller value of the sampling frames. Table 3 shows the mean and SD of the classification accuracy by dimensionality in the feature vector of SVM, and the amount of change indicates the value compared with one smaller value for the sampling frames.

4. Discussion

The findings of this study underscore the fact that AI might affect the outcome of infertility care. This study showed that SVM with the feature vectors based on LBP and PCA estimated the potential for oocyte rupture. These findings are useful for developing new strategies to improve the success rate of Piezo-ICSI and new biomarkers to predict oocyte quality. To our knowledge, this is the first report to find that AI can predict the possibility of rupture of the oocyte cytoplasmic membrane based on the characteristics of a microscopic movie of the oocyte before puncturing. Of particular note is that the texture of the oocyte image before puncturing was associated with the possibility of rupture or nonrupture. The results consist of the evaluation using all the ruptured and nonruptured oocytes data as shown in Table 1, Table 2 and Table 3. The high classification performance could be achieved by considering the sampling frames, and the dimensionality and kernels in SVM. It indicates that they contain the valuable characteristic data regarding the difference between the ruptured and nonruptured oocytes. Although how much each feature affects classification performance had not been adequately investigated yet, the more detailed investigations might support the analysis techniques of the rupture discrimination. Investigating the impact of each feature on the classification and developing analytical systems for more sophisticated and personalized medicine would be part of the future work.
The possibility for rupture after ICSI might relate to the level of skills of the operators. It is reported that it may be only partially true, though the ICSI protocol seems well established [9]. Extensive training is needed to achieve more success rates, however, there remains some ethical problematic issues to provide the human oocytes as the training materials. It is expected that a medical simulator for ICSI could be developed in the future. On the other hand, we have the first report that the feature characteristics of the membrane could be a predictor to avoid the rupture [16,17,18,19]. This technique visualized the optimal puncture point with image processing of LBP in the clinical study. It is suggested to be more useful to integrate the techniques to target the membrane and target the oocyte itself.
The next step, we think, is to realize this technology in real time while performing piezo-ICSI. If the prediction is negative, our system can propose the embryologists to proceed more cautiously before the injection in that particular oocyte. In it, the combination of the technique visualized with the optimal puncture point with image processing of LBP would be required. Furthermore, by calculating the probability of the oocytes rupture, it has the potential to become an important feedback factor for improving the process of ICSI. We hope to provide a more efficient and useful puncture process.

4.1. Consideration of Sampling Frames

The recording time depends on the length of the microscopic oocyte movies, which in this experiment, was 30–120 s. The movie was provided in captured frames, and some frames were selected before puncturing. The sampling frames (i.e., the selected frame number) must be unified to prevent selection bias. We hypothesized that the frame data of the microscopic oocyte movie before puncturing might include important information for classifying ruptured and nonruptured oocytes. This experiment investigated the sampling frames of 1 to 5 (N = 1, 2, 3, 4, 5) on one microscopic oocyte movie. In Table 2, on each kernel of one linear kernel and three nonlinear kernels of RBF, polynomial function, and sigmoid function, the mean and SD of the classification accuracy for the dimensionalities of 1–11 were 74.88% ± 3.06% on three sampling frames, 80.45% ± 5.66% on four sampling frames, 82.54% ± 8.08% on three sampling frames, and 53.41% ± 3.68% on one sampling frame, respectively. The best scores had fewer than four sampling frames on all kernels. In this experiment, we found little increase in the classification performance of five sampling frames compared with four sampling frames. In our recording protocol, the temporal resolution was 30 fps and the interval was approximately five frames. Thus, the data of sampling frames within approximately 1 s before puncturing involve all of the important information for classification. Although it might be suggested that more frame images should be used for classification because including only a few frames and the numbers of sampling frames did not significantly affect performance, more sampling frames demand a larger processing cost, which is not suitable for real medical diagnosis support systems. Therefore, we concluded that five sampling frames, which equate to approximately 1-s of data, are adequate for empirically classifying ruptures and nonruptured oocytes.

4.2. Consideration of Dimensionality and Kernels in SVM

In this study, we hypothesized that dimensionality data not exceeding 10 might be considered to be an important determinant and predictor of classifying ruptured and nonruptured oocytes. In this experiment, we investigated the dimensionalities of 1 to 10. In Table 3, on each dimensionality of 1 to 10, the mean and SD of classification accuracies for one linear kernel and three nonlinear kernels of RBF, polynomial function, and sigmoid function were 76.20% ± 0.54% on dimensionality, 82.79% ± 2.63% on 10 dimensionality, 87.25% ± 2.22% on 10 dimensionality, and 59.67% ± 2.42% on 1 dimensionality, respectively. We added the result of 11 dimensionalities to this table because of the top score in 10 dimensionality results for nonlinear kernels of RBF and poly function. On the nonlinear kernel of RBF, the amount of change between 10 to 11 dimensionality was −0.94%, compared with 0.13% for the amount of change between 9 to 10 dimensionality. On the nonlinear kernel of the polynominal function, the amount of change between 10 to 11 dimensionality was 0.04%, as compared with 0.14% for the amount of change between 9 to 10 dimensionality. Our results with both decreases suggest that 10 dimensionality data might be the limit for predicting the possibility of oocyte rupture. Again, although it might be suggested that more dimensionalities should be used for classification, this would demand a larger processing cost, which does not result in the realization of a medical diagnosis support system. Thus, dimensionality data not exceeding 10 would better serve feature vectors for classifying ruptured and nonruptured oocytes.

4.3. Sample Imbalance and Size

The possibility is that a sample size imbalance on the numbers of the ruptured and nonruptured oocytes might influence the analysis for the reasons of no sufficient collection data. In this experiment, the numbers of the ruptured oocytes are smaller than the numbers of the nonruptured oocytes, which is equivalent almost to two-thirds. In generally, SVM seems to perform best with the balanced numbers, the ruptured and nonruputured oocytes in this study. However, our study utilized all the samples except the testing data set for our first step to investigate the effectivity of the proposed methods. In the future, we need to register suitable samples for the ruptured and nonruptured oocytes. In the future, we will collect more data and control the balance of data samples using the random sampling or the propensity score matching for selecting suitable data samples for training to accurately classify them into the groups of the ruptured and nonruptured oocytes.

4.4. Study Limitation

Our study had a relatively small sample size, especially of the ruptured oocytes. We provided the experimental design with the statistical inference to determine whether the founding results are true or incidentally. In this study, all the samples excluding the testing data set were used to investigate the effectiveness of the proposed method as the first stage. The data statistical interpretation was realized by confirming with a statistically significant p-value < 0.05 in the chi-square test to calculate the confusion matrix for assessment of classification. The findings of this study should be interpreted with caution due to the uncertainties regarding baseline data. Future studies should investigate larger sample sizes of oocytes. Although there is a need to explain the physiological mechanism of oocytes, it is important that findings lead to many clinical benefits. Further research is essential to determine the relationship between the possibility of rupture and microscopic frame images and to understand the mechanisms behind the oocytes.

5. Conclusions

In summary, in this study, we found a difference in the image texture of the microscopic movie frames between the ruptured oocytes and nonruptured oocytes. This is the first report, to our knowledge, to find that image processing enables the prediction of whether the oocyte cytoplasmic membrane has a tendency to rupture on Piezo-ICSI. Of particular emphasis is the fact that movie frames can be used as a basis for predicting the rupture possibility for the oocyte cytoplasmic membrane.

Author Contributions

Conceptualization: substantial contributions to the conception or design of the work: N.Y., H.T., T.M. (Takashi Morimoto), T.M. (Tomohiro Maekawa), S.M., T.I., Y.H.; data curation: substantial contributions to the acquisition of data for the work: T.M.(Takashi Morimoto), T.M. (Tomohiro Maekawa), S.M., T.I.; formal analysis: substantial contributions to the analysis, or interpretation of data for the work: N.Y., H.T., Y.H.; validation: final approval of the version to be published: N.Y., H.T., T.M. (Takashi Morimoto), T.M. (Tomohiro Maekawa), S.M., T.I., Y.H.; writing—review and editing preparation: agreement to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved: N.Y., H.T., T.M. (Takashi Morimoto), T.M. (Tomohiro Maekawa), S.M., T.I., Y.H. All authors have read and agreed to the published version of the manuscript.

Funding

This study received no external funding.

Institutional Review Board Statement

The Institutional Review Board approved the study protocol at Reproduction Clinic Tokyo (1 September 2019; No. 2019-T-L-01) and the Graduate School of Information Science, University of Hyogo (28 April 2021; No. 202101). Written informed consent was obtained from all subjects before enrollment. Study procedures were carried out in accordance with the Declaration of Helsinki and the Good Clinical Practice guidelines.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study. Written informed consent was obtained from the subjects to publish this paper.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Katagiri, Y.; Jwa, S.C.; Kuwahara, A.; Iwasa, T.; Ono, M.; Kato, K.; Kishi, H.; Kuwabara, Y.; Harada, M.; Hamatani, T.; et al. Assisted reproductive technology in Japan: A summary report for 2019 by the Ethics Committee of the Japan Society of Obstetrics and Gynecology. Reprod. Med. Biol. 2021, 21, 1–12. [Google Scholar] [CrossRef] [PubMed]
  2. Chambers, G.M.; Dyer, S.; Zegers-Hochschild, F.; de Mouzon, J.; Ishihara, O.; Banker, M.; Mansour, R.; Kupka, M.S.; Adamson, G.D. International committee for monitoring assisted reproductive technologies world report: Assisted reproductive technology, 2014. Hum. Reprod. 2021, 36, 2921–2934. [Google Scholar] [CrossRef]
  3. Palermo, G.; Joris, H.; Devroey, P.; Van Steirteghem, A.C. Pregnancies after intracytoplasmic injection of single spermatozoon into an oocyte. Lancet 1992, 340, 17–18. [Google Scholar] [CrossRef]
  4. Huang, T.; Kimura, Y.; Yanagimachi, R. The use of piezo micromanipulation for intracytoplasmic sperm injection of human oocytes. J. Assist. Reprod. Genet. 1996, 13, 320–328. [Google Scholar] [CrossRef] [PubMed]
  5. Kimura, Y.; Yanagimachi, R. Intracytoplasmic sperm injection in the mouse. Biol. Reprod. 1995, 52, 709–720. [Google Scholar] [CrossRef] [Green Version]
  6. Yanagida, K.; Katayose, H.; Yazawa, H.; Kimura, Y.; Konnai, K.; Sato, A. The usefulness of a piezo-micromanipulator in intracytoplasmic sperm injection in humans. Hum. Reprod. 1999, 14, 448–453. [Google Scholar] [CrossRef] [Green Version]
  7. Palermo, G.D.; Alikani, M.; Bertoli, M.; Colombero, L.T.; Moy, F.; Cohen, J.; Rosenwaks, Z. Oolemma characteristics in relation to survival and fertilization patterns of oocytes treated by intracytoplasmic sperm injection. Hum. Reprod. 1996, 11, 172–176. [Google Scholar] [CrossRef] [Green Version]
  8. Iwayama, H.; Yamashita, M. Quantitative evaluation of intercellular local deformation of human oocytes during Piezo-assisted intracytoplasmic sperm injection using video-based motion analysis. F&S Sci. 2021, 2, 124–134. [Google Scholar]
  9. Rubino, P.; Vigano, P.; Luddi, A.; Piomboni, P. The ICSI procedure from past to future: A systematic review of the more controvercial aspects. Hum. Reprod. Update 2016, 22, 194–227. [Google Scholar] [CrossRef] [Green Version]
  10. Dana, H.B.; Christopher, M.B. Computer Vision; Prentice Hall: Hoboken, NJ, USA, 1982; ISBN 13:9780131653160. [Google Scholar]
  11. He, D.; Wang, L. Texture Unit, Texture Spectrum, And Texture Analysis. IEEE Trans. Geosci. Remote Sens. 1990, 28, 509–512. [Google Scholar]
  12. Ojala, T.; Pietikäinen, M.; Harwood, D. A comparative study of texture measures with classification based on feature distributions. Pattern Recognit. 1996, 29, 51–59. [Google Scholar] [CrossRef]
  13. Huang, D.; Shan, C.; Ardabilian, M.; Wang, Y.; Chen, L. Local binary patterns and its application to facial image analysis: A survey. IEEE Trans. Syst. Man Cybern. Part C 2011, 41, 765–781. [Google Scholar] [CrossRef]
  14. Basile, T.M.A.; Caponetti, L.; Castellano, G.; Sforza, G. A Texture-based image processing approach for the description of human oocyte cytoplasm. IEEE Trans. Instrum. Meas. 2010, 59, 2591–2601. [Google Scholar] [CrossRef]
  15. Wang, R.; Pan, W.; Jin, L.; Li, Y.; Geng, Y.; Gao, C.; Chen, G.; Wang, H.; Ma, D.; Liao, S. Artificial intelligence in reproductive medicine. Reproduction 2019, 158, R139–R154. [Google Scholar] [CrossRef]
  16. Kinishi, Y.; Maekawa, T.; Mizuta, S.; Ishikawa, T.; Hata, Y. Detection of optimal puncture position in ovum images for artificial insemination. In 2019 International Conference on Machine Learning and Cybernetics; IEEE: New York, NY, USA, 2019; pp. 140–144. [Google Scholar]
  17. Maekawa, T.; Mizuta, S.; Kinishi, Y.; Takahashi, C.; Matsubayashi, H.; Kitaya, K.; Takeuchi, T.; Hata, Y.; Ishikawa, T. Identification of the optimal puncture position in PIEZO-ICSI using image analysis: A pilot study. Fertil. Steril. 2019, 112, E279. [Google Scholar] [CrossRef]
  18. Mori, K.; Kitaya, K.; Ishikawa, T.; Hata, Y. Analysis of endometrium form by using LBP for female infertility. In 2018 International Conference on Machine Learning and Cybernetics; IEEE: New York, NY, USA, 2018; pp. 75–79. [Google Scholar]
  19. Morimoto, T.; Maekawa, T.; Mizuta, S.; Matsubayashi, H.; Takeuchi, T.; Hata, Y.; Ishikawa, T. Optimal puncture position for intracytoplasmic sperm injection can be detected by image analysis using Local Binary Pattern. Reprod. BioMed. Online 2022. [Google Scholar] [CrossRef]
  20. Pearson, K. On lines and planes of closest fit to systems of points in space. Philos. Mag. 1901, 2, 559–572. [Google Scholar] [CrossRef] [Green Version]
  21. Abdi, H.; Williams, L.J. Principal component analysis. Wiley Interdiscip. Rev. Comput. Stat. 2010, 2, 433–459. [Google Scholar] [CrossRef]
  22. Vapnik, V.; Lerner, A. Pattern recognition using generalized portrait method. Autom. Remote Control 1963, 24, 774–780. [Google Scholar]
  23. Tsochantaridis, I.; Joachims, T.; Hofmann, T.; Altun, Y. Large margin methods for structured and interdependent output variables. J. Mach. Learn. Res. 2005, 6, 1453–1484. [Google Scholar]
  24. Nakamura, S.; Yagi, N.; Kawamura, N.; Kashioka, H.; Hirata, M.; Maezawa, H.; Yanagida, T.; Hata, Y.; Sakai, Y. Relationship between singing experience and laryngeal movement obtained by DeepLabCut. In 5th IEEE International Conference on Cybernetics (CYBCONF); IEEE: New York, NY, USA, 2021; pp. 073–078. [Google Scholar]
  25. Inoue, K.; Yoshioka, M.; Yagi, N.; Nagami, S.; Oku, Y. Using machine learning and a combination of respiratory flow, laryngeal motion, and swallowing sounds to classify safe and unsafe swallowing. IEEE Trans. Biomed. Eng. 2018, 65, 2529–2541. [Google Scholar] [CrossRef] [PubMed]
  26. Ukai, K.; Rahman, R.; Yagi, N.; Hayashi, K.; Maruo, A.; Muratsu, H.; Kobashi, S. Detecting pelvic fracture on 3D-CT using deep convolutional neural networks with multi-orientated slab images. Sci. Rep. 2021, 11, 11716. [Google Scholar] [CrossRef] [PubMed]
  27. Kohavi, R. A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence; Morgan Kaufmann Publishers Inc.: San Francisco, CA, USA, 1995; Volume 2, pp. 1137–1143. [Google Scholar]
  28. Yagi, N.; Ishikawa, T.; Hata, Y. Stem cell quantity determination in artificial culture bone by ultrasonic testing. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. 2014, 97, 913–922. [Google Scholar] [CrossRef]
  29. Cramér, H. Mathematical Methods of Statistics; Princeton University Press: Princeton, NJ, USA, 1999. [Google Scholar]
  30. William, C.G. The Chi-square Test of Goodness of Fit. Ann. Math. Stat. 1952, 23, 315–345. [Google Scholar]
  31. Power, D.M.W. Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness & Correlation. Int. J. Mach. Learn. Technol. 2011, 2, 37–63. [Google Scholar]
Figure 1. Oocyte under Piezo-ICSI. (A) Nonruptured oocyte. (B) Ruptured oocyte. A1, injection pipette directed toward the center of an oocyte. A2, injection pipette of A1 was inserted more deeply. A3, the injection pipette of A2 was inserted more deeply, and it smoothly penetrated the oocyte cytoplasmic membrane without rupture. B1, an injection pipette directed toward the center of an oocyte. B2, the injection pipette of B1 was inserted more deeply. B3, the injection pipette of B2 was inserted more deeply, and it did not smoothly penetrate the oocyte cytoplasmic membrane with rupture. All images for A1B3 are of 744 pixels width and 453 pixels height.
Figure 1. Oocyte under Piezo-ICSI. (A) Nonruptured oocyte. (B) Ruptured oocyte. A1, injection pipette directed toward the center of an oocyte. A2, injection pipette of A1 was inserted more deeply. A3, the injection pipette of A2 was inserted more deeply, and it smoothly penetrated the oocyte cytoplasmic membrane without rupture. B1, an injection pipette directed toward the center of an oocyte. B2, the injection pipette of B1 was inserted more deeply. B3, the injection pipette of B2 was inserted more deeply, and it did not smoothly penetrate the oocyte cytoplasmic membrane with rupture. All images for A1B3 are of 744 pixels width and 453 pixels height.
Jcm 11 06546 g001
Figure 2. Image of oocyte. (A) Raw frame image of 960 pixels width and 540 pixels height, captured from microscopic movie. (B) Trimming image of 380 pixels width and 370 pixels height specified, based on the raw frame image A, is an analyzed target image.
Figure 2. Image of oocyte. (A) Raw frame image of 960 pixels width and 540 pixels height, captured from microscopic movie. (B) Trimming image of 380 pixels width and 370 pixels height specified, based on the raw frame image A, is an analyzed target image.
Jcm 11 06546 g002
Figure 3. Evaluation results of SVM using four kernels. (A) Linear function. (B) Nonlinear RBF. (C) Non-linear poly function. (D) Nonlinear sigmoid function.
Figure 3. Evaluation results of SVM using four kernels. (A) Linear function. (B) Nonlinear RBF. (C) Non-linear poly function. (D) Nonlinear sigmoid function.
Jcm 11 06546 g003aJcm 11 06546 g003b
Table 1. Classification accuracy in nonlinear kernel of polynomial function in SVM a.
Table 1. Classification accuracy in nonlinear kernel of polynomial function in SVM a.
Sampling FramesDimensionalityAccuracy (%)Sensitivity (%)Specificity (%)
2165.0562.86100.00
273.1269.2393.33
376.8873.7686.67
477.9679.4975.36
582.2684.0779.45
685.4890.2979.52
790.3289.6691.43
886.5688.2984.00
989.7890.9988.00
1089.2591.6785.90
1190.3291.8288.16
3163.8062.03100.00
275.9971.12100.00
377.0673.0691.67
478.4976.6582.93
584.2383.0686.46
685.6687.4383.04
785.6688.8281.36
889.2591.4186.21
991.4091.2391.67
1089.2589.0289.62
1187.1089.5783.62
a The bold means the maximum.
Table 2. Comparison of sampling frames (mean and SD) of classification accuracy in one linear kernel and three nonlinear kernels a.
Table 2. Comparison of sampling frames (mean and SD) of classification accuracy in one linear kernel and three nonlinear kernels a.
Sampling FramesMean and SD of Accuracy (Amount of Change; %)
Liner KernelNonliner Kernel
RBFPolynomial FunctionSigmoid Function
174.00 ± 3.5976.05 ± 5.8780.74 ± 6.2655.43 ± 3.38
274.05 ± 3.72(0.05)76.34 ± 6.10(0.29)82.45 ± 8.31(1.71)52.49 ± 3.06(−2.93)
374.88 ± 3.06(0.83)78.82 ± 5.69(2.48)82.54 ± 8.08(0.08)53.41 ± 3.68(0.91)
474.71 ± 3.42(−0.17)80.45 ± 5.66(1.63)80.55 ± 6.79(−1.99)51.96 ± 3.78(−1.45)
573.84 ± 3.07(−0.87)79.73 ± 6.56(−0.72)79.57 ± 6.17(−0.98)48.54 ± 4.93(−3.41)
a The amount of change means the value compared with one smaller value for sampling frames. The bold means the maximum.
Table 3. Comparison of dimensionality (mean and SD) of classification accuracy in one linear kernel and three nonlinear kernels a.
Table 3. Comparison of dimensionality (mean and SD) of classification accuracy in one linear kernel and three nonlinear kernels a.
DimensionalityMean and SD of Accuracy (Amount of Change; %)
Linear KernelNonlinear Kernel
RBFPolynomial FunctionSigmoid Function
164.81 ± 0.8865.70 ± 2.1665.60 ± 1.2659.67 ± 2.42
275.60 ± 1.08(10.79)69.39 ± 3.86(3.70)74.87 ± 1.86(9.28)55.64 ± 3.77(−4.03)
375.92 ± 1.41(0.32)74.53 ± 0.88(5.14)75.28 ± 1.85(0.41)53.66 ± 1.96(−1.98)
475.32 ± 1.42(−0.61)79.18 ± 1.95(4.65)78.38 ± 0.29(3.09)53.68 ± 2.13(0.01)
576.20 ± 0.54(0.89)79.61 ± 1.55(0.43)81.30 ± 2.65(2.92)51.88 ± 4.20(−1.80)
675.43 ± 1.57(−0.77)80.80 ± 2.03(1.20)83.29 ± 2.26(2.00)51.28 ± 4.12(−0.60)
774.82 ± 1.48(−0.60)82.03 ± 2.45(1.23)86.27 ± 2.41(2.98)50.84 ± 3.74(−0.44)
874.35 ± 1.98(−0.48)82.51 ± 2.62(0.48)86.23 ± 2.00(−0.05)50.23 ± 3.45(−0.60)
974.57 ± 1.13(0.22)82.66 ± 2.48(0.16)87.11 ± 3.23(0.88)50.13 ± 4.21(−0.10)
1074.89 ± 1.10(0.32)82.79 ± 2.63(0.13)87.25 ± 2.22(0.14)49.56 ± 3.65(−0.58)
Additionally
1175.32 ± 0.72(0.43)81.86 ± 1.94(−0.94)87.29 ± 1.91(0.04)49.45 ± 3.20(−0.11)
a The amount of change means the value compared with one smaller value for sampling frames. The bold means the maximum.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Yagi, N.; Tsuji, H.; Morimoto, T.; Maekawa, T.; Mizuta, S.; Ishikawa, T.; Hata, Y. Rupture Prediction for Microscopic Oocyte Images of Piezo Intracytoplasmic Sperm Injection by Principal Component Analysis. J. Clin. Med. 2022, 11, 6546. https://doi.org/10.3390/jcm11216546

AMA Style

Yagi N, Tsuji H, Morimoto T, Maekawa T, Mizuta S, Ishikawa T, Hata Y. Rupture Prediction for Microscopic Oocyte Images of Piezo Intracytoplasmic Sperm Injection by Principal Component Analysis. Journal of Clinical Medicine. 2022; 11(21):6546. https://doi.org/10.3390/jcm11216546

Chicago/Turabian Style

Yagi, Naomi, Hyodo Tsuji, Takashi Morimoto, Tomohiro Maekawa, Shimpei Mizuta, Tomomoto Ishikawa, and Yutaka Hata. 2022. "Rupture Prediction for Microscopic Oocyte Images of Piezo Intracytoplasmic Sperm Injection by Principal Component Analysis" Journal of Clinical Medicine 11, no. 21: 6546. https://doi.org/10.3390/jcm11216546

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop