Next Article in Journal
Analysis of Distributed Measurement Method for Array Antenna Position
Previous Article in Journal
On Solving Large-Size Generalized Cell Formation Problems via a Hard Computing Approach Using the PMP
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements

1
Department of Computer Science & Engineering, Graduate School, Soonchunhyang University, 22 Soonchunhyang-ro, Asan 31538, Korea
2
Department of Occupation Theraphy, College of Medical Sciences, Soonchunhyang University, 22 Soonchunhyang-ro, Asan 31538, Korea
3
Department of Medical IT Engineering, College of Medical Sciences, Soonchunhyang University, 22 Soonchunhyang-ro, Asan 31538, Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(10), 3479; https://doi.org/10.3390/app10103479
Submission received: 9 April 2020 / Revised: 1 May 2020 / Accepted: 14 May 2020 / Published: 18 May 2020
(This article belongs to the Section Computing and Artificial Intelligence)

Abstract

:
As the basis of communication, a writer is often identified through their handwriting characteristics. In clinical practice, static elements of handwriting are evaluated and scored, which might be used for subjective judgment in health situations. By investigating the dynamic information in space when writing Hangul, in this study, we present how to analyze Hangul writing characteristics and build new writing analysis elements in the structural language. The ample characters included 14 consonants and 10 vowels. The cloud of line distribution (COLD) method was used to visualize on-stroke characteristics when writing each character. If the written character showed a straight line (the angle of the letter being 0), the feature distribution appeared on the x-axis of the polar domain. If the written character had many kinks (the angle of the letter being −90 or 90), the feature distribution appeared on the polar domain’s y-axis. In-air movement was visualized using principal component analysis (PCA), and typical in-air movement had an annular shape, which might be used as a new element in handwriting analysis. This study shows the possibility of using such a tool for the writing analysis of structural languages.

1. Introduction

Text is the basis of communication and involves sophisticated activities for describing and expressing thoughts. Writing is a visual representation of the integration of perception, cognitive precession, and exercise planning and execution [1,2,3,4]. Writing is also a high-dimensional function that involves various individual characteristics and is performed through continuous behavioral changes. Therefore, it is widely understood as a process that is characterized by spatial and kinetic parameters, rather than a mere product of hand and finger movements [5,6]. Therefore, pattern and handwriting recognition studies are currently being conducted to analyze individual cursive characteristics for learning, document analysis, crime, signature verification, language translation, and disease prediction [7,8,9,10,11,12]. Writing is an important task in the childhood development process because writing-related regressions in children are likely to negatively affect academic achievement and cause social sentiment problems, thus highlighting the importance of initial screening, arbitration, and inspection [13,14,15]. The disadvantage of clinical evaluation is that accurate analysis is difficult to achieve, given the focus on scoring systems’ exercise factors or evaluation methods, which allow evaluators to interpret results subjectively [4,16]. However, even when writers write in the same language, each writer has a different style [17]. Therefore, objective, reliable writing feature elements should be extracted to analyze individuals’ handwriting.
In other types of handwriting images, information about shape, contrast, and strokes are important characteristics that represent a letter’s components. The extremal region (ER), which has been proposed in previous studies, has immutable features of rotation, scaling, and distortion; however, it does not accurately detect characters [18]. The cloud of line distribution (COLD), which uses polygon approximation methods to detect dominance in English and find unique attributes based on angle information, emerged as a method to address this flaw [17,18,19]. COLD is widely used for handwriting recognition and represents different distributions depending on density, slope, and curvature. Thus, the COLD distribution pattern for static elements can identify writers and, in turn, be used for document and image classification [17]. These point-based feature variables can generally yield high accuracy and reliability, which are comparable to those that can be achieved using time-consuming parameters in handwriting analysis [5,10,20]. Typically, online handwriting can store three-dimensional motion (on-surface and in-air movements), dynamic information (time, pressure, etc.), and static information (on-surface movements) that is obtained when written on the ground [6,7,10]. Therefore, it is possible to compare two signatures or characterize the kinematic analysis of handwriting movements [7,21,22]. However, most studies pertained to on-surface contexts [23,24,25,26]. He and Schomaker [17] were able to distinguish writers who wrote the same article based on COLD characteristics. The writing’s slope was also ascertained based on its characteristics and direction of distribution. With COLD, handwriting with an irregular curvature in the centralized distribution corresponds to a writing with a high curvature and scattered distribution. Wang et al. [18] and Wang et al. [19] used letters containing COLD to detect letters in images. Furthermore, Zuo et al. [27] applied COLD to personal handwriting identification through principal component analysis (PCA) of grayscale images.
In-air movements (which refers to the moments when the pen is taken off a surface and the movements in space when writing) entail fine hand and arm motions. They can also represent kinetic characteristics. Yin et al. [28] used PCA to recognize in-air writing gestures in a three-dimensional space. However, this was projected into a two-dimensional plane to facilitate representation. Thus, the need for in-air movement research is increasing [29,30]. However, the languages that have been used and studied during on-surface and in-air analyses and experimentation are limited, requiring basic research on languages with structural characteristics.
When compared to many of characteristics of the world’s languages, Hangul has different characteristics, patterns, and structures. The strokes that comprise the letters are concise and visually distinct, incorporating horizontal, vertical, square, and circular characters. Hangul is a phonetic alphabet that is comprised of a combination of syllable units, thus eliminating the need to arrange each consonant in a single line and write down phonemes (the smallest unit of speech). This is called a syllabic writing system. Syllabic writing systems consist of 14 basic consonants (ㄱ-ㅎ) and 10 basic vowels (ㅏ-ㅣ) (Figure 1) and are organized please check intended meaning has been retained (Figure 2). Therefore, in comparison with other languages, Hangul involves more movements in which the pen touches a surface and falls when writing a meaningful character. The direction of movement may also vary depending on the order of the letters. This feature can only be found in union languages. Furthermore, since Hangul can produce 11,172 written syllables in combination with words, it can be interpreted as having a different meaning if the rhyme is different [31]. For example, the Korean word 눈 can have two meanings depending on the pronunciation, either “eye” and “snow.” Meanwhile, 배 can have three meanings, including “belly,” “pear,” and “ship.” Therefore, it is necessary to understand the words’ meanings and contexts both before and after a sentence or conversation. Along with literacy, these phonetic abilities are essential spelling technology elements as they comprise the basic steps of spelling. Thus, phonetic spelling skills from the fundamental stage of spelling and error analysis necessitate research on early development trends [32]. The study of spelling development in Korea is in its early stages, requiring active research in special education, language therapy, and Korean linguistics and language education. In this study, we aimed to present basic data on Hangul cursive writing characteristics and new writing analysis elements by utilizing three-dimensional movement and dynamic information in the space that appears when writing basic consonants on tablets.

2. Materials and Methods

2.1. Subjects

All 24 participants (age: 22.5 ± 2.35) were diagnosed as being free of neurological conditions. The inspection paper selected 24 basic consonants and vowels in Hangul. The upper line was placed according to the order of the consonants, while the lower line was placed according to the order of the vowels (Figure 3) [4,33]. The inspection paper compartments were 1.7 × 1.7   cm .

2.2. Tablet

Using a table (Wacom Cintique 13HD, Wacom Co., Saitama, Japan) and MovAlyzeR software (NeuroScript, LLC, Tempe, AZ, USA), write-inspection was rendered on the tablet screen at the same size as A4 paper. As soon as the tablet pen touched the screen, the coordinates were saved. In-air coordinates were collected over time. After separating in-air pen movements (in the air) from on-stroke pen movements (on the tablet screen), the data were extracted by calculating the size, pressure (MAX.1024) [34], in-air and on-stroke times, and velocity by 200 Hz.

2.3. Cloud of Line Distribution (COLD)

As a method, COLD finds a dominant point and expresses it in the polar domain based on the curve consisting of the line’s characteristics [17,35]. In this study, the on-stroke and in-air movements were separated by writing pressure using the developed system. To analyze the distribution pattern of static elements, only pressures above zero were recognized and displayed on the screen. The reason the pressure was above zero is because writers wrote on the screen. The consonants and vowels were then cropped to 70 × 70 pixels and stored as images. Finding the boundaries of letters with a canny edge, the cropped image followed Otsu binarization, which is not sensitive to noise and extracts strong edges [19].
The angle of the vector around a letter’s boundaries was defined as vector v, vector length l. Dominant point a = { P i ( x i ,   y i )   |   i = 1 ,   2 ,   3 n } coordinates were obtained using Equation (1). In this study, the number of dominant points was expressed as n, the coordinates were ( x i ,   y i ) , and the number was set to eight.
a = a b s ( c o s 1 ( v 1 × v 2 l 1 × l 2 ) × ( l 1 × l 2 ) )
The coordinates ( θ ,   γ ) were calculated based on Equations (2) and (3) by setting the image angle θ and line segments γ for representation in the polar domain. In addition, line segments k = 1 were calculated and established to clearly show the character characteristics in this study [8,17]. Later, the distribution pattern was saved as a 420 × 560 TIF file.
θ = t a n 1 ( y i + 1 y i x i + 1 x i )
γ = a b s ( ( y i + 1 y i ) 2 + ( x i + 1 x i ) 2 )

2.4. Principal Component Analysis (PCA)

As the dataset’s characteristics increased, the dimension also increased. As the data dimensions increased, the volume of data space also increased exponentially. Therefore, the density of the data became sparse as the dimensions increased. In addition, as the dimension of the data increased, the distance between datapoints also increased, which is called the curse of dimensionality. As a technique to address this, PCA converts samples of high-dimensional space into low-dimensional space without linear association with the aim of finding a new basis that preserves the distribution of the original data as much as possible [36,37,38,39]. In this study, only coordinates with pressures of zero were recognized to analyze the movement in space. The reason the pressure was zero is because it moved in space. The average centralization of Equation (4) was performed for raw data X to ensure that the first component represented the maximum direction of distribution when performing PCA.
X n e w = X r a w m e a n
After calculating the eigenvalues λ and eigenvectors e of the covariance matrix C, Equation (5) of m × n data, we then internalized the eigenvector and X to convert new bases and data that were orthogonal to each other [36].
C X = 1 N X X T

3. Results

3.1. Cloud of Line Distribution (COLD) Features

Figure 4 presents the COLD results for 14 consonants (Figure 4a) and 10 vowels (Figure 4b). These include 192 dots representing all eight dominant points extracted from 24 images cropped and stored by 24 writers. The COLD results were skewed to the right because the range of the arctangent was π 2 < t a n 1 < π 2 , and the line segments were taken as the absolute value. The absolute value was justified because the orientation of the length did not need to be considered, and a distinct difference was visually observable when the distribution characteristics were brought together. In the polar domain, the x-axis did not differ significantly with respect to the angle, while the y-axis was represented by a dense distribution of features when it differed significantly in angle. Furthermore, short lines of line segments represented points at the center of the polar domain, while the lines of the line segments represented points far from the center. ㅡ is a typical example of a line pattern with little difference in angles. Meanwhile, ㅣ is a typical example of a short pattern, although there are many differences in angles. In addition, ㅅ is a typical example of a text with a characteristically symmetrical form of writing in which COLD results also showed a symmetrical form of angle and length relative to zero degrees on the x-axis. ㅇ and ㅎ are circular characters with varying degrees of angles in the letter. However, the point-to-point distance is a representative example of a short pattern. These results explain the general distribution patterns for each consonant and vowel of on-stroke movements. If the COLD results of other writers differed from the distribution patterns of this study, it can be confirmed that the characters were written in different characters or curved surfaces, stair formation, or short or long lengths. As such, one distribution pattern identifies the character characteristics of the writer and allows for an analysis of the individuals.

3.2. PCA Features

Figure 5 presents the results of 10 PCAs. Each color represents one writer’s results. In Figure 5, we can see that the distribution of data is divided on both sides. This is because when we write, we generally move from left to right, as shown in Figure 3. When participants wrote all 14 consonants and then changed lines to write, the y-axis changed greatly, and moved from right to left and then wrote. Therefore, the upper distribution (Figure 6b) is the result of consonants, and the lower one (Figure 6c) is the distribution of vowels. At this time, the x-axis is the number of the row, and the y-axis is the result of PCA. With PCA, the larger the variance, the wider the spread of the dots on the axis, and the more information is made available. At this time, reducing three-dimensional motion to one dimension may result in information loss, but as a result of this study, data could be preserved at an average of 97.59%. This enabled the use of reliable data. Thus, a short stay in the air produced a mild brown line result with respect to the slope of the baseline, while a long stay in the air resulted in a steep pink line (Figure 6a). In-air movement was also observed in this case (Figure 6b,c), where the turquoise is shown in a ring form and not in pink. The ring-shaped writing style appeared because Hangul’s writing style is lower than the starting point, where the stroke of the letter ends; meanwhile, movement from the end point to the starting point was constant. Thus, the PCA results showed no ring figure, meaning either that the pen was moved somewhere else or that there was hesitation near the point at which the stroke of the letter ends. Figure 6b,c show a void in the middle of the pink line, indicating that neither hesitation in writing nor in-air movements were detected. This also means that the pen was removed from the tablet and used for rewriting. This allows the writer to see if his or her concentration and movement are constant when performing the writing and to visually check the time of the writing.

4. Discussion

As the basis of sophisticated communication, writing is a visual representation of integrated perception, cognitive processing, and exercise planning and execution. Writing is also a high-dimensional function in which a person’s unique characteristics are revealed through continuous behavioral changes. Handwriting activates specific areas of the brain, allowing it to predict reading and mathematical abilities in addition to writing abilities [26]. Therefore, detailed, sophisticated handwriting analysis is needed; however, evaluators and inspectors can proceed using a paper inspection sheet in a defined environment. Furthermore, clinical writing can be assessed using a scoring system that judges the form, presentation, and writing ability of a writing sample without providing any specific measurements. This highlights the need for tool development in the area of assessment and intervention. Such a tool requires careful analysis and cannot be overlooked in the interest of proper intervention for individuals who stand to benefit [40,41].
In this study, the COLD characteristics of on-stroke and in-air PCA, which can be seen in the dynamic information obtained from tablet writing, were intended to report on the potential for writing patterns and analysis elements. The experiment was conducted on 24 adults (age: 22.5 ± 2.35) who did not have neurological conditions.
From the COLD distribution, only the morphological appearance of the consonants and vowels showed that ㄱ, ㄴ, ㅏ, ㅓ, ㅗ and ㅜ all consist of two lines that are horizontal and vertical and have similar patterns. In addition, if the sequence of strokes is not considered in the actual writing experiment, ㅓ and ㅜ can be written similarly to ㄱ, because ㅓ and ㅜ are used in one stroke. In the case of ㅗ and ㅜ, the horizontal line takes a longer form because the ㅡ line is longer. Therefore, it was possible to see a shape in which dots are concentrated on the x-axis rather than the y-axis. ㄷ, ㅑ, ㅕ, and ㅠ added one line to the preceding vowel, which was visually confirmed as having a similar pattern. ㅑ and ㅕ have a slightly curved shape, rather than a horizontal one, owing to changes in angles that are not parallel to the horizontal line when writing two strokes across. Thus, the distribution of points is symmetrically spread around the x-aixs. ㅋ is a stroke that is different from ㄱ, but the pattern did not look similar as it showed differences in the order, length, and angle of the strokes. Therefore, ㅋ could produce a distribution of points in the center rather than the characteristics of the x and y axes. ㅛ also added a stroke to ㅗ, while the ㅡ section was often short when only the vowels were used, with each writer showing a visible difference in stroke order and length. It can be explained that the distribution length of the y-axis is shorter and that the ㅛ is slightly spread rather than concentrated on the x-axis. ㅁ and ㅂ are similar consonants, but the distribution results showed visible differences. With respect to ㅁ, there were many scribbles where writers wrote in single strokes or in the form of upside-down triangles, such as ㅇ. Thus, the horizontal and vertical stroke features were found in the polar domain because there were various types of writing. ㄹ and ㅇ had many variations in terms of the order of strokes, so various distribution results were visible without showing direction. ㅌ and ㅍ have many handwriting formats that do not take the stroke sequence into account, and each writer can have a different style. Therefore, different patterns can be identified visually. ㅅ, ㅈ and ㅊ are more pronounced with angle variations in strokes than with other consonants. ㅅ had a long, visible stroke in the angle of change. Thus, we could see a symmetrical shape on the x-axis rather than on the x-axis and y-axis. In the case of ㅊ and ㅎ, the characters are made by adding strokes to ㅈ and ㅇ, respectively, compared to other consonants. Each writer showed different strokes, resulting in different results to other consonants. This means that the changes in angle and length were different for each writer, and it can be seen that there were various distribution based on the center. The relationship between the speed that appeared in the vertical and horizontal directions depended on both the writer and the letter. This can be used to provide additional information and improve the system’s performance during handwriting analysis.
Since handwriting is associated with several movements and motor skills, pauses and hesitations within a series of handwriting acts influence writing ability [42,43]. Indeed, skilled writers’ in-air movements are less fragile and not much movement in space can be seen. However, unskilled writers’ in-air movements—for example, the movements of patients with writing disorders, dyslexia, and Parkinson’s disease—can be observed as inconsistent and brittle [29]. This study analyzed in-air movements that were obtained in real time through the visualization of PCA. Skilled writers showed an annular appearance, whereas unskilled writers who were unable to concentrate, who hesitated, or who so much as removed their hands from the table and rewrote, produced S-shaped or empty appearances. Overall, this study’s results suggest that in-air analysis is possible through morphological patterns and the visualization of PCA, and this can be used as an element of new handwriting analysis.
The development of digital devices has allowed for new systems to be used at various learning sites, thus increasing the need for new analytical elements to provide a thorough assessment of both users’ learning abilities and performance procedures. Studies that aim to fulfill these needs are underway [44,45,46]. Bonneton-Botté et al. [22] and Neumann [47] include notes on tables that are applicable to children, objectifying the added value of the digital learning environment. Meanwhile, Rosemblum et al. [48] and Vessio [49] have indicated that Parkinson’s disease patients’ on-stroke and in-air handwriting features could provide meaningful applications for cost-effective, rapid, and reliable medical diagnoses. Moreover, Sesa-Nogueras [50] has suggested that in-air movements can offer as much information as on-stroke movements can, and can also be used in recognition. In addition, it was revealed that Parkinson’s disease can be assessed by analyzing on-surface and in-air movements in Drotár [29] and dynamic information of writing in Moetesum et al. [51]. The reason we can distinguish between normal people and patients is that patients with Parkinson’s disease can see irregular patterns and non-smooth forms of Archimedean spiral patterns, and size and shape gradually change. Therefore, it is believed that this study’s results—on-stroke COLD pattern and in-air PCA—will be the basis for writing analysis. Furthermore, since Hangul is uncomplicated and concisely expressed, with a clear visual distinction when compared to other languages, it can be used as basic data for structural language, in addition to being used in data and analysis systems for learning evaluations based on basic shapes, given that it consists of basic strokes in the form of straight lines, circles, and squares. Other applications include medical diagnosis and rehabilitation process analysis using Parkinson’s disease patients’ writing, for instance, as well as write-through analysis.

5. Conclusions

As the most sophisticated communication skill, writing is an evaluation factor that measures children’s development and the integration of adult vision movements; however, presently, it is only being assessed using static feature elements and evaluators’ subjective interpretations. In addition, as learning with digital devices increases, there is a need for new analytical elements for tools and methods to analyze writing digitally. Therefore, in this study, objective and consistent data were obtained using tablets to present basic data on the writing characteristics and new writing analysis elements of Hangul, a structural language. Afterwards, a static element was analyzed using COLD, and movements during writing were analyzed using PCA. First, COLD was used to visually identify the characteristics of each character. Characters consisting of horizontal and vertical lines were distributed on the x-and y-axes, respectively. However, in the case of letters with several kinks or variations in angles, such as ㅇ or ㅎ, the distribution patterns were independent of the axis. In addition, the shorter the line segments, the more distributed the dots around the polar domain were, and the longer lines were scattered far away. Next, as a result of PCA, the shorter the time spent engaged in in-air movement, the less urgent the slope of the baseline, but the longer the time, the more urgent the slope of the baseline. In addition, writing movements in space generally showed ring-shaped features. This study has proved that visual pattern analysis and thr evaluation of dynamic elements that show patterns and movements in static elements through tablets are possible. In addition, a new analytical element was presented as a digital writing evaluation tool. We intend to conduct a study involving structural letters, words, and sentences in combination with future consonants and vowels. We also plan to develop a system that allows data to take the form of big data in order to examine writing disorder interventions and assessments, and rehabilitation or learning progress.

Author Contributions

Conceptualization, E.B.K. and E.Y.K. and O.L.; methodology and software E.B.K.; writing—original draft, E.B.K.; writing—review and editing, E.B.K. and O.L.; supervision, O.L.; All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Soonchunhyang University Research Fund and a National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (2019R1F1A1058827).

Conflicts of Interest

Authors have no conflicts of interest to declare.

References

  1. Reisman, J.E. Development and reliability of the research version of the Minnesota Handwriting Test. Phys. Occup. Ther. Pediatr. 1993, 13, 41–55. [Google Scholar] [CrossRef]
  2. Gu, Y.; Hong, S.; Lee, K.; Son, J.; Kim, D. Relationship between Written Expression and Writing Fluency among Primary Grade Students. Korea J. Learn. Disabil. 2008, 5, 43–59. [Google Scholar]
  3. Kim, D.; Lee, J.; Lee, M. Meta-analysis of Writing Learning Disability for Single-subject Intervention Researches in Korea. Korea J. Learn. Disabil. 2013, 10, 73–82. [Google Scholar]
  4. Kim, E.-B.; Lee, C.-H.; Kim, E.-Y.; Lee, O. Quantitative image processing analysis for handwriting legibility evaluation. J. Korea Acad. -Ind. Coop. Soc. 2019, 20, 158–165. [Google Scholar]
  5. Tucha, O.; Tucha, L.; Lange, K.W. Graphonomics, automaticity and handwriting assessment. Literacy 2008, 42, 145–155. [Google Scholar] [CrossRef]
  6. Gerth, S.; Dolk, T.; Klassert, A.; Fliesser, M.; Fischer, M.H.; Nottbusch, G.; Festman, J. Adapting to the surface: A comparison of handwriting measures when writing on a tablet computer and on paper. Hum. Mov. Sci. 2016, 48, 62–73. [Google Scholar] [CrossRef]
  7. Xia, X.; Chen, Z.; Luan, F.; Song, X. Signature alignment based on GMM for on-line signature verification. Pattern Recognit. 2017, 65, 188–196. [Google Scholar] [CrossRef]
  8. Nag, S.; Shivakumara, P.; Wu, Y.; Pal, U.; Lu, T. New COLD Feature Based Handwriting Analysis for Enthnicity/Nationality Identification. In Proceedings of the 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR), Niagara Falls, NY, USA, 5–8 August 2018. [Google Scholar]
  9. Guilbert, J.; Alamargot, D.; Morin, M.-F. Handwriting on a tablet screen: Role of visual and proprioceptive feedback in the control of movement by children and adults. Hum. Mov. Sci. 2019, 65, 30–41. [Google Scholar] [CrossRef]
  10. Diaz, M.; Ferrer, M.A.; Impedovo, D.; Pirlo, G.; Vessio, G. Dynamically enhanced static handwriting representation for Parkinson’s disease detection. Pattern Recognit. Lett. 2019, 128, 204–210. [Google Scholar] [CrossRef]
  11. Husnain, M.; Saad Missen, M.M.; Mumtaz, S.; Jhanidr, M.Z.; Coustaty, M.; Muzzamil Luqman, M.; Ogier, J.-M.; Sang Choi, G. Recognition of Urdu Handwritten Characters Using Convolutional Neural Network. Appl. Sci. 2019, 9, 2758. [Google Scholar] [CrossRef] [Green Version]
  12. Abiyev, R.H.; Arslan, M.; Idoko, J.B. Sign Language Translation Using Deep Convolutional Neural Networks. KSII Trans. Internet Inf. Syst. 2020, 14, 631–653. [Google Scholar]
  13. Wilson, J.; Olinghouse, N.G.; McCoach, D.B.; Santangelo, T.; Andrada, G.N. Comparing the accuracy of different scoring methods for identifying sixth graders at risk of failing a state writing assessment. Assess. Writ. 2016, 27, 11–23. [Google Scholar] [CrossRef]
  14. Costa, L.-J.; Green, M.; Sideris, J.; Hooper, S.R. First-grade cognitive predictors of writing disabilities in grades 2 through 4 elementary school students. J. Learn. Disabil. 2018, 51, 351–362. [Google Scholar] [CrossRef] [PubMed]
  15. Donica, D.K.; Holt, S. Examining Validity of the Print Tool Compared With Test of Handwriting Skills–Revised. OTJR Occup. Particip. Health 2019, 39, 167–175. [Google Scholar] [CrossRef] [PubMed]
  16. Shin, J. The Validity of Curriculum-Based Measurement in Writing for Screeing Students at risk for Writing Disabilities: A Meta-Analysis. Korea J. Learn. Disabil. 2019, 16, 101–122. [Google Scholar]
  17. He, S.; Schomaker, L. Writer identification using curvature-free features. Pattern Recognit. 2017, 63, 451–464. [Google Scholar] [CrossRef]
  18. Wang, W.; Wu, Y.; Palaiahnakote, S.; Lu, T.; Liu, J. Cloud of Line Distribution for Arbitrary Text Detection in Scene/Video/License Plate Images. In Proceedings of the Pacific Rim Conference on Multimedia, Harbin, China, 28–29 September 2017. [Google Scholar]
  19. Wang, W.; Wu, Y.; Shivakumara, P.; Lu, T. Cloud of Line Distribution and Random Forest Based Text Detection from Natural/Video Scene Images. In Proceedings of the International Conference on Multimedia Modeling, Bankok, Thailand, 5–7 February 2018. [Google Scholar]
  20. Jain, A.K.; Griess, F.D.; Connell, S.D. On-line signature verification. Pattern Recognit. 2002, 35, 2963–2972. [Google Scholar] [CrossRef]
  21. Kumar, P.; Saini, R.; Roy, P.P.; Pal, U. A lexicon-free approach for 3D handwriting recognition using classifier combination. Pattern Recognit. Lett. 2018, 103, 1–7. [Google Scholar] [CrossRef]
  22. Bonneton-Botté, N.; Fleury, S.; Girard, N.; Le Magadou, M.; Cherbonnier, A.; Renault, M.; Anquetil, E.; Jamet, E. Can tablet apps support the learning of handwriting? An investigation of learning outcomes in kindergarten classroom. Comput. Educ. 2020, 151, 103831. [Google Scholar] [CrossRef] [Green Version]
  23. Van Gemmert, A.; Adler, C.H.; Stelmach, G. Parkinson’s disease patients undershoot target size in handwriting and similar tasks. J. Neurol. Neurosurg. Psychiatry 2003, 74, 1502–1508. [Google Scholar] [CrossRef] [Green Version]
  24. Berninger, V.W.; Nagy, W.; Tanimoto, S.; Thompson, R.; Abbott, R.D. Computer instruction in handwriting, spelling, and composing for students with specific learning disabilities in grades 4–9. Comput. Educ. 2015, 81, 154–168. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Nackaerts, E.; Nieuwboer, A.; Broeder, S.; Smits-Engelsman, B.C.; Swinnen, S.P.; Vandenberghe, W.; Heremans, E. Opposite effects of visual cueing during writing-like movements of different amplitudes in Parkinson’s disease. Neurorehabilit. Neural Repair 2016, 30, 431–439. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Wollscheid, S.; Sjaastad, J.; Tømte, C. The impact of digital devices vs. Pen (cil) and paper on primary school students’ writing skills—A research review. Comput. Educ. 2016, 95, 19–35. [Google Scholar] [CrossRef]
  27. Zuo, L.; Wang, Y.; Tan, T. Personal handwriting identification based on PCA. In Proceedings of the Second International Conference on Image and Graphics, Hefei, China, 16–18 August 2002. [Google Scholar]
  28. Yin, Y.; Xie, L.; Gu, T.; Lu, Y.; Lu, S. AirContour: Building Contour-based Model for In-Air Writing Gesture Recognition. ACM Trans. Sens. Netw. (TOSN) 2019, 15, 1–25. [Google Scholar] [CrossRef]
  29. Drotár, P.; Mekyska, J.; Rektorová, I.; Masarová, L.; Smékal, Z.; Faundez-Zanuy, M. Analysis of in-air movement in handwriting: A novel marker for Parkinson’s disease. Comput. Methods Programs Biomed. 2014, 117, 405–411. [Google Scholar] [CrossRef] [PubMed]
  30. Jerkovic, V.M.; Kojic, V.; Miskovic, N.D.; Djukic, T.; Kostic, V.S.; Popovic, M.B. Analysis of on-surface and in-air movement in handwriting of subjects with Parkinson’s disease and atypical parkinsonism. Biomed. Eng. Biomed. Tech. 2019, 64, 187–194. [Google Scholar] [CrossRef]
  31. Yoon, H. The Characteristics of decoding process in Korean Scripts, Hangul. Korean J. Hum. Dev. 2001, 8, 27–43. [Google Scholar]
  32. Yang, M. Spelling Development of Kindergarten Students: A one Year Longitudinal Study. Korean Acad. Speech-Lang. Pathol. Audiol. 2009, 14, 14–33. [Google Scholar]
  33. Lee, C.H.; Kim, E.B.; Lee, O.; Kim, E.Y. Development of the Korean Handwriting Assessment for Children Using Digital Image Processing. KSII Trans. Internet Inf. Syst. 2019, 13, 4241–4254. [Google Scholar]
  34. Rosenblum, S.; Dror, G. Identifying developmental dysgraphia characteristics utilizing handwriting classification methods. IEEE Trans. Hum. Mach. Syst. 2016, 47, 293–298. [Google Scholar] [CrossRef]
  35. Choudhury, H.; Prasanna, S.M. Representation of online handwriting using multi-component sinusoidal model. Pattern Recognit. 2019, 91, 200–215. [Google Scholar] [CrossRef]
  36. Shlens, J. A tutorial on principal component analysis. arXiv 2014, arXiv:1404.1100. [Google Scholar]
  37. Alginahi, Y.M.; Mudassar, M.; Kabir, M.N. An Arabic Script Recognition System. KSII Trans. Internet Inf. Syst. 2015, 9. [Google Scholar] [CrossRef]
  38. Wan, M.; Lai, Z. Feature Extraction via Sparse Difference Embedding (SDE). KSII Trans. Internet Inf. Syst. 2017, 11. [Google Scholar] [CrossRef]
  39. Li, F.; Li, X.; Wang, F.; Zhang, D.; Xia, Y.; He, F. A Novel P300 Classification Algorithm Based on a Principal Component Analysis-Convolutional Neural Network. Appl. Sci. 2020, 10, 1546. [Google Scholar] [CrossRef] [Green Version]
  40. Ko, S.-Y.; Paek, Y.-S.; Kil, H.; Jin, M.; Sakura, Y.; Son, S.-H. Meta-analysis of single subject researches for students with difficulty in writing: Focusing on students with mild intellectual disabilities, learning disabilities, and low achievement. J. Spec. Educ. Theory Pract. 2018, 19, 123–148. [Google Scholar] [CrossRef]
  41. Williams, C.; Beam, S. Technology and writing: Review of research. Comput. Educ. 2019, 128, 227–242. [Google Scholar] [CrossRef]
  42. Rosenblum, S.; Parush, S.; Weiss, P.L. The in air phenomenon: Temporal and spatial correlates of the handwriting process. Percept. Mot. Ski. 2003, 96, 933–954. [Google Scholar] [CrossRef]
  43. Mucha, J.; Mekyska, J.; Galaz, Z.; Faundez-Zanuy, M.; Lopez-de-Ipina, K.; Zvoncak, V.; Kiska, T.; Smekal, Z.; Brabenec, L.; Rektorova, I. Identification and monitoring of Parkinson’s disease dysgraphia based on fractional-order derivatives of online handwriting. Appl. Sci. 2018, 8, 2566. [Google Scholar] [CrossRef] [Green Version]
  44. Holdich, C.; Holdich, R.G.; Chung, P.W. Assessing aspects of children’s written grammar: Automating the process. Comput. Educ. 2002, 39, 37–50. [Google Scholar] [CrossRef] [Green Version]
  45. Jun, W.; Hong, S.-K. A Study on Development of Quality Standards of Educational Smart Contents. KSII Trans. Internet Inf. Syst. 2014, 8. [Google Scholar] [CrossRef]
  46. Pacheco-Venegas, N.D.; López, G.; Andrade-Aréchiga, M. Conceptualization, development and implementation of a web-based system for automatic evaluation of mathematical expressions. Comput. Educ. 2015, 88, 15–28. [Google Scholar] [CrossRef]
  47. Neumann, M.M. Young children’s use of touch screen tablets for writing and reading at home: Relationships with emergent literacy. Comput. Educ. 2016, 97, 61–68. [Google Scholar] [CrossRef] [Green Version]
  48. Rosenblum, S.; Samuel, M.; Zlotnik, S.; Erikh, I.; Schlesinger, I. Handwriting as an objective tool for Parkinson’s disease diagnosis. J. Neurol. 2013, 260, 2357–2361. [Google Scholar] [CrossRef] [PubMed]
  49. Vessio, G. Dynamic Handwriting Analysis for Neurodegenerative Disease Assessment: A Literary Review. Appl. Sci. 2019, 9, 4666. [Google Scholar] [CrossRef] [Green Version]
  50. Sesa-Nogueras, E.; Faundez-Zanuy, M.; Mekyska, J. An information analysis of in-air and on-surface trajectories in online handwriting. Cogn. Comput. 2012, 4, 195–205. [Google Scholar] [CrossRef]
  51. Moetesum, M.; Siddiqi, I.; Vincent, N.; Cloppet, F. Assessing visual attributes of handwriting for prediction of neurological disorders—A case study on Parkinson’s disease. Pattern Recognit. Lett. 2019, 121, 19–27. [Google Scholar] [CrossRef]
Figure 1. This is the order in which consonants and vowels are written in the elementary school curriculum.
Figure 1. This is the order in which consonants and vowels are written in the elementary school curriculum.
Applsci 10 03479 g001
Figure 2. Six types of consonants and vowels in Hangul.
Figure 2. Six types of consonants and vowels in Hangul.
Applsci 10 03479 g002
Figure 3. The test paper was produced using 14 Korean consonants and 10 vowels. The upper line displays the Korean consonants, while the lower line shows the vowels. The test paper represented black in on-stroke and red in in-air movement.
Figure 3. The test paper was produced using 14 Korean consonants and 10 vowels. The upper line displays the Korean consonants, while the lower line shows the vowels. The test paper represented black in on-stroke and red in in-air movement.
Applsci 10 03479 g003
Figure 4. This represents the cloud of line distribution (COLD) results for a tablet writing test, featuring results for each consonant and each vowel, where (a) shows 14 consonant results (which is covered red line) and (b) shows 10 vowel results (which is covered blue line).
Figure 4. This represents the cloud of line distribution (COLD) results for a tablet writing test, featuring results for each consonant and each vowel, where (a) shows 14 consonant results (which is covered red line) and (b) shows 10 vowel results (which is covered blue line).
Applsci 10 03479 g004
Figure 5. This represents the principal component analysis (PCA) results of ten representative in-air data, where each color represents a datapoint. A line in the same color is a basis line based on the PCA results of the in-air data.
Figure 5. This represents the principal component analysis (PCA) results of ten representative in-air data, where each color represents a datapoint. A line in the same color is a basis line based on the PCA results of the in-air data.
Applsci 10 03479 g005
Figure 6. (a) shows the two most informative results for the ten representative in-air data PCA results, where (b) is an amplification of the results for consonants (drawn from the two results in (a) that the upper distribution) and (c) is an amplification of the results for the vowel (also drawn from the two results in (a) that lower distribution).
Figure 6. (a) shows the two most informative results for the ten representative in-air data PCA results, where (b) is an amplification of the results for consonants (drawn from the two results in (a) that the upper distribution) and (c) is an amplification of the results for the vowel (also drawn from the two results in (a) that lower distribution).
Applsci 10 03479 g006

Share and Cite

MDPI and ACS Style

Kim, E.B.; Kim, E.Y.; Lee, O. Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements. Appl. Sci. 2020, 10, 3479. https://doi.org/10.3390/app10103479

AMA Style

Kim EB, Kim EY, Lee O. Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements. Applied Sciences. 2020; 10(10):3479. https://doi.org/10.3390/app10103479

Chicago/Turabian Style

Kim, Eun Bin, Eun Young Kim, and Onseok Lee. 2020. "Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements" Applied Sciences 10, no. 10: 3479. https://doi.org/10.3390/app10103479

APA Style

Kim, E. B., Kim, E. Y., & Lee, O. (2020). Meta-Analyzing the Writing Process of Structural Language to Develop New Writing Analysis Elements. Applied Sciences, 10(10), 3479. https://doi.org/10.3390/app10103479

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop