Abstract
Nowadays, different automatic systems for writer identification and verification are available. On-line writer identification through automatic analysis of handwriting acquired with a tablet has been widely studied. Furthermore, the recent development of Commercial Off-The-Shelf (COTS) wearables with integrated inertial measurement units (IMUs) recording limbs movement allows the study of handwriting movements executed on the air. The goal of this paper is to compare the performance of an online writer identification system while processing 2D data acquired by a tablet while writing on-paper and 3D data acquired by a smartwatch while writing on-air. To this end, a database of handwriting samples produced by the same writers while writing the same symbols in the two modalities has been built up. The results of the study show a performance gap smaller than 5% between the 2D and 3D top implementations of the system, confirming that 3D handwriting is a promising alternative for developing wearable user authentication system.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Data Availability Statement
The feature sets used in the experiments are freely available for research purposes at https://github.com/Natural-Computation-Lab/2D_vs_3D_handwriting.
References
Aha, D.W., Kibler, D., Albert, M.K.: Instance-based learning algorithms. Mach. Learn. 6(1), 37–66 (1991)
Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)
Ansari, A.R., Bradley, R.A., et al.: Rank-sum tests for dispersions. Ann. Math. Stat. 31(4), 1174–1189 (1960)
Bailador, G., Sanchez-Avila, C., Guerra-Casanova, J., de Santos Sierra, A.: Analysis of pattern recognition techniques for in-air signature biometrics. Pattern Recogn. 44(10–11), 2468–2478 (2011)
Berman, S., Stern, H.: Sensors for gesture recognition systems. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 42(3), 277–290 (2011)
Bhatia, S., Bhatia, P., Nagpal, D., Nayak, S.: Online signature forgery prevention. Int. J. Comput. Appl. 75(13), 21–29 (2013)
Blasco, J., Chen, T.M., Tapiador, J., Peris-Lopez, P.: A survey of wearable biometric recognition systems. ACM Comput. Surv. (CSUR) 49(3), 1–35 (2016)
Carmona-Duarte, C., Ferrer, M.A., Parziale, A., Marcelli, A.: Temporal evolution in synthetic handwriting. Pattern Recogn. 68, 233–244 (2017)
Ciuffo, F., Weiss, G.M.: Smartwatch-based transcription biometrics. In: 2017 IEEE 8th Annual Ubiquitous Computing, Electronics and Mobile Communication Conference (UEMCON), pp. 145–149. IEEE (2017)
Contreras-Vidal, J.L., Teulings, H., Stelmach, G.: Elderly subjects are impaired in spatial coordination in fine motor control. Acta Physiol. 100(1–2), 25–35 (1998)
Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
Diaz, M., Ferrer, M.A., Impedovo, D., Malik, M.I., Pirlo, G., Plamondon, R.: A perspective analysis of handwritten signature technology. ACM Comput. Surv. (CSUR) 51(6), 1–39 (2019)
Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., Twombly, X.: Vision-based hand pose estimation: a review. Comput. Vis. Image Underst. 108(1–2), 52–73 (2007)
Ferrer, M.A., Diaz, M., Carmona-Duarte, C., Morales, A.: A behavioral handwriting model for static and dynamic signature synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1041–1053 (2016)
Gan, J., Wang, W., Lu, K.: In-air handwritten Chinese text recognition with temporal convolutional recurrent network. Pattern Recogn. 97, 107025 (2020)
Griswold-Steiner, I., Matovu, R., Serwadda, A.: Handwriting watcher: a mechanism for smartwatch-driven handwriting authentication. In: 2017 IEEE International Joint Conference on Biometrics (IJCB), pp. 216–224. IEEE (2017)
Griswold-Steiner, I., Matovu, R., Serwadda, A.: Wearables-driven freeform handwriting authentication. IEEE Trans. Biom. Behav. Identity Sci. 1(3), 152–164 (2019)
He, S., Schomaker, L.: Writer identification using curvature-free features. Pattern Recogn. 63, 451–464 (2017)
Ho, T.K.: Random decision forests. In: Proceedings of 3rd International Conference on Document Analysis and Recognition, vol. 1, pp. 278–282. IEEE (1995)
Huang, C., Yang, Z., Chen, H., Zhang, Q.: Signing in the air w/o constraints: robust gesture-based authentication for wrist wearables. In: GLOBECOM 2017–2017 IEEE Global Communications Conference, pp. 1–6. IEEE (2017)
Impedovo, D., Pirlo, G., Plamondon, R.: Handwritten signature verification: new advancements and open issues. In: 2012 International Conference on Frontiers in Handwriting Recognition, pp. 367–372. IEEE (2012)
Jain, A.K., Flynn, P., Ross, A.A.: Handbook of Biometrics. Springer, Heidelberg (2007). https://doi.org/10.1007/978-0-387-71041-9
Kamaishi, S., Uda, R.: Biometric authentication by handwriting using leap motion. In: Proceedings of the 10th International Conference on Ubiquitous Information Management and Communication, pp. 1–5 (2016)
Kutzner, T., Pazmiño-Zapatier, C.F., Gebhard, M., Bönninger, I., Plath, W.D., Travieso, C.M.: Writer identification using handwritten cursive texts and single character words. Electronics 8(4), 391 (2019)
Liu, J., Zhong, L., Wickramasuriya, J., Vasudevan, V.: User evaluation of lightweight user authentication with a single tri-axis accelerometer. In: Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 1–10 (2009)
Marcelli, A., Parziale, A., Senatore, R.: Some observations on handwriting from a motor learning perspective. In: AFHA, vol. 1022, pp. 6–10. Citeseer (2013)
Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 37(3), 311–324 (2007)
Murata, T., Shin, J.: Hand gesture and character recognition based on kinect sensor. Int. J. Distrib. Sens. Netw. 10(7), 278460 (2014)
Parziale, A., Senatore, R., Della Cioppa, A., Marcelli, A.: Cartesian genetic programming for diagnosis of parkinson disease through handwriting analysis: performance vs. interpretability issues. Artif. Intell. Med. 111, 101984 (2021)
Parziale, A., Diaz, M., Ferrer, M.A., Marcelli, A.: SM-DTW: stability modulated dynamic time warping for signature verification. Pattern Recogn. Lett. 121, 113–122 (2019)
Parziale, A., Parisi, R., Marcelli, A.: Extracting the motor program of handwriting from its lognormal representation. In: The Lognormality Principle and its Applications in e-Security, e-Learning and e-Health, pp. 289–308 (2021). https://doi.org/10.1142/9789811226830_0013
Parziale, A., et al.: An interactive tool for forensic handwriting examination. In: 2014 14th International Conference on Frontiers in Handwriting Recognition, pp. 440–445. IEEE (2014)
Pedregosa, F., et al.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
Raibert, M.H.: Motor control and learning by the state space model. Ph.D. thesis, Massachusetts Institute of Technology (1977)
Shin, J., Kutsuoka, T., Kim, C.M.: Writer verification based on three-dimensional information using kinect sensor. In: Proceedings of the International Conference on Research in Adaptive and Convergent Systems, pp. 89–90 (2016)
Srihari, S.N., Cha, S.H., Arora, H., Lee, S.: Individuality of handwriting. J. Forensic Sci. 47(4), 1–17 (2002)
Srihari, S.N., Tomai, C.I., Zhang, B., Lee, S.: Individuality of numerals. In: ICDAR, vol. 3, pp. 1096–1100. Citeseer (2003)
Sun, Z., Wang, Y., Qu, G., Zhou, Z.: A 3-D hand gesture signature based biometric authentication system for smartphones. Secur. Commun. Netw. 9(11), 1359–1373 (2016)
Teulings, H.L.: MovAlyzeR. Version 6.1. Neuroscript LTD (2021). https://www.neuroscript.net
Teulings, H.L., Maarse, F.J.: Digital recording and processing of handwriting movements. Hum. Mov. Sci. 3(1–2), 193–217 (1984)
Venugopal, V., Sundaram, S.: Online writer identification system using adaptive sparse representation framework. IET Biom. 9(3), 126–133 (2020)
Wang, X., Tanaka, J.: GesID: 3D gesture authentication based on depth camera and one-class classification. Sensors 18(10), 3265 (2018)
Wing, A.M.: Motor control: mechanisms of motor equivalence in handwriting. Curr. Biol. 10(6), R245–R248 (2000)
Yang, J., Li, Y., Xie, M.: Motionauth: motion-based authentication for wrist worn smart devices. In: 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops), pp. 550–555. IEEE (2015)
Yang, W., Jin, L., Liu, M.: Deepwriterid: an end-to-end online text-independent writer identification system. IEEE Intell. Syst. 31(2), 45–53 (2016)
Zhang, X.Y., Xie, G.S., Liu, C.L., Bengio, Y.: End-to-end online writer identification with recurrent neural network. IEEE Trans. Hum. Mach. Syst. 47(2), 285–292 (2016)
Acknowledgment
This study was funded by the Spanish government’s MIMECO PID2019-109099RB-C41 research project and European Union FEDER program/funds. C. Carmona-Duarte was supported by a Juan de la Cierva grant (IJCI-2016-27682), and Viera y Clavijo grant from ULPGC.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Parziale, A., Carmona-Duarte, C., Ferrer, M.A., Marcelli, A. (2021). 2D vs 3D Online Writer Identification: A Comparative Study. In: Lladós, J., Lopresti, D., Uchida, S. (eds) Document Analysis and Recognition – ICDAR 2021. ICDAR 2021. Lecture Notes in Computer Science(), vol 12823. Springer, Cham. https://doi.org/10.1007/978-3-030-86334-0_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-86334-0_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86333-3
Online ISBN: 978-3-030-86334-0
eBook Packages: Computer ScienceComputer Science (R0)