Acta Informatica Pragensia 2022, 11(2), 205-217 | DOI: 10.18267/j.aip.1802356

Gender Recognition Based on Hand Thermal Characteristic

Katerina Prihodova ORCID...
Institute of System Engineering and Informatics, Faculty of Economics and Administration, University of Pardubice, Studentská 84, Pardubice 2, Czech Republic

Automatic gender recognition is one of the frequently solved tasks in computer vision. It is useful for analysing human behaviour, intelligent monitoring or security. In this article, gender is recognized based on multispectral images of the hand. Hand (palm and back) images are obtained in the visible spectrum and thermal spectrum; then a fusion of images is performed. Some studies say that it is possible to distinguish male and female hands by some geometric features of the hand. The aim of this article is to determine whether it is possible to recognize gender by the thermal characteristics of the hand and, at the same time, to find the best architecture for this recognition. The article compares several algorithms that can be used to solve this issue. The convolutional neural network (CNN) AlexNet is used for feature extraction. The support vector machine, linear discriminant, naive Bayes classifier and neural networks were used for subsequent classification. Only CNNs were used for both extraction and subsequent classification. All of these methods lead to high accuracy of gender recognition. However, the most accurate are the convolutional neural networks VGG-16 and VGG-19. The accuracy of gender recognition (test data) is 94.9% for the palm and 89.9% for the back. Experiments in comparative studies have had promising results and shown that multispectral hand images (thermal and visible) can be useful in gender recognition.

Keywords: Gender recognition; Thermal images; Hand images; Fusion; Convolutional neural network.

Received: January 6, 2022; Revised: April 7, 2022; Accepted: April 30, 2022; Prepublished online: May 1, 2022; Published: August 19, 2022  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Prihodova, K. (2022). Gender Recognition Based on Hand Thermal Characteristic. Acta Informatica Pragensia, 11(2), 205-217. doi: 10.18267/j.aip.180
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Afifi, M. (2019). 11K Hands: Gender recognition and biometric identification using a large dataset of hand images. Multimedia Tools and Applications, 78(15), 20835-20854. https://doi.org/10.1007/s11042-019-7424-8 Go to original source...
    2. Afifi, M., & Abdelhamed, A. (2019). AFIF4: Deep gender classification based on AdaBoost-based fusion of isolated facial features and foggy faces. Journal of Visual Communication and Image Representation, 62, 77-86. https://doi.org/10.1016/j.jvcir.2019.05.001 Go to original source...
    3. Afifi, M., Nasser, M., Korashy, M., Rohde, K., & Mohamed, A. A. (2018). Can we boost the power of the Viola-Jones face detector using preprocessing? An empirical study. Journal of Electronic Imaging, 27(04), 1. https://doi.org/10.1117/1.jei.27.4.043020 Go to original source...
    4. Agnihotri A. K., Purwar B., Jeebun N., & Agnihotri S. (2005). Determination of sex by hand dimensions. The Internet Journal of Forensic Science, 1(2), 1-3.
    5. Amayeh G., Bebis G., & Nicolescu M. (2008). Gender classification from hand shape. In 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, (pp. 1-7). IEEE. https://doi.org/10.1109/CVPRW.2008.4563122 Go to original source...
    6. Azzopardi G., Greco A., & Vento M. (2016). Gender recognition from face images with trainable COSFIRE filters. In 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), (pp. 235-241). IEEE. https://doi.org/10.1109/AVSS.2016.7738068 Go to original source...
    7. Bartuzi E., Roszczewska K., Czajka A., & Pacut A. (2018). Unconstrained Biometric Recognition based on Thermal Hand Images. In 6th International Workshop on Biometrics and Forensics. IEEE. https://doi.org/10.1109/IWBF.2018.8401567 Go to original source...
    8. Brown, W. M., Hines, M., Fane, B. A., & Breedlove, S. Marc. (2002). Masculinized Finger Length Patterns in Human Males and Females with Congenital Adrenal Hyperplasia. Hormones and Behavior, 42(4), 380-386. https://doi.org/10.1006/hbeh.2002.1830 Go to original source...
    9. Bruce, V., Burton, A. M., Hanna, E., Healey, P., Mason, O., Coombes, A., Fright, R., & Linney, A. (1993). Sex discrimination: how do we tell the difference between male and female faces? Perception, 22(2), 131-152. https://doi.org/10.1068/p220131 Go to original source...
    10. Chen C., & Ross A. (2011). Evaluation of gender classification methods on thermal and near-infrared face images. In 2011 International Joint Conference on Biometrics (IJCB), (pp. 1-8). IEEE. https://doi.org/10.1109/IJCB.2011.6117544 Go to original source...
    11. Cirne M., & Helio P. (2017). Gender Recognition from Face Images Using a Geometric Descriptor. In IEEE International Conference on Systems Man and Cybernetics Conference Proceedings, (pp. 2006-2011). IEEE. https://doi.org/10.1109/SMC.2017.8122913 Go to original source...
    12. Dantcheva, A., Velardo, C., D'Angelo, A., & Dugelay, J.-L. (2010). Bag of soft biometrics for person identification. Multimedia Tools and Applications, 51(2), 739-777. https://doi.org/10.1007/s11042-010-0635-7 Go to original source...
    13. Dantcheva, A., Elia, P., & Ross, A. (2016). What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics. IEEE Transactions on Information Forensics and Security, 11(3), 441-467. https://doi.org/10.1109/tifs.2015.2480381 Go to original source...
    14. Fabbri K. (2015). A Brief History of Thermal Comfort: From Effective Temperature to Adaptive Thermal Comfort. In Indoor Thermal Comfort Perception, (pp. 7-23). Springer International Publishing. https://doi.org/10.1007/978-3-319-18651-1_2 Go to original source...
    15. FLIR. (2019). What is MSX?. https://www.flir.com/discover/professional-tools/what-is-msx/
    16. Kuehlkamp A., Becker B., & Bowyer K. (2017). Gender-from-iris or gender-from-mascara?. In 2017 IEEE winter conference on applications of computer vision (WACV), (pp. 1151-1159). IEEE. https://doi.org/10.1109/WACV.2017.133 Go to original source...
    17. Li, Y., Zeng, J., Shan, S., & Chen, X. (2019). Occlusion Aware Facial Expression Recognition Using CNN With Attention Mechanism. IEEE Transactions on Image Processing, 28(5), 2439-2450. https://doi.org/10.1109/TIP.2018.2886767 Go to original source...
    18. Loth S. R., & Iscan M. Y. (2000). Sex Determination. In Encyclopedia of Forensic Sciences. Academic Press. Go to original source...
    19. Lu J., G. Wang, & Huang T.S. (2012). Gait-based gender classification in unconstrained environments. In Proceedings of the 21st International Conference on Pattern Recognition (pp. 3284-3287). IEEE.
    20. Matkowski W. M., & Kong A. W. K. (2020). Gender and Ethnicity Classification Based on Palmprint and Palmar Hand Images from Uncontrolled Environment. In 2020 IEEE International Joint Conference on Biometrics (IJCB), (pp. 1-7). IEEE. https://doi.org/10.1109/IJCB48548.2020.9304907 Go to original source...
    21. Matkowski, W. M., Chai, T., & Kong, A. W. K. (2020). Palmprint Recognition in Uncontrolled and Uncooperative Environment. IEEE Transactions on Information Forensics and Security, 15, 1601-1615. https://doi.org/10.1109/tifs.2019.2945183 Go to original source...
    22. Makinen, E., & Raisamo, R. (2008). Evaluation of Gender Classification Methods with Automatically Detected and Aligned Faces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 30(3), 541-547. https://doi.org/10.1109/TPAMI.2007.70800 Go to original source...
    23. Nguyen, D., & Park, K. (2016). Body-Based Gender Recognition Using Images from Visible and Thermal Cameras. Sensors, 16(2), 156. https://doi.org/10.3390/s16020156 Go to original source...
    24. Prihodova K., & Jech J. (2021). Gender recognition using thermal images from UAV. In 2021 International Conference on Information and Digital Technologies (IDT). IEEE. https://doi.org/10.1109/IDT52577.2021.9497627 Go to original source...
    25. Raimi, K. (2019). Difference between AlexNet, VGGNet, ResNet, and Inception. Towards Data Science. https://towardsdatascience.com/illustrated-10-cnn-architectures-95d78ace614d#e971
    26. Tapia, J. E., Perez, C. A., & Bowyer, K. W. (2016). Gender Classification from the Same Iris Code Used for Recognition. IEEE Transactions on Information Forensics and Security, 11(8), 1760-1770. https://doi.org/10.1109/tifs.2016.2550418 Go to original source...
    27. Ullah, I., Hussain, M., Aboalsamh, H., Muhammad, G., Mirza, A. M., & Bebis, G. (2012). Gender Recognition from Face Images with Dyadic Wavelet Transform and Local Binary Pattern. In Advances in Visual Computing, (pp. 409-419). Springer. https://doi.org/10.1007/978-3-642-33191-6_40 Go to original source...
    28. Wang, M.-H. (2012). Hand Recognition Using Thermal Image and Extension Neural Network. Mathematical Problems in Engineering, 2012, 1-15. https://doi.org/10.1155/2012/905495 Go to original source...
    29. Wang, S., Gao, Z., He, S., He, M., & Ji, Q. (2015). Gender recognition from visible and thermal infrared facial images. Multimedia Tools and Applications, 75(14), 8419-8442. https://doi.org/10.1007/s11042-015-2756-5 Go to original source...
    30. Xie, J., Zhang, L., You, J., Zhang, D., & Qu, X. (2012). A Study of Hand Back Skin Texture Patterns for Personal Identification and Gender Classification. Sensors, 12(7), 8691-8709. https://doi.org/10.3390/s120708691 Go to original source...
    31. Yang Z., & Ai H. (2007). Demographic classification with local binary patterns. In Advances in Biometrics, (pp. 464-473). Springer. https://doi.org/10.1007/978-3-540-74549-5_49 Go to original source...
    32. Zhao H., & Wang P. (2019). A Short Review of Age and Gender Recognition Based on Speech. In 2019 IEEE 5th Intl Conference on Big Data Security on Cloud (BigDataSecurity), IEEE Intl Conference on High Performance and Smart Computing, (HPSC) and IEEE Intl Conference on Intelligent Data and Security (IDS) (pp. 183-185). IEEE. https://doi.org/10.1109/bigdatasecurity-hpsc-ids.2019.00042 Go to original source...
    33. Zhou Y., Ni H., Ren F., & Kang X. (2019). Face and Gender Recognition System Based on Convolutional Neural Networks. In IEEE 2019 International Conference on Mechatronics and Automation (ICMA), (pp. 1091-1095). IEEE. https://doi.org/10.1109/ICMA.2019.8816192 Go to original source...

    This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return to the content