Skip to main content
SpringerLink
Log in

Robust palm and knuckle ROI extraction in unconstrained environment

  • Short paper
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

Palm and knuckle prints can be extracted from a hand using a low-cost camera in a contactless manner. This makes the process of palm and knuckle recognition fast and convenient and solves the hygiene issue for users. A number of challenges arise in such an unconstrained environment: geometric transformations, connected fingers and the existence of finger rings, hand wrist and other false objects. This paper proposes a palm and knuckle ROI extraction method that is robust to these challenges. The method consists of ten simple steps that are mainly based on blob analysis without a need for pre-training or parameters adjustment which facilitates its generalization ability. It is automatically tested on five public hand databases (DBs), four inner and one outer, that cover these challenges, namely Sfax, IITD, PolyU 3D/2D, HGC and BioChanves. Based on the proposed evaluation methodology and the generated ground truth data, the method correctly extracts the palm ROI in more than 99% and the knuckle ROIs in more than 97.8% of each DB. After a massive rotation and scaling tests, the average drop in the accuracy is bounded by 0.01% for palm and 0.7% for knuckles when fingers are separated (first three DBs). The robustness of the proposed method to such challenges facilitates the recognition of palms and knuckles in an unconstrained environment. To make the results fully reproducible, both ground truth data and related source code are made publicly available (All materials are publicly available at https://www.dropbox.com/sh/z84897stmcw0zr0/AADcWvf2_KF5L3xRDCIDsZ5La?dl=0.)

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Notes

  1. As described in “Estimation of Palm and Finger Measures” section.

References

  1. Michael GKO, Connie T, Teoh ABJ (2012) A contactless biometric system using multiple hand features. J Vis Commun Image Represent 23(7):1068–1084

    Article  Google Scholar 

  2. Magalhães F, Oliveira HP, Matos H, Campilho A (2010) HGC2011-hand geometric points detection competition database, 23 Dec 2010. [Online]. http://www.fe.up.pt/~hgc2011/. Accessed 1 Oct 2014

  3. Michael GKO, Connie T, Teoh ABJ (2008) Touch-less palm print biometrics: novel design and implementation. Image Vis Comput 26(12):1551–1560

    Article  Google Scholar 

  4. Jemaa SB, Frikha M, Moalla I, Hammami M, Ben-Abdallah H (2012) Sfax-Miracl hand database for contactless hand biometrics applications. In: Proceedings of the 5th international conference on image and signal processing (ICISP 2012), Marroc

  5. Kumar A (2008) Incorporating cohort information for reliable palmprint authentication. In: Proceedings of the ICVGIP, Bhubneshwar, India

  6. Kanhangad V, Kumar A, Zhang D (2014) The Hong Kong polytechnic university contact-free 3D/2D hand images database version 1.0, [Online]. http://www.comp.polyu.edu.hk/~csajaykr/myhome/database_request/3dhand/Hand3D.htm. Accessed 2014

  7. Montalvão J, Molina L, Canuto J (2010) Robust hand image processing for biometric application. Pattern Anal Appl 13(4):397–407

    Article  MathSciNet  Google Scholar 

  8. ELSayed AS, Ebeid HM, Roushdy M, Fayed ZT (2017) A method for contactless palm ROI extraction. In: 11th International conference on computer engineering and systems (ICCES), IEEE, Cairo, Egypt

  9. Publicly available materials of this work, [Online]. https://www.dropbox.com/sh/z84897stmcw0zr0/AADcWvf2_KF5L3xRDCIDsZ5La?dl=0. Accessed Feb 2019

  10. Yoruk E, Konukoglu E (2006) Shape-based hand recognition. IEEE Trans Image Process 15(7):1803–1815

    Article  Google Scholar 

  11. Mestetskiy L, Bakina I, Kurakin A (2011) Hand geometry analysis by continuous skeletons. ICIAR 2011, Part II. LNCS, Heidelberg

    Google Scholar 

  12. Aykut M, Ekinci M (2013) AAM-based palm segmentation in unrestricted backgrounds and various postures for palmprint recognition. Pattern Recogn Lett 34(9):955–962

    Article  Google Scholar 

  13. Kalluri HK, Prasad MVNK, Agarwal A (2012) Dynamic ROI extraction algorithm for palmprints. In: Tan Y, Shi Y, Ji Z (eds) Advances in swarm intelligence. ICSI 2012. Lecture notes in computer science, vol 7332. Springer, Berlin, Heidelberg, pp 217–227

  14. Sierra ADS, Ávila CS, Casanova JG, Pozo GBD (2011) Invariant hand biometrics feature extraction. In: Proceedings of the 6th Chinese conference on biometric recognition (CCBR’11), Berlin, Heidelberg

  15. Ito K, Sato T, Aoyama S, Sakai S, Yusa S, Aoki T (2015) Palm region extraction for contactless palmprint recognition. In: IEEE international conference on biometrics (ICB)

  16. Jemaa S, Hammami M, Ben-Abdallah H (2012) Biometric identification using a new direction in contactless palm print imaging. In: Proceedings of the international conference of image processing computer vision and pattern recognition (IPCV’12), Las Vegas, USA

  17. Kanhangad V, Kumar A, Zhang D (2011) A unified framework for contactless hand verification. IEEE Trans Inf Forens Secur 6(3):1014–1027

    Article  Google Scholar 

  18. Kumar A, Wong DC, Shen HC, Jain AK (2003) Personal verification using palmprint and hand geometry biometric. In: Audio-and video-based biometric person authentication, Guildford, UK

  19. Badrinath GS, Gupta P (2012) Palmprint based recognition system using phase-difference information. Future Gener Comput Syst 28(1):287–305

    Article  Google Scholar 

  20. Luque-Baena RM, Elizondo D, Lopez-Rubio E, Palomo EJ, Watson T (2013) Assessment of geometric features for individual identification and verification in biometric hand systems. Expert Syst Appl 40(9):3580–3594

    Article  Google Scholar 

  21. Balwant MK, Agarwal A, Rao C (2015) Online touchless palmprint registration system in a dynamic environment. Proc Comput Sci 54:799–808

    Article  Google Scholar 

  22. Sharma S, Dubey SR, Singh SK, Saxena R, Singh RK (2015) Identity verification using shape and geometry of human hands. Expert Syst Appl 42(2):821–832

    Article  Google Scholar 

  23. Shang L, Chen J, Su PG, Zhou Y (2012) ROI extraction of palmprint images using modified harris corner point detection algorithm. In: Proceedings of the 8th international conference on intelligent computing theories and applications (ICIC’12), China

  24. Yan M, Sun D, Zhao S, Zhou J (2013) A robust approach for palm ROI extraction based on real-time region learning. In: Sun Z, Shan S, Yang G, Zhou J, Wang Y, Yin Y (eds) Biometric recognition. Springer, Berlin, pp 241–248

    Chapter  Google Scholar 

  25. Aoyama S, Ito K, Aoki T, Ota H (2013) A contactless palmprint recognition algorithm for mobile phones. In International workshop on advanced image technology, Japan

  26. Feng Y, Li LHJ, Liu C (2011) Real-time ROI acquisition for unsupervised and touch-less palmprint. World Acad Sci Eng Technol 78:823–827

    Google Scholar 

  27. de Santos-Sierra A, Mendaza-Ormaza A, Sanchez-Avila C, Guerra-Casanova J (2011) Hand biometrics in mobile devices. In: Advanced biometric technologies, INTECH Open Access, pp 367–382

  28. Choraś M, Kozik R (2011) Contactless palmprint and knuckle biometrics for mobile devices. Pattern Anal Appl 15(1):73–85

    Article  MathSciNet  Google Scholar 

  29. Jia W, Hu R, Gui J, Zhao Y, Ren X (2012) Palmprint recognition across different devices. Sensors 12:7938–7964

    Article  Google Scholar 

  30. Methani C (2010) Camera based palmprint recognition. Dissertation, International Institute of Information Technology, Hyderabad, India

  31. Han Y, Sun Z, Wang F, Tan T (2007) Palmprint recognition under unconstrained scenes. In: 8th Asian conference on computer vision. Springer, Berlin

  32. Morales A, Gonzalez E, Ferrer MA (2012) On the feasibility of interoperable schemes in hand biometrics. Sensors 12(2):1352–1382

    Article  Google Scholar 

  33. Anitha ML, Rao KAR (2015) Extraction of region of interest (ROI) for palm print and inner knuckle print. Int J Comput Appl 124(14):887–975

    Google Scholar 

  34. Xu X, Jin Q, Zhou L, Qin J, Wong T-T, Han G (2015) Illumination-invariant and deformation-tolerant inner Knuckle print recognition using portable devices. Sensors 15(2):4326

    Article  Google Scholar 

  35. Li Q, Qiu Z, Sun D, Wu J (2004) Personal identification using knuckleprint. Adv Biom Pers Authent 6:680–689

    Article  Google Scholar 

  36. Xu X-M, Lai X-Z, Jin Q, Yuan X-H, Lai S-L, Lin Y-W, Huang J-W (2015) A novel IKP-based biometric recognition using mobile phone camera. Int J Distrib Sens Netw 11:705710

    Google Scholar 

  37. Jemaa SB, Hammami M, Ben-Abdallah H (2016) Finger surfaces recognition using rank level fusion. Comput J 58:717

    Google Scholar 

  38. Michael GKO, Connie T, Jin ATB (2010) An innovative contactless palm print and knuckle print recognition system. Pattern Recogn Lett 31(12):1708–1719

    Article  Google Scholar 

  39. Savič T, Pavešić N (2007) Personal recognition based on an image of the palmar surface of the hand. Pattern Recogn 40(11):3152–3163

    Article  MATH  Google Scholar 

  40. Gonzales RC, Woods RE (2006) Digital image processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River

    Google Scholar 

  41. Jain G (2010) Color balancing using the gray world assumption, 2010. [Online]. http://www.mathworks.com/matlabcentral/fileexchange/28565-skin-detection/content/grayworld.m. Accessed 2014

  42. Zhu L, Zhang S (2010) Multimodal biometric identification system based on finger geometry, knuckle print and palm print. Pattern Recogn Lett 31(12):1641–1649

    Article  Google Scholar 

  43. Nigam A, Gupta P (2015) Designing an accurate hand biometric based authentication system fusing finger knuckleprint and palmprint. Neurocomputing 151:1120–1132

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Faculty of Computers and Information Sciences, Ain Shams University, Cairo, Egypt

    Ahmed S. ELSayed, Mohamed Roushdy & Zaki T. Fayed

  2. Scientific Computing Department, Faculty of Computers and Information Sciences, Ain Shams University, Cairo, Egypt

    Hala M. Ebeid

Authors
  1. Ahmed S. ELSayed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hala M. Ebeid
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohamed Roushdy
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zaki T. Fayed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ahmed S. ELSayed.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

ELSayed, A.S., Ebeid, H.M., Roushdy, M. et al. Robust palm and knuckle ROI extraction in unconstrained environment. Pattern Anal Applic 22, 1537–1559 (2019). https://doi.org/10.1007/s10044-019-00799-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-019-00799-y

Keywords

Search

Navigation