[go: up one dir, main page]

CN202041967U - Palm Vein and Face Dual Mode Biometric Recognition Instrument - Google Patents

Palm Vein and Face Dual Mode Biometric Recognition Instrument Download PDF

Info

Publication number
CN202041967U
CN202041967U CN2011201084754U CN201120108475U CN202041967U CN 202041967 U CN202041967 U CN 202041967U CN 2011201084754 U CN2011201084754 U CN 2011201084754U CN 201120108475 U CN201120108475 U CN 201120108475U CN 202041967 U CN202041967 U CN 202041967U
Authority
CN
China
Prior art keywords
recognition
palm vein
arm processor
camera
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN2011201084754U
Other languages
Chinese (zh)
Inventor
李承冬
杜边境
李冬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China University of Mining and Technology Beijing CUMTB
Original Assignee
China University of Mining and Technology Beijing CUMTB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China University of Mining and Technology Beijing CUMTB filed Critical China University of Mining and Technology Beijing CUMTB
Priority to CN2011201084754U priority Critical patent/CN202041967U/en
Application granted granted Critical
Publication of CN202041967U publication Critical patent/CN202041967U/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Collating Specific Patterns (AREA)

Abstract

掌静脉与人脸双模态生物识别仪,本实用新型属于光学仪器与模式识别领域,使用了多个ARM处理器、存储器、触摸屏、滤光片等,最终组成了一种高精度的多生物特征识别设备。ARM处理器(8)(9)(10)和ARM处理器(11)的连接控制方式,不仅可以分担主控单元ARM处理器(11)的处理任务,也使得识别过程的任务划分变得更加清晰,大大的加快了识别的速度,解决了掌静脉与人脸识别计算量大造成的识别时间长的问题。设备简单易用,扩展性强,可广泛应用于人员登记、门禁、银行等场合。

Figure 201120108475

Palm vein and human face dual-mode biometric recognition instrument, the utility model belongs to the field of optical instruments and pattern recognition, uses a plurality of ARM processors, memories, touch screens, optical filters, etc., and finally forms a high-precision multi-biological Feature recognition equipment. The connection control mode of the ARM processor (8) (9) (10) and the ARM processor (11) can not only share the processing tasks of the main control unit ARM processor (11), but also make the task division of the recognition process more efficient. Clear, which greatly speeds up the recognition speed, and solves the problem of long recognition time caused by the large amount of calculation for palm vein and face recognition. The equipment is easy to use and has strong scalability, and can be widely used in personnel registration, access control, banking and other occasions.

Figure 201120108475

Description

掌静脉与人脸双模态生物识别仪Palm Vein and Face Dual Mode Biometric Recognition Instrument

(一)所属技术领域 (1) Technical field

本实用新型属于光学仪器与模式识别领域,主要是基于近红外光的双模态生物特征采集设备,使用了多个ARM处理器、存储器、触摸屏、滤光片等,最终组成了一种综合型的生物特征识别设备。The utility model belongs to the field of optical instruments and pattern recognition, and is mainly a dual-mode biometric feature acquisition device based on near-infrared light, which uses a plurality of ARM processors, memories, touch screens, filters, etc., and finally forms a comprehensive biometric identification devices.

(二)背景技术 (2) Background technology

生物识别技术,是近几年在全球范围内迅速发展起来的计算机安全技术,它根据人脸、指纹、语音、静脉等人体生物特征,利用图像处理和模式识别鉴别或验证身份。生物特征识别作为一项利用人类特有的生理特征(如指纹、人脸、虹膜、静脉、视网膜等)或行为特征(如签名、声音、步态等)进行身份识别的技术,具有不易丢失、难伪造、唯一性、使用方便的特点,正在逐渐替代传统的身份识别方法。Biometrics technology is a computer security technology that has developed rapidly around the world in recent years. It uses image processing and pattern recognition to identify or verify identities based on human biological characteristics such as faces, fingerprints, voices, and veins. As a technology that uses human-specific physiological characteristics (such as fingerprints, faces, irises, veins, retinas, etc.) or behavioral characteristics (such as signatures, voices, gait, etc.) Forgery, uniqueness, and ease of use are gradually replacing traditional identification methods.

尽管各种人体生物特征都有各自的优势,但对于生物特征鉴定系统的准确性及安全性要求日益提高的今天,每一种生物特征并不可能具有真正意义上的普遍性,单个生物特征识别系统中的一些固有限制影响了准确性,如某些人或某些群体(例如体操运动员)的指纹特征因为磨损变得很少,人脸识别系统对于人体外表特征:头发、饰物、变老以及孪生儿的辨别则很困难。而这些固有的限制很难用算法再去提高其准确性,因此仅靠单一方法或单一生物特征难以满足实际应用。故将多个生物特征融合在一起进行身份的识别,正成为一种研究与发展的趋势。Although various human biometric features have their own advantages, today, with increasing requirements for the accuracy and security of the biometric identification system, it is impossible for each biometric feature to be universal in a true sense. Some inherent limitations in the system affect the accuracy, such as the fingerprint characteristics of certain people or groups of people (such as gymnasts) become less due to wear and tear, and the face recognition system is less sensitive to human appearance characteristics: hair, accessories, aging and Distinguishing twins is difficult. However, these inherent limitations are difficult to use algorithms to improve its accuracy, so it is difficult to meet practical applications only by a single method or a single biometric feature. Therefore, it is becoming a research and development trend to integrate multiple biometric features together for identity identification.

由于生物识别计算量很大,通常生物识别设备只能识别一种生物特征。现有的多模态生物识别系统较少,国内有北方交通大学的人脸和手形识别,国外的多数设备同样用到了指纹、语音、手形等一些容易产生特征缺失、抗干扰差或识别精度不高等问题的生物特征,无法达到想要的精度。而多生物特征融合的问题就是计算量大,识别实时性变差。Due to the large amount of calculation of biometrics, usually biometric devices can only recognize one biometric feature. There are few existing multi-modal biometric identification systems. In China, there are face and hand shape recognition from Northern Jiaotong University. Most foreign devices also use fingerprints, voice, hand shape, etc., which are prone to missing features, poor anti-interference, or poor recognition accuracy. The biometrics of advanced problems cannot achieve the desired accuracy. However, the problem of multi-biometric feature fusion is that the amount of calculation is large, and the real-time performance of recognition becomes poor.

(三)发明内容 (3) Contents of the invention

本实用新型解决的技术问题是提供一种多模态高精度的生物特征识别设备,采取的思路就是选取掌静脉和人脸两种生物特征进行识别以满足高精度的要求,多处理器并联的结构以达到缩短识别时间的目的。The technical problem solved by the utility model is to provide a multi-modal high-precision biometric feature recognition device. The idea adopted is to select two biometric features of the palm vein and the face for recognition to meet the high-precision requirements. The multi-processor parallel structure to achieve the purpose of shortening the recognition time.

为了达到上述目的,本实用新型采用的技术方案主要包括以下几个模块:用于获取人脸生物特征的人脸图像采集模块;用于获取手掌静脉特征的手掌静脉图像采集模块;用于驱动触摸屏、语音、显示识别界面的辅助处理模块;用于协调以及管理模块运行的主控单元模块。由于前三个模块相互独立,相互平行,并且各模块都对采集的数据进行了一定的预处理,大大加快了整个系统的运行速度。In order to achieve the above-mentioned purpose, the technical solution adopted by the utility model mainly includes the following modules: a face image acquisition module for obtaining facial biological characteristics; a palm vein image acquisition module for obtaining palm vein characteristics; for driving a touch screen Auxiliary processing modules for voice, display and recognition interfaces; main control unit modules for coordinating and managing module operations. Since the first three modules are mutually independent and parallel to each other, and each module has carried out certain preprocessing on the collected data, the operation speed of the whole system has been greatly accelerated.

首先,用户需将手掌放在掌静脉采集模块上,并正对人脸采集模块,此时掌静脉采集模块会自动捕捉靠近的手掌,确认后,将预处理得到的二值手掌静脉图像发送至主控单元模块,主控单元会开启人脸采集模块,之后人脸采集模块工作,搜索人脸在屏幕中的位置,并将人脸的位置和截取的面部图像发送至主控单元模块;最后主控单元对获取的掌静脉特征和人脸特征进行识别处理,并将识别结果发送至辅助处理模块,然后辅助处理模块调用信息库中存储的人员信息,显示在触摸屏上。当对人员信息进行注册时,则可通过触摸屏的提示进行人机交互方便易用。First, the user needs to place the palm on the palm vein acquisition module and face the face acquisition module. At this time, the palm vein acquisition module will automatically capture the approaching palm. After confirmation, the binary palm vein image obtained by preprocessing will be sent to The main control unit module, the main control unit will open the face acquisition module, and then the face acquisition module will work, search for the position of the face on the screen, and send the position of the face and the captured facial image to the main control unit module; finally The main control unit recognizes the obtained palm vein features and face features, and sends the recognition results to the auxiliary processing module, and then the auxiliary processing module calls the personnel information stored in the information database and displays them on the touch screen. When registering personnel information, it is convenient and easy to use for human-computer interaction through the prompts on the touch screen.

(四)附图说明 (4) Description of drawings

图1是本实用新型的系统结构图。Fig. 1 is a system structure diagram of the utility model.

图2是血色素的吸光特性。Figure 2 is the light absorption characteristics of hemoglobin.

图1中标示1、2、3表示普通的网络摄像头,4、5、6、7表示同步动态存储器,8、9、10、11表示ARM处理器,12表示触摸屏,13表示音频接口,14表示网络接口,15表示闪存Flash,其中1、4、8构成人脸图像采集模块,2、5、9构成掌静脉图像采集模块,3、6、10、12、13构成辅助处理模块,7、11、14、15构成主控单元模块。The marks 1, 2, and 3 in Figure 1 represent ordinary webcams, 4, 5, 6, and 7 represent synchronous dynamic memory, 8, 9, 10, and 11 represent ARM processors, 12 represent touch screens, 13 represent audio interfaces, and 14 represent Network interface, 15 represents flash memory Flash, wherein 1, 4, 8 constitute the face image acquisition module, 2, 5, 9 constitute the palm vein image acquisition module, 3, 6, 10, 12, 13 constitute the auxiliary processing module, 7, 11 , 14, 15 constitute the main control unit module.

下面结合附图,对本实用新型做进一步的说明:Below in conjunction with accompanying drawing, the utility model is described further:

(五)具体实施方式 (5) Specific implementation methods

摄像头1需要在镜头上加850nm高通滤光片,并在其周围布置850nm红外光发射管阵列,用于获得近红外光下的人脸图像;摄像头2需要在镜头上加760nm窄带滤光片,并在其周围布置760nm红外光发射管阵列,用于获取近红外光下的掌静脉图像,原理可由2得出,当用760nm波段的光照射到手掌时,由于血管中的氧化血色素和还原血色素吸光特性的不同,从而使静脉凸显出来;摄像头3则用于获取正常光照下的人脸背景图像,不加滤光片。而SDRAM4、5、6、7则作为相应ARM处理器的内存单元,存入一些临时性的数据。Camera 1 needs to add an 850nm high-pass filter to the lens, and arrange an array of 850nm infrared light emitting tubes around it to obtain face images under near-infrared light; camera 2 needs to add a 760nm narrow-band filter to the lens, A 760nm infrared light emitting tube array is arranged around it to obtain palm vein images under near-infrared light. The principle can be obtained from 2. The difference in light absorption characteristics makes the veins stand out; the camera 3 is used to obtain the background image of the face under normal light without adding a filter. SDRAM4, 5, 6, and 7 are used as the memory unit of the corresponding ARM processor to store some temporary data.

当用户注册信息时,首先点击触摸屏的注册按键,辅助处理模块中的ARM处理器10发送信号至主控单元模块中的ARM处理器11,然后ARM处理器11控制ARM处理器9开始工作,通过摄像头2采集掌静脉图像,并调用预处理算法,进行定位、细化操作,得到一幅二值化得掌静脉图像,并将结果返回至ARM处理器11,此时ARM处理器11在闪存15中建立文件夹存入掌静脉信息,并控制ARM处理器10在触摸屏12上显示掌静脉采集完成的信息,提示做好人脸采集的准备,之后ARM处理器11控制ARM处理器8开始工作,ARM处理器8通过摄像头1获得近红外光下的人脸图像,截取人脸面部图像后,将图像信息发送至ARM处理器11,然后ARM处理器11将图像信息存入掌静脉采集时建立的文件夹内,并控制ARM处理器10截取正常光源下的人脸图像同样存入掌静脉采集是建立的文件夹内,并在触摸屏12上显示人脸图像采集完毕,提示输入注册人员姓名以及其他信息,最后注册完毕。When the user registers information, at first click the registration key of touch screen, the ARM processor 10 in the auxiliary processing module sends a signal to the ARM processor 11 in the main control unit module, then the ARM processor 11 controls the ARM processor 9 to start working, by The camera 2 collects the palm vein image, calls the preprocessing algorithm, performs positioning and refinement operations, obtains a binarized palm vein image, and returns the result to the ARM processor 11. At this time, the ARM processor 11 is stored in the flash memory 15 Create a folder in the middle and store the palm vein information, and control the ARM processor 10 to display the information that the palm vein acquisition is completed on the touch screen 12, prompting to prepare for face acquisition, and then the ARM processor 11 controls the ARM processor 8 to start working, and the ARM The processor 8 obtains the face image under the near-infrared light through the camera 1, and after intercepting the face image, sends the image information to the ARM processor 11, and then the ARM processor 11 stores the image information into the file created during palm vein collection folder, and control the ARM processor 10 to intercept the face image under the normal light source and store it in the folder established by the palm vein collection, and display on the touch screen 12 that the face image collection is completed, prompting to input the name of the registered person and other information , and finally the registration is complete.

当进行识别时,待识别人员,首先将手掌放在掌静脉采集摄像头2上,ARM处理器9会自动检测手掌,确认后,将对获取的掌静脉图像进行定位、细化操作,并向ARM处理器11发送处理后的掌静脉图像,当ARM处理器11接收到掌静脉图像后,会控制ARM处理器8开始运行,ARM处理器8则调入人脸检测算法,检测人脸,如果检测正常则将截取的面部图像发送至处理器11,检测不正常时则通过ARM处理器11控制ARM处理器10在触摸屏12上提示请正对摄像头,直至检测到人脸,将截取的面部图像发送至处理器11。当人脸信息采集完成后,ARM处理器11调用识别算法,将获取的信息与信息库闪存15中已存信息进行比对,如果相符,则控制ARM处理器10显示识别完成,同时发出音频信号,如果不相符则提示陌生人,并通过语音提示报警信号,识别完成后可通网络接口14发送识别结果。When performing identification, the person to be identified first puts the palm on the palm vein collection camera 2, and the ARM processor 9 automatically detects the palm. Processor 11 sends the processed palm vein image, and when ARM processor 11 receives the palm vein image, it will control ARM processor 8 to start running, and ARM processor 8 will call into the face detection algorithm to detect people's faces. Normal then the facial image that intercepts is sent to processor 11, then controls ARM processor 10 by ARM processor 11 and prompts on touch screen 12 and please face the camera when detection is not normal, until a human face is detected, the facial image that is intercepted is sent to processor 11. After the collection of face information is completed, the ARM processor 11 invokes the recognition algorithm, compares the information obtained with the information stored in the information library flash memory 15, and if they match, the ARM processor 10 is controlled to display that the recognition is complete, and simultaneously send an audio signal , if it does not match, the stranger will be prompted, and the alarm signal will be prompted by voice. After the recognition is completed, the recognition result can be sent through the network interface 14.

本实用新型采用的硬件设备主要思想是并行式处理,不仅识别时间短,精度高,而且易于使用,扩展性强,可广泛应用于人员登记、门禁、银行等场合。The main idea of the hardware device used in the utility model is parallel processing, which not only has short recognition time and high precision, but also is easy to use and has strong expansibility, and can be widely used in personnel registration, access control, banks and other occasions.

Claims (4)

1.掌静脉与人脸双模态生物识别仪,由USB免驱摄像头(1)(2)(3),同步动态存储器SDRAM(4)(5)(6)(7),ARM处理器(8)(9)(10)(11),触摸屏(12),音频接口(13),网络接口(14)和闪存F1ash(15)组成,其特征在于,ARM处理器(8)(9)(10)连接至ARM处理器(11),均受ARM处理器(11)控制。1. Palm vein and face dual-mode biometric recognition instrument, composed of USB drive-free camera (1) (2) (3), synchronous dynamic memory SDRAM (4) (5) (6) (7), ARM processor ( 8) (9) (10) (11), touch screen (12), audio interface (13), network interface (14) and flash memory F1ash (15) form, it is characterized in that, ARM processor (8) (9) ( 10) connected to the ARM processor (11), all controlled by the ARM processor (11). 2.如权利要求1所述的掌静脉与人脸双模态生物识别仪,其特征是:摄像头(1)为USB免驱摄像头,镜头上加850nm高通滤光片,并在摄像头周围布置有850nm波长的环形光源。2. palm vein as claimed in claim 1 and people's face dual-mode biometric identification instrument, it is characterized in that: camera (1) is a USB driver-free camera, adds 850nm high-pass filter on the lens, and is arranged around the camera 850nm wavelength ring light source. 3.如权利要求1所述的掌静脉与人脸双模态生物识别仪,其特征是:摄像头(2)为USB免驱摄像头,镜头上加760nm窄带滤光片,并在摄像头周围布置有760nm波长的环形光源。3. palm vein as claimed in claim 1 and human face dual-mode biometric identification instrument, it is characterized in that: camera (2) is a USB driver-free camera, adds 760nm narrow-band filter on the lens, and is arranged around the camera Ring light source with 760nm wavelength. 4.如权利要求1所述的掌静脉与人脸双模态生物识别仪,其特征是:摄像头(3)为USB免驱摄像头,镜头不加滤光片,周围不布置附加光源4. The palm vein and human face dual-mode biometric identification device as claimed in claim 1, characterized in that: the camera (3) is a USB drive-free camera, the lens does not add an optical filter, and no additional light source is arranged around it
CN2011201084754U 2011-04-08 2011-04-08 Palm Vein and Face Dual Mode Biometric Recognition Instrument Expired - Fee Related CN202041967U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011201084754U CN202041967U (en) 2011-04-08 2011-04-08 Palm Vein and Face Dual Mode Biometric Recognition Instrument

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011201084754U CN202041967U (en) 2011-04-08 2011-04-08 Palm Vein and Face Dual Mode Biometric Recognition Instrument

Publications (1)

Publication Number Publication Date
CN202041967U true CN202041967U (en) 2011-11-16

Family

ID=44969404

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011201084754U Expired - Fee Related CN202041967U (en) 2011-04-08 2011-04-08 Palm Vein and Face Dual Mode Biometric Recognition Instrument

Country Status (1)

Country Link
CN (1) CN202041967U (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105224906A (en) * 2014-05-27 2016-01-06 常熟安智生物识别技术有限公司 Vena metacarpea identification intelligent system
CN107077615A (en) * 2017-01-12 2017-08-18 厦门中控生物识别信息技术有限公司 Fingerprint method for anti-counterfeit and equipment
CN107403174A (en) * 2017-09-18 2017-11-28 成都折衍科技有限公司 Vein fingerprint and face composite identification system
CN107480657A (en) * 2017-09-19 2017-12-15 成都折衍科技有限公司 Combined type safety distinguishing apparatus based on hand vein recognition
CN108090415A (en) * 2017-11-24 2018-05-29 江西智梦圆电子商务有限公司 A kind of identity comparison method identified based on face and vena metacarpea
WO2018176399A1 (en) * 2017-03-31 2018-10-04 中控智慧科技股份有限公司 Image collection method and device
CN108647672A (en) * 2018-06-29 2018-10-12 张维先 The palm vein identification system quickly identified can be achieved
CN111462379A (en) * 2020-03-17 2020-07-28 广东网深锐识科技有限公司 Access control management method, system and medium containing palm vein and face recognition
CN112668511A (en) * 2020-12-31 2021-04-16 深兰盛视科技(苏州)有限公司 Identity recognition method and device, electronic equipment and storage medium

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105224906A (en) * 2014-05-27 2016-01-06 常熟安智生物识别技术有限公司 Vena metacarpea identification intelligent system
CN105224906B (en) * 2014-05-27 2020-08-11 苏州肯谱瑞力信息科技有限公司 Palm vein recognition intelligent system
CN107077615A (en) * 2017-01-12 2017-08-18 厦门中控生物识别信息技术有限公司 Fingerprint method for anti-counterfeit and equipment
WO2018176399A1 (en) * 2017-03-31 2018-10-04 中控智慧科技股份有限公司 Image collection method and device
US10984267B2 (en) 2017-03-31 2021-04-20 Zkteco Usa Llc Method and system for imaging acquisition
CN107403174A (en) * 2017-09-18 2017-11-28 成都折衍科技有限公司 Vein fingerprint and face composite identification system
CN107480657A (en) * 2017-09-19 2017-12-15 成都折衍科技有限公司 Combined type safety distinguishing apparatus based on hand vein recognition
CN108090415A (en) * 2017-11-24 2018-05-29 江西智梦圆电子商务有限公司 A kind of identity comparison method identified based on face and vena metacarpea
CN108647672A (en) * 2018-06-29 2018-10-12 张维先 The palm vein identification system quickly identified can be achieved
CN111462379A (en) * 2020-03-17 2020-07-28 广东网深锐识科技有限公司 Access control management method, system and medium containing palm vein and face recognition
CN112668511A (en) * 2020-12-31 2021-04-16 深兰盛视科技(苏州)有限公司 Identity recognition method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN202041967U (en) Palm Vein and Face Dual Mode Biometric Recognition Instrument
CN102332093B (en) Identity authentication method and device adopting palmprint and human face fusion recognition
CN100492400C (en) Finger Vein Feature Extraction and Matching Recognition Method
WO2021003964A1 (en) Method and apparatus for face shape recognition, electronic device and storage medium
CN104582187A (en) Recording and lighting control system and method based on face recognition and expression recognition
CN105427421A (en) Entrance guard control method based on face recognition
CN101006923A (en) Identity recognition instrument based on characteristics of subcutaneous vein of dorsum of hand and recognition method
CN106411952B (en) A kind of dynamic gesture user identity authentication method and device
CN104799865B (en) fingerprint identification system
CN102117404A (en) Reflective finger vein feature acquisition device and personal identity authentication method thereof
CN103336950A (en) Human face identification method and system
WO2019011072A1 (en) Iris live detection method and related product
CN204791017U (en) Mobile terminal users authentication device based on many biological characteristics mode
Awad et al. Impact of some biometric modalities on forensic science
CN109766836A (en) Finger vein identification and unlocking method and system
CN203366348U (en) Face recognition system and entrance guard system
WO2018210048A1 (en) Fpga-based hardware iris recognition system and method, and readable storage medium
CN104636731A (en) Authentication device and authentication method combining finger vein recognition with wrist vein recognition and fingernail recognition
CN104217195A (en) A stereo imaging and recognition system for hand veins
CN118247818A (en) Multi-mode biological feature fusion personnel identity recognition method and recognition platform based on deep learning
CN101794376B (en) Multimodal biological image acquisition device for 3D hand shape and palmprint
CN106295622A (en) A kind of recognition methods based on hand back vein
CN105354468A (en) User identification method based on multi-axis force platform gait analysis
CN113435229A (en) Face iris multi-mode recognition method and device, readable storage medium and equipment
CN103942553B (en) Multispectral palm-print fine-texture extraction and identification method

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20111116

Termination date: 20120408