[go: up one dir, main page]

CN113534945B - Method, device, equipment and storage medium for determining eye tracking calibration coefficient - Google Patents

Method, device, equipment and storage medium for determining eye tracking calibration coefficient Download PDF

Info

Publication number
CN113534945B
CN113534945B CN202010304327.3A CN202010304327A CN113534945B CN 113534945 B CN113534945 B CN 113534945B CN 202010304327 A CN202010304327 A CN 202010304327A CN 113534945 B CN113534945 B CN 113534945B
Authority
CN
China
Prior art keywords
calibration coefficient
calibration
gaze
eye
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010304327.3A
Other languages
Chinese (zh)
Other versions
CN113534945A (en
Inventor
杨飞
赖建军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing 7Invensun Technology Co Ltd
Original Assignee
Beijing 7Invensun Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing 7Invensun Technology Co Ltd filed Critical Beijing 7Invensun Technology Co Ltd
Priority to CN202010304327.3A priority Critical patent/CN113534945B/en
Publication of CN113534945A publication Critical patent/CN113534945A/en
Application granted granted Critical
Publication of CN113534945B publication Critical patent/CN113534945B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The embodiment of the invention provides a method, a device, equipment and a storage medium for determining an eyeball tracking calibration coefficient. Comprising the following steps: collecting eye images of a user looking at a set target point; determining calculated fixation point information corresponding to each calibration coefficient according to each stored calibration coefficient and the eye image; determining the fixation precision of each calibration coefficient according to the calculated fixation point information and the information of the set target point; and determining the calibration coefficient with the fixation precision meeting the set condition as a target calibration coefficient. According to the method for determining the eyeball tracking calibration coefficient, provided by the embodiment of the invention, the target calibration coefficient suitable for the user is determined by the user looking at the eye image of the set target point and the stored calibration coefficient, so that the calibration coefficient of the user can be rapidly determined, and the eyeball tracking efficiency is improved.

Description

眼球追踪校准系数的确定方法、装置、设备及存储介质Method, device, equipment and storage medium for determining eye tracking calibration coefficient

技术领域Technical Field

本发明实施例涉及眼球追踪技术领域,尤其涉及一种眼球追踪校准系数的确定方法、装置、设备及存储介质。Embodiments of the present invention relate to the field of eye tracking technology, and in particular to a method, device, equipment and storage medium for determining an eye tracking calibration coefficient.

背景技术Background Art

用户使用眼球追踪设备进行眼球追踪时,为了达到最好的追踪效果,需要先进行校准,获得针对该用户的校准系数,此系数在当前软件环境下对该用户的眼球追踪效果是最优的。因而,获取针对用户的校准系数就显得尤为重要。When a user uses an eye tracking device for eye tracking, in order to achieve the best tracking effect, it is necessary to calibrate first and obtain a calibration coefficient for the user. This coefficient is optimal for the user's eye tracking effect in the current software environment. Therefore, it is particularly important to obtain a calibration coefficient for the user.

现有技术中,用户每次使用眼球追踪设备时都需要进行校准,而校准过程复杂,影响眼球追踪的效率及用户的体验。或者,将用户身份与校准系数绑定存储,使用时进行身份识别,获得该用户的校准系数,但是该方法会受到软硬件或用户生物信息的限制,有识别错误的弊端。In the prior art, users need to calibrate the eye tracking device every time they use it, and the calibration process is complicated, which affects the efficiency of eye tracking and the user experience. Alternatively, the user identity and the calibration coefficient are bound and stored, and the identity is identified when used to obtain the user's calibration coefficient. However, this method is limited by software and hardware or user biometric information and has the disadvantage of recognition errors.

发明内容Summary of the invention

本发明实施例提供一种眼球追踪校准系数的确定方法、装置、设备及存储介质,可以快速的确定用户的校准系数,从而提高眼球追踪的效率。The embodiments of the present invention provide a method, device, equipment and storage medium for determining an eye tracking calibration coefficient, which can quickly determine the calibration coefficient of a user, thereby improving the efficiency of eye tracking.

第一方面,本发明实施例提供了一种眼球追踪校准系数的确定方法,包括:In a first aspect, an embodiment of the present invention provides a method for determining an eye tracking calibration coefficient, comprising:

采集用户注视设定目标点的眼部图像;Collecting eye images of the user looking at a set target point;

根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息;Determine, according to the stored calibration coefficients and the eye image, the calculated gaze point information corresponding to each calibration coefficient;

根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度;Determining the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information;

将注视精度满足设定条件的校准系数确定为目标校准系数。The calibration coefficient whose gaze accuracy satisfies the set conditions is determined as the target calibration coefficient.

第二方面,本发明实施例还提供了一种眼球追踪校准系数的确定装置,包括:In a second aspect, an embodiment of the present invention further provides a device for determining an eye tracking calibration coefficient, comprising:

眼部图像采集模块,用于采集用户注视设定目标点的眼部图像;An eye image acquisition module, used to acquire an eye image of a user gazing at a set target point;

计算注视点信息获取模块,用于根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息;A calculation gaze point information acquisition module, used to determine the calculation gaze point information corresponding to each calibration coefficient according to the stored calibration coefficients and the eye image;

注视精度确定模块,用于根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度;A gaze accuracy determination module, used to determine the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information;

目标校准系数确定模块,用于将注视精度满足设定条件的校准系数确定为目标校准系数。The target calibration coefficient determination module is used to determine the calibration coefficient whose gaze accuracy meets the set conditions as the target calibration coefficient.

第三方面,本发明实施例还提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如本发明实施例所述的眼球追踪校准系数的确定方法。In a third aspect, an embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for determining the eye tracking calibration coefficient as described in the embodiment of the present invention is implemented.

第四方面,本发明实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,该程序被处理装置执行时实现如本发明实施例所述的眼球追踪校准系数的确定方法。In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processing device, implements the method for determining the eye tracking calibration coefficient as described in an embodiment of the present invention.

本实施例,首先采集用户注视设定目标点的眼部图像,然后根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息,再然后根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度,最后将注视精度满足设定条件的校准系数确定为目标校准系数。本发明实施例提供的眼球追踪校准系数的确定方法,通过用户注视一个设定目标点的眼部图像和存储的校准系数来确定适合用户的目标校准系数,可以快速的确定用户的校准系数,从而提高眼球追踪的效率和用户体验。In this embodiment, the eye image of the user gazing at the set target point is first collected, and then the calculated gaze point information corresponding to each calibration coefficient is determined based on the stored calibration coefficients and the eye image, and then the gaze accuracy of each calibration coefficient is determined based on the calculated gaze point information and the information of the set target point, and finally the calibration coefficient whose gaze accuracy meets the set conditions is determined as the target calibration coefficient. The method for determining the eye tracking calibration coefficient provided in the embodiment of the present invention determines the target calibration coefficient suitable for the user by using the eye image of the user gazing at a set target point and the stored calibration coefficient, and can quickly determine the calibration coefficient of the user, thereby improving the efficiency of eye tracking and user experience.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1是本发明实施例一中的一种眼球追踪校准系数的确定方法的流程图;FIG1 is a flow chart of a method for determining an eye tracking calibration coefficient in Embodiment 1 of the present invention;

图2是本发明实施例二中的一种眼球追踪校准系数的确定装置的结构示意图;FIG2 is a schematic diagram of the structure of a device for determining an eye tracking calibration coefficient in a second embodiment of the present invention;

图3是本发明实施例三中的一种计算机设备的结构示意图。FIG3 is a schematic diagram of the structure of a computer device in Embodiment 3 of the present invention.

具体实施方式DETAILED DESCRIPTION

下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.

视线追踪也可以称为眼动追踪,是通过测量眼睛运动情况来估计眼睛的视线方向和/或注视点的技术。具体可以通过实时捕捉待检测用户的眼部图像,并通过待检测用户的眼睛图像分析眼部特征的相对位置,获得待检测用户的注视点信息;或者通过眼球与电容极板之间的电容值来检测眼球运动,获得待检测用户的注视点信息;又或者通过在鼻梁、额头、耳朵或耳垂处放置电极,通过检测的肌电流信号模式来检测眼球运动,获得待检测用户的注视点信息。当然也可以采用其他的实时获取待检测用户的注视点信息的方法,这都应属于本发明的保护范畴。Sight tracking can also be called eye tracking, which is a technology that estimates the sight direction and/or gaze point of the eyes by measuring the movement of the eyes. Specifically, the gaze point information of the user to be detected can be obtained by capturing the eye image of the user to be detected in real time, and analyzing the relative position of the eye features through the eye image of the user to be detected; or the eye movement can be detected by the capacitance value between the eyeball and the capacitor plate to obtain the gaze point information of the user to be detected; or by placing electrodes on the bridge of the nose, forehead, ears or earlobes, and detecting the eye movement through the detected myoelectric signal pattern to obtain the gaze point information of the user to be detected. Of course, other methods for obtaining the gaze point information of the user to be detected in real time can also be used, which should all fall within the protection scope of the present invention.

对眼球进行追踪可以采用光学记录法实现。光学记录法的原理是,利用红外相机记录被测试者的眼睛运动情况,即获取能够反映眼睛运动的眼部图像,从获取到的眼部图像中提取眼部特征用于建立视线的估计模型。其中,眼部特征可以包括:瞳孔位置、瞳孔形状、虹膜位置、虹膜形状、眼皮位置、眼角位置、光斑位置(或者普尔钦斑)等。光学记录法包括瞳孔-角膜反射法。瞳孔-角膜反射法的原理是,近红外光源照向眼睛,由红外相机对眼部进行拍摄,同时拍摄到光源在角膜上的反射点即光斑,由此获取到带有光斑的眼部图像。Tracking the eyeball can be achieved by optical recording. The principle of the optical recording method is to use an infrared camera to record the eye movement of the subject, that is, to obtain an eye image that can reflect the eye movement, and extract eye features from the obtained eye image to establish an estimation model of the line of sight. Among them, eye features may include: pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, light spot position (or Purkinje spot), etc. The optical recording method includes the pupil-corneal reflection method. The principle of the pupil-corneal reflection method is that a near-infrared light source is directed to the eye, and the eye is photographed by an infrared camera, and the reflection point of the light source on the cornea, i.e., the light spot, is photographed at the same time, thereby obtaining an eye image with a light spot.

当然,除了光学记录法外,眼球追踪装置还可以是MEMS微机电系统,例如包括MEMS红外扫描反射镜、红外光源、红外接收器;又或者是电容传感器,其通过眼球与电容极板之间的电容值来检测眼球运动;更可以是肌电流检测器,其通过在鼻梁、额头、耳朵或耳垂处放置电极,通过检测的肌电流信号模式来检测眼球运动。Of course, in addition to the optical recording method, the eye tracking device can also be a MEMS micro-electromechanical system, such as a MEMS infrared scanning reflector, an infrared light source, and an infrared receiver; or a capacitive sensor, which detects eye movement through the capacitance value between the eyeball and the capacitor plate; it can also be a myoelectric detector, which detects eye movement by placing electrodes on the bridge of the nose, forehead, ears, or earlobes, and detecting eye movement through the detected myoelectric signal pattern.

目前视线追踪技术有多种方法可以获取用户的注视信息,在这个不再一一举例。Currently, there are many ways to obtain user gaze information using eye tracking technology, and we will not list them one by one here.

实施例一Embodiment 1

图1为本发明实施例一提供的一种眼球追踪校准系数的确定方法的流程图,本实施例可适用于对用户使用眼球追踪设备时确定校准系数的情况,该方法可以由眼球追踪校准系数的确定装置来执行,该装置可由硬件和/或软件组成,并一般可集成在具有眼球追踪校准系数的确定功能的设备中,该设备可以是服务器或服务器集群等电子设备。如图1所示,具体包括如下步骤:FIG1 is a flow chart of a method for determining an eye tracking calibration coefficient provided in Embodiment 1 of the present invention. This embodiment is applicable to the case where a calibration coefficient is determined when a user uses an eye tracking device. The method can be executed by an eye tracking calibration coefficient determination device, which can be composed of hardware and/or software and can generally be integrated in a device having an eye tracking calibration coefficient determination function, which can be an electronic device such as a server or a server cluster. As shown in FIG1 , the method specifically includes the following steps:

步骤110,采集用户注视设定目标点的眼部图像。Step 110: collecting an eye image of the user gazing at a set target point.

其中,设定点可以是在屏幕上设定的位置上显示的一个点,也可以是现实世界中指定的某个标志物的位置点,统称目标点以供用户注视。眼部图像可以是用户注视设定目标点时采集的多张连续的眼部图像。本实施例中,用户使用眼动追踪设备时,需要先对用户的眼睛进行校准,以获取用户的校准系数,从而根据校准系数对用户的视线进行追踪。用户使用眼动追踪设备,设备显示或指示一个点供用户注视,并采集用户注视该目标点的多张眼部图像。The set point may be a point displayed at a set position on the screen, or may be a position point of a designated marker in the real world, collectively referred to as a target point for the user to look at. The eye image may be a plurality of continuous eye images captured when the user looks at the set target point. In this embodiment, when the user uses the eye tracking device, the user's eyes need to be calibrated first to obtain the user's calibration coefficient, so as to track the user's line of sight according to the calibration coefficient. When the user uses the eye tracking device, the device displays or indicates a point for the user to look at, and captures a plurality of eye images of the user looking at the target point.

步骤120,根据存储的各校准系数和眼部图像确定各校准系数分别对应的计算注视点信息。Step 120, determining the calculated gaze point information corresponding to each calibration coefficient according to the stored calibration coefficients and the eye image.

其中,存储的校准系数可以是对不同用户的眼球进行校准获得的得分超过设定阈值的校准系数,即最优校准系数。本实施例中,可以从存储的校准系数中选择一个作为当前用户的校准系数,从而无需对当前用户重新校准。计算注视点信息可以是根据校准系数和眼部图像计算出的注视点的坐标信息。The stored calibration coefficients may be calibration coefficients obtained by calibrating the eyeballs of different users and having a score exceeding a set threshold, i.e., the optimal calibration coefficients. In this embodiment, one of the stored calibration coefficients may be selected as the calibration coefficient of the current user, thereby eliminating the need to recalibrate the current user. The calculated gaze point information may be the coordinate information of the gaze point calculated based on the calibration coefficients and the eye image.

具体的,根据存储的各校准系数和眼部图像确定各校准系数分别对应的计算注视点信息的方式可以是:对眼部图像进行特征提取,获得眼部特征信息;根据存储的各校准系数和特征信息进行计算,获得各校准系数分别对应的计算注视点信息。Specifically, the method of determining the calculated gaze point information corresponding to each calibration coefficient based on the stored calibration coefficients and eye images can be: performing feature extraction on the eye image to obtain eye feature information; performing calculations based on the stored calibration coefficients and feature information to obtain the calculated gaze point information corresponding to each calibration coefficient.

其中,眼部特征信息可以包括瞳孔中心位置信息和光斑中心位置信息。眼部特性信息可以包括一个或多个子特征信息,即一张或多张眼部图像对应的特征信息。本实施例中,对眼部图像进行特征提取,获得眼部特征信息的过程可以是:若眼部图像包含多张,则对每张眼部图像分别进行特征提取,获得多个子特征信息;对多个子特征信息进行聚类算法选择,获得至少一个最优子特征信息;将至少一个最优子特征信息确定为眼部特征信息。Among them, the eye feature information may include pupil center position information and spot center position information. The eye feature information may include one or more sub-feature information, that is, feature information corresponding to one or more eye images. In this embodiment, the process of extracting features from eye images to obtain eye feature information may be: if there are multiple eye images, then extracting features from each eye image to obtain multiple sub-feature information; performing clustering algorithm selection on the multiple sub-feature information to obtain at least one optimal sub-feature information; and determining at least one optimal sub-feature information as the eye feature information.

其中,子特性信息可以包括子瞳孔中心位置信息和子光斑中心位置信息。本实施例中,若采集的用户注视设定目标点的眼部图像为多张,则对每张图像进行特征提取,获得每张眼部图像分别对应的子特征信息,然后采集聚类算法对多个子特征信息进行聚类,获得一个或多个最优子特征信息,最后根据校准系数和最优子特征信息获得计算注视点信息。The sub-feature information may include sub-pupil center position information and sub-spot center position information. In this embodiment, if multiple eye images of the user gazing at the set target point are collected, feature extraction is performed on each image to obtain sub-feature information corresponding to each eye image, and then a clustering algorithm is used to cluster the multiple sub-feature information to obtain one or more optimal sub-feature information, and finally the gaze point information is calculated based on the calibration coefficient and the optimal sub-feature information.

步骤130,根据计算注视点信息和设定目标点的信息确定各校准系数的注视精度。Step 130, determining the gaze accuracy of each calibration coefficient based on the calculated gaze point information and the set target point information.

其中,注视精度可以是计算注视点和设定目标点间的距离,或者计算注视点和用户眼睛连线与设定目标点和用户眼睛连线的夹角。The gaze accuracy may be calculated by calculating the distance between the gaze point and the set target point, or by calculating the angle between the line connecting the gaze point and the user's eyes and the line connecting the set target point and the user's eyes.

可选的,在获得各存储的校准系数对应的计算注视点后,获取计算注视点和设定目标点间的距离,将计算获得的距离确定为注视精度。Optionally, after obtaining the calculated gaze point corresponding to each stored calibration coefficient, the distance between the calculated gaze point and the set target point is obtained, and the calculated distance is determined as the gaze accuracy.

可选的,在获得各存储的校准系数对应的计算注视点后,确定计算注视点和用户眼睛连线与设定目标点和用户眼睛连线的夹角,将计算获得的夹角确定为注视精度。Optionally, after obtaining the calculated gaze point corresponding to each stored calibration coefficient, the angle between the calculated gaze point and the user's eye and the line between the set target point and the user's eye is determined, and the calculated angle is determined as the gaze accuracy.

步骤140,将注视精度满足设定条件的校准系数确定为目标校准系数。Step 140: determine the calibration coefficient whose gaze accuracy meets the set conditions as the target calibration coefficient.

具体的,若注视精度为计算注视点和设定目标点间的距离,将注视精度满足设定条件的校准系数确定为目标校准系数的方式可以是:将距离小于第一设定值的校准系数确定为目标校准系数。其中,第一设定值可以为0.6mm-2mm中的一个数值。Specifically, if the gaze accuracy is to calculate the distance between the gaze point and the set target point, the calibration coefficient whose gaze accuracy meets the set conditions may be determined as the target calibration coefficient by: determining the calibration coefficient whose distance is less than a first set value as the target calibration coefficient. The first set value may be a value between 0.6 mm and 2 mm.

具体的,注视精度为计算注视点和用户眼睛连线与设定目标点和用户眼睛连线的夹角,将注视精度满足设定条件的校准系数确定为目标校准系数的方式为:将夹角小于第二设定值得校准系数确定为目标校准系数。其中,第二设定值可以为0.5度-2度中的一个数值。Specifically, the gaze accuracy is the angle between the line between the gaze point and the user's eyes and the line between the set target point and the user's eyes, and the calibration coefficient whose gaze accuracy meets the set conditions is determined as the target calibration coefficient by: determining the calibration coefficient whose angle is less than the second set value as the target calibration coefficient. The second set value can be a value between 0.5 degrees and 2 degrees.

需要注意的,第一设定值和第二设定值的具体数值根据眼球追踪设备本身的精度以及实际应用的需求精度而确定,可以根据实际需求进行确定和改变。It should be noted that the specific values of the first setting value and the second setting value are determined according to the accuracy of the eye tracking device itself and the required accuracy of the actual application, and can be determined and changed according to actual needs.

本实施例中,在确定目标校准系数时,可以从存储的所有校准系数中进行选择,或者从部分(如得分排序靠前)校准系数中选择。In this embodiment, when determining the target calibration coefficient, it can be selected from all stored calibration coefficients, or selected from part of the calibration coefficients (such as those ranked higher in score).

本实施例的技术方案,首先采集用户注视设定目标点的眼部图像,然后根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息,再然后根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度,最后将注视精度满足设定条件的校准系数确定为目标校准系数。本发明实施例提供的眼球追踪校准系数的确定方法,通过用户注视一个设定目标点的眼部图像和存储的校准系数来确定适合用户的目标校准系数,可以快速的确定用户的校准系数,从而提高眼球追踪的效率和用户体验。The technical solution of this embodiment first collects the eye image of the user gazing at the set target point, then determines the calculated gaze point information corresponding to each calibration coefficient based on the stored calibration coefficients and the eye image, then determines the gaze accuracy of each calibration coefficient based on the calculated gaze point information and the information of the set target point, and finally determines the calibration coefficient whose gaze accuracy meets the set conditions as the target calibration coefficient. The method for determining the eye tracking calibration coefficient provided by the embodiment of the present invention determines the target calibration coefficient suitable for the user by using the eye image of the user gazing at a set target point and the stored calibration coefficient, and can quickly determine the calibration coefficient of the user, thereby improving the efficiency of eye tracking and user experience.

可选的,在采集用户注视设定目标点的眼部图像之前,还包括如下步骤:对多个用户进行眼球追踪校准,获得多个校准系数;计算各校准系数的得分,将得分超过设定阈值的校准系数确定为最优校准系数;将最优校准系数进行存储。Optionally, before collecting the eye image of the user looking at the set target point, the following steps are also included: performing eye tracking calibration on multiple users to obtain multiple calibration coefficients; calculating the score of each calibration coefficient, and determining the calibration coefficient whose score exceeds a set threshold as the optimal calibration coefficient; and storing the optimal calibration coefficient.

其中,对用户进行眼球追踪校准,获得校准系数的过程可以是:采集用户注视多个目标点的眼部图像;对每个目标点对应的多张眼部图像采用聚类算法进行处理,获得各目标点分别对应的至少一张最优眼部图像;根据各目标点对应的至少一张眼部图像计算校准系数。Among them, the process of performing eye tracking calibration on the user and obtaining the calibration coefficient can be: collecting eye images of the user gazing at multiple target points; using a clustering algorithm to process multiple eye images corresponding to each target point to obtain at least one optimal eye image corresponding to each target point; and calculating the calibration coefficient based on at least one eye image corresponding to each target point.

具体的,对每个目标点对应的多张眼部图像采用聚类算法进行处理的方式可以是,针对当前目标点对应的多张眼部图像,首先提取每张眼部图像的特征信息,获得多个子特征信息,然后采用聚类算法对多个子特征信息进行聚类,获得当前目标点的一个或多个最优子特征信息。相应的,根据各目标点对应的至少一张眼部图像计算校准系数的方式可以是,根据各目标点对应的一个或多个最优子特征信息计算校准系数。Specifically, the method of processing the multiple eye images corresponding to each target point using a clustering algorithm may be, for the multiple eye images corresponding to the current target point, first extracting feature information of each eye image to obtain multiple sub-feature information, and then clustering the multiple sub-feature information using a clustering algorithm to obtain one or more optimal sub-feature information of the current target point. Correspondingly, the method of calculating the calibration coefficient according to at least one eye image corresponding to each target point may be to calculate the calibration coefficient according to one or more optimal sub-feature information corresponding to each target point.

其中,计算校准系数的得分的方式可以是:根据校准系数和各目标点对应的至少一张最优眼部图像确定计算注视点的注视精度;根据计算注视点的注视精度计算对应校准系数的得分。其中,注视精度的数值越低,对应的校准系数的得分越高。The method of calculating the score of the calibration coefficient may be: determining the gaze accuracy of the calculated gaze point according to the calibration coefficient and at least one optimal eye image corresponding to each target point; and calculating the score of the corresponding calibration coefficient according to the gaze accuracy of the calculated gaze point. The lower the value of the gaze accuracy, the higher the score of the corresponding calibration coefficient.

其中,注视精度可以是计算注视点和设定目标点间的距离,或者计算注视点和用户眼睛连线与设定目标点和用户眼睛连线的夹角。具体的,针对当前目标点,根据当前目标点的一个或多个最优子特性信息和校准系数获得当前目标点对应的计算注视点信息,然后根据计算注视点信息和当前目标点信息计算当前计算注视点的注视精度。The gaze accuracy may be the distance between the calculated gaze point and the set target point, or the angle between the calculated gaze point and the user's eyes and the set target point and the user's eyes. Specifically, for the current target point, the calculated gaze point information corresponding to the current target point is obtained according to one or more optimal sub-characteristic information and the calibration coefficient of the current target point, and then the gaze accuracy of the current calculated gaze point is calculated according to the calculated gaze point information and the current target point information.

本实施例中,根据各计算注视点的注视精度计算校准系数的得分的方式可以是,求取各计算注视点的平均注视精度,根据平均注视精度确定校准系数的得分。本实施例中,可以预先设置注视精度与得分之间的对应关系,根据对应关系创建注视精度与校准系数得分的映射表。具体的,在获得校准系数后,根据校准系数确定各计算注视点的注视精度,并求取平均注视精度,然后从映射表中查找平均注视精度对应的得分,从而获得校准系数的得分。示例性的,假设各计算注视点的注视精度为0.3、0.33、0.44、0.35、0.46,平均注视精度为0.376,从映射表中查找到0.376对应的得分为92分,即校准系数的得分为92分。若设定阈值设置为90分,则将得分为92的校准系数确定为最优校准系数,并进行存储。In this embodiment, the way to calculate the score of the calibration coefficient according to the gaze accuracy of each calculated gaze point can be to obtain the average gaze accuracy of each calculated gaze point, and determine the score of the calibration coefficient according to the average gaze accuracy. In this embodiment, the corresponding relationship between the gaze accuracy and the score can be preset, and a mapping table of the gaze accuracy and the calibration coefficient score can be created according to the corresponding relationship. Specifically, after obtaining the calibration coefficient, the gaze accuracy of each calculated gaze point is determined according to the calibration coefficient, and the average gaze accuracy is obtained, and then the score corresponding to the average gaze accuracy is found from the mapping table, so as to obtain the score of the calibration coefficient. Exemplarily, assuming that the gaze accuracy of each calculated gaze point is 0.3, 0.33, 0.44, 0.35, and 0.46, and the average gaze accuracy is 0.376, the score corresponding to 0.376 is found from the mapping table to be 92 points, that is, the score of the calibration coefficient is 92 points. If the threshold is set to 90 points, the calibration coefficient with a score of 92 is determined as the optimal calibration coefficient and stored.

本实施例中,将得分超过设定阈值的校准系数进行存储,以备后续使用眼球追踪设备的用户采用,无需对后续使用眼球追踪设备的用户重新进行校准,可以提高眼球追踪的效率。In this embodiment, the calibration coefficients whose scores exceed the set threshold are stored for subsequent use by users who use the eye tracking device. There is no need to recalibrate the users who use the eye tracking device, which can improve the efficiency of eye tracking.

实施例二Embodiment 2

图2为本发明实施例二提供的一种眼球追踪校准系数的确定装置的结构示意图。如图2所示,该装置包括:眼部图像采集模块210,计算注视点信息获取模块220,注视精度确定模块230和目标校准系数确定模块240。Fig. 2 is a schematic diagram of the structure of an eye tracking calibration coefficient determination device provided by Embodiment 2 of the present invention. As shown in Fig. 2, the device comprises: an eye image acquisition module 210, a gaze point information acquisition module 220, a gaze accuracy determination module 230 and a target calibration coefficient determination module 240.

眼部图像采集模块210,用于采集用户注视设定目标点的眼部图像;Eye image acquisition module 210, used to acquire an eye image of a user gazing at a set target point;

计算注视点信息获取模块220,用于根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息;A calculated fixation point information acquisition module 220, configured to determine the calculated fixation point information corresponding to each calibration coefficient according to each stored calibration coefficient and the eye image;

注视精度确定模块230,用于根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度;A gaze accuracy determination module 230, configured to determine the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information;

目标校准系数确定模块240,用于将注视精度满足设定条件的校准系数确定为目标校准系数。The target calibration coefficient determination module 240 is used to determine the calibration coefficient whose gaze accuracy meets the set conditions as the target calibration coefficient.

可选的,计算注视点信息获取模块220,还用于:Optionally, the module for obtaining the gaze point information calculation 220 is further configured to:

对所述眼部图像进行特征提取,获得眼部特征信息;所述眼部特征信息包括瞳孔中心位置信息和光斑中心位置信息;Extracting features from the eye image to obtain eye feature information; the eye feature information includes pupil center position information and light spot center position information;

根据存储的各校准系数和所述眼部特征信息进行计算,获得各校准系数分别对应的计算注视点信息。Calculation is performed based on the stored calibration coefficients and the eye feature information to obtain calculated gaze point information corresponding to each calibration coefficient.

可选的,计算注视点信息获取模块220,还用于:Optionally, the module for obtaining the gaze point information calculation 220 is further configured to:

若眼部图像包含多张,则对每张眼部图像分别进行特征提取,获得多个子特征信息;If there are multiple eye images, feature extraction is performed on each eye image to obtain multiple sub-feature information;

对所述多个子特征信息进行聚类算法选择,获得至少一个最优子特征信息;将所述至少一个最优子特征信息确定为眼部特征信息。A clustering algorithm is performed on the multiple sub-feature information to obtain at least one optimal sub-feature information; and the at least one optimal sub-feature information is determined as eye feature information.

可选的,注视精度确定模块230,还用于:Optionally, the gaze accuracy determination module 230 is further configured to:

获取所述计算注视点和所述设定目标点间的距离,将所述距离确定为注视精度;Obtaining the distance between the calculated gaze point and the set target point, and determining the distance as the gaze accuracy;

可选的,目标校准系数确定模块240,还用于:Optionally, the target calibration coefficient determination module 240 is further configured to:

将距离小于第一设定值的校准系数确定为目标校准系数。The calibration coefficient whose distance is smaller than the first set value is determined as the target calibration coefficient.

可选的,注视精度确定模块230,还用于:Optionally, the gaze accuracy determination module 230 is further configured to:

确定计算注视点和用户眼睛连线与所述设定目标点和用户眼睛连线的夹角,将所述夹角确定为注视精度;Determine and calculate the angle between the line between the gaze point and the user's eyes and the line between the set target point and the user's eyes, and determine the angle as the gaze accuracy;

可选的,目标校准系数确定模块240,还用于:Optionally, the target calibration coefficient determination module 240 is further configured to:

将夹角小于第二设定值得校准系数确定为目标校准系数。The calibration coefficient whose included angle is smaller than the second set value is determined as the target calibration coefficient.

可选的,还包括:最优校准系数获取模块,用于:Optionally, it also includes: an optimal calibration coefficient acquisition module, used to:

对多个用户进行眼球追踪校准,获得多个校准系数;Perform eye tracking calibration on multiple users to obtain multiple calibration coefficients;

计算各校准系数的得分,将得分超过设定阈值的校准系数确定最优校准系数;Calculate the score of each calibration coefficient, and determine the optimal calibration coefficient for the calibration coefficient whose score exceeds the set threshold;

将所述最优校准系数进行存储。The optimal calibration coefficient is stored.

可选的,最优校准系数获取模块,还用于:Optionally, the optimal calibration coefficient acquisition module is also used to:

采集用户注视多个目标点的眼部图像;Collect eye images of the user gazing at multiple target points;

对每个目标点对应的多张眼部图像采用聚类算法进行处理,获得各目标点分别对应的至少一张最优眼部图像;A clustering algorithm is used to process multiple eye images corresponding to each target point to obtain at least one optimal eye image corresponding to each target point;

根据各目标点对应的至少一张眼部图像计算校准系数。The calibration coefficient is calculated according to at least one eye image corresponding to each target point.

可选的,最优校准系数获取模块,还用于:Optionally, the optimal calibration coefficient acquisition module is also used to:

根据所述校准系数和各目标点对应的至少一张最优眼部图像计算各目标点的注视精度;Calculating the gaze accuracy of each target point according to the calibration coefficient and at least one optimal eye image corresponding to each target point;

根据所述各目标点的注视精度计算所述校准系数的得分。The score of the calibration coefficient is calculated according to the gaze accuracy of each target point.

上述装置可执行本发明前述所有实施例所提供的方法,具备执行上述方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本发明前述所有实施例所提供的方法。The above device can execute the methods provided by all the above embodiments of the present invention, and has the corresponding functional modules and beneficial effects of executing the above methods. For technical details not described in detail in this embodiment, please refer to the methods provided by all the above embodiments of the present invention.

实施例三Embodiment 3

图3为本发明实施例三提供的一种计算机设备的结构示意图。图3示出了适于用来实现本发明实施方式的计算机设备312的框图。图3显示的计算机设备312仅仅是一个示例,不应对本发明实施例的功能和使用范围带来任何限制。设备312是典型的眼球追踪校准系数的确定功能的计算设备。FIG3 is a block diagram of a computer device provided in Embodiment 3 of the present invention. FIG3 shows a block diagram of a computer device 312 suitable for implementing the present invention. The computer device 312 shown in FIG3 is only an example and should not limit the functions and scope of use of the present invention. Device 312 is a typical computing device for determining the eye tracking calibration coefficient.

如图3所示,计算机设备312以通用计算设备的形式表现。计算机设备312的组件可以包括但不限于:一个或者多个处理器316,存储装置328,连接不同系统组件(包括存储装置328和处理器316)的总线318。As shown in Fig. 3, computer device 312 is in the form of a general-purpose computing device. Components of computer device 312 may include, but are not limited to: one or more processors 316, storage device 328, and bus 318 connecting different system components (including storage device 328 and processor 316).

总线318表示几类总线结构中的一种或多种,包括存储器总线或者存储器控制器,外围总线,图形加速端口,处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说,这些体系结构包括但不限于工业标准体系结构(Industry StandardArchitecture,ISA)总线,微通道体系结构(Micro Channel Architecture,MCA)总线,增强型ISA总线、视频电子标准协会(Video Electronics Standards Association,VESA)局域总线以及外围组件互连(Peripheral Component Interconnect,PCI)总线。Bus 318 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor or a local bus using any of a variety of bus architectures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnect (PCI) bus.

计算机设备312典型地包括多种计算机系统可读介质。这些介质可以是任何能够被计算机设备312访问的可用介质,包括易失性和非易失性介质,可移动的和不可移动的介质。The computer device 312 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 312, including volatile and non-volatile media, removable and non-removable media.

存储装置328可以包括易失性存储器形式的计算机系统可读介质,例如随机存取存储器(Random Access Memory,RAM)330和/或高速缓存存储器332。计算机设备312可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例,存储系统334可以用于读写不可移动的、非易失性磁介质(图3未显示,通常称为“硬盘驱动器”)。尽管图3中未示出,可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器,以及对可移动非易失性光盘(例如只读光盘(Compact Disc-Read Only Memory,CD-ROM)、数字视盘(Digital Video Disc-Read Only Memory,DVD-ROM)或者其它光介质)读写的光盘驱动器。在这些情况下,每个驱动器可以通过一个或者多个数据介质接口与总线318相连。存储装置328可以包括至少一个程序产品,该程序产品具有一组(例如至少一个)程序模块,这些程序模块被配置以执行本发明各实施例的功能。The storage device 328 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 330 and/or cache memory 332. The computer device 312 may further include other removable/non-removable, volatile/non-volatile computer system storage media. By way of example only, the storage system 334 may be used to read and write non-removable, non-volatile magnetic media (not shown in FIG. 3 , commonly referred to as a “hard drive”). Although not shown in FIG. 3 , a disk drive for reading and writing removable non-volatile disks (such as “floppy disks”) and an optical disk drive for reading and writing removable non-volatile optical disks (such as compact disc-read only memory (CD-ROM), digital video discs (DVD-ROM) or other optical media) may be provided. In these cases, each drive may be connected to the bus 318 via one or more data media interfaces. The storage device 328 may include at least one program product having a set (eg, at least one) of program modules configured to perform the functions of various embodiments of the present invention.

具有一组(至少一个)程序模块326的程序336,可以存储在例如存储装置328中,这样的程序模块326包括但不限于操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块326通常执行本发明所描述的实施例中的功能和/或方法。A program 336 having a set (at least one) of program modules 326 may be stored, for example, in a storage device 328, such program modules 326 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 326 generally perform the functions and/or methods of the embodiments described herein.

计算机设备312也可以与一个或多个外部设备314(例如键盘、指向设备、摄像头、显示器324等)通信,还可与一个或者多个使得用户能与该计算机设备312交互的设备通信,和/或与使得该计算机设备312能与一个或多个其它计算设备进行通信的任何设备(例如网卡,调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口322进行。并且,计算机设备312还可以通过网络适配器320与一个或者多个网络(例如局域网(Local AreaNetwork,LAN),广域网Wide Area Network,WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器320通过总线318与计算机设备312的其它模块通信。应当明白,尽管图中未示出,可以结合计算机设备312使用其它硬件和/或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、磁盘阵列(Redundant Arrays of IndependentDisks,RAID)系统、磁带驱动器以及数据备份存储系统等。The computer device 312 may also communicate with one or more external devices 314 (e.g., keyboard, pointing device, camera, display 324, etc.), may also communicate with one or more devices that enable a user to interact with the computer device 312, and/or communicate with any device that enables the computer device 312 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed through an input/output (I/O) interface 322. In addition, the computer device 312 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN) and/or a public network, such as the Internet) through a network adapter 320. As shown, the network adapter 320 communicates with other modules of the computer device 312 through a bus 318. It should be understood that although not shown in the figure, other hardware and/or software modules can be used in conjunction with the computer device 312, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, disk arrays (Redundant Arrays of Independent Disks, RAID) systems, tape drives, and data backup storage systems.

处理器316通过运行存储在存储装置328中的程序,从而执行各种功能应用以及数据处理,例如实现本发明上述实施例所提供的眼球追踪校准系数的确定方法。The processor 316 executes various functional applications and data processing by running the programs stored in the storage device 328, such as implementing the method for determining the eye tracking calibration coefficient provided in the above embodiment of the present invention.

实施例四Embodiment 4

本发明实施例提供了一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序,该程序被处理装置执行时实现如本发明实施例中的眼球追踪校准系数的确定方法。本发明上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。而在本公开中,计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读信号介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括但不限于:电线、光缆、RF(射频)等等,或者上述的任意合适的组合。The embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processing device, a method for determining an eye tracking calibration coefficient in an embodiment of the present invention is implemented. The computer-readable medium of the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

在一些实施方式中,客户端、服务器可以利用诸如HTTP(HyperText TransferProtocol,超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信,并且可以与任意形式或介质的数字数据通信(例如,通信网络)互连。通信网络的示例包括局域网(“LAN”),广域网(“WAN”),网际网(例如,互联网)以及端对端网络(例如,ad hoc端对端网络),以及任何当前已知或未来研发的网络。In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

上述计算机可读介质可以是上述电子设备中所包含的;也可以是单独存在,而未装配入该电子设备中。The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

上述计算机可读介质承载有一个或者多个程序,当上述一个或者多个程序被该电子设备执行时,使得该电子设备:接收用户输入的源文本,将所述源文本翻译为目标语种对应的目标文本;获取所述用户的历史纠正行为;根据所述历史纠正行为对所述目标文本进行纠正,获得翻译结果,并将所述翻译结果推送至所述用户所在的客户端。The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: receives a source text input by a user, translates the source text into a target text corresponding to a target language; obtains the user's historical correction behavior; corrects the target text according to the historical correction behavior, obtains a translation result, and pushes the translation result to the client where the user is located.

可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码,上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中,远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机,或者,可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

附图中的流程图和框图,图示了按照本公开各种实施例的系统、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上,流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分,该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意,在有些作为替换的实现中,方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如,两个接连地表示的方框实际上可以基本并行地执行,它们有时也可以按相反的顺序执行,这依所涉及的功能而定。也要注意的是,框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合,可以用执行规定的功能或操作的专用的基于硬件的系统来实现,或者可以用专用硬件与计算机指令的组合来实现。The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

描述于本公开实施例中所涉及到的单元可以通过软件的方式实现,也可以通过硬件的方式来实现。其中,单元的名称在某种情况下并不构成对该单元本身的限定。The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如,非限制性地,可以使用的示范类型的硬件逻辑部件包括:现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上系统(SOC)、复杂可编程逻辑设备(CPLD)等等。The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

在本公开的上下文中,机器可读介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims (10)

1.一种眼球追踪校准系数的确定方法,其特征在于,包括:1. A method for determining an eye tracking calibration coefficient, comprising: 采集用户注视设定目标点的眼部图像;Collecting eye images of the user looking at a set target point; 根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息;Determine, according to the stored calibration coefficients and the eye image, the calculated gaze point information corresponding to each calibration coefficient; 根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度;Determining the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information; 将注视精度满足设定条件的校准系数确定为目标校准系数,其中,所述目标校准系数由所述存储的各校准系数中选择;Determine a calibration coefficient whose gaze accuracy satisfies a set condition as a target calibration coefficient, wherein the target calibration coefficient is selected from the stored calibration coefficients; 其中,所述存储的各校准系数的获取方式为:对多个用户进行眼球追踪校准,获得多个校准系数;计算各校准系数的得分,将得分超过设定阈值的校准系数确定为最优校准系数;将所述最优校准系数进行存储。The stored calibration coefficients are obtained by: performing eye tracking calibration on multiple users to obtain multiple calibration coefficients; calculating the score of each calibration coefficient, and determining the calibration coefficient whose score exceeds a set threshold as the optimal calibration coefficient; and storing the optimal calibration coefficient. 2.根据权利要求1所述的方法,其特征在于,根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息,包括:2. The method according to claim 1, characterized in that determining the calculated gaze point information corresponding to each calibration coefficient respectively according to the stored calibration coefficients and the eye image comprises: 对所述眼部图像进行特征提取,获得眼部特征信息;所述眼部特征信息包括瞳孔中心位置信息和光斑中心位置信息;Extracting features from the eye image to obtain eye feature information; the eye feature information includes pupil center position information and light spot center position information; 根据存储的各校准系数和所述眼部特征信息进行计算,获得各校准系数分别对应的计算注视点信息。Calculation is performed based on the stored calibration coefficients and the eye feature information to obtain calculated gaze point information corresponding to each calibration coefficient. 3.根据权利要求2所述的方法,其特征在于,对所述眼部图像进行特征提取,获得眼部特征信息,包括:3. The method according to claim 2, characterized in that extracting features from the eye image to obtain eye feature information comprises: 若眼部图像包含多张,则对每张眼部图像分别进行特征提取,获得多个子特征信息;If there are multiple eye images, feature extraction is performed on each eye image to obtain multiple sub-feature information; 对所述多个子特征信息进行聚类算法选择,获得至少一个最优子特征信息;将所述至少一个最优子特征信息确定为眼部特征信息。A clustering algorithm is performed on the multiple sub-feature information to obtain at least one optimal sub-feature information; and the at least one optimal sub-feature information is determined as eye feature information. 4.根据权利要求1所述的方法,其特征在于,根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度,包括:4. The method according to claim 1, characterized in that determining the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information comprises: 获取所述计算注视点和所述设定目标点间的距离,将所述距离确定为注视精度;Obtaining the distance between the calculated gaze point and the set target point, and determining the distance as the gaze accuracy; 相应的,将注视精度满足设定条件的校准系数确定为目标校准系数,包括:Accordingly, the calibration coefficient whose gaze accuracy meets the set conditions is determined as the target calibration coefficient, including: 将所述距离小于第一设定值的校准系数确定为目标校准系数。The calibration coefficient for which the distance is smaller than the first set value is determined as the target calibration coefficient. 5.根据权利要求1所述的方法,其特征在于,根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度,包括:5. The method according to claim 1, characterized in that determining the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information comprises: 确定计算注视点和用户眼睛连线与所述设定目标点和用户眼睛连线的夹角,将所述夹角确定为注视精度;Determine and calculate the angle between the line between the gaze point and the user's eyes and the line between the set target point and the user's eyes, and determine the angle as the gaze accuracy; 相应的,将注视精度满足设定条件的校准系数确定为目标校准系数,包括:Accordingly, the calibration coefficient whose gaze accuracy meets the set conditions is determined as the target calibration coefficient, including: 将所述夹角小于第二设定值得校准系数确定为目标校准系数。The calibration coefficient whose angle is smaller than the second set value is determined as the target calibration coefficient. 6.根据权利要求1所述的方法,其特征在于,对用户进行眼球追踪校准,获得校准系数,包括:6. The method according to claim 1, characterized in that performing eye tracking calibration on the user to obtain the calibration coefficient comprises: 采集用户注视多个目标点的眼部图像;Collect eye images of the user gazing at multiple target points; 对每个目标点对应的多张眼部图像采用聚类算法进行处理,获得各目标点分别对应的至少一张最优眼部图像;A clustering algorithm is used to process multiple eye images corresponding to each target point to obtain at least one optimal eye image corresponding to each target point; 根据各目标点对应的至少一张最优眼部图像计算校准系数。The calibration coefficient is calculated according to at least one optimal eye image corresponding to each target point. 7.根据权利要求6所述的方法,其特征在于,计算各校准系数的得分,包括:7. The method according to claim 6, wherein calculating the score of each calibration coefficient comprises: 根据所述校准系数和各目标点对应的至少一张最优眼部图像计算各目标点的注视精度;Calculating the gaze accuracy of each target point according to the calibration coefficient and at least one optimal eye image corresponding to each target point; 根据所述各目标点的注视精度计算所述校准系数的得分。The score of the calibration coefficient is calculated according to the gaze accuracy of each target point. 8.一种眼球追踪校准系数的确定装置,其特征在于,包括:8. A device for determining an eye tracking calibration coefficient, comprising: 眼部图像采集模块,用于采集用户注视设定目标点的眼部图像;An eye image acquisition module, used to acquire an eye image of a user gazing at a set target point; 计算注视点信息获取模块,用于根据存储的各校准系数和所述眼部图像确定各校准系数分别对应的计算注视点信息;A calculation gaze point information acquisition module, used to determine the calculation gaze point information corresponding to each calibration coefficient according to the stored calibration coefficients and the eye image; 注视精度确定模块,用于根据所述计算注视点信息和所述设定目标点的信息确定各校准系数的注视精度;A gaze accuracy determination module, used to determine the gaze accuracy of each calibration coefficient according to the calculated gaze point information and the set target point information; 目标校准系数确定模块,用于将注视精度满足设定条件的校准系数确定为目标校准系数,所述目标校准系数由所述存储的各校准系数中选择;A target calibration coefficient determination module, used to determine a calibration coefficient whose gaze accuracy meets a set condition as a target calibration coefficient, wherein the target calibration coefficient is selected from the stored calibration coefficients; 其中,所述存储的各校准系数的获取方式为:对多个用户进行眼球追踪校准,获得多个校准系数;计算各校准系数的得分,将得分超过设定阈值的校准系数确定为最优校准系数;将所述最优校准系数进行存储。The stored calibration coefficients are obtained by: performing eye tracking calibration on multiple users to obtain multiple calibration coefficients; calculating the score of each calibration coefficient, and determining the calibration coefficient whose score exceeds a set threshold as the optimal calibration coefficient; and storing the optimal calibration coefficient. 9.一种计算机设备,其特征在于,所述设备包括:包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如权利要求1-7任一所述的眼球追踪校准系数的确定方法。9. A computer device, characterized in that the device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method for determining the eye tracking calibration coefficient as described in any one of claims 1 to 7 is implemented. 10.一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理装置执行时实现如权利要求1-7中任一所述的眼球追踪校准系数的确定方法。10. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processing device, the method for determining an eye tracking calibration coefficient as described in any one of claims 1 to 7 is implemented.
CN202010304327.3A 2020-04-17 2020-04-17 Method, device, equipment and storage medium for determining eye tracking calibration coefficient Active CN113534945B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010304327.3A CN113534945B (en) 2020-04-17 2020-04-17 Method, device, equipment and storage medium for determining eye tracking calibration coefficient

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010304327.3A CN113534945B (en) 2020-04-17 2020-04-17 Method, device, equipment and storage medium for determining eye tracking calibration coefficient

Publications (2)

Publication Number Publication Date
CN113534945A CN113534945A (en) 2021-10-22
CN113534945B true CN113534945B (en) 2024-11-05

Family

ID=78123278

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010304327.3A Active CN113534945B (en) 2020-04-17 2020-04-17 Method, device, equipment and storage medium for determining eye tracking calibration coefficient

Country Status (1)

Country Link
CN (1) CN113534945B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113992907B (en) * 2021-10-29 2023-11-07 南昌虚拟现实研究院股份有限公司 Eyeball parameter verification method, eyeball parameter verification system, computer and readable storage medium
CN115857678B (en) * 2022-11-21 2024-03-29 北京中科睿医信息科技有限公司 Eye movement testing method, device, equipment and storage medium
CN118111680B (en) * 2024-04-26 2024-08-09 甬江实验室 Head display device calibration method, device and head display device calibration system
CN118860141A (en) * 2024-07-01 2024-10-29 成都集思鸣智科技有限公司 Eye tracking calibration method, device, system and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110427101A (en) * 2019-07-08 2019-11-08 北京七鑫易维信息技术有限公司 Calibration method, device, equipment and the storage medium of eyeball tracking
CN110908511A (en) * 2019-11-08 2020-03-24 Oppo广东移动通信有限公司 Method and related device for triggering recalibration

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002063241A1 (en) * 2001-02-08 2002-08-15 Nkk Corporation Three-dimensional coordinate measuring method, three-dimensional coordinate measuring apparatus, and method for building large-sized structure
JP4082565B2 (en) * 2002-02-28 2008-04-30 株式会社キャンパスクリエイト Automatic focusing glasses and calibration method thereof
EP3129849B1 (en) * 2014-04-11 2020-02-12 Facebook Technologies, LLC Systems and methods of eye tracking calibration
US9851791B2 (en) * 2014-11-14 2017-12-26 Facebook, Inc. Dynamic eye tracking calibration
CN110341617B (en) * 2019-07-08 2021-05-28 北京七鑫易维信息技术有限公司 Eye tracking method, device, vehicle and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110427101A (en) * 2019-07-08 2019-11-08 北京七鑫易维信息技术有限公司 Calibration method, device, equipment and the storage medium of eyeball tracking
CN110908511A (en) * 2019-11-08 2020-03-24 Oppo广东移动通信有限公司 Method and related device for triggering recalibration

Also Published As

Publication number Publication date
CN113534945A (en) 2021-10-22

Similar Documents

Publication Publication Date Title
CN113534945B (en) Method, device, equipment and storage medium for determining eye tracking calibration coefficient
JP7399210B2 (en) Method for processing ocular images of the eyes of a wearer of a head-mounted display system
JP2021166107A (en) Eyelid shape estimation using eye pose measurement
US9202280B2 (en) Position estimation based rotation of switched off light source
KR102334139B1 (en) Eye gaze tracking based upon adaptive homography mapping
CN108985210A (en) A kind of Eye-controlling focus method and system based on human eye geometrical characteristic
CN110276239B (en) Eye tracking method, electronic device, and non-transitory computer-readable recording medium
CN110051319A (en) Adjusting method, device, equipment and the storage medium of eyeball tracking sensor
CN114391117A (en) Eye tracking delay enhancement
CN110555426A (en) Sight line detection method, device, equipment and storage medium
JP2020502717A (en) Method and system for implant identification using imaging data
CN109543644B (en) Multi-modal gesture recognition method
WO2022032911A1 (en) Gaze tracking method and apparatus
US11751764B2 (en) Measuring a posterior corneal surface of an eye
CN111916203A (en) Health detection method and device, electronic equipment and storage medium
US20240013431A1 (en) Image capture devices, systems, and methods
CN112836685A (en) A kind of auxiliary reading method, system and storage medium
CN114429670A (en) Pupil detection method, device, equipment and storage medium
CN118799359A (en) Eye tracking method, device, system and storage medium
CN113741682A (en) Method, device and equipment for mapping fixation point and storage medium
CN112132755A (en) Method, apparatus, system and computer readable medium for correcting and demarcating pupil position
CN112528713B (en) Gaze point estimation method, gaze point estimation system, gaze point estimation processor and gaze point estimation equipment
WO2022267992A1 (en) Method and apparatus for acquiring target of fixation in head-mounted display device
CN109284002B (en) User distance estimation method, device, equipment and storage medium
CN110275608B (en) Human eye sight tracking method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant