CN110278367B - Human eye detection method, system, device and medium based on shooting device - Google Patents
Human eye detection method, system, device and medium based on shooting device Download PDFInfo
- Publication number
- CN110278367B CN110278367B CN201810210493.XA CN201810210493A CN110278367B CN 110278367 B CN110278367 B CN 110278367B CN 201810210493 A CN201810210493 A CN 201810210493A CN 110278367 B CN110278367 B CN 110278367B
- Authority
- CN
- China
- Prior art keywords
- image
- detected person
- eyes
- shooting device
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to the field of monitoring and discloses a human eye detection method, a human eye detection system, human eye detection equipment and a human eye detection medium based on a shooting device. The human eye detection method comprises the following steps: acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero; and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images. The invention can effectively improve the detection frequency of human eyes, thereby effectively improving the detection accuracy of the closed state of the human eyes.
Description
Technical Field
The invention relates to the field of monitoring, in particular to a human eye detection method, a human eye detection system, human eye detection equipment and a human eye detection medium based on a shooting device.
Background
Since traffic accidents related to fatigue driving are frequent, it is important to detect the state of a driver in fatigue driving.
In the process of detecting the state of the driver, the state of the driver may be detected by a contact means such as detecting a heartbeat or a pulse, or the state of the driver may be analyzed and estimated by detecting a macro motion and a local motion of the face of the driver by an image capturing device. The driver state detection based on the shooting device is widely applied to the driver state detection due to the advantages of non-contact, no interference to the driver and the like. Analyzing and estimating the state of the driver by image detection includes detection of the open-closed state of both eyes of the driver.
At present, an electronic shutter mode commonly adopted by an image sensor in a shooting device includes a Global shutter (Global shutter) and a rolling shutter (rolling shutter), and the Global shutter is realized by exposing a whole picture at the same time. All pixel points of the sensor collect light simultaneously and are exposed simultaneously. Unlike the global shutter, the rolling shutter is realized by controlling the chip to expose line by line. Rolling shutters also do not have a shutter in the practical sense, but rather have different portions that are sensitive to light at different times by electrically switching the sensor on and off. And carrying out exposure line by line until all pixel points are exposed. Among them, the rolling shutter is widely used because of its low price and convenience in subsequent data processing.
However, the imaging device using the rolling shutter has the following problems when detecting the open/close state of both eyes of the driver:
the photographing device cannot detect the opening and closing movement of human eyes occurring between the two frames of images being photographed. Because the line between the human eyes is generally parallel to the rows or columns (generally parallel to the rows) in the pixel array of its image sensor when using a camera, both eyes are exposed at the same time when exposing. For example, FIG. 1(a) shows that the eye-closing behavior of the detected person occurs at t1-t2Time period, fig. 1(b) shows a state of a human eye photographed by a photographing device employing a rolling shutter, which is commonly used (both human eyes are parallel to a row of a pixel array). It can be seen that the eye-closing behavior shown in fig. 1(a) occurs just between the times that the camera exposes the human eye portion, and therefore cannot be detected.
Disclosure of Invention
The invention aims to provide a human eye detection method, a human eye detection system, human eye detection equipment and a human eye detection medium based on a shooting device, which can effectively improve the detection frequency of human eyes so as to effectively improve the detection accuracy of human eye closure states.
In order to solve the above technical problem, an embodiment of the present invention discloses a human eye detection method based on a photographing device, wherein the photographing device includes an image sensor having a rolling shutter; the method comprises the following steps:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In one example, determining the eye opening and closing state of the detected person includes:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
In another example, the above-described subject is a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
The embodiment of the invention also discloses a human eye detection system based on the shooting device, wherein the shooting device comprises an image sensor with a rolling shutter; the system comprises
The device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring multi-frame continuous images of a detected person shot by a shooting device, when the images are shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and the determining unit is used for determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In one example, the detected person is a driver, and the photographing device is installed in a driving vehicle of the driver; and the determination unit includes:
the calculating subunit is used for calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and the determining subunit is used for determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
Embodiments of the present invention also disclose an apparatus comprising a memory storing computer executable instructions and a processor configured to execute the instructions to implement a camera-based eye detection method, wherein the camera comprises an image sensor having a rolling shutter;
the human eye detection method based on the shooting device comprises the following steps:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In one example, determining the eye opening and closing state of the detected person includes:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
In another example, the above-described subject is a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
Embodiments of the present invention also disclose a non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In another example, the instructions are further operable to perform operations comprising:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
In another example, the above-described subject is a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
Compared with the prior art, the implementation mode of the invention has the main differences and the effects that:
by adopting the shooting device with the rolling shutter and obliquely arranging the pixel array of the image sensor in the shooting device and the connection line of human eyes, the detection frequency of human eyes can be effectively improved, and the detection accuracy of the closed state of the human eyes is effectively improved.
Further, the accuracy of detecting the fatigue driving state of the driver is improved by effectively improving the accuracy of detecting the closing state of human eyes.
Drawings
FIG. 1(a) is a schematic diagram of one eye closing behavior of a tested person; FIG. 1(b) is a diagram illustrating the state of human eyes detected by a photographing apparatus using a rolling-shutter type shutter according to the prior art; fig. 1(c) is a schematic diagram of the state of the human eye detected by the photographing device using the rolling shutter door shutter according to the first embodiment of the present invention.
Fig. 2 is a schematic diagram of a position relationship between a binocular line of a detected person and a pixel array of an image sensor in the first embodiment of the present invention.
Fig. 3 is a schematic flow chart of a human eye detection method based on a camera according to a first embodiment of the present invention;
fig. 4 is a schematic structural diagram of a human eye detection system based on a camera according to a second embodiment of the present invention.
Detailed Description
In the following description, numerous technical details are set forth in order to provide a better understanding of the present application. However, it will be understood by those skilled in the art that the technical solutions claimed in the present application can be implemented without these technical details and with various changes and modifications based on the following embodiments.
In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
The first embodiment of the invention relates to a human eye detection method based on a shooting device. Fig. 3 is a flow chart of the human eye detection method.
Specifically, as shown in fig. 1, the method includes the steps of:
in step 301, multiple frames of continuous images of a detected person captured by a capturing device are obtained, wherein a connecting line between two eyes of the detected person forms an included angle with a row or a column in a pixel array of an image sensor when the images are captured, and the included angle is larger than zero. Wherein the photographing device includes an image sensor having a rolling shutter. For example, fig. 2 shows a schematic diagram of the positional relationship between the eyes of a detected person and a pixel array, in fig. 2, an arrow E indicates a scanning direction of an image sensor employing a rolling shutter to perform line-by-line scanning, lines a and B respectively indicate lines in which both eyes of the detected person are located in the pixel array, and a line D indicates a direction of the lines of the pixel array. It can be seen that the line C between the eyes is at an angle theta to the line a or B or C representing the rows in the pixel array.
Further, it is understood that the photographing device referred to in the present invention is a device capable of continuously photographing images, such as a video camera, and the like.
Step 302 is thereafter entered. And determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
It is understood that the eye-opening and closing state includes the state in which the eyes are open, closed, or in between. For example, the open-closed state of the eyes may be expressed by the degree of closure of the eyes, which is 100% when the human eyes are fully closed and 0 when the human eyes are fully open.
Further, it is understood that the exposure speed of the camera includes the exposure time required for exposing a row of pixels in the pixel array, and may further include other parameters indicating the exposure speed of the camera, which is not limited herein.
A specific way of determining the open/closed state of the eyes of the subject will be described in detail below with reference to fig. 1(c) and 2:
1) according to the line exposure time t of the shooting device0And calculating the exposure time difference delta t of the detected human eyes in each frame of image by the included angle theta and the distance s between the detected human eyes in the image. For example, Δ t may be calculated by the following formula:
Δt=t0×s×sinθ
it is to be understood that, in the embodiments of the present invention, the row exposure time refers to an exposure time required for an image sensor employing a rolling shutter door shutter to expose one row of pixels in a pixel array.
2) And determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image. For example, for the image shown in fig. 2, at time t1, the eye R in the image begins to be exposed, with a degree of closure of 30%; at time t2, the eye L in the image starts to be exposed, and its degree of closure is 60%. The human eye can be estimated to have the eye closing tendency, and whether the eye is closed or not can be estimated by the same measurement on the first frame or the last frame of the image, for example, if the closing degree of the eyes R and L in the next frame of the image is 100% and 0 respectively, the detected human can be judged to have the eye closing behavior once.
It is understood that the specific examples are illustrative and that the numbers or specific steps may be varied accordingly depending on the application, but are within the scope of the claims.
This flow ends thereafter.
With the above method, it can be applied to the field of monitoring the driving state of the driver, i.e., the person detected is the driver of the vehicle, and the photographing device is installed in the driving vehicle of the driver. In this application scenario, the camera is typically a camera mounted on the steering wheel for detecting the state of the driver during driving.
The method can improve the accuracy of detecting the closed state of human eyes, so that the method is favorable for improving the accuracy of detecting the fatigue driving state of a driver. Based on the method, a person skilled in the art can analyze whether the driver is tired or not by adopting various existing means.
According to the invention, the rolling shutter type shooting device is adopted, and the pixel array of the image sensor in the shooting device is obliquely arranged with the connection line of human eyes, so that the detection frequency of human eyes can be effectively improved, and the detection accuracy of the closed state of human eyes is effectively improved.
A second embodiment of the invention relates to a human eye detection system based on a camera, wherein the camera comprises an image sensor with a rolling shutter. Fig. 4 is a schematic structural diagram of the human eye detection system. Specifically, as shown in fig. 4, the system includes:
the acquisition unit is used for acquiring multi-frame continuous images of the detected person shot by the shooting device, wherein when the images are shot, a connecting line between two eyes of the detected person forms a certain included angle with a row or a column in a pixel array of the image sensor, and the included angle is larger than zero.
And the determining unit is used for determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In a preferred example, the detected person is a driver, and the photographing device is installed in a driving vehicle of the driver.
In another preferred embodiment, the determining unit includes:
the calculating subunit is used for calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and the determining subunit is used for determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
The first embodiment is a method embodiment corresponding to the present embodiment, and the present embodiment can be implemented in cooperation with the first embodiment. The related technical details mentioned in the first embodiment are still valid in this embodiment, and are not described herein again in order to reduce repetition. Accordingly, the related-art details mentioned in the present embodiment can also be applied to the first embodiment.
A third embodiment of the invention is directed to an apparatus comprising a memory storing computer executable instructions and a processor configured to execute the instructions to implement a camera-based eye detection method, wherein the camera comprises an image sensor having a rolling shutter; the human eye detection method based on the shooting device comprises the following steps:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In an example, determining the eye opening and closing state of the detected person includes:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
In another example, the subject is a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
A fourth embodiment of the present invention is directed to a non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of an image sensor form a certain included angle, and the included angle is larger than zero;
and determining the opening and closing state of the eyes of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
In an example, the instructions are further operable to perform operations comprising:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time and the included angle of the shooting device and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the corresponding multiple frames of continuous images and the eye part in the image.
In another example, the subject is a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
The method embodiments of the present invention may be implemented in software, hardware, firmware, etc. Whether the present invention is implemented as software, hardware, or firmware, the instruction code may be stored in any type of computer-accessible memory (e.g., permanent or modifiable, volatile or non-volatile, solid or non-solid, fixed or removable media, etc.). Also, the Memory may be, for example, Programmable Array Logic (PAL), Random Access Memory (RAM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic disk, an optical disk, a Digital Versatile Disk (DVD), or the like.
It should be noted that, each unit/module mentioned in each device embodiment of the present invention is a logical unit/module, and physically, one logical unit may be one physical unit, or may be a part of one physical unit, or may be implemented by a combination of multiple physical units, and the physical implementation manner of these logical units itself is not the most important, and the combination of the functions implemented by these logical units is the key to solve the technical problem provided by the present invention. Furthermore, the above-mentioned embodiments of the apparatus of the present invention do not introduce elements that are less relevant for solving the technical problems of the present invention in order to highlight the innovative part of the present invention, which does not indicate that there are no other elements in the above-mentioned embodiments of the apparatus.
It is to be noted that in the claims and the description of the present patent, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the use of the verb "comprise a" to define an element does not exclude the presence of another, same element in a process, method, article, or apparatus that comprises the element.
While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.
Claims (11)
1. A human eye detection method based on a shooting device is characterized in that the shooting device comprises an image sensor with a rolling shutter;
the method comprises the following steps:
acquiring a multi-frame continuous image of a detected person shot by the shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of the image sensor form a certain included angle, and the included angle is larger than zero;
and determining the eye opening and closing state of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous image.
2. The human eye detection method of claim 1, wherein the determining the eye opening and closing state of the detected human eye comprises:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time of the shooting device, the included angle and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the plurality of frames of continuous images and the eye part in the image.
3. The human eye detection method according to claim 1 or 2, wherein the human eye is detected as a driver of a vehicle, and the photographing device is installed in a driving vehicle of the driver.
4. A human eye detection system based on a camera, characterized in that the camera comprises an image sensor with a rolling shutter;
the system comprises
The acquisition unit is used for acquiring multi-frame continuous images of the detected person shot by the shooting device, wherein when the images are shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of the image sensor form a certain included angle, and the included angle is larger than zero;
and the determining unit is used for determining the eye opening and closing state of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous images.
5. The human eye detection system according to claim 4, wherein the human eye is detected as a driver, and the photographing device is installed in a driving vehicle of the driver; and is
The determination unit includes:
the calculating subunit is used for calculating the exposure time difference of the two eyes of the detected person in each frame of the image according to the line exposure time of the shooting device, the included angle and the distance between the two eyes of the detected person in the image;
and the determining subunit is used for determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the plurality of frames of continuous images and the eye part in the image.
6. An apparatus comprising a memory storing computer executable instructions and a processor configured to execute the instructions to implement a camera-based human eye detection method, wherein the camera comprises an image sensor having a rolling shutter;
the human eye detection method based on the shooting device comprises the following steps:
acquiring a multi-frame continuous image of a detected person shot by the shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of the image sensor form a certain included angle, and the included angle is larger than zero;
and determining the eye opening and closing state of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous image.
7. The apparatus of claim 6, wherein the determining the eye-opening and eye-closing state of the detected person comprises:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time of the shooting device, the included angle and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the plurality of frames of continuous images and the eye part in the image.
8. The apparatus according to claim 6 or 7, characterized in that the detected person is a vehicle driver, and the photographing device is installed in a driving vehicle of the driver.
9. A non-transitory computer storage medium encoded with a computer program, the computer program comprising instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
acquiring a multi-frame continuous image of a detected person shot by a shooting device, wherein when the image is shot, a connecting line between two eyes of the detected person and a row or a column in a pixel array of the image sensor form a certain included angle, and the included angle is larger than zero;
and determining the eye opening and closing state of the detected person according to the exposure speed of the shooting device and the eye part of the person in the multi-frame continuous image.
10. The computer storage medium of claim 9, wherein the instructions are further operable to perform operations comprising:
calculating the exposure time difference of the two eyes of the detected person in each frame of image according to the line exposure time of the shooting device, the included angle and the distance between the two eyes of the detected person in the image;
and determining the eye opening and closing state of the detected person according to the exposure time difference of each frame of image in the plurality of frames of continuous images and the eye part in the image.
11. The computer storage medium of claim 9 or 10, wherein the detected person is a driver of a vehicle, and the camera is installed in a driving vehicle of the driver.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810210493.XA CN110278367B (en) | 2018-03-14 | 2018-03-14 | Human eye detection method, system, device and medium based on shooting device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810210493.XA CN110278367B (en) | 2018-03-14 | 2018-03-14 | Human eye detection method, system, device and medium based on shooting device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110278367A CN110278367A (en) | 2019-09-24 |
| CN110278367B true CN110278367B (en) | 2021-11-19 |
Family
ID=67957631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810210493.XA Active CN110278367B (en) | 2018-03-14 | 2018-03-14 | Human eye detection method, system, device and medium based on shooting device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110278367B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101692980A (en) * | 2009-10-30 | 2010-04-14 | 吴泽俊 | Method for detecting fatigue driving |
| CN101834997A (en) * | 2009-03-09 | 2010-09-15 | 三星数码影像株式会社 | The method of digital image processing apparatus and this digital image processing apparatus of control |
| CN102054163A (en) * | 2009-10-27 | 2011-05-11 | 南京理工大学 | Method for testing driver fatigue based on monocular vision |
| CN102193269A (en) * | 2010-03-15 | 2011-09-21 | 索尼公司 | Image pickup apparatus |
| CN203838770U (en) * | 2014-04-29 | 2014-09-17 | 深圳前向启创数码技术有限公司 | Automobile data recorder |
| CN104718743A (en) * | 2012-10-02 | 2015-06-17 | 株式会社电装 | State monitoring device |
| DE102014221039A1 (en) * | 2014-10-16 | 2016-04-21 | Robert Bosch Gmbh | A control device for a motor vehicle having a driver-side camera and a method for picking up the face of a vehicle occupant |
| CN106327801A (en) * | 2015-07-07 | 2017-01-11 | 北京易车互联信息技术有限公司 | Method and device for detecting fatigue driving |
| CN107563346A (en) * | 2017-09-20 | 2018-01-09 | 南京栎树交通互联科技有限公司 | One kind realizes that driver fatigue sentences method for distinguishing based on eye image processing |
| CN107595307A (en) * | 2017-10-23 | 2018-01-19 | 湖南科技大学 | Fatigue driving detection device and detection method based on machine vision eye recognition |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8604932B2 (en) * | 1992-05-05 | 2013-12-10 | American Vehicular Sciences, LLC | Driver fatigue monitoring system and method |
| US7596242B2 (en) * | 1995-06-07 | 2009-09-29 | Automotive Technologies International, Inc. | Image processing for vehicular applications |
| US10019634B2 (en) * | 2010-06-04 | 2018-07-10 | Masoud Vaziri | Method and apparatus for an eye tracking wearable computer |
-
2018
- 2018-03-14 CN CN201810210493.XA patent/CN110278367B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101834997A (en) * | 2009-03-09 | 2010-09-15 | 三星数码影像株式会社 | The method of digital image processing apparatus and this digital image processing apparatus of control |
| CN102054163A (en) * | 2009-10-27 | 2011-05-11 | 南京理工大学 | Method for testing driver fatigue based on monocular vision |
| CN101692980A (en) * | 2009-10-30 | 2010-04-14 | 吴泽俊 | Method for detecting fatigue driving |
| CN102193269A (en) * | 2010-03-15 | 2011-09-21 | 索尼公司 | Image pickup apparatus |
| CN104718743A (en) * | 2012-10-02 | 2015-06-17 | 株式会社电装 | State monitoring device |
| CN203838770U (en) * | 2014-04-29 | 2014-09-17 | 深圳前向启创数码技术有限公司 | Automobile data recorder |
| DE102014221039A1 (en) * | 2014-10-16 | 2016-04-21 | Robert Bosch Gmbh | A control device for a motor vehicle having a driver-side camera and a method for picking up the face of a vehicle occupant |
| CN106327801A (en) * | 2015-07-07 | 2017-01-11 | 北京易车互联信息技术有限公司 | Method and device for detecting fatigue driving |
| CN107563346A (en) * | 2017-09-20 | 2018-01-09 | 南京栎树交通互联科技有限公司 | One kind realizes that driver fatigue sentences method for distinguishing based on eye image processing |
| CN107595307A (en) * | 2017-10-23 | 2018-01-19 | 湖南科技大学 | Fatigue driving detection device and detection method based on machine vision eye recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110278367A (en) | 2019-09-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8035725B2 (en) | Multi-focus camera apparatus and image processing method and program used therein | |
| US8436907B2 (en) | Heterogeneous video capturing system | |
| JP6629454B2 (en) | Image fusion method and device, and terminal device | |
| US9467623B2 (en) | Image correcting apparatus and method for imaging device | |
| US10455147B2 (en) | Image processing method | |
| US20190230269A1 (en) | Monitoring camera, method of controlling monitoring camera, and non-transitory computer-readable storage medium | |
| EP2309457A1 (en) | Image processing apparatus, image capturing apparatus, image processing method, and program | |
| JP2020520603A5 (en) | ||
| JP6860433B2 (en) | Processing equipment, processing systems, methods and programs | |
| JP6544393B2 (en) | Image recording apparatus, image recording method and image recording program | |
| JP2007028123A5 (en) | ||
| JP7441815B2 (en) | Methods and devices for determining video authenticity | |
| US10699386B2 (en) | Techniques for scene-based nonuniformity correction in shutterless FIR cameras | |
| CN116152691A (en) | Image detection method, device, equipment and storage medium | |
| CN110278367B (en) | Human eye detection method, system, device and medium based on shooting device | |
| JP7626887B2 (en) | Masking detected objects in a video stream | |
| US20210314476A1 (en) | Method for calculating exposure evaluation value and imaging device | |
| US20100253798A1 (en) | Image processing apparatus, digital camera, and recording medium | |
| KR20150146424A (en) | Method for determining estimated depth in an image and system thereof | |
| CN112016423A (en) | Vehicle door state identification method, device, equipment and computer storage medium | |
| JP4052348B2 (en) | Image processing apparatus and image processing method | |
| US11985432B2 (en) | Image processing device and image processing method suitably applied to biometric authentication | |
| KR20180071532A (en) | Method and Apparatus for Capturing and Storing High Resolution Endoscope Image | |
| KR20220035029A (en) | Method and apparatus for removing the remembrance in an infrared image of a changing scene | |
| KR100278989B1 (en) | Closed Circuit Monitoring Apparatus and Method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |