CN104331168B - Display adjusting method and electronic equipment - Google Patents

Abstract

The invention is applicable to the field of electronic equipment, and provides a display adjustment method and electronic equipment. When the user browses the screen on the display screen, the user's face image is obtained; the feature analysis of the face image is carried out to identify the viewing angle of the user's eyes; based on the viewing angle, the display of the screen is adjusted according to a special algorithm angle so that part of the picture is displayed towards the user's eyes. Realize real-time tracking of the viewing angle of the eyes and adjust the display angle of the picture accordingly; especially when the user squints at the picture, after adjusting the picture according to the viewing angle, it is convenient for the user to clearly browse the part of the picture that is of interest to the user, reducing the strain on the eyes damage.

Description

Display adjustment method and electronics

technical field

The invention belongs to the field of electronic equipment, and in particular relates to a display adjustment method and electronic equipment.

Background technique

Electronic equipment refers to equipment composed of electronic components such as integrated circuits, transistors, and electronic tubes; for some electronic equipment, it can also be programmed to achieve various functions. At present, electronic equipment has been widely developed and applied in various industries, including: electronic computers, robots controlled by programmed controllers, numerical control and program-controlled systems, etc.; Including smart home appliances.

In addition, the electronic device is equipped with a display screen, and the electronic device can display a picture carrying data through the display screen, so that the user can obtain interesting information by browsing the picture. However, because the light emitted by the display screen has a certain amount of radiation when displaying pictures; and the pictures in the display screen are usually displayed on a plane at a constant fixed angle, if the user browses the pictures in the display screen at a squint angle, it will be harmful to the eyes. It hurts a lot.

Contents of the invention

The object of the present invention is to provide a display adjustment method and an electronic device, in order to solve the problem of eye injury caused by users browsing the screen displayed on the display screen at a squint angle.

In a first aspect, the present invention provides a display adjustment method, the display adjustment method comprising:

Obtain the user's face image when the user browses the screen on the display screen;

Perform feature analysis on the face image to identify the viewing angle of the user's eyes;

Based on the viewing angle, the display angle of the picture is adjusted according to an ad-hoc algorithm, so that part of the picture is displayed toward the user's eyes.

With reference to the first aspect, in the first possible implementation of the first aspect, the step of adjusting the display angle of the display screen according to an ad-hoc algorithm based on the viewing angle specifically includes:

detecting the distance between the user's eyes and the display screen;

determining the curvature of the curve according to a first algorithm based on the distance and the viewing angle;

The display angle of the picture is adjusted by the curve.

With reference to the first aspect or the first possible implementation of the first aspect, in the second possible implementation of the first aspect, after the step of adjusting the display angle of the picture with the curve, the The display adjustment method also includes:

Detecting the light intensity of the environment where the display screen is located;

Based on the distance, the light intensity and the viewing angle, the display brightness of the picture is determined according to the second algorithm, and the part of the picture facing the eyes is displayed with a differential brightness.

With reference to the first aspect or the first implementation manner of the first aspect or the second possible implementation manner of the first aspect, in a third possible implementation manner of the first aspect, the adjustment of the After the step of display angle of the picture, the display adjustment method also includes:

The part of the picture facing the eye is adjusted according to the third algorithm, so as to display the part of the picture facing the eye differently.

In combination with the first aspect or the first implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect, the fourth possible implementation of the first aspect In the method, after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method specifically includes:

identifying eyelid movement information from the face image;

If the state of eye fatigue is recognized according to the motion information, the display screen is controlled to display in a preset mode when the time for continuously recognizing the state of eye fatigue reaches the first time;

Wherein, the preset mode includes one or a combination of the following: displaying the picture in a preset manner, displaying a preset picture reminding the user to rest their eyes.

Combining the first aspect or the first implementation mode of the first aspect or combining the second possible implementation mode of the first aspect or the third possible implementation mode of the first aspect or the fourth possible implementation mode of the first aspect way, in the fifth possible implementation of the first aspect, after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method specifically includes:

When the angle difference between the viewing angle and the front view angle is greater than a preset difference and the user continues to browse the picture at the viewing angle for a second time, control the display screen to display in a preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the picture in a preset manner, displaying a preset picture reminding the user to rest their eyes.

In combination with the first aspect or the first implementation mode of the first aspect or the second possible implementation mode of the first aspect or the third possible implementation mode of the first aspect or the fourth possible implementation mode of the first aspect Or in the fifth possible implementation of the first aspect, in the sixth possible implementation of the first aspect, after the step of adjusting the display angle of the screen according to the ad hoc algorithm, the display adjustment method Specifically include:

Identify the movement information of the eyelids from the face image, and identify whether the user is in a state of eye fatigue according to the movement information;

When the angle difference between the viewing angle and the front viewing angle is greater than a preset difference, and the time when the eye fatigue state is continuously recognized and the time when the user continues to browse the picture at the viewing angle reaches a third time at the same time , then control the display screen to display according to the preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the picture in a preset manner, displaying a preset picture reminding the user to rest their eyes.

In a second aspect, the present invention provides an electronic device, which includes a control module, a display screen and an image acquisition module;

The image acquisition module is used to: acquire the user's face image when the user browses the screen in the display screen;

The control module includes an angle recognition unit and a display unit;

The angle identification unit is used to: perform feature analysis on the face image acquired by the image acquisition module and identify the viewing angle of the user's eyes;

The display unit is configured to: adjust the display angle of the picture on the display screen according to an ad hoc algorithm based on the viewing angle identified by the angle identification unit, so that part of the picture is displayed toward the user's eyes.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the electronic device further includes a distance detection module;

The distance detection module is used to: detect the distance between the user's eyes and the display screen;

The display unit specifically includes a curvature determination unit and an adjustment unit;

The curvature determination unit is configured to: determine the curvature of the curve according to a first algorithm based on the distance detected by the distance detection module and the viewing angle identified by the angle identification unit;

The adjusting unit is configured to: adjust the display angle of the picture according to the curve determined by the curvature determining unit.

With reference to the second aspect or the first possible implementation manner of the second aspect, in the second possible implementation manner of the second aspect, the electronic device further includes an ambient light detection module;

The ambient light detection module is used to: detect the light intensity of the environment where the display screen is located;

The adjustment unit is configured to: determine the distance according to the second algorithm based on the distance detected by the distance detection module, the light intensity detected by the ambient light detection module, and the viewing angle recognized by the angle recognition unit. The display brightness of the picture is to display the part of the picture facing the eyes with a different brightness.

With reference to the second aspect or the first implementation manner of the second aspect or the second possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the display unit is specifically configured to:

The part of the screen facing the user is adjusted according to the third algorithm to distinguish the part of the screen facing the user.

In combination with the second aspect or the first implementation manner of the second aspect or the second possible implementation manner of the second aspect or the third possible implementation manner of the second aspect, the fourth possible implementation manner of the second aspect In the mode, the control module also includes an eye fatigue identification unit;

The eye fatigue identification unit is configured to: identify eyelid movement information from the face image acquired by the image acquisition module, and identify whether the user is in a state of eye fatigue according to the movement information;

The display unit is further configured to: control the display screen to display in a preset mode when the eye fatigue recognition unit continues to recognize the eye fatigue state for a first time;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

Combining the second aspect or the first implementation mode of the second aspect or combining the second possible implementation mode of the second aspect or the third possible implementation mode of the second aspect or the fourth possible implementation mode of the second aspect In a fifth possible implementation manner of the second aspect, the display unit is further configured to: when the angle difference between the viewing angle and the front viewing angle is greater than a preset difference, and the user continues to view the When viewing the screen at an angle reaches a second time, control the display screen to display in a preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

In combination with the second aspect or the first implementation manner of the second aspect or the second possible implementation manner of the second aspect or the third possible implementation manner of the second aspect or the fourth possible implementation manner of the second aspect Or in the fifth possible implementation of the second aspect, in the sixth possible implementation of the second aspect, the control module further includes an eye fatigue identification unit;

The eye fatigue identification unit is configured to: identify eyelid movement information from the face image acquired by the image acquisition module, and identify whether the user is in a state of eye fatigue according to the movement information;

The display unit is also used for: when the angle difference between the viewing angle and the front viewing angle is greater than a preset difference, and the time when the state of eye fatigue is continuously recognized and the user continues to browse the When the time of the screen reaches the third time at the same time, control the display screen to display according to the preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

In combination with the second aspect or the first implementation manner of the second aspect or the second possible implementation manner of the second aspect or the third possible implementation manner of the second aspect or the fourth possible implementation manner of the second aspect Or the fifth possible implementation manner of the second aspect or the sixth possible implementation manner of the second aspect, in the seventh possible implementation manner of the second aspect, the electronic device is a smart phone or a tablet computer.

Beneficial effects of the present invention: When the user browses the picture in the display screen, the viewing angle of the eyes is tracked in real time, and the display angle of the picture is adjusted according to the viewing angle, so that part of the picture is displayed toward the user's eyes, especially when the user squints For this picture, after the picture is adjusted according to the viewing angle, it is convenient for the user to clearly browse the interested part of the picture, and the damage to the eyes is reduced.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the descriptions of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only of the present invention. For some embodiments, those of ordinary skill in the art can also obtain other drawings based on these drawings without paying creative efforts.

FIG. 1 is a flowchart of a display adjustment method provided by an embodiment of the present invention;

Fig. 2 is an optimized workflow diagram of the display adjustment method provided by the embodiment of the present invention;

Fig. 3 is another optimization workflow diagram of the display adjustment method provided by the embodiment of the present invention;

Fig. 4 is another optimization workflow diagram of the display adjustment method provided by the embodiment of the present invention;

Fig. 5 is another optimization workflow diagram of the display adjustment method provided by the embodiment of the present invention;

Fig. 6 is another optimization workflow diagram of the display adjustment method provided by the embodiment of the present invention;

Fig. 7 is another optimization workflow diagram of the display adjustment method provided by the embodiment of the present invention;

FIG. 8 is a composition structure of an electronic device provided by an embodiment of the present invention;

FIG. 9 is an optimized composition structure of an electronic device provided by an embodiment of the present invention;

FIG. 10 is another optimized composition structure of the electronic device provided by the embodiment of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In order to illustrate the technical solutions of the present invention, specific examples are used below to illustrate.

The electronic devices described in the embodiments of the present invention all have display screens. An electronic device displays a data-laden screen on a display screen; the user can read information of interest from the screen. In addition, the embodiment of the present invention does not limit the internal structure of the display screen, nor does it limit the technical means of how the display screen realizes display; in addition, it does not limit whether the display screen has other functions, for example, the display screen is a touch screen, The touch screen not only has the function of displaying the screen, but if the screen is equipped with control keys, the user can also trigger an operation command through the control keys in the screen, and control the electronic device to specify the corresponding application program through the operation command, so that the user can control the screen through the touch screen. Electronic equipment.

It should be noted that the screen in the embodiment of the present invention includes at least one or more of the following: symbols such as letters and numbers, pictures, and control keys. The symbolic characters described in the embodiments of the present invention may be symbolic characters of different countries; they may also be symbolic characters specifically used in different regions, for example: symbolic characters agreed between different users, and for example: ethnic dialects used in different regions.

In order to facilitate the description of the display adjustment method provided by the embodiment of the present invention, FIG. 1 shows the workflow of the display adjustment method provided by the embodiment of the present invention, but FIG. 1 only shows the parts related to the embodiment of the present invention.

As shown in FIG. 1 , the display adjustment method provided by the embodiment of the present invention generally includes two basic steps: step A1 , step A2 and step A3 .

In step A1, the user's face image is acquired when the user browses the screen on the display screen.

It should be noted that there is no limitation on how the image acquisition module described in the embodiment of the present invention acquires the user's face image; Recognition and eye recognition, and then determine the position of the pupil in the eye; another example, based on infrared imaging technology, collect the user's face image through the infrared camera (belonging to the image acquisition module), and analyze the pupil in the eye from the face image s position.

Step A2, performing feature analysis on the face image to identify the viewing angle of the user's eyes.

In the embodiment of the present invention, it is based on the face image collected when the user browses the screen in the display screen, and the position of the user's pupil in the eye is recognized according to the face image, and the position of the pupil in the eye is recognized according to the position of the pupil in the eye. The position determines the viewing angle.

As an embodiment of determining the viewing angle according to the position of the pupil in the eye, the viewing angle is determined using a human eye tracking algorithm with the position of the pupil in the eye as an input value. For example, when the user browses the picture in the display screen, the user takes a photo of the user's face through the camera (belonging to the image acquisition module), obtains the user's face image, and adopts the SIFT feature (Scale-invariant feature transform, scale-invariant feature conversion) algorithm to process the face image, identify the position of the pupil in the eye and determine the viewing angle; preferably, in the process of using the SIFT feature to identify the position of the pupil in the eye and determine the viewing angle, it can be combined Kalman filter and Meanshift algorithm to improve the accuracy of identifying the position of the pupil in the eye, and determine the accuracy of the viewing angle; preferably, specifically in the process of determining the viewing angle, the center of the pupil can be determined using the adaboost algorithm position to determine the gaze direction of the user, and further determine the viewing angle according to the gaze direction.

As an embodiment of determining the viewing angle according to the position of the pupil in the eye, a Cartesian plane coordinate system is established, with the position of the pupil when the eyes look directly at the origin of the coordinates, and -180 can be determined according to the position of the pupil in the eye degrees to 180 degrees; when the pupil is in the direction of the upper right corner of the eye, the angle range of the determined front view angle is 0 degrees to 90 degrees; when the pupil is in the direction of the upper left corner of the eye, the determined The angle range of the front view angle is 91 degrees to 180 degrees; when the pupil is in the direction of the lower left corner of the eye, the angle range of the determined front view angle is -180 degrees to -91 degrees; when the pupil is in the direction of the lower right corner of the eye, The determined front view angle ranges from -90 degrees to -1 degrees. For example, when the user browses the pictures on the display screen, the position of the pupil in the eye is the first position in the upper right corner, and according to the one-to-one mapping relationship between the position of the pupil in the upper right corner and the viewing angle, it can be determined that the position of the pupil is the first position in the upper right corner. The position corresponds to a viewing angle of 30 degrees.

In the embodiment of the present invention, it can be determined according to the viewing angle: whether the user looks straight at the picture in the display screen, whether the user squints at the picture in the display screen; if the user squints at the picture in the display screen, it can be determined according to the viewing angle: the user The squint angle when squinting at the picture in the monitor. For example, when the viewing angle is zero degrees, it means that the user browses the images on the display screen in a direct-viewing manner, that is, the user is looking directly at the images on the display screen. When the viewing angle is 30 degrees, it means that the user browses the pictures on the display screen at a 30-degree angle of oblique viewing, that is, the user is viewing the pictures on the display screen obliquely.

Step A3, based on the viewing angle, adjust the display angle of the picture according to an ad-hoc algorithm, so that part of the picture is displayed toward the user's eyes.

As a possible implementation of step A3, in order to prevent the user from browsing the screen in the display screen in a squint manner for a long time, after determining the viewing angle of the user in step A2, determine whether the viewing angle is a frontal viewing angle, if not, Then adjust the display angle of the picture according to the ad-hoc algorithm, so that the user cannot continue to browse the part of the picture of interest, preferably, gradually reduce the display of the part of the picture of interest in the direction of the user's eyes on the display screen Brightness until the black screen is displayed to protect the user's eyes.

As a possible implementation of step A3, after the viewing angle of the user is determined in step A2, it is judged whether the viewing angle is a front view angle, if not, in order to meet the user's continuous browsing needs and protect the user's eyes, Adjust the display angle of the picture according to an ad-hoc algorithm, so that all or part of the picture in the display screen is displayed toward the user's eyes; Part of the screen with information of interest to the user is displayed toward the user's eyes.

For example, after adjusting the display angle of the screen according to the ad-hoc algorithm, if the information that the user is interested in is not displayed towards the user's eyes, the user can move the part of the screen that carries the information that the user is interested in through the buttons on the electronic device, Adjust the part of the screen carrying the information that the user is interested in to be displayed towards the user's eyes;

As another example, after adjusting the display angle of the picture according to the ad-hoc algorithm, if the display screen on the electronic device is a touch screen, if the information that the user is interested in is not displayed toward the user's eyes, the user can touch the screen on the touch screen. Operate to move the part of the screen carrying the information of interest to the user, and adjust the part of the screen carrying the information of interest to the user to be displayed toward the eyes of the user.

It is worth noting that the special algorithm described in the embodiment of the present invention is used to adjust the display angles of all the pictures, or to adjust the display angles of some of the pictures. As long as an algorithm that can meet the needs of users and realize the adjustment of the display angle of the picture belongs to the special algorithm described in the embodiment of the present invention, it is not limited here.

Fig. 2 shows an optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation mode of the embodiment of the present invention, referring to FIG. 2, for step A3, and for the step of adjusting the display angle of the display screen based on the viewing angle and according to an ad hoc algorithm, it specifically includes step A31, step A32 and step A33.

Step A31, detecting the distance between the user's eyes and the display screen.

In this implementation manner, there is no limitation on how to detect the distance between the user's eyes and the display screen. For example, by setting a sign near the eyes, the electronic device detects the sign through wireless technology, and calculates the distance between the eye and the display screen according to the delay time for detecting the sign and the transmission speed of the signal adopted by the wireless technology . For another example, the electronic device is equipped with a distance detection module, and the distance detection module detects the distance between the user's face and the display screen. Therefore, the distance detected by the distance detection module can be approximated as the distance between the user's eyes and the display screen.

Step A32, based on the distance and the viewing angle, determine the curvature of the curve according to a first algorithm.

Wherein, the first algorithm is used to adjust the display angle of all the pictures so that part of the pictures face the user's eyes, or to adjust the display angle of part of the pictures so that part of the pictures face the user's eyes . As long as the algorithm can meet the needs of the user and can determine the display angle of the screen to adjust part of the screen to face the user's eyes, it belongs to the first algorithm described in this embodiment, and is not limited here.

In this embodiment, the first algorithm is designed with at least the distance and the viewing angle as parameters. Specifically, the first algorithm is set in advance according to previous experimental data (distance collected in the past, viewing angle determined in the past); or the first algorithm is artificially set in advance. This first algorithm is used to adjust the curvature of the curve. It should be noted that the range of the curvature adjusted by the first algorithm includes 0 to positive infinity. When the curvature determined according to the first algorithm is 0, the picture is displayed in a plane. When the curvature determined according to the first algorithm is not 0, the picture is displayed with a curved surface.

It is worth noting that, based on the distance and the viewing angle and according to the first algorithm, the curvature of one or more curves can be determined at the same time; if the curvature of multiple curves is determined, the multiple curves will be used when performing step A33 The curve is used as the datum to determine a surface.

Step A33, adjusting the display angle of the picture according to the curve.

In this embodiment, after the curvature of each point on the curve is determined in step A32, the pixel points on the screen can be set correspondingly according to the curve (possibly one or more), and the set screen can be displayed. For example, when the curvature of a curve is determined according to the first algorithm, the picture displayed on the original plane is adjusted to be displayed on the curved plane by using the curve. As another example, when the curvature of at least two curves is determined according to the first algorithm, a preset algorithm is used to combine each curve to generate a curved surface, and the pixels on the screen are rendered to the curved surface one by one, and displayed on the display screen as The curved surface displays the picture.

After step A33 adjusts the display angle of the picture with the curve, a part of the picture is adjusted to be displayed toward the user's eyes. When the part of the picture displayed towards the user is not the part of the picture that the user is interested in, the user can operate the electronic device to adjust the part of the picture that is of interest to be displayed towards the user's eyes. The operation method of operating the electronic device is described here. It is not limited (such as the above), and will not be repeated here.

Fig. 3 shows another optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation manner of the embodiment of the present invention, referring to FIG. 3 , after the step of adjusting the display angle of the picture with the curve, it specifically includes step A34 and step A35 .

Step A34, detecting the light intensity of the environment where the display screen is located.

In this embodiment, there is no limitation on how to detect the light intensity of the environment where the display screen is located.

For example, a light sensor (preferably an ambient light sensor) is provided on the electronic device, preferably, the light sensor is arranged near or on the display screen; the light intensity around the display screen is detected by the light sensor.

Step A35, based on the distance, the light intensity and the viewing angle, determine the display brightness of the picture according to the second algorithm, and display the part of the picture facing the eyes with different brightness.

In this embodiment, because the light intensity of the environment where the display screen is located is different, it will affect whether the user can clearly see the picture displayed on the display screen to varying degrees. Therefore, when the present invention establishes the second algorithm based on experimental data or artificially, not only the distance between the user's eyes and the display screen and the viewing angle of the user's eyes are considered as parameters, but also the light intensity of the environment where the display screen is located is considered as a parameter. ; Of course, on the basis of considering the distance, the light intensity and the viewing angle, other parameters can also be added to optimize the second algorithm. On the basis of using the distance, the light intensity, and the viewing angle as parameters, this embodiment does not limit the second algorithm designed.

In this embodiment, because the display screen is in different ambient light, it will affect whether the user can clearly browse the screen in the display screen, and the distance between the eyes and the display screen is detected in real time, and the light intensity of the environment where the display screen is located is detected in real time, so as to determine the user's The viewing angle of the eyes; based on the detected distance, light intensity and viewing angle, determine the display brightness according to the second algorithm, adjust the part of the picture displayed towards the eyes with the determined display brightness, and adjust the part of the picture that is not displayed towards the eyes Do other brightness processing or not do brightness processing on the part of the picture. Therefore, the part of the picture displayed towards the eyes is displayed with different brightness from other parts of the picture, and the part of the picture towards the eyes is displayed with the display brightness determined by the second algorithm so that the user can clearly browse screen described in this section. Therefore, for the part of the picture displayed towards the eyes, it is displayed with the display brightness determined according to the second algorithm, so that the user can browse clearly; for other parts of the picture that are not displayed towards the eyes, it can be displayed with other brightness, which is convenient. The user distinguishes other partial screens displayed toward the eyes from the entire screen.

Fig. 4 shows an optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation manner of the embodiment of the present invention, referring to FIG. 4 , for step A3, after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method further includes step A4.

Step A4, adjusting the part of the picture facing the eyes according to the third algorithm, so as to display the part of the picture facing the eyes differently.

In this embodiment, because the viewing angle of the user's eyes is usually not a frontal viewing angle, it is necessary to adjust the display angle of the picture, and adjust part of the picture to be displayed in the direction of the user's eyes; because browsing the picture at an incorrect angle It is easy to hurt the eyes, and it is not easy to browse, and the eyes are easy to get tired when browsing; in view of this, this embodiment will not only adjust part of the screen to be displayed toward the user's eyes, but also adjust the part of the screen displayed toward the eyes. The pictures are displayed differently, specifically, the part of the picture facing the eyes is displayed differently from other part of the picture.

It is worth noting that the third algorithm is used to perform image processing on the part of the picture facing the eye, so that the part of the picture facing the eye is displayed differently from other part of the picture. After the part of the picture facing the eyes is adjusted according to the third algorithm, the differential display method of the part of the picture facing the eyes may be: zooming in on the part of the picture, highlighting the part of the picture from the picture, or The pixels in this part of the picture are rearranged and displayed according to an image processing algorithm. Therefore, the specific adjustment method (image processing) of the part of the screen facing the eyes by using the third algorithm in this embodiment is not limited here.

Fig. 5 shows an optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation manner of the embodiment of the present invention, referring to FIG. 5 , after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method specifically includes step B1 and step B2.

Step B1, identifying eyelid movement information from the face image.

Specifically, within a preset time period, continue to execute step A1 to acquire the user's face image, use the eye recognition algorithm (refer to the above, and will not repeat it here) to identify the eyelids, and identify the eyelids within the preset time period. Motion information; Among them, the motion information to be recognized is: the position of the eyelid moving up and down during the process of eye closing and eye opening.

Usually, when a user experiences eye fatigue due to excessive use of the eyes, the eyelids will continue to slowly droop. Correspondingly, the eye fatigue state described in this embodiment is specifically set as an action state in which the eyelids continue to droop slowly except for the user blinking.

Step B2, if the state of eye fatigue is identified according to the motion information, control the display screen to display in a preset mode when the time for continuously recognizing the state of eye fatigue reaches the first time; wherein, the preset The setting mode includes one or a combination of the following: displaying the picture in a preset manner, and displaying a preset picture reminding the user to rest his eyes.

In this embodiment, for the face image acquired within the preset time period, after establishing a unified coordinate system for the face image, the coordinate data of the eyelids within the preset time period will be determined in the coordinate system (i.e. motion information); according to the chronological order, the motion information within the preset time period is identified with the state of eye fatigue, if the time to continuously recognize the state of eye fatigue within the preset time period reaches the first time, this implementation The method determines that the user has overused the eyes and needs to rest the eyes; and then controls the display screen to display in a preset mode.

Specifically, the preset mode is: what kind of picture is displayed on the display screen, and in what way the picture is displayed. This embodiment does not limit the preset mode.

As an implementation of the preset mode, when the time of continuously recognizing the state of eye fatigue reaches the first time, continue to display the picture that the user is interested in according to the preset method; wherein, the preset method is the same as the currently displayed The display modes of the pictures are different, but this embodiment does not limit the algorithm used to determine the preset mode; for example, gradually disappearing the pictures in the display screen in a gradual manner; another example, gradually disappearing in a flashing mode picture.

As an embodiment of the preset mode, when the time for continuously recognizing the state of eye fatigue reaches the first time, a preset picture is displayed, which is a picture reminding the user to rest the eyes; It is assumed that there is no limitation on what kind of picture the picture is; for example, the preset picture is a picture with a pure protective color; for another example, the text content contained in the preset picture is content reminding the user to rest their eyes.

As an embodiment of the preset mode, when the time for continuously recognizing the state of eye fatigue reaches the first time, the screen is displayed in a preset manner in a part of the display screen, and the screen is displayed in another part of the display screen. Display a preset image that reminds the user to rest their eyes.

FIG. 6 shows an optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation manner of the embodiment of the present invention, referring to FIG. 6 , after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method further includes step C1.

Step C1, when the angle difference between the viewing angle and the front viewing angle is greater than a preset difference, and the user continues to browse the picture at the viewing angle for a second time, control the display screen to follow the preset mode display; wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner, and displaying a preset picture reminding the user to rest their eyes.

Specifically, in this embodiment, when it is determined that the angle difference between the viewing angle and the front viewing angle is greater than a preset difference value, it is determined that the user is squinting (according to the preset difference value preset by the user) or seriously. Strabismus (according to the preset difference preset by the user); in the case of squinting or severe squinting, if the user continues to browse the screen at the viewing angle, and the continuous browsing time reaches At the second time, this embodiment judges that the display screen is squinted and the eyes have been used excessively, and the user needs to be reminded to take a rest immediately, and then this embodiment controls the display screen to display in a preset mode. It is displayed in the preset mode, and will not be repeated here, referring to the description of the previous embodiment.

Preferably, before step C1, it is judged whether the viewing angle is a normal viewing angle. Specifically, after step A2 is performed to determine the viewing angle, it is judged whether the viewing angle is a front viewing angle. It is possible to control the display screen to display according to a preset mode.

FIG. 7 shows an optimized workflow of the display adjustment method provided by the embodiment of the present invention, but only shows the part related to the embodiment of the present invention.

As an implementation manner of the embodiment of the present invention, referring to FIG. 7 , after the step of adjusting the display angle of the picture according to the ad hoc algorithm, the display adjustment method specifically includes step D1 and step D1.

Step D1, identifying eyelid movement information from the face image, and identifying whether the user is in a state of eye fatigue according to the movement information.

For the step of recognizing eyelid movement information from the face image in step D1, refer to the above-mentioned step B1, which will not be repeated here.

For the face image obtained within the preset time period, after establishing a unified coordinate system for the face image, determine the coordinate data (ie motion information) of the eyelids in the preset time period in the coordinate system; according to The movement information within the preset period of time is identified in chronological order using the state of eye fatigue. The identification method is: based on the position of the eyelids recorded in the movement information, it is judged in chronological order whether the user's eyelids continue to droop slowly. If it continues to droop slowly, It is judged to be in a state of eye fatigue.

Step D2, when the angle difference between the viewing angle and the front viewing angle is greater than the preset difference value, and the time when the state of eye fatigue is continuously recognized and the time when the user continues to browse the picture at the viewing angle is reached at the same time At the third time, the display screen is controlled to display in a preset mode; wherein the preset mode includes one or a combination of the following: displaying the screen in a preset manner, displaying a preset picture reminding the user to rest their eyes .

In this embodiment, the display screen is controlled to be displayed in a preset mode only when the user squints at the display screen and experiences eye fatigue for a third time. Specifically, if the angle difference between the viewing angle identified within the preset time period and the front viewing angle is greater than the preset difference, and at the same time, the time during which the eye fatigue state is continuously recognized within the preset time period is within the preset time period If the user continues to browse the screen at the viewing angle and reaches the third time at the same time, this embodiment determines that the user squints the display screen and uses his eyes excessively, and needs to rest his eyes; then the display screen is controlled to display in a preset mode, and then In this embodiment, the display screen is controlled to be displayed in a preset mode. For the preset mode and how to display it in the preset mode on the display screen, details will not be repeated here, and reference is made to the description in the previous embodiment.

It should be understood that in the embodiment of the present invention, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, rather than the implementation process of the embodiment of the present invention. constitute any limitation.

It should be noted that the display adjustment method provided in the embodiment of the present invention is applicable to the electronic device provided in the embodiment of the present invention.

FIG. 8 shows the composition structure of the electronic device provided by the embodiment of the present invention, and for the convenience of description, only the parts related to the embodiment of the present invention are shown.

The electronic device provided in this embodiment, as shown in FIG. 8, the electronic device includes a control module 1, a display screen 2 and an image acquisition module 3;

The image acquisition module 3 is used to: acquire the face image of the user when the user browses the screen in the display screen 2;

The control module 1 includes an angle recognition unit 11 and a display unit 12;

The angle identification unit 11 is used for: performing feature analysis on the face image acquired by the image acquisition module 3 and identifying the viewing angle of the user's eyes;

The display unit 12 is configured to: adjust the display angle of the picture on the display screen 2 according to an ad-hoc algorithm based on the viewing angle recognized by the angle recognition unit 11, so that part of the picture is displayed toward the user's eyes .

As an implementation manner of an embodiment of the present invention, the display unit 12 is specifically configured to: adjust the part of the screen facing the user according to the third algorithm, so as to distinguishably display the part of the screen facing the user.

FIG. 9 shows an optimized composition structure of an electronic device provided by an embodiment of the present invention. For ease of description, only parts related to the embodiment of the present invention are shown.

As an implementation manner of an embodiment of the present invention, referring to FIG. 9 , the electronic device further includes a distance detection module 4;

The distance detection module 4 is used to: detect the distance between the user's eyes and the display screen 2;

The display unit 12 specifically includes a curvature determination unit 121 and an adjustment unit 122;

The curvature determination unit 121 is configured to: determine the curvature of the curve according to a first algorithm based on the distance detected by the distance detection module 4 and the viewing angle identified by the angle identification unit 11;

The adjusting unit 122 is configured to: adjust the display angle of the picture according to the curve determined by the curvature determining unit 121 .

As an implementation manner of an embodiment of the present invention, referring to FIG. 9 , the electronic device further includes an ambient light detection module 5;

The ambient light detection module 5 is used to: detect the light intensity of the environment where the display screen 2 is located;

The adjustment unit 122 is configured to: based on the distance detected by the distance detection module 4, the light intensity detected by the ambient light detection module 5 and the viewing angle recognized by the angle recognition unit 11, according to the second An algorithm determines the display brightness of the picture, and displays the part of the picture facing the eyes with a differential brightness.

FIG. 10 shows another optimized composition structure of the electronic device provided by the embodiment of the present invention. For the convenience of description, only the parts related to the embodiment of the present invention are shown.

As an implementation of an embodiment of the present invention, referring to FIG. 10 , the control module 1 further includes an eye fatigue identification unit 13;

The eye fatigue recognition unit 13 is used to: recognize the movement information of the eyelids from the face image obtained by the image acquisition module 3, and identify whether the user is in a state of eye fatigue according to the movement information;

The display unit 12 is further configured to: control the display screen 2 to display in a preset mode when the eye fatigue identification unit 13 continues to recognize the eye fatigue state for a first time;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

As an embodiment of the present invention, the display unit 12 is further configured to: when the angle difference between the viewing angle and the front viewing angle is greater than a preset difference, and the user continues to browse the screen at the viewing angle When the time reaches the second time, control the display screen 2 to display according to the preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

As an embodiment of the present invention, the control module 1 further includes an eye fatigue identification unit 13;

The eye fatigue recognition unit 13 is used to: recognize the movement information of the eyelids from the face image obtained by the image acquisition module 3, and identify whether the user is in a state of eye fatigue according to the movement information;

The display unit 12 is also used for: when the angle difference between the viewing angle and the front view angle is greater than a preset difference value, and the time when the state of eye fatigue is continuously recognized and the user continues to browse all content at the viewing angle When the time of the screen reaches the third time at the same time, control the display screen 2 to display according to the preset mode;

Wherein, the preset mode includes one or a combination of the following: displaying the screen in a preset manner or displaying a preset picture, and displaying a preset picture reminding the user to rest their eyes.

As an embodiment of the present invention, the electronic device is a smart phone or a tablet computer.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described electronic equipment, each module, and each unit can refer to the corresponding process in the foregoing method embodiment, and will not be repeated here. .

In the several embodiments provided in this application, it should be understood that the disclosed electronic device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units included in the control module is only a logical function division. In actual implementation, there may be other division methods, such as multiple units Or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes. .

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims (13)

1. a kind of display adjusting method, it is characterised in that the display adjusting method includes：

During picture in user's browse displays screen, the facial image of user is obtained；

Signature analysis is carried out to the facial image, identifies the viewing angle of eyes of user；Identified according to the facial image The pupil of user location in eyes, according to pupil, location determines the viewing angle in eyes；

Based on the viewing angle, according to the angles of display of the ad hoc algorithm adjustment picture so that the part picture direction The eyes of user are shown；If user's information interested is not shown towards the eyes of user, user manipulate electronic equipment with The part picture that adjustment is loaded with user's information interested is shown towards the eyes of user；

It is described to be based on the viewing angle, according to the step for the angles of display of the ad hoc algorithm adjustment picture, specifically include：

Detect the eyes of user and the distance of the display screen；

Based on the distance and the viewing angle, bent curvature of a curve is determined according to the first algorithm；

The angles of display of the picture is adjusted with the curve；Pixel on the picture is subjected to corresponding set according to the curve Put, the picture set is completed in display.

2. display adjusting method as claimed in claim 1, it is characterised in that described that the aobvious of the picture is adjusted with the curve After the step for showing angle, the display adjusting method also includes：

Detect the light intensity of the display screen local environment；

Based on the distance, the light intensity and the viewing angle, determine that the display of the picture is bright according to the second algorithm Degree, the part picture towards the eyes is shown to distinguish brightness.

3. the display adjusting method as described in any one of claim 1 to 2, it is characterised in that described to be adjusted according to ad hoc algorithm After the step for angles of display of the picture, the display adjusting method also includes：

The part picture according to third algorithm adjustment towards the eyes, to distinctly display the part institute towards the eyes State picture.

4. display adjusting method as claimed in claim 1, it is characterised in that described that the picture is adjusted according to ad hoc algorithm After the step for angles of display, the display adjusting method specifically includes：

The movable information of eyelid is identified from the facial image；

If identified according to the movable information with kopiopia state, persistently recognize it is described with kopiopia state when Between control the display screen to be shown according to preset mode when reaching the very first time；

Wherein, the preset mode includes following one kind or its combination：The picture, display alarm are shown according to predetermined manner The default picture of user's rest eyes.

5. display adjusting method as claimed in claim 1, it is characterised in that described that the picture is adjusted according to ad hoc algorithm After the step for angles of display, the display adjusting method also includes：

It is more than preset difference value in the differential seat angle of the viewing angle and positive angle and user continues to browse with the viewing angle When the time of the picture reached for the second time, the display screen is controlled to be shown according to preset mode；

Wherein, the preset mode includes following one kind or its combination：The picture, display alarm are shown according to predetermined manner The default picture of user's rest eyes.

6. display adjusting method as claimed in claim 1, it is characterised in that described that the picture is adjusted according to ad hoc algorithm After the step for angles of display, the display adjusting method specifically includes：

The movable information of eyelid is identified from the facial image, identifies whether user is in tired with eye according to the movable information Labor state；

It is more than preset difference value in the viewing angle and the differential seat angle of positive angle and persistently recognizes the kopiopia state Time and user continue when browsing the time of the picture with the viewing angle while reaching for three time, then control described in Display screen is shown according to preset mode；

Wherein, the preset mode includes following one kind or its combination：The picture, display alarm are shown according to predetermined manner The default picture of user's rest eyes.

7. a kind of electronic equipment, it is characterised in that the electronic equipment includes control module, display screen and image collection module；

Described image acquisition module is used for：The facial image of user is obtained during picture in user's browse displays screen；

The control module includes angle recognition unit and display unit；

The angle recognition unit is used for：The facial image got to described image acquisition module carries out signature analysis and identified Go out the viewing angle of eyes of user；The pupil of user is identified the location of in eyes according to the facial image, according to pupil Hole location in eyes determines the viewing angle；

The display unit is used for：The viewing angle identified based on the angle recognition unit, institute is adjusted according to ad hoc algorithm State angles of display of the picture in the display screen so that the part picture is shown towards the eyes of user；If user feels The information of interest does not show that user manipulates electronic equipment and is loaded with user's information interested to adjust towards the eyes of user Part picture is shown towards the eyes of user；

The electronic equipment also includes apart from detection module；

It is described to be used for apart from detection module：Detect the eyes of user and the distance of the display screen；

The display unit specifically includes curvature determining unit and adjustment unit；

The curvature determining unit is used for：Known based on the distance detected apart from detection module and the angle recognition unit The viewing angle not gone out, bent curvature of a curve is determined according to the first algorithm；

The adjustment unit is used for：The curve determined with the curvature determining unit adjusts the angles of display of the picture；By institute State pixel on picture to be correspondingly arranged according to the curve, the picture set is completed in display.

8. electronic equipment as claimed in claim 7, it is characterised in that the electronic equipment also includes ambient light detection module；

The ambient light detection module is used for：Detect the light intensity of the display screen local environment；

The adjustment unit is used for：Detected based on the distance detected apart from detection module, the ambient light detection module To the viewing angle that identifies of light intensity and the angle recognition unit, the display of the picture is determined according to the second algorithm Brightness, the part picture towards the eyes is shown to distinguish brightness.

9. the electronic equipment as described in any one of claim 7 to 8, it is characterised in that the display unit is specifically used for：

The part picture according to third algorithm adjustment towards user, to distinctly display the part picture towards user.

10. electronic equipment as claimed in claim 7, it is characterised in that the control module also includes identifying list with kopiopia Member；

It is described to be used for kopiopia recognition unit：The facial image got from described image acquisition module identifies the fortune of eyelid Dynamic information, identify whether user is according to the movable information and use kopiopia state；

The display unit is additionally operable to：In the time that the kopiopia state is persistently recognized with kopiopia recognition unit When reaching the very first time, the display screen is controlled to be shown according to preset mode；

Wherein, the preset mode includes following one kind or its combination：The picture or display are shown according to predetermined manner Default picture, the default picture of display alarm user's rest eyes.

11. electronic equipment as claimed in claim 7, it is characterised in that

The display unit is additionally operable to：It is more than preset difference value in the differential seat angle of the viewing angle and positive angle and user holds It is continuous when browsing time of the picture with the viewing angle and reaching for the second time, control the display screen to show according to preset mode Show；

Wherein, the preset mode includes following one kind or its combination：The picture or display are shown according to predetermined manner Default picture, the default picture of display alarm user's rest eyes.

12. electronic equipment as claimed in claim 7, it is characterised in that the control module also includes identifying list with kopiopia Member；

It is described to be used for kopiopia recognition unit：The facial image got from described image acquisition module identifies the fortune of eyelid Dynamic information, identify whether user is according to the movable information and use kopiopia state；

The display unit is additionally operable to：It is more than preset difference value and lasting knowledge in the viewing angle and the differential seat angle of positive angle It is clipped to the time with kopiopia state and user continues to browse the time of the picture with the viewing angle while reach During three time, the display screen is controlled to be shown according to preset mode；

Wherein, the preset mode includes following one kind or its combination：The picture or display are shown according to predetermined manner Default picture, the default picture of display alarm user's rest eyes.

13. electronic equipment as claimed in claim 7, it is characterised in that the electronic equipment is smart mobile phone or tablet personal computer.