TWI796822B - Method and system for processing image display - Google Patents

Abstract

The disclosure provides a method and system for processing image display. The method includes: obtaining an image by an image capture device, and detecting a portrait feature of image to generate a detected portrait; determining whether the detected portrait and a corrected portrait overlap; in response to the detected portrait overlapping the corrected portrait, outputting a preset image size; in response to the detected portrait not overlapping the corrected portrait; generating a image size according to a current distance of the detected portrait and a preset distance, and setting the image size as the preset image size. Accordingly, the preset portrait size can be adjusted adaptively according to different distance between user and the image capture device to improve an accuracy of a following inspection process.

Description

Image display processing method and image display processing system

The present invention relates to an image adjustment technology, and in particular relates to an image display processing method and an image display processing system which can automatically adjust the image size according to the use environment.

Regular vision testing can detect the signs of eye diseases early, so as to improve the effect of treatment and prevent the deterioration of vision. Although people can go to clinics or hospitals for vision examinations nowadays, they have to go to hospitals regularly and frequently for vision examinations, which reduces the willingness of users. Therefore, providing a method and device that allows users to perform vision testing in a home environment will increase people's willingness to check their vision regularly, thereby allowing users to detect signs of vision lesions early and improve the possibility of treatment . Among them, the pre-work of the vision test (such as: the decoration of the environment, the control of the distance, the brightness of the environment) will affect the process and results of the vision test. Therefore, how to conveniently and automatically ensure and detect whether the user is within a standard measurement distance and whether the detection environment is suitable has become an urgent development direction for personnel and operators in related fields.

In view of this, an embodiment of the present invention provides an image display processing system and an image display processing method, which can automatically adjust the size of the visual mark according to the usage environment, thereby improving the accuracy of the subsequent detection process and determining the distance between the user and the screen. Accuracy of distance.

The image display processing method of the embodiment of the present invention includes (but is not limited to) the following steps: capture an image through an image capture device, and detect a human figure in the image to generate a detected human figure; determine whether the detected human figure overlaps with the corrected human figure ; In response to the overlap between the detected portrait and the corrected portrait, a preset image size is output; in response to the non-overlap between the detected portrait and the corrected portrait, the image size is generated according to the current distance of the detected portrait and the preset distance, and the preset image is output Image Size is set to the image size.

The image display processing system of the embodiment of the present invention includes (but not limited to) an image capture device, a display, and an electronic device. The electronic device is coupled to the image capturing device and the display. The electronic device includes a storage medium and a processor, and the storage medium stores computer programs. The processor loads and executes a computer program configured to capture an image through an image capture device, and detect a human figure in the image to generate a detected human figure; determine whether the detected human figure overlaps with the corrected human figure; respond to the detected human figure Overlapping with the corrected portrait, the processor outputs a preset image size; in response to the non-overlap between the detected portrait and the corrected portrait, an image size is generated according to the current distance and the preset distance of the detected portrait, and the preset image size is set to image size.

Based on the above, according to the image display processing system and image display processing method of the embodiment of the present invention, before performing the detection process (for example, vision detection), through the technical characteristics of the image display processing system and method, the size of the image can be ensured. (For example, the visual mark, image or text size of vision detection) is related to the distance between the user and the display to improve the accuracy of the detection process, and through the processor to detect whether the detected portrait and the corrected portrait overlap, thereby improving the use Convenience and reliability of the testing process.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail together with the accompanying drawings.

FIG. 1 is a block diagram of components of an image display processing system 1 according to an embodiment of the present invention. Please refer to FIG. 1 , the image display processing system 1 includes (but not limited to) an image capture device 11 , a display 12 and an electronic device 10 . The electronic device 10 is coupled to the image capturing device 11 and the display 12 , and the electronic device includes a processor 110 and a storage medium 120 . The electronic device 10 may be a desktop computer, a notebook computer, a smart phone, a tablet computer, a medical testing instrument or other computing devices. Moreover, the image display processing system 1 may be a desktop computer, a notebook computer, a smart phone, a tablet computer, a server, a medical testing instrument or other computing devices with built-in camera lenses and screens.

The image capturing device 11 is composed of elements such as a lens, an aperture, a shutter, and an image sensor, for example. Wherein, the lens includes a plurality of optical lenses, which are driven by actuators such as stepping motors or voice coil motors to change the relative positions of the lenses, thereby changing the focal length of the lenses. In one embodiment, the image capture device 11 is, for example, a lens with a known focal length.

The display 12 may be a liquid crystal display (Liquid-Crystal Display, LCD), a light-emitting diode (Light-Emitting Diode, LED) display, an organic light-emitting diode (Organic Light-Emitting Diode, OLED) or other types of displays.

The processor 110 is coupled to the storage medium 120, the image capture device 11, and the display 12. The processor 110 may be a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphic Processing unit, GPU), or other programmable General-purpose or special-purpose microprocessor (Microprocessor), digital signal processor (Digital Signal Processor, DSP), programmable controller, field programmable logic gate array (Field Programmable Gate Array, FPGA), special An Application-Specific Integrated Circuit (ASIC), a neural network accelerator or other similar components or a combination of the above-mentioned components are applied.

The storage medium 120 can be any type of fixed or removable random access memory (Radom Access Memory, RAM), read only memory (Read Only Memory, ROM), flash memory (flash memory), traditional hard disk (Hard Disk Drive, HDD), Solid-State Drive (Solid-State Drive, SSD) or similar components. In one embodiment, the storage medium 120 is used to record codes, computer programs, software modules, configurations, data (such as images, values, reference values, distances, etc.) or files, and will be described in detail later. Example. In one embodiment, the processor 110 is used to execute all or part of the operations of the image display processing system 1, and can load and execute various program codes, computer programs, software modules, files and files recorded in the storage medium 120. material.

In one embodiment, the image display processing system 1 further includes an input device 13 . The input device 13 is coupled to the processor 110 , and the input device 13 may be a keyboard, a touch panel, a mouse button, a pointing stick, a track ball, and the like.

In the following, the method described in the embodiment of the present invention will be described in conjunction with various devices, components and modules in the image display processing system 1 . Each process of the method can be adjusted accordingly according to the implementation situation, and is not limited thereto.

FIG. 2 is a first flowchart of an image display processing method according to an embodiment of the present invention. FIG. 3 is a second flowchart of an image display processing method according to an embodiment of the invention. The method of this embodiment can be executed by the image display processing system 1 in FIG. 1 . The details of the steps in FIG. 2 and FIG. 3 will be described below with the components shown in FIG. 1 .

First, in step S310 , the processor 110 receives user information from the input device 13 . For example, the user inputs the user's height through the input device 13 . On the other hand, the processor 110 can display basic information fields through the display 12 for the user to input basic information. For example: gender, age, health status (eg, pregnancy, diabetes, high blood pressure), eye disease history (eg, eye surgery, etc.), previous prescriptions. Accordingly, the report of the subsequent detection process (for example, vision detection) is more reliable, and the working time of the person in charge of the detection process is saved.

Next, in step S320 , the processor 110 displays reminders and confirmation item fields through the display 12 , so that the user can clearly know the conditions of the appropriate measurement environment. For example, the confirmation item field may be ambient light, distance, angle of the image capture device 11 (for example, a video camera, a built-in lens of a laptop computer) and the user, indoor lighting, display 12 (for example, screen) is vertical to the desktop, the lens is turned on, the brightness of the screen is adjusted to an appropriate brightness, or the image capture device 11 and the display 12 are at the same distance (for example, both are 6 meters away from the user) and at the same angle (for example, perpendicular to the ground ) placed. Accordingly, the accuracy of the measurement environment is improved and the operation is made easier to enhance user satisfaction.

FIG. 4 is a schematic diagram of the corrected pixel size according to an embodiment of the present invention. As shown in FIG. 3 and FIG. 4, in step S330, the processor 110 displays the corrected image MB through the display 12, according to the size of the corrected image MB and the actual product Adjust the preset image size. Since the pixel size of each display is different, the size of the images or characters displayed on the display 12 is also different. Therefore, in order to determine the pixel size of the display 12 , the processor 110 displays a frame line of an actual item (eg, a credit card or ruler) through the display 12 . Next, the processor 110 reminds the user to place an object of the same length on the display 12 through the display 12, and adjusts the size of the frame line of the corrected image MB to be the same as the size of the actual object. Accordingly, the processor 110 can determine the pixel size of the display 12 . For example, the original pixel is x (for example, the credit card MB displayed on the screen), and the pixel after the user compares the size of the actual item is x'. Then, the original image size or the pixel of the image is adjusted to the ratio of y to y times x' divided by x pixels.

Next, in step S210 , the processor 110 captures an image through the image capture device 11 , and detects a human figure in the image to generate a detected human figure. FIG. 5 is a schematic diagram of an electronic device, a display and an input device according to an embodiment of the invention. Specifically, as shown in FIG. 5 , the image capture device 11 captures an image. Next, the processor 110 detects the portrait 30 in the image, and displays the detected portrait 30A corresponding to the portrait on the display 12 .

In another embodiment, step S210 further includes step S340. In step S340 , in response to the image capture device 11 not detecting any human figure in the image, the processor 110 displays an environmental reminder message through the display 12 . For example, the environmental reminder message can be "check whether the indoor lighting is turned on" or "check whether there is an obstacle in front of the camera".

Next, in step S220 , the processor 110 determines whether the detected portrait 30A overlaps with the corrected portrait P. FIG. 6 is a schematic diagram of a method for resizing an image and correcting a portrait P according to an embodiment of the present invention. As shown in FIG. 6 , the image size PH of the corrected portrait P on the display 12 is related to the height H of the portrait 30 , the preset distance PD and the focal length F of the lens of the image capture device. Specifically, the user inputs the height H of the portrait 30 (for example, the height of the user) through the input device 13 . Next, the processor 110 detects the focal length F of the lens of the image capture device 11 . In one embodiment, the image capture device 11 is a lens with a known lens focal length. When the image capture device 11 is coupled to the electronic device 10, the image capture device 11 stores the value of the focal length F of the lens into the electronic device. 10 among the storage medium 120. In other words, the processor 110 determines whether the detected portrait overlaps with the corrected portrait, and the processor is confirming whether the user maintains a set distance (preset distance) (step S350 ).

…(1) F為鏡頭焦距，RH為實品大小(例如，高15公分的尺，寬8.5公分的信用卡)，RP為實品於顯示器12上顯示的實品影像的大小，RD為實品與影像擷取裝置11之間的距離。 In another embodiment, when the processor 110 reads the lens focal length F of the image capture device from the storage medium 120 , the processor 110 displays a lens focal length confirmation message through the display 12 . Moreover, the processor 110 captures the real product image through the image capture device 11 , and calculates the lens focal length F of the image capture device 11 according to the size of the real product image, the real product size and the real product distance. For example, the processor 110 displays on the display 12 the columns of the size of the real product and the distance of the real product, so that the user can take out the corresponding real product and place the real product at the corresponding distance. For example, the user places a ruler or a credit card (i.e., the actual product) at 15 cm in front of the image capture device 11 (i.e., the distance from the actual product), and then the image capture device 11 captures an image of the actual product, and passes The display 12 displays an actual product image corresponding to the actual product. Accordingly, the processor 110 calculates the lens focal length F of the image capture device 11 according to the size of the real product image, the real product size and the real product distance, which can be expressed as the following equation:

...(1) F is the focal length of the lens, RH is the size of the real product (for example, a ruler with a height of 15 cm, and a credit card with a width of 8.5 cm), RP is the size of the real product image displayed on the monitor 12, and RD is the real product The distance from the image capture device 11.

…(2) 也就是說，校正人像P的影像大小PH為鏡頭焦距F乘以預設距離PD除以高度值H。關於影像大小PH可以是呈現於顯示器12上的像素(Pixel)值或長度。舉例來說，人像30(例如，使用者)距離該影像擷取裝置11的預設距離PD為600公分，鏡頭焦距F為3公分，且人像30的高度值為150公分。接著，根據上述方程式(2)可得出影像大小PH為12公分。 Moreover, after the processor 110 reads the focal length F of the lens of the image capture device 11 from the storage medium 120 or calculates the focal length F of the lens, the processor 110 calculates the height value H of the portrait 30 , the focal length F of the lens of the image capture device 11 and The preset distance PD determines the image size PH of the corrected portrait P. The relationship between the corrected image size PH of the portrait P, the height H of the portrait 30, the lens focal length F of the image capture device 11, and the preset distance PD can be expressed as the following equation:

...(2) In other words, the image size PH of the corrected portrait P is the lens focal length F multiplied by the preset distance PD divided by the height value H. The image size PH may be a pixel value or a length displayed on the display 12 . For example, the preset distance PD between the portrait 30 (for example, the user) and the image capture device 11 is 600 cm, the focal length F of the lens is 3 cm, and the height of the portrait 30 is 150 cm. Then, according to the above equation (2), it can be obtained that the image size PH is 12 cm.

Furthermore, the processor 110 displays the corresponding corrected portrait P through the display 12 according to the image size PH of the corrected portrait P. The number of dots (Dots Per Inch, DPI) is converted into the corresponding pixel value (Pixel). FIG. 7A is a schematic diagram of judging whether the detected portrait and the corrected portrait overlap according to an embodiment of the present invention. As shown in FIG. 2 and FIG. 7A , in step S230 , the processor 110 outputs a preset image size in response to the overlap between the corrected portrait P displayed on the display 12 and the detected portrait 30A. The preset image size is related to the preset distance PD. For example, when the preset distance is 6 meters, the default image size corresponding to vision 1.0 can be set as 8.73 mm. When the preset distance is 1 meter, the preset image size corresponding to vision 1.0 can be set to 1.45 mm. It is added that the image size corresponding to vision 1.0 is set to a first value between 1mm and 20mm (for example, 8.73mm, 1.45mm), while the image size corresponding to other vision values (for example, 0.9, The image size of 0.8, 0.3, 0.1) should be adjusted corresponding to the above-mentioned first value of vision 1.0 (for example, 17.46 mm, 2.9 mm, 80.73 mm, 14.5 mm), but this case should not be limited to this. In one embodiment, after the processor 110 outputs a preset image size, the processor 110 uses the preset image size to perform a preset detection process (for example, vision detection) (step S380), and generates a corresponding detection report ( S390). The testing process can be vision testing, or it can be a testing process that needs to unify and confirm the image display size (for example, image size) of the monitor or confirm the distance between the user and the monitor, and this case should not be limited to this. That is, the image size in this case can also be other image sizes or font sizes.

On the other hand, in step S220, in response to when the detected portrait 30A does not overlap with the corrected portrait P (step S360), the processor 110 generates an image size according to the current distance D and the preset distance PD of the detected portrait 30A. And, the processor 110 sets the preset image size as the image size (step S240). FIG. 7B is a schematic diagram of judging whether the detected portrait and the corrected portrait overlap according to an embodiment of the present invention. Specifically, the user inputs the height H of the portrait 30 (for example, the height of the user) through the input device 13 . Then, in response to the detected portrait 30A being larger than the corrected portrait P, the processor 110 receives the environment distance value through the input device 13 . Specifically, in the environment actually used by the user, the maximum distance between the user and the image capture device 11 and the display 12 is the environmental distance value, and the environmental distance value is smaller than the preset distance value PD. That is to say, the measurement environment of the user is smaller than the preset distance (for example, 5 meters or 6 meters) of the vision measurement.

For example, when the processor 110 detects that the detected portrait 30A is larger than the corrected portrait P, the processor 110 first displays a message (for example, please stand at the farthest distance) through the display 12 . After the user stands at the farthest distance in the measurement environment, the processor 110 still detects that the distance between the user (that is, the portrait 30) and the image capture device 11 is still less than the preset distance (that is, the detected portrait 30A is greater than To calibrate the portrait P), the processor 110 displays the environment distance value input field through the display 12 (step S370). Then, the user inputs the environment distance value to the processor 110 through the input device 13 . Accordingly, the processor 110 determines the image size PH of the corrected image P according to the height H of the portrait 30 , the focal length of the lens F and the environment distance (step S375 ). Moreover, the processor 110 adjusts the image size according to the image size PH of the corrected image P, and sets the default image size as the value of the image size. For example, when the preset distance is 6 meters, the image size corresponding to vision 1.0 is 9 millimeters, the image size PH before adjustment is 12 centimeters, and the environmental distance value is 3 meters, then the processor 110 according to the preset Adjust the image size PH to 6 cm corresponding to the ratio of the distance to the environment distance value. Moreover, the processor 110 also correspondingly sets the value of the image size as 4.5mm, and sets the preset image size as the value of the image size (for example, 4.5mm). In this way, in response to the overlapping of the detected portrait and the corrected portrait (ie, the adjusted corrected portrait), the processor 110 outputs a preset image size (ie, an image size value corresponding to the environment distance value). Accordingly, the image display processing system 1 can correspondingly adjust and correct the value of the portrait and image size according to the user's actual measurement environment distance, and further has the advantage of automatically displaying the corresponding image size according to different measurement environments.

In one embodiment, in step S220 , the processor 110 displays a reminder message through the display 12 in response to the detected portrait 30A being smaller than the corrected portrait P. Next, in response to the overlapping of the detected portrait 30A and the corrected portrait P, the processor 110 outputs a corresponding preset image size according to the preset distance. For example, when the distance between the user and the display 12 is greater than the preset distance, the processor 110 displays a reminder message through the display 12, the content of which is, for example, "please walk forward facing the screen". (Step S365) Next, when the processor 110 detects that the user's distance is equal to the preset distance (that is, the detected portrait 30A overlaps with the corrected portrait P), the processor 110 outputs a preset image size corresponding to the preset distance .

To sum up, in the image display processing system 1 and the image display processing method of the embodiment of the present invention, the human portrait is detected through the image capture device 11 to ensure and remind the user to communicate with the image capture device 11 and the display 12 The distance between them conforms to the size of the image, thereby improving the reliability and convenience of the subsequent vision test results.

Although the present invention has been disclosed above with the embodiments, it is not intended to limit the present invention. Anyone with ordinary knowledge in the technical field may make some changes and modifications without departing from the spirit and scope of the present invention. The scope of protection of the present invention should be defined by the scope of the appended patent application.

1: Image display processing system 10: Electronic device 110: Processor 120: storage media 11: Image capture device 12: Display 13: Input device MB: corrected image 30: portrait 30A: Detection of portraits P: Calibrating portraits H, PH: height value PD: preset distance D: current distance F: lens focal length S210~S240, S310~S390: steps

FIG. 1 is a block diagram of components of an image display processing system according to an embodiment of the present invention. FIG. 2 is a first flowchart of an image display processing method according to an embodiment of the present invention. FIG. 3 is a second flowchart of an image display processing method according to an embodiment of the invention. FIG. 4 is a schematic diagram of correcting pixel size according to an embodiment of the invention. FIG. 5 is a schematic diagram of an electronic device, a display and an input device according to an embodiment of the invention. FIG. 6 is a schematic diagram of a method for resizing an image and correcting a portrait according to an embodiment of the invention. 7A and 7B are schematic diagrams of judging whether the detected portrait and the corrected portrait overlap according to an embodiment of the present invention.

S210~S240: steps

Claims (11)

An image display processing system, comprising: an image capture device; a display; an electronic device coupled to the image capture device and the display, including a storage medium and a processor, wherein the storage medium stores a computer program , and the processor is configured to load and execute the computer program to: capture an image through the image capture device, and detect a human figure in the image to generate a detected human figure; determine the detected human figure and Whether a calibrated portrait overlaps; in response to the overlapping of the detected portrait and the calibrated portrait, a preset image size is output; in response to the non-overlapping of the detected portrait and the calibrated portrait, according to a current distance of the detected portrait and a A preset distance generates an image size, and the preset image size is set as the image size, wherein the current distance is the distance between the portrait and the image capture device, and the image size is related to the The focal length of a lens of the image capture device. The image display processing system according to claim 1, wherein before the step of determining whether the detected portrait overlaps with a corrected portrait, the processor is further configured to: receive a height value of the portrait through an input device. The image display processing system as described in claim 1, wherein before the step of capturing the image through the image capture device, the processor is further configured to: display a corrected image through the display, and based on the corrected image and a Real product Resizes the preset image size. The image display processing system as described in claim 2, wherein the step of judging whether the detected portrait and the corrected portrait overlap includes: detecting the focal length of the lens of the image capture device; according to the height value, the focal length of the lens and A preset distance determines an image size of the corrected portrait; according to the image size of the corrected portrait, the corresponding corrected portrait is displayed on the display; in response to the overlapping of the corrected portrait displayed on the display and the detected portrait, Output this preset image size. The image display processing system as described in claim 1, wherein the image capture device captures the image, and detects the human figure in the image to generate the detected human figure, the processor is further configured to To: capture a real product image through the image capture device; calculate the focal length of the lens of the image capture device according to the size of the real product image, the real product size and a real product distance. The image display processing system according to claim 2, wherein the step of judging whether the detected portrait overlaps with the corrected portrait comprises: displaying a reminder message through the display in response to the detected portrait being smaller than the corrected portrait; The detected portrait is overlapped with the corrected portrait, and the corresponding preset image size is output according to the preset distance. The image display processing system as described in claim 2, wherein the step of judging whether the detected portrait overlaps with the corrected portrait includes: receiving an environmental distance value through the input device in response to the detected portrait being larger than the corrected portrait; Adjust an image size of the corrected image according to the height value, the focal length of the lens and the environmental distance value; display the corresponding corrected portrait on the display according to the image size of the corrected portrait; determine the image size according to the image size , and setting the default image size as the value of the image size; outputting the default image size in response to the overlap between the detected portrait and the corrected portrait. The image display processing system as described in claim 1, wherein the step of detecting the portrait in the image by the image capture device to generate the detected portrait comprises: responding to the image capture device detecting in the image If any of the portraits cannot be detected, an environmental reminder message is displayed through the display. An image display processing method, suitable for an electronic device coupled with an image capture device and a display, the method includes the following steps: capture an image through the image capture device, and detect a portrait in the image to generate a detected portrait; judging whether the detected portrait overlaps with a corrected portrait; In response to the overlapping of the detected portrait and the corrected portrait, outputting a preset image size; in response to the non-overlapping of the detected portrait and the corrected portrait, generating an image according to a current distance and a preset distance of the detected portrait image size, and the default image size is set as the image size, wherein the current distance is the distance between the portrait and the image capture device, and the image size is related to an image capture device lens focal length. The image display processing method as described in claim 9, wherein the step of judging whether the detected portrait and the corrected portrait overlap includes: receiving a height value of the portrait through an input device; detecting the image capture device Lens focal length; adjust an image size of the corrected portrait according to the height value, the focal length of the lens and a preset distance; display the corresponding corrected portrait on the display according to the image size of the corrected portrait, and according to the corrected portrait The image size generates a corresponding image size; in response to the corrected portrait displayed on the display overlapping the detected portrait, setting the image size to the default image size, and outputting the default image size. The image display processing method as described in Claim 9, wherein the step of judging whether the detected portrait overlaps with the corrected portrait comprises: receiving a height value of the portrait through an input device; in response to the detected portrait being larger than the corrected portrait For a portrait, an environmental distance value is received through the input device; Adjust an image size of the corrected image according to the height value, the focal length of the lens and the environmental distance value; display the corresponding corrected portrait on the display according to the image size of the corrected portrait; determine the image size according to the image size , and setting the default image size as the value of the image size; outputting the default image size in response to the overlap between the detected portrait and the corrected portrait.

Images