CN114582484A - Image information input method, physiological image processing method and image processing equipment - Google Patents

Abstract

A method for inputting image information, comprising using a camera of a terminal device to photograph a measurement result screen of a measuring device to obtain an output image, using a communication transmission interface of the terminal device to transmit the output image to a cloud server, and using the cloud server to identify the output image to obtain information about the Identifying the identified matching result of the measurement value and the identified measuring unit, and storing the identified matching result in the cloud server.

Description

Image information input method, physiological image processing method and image processing device

technical field

The present invention relates to a processing device and a processing method for a measurement value and a measurement unit, and in particular to a processing device and a processing method for the measurement value and measurement unit of a physiological state.

Background technique

Current physiological measuring instruments, such as blood glucose machines, blood pressure monitors, etc., all use digital methods to display actual measured values and actual measuring units on the screen. If the user inputs the actual measurement value to the application program of the terminal device, the actual measurement value is manually input to the physiological state application program of the terminal device.

However, for elderly users, errors often occur when observing the actual measurement values displayed by the physiological measuring instrument and inputting the actual measurement values to the physiological state application program of the terminal device, so that the physiological state of the terminal device The application's analysis based on actual measured values lacks credibility. In order to solve the above problems, there are a variety of measuring instruments with Bluetooth communication modules on the market, which are linked with the physiological state application program of the terminal device through the Bluetooth communication module, so as to solve the problem of misreading the actual measurement value and inputting the wrong actual measurement value. Happening. However, since the Bluetooth communication specifications of the physiological measurement instruments on the market are not consistent, corresponding applications must be designed for measurement instruments with different Bluetooth communication specifications, resulting in inconvenience in use.

In view of this, there is indeed a need for an improved image information processing device and an improved display information input method in order to improve the above-mentioned shortcomings.

SUMMARY OF THE INVENTION

The present invention provides an image information input method, a physiological image processing method, and an image processing device, which not only require no manual input of actual measurement values to an application program of a user's terminal device, but are also suitable for measurement of various Bluetooth communication specifications. device and measuring device without communication function.

According to an embodiment of the present invention, a method for inputting image information is provided. ; identify the output image with the cloud server to obtain identified matching results regarding the identified measurement values and identified measurement units; and store the identified matching results with the cloud server.

According to an embodiment of the present invention, a physiological image processing method is provided, which includes: taking a measurement result screen of a physiological measuring device with a camera of a terminal device to generate an output image; transmitting the output image to the cloud through a communication transmission interface of the terminal device server; identify the output image with the cloud server to obtain the identified matching result about the identified physiological state value and the identified physiological state unit; transmit the identified matching result to the terminal device with the cloud server to generate the identified physiological state value and the identified matching result The confirmed matching result of the physiological state unit; the terminal device transmits the confirmed matching result to the cloud server; the cloud server stores the confirmed matching result.

According to an embodiment of the present invention, an image processing apparatus is provided, including a terminal device and a cloud server. The terminal device includes a camera and a communication transmission interface, and the communication transmission interface is electrically connected to the camera and the cloud server. The camera is used to capture the measurement result picture of the measuring device to generate the output image, and the cloud server is used to identify the output image to obtain the identified matching result about the identified measurement value and the identified measurement unit, store the identified matching result and transmit it The identified matching results are sent to the terminal device, and the terminal device is used to store the identified matching results.

To sum up, since the identified measurement value and the identified measurement unit stored in the terminal device can be used as the input basis for the application program of the terminal device in the future, in addition to avoiding the situation of erroneous observation of the actual measurement value and input of the wrong actual measurement value At the same time, it can be applied to measurement devices of different Bluetooth communication specifications and measurement devices without communication function, which is more convenient to use.

The above description of the content of the present invention and the description of the following embodiments are used to demonstrate and explain the spirit and principle of the present invention, and provide further explanation for the claims of the present invention.

Description of drawings

FIG. 1 is a block diagram of an embodiment of an image processing apparatus of the present invention.

FIG. 2 is a schematic diagram of a measurement result screen displayed on the display screen of FIG. 1 .

FIG. 3 is a flowchart of the first embodiment of the image information input method of the present invention.

FIG. 4 is a flowchart of a second embodiment of the image information input method of the present invention.

FIG. 5 is a flowchart of a third embodiment of the image information input method of the present invention.

FIG. 6 is a flowchart of a fourth embodiment of the image information input method of the present invention.

FIG. 7 is a flowchart of the first embodiment of the physiological image processing method of the present invention.

FIG. 8 is a flowchart of the second embodiment of the physiological image processing method of the present invention.

FIG. 9 is a flowchart of the third embodiment of the physiological image processing method of the present invention.

FIG. 10 is a flowchart of the fourth embodiment of the physiological image processing method of the present invention.

FIG. 11 is a flowchart of the fifth embodiment of the physiological image processing method of the present invention.

FIG. 12 is a comprehensive historical physiological state trend graph of an embodiment.

13A and 13B are flowcharts of the sixth embodiment of the physiological image processing method of the present invention.

FIG. 14 is a flowchart of the seventh embodiment of the physiological image processing method of the present invention.

Detailed ways

FIG. 1 is a block diagram of an embodiment of an image processing apparatus of the present invention. As shown in FIG. 1 , the image processing apparatus includes a terminal device 1 and a cloud server 2 . The terminal device 1 is, for example, a computer host or a mobile communication device, and the terminal device 1 is communicatively connected to the cloud server 2 . The terminal device 1 includes a processor 11, a memory 12, a display screen 13, a camera 14, and a first communication transmission interface 15. The processor 11 is electrically connected to the memory 12, the display screen 13, the camera 14, and the first communication transmission interface 15, and displays a The screen 13 is electrically connected to the camera 14 through the processor 11 , the first communication transmission interface 15 is electrically connected to the camera 14 through the processor 11 , and the memory 12 stores an application program (such as a web page program, a computer application program or a communication device application) program (APP)).

The cloud server 2 includes a first service device 21 , a second service device 22 and a second communication transmission interface 23 . The first service device 21 is electrically connected to the second communication transmission interface 23 , and the second service device 22 is electrically connected to the second communication transmission interface 23 . The transmission interface 23 , and the second communication transmission interface 23 is electrically connected to the first communication transmission interface 15 . In one embodiment, the first communication transmission interface 15 and the second communication transmission interface 23 are circuit interfaces for communicating with the network. Therefore, the first communication transmission interface 15 of the terminal device 1 and the first communication transmission interface of the cloud server 2 The two communication transmission interfaces 23 can transmit and receive signals and data with each other via the network.

FIG. 2 is a schematic diagram of the display screen 13 displaying a measurement result picture. The display screen 13 is used for displaying a frame 131 and a direction indicator 132 . The frame 131 is for the user to frame the measurement result screen of the measuring device within the frame 131 , and the direction indicator 132 is located outside the frame 131 . The direction indicator 132 is fixed in one direction. According to the direction indicator 132 , the user can be more easily guided to adjust the shooting angle of the camera 14 , so that the measurement result picture of the measuring device is displayed in the frame 131 at the correct angle. The processor 11 drives the camera 14 to capture the measurement result screen displayed by the measuring device in the frame 131 and generates an initial image. The processor 11 first performs image processing (gray-scale conversion, edge detection or a combination thereof) on the initial image to generate an output and transmit the output image to the second communication transmission interface 23 of the cloud server 2 through the first communication transmission interface 15 , and the cloud server 2 obtains the output image through the second communication transmission interface 23 . Alternatively, the initial image is directly used as the output image without undergoing image processing by the processor 11 . In other embodiments of the present invention, when the display screen 13 does not display at least one of the frame 131 and the direction indicator 132 , the user can also use the camera 14 to capture the measurement result screen displayed by the measurement device to obtain an initial image.

The cloud server 2 identifies the output image from the terminal device 1 to obtain the identified matching result regarding the identified measurement value and the identified measurement unit, and the cloud server 2 stores the identified matching result and transmits the identified matching result through the second communication transmission interface 23 . The matching result is identified to the processor 11 of the terminal device 1 . The processor 11 stores the identified matching result in the memory 12 as an input basis for the application program in the memory 12 .

The measurement result screen of the measurement device may have actual measurement values, or at least one of a characteristic pattern (such as a heart-shaped pattern, a thermometer pattern, or a footprint pattern), an actual measurement unit, and a brand pattern of the measurement device, and the actual measurement result. The measured value, wherein the characteristic pattern can be used to correspond to the actual measured value. For example, the heart-shaped pattern can correspond to the actual measured value of the heart rate, the thermometer pattern can correspond to the actual measured value of body temperature or air temperature, and the footprint pattern can correspond to the actual measured value of the number of steps. Actual measured values, etc. The type of measurement device is not limited. For example, the measurement device is a physiological measurement device, and the actual measurement value and actual measurement unit displayed by the physiological measurement device are the actual physiological state value and the actual physiological state unit, respectively. .

FIG. 3 is a flowchart of the first embodiment of the image information input method of the present invention. The image information input method of FIG. 3 may be performed by any type of image processing apparatus. Specifically, when the camera 14 of the image processing apparatus executing the image information input method of FIG. 3 acquires an initial image, the display screen 13 of the image processing apparatus does not display at least one of the frame 131 and the direction indicator 132 , or the image processing apparatus does not display at least one of the frame 131 and the direction indicator 132 . The display screen 13 of the display frame 131 and the direction indicator 132 are displayed. For the convenience of subsequent descriptions, the image information input method of the present invention is exemplified by the embodiment of the image processing apparatus in FIG. 1 .

As shown in FIG. 3 , first, the camera 14 of the terminal device 1 captures the measurement result picture of the measurement device to generate an output image, which includes steps S301 - S302 . In step S301, the camera 14 of the terminal device 1 captures the measurement result screen of the measurement device to obtain an initial image. The memory 12 stores an image processing program (such as a grayscale conversion program and an edge detection program). In step S302, the processor 11 of the terminal device 1 performs image processing (such as grayscale conversion, edge detection, or a combination thereof) on the initial image to generate an output. image, and the data size of the output image is smaller than the data size of the original image. Step S303 transmits the output image to the cloud server 2 through the first communication transmission interface 15 of the terminal device 1 . The cloud server 2 stores an image recognition algorithm (eg, a machine learning algorithm or an optical character recognition algorithm (Optical Character Recognition)). Step S304 uses the image recognition algorithm of the cloud server 2 to recognize the output image to obtain the recognized matching result regarding the recognized measurement value and the recognized measurement unit. Step S305 uses the cloud server 2 to store the identified matching result. In step S306 , the cloud server 2 transmits the identified matching result to the processor 11 of the terminal device 1 . In step S307 , the processor 11 of the terminal device 1 stores the identified matching result in the memory 12 of the terminal device 1 as an input basis for the application program in the memory 12 . Thereby, the user of the terminal device 1 can confirm whether the identified measurement value and the identified measurement unit are the same as the actual measurement value and the actual measurement unit.

Regarding other embodiments of the image information input method, the terminal device 1 may directly use the original image as the output image without performing any image processing on the original image, and transmit the original image to the cloud server 2, and then the cloud server 2 recognizes the original image to obtain An identified match result for an identified measurement value and an identified unit of measurement.

4 is a flowchart of a second embodiment of the image information input method of the present invention, wherein steps S401 to S407 of this embodiment are the same as steps S301 to S307 of the first embodiment, and the second embodiment is the same as the first embodiment The difference between the embodiments is that step S408 is further included. As shown in FIG. 4 , in step S408 , after the processor 11 stores the identified matching result in the memory 12 , the terminal device 1 returns the correction information about the identified matching result to the cloud server 2 . Specifically, when the identified measurement value or the identified measurement unit obtained by the terminal device 1 is different from the actual measurement value or actual measurement unit of the measurement result screen of the measurement device, the terminal device 1 feeds back information about the identified measurement value. The measured value or the correction information of the identified measurement unit is sent to the cloud server 2, and the image recognition algorithm stored in the cloud server 2 can be updated according to the correction information. The updated image recognition algorithm has better image recognition accuracy sex.

5 is a flowchart of a third embodiment of the image information input method of the present invention, wherein steps S501 to S504 of this embodiment are the same as steps S301 to S304 of the first embodiment, and the third embodiment is the same as the first embodiment The difference between the embodiments is that this embodiment includes steps S505 to S508. As shown in FIG. 5 , in step S505 , after the cloud server 2 obtains the identified matching result about the identified measurement value and the identified measurement unit, the cloud server 2 performs a unit conversion process on the identified matching result to generate a conversion matching results. Step S506 is to store the converted matching result in the cloud server 2 . In step S507 , the cloud server 2 transmits the converted matching result to the terminal device 1 . Step S508 is to store the converted matching result in the memory 12 by the processor 11 as an input basis for the application program in the memory 12 . Specifically, there are two units for the representation of blood glucose values, one is milligrams per deciliter (mg/dl) and the other is millimoles per liter (mmol/L). The conversion formula for the two units is: mg/ dl÷18=mmol/L or mmol/L×18=mg/dl. Since the measurement units used by users in different countries are different, the cloud server 2 performs unit conversion processing on the identified matching results, so that users in different countries can more conveniently use the converted matching results as an application in the memory 12 input basis. In addition, the cloud server 2 can also store the identified matching results and the converted matching results, and transmit the identified matching results and the transformed matching results to the terminal device 1 , in addition to providing the user of the terminal device 1 to confirm the identified measurement values and the converted matching results. In addition to identifying whether the measurement unit is the same as the actual measurement value and the actual measurement unit, it also allows users to know the measurement results with their accustomed measurement units, so as to improve the user's experience.

6 is a flowchart of a fourth embodiment of the image information input method of the present invention. Steps S601 to S603 of the fourth embodiment are the same as steps S301 to S303 of the first embodiment, and the fourth embodiment is the same as the first embodiment. The difference of the embodiment is that steps S604 to S607 are included. As shown in FIG. 6 , step S604 uses the image recognition algorithm of the cloud server 2 to recognize the output image to obtain the first recognized matching result of the first recognized measurement value and the first recognized measurement unit and the second recognized matching result. A second identified matching result of the measurement value and the second identified measurement unit is identified. Specifically, the output image from the terminal device 1 includes two different actual measurement values and their corresponding two actual measurement units. Step S605 uses the cloud server 2 to store the first identified matching result and the second identified matching result. In step S606 , the cloud server 2 transmits the first identified matching result and the second identified matching result to the terminal device 1 . In step S607 , the processor 11 of the terminal device 1 stores the first identified matching result and the second identified matching result in the memory 12 as an input basis for the application program in the memory 12 .

In addition, step S604 can also be replaced by using the image recognition algorithm of the cloud server 2 to recognize the output image to obtain the first recognized matching result of the first recognized measurement value and the recognized measurement unit and the second recognized value A second identified match of the measured value and the identified unit of measure. For example, the measurement device is a sphygmomanometer, and the output image from the terminal device 1 includes systolic blood pressure and diastolic blood pressure.

FIG. 7 is a flowchart of the first embodiment of the physiological image processing method of the present invention. The physiological image processing method of FIG. 7 can be performed by different kinds of image processing apparatuses, but is preferably performed with the image processing apparatus of FIG. 1 . Therefore, subsequent execution of the physiological image processing method of the present invention is exemplified by the image processing apparatus shown in FIG. 1 .

As shown in FIG. 7 , in step S701 , the camera 14 of the terminal device 1 captures the measurement result screen of the physiological measurement device to generate an output image. In step S702, the terminal device 1 transmits the output image to the first service device 21 of the cloud server 2, and the first service device 21 stores the image recognition algorithm. Step S703 uses the first service device 21 to identify the output image from the terminal device 1 to obtain the identified matching result regarding the identified physiological state value and the identified physiological state unit. In step S704, the first service device 21 stores and transmits the identified matching result to the terminal device 1, so as to generate a confirmed matching result regarding the confirmed physiological state value and the confirmed physiological state unit. To be more specific, the terminal device 1 receives the identified matching result from the first service device 21 of the cloud server 2 as input to the application program in the terminal device 1, and can be used by the user of the terminal device 1 to confirm whether the identified matching result matches the actual one. The physiological state values and the actual physiological state units are the same to generate a confirmed match, which can improve the accuracy of the confirmed match. In step S705, the terminal device 1 transmits the confirmed matching result to the second service device 22 of the cloud server 2, and then the second service device 22 stores the confirmed matching result, wherein storing the confirmed matching result in the second service device 22 includes step S706 and step S707, in step S706, the second service device 22 stores the confirmed physiological state value and the confirmed physiological state unit, and step S707 uses the second service device 22 to update the historical physiological state according to the confirmed physiological state value and the confirmed physiological state unit A record table or a historical physiological state trend graph, wherein the historical physiological state record table and the historical physiological state trend graph have been stored in the second service device 22 of the cloud server 2 in advance, and any one of the historical physiological state record table and the historical physiological state trend graph includes Multiple historical physiological state values. In addition, the terminal device 1 can transmit the confirmed matching result as correction information to the first service device 21 of the cloud server 2 to update the image recognition algorithm. The updated image recognition algorithm has better image recognition accuracy.

As shown in FIG. 7 , in step S708, the terminal device 1 or the user application interface is used to transmit the request signal to the second service device 22. For example, the user application interface can be the mobile communication device of the user's relatives and friends, doctors, personal butlers or caregivers. Or a computer host, or a computer host of a medical institution. In step S709, the second service device 22 returns the request result to the terminal device 1 or the user application interface according to the request signal, wherein the request result can be the confirmed matching result, the updated historical physiological state record table or the updated historical physiological state trend picture. In detail, the terminal device 1 and the user application interface are installed with an authorization program (such as a telemedicine care program or a remote physiological monitoring program) to transmit a request signal to the second service device 22, wherein the authorization program is an application program authorized by the cloud server 2 , and can be transmitted with the cloud server 2 , and the authorization procedure is set by the second service device 22 of the cloud server 2 . To put it simply, the terminal device 1 or the user application interface must pass the authorization procedure before sending the request signal to the second service device 22 of the cloud server 2 . In other embodiments, the second service device 22 of the cloud server 2 may further perform unit conversion processing on the confirmed matching result to obtain and store the confirmed matching result after conversion, and the terminal device 1 or the user application interface transmits the request signal to the cloud server. After 2, the request result that can be obtained from the cloud server 2 can further include the confirmed matching result after conversion, so that users in different countries can easily know the measurement result after obtaining the request result.

FIG. 8 is a flowchart of the second embodiment of the physiological image processing method of the present invention, wherein steps S801 to S807 of this embodiment are the same as steps S701 to S707 of the first embodiment, and the embodiment of FIG. 8 is the same as that of FIG. The difference of the embodiment of 7 lies in step S808 and step S809. In short, the second service device 22 can determine whether the physiological state information is outside the personal state interval, and transmit the warning information to the terminal device 1 or the user application interface, wherein the personal state interval relates to the physiological state of the user of the terminal device 1, The physiological state information may be, for example, a confirmed matching result, a converted confirmed matching result, an updated historical physiological state record table, or an updated historical physiological state trend graph. As shown in FIG. 8 , when the physiological state information is the confirmed matching result, step S808 uses the second service device 22 to determine whether the confirmed matching result is outside the personal state interval. When the second service device 22 of the cloud server 2 determines that the confirmed matching result is outside the personal status interval, step S809 is executed. In step S809, the second service device 22 of the cloud server 2 transmits a warning message to the terminal device 1 or the user application interface, The user who obtains the warning information through the user application interface may be different from the user who transmits the request signal through the user application interface in step S708 of FIG. 7 . It is worth mentioning that the user who obtains the warning information through the user application interface is set by the user of the terminal device 1 on the second service device 22 of the cloud server 2 . In addition, the user application interface of the user who can obtain the warning information has an application program associated with the user who can obtain the warning information, so that the user who can obtain the warning information can obtain the warning information through an authorization program, text message or voice call. When the second service device 22 of the cloud server 2 determines that the confirmed matching result is not outside the personal state interval, the execution of the physiological image information processing method is ended. In detail, the personal state interval is the interval in which the user's physiological state value is in a healthy state, so the personal state interval may vary with changes in the user's age, height, weight, daily routine, medication records or medical records of the terminal device 1 . . For example, the personal state interval is the normal blood pressure interval of the user, and the normal blood pressure interval varies with the age of the user. Alternatively, the personal state interval is the user's normal blood sugar interval, and the normal blood sugar interval may be different between the pre-meal period and the post-meal period.

9 is a flowchart of a third embodiment of the physiological image processing method of the present invention, and steps S901 to S907 of the third embodiment are the same as steps S701 to S707 of the first embodiment, and the third embodiment is the same as the first embodiment. The difference of an embodiment lies in step S908. In short, the terminal device 1 can instruct the second service device 22 to share the shared information to the user application interface, wherein the shared information can be physiological state information. In addition, the user application interface of the shareable user has an authorization procedure associated with the shareable user. As shown in FIG. 9 , when the shared information is the confirmed physiological state value and the confirmed physiological state unit, in step S908 , the terminal device 1 instructs the second service device 22 to send the confirmed physiological state value and the confirmed physiological state value of the user of the terminal device 1 to the second service device 22 in step S908 . The confirmed physiological state unit is shared to the user application interface, wherein the confirmed physiological state value shared by the user of the terminal device 1 and the user of the confirmed physiological state unit obtained through the user application interface may be different from step S708 in FIG. 7 through the user application interface. The user who transmits the request signal may be different from the user who obtains the alert information through the user interface. It is worth mentioning that the user who obtains the sharing information through the user application interface is set by the user of the terminal device 1 in the second service device 22 of the cloud server 2 .

FIG. 10 is a flowchart of the fourth embodiment of the physiological image processing method of the present invention, wherein steps S1001 to S1007 of this embodiment are the same as steps S701 to S707 of the first embodiment, and the embodiment of FIG. 10 is the same as that of FIG. The difference of the embodiment of 7 lies in step S1008. As shown in FIG. 10 , when the shared information is the updated historical physiological state record table or the updated historical physiological state trend chart, in step S1008, the terminal device 1 instructs the second service device 22 to send the updated information about the terminal device 1 to the second service device 22 in step S1008. The historical physiological state record table or the updated historical physiological state trend graph is shared to the user application interface, wherein the updated historical physiological state record table or the updated historical physiological state trend graph contains the current physiological state value of the user of the terminal device 1 and Multiple historical physiological state values. In addition, the user of the terminal device 1 can also share the historical physiological state record table or the historical physiological state trend chart within the specified time period, that is, the shared information can also be the physiological state information within the specified time period.

FIG. 11 is a flowchart of the fifth embodiment of the physiological image processing method of the present invention. As shown in FIG. 11 , in step S1101 , the camera 14 of the terminal device 1 captures the measurement result screen of the physiological measurement device to generate an output image. In step S1102 , the terminal device 1 transmits the output image to the first service device 21 of the cloud server 2 . Step S1103 uses the first service device 21 to identify the output image from the terminal device 1 to obtain the first identified matching result of the first identified physiological state value and the first identified physiological state unit and obtain the second identified physiological state A value and a second identified match result for a second identified physiological state unit, wherein the first identified physiological state value is different from the second identified physiological state value, and the first identified physiological state unit is different from the second identified physiological state Status unit. In detail, the output image from the terminal device 1 includes two or more actual physiological state values and actual physiological state units, so the output image can generate two or more identified physiological state values and identified physiological state values after being identified by the cloud server 2. Status unit. In step S1104, the first service device 21 stores and transmits the first identified matching result and the second identified matching result to the terminal device 1, so as to generate the first identified physiological state value and the first identified physiological state unit. A confirmed match result, and a second confirmed match result for the second confirmed physiological state value and the second confirmed physiological state unit, wherein the first service device 21 transmits the first identified match result and the second identified match result The transmission to the terminal device 1 may or may not be performed at the same time. In detail, the terminal device 1 receives the first identified matching result and the second identified matching result from the first service device 21 of the cloud server 2 , and serves as the input of the application program in the terminal device 1 for the terminal device 1 of users confirm whether the first identified match and the second identified match are correct to generate the first and second identified matches, which can improve the first and second identified matches accuracy. Step S1105, use the terminal device 1 to transmit the first confirmed matching result and the second confirmed matching result to the second service device 22 of the cloud server 2, and then use the second service device 22 to store the first confirmed matching result and the second confirmed matching result. Confirming the matching result, wherein storing the first confirmed matching result with the second service device 22 includes steps S1106 and S1107, and step S1106 storing the first confirmed physiological state value and the first confirmed physiological state unit with the second service device 22, In step S1107, the second service device 22 updates the first historical physiological state record table or the first historical physiological state trend chart according to the first confirmed physiological state value and the first confirmed physiological state unit, wherein the first historical physiological state record table And the first historical physiological state trend graph has been stored in the second service device 22 in advance, and any one of the first historical physiological state record table and the first historical physiological state trend graph contains multiple first historical physiological state values. In other embodiments, the first identified physiological state unit may be the same as the second identified physiological state unit.

As shown in FIG. 11 , using the second service device 22 to store the second confirmed matching result includes steps S1108 and S1109 . Step S1108 uses the second service device 22 to store the second confirmed physiological state value and the second confirmed physiological state unit , and step S1109 uses the second service device 22 to update the second historical physiological state record table or the second historical physiological state trend chart according to the second confirmed physiological state value and the second confirmed physiological state unit, wherein the second historical physiological state records The table and the second historical physiological state trend graph have been stored in the second service device 22 in advance, and any one of the second historical physiological state record table and the second historical physiological state trend graph contains multiple second historical physiological state values. Next, in step S1110, the second service device 22 combines the first historical physiological state record table and the second historical physiological state record table to create a comprehensive historical physiological state record table, or combines the first historical physiological state trend chart and the second historical physiological state Trend charts to create a comprehensive historical physiological state trend chart. Specifically, after the terminal device 1 or the user application interface transmits the request signal to the cloud server 2, the request results that can be obtained from the cloud server 2 include the first confirmed matching result, the second confirmed matching result, and the updated first history Physiological status record table, updated first historical physiological status trend chart, updated second historical physiological status record table, updated second historical physiological status trend chart, comprehensive historical physiological status record table, comprehensive historical physiological status trend Figure or any combination of the above. In other embodiments, the second service device 22 of the cloud server 2 may further perform unit conversion processing on the first confirmed matching result and the second confirmed matching result to obtain and store the converted first confirmed matching result and the converted After the second confirmed matching result, after the terminal device 1 or the user application interface transmits the request signal to the cloud server 2, the request result that can be obtained from the cloud server 2 may further include the first confirmed matching result after conversion, the second confirmed matching result after conversion, and the second confirmed matching result after conversion. Match results or a combination thereof.

FIG. 12 is a comprehensive historical physiological state trend graph of an embodiment. As shown in FIG. 12 , the unit of the horizontal axis is hours, the unit of the first vertical axis is Celsius, and the unit of the second vertical axis is times/minute. The first historical physiological state value represents the number of body temperature of the user of the terminal device 1 , and the second historical physiological state value represents the number of heartbeats per minute of the user of the terminal device 1 . For example, the physician can obtain the comprehensive historical physiological state trend diagram of the user of the terminal device 1 from the cloud server 2 through the computer host of the medical institution. in accordance with. The above historical physiological state values and historical physiological state units are only examples and are not limited thereto.

13A and 13B are flowcharts of the sixth embodiment of the physiological image processing method of the present invention. As shown in FIGS. 13A and 13B . Step S1301 uses the camera 14 of the terminal device 1 to capture the first measurement result picture of the first physiological measurement device to generate a first output image. In step S1302 , the terminal device 1 transmits the first output image to the first service device 21 of the cloud server 2 . Step S1303 uses the first service device 21 to identify the first output image to obtain a first identified matching result regarding the first identified physiological state value and the first identified physiological state unit. In step S1304, the first service device 21 stores and transmits the first identified matching result to the terminal device 1, which is used as an input basis for the application program in the memory 12 to generate the first confirmed physiological state value and the first confirmed physiological state The unit's first confirmed match, where the in-memory 12 application may be, for example, an authorized program. In detail, the terminal device 1 may input the first recognized matching result into the application to generate the first confirmed matching result. The user of the terminal device 1 can determine whether the first identified matching result with respect to the first identified physiological state value and the first identified physiological state unit matches the first actual value displayed on the first measurement result screen of the first physiological measurement device. The physiological state numerical value and the first actual physiological state unit are the same. When the first identified physiological state value and the first identified physiological state unit are the same as the first actual physiological state value and the first actual physiological state unit, the first identified physiological state value and the first identified physiological state unit are used as is the first validated physiological state value and the first validated physiological state unit to generate a first validated match result. When the first identified physiological state value and the first identified physiological state unit are different from the first actual physiological state value and the first actual physiological state unit, the user of the terminal device 1 can An actual physiological state unit is corrected to generate a first validated match result for the first validated physiological state value and the first validated physiological state unit. Step S1305, the terminal device 1 transmits the first confirmed matching result to the second service device 22 of the cloud server 2, and the second service device 22 stores the first confirmed matching result, wherein the second service device 22 stores the first confirmed matching result. Confirming the matching result includes steps S1306 and S1307. In step S1306, the second service device 22 stores the first confirmed physiological state value and the first confirmed physiological state unit, and in step S1307, the second service device 22 stores the first confirmed physiological state value and the first confirmed physiological state unit according to the second service device 22. Update the first historical physiological state record table or the first historical physiological state trend chart.

Step S1308 uses the camera 14 of the terminal device 1 to capture the second measurement result picture of the second physiological measurement device to generate a second output image. In step S1309 , the terminal device 1 transmits the second output image to the first service device 21 . Step S1310 uses the first service device 21 to identify the second output image to obtain a second identified matching result regarding the second identified physiological state value and the second identified physiological state unit. In step S1311, the first service device 21 transmits the second matching result to the terminal device 1, which is used as an input basis for the application program in the memory 12, so as to generate the first data about the second confirmed physiological state value and the second confirmed physiological state unit. After confirming the matching result, the application program in the memory 12 can be, for example, an authorized program. In detail, the terminal device 1 can input the second identified matching result into the application to generate the second confirmed matching result. The user of the terminal device 1 can determine whether the second identified physiological state value and the second identified physiological state unit are the same as the second actual physiological state value and the second actual physiological state value displayed on the second measurement result screen of the second physiological measurement device. Physiological state units are the same. When the second identified physiological state value and the second identified physiological state unit are the same as the second actual physiological state value and the second actual physiological state unit, the second identified physiological state value and the second identified physiological state unit are used as The second validated physiological state value and the second validated physiological state unit to generate a second validated match result. When the second recognized physiological state value and the second recognized physiological state unit are different from the second actual physiological state value and the second actual physiological state unit, the user of the terminal device 1 can The two actual physiological state units are corrected to produce a second validated match result for the second validated physiological state value and the second validated physiological state unit.

In step S1312, the terminal device 1 transmits the second confirmed matching result to the second service device 22 of the cloud server 2, and then the second confirmed matching result is stored in the second service device 22, wherein the second service device 22 stores the second confirmed matching result. The confirmed matching result includes steps S1313 and S1314. Step S1313 uses the second service device 22 to store the second confirmed physiological state value and the second confirmed physiological state unit, and step S1314 uses the second service device 22 to store the second confirmed physiological state value and the second confirmed physiological state unit Update the second historical physiological state record table or the second historical physiological state trend chart. Next, in step S1315, the second service device 22 combines the first historical physiological state record table and the second historical physiological state record table to create a comprehensive historical physiological state record table or combines the first historical physiological state trend graph and the second historical physiological state trend Graph to build a comprehensive historical physiological state trend graph. Next, in step S1316, the terminal device 1 or the user application interface transmits the request signal to the second service device 22, and in step S1317, the second service device 22 returns the request result to the terminal device 1 or the user application interface according to the request signal. To be more specific, in the embodiments of FIGS. 13A and 13B , the camera 14 of the terminal device 1 shoots images of two different physiological measurement devices at different time points, so as to obtain two measurement result pictures at different time points respectively. . It is worth mentioning that when the first identified matching result is different from the first actual physiological state value and the first actual physiological state unit, or the second identified matching result is different from the second actual physiological state value and the second actual physiological state When the units are different, the terminal device 1 can transmit the first confirmed matching result or the second confirmed matching result as correction information to the first service device 21 of the cloud server 2 to update the image recognition algorithm, and the updated image recognition The algorithm has better image recognition accuracy.

FIG. 14 is a flowchart of the seventh embodiment of the physiological image processing method of the present invention, wherein steps S1401 to S1407 of this embodiment are the same as steps S701 to S707 of the first embodiment, and the embodiment of FIG. 14 is the same as that of FIG. 14 . The difference of the embodiment of 7 lies in step S1408 and step S1409. As shown in FIG. 14 , in step S1408, after updating the historical physiological state record table or the historical physiological state trend chart with the second service device 22 of the cloud server 2, the terminal device 1 or the user application interface transmits the health education request to the second service device 22, and in step S1409, the second service device 22 transmits the health education information to the terminal device 1 or the user application interface according to the personal state and physiological state of the user of the terminal device 1. It is worth mentioning that the user who can obtain the health education information is set by the user of the terminal device 1 in the second cloud service device 22 of the cloud server 2 . In another embodiment of the present invention, the second service device 22 can directly provide the health education information to the terminal device 1 and can receive after receiving the confirmed matching result or updating the historical physiological state record table or the historical physiological state trend chart. Users of health education information. In addition, in another embodiment of the present invention, after the terminal device 1 or the user application interface obtains the sharing information, the warning information or the request result, the terminal device 1 or the user application interface can also use the terminal device 1 or the user application interface to obtain the sharing information, the warning information or the request result. The health education request is sent to the second service device 22, and the second service device 22 returns the health education information to the terminal device 1 or the user application interface according to the health education request.

In other embodiments, when the cloud server 2 has stored multiple historical physiological state values about the user of the terminal device 1 within a time period, the user application interface may transmit a request signal to the second service device 22, and the second service device 22 Send the request result to the user application interface according to the request signal from the user application interface. The request result received by the user application interface includes multiple historical physiological state values of the user of the terminal device 1 in the aforementioned time period. Then, the user of the user application interface (eg, medical staff) can provide health care according to these historical physiological state values. The teaching information is transmitted to the terminal device 1 via the second service device 22 . In other words, when the user of the user application interface is a medical staff, the user of the user application interface can provide health education information according to the obtained request result, and transmit it to the terminal device 1 via the second service device 22 .

The identified measurement value and the identified measurement unit stored in the terminal device 1 can be used as the input basis for the application program of the terminal device 1, except to avoid the situation of erroneous observation of the identified measurement value and input of the wrong identified measurement value, and at the same time It can be applied to measuring instruments of different Bluetooth communication specifications and measuring devices without communication functions, and is more convenient to use. In addition, the user of the terminal device 1 can adjust the diet and daily routine according to the health education information sent by the cloud server 2, so as to continuously improve the personal health status. The relatives and friends of the user or the doctor of the medical institution pay more attention to the health state of the user according to the warning information sent by the cloud server 2 and the shared physiological state information. Furthermore, the physician of the medical institution obtains the user's current physiological state value, the updated historical physiological state record table, the updated historical physiological state trend chart, the comprehensive historical physiological state record table, or the comprehensive historical physiological state trend chart from the cloud server based on the data obtained from the cloud server. , which can provide suitable health education information to the user's terminal device through the cloud server, allowing users to improve their health status according to the health education information.

【Symbol Description】

1 Terminal device

11 Processor

12 memory

13 Display screen

131 Frames

132 Directional Indicators

14 cameras

15 The first communication transmission interface

2 Cloud server

21 The first service device

22 Second service device

23 Second communication transmission interface

Claims (20)

1. An image information input method, comprising:

shooting a measurement result picture of the measuring device by a camera of the terminal device to generate an output image;

transmitting the output image to a cloud server by using a communication transmission interface of the terminal device;

identifying the output image with the cloud server to obtain identified matching results for the identified measurement values and the identified measurement units; and

and storing the identified matching result by the cloud server.

2. The method as claimed in claim 1, wherein capturing the measurement result frame of the measurement device by the camera of the terminal device to generate the output image comprises: shooting the measurement result picture to obtain an initial image; and performing image processing on the initial image to generate the output image, wherein the data volume of the output image is smaller than that of the initial image.

3. The image information input method according to claim 1, further comprising: and transmitting the identified matching result to the memory of the terminal device by the cloud server.

4. The image information input method of claim 3, further comprising sending the identified matching result to the terminal device by the cloud server, and then sending a correction message related to the identified matching result back to the cloud server by the terminal device.

5. The image information input method of claim 1, further comprising: performing unit conversion processing on the identified matching result by using the cloud server to generate a converted matching result; and storing the converted matching result by the cloud server.

6. The image information input method of claim 1, wherein the identified measurement value is a first identified measurement unit, the identified measurement unit is a first identified measurement unit, the identified matching result is a first identified matching result, and identifying the output image with the cloud server further obtains a second identified matching result with respect to a second identified measurement unit and a second identified measurement unit, and storing the second identified matching result with the cloud server.

7. A physiological image processing method is characterized by comprising the following steps:

shooting a measurement result picture of the physiological measurement device by a camera of the terminal device to generate an output image;

transmitting the output image to a cloud server by using a communication transmission interface of the terminal device;

identifying the output image with the cloud server to obtain identified matching results for the identified physiological state values and the identified physiological state units;

transmitting the identified matching result to the terminal device with the cloud server to generate a confirmed matching result for a confirmed physiological status value and a confirmed physiological status unit;

transmitting the confirmed matching result to the cloud server by the terminal device;

storing the confirmed matching result with the cloud server.

8. The method as claimed in claim 7, further comprising comparing the physiological status information with a personal status interval by the cloud server, and transmitting an alert message to the terminal device or the user application interface by the cloud server when the physiological status information is outside the personal status interval.

9. The method as claimed in claim 7, further comprising instructing the cloud server to share the confirmed physiological status value and the confirmed physiological status unit with a user application interface via the terminal device.

10. The method as claimed in claim 7, further comprising transmitting a sanitation request to the cloud server via the terminal device or the user application interface, and transmitting sanitation information to the terminal device or the user application interface via the cloud server according to the sanitation request.

11. The method of claim 7, wherein storing the confirmed match result with the cloud server comprises: storing the confirmed physiological status value and the confirmed physiological status unit with the cloud server; and updating a historical physiological state record table or a historical physiological state trend chart by the cloud server according to the confirmed physiological state numerical value and the confirmed physiological state unit.

12. The method as claimed in claim 11, further comprising instructing the cloud server to share the historical physiological state record table or the historical physiological state trend graph to a user application interface by the terminal device.

13. The method as claimed in claim 11, wherein the confirmed physiological state value is a first confirmed physiological state value, the confirmed physiological state unit is a first confirmed physiological state unit, and the confirmed matching result is a first confirmed matching result, wherein the method further comprises: identifying the output image with the cloud server to obtain a second identified matching result regarding a second identified physiological state value and a second identified physiological state unit; transmitting, with the cloud server, the second identified matching result to the terminal device to obtain a second confirmed matching result for a second confirmed physiological status value and a second confirmed physiological status unit; transmitting the second confirmed matching result to the cloud server by the terminal device; and storing the second confirmed matching result with the cloud server.

14. The method as claimed in claim 13, wherein the historical physiological state record table is a first historical physiological state record table, the historical physiological state trend graph is a first historical physiological state trend graph, and wherein the storing the second confirmed matching result with the cloud server comprises: storing the second confirmed physiological status value and the second confirmed physiological status unit with the cloud server; and updating a second historical physiological state record table or a second historical physiological state trend graph by the cloud server according to the second confirmed physiological state numerical value and the second confirmed physiological state unit.

15. The method as claimed in claim 14, further comprising establishing a comprehensive historical physiological state record table by the cloud server in combination with the first historical physiological state record table and the second historical physiological state record table, or establishing a comprehensive historical physiological state trend map by combining the first historical physiological state trend map and the second historical physiological state trend map.

16. The method as claimed in claim 11, wherein the physiological measurement device is a first physiological measurement device, the measurement frame is a first measurement frame, the output image is a first output image, the recognized physiological status value is a first recognized physiological status value, the recognized physiological status unit is a first recognized physiological status unit, the recognized matching result is a first recognized matching result, the confirmed physiological status value is a first confirmed physiological status value, the confirmed physiological status unit is a first confirmed physiological status unit, the confirmed matching result is a first confirmed matching result, and the method for processing physiological image information further comprises:

shooting a second measurement result picture of a second physiological measurement device by the camera to generate a second output image;

transmitting the second output image to the cloud server through the communication transmission interface;

identifying the second output image with the cloud server to obtain a second identified matching result regarding a second identified physiological state value and a second identified physiological state unit;

transmitting, with the cloud server, the second identified matching result to the terminal device to generate a second confirmed matching result for a second confirmed physiological status value and a second confirmed physiological status unit;

transmitting the second confirmed matching result to the cloud server by the terminal device; and

storing the second confirmed matching result with the cloud server.

17. The method as claimed in claim 16, wherein the historical physiological state record table is a first historical physiological state record table, the historical physiological state trend graph is a first historical physiological state trend graph, and wherein the storing the second confirmed matching result with the cloud server comprises: storing the second confirmed physiological status value and the second confirmed physiological status unit with the cloud server; and updating a second historical physiological state record table or a second historical physiological state trend graph by the cloud server according to the second confirmed physiological state numerical value and the second confirmed physiological state unit.

18. The method as claimed in claim 17, further comprising establishing a comprehensive historical physiological state record table by the cloud server in combination with the first historical physiological state record table and the second historical physiological state record table, or establishing a comprehensive historical physiological state trend map by combining the first historical physiological state trend map and the second historical physiological state trend map.

19. An image processing apparatus, comprising:

the terminal device comprises a camera and a communication transmission interface, wherein the communication transmission interface is electrically connected with the camera, and the camera is used for shooting a measurement result picture of the measuring device to generate an output image; and

and the cloud server is electrically connected to the communication transmission interface and used for identifying the output image to obtain an identified matching result about the identified measurement value and the identified measurement unit, storing the identified matching result and transmitting the identified matching result to the terminal device.

20. The image processing apparatus as claimed in claim 19, wherein the terminal device further comprises a display screen electrically connected to the camera, the display screen displaying a frame and a direction indicator, the measurement result frame being displayed in the frame, the direction indicator being located outside the frame.

Images