JP6726093B2 - Information processing system - Google Patents

Description

The present disclosure relates to an information processing system, and particularly to an information processing system including a sphygmomanometer, a terminal device, and a server communicable with the terminal device.

Various measuring devices have been developed to measure various biological information relating to the health condition of the human body such as blood pressure and pulse. The user's health condition is checked by importing the measurement data of such measuring equipment into a terminal device for collecting the measurement data.

For example, Japanese Patent Laid-Open No. 2001-224557 (Patent Document 1) discloses a data input device. The data input device includes an image acquisition means for obtaining an image of the data displayed on the data display section of the measuring instrument, a number reading means for reading the numbers in the obtained image, and a display means for displaying the read numbers. ..

JP 2001-224557 A

In recent years, systems that collectively manage data in a server have become widespread. Therefore, various measurement data (for example, blood pressure value, pulse rate, etc.) obtained by the data input device according to Patent Document 1 are transmitted to the server, and the health condition of the user is managed using the data collected by the server. A system that does is possible. In such a system, in order to accurately grasp the user's health condition, there is an increasing need to secure the reliability of measurement data that is regularly transmitted from a terminal device such as a data input device to a server.

Patent Document 1 discloses that the measurement data measured and displayed by a predetermined measuring device is analyzed, and the analysis result is output to a predetermined processing device. However, nothing is taught about the technology related to the above needs. Absent.

The present disclosure has been made in view of the above, and an object in a certain aspect is to provide an information processing system capable of more accurately grasping the health condition of a user of a terminal device.

An information processing system according to an embodiment includes a sphygmomanometer, a terminal device, and a server communicable with the terminal device. The terminal device sends an image pickup means, a detection means for detecting the measurement result displayed on the display of the sphygmomanometer from the images of the sphygmomanometer included in the captured image generated by the image pickup means, and the measurement result to the server. And a terminal transmitting means for performing the same. The server evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device, and an error notification to the terminal device when the evaluation result evaluates that the reliability of the measurement result is low. Server transmitting means for transmitting.

Preferably, the measurement result includes the measurement date and time when the measurement was performed using the sphygmomanometer. The terminal transmission means further transmits the image capture date and time of the captured image to the server. The evaluation means calculates the period from the measurement date and time to the image pickup date and time, and if the calculated period is not within the predetermined period, evaluates that the reliability of the measurement result is low. The server transmission means transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device.

Preferably, the terminal device further includes position information acquisition means for acquiring position information of the terminal device. The terminal transmission means further transmits the position information of the terminal device to the server. The evaluation means determines whether or not the terminal device exists at the predetermined position based on the received position information of the terminal device, and if the terminal device does not exist at the predetermined position, the reliability of the measurement result is low. Evaluate. The server transmission means transmits an error notification indicating that the measurement place of the sphygmomanometer is different from the predetermined position to the terminal device.

Preferably, the terminal transmitting means further transmits the captured image to the server. The evaluation means judges whether or not the blood pressure monitor is a predetermined blood pressure monitor based on the received imaged image, and if the blood pressure monitor is not the predetermined blood pressure monitor, the reliability of the measurement result is evaluated as low. To do. The server transmission means transmits an error notification indicating that the blood pressure monitor is not a predetermined blood pressure monitor to the terminal device.

Preferably, the evaluation means determines whether or not the sphygmomanometer is a predetermined sphygmomanometer, based on at least one of the brand, shape, and model of the sphygmomanometer extracted from the received captured image.

Preferably, the captured image further includes a finger image of the measurement subject of the sphygmomanometer. The evaluation means extracts the first characteristic information of the finger from the image of the finger of the measured person included in the captured image, and the first characteristic information and the second characteristic information of the finger of the measured person stored in advance in the server. Is determined, and if the first characteristic information and the second characteristic information do not match, it is evaluated that the reliability of the measurement result is low. The server transmission means transmits to the terminal device an error notification that the finger image of the measurement subject included in the captured image is different from the finger image of the measurement subject registered in advance.

According to the present disclosure, it becomes possible to more accurately grasp the health condition of the user of the terminal device.

It is a figure which shows the schematic structure of an information processing system. It is a block diagram showing an example of the hardware constitutions of a terminal device. It is a figure which shows an example of the external appearance of the main-body part of a sphygmomanometer. It is a figure which shows the operation|movement outline|summary of an information processing system. It is a figure which shows the screen displayed on the display of a terminal device when a blood pressure monitor is imaged. It is a figure which shows an example of the error notification displayed on the display of a terminal device. It is a figure which shows an example of the captured image containing a sphygmomanometer and a person's finger. It is a figure which shows an example of the captured image of the scene where the to-be-measured person is wearing the wrist-type sphygmomanometer. It is a block diagram which shows the function structure of a terminal device and a server. It is a flow chart which shows an example of the processing procedure of a terminal unit and a server. 7 is a flowchart showing an example of a reliability evaluation processing procedure according to the present embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<System configuration>
FIG. 1 is a diagram showing a schematic configuration of the information processing system 1.

With reference to FIG. 1, the information processing system 1 includes a plurality of terminal devices 10A and 10B which are user terminals, blood pressure monitors 20A and 20B for measuring a user's blood pressure, a server 30, and a network 40. .. In the present embodiment, it is assumed that the terminal device 10A is the terminal of the user A and the terminal device 10B is the terminal of the user B. In the following, for convenience of description, the terminal devices 10A and 10B may be collectively referred to as "terminal device 10".

The sphygmomanometer 20A is a stationary upper arm sphygmomanometer in which the main body and the cuff (arm girdle) are separate bodies. The sphygmomanometer 20B is a wrist watch type sphygmomanometer in which the main body and the cuff are integrated. The sphygmomanometer 20B has a function of being worn on an arm for a long time like a wristwatch and measuring pulsation for each beat continuously for 24 hours, a function of being always worn and performing measurement only by pressing a measurement start button, and the like. .. This allows the blood pressure monitor 20B to constantly measure the blood pressure of the user. Hereinafter, for convenience of description, the sphygmomanometers 20A and 20B may be collectively referred to as the “sphygmomanometer 20”.

The terminal device 10 is, for example, a smartphone including a camera and a touch panel. The terminal device 10 has a function of detecting the measurement result displayed on the display of the sphygmomanometer 20 from the captured image generated by imaging the sphygmomanometer 20 using the camera. In the following, a smartphone will be described as a typical example of the “terminal device”. However, the terminal device may be another terminal device having an imaging function such as a foldable mobile phone, a tablet terminal device, and a PDA (Personal Data Assistance).

The network 40 for connecting the terminal device 10 and the server 30 to each other includes various networks such as the Internet and a mobile terminal communication network.

The server 30 stores various data transmitted from the terminal device 10. Specifically, the server 30 stores the identification information (user ID) of the user and the identification information (terminal ID) of the terminal device 10 in the database 32 in association with each other. The server 30 uses the database 32 to manage various data transmitted from each terminal device 10 for each user ID (and terminal ID). The database 32 stores, for example, measurement results such as the blood pressure value of the user A transmitted from the terminal device 10A to the server 30.

<Hardware configuration>
(Terminal device)
FIG. 2 is a block diagram showing an example of the hardware configuration of the terminal device 10. 2, the terminal device 10 has a processor 152, a memory 154, an input device 156, a display 158, a wireless communication unit 160, a communication antenna 162, a camera 163, and a memory as main components. An interface (I/F) 164, a communication interface (I/F) 166, a speaker 168, a microphone 170, and a GPS controller 172 are included.

The processor 152 is typically an arithmetic processing unit such as a CPU (Central Processing Unit) or an MPU (Multi Processing Unit). The processor 152 functions as a control unit that controls the operation of each unit of the terminal device 10 by reading and executing the program stored in the memory 154. The processor 152 implements each of the processes (steps) of the terminal device 10 described later by executing the program.

The memory 154 is realized by a RAM (Random Access Memory), a ROM (Read-Only Memory), a flash memory, or the like. The memory 154 stores a program executed by the processor 152, data used by the processor 152, and the like.

The input device 156 receives an operation input to the terminal device 10. Input device 156 is typically realized by a touch panel. The touch panel is provided on the display 158 having a function as a display unit, and is of a capacitance type, for example. The touch panel detects a touch operation on the touch panel by an external object at predetermined time intervals and inputs touch coordinates to the processor 152. However, the input device 156 may include buttons and the like.

The wireless communication unit 160 connects to the mobile communication network via the communication antenna 162 and transmits/receives signals for wireless communication. This allows the terminal device 10 to communicate with another communication device (for example, the server 30) via a mobile communication network such as LTE (Long Term Evolution).

The camera 163 is realized by, for example, a CCD (Charge Coupled Device) system, a CMOS (Complementary Mental Oxide Semiconductor) system, or another system.

The memory interface 164 reads data from the external storage medium 165. The processor 152 reads the data stored in the storage medium 165 via the memory interface 164 and stores the data in the memory 154. The processor 152 reads the data from the memory 154 and stores the data in the external storage medium 165 via the memory interface 164.

The storage medium 165 is non-volatile such as a CD (Compact Disc), a DVD (Digital Versatile Disk), a BD (Blu-ray (registered trademark) Disc), a USB (Universal Serial Bus) memory, and an SD (Secure Digital) memory card. It includes a medium for storing the program.

The communication interface (I/F) 166 is a communication interface for exchanging various data with other devices, and is realized by an adapter, a connector, or the like. In the present embodiment, BLE (Bluetooth (registered trademark) low energy) is adopted as the communication method. However, the communication system may be a wireless communication system such as a wireless LAN or a wired communication system using a USB (Universal Serial Bus) or the like.

The speaker 168 converts the voice signal given from the processor 152 into a voice and outputs the voice to the outside of the terminal device 10. The microphone 170 receives a voice input to the terminal device 10 and gives a voice signal corresponding to the voice input to the processor 152.

The GPS controller 172 receives the GPS signal or the position signal (positioning signal) from the base station to acquire the position information of the terminal device 10. The GPS controller 172 inputs the acquired positional information of the terminal device 10 to the processor 152.

The terminal device 10 includes various sensors (acceleration sensor and angular velocity sensor), a time measuring unit for measuring time, and the like.

(server)
The server 30 only needs to be able to provide information processing as described below as a whole, and a known hardware configuration can be adopted. For example, the server 30 has a processor for executing various processes, a memory for storing programs and data, a communication interface for transmitting and receiving various data with the terminal device 10, and an instruction from an administrator. And input interface for.

(Sphygmomanometer)
The sphygmomanometer 20 is only required to be able to provide the information processing described below as a whole, and a well-known hardware configuration can be adopted. For example, the sphygmomanometer 20 includes a processor for executing various processes, a memory for storing programs and data, a display for displaying measurement data, and an input interface for receiving instructions from a user. (For example, a button, a switch, etc.), a cuff that can be wrapped around a user's upper arm (or wrist), a cuff pressure adjusting mechanism such as a piezoelectric pump and an exhaust valve, and a pressure sensor for detecting the cuff pressure, It includes a time measuring unit for measuring the time and a temperature sensor for detecting the outside air temperature.

FIG. 3 is a diagram showing an example of the external appearance of the main body of the sphygmomanometer 20A. Referring to FIG. 3, main body 22 of sphygmomanometer 20A includes a display 24, a forward/back button 26, a lamp 27, a user number switch 28, and a blood pressure measurement start/stop button 29. In addition, on the outer surface of the main body portion 22, brand information 41 (for example, brand “AAA”) and model information 43 (for example, model “XYZ-ABC”) of the sphygmomanometer 20 are provided. The user number switch 28 is used when the measurement results of two persons are stored separately. In the example of FIG. 3, the user with the number “1” is selected. The lamp 27 is a lamp indicating whether or not the cuff is properly wound, and is shown to be appropriate in the example of FIG.

The display 24 displays the measurement result. Specifically, the measurement result is displayed in the area 52 together with the systolic blood pressure value (for example, 118 mmHg), the minimum blood pressure value (for example, 78 mmHg) and the pulse rate (for example, 70 nights/minute) displayed in the area 50. The measurement date and time (for example, 7:30 on July 1st), the user number (for example, “1”) displayed in the area 54, and the current temperature (for example, 24 degrees) displayed in the area 56. , And various messages displayed in the area 58 (for example, a message indicating the completion of measurement). The measurement result may include information indicating the pulse wave state, information indicating whether the cuff is properly wound, and the like.

<Operation overview>
FIG. 4 is a diagram showing an operation outline of the information processing system 1. Here, it is assumed that the user of the terminal device 10 uses the sphygmomanometer 20A to measure blood pressure. FIG. 5 is a diagram showing a screen displayed on the display 158 of the terminal device 10 when the blood pressure monitor 20A is imaged. FIG. 6 is a diagram showing an example of the error notification displayed on the display 158 of the terminal device 10.

Referring to FIG. 4, sphygmomanometer 20A measures the blood pressure value (maximum blood pressure value, minimum blood pressure value) and pulse rate of the user, and displays the measurement result on display 24 (sequence SQ10).

The terminal device 10 uses the camera 163 to image (capture) the sphygmomanometer 20A in which the measurement result is displayed on the display 24 (sequence SQ12). The terminal device 10 detects the measurement result from the captured image (sequence SQ14). For example, as shown in FIG. 5, a screen 500 including four corner frames 510 is displayed on the display 158 of the terminal device 10 in the imaging mode. The user takes an image so that the display 24 of the sphygmomanometer 20A fits within the frame 510. As a result, the terminal device 10 detects the measurement result by analyzing the captured image using the known OCR technology or the like and the image recognition technology or the like.

For example, the frame 510 is displayed as a frame showing the outer four corners of the recognition range (analysis range) in which the character string can be recognized. Therefore, the inside of the frame 510 is the recognition range. The terminal device 10 executes a process of recognizing the measurement result imaged so as to be within the recognition range. Specifically, the terminal device 10 recognizes various character strings included in the measurement result. In addition, the "character" in the present embodiment means a symbol in which lines and dots are combined to convey and record a word (language), and not only an alphanumeric symbol, a kanji character, a kana character, etc. , Stamps and other arbitrary figures with identification codes are included.

Here, the terminal device 10 stores in the memory 154 screen information indicating what information is displayed in which area of the display 24 of the sphygmomanometer 20A. Therefore, for example, when the display 24 is imaged so as to fit within the frame 510 which is the recognition range, the terminal device 10 uses the screen information to determine what information each recognized character string is. Can be specified. For example, in the terminal device 10, the plurality of character strings “118”, “78”, and “70” recognized in the region 50 of the display 24 that is contained in the frame 510 are the maximum blood pressure value, the minimum blood pressure value, and the pulse rate, respectively. Can be specified as a character string indicating.

In addition, the terminal device 10 receives an instruction from the user and specifies that the subject is the blood pressure monitor 20A. Alternatively, the terminal device 10 extracts the characteristic information (shape, model, brand) of the sphygmomanometer from the captured image and compares the extracted characteristic information with the characteristic information of each sphygmomanometer stored in advance. By doing so, it may be specified that the subject is the blood pressure monitor 20A.

Again referring to FIG. 4, terminal device 10 transmits various information including measurement data and other information to server 30 via network 40 (sequence SQ16). The other information is, for example, the shooting date/time, the user ID, the terminal ID, and the like.

Server 30 evaluates the reliability of the measurement result based on a predetermined evaluation method (sequence SQ18). For example, the server 30 evaluates that the reliability of the measurement result is low when the period from the measurement date/time to the image capturing date/time is not within the predetermined period. In this case, the server 30 does not store the measurement result in the database 32.

If the server 30 evaluates that the reliability of the measurement result is low, it notifies the terminal device 10 of an error (sequence SQ20). For example, the server 30 transmits to the terminal device 10 an error notification indicating that the measurement result is unreliable because the period from the measurement time to the imaging time is too long. The terminal device 10 displays the error notification received from the server 30 on the display 158 (sequence SQ22). For example, as shown in FIG. 6, the terminal device 10 has a low reliability such as a message 610 such as “the measurement result is unreliable” or “the period from the measurement time to the imaging time is too long”. An error notification screen 600 including a message 620 indicating “” is displayed on the display 158. The error notification screen 600 may further include a message prompting the user to perform remeasurement.

If the server 30 evaluates that the reliability of the measurement data is high (not low) based on a predetermined evaluation method, the server 30 notifies the terminal device 10 that the measurement data is normal. You may send it. In this case, the server 30 stores the measurement data in the database 32.

<Evaluation method>
In the present embodiment, the server 30 evaluates the reliability of the measurement result received from the terminal device 10 according to various evaluation methods. Here, the evaluation method executed by the server 30 will be described.

(Evaluation method: Part 1)
In the evaluation method (No. 1), the reliability of the measurement result is evaluated based on the period from the measurement date and time to the imaging date and time. Specifically, the terminal device 10 transmits to the server 30 the measurement result detected from the imaged image of the sphygmomanometer 20A and the imaged date and time when the image of the sphygmomanometer 20A was captured. The server 30 calculates the period from the measurement date and time to the image capturing date and time, and if the calculated period (calculation period) is not within the predetermined period (for example, within 1 minute), the reliability of the measurement result is evaluated as low. However, if the calculation period is within the predetermined period, it is evaluated that the measurement result is highly reliable. The reason for evaluating the reliability in this way will be described below.

If the period from the measurement date/time to the image capturing date/time is not within the predetermined period, it is considered that the user of the terminal device 10 who is the subject does not take an image of the sphygmomanometer immediately after taking the blood pressure measurement. .. From this fact, it is undeniable that the measurement result may be tampered with by some method, and thus the reliability of the measurement result is evaluated as low.

In addition, when the time of the blood pressure monitor is set incorrectly, an error occurs in the calculation period. In such a case, even if the user measures the blood pressure and then immediately images the blood pressure monitor with the camera, it is considered that the calculation period is not within the predetermined period. Since the blood pressure fluctuates even during the day, the index (that is, the measurement date and time) when measuring the day (morning or night) is used to accurately grasp the health condition of the user. It becomes an important factor. From this, when the calculation period is not within the predetermined period, it cannot be denied that the measurement date and time is not accurate, so that the reliability of the measurement result is evaluated to be low.

(Evaluation method: Part 2)
In the evaluation method (2), the reliability of the measurement result is evaluated based on the measurement location. Specifically, the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20A and the position information of the own device to the server 30. The server 30 determines whether or not the terminal device 10 exists at a predetermined measurement location based on the position information of the terminal device 10. The server 30 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined measurement place, and evaluates that the reliability of the measurement result is high when the terminal device 10 is present at the predetermined measurement place. The position information of the predetermined measurement location is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. The reason for evaluating the reliability in this way will be described below.

If you are nervous, your blood pressure will rise more than at rest. For example, when a person who normally measures blood pressure at home measures blood pressure at a hospital, his/her blood pressure may be higher than that at home due to mental tension. Therefore, the index indicating whether the measurement place at the time of blood pressure measurement is the same place as usual (predetermined measurement place) is an important factor for accurately grasping the health condition of the user. From this, when the terminal device 10 is not present at a predetermined measurement location, the possibility that the blood pressure has changed depending on the measurement location cannot be denied, and thus the reliability of the measurement result is evaluated to be low.

The measurement date and time may be further compared with the reception date and time at which the server 30 received the position information in order to more accurately determine that the terminal device 10 was present at the predetermined measurement location when measuring the blood pressure. Specifically, when the position information of the terminal device 10 indicates a predetermined measurement location and the time from the measurement date/time to the reception date/time is within a predetermined time, the server 30 determines that the server device 30 measures the blood pressure. Sometimes it is determined that the object was present at the specified measurement location. On the other hand, even if the position information of the terminal device 10 indicates the predetermined measurement location, the server 30 determines that the terminal device 10 is present at the predetermined measurement location at the time of blood pressure measurement if the time is not within the predetermined time. It was determined that it was not. In this case, the server 30 evaluates that the reliability of the measurement result is low.

(Evaluation method: Part 3)
In the evaluation method (3), the reliability of the measurement result is evaluated based on the brand, model, shape, etc. of the sphygmomanometer. Specifically, the terminal device 10 transmits the captured image of the sphygmomanometer 20A to the server 30. The server 30 determines whether the sphygmomanometer 20A is an authenticated sphygmomanometer based on the captured image. The server 30 evaluates that the measurement result has low reliability when the sphygmomanometer 20A is not an authenticated blood pressure monitor, and evaluates that the measurement result has high reliability when the sphygmomanometer 20A is an authenticated blood pressure monitor. Specifically, the server 30 extracts the brand information, model, shape, and the like of the sphygmomanometer 20A based on the imaged image of the sphygmomanometer 20A. The server 30 determines whether the sphygmomanometer 20A is an authenticated sphygmomanometer based on these pieces of information. For example, assume that the brand X blood pressure monitor is a certified blood pressure monitor. In this case, when the extracted brand information indicates brand X, server 30 determines that sphygmomanometer 20A is an authenticated sphygmomanometer.

(Evaluation method: Part 4)
In the evaluation method (4), the reliability of the measurement result is evaluated based on the finger image of the user (measured person). Here, it is assumed that the measurement subject images the sphygmomanometer 20A and his/her finger using the camera 163 of the terminal device 10A.

FIG. 7 is a diagram showing an example of a captured image including the blood pressure monitor and the fingers of the measurement subject. The screen 700 of FIG. 7 is an image of a state in which the measurement subject has a cuff wrapped around his left arm using the sphygmomanometer 20A, which is an upper arm sphygmomanometer, and his left finger is brought close to the sphygmomanometer 20A. It shows the situation.

10 A of terminal devices transmit the captured image containing the image of 20 A of sphygmomanometers, and the finger image of a to-be-measured person to the server 30 as shown on the screen 700. The server 30 extracts the characteristic information of the finger from the finger image of the measurement subject. The server 30 determines whether the characteristic information of the finger stored in association with the terminal ID (and the user ID) of the terminal device 10A matches the extracted characteristic information of the finger. When the stored characteristic information does not match the extracted characteristic information, the server 30 determines that the person to be measured is not the user A (user of the terminal device 10A), and the reliability of the measurement result. Is evaluated as low. When these pieces of characteristic information match, the server 30 determines that the person to be measured is the user A and evaluates that the measurement result is highly reliable.

Note that although the example of FIG. 7 illustrates that the entire five fingers are imaged, one or more specific fingers (for example, only the index finger) are included if the characteristic information of the fingers can be compared. You may image like this. Further, when the characteristic information of the palm stored in association with the terminal ID of the terminal device 10A and the characteristic information of the palm of the measurement subject extracted from the captured image match, the reliability of the measurement result is evaluated as high. If the feature information does not match, it may be evaluated that the reliability of the measurement result is low.

Next, when using a wrist-type blood pressure monitor, the reliability of the measurement result may be evaluated based on the wearing state.

FIG. 8: is a figure which shows an example of the captured image of the scene where the to-be-measured person is wearing the wrist-type blood pressure monitor. The screen 800 of FIG. 8 shows a state in which the subject has taken an image of a state in which the sphygmomanometer 20B is worn when the measurement is performed with the cuff wrapped around the left wrist using the sphygmomanometer 20B, which is a wrist sphygmomanometer. There is.

As shown on the screen 800, the terminal device 10 transmits to the server 30 a captured image in which the blood pressure monitor 20B is worn on the wrist of the measurement subject. Specifically, in the case of the wrist type blood pressure monitor, as in the case of the upper arm type blood pressure monitor, the reliability of the measurement result is evaluated based on the characteristic information of the finger (and palm) of the measurement subject. Therefore, the terminal device 10 is in a state where the blood pressure monitor 20B is attached to the wrist of the person to be measured, and transmits the captured image including the fingers of the person to be measured (the captured image as shown in FIG. 8) to the server 30. ..

First, when the server 30 determines that the blood pressure monitor 20B is not attached, the server 30 evaluates that the measurement result has low reliability. For example, when the image of the blood pressure monitor 20B and the images of the finger and wrist of the measurement subject are not included in the captured images, the server 30 determines that the blood pressure monitor 20B is not attached. , It is evaluated that the reliability of the measurement result is low.

If the server 30 determines that the sphygmomanometer 20B is attached, does the hand characteristic information stored in association with the terminal ID of the terminal device 10A match the extracted hand characteristic information? Further judge whether or not. If the stored characteristic information does not match the extracted characteristic information, the server 30 determines that the person to be measured is not the user A and evaluates that the measurement result has low reliability. When these pieces of characteristic information match, the server 30 determines that the person to be measured is the user A and evaluates that the measurement result is highly reliable.

<Functional configuration>
FIG. 9 is a block diagram showing the functional configurations of the terminal device 10 and the server 30. With reference to FIG. 9, the terminal device 10 includes an imaging unit 202, a display control unit 204, a detection unit 206, a position information acquisition unit 208, and a terminal communication unit 210. The server 30 includes a server communication unit 252, an evaluation unit 254, and a database 32.

The image capturing unit 202 of the terminal device 10 captures an image of a subject and generates a captured image. In the present embodiment, the image capturing unit 202 generates a captured image including the image of the blood pressure monitor 20 as the subject. The imaging unit 202 is a function mainly realized by the processor 152 and the camera 163 working together. The imaging unit 202 outputs the generated captured image to the display control unit 204, the detection unit 206, and the terminal communication unit 210.

The display control unit 204 causes the display 158 to display captured images generated by sequentially capturing images by the image capturing unit 202.

The detection unit 206 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the images of the sphygmomanometer 20 included in the captured image generated by the imaging unit 202. The measurement result includes, for example, a systolic blood pressure value, a diastolic blood pressure value, a pulse rate, a measurement date and time, an air temperature, a user number, various messages, information indicating whether the cuff is properly wrapped, and information indicating a pulse wave state. The detection unit 206 outputs the detected measurement result to the terminal communication unit 210.

The position information acquisition unit 208 acquires the position information of the terminal device 10 based on the GPS signal or the position signal from the base station. The position information acquisition unit 208 is a function mainly realized by the GPS controller 172. The position information acquisition unit 208 outputs the acquired position information to the terminal communication unit 210.

The terminal communication unit 210 transmits various information including the measurement result detected by the detection unit 206 and other information to the server 30. The other information includes, for example, the user ID, the terminal ID, the captured image generated by the image capturing unit 202, the captured date and time of the captured image, and the position information of the terminal device 10 acquired by the position information acquisition unit 208.

The server communication unit 252 of the server 30 receives various kinds of information from the terminal device 10. The server communication unit 252 outputs various information to the evaluation unit 254.

The evaluation unit 254 evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device 10. The server communication unit 252 transmits an error notification to the terminal device 10 when the evaluation unit 254 evaluates that the reliability of the measurement result is low.

Specifically, in a certain aspect, the evaluation unit 254 calculates the period from the measurement date/time to the image capturing date/time, and determines whether the calculated period is within the predetermined period. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the calculated period is not within the predetermined period. In this case, the server communication unit 252 transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device 10.

In another aspect, the evaluation unit 254 determines whether or not the terminal device 10 exists at a predetermined position based on the position information of the terminal device 10 received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined position. The information indicating the predetermined position is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. In this case, the server communication unit 252 transmits to the terminal device 10 an error notification indicating that the measurement place of the sphygmomanometer 20 is different from the predetermined position.

In still another aspect, the evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the captured image received from the terminal device 10. The evaluation unit 254 evaluates that the measurement result has low reliability when the sphygmomanometer 20 is not a predetermined sphygmomanometer. More specifically, the evaluation unit 254 extracts at least one of the brand, model, and shape of the sphygmomanometer 20 from the captured image. The evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the extracted information. When the evaluation unit 254 evaluates that the measurement result has low reliability, the server communication unit 252 transmits an error notification indicating that the sphygmomanometer 20 is not a predetermined sphygmomanometer to the terminal device 10. The predetermined sphygmomanometer is, for example, a sphygmomanometer permitted by the administrator of the server 30 or the like by satisfying conditions such as measurement accuracy.

In still another aspect, the evaluation unit 254 extracts the characteristic information Fa of the finger from the finger image of the measurement subject included in the captured image. The evaluation unit 254 determines whether or not the characteristic information Fa and the characteristic information Fb of the finger of the measurement subject stored in advance in the memory of the server 30 match. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the feature information Fa and the feature information Fb do not match. In this case, the server communication unit 252 transmits, to the terminal device 10, an error notification that the finger image of the measurement subject included in the captured image is different from the finger image of the measurement subject stored in advance. The feature information Fb is stored in the memory of the server 30 in association with the terminal ID and the user ID.

The evaluation unit 254 may evaluate the reliability of the measurement result based on the plurality of evaluation items described above. For example, "the period from the measurement date and time to the image capturing date and time" is the evaluation item E1, "positional information of the terminal device 10" is the evaluation item E2, "sphygmomanometer used for measurement" is the evaluation item E3, and The included finger image of the person to be measured" is an evaluation item E4. In this case, when even one of the evaluation items E1 to E4 evaluates that the reliability of the measurement result is low according to the above-described evaluation method, the evaluation unit 254 determines the reliability of the measurement result for the remaining evaluation items. Even if it is not evaluated as low, it is finally evaluated that the reliability of the measurement result is low. That is, the evaluation unit 254 finally evaluates that the reliability of the measurement result is high, only when the reliability of the measurement result is not evaluated as low according to the above-described evaluation method for all the evaluation items E1 to E4. To do. In addition, which evaluation item should be used to evaluate the measurement result may be arbitrarily set by the administrator of the server 30 or the like.

The evaluation unit 254 outputs the evaluation result to the server communication unit 252. When the evaluation unit 254 evaluates that the reliability of the measurement result is low, the evaluation unit 254 discards the measurement result without storing it in the database 32. When the evaluation unit 254 evaluates that the measurement result is highly reliable, the evaluation unit 254 stores the measurement result in the database 32 in association with the terminal ID and the user ID.

When the evaluation unit 254 evaluates that the measurement result is highly reliable, the server communication unit 252 notifies that the measurement result is normal (for example, a message indicating that the measurement result is normally stored in the database 32). The notification) may be transmitted to the terminal device 10.

The terminal communication unit 210 of the terminal device 10 receives various notifications (for example, error notification, normal notification) transmitted from the server 30. The terminal communication unit 210 outputs the received various notifications to the display control unit 204. The display control unit 204 causes the display 158 to display various notifications.

<Processing procedure>
FIG. 10 is a flowchart showing an example of the processing procedure of the terminal device 10 and the server 30.

With reference to FIG. 10, the processor 152 of the terminal device 10 generates a captured image of the sphygmomanometer 20 captured by using the camera 163 (step S100). The processor 152 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the captured image (step S102). The processor 152 transmits various information to the server 30 via the wireless communication unit 160 (or the communication interface 166) (step S104). Here, various information includes a measurement result, a user ID, a terminal ID, a captured image, a captured date and time, and position information of the terminal device 10. Further, the measurement result includes the maximum blood pressure value, the minimum blood pressure value, the pulse rate, and the measurement date and time.

The processor of the server 30 (hereinafter referred to as “server processor”) receives various information transmitted from the terminal device 10 via the communication interface (step S106). The server processor executes the reliability evaluation process of the measurement result based on various information (step S110).

FIG. 11 is a flowchart showing an example of the reliability evaluation processing procedure. Referring to FIG. 11, the server processor determines whether or not the period from the measurement date/time to the image capturing date/time is within a predetermined period (step S202). When the period is not within the predetermined period (NO in step S202), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the period is within the predetermined period (YES in step S202), the server processor determines whether or not the terminal device 10 is present in the predetermined position (step S204).

When the terminal device 10 is not present at the predetermined position (NO in step S204), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. When the terminal device 10 is present at the predetermined position (YES in step S204), the server processor determines whether the sphygmomanometer 20 used for the measurement is the predetermined sphygmomanometer (step S206).

If the sphygmomanometer 20 is not the predetermined sphygmomanometer (NO in step S206), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. When sphygmomanometer 20 is a predetermined sphygmomanometer (YES in step S206), the server processor includes the characteristic information of the finger of the person to be measured included in the received captured image and the target information stored in the memory of server 30. It is determined whether the characteristic information of the finger of the measurer matches (step S208).

When these pieces of characteristic information do not match (NO in step S208), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. When these pieces of feature information match (YES in step S208), the server processor evaluates that the reliability of the measurement result is high (step S210), and ends the reliability evaluation process.

Again referring to FIG. 10, the server processor determines whether or not the reliability of the measurement result is evaluated to be low in the reliability evaluation processing (step S112). If the server processor evaluates that the reliability of the measurement result is low (YES in step S112), the server processor transmits an error notification to the terminal device 10 via the communication interface (step S114). When the server processor evaluates that the measurement result has high reliability (NO in step S112), the server processor stores the measurement result in the database 32 (step S116). Then, the server processor transmits a notification that the measurement result is normally stored in the database 32 to the terminal device 10 via the communication interface (step S118).

The terminal device 10 receives various notifications from the server 30 via the wireless communication unit 160 (or the communication interface 166) (step S120). The terminal device 10 displays various notifications on the display 158 (step S122) and ends the process. Note that the terminal device 10 may output various notifications by voice via the speaker 168.

<Advantages>
According to the present embodiment, the reliability of the measurement result transmitted from the terminal device 10 to the server 30 is evaluated, and when the reliability is evaluated to be low, an error notification is transmitted from the server 30 to the terminal device 10. .. As a result, the reliability of the measurement result stored in the server 30 can be secured, and the user can grasp the reliability of the measurement result in real time. As a result, for example, it is possible to reduce the possibility that the user may be overconfident in his or her own health condition, or may become too anxious about his or her health condition. In addition, a system in which the administrator of the server 30 gives the user of the terminal device 10 some kind of merit (for example, if the health condition is good, the medical insurance fee is reduced) is given to the user. If so, the system can be operated properly.

<Other Embodiments>
(1) In the above-described embodiment, the configuration in which the server 30 evaluates the reliability of the measurement result based on the four evaluation items E1 to E4 has been described, but the configuration is not limited thereto. For example, the server 30 may evaluate the reliability of the measurement result based on the temperature information included in the measurement result and the information indicating whether the cuff is properly wound. Specifically, the server 30 may determine that the reliability of the measurement result is low when the air temperature is lower than the predetermined temperature or when the cuff is not properly wound.

Furthermore, the reliability of the measurement result may be evaluated as follows. Specifically, the evaluation unit 254 of the server 30 determines that the difference between the measurement time Ta1 included in the measurement result of this time and the measurement time Ta2 included in the past measurement result (for example, the measurement result of yesterday) is within the predetermined time. (For example, within 5 minutes). For example, the evaluation unit 254 determines whether the measurement on one day and the measurement on another day are performed at substantially the same time. Further, the evaluation unit 254 determines whether or not the difference between the imaging time Tb1 included in the current measurement result and the imaging time Tb2 included in the past measurement result is within a predetermined time. For example, the evaluation unit 254 determines whether the imaging after the measurement on one day and the imaging after the measurement on another day are performed at substantially the same time.

The evaluation unit 254 also determines whether the sphygmomanometer X1 used in the current measurement and the sphygmomanometer X2 used in the past measurements are the same. The evaluation unit 254 makes the determination by, for example, comparing information (brand information, model, shape, etc.) extracted from the imaged image of the blood pressure monitor X1 with information extracted from the imaged image of the blood pressure monitor X2. ..

Then, the evaluation unit 254 determines that the difference between the measurement time Ta1 and the measurement time Ta2 is within a predetermined time, the difference between the imaging time Tb1 and the imaging time Tb2 is within a predetermined time, and the blood pressure monitor X1 and the blood pressure are equal to each other. It is determined whether or not the condition that the total X2 is the same is satisfied. If the evaluation unit 254 determines that the condition is satisfied, the evaluation unit 254 includes the measurement value M1 (either the maximum blood pressure value, the minimum blood pressure value, or the pulse rate) included in the measurement result of this time and the past measurement result. It is determined whether the difference between the measured value M2 and the measured value M2 is within a predetermined value.

When the evaluation unit 254 determines that the difference between the measured value M1 and the measured value M2 is not within the predetermined value, it evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits, to the terminal device 10, for example, as an error notification, a notification that calls attention to whether impersonation or the like has been performed. Alternatively, the server communication unit 252 transmits to the terminal device 10 a notification that it is necessary to pay attention to a health condition such as a change in physical condition and a symptom.

(2) In the above-described embodiment, it is possible to provide a program that causes a computer to function and execute the control described in the above-described flowchart. Such a program is recorded on a non-transitory computer-readable recording medium such as a flexible disk attached to a computer, a CD- ROM (Compact Disk Read Only Memory), a secondary storage device, a main storage device, and a memory card. It can also be provided as a program product. Alternatively, the program may be provided by being recorded in a recording medium such as a hard disk built in the computer. Further, the program can be provided by downloading via the network.

The program may be a program module that is provided as a part of an operating system (OS) of a computer and calls a necessary module in a predetermined arrangement at a predetermined timing to execute a process. In that case, the program itself does not include the above module, and the process is executed in cooperation with the OS. A program that does not include such a module may also be included in the program according to the present embodiment.

Further, the program according to the present embodiment may be provided by being incorporated in a part of another program. Even in that case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. A program incorporated in such another program may also be included in the program according to the present embodiment.

(3) The configuration illustrated as the above-described embodiment is an example of the configuration of the present invention, and can be combined with another known technique, and a part thereof is not deviated from the scope not departing from the gist of the present invention. It is also possible to change the configuration such as omitting it. Further, in the above-described embodiment, the processes and configurations described in the other embodiments may be appropriately adopted and implemented.

The embodiments disclosed this time are to be considered as illustrative in all points and not restrictive. The scope of the present invention is shown not by the above description but by the claims, and is intended to include meanings equivalent to the claims and all modifications within the scope.

1 Information Processing System, 10 Terminal Device, 20 Blood Pressure Monitor, 22 Main Body, 24,158 Display, 26 Forward/Back Button, 27 Lamp, 28 User Number Switch, 29 Stop Button, 30 Server, 32 Database, 40 Network, 152 Processor, 154 memory, 156 input device, 160 wireless communication unit, 162 communication antenna, 163 camera, 164 memory interface, 165 storage medium, 166 communication interface, 168 speaker, 170 microphone, 172 controller, 202 imaging unit, 204 display control unit , 206 detection unit, 208 position information acquisition unit, 210 terminal communication unit, 252 server communication unit, 254 evaluation unit.

Claims (5)

An information processing system comprising a sphygmomanometer, a terminal device, and a server configured to communicate with the terminal device,
The terminal device,
An imaging unit ,
From the image of the blood pressure monitor included in the captured image generated by the imaging unit, a detector for detecting the measurement results displayed on the display of the blood pressure monitor,
A terminal transmission unit for transmitting the measurement result to the server,
The server is
An evaluation unit that evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device,
When it is evaluated to be low reliability of the measurement results by the evaluation unit, viewed contains a server transmitter for transmitting error notification to the terminal device,
The measurement result includes a measurement date and time when the measurement was performed using the sphygmomanometer,
The terminal transmission unit further transmits the image capture date and time of the captured image to the server,
The evaluation unit calculates a period from the measurement date and time to the imaging date and time, and when the calculated period is not within a predetermined period, evaluates that the measurement result has low reliability,
The information processing system , wherein the server transmission unit transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device . The terminal device further includes a position information acquisition unit that acquires position information of the terminal device,
The terminal transmission unit further transmits the position information of the terminal device to the server,
The evaluation unit determines whether the terminal device exists at a predetermined position based on the received position information of the terminal device, and when the terminal device does not exist at the predetermined position, the evaluation unit determines whether the terminal device exists at the predetermined position. We evaluated that the reliability of the measurement results was low,
The information processing system according to claim 1, wherein the server transmission unit transmits, to the terminal device, an error notification indicating that the measurement location of the sphygmomanometer is different from the predetermined location. An information processing system comprising a sphygmomanometer, a terminal device, and a server configured to communicate with the terminal device,
The terminal device,
An imaging unit,
From the image of the sphygmomanometer included in the captured image generated by the imaging unit, a detection unit that detects the measurement result displayed on the display of the sphygmomanometer,
A terminal transmission unit for transmitting the measurement result to the server,
The server is
An evaluation unit that evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device,
When it is evaluated by the evaluation unit that the reliability of the measurement result is low, a server transmission unit that transmits an error notification to the terminal device is included,
The terminal transmission unit further transmits the captured image to the server,
Based on the received captured image, the evaluation unit determines whether the sphygmomanometer is a predetermined sphygmomanometer, and if the sphygmomanometer is not the predetermined sphygmomanometer, the measurement result is Evaluated as unreliable,
Said server transmitting unit, the blood pressure meter transmits an error notification that the non-predetermined sphygmomanometer to the terminal device, information processing system. The evaluation unit determines whether the sphygmomanometer is the predetermined sphygmomanometer based on at least one of the brand, shape, and model of the sphygmomanometer extracted from the received captured image. The information processing system according to claim 3 , wherein The captured image further includes a finger image of the measurement subject of the sphygmomanometer,
The evaluation unit extracts first characteristic information of a finger from a finger image of the measured person included in the captured image, and the first characteristic information and a finger of the measured person stored in advance in the server. It is determined whether or not the second feature information of the above-mentioned, and the first feature information and the second feature information do not match, it is evaluated that the reliability of the measurement result is low,
Said server transmitting unit, hand image of the measured person included in the captured image, an error notification is transmitted to the hand image of the measured person registered in advance different effect to the terminal device, according to claim 3 Or the information processing system according to 4 .