JP2015153102A - Ear-mounted device, ear-mounted device set, server, program, and information provision system - Google Patents

Abstract

[PROBLEMS] To maximize the user's physical condition that can be obtained in a multifaceted and accurate manner in a state convenient for the user.
An input unit (3) for detecting a user's physical state and responding to the user's physical state based on feedback information determined according to the physical state information indicating the user's physical state detected by the input unit A function execution unit (44) for executing the function to be performed.
[Selection] Figure 1

Description

  The present invention relates to an ear-mounted device, an ear-mounted device set, a server, a program, and an information providing system.

  As wearable computers that have already been put into practical use, there are glasses-type and watch-type wearable computers (see, for example, Patent Document 1). For such glasses-type and watch-type wearable computers, it is necessary for the user to turn his / her line of sight toward the computer during operation or to use his / her hand, which may interfere with the user's natural operations in daily life. was there.

  Therefore, as a result of diligent research, the present inventors have made an ear-mounted type that can be operated in an eye-free state (no need to look at the computer) and a hands-free state (no need to use a hand). Developed wearable computer.

JP 2013-243514 A (published December 5, 2013)

  Wearable computers of the type that are worn on the ear as described above are highly convenient and can be operated in an eye-free and hands-free state, as well as the physical condition of the user (body temperature, pulse, facial muscle movement due to coughing and sneezing) Etc.) can be detected multifacetedly and accurately. Although the body condition detected in many ways in this way has the potential to be applied to various services and applications, the conventional technology has not yet been fully utilized. was there.

  In view of the above-described conventional problems, the present invention provides an ear-worn device, an ear-worn device set, a server, and an ear-worn device that can make the most of the user's physical condition that can be obtained in a multifaceted and accurate manner in a highly convenient state for the user The object is to provide an information providing system and program.

  In order to solve the above-described problem, an ear-mounted device according to one aspect of the present invention is an ear-mounted device that is mounted on an ear, and includes a detection unit that detects a user's body condition, and the detection unit includes: Function execution means for executing a function corresponding to the physical condition of the user based on feedback information determined according to the detected physical condition information indicating the physical condition of the user.

  The ear-mounted device according to the present invention can detect the user's physical condition in a multifaceted and accurate manner by the detection means. Therefore, the functions executed by the function executing means can be varied and are appropriately matched to the user's physical condition according to the user's physical condition detected multifacetedly and accurately by the detecting means. Thereby, the user's physical condition that can be obtained in a multifaceted and accurate manner in a state that is highly convenient for the user can be utilized to the maximum extent.

It is a block diagram which shows an example of the principal part structure of the information provision system which concerns on one Embodiment of this invention. It is a figure which shows an example of the outline | summary of the ear mounting | wearing type apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows an example of a process of the information provision system which concerns on one Embodiment of this invention. It is a figure which shows an example of the state which inserted the ear canal input part in FIG. 1 in the user's ear canal. It is the graph which showed the data regarding a user's life rhythm. It is a flowchart which shows an example of the process of S22 in FIG. It is a flowchart which shows an example of a process of the information provision system which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the principal part structure of the ear wearing type set which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the process in the ear wearing type apparatus set which concerns on one Embodiment of this invention. The flowchart which shows an example of the process in which the body condition information which shows the user's physical condition which the ear-wearing apparatus which concerns on one Embodiment of this invention detected, and the feedback information determined based on a user's physical condition information are accumulate | stored It is. It is a block diagram which shows an example of the principal part structure of the information provision system for assisting a disabled person based on one Embodiment of this invention. It is a flowchart which shows an example of the process in which the information provision system which concerns on one Embodiment of this invention supports a disabled person.

  Hereinafter, embodiments of the present invention will be described in detail.

(Overview)
FIG. 2 is a diagram illustrating an example of an outline of the ear-mounted device 1 according to the embodiment of the present invention. FIG. 2A is a diagram illustrating an example of the appearance of the ear-mounted device 1. The ear-mounted device 1 shown in (a) of FIG. 2 is worn by the user so as to be hung on the user's right ear. The ear-worn device 1 includes an inner ear shell portion 11 and an outer ear shell portion 12. Between the ear shell inner part 11 and the ear shell outer part 12, an elastic member is provided for hanging on the user's ear. The ear shell inner part 11 is worn in a state of closing the opening of the user's ear canal. The ear shell outer part 12 is mounted in a state of being located on the back side of the user's ear shell.

  The ear shell inner part 11 and the ear shell outer part 12 may be decorated. For example, as shown in FIG. 2A, an artificial diamond 13 may be embedded, or a picture (not shown) representing a flower may be applied.

  Moreover, the shape of the ear-mounted device 1 shown in FIG. 2 (a) is a shape that uses a ball as a motif. In addition to this, as the shape of the ear-worn device 1, the ear shell inner portion 11 may have a shape imitating a cherry blossom, and the ear shell outer portion 12 may have a shape imitating a petal dancing from a full bloom cherry blossom (not shown). ).

  The ear-mounted device 1 may be mounted on one ear of the user, or may be mounted on both ears of the user. The ear-mounted device 1a shown in (b) of FIG. 2 has a shape that is mounted on the user's left ear.

  FIG. 2B is a diagram illustrating an example of a communication destination of the ear-mounted device. As shown in FIG. 2B, the ear-mounted device 1a can communicate with a plurality of external devices. For example, the ear-mounted device 1a communicates directly with the server 2, the external device 10, the ear-mounted device 1b, and other external devices. The server 2 that can communicate with the ear-worn device 1a can communicate with the external device 10, the external device 14 different from the external device 10, and a terminal of a third party organization. The external device 10 and the external device 14 are, for example, portable terminals (tablet terminals, smartphones, etc.) and personal computers.

  For example, when the user wearing the ear-worn device 1a is an elderly person, the family of the user who lives far away from the user refers to the information notified from the server 2 to the external device 14 owned by the user's family. By doing so, it is possible to know the state of the user. Also, for example, the server 2 that has acquired information indicating the state of the user wearing the ear-worn device 1a is a third party organization (family hospital, local government to which the user belongs, service organization that supports the user, etc. ), And the external device 14 owned by the civil welfare committee are notified of information indicating the state of the user, the service for supporting the user can be enhanced. Further, for example, the ear-mounted device 1a can also operate other external devices by communicating with other external devices (home appliances such as a television, electric vehicle, health device, etc.).

  For example, when the user wearing the ear-mounted device 1a carries the external device (mobile terminal) 10, communication between the ear-mounted device 1a and the external device (mobile terminal) 10 is performed by Bluetooth (registration). Trademark) or the like, and communication between the external device (mobile terminal) 10 and the server 2 may be performed by an existing communication method. Further, for example, when two different ear-mounted devices communicate with each other at a short distance, short-range wireless communication may be used. The communication method used is not particularly limited.

(Main components of the information provision system)
FIG. 1 is a block diagram showing an example of a main configuration of an information providing system A according to an embodiment of the present invention. As shown in FIG. 1, the information providing system A includes an ear-worn device 1 and a server 2. The ear-mounted device 1 and the server 2 can communicate with each other via an external device (portable terminal) 10. In the present embodiment, it is assumed that the user wearing the ear-mounted device 1a is carrying the external device (mobile terminal) 10. Note that, as described above, the communication destination of the ear-mounted device 1a is not limited to the external device (mobile terminal) 10. For example, when the user wearing the ear-worn device 1 does not carry the external device (mobile terminal) 10, the ear-worn device 1 and the server 2 may communicate directly.

  Moreover, although this embodiment demonstrates as what determines the feedback information according to the body state information which shows the body state of the user which the control part 8 of the server 2 detected by the ear mounting | wearing apparatus 1 is not limited to this. . That is, the function of the control unit 8 may be provided in the ear-worn device 1 or a communication destination (for example, a portable terminal) that can communicate with the ear-worn device 1 shown in FIG. May be provided.

(Essential configuration of ear-mounted device)
As shown in FIG. 1, the ear-worn device 1 includes an input unit (detection unit) 3, a control unit 4, a communication unit (transmission unit, reception unit) 5, and an output unit 6. The input unit 3 detects the physical state of the user, the control unit 4 executes a function corresponding to the physical state of the user detected by the input unit 3, and the output unit 6 outputs a function executed by the control unit 4.

  The input unit 3 includes various sensors that detect the user's physical condition. The input unit 3 includes an ear canal input unit 31 and an earshell input unit 32. The ear canal input unit 31 and the ear shell input unit 32 are respectively provided in the ear shell inner portion 11 and the ear shell outer portion 12 shown in FIG. The external auditory canal input unit 31 detects the user's physical condition from the user's external auditory canal (ear hole). Of the various sensors included in the input unit 3, a sensor that can detect the user's physical condition more accurately when detected from the user's external auditory canal is provided in the external auditory canal input unit 31.

  For example, when measuring the user's body temperature, it is more accurate to measure from inside the user's ear hole (ear canal) than to measure from outside the user's ear (ear shell). For example, when measuring the outside air temperature, it is more accurate to measure from outside the user's ear (ear shell) than to measure from inside the hole of the user's ear (ear canal).

  As shown in FIG. 1, the ear canal input unit 31 includes an optical distance sensor 31a, a pulse wave sensor 31b, and a body temperature sensor 31c. The optical distance sensor 31a detects the shape of the ear canal of the user wearing the ear-worn device 1. Details of the optical distance sensor 31a will be described later with reference to FIG. The pulse wave sensor 31b detects a user's pulse group. The body temperature sensor 31c detects a user's body temperature.

  The ear shell input unit 32 includes a microphone 32a, an acceleration sensor 32b, an outside air temperature sensor 32c, a GPS sensor 32d, an inclination sensor 32e, a geomagnetic sensor 32f, and an atmospheric pressure sensor 32g. The microphone 32a inputs a user's voice. The acceleration sensor 32b detects a user's movement. The outside air temperature sensor 32c detects the air temperature around the user. The GPS sensor 32d detects the position of the user by radio waves from an artificial satellite or the like. The inclination sensor 32e detects the inclination of the user. For example, an angular velocity sensor (Gyro sensor) can be used as the tilt sensor 32e. The geomagnetic sensor 32f detects the direction (azimuth) that the user is facing. The atmospheric pressure sensor 32g detects atmospheric pressure around the user.

  The control unit 4 includes an acquisition unit 41, an operation state determination unit (operation state determination unit) 42, a conversion unit (conversion unit) 43, and a function execution unit (function execution unit) 44. The acquisition unit 41 acquires physical state information indicating the physical state of the user detected by the input unit 3 from the input unit 3. Then, the acquisition unit 41 notifies the communication unit 5 of the acquired body state information. When the setting is made to determine whether or not the user's physical state detected by the input unit 3 is a state in which the user intended operation is performed, the acquisition unit 41 operates the acquired user's physical state information. The state determination unit 42 is notified.

  The operation state determination unit 42 determines whether the body state indicated by the body state information notified from the acquisition unit 41 is a state in which the user has performed an operation intended to execute the function by the function execution unit 44. . When the body state information notified from the acquisition unit 41 indicates that the user has performed the operation intended by the user, the operation state determination unit 42 displays operation information indicating that the operation intended by the user has been performed. The communication unit 5 is notified.

  The conversion unit 43 converts information notified from the communication unit 5 into a predetermined signal. The function execution unit 44 executes a function corresponding to the physical condition of the user based on the feedback information notified from the communication unit 5. Further, the function execution unit 44 executes a function corresponding to the signal converted by the conversion unit 43 based on the signal notified from the conversion unit 43. Then, the function execution unit 44 notifies the output unit 6.

  The output unit 6 includes a vibration unit 61, a speaker 62, and a bone conduction unit 63, and outputs a function executed by the function execution unit 44. For example, when the information notified from the function execution unit 44 indicates that the earclaw massage is performed, the vibration unit 61 applies vibration to a predetermined vase of the user's ear according to the information notified from the function execution unit 44. . When the information notified from the function execution unit 44 indicates sound, the speaker 62 converts the content of the information notified from the function execution unit 44 into sound and transmits the sound to the user. When it is set to transmit to the user using the bone conduction unit 63 instead of the speaker 62, the bone conduction unit 63 converts the content of the information notified from the function execution unit 44 into the bone conduction ultrasonic wave. Convert and communicate to the user.

  The communication unit 5 performs communication with various external devices that can communicate with the ear-worn device 1 (see FIG. 2B). In the example shown in FIG. 1, the communication unit 5 communicates with the server 2 via an external device (portable terminal) 10. For example, the communication unit 5 transmits body state information indicating the user's body state detected by the input unit 3 including the operation information determined by the operation state determination unit 42 to the server 2 via the external device 10. Further, the communication unit 5 receives feedback information determined according to the body state information notified by the ear-worn device 1 from the server 2 via the external device 10.

(Server configuration)
As shown in FIG. 1, the server 2 includes a communication unit (transmission unit, reception unit) 7, a control unit 8, and an information storage unit 9. The communication unit 7 communicates with various external devices that can communicate with the server 2 (see FIG. 2B). In the example shown in FIG. 1, communication with the ear-mounted device 1 is performed via an external device (mobile terminal) 10. For example, the communication unit 7 transmits the body state information indicating the user's body state detected by the ear-worn device 1 including the operation information determined by the ear-worn device 1 via the external device 10. Receive from 1. Further, the server 2 transmits feedback information determined according to the body condition information notified by the ear-mounted device 1 to the ear-mounted device 1 via the external device 10.

  The control unit 8 includes an analysis unit 81, an estimation unit (estimation unit) 82, and a feedback information determination unit (feedback information determination unit) 83. The analysis unit 81 acquires the body state information including the operation information received by the communication unit 7 and stores it in the information storage unit 9. The analysis unit 81 analyzes the user's physical condition from the accumulated information.

  The estimation unit 82 estimates the user's life rhythm based on the body state information acquired by the analysis unit 81, and accumulates the estimated user's life rhythm information in the information storage unit 9. Here, the user's life rhythm is information on the user's overall life including the user's meal time, the user's exercise time, the user's stress level, and the like. Moreover, when the estimation part 82 estimates a user's meal time further based on the estimated life rhythm, the meal time information which shows the estimated meal time is accumulate | stored in the information storage part 9. FIG. Note that the body state information stored in the information storage unit 9 may be used as information used for the estimation unit 82 to estimate.

  The feedback information determination unit 83 compares the user's life rhythm information estimated by the estimation unit 82 with the user's physical state information stored in the information storage unit 9, and determines feedback information according to the user's physical state information. To do. For example, when the current time indicates that it is within the meal time of the life rhythm information, and the user's physical condition information indicates that the meal is not being eaten, the user should be told that it is time to eat. Determine the feedback information to show. Then, the feedback information determination unit 83 notifies the communication unit 7 of the feedback information determined by the feedback information determination unit 83 and stores it in the information storage unit 9.

  The information storage unit 9 stores information notified from the control unit 8. The information storage unit 9 mainly includes body state information 91 acquired by the analysis unit 81, life rhythm information 92 and mealtime information 93 estimated by the estimation unit 82, and feedback information 94 determined by the feedback information determination unit 83. And are accumulated.

(Function execution processing based on the user's physical condition)
FIG. 3 is a flowchart illustrating an example of processing of the information providing system A. As shown in FIG. 3, the ear-worn device 1 performs a process of detecting a user's physical condition and a process of executing a function according to the user's physical condition information, and the server 2 is a user's physical condition information. The process of determining feedback information according to is performed.

  In the ear-mounted device 1, the input unit 3 detects the user's physical condition (S11). And the communication part 5 transmits the body state information which shows the user's physical state which the input part 3 detected to the server 2 via the external device (mobile terminal) 10 (S12).

  Next, in the server 2, the communication unit 7 receives the body state information indicating the body state of the user detected by the ear-mounted device 1 via the external device 10 (S21). Then, the analysis unit 81 or the estimation unit 82 analyzes the body condition information received by the communication unit 7 (S22). An example of S22 will be described in detail later with reference to FIG. After S22, the feedback information determination unit 83 determines feedback information according to the user's physical condition information (S23). After S23, the communication unit 7 transmits the feedback information determined by the feedback information determination unit 83 to the external device (for example, the ear-mounted device 1 via the external device 10) (S24).

  In the ear-mounted device 1, the communication unit 5 receives the feedback information determined by the server 2 via the external device 10 (S13). After S13, the function execution unit 44 executes a function based on the physical condition of the user according to the feedback information received by the communication unit 5 (S14).

Embodiment 1
In this embodiment, the user's life rhythm and meal time are estimated based on the movement of the ear canal of the user wearing the ear-worn device 1.

(Ear canal input part)
FIG. 4 is a diagram illustrating an example of a state in which the ear canal input unit 31 is inserted into the user's ear canal. As shown in FIG. 4, the optical distance sensor 31a emits light (for example, infrared rays) and receives light reflected by the user's ear canal and eardrum. For example, the optical distance sensor 31a is composed of a photo reflector, and the infrared ray used has a wavelength of about 940 nanometers.

  When the user into which the optical distance sensor 31a is inserted changes the facial expression, the user's external ear moves in conjunction with the facial expression of the user, and the shape of the ear canal and the position of the eardrum change. For this reason, the intensity of the reflected light received by the optical distance sensor 31a changes with the movement of the user's outer ear. That is, by using the change in the intensity of the reflected light, it is possible to detect the movement of the outer ear and estimate the facial expression. For example, it is possible to estimate the back teeth biting, whispering, blinking, eye movement, and the like.

  In the present embodiment, the movement of the outer ear is detected using the optical distance sensor 31a, the presence / absence of mastication by the user is determined, and the meal time of the user is estimated.

(rhythm of daily life)
FIG. 5 is a graph showing data related to a user's life rhythm. (A) in FIG.
It is a graph which shows an example of a time change about the voltage value of signal a which optical distance sensor 31a measured. As shown in FIG. 5A, the optical distance sensor 31a measures the movement of the outer ear every predetermined time (for example, 1/10 second).

  For example, when there is no large change (for example, mastication) in the facial expression of the user, the movement of the user's outer ear is small, so that the voltage difference is similar to the voltage difference between the point a1 at t = 1 and the point a2 at t = 2. The difference is small. Further, when there is a large change in the facial expression of the user, the movement of the user's outer ear is large, and thus the voltage difference is large, such as the voltage difference between the point a2 at t = 2 and the point a3 at t = 3. The predetermined time measured by the optical distance sensor 31a is determined by, for example, a PIC (Peripheral Interface Controller) (not shown) provided in the ear-worn device 1. When the PIC is used, the measurement interval may vary, so there may be nine measurements per second.

  (B) of Drawing 5 is a figure showing an example of a time change about a user's life rhythm. The values of the life features shown in the figure (hereinafter referred to as life feature amounts) are calculated every 5 minutes based on the measurement data shown in FIG. 5A and measured by the optical distance sensor 31a. It is a value obtained by adding the average value and the variance of the measurement data. A detailed method for calculating the life feature will be described later with reference to FIG.

  The data shown in (b) of FIG. 5 is data obtained by adding the life feature amounts for seven consecutive days at the same time. The life rhythm of the user can be estimated from the data shown in the figure. For example, at time 12:10 to 12:30 of time 11:00 to 13:00, a high value having a significant difference from the value of the life feature value in other time zones is shown, so time 12:10 It is estimated that the user is chewing at ˜12: 30. Further, the strength of the user's mastication is estimated from the value of the life feature value.

  Further, the data obtained by adding the life feature amounts as shown in FIG. 5B may be data obtained by adding the life feature amounts of different days at the same time. For example, in the case of a user whose meal time is different for each day of the week, the life feature values for the same day may be added. In addition, the daily life feature amounts of consecutive days in a predetermined period may be added together, or the daily life feature amounts of different days in the same season may be added up. Thus, the life rhythm of the user can be estimated more accurately by adding the life feature amounts of different days at the same time according to the life of the user.

  (C) of FIG. 5 is a figure which shows an example of the user's meal time estimated from the life rhythm. The meal time shown in the figure is calculated based on the life feature amount shown in FIG. A detailed meal time calculation method will be described later with reference to FIG. As shown in (c) of FIG. 5, the user is eating at the time 12:11 to 12:30 when the value of the meal data is 1 in the time 11:00 to 13:00. Presumed. For example, the meal time for seven consecutive days is estimated to be 12: 11-12: 30.

  (D) of FIG. 5 is a figure which shows an example of the average of the time when the user whose meal time was estimated in (c) of FIG. For example, during the time 12:12 to 12:26 shown in the figure, the user actually ate on the day (seven consecutive days) used for the addition of the life feature values in FIG. 5B. Shows the average of time.

(Meal time estimation process)
FIG. 6 is a flowchart showing an example of the process of S22 in FIG. This process is a process for estimating the user's life rhythm (see FIG. 5B) and the user's meal time (see FIG. 5C) based on the measurement data detected by the optical distance sensor 31a. (Analysis processing). The analysis process will be described as a setting performed on the server 2 (see FIG. 1) side, but may be a setting performed on the ear-mounted device 1 (see FIG. 1) side, or an external device 10 (for example, It is good also as a setting performed by the portable terminal side.

As shown in FIG. 6, the estimation unit 82 acquires measurement data A _i (i = 1, 2, 3,...) For a predetermined period measured by the optical distance sensor 31a (S101). For example, in the case of FIG. 5, the estimation unit 82 acquires the measurement data A _i measured from 11:00 to 13:00 in one week. Note that the measurement data A _i may be acquired every time the optical distance sensor 31a performs measurement, may be acquired in batches on a daily basis, or may be acquired in batches every predetermined time. Good. Further, the measurement data A _i acquired by the estimation unit 82 may be stored in the information storage unit 9 as arbitrary body timing information. In the following description, the measurement data A _i is assumed to be measurement data for one day.

Next, the estimation unit 82 extracts a measurement value A _i that satisfies the following expression (1) (S102).
S ₁ <A _i <S ₂ (1)
However, S ₁ is a threshold value obtained by multiplying the average value of A _i by 0.7, and S ₂ is a threshold value obtained by multiplying the average value of A _i by 1.3.

Then, the estimation unit 82 sets the measurement values A _i extracted in S102 as the extraction values B _j (j = 1, 2, 3,...) In the order of the measured times (S103).

After S103, the estimation unit 82 calculates the change amount C _k (k = j−1) of the extracted value B _j based on the equation (2) (S104).
C _k = | B _{j + 1} −B _j | Expression (2)
After S104, the estimation unit 82 uses the change amount C _k calculated in S104 to calculate the equation (3) from the change amount C _k calculated from the value A _i measured within a predetermined time (for example, 5 minutes). ) on the basis to calculate the life characteristic quantity _{D l} (S105).

・・・式（３）
Ｓ１０５の後、推定部８２は、Ｓ１０５にて算出した生活特徴量Ｄ_ｌと、異なる日の生活特徴量Ｄ_ｌとを、同時刻について足し合わせ、生活リズムデータＥ_ｌを算出する（Ｓ１０６）。そして、推定部８２は、生活リズムＥ_ｌについてグラフを作成する（Ｓ１０７）。例えば、図５の（ｂ）は、１週間分の生活特徴量Ｄ_ｌを足し合わせることにより算出した生活リズムＥ_ｌについて時間変化を示すグラフである。なお、推定部８２が推定した生活リズムＥ_ｌを示す生活リズム情報は、任意のタイミングで情報蓄積部９に蓄積される。

... Formula (3)
After S105, estimation unit 82, a life characteristic quantity _{D l} calculated in S105, and a life characteristic quantity _{D l} different days, the sum for the same time, calculates the life rhythm data _{E l} (S106). The estimation unit 82 generates a graph for life rhythm _{E l} (S107). For example, (b) of FIG. 5 is a graph showing a time change for the life rhythm E _l calculated by adding the life feature amounts D _l for one week. The life rhythm information indicating the life rhythm _El estimated by the estimation unit 82 is accumulated in the information accumulation unit 9 at an arbitrary timing.

Then, the estimation unit 82, life rhythm data _{E l} is whether satisfies the following formula (4), determines for each value _{E l} (S108). For example, in the case of FIG. 5B, determination is made for each value calculated in units of 5 minutes.
T <E _l Formula (4)
However, T is, the minimum value minus the life rhythm data E life rhythm data E _l from the maximum value of _l, the threshold value multiplied by 0.5.

If YES in S108, the estimation unit 82 sets E _l as meal data F _l = 1 (S109). If NO in S108, the estimation unit 82 sets E _l as meal data F _l = 0. (S110). And the estimation part 82 produces a graph about the change of the meal data _Fl within a predetermined period (S111), and estimates a user's meal time from the graph produced in S111 (S112).

  For example, (c) of FIG. 5 is a graph showing the time change of the meal time of the user in one week created in S111. From the graph shown in (c) of FIG. Is estimated to be 12: 11-12: 30. The meal time information indicating the meal time estimated by the estimation unit 82 is stored in the information storage unit 9 at an arbitrary timing.

  When the meal times shown in FIG. 5C and FIG. 5D are compared, the error between the estimated meal time and the actual meal time is small. This is because, when the user wearing the ear-worn device 1 is eating at regular times, as shown in FIG. This is because a high value having a significant difference from the value (0.05) of the life feature value in other time zones is shown in the time (12:05 to 12:35). For this reason, when the user wearing the ear-worn device 1 eats at regular times, it is possible to estimate the meal time of the user almost accurately based on the movement of the user's outer ear.

  In addition, when the user wearing the ear-worn device 1 does not eat at regular times, the time zone in which a high life feature value is displayed as shown in FIG. It may not be possible to estimate accurately. In this case, the estimation unit 82 can estimate that the user does not eat at regular times.

[Embodiment 2]
Another embodiment of the present invention will be described below with reference to FIGS. 11 and 12. For convenience of explanation, members having the same functions as those described in the above embodiment are denoted by the same reference numerals and description thereof is omitted.

  This embodiment is an example of a service provided based on data acquired by the ear-worn device 1. The following description is divided into a health care service, an entertainment service, a life information service, and an information providing service to a third party organization. In addition, although it is assumed that the service to be provided is provided from the server 2, the service is not limited to the service from the server 2, and communicates with the ear-worn device 1 shown in FIG. It may be a service from a possible communication destination.

(Example 1: Healthcare service)
The present embodiment is a health care service provided as a function corresponding to the physical state of a user wearing the ear-mounted device 1 based on data detected by various sensors provided in the ear-mounted device 1. Health care services described below include nutritional guidance, physical condition management, disease prevention, stress relief and sports support.

<Nutrition guidance>
Nutritional guidance is a service that is useful for dieting of users. For example, the server 2 estimates the user's meal time and the intensity of mastication from the data detected by the optical distance sensor 31a of the ear-worn device 1, calculates the user's intake calories from the estimated results, and relates to nutrition Determine feedback information.

  More specifically, when the intake calorie calculated by the server 2 is higher than the user's normal intake calorie, the server 2 indicates to the user that it is better not to eat too much. Information is determined as feedback information. Then, based on the feedback information determined by the server 2, the ear-mounted device 1 uses the speaker 62 to communicate to the user that “It is better not to eat too much”. In addition, when the meal time estimated by the server 2 is shorter than the user's normal meal time, the server 2 determines information to be transmitted to the user as “please chew and eat” as feedback information. . Then, based on the feedback information determined by the server 2, the ear-worn device 1 uses the speaker 62 to communicate to the user that “please chew well”.

<Physical condition management>
Physical condition management is a service for maintaining that the user's physical condition is good. For example, the server 2 estimates a change in the physical condition of the user from data detected by the pulse wave sensor 31b, the body temperature sensor 31c, and the outside air temperature sensor 32c of the ear-worn device 1, and determines feedback information related to the physical condition.

  More specifically, when the data detected by the ear-mounted device 1 indicates that the temperature around the user is high, the user's body temperature is high, and the user's pulse wave is fast, the server 2 indicates that the user is in a heat stroke state. The information indicating that the user needs to take moisture is transmitted as feedback information. Further, when the change in the physical condition estimated by the server 2 is an increase in the user's body temperature, the server 2 estimates that the user has started to catch a cold, and communicates to the user such as “Let's be warm”. The information to be shown is determined as feedback information. Further, when the data detected by the ear-worn device 1 is the basal body temperature of the woman, the server 2 determines feedback information specific to the physiological phenomenon of the woman.

<Disease prevention>
Disease prevention is a service for preventing the occurrence of a disorder in various functions of the user's body. For example, when the server 2 estimates that the user has a symptom such as rheumatism, neuralgia, or bronchitis, information indicating a massage that stimulates an earlobe corresponding to various symptoms is determined as feedback information. Then, the vibration unit 61 of the ear-mounted device 1 stimulates the user's ear based on the feedback information determined by the server 2.

  Further, for example, the server 2 analyzes symptoms such as whether the user is snoring during sleep from the data detected by the microphone 32a of the ear-worn device 1, and the user is in a sleep apnea syndrome state. Estimate whether or not there is. When the server 2 estimates that the user is in sleep apnea syndrome, when the ear-mounted device 1 detects the user's snoring, the server 2 starts a massage that stimulates the user's ear. Is determined as feedback information. Next, the vibration unit 61 of the ear-worn device 1 stimulates the user's ear based on the feedback information determined by the server 2. By giving an unexpected stimulus to the sleeping user's ear, the sleeping user is expected to change the direction of the neck unconsciously. For this reason, the sleeping user can unconsciously secure the airway and prevent the sleepless user's apnea state.

<Relieving stress>
Stress relief is a service that reduces stress that adversely affects the mind and body of the user. For example, the server 2 estimates the degree of stress of the user from the data detected by the pulse wave sensor 31b of the ear-worn device 1. When the degree of stress estimated by the server 2 is such that the user's mind and body are adversely affected, the server 2 determines information indicating that distribution of classical music having a healing effect is started as feedback information.

<Sport support>
Sports support is a service provided while a user is exercising. For example, the server 2 indicates that the user's walking or running pace is estimated from data detected by the GPS sensor 32d of the ear-worn device 1, and advice corresponding to the estimated pace is transmitted to the user by voice. Determine feedback information.

  Further, for example, when the user has a mountain climbing hobby, the server 2 determines that the user is in a hypothermic or altitude sickness state from data detected by the pulse wave sensor 31b, the GPS sensor 32d, and the atmospheric pressure sensor 32g of the ear-worn device 1. Whether or not the feedback information is determined. Further, when the user is distressed during mountain climbing, the server 2 estimates the position information of the user from the data detected by the GPS sensor 32d and the atmospheric pressure sensor 32g of the ear-worn device 1, and the third party heads for rescue. Provide user location information to institutions. Until the distressed user is rescued, the server 2 may determine, as feedback information, information indicating that a voice is transmitted to the user such as “Now, rescue is coming. Good luck!”.

  Further, for example, when the user has a hobby such as locomotive gymnastics, tai chi or yoga, the server 2 uses the data detected by the acceleration sensor 32b and the tilt sensor 32e of the ear-worn device 1 so that the user takes an appropriate pose or balance. Whether or not a certain state is present is estimated, and information for transmitting advice to the user so that the user can maintain an appropriate pose or balance is determined as feedback information. Further, the server 2 may assign a score indicating how appropriate the pause or balance performed by the user is, and may determine feedback information according to the score.

(Example 2: Entertainment service)
In this embodiment, in the case of setting to determine whether or not the user's physical state detected by the ear-mounted device 1 is a state in which an operation intended by the user is performed, the user wearing the ear-mounted device 1 It is an entertainment service provided as a function corresponding to the intended operation. The entertainment care services described below include music distribution, music guidance, search functions, volume control, tourist guides, event guides and advisory services.

(Function execution processing by user operation)
FIG. 7 is a flowchart illustrating an example of processing of the information providing system A. As shown in FIG. 7, the ear-worn device 1 performs a process of detecting a user's physical condition and a process of executing a function according to an operation intended by the user, and the server 2 performs an operation intended by the user. The process of determining feedback information corresponding to the operation information indicating is performed.

  In the ear-mounted device 1, the input unit 3 detects the user's physical condition (S31). Then, the operation state determination unit 42 determines whether the user's physical state detected by the input unit 3 is a state in which the user has performed an operation intended to execute the function by the function execution unit 44 (S32). . In the case of YES in S32, the communication unit 5 transmits the body state information indicating the user's body state detected by the input unit 3 including the operation information determined in S32 via the external device (mobile terminal) 10. It transmits to the server 2 (S33). On the other hand, if NO at S32, the processing from S31 is repeated.

  Here, it is assumed that the operation information is set in advance as to what operation state of the user indicates. For example, when the input unit 3 detects the bite of the user's back teeth, the operation state determination unit 42 determines that the body state information indicating the bite of the user's back teeth is operation information indicating YES. For example, when the input unit 3 detects the user's swing, the operation state determination unit 42 determines that the body state information indicating the user's swing is operation information indicating NO. For example, when the input unit 3 detects a user's blink, the operation state determination unit 42 determines that the body state information indicating the user's blink is operation information indicating the start of a service provided from the server 2. .

  Next, in the server 2, the communication unit 7 transmits the body state information indicating the user's body state detected by the ear-mounted device 1, including the operation information determined by the ear-mounted device 1, via the external device 10. Receive (S41). Then, the analysis unit 81 or the estimation unit 82 analyzes the body state information including the operation information determined in S32 received by the communication unit 7 (S42). After S42, the feedback information determination unit 83 determines feedback information according to the operation information and the user's physical condition information (S43). After S43, the communication unit 7 transmits the feedback information determined by the feedback information determination unit 83 to the external device (for example, the ear-mounted device 1 via the external device 10) (S44).

  In the ear-worn device 1, the communication unit 5 receives the feedback information determined by the server 2 via the external device 10 (S34). After S34, the function execution unit 44 executes a function based on the physical condition of the user according to the feedback information received by the communication unit 5 (S35).

<Music distribution>
Music distribution is a service that distributes music to users in accordance with user operations. For example, when the life rhythm information indicates that the current time is the user's commuting time, the server 2 estimates that the user is bored and transmits information to the user such as “Listen to music?” Are determined as feedback information. When the ear-worn device 1 detects a user's whisper, blink, or voice instruction, the ear-wearable device 1 determines that the user is in a physical state that has performed an operation intended to execute the function, and includes physical state information including operation information. Is transmitted to the server 2 via the external device 10. It is assumed that whether the operation information is in a state indicating YES or NO is set in advance.

  Next, when the operation information indicates a state of YES, the server 2 determines, as feedback information, information indicating that music corresponding to the user's physical condition is to be distributed to the user. More specifically, when the body state information indicates that the user's feelings are elevated, the server 2 may determine information indicating that up-tempo music is distributed to the user as feedback information. . On the other hand, when the operation information indicates NO, information to be transmitted to the user such as “Okay, listen to the latest news?” May be determined as feedback information.

<Music instruction>
Music guidance is a service provided when a user plays music. For example, assume that the user is singing. The server 2 analyzes which pitch the user's voice data detected by the ear-worn device 1 indicates, and asks the user that “the voice is low at the chorus. It was perfect yesterday.” Information indicating transmission by voice is determined as feedback information. Further, for example, a case where the user performs tuning of a musical instrument is assumed. The server 2 analyzes which pitch the sound data of the musical instrument detected by the ear-worn device 1 indicates, and provides feedback information indicating that advice that allows the user to be tuned correctly is transmitted to the user by voice. To decide. With such a configuration, the burden of tuning work is reduced for a user who has no absolute pitch.

<Search function>
The search function is a service in which a user searches for desired information in accordance with a user operation. For example, when the life rhythm information indicates that the current time is the user's meal time zone, the server 2 voices to the user, “Where do you eat today's meal? The feedback information indicating that it is transmitted in is determined. When the server 2 receives the user operation information indicating the YES state, the server 2 detects the shop and provides feedback information indicating that the listed shop name is transmitted to the user by voice. decide. Furthermore, when the server 2 receives user operation information indicating a YES state, the server 2 makes a reservation for a store desired by the user.

  The stores listed by the server 2 may be estimated for the user's favorite stores based on various information stored in the information storage unit 9 of the server 2, and the user's health condition is good. It may be estimated about the store to keep things. In addition to searching for a restaurant for a restaurant, a store for a shopping may be searched, or when the user is traveling, a service for searching for a place for sightseeing by the user may be used.

<Volume control>
The volume control is a service for adjusting the volume of an external device communicating with the ear-mounted device 1 worn by the user. For example, when the user is listening to the sound of the TV (external device) from the ear-mounted device 1 while doing housework, the volume of the TV may be adjusted according to the operation information of the user. In addition to volume adjustment, an external device such as a TV may be operated in accordance with user operation information. That is, the ear-mounted device 1 may have a role of a conventional remote control.

<Tourist / Event Guide>
The tourist guide / event guide is a service that provides guidance on the land where the user is sightseeing or the event in which the user is participating. For example, when the user is sightseeing, the server 2 provides the user with the content of the information on the land that the user is sightseeing (information published in a tourism magazine, etc.) by voice according to the user's operation information. Feedback information indicating transmission is determined. In addition, for example, when a user is viewing a painting at a museum, the content of the information that the user is viewing (the author of the painting, a general evaluation of the painting, etc.) is displayed according to the user's operation information. The feedback information indicating that it is transmitted by voice is determined. Further, for example, when the user looks up at the sky while looking up at the sky, the server 2 determines feedback information indicating that the content of the information of the constellation in the direction in which the user is looking is transmitted to the user by voice.

  For this reason, even if the user has not learned in advance, the service which provides the knowledge which a user desires in real time is attained.

<Advice service>
The advice service is a service that provides words that resonate with the user's heart in accordance with the user's emotions using the user's favorite voice. For example, when the user's physical condition information indicates that the user has a sad feeling, the server 2 transmits to the user with the voice of the person who most touches the user, such as “I will heal you”. The information to be shown is determined as feedback information.

(Example 3: Life information service)
The present embodiment is a life information service provided as a function corresponding to the physical state of a user wearing the ear-mounted device 1 based on data detected by a sensor provided in the ear-mounted device 1. The life information service described below includes an automatic distribution service, a translation function service, and an event management service.

<Automatic distribution service>
The automatic distribution service is a service that distributes useful information related to the overall life of the user. For example, when the user intends to use the bus, the server 2 determines the bus stop nearest to the user and the bus operation time available to the user from the user's physical condition information including the GPS sensor information. The feedback information indicating that it is transmitted by voice is determined. Further, for example, the server 2 determines feedback information indicating that the weather information of the land where the user is located and the latest news and the like are transmitted to the user by voice.

<Translation function service>
The translation function service is a service that provides translated content to a user wearing the ear-worn device 1. For example, when the language used by the user wearing the ear-worn device 1 is different from the language used by a person who has a conversation with the user, the server 2 is a person who has a conversation with the user about the contents spoken by the user. Is translated using the language used, and feedback information indicating that the translated content is transmitted to a person who speaks with the user by voice is determined. In addition, the server 2 determines the feedback information indicating that the content spoken by the person who has a conversation with the user is translated using the language used by the user, and the translated content is transmitted to the user by voice.

  Therefore, the user can talk in real time with a person who uses a language that the user does not know without learning a language that the user does not know.

<Event management service>
The event management service is a service that assists the exchange of members when the members manage events in a preset group. For example, it can also be used as a substitute for a headset (commonly known as an income) in which a microphone is attached to headphones used for theatre, dance, presentation, announcement, and the like. Two ear-mounted devices used as income are referred to as an ear-mounted device set. Hereinafter, the ear-mounted device set will be described with reference to FIGS.

(Ear-mounted device set)
FIG. 8 is a block diagram illustrating an example of a main configuration of an ear-mounted set. As shown in FIG. 8, the first ear-mounted device 1a and the second ear-mounted device 1b can directly communicate with each other. Each of the first ear-worn device 1a and the second ear-worn device 1b is worn by different users.

  In the second ear-mounted device 1b, the input unit 3b detects the physical state of the user wearing the second ear-mounted device 1b. The acquisition unit 41b of the control unit 4b acquires body state information indicating the user's body state detected by the input unit 3b. The operation state determination unit 42b of the control unit 4b is configured so that the body state information acquired by the acquisition unit 41b performs an operation intended to execute a function by the function execution unit 44 by the user wearing the second ear-mounted device 1b. It is determined whether or not it is in the state. When the body state information acquired by the acquisition unit 41b indicates that the user has performed an operation intended by the user, the operation state determination unit 42b displays the body state information indicating that the operation intended by the user has been performed. The communication unit 5b is notified. The communication unit 5b transmits body state information indicating that an operation intended by the user wearing the second ear-worn device 1b has been performed to the first ear-worn device 1a.

  In the first ear wearable device 1a, the communication unit 5a receives the body condition information determined by the second ear wearable device 1b from the second ear wearable device 1b. The conversion unit 43a of the control unit 4a converts the body condition information received by the communication unit 5a into a predetermined signal. The function execution unit 44a of the control unit 4a executes a function corresponding to the signal converted by the conversion unit 43a based on the signal converted by the conversion unit 43a. The output unit 6a performs a predetermined output in accordance with a signal notified from the function execution unit 44a.

(Function execution processing of ear-mounted device set)
FIG. 9 is a flowchart illustrating an example of processing in the ear-worn device set. As shown in FIG. 9, in the second ear-mounted device 1b, the input unit 3b detects the physical state of the user wearing the second ear-mounted device 1b (S51). In the operation state determination unit 42b, the body state information acquired by the acquisition unit 41b is a state in which the user wearing the second ear-worn device 1b performs an operation intended to execute the function by the function execution unit 44. It is determined whether or not (S52). In the case of YES in S52, the communication unit 5b transmits body state information indicating that the user wearing the second ear-worn device 1b has performed an operation intended to the first ear-worn device 1a. (S53).

  Next, in the first ear-mounted device 1a, the communication unit 5a receives the body condition information determined by the second ear-mounted device 1b from the second ear-mounted device 1b (S61). Then, the control unit 4a analyzes the body state information received by the communication unit 5a (S62). After S62, the conversion unit 43a converts the body condition information received by the communication unit 5a into a predetermined signal (S63). After S63, the function execution unit 44a executes a function corresponding to the signal converted by the conversion unit 43a (S63).

  For example, when a user wearing the second ear-worn device 1b crawls, the first ear-worn device 1a prompts the user wearing the first ear-worn device 1a to “illuminate the stage well”. Communicate with etc. Note that the processing in the ear-worn device set is not limited to the processing performed by the first ear-worn device 1a and the second ear-worn device 1b separately, and the same processing can be performed. To do.

(Example 4: Information service to each organization)
The present embodiment is a service that provides information to each organization based on data detected by a sensor provided in the ear-worn device 1. Data provided to each organization shall be provided in a format that protects personal information.

  As described above with reference to FIG. 2B, the ear-mounted device 1a can communicate with various external devices. For this reason, the body state information indicating the body state of the user detected by the ear-mounted device 1a is accumulated in the server 2, for example. The server 2 stores information related to the physical states of a plurality of users, and the server 2 can provide the stored information to a third party organization.

(Information accumulation process)
FIG. 10 is a flowchart illustrating an example of processing in which physical state information indicating the physical state of the user detected by the ear-mounted device 1 and feedback information determined based on the physical state information of the user are accumulated.

  As shown in FIG. 10, in the ear-mounted device 1, the input unit 3 detects the user's physical condition (S71). And the communication part 5 transmits the body state information which shows the user's physical state which the input part 3 detected to the server 2 via the external device (mobile terminal) 10 (S72).

  Next, in the server 2, the communication unit 7 receives the body state information indicating the body state of the user detected by the ear-mounted device 1 via the external device 10 (S81). And the analysis part 81 accumulate | stores the physical condition information which the communication part 7 received in the information storage part 9 (S82). Further, the analysis unit 81 or the estimation unit 82 analyzes the body state information received by the communication unit 7 (S83), and stores the analyzed information in the information storage unit 9. The feedback information determination unit 83 determines feedback information according to the user's physical condition information (S84). After S84, the feedback information determination unit 83 stores the determined feedback information in the information storage unit 9 (S85). Note that the processing of S82, S83, and S84 may be performed in any order.

<Information provision example 1>
For example, when the user is an elderly person, the operator of the information providing service that uses the server 2 uses the information storage unit 9 of the server 2 to provide the user's physical condition information to a third party organization such as a hospital. Thereby, the hospital provided with the information regarding the user's physical condition can manage the user's health without performing the user's inquiry.

  In addition, for example, when an experimental drug is administered to the user, the operator of the information providing service using the server 2 sends the experimental drug to a third-party organization such as a pharmaceutical company or a university that is testing the drug. Information stored in the information storage unit 9 of the server 2 is provided as information on the physical condition of the user who has been administered. As a result, a third-party organization such as a pharmaceutical company or a university that has been provided with information on the physical condition of the user acquires more detailed experimental data of the user without restricting the user, and improves the drug at the experimental stage. be able to.

<Information provision example 2>
For example, an operator of an information providing service using the server 2 may provide information regarding the physical condition of an elderly person who is a user to various administrative institutions. Thereby, the administrative institution can manage the physical condition of the elderly person wearing the ear-worn device. In addition, the administrative organization can be used to implement a town planning that makes it easy for elderly people wearing ear-mounted devices to live. Note that the information provided from the server 2 to the administrative institution does not have to be limited to information acquired from the elderly. For example, it may be information regarding the physical condition of all users wearing ear-mounted devices. Thereby, the administrative institution can estimate the area where influenza etc. is prevalent and can issue an influenza prevention warning.

<Information provision example 3>
For example, when music is distributed to a user wearing an ear-worn device, physical state information indicating the physical state of the user who is listening to the distributed music is stored in the information storage unit 9. Then, from the music distributed by the server 2 and the physical condition information (body temperature, pulse, etc.) of the user who has listened to the distributed music, the server 2 analyzes how much the user's mood is enhanced in which music. . Furthermore, the server 2 estimates the music evaluation for each user (the degree of user's preference for the distributed music, which is determined from the user's physical condition) from the analysis result of the server 2. The server 2 may create information indicating a music evaluation according to the age of the user from the music evaluations of a plurality of users, and provide the created information indicating the music evaluation according to the age of the user to the music distribution service business. .

  Thereby, a third party organization such as a music distribution service business can grasp the impression that the user cannot make words, and can utilize it for business development.

[Embodiment 3]
Another embodiment of the present invention will be described below with reference to FIGS. 11 and 12. For convenience of explanation, members having the same functions as those described in the above embodiment are denoted by the same reference numerals and description thereof is omitted. This embodiment is a service for supporting a person with a disability who has some kind of disorder in the function of a body organ. In the following, a service for a visually handicapped person will be described. However, a service for a handicapped person (for example, a hearing handicapped person) having a disability in a function other than vision may be used.

(Configuration of essential parts of information provision system for people with disabilities)
FIG. 11 is a block diagram illustrating an example of a main configuration of an information providing system for supporting a person with a disability according to an embodiment of the present invention. In the present embodiment, the server 2a determines feedback information corresponding to the body state information based on the body state information indicating the body state of the user detected from the ear-mounted device 1. Then, an external device 10a (for example, a self-propelled device such as a robot or an information distribution device installed in a hospital or the like) for supporting a user wearing the ear-mounted device 1 and the ear-mounted device 1 It is assumed that at least one of them executes a function corresponding to the user's physical condition based on the feedback information determined by the server 2. It is assumed that the external device 10a is arranged in advance near the user.

  As shown in FIG. 11, the information providing system A 'includes an ear-worn device 1 and a server 2a. The ear-mounted device 1 can communicate with the server 2 a via an external device (portable terminal) 10. The communication destination with the information providing system A ′ is not limited to the example shown in FIG. 11, and the communication destination shown in (b) of FIG. 2 may be used.

  The server 2a includes a communication unit 7, a control unit 8a, and an information storage unit 9a. The control unit 8a includes an analysis unit 81, an estimation unit 82, and a feedback information determination unit 83a. When the user wearing the ear-worn device 1 is a person with a disability, the feedback information determination unit 83a determines feedback information for ensuring user safety according to the user's physical condition information. Then, the feedback information determination unit 83a notifies the communication unit 7 of the feedback information determined by the feedback information determination unit 83a and stores it in the information storage unit 9a. The information storage unit 9a stores information notified from the control unit 8a. The information storage unit 9 mainly includes body state information 91 acquired by the analysis unit 81, life rhythm information 92 and mealtime information 93 estimated by the estimation unit 82, and feedback information 94a determined by the feedback information determination unit 83a. And are accumulated.

  The external device (robot) 10a can communicate with at least one of the ear-mounted device 1, the external device (mobile terminal) 10, and the server 2a. When the external device 10a is arranged near the user wearing the ear-worn device 1, the external device 10a moves near the user and provides a service for ensuring the safety of the user.

(Function execution processing based on the physical condition of persons with disabilities)
FIG. 12 is a flowchart illustrating an example of processing in which the information providing system A ′ supports a person with a disability. As shown in FIG. 12, the ear-worn device 1 performs the processes of S11 to S14 described above with reference to FIG. The server 2a performs the processes of S21 to S24 described above with reference to FIG. The external device 10a (robot) performs support processing for ensuring the safety of a user who is a disabled person.

  The external device 10a (robot) receives, as support information, information indicating a function that the external device 10a should perform in order to support the user among the feedback information determined by the server 2a (S91). Then, the external device 10a executes a support function based on the user's physical condition according to the received support information (S92).

  For example, when the user is a visually impaired person, the feedback information determined in S23 in the server 2a is information indicating that the ear-worn type device 1 is used to convey to the user by voice that "there is a stairs ahead" , And information indicating that the external device 10a supports the user so that the user does not fall on the stairs. In S14 of the ear-mounted device 1, the speaker 62 transmits to the user that “there is a staircase ahead” based on the feedback information determined in S23. In S92 of the external device 10a, the external device 10a moves closer to the user based on the feedback information determined in S23, and assists the user not to fall on the stairs in front of the user.

  Further, for example, when the user is a hearing impaired person, the bone conduction unit 63 may be set to be used without using the speaker 62 of the ear-worn device 1.

  Furthermore, the following functions are also assumed as functions based on the user's physical condition executed by the ear-mounted device 1 and the external device 10a. That is, as a result of analyzing the body condition information in S22, if it is estimated that the user's meal time is approaching, the ear-mounted device 1 will say "It is almost time for meals. Also, the right elevator is safe and convenient for the cafeteria. The robot will be coming soon. " Furthermore, the external device 10a may move near the user and assist the user not to fall on the stairs, and may execute a function of attending the user to the dining room.

  In the above description, a robot is assumed as the external device 10a. Of course, it is possible to use a stationary information distribution device instead of the robot as the external device 10a. When an information distribution device is used as the external device 10a, for example, it is assumed that the information distribution device executes the following functions. That is, a situation is assumed in which a visually handicapped person approaching the meal time as described above is approaching the stairs. In this case, the information distribution apparatus as the external device 10a executes a function of transmitting the above situation to a computer installed in the nurse center in order to manage the patient situation. As a result, a nurse or the like can be immediately brought close to a visually impaired person from the nurse center and guided to the dining room.

  In addition, even if it does not use the external apparatus 10a, the function for assisting a disabled person is realizable by the ear mounting | wearing type apparatus 1 and the server 2a. For example, the user of the ear-worn device 1 performs chewing and whispering of the back teeth as an operation intended to distribute map information including points requiring attention such as “intersection” and “stairs to the underpass”. Then, operation information indicating that the user has performed such operation, body condition information including information indicating the current position of the user from the GPS sensor 32d, and the ear-mounted device 1 via the external device 10 to the server 2a. Send.

  When the server 2a receives the body condition information as described above, the server 2a determines that the map information is to be transmitted as feedback information including the point requiring attention to the user and transmits it to the ear-worn device 1. To do. Then, the ear-worn device 1 receives the feedback information described above, and communicates to the user that “There is an intersection after 10 m ahead. In this way, it is possible to support persons with disabilities using the ear-mounted device 1 and the server 2a without necessarily using the external device 10a.

[Example of software implementation]
The control blocks (particularly the analysis unit 81, the estimation unit 82, and the feedback information determination unit 83) of the server 2 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or a CPU ( It may be realized by software using a Central Processing Unit.

  In the latter case, the server 2 includes a CPU that executes instructions of a program that is software that implements each function, a ROM (Read Only Memory) or a storage in which the program and various data are recorded so as to be readable by the computer (or CPU). An apparatus (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
An ear-mounted device according to aspect 1 of the present invention is an ear-mounted device that is worn on an ear, and shows detection means for detecting a user's physical condition and the user's physical condition detected by the detection means. Function execution means for executing a function corresponding to the physical condition of the user based on feedback information determined according to the physical condition information.

  According to the said structure, a user's physical condition can be detected multilaterally and accurately by a detection means. Therefore, the functions executed by the function executing means can be varied and are appropriately matched to the user's physical condition according to the user's physical condition detected multifacetedly and accurately by the detecting means. Thereby, the user's physical condition that can be obtained in a multifaceted and accurate manner in a state that is highly convenient for the user can be utilized to the maximum extent.

  An ear-mounted device according to aspect 2 of the present invention is determined by the external device according to aspect 1 above, the transmission unit transmitting the physical state information indicating the physical state of the user detected by the detection unit to the external device, and the external device. And receiving means for receiving feedback information corresponding to the physical condition information.

  According to the above configuration, feedback information for executing a function corresponding to the user's physical condition is determined by the external apparatus based on the physical condition information transmitted by the transmission unit of the ear-worn device. The ear-worn device can execute a function corresponding to the physical condition of the user by the function execution unit when the feedback information is received by the reception unit. That is, by performing the process of determining feedback information with an external device, the processing burden on the ear-worn device can be reduced, and the ear-worn device can be made compact and lightweight.

  The ear-mounted device according to aspect 3 of the present invention is the ear-mounted apparatus according to aspect 2, wherein the detection means detects a state relating to the movement of the user's outer ear as the user's physical state, and the feedback information is The function execution means corresponds to the life rhythm of the user based on the feedback information. The life rhythm estimated from the state relating to the movement of the outer ear detected by the detection means. A function may be performed.

  When chewing during a meal, the outer ear moves in conjunction with the movement of the user's face. As a result of earnest research, the present inventors have found that the user's meal time can be accurately grasped by detecting the state relating to the movement of the user's outer ear. Since the user's meal time is an important index for grasping the user's life rhythm, it can be said that if the meal time is accurately grasped, the life rhythm can be accurately grasped.

  Therefore, according to the said structure, since the state which concerns on a user's outer ear movement is detected by a detection means, a user's meal time can be grasped | ascertained accurately and a lifestyle rhythm can also be grasped | ascertained accordingly. And based on the feedback information determined using the life rhythm accurately grasped, the function executed by the function execution means can be made to accurately correspond to the user's life rhythm.

  The ear-mounted device according to aspect 4 of the present invention is the above-described aspect 1, in which the estimation unit that estimates the life rhythm of the user from the state related to the movement of the outer ear detected by the detection unit as the physical state of the user; Feedback information determining means for determining feedback information corresponding to the life rhythm estimated by the estimating means may be provided.

  According to the said structure, the function performed by a function execution means can be made to respond | correspond to a user's life rhythm exactly. Moreover, the estimation means and feedback information determination means provided in the ear-worn device perform life rhythm estimation processing and feedback information determination processing, so that processing for transmitting body state information to the external device and feedback information are received. The processing to be performed can be omitted. Thereby, the power consumed by the ear-mounted device can be reduced.

  The ear-worn device according to aspect 5 of the present invention is the above-mentioned aspect 4, wherein the estimation means determines whether or not the measurement data indicating the state relating to the movement of the outer ear is within a predetermined allowable range. The life rhythm of the user may be estimated based on the temporal change amount of the measurement data included in the allowable range.

  In the above configuration, if a predetermined allowable range is set to the range of measurement data that can be shown when the user is eating and the range that is obtained empirically, the measurement data at the time of not eating is obtained. Since the life rhythm can be estimated after being rejected, the accuracy of the life rhythm estimation can be improved.

  The ear-worn device according to aspect 6 of the present invention is the ear-mounted apparatus according to aspect 5, in which the estimating means further calculates a life feature value that is a value based on the average value and variance related to the temporal change amount within a predetermined time. It may be used to estimate the user's life rhythm.

  In the above configuration, the average value of the temporal change amount of the measurement data within the predetermined time functions as an index indicating the magnitude of the change of the measurement data within the predetermined time. Further, the dispersion of the temporal change amount of the measurement data within the predetermined time functions as an index indicating the variation in the change of the measurement data within the predetermined time. Then, by estimating the life rhythm using the life feature amount based on these two indices, the accuracy of the life rhythm estimation can be improved.

  The ear-worn device according to aspect 7 of the present invention is the ear-mounted device according to aspect 6, in which the estimation means further adds life rhythm data for a certain period by adding the life feature quantities related to the same time on different days. The user's life rhythm may be estimated based on the life rhythm data.

  According to the above configuration, it is possible to estimate the life rhythm in the long term by setting a certain period for calculating the life rhythm data to one week, for example, instead of estimating the life rhythm in real time. Can protect.

  The ear-worn device according to the eighth aspect of the present invention is the ear-mounted device according to any one of the first to fourth aspects, wherein the user's physical condition detected by the detection unit is determined by the user to execute the function by the function execution unit. An operation state determination unit that determines that the intended operation is performed may be provided, and the function execution unit may execute a function corresponding to the state determined by the operation state determination unit.

  According to the above configuration, as an operation intended by the user to execute the function by the function execution unit, as long as the user engages the back teeth, whispering, etc., it is determined that the user has performed the operation by the operation state determination unit, A function corresponding to an operation intended by the user is executed by the function execution means. Thereby, the user can enjoy services by executing various functions in a completely hands-free and hands-free state.

  The ear-worn device set according to the ninth aspect of the present invention is communicable with the first ear-worn device having the configuration of the ear-worn device according to the eighth aspect and the first ear-worn device. An ear-worn device set including a second ear-worn device having the configuration of the ear-worn device, wherein the first ear-worn device is an operation state provided in the second ear-worn device. The receiving means for receiving information indicating that the operation of the user of the second ear-worn device determined by the determining means has been performed, and information indicating the state received by the receiving means, Conversion means for converting into a predetermined signal, and the function execution means of the first ear-wearable device may further execute a function corresponding to the signal converted by the conversion means of the first ear-wearable device. Good.

  According to the ear-worn device set having the above-described configuration, the user of the second ear-worn device performs operations such as biting and whispering the back teeth with the intention of communicating with the user of the first ear-worn device. Only the function corresponding to the user's operation of the second ear wearable device is executed in the first ear wearable device. Thereby, communication between the user of the first ear-worn device and the user of the second ear-worn device can be realized. By using such an ear-mounted device set, users can communicate with each other even when it is difficult for the users to communicate with each other by gestures or hand gestures, for example, in a train or behind the scenes.

  The server which concerns on aspect 10 of this invention is a receiving means which receives the body state information which shows the user's physical state detected with the ear mounting | wearing type apparatus with which an ear | edge is mounted | worn, The said body state information which the said receiving means received Feedback information determining means for determining feedback information according to the information, and transmitting means for transmitting the feedback information determined by the feedback information determining means to an external device.

  According to the above configuration, the feedback information is determined according to the body condition detected in a multifaceted and accurate manner by the ear-worn device, so that the feedback information is also rich in variations according to the user's body condition and is also in the body condition. It will be precisely aligned. Therefore, by transmitting this feedback information to the external device, it is possible to make maximum use of the user's physical condition that can be obtained in a multifaceted and accurate manner in the external device that has received the feedback information.

  Furthermore, since processing for determining feedback information is performed by the server, it is not necessary to perform processing for determining feedback information in an external device that is a recipient of feedback information, and the processing load on the external device can be reduced.

  The server according to aspect 11 of the present invention is based on the above aspect 10 and estimates the life rhythm of the user from information indicating the state relating to the movement of the user's outer ear received by the receiving unit as the body state information. And feedback information determination means for determining feedback information corresponding to the life rhythm estimated by the estimation means.

  According to the said structure, a user's meal time is grasped | ascertained accurately from the movement of a user's outer ear, and a lifestyle rhythm can also be grasped | ascertained accordingly. Therefore, the feedback information can also be determined corresponding to the user's life rhythm accurately.

  The server according to aspect 12 of the present invention, in the above aspect 11, the estimation means determines whether or not the measurement data indicating the state related to the movement of the outer ear is included within a predetermined allowable range, The user's life rhythm may be estimated based on a temporal change amount of measurement data included in the allowable range.

  According to the said structure, there exists an effect similar to the said aspect 5. FIG.

  The server according to aspect 13 of the present invention is the server according to aspect 12, in which the estimation unit further uses the life feature amount that is a value based on an average value and variance relating to the temporal change amount within a predetermined time. The user's life rhythm may be estimated.

  According to the said structure, there exists an effect similar to the said aspect 6. FIG.

  The server according to aspect 14 of the present invention is the server according to aspect 14, wherein the estimation means further calculates life rhythm data for a certain period by adding the life feature amounts related to the same time on different days, Based on the life rhythm data, the user's life rhythm may be estimated.

  According to the said structure, there exists an effect similar to the said aspect 7. FIG.

  The server according to aspect 15 of the present invention is the server according to aspect 15, wherein the receiving means receives physical condition information indicating the physical condition of the disabled person, and the feedback information determining means is the physical condition of the disabled person. Feedback information for ensuring the safety of the disabled person may be determined according to the body condition information indicating the above.

  According to the above configuration, the feedback information is determined by accurately corresponding to the physical condition of the disabled person, so that the safety of the disabled person can be appropriately ensured according to the physical condition. In particular, persons with disabilities need to care for their physical condition more carefully than healthy persons, so it can be said that it is very useful for ensuring the safety of persons with disabilities.

  The program according to the sixteenth aspect of the present invention includes a reception step of receiving body state information indicating a user's physical state detected by an ear-mounted device worn on an ear, and the body received in the reception step. Based on the feedback information determined according to the state information, the computer executes a function execution step for executing a function corresponding to the user's physical state.

  By executing the program having the above configuration on a computer, it is possible to execute functions on the computer that are rich in variations and accurately matched to the physical condition of the user. Therefore, the user's physical condition that can be obtained in a multifaceted and accurate manner in a state convenient for the user can be utilized to the maximum extent in the computer.

  An information providing system according to a seventeenth aspect of the present invention is an information providing system including an ear-mounted device that is worn on an ear and a server that can communicate with the ear-mounted device. Comprises detection means for detecting a user's physical condition, and transmission means for transmitting body condition information indicating the physical condition of the user detected by the detection means to an external device, wherein the server includes the transmission means. Receiving means for receiving the physical condition information transmitted by: feedback information determining means for determining feedback information according to the physical condition information received by the receiving means; feedback information determined by the feedback information determining means; And an information storage unit for storing at least one of the body condition information.

  According to the above configuration, physical state information that is acquired in a multifaceted and appropriate manner in a state that is highly convenient for the user, or feedback information that corresponds to the physical state accurately and is rich in variations is stored in the information storage unit of the server. Accumulated. If the information stored in the information storage unit is provided to a third party organization, the third party organization can provide various services by utilizing physical condition information and feedback information.

  An information providing system according to an aspect 18 of the present invention is an information providing system including an ear-mounted device that is worn on an ear and a server that can communicate with the ear-mounted device, and the ear-mounted device. Detects a state relating to the movement of the user's outer ear as the user's physical state, and transmits information indicating the state relating to the movement of the user's outer ear to the external device as body state information indicating the user's physical state. The server includes a receiving means for receiving the physical condition information transmitted by the transmitting means, and a movement of the user's outer ear indicated by the physical condition information received by the receiving means. The estimation means for estimating the user's life rhythm from the state, and feedback information for determining feedback information corresponding to the life rhythm estimated by the estimation means Has a constant section, the feedback information, and transmitting means for transmitting at least one of said physical condition information to the external device.

  According to the said structure, the effect similar to the ear mounting | wearing type apparatus in the said aspect 3 and the server in the said aspect 10 can be acquired.

  In the information providing system according to aspect 19 of the present invention, in the above aspect 17 or 18, the receiving means receives physical condition information indicating a physical condition of the disabled person, and the feedback information determining means is the obstacle. The feedback information for ensuring the safety of the disabled person may be determined according to the physical condition information indicating the physical condition of the person.

  According to the above configuration, an information providing system useful for ensuring the safety of persons with disabilities can be realized.

  The server according to each aspect of the present invention may be realized by a computer. In this case, a server control program for realizing the server by the computer by causing the computer to operate as each unit included in the server, and A computer-readable recording medium on which it is recorded also falls within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to utilize for a user various services by making the most use of the user's physical condition obtained from an ear mounting | wearing apparatus. For example, the present invention can be used for various health care services, entertainment services, information providing services, and services that support elderly people and persons with disabilities using life rhythm estimation results as described in the above-described embodiment. it can. Furthermore, the present invention has the potential to be applied to other services, and the industrial applicability is immeasurable.

1, 1a, 1b Ear-mounted device 2, 2a Server 3, 3b Input unit (detection means)
31 Ear canal input part (detection means)
31a Optical distance sensor (detection means)
31b Pulse wave sensor (detection means)
31c Body temperature sensor (detection means)
32 Ear shell input part (detection means)
32a Microphone (detection means)
32b Acceleration sensor (detection means)
32c Outside air temperature sensor (detection means)
32d GPS sensor (detection means)
32e Tilt sensor (detection means)
32f Geomagnetic sensor (detection means)
32g Barometric pressure sensor (detection means)
4, 4a, 4b Control unit 41, 41b Acquisition unit 42, 42b Operation state determination unit (operation state determination means)
43, 43a Conversion unit (conversion means)
44, 44a Function execution unit (function execution means)
5, 5a, 5b Communication part (transmission means, reception means)
6, 6a Output unit 61 Vibration unit 62 Speaker 63 Bone conduction unit 7 Communication unit (transmission means, reception means)
8, 8a Control unit 81 Analysis unit 82 Estimation unit (estimation means)
83, 83a Feedback information determination unit (feedback information determination means)
9, 9a Information storage unit 91 Physical state information 92 Life rhythm information 93 Meal time information 94 Feedback information 10, 10a, 14 External device A, A ′ Information providing system

Claims (19)

An ear-mounted device that is worn on the ear,
Detecting means for detecting a user's physical condition;
Function execution means for executing a function corresponding to the physical condition of the user based on feedback information determined according to physical condition information indicating the physical condition of the user detected by the detection means. Ear-mounted device. Transmitting means for transmitting physical state information indicating the physical state of the user detected by the detecting means to an external device;
The ear-worn device according to claim 1, further comprising receiving means for receiving feedback information determined by the external device according to the physical condition information. The detection means detects a state relating to the movement of the user's outer ear as the physical state of the user,
The feedback information is determined using a life rhythm estimated from the state relating to the movement of the outer ear detected by the detection means,
The ear-worn device according to claim 2, wherein the function executing means executes a function corresponding to the life rhythm of the user based on the feedback information. Estimating means for estimating the life rhythm of the user from the state relating to the movement of the outer ear detected by the detecting means as the physical state of the user;
The ear-worn device according to claim 1, further comprising feedback information determining means for determining feedback information corresponding to the life rhythm estimated by the estimating means.   The estimation means determines whether or not the measurement data indicating the state related to the movement of the outer ear is included within a predetermined allowable range, and based on a temporal change amount of the measurement data included in the allowable range. The ear-mounted device according to claim 4, wherein the life rhythm of the user is estimated.   The said estimation means further estimates the said user's life rhythm using the life feature-value which is a value based on the average value and dispersion | variation which concern on the said temporal variation | change_quantity in predetermined time. The ear-worn device according to 1.   The estimation means further calculates the life rhythm data for a certain period by adding the life feature amounts related to the same time on different days, and estimates the user's life rhythm based on the life rhythm data. The ear-mounted device according to claim 6. An operation state determination unit that determines that the physical state of the user detected by the detection unit is a state in which the user has performed an operation intended to execute a function by the function execution unit;
5. The ear-worn device according to claim 1, wherein the function execution unit executes a function corresponding to the state determined by the operation state determination unit. A first ear-worn device comprising the configuration of the ear-worn device of claim 8;
An ear-worn device set, comprising: a second ear-worn device that can communicate with the first ear-worn device and comprises the ear-worn device according to claim 8.
The first ear wearable device is:
Receiving means for receiving information indicating a state in which an operation intended by a user of the second ear-worn device is performed, which is determined by an operation state determining unit provided in the second ear-worn device;
Conversion means for converting the information indicating the state received by the reception means into a predetermined signal;
The ear wearing type device set, wherein the function executing means of the first ear wearing type device further executes a function corresponding to the signal converted by the converting means of the first ear wearing type device. Receiving means for receiving physical condition information indicating the physical condition of the user detected by the ear-mounted device worn on the ear;
Feedback information determining means for determining feedback information according to the physical condition information received by the receiving means;
A server comprising: transmission means for transmitting feedback information determined by the feedback information determination means to an external device. Estimation means for estimating the life rhythm of the user from information indicating the state relating to the movement of the user's outer ear received by the receiving means as the physical state information;
The server according to claim 10, further comprising feedback information determination means for determining feedback information corresponding to the life rhythm estimated by the estimation means.   The estimation means determines whether or not the measurement data indicating the state related to the movement of the outer ear is included within a predetermined allowable range, and based on a temporal change amount of the measurement data included in the allowable range. The server according to claim 11, wherein the life rhythm of the user is estimated.   13. The estimating means further estimates the user's life rhythm using a life feature value that is a value based on an average value and variance relating to the temporal change amount within a predetermined time. Server described in.   The estimation means further calculates the life rhythm data for a certain period by adding the life feature amounts related to the same time on different days, and estimates the user's life rhythm based on the life rhythm data. The server according to claim 13. The receiving means is for receiving physical condition information indicating the physical condition of the disabled person,
The server according to claim 10, wherein the feedback information determination unit determines feedback information for ensuring safety of the disabled person in accordance with body condition information indicating a physical condition of the disabled person. A receiving step for receiving physical state information indicating a physical state of the user detected by the ear-mounted device attached to the ear;
A function execution step for executing a function corresponding to the physical condition of the user based on feedback information determined in accordance with the physical condition information received in the reception step, Program to do. An information providing system including an ear-mounted device worn on an ear and a server capable of communicating with the ear-mounted device,
The ear-mounted device is
Detecting means for detecting a user's physical condition;
Transmitting means for transmitting physical state information indicating the physical state of the user detected by the detecting means to an external device;
The server
Receiving means for receiving the physical condition information transmitted by the transmitting means;
Feedback information determining means for determining feedback information according to the physical condition information received by the receiving means;
An information providing system comprising: an information accumulation unit that accumulates at least one of the feedback information determined by the feedback information determination unit and the physical condition information. An information providing system including an ear-mounted device worn on an ear and a server capable of communicating with the ear-mounted device,
The ear-mounted device is
Detecting means for detecting a state relating to the movement of the user's outer ear as the user's physical state;
Transmission means for transmitting information indicating a state relating to the movement of the user's outer ear to an external device as body state information indicating the user's physical state,
The server
Receiving means for receiving the physical condition information transmitted by the transmitting means;
Estimating means for estimating the user's life rhythm from the state relating to the movement of the user's outer ear indicated by the physical condition information received by the receiving means;
Feedback information determining means for determining feedback information corresponding to the life rhythm estimated by the estimating means;
An information providing system comprising: transmission means for transmitting at least one of the feedback information and the physical condition information to an external device. The receiving means is for receiving physical condition information indicating the physical condition of the disabled person,
The said feedback information determination means determines the feedback information for ensuring the safety | security of the said disabled person according to the physical condition information which shows the physical condition of the said disabled person, The Claim 17 or 18 characterized by the above-mentioned. Information provision system.

Images