CN110853294A - Method and device for monitoring by using household appliance and computer storage medium - Google Patents
Method and device for monitoring by using household appliance and computer storage medium Download PDFInfo
- Publication number
- CN110853294A CN110853294A CN201911040118.6A CN201911040118A CN110853294A CN 110853294 A CN110853294 A CN 110853294A CN 201911040118 A CN201911040118 A CN 201911040118A CN 110853294 A CN110853294 A CN 110853294A
- Authority
- CN
- China
- Prior art keywords
- information
- state information
- user terminal
- biological
- alarm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/02—Alarms for ensuring the safety of persons
- G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
- G08B21/0438—Sensor means for detecting
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
- G10L15/063—Training
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
- G10L25/24—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being the cepstrum
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Signal Processing (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Gerontology & Geriatric Medicine (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Artificial Intelligence (AREA)
- Alarm Systems (AREA)
- Emergency Alarm Devices (AREA)
Abstract
The application discloses a method, a device and a computer storage medium for monitoring by using household appliances. The method for monitoring by using the household appliance comprises the following steps: acquiring a sound signal of a monitoring area through household appliances in a home network; determining biological state information corresponding to the sound signal, wherein the biological state information comprises state information and category information; and transmitting the biological state information to the user terminal. By the method for monitoring by using the household appliance, the living beings in the monitoring area can be monitored, and a user can know the living states in time through the user terminal.
Description
Technical Field
The present application relates to the field of home monitoring technologies, and in particular, to a method and an apparatus for monitoring by using a home appliance, and a computer storage medium.
Background
With the development and progress of society, the pressure of life is getting bigger, the young generation spends more and more time and energy at work, and does not have enough time to take care of living beings with poor self-care capability, such as old people, children and pets in home.
Disclosure of Invention
The application mainly aims to provide a method, a device and a computer storage medium for monitoring by using a household appliance, which can monitor organisms in a monitoring area and enable a user to know the biological state in time through a user terminal.
In order to achieve the purpose, the technical scheme adopted by the application is as follows: a method for monitoring with home appliances, a plurality of which constitute a home network, the method comprising: acquiring a sound signal of a monitoring area through household appliances in a home network; determining biological state information corresponding to the sound signal, wherein the biological state information comprises state information and category information; and transmitting the biological state information to the user terminal.
In order to achieve the purpose, the other technical scheme adopted by the application is as follows: a monitoring device comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, and the steps of the method for monitoring by using the household appliance are realized when the processor executes the computer program.
In order to achieve the above purpose, the present application adopts another technical solution: a computer storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method of monitoring with a household appliance.
The beneficial effect of this application is: different from the prior art, acquire the sound signal in the monitoring area through domestic appliance, just can gather the sound signal in the monitoring area through domestic appliance like this, this application brings domestic appliance into family's control field for the first time, under not increasing user's cost, make up family's sound early warning, the vacancy in control field, and analyze and then confirm the state information (for example thirsty, disease, fall down etc.) and the classification information (for example children, old man, pet etc.) that the sound signal corresponds through monitoring device, and can send state information and classification information to user terminal, monitoring device just so can in time know biological state through the sound signal, can monitor the biology in the monitoring area, and inform user terminal with biological state, let the user can in time know biological state through user terminal.
Drawings
FIG. 1 is a schematic diagram of an embodiment of a system for monitoring with a household appliance according to the present application;
FIG. 2 is a schematic flow chart diagram illustrating an embodiment of a method for monitoring with a home appliance according to the present application;
FIG. 3 is a schematic flow chart diagram illustrating another embodiment of a method for monitoring with a home appliance according to the present application;
FIG. 4 is a schematic flow chart diagram illustrating a further embodiment of a method for monitoring with a household appliance according to the present application;
FIG. 5 is a schematic diagram of an embodiment of a monitoring device according to the present application;
FIG. 6 is a schematic structural diagram of an embodiment of a computer storage medium according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The current young generation spends more and more time and energy at work, and does not have enough time to take care of living beings with poor self-care capability, such as old people, children, pets and the like in families. Monitoring the home with a monitoring device is one means to solve the above problems.
Children or old people can be monitored in a video monitoring mode. However, the video monitoring method may have the following problems: the cost is large; to user privacy security; monitoring and arranging points to influence the beauty of the home; the cloud transmission is slow, and problems cannot be found in time.
Because the sound monitoring only relates to audio information, compared with the video information of the video monitoring, the files collected by the sound monitoring are much smaller, and the private pictures are not related.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an embodiment of a system for monitoring by using a household appliance according to the present application. The system 10 for monitoring by using a home appliance according to the present embodiment may monitor a monitoring area by using the home appliance 11. And a home network is arranged in the monitoring area. The home network is constituted by a plurality of home appliances 11. The home appliance 11 has a function of collecting a sound signal.
The system 10 for monitoring by using a home appliance according to the present embodiment includes a home appliance 11, a monitoring device 12, and a user terminal 13. The monitoring device 10 is connected to at least one household appliance 11. The household appliance 11 is used for collecting sound signals and transmitting the sound signals to the monitoring device 12. The monitoring device 12 is configured to receive the sound signal, determine biological status information corresponding to the sound signal, and send the biological status information to the user terminal 13. In this embodiment, the monitoring device 12 may be provided with a sound detection model. The sound detection model can be used for confirming the corresponding biological state information of the sound signal by analyzing the sound signal. In addition, the voice detection model may be trained based on a training voice set. The training sound set may include sounds (including breathing, flatus, crying, quarreling, falling, and various sounds of pets) emitted by animals, people of different ages in normal life. In addition, the monitoring device 12 may also store the received sound signals during operation and may identify the sound signals with biological status information. And when the biological state information corresponding to the voice signal fed back by the user is incorrect, training and updating the voice detection model according to the incorrect voice signal.
The household electrical appliance 11 can be an electrical appliance which works or is powered on for a long time for standby, such as a refrigerator, an air conditioner, a water heater and the like, so that devices are not required to be additionally arranged for collecting sound signals, and household electrical energy loss is not required to be increased.
The user terminal 13 may represent a mobile phone, a smart phone, a computer, a notebook computer, a tablet computer, a Digital broadcast receiver, a Personal Digital Assistant (PDA), a Portable Multimedia Player (PMP), and/or a navigation device.
With respect to further functions of the monitoring device 12 in an embodiment of the system 10 for monitoring with a home appliance, reference may be made to the following specific embodiments of the method for monitoring with a home appliance.
As shown in fig. 2, fig. 2 is a schematic flow chart of an embodiment of the monitoring method using a household appliance according to the present application. The method for monitoring by using the household appliance can take the monitoring device as an execution main body. The method for monitoring by using the household appliance comprises the following steps.
Step S101: and acquiring the sound signal of the monitoring area through the household appliances in the home network.
The household appliances in the home network are responsible for collecting the sound signals of the monitoring area, and then the household appliances can transmit the collected sound signals to the monitoring device, so that the monitoring device can obtain the sound information of the monitoring area.
The sound signal may include various sounds such as breathing sounds, flatus sounds, crying sounds, quarreling sounds, falling sounds, etc. of animals or people of different ages.
Step S102: and determining the biological state information corresponding to the sound signals.
Based on the obtained sound signals, the status of the person or animal in the monitored area (i.e. the biological status information) can be determined. The biological status information may include status information and category information. The status information may reveal what state the organism is in, for example, may reveal that the organism is in a state of hunger and thirst, physical discomfort, excretion, or wrestling. The category information may reveal the category to which the living being belongs, for example, may reveal that the category to which the living being belongs is a pet, a child, an elderly person, or the like.
In this embodiment, the determination of the biological status information corresponding to the sound signal may be implemented by: and matching the sound signal with a pre-stored sound set so as to match biological state information corresponding to the sound signal.
In other embodiments, the determination of the biological status information corresponding to the sound signal may be implemented by: and matching the characteristics of the sound signals with a pre-stored sound characteristic set so as to match biological state information corresponding to the sound signals. Of course, before this, sound feature extraction needs to be performed on the sound signal to obtain the features of the sound signal. The features of the sound signal may comprise voiceprint features. Alternatively, the characteristics of the sound signal may include time-domain characteristic parameters including short-time average energy, short-time average amplitude, short-time average zero-crossing rate, formants, pitch frequency, and the like, and frequency-domain characteristic parameters including linear prediction coefficients, linear prediction cepstral coefficients, mel-frequency cepstral coefficients, and the like. The formants represent the characteristics of vocal tract response, the fundamental frequency represents the characteristics of glottal excitation, the linear prediction coefficient and the linear prediction cepstrum coefficient simultaneously represent the characteristics of glottal excitation and vocal tract response, and the Mel frequency cepstrum coefficient simulates the characteristics of human auditory sense.
In addition, based on the obtained sound signal, not only the state information but also the category information can be determined, and a specific implementation manner may be: firstly, matching the sound signal with a pre-stored sound set of multiple biological categories (or matching the characteristics of the sound signal with the pre-stored sound characteristic set of multiple biological categories), and determining the category information corresponding to the sound signal; then, the sound signal is matched with the sound set of the plurality of biological states corresponding to the category information (or the characteristics of the sound signal are matched with the sound set of the plurality of biological states corresponding to the category information), and the state information corresponding to the sound signal is determined.
Step S103: and transmitting the biological state information to the user terminal.
And after the biological state information corresponding to the sound signal is determined, sending the determined biological state information to the user terminal.
Transmitting the biological status information to the user terminal may include: determining whether the biological status information is abnormal; responding to the abnormity of the biological state information, and sending alarm information to the user terminal; and sending the common information to the user terminal in response to the fact that the biological state information is not abnormal. Wherein, the alarm information and the general information may each include biological status information and/or a sound signal, so that the user may play the sound signal to verify whether the biological status information is accurate when viewing the alarm information and the general information. The alert information may also include an alert ring tone issued based on the biological status information. Therefore, the user terminal can play the alarm ring tone when receiving the alarm information. Of course, the alarm information and the general information may also include the contents of the home appliance collecting the sound signal, the name of the sub monitoring area, the measures that can be taken, and the like.
In addition, in other embodiments, in response to the fact that the biological state information is not abnormal, information may not be sent to the user terminal, so that the user is prevented from receiving a lot of unnecessary information and wasting the computing resources of the monitoring device and the user terminal.
Both the alert message and the general message may be referred to as reminder messages. In this embodiment, the reminding information may be sent to the user terminal according to different message types, that is, the reminding information may correspond to the state information and/or the category information.
Specifically, the audio signal may be classified according to category information, that is, each category information has a corresponding message type, for example, when the category information corresponding to the audio signal is a child, the reminding information corresponding to the audio signal is sent to the user terminal according to the message type corresponding to the child. It can be understood that, alternatively, the state information may be classified according to the state information, that is, each state information has a corresponding message type, for example, when the state information corresponding to the sound signal is a disease, the reminding information corresponding to the sound signal is sent to the user terminal according to the message type corresponding to the disease, so that the user terminal can determine the state information in the reminding information according to the message type, and thus, according to the message type, the urgency can be determined, unnecessary processing items can be omitted, and the processing time can be saved.
Further, when the reminding information is the alarm information, the reminding information may be corresponding to the state information and/or the category information, and specifically may be embodied as: the alarm ring in the alarm information corresponds to the state information and/or the category information, so that the user can directly judge the state information and/or the category information according to the ring played by the user terminal, and the user can judge whether the things are urgent or urgent without opening the content of the alarm information.
In this embodiment, the sound signal in the monitoring area is obtained through the household appliance, so that the sound signal in the monitoring area can be collected through the household appliance, the household appliance is brought into the household monitoring field for the first time, the vacancy of the household sound early warning and monitoring field is made up without increasing the user cost, the state information (for example, thirsty, diseases, falling down and the like) and the category information (for example, children, old people, pets and the like) corresponding to the sound signal are further determined through the analysis of the monitoring device, and the state information and the category information are sent to the user terminal, so that the monitoring device can know the state of the living body in time through the sound signal and inform the user terminal of the state of the living body, and the user can know the biological state in time through the user terminal.
Fig. 3 is a schematic flow chart of another embodiment of the monitoring method using the household appliance according to the present application, as shown in fig. 3.
Step S201: and receiving a third modification instruction sent by the user terminal, wherein the third modification instruction is an instruction for modifying the monitoring area.
The third modification instruction is an instruction issued by the user terminal to start and/or close at least part of functions of the household appliances in the home network for collecting the sound signals. The user terminal can control the on and off of the function of collecting the sound signals of the household appliances in the home network by issuing a third modification instruction, namely correspondingly controlling whether to collect the sound signals of at least part of the monitored area.
Step S202: and modifying the monitoring area according to the third modification instruction.
Step S203: and acquiring the sound signal through the household appliance in the modified monitoring area.
After the sound signal is acquired through the household appliance in the modified monitoring area, the category information corresponding to the sound signal can be determined.
Step S204: and determining the biological state information corresponding to the sound signals.
Step S205: and transmitting the biological state information to the user terminal.
The biological status information may be transmitted to the user terminal only when the category information and/or the status information is within an alarm range of the biological status information. The biological status information can be transmitted to the user terminal through the alarm information, of course.
The alarm range of the biological status information may include an alarm range of the status information and an alarm range of the category information. In the present embodiment, the alarm information may be issued only when the category information is within the alarm range of the category information and the status information is within the alarm range of the status information.
The alert range of the status information may include an alert category range of the status information. The alarm category range of the state information may mean in which state the living organism is in which state the alarm information can be issued, and in which state the living organism is out of the alarm category range of the state information the alarm information is not issued to the user terminal. For example, the alarm category range of the status information is hunger and disease, and the alarm information is only sent out when the status information is hunger or disease.
The status information may include a status type and a status threshold, for example, the status information corresponding to the sound signal may include a disease (status type) and 85% (status threshold). Accordingly, the alarm range of the status information may also include an alarm threshold range of the status information. The alarm threshold range of the state information may refer to a limit of a state threshold for issuing the alarm information, that is, when the state threshold in the state information is within the alarm threshold range of the state information, the alarm information may be issued, and when the state threshold in the state information is not within the alarm threshold range of the state information, the alarm information may not be issued. It is to be appreciated that multiple status types may collectively correspond to an alarm threshold range for status information, e.g., alarm threshold ranges for hunger, illness, and thirst-prone status information may each be 80% -100%. Of course, there may be one alarm threshold range of status information per status type. Likewise, when the alarm range of the status information includes the alarm category range of the status information and the alarm threshold range of the status information, the alarm information may be issued only when the status type is within the alarm category range of the status information and the status threshold is within the alarm threshold range of the status information.
The alarm range of the category information may indicate the type of the creature, and the alarm information may be issued so that the user terminal is not issued with the alarm information when the type of the creature is out of the alarm range of the category information. For example, when the alarm range of the category information is a pet or a child, the alarm information may be issued only when the category information recognized by voice is a child or a pet, and if the category information recognized by voice is an old person, the alarm information may not be issued.
Before transmitting the biological status information to the user terminal: a first modification instruction sent by the user terminal may be received. The first modification instruction is an instruction for modifying the alarm range of the state information; and modifying the alarm range of the state information according to the first modification instruction. And when the state information is in the alarm range of the modified state information, sending reminding information to the user terminal. If the state information corresponding to the sound signal is not in the alarm range of the modified state information, the monitoring device does not send the reminding information to the user terminal, so that the user can set the alarm range of the state information by himself, namely the range of the state information received by the user terminal can be determined by himself. When the reminding information is the alarm information, the condition for sending the alarm information to the user terminal may be: the status information is abnormal and the status information is within the modified status information alert range.
Accordingly, before transmitting the biological status information to the user terminal: receiving a second modification instruction sent by the user terminal, wherein the second modification instruction is an instruction for modifying the alarm range of the category information; and modifying the alarm range of the category information according to the second modification instruction. And when the category information is in the alarm range of the modified category information, sending reminding information to the user. When the reminding information is the alarm information, the condition for sending the alarm information to the user terminal may be: the status information is abnormal and the category information is within the modified category information alert range.
Step S206: and receiving a control instruction sent by the user terminal after receiving the biological state information.
Wherein the control instruction is issued by the user terminal after receiving the biological status information. After the biological state information is sent to the user terminal, the user terminal can look up the biological state information, and then the user terminal can issue a control instruction to the household appliance related to the biological state information according to the biological state information. The household appliances related to the biological state information can execute corresponding operations according to the received control instructions. The home appliance related to the biological state information is a home appliance capable of processing the related matters of the biological state information.
In addition, in this embodiment, after step S204, in addition to receiving the control instruction from the user terminal, the user terminal may also receive confirmation information indicating whether the biological status information is incorrect, so as to determine the accuracy of the voice detection model according to the confirmation information, and train and update the voice detection model when the accuracy of the voice detection model is lower than a preset value, thereby ensuring the accuracy of the voice detection model loaded on the monitoring device and improving the efficiency of identifying the biological status information.
Step S207: and sending the control instruction to the household appliance related to the biological state information.
Fig. 4 is a schematic flow chart of another embodiment of the monitoring method using the household appliance according to the present application, as shown in fig. 4.
Step S301: and acquiring a sound signal through the household appliances in the monitoring area.
Step S302: and determining the biological state information corresponding to the sound signals.
Step S303: and transmitting the biological state information to the user terminal.
Step S304: and issuing a control instruction to the household appliance related to the biological state information based on the biological state information.
Wherein the home appliance related to the biological state information is a home appliance which processes events related to the biological state information. The control command may include the type of program to be executed by the household appliance, the execution time, and the like.
After the biological state information corresponding to the sound signal is determined, the monitoring device can directly issue a control instruction to the household appliance related to the biological state information according to the biological state information, so that the household appliance can be controlled in time according to the actual condition, measures can be taken in time, and the user terminal does not respond in time in case of emergency. For example, when the state information is frightened or feared, a music playing instruction is given to the sound player in the home network, so that the emotion of the living beings in the monitored area can be relieved.
In addition, the control instruction can be issued to the household appliances related to the biological state information by combining the category information and the state information. For example, when the type information corresponding to the audio signal is an animal and the state information corresponding to the audio signal is thirst, a feeding instruction is issued to the feeding device in the monitoring area.
In the embodiment, the biological position information representing the source of the sound signal can be determined through the sound signal, and the control instruction is issued to the household appliance by combining the biological position information and the biological state information. The specific implementation manner of determining the biological position information representing the source of the sound signal through the sound signal may be: determining the household appliance for collecting the sound signal through the sound signal; confirming the relative position between the household appliance and the living being through the sound signal; and confirming the position of the living being according to the relative position and the position of the household appliance. Specifically, issuing a control instruction to the household appliance related to the biological state information by combining the biological position information and the biological state information may include: determining a home appliance related to the biological status information; and controlling the determined home appliance to move to the position represented by the biological position information. The specific implementation manner of the step of controlling the determined household appliance to move to the position represented by the biological position information may be: determining location information of the home appliance related to the biological status information; determining a moving path by the determined position information of the home appliance (the determined home appliance may refer to a home appliance related to the biological state information) and the biological position information; and transmitting the moving path and the type of the program to be executed to the determined household appliance to control the determined household appliance to move to the position represented by the biological position information and process the relevant event of the biological state information. The determined household appliance may be a feeding device or a music player, a video communication device, or the like.
Of course, in other embodiments, the home appliance collecting the sound signal may be determined according to the sound signal, and then the relative position of the home appliance and the living being may be determined; then determining the relative positions of the living being and the determined household appliance based on the determined relative positions of the household appliance and the household appliance for collecting the sound signal; determining a moving path of the determined household appliance to the position where the living being is located according to the relative position of the living being and the determined household appliance; and then transmitting the moving path to the determined home appliance. Therefore, the biological position information can be determined according to the sound signals by the monitoring position, so that the determined moving path of the household appliance is planned, the determined household appliance is indicated to move to the position represented by the biological position information, and the problem of abnormal state information can be solved more accurately and directly.
In addition, the monitoring device can have different processing modes according to different state information.
If the status information is slightly abnormal, the processing manner may be that the receiving user terminal in S205 receives the control instruction sent by the biological status information, and sends the control instruction to the household appliance related to the biological status information.
In addition, when the state information of the living body can be processed by the home appliances in the monitoring area, the processing may be performed in S304 by issuing a control command to the home appliances related to the biological state information based on the biological state information.
It is understood that when the status information is a disease, an ambulance call can be directly dialed to request rescue (in practical applications, the ambulance call can be determined by combining the category information, and then the ambulance call can be dialed to request rescue).
Referring to fig. 5, fig. 5 is a schematic structural diagram of an embodiment of a monitoring device according to the present application. The monitoring device 20 in the present embodiment includes:
the monitoring device 20 in the present embodiment includes: a memory 21, a processor 22, and a computer program stored in the memory 21 and executable on the processor 22. The processor 22, when executing the computer program, may implement the steps of the above-described embodiments of the method for monitoring with a home appliance, such as step S101 shown in fig. 2.
The monitoring device 20 may include, but is not limited to, a processor 22 and a memory 21. It will be appreciated by those skilled in the art that the schematic diagram is merely an example of the monitoring apparatus 20 and does not constitute a limitation of the monitoring apparatus 20, and may include more or less components than those shown, or combine some components, or different components, for example, the monitoring apparatus 20 may further include an input-output device, a network access device, a bus, etc. The processor 22 may be a central processing unit, but may also be other general purpose processors, digital signal processors, application specific integrated circuits, off-the-shelf programmable gate arrays or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. The memory 21 may include high speed random access memory and may also include non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, at least one magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
The integrated unit of the monitoring device 20 may be stored in a computer storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. As shown in fig. 6, based on such understanding, all or part of the flow of the method of the embodiments described above may be implemented by a computer program 31, the computer program 31 may be stored in a computer storage medium 30, and when being executed, the computer program 31 may implement the steps of the method embodiments described above. The computer program 31 comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. Computer storage medium 30 may include: any entity or device capable of carrying computer program code, recording medium, U.S. disk, removable hard disk, magnetic disk, optical disk, computer memory, read-only memory, random access memory, electrical carrier wave signals, telecommunications signals, software distribution medium, and the like.
The above embodiments are merely examples and are not intended to limit the scope of the present disclosure, and all modifications, equivalents, and flow charts using the contents of the specification and drawings of the present disclosure or those directly or indirectly applied to other related technical fields are intended to be included in the scope of the present disclosure.
Claims (10)
1. A method for monitoring using home appliances, wherein a plurality of the home appliances constitute a home network, the method comprising:
acquiring a sound signal of a monitoring area through household appliances in the home network;
determining biological state information corresponding to the sound signal, wherein the biological state information comprises state information and category information;
and sending the biological state information to a user terminal.
2. The method according to claim 1, characterized in that it comprises:
judging whether the biological state information is abnormal or not;
and responding to the abnormal biological state information, and sending alarm information to the user terminal.
3. The method of claim 2,
the sending of the alarm information to the user terminal includes: and sending the alarm information to the user terminal, wherein the alarm information corresponds to the state information and/or the category information.
4. The method of claim 2, wherein the method comprises:
receiving a first modification instruction sent by the user terminal, wherein the first modification instruction is an instruction for modifying an alarm range of state information;
modifying the alarm range of the state information according to the first modification instruction;
the sending of alarm information to the user terminal in response to the abnormality of the biological status information includes:
and responding to the abnormal biological state information, and sending alarm information to the user terminal when the state information is in the modified state information alarm range.
5. The method of claim 2, further comprising:
receiving a second modification instruction sent by the user terminal, wherein the second modification instruction is an instruction for modifying the alarm range of the category information;
modifying the alarm range of the category information according to the second modification instruction;
the sending of alarm information to the user terminal in response to the abnormality of the biological status information includes:
and responding to the abnormal biological state information, and sending alarm information to the user terminal when the category information is within the alarm range of the modified category information.
6. The method according to claim 1, characterized in that it comprises:
receiving a third modification instruction sent by the user terminal, wherein the third modification instruction is an instruction for modifying a monitoring area;
modifying the monitoring area according to the third modification instruction;
and acquiring the sound signal through the household appliance in the modified monitoring area.
7. The method according to claim 1, characterized in that it comprises:
receiving a control instruction sent by the user terminal after receiving the biological state information; and sending the control instruction to the household appliance related to the biological state information.
8. The method of claim 1, wherein the obtaining of the sound signal of the monitored area by the home appliances in the home network further comprises:
determining biological location information indicative of a source of the acoustic signal;
the method further comprises the following steps:
determining a home appliance related to the biological status information;
controlling the determined home appliance to move to a location represented by the biological location information.
9. A monitoring device, comprising a memory and a processor; the memory has stored therein a computer program for execution by the processor to carry out the steps of the method for monitoring with a domestic appliance according to any one of claims 1 to 8.
10. A computer storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of monitoring with a domestic appliance according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911040118.6A CN110853294A (en) | 2019-10-29 | 2019-10-29 | Method and device for monitoring by using household appliance and computer storage medium |
| PCT/CN2019/124119 WO2021082196A1 (en) | 2019-10-29 | 2019-12-09 | Monitoring method using household appliance, device, and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911040118.6A CN110853294A (en) | 2019-10-29 | 2019-10-29 | Method and device for monitoring by using household appliance and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110853294A true CN110853294A (en) | 2020-02-28 |
Family
ID=69598875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911040118.6A Pending CN110853294A (en) | 2019-10-29 | 2019-10-29 | Method and device for monitoring by using household appliance and computer storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110853294A (en) |
| WO (1) | WO2021082196A1 (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1527992A (en) * | 2001-03-15 | 2004-09-08 | �ʼҷ����ֵ�������˾ | Automatic system for monitoring independent person requiring occasional assistance |
| CN102455036A (en) * | 2010-10-15 | 2012-05-16 | 日立空调·家用电器株式会社 | Air conditioner |
| US20160150207A1 (en) * | 2014-06-24 | 2016-05-26 | Sony Corporation | Sound signal processing method and apparatus, and mobile terminal |
| CN107123220A (en) * | 2017-06-06 | 2017-09-01 | 甲丙益（深圳）网络科技有限公司 | Apparatus and method for the security monitoring of the interior space |
| CN107635147A (en) * | 2017-09-30 | 2018-01-26 | 上海交通大学 | Health information management TV based on multi-modal human-computer interaction |
| CN108536112A (en) * | 2018-07-16 | 2018-09-14 | 潍坊学院 | A kind of Intelligent control system for household appliances and method based on technology of Internet of things |
| CN108572647A (en) * | 2018-07-24 | 2018-09-25 | 南京阿凡达机器人科技有限公司 | A kind of smart home management method and management platform based on mobile robot |
| CN109171644A (en) * | 2018-06-22 | 2019-01-11 | 平安科技（深圳）有限公司 | Health control method, device, computer equipment and storage medium based on voice recognition |
| CN109903522A (en) * | 2019-01-24 | 2019-06-18 | 珠海格力电器股份有限公司 | Monitoring method and device, storage medium and household appliance |
| CN110111815A (en) * | 2019-04-16 | 2019-08-09 | 平安科技（深圳）有限公司 | Animal anomaly sound monitoring method and device, storage medium, electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102195897B1 (en) * | 2013-06-05 | 2020-12-28 | 삼성전자주식회사 | Apparatus for dectecting aucoustic event, operating method thereof, and computer-readable recording medium having embodied thereon a program which when executed by a computer perorms the method |
| CN106887122B (en) * | 2015-12-15 | 2019-08-30 | 美的集团股份有限公司 | The method, apparatus and speaker alarmed by speaker |
| CN107144341A (en) * | 2017-04-28 | 2017-09-08 | 珠海格力电器股份有限公司 | Environment monitoring method and device and air conditioner with device |
-
2019
- 2019-10-29 CN CN201911040118.6A patent/CN110853294A/en active Pending
- 2019-12-09 WO PCT/CN2019/124119 patent/WO2021082196A1/en not_active Ceased
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1527992A (en) * | 2001-03-15 | 2004-09-08 | �ʼҷ����ֵ�������˾ | Automatic system for monitoring independent person requiring occasional assistance |
| CN102455036A (en) * | 2010-10-15 | 2012-05-16 | 日立空调·家用电器株式会社 | Air conditioner |
| US20160150207A1 (en) * | 2014-06-24 | 2016-05-26 | Sony Corporation | Sound signal processing method and apparatus, and mobile terminal |
| CN107123220A (en) * | 2017-06-06 | 2017-09-01 | 甲丙益（深圳）网络科技有限公司 | Apparatus and method for the security monitoring of the interior space |
| CN107635147A (en) * | 2017-09-30 | 2018-01-26 | 上海交通大学 | Health information management TV based on multi-modal human-computer interaction |
| CN109171644A (en) * | 2018-06-22 | 2019-01-11 | 平安科技（深圳）有限公司 | Health control method, device, computer equipment and storage medium based on voice recognition |
| CN108536112A (en) * | 2018-07-16 | 2018-09-14 | 潍坊学院 | A kind of Intelligent control system for household appliances and method based on technology of Internet of things |
| CN108572647A (en) * | 2018-07-24 | 2018-09-25 | 南京阿凡达机器人科技有限公司 | A kind of smart home management method and management platform based on mobile robot |
| CN109903522A (en) * | 2019-01-24 | 2019-06-18 | 珠海格力电器股份有限公司 | Monitoring method and device, storage medium and household appliance |
| CN110111815A (en) * | 2019-04-16 | 2019-08-09 | 平安科技（深圳）有限公司 | Animal anomaly sound monitoring method and device, storage medium, electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021082196A1 (en) | 2021-05-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10964336B2 (en) | Systems for and methods of intelligent acoustic monitoring | |
| US9609441B2 (en) | Smart hearing aid | |
| CN106024016B (en) | Child nursing type robot and method for identifying crying of child | |
| Quervel-Chaumette et al. | Investigating empathy-like responding to conspecifics’ distress in pet dogs | |
| EP3109800A1 (en) | Human-computer interactive method based on artificial intelligence and terminal device | |
| CN110060685A (en) | Voice awakening method and device | |
| CN107003723A (en) | For the response selection in conversational system and the method and system of the automation of composition | |
| CN108935188A (en) | Pig disease identification method, apparatus and electronic equipment | |
| EP3923198A1 (en) | Method and apparatus for processing emotion information | |
| CN110111815A (en) | Animal anomaly sound monitoring method and device, storage medium, electronic equipment | |
| CN112487235A (en) | Audio resource playing method and device, intelligent terminal and storage medium | |
| Charlton | The acoustic structure and information content of female koala vocal signals | |
| Reber et al. | Common marmosets are sensitive to simple dependencies at variable distances in an artificial grammar | |
| CN103634457A (en) | Method for controlling alarm clock bell by using sound and electronic apparatus | |
| Löschner et al. | Marmoset monkeys use different avoidance strategies to cope with ambient noise during vocal behavior | |
| JP6861398B2 (en) | Information processing method and information processing device | |
| Beltrán et al. | Recognition of audible disruptive behavior from people with dementia | |
| CN110853294A (en) | Method and device for monitoring by using household appliance and computer storage medium | |
| KR102573186B1 (en) | Apparatus, method, and recording medium for providing animal sound analysis information | |
| CN112185364A (en) | Method and device for detecting baby crying | |
| Ma et al. | Power-law scaling of calling dynamics in zebra finches | |
| US11445704B1 (en) | Sound button device | |
| CN112583673B (en) | Control method and device for awakening equipment | |
| CN115299896A (en) | Vital sign monitoring method, equipment, system and storage medium | |
| CN110419460B (en) | Pet control method based on pet wearing equipment and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200228 |