KR101538756B1 - Mobile device and method for outputting sound wave to control external device, and the external device - Google Patents

Abstract

The mobile device includes an input receiver for receiving one or more inputs via a user interface, control information corresponding to an operation of the external device based on the one or more inputs, wherein the control information includes a first symbol and a second symbol A control information determination unit, a sound wave data generation unit that generates sound wave data corresponding to the control information, and an output unit that outputs sound waves corresponding to the generated sound wave data through the sound wave generation device. At this time, the sound wave data generator determines the first frequency corresponding to the first symbol, determines the second frequency corresponding to the second symbol, generates the sound wave data based on the first frequency and the second frequency, The sound wave data includes a portion corresponding to the first frequency and a portion corresponding to the second frequency.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a mobile device and a method for outputting a sound wave for controlling an external device,

A device and a method for outputting a sound wave including control information for an external device, and an external device.

Recently, smart home appliances such as a refrigerator, a washing machine, an oven, a vacuum cleaner, an air conditioner, and a TV having an internet connection function have appeared, and such smart home appliances are gradually becoming popular. These smart appliances can be updated online when new recipes or washing methods are added, or they can be remotely checked from outside. For example, in addition to a simple refrigeration or freezing function, there may be a refrigerator having functions such as shopping through the Internet, food product management, and the like.

On the other hand, in order to interoperate with Internet access and other devices, such a smart home appliance is required to connect to an access point (AP) such as a wireless router on a home network. However, current smart home appliances have a disadvantage that input of data for network setting is complicated and cumbersome because of limited functions due to restriction of screen and input devices, hardware specifications, software specifications, and the like. Accordingly, there is a need for a method of controlling the operation of a smart home appliance without connection to a wireless router on the home network. Korean Patent Laid-Open Publication No. 2006-0089854 discloses a system configuration for controlling the operation of household appliances using a home gateway connected to the external Internet.

It is desired to control the operation of an external device such as a home appliance through a mobile device without a network connection through a separate wireless connection device. And to control the operation of the external device using the sound wave data output through the mobile device. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may be present.

According to an aspect of the present invention, there is provided an information processing apparatus including an input receiving unit for receiving at least one input through a user interface, a control unit for determining control information corresponding to an operation of the external device based on the at least one input, Wherein the control information includes a first symbol and a second symbol, a sound wave data generation section that generates sound wave data corresponding to the control information, and a sound wave generation section that generates the sound wave Wherein the sound wave data generation unit determines a first frequency corresponding to the first symbol, determines a second frequency corresponding to the second symbol, and outputs the second frequency corresponding to the first frequency, And generating the sound wave data based on the second frequency, wherein the sound wave data is generated from the first frequency And a portion corresponding to the second frequency, wherein the portion corresponding to the first frequency and the portion corresponding to the second frequency.

Another embodiment of the present invention provides a method for controlling an external device, comprising receiving at least one input via a user interface, determining control information corresponding to an operation of an external device based on the at least one input, Generating sound wave data corresponding to the control information, and outputting sound wave data corresponding to the generated sound wave data through the sound wave generator, wherein the sound wave data generating means generates the sound wave data Determining a first frequency corresponding to the first symbol, determining a second frequency corresponding to the second symbol, and generating the sound wave data based on the first frequency and the second frequency And the sound wave data includes a portion corresponding to the first frequency and a portion corresponding to the second frequency. It can provide a file output method.

According to another embodiment of the present invention, there is provided an information processing apparatus including a sound wave receiving unit for receiving a sound wave output from a mobile device through a sound wave receiving apparatus, a control information obtaining unit for obtaining control information including an ID of the device using a sound wave, Wherein the control information obtaining unit determines the first frequency corresponding to the first portion of the sound wave, and determines the second frequency corresponding to the second portion of the sound wave, Generates a first symbol corresponding to the first frequency, generates a second symbol corresponding to the second frequency, and generates the control information based on the combination of the first symbol and the second symbol To obtain a device.

Yet another embodiment of the present invention is directed to an apparatus and method for operating a device, the apparatus comprising: an operation performing unit operable to perform an operation of the device; and generating status information of the device related to the operation, the status information including a first symbol and a second symbol. A sound wave data generation unit for generating sound wave data corresponding to the state information, and a sound wave output unit for outputting a sound wave corresponding to the generated sound wave data through a sound wave generator, Determining a first frequency corresponding to a first symbol, determining a second frequency corresponding to the second symbol, and generating the sound wave data based on the first frequency and the second frequency, Comprises a portion corresponding to the first frequency and a portion corresponding to the second frequency .

According to another embodiment of the present invention, there is provided a mobile communication terminal, further comprising: a sound wave receiving unit for receiving the sound wave output from the mobile device through the sound wave receiving apparatus; and a control information obtaining unit for obtaining control information using the received sound wave, And the control information obtaining unit determines the first frequency corresponding to the first portion of the sound wave and determines the second frequency corresponding to the second portion of the sound wave based on the control information, Generating a first symbol corresponding to the first frequency, generating a second symbol corresponding to the second frequency, and obtaining the control information based on the combination of the first symbol and the second symbol Lt; / RTI > device.

Yet another embodiment of the present invention is a method comprising: performing an operation of a device, generating state information of the device, wherein the state information comprises a first symbol and a second symbol; Generating sound wave data corresponding to the state information, and outputting a sound wave corresponding to the generated sound wave data through the sound wave generator, wherein the step of generating the sound wave data includes generating first sound wave data corresponding to the first symbol Determining a second frequency corresponding to the second symbol, and generating the sound wave data based on the first frequency and the second frequency, wherein the sound wave data corresponds to the first frequency And a portion corresponding to the second frequency.

According to any one of the above-mentioned objects of the present invention, it is possible to determine the control information corresponding to the operation of the external device based on the user's input. The sound wave data corresponding to the control information determined through the mobile device can be generated. The operation of the external device can be controlled using the sound wave data output through the mobile device. The operation of an external device such as a home appliance can be controlled by using the mobile device without connecting the network through the wireless connection device.

1 is a configuration diagram of a device control system according to an embodiment of the present invention.
2 is a configuration diagram of a mobile device according to an embodiment of the present invention.
3 is a diagram illustrating a process of transmitting control information from a mobile device according to an embodiment of the present invention.
4A to 4D are diagrams for explaining an example of a process of generating sound wave data.
5 is a flowchart illustrating an example of a process of decoding a sound wave.
6 is an operational flowchart for explaining another example of a process of decoding a sound wave.
7A to 7B are views for explaining an example of a process of decoding a sound wave.
8 is a flowchart for explaining another example of a process of decoding a sound wave.
9 is a configuration diagram of an external device according to an embodiment of the present invention.
10 is a configuration diagram of an external device according to an embodiment of the present invention.
11 is a flowchart illustrating an operation of outputting a sound wave according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

The following examples are intended to further illustrate the present invention and are not intended to limit the scope of the present invention. Accordingly, the same scope of the invention performing the same function as the present invention will also fall within the scope of the present invention.

1 is a configuration diagram of a device control system according to an embodiment of the present invention. Referring to FIG. 1, a device control system includes a mobile device 10 and an external device 20.

The mobile device 10 may receive one or more inputs via a user interface and determine control information corresponding to the operation of the external device 20 based on the received one or more inputs. For example, when the mobile device 10 receives an input to drag to a specific location, it may determine control information for operating the robot cleaner of the external device 20, and may input the input that shakes the mobile device 10 like a fan The control information for operating the air conditioner may be determined.

The mobile device 10 may generate the sound wave data corresponding to the control information and output the sound wave corresponding to the sound wave data generated through the sound wave generating device. For example, the mobile device 10 may encode control information for operating the predetermined robot cleaner and the ID of the robot cleaner as sound data, and output the sound wave encoded through the speaker.

The mobile device 10 may determine the additional information related to the control information of the external device 20 and may transmit the determined additional information in connection with the external device 20 via the network. For example, the mobile device 10 may transmit the additional information, such as the detailed temperature, in connection with the control information for controlling the operation of the refrigerator through the network connected with the external device 20.

The mobile device 10 may receive the sound wave output from the external device 20, generate control information corresponding to the received sound wave, and output a sound wave corresponding to the generated control information. At this time, the sound wave output from the external device 20 may include status information of the external device 20, and the status information may be at least one of the current status or the failure diagnosis information. One example of the current state includes the on / off state of the external device 20, the power use state, the operation time, and the like. The example of the failure diagnosis information includes the abnormality symptom occurrence information, the error code, and the failure site information.

The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. One example of such a network is a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) , A WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth (Bluetooth), a wireless LAN (Local Area Network) Networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like.

Meanwhile, the mobile device 10 may be implemented as a portable terminal capable of accessing a remote server through a network. Here, the portable terminal is a mobile communication device that is guaranteed to be portable and mobility. For example, a portable communication terminal such as a PCS (Personal Communication System), a GSM (Global System for Mobile communication), a PDC (Personal Digital Cellular), a PHS (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-CDMA (W-CDMA), Wibro (Wireless Broadband Internet) ) Handheld based wireless communication devices such as mobile phones, handsets, smartphones, smart pads, tablet PCs, and the like. However, since the type of mobile device 10 disclosed in FIG. 1 is merely an example for convenience of explanation, the types and forms of the calling terminal 20 and the receiving terminal 30, And the like.

The operation of the mobile device 10 will be described in detail again in FIG.

The external device 20 can receive the sound wave output from the mobile device 10 through the sound wave receiving device and obtain the control information using the received sound wave. For example, the external device 20 receives the sound code encoded from the mobile device 10 and output through the speaker of the mobile device 10, decodes the received sound code, Can be obtained.

The external device 20 can confirm the object of the control information based on the ID of the external device 20 and can perform an operation corresponding to the control information.

The external device 20 can be implemented as a smart home appliance capable of connecting various network functions and equipped with a service control function and various smart services. In general, smart home appliances can be automatically adjusted to achieve optimal performance, and can mean home appliances such as refrigerators, washing machines, air conditioners, ovens, and microwave ovens with built-in communication functions. However, since the external device 20 shown in FIG. 1 is merely an example for convenience of explanation, the type and the type of the external device discussed in the present application are not limited to those shown in FIG.

The external device 20 generates status information of the external device 20 in association with the operation while the external device 20 is operating, generates sound data corresponding to the generated status information, It is possible to output a sound wave corresponding to the data. Further, the external device 20 can receive the sound wave output from the mobile device 10 as a response corresponding to the outputted sound wave.

This operation of the external device 20 will be described in more detail with reference to the following drawings.

2 is a configuration diagram of a mobile device according to an embodiment of the present invention. 2, the mobile device 10 includes an input receiving unit 101, a control information determining unit 102, a sound data generating unit 103, an output unit 104, a communication unit, and a display unit 106.

The input receiving unit 101 receives one or more inputs through a user interface. The user interface includes, but is not limited to, one or more of an interface for recognizing the movement of the mobile device 10, an interface for recognizing the user's movement and motion through the camera, a touch panel interface, a hardware button input interface and a voice recognition interface .

For example, the input receiving unit 101 may receive an input that draws a screen or draws a circle through the touch panel, and may receive an input that shakes the mobile device 10 like a fan. Meanwhile, the input receiving unit 101 may receive different inputs through the first user interface and the second user interface. For example, a touch input may be received through the touch panel and a voice of a user may be received through voice recognition.

The control information determination unit 102 determines control information corresponding to the operation of the external device 20 based on one or more inputs inputted through the input reception unit 101. [ For example, when the control information determination unit 102 receives an input that draws a screen or draws a circle through the touch panel, the control information determination unit 102 can determine control information for controlling the robot cleaner in the external device 20 to operate, When receiving an input that shakes the device 10 like a fan, it can determine control information that controls the air conditioner to operate. One example of the determined control information is on / off of the power supply of the external device 20, temperature control of the refrigerator in the external device 20, operation time adjustment of the air conditioner, movement path adjustment of the robot cleaner, But is not limited thereto, and various control information can be determined.

The control information determination unit 102 can receive the sound wave output from the external device 20 and generate control information corresponding to the received sound wave. At this time, the output sound wave may include status information of the external device 20, and the control information determination unit 102 may generate control information based on the status information. For example, the control information determination unit 102 recognizes that there is a problem with the external device 20 based on the status information of the external device 20, Can be generated.

The sound wave data generation section (103) generates sound wave data corresponding to the determined control information. For example, the sound wave data generation unit 103 may generate control information determined through a multi tone based encoder as sound wave data. Multitone-based encoders have the advantage of increasing the amount of information in a character, and currently can represent up to 64 characters and numbers. In addition, a multitone-based encoder can use a frequency of 200 Hz interval which is strong against peripheral interference and can represent a lot of information, and can have a protocol structure of header, body, and error correction.

In another example, the sound wave data generation section 103 may generate control information as sound wave data through an encoder using the non-audible frequency band. An encoder using the non-audible range can obtain a stable recognition rate even in a noisy environment by synthesizing a pure tone of the non-audible range. As will be described below, generating a sound signal or a sound code corresponding to one frequency is expressed as pure tone-based encoding, and generating a sound signal or sound code corresponding to two or more frequencies is a multi- Based encoding.

In the method for generating the sound wave data in the sound wave data generation unit 103, the sound wave data generation unit 103 generates the predetermined code by mapping the determined control information for each frequency, combining the calculated control information with the pure tone in the non- The non-audible sound wave data can be generated by applying a protocol having an error correction code to the generated predetermined code. On the other hand, the sound wave data generation unit 103 may generate the sound wave data by mapping control information by frequency and applying a protocol having an error correction code. The sound wave data generation unit 103 may generate the sound wave of the generated non-audible sound wave "sound wave of control information from the smartphone is being transmitted to the air conditioner" or sound wave synthesized with music. The sound wave data may be mixed with a sound code, a sound QR code, or the like.

The sound wave data generating unit 103 may generate the control information and the sound wave data corresponding to the ID of the external device 20. [ At this time, the external device 20 may be selected as a destination of a sound wave among the plurality of external devices 20. [ For example, the sound wave data generation unit 103 generates sound wave data corresponding to the ID of any one of the external devices 20, and generates sound wave data for a device that wants to transmit the control information . In other words, the sound wave data generation unit 103 can select the sound wave data including the ID of the refrigerator among the plurality of external devices 20. As a result, it is possible to generate the sound wave data for transmitting the control information by selecting the external device 20 to control only the refrigerator.

The sound wave data generating unit 103 generates a plurality of pieces of partial information corresponding to the control information, determines a plurality of frequencies corresponding to the generated plurality of pieces of partial information, and outputs a sound signal corresponding to each of the determined plurality of frequencies to a predetermined time It is possible to generate the sound wave data corresponding to the control information.

The control information may include a plurality of pieces of partial information. At this time, the partial information may be a symbol included in the control information. One example of a partial information or symbol is at least one of a letter such as 'a', 'a', a number such as '1', '2', and a symbol (or sign). In addition, letters can be used as a superordinate concept including numbers and symbols (or symbols), and also alphanumeric, alphanumeric characters can be used as superordinate concepts including at least one of letters, numbers and symbols have.

The sound wave data generating unit 103 can determine a frequency corresponding to each of the plurality of pieces of partial information. For example, the sound wave data generation unit 103 may divide the total bandwidth 5000Hz between 16000 Hz and 21000 Hz, which is the non-audible sound band frequency, in units of 200 Hz to divide 25 frequencies, And determines each of them as a frequency corresponding to each of the 25 pieces of partial information. For example, the frequency of the first symbol 'A' of the control information 'AB2 @' is determined to be 16000 Hz, the frequency of the second symbol 'B' is determined to be 16200 Hz, The frequency of the third symbol '2' may be determined to be 16400 Hz, and the frequency of the fourth symbol '@' may be determined to be 17000 Hz.

The sound wave data generation unit 103 may determine a first frequency corresponding to the first symbol and a second frequency corresponding to the second symbol. In this case, the first symbol and the second symbol may be included in the control information. As such, one meaningful data (e.g., control information) is mapped to each of a plurality of symbols by the sound wave data generation unit 103, and each of the plurality of symbols can be mapped to each of a plurality of frequencies. At this time, the symbol may be selected from a specific symbol set (or a specific code set). In one example, the symbol may be selected from a plurality of symbols included in the set of ASCII codes (e.g., ASCII codes). In this case, the ASCII code set includes alphanumeric characters such as 'a' to 'z', numbers such as '0' to '9', special characters such as '!' And '?', 'A' to 'Z' (Or sign) such as '+', '=', and so on. Table 1 shows an example of a plurality of symbols included in the ASCII code.

[Table 1]

In another example, the symbol may be selected from a plurality of symbols included in the Hex code set. At this time, each of the symbols may be any one of 16 symbols such as '0' to '9', 'A' to 'F' included in the first Hex code set. In addition, each of the symbols includes '00', '01', ..., '0A', '0B', ..., '20', '21', ..., May be any one of 256 symbols such as 2A, 2B, ..., FE, and FF. Each symbol in the second Hex code set may include 16 symbols included in the first Hex code set as symbol elements. That is, as with each symbol of the second Hex code set, a specific symbol may be composed of two or more symbol elements, and the symbol elements may be any of letters, numbers, symbols (or signs). Table 2 shows an example of symbols included in the first Hex code set. In this case, the first Hex code set includes 'L' and 'G' for header, tail, continuous code (or redundant code) in addition to 16 symbols such as '0' And so on.

[Table 2]

Table 3 shows an example of symbols included in the second Hex code set. At this time, the second set of Hex codes is '00', '01', ..., '0A', '0B', ..., '20', '21', ..., '2A' 5 'codes such as' L ',' G ', etc. for header, tail, continuous code (or redundant code) in addition to 256 symbols such as 2B', ..., 'FE' have.

[Table 3]

As another example, the symbol may be selected from a plurality of symbols included in the binary code set. In this case, the binary code set may be any one of the first to Nth binary code sets according to the number of bits. Also, each binary code set may have a different number of symbols depending on the number of bits. Table 4 shows an example of the first to Nth binary code sets. As shown in Table 4, the first binary code set having one bit includes two symbols of '0' and '1', and the second binary code set having two bits includes '00' to '11' An Nth binary code set having N bits may include 2 ^N symbols such as '00 ... 00' to '11 · 11'. According to an embodiment of the present invention, the sound wave data generation unit 103 may select any one code set among a plurality of code sets, and may include information on a code set in the control information .

[Table 4]

The sound wave data generating unit 103 can select a frequency corresponding to each of a plurality of symbols included in the control information from a plurality of frequencies. At this time, a plurality of frequencies may be included in a predetermined frequency set. The plurality of frequencies may be arranged to have a constant frequency interval from the lowest frequency to the highest frequency among the plurality of frequencies. 16000Hz ',' 16200Hz ', and' 16000Hz 'arranged to have a frequency spacing of 200Hz from the lowest frequency 16000Hz to the highest frequency 24000Hz when a plurality of frequencies are to be selected within a range of equal to or greater than 16000Hz and less than or equal to 24000Hz, '16400 Hz', ..., '23600 Hz', '23800 Hz', and '24000 Hz'.

An example of determining the frequency interval will be described. The sound wave data generating unit 103 may determine a frequency interval (or a frequency step) in a manner similar to Equation (1) using a sample rate and an FFT point value. At this time, the sample rate may mean the number of times of sampling per second when recording a sound. For example, if the sample rate is 1000 Hz, it means that the sampling is performed at a cycle of 1000 times per second. Generally, the higher the sample rate, the better the sound quality, but the capacity of the stored file becomes larger. The sample rate may be determined by default, or it may be input from a user or an administrator, but it may be a sample rate for voice / music data output with the sound code itself or the sound code. In addition, the FFT (Fast Fourier Transform) point may mean the number of frequencies input during the FFT, but is not limited thereto. The FFT point may be determined by default or may be input from a user or an administrator, but may also be a sound code itself or an FFT point for audio / music data output with the sound code. Meanwhile, Table 5 shows an example of a frequency step determined according to the sample rate and the FFF point.

[Equation 1]

[Table 5]

Referring to Table 5, if the sample rate is '48000 Hz' and the FFT point is '1024', the frequency interval may be '46.875 Hz'. In this case, when the lowest frequency is' 16000 Hz ', a plurality of frequencies are' 16000 Hz ',' 16046.88 Hz ', ...,' 19750 Hz ', and' . ., '39953.13 Hz' (frequency when i is 511). In this case, when a plurality of frequencies should be selected within a range of equal to or greater than 16000 Hz, which is the non-audible frequency band, and less than or equal to 24000 Hz, the highest frequency among the plurality of frequencies is' 23968.75 Hz '.

&Quot; (2) "

[Table 6]

The sound wave data generation unit 103 can determine a frequency corresponding to each of the plurality of symbols. For example, when a plurality of symbols are selected from a plurality of symbols included in an ASCII code (e.g., ASCII code) set and a plurality of frequencies are determined as listed in Table 6, the sound wave data generating section 103 A frequency corresponding to each of a plurality of symbols can be determined as shown in Table 7.

[Table 7]

The plurality of frequencies exemplified above may be frequencies included in the non-audible sound wave frequency band (or non-audible frequency band). That is, according to an embodiment of the present invention, the plurality of frequencies may be frequencies included in the non-audible sound wave frequency band. An example of a non-audible sound frequency band may be a frequency band in the range of 16000 Hz to 24000 Hz. However, the present invention is not limited thereto. For example, another example of a non-audible sound wave frequency band may be a frequency band in the range of 17000 Hz to 24000 Hz.

According to another embodiment of the present invention, the plurality of frequencies may be frequencies included in an audible sound wave frequency band (or audible frequency band). One example of an audible sound wave frequency band may be a frequency band in the range of 1700 Hz to 12000 Hz. However, the present invention is not limited thereto. For example, another example of an audible sound wave frequency band may be a frequency band within a range of 100 Hz to 8000 Hz.

If a plurality of frequencies are included in the audible sound wave frequency band, a plurality of frequencies mapped to each of the plurality of symbols may be as shown in Table 8. [ At this time, when the sample rate is 48000 Hz and the FFT point is 1024, the frequency interval is determined to be 46.875 Hz according to Equation (1), and the lowest frequency is 1734.38 Hz included in the range of 1700 Hz to 12000 Hz . ≪ / RTI > Further, the plurality of symbols can be determined from all or a part of the ASCII code.

[Table 8]

The sound wave data generating unit 103 can generate a plurality of sound signals corresponding to each of the plurality of frequencies. For example, the sound wave data generating section 103 may generate a first sound signal corresponding to the first frequency and a second sound signal corresponding to the second frequency. The sound wave data generating section 103 may generate a sinusoidal sound wave signal having a frequency as a center (or fundamental) frequency or a carrier frequency as a sound signal. For example, the sound wave data generating unit 103 may generate a sinusoidal sound wave signal having a frequency of 16000 Hz as a fundamental frequency.

The sound wave data generation unit 103 generates sound wave data corresponding to the control information by combining or arranging a plurality of sound signals at predetermined time intervals. At this time, each of the sound signals arranged in accordance with the time interval may be constituted by each frame of the sound code.

The sound code may include a header, a body, and a tail. In this case, the body may include a plurality of sound signals, and the header may include additional sound signals (or additional sound codes) corresponding to the additional information such as identification information of the encoding apparatus and identification information of the decoding apparatus. (Or an error correction sound code) corresponding to an error correction code such as a cyclic redundancy check.

According to an embodiment of the present invention, the sound wave data generation section 103 may classify the audible sound frequency band corresponding to the sound and the non-audible sound frequency band corresponding to the sound code, Can be generated and output. The audible sound frequency band may be a frequency band in the range of 1700 Hz to 12000 Hz and the non-audible sound frequency band may be a frequency band in the range of 16000 Hz to 24000 Hz.

The output unit 104 can output a sound wave corresponding to the sound wave data generated through the sound wave generator. The output unit 104 may output a sound wave corresponding to the sound data generated through the sound wave data generation unit 103 and a sound wave corresponding to the music data encoded with the stored music. The output unit 104 may output a sound wave corresponding to the sound wave data in the non-visible region. For example, the output unit 104 can output a sound wave through a speaker which is a sound wave generating device of the mobile device 10. [ The sound wave output through the speaker may be a sound file of a non-audible range that can not be heard by the user, and may be a sound file whose radio access device information is mapped to a predetermined frequency band. On the other hand, the sound waves may be in a form corresponding to the music data previously stored in the mobile device 10. [

The sound wave output through the output unit 104 is input to the sound wave receiving apparatus of the external device 20 and the external device 20 can acquire the control information by using the sound wave. Then, the external device 20 can perform an operation corresponding to the control information based on the obtained control information. For example, the external device 20 receives a sound wave output through an output unit through a microphone, which is a sound wave receiving apparatus, and decodes the input sound wave to acquire the ID and control information of the external device 20, It is possible to confirm that the device is the target of the control information through the ID of the device 20, and to perform the operation corresponding to the control information.

Although not shown in the figure, the mobile device 10 may further include an input unit (not shown) for receiving a sound wave generated from the external device 20 through a sound wave receiving apparatus. At this time, the sound waves may correspond to the current operation state of the external device 20 and the status information such as the trouble diagnosis information. As described above, the control information determination unit 102 can generate the control information based on the sound waves input through the input unit (not shown). As described above, according to an embodiment of the present invention, when the external device 20 outputs a sound wave informing its own state, the mobile device 10 can output a sound wave corresponding to the control information as a response thereto.

The control information determination unit 102 may generate state information by decoding or interpreting a sound wave generated from the external device 20. [ The contents that are not described in relation to the operation of the control information determination unit 102 are the same as or very similar to those described for the operation of the control information acquisition unit 202 in FIG. 4, The contents of the operation of the unit 202 are applied as they are. However, when applied, the 'control information' in the description of the control information obtaining unit 202 is regarded as 'status information'.

According to another embodiment of the present invention, the mobile device 20 first outputs control information, and the external device 10 may output a sound wave corresponding to its own status information in response thereto.

According to another embodiment of the present invention, the mobile device 10 may further include a communication unit 105 for transmitting and receiving a radio signal corresponding to the wireless communication standard with the external device 20. [ In this case, the wireless communication standard may be any one of Wi-Fi, Near Field Communication (NFC), Bluetooth, Zigbee, and Radio Frequency Identification (RFID) .

The communication unit 105 can transmit the determined control information to the external device 20, for example, by activating the NFC tag and approaching the activated NFC tag to the external device 20. [ At this time, the external device 20 can perform an operation corresponding to the control information based on the control information transmitted through the NFC tag.

In another example, the communication unit 105 may transmit control information to the external device 20 by pairing with the external device 20 via Bluetooth. The external device 20 can perform an operation corresponding to the control information based on the control information transmitted through the Bluetooth.

On the other hand, when the communication unit 105 receives the radio signal including the response to the sound wave output through the output unit 104, the control information determination unit 102 may generate the control information corresponding to the response. For example, the control information determination unit 102 determines, based on the current operation state information of the external device 20 received from the external device 20 via the communication unit 105, control information for controlling the operation of the device You can decide.

The control information determination unit 102 further determines the additional information related to the control information and may transmit the wireless signal corresponding to the additional information determined through the communication unit 105 to the external device 20. [ The additional information may be information for controlling the operation of the external device 20 in more detail, such as setting the operation temperature of the refrigerator or setting the operation time of the air conditioner.

The control information determination unit 102 may determine the control information based on the first input inputted through the first user interface and determine the additional information based on the second input inputted through the second user interface. In other words, the control information determination unit 102 can receive different inputs, determine the first input as control information, and determine the second input as additional information. For example, the control information can be determined based on the input that is dragged through the touch panel, and the additional information can be determined based on the voice input from the user.

The control information determined through the control information determination unit 102 is generated as sound wave data and outputted as a sound wave through the sound wave generator to be transmitted to the external device 20. The determined additional information is transmitted to the external device 20 ). ≪ / RTI >

The display unit 105 displays one or more of the ID of the external device 20, the ID of the mobile device 10, the current status of the external device 20, and the failure information of the external device 20 on the display of the mobile device 10 Can be displayed. The information displayed through the display unit 105 may be a sound wave outputted from the external device 20 and received by an input unit (not shown), or may be transmitted by a radio signal and received by the communication unit 105.

3 is a diagram illustrating a process of transmitting control information from a mobile device according to an embodiment of the present invention. Referring to FIG. 3, the mobile device 10 receives a user's input through a user interface (S301) and determines control information based on the received input (S302). The mobile device 10 generates sound wave data based on the ID of the external device 20 to be controlled and the determined control information (S303), and outputs the sound wave generated through the speaker (S304). The sound wave output may be a sound wave in the audible frequency range or a sound file in the audible frequency range. The outputted sound wave may be in a form combined with predetermined music or voice pre-stored in the mobile device 10. [

The external device 20 receives the sound wave output through the sound wave receiving device and analyzes it (S305) to acquire the ID and control information of the external device 20, and performs an operation corresponding thereto based on the obtained control information (S306). The external device 20 does not perform the operation when the ID of the external device 20 is not itself.

The external device 20 receives the sound wave output through the sound wave receiving apparatus, divides the sound wave into a plurality of frames at predetermined time intervals, and performs frequency analysis on each of the plurality of frames to obtain a frequency corresponding to each of the plurality of frames And generate control information corresponding to the sound wave based on the plurality of symbols corresponding to the identified frequency. In this case, for frequency analysis, the external device 20 performs fast Fourier transform to convert a time signal into a frequency signal. The ideal Fourier transform is taken on infinitely long samples to transform data on the time axis into data on the frequency axis. However, in actual implementation, it is impossible to take an infinite length sample and process it, so try frequency analysis on a frame-by-frame basis. At this time, spectrum leakage occurs and unintended frequency components can be detected together. In addition, if the sufficient number of cycles of the sound wave is not guaranteed in the analysis frame, or if the length of the analysis frame and the periodicity of the sound wave do not exactly match, the observed spectrum may be attenuated in size. This attenuation phenomenon may cause the phenomenon that the actual signal component (or the main lobe) becomes smaller than the peripheral signal component (or the side lobe) due to the interference with the spectral leakage, thereby lowering the recognition rate.

4A, the signal of reference numeral 401 corresponds to the fact that the periodicity of the sound wave coincides with the frame length (reference numeral 403 or 404) so that the actual signal component (or main lobe) can be accurately detected, The signal 402 has a periodicity of the sound wave that does not coincide with the frame length, so that the size of the actual signal component (or the main lobe) can be attenuated relative to the surrounding signal component (or side lobe) by the spectral leakage. Such a peripheral signal component (or a side lobe) may interfere with a real signal component (or main lobe) to lower the recognition rate for a real signal component (or main lobe).

According to an embodiment of the present invention, when mapping a plurality of frequencies to a plurality of symbols, the sound wave data generation unit 103 may have a plurality of frequencies each having an up and down margin frequency. For example, after the plurality of frequencies are determined as shown in Table 6, if the frequency of any one of the plurality of symbols is determined to be the first frequency, Can be selected as the blank frequency. In addition, the sound wave data generating unit 103 may not use the blanking frequency for mapping with a plurality of symbols. As a result, the plurality of frequencies are arranged in the order of frequency (or mapping frequency) mapped to the symbol, frequency (or blanking frequency) not mapped to the symbol, frequency mapped to the symbol, frequency mapped to the symbol . As shown in Table 6, if the frequency 16468.75 Hz when i = 10 is mapped to the first symbol, the frequency is 16421.88 Hz when i is 9 and the frequency is 16515.63 Hz when i is 11, And the frequency mapped to the second symbol may be a frequency of 16375 Hz when i is 8 or a frequency of 16562.5 Hz when i is 12. In this context, the frequency mapped to the third symbol may be 16281.25 Hz for i = 6 or 16656.25 Hz for i = 14.

4B, the sound wave data generation unit 103 determines the frequency of each symbol included in the control information 'AA ... A3' composed of N symbols, and outputs the determined frequency (Or sound signal, partial data) corresponding to each of them. More specifically, the sound wave data generating unit 103 generates a signal 405 corresponding to the frequency '16700 Hz' of the first symbol 'A' of the control information and generates a signal 405 of the frequency '16700 Hz' Generates a signal 406 corresponding to the frequency '16700Hz' of the (N-1) th symbol 'A' of the control information, and generates a signal 407 corresponding to the frequency ' To generate a signal 408 corresponding to < RTI ID = 0.0 > 16850Hz. ≪ / RTI > As described above, the sound code (or sound wave data) can be generated by combining the thus generated signals (or sound signals, partial data) according to time intervals. At this time, the signal (or sound signal, partial data) and the sound code (or sound wave data) may be frequency signals. However, the signal (or the sound signal, the partial data) and the sound code (or the sound wave data) may be a time signal converted from the frequency signal (for example, a sinusoidal signal having a specific frequency as a center frequency) Or the sound signal, the partial data) and the sound code (or the sound wave data) can be converted into the time signal converted from the frequency signal through the inverse Fourier transform.

According to an embodiment of the present invention, the sound wave data generation section 103 may determine a plurality of frequencies (e.g., first frequency and second frequency) corresponding to the first symbol and may correspond to a plurality of frequencies (Or the first sound signal, the first partial data). Likewise, the sound wave data generation section 103 determines a plurality of frequencies (for example, a third frequency and a fourth frequency) corresponding to the second symbol, and generates a second signal corresponding to the plurality of frequencies can do. In this manner, the sound wave data generation unit 103 can allocate or map two or more frequencies per symbol, and generate individual signals based on two or more frequencies. Assigning two frequencies per information makes it possible to represent more information than assigning one frequency per existing information. Also, in this specification, generating one signal (or sound signal, partial data) or sound code (or sound wave data) corresponding to one frequency is referred to as a pure tone encoding technique, and one corresponding to two or more frequencies Lt; / RTI > may be expressed as a multi-tone encoding technique.

4C, the sound wave data generation unit 103 determines a plurality of frequencies of each symbol included in the control information 'Az ... A3' composed of N symbols, It is possible to generate a signal corresponding to a plurality of determined frequencies. For example, the sound wave data generating unit 103 may assign or map the first symbol 'A' to both the first frequency '16700 Hz' and the second frequency '17000 Hz', and the first frequency ' Signal 409 and generates a second sub signal 410 having a second frequency as a fundamental frequency and generates a first sub signal 409 and a second sub signal 410 based on the generated first sub signal 409 and second sub signal 410, Signal can be generated. The sound wave data generation unit 103 allocates or maps both the first frequency '16700 Hz' and the third frequency '17000 Hz' to the first symbol 'z' and outputs the third sub signal having the first frequency as a fundamental frequency 411), generates a fourth sub signal 412 having the 23rd frequency as a fundamental frequency, and generates a second signal based on the generated third sub signal 411 and the second sub signal 412 can do.

When the external device 20 receives the sound wave through the microphone, echo is generated due to the acoustic characteristics of the surrounding space, and decoding of the sound wave may become difficult. That is, the previously outputted sound wave may invade the sound wave region to be output later, thereby confusing the frequency detection. For example, if symbol 'A' is mapped to frequency '10000 Hz', symbol 'B' to frequency '20000 Hz', symbol 'C' to frequency '30000 Hz', and symbol 'D' to frequency '40000 Hz' When the sound wave corresponding to the control information 'ABCD' is outputted by the mobile device 10, the external device 20 can recognize 'ABBD' or 'AACD' which is a result of erroneous decoding due to the echo component.

According to an embodiment of the present invention, the sound wave data generation unit 103 may use a continuous symbol (or a redundant symbol) to notify that the same symbol is consecutively emitted. That is, the sound wave data generation unit 103 determines the rule that "the previous code and the current code can not be the same", and when the actual control information is duplicated like 'AACD' A continuous symbol (or a redundant symbol) can be selected in place of the symbol 'A'. For example, the sound wave data generation unit 103 generates the sound wave data 103 using the frequency of '10000 Hz', the frequency of '20000 Hz', the frequency of 'C', and the frequency of 'D' A $ CD ',' A $ CD ',' A $ CD ', and' A $ CD ', and' A $ CD 'if the continuous symbol (or redundant symbol) $ Cd 'can be generated.

According to an embodiment of the present invention, the sound wave data generation unit 103 generates sound wave data (or sound) by performing pulse shaping on sound wave data (or sound code) Code). Pulse shaping is an example of a signal processing process and pulse shaping minimizes the spectral leakage of sonic data (or sound code) and minimizes spectral leakage of sonic data (or sound code) Or inter-symbol interference of the sound wave data (or sound code) can be eliminated or minimized. Also, pulse shaping is suitable for controlling the sound of the audible area. The windows used for such pulse shaping are variable and include, for example, a Hanning window or a Tukey window.

According to an embodiment of the present invention, the sound wave data generation unit 103 may generate at least two or more signals corresponding to symbols, thereby generating a signal group corresponding to the symbols. At this time, the sound wave data generating section 103 generates at least two or more signals (for example, five consecutive times) corresponding to the symbols and having the first time, thereby generating a signal Groups can be created. Also, the second time may be greater than the first time. In one example, if the second time is 50 ms, the first time may be 10 ms less than the second time. Also, in this case, the signal group may include five signals. Also, according to an embodiment of the present invention, a signal is expressed as a sub signal, and a signal group may be expressed as a signal including a plurality of sub signals.

Referring to FIG. 4D, the sound wave data generation unit 103 determines a frequency '16700 Hz' corresponding to the first symbol, and successively generates five signals corresponding to the frequency '16700 Hz' and having a time of 10 ms , The signal group 413 corresponding to the frequency '16700 Hz' and corresponding to the time of 50 ms can be generated. Similarly, the sound wave data generating unit 103 determines the frequency '16800 Hz' corresponding to the second symbol, and successively generates five signals corresponding to the frequency '16800 Hz' and having a time of 10 ms, To generate a signal group 414 corresponding to a time of 50 ms. In other words, according to an embodiment of the present invention, the sound wave data generation unit 103 determines a frequency '16800 Hz' corresponding to the second symbol, and generates a sub signal 5 'corresponding to the frequency' 16800 Hz ' By successively generating a signal 414 corresponding to the frequency '16700 Hz' and corresponding to a time of 50 ms. Also, the first time mentioned above may be a unit time for distinguishing frames.

5 is a flowchart illustrating an example of a process of decoding a sound wave. 5, when the sound wave output from the mobile device 10 is input (S501), the external device 20 (or the internal module of the external device 20) divides the sound wave into a plurality of frames (S502 , The fast Fourier transform for the divided frames is performed (S503), the decoding process is performed based on the conversion result (S504), and the result is generated (S505). At this time, the result may be control information.

6 is an operational flowchart for explaining another example of a process of decoding a sound wave. 6, the external device 20 (or an internal module of the external device 20) may further perform steps S601 to S603 between steps S502 and S503 of FIG. In step S601, the external device 20 converts the audio frequency band into the stop band and the non-audible frequency band from the passband (" passband ") to extract the signal of the non- Pass band) can be used. The sound waves passing through the high-pass filter can have only components of the non-audible frequency band. Also, in step S601, the external device 20 can amplify the signal passed through the filter within the expressible quantization range.

In step S602, the external device 20 may perform normalization (or amplitude normalization). To this end, the external device 20 may change the weight value in real time by using the ratio of the largest value of the frame of the input sound wave to a predetermined reference value. In this case, one example of the reference value is a half value of the maximum amplitude of quantization. The use of the half value of the maximum quantization size as a reference value is necessary because both the non-audible and audible areas must be considered. When the sound wave is quantized to 16 bits, the representable range is -2 ¹⁵ to (2 ¹⁵ - 1), and the external device 20 sets the signal size to the maximum within the quantization range expressible for FFT scaling in S503 Can be amplified.

In step S603, the external device 20 may add the sound wave source and the original sound wave source output from the filter. Accordingly, the frequency components of the audible frequency band and the non-audible frequency band can be configured to have the same ratio size. The reason for adding the original sound wave source is that it is difficult to decode the audible band because the frequency band of the audible band is hardly present in the signal passing through the filter. By adding the original sound source at a certain rate, it is possible to decode both the audible and non-audible areas.

By performing steps S601 to S603, the external device 20 can compensate for the disadvantage of the scaling of the fixed-point FFT algorithm that can occur when performing only the step of Fig. The magnitude and frequency configuration of the input signal at various times induces a serious error in the FFT scaling process, which makes it difficult to ensure a consistent recognition rate. Simply amplifying the magnitude of the input signal can not be a solution because the input signal of the audible region has a larger value than that of the input signal of the non-audible region, so that before the frequency component of the non- The overflow of the amplified signal occurs and the meaning of amplification is lost.

The external device 20 extracts the signal of the non-audible area and the signal of the audible area separately using the filter, amplifies the maximum possible in each area, adds the two sound sources, and obtains the maximum effective bit for scaling of the FFT Thus, the recognition rate can be improved without a large increase in the amount of computation, as compared with performing only the steps of Fig.

7A to 7B are views for explaining an example of a process of decoding a sound wave. The external device 20 may detect a header symbol or a tail symbol through a corresponding plurality of frames of the sound wave prior to performing the decoding process (or decoding algorithm).

7A, when the external device 20 recognizes two or three symbols preceding the symbol group 71 corresponding to the first header, the external device 20 can determine that the first header symbol is recognized. In addition, the external device 20 may determine that the first header symbol is recognized if two or three consecutive frames have the same frequency component of the spectral peak value. At this time, the external device 20 may know the frequency component of the first header symbol in advance to determine that two or three consecutive frames have the same frequency component of the spectral peak value. Also, when the external device 20 recognizes two or three symbols preceding the symbol group 72 corresponding to the second header, it can determine that the second header symbol is recognized. In addition, the external device 20 can determine that the second header symbol is recognized if two or three consecutive frames have the same frequency component of the spectral peak value.

Similarly, when the external device 20 recognizes two or three preceding symbols among the group of symbols corresponding to the tail, it can determine that the tail symbol is recognized. Also, the external device 20 can determine that the tail symbol is recognized when two or three consecutive frames have the same frequency component of the spectral peak value.

The external device 20 may perform a decoding process (or decoding algorithm). First, when the header is detected, the external device 20 can estimate and store the time at which the actual data starts. 7A, when the first header symbol group (or the first header symbols) is detected and the second header symbol group (or the second header symbols) is detected, the external device 20 transmits the control information It can be predicted that the time at which the corresponding data (or body) starts is approximately the second header symbol and is after 20 ms.

When the data (or the body) starts, the external device 20 may divide the image data into a predetermined number of frames by a predetermined number of frames until a tail (or a tail group or a tail symbol) is detected, and store the image data in an ordered pair. 7B, the external device 20 arranges each of the five symbols included in the symbol group 74 in a code group, arranges each of the five symbols included in the symbol group 75 in a code group The symbol group 76 and the symbol group 77 may be similarly performed and the fifth symbol included in the checksum symbol group 78 may be arranged in the code group.

Thereafter, the external device 20 determines whether there is a consecutive symbol (or duplicate symbol) for each code group, restores the original symbol if it exists, checks whether the checksum is correct in each code group, And the largest code group among the selected code groups can be selected as the final code group. The external device 20 can confirm or generate the control information through the symbols in the finally selected code group.

8 is a flowchart for explaining another example of a process of decoding a sound wave. 8, the external device 20 (or the internal module of the external device 20) determines whether the input sound wave is completely recorded (S801). If the sound wave is completed, the sound wave is divided into a plurality of frames (Step S802), performs filtering on a plurality of divided frames (S803), performs FFT on the basis of the filtered result (S804), performs spectrum analysis on the FFT result (S805) Based on the result, the header and the tail can be detected (S806). 8, the external device 20 determines whether a header is detected (S807). If a header is detected (S808), the external device 20 determines whether a tail is detected. If no tail is detected, the external device 20 performs frame symbol grouping S809), symbol data for the code group is generated (S810), and when a tail is detected, restoration of the echo symbol is performed based on the symbol data (S811), and checks are performed for each of the plurality of code groups , Selects a code group matched with the checksum, selects a code group having the largest cumulative spectrum energy as the final code group (S812), and outputs a result (for example, control information) based on the selected final code group (S813).

9 is a configuration diagram of an external device according to an embodiment of the present invention. 9, the external device 20 includes a sound wave receiving unit 201, a control information obtaining unit 202, and an operation performing unit 203. However, the configuration of the external device 20 shown in Fig. 9 is not limited to those described above.

The sound wave receiving unit 201 receives sound waves output from the mobile device 10 through the sound wave receiving apparatus. For example, the sound wave receiver 201 may receive sound waves output from the mobile device 10 through a microphone device. The sound waves received through the microphone can be sound files in the audible and audible areas of the non-audible range, and sound files encoded with music or voice.

The control information obtaining unit 202 obtains the ID and control information of the external device 20 using the sound waves. The control information obtaining unit 202 divides the sound wave input through the sound wave receiving apparatus into specific frames and converts the sound waves into frequency domains and analyzes the entire frequency band of audible or non-audible frequencies through frequency analysis, And the control information included in the sound wave can be acquired by a method of confirming and correcting the error through the error correction algorithm that was performed in encoding the sound wave data. At this time, the control information may be a control command.

The control information obtaining unit 202 divides the sound wave into a plurality of frames at a predetermined time interval, identifies a frequency corresponding to each of the plurality of frames through frequency analysis for each of the plurality of frames, The control information corresponding to the sound wave can be generated based on the plurality of pieces of partial information.

The control information obtaining unit 202 can divide the sound wave into a plurality of frames at predetermined time intervals. For example, the control information obtaining unit 202 divides a sound wave into a plurality of frames according to a time interval of 10 ms. At this time, when the sound wave is a sound wave lasting 50 msec, the sound wave can be divided into five frames.

The control information obtaining unit 202 can identify a frequency corresponding to each of a plurality of frames through frequency analysis for each of a plurality of frames. In this case, each of the plurality of frames includes a sound signal of a predetermined frequency, and a frequency corresponding to each of the plurality of frames may denote a frequency of the sound signal. Generally, the plurality of frequencies can be selected within the range of 16000 Hz to 24000 Hz. In addition, the interval between the plurality of frequencies can be variously determined as 50 Hz, 100 Hz, and 200 Hz. In addition, the control information obtaining unit 202 can identify frequencies by analyzing peaks of frequencies for each of a plurality of frames.

The control information obtaining section 202 identifies, for example, 16000 Hz, which is the frequency of the sound signal contained in the first frame of the plurality of frames, and 17000 Hz, which is the frequency of the sound signal contained in the second frame have.

The control information acquisition unit 202 can identify the frequency through frequency analysis. To this end, the control information obtaining unit 202 can identify a frequency using an analog sound code, a frequency conversion technique for a sound signal of each of a plurality of frames or a plurality of frames, and an inverse frequency conversion technique. One example of the frequency conversion technique is Fast Fourier Transform (FFT), and an example of the inverse frequency conversion technique is IFFT (Inverse Fast Fourier Transform).

The control information obtaining unit 202 can generate control information corresponding to a sound wave based on a plurality of pieces of partial information corresponding to the identified frequencies. For example, the control information obtaining section 202 may be configured such that the sound code is composed of three frames, the frequency of the first frame is 15000 Hz, the frequency of the second frame is 15200 Hz, the frequency of the third frame is 17000 Hz , It is possible to generate partial information '0' corresponding to 15000 Hz, partial information '1' corresponding to 15200 Hz and partial information 'A' corresponding to 17000 Hz, respectively.

The control information obtaining unit 202 can generate control information corresponding to a sound wave based on a plurality of pieces of partial information. For example, when the partial information of the first frame is '0', the partial information of the second frame is '1', and the partial information of the third frame is 'A', the control information obtaining unit 202 obtains , And can decode or generate '01A' which is control information corresponding to the sound code.

The control information acquiring unit 202 recognizes the voice through speech recognition, generates first information corresponding to the voice, generates second information corresponding to the sound code, and uses the first information and the second information Information can be generated. For example, the first information may be used to decode the second information, or the first information and the second information may be combined to generate information.

Operating the audio frequency band and the non-audible frequency band of the sound code separately enables simultaneous recognition of speech recognition and sound code by the same hardware (for example, a decoding device) while minimizing mutual interference . This provides users with a more versatile HMI (Human Machine Interface) through a combination of voice and sound codes.

The operation performing unit 203 performs an operation corresponding to the control information based on the obtained control information. For example, the operation performing unit may operate a function of adjusting the wind direction of the air conditioner based on the control information for controlling the wind direction of the air conditioner.

In another embodiment, when an input for requesting the current state or failure diagnosis information of the external device 20 is received through the input receiving unit 201, the external device 20 generates the current state or the failure diagnosis information as sound data And a sound wave data generating unit and an output unit for outputting the sound wave data.

The external device 20 may further include a communication unit for transmitting the status information including at least one of the current status of the device and the diagnostic information to the mobile device 10. [

The description of the sound wave data generating unit, the output unit, and the communication unit can be inferred through the operation of the mobile device 10 described with reference to FIG. 2, and a detailed description thereof will be omitted.

In addition, the matters not described with respect to the external device 20 through the above-described FIG. 5 apply to the contents described above with reference to the drawings.

10 is a configuration diagram of an external device according to an embodiment of the present invention. The external device 20 may include an operation performing unit 203, a state information generating unit 204, a sound wave data generating unit 205, and a sound wave output unit 206. [

The operation performing unit 203 performs an operation of the external device 20. In this case, the operation performing unit 203 performs an operation through at least one or more power devices included in the external device 20. For example, when the external device 20 is a refrigerator, the operation performing unit 203 may perform the circulation operation of the refrigerant through the power unit included in the refrigerator. In another example, when the external device 20 is a cleaner, the operation performing unit 203 may perform an operation of moving the cleaner through the power device. For example, when the external device 20 is a fan, the fan of the fan can be rotated through the power unit of the operation performing unit 203.

The state information generation unit 204 generates state information of the external device 20 related to the operation. At this time, the status information is at least one of the current status of the external device 20 or the failure diagnosis information. An example of the current status includes on / off of the external device 20, power use status, An example of the fault diagnosis information includes abnormality symptom occurrence information, an error code, and fault site information.

The state information generation unit 204 can generate state information corresponding to an abnormal symptom in connection with the operation of the external device 20. [ For example, when the external device 20 is a refrigerator and the external device 20 stops operating, the status information generating unit 204 may generate status information indicating that the operation of the external device 20 has stopped have. For example, when the external device 20 is a washing machine and a predetermined error code is generated in the washing machine, the status information generating unit 204 may generate status information corresponding to the error code.

The sound wave data generation unit 205 generates sound wave data corresponding to the state information. More specifically, the sound wave data generation unit 205 generates a plurality of pieces of partial information corresponding to the state information, determines a plurality of frequencies corresponding to the generated plurality of pieces of partial information, The sound wave data corresponding to the state information can be generated.

The contents not described in relation to the operation of the sound wave data generation unit 205 are the same as or very similar to those described for the operation of the sound wave data generation unit 103 in FIG. 2, and therefore, the sound wave data generation unit 103 are applied as they are. However, in the case of applying it, the 'control information' among the contents of the operation of the sound wave data generation unit 103 of FIG. 2 is regarded as 'state information'.

The sound wave output unit 206 outputs a sound wave corresponding to the sound wave data generated through the sound wave generator. At this time, an example of the sound wave generating device is a speaker device, but is not limited thereto. The outputted sound waves are input to the mobile device 10. [

Although not shown in FIG. 10, the external device 20 of FIG. 10 may further include a sound wave receiver 201 and a control information acquiring unit 202. The sound wave receiving unit 201 receives the sound wave output from the mobile device 10 through the sound wave receiving apparatus, and the control information obtaining unit 202 acquires the control information using the received sound wave. In this case, the control information may be a response to the sound wave output from the sound wave output unit 206, and the operation performing unit 203 may perform an operation based on the control information.

11 is a flowchart illustrating an operation of outputting a sound wave according to an embodiment of the present invention. The method of outputting sound waves through the mobile device 10 shown in FIG. 11 includes steps that are processed in a time-series manner in the mobile device 10 described with reference to FIGS. Therefore, even if omitted in the following description, the description of the mobile device 10 through Figs. 1 and 2 also applies to Fig.

11, the mobile device 10 receives one or more inputs through a user interface (S601), determines control information corresponding to the operation of the external device 20 based on the received one or more inputs (S602 )do. The mobile device 10 generates sound wave data corresponding to the control information (S603). The sound wave data generated through the mobile device 10 may be stored in the form of audio sound data in which the control information is mapped to frequency, non-audible sound wave data in which the auditory frequency is used, music stored in the mobile device 10, Of the sound wave data. The mobile device 10 can output the sound wave corresponding to the generated sound wave data through the sound wave generator (S604).

The external device 20 can receive the sound wave output from the mobile device 10 and perform an operation corresponding to the control information based on the control information included in the sound wave.

Although not shown, in accordance with one embodiment of the present invention, a sonic output method includes performing a device operation (not shown), generating status information of the device (not shown) associated with the operation, Generating sound wave data corresponding to the information, and outputting a sound wave corresponding to the generated sound wave data through a sound wave generator (not shown). In this case, the sound wave output method is performed by the external device 20 in Fig. Therefore, the contents omitted in the following description apply mutatis mutandis to the contents described for the external device 20 in Fig. The sound wave output method includes a step (not shown) of receiving a sound wave outputted from the mobile device 10 through a sound wave receiving apparatus, a step (not shown) of obtaining control information using the received sound wave, And performing an operation based thereon.

Each of the methods of outputting sound waves and the sound output methods not shown, which are described with reference to Fig. 11, may also be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

10: Mobile device
20: External device

Claims (13)

In a mobile device,
An input receiver for receiving one or more inputs via a user interface;
Control information corresponding to an operation of an external device based on the one or more inputs,
At least one mapping table to be used among a first mapping table defined in a non-audible sound wave frequency band and a second mapping table defined in an audible sound wave frequency band,
A control information determination unit for determining a code set to be used among an ascii (ASCII) code set, a hex code set, and a binary code set;
A sound wave data generation unit for generating sound wave data corresponding to the control information according to the determined mapping table and the determined code set; And
And an output unit for outputting a sound wave corresponding to the generated sound wave data through a sound wave generator,
Wherein the control information includes at least one or more symbols,
Wherein the sound wave data generation unit comprises:
Wherein the control information is configured to change the redundant symbol to a predetermined symbol if the control information comprises at least one redundant symbol.
The method according to claim 1,
Wherein the sound wave data generation unit generates the first sound signal corresponding to the first frequency, generates a second sound signal corresponding to the second frequency, and generates the second sound signal corresponding to the first sound signal and the second And combining the sound signals to generate the sound wave data.
The method according to claim 1,
Wherein the control information includes a first symbol and a second symbol,
Wherein the first symbol is a character and the second symbol is a natural number greater than one.
The method according to claim 1,
Wherein the sound wave data generation unit determines the first frequency and the second frequency respectively corresponding to the first symbol and the second symbol included in the control information and generates the sound wave data based on the first frequency and the second frequency, and,
Wherein the sound wave data includes a portion corresponding to the first frequency and a portion corresponding to the second frequency.
The method according to claim 1,
And an input unit for receiving a sound wave generated from the external device through a sound wave receiving apparatus,
And the control information determination unit determines the second control information based on the sound waves inputted.
The method according to claim 1,
The sound wave is input to a sound wave receiving apparatus of the external device,
And the external device performs the operation.
The method according to claim 1,
The sound wave data generating unit generates sound wave data corresponding to the control information and the ID of the external device,
Wherein the external device is selected as a destination of the sound wave among a plurality of external devices.
The method according to claim 1,
Wherein the first frequency is selected from a plurality of frequencies,
Wherein the plurality of frequencies are arranged to have a constant frequency interval from a lowest frequency to a highest frequency of the plurality of frequencies.
The method according to claim 1,
Wherein the output unit outputs the first sound wave corresponding to the generated sound wave data and the second sound wave corresponding to the stored music data through the sound wave generator.
6. The method of claim 5,
Wherein the sound wave generated from the external device includes a response to the sound wave output,
Wherein the sound wave generated from the external device corresponds to any one of the ID of the external device, the ID of the mobile device, the current state of the external device, and the failure information of the external device.
A method of outputting sound waves in a mobile device,
Receiving one or more inputs via a user interface;
Control information corresponding to an operation of an external device based on the one or more inputs,
At least one mapping table to be used among a first mapping table defined in a non-audible sound wave frequency band and a second mapping table defined in an audible sound wave frequency band,
Determining an ASCII (ASCII) code set, a Hex code set, and a binary code set to be used;
Generating sound wave data corresponding to the control information according to the determined mapping table and the determined code set; And
And outputting sound wave data corresponding to the generated sound wave data through the sound wave generator,
Wherein the control information includes at least one or more symbols,
Wherein if the control information comprises at least one redundant symbol, then the redundant symbol is changed to a predetermined symbol.
A sound wave receiver for receiving sound waves output from the mobile device through the sound wave receiver;
A control information obtaining unit for obtaining control information including an ID of the device using the sound waves; And
And an operation performing unit operable to perform an operation corresponding to the control information based on the obtained control information,
The control information obtaining unit
Checking at least one mapping table used in the mobile device from among a first mapping table defined in a non-audible sound wave frequency band and a second mapping table defined in an audible sound wave frequency band,
Checking a set of codes used in the mobile device among an ASCII (ASCII) code set, a Hex code set, and a binary code set,
Acquiring the control information according to the checked mapping table and the checked code set,
Wherein the sound waves are generated by the mobile device based on device control information including at least one or more symbols,
Wherein if the device control information comprises at least one redundant symbol, then the redundant symbol is changed to a predetermined symbol.
In a device,
An operation performing unit operable to perform an operation of the device;
A status information generator for generating status information of the device related to the operation;
A sound wave data generation unit for generating sound wave data corresponding to the state information according to at least one mapping table and code set; And
And a sound wave output unit for outputting a sound wave corresponding to the generated sound wave data through the sound wave generator,
Wherein the mapping table is determined as at least one of a first mapping table defined in a non-audible sound wave frequency band and a second mapping table defined in an audible sound wave frequency band,
Wherein the code set is determined as at least one of an ASCII code set, a Hex code set, and a binary code set,
Wherein the status information comprises at least one or more symbols,
Wherein the sound wave data generation unit comprises:
And to change the redundant symbol to a predetermined symbol if the status information comprises at least one redundant symbol.

Images