KR102864051B1 - Wireless earphone device and control method thereof - Google Patents

Abstract

According to an embodiment disclosed in the present document, a wireless earphone device includes two ear units, wherein at least one of the two ear units includes a communication module, at least one sensor, a plurality of microphones, at least one processor operatively connected to the communication module, the at least one sensor and the plurality of microphones, and a memory operatively connected to the at least one processor, wherein the memory may store instructions that, when executed, cause the at least one processor to determine a wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit via the communication module, and, if it is determined that the wearing states of the ear units do not correspond to a reference state, select one of the ear units based on the wearing states of the ear units, detect a declination of the ear unit based on a sensing signal for the selected ear unit, and compensate for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination. In addition to these, various embodiments identified through the present document are possible.

Description

Wireless earphone device and control method thereof {WIRELESS EARPHONE DEVICE AND CONTROL METHOD THEREOF}

Various embodiments disclosed in this document relate to a technology for controlling a wireless earphone device to correct a voice signal by taking into account the wearing state of the device.

With the advancement of communication technology, the use of wireless earphones is gradually increasing. Recently, true wireless stereo (TWS) products, which eliminate cables or connectors between earbuds, have become mainstream. These products can be paired with electronic devices such as smartphones, tablets, and computers to provide a variety of functions. For example, a user can listen to music using wireless earphones connected to a smartphone and then answer a phone call.

For TWS products, incorrect fit can occur frequently due to different preferred wearing positions and habits. The angle at which the earbuds are inserted into the user's ear, the proper left-right orientation, and the tightness of the fit can all affect the functionality of the wireless earbuds.

The growth of the wireless earphone market has led to an increase in the adoption of wireless earphones, such as TWS products. However, users may still find it difficult to receive guidance on how to properly wear wireless earphones. If users are unaware of whether they are wearing their wireless earphones properly, voice recognition and call quality may deteriorate.

Accordingly, various embodiments of this document can improve the voice recognition function and call quality of wireless earphone products by checking the user's wearing status of wireless earphones and providing guidance on miswearing. Furthermore, if improvement is not achieved despite providing guidance on miswearing wireless earphones a specified number of times, various embodiments can be provided to improve the quality of wireless earphone products by compensating for voice signal delay due to wearing deviations.

The technical problems to be achieved in the embodiments disclosed in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention pertains from the description below.

According to an embodiment disclosed in the present document, a wireless earphone device includes two ear units, wherein at least one of the two ear units includes a communication module, at least one sensor, a plurality of microphones, at least one processor operatively connected to the communication module, the at least one sensor and the plurality of microphones, and a memory operatively connected to the at least one processor, wherein the memory stores instructions that, when executed, cause the at least one processor to determine whether the ear units are worn and the wearing states of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module, and, when it is determined that the wearing states of the ear units do not correspond to a reference state, select one of the ear units based on the wearing states of the ear units, detect a declination of the ear unit based on a sensing signal for the selected ear unit, and compensate for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected declination, wherein the declination is determined based on a reference state of the ear unit and a declination determined for the ear unit. There may be an error angle due to differences in wearing conditions.

An operating method in one of the ear units constituting a wireless earphone device according to an embodiment disclosed in the present document includes an operation of detecting wearing of the ear units, an operation of confirming a wearing state of the ear units, an operation of selecting one of the ear units based on the wearing states of the ear units when it is confirmed that the wearing states of the ear units do not correspond to a reference state, an operation of detecting a bias of the ear unit, and an operation of compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected bias, wherein the bias may be an error angle due to a difference between a reference state of the ear unit and a wearing state confirmed for the ear unit.

According to the various embodiments disclosed in this document, the voice recognition function and call quality of wireless earphone products can be improved by checking the user's wearing status of wireless earphones and providing guidance on miswearing. Furthermore, when a user speaks while wearing wireless earphones, the delay in voice signals due to wearing errors can be compensated for, thereby enhancing user satisfaction with the wireless earphone products.

In addition, various effects may be provided, either directly or indirectly, through this document.

FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.
FIG. 2 illustrates a conceptual diagram of a method for checking the wearing status of a wireless earphone device according to one embodiment.
FIG. 3 is a block diagram illustrating the configuration of a wireless earphone device according to one embodiment.
FIG. 4 is a block diagram illustrating a configuration of an electronic device according to one embodiment.
FIG. 5 is a drawing illustrating a method for guiding wearing of a wireless earphone device in an electronic device according to one embodiment.
FIG. 6A and FIG. 6B are diagrams showing values of sensing signals that change depending on the wearing state of the ear unit according to one embodiment.
FIG. 7 is a diagram showing the values of sensing signals that change depending on the left and right direction of wearing of the ear unit according to one embodiment.
FIG. 8 is a diagram showing a waveform of a sensing signal that changes depending on the wearing intensity of the ear unit according to one embodiment.
FIG. 9 is a diagram illustrating a method for calculating a delay for a microphone output signal based on the wearing state of an ear unit according to one embodiment.
FIG. 10 is a drawing illustrating a method for compensating for a delay in a microphone input signal of an ear unit according to one embodiment.
FIG. 11 is a flowchart illustrating a method for controlling a wireless earphone device according to one embodiment.
FIG. 12 is a drawing illustrating a method for guiding the wearing state of a wireless earphone device and correcting an output signal according to one embodiment.
In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components.

Hereinafter, various embodiments disclosed in this document are described with reference to the attached drawings. For convenience of explanation, the components depicted in the drawings may be exaggerated or reduced in size, and the present invention is not necessarily limited to the drawings.

Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store ^™ ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

FIG. 1 is a diagram illustrating an electronic device within a network environment (100) according to one embodiment.

Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, in the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include a plurality of artificial neural network layers. The artificial neural network can be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model can additionally or alternatively include a software structure.

The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, Wi-Fi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and/or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199). The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

FIG. 2 illustrates a conceptual diagram of a method for checking the wearing status of a wireless earphone device according to one embodiment.

In FIG. 2, the wireless earphone device (200) can be connected to the electronic device (210) via a short-range wireless network. The short-range wireless network for establishing a connection between the wireless earphone device (200) and the electronic device (210) can be appropriately selected. For example, Bluetooth, BLE (Bluetooth Low Energy), Wi-Fi direct, NFC (near field communication), UWB (ultra-wide band) communication, or infrared (infra-red) communication can be used to establish a wireless connection between the wireless earphone device (200) and the electronic device (210). When a wireless connection with the electronic device (210) is established, the wireless earphone device (200) can check the wearing state of the ear units constituting the wireless earphone device (200) by interworking with the electronic device (210).

According to various embodiments, the electronic device (210) may be a mobile communication device such as a smartphone or a tablet device, and the description of the electronic device (101) described with reference to FIG. 1 may be appropriately applied to the electronic device (210). The wireless earphone device (200) is a device that outputs an audio signal or generates a voice signal related to a function provided by the electronic device (210), and other descriptions of the electronic device (101) of FIG. 1, excluding the part about the display module (160), may be appropriately applied to the wireless earphone device (200).

In one embodiment, the wireless earphone device (200) may include two ear units (201, 202). One of the two ear units (201, 202) may be a left unit mounted on the left ear, and the other may be a right unit mounted on the right ear. Each of the two ear units (201, 202) may include at least one sensor, and may measure whether the ear unit is mounted on the user's ear and/or a wearing state using the at least one sensor. According to various embodiments of the present invention, the electronic device (210) may perform a test to confirm the wearing state of the ear units (201, 202) in conjunction with the wireless earphone device (200). When the electronic device (210) receives a user request regarding a wearing test of the wireless earphone device (200), the electronic device (210) may display a user interface for performing the wearing test on the display. For example, the electronic device (210) may provide a user interface including guidance text instructing the user to maintain an upright posture while measuring the wearing status of the ear units (201, 202). While the user interface is displayed on the electronic device (210), the wireless earphone device (200) may output a voice message with the same content as the guidance text through each ear unit.

In one embodiment, when the wireless earphone device (200) receives a request for checking the wearing state of the ear units (201, 202) from the electronic device (210), the wireless earphone device (200) may measure the wearing state of each ear unit using at least one sensor provided in the ear units (201, 202) and check whether the measured wearing state corresponds to a reference wearing state. The reference wearing state may represent state data proposed to provide optimized sound quality in the wireless earphone device (200). According to various embodiments of the present invention, the at least one sensor may include an acceleration sensor. For example, the wireless earphone device (200) may check how much the wearing angle of each ear unit is deviated from the reference wearing angle, whether each ear unit is worn in the left-right direction correctly, or how closely each ear unit is worn on the user's ear, based on a gravitational acceleration signal measured from an acceleration sensor included in each ear unit. The wireless earphone device (200) may transmit information regarding the checked wearing state of each ear unit to the electronic device (200).

In one embodiment, the electronic device (210) may provide wearing guide information corresponding to the wearing state of each ear unit obtained from the wireless earphone device (200). For example, if information indicating that the wearing angle of the left ear unit is rotated 15 degrees counterclockwise with respect to the reference wearing angle is received, the electronic device (210) may display wearing guide information instructing that the wearing angle of the left ear unit be rotated 15 degrees clockwise. For another example, if information indicating that the wearing strength of the right ear unit is lower than the reference wearing strength is received, the electronic device (210) may display wearing guide information instructing that the right ear unit be worn more closely to the user's ear. According to various embodiments of the present invention, the wearing guide information may be provided through the wireless earphone device (210). While the wearing guide information is displayed on the electronic device (210), the wireless earphone device (200) may output a voice message associated with the wearing guide information through each ear unit.

In one embodiment, the wireless earphone device (200) may re-measure the wearing state of the changed ear units (201, 202) after providing the wearing guide information using at least one sensor included in each ear unit, and may check whether the re-measured wearing state corresponds to the reference wearing state. If the checking result shows that the wearing state of the changed ear units (201, 202) corresponds to the reference wearing state, the wearing test may be terminated. If the checking result shows that the wearing state of the changed ear units (201, 202) still does not correspond to the reference wearing state, the wireless earphone device (200) and the electronic device (210) may additionally provide wearing guide information regarding how to change the current wearing state of the ear units (201, 202) toward the reference wearing state. According to various embodiments of the present invention, the electronic device (210) may perform the process of checking the wearing state of the ear units (201, 202) and providing the corresponding wearing guide information a specified number of times. If it is determined that the wearing state of the changed ear units (201, 202) still does not correspond to the reference wearing state after providing the above-mentioned wearing guide information the specified number of times, the wireless earphone device (200) may select one of the ear units (201, 202). For example, the wireless earphone device (200) may select an ear unit whose current wearing state is determined to be close to the reference wearing state among the two ear units (201, 202), and may acquire a voice signal using a plurality of microphones included in the selected ear unit. In this process, the wireless earphone device (200) may improve the call quality of the wireless earphone device (200) by compensating for a delay between the plurality of microphones by considering a wearing deviation according to the wearing state of the selected ear unit compared to the reference wearing state.

FIG. 3 is a block diagram illustrating the configuration of a wireless earphone device (200) according to one embodiment.

Referring to FIG. 3, the wireless earphone device (200) is a device that outputs an audio signal or acquires a user's voice signal, and may be composed of two ear units. The two ear units may each correspond to a left ear unit or a right ear unit. At least one of the two ear units may include a communication module (310), at least one sensor (320), a plurality of microphones (330), a speaker (340), and at least one processor (350) or memory (360). In FIG. 3, the wireless earphone device (200) may correspond to the wireless earphone device (200) illustrated in FIG. 2, and other descriptions of the electronic device (101) described with reference to FIG. 1, excluding the part about the display (160), may be appropriately applied to the wireless earphone device (200).

In one embodiment, a communication module (310) (e.g., a wireless communication module (192) of FIG. 1) may establish a communication connection with an electronic device (e.g., an electronic device (102, 104) of FIG. 1 or an electronic device (210) of FIG. 2) and transmit and receive various data. For example, the communication module (310) may support at least one communication method among wireless-fidelity (Wi-Fi), Bluetooth, near field communication (NFC), or ultra-wide band (UWB) communication.

In one embodiment, at least one sensor (320) (e.g., sensor module (176) of FIG. 1) can measure whether the wireless earphone device (200) is worn and/or its wearing state. For example, at least one sensor (320) can include an acceleration sensor, in which case at least one of the wearing angle, left-right direction, or wearing intensity of each ear unit can be determined based on a gravitational acceleration signal measured from the acceleration sensor.

In one embodiment, multiple microphones (330) (e.g., input module (150) of FIG. 1) can acquire a user's voice signal.

In one embodiment, a speaker (340) (e.g., an audio output module (155) of FIG. 1) may output an audio signal related to a function provided by an electronic device (e.g., an electronic device (210) of FIG. 2) with which a wireless connection is established with a wireless earphone device (200).

In one embodiment, the memory (360) (e.g., the memory (130) of FIG. 1) may store instructions that, when executed, control at least one processor (350) (e.g., the processor (120) of FIG. 1) to perform various operations. For example, the at least one processor (350) may perform operations of checking the wearing status of the ear units, providing corresponding wearing guide information, and correcting voice signals by taking into account wearing deviations.

In one embodiment, at least one processor (350) may obtain a first sensing signal associated with a wearing state of a first ear unit, which is one of two ear units, from at least one sensor (320). The first sensing signal may be a gravitational acceleration signal detected from the at least one sensor (320) while the first ear unit is worn on the user's ear.

In one embodiment, at least one processor (350) may receive a second sensing signal associated with a wearing state of the second ear unit, which is another one of the two ear units, through the communication module (310). The second sensing signal may be a gravitational acceleration signal detected from a sensor included in the second ear unit while the second ear unit is worn on the user's ear. According to various embodiments of the present invention, at least one processor (350) may obtain the first sensing signal and the second sensing signal in response to receiving a wearing test request for the ear units from the electronic device (210).

In one embodiment, at least one processor (350) can check the wearing state of the ear units based on the first sensing signal and the second sensing signal. According to various embodiments of the present invention, at least one processor (350) can check the state of the ear units based on sensing signals acquired during a first time period in which a user wearing the ear units maintains a frontal posture without speaking, and during a second time period in which the user maintains a frontal posture while speaking. For example, at least one processor (350) can obtain a first gravitational acceleration signal measured for the first ear unit during the first time period from at least one sensor (320), and can obtain a second gravitational acceleration signal measured for the second ear unit during the first time period from the communication module (310). At least one processor (350) can check at least one of a wearing angle or a left-right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal. For another example, at least one processor (350) may obtain a third gravitational acceleration signal measured for the first ear unit during the second time interval from at least one sensor (320), and may obtain a fourth gravitational acceleration signal measured for the second ear unit during the second time interval from the communication module (310). At least one processor (350) may determine the wearing intensity of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal.

In one embodiment, at least one processor (350) may determine whether the wearing state of the ear units corresponds to a reference wearing state based on the first sensing signal and the second sensing signal. The reference wearing state may indicate a state data range in which the wireless earphone device (200) can provide optimal voice quality. For example, at least one processor (350) may compare the first sensing signal and the second sensing signal with a reference signal, which is a signal measured corresponding to the reference wearing state, and may determine whether the wearing state of the ear units corresponds to the reference wearing state based on the comparison result. As another example, at least one processor (350) may determine whether the first sensing signal and the second sensing signal are included within a range of a reference signal defined as the reference wearing state. If the determination result indicates that the wearing state of the ear units corresponds to the reference wearing state, at least one processor (350) may determine that the ear units are properly worn on the user's ears and may transmit a signal indicating that the ear units are properly worn to the electronic device (210). If the above-described verification result shows that the wearing states of the ear units do not correspond to the reference wearing state, at least one processor (350) may transmit information about the wearing states of the ear units to the electronic device (210). According to various embodiments of the present invention, at least one processor (350) may obtain wearing guide information corresponding to the wearing states of the ear units from the electronic device (210). For example, if it is confirmed that the left and right directions of the first ear unit and the second ear unit are swapped and worn, wearing guide information instructing to swap the first ear unit and the second ear unit in the current wearing state may be provided. At least one processor (350) may control the speaker (340) to output a voice message about the obtained wearing guide information. While the voice message about the wearing guide information is output from the ear units, a user interface including the wearing guide information may be displayed on the display of the electronic device (210). According to various embodiments of the present invention, the checking of the wearing state of the ear units and the provision of wearing guide information corresponding to the checked wearing state may be repeatedly performed a specified number of times. At least one processor (350) may, after providing the wearing guide information, re-acquire a first sensing signal measured for the first ear unit and a second sensing signal measured for the second ear unit. At least one processor (350) may, based on the re-acquired first sensing signal and second sensing signal, check whether the changed wearing state of the ear units corresponds to the reference wearing state, and, based on the checking result, may re-provide wearing guide information corresponding to the changed wearing state. If the checked wearing state of the ear units is still different from the reference wearing state after providing the wearing guide information a specified number of times, the at least one processor (350) may determine that the wearing state of the ear units does not correspond to the reference wearing state and may no longer provide the wearing guide information.

In one embodiment, at least one processor (350) may select one of the ear units based on the wearing states of the ear units when it is determined that the wearing states of the ear units do not correspond to the reference wearing state. The selected ear unit may be used to obtain a user's voice signal in conjunction with the electronic device (210). For example, at least one processor (350) may select an ear unit among the first ear unit and the second ear unit, the wearing state of which is determined to be close to the reference wearing state, and may obtain a user's voice signal using a plurality of microphones included in the selected ear unit.

In one embodiment, at least one processor (350) may detect a declination of the ear unit based on a sensing signal measured for the selected ear unit. The declination is an error angle due to a difference between a current wearing state confirmed for the ear unit and the reference wearing state, and may indicate how much the current wearing angle of the ear unit is deviated compared to the reference angle of the reference wearing state.

In one embodiment, at least one processor (350) may compensate for a delay in a signal input to one of the plurality of microphones included in the ear unit based on the detected bias. When a user's voice signal is acquired using the ear unit, the time it takes for the voice spoken by the user to be transmitted from the user's mouth to each of the plurality of microphones may be different due to a difference in distance between the user's mouth and each microphone. For example, if a second microphone among the microphones included in the ear unit is further away from the user's mouth than a first microphone, a signal input to the second microphone when the user speaks may be delayed compared to a signal input to the first microphone. At least one processor (350) may calculate a delay in an input signal of the second microphone based on the distance between the first microphone and the second microphone and the bias. At least one processor (350) may obtain a delay-compensated input signal for the input signal of the second microphone by applying a function for compensating the calculated delay to the input signal of the second microphone. According to various embodiments of the present invention, at least one processor (350) may generate a voice signal by synthesizing the delay-compensated input signal of the second microphone with an input signal of another microphone included in the ear unit. At least one processor (350) may transmit the generated voice signal to the electronic device (210).

FIG. 4 is a block diagram illustrating the configuration of an electronic device (210) according to one embodiment.

Referring to FIG. 4, the electronic device (210) is a device that provides wearing guide information corresponding to the wearing state of the ear units identified from the wireless earphone device (200), and may include a communication module (410), a display (420), and at least one processor (430) or memory (440). In FIG. 4, the electronic device (210) may correspond to the electronic device (101) illustrated in FIG. 1 or the electronic device (210) illustrated in FIG. 2.

In one embodiment, the communication module (410) (e.g., the communication module (190) of FIG. 1) can establish a communication connection with a wireless earphone device (e.g., the electronic device (102, 104) of FIG. 1 or the wireless earphone device (200) of FIG. 2) and transmit and receive various data. For example, the communication module (410) can support at least one communication method among cellular, Wi-Fi (wireless-fidelity), Bluetooth, NFC (near field communication), or UWB (ultra-wide band) communication.

In one embodiment, the display (420) (e.g., the display module (160) of FIG. 1) may display the wearing status of the ear units included in the wireless earphone device (200) or corresponding wearing guide information. According to various embodiments of the present invention, the display (420) may also display information regarding postures or precautions to be taken by the user during the process of measuring the wearing status of the ear units.

In one embodiment, the memory (440) (e.g., the memory (130) of FIG. 1) may store instructions that, when executed, control at least one processor (430) (e.g., the processor (120) of FIG. 1) to perform various operations. For example, the at least one processor (430) may perform operations to guide a user to properly wear the wireless earphone device (200).

In one embodiment, when a wireless connection with a wireless earphone device (200) is established through a communication module (410), at least one processor (430) may display on the display (420) that the wireless connection to the wireless earphone device (200) is normally established. In addition, when at least one processor (430) determines that the wireless connection with the wireless earphone device (200) has failed, it may display on the display (420) a guidance message to check the surrounding network environment.

In one embodiment, at least one processor (430) may receive a request for checking the wearing status of the ear units of the wireless earphone device (200) with which a wireless connection is established. For example, when the at least one processor (430) receives a user request for checking the wearing status of the ear units, the at least one processor (430) may transmit the user request to the wireless earphone device (200) and execute a test mode for checking the wearing status of the ear units. While the test mode is executed, the at least one processor (430) may display a guidance message on the display (420) guiding the user to maintain a frontal posture while wearing the ear units for accurate measurement. According to various embodiments of the present invention, the at least one processor (430) may share the guidance message with the wireless earphone device (200) so that while the guidance message is displayed on the display (420), a voice signal having the same content as the guidance message is output through the ear units.

In one embodiment, at least one processor (430) may obtain information about the wearing state of the ear units confirmed in response to the user request from the wireless earphone device (200). According to various embodiments of the present invention, when the wireless earphone device (200) receives the user request from the electronic device (210), the wireless earphone device (200) may measure a gravitational acceleration signal of the ear units and confirm the wearing state of the ear units based on the measured gravitational acceleration signal. The wearing state may include at least one of a wearing angle, a left-right direction, or a wearing intensity of each ear unit. The wireless earphone device (200) may transmit the information about the wearing state of the ear units confirmed to the electronic device (210).

In one embodiment, at least one processor (430) may provide wearing guide information for the ear units based on information about the wearing state of the ear units obtained from the wireless earphone device (200). For example, if the at least one processor (430) determines that the wearing angle of the left ear unit is rotated 15 degrees counterclockwise with respect to the reference wearing state based on the information about the wearing state, the at least one processor (430) may output a message on the display (420) instructing the left ear unit to be rotated 15 degrees clockwise with respect to the current wearing state. For another example, if the at least one processor (430) determines that the current wearing state of the ear units corresponds to the reference wearing state, the at least one processor (430) may output a message indicating that the ear units are properly worn. According to various embodiments of the present invention, the at least one processor (430) may transmit wearing guide information for the ear units to the wireless earphone device (200). While the wearing guide information is displayed on the display (420) of the electronic device (210), a voice message including the same content as the wearing guide information may be output through the ear units.

FIG. 5 is a drawing illustrating a method of guiding wearing of a wireless earphone device (200) in an electronic device (210) according to one embodiment.

Referring to FIG. 5, the electronic device (210) can check the wearing status of the ear units (201, 202) by linking with the wireless earphone device (200) with which a wireless communication connection is established. In one embodiment, when a wireless connection with the wireless earphone device (200) is established, the electronic device (210) can indicate that it has been successfully connected to the wireless earphone device (200) and provide a user interface (510) for guidance on wearing the wireless earphone device (200). The user interface (510) for guidance on wearing the wireless earphone device (200) can include information on how to wear the ear units (201, 202) and a menu button (515) for performing a wearing test.

In one embodiment, the electronic device (210) may perform a wearing test on the wireless earphone device (200) in response to detecting a user input for the menu button (515). While performing the wearing test, the electronic device (210) may display a message (520, 530) regarding the measurement of the wearing state of the ear units (201, 202) of the wireless earphone device (200) on a display (e.g., the display module (160) of FIG. 1 or the display (420) of FIG. 4). According to various embodiments of the present invention, the electronic device (210) may output a message (520, 530) to guide a user (500) wearing the ear units (201, 202) to maintain a frontal posture so as to minimize the influence of other environmental factors while measuring the wearing state of the ear units (201, 202). For example, the electronic device (210) may display a message (520) instructing to maintain a frontal state while wearing the ear units (201, 202) for a first time period, and may check the wearing angle and/or left-right direction of the ear units (201, 202) based on an acceleration signal measured for the ear units (201, 202) for the first time period. The wearing angle may indicate how much the ear units (201, 202) are rotated when comparing the current wearing state with a reference wearing state. The left-right direction may indicate whether the left-right direction according to the current wearing state of the ear units (201, 202) is appropriately worn. For another example, the electronic device (210) may display a message (530) that induces the user to speak while maintaining a frontal state while wearing the ear units (201, 202) for a second period of time, and may check the wearing intensity of the ear units (201, 202) based on an acceleration signal measured for the ear units (201, 202) for the second period of time. The wearing intensity may indicate whether the ear units (201, 202) are worn in an appropriately close contact with the user's (500) ears.

In one embodiment, the electronic device (210) may provide wearing guide information corresponding to the wearing state of the confirmed ear units (201, 202). For example, if the electronic device (210) determines that the wearing angle according to the current wearing state of the left ear unit among the ear units (201, 202) is rotated 15 degrees counterclockwise with respect to the reference wearing state, the electronic device (210) may provide a message guiding the left ear unit to be rotated 15 degrees clockwise with respect to the current wearing state. As another example, if the electronic device (210) determines that the wearing strength according to the current wearing state of the right ear unit among the ear units (201, 202) is lower than the reference wearing state, the electronic device (210) may provide a message guiding the right ear unit to be worn more closely to the ear of the user (500).

FIGS. 6A and 6B are diagrams showing values of sensing signals that change depending on the wearing state of the ear units, according to one embodiment. In one embodiment, the wireless earphone device (200) can check the wearing state of the ear units based on sensing signals measured while the user is wearing the ear units. The wireless earphone device (200) can obtain the sensing signal from at least one sensor included in each ear unit. According to various embodiments of the present invention, the at least one sensor may include an acceleration sensor, and the sensing signal may be an acceleration signal measured using the acceleration sensor. The wireless earphone device (200) can obtain an acceleration signal sensed for each ear unit using the acceleration sensor included in each ear unit during a time when the user wearing the ear units maintains a posture of looking straight ahead without speaking. The acceleration signal may include different values depending on the wearing state of each ear unit.

Fig. 6a shows the X-axis value of the sensing signal according to the beamforming angle of the ear unit. The beamforming angle indicates the direction in which the ear unit detects sound caused by the user's speech, and may be associated with the positions of a plurality of microphones included in the ear unit. The beamforming angle described in Fig. 6a may mean the angle formed in the direction in which the sound is detected in the ear unit based on a straight axis connecting any one of the plurality of microphones and the user's mouth. When the beamforming angle of the ear unit is 33 degrees (601), it can be confirmed that the normalized value of the X-axis direction of the sensing signal is a value of -0.09 (611), which is slightly lower than 0 indicated by the dotted line. In addition, it can be confirmed that when the beamforming angle of the ear unit is 68 degrees (602), the X-axis value of the sensing signal shows a value of 0.05 (612), which is slightly higher than 0 indicated by a dotted line, and when the beamforming angle of the ear unit is 162 degrees (603), the X-axis value of the sensing signal shows a value of 0.2 (613). In this way, it can be confirmed that the normalized value of the X-axis direction of the sensing signal changes depending on the beamforming angle of the ear unit.

Fig. 6b shows the X, Y, and Z-axis values of the sensing signal according to the wearing angle of the ear unit. The wearing angle indicates how much the wearing angle according to the wearing state of the ear unit is rotated compared to the reference wearing state, and can be determined based on a straight axis connecting two microphones included in the ear unit. Referring to Fig. 6b, in the case of a sensing signal (621) measured when the ear unit corresponds to the reference wearing state, a normalized value in the X-axis direction can have a value greater than 0 indicated by the dotted line. If the wearing angle of the ear unit is rotated 90 degrees clockwise with respect to the reference wearing state, a sensing signal (631) having an X-axis value slightly lower than 0 indicated by the dotted line can be obtained. If the wearing angle of the ear unit is rotated 90 degrees counterclockwise with respect to the reference wearing state, a sensing signal (641) having an X-axis value almost similar to 0 indicated by the dotted line can be obtained. In this way, it can be confirmed that the X-axis value of the sensing signal is different depending on the wearing angle of the ear unit. According to various embodiments of the present invention, the spatial position of the ear unit can be confirmed in more detail based on the Y-axis value or the Z-axis value in addition to the X-axis value of the sensing signal. When the user wears the ear unit in accordance with the reference wearing state, the wireless earphone device (200) can obtain a sensing signal (622) having a Y-axis value at a level slightly lower than 0. It can be confirmed that the Y-axis value of the sensing signal (632) obtained in the wearing state in which the ear unit is worn at an angle rotated 90 degrees clockwise and the Y-axis value of the sensing signal (642) obtained in the wearing state in which the ear unit is worn at an angle rotated 90 degrees counterclockwise are different from the Y-axis value of the sensing signal (622) measured in the reference wearing state. Similarly, it can be confirmed that the Z-axis value of the sensing signal (623) measured from the ear unit in the reference wearing state has a level almost similar to 0, but the Z-axis value of the sensing signal (633) obtained in the wearing state in which the wearing angle of the ear unit is rotated 90 degrees clockwise and the Z-axis value of the sensing signal (643) obtained in the wearing state in which the wearing angle of the ear unit is rotated 90 degrees counterclockwise are levels greater than 0. In this way, the wireless earphone device (200) can confirm the current wearing angle of the ear unit by comparing the sensing signal measured in the wearing state of the ear unit with the sensing signal in the reference wearing state, and can generate and provide wearing guide information regarding the direction in which the wearing angle of the ear unit should be rotated through the analysis of the confirmation result.

FIG. 7 is a diagram showing values of sensing signals that change depending on the left-right wearing direction of the ear units, according to one embodiment. In one embodiment, the wireless earphone device (200) can determine whether the left-right directions of the ear units are properly worn based on sensing signals measured while the user is wearing the ear units. According to various embodiments of the present invention, the sensing signals may be acceleration signals measured for each ear unit while the user wearing the ear units maintains a posture of looking straight ahead without speaking.

Referring to FIG. 7, a first sensing signal obtained while the left ear unit is worn on the user's left ear and a second sensing signal obtained while the left ear unit is worn on the user's right ear may include different values. Normalized values for each of the X-axis, Y-axis, and Z-axis directions of the first sensing signal measured while the user is wearing the left ear unit on his or her left ear can be confirmed as shown in graphs 711, 712, and 713. When the left ear unit is worn on the user's left ear, the X-axis direction value (711) of the first sensing signal may indicate a level greater than 0 indicated by a dotted line, and the Y-axis direction value (712) and the Z-axis direction value (713) of the first sensing signal may indicate a level lower than 0 indicated by a dotted line. On the other hand, when the left ear unit is worn on the user's right ear, the X-axis direction value (721) of the second sensing signal may indicate a level less than 0 indicated by a dotted line, and the Y-axis direction value (722) and the Z-axis direction value (723) of the second sensing signal may indicate a level of 0. In this way, the wireless earphone device (200) can check whether the left and right directions of the ear unit are properly worn based on the sensing signal measured while the ear unit is worn, and can provide guide information regarding the left and right wearing of the ear unit based on the check result.

FIG. 8 is a diagram showing a waveform of a sensing signal that changes depending on the wearing strength of the ear unit, according to one embodiment. In one embodiment, the wireless earphone device (200) can determine whether the ear units are worn in close contact with the user's ears with an appropriate strength based on the sensing signals measured while the user is wearing the ear units. According to various embodiments of the present invention, the sensing signals may be acceleration signals measured for each ear unit while the user wearing the ear units maintains a posture of looking straight ahead while speaking.

Referring to FIG. 8, it can be confirmed that the amplitude of the signal waveform of the first sensing signal (811) measured when the user speaks while the ear unit is worn in close contact with the user's ear with an appropriate wearing strength is changed within a relatively large range. It can be confirmed that the amplitude of the second sensing signal (812) measured when the user speaks while the ear unit is worn in the user's ear with a lower wearing strength compared to the reference wearing state is changed within a smaller range compared to the first sensing signal (811). In this way, the wireless earphone device (200) can confirm whether the ear unit is worn in close contact with the user's ear with an appropriate strength based on the sensing signal measured when the user speaks while the ear unit is worn, and can provide guide information regarding the wearing strength of the ear unit based on the confirmation result.

FIG. 9 is a diagram illustrating a method for calculating a delay for a microphone input signal based on a wearing state of an ear unit, according to an embodiment. In an embodiment, if the wireless earphone device (200) determines that the wearing state of the ear units does not correspond to a reference wearing state even after providing wearing guide information for the ear units a specified number of times, the wireless earphone device (200) may select one of the ear units. For example, the wireless earphone device (200) may select an ear unit among the ear units whose current wearing state is determined to be close to the reference wearing state.

Referring to FIG. 9, in the process of the wireless earphone device (200) generating a voice signal by the user's speech, the first microphone (901) and the second microphone (902) included in the selected ear unit can receive the signal by the user's speech with a time difference. For example, in the case where the user's mouth (903) is positioned in a straight line with the first microphone (901) and the second microphone (902) as shown on the left side of FIG. 9, the signal by the user's speech can be input to the second microphone (902) with a time delay of d1 (911) compared to the first microphone (901) due to the positional difference between the first microphone (901) and the second microphone (902). When the user's mouth (903) is positioned in a straight line with the first microphone (901) and the second microphone (902), the difference between the distance to the first microphone (901) and the distance to the second microphone (902) based on the user's mouth (903) is the greatest, so the wireless earphone device (200) can confirm that d1 (911) corresponds to the maximum time delay. In Fig. 9, the maximum time delay d1 (911) applied to the input signal of the second microphone (902) can be assumed to be equal to the time it takes for the signal caused by the user's speech to travel from the first microphone (901) to the second microphone (902). In addition, the time can be calculated using a formula that divides the distance by the speed. By substituting the distance (d) between the first microphone (901) and the second microphone (902) and the speed of sound (342 m/s) into the above formula, the maximum time delay d1 (911) can be calculated as shown in the following mathematical expression 1.

In one embodiment, when the straight axis connecting the first microphone (901) and the second microphone (902) included in the selected ear unit rotates clockwise by θ as shown on the right side of FIG. 9, the time delay applied to the input signal of the second microphone (902) may change. In this case, a signal by a user's speech may be input to the second microphone (902) with a time delay of d2 (912) from the first microphone (901). The wireless earphone device (200) may determine the rotation angle θ of the ear unit based on the sensing signal measured for the ear unit. The wireless earphone device (200) may calculate d2 (912) as shown in Mathematical Expression 2 below by reflecting the rotation angle θ of the ear unit based on the maximum time delay d1 (911).

In one embodiment, the wireless earphone device (200) can improve functions of the wireless earphone device (200), such as calling or voice recognition, by calculating and compensating for a time delay for an input signal of the second microphone (902) according to the wearing state of the ear unit.

FIG. 10 is a diagram illustrating a method for compensating for a delay in a microphone input signal of an ear unit according to an embodiment. The functions or operations described with reference to FIG. 10 may be understood as functions performed by at least one processor (350) included in the ear unit of the wireless earphone device (200) of FIG. 3. The at least one processor (350) may execute commands (e.g., instructions) stored in a memory (360) to implement the software modules illustrated in FIG. 10, and control hardware associated with the function (e.g., the communication module (310), at least one sensor (320), or multiple microphones (330) of FIG. 3).

Referring to FIG. 10, the wireless earphone device (200) can generate a voice signal by a user's speech using multiple microphones included in one ear unit selected from among two ear units. In one embodiment, the ear unit can include at least one acceleration sensor (1001), a first microphone (901), a second microphone (902), or a third microphone (1002). According to various embodiments, the first microphone (901) and the second microphone (902) can be external microphones mounted on the ear unit, and the third microphone (1002) can be an internal microphone mounted on the ear unit.

In one embodiment, the rotation angle detection module (1010) of the wireless earphone device (200) can obtain an acceleration signal measured for the ear unit using at least one acceleration sensor (1001), and based on the obtained acceleration signal, can detect a declination indicating how much a straight axis connecting the first microphone (901) and the second microphone (902) is rotated with respect to a standard wearing state.

In one embodiment, the delay compensation module (1020) of the wireless earphone device (200) calculates a time delay for an input signal of the second microphone (902) by considering the detected bias, and applies a function for compensating for the calculated time delay to the input signal, thereby compensating for the time delay for the input signal of the second microphone (902).

In one embodiment, the Beamformer and Noise suppression module (1030) of the wireless earphone device (200) can synthesize signals input to the first microphone (901), the second microphone (902), or the third microphone (1002) when the user speaks. For example, the Beamformer and Noise suppression module (1030) can synthesize the input signal of the second microphone (902) for which the time delay has been compensated for with the input signal of the first microphone (901) and/or the input signal of the third microphone (1002). The Beamformer and Noise suppression module (1030) can generate a clearer voice signal by removing noise components from the synthesized signal.

FIG. 11 is a flowchart illustrating a method for controlling a wireless earphone device (200) according to an embodiment. According to an embodiment, the wireless earphone device (200) is a device that outputs an audio signal or obtains a user's voice signal, and may correspond to the electronic device (101) illustrated in FIG. 1 or the wireless earphone device (200) illustrated in FIG. 2. The operations of FIG. 11 may be performed by at least one processor (e.g., the processor (120) of FIG. 1 or at least one processor (350) of FIG. 3) included in at least one ear unit among the ear units constituting the wireless earphone device (200).

Referring to FIG. 11, in operation 1110, the wireless earphone device (200) may obtain sensing signals of ear units (e.g., ear units (201, 202) of FIG. 2). For example, the wireless earphone device (200) may obtain a first sensing signal measured for a first ear unit and a second sensing signal measured for a second ear unit using at least one sensor (e.g., at least one sensor (320) of FIG. 3) included in each of the ear units. According to various embodiments of the present invention, the wireless earphone device (200) may obtain the first sensing signal and the second sensing signal in response to receiving a wear test request for the ear units from an electronic device (e.g., the electronic device (210) of FIG. 2) with which a wireless connection is established with the wireless earphone device (200). According to various embodiments of the present invention, the first sensing signal and the second sensing signal may be obtained for a first time period in which a user wearing the ear units maintains a frontal posture without speaking and a second time period in which the user maintains a frontal posture while speaking. For example, the wireless earphone device (200) may determine at least one of a wearing angle or a left-right direction of the ear units based on a first sensing signal measured for the first ear unit during the first time period and a second sensing signal measured for the second ear unit during the first time period. As another example, the wireless earphone device (200) may determine a wearing intensity of the ear units based on a first sensing signal measured for the first ear unit during the second time period and a second sensing signal measured for the second ear unit during the second time period.

According to one embodiment, in operation 1120, the wireless earphone device (200) can determine the wearing state of the ear units based on the first sensing signal and the second sensing signal. The wearing state may include at least one of the wearing angle, left-right direction, or wearing intensity of each ear unit.

According to one embodiment, in operation 1130, the wireless earphone device (200) may determine whether the wearing state of the ear units corresponds to a reference wearing state based on the first sensing signal and the second sensing signal. The reference wearing state may indicate a state data range in which the wireless earphone device (200) can provide optimal voice quality. For example, the wireless earphone device (200) may compare the first sensing signal and the second sensing signal with a reference signal, which is a signal measured corresponding to the reference wearing state, and may determine whether the wearing state of the ear units corresponds to the reference wearing state based on the comparison result. As another example, the wireless earphone device (200) may determine whether the first sensing signal and the second sensing signal are included within a range of a reference signal defined as the reference wearing state. If the above verification result shows that the wearing state of the ear units corresponds to the reference wearing state (Operation 1130 - Yes), the wireless earphone device (200) may determine that the ear units are properly worn on the user's ears and may end the wearing state verification procedure for the ear units. If the verification result shows that the wearing state of the ear units does not correspond to the reference wearing state (Operation 1130 - No), the wireless earphone device (200) may transmit information about the wearing state of the ear units to the electronic device (210). The wireless earphone device (200) may obtain wearing guide information corresponding to the wearing state of the ear units from the electronic device (210) and output the obtained wearing guide information through a speaker included in each ear unit (e.g., the speaker (340) of FIG. 2). For example, if it is confirmed that the left and right directions of the first ear unit and the second ear unit are swapped and worn, wearing guide information may be provided that instructs the user to swap the first ear unit and the second ear unit in the current wearing state. For another example, if the wearing strength of the second ear unit is determined to be lower than the reference wearing strength, wearing guide information may be provided that instructs the user to wear the right ear unit more closely on the user's ear. While the wearing guide information is output from the ear units, a user interface including the wearing guide information may be displayed on the display of the electronic device (210). According to various embodiments of the present invention, the checking of the wearing state of the ear units and the provision of wearing guide information corresponding to the checked wearing state may be repeated a specified number of times. After providing the wearing guide information, the wireless earphone device (200) may re-measure the first sensing signal for the first ear unit and the second sensing signal for the second ear unit, and determine whether the changed wearing state of the ear units corresponds to the reference wearing state based on the re-measured first sensing signal and second sensing signal. The wireless earphone device (200) may re-provide wearing guide information corresponding to the changed wearing state based on the checking result. If the wearing state of the ear units confirmed after providing the wearing guide information a specified number of times is still different from the reference wearing state, the wireless earphone device (200) determines that the wearing state of the ear units does not correspond to the reference wearing state, and determines one of the ear units to be used for generating a user's voice signal.

According to one embodiment, in operation 1140, the wireless earphone device (200) may select one of the ear units based on the current wearing state confirmed for the ear units. For example, the wireless earphone device (200) may select an ear unit among the first ear unit and the second ear unit, the wearing state of which is confirmed to be close to the reference wearing state, as the ear unit for acquiring the user's voice signal.

According to one embodiment, in operation 1150, the wireless earphone device (200) can detect the declination of the ear unit based on the sensing signal measured for the selected ear unit. The declination is an error angle due to the difference between the current wearing state confirmed for the ear unit and the reference wearing state, and can indicate how much the current wearing angle of the ear unit is deviated compared to the reference angle of the reference wearing state.

According to one embodiment, in operation 1160, the wireless earphone device (200) may compensate for a delay in a signal input to one of a plurality of microphones included in the ear unit based on the detected bias. According to various embodiments of the present invention, if a second microphone among the microphones included in the ear unit is further away from the user's mouth than the first microphone, a signal input to the second microphone when the user speaks may be delayed compared to a signal input to the first microphone. The wireless earphone device (200) may calculate a delay in an input signal of the second microphone based on the distance between the first microphone and the second microphone and the bias, and apply a function for compensating for the calculated delay to the input signal of the second microphone, thereby performing delay compensation for the input signal of the second microphone. According to various embodiments of the present invention, the wireless earphone device (200) can generate a voice signal by synthesizing the input signal of the delay-compensated second microphone with the input signal of another microphone included in the ear unit, and transmit the generated voice signal to the electronic device (210).

FIG. 12 is a drawing illustrating a method of guiding the wearing state of a wireless earphone device (200) and correcting an output signal according to one embodiment.

Referring to FIG. 12, a wireless connection between a wireless earphone (200) and an electronic device (210) can be established in operation 1201. The wireless connection can be established based on a short-range wireless network such as Bluetooth, BLE (Bluetooth Low Energy), Wi-Fi direct, NFC (near field communication), UWB (ultra-wide band) communication, or infrared (infra-red) communication.

According to one embodiment, in operation 1203, the wireless earphone device (200) can detect that two ear units constituting the wireless earphone device (200) are worn on the user's ears. The wireless earphone device (200) can determine whether each ear unit is worn based on a sensing signal detected from at least one sensor included in each ear unit.

According to one embodiment, in operation 1205, the electronic device (210) may obtain a user request regarding measurement of a wearing state of the wireless earphone device (200). According to various embodiments of the present invention, the electronic device (210) may transmit the obtained user request to the wireless earphone device (200) and execute a test mode for measuring the wearing state of the wireless earphone device (200). In response to the user request, the electronic device (210) may display a user interface for measuring the wearing state of the wireless earphone device (200). For example, the electronic device (210) may display a message guiding the user to maintain a frontal posture while wearing the ear units while the test mode is executed. The electronic device (210) may control a voice message including the same content as the message to be output through the ear units while the test mode is executed.

According to one embodiment, in operation 1207, the wireless earphone device (200) can check the wearing state of the ear units based on the sensing signals detected for each ear unit. For example, the wireless earphone device (200) can check how much the wearing angle of each ear unit is deviated from the reference wearing angle, whether each ear unit is worn in the left-right direction, or how closely each ear unit is worn on the user's ear, based on the acceleration signal measured for each ear unit. In operation 1207, the wireless earphone device (200) can transmit information about the wearing state of each ear unit checked above to the electronic device (200).

According to one embodiment, in operation 1209, the electronic device (210) may provide wearing guide information corresponding to the wearing states of the ear units based on the information about the wearing states acquired from the wireless earphone device (200). For example, if information indicating that the wearing angle of the left ear unit is rotated 15 degrees counterclockwise with respect to a reference wearing angle is received, the electronic device (210) may display wearing guide information instructing that the wearing angle of the left ear unit be rotated 15 degrees clockwise. For another example, if information indicating that the wearing strength of the right ear unit is lower than the reference wearing strength is received, the electronic device (210) may display wearing guide information instructing that the right ear unit be worn more closely to the user's ear. According to various embodiments of the present invention, while displaying the wearing guide information, the electronic device (210) may control to output a voice message including the same content as the wearing guide information through the ear units.

According to various embodiments of the present invention, while a test mode for measuring the wearing state of the ear units is executed, operations 1207 to 1209 may be repeatedly performed a specified number of times. The wireless earphone device (200) may re-measure the wearing state of the changed ear units after the provision of the wearing guide information and check whether the re-measured wearing state corresponds to a reference wearing state. If the checking result shows that the wearing state of the changed ear units corresponds to the reference wearing state, the wearing test may be terminated. If the checking result shows that the wearing state of the changed ear units still does not correspond to the reference wearing state, wearing guide information corresponding to the changed wearing state may be additionally provided.

According to one embodiment, if the wireless earphone device (200) determines that the changed wearing state of the ear units still does not correspond to the reference wearing state after providing the wearing guide information the specified number of times in operation 1211, the wireless earphone device (200) may select one of the ear units in operation 1213. For example, the wireless earphone device (200) may select an ear unit whose current wearing state is determined to be close to the reference wearing state among the ear units to acquire a user's voice signal.

According to one embodiment, in operation 1215, the wireless earphone device (200) can detect the declination of the selected ear unit. The declination is an error angle due to the difference between the current wearing state confirmed for the ear unit and the reference wearing state, and can indicate how much the current wearing angle of the ear unit is rotated with respect to the reference wearing state. The wireless earphone device (200) can detect the declination based on a sensing signal measured for the ear unit.

According to one embodiment, in operation 1217, the wireless earphone device (200) may compensate for a delay in a signal input to one of a plurality of microphones included in the selected ear unit based on the detected bias. For example, the wireless earphone device (200) may calculate a delay in a signal input to the second microphone based on a distance between a first microphone and a second microphone included in the ear unit and the detected bias. The wireless earphone device (200) may apply a function for compensating for the calculated delay to an input signal of the second microphone to compensate for the delay in the input signal of the second microphone, and may synthesize the delay-compensated input signal with an input signal of the first microphone to obtain a voice signal. The wireless earphone device (200) may transmit the obtained voice signal to the electronic device (210).

According to an embodiment, a wireless earphone device (e.g., wireless earphone device (200)) includes two ear units (e.g., ear units (201, 202)), at least one ear unit of the two ear units includes a communication module (e.g., communication module (310)), at least one sensor (e.g., sensor (320)), a plurality of microphones (e.g., microphone (330)), at least one processor (e.g., 350) operatively connected to the communication module, the at least one sensor, and the plurality of microphones, and a memory (e.g., 360) operatively connected to the at least one processor, wherein, when executed, the at least one processor determines a wearing state of the ear units based on a first sensing signal of the at least one sensor and a second sensing signal received from another ear unit through the communication module, and, when it is determined that the wearing state of the ear units does not correspond to a reference state, selects one of the ear units based on the wearing state of the ear units, and selects a sensing signal for the selected ear unit based on the sensing signal for the selected ear unit. Store instructions for detecting a bias of the ear unit and compensating for a delay in a signal input to one of a plurality of microphones included in the ear unit based on the detected bias, wherein the bias may be an error angle due to a difference between a reference state of the ear unit and a confirmed wearing state for the ear unit.

In one embodiment, the instructions cause the at least one processor to obtain a first gravitational acceleration signal measured during a first time interval using the at least one sensor, obtain a second gravitational acceleration signal measured during the first time interval from the other ear unit, and determine at least one of a wearing angle or a left-right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal, wherein the first time interval may be a time interval in which a user wearing the ear units maintains a posture of looking straight ahead without speaking.

In one embodiment, the instructions cause the at least one processor to obtain a third gravitational acceleration signal measured using the at least one sensor during a second time interval, obtain a fourth gravitational acceleration signal measured during the second time interval from the other ear unit, and determine a wearing intensity of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal, wherein the second time interval may be a time interval in which a user wearing the ear units maintains a posture of looking straight ahead while speaking.

In one embodiment, the instructions may cause the at least one processor to compare the first sensing signal and the second sensing signal with a reference signal representing the measurement signal of the reference state, and to determine the wearing state of the ear units based on the comparison result.

In one embodiment, the instructions may cause the at least one processor to receive a wearing test request for the ear units from an electronic device (e.g., electronic device (200)) with which a wireless connection is established through the communication module, obtain the first sensing signal and the second sensing signal based on the wearing test request, and transmit information about the wearing state of the ear units confirmed based on the first sensing signal and the second sensing signal to the electronic device.

In one embodiment, the at least one ear unit further includes a speaker (e.g., speaker (340)), and the instructions may cause the at least one processor to receive wearing guide information corresponding to a wearing state of the ear units from the electronic device, and output the received wearing guide information through the speaker.

In one embodiment, the instructions may cause the at least one processor to determine a wearing state of the ear units based on a first sensing signal obtained from the at least one sensor after outputting the wearing guide information and a second sensing signal received from the other ear unit through the communication module, and to determine whether the determined wearing state of the ear units corresponds to the reference state.

In one embodiment, the instructions may cause the at least one processor to select an ear unit whose wearing state is closer to the reference state among the ear units when it is determined that the wearing state of the ear units does not correspond to the reference state after outputting the wearing guide information a specified number of times.

In one embodiment, the instructions may cause the at least one processor to calculate a delay for an input signal of the second microphone based on a distance and a bias between a first microphone (e.g., a first microphone (901)) and a second microphone (e.g., a second microphone (902)) among a plurality of microphones included in the selected ear unit, and to apply a function for compensating for the calculated delay to the input signal of the second microphone to obtain a delay-compensated input signal for the input signal of the second microphone.

In one embodiment, the instructions may cause the at least one processor to generate a voice signal by synthesizing the delay-compensated input signal with an input signal of the first microphone, and to transmit the generated voice signal to an electronic device having a wireless connection established with the ear units.

According to another embodiment, an operating method in one of the ear units constituting a wireless earphone device includes an operation of detecting wearing of the ear units based on a first sensing signal measured in the ear unit and a second sensing signal received from another ear unit, an operation of confirming a wearing state of the ear units based on the first sensing signal and the second sensing signal, an operation of selecting one of the ear units based on the wearing states of the ear units when it is confirmed that the wearing states of the ear units do not correspond to a reference state, an operation of detecting a bias of the selected ear unit, and an operation of compensating for a delay for a signal input to one of a plurality of microphones included in the ear unit based on the detected bias, wherein the bias may be an error angle due to a difference between a reference state of the ear unit and a wearing state confirmed for the ear unit.

In one embodiment, the operation of checking the wearing state of the ear units includes an operation of obtaining a first gravitational acceleration signal measured during a first time interval using at least one sensor included in the ear unit, an operation of obtaining a second gravitational acceleration signal measured during the first time interval from another ear unit, and an operation of checking at least one of a wearing angle or a left-right direction of the ear units based on the first gravitational acceleration signal and the second gravitational acceleration signal, wherein the first time interval may be a time interval in which a user wearing the ear units maintains a posture of looking straight ahead without speaking.

In one embodiment, the operation of checking the wearing state of the ear units includes an operation of obtaining a third gravitational acceleration signal measured during a second time interval using the at least one sensor, an operation of obtaining a fourth gravitational acceleration signal measured during the second time interval from another ear unit, and an operation of checking the wearing intensity of the ear units based on the third gravitational acceleration signal and the fourth gravitational acceleration signal, wherein the second time interval may be a time interval in which a user wearing the ear units maintains a posture of looking straight ahead while speaking.

In one embodiment, the operation of checking the wearing state of the ear units may include an operation of comparing the first sensing signal and the second sensing signal with a reference signal representing a measurement signal of the reference state, and an operation of checking the wearing state of the ear units based on the comparison result.

In one embodiment, the method may further include receiving a wear test request for the ear units from an electronic device having a wireless connection established with the ear units, obtaining the first sensing signal and the second sensing signal based on the wear test request, and transmitting information about the wearing state of the ear units confirmed based on the first sensing signal and the second sensing signal to the electronic device.

In one embodiment, the method may further include an operation of receiving wearing guide information corresponding to a wearing state of the ear units from the electronic device, and an operation of outputting the received wearing guide information through a speaker included in the ear units.

In one embodiment, the method may further include an operation of confirming a wearing state of the ear units based on a first sensing signal measured from the ear unit and a second sensing signal received from the other ear unit after outputting the wearing guide information, and an operation of confirming whether the confirmed wearing state of the ear units corresponds to the reference state.

In one embodiment, the method may further include an operation of selecting an ear unit whose wearing state is closer to the reference state among the ear units when it is confirmed that the wearing state of the ear units does not correspond to the reference state after outputting the wearing guide information a specified number of times.

In one embodiment, the operation of compensating for a delay for a signal input to one of the plurality of microphones may include the operation of calculating a delay for an input signal of the second microphone based on a distance and an angle between a first microphone and a second microphone included in the selected ear unit, and the operation of applying a function for compensating for the calculated delay to the input signal of the second microphone to obtain a delay-compensated input signal for the input signal of the second microphone.

In one embodiment, the method may further include generating a voice signal by synthesizing the delay-compensated input signal with an input signal of the first microphone, and transmitting the generated voice signal to an electronic device having a wireless connection established with the ear units.

Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

The term "module" as used herein may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

According to various embodiments, each component (e.g., a module or a program) of the above-described components may include a single or multiple entities. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims (20)

In wireless earphone devices,
Contains two ear units,
At least one of the above two ear units,
Communication module;
At least one sensor;
Multiple microphones;
at least one processor; and
Contains memory that stores instructions,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
While the user wearing the above ear units maintains a frontal posture, the wearing status of the ear units is confirmed based on the first sensing signal of the at least one sensor and the second sensing signal received from another ear unit through the communication module,
If it is confirmed that the wearing status of the above ear units does not correspond to the reference status, one of the ear units is selected based on the wearing status of the above ear units,
Detecting the declination of the ear unit based on the sensing signal for the selected ear unit,
Calculate the delay for the input signal of the second microphone based on the distance between the first microphone and the second microphone among the plurality of microphones included in the above-mentioned selected ear unit, the speed of sound, and the detected bias,
To compensate for the calculated delay for the input signal of the second microphone,
A wireless earphone device, wherein the above-mentioned angle is an error angle due to the difference between the reference state of the ear unit and the confirmed wearing state of the ear unit. In claim 1,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Obtaining a first gravitational acceleration signal measured during a first time interval using at least one sensor,
Obtain a second gravitational acceleration signal measured during the first time interval from the other ear unit,
At least one of the wearing angle or left-right direction of the ear units is checked based on the first gravity acceleration signal and the second gravity acceleration signal,
A wireless earphone device, wherein the first time period is a time period in which the user maintains a posture of looking straight ahead without speaking. In claim 1,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Obtaining a third gravitational acceleration signal measured using at least one sensor during a second time interval,
Obtaining a fourth gravitational acceleration signal measured during the second time interval from the other ear unit,
The wearing strength of the ear units is checked based on the third gravity acceleration signal and the fourth gravity acceleration signal.
A wireless earphone device wherein the second time period is a time period in which the user maintains a posture of looking straight ahead while speaking. In claim 1,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Compare the first sensing signal and the second sensing signal with a reference signal representing a measurement signal of the reference state,
A wireless earphone device that checks the wearing status of the ear units based on the above comparison results. In claim 1,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Receive a wear test request for the ear units from an electronic device with which a wireless connection has been established through the communication module;
Obtaining the first sensing signal and the second sensing signal based on the above-mentioned wear test request,
A wireless earphone device that transmits information about the wearing status of the ear units confirmed based on the first sensing signal and the second sensing signal to the electronic device. In claim 5,
wherein at least one of the ear units further comprises a speaker,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Receive wearing guide information corresponding to the wearing status of the ear units from the electronic device,
A wireless earphone device that outputs the received wearing guide information through the speaker. In claim 6,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
After outputting the above wearing guide information, the wearing status of the ear units is confirmed based on the first sensing signal obtained from the at least one sensor and the second sensing signal received from the other ear unit through the communication module.
A wireless earphone device that checks whether the wearing state of the above-mentioned ear units corresponds to the above-mentioned reference state. In claim 7,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
A wireless earphone device that, when it is confirmed that the wearing state of the ear units does not correspond to the reference state after outputting the above wearing guide information a specified number of times, selects an ear unit among the ear units whose wearing state is closer to the reference state. In claim 1,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
A wireless earphone device that obtains a delay-compensated input signal for the input signal of the second microphone by applying a function for compensating the calculated delay to the input signal of the second microphone. In claim 9,
The above instructions, when executed by the at least one processor, cause the wireless earphone device to:
Generate a voice signal by synthesizing the delay-compensated input signal with the input signal of the first microphone,
A wireless earphone device that transmits the generated voice signal to an electronic device that has a wireless connection established with the ear units. delete delete delete delete delete delete delete delete delete delete