CN108810787B

CN108810787B - Foreign object detection method, device and terminal based on audio equipment

Info

Publication number: CN108810787B
Application number: CN201810521364.2A
Authority: CN
Inventors: 严笔祥
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-05-28
Filing date: 2018-05-28
Publication date: 2021-08-31
Anticipated expiration: 2038-05-28
Also published as: CN108810787A

Abstract

The present application relates to an audio device-based foreign object detection method, device, terminal, audio device, and readable storage medium. The method includes: acquiring an acoustic reflection signal formed by reflection and vibration of the ear canal based on an audio signal played by an audio device; comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is when there is no foreign body in the ear canal The audio signal is a signal formed by the reflection and vibration of the ear canal; the detection result of whether there is a foreign body in the ear canal is output according to the comparison result, and the detection result of whether there is a foreign body in the ear canal can be intelligently output according to the comparison result of the acoustic reflection signal and the preset reflection signal , which can remind the user to clean up foreign objects in time, improve the user's listening experience, and expand the use function of the headset or terminal.

Description

Foreign matter detection method and device based on audio equipment and terminal

Technical Field

The present application relates to the field of communications technologies, and in particular, to a foreign object detection method and apparatus based on an audio device, a terminal, an audio device, and a readable storage medium.

Background

With the development of communication technology, intelligent devices have been incorporated into the lives of people, and the lives of people are greatly improved. More and more people like to listen to music and watch videos by using the terminal, so in order to ensure good listening experience and avoid causing sound interference to other people, users generally wear audio equipment and listen to audio by using ears.

In order to improve the hearing experience of the ears of a user, the user often treats foreign matters in the ear canals, but when the foreign matters are treated, the user cannot know whether the foreign matters exist in the ear canals, usually, the ears are taken out by blind people, and the experience degree is low; or the foreign matters need to be observed and cleaned by special auxiliary equipment, the operation is complex and the use is inconvenient.

Disclosure of Invention

The embodiment of the application provides a foreign matter detection method, a foreign matter detection device, a terminal, an audio device and a readable storage medium based on the audio device, which can automatically detect whether foreign matters exist in an auditory canal, timely remind a user of cleaning the foreign matters, and improve hearing experience of the user.

A foreign object detection method based on an audio device, comprising:

acquiring an acoustic reflection signal formed by the audio signal played by audio equipment through the reflection and vibration of an ear canal;

comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the auditory canal when no foreign matter exists in the auditory canal;

and outputting a detection result of whether the foreign matter exists in the auditory canal according to the comparison result.

An audio device-based foreign object detection apparatus comprising:

the acquisition module is used for acquiring an acoustic reflection signal formed by the audio signal played by the audio equipment through the reflection and the vibration of the auditory canal;

the comparison module is used for comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by reflecting and vibrating the audio signal through the auditory canal when no foreign matter exists in the auditory canal;

and the output module is used for outputting the detection result of whether the foreign matter exists in the auditory canal according to the comparison result.

A terminal comprising a memory and a processor, the memory having stored therein computer readable instructions, which when executed by the processor, cause the processor to perform the steps of the above method.

A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method.

An audio device comprises an audio acquisition module, a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor is electrically connected with the memory, the acquisition module and the processor, and the steps of the method are realized when the processor executes the computer program.

According to the foreign matter detection method based on the audio equipment, the device, the terminal, the audio equipment and the computer readable storage medium, acoustic reflection signals formed by the fact that the audio signals played by the audio equipment are reflected and vibrated through the auditory meatus can be obtained; comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the auditory canal when no foreign matter exists in the auditory canal; according to the comparison result output whether there is the testing result of foreign matter in the duct, can be intelligent according to whether there is the testing result of foreign matter in acoustic reflection signal and the comparison result output duct of predetermineeing reflection signal, can in time remind the user to clear up the foreign matter, promote user's sense of hearing and experience, expanded the service function at earphone or terminal.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a diagram illustrating an exemplary application of a foreign object detection method based on an audio device;

fig. 2 is a schematic diagram of the internal structure of the terminal in one embodiment;

FIG. 3 is a flow chart illustrating an exemplary method for detecting a foreign object based on an audio device;

FIG. 4 is a flow diagram illustrating a comparison of the acoustic reflection signal with a predetermined reflection signal according to one embodiment;

FIG. 5 is a flow chart illustrating the determination of whether a foreign object is present in the ear canal based on the comparison in one embodiment;

FIG. 6 is a flow chart of comparing the acoustic reflection signal with a predetermined reflection signal in another embodiment;

FIG. 7 is a flow chart illustrating the determination of whether a foreign object is present in the ear canal based on the comparison in accordance with another embodiment;

FIG. 8 is a flow chart illustrating a foreign object detection method based on an audio device according to another embodiment;

FIG. 9 is a flow chart illustrating a foreign object detection method based on an audio device according to another embodiment;

FIG. 10 is a block diagram of an embodiment of an audio device-based foreign object detection apparatus;

fig. 11 is a block diagram of a partial structure of a mobile phone related to a terminal according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application.

Fig. 1 is a schematic diagram of an application environment of an input operation control method in one embodiment. As shown in fig. 1, the application environment includes a terminal 110 and an audio device 120 communicating with the terminal 110.

Where audio signals including, but not limited to, songs, video tones, spoken voice, etc. are played on the terminal 110, the terminal 110 is communicatively coupled to the audio device 120. The terminal 110 and the audio device 120 may communicate in a wired or wireless manner to realize data transmission.

Terminal 110 has installed thereon an Application (APP), which refers to a computer program for performing one or more specific tasks, and which operates in a user mode, is capable of interacting with a user, and has a visual user interface. The terminal 110 interacts with the user through an application, for example, the terminal 110 may play songs that the user likes and recommend songs to the user through the music APP.

The audio device 120 may be a device having a sound generating function, such as a speaker or an earphone, or an electronic device having an input and an output of audio signals, such as an earphone including a speaker or an earphone.

Fig. 2 is a schematic diagram of an internal structure of the terminal in one embodiment. The terminal 110 includes a processor, a memory, and a display screen connected by a system bus. Wherein the processor is configured to provide computing and control capabilities to support the operation of the entire terminal 110. The memory is used for storing data, programs, instruction codes and/or the like, and at least one computer program is stored on the memory, and the computer program can be executed by the processor to realize the foreign object detection method based on the audio device suitable for the terminal 110 provided in the embodiment of the present application. The Memory may include a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random-Access-Memory (RAM). For example, in one embodiment, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a database, and a computer program. The database stores data related to implementing a foreign object detection method based on an audio device provided in the above embodiments. The computer program can be executed by a processor for implementing an audio device-based foreign object detection method provided by various embodiments of the present application. The internal memory provides a cached operating environment for the operating system, databases, and computer programs in the non-volatile storage medium. The display screen may be a touch screen, such as a capacitive screen or an electronic screen, for displaying interface information of the terminal 110, and includes a screen-on state and a screen-off state. The terminal 110 may be a mobile phone, a tablet computer, a personal digital assistant, a wearable device, or the like.

Those skilled in the art will appreciate that the configuration shown in fig. 2 is a block diagram of only a portion of the configuration associated with the present application and does not constitute a limitation on the terminal 110 to which the present application is applied, and that a particular terminal 110 may include more or less components than those shown, or combine certain components, or have a different arrangement of components.

Fig. 3 is a flowchart of an audio device-based foreign object detection method in an embodiment, where the audio device-based foreign object detection method in this embodiment is described by taking the terminal and/or the audio device in fig. 1 as an example. The audio device may be a device having a generating function such as a speaker or an earphone, or may be an electronic device having an input/output audio signal such as an earphone including a speaker or an earphone. In the present application, an earphone is described as an audio device, wherein the earphone may be a wired or wireless earphone that can be placed into the ear canal of a user. The foreign matter detection method based on the audio equipment comprises the following steps 302-306:

step 302: the method comprises the steps of obtaining an acoustic reflection signal formed by reflecting and vibrating an audio signal played by the audio equipment through an ear canal.

The audio device may be an in-ear, earplug, or other wired or wireless headset that may be placed in the ear canal of the user. The user can listen to music, receive calls, etc. using the headset. When the user places the earphone in the ear canal, an acoustic reflection signal formed by the audio signal reflected and vibrated by the ear canal can be recorded based on the audio signal currently played by the earphone.

The audio signal played by the earphone can be controlled by a terminal connected with the earphone, the terminal can output the audio signal to the earphone, and the earphone plays the audio signal. The audio signal can be music or voice signal sent by playing multimedia file for application program (music, video, game, conversation, etc.); the audio signal can also be a voice signal of the user or a contact person in the conversation process; the audio signal may also be a sound signal outside the hearing range of the user (audio signal above 20 KHz) or the like. It should be noted that the above list is an example of an audio signal, and is not limited, and the audio signal may be set in other ways.

When the earphone is placed in the ear canal, the earphone plays an audio signal, which is transmitted in the ear canal, forming an acoustic reflection signal by reflection and vibration of the ear canal.

In one embodiment, the earphone includes an electroacoustic transducer, and an acoustic reflection signal formed by the audio signal reflecting and vibrating through the ear canal can be collected or recorded based on the electroacoustic transducer of the earphone. The electroacoustic transducer is a loudspeaker and can convert an electric signal corresponding to an audio signal into a sound wave signal which can be heard by a user. Meanwhile, the electroacoustic transducer is very sensitive to sound waves in the internal structure (ear canal) of the ear of a user, can cause the vibration of a cone of a loudspeaker, and drives a coil connected with the cone to make a motion of cutting magnetic lines of force in a magnetic field of a permanent magnet, so that current changing along with the change of the sound waves is generated (the phenomenon of generating the current is physically called as an electromagnetic induction phenomenon), and meanwhile, electromotive force of audio frequency is output at two ends of the coil. Thus, the electroacoustic transducer may also be used to pick up an acoustic reflection signal formed by the audio signal reflecting and vibrating through the ear canal. That is, the electroacoustic transducer may be used as a microphone.

The electroacoustic transducer playing the audio signal records the acoustic reflection signal formed by the audio signal reflected and vibrated by the auditory canal, and a microphone does not need to be additionally arranged in the earphone, so that the cost is saved, and the internal structure of the earphone is simplified.

Optionally, the earphone may further include a microphone for acquiring an acoustic reflection signal formed by reflection and vibration of the audio signal and the vibration signal from the ear canal. Wherein the microphone of the earphone is arranged at the side of the earphone in contact with the ear canal of the user when the earphone is worn in the ear canal of the user, e.g. the microphone may be arranged on the earphone housing of the speaker through hole.

It should be noted that, the executing body for acquiring the acoustic reflection signal formed by the audio signal played by the audio device being reflected and vibrated by the ear canal in step 302 may be an audio device (earphone) or a terminal. The earphone can directly acquire acoustic reflection signals which are acquired by the electroacoustic transducer or the microphone and formed by the reflection and the vibration of the auditory canal, or the earphone can transmit the acquired acoustic reflection signals to a terminal which is in communication connection with the earphone, and then the terminal acquires the acoustic reflection signals.

Step 304: comparing the acoustic reflection signal with a preset reflection signal.

The preset reflection signal may be a signal formed by the audio signal being reflected and vibrated by the ear canal when there is no foreign object in the ear canal. That is, after the foreign matter in the user's ear canal is cleared away totally, place the earphone in the ear canal, the audio signal is broadcast to the earphone to gather the signal that this audio signal formed through ear canal reflection and vibration, this signal is promptly and predetermines reflection signal. The preset reflected signal may be stored in the earphone or the terminal in advance.

When foreign matters exist in the auditory canal of a user, the transmission stroke and the reflection stroke of the audio signals are influenced by the existence of the foreign matters in the process of transmitting the audio signals in the auditory canal of the user, and meanwhile, the absorption degree of the foreign matters and the skin of the auditory canal of the user to the audio signals is different. The acquired acoustic reflection signal may be compared with a preset reflection signal, and whether a foreign object exists in the ear canal of the user may be determined according to the comparison result.

Specifically, when comparing the acoustic reflection signal with the preset reflection signal, the loudness information and the energy information of the two signals may be compared. The loudness information can refer to subjective feeling of human ears on volume and sound intensity, and the loudness is mainly determined by the sound intensity, so that the sound intensity is improved, and the loudness level is correspondingly increased; the loudness of sound is not determined purely by sound intensity, but depends on frequency, and pure tones of different frequencies have different loudness growth rates, wherein the loudness growth rate of low-frequency pure tones is faster than that of medium-frequency pure tones. The energy information can be obtained by calculating the square sum of the signal intensities of the acoustic reflection signal in a preset time period.

Optionally, when the acoustic reflection signal is compared with the preset reflection signal, an acoustic impulse response capable of characterizing the acoustic characteristics of the space in the ear canal of the user of the earphone can be obtained according to the ratio of the acoustic reflection signal to the audio signal. That is, the acoustic impulse response may be used to characterize the spatial acoustic characteristics of the enclosed space formed by the earpiece and the user's ear canal when the earpiece is placed in the ear canal. Whether foreign matters exist in the auditory canals of the users can be judged by comparing the acoustic reflection signals and the audio signals with the ratio of the audio signals.

It should be noted that, the executing body for comparing the acoustic reflection signal with the preset reflection signal in step 304 may be an audio device (earphone) or a terminal. The preset reflection signal may be preset and stored in the audio device or the terminal, and when the execution subject for acquiring the acoustic reflection signal in step 302 is an earphone, the earphone may compare the acquired acoustic reflection signal with the stored preset reflection signal. When the execution subject of the step 302 of acquiring the acoustic reflection signal is a terminal, the terminal may compare the acquired acoustic reflection signal with a stored preset reflection signal.

Step 306: and outputting a detection result of whether the foreign matter exists in the auditory canal according to the comparison result.

According to the comparison result of the acoustic reflection signal and the preset reflection signal, whether foreign matters exist in the auditory canal of the user can be determined, and the detection result of whether the foreign matters exist in the auditory canal is output.

Specifically, if the loudness information of the reflected signal and the preset reflected signal is compared, whether foreign matters exist in the auditory canal of the user can be judged according to the difference value by comparing the loudness information of the reflected signal and the preset reflected signal; if the comparison is the energy information of the reflected signal and the preset reflected signal, whether foreign matters exist in the auditory canal can be judged according to the difference value by comparing the energy information of the two reflected signals; if the comparison is the ratio of the reflection signal and the preset reflection signal to the audio signal, whether foreign matters exist in the auditory canal can be judged according to the scale factor by comparing the scale factors of the energy information of the reflection signal and the preset reflection signal.

The output mode of the detection result can be output through earphone voice, and also can be output through terminal voice and/or display. Further, when there is the foreign matter in the user's duct, earphone or terminal can export corresponding warning sound suggestion user, and the user of being convenient for in time clears up the foreign matter in the duct, improves user's sense of hearing and experiences, can also avoid the foreign matter in the duct to cause the influence to user's health simultaneously. When no foreign matter exists in the ear canal of the user, the earphone or the terminal can output corresponding prompt tone to inform the user, no foreign matter exists in the ear canal, and prompt information such as frequent ear picking is not needed.

It should be noted that, the execution subject outputting the detection result of whether the foreign object exists in the ear canal according to the comparison result in step 304 may be an audio device (earphone) or a terminal.

The foreign matter detection method based on the audio equipment obtains an acoustic reflection signal formed by the audio signal played by the audio equipment through the reflection and the vibration of the auditory canal; comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the auditory canal when no foreign matter exists in the auditory canal; according to the comparison result output whether there is the testing result of foreign matter in the duct, can be intelligent according to whether there is the testing result of foreign matter in acoustic reflection signal and the comparison result output duct of predetermineeing reflection signal, can in time remind the user to clear up the foreign matter, promote user's sense of hearing and experience, expanded the service function at earphone or terminal.

It should be noted that, in steps 302 to 306, the execution subject of each step may be a terminal or an audio device, and this is not limited further.

In one embodiment, before comparing the acoustic reflection signal with a preset reflection signal, the method may further include: the audio signal is subjected to filtering and noise reduction processing to filter noise signals affecting the audio signal, wherein the noise signals may be environmental noises when the audio signal is played, such as external whistling sounds, speaking sounds and the like, and may also be circuit noises of the audio device itself. Environmental noise and circuit noise can cause big interference to the result of comparison, through carrying out filtering noise reduction to audio signal, can improve whether have the accuracy that the foreign matter judged in the duct, prevent that the condition of erroneous judgement from taking place.

FIG. 4 is a flow chart of comparing the acoustic reflection signal with a predetermined reflection signal according to an embodiment. In one embodiment, comparing the acoustic reflection signal with a preset reflection signal comprises:

step 402: and determining the acoustic impulse response of the spatial characteristics of the ear canal where the audio equipment is located according to the acoustic reflection signal and the audio signal.

The method comprises the steps of placing an earphone at a preset position of an ear canal of a user, obtaining an audio signal s (t) played by the earphone currently and an acoustic reflection signal r (t) collected by an electroacoustic transducer or a microphone in the ear canal, and determining an acoustic impulse response w (t) of a space feature of the earphone in the ear canal of the user according to the acoustic reflection signal r (t) and the audio signal s (t). The relationship among the acoustic reflection signal r (t), the audio signal s (t), and the acoustic impulse response w (t) can be expressed by the following formula:

r(t)＝s(t)*w(t) (1)

where the acoustic impulse response w (t) is a parameter reflecting the coupling of the earpiece and the user's ear. The acoustic impulse response w (t) can be understood as the spatial characteristics of the ear canal of the user where the earphone is currently located. When no foreign body exists in the auditory canal and the earphone is located at different positions of the auditory canal, the corresponding acoustic impulse response w (t) is different; when different amounts of foreign objects are present in the ear canal of the earpiece with the earpiece in the same position, the corresponding acoustic impulse response w (t) is also different. In formula (1), the audio signal is s (t) and the acoustic reflection signal is r (t) which can be obtained by monitoring an audio circuit arranged in the audio device or the terminal, and thus the acoustic impulse response w (t) associated with the spatial feature of the ear canal in which the earphone is located can be obtained.

Furthermore, a noise factor e (t) may be added to the above formula (1), where the noise factor e (t) includes ambient noise and circuit noise; the environmental noise is generated in the process of recording the acoustic reflection signal when the audio signal s (t) is not played, and can be collected by an additional microphone; circuit noise is noise caused in a built-in circuit of an audio device, and is an inherent property of the audio device. Adding the noise factor e (t) as a known parameter, and considering the noise factor e (t), the formula (1) can be revised as:

r(t)＝s(t)*w(t)+e(t) (2)

in the formula (2), the newly added noise factor e (t), the audio signal s (t), and the acoustic reflection signal r (t) are known parameters, and the acoustic impulse response w (t) associated with the spatial feature of the ear canal where the earphone is located can be obtained.

Furthermore, the ear print information of each user can be characterized by the acoustic impulse response w (t), and the identity information of the user can be determined according to the ear print information, and correspondingly, the acoustic impulse response can also characterize the identity information of the user.

It should be noted that the preset position may be the most comfortable position for the user to wear the headset, the most stable position for wearing the headset, or a user-defined position. In the embodiments of the present application, the preset position is not further limited.

Step 404: and determining a preset impulse response of the spatial feature of the ear canal where the audio equipment is located according to the preset reflection signal and the audio signal.

The preset reflection signal is a signal formed by the fact that when no foreign matter exists in the ear canal of the user and the earphone is worn at the preset position, the audio signal is reflected and vibrated through the ear canal. That is, after the foreign matter in the user's ear canal is cleared away totally, place the earphone in the preset position department of ear canal, the audio signal is broadcast to the earphone to gather the signal that this audio signal formed through ear canal reflection and vibration, this signal is just predetermineeing the reflection signal.

Correspondingly, the earphone is placed at a preset position of the ear canal of the user, an audio signal s ' (t) currently played by the earphone and a preset reflection signal r ' (t) in the ear canal collected by the electroacoustic transducer or the microphone are obtained, and a preset impulse response w ' (t) of the space characteristic of the earphone in the ear canal of the user is determined according to the preset reflection signal r ' (t) and the audio signal s ' (t). The relationship between the audio signal s (t), the preset reflection signal r '(t) and the preset impulse response w' (t) can be expressed by the following formula:

r'(t)＝s(t)*w'(t) (3)

in the formula, the preset impulse response w' (t) is a parameter that can reflect the coupling between the earphone and the ear of the user when no foreign object is present in the ear canal of the user. In the formula (3), the audio signal s (t) and the preset reflection signal r '(t) may be obtained by monitoring through an audio circuit provided in the audio device or the terminal, so as to obtain a preset impulse response w' (t) associated with the spatial feature of the ear canal where the earphone is located.

Further, the position of the earphone in the ear canal can be adjusted, and a set (1-10) of preset impulse responses for characterizing the spatial characteristics of the ear canal of the user where the earphone is currently located is obtained.

Step 406: and comparing the preset impulse response with the acoustic impulse response, and acquiring a scale factor of the preset impulse response and the acoustic impulse response.

Comparing the obtained preset impulse response w '(t) with the acoustic impulse response w (t), wherein a difference or a ratio of the preset impulse response w' (t) and the acoustic impulse response w (t) can be obtained, and the obtained difference is recorded as a difference factor and the obtained ratio is recorded as a scale factor. When the earphone is fixedly placed at the preset position, the spatial characteristic of the ear canal corresponding to the situation that no foreign matter exists in the ear canal of the user is the largest, namely the corresponding preset impulse response w' (t) is also the largest. In the present embodiment, the scale factor μ of the preset impulse response w '(t) and the acoustic impulse response w (t) may be obtained, where the scale factor μ is the preset impulse response w' (t)/the acoustic impulse response w (t).

FIG. 5 is a flow chart of determining whether a foreign object is present in the ear canal based on the comparison in one embodiment. In one embodiment, determining whether a foreign object is present in the ear canal based on the comparison comprises:

step 502: and comparing the scale factor with a preset scale factor.

Step 504: and when the scale factor is larger than the preset scale factor, outputting prompt information that foreign matters exist in the auditory canal.

According to the step 406, the preset impulse response and the acoustic impulse response are compared, and a scale factor of the preset impulse response and the acoustic impulse response is obtained. And comparing the obtained scale factor with a preset scale factor, and outputting prompt information of the existence of foreign matters in the auditory canal when the obtained scale factor is greater than the preset scale factor.

When a user can determine that foreign matters exist in the ear canal of the user by naked eyes or by means of other sight glass equipment, the acoustic impulse response w (t) is obtained by the test signal and the acoustic reflection signal played by the gene earphone, and then the scale factor mu of the preset impulse response w' (t) and the acoustic impulse response w (t) is obtained. Under the condition that the foreign matter exists in the auditory canal of the user, a large number of scale factors mu are obtained, data statistics analysis is carried out on the obtained scale factors mu, and then the preset scale factors are obtained. Wherein, the preset scale factor can be set to 1, 1.1, 1.2 and other values. Optionally, the preset scale factor may also be set according to the identity information of the user, and the preset scale factors of users with different identity information are different. In the embodiment of the present application, the obtaining manner and the numerical value of the preset scaling factor are not further limited.

When the obtained scale factor is larger than the preset scale factor, the foreign matter in the auditory canal of the user can be determined, and prompt information can be output so as to remind the user to draw the auditory canal in time, clear the foreign matter in the auditory canal and improve the auditory experience of the user. Meanwhile, the influence on the health of the human body caused by excessive foreign matters and overlong stay time existing in the auditory canal can be avoided.

Optionally, the detection results with different degrees may be output according to the difference between the scaling factor and the preset scaling factor, for example, "too many foreign bodies, suggest medical treatment"; "more foreign body, timely ear picking treatment"; "foreign matter is present, ear picking treatment is performed at idle time", and the like.

When the obtained scale factor is smaller than or equal to the preset scale factor, it can be determined that no foreign matter exists in the ear canal of the user, or the amount of the existing foreign matter is very small and can be ignored. In this case, a prompt message such as "no foreign matter is present and ear picking processing is not necessary" can be output.

It should be noted that, when outputting the detection result of whether there is a foreign object in the ear canal, the way of outputting the detection result may be an earphone voice output, a terminal voice output or a terminal display output; the prompt content for outputting the detection result is not limited to the above example, and may also be set according to the actual experience of the user. In the present application, the manner and content of the presentation are not further limited.

Fig. 6 is a flow chart of comparing the acoustic reflection signal with a predetermined reflection signal in another embodiment. In one embodiment, outputting a detection result of whether a foreign object exists in the ear canal according to the comparison result includes:

step 602: acquiring first decibel information of a preset audio clip in the acoustic reflection signal;

step 604: acquiring second decibel information of the preset audio clip in the preset reflection signal;

decibel (decibel) is a unit of measure that measures the ratio of the number of two identical units, primarily used to measure sound intensity, often expressed in dB. Decibels are the more commonly used unit of measure. The decibels may represent one unit of the ratio of the power quantities, equal to 10 times the common logarithm of the ratio of the power intensities. The decibels may represent one unit of the ratio of the field magnitudes, equal to 20 times the common logarithm of the ratio of the field magnitude. The decibels may represent units of sound pressure level that are approximately equal to the minimum division of the difference in loudness that is typically perceived by the human ear.

Specifically, amplitude information (amplitude) of the preset audio segment may be obtained based on the obtained preset audio segment, where the amplitude information may be a maximum amplitude of the preset audio segment or an average amplitude of the preset audio segment, and the average amplitude may be a sum of squares of the preset audio segment or an average of absolute values of the preset audio segment. For example, the decibel information of the preset audio segment may be obtained based on the following formula:

in the formula, L_dBDecibel information (decibel value), A, representing a preset audio segment₁Amplitude information representing the predetermined audio piece, A₀Representing the reference amplitude. Wherein the reference value amplitude A₀600 may be taken, at which time the calculated decibel information is the decibel value relative to the background noise; amplitude of reference a₀The amplitude of the sound pressure value of 20 micro-pascals and the reference value amplitude A can also be₀It can also be defined as 1, the minimum sound amplitude that can be picked up by a microphone in the audio device. It should be noted that the examples of the present application are for reference valuesAmplitude A₀And is not particularly limited.

Specifically, the terminal or the headphone may use read (byte 2) for sound source data of a preset audio segment in the acoustic reflection signal]The method reads the audio data from the buffer into the byte array, and then obtains the amplitude information of the preset audio segment in the acoustic reflection signal, such as the maximum amplitude or the average amplitude (the square sum or the average value of the absolute values). In this embodiment, the average amplitude of the preset audio segment in the acoustic reflection signal can be obtained, so that the influence of individual extreme values can be avoided, and the calculation result is more stable. After obtaining the average amplitude, when the average amplitude A₁The average amplitude A is then averaged₁Substituting into a formula with constant coefficient of 10; when the average amplitude A₁When the average amplitude is the average of absolute values, the average amplitude A is calculated₁Substituting into a formula with a constant coefficient of 20 to obtain first decibel information.

Correspondingly, the terminal or the earphone can also extract a preset audio clip in the preset reflection signal, and then the second decibel information is obtained according to the amplitude information of the preset audio clip.

The preset audio clip may be a clip set by a user in the audio signal, a clip with a specific frequency in the audio signal, or an audio clip within a preset duration. The starting point, the duration and the number of the preset durations can be set according to the characteristics of the audio signals, and the embodiment of the application is not limited. For example, the 5 th to 15 th seconds for starting the acquisition may be a preset time length, and the 5 th second for starting the acquisition may also be a preset time length, and then each time period of 1 second is a time length.

Step 606: and comparing and acquiring the difference value of the second decibel information and the first decibel information.

Comparing the obtained first decibel information with the obtained second decibel information to obtain a difference between the second decibel information and the first decibel information, that is, the difference δ is the second decibel information L_dB2-first decibel information L_dB1。

Optionally, information such as a ratio of the first decibel information to the second decibel information, or an absolute value of a difference between the first decibel information and the second decibel information may be obtained through comparison.

Fig. 7 is a flow chart of determining whether a foreign object is present in the ear canal according to the comparison result in another embodiment. In one embodiment, determining whether a foreign object is present in the ear canal based on the comparison comprises:

the determining whether a foreign object exists in the ear canal according to the comparison result includes:

step 702: comparing the difference value with a preset difference value;

step 704: and when the difference is larger than the preset difference, outputting prompt information that foreign matters exist in the auditory canal.

When foreign matters exist in the auditory canal, the closed space formed by the earphone and the auditory canal is smaller than the space without the foreign matters due to the existence of the foreign matters, and the reflection path of an acoustic reflection signal formed by the reflection and vibration of an audio signal of the earphone is smaller than a preset reflection signal. When the electroacoustic transducer or the microphone in the earphone respectively collects the acoustic reflection signal and the preset reflection signal, the decibel information corresponding to the acoustic reflection signal and the preset reflection signal can be obtained. The shorter the reflection path is, the smaller the absorption and propagation loss of the sound signal is, and the greater the sound intensity of the acoustic reflection signal formed by reflection and vibration is, that is, the greater the decibel information is. Based on the method, whether foreign matters exist in the auditory canal of the user can be judged according to the acoustic reflection signals and the decibel information of the preset reflection signals.

According to the obtained difference value delta-second sub information L_dB2-first decibel information L_dB1Further, the difference δ may be compared with a preset difference value_{Preparation of}Comparing, and when the obtained difference delta is larger than the preset difference delta_{Preparation of}During the time, then can confirm that there is the foreign matter in the duct to the suggestion information of "there is the foreign matter in the duct, worried about in time clearance" is output, according to this suggestion information, the user can in time clear up the foreign matter in the duct, improves user's sense of hearing and experiences, can avoid simultaneously because of the foreign matter too much, stop the time in the ductToo long to affect the health of the user.

Optionally, the detection results with different degrees may be output according to the magnitude of the difference, for example, "too many foreign bodies, suggest medical treatment"; "more foreign body, timely ear picking treatment"; "foreign matter is present, ear picking treatment is performed at idle time", and the like.

When the obtained difference is smaller than or equal to the preset difference, it can be determined that no foreign matter exists in the ear canal of the user, or the amount of the existing foreign matter is very small and can be ignored. In this case, a prompt message such as "no foreign matter is present and ear picking processing is not necessary" can be output.

In one embodiment, after outputting the prompt message of the presence of the foreign object in the ear canal, the method further includes:

step 802: and acquiring the preset volume of the audio equipment for playing the audio signal.

Step 804: and compensating the preset volume according to the scale factor to control and output an audio signal with a target volume.

When the foreign matter exists in the auditory canal, the volume of the audio signal received by the user is smaller than the volume of the audio played by the earphone due to the existence of the foreign matter, and in order to compensate the volume loss caused by the existence of the foreign matter, the lost volume can be compensated according to the volume of the audio signal played by the earphone, so that the playing volume is increased, and the user can receive the audio signal with perfect volume.

Specifically, the preset volume of the audio signal played by the earphone can be acquired based on the earphone, and the preset volume is compensated according to the scale factor to control the output of the audio signal with the target volume. The scale factor is a ratio of a preset impulse response w' (t) to an acoustic impulse response w (t). And compensating the preset volume according to the scale factor to obtain the target volume. The target volume is a product of the preset volume and the scale factor. When having the foreign matter in the duct, when playing audio signal with preset volume, because of the existence of foreign matter in the duct, the volume that can make this audio signal that the user received is less than preset volume, utilize the scale factor, can compensate because of the volume that the foreign matter blockked the loss, improve automatically and predetermine the volume, play audio signal with the target volume, can make the user receive the audio frequency that has preset volume, can be based on the volume that scale factor automatically regulated earphone output audio signal, improve the user and listen to audio signal's experience degree. Meanwhile, the mode of adjusting the volume is simple and quick, the response speed is high, the influence on the audio signal needing to be played is small, and the distortion is avoided.

Optionally, the gain of the audio signal to be played can be adjusted by adjusting the gain of the hardware, so as to increase the amplification factor and thus increase the playing volume.

The foreign matter detection method of the embodiment can automatically detect whether the foreign matter exists in the ear canal of the user based on the earphone, when the foreign matter exists in the ear canal, a corresponding detection result can be output, the volume of the audio signal played by the earphone is increased, and the volume of the audio signal received by the user is guaranteed not to be affected by the foreign matter existing in the ear canal.

Fig. 9 is a flowchart of an audio device-based foreign object detection method according to an embodiment, where the audio device-based foreign object detection method includes:

step 902: and acquiring the identity information of the user currently wearing the audio equipment.

The identity information may be ear print information, fingerprint information, etc. of the user. Specifically, the ear print information of the user may be obtained based on the currently played audio signal of the earphone, or the fingerprint information of the user may be verified based on the terminal. For example, obtaining the ear print information of the user based on the audio signal currently played by the earphone includes: when the earphone has an audio signal to play, the audio signal can form an acoustic reflection signal through the reflection and vibration of the ear canal (the internal structure of the ear), and the acoustic impulse response of the user can be obtained according to the played audio signal and the collected acoustic reflection signal. The acoustic impulse response is used for representing the spatial characteristics of the ear canal where the earphone is located currently, and can also be understood as ear print information of the ear canal where the earphone of the earphone is located currently.

Step 904: when the identity information is consistent with preset identity information, judging whether a trigger operation of foreign matter detection input by a user is received;

the preset identity information is identity information of the owner user, namely an original user of the earphone.

Specifically, the identity information may be represented by ear print information, and the preset identity information includes preset ear print information of the owner user (including ear print information of the left ear canal and ear print information of the right ear canal). When a user plays an audio signal using the headset, the headset includes a first earpiece and a second earpiece, wherein the first earpiece is placed in the left ear canal and the second earpiece is placed in the right ear canal. And if the ear print information of the left ear canal and the ear print information of the right ear canal of the user are matched with the preset ear print information, the identity information of the current user is considered to be consistent with the preset identity information. And when the identity information is consistent with the preset identity information, whether the earphone or the terminal receives a foreign matter detection triggering operation input by a user can be judged.

The triggering operation may be an input operation performed by a user on the earphone in a manner of touch, tapping, or the like according to a preset operation manner, or an input operation performed by a user on the terminal in a manner of touch, sliding, voice, pressing, or the like according to a preset operation manner. The system may also be automatically triggered, for example, when the earphone plays an audio signal, the detection may be performed once at a preset time interval, and so on. In the present application, neither the operation mode of the trigger operation nor the object for receiving the trigger operation is further limited.

Step 906: and when the triggering operation is received, acquiring an acoustic reflection signal formed by the audio signal played by the audio equipment through the reflection and vibration of the ear canal.

The triggering operation is used for opening a channel for foreign object detection, that is, when the triggering operation input by a user is received, an acoustic reflection signal formed by the audio signal played by the audio device through the ear canal reflection and vibration is obtained.

Step 908: comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the auditory canal when no foreign matter exists in the auditory canal;

step 910: and outputting a detection result of whether the foreign matter exists in the auditory canal according to the comparison result.

Steps 908 to 910 correspond to steps 304 to 306 in the previous embodiment, and are not further limited herein.

According to the foreign matter detection method based on the audio equipment, when the audio equipment is worn in the ear canal of a preset user, the foreign matter detection method can be executed according to the triggering operation input by the user, and the foreign matter detection is started only at the moment required by the user by setting the triggering condition of the foreign matter detection, so that the power consumption is saved, and the user experience is improved. Meanwhile, through identity verification, foreign matter detection is only carried out on the auditory meatus of the user according with the preset identity information, and unnecessary troubles brought to the user can be avoided.

It should be understood that, although the steps in the flowcharts corresponding to the above-described embodiments are sequentially shown as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in fig. 3-9 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performance of the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternating with other steps or at least some of the sub-steps or stages of other steps.

As shown in fig. 10, in one embodiment, there is provided an audio device-based foreign object detection apparatus, including:

an obtaining module 1010, configured to obtain an acoustic reflection signal formed by an audio signal played by an audio device being reflected and vibrated by an ear canal;

a comparing module 1020, configured to compare the acoustic reflection signal with a preset reflection signal, where the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the ear canal when no foreign object exists in the ear canal;

and an output module 1030, configured to output a detection result of whether a foreign object exists in the ear canal according to the comparison result.

The foreign matter detection device based on the audio equipment can acquire an acoustic reflection signal formed by the audio signal played by the audio equipment through the reflection and the vibration of the auditory canal; comparing the acoustic reflection signal with a preset reflection signal, wherein the preset reflection signal is a signal formed by the audio signal being reflected and vibrated by the auditory canal when no foreign matter exists in the auditory canal; according to the comparison result output whether there is the testing result of foreign matter in the duct, can be intelligent according to whether there is the testing result of foreign matter in acoustic reflection signal and the comparison result output duct of predetermineeing reflection signal, can in time remind the user to clear up the foreign matter, promote user's sense of hearing and experience, expanded the service function at earphone or terminal.

In one embodiment, the comparison module includes:

a determining unit, configured to determine, according to the acoustic reflection signal and the audio signal, an acoustic impulse response of a spatial feature of an ear canal in which the audio device is located; determining a preset impulse response of the spatial feature of the ear canal where the audio equipment is located according to the preset reflection signal and the audio signal;

and the comparison unit is used for comparing the preset impulse response with the acoustic impulse response and acquiring the scale factor of the preset impulse response and the acoustic impulse response.

In one embodiment, an output module includes:

the judging unit is used for comparing the scale factor with a preset scale factor;

and the output unit is used for outputting prompt information that foreign matters exist in the auditory canal when the scale factor is larger than a preset scale factor.

The foreign matter detection device of this embodiment can be based on the acoustics reflected signal that the earphone gathered, predetermine the reflected signal and acquire corresponding impulse response, according to whether there is the foreign matter in the impulse response automated inspection user's duct, when there is the foreign matter in the duct, can export corresponding testing result, can in time remind the user to clear up the foreign matter, promotes user's sense of hearing and experiences, has expanded the service function at earphone or terminal.

In another embodiment, a comparison module includes:

the decibel acquisition unit is used for acquiring first decibel information of a preset audio clip in the acoustic reflection signal; the second decibel information of the preset audio clip in the preset reflection signal is also obtained;

and the decibel comparison unit is used for comparing and acquiring the difference value between the second decibel information and the first decibel information.

In another embodiment, an output module includes:

a difference comparison unit for comparing the difference with a preset difference;

and the result output unit is used for outputting prompt information that foreign matters exist in the auditory canal when the difference value is larger than the preset difference value.

The foreign matter detection device of this embodiment can be based on the acoustics reflected signal that the earphone gathered and predetermine reflected signal's decibel information, whether have the foreign matter in the automated inspection user's duct, when having the foreign matter in the duct, can export corresponding testing result, can in time remind the user to clear up the foreign matter, promotes user's sense of hearing and experiences, has expanded the service function at earphone or terminal.

In one embodiment, the foreign object detection apparatus based on an audio device further includes:

the volume acquisition module is used for acquiring preset loudness information of the audio signal played by the audio equipment;

and the volume compensation module is used for compensating the preset loudness information according to the scale factor so as to control and output the audio signal with the target loudness.

The foreign matter detection device of this embodiment can be based on whether there is the foreign matter in the earphone automated inspection user's duct, when there is the foreign matter in the duct, can export corresponding testing result to improve earphone broadcast audio signal's volume, guarantee that the volume of the audio signal who is received by the user can not receive the influence because of there being the foreign matter in the duct.

the triggering module is used for acquiring the identity information of a user wearing the audio equipment at present; and when the identity information is consistent with the preset identity information, judging whether a trigger operation of foreign matter detection input by a user is received.

Above-mentioned foreign matter detection device based on audio equipment when audio equipment wears and predetermines user's duct, just can carry out the foreign matter detection method according to the trigger operation of user input, through setting for the trigger condition that the foreign matter detected, only just starts the foreign matter and detects at the moment that the user needs, saves the consumption, improves user experience degree. Meanwhile, through identity verification, foreign matter detection is only carried out on the auditory meatus of the user according with the preset identity information, and unnecessary troubles brought to the user can be avoided.

The division of each module in the above foreign object detection apparatus based on audio equipment is merely for illustration, and in other embodiments, the foreign object detection apparatus based on audio equipment may be divided into different modules as needed to complete all or part of the functions of the above foreign object detection apparatus based on audio equipment.

For specific limitations of the audio device-based foreign object detection apparatus, reference may be made to the above limitations of the audio device-based foreign object detection method, which are not described herein again. The modules in the foreign object detection apparatus based on the audio device may be wholly or partially implemented by software, hardware and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.

The implementation of each module in the audio device-based foreign object detection apparatus provided in the embodiment of the present application may be in the form of a computer program. The computer program may be run on a terminal or a server. The program modules constituted by the computer program may be stored on the memory of the terminal or the server. The computer program, when executed by a processor, implements the steps of the audio device-based foreign object detection method described in embodiments of the present application.

The embodiment of the application further provides an audio device, which includes an audio acquisition module, a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor is electrically connected with the memory, the acquisition module and the processor, and when the processor executes the computer program, the foreign object detection method based on the audio device described in the above embodiments is implemented.

In one embodiment, the audio acquisition module is an electroacoustic transducer for playing an audio signal and acquiring an acoustic echo signal formed by the audio signal reflected and vibrated by an ear canal.

In one embodiment, the audio acquisition module is a microphone; the microphone is used for collecting acoustic echo signals formed by the audio signals through the reflection and the vibration of the auditory canal.

In one embodiment, the audio device further comprises an image acquisition module for acquiring image information within the ear canal, the image acquisition module being connected to the processor.

The embodiment of the application also provides a computer readable storage medium. One or more non-transitory computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the audio device-based foreign object detection methods as described in the embodiments above.

The embodiment of the application also provides a computer program product. A computer program product containing instructions which, when run on a computer, cause the computer to perform the audio device based foreign object detection method described in the embodiments above.

The embodiment of the application also provides the terminal equipment. As shown in fig. 11, for convenience of explanation, only the parts related to the embodiments of the present application are shown, and details of the technology are not disclosed, please refer to the method part of the embodiments of the present application. The terminal device may be any terminal device including a mobile phone, a tablet computer, a PDA (Personal Digital Assistant), a POS (Point of Sales, electronic device), a vehicle-mounted computer, a wearable device, etc., taking the terminal device as the mobile phone as an example:

fig. 11 is a block diagram of a partial structure of a mobile phone related to a terminal device according to an embodiment of the present application. Referring to fig. 11, the cellular phone includes: radio Frequency (RF) circuitry 1110, memory 1120, input unit 1130, display unit 1140, sensors 1150, audio circuitry 1160, wireless fidelity (WiFi) module 1170, processor 1180, and power supply 1190. Those skilled in the art will appreciate that the handset configuration shown in fig. 11 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The RF circuit 1110 may be configured to receive and transmit signals during information transmission and reception or during a call, and may receive downlink information of a base station and then process the downlink information to the processor 1180; the uplink data may also be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 1110 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE)), e-mail, Short Messaging Service (SMS), and the like.

The memory 1120 may be used to store software programs and modules, and the processor 1180 may execute various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 1120. The memory 1120 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as an application program for a sound playing function, an application program for an image playing function, and the like), and the like; the data storage area may store data (such as audio data, an address book, etc.) created according to the use of the mobile phone, and the like. Further, the memory 1120 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The input unit 1130 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone 1100. Specifically, the input unit 1130 may include an operation panel 1131 and other input devices 1132. The operation panel 1131, which may also be referred to as a touch screen, may collect touch operations performed by a user on or near the operation panel 1131 (for example, operations performed by the user on or near the operation panel 1131 by using any suitable object or accessory such as a finger or a stylus pen), and drive the corresponding connection device according to a preset program. In one embodiment, the operation panel 1131 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1180, and can receive and execute commands sent by the processor 1180. In addition, the operation panel 1131 can be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 1130 may include other input devices 1132 in addition to the operation panel 1131. In particular, other input devices 1132 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), and the like.

The display unit 1140 may be used to display information input by the user or information provided to the user and various menus of the cellular phone. The display unit 1140 may include a display panel 1141. In one embodiment, the Display panel 1141 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. In one embodiment, the operation panel 1131 may cover the display panel 1141, and when the operation panel 1131 detects a touch operation on or near the operation panel, the touch operation is transmitted to the processor 1180 to determine the type of the touch event, and then the processor 1180 provides a corresponding visual output on the display panel 1141 according to the type of the touch event. Although in fig. 11, the operation panel 1131 and the display panel 1141 are two independent components to implement the input and output functions of the mobile phone, in some embodiments, the operation panel 1131 and the display panel 1141 may be integrated to implement the input and output functions of the mobile phone.

The cell phone 1100 can also include at least one sensor 1150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a distance sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1141 according to the brightness of ambient light, and the distance sensor may turn off the display panel 1141 and/or the backlight when the mobile phone moves to the ear. The motion sensor can comprise an acceleration sensor, the acceleration sensor can detect the magnitude of acceleration in each direction, the magnitude and the direction of gravity can be detected when the mobile phone is static, and the motion sensor can be used for identifying the application of the gesture of the mobile phone (such as horizontal and vertical screen switching), the vibration identification related functions (such as pedometer and knocking) and the like; the mobile phone may be provided with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor.

Audio circuitry 1160, speaker 1161 and microphone 1162 may provide an audio interface between a user and a cell phone. The audio circuit 1160 may transmit the electrical signal converted from the received audio data to the speaker 1161, and convert the electrical signal into a sound signal for output by the speaker 1161; on the other hand, the microphone 1162 converts the collected sound signal into an electrical signal, and the electrical signal is received by the audio circuit 1160 and converted into audio data, and then the audio data is processed by the audio data output processor 1180, and then the audio data is sent to another mobile phone through the RF circuit 1110, or the audio data is output to the memory 1120 for subsequent processing.

WiFi belongs to short-distance wireless transmission technology, and the cell phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 1170, and provides wireless broadband internet access for the user. Although fig. 11 shows the WiFi module 1170, it is to be understood that it does not necessarily form part of the handset 1100 and may be omitted as desired.

The processor 1180 is a control center of the mobile phone, and is connected to various parts of the whole mobile phone through various interfaces and lines, and executes various functions of the mobile phone and processes data by running or executing software programs and/or modules stored in the memory 1120 and calling data stored in the memory 1120, thereby performing an overall monitoring of the mobile phone. In one embodiment, the processor 1180 may include one or more processing units. In one embodiment, the processor 1180 may integrate an application processor and a modem, wherein the application processor primarily handles operating systems, user interfaces, application programs, and the like; the modem handles primarily wireless communications. It is to be appreciated that the modem may not be integrated into the processor 1180. For example, the processor 1180 may integrate an application processor and a baseband processor, and the baseband processor and other peripheral chips may constitute a modem. The cell phone 1100 also includes a power supply 1190 (e.g., a battery) for providing power to various components, which may be logically coupled to the processor 1180 via a power management system, such that the power management system may be configured to manage charging, discharging, and power consumption.

In one embodiment, the cell phone 1100 may also include a camera, a bluetooth module, and the like.

In the embodiment of the present application, the processor included in the mobile phone implements the above-described foreign object detection method based on the audio device when executing the computer program stored in the memory.

When the computer program running on the processor is executed, the equipment cost for monitoring the health data of the user is saved, the mode for the user to obtain the health data is more convenient, and the human-computer interaction experience of the user is improved.

Any reference to memory, storage, database, or other medium used herein may include non-volatile and/or volatile memory. Suitable non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM), which acts as external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms, such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), Enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. a foreign body detection method based on audio equipment, is characterized in that, comprises:

Recording the acoustic reflection signal formed by the audio signal reflected and vibrated by the ear canal based on the electro-acoustic transducer that plays the audio signal, wherein the audio device is an earphone;

obtaining the first decibel information of the preset audio segment in the acoustic reflection signal;

acquiring the second decibel information of the preset audio clip in the preset reflection signal;

comparing and acquiring the difference between the second decibel information and the first decibel information, wherein the preset reflected signal is a signal formed by the audio signal reflected and vibrated by the ear canal when there is no foreign body in the ear canal;

A detection result of whether there is a foreign body in the ear canal is output according to the difference value.

2. The method according to claim 1, wherein the outputting the detection result of whether there is a foreign body in the ear canal according to the difference value comprises:

comparing the difference with a preset difference;

When the difference value is greater than the preset difference value, prompt information indicating that there is a foreign body in the ear canal is output.

3. The method according to any one of claims 1-2, wherein before the electroacoustic transducer based on playing the audio signal records the acoustic reflection signal formed by the reflection and vibration of the audio signal through the ear canal. ,Also includes:

Obtain the identity information of the user currently wearing the audio device;

When the identity information is consistent with the preset identity information, judging whether the triggering operation of foreign object detection input by the user is accepted;

When the trigger operation is received, an acoustic reflection signal formed based on the reflection and vibration of the audio signal played by the audio device through the ear canal is acquired.

4. A foreign object detection device based on audio equipment, characterized in that, comprising:

an acquisition module for recording an acoustic reflection signal formed by the audio signal reflected and vibrated by the ear canal based on the electro-acoustic transducer that plays the audio signal, wherein the audio device is an earphone;

The comparison module includes: a decibel acquisition unit, configured to acquire the first decibel information of the preset audio segment in the acoustic reflection signal; and also for acquiring the second decibel information of the preset audio segment in the preset reflection signal; wherein , the preset reflected signal is a signal formed by the audio signal reflected and vibrated by the ear canal when there is no foreign body in the ear canal;

An output module, configured to compare and acquire the difference between the second decibel information and the first decibel information, and output a detection result of whether there is a foreign body in the ear canal according to the difference.

5. A terminal comprising a memory and a processor, wherein computer-readable instructions are stored in the memory, and when the instructions are executed by the processor, the processor is made to execute any one of claims 1 to 3 the steps of the method.

6. A computer-readable storage medium on which a computer program is stored, wherein the computer program implements the steps of the method according to any one of claims 1 to 3 when the computer program is executed by a processor.

7. a kind of audio frequency equipment, it is characterized in that, comprise audio frequency acquisition module, memory, processor and the computer program that is stored on memory and can run on processor, described processor is electrically connected with described memory, audio frequency acquisition module , when the processor executes the computer program, the steps of the method according to any one of claims 1 to 3 are implemented; the audio acquisition module is an electro-acoustic transducer, and the electro-acoustic transducer is used to play audio signals and collecting the acoustic echo signal formed by the reflection and vibration of the audio signal through the ear canal.