CN114401384A - Intelligent device audio working mode prompting method and device - Google Patents

Abstract

The present application discloses a method for prompting an audio working mode of an intelligent device, which includes: acquiring an image of a user's pronunciation part; acquiring volume information picked up by a sound pickup device; and judging whether there is sound information to be transmitted according to the pronunciation part image or volume information ; if yes, then judge whether the working mode of the sound pickup device is the silent mode; if so, send out the silent mode prompt information according to the preset method. This application uses the pronunciation part image combined with the image recognition and comparison technology to determine whether there is sound information that the user needs to transmit, or uses the volume information combined with the sound pickup environment volume monitoring technology to determine whether there is sound information that the user needs to transmit. In this way, a silent mode prompt message is issued to remind the user that the smart device currently used is in the silent mode of the pickup device, and the silent mode is released in time, thereby improving the smoothness and efficiency of communication.

Description

A kind of intelligent device audio working mode prompting method and device

technical field

The present application relates to the technical field of sound processing, in particular to a method for prompting an audio working mode of a smart device, an apparatus for prompting an audio working mode of a smart device, and another method for prompting an audio working mode of a smart device, an electronic device and a computer storage medium.

Background technique

At present, smart devices represented by mobile phones and laptops have increasingly penetrated into life and work. Using smart devices for remote communication, such as holding remote conferences, has become a common way of working.

In remote conferences based on smart terminal devices, it is often necessary to remind users. For example, in the process of audio and video conferences (or audio conferences only using audio), it is often necessary to let one person speak, while other personnel need to Mute to avoid the introduction of interfering audio sources. However, the terminal in the silent mode may need to enter the conference discussion or speech state, and the user may forget that the terminal is in the silent mode - that is, the audio working mode that cuts off the sound transmission function. , causing the user to keep talking, but other audio and video participants did not hear any sound, resulting in an unsmooth remote conference experience and affecting the progress of the conference.

SUMMARY OF THE INVENTION

An embodiment of the present application provides a method for prompting a working mode of a sound pickup device, so as to solve the problem in the prior art that a terminal device works in a silent mode when it needs to transmit sound information. Embodiments of the present application further provide an apparatus for prompting an audio working mode of a smart device, another method for prompting an audio working mode of a smart device, an electronic device, and a computer storage medium.

The method for prompting the audio working mode of the smart device provided by the embodiment of the present application includes:

Obtain the image of the user's pronunciation part;

Get the volume information picked up by the sound pickup device;

According to the pronunciation part image, or according to the volume information, determine whether there is sound information that needs to be transmitted; if so, enter the next step;

Determine whether the working mode of the sound pickup device is the silent mode; if so, enter the next step;

According to the preset method, the prompt message of silent mode is sent out.

Optionally, the acquiring an image of the user's pronunciation part includes:

Obtain an image of the user's pronunciation part collected by the camera device;

From the pronunciation part image, extract first image information and second image information of the pronunciation part of the user in the pronunciation part image; there is a predetermined acquisition time between the first image information and the second image information interval;

Described according to the described pronunciation part image, judge whether there is sound information that needs to be transmitted; If yes, then enter the next step, including:

Compare the multiple groups of first image information and the second image information of the pronunciation part within a specified period of time of the user, and judge whether the pronunciation part has continuous change; if so, determine that there is sound information that needs to be transmitted, and enter the next step .

Optionally, the acquiring the volume information picked up by the sound pickup device includes:

Obtain the sound signal collected by the pickup device;

Preprocessing the sound signal to extract the sounding information;

Estimate the volume of the sounding information, and obtain the sounding volume information;

The sound volume information is determined as volume information picked up by the sound pickup device.

Optionally, according to the volume information, judging whether there is sound information that needs to be transmitted; including:

Obtain the volume value in the sound volume information and the sound duration corresponding to the volume value;

Compare the volume value with a preset volume value threshold, and determine whether the volume value satisfies the preset volume value threshold; if so, further determine whether the sound duration satisfies the preset sound duration threshold; , it is judged that there is voice information that needs to be transmitted.

Optionally, also include:

Obtain the voiceprint feature information in the vocalization information;

The voiceprint feature information is compared with a preset voiceprint feature standard to determine whether there is voice information that needs to be transmitted.

Optionally, the judging whether the working mode of the sound pickup device is a silent mode includes:

Get the status setting of the sound pickup device in the relevant application. If the microphone is set to be off, it is in silent mode.

Optionally, the silent mode prompt information includes at least one of the following information: prompt light flashing information, speaker broadcasting information, sound pickup equipment vibration information, and mute icon information corresponding to the silent mode.

Optionally, it also includes: if no trigger operation for the mute icon is obtained within a preset time, enlarging the mute icon, and displaying the magnified mute icon on the sound pickup device The center position of the interactive interface.

Optionally, after sending out the silent mode prompt information according to a preset method, the method further includes: obtaining a triggering operation for releasing the feedback of the silent mode prompt information, and releasing the silent mode according to the canceling trigger operation; or,

If no triggering operation for releasing the prompt information feedback of the mute mode is obtained within a preset time, a release signal for releasing the mute mode is triggered to be generated, and the mute mode is released according to the release signal.

Optionally, it includes a pre-step: judging whether the sound-picking device is in a silent mode, and if so, acquiring an image of the user's pronunciation part, and acquiring volume information picked up by the sound-picking device.

The present application also provides a method for prompting an audio working mode of a smart device, including:

Obtain the working mode of the pickup device as the speaking mode;

Obtain the image of the user's pronunciation part;

Get the volume information picked up by the sound pickup device;

According to the pronunciation part image, or according to the volume information, determine whether there is sound information that needs to be transmitted; if not, enter the next step;

According to a preset manner, the speaking mode is switched to the mute mode.

The application also provides an audio working mode prompting device for an intelligent device, including:

an image acquisition unit for acquiring an image of a user's pronunciation part;

a volume information acquisition unit, used for acquiring the volume information picked up by the sound pickup device;

The sound information judgment unit is used to judge whether there is sound information that needs to be transmitted according to the image of the pronunciation part or according to the volume information; if so, enter the next step;

A silent mode judgment unit, used for judging whether the working mode of the sound pickup device is a silent mode; if yes, then enter the next step;

The silent mode prompt information sending unit is used to send out the silent mode prompt information according to a preset method.

The application also provides an audio working mode prompting device for an intelligent device, including:

a speaking mode acquisition unit, used for acquiring the working mode of the sound pickup device as the speaking mode;

an image acquisition unit for acquiring an image of a user's pronunciation part;

a volume information acquisition unit, used for acquiring the volume information picked up by the sound pickup device;

The sound information judgment unit is used to judge whether there is sound information that needs to be transmitted according to the image of the pronunciation part or according to the volume information; if not, then enter the next step;

The switching unit is configured to switch the speaking mode to the mute mode according to a preset manner.

The present application further provides an electronic device, the electronic device includes: a processor; and a memory for storing a computer program, the computer program being executed by the processor to execute any one of the methods described above.

The present application also provides a computer storage medium, where the computer storage medium stores a computer program, and the computer program is executed by a processor to execute any one of the methods described above.

Embodiments of the present application further provide a computer storage medium, where a computer program is stored in the computer storage medium, and the computer program is executed by a processor to execute the above-mentioned method.

Compared with the prior art, the present application has the following advantages:

An embodiment of the present application provides a method for prompting an audio working mode of a smart device, including: acquiring an image of a user's pronunciation part; acquiring volume information picked up by a sound pickup device; Sound information to be transmitted; if yes, go to the next step; judge whether the working mode of the sound pickup device is the silent mode; In this embodiment of the present application, it is judged whether there is sound information that the user needs to transmit by using the image of the pronunciation part, or whether there is sound information that needs to be transmitted by the environmental volume monitoring, and according to a preset method, a silent mode prompt message is sent to remind the user. The currently used sound pickup equipment is in the mute mode, so that the user can release the mute mode in time, thereby improving the fluency and efficiency of remote communication of intelligent terminals such as conference calls.

Description of drawings

1 is a schematic diagram of an application scenario of an audio working mode of a smart device provided by the first embodiment of the present application;

2 is a flowchart of a method for prompting an audio working mode of a smart device provided by the first embodiment of the present application;

3 is a schematic diagram of a device for prompting an audio working mode of a smart device according to a second embodiment of the present application;

4 is a flowchart of a method for prompting an audio working mode of a smart device provided by the third embodiment of the present application;

5 is a schematic diagram of an apparatus for prompting an audio working mode of a smart device according to a fourth embodiment of the present application;

FIG. 6 is a schematic diagram of an electronic device provided by a fifth embodiment of the present application.

Detailed ways

In the following description, numerous specific details are set forth in order to facilitate a thorough understanding of the embodiments of the present application. However, the embodiments of the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar promotions without violating the connotations of the embodiments of the present application. Therefore, the embodiments of the present application are not subject to the specific details disclosed below. Implemented restrictions.

In order to enable those skilled in the art to better understand the solution of the present application, the specific application scenarios of the embodiments of the present application will be described in detail below based on the method for prompting the working mode of a sound pickup device provided by the present application, as shown in FIG. 1 , which is the present application. A schematic diagram of an application scenario provided by the first embodiment.

This scenario is a video conference scenario. When a user uses a terminal device for a video conference, due to its misoperation, or simply to avoid disturbing other speakers, the terminal device obtains the user's trigger operation for the mute icon. The mode corresponding to the mute icon is switched to mute mode. The mute mode may be unknown to the user, or the user forgets to return to normal when speaking. Wherein, in this scenario, the terminal device includes a sound pickup device, and the specific form of the terminal device may be a mobile phone, a tablet computer, a notebook computer, a desktop computer, or the like.

During a video conference, the smart device is in an audio and video working environment (or called an audio and video working mode, in this application, it is called an audio and video working environment, so as to distinguish it from the audio working mode in the technical topic) or the audio and video working mode. The working environment, the so-called audio and video working environment, is to transmit both audio information and video information, which can usually be called a video conference. At this time, the video capture device (camera device) of the smart device is in a working state; the audio working environment, It means that only the smart device only transmits audio information, which can usually be called a conference call. In the above two working environments, different ways can be used in the present application to judge whether the voice information needs to be transmitted.

In the audio and video working environment, only the camera device in the device is in a working state. At this time, the video information collected by the camera device usually includes the image of the user's pronunciation part, and the user's pronunciation part mainly refers to the mouth. , the corresponding pronunciation part image mainly refers to the video of the mouth area in the video. After the camera device obtains the image of the voice part of the user, the image of the voice part of the user is sent to the image processor of the smart device, and the image processor processes the collected image of the voice part. Specifically, extract the first image information and the second image information obtained by the user's pronunciation part in the pronunciation part image between a suitable time interval, and compare the first image information and the second image information to determine Whether there is a change in the pronunciation part is to determine whether there is image difference information between the first image information and the second image information, and if there is image difference information, it is determined that there is sound information that needs to be transmitted. The above-mentioned first image information and second image information can be continuously collected and compared to form a continuous process, and a reasonable judgment process can be set. Obtain an accurate judgment of whether there is audio information that needs to be transmitted. The above-mentioned image processor generally refers to a software program in a smart device that analyzes and processes an image, and certainly does not exclude dedicated hardware for implementing the analysis and processing function.

In the audio working environment, the camera device does not work, but the sound pickup device still works; however, according to the current audio working mode, the processing and transmission of the signals collected by the sound pickup device are different; If the pickup device is in silent mode, the signal collected by the pickup device will not be decoded, but the pickup device itself will still work. It should be noted here that in many cases, the silent mode of a smart device refers to a working mode in which the smart device is not disturbed by external incoming call signals. However, the silent mode of this application is aimed at the sound pickup device in scenarios such as remote conferences. Silent mode, in this scenario, the silent mode means that the sound pickup device is in silent mode, that is, the microphone mark on the operation interface is turned off (if the operation interface is marked with this mark), and the user's voice will not be transmitted to the The case of other smart devices participating in remote meetings. In the audio working environment, regardless of whether it is in the silent mode, the sound pickup device can still pick up the volume information, and the speech processor can obtain the volume value of the volume information and the sound duration corresponding to the volume value, according to a predetermined judgment standard— —Specifically, including whether the volume value reaches the preset volume value threshold, and if the above conditions are met, determine whether the volume value threshold reaches the preset sound duration threshold, and if it is also satisfied, then it can be judged that the current need to transmit sound information.

Regardless of the above working environment, if it is determined that the sound information needs to be transmitted, it is further judged whether the sound pickup device is working in the silent mode, and if so, a predetermined method is used to remind the user to end the silent mode.

Specifically, it will use the lighting element of the smart device to send out a flashing action; or, use the speaker of the smart device to send out voice information; or, use the vibrating device of the smart device to send out a vibrating action; or, display mute on the interactive interface of the smart device Mute icon information corresponding to the mode. The above-mentioned silent mode prompt information is used to prompt the user that the working mode in the current video conference environment is the silent mode. When the user sees these mute mode prompt messages, he or she will find out that the working mode in the video conference environment is the mute mode in time, and cancel the mute mode in time.

This scene uses image recognition and comparison technology and environmental volume monitoring technology to determine whether the user is speaking, and reminds the user through the software interactive interface of the pickup device, and reminds the user of the current location through hardware sound, light, vibration, etc. The video conference is in silent mode, so that the user or the pickup device can automatically unmute the mode, thereby improving the smoothness and efficiency of communication.

Corresponding to the above scenario, the first embodiment of the present application provides a method for prompting an audio working mode of a smart device, as shown in FIG. 2 , which is an audio working mode prompt for a smart device provided by the first embodiment of the present application. Flowchart of the method. The method includes the following steps:

Step S201, acquiring an image of a user's pronunciation part.

In this step, the audio and video working environment includes at least a video conference environment and a video chat environment. The audio working environment includes at least a voice conferencing environment, a voice chatting environment and a telephone communication environment.

In the audio and video working environment, the camera device is turned on, and the camera device generally collects the user's facial information, which naturally includes the image of the pronunciation part. Among them, the pronunciation part of the user mainly refers to the mouth, and the corresponding pronunciation part image mainly refers to the mouth part in the video for the face. After the camera device obtains the image of the voice part of the user, it will send the image of the voice part of the user to the image processor set in the smart device, and the image processor will further process the obtained image of the voice part. The image processor in this embodiment specifically refers to a software program or process that analyzes and processes an image of a speech part to obtain whether there is a sound to be transmitted. Of course, it is not excluded to implement it with special hardware.

Step S202, acquiring volume information picked up by the sound pickup device.

In the audio working environment, obtain the volume information picked up by the sound pickup device. Pickup equipment, also known as pickup head, generally refers to the composition of a microphone (commonly known as a microphone head) and an audio amplifier circuit. A microphone is a device that converts audio vibrations into electrical signals through electromagnetic induction. The audio amplifying circuit is used to shape and amplify the electrical signal collected and converted by the microphone, and transmit it to subsequent components for encoding, decoding and transmission. As mentioned above, even if the microphone has been muted, the essential meaning is that the subsequent codec and transmission procedures of the sound pickup device are stopped, but the sound pickup device itself is still collecting volume information of the surrounding environment.

In this step, acquiring the volume information picked up by the sound pickup device specifically includes: acquiring the sound signal collected by the sound pickup device, the sound signal needs to be preprocessed, the vocalization information is extracted, and the volume of the vocalization information is estimated , obtain sound volume information, and determine the sound volume information as the volume information picked up by the sound pickup device. This process is to distinguish the vocal information of the target object from other acoustic information in the environment. There are many possibilities for specific implementations in the art, especially when the target object is a natural person, it is an achievable technology to distinguish the sound information of the natural person from the sound information in other environments.

In this step, since the volume information involves not only the voice of the user, but also the voice of other users or other devices, in order to accurately determine whether the voice is the voice of the current user, the above steps further include: obtaining The voiceprint feature information in the vocalization information, the voiceprint feature information represents a specific sound standard. For example, the voiceprint feature information of the voice made by the user corresponds to the user standard, and the voiceprint feature information of the sound emitted by the electronic device corresponds to the electronic device standard. After obtaining the voiceprint feature information, the voiceprint feature information is compared with the preset voiceprint feature standard to determine whether there is a judgment standard for the voice information to be transmitted, so as to determine that the current volume information is generated by a specific generated by users. For example, the user of the smart phone can store his own voiceprint information in the mobile phone in advance, and in this step, he can use the pre-stored voiceprint information as a standard to determine whether it is his own voice.

Step S203, according to the image of the sounding part, or according to the volume information, determine whether there is sound information that needs to be transmitted; if so, go to the next step.

After the sounding part image and the volume information are obtained, it can be determined whether there is sound information to be transmitted according to the sounding part image or the sound volume information. Among them, in the first embodiment of the present application, the sound information to be transmitted refers to the sound made by the current user. Of course, in other embodiments, the sound information to be transmitted may also refer to the sound emitted by the target object. Including electronic devices that can make sounds, animals, etc. The following will describe the specific content of determining whether there is sound information to be transmitted according to the sounding part image, and determining whether there is sound information to be transmitted according to the volume information.

Wherein, it is judged whether there is sound information that needs to be transmitted according to the image of the pronunciation part, and if so, the next step is entered, which specifically includes: corresponding to the above steps, extracting the pronunciation of the user in the image of the pronunciation part from the image of the pronunciation part After the first image information and the second image information of the part are compared, the first image information and the second image information of the pronunciation part of the user are compared to determine whether there is a change in the pronunciation part. Specifically, the first image information and the second image information are compared. 2. Whether there is image difference information in the image information, if there is image difference information, it is determined that there is a change in the pronunciation part, and it is determined that there is sound information that needs to be transmitted, and the next step is entered.

Specifically, the above processing process is to perform frame-by-frame processing on the pronunciation part images in time sequence, so as to extract the first image information and the second image information of the user's pronunciation part in the pronunciation part images, the first image information and the second image information. The information has different acquisition times, and the time intervals of the different acquisition times are appropriately set according to the movement frequency of the observed speech part. For example, the first image information and the second image information may be image information corresponding to adjacent video frames, or may be obtained after obtaining the first image information corresponding to the first frame and then obtaining the second image information corresponding to the tenth frame. The reason for increasing the interval of the video frames between the first image information and the second image information is to obtain the first image information and the second image information whose image information is obviously different. Of course, a variety of different schemes can be adopted to judge whether there is sound information to be transmitted according to the image of the pronunciation part. For example, a special recognition model is trained by using machine learning technology. In this application, the above-mentioned direct comparison first The solution of the image information and the second image information can occupy relatively few computing resources, as long as it is found that there is a difference between the pronunciation parts in the first image information and the second image information. Of course, in the present application, the above-mentioned comparison of the first image information and the second image information is only a simplified solution. In fact, it is possible to continuously intercept a fixed time interval within a certain period of time, such as 10-30 seconds. and compare and judge the adjacent intercepted images, and finally determine whether there is sound information that needs to be transmitted by comparing multiple sets of first image information and second image information in this time period. For example, if the comparison results all indicate that there is movement in the vocal part, it can be determined that the user is vocalizing continuously. For this application, in the process of making the above judgment, it is necessary to be very careful not to make a wrong judgment. For example, if there is only a change between a set of first image information and the second image information, it may be that the user occasionally has a pronunciation part. movement, not necessarily speaking. For accurate judgment, it is necessary to compare multiple sets of first image information and second image information of the pronunciation part of the user within a period of time to determine whether there is a continuous change in the pronunciation part. For example, the observation time length can be set to 30 seconds, and the interval between each set of first image information and the second image information is 1 second. If 30 sets of comparison results are found within 30 seconds, the first image information and the second image information If there is a change between the two, it can be determined that the user is speaking, that is, there is voice information that needs to be transmitted.

Wherein, according to the volume information, it is judged whether there is sound information that needs to be transmitted, and if so, the next step is entered. Specifically, it is necessary to obtain the sound signal collected by the sound pickup device, preprocess the sound signal, extract the sounding information, estimate the volume of the sounding information, obtain the sounding volume information, and determine the sounding volume information as The volume information picked up by the sound pickup device.

In this step, since the volume information involves not only the voice of the user, but also the voice of other users or other devices, in order to accurately determine whether the voice is the voice of the current user, the above steps further include: obtaining The voiceprint feature information in the vocalization information, the voiceprint feature information represents a specific sound standard. For example, the voiceprint feature information of the voice made by the user corresponds to the user standard, and the voiceprint feature information of the sound emitted by the electronic device corresponds to the electronic device standard. After the voiceprint feature information is obtained, the voiceprint feature information is compared with the preset voiceprint feature standard, so as to determine whether there is a judgment standard for the voice information to be transmitted, so as to determine that the current volume information is generated by the user produced. Obtain the volume value in the sound volume information and the sound duration corresponding to the volume value, compare the volume value with a preset volume value threshold, and determine whether the volume value satisfies the preset volume value threshold; if so, then It is further judged whether the sound duration satisfies the preset sound duration threshold; if so, it is judged that there is sound information to be transmitted. For example, if the volume value in the sound volume information is 40 decibels and the preset volume value threshold is 40 decibels, the volume value satisfies the preset volume value threshold. And the sound duration corresponding to the volume value is 5 seconds, and the preset sound duration threshold is 5 seconds, it is determined that there is sound information to be transmitted.

The purpose of the above judgment process is also to solve the problem of misjudgment. For example, the speaker occasionally whispers and cannot be judged to be speaking. This situation can be judged by whether the volume exceeds a predetermined standard threshold; Cough, although it causes a relatively large ambient volume, has a very short duration; therefore, the volume and duration must be combined, that is, it is judged that the volume exceeds a certain threshold and lasts for a period of time, in order to confirm that the user is in the conference speech state.

Step S204, judging whether the working mode of the sound pickup device is the silent mode; if so, go to the next step.

After determining that there is sound information to be transmitted, it is determined whether the working mode of the sound pickup device is the silent mode. Specifically, in judging that the relevant application is running, the state of the sound pickup device is set. If the microphone is set to be off is in silent mode.

In other embodiments, judging whether the working mode of the sound pickup device is the silent mode may further include the following steps: the sound pickup device obtains the sound information that needs to be transmitted in the corresponding audio region played in the audio and video working environment, and judges that the sound information needs to be transmitted. Whether the audio information is played in the audio area, and if the audio information that needs to be transmitted is played in the audio area, it is determined that the audio information to be transmitted is recorded in the audio and video working environment, and the sound pickup in the video conferencing environment is determined. The working mode of the device is non-silent mode; on the contrary, if the audio information to be transmitted is not played in the audio area, it is determined that the audio information to be transmitted has not been recorded in the audio and video working environment, and the audio and video conferencing environment is determined. The working mode of the pickup device is silent mode. The audio area refers to a processing channel in which the smart device encodes, decodes and transmits audio information.

Step S205 , according to a preset method, send out a silent mode prompt message.

After it is determined that the working mode of the pickup device is the silent mode, the pickup device will issue a silent mode prompt message according to the preset method to remind the user that the current pickup device is in the silent mode, so that the user can release the current silent mode in time. . Among them, in the first embodiment of the present application, according to a preset method, the prompt information of the silent mode is sent out at least the following kinds of prompt information: prompt light flashing information, speaker broadcasting information, sound pickup equipment vibration information and corresponding to the silent mode. Mute icon information. The implementation manners of these types of prompt information will be described in detail below.

Specifically, for the flashing information of the prompt light, after it is determined that the working mode of the sound pickup device is the silent mode, the processor of the sound pickup device will send the flashing information to the lighting device, and the lighting device will control the sound pickup device according to the flashing information. The lamp performs a flickering action, and the frequency and intensity of the flickering action of the light can be realized according to the flickering frequency and intensity signals in the flickering information. Further, if the sound pickup device does not obtain a trigger operation for the mute icon within a preset time, the flickering frequency and intensity of the flickering action will be increased to remind the user that the sound pickup device is currently in the mute mode.

For speaker broadcast information, after determining that the working mode of the sound pickup device is silent mode, the processor of the sound pickup device will send broadcast information to the speaker, and the broadcast information may specifically be "silent mode" or other voice information. Speaker The broadcast information controls the speaker to play the voice information. Further, if the sound pickup device does not obtain a trigger operation for the mute icon within the preset time, the volume of the sound played by the speaker is increased to remind the user that the sound pickup device is currently in the silent mode.

For the vibration information of the pickup device, after the working mode of the pickup device is determined to be silent mode, the processor of the pickup device will send the vibration information to the vibration device, and the vibration device will control the vibration body of the pickup device to drive the pickup device according to the vibration information. Vibration occurs. Wherein, the vibration frequency and intensity of the vibration body can be realized according to the vibration frequency and intensity signals in the vibration information. Further, if the sound pickup device does not obtain a trigger operation for the mute icon within the preset time, the vibration frequency and intensity of the vibration action are increased to remind the user that the sound pickup device is currently in the silent mode.

For the mute icon information corresponding to the silent mode, after determining that the working mode of the pickup device is the silent mode, the processor of the pickup device will obtain the mute icon corresponding to the silent mode, and send the mute icon to the interactive interface of the pickup device exhibit. Further, if the sound pickup device does not obtain a trigger operation for the mute icon within the preset time, the mute icon is enlarged, and the enlarged mute icon is displayed in the center of the interactive interface of the sound pickup device. position to alert the user that the current pickup device is in silent mode.

In the first embodiment of the present application, after sending out the mute mode prompt information according to a preset method, the method further includes: obtaining a triggering operation for canceling the feedback of the mute mode prompt information, and canceling the mute mode according to the cancel trigger operation. Or, after the silent mode prompt information is sent out according to a preset method, within a preset time, the trigger operation for releasing the feedback for the silent mode prompt information is not obtained, then triggering the generation of a cancel signal for canceling the mute mode, according to the cancel signal Unmute mode to switch to speak mode. Wherein, within the preset time, it also includes presenting dynamic timing information on the interactive interface, the dynamic timing information including at least digital countdown information and light bar weakening timing information, so as to prompt the user to cancel the mute mode through the dynamic timing information. It can be seen that in the first embodiment of the present application, the user can manually cancel the mute mode through the mute mode prompt information provided by the sound pickup device, and can also automatically cancel the mute mode through the control method of the sound pickup device itself, so as to realize the realization from various aspects. For the release operation of silent mode.

For this embodiment, it may further include a pre-step: judging whether the sound pickup device is in a silent mode, and if so, acquiring an image of the user's pronunciation part, and acquiring volume information picked up by the sound pickup device. That is to say, it is first determined whether it is necessary to monitor whether the sound pickup device is in the silent mode, and then the relevant operation steps are performed according to the corresponding mode.

An embodiment of the present application provides a method for prompting an audio working mode of a smart device, including: acquiring an image of a user's pronunciation part; acquiring volume information picked up by a sound pickup device; Sound information to be transmitted; if yes, go to the next step; judge whether the working mode of the sound pickup device is the silent mode; In this embodiment of the present application, it is judged whether there is sound information that the user needs to transmit by using the image of the pronunciation part, or whether there is sound information that needs to be transmitted by the environmental volume monitoring, and according to a preset method, a silent mode prompt message is sent to remind the user. The currently used sound pickup equipment is in the mute mode, so that the user can release the mute mode in time, thereby improving the fluency and efficiency of remote communication of intelligent terminals such as conference calls.

Corresponding to the method for prompting the working mode of a sound pickup device provided in the first embodiment of the present application, the second embodiment of the present application correspondingly provides a device for prompting an audio working mode of a smart device. Since the apparatus embodiment is basically similar to the first embodiment, the description is relatively simple, and reference may be made to the partial description of the first embodiment for related parts. The apparatus embodiments described below are merely illustrative.

Please refer to FIG. 3 , which is a schematic diagram of a device for prompting an audio working mode of a smart device according to a second embodiment of the present application. The smart device working mode prompting device includes: an image acquisition unit 301 for acquiring an image of a user's pronunciation part; a volume information acquisition unit 302 for acquiring volume information picked up by a sound pickup device; a sound information judging unit 303 for Describe the pronunciation part image, or according to the described volume information, judge whether there is the sound information that needs to be transmitted; If yes, then enter the next step; The silent mode judgment unit 304 is used for judging whether the working mode of the described sound pickup equipment is the silent mode; If so, go to the next step; the mute mode prompt information sending unit 305 is configured to send out the mute mode prompt information according to a preset method.

Optionally, the image obtaining unit 301 is specifically configured to obtain an image of the pronunciation part of the user collected by the camera device;

From the pronunciation part image, extract first image information and second image information of the pronunciation part of the user in the pronunciation part image; there is a predetermined acquisition time between the first image information and the second image information Correspondingly, the sound information judging unit 302 includes a first sound information judging subunit, which is used to compare multiple groups of first image information and second image information of the pronunciation part of the user within a specified period of time, and judge the pronunciation. Whether there is a continuous change in the part; if so, it is determined that there is sound information that needs to be transmitted, and the next step is entered.

Optionally, the volume information acquisition unit 302 is specifically configured to acquire the sound signal collected by the sound pickup device;

Preprocessing the sound signal to extract the sounding information;

Estimate the volume of the sounding information, and obtain the sounding volume information;

The sound volume information is determined as volume information picked up by the sound pickup device.

Optionally, the sound information judging unit 303 includes a second sound information judging subunit for obtaining the volume value in the sound volume information and the sound duration time corresponding to the volume value;

Compare the volume value with a preset volume value threshold, and determine whether the volume value satisfies the preset volume value threshold; if so, further determine whether the sound duration satisfies the preset sound duration threshold; , it is judged that there is voice information that needs to be transmitted.

Optionally, the sound information judgment unit 303 further includes a judgment standard unit for obtaining the voiceprint feature information in the utterance information;

The voiceprint feature information is compared with a preset voiceprint feature standard to determine whether there is voice information that needs to be transmitted.

Optionally, the mute mode determination unit 304 is specifically configured to acquire the state setting of the sound pickup device in the relevant application. If the state is set to the state where the microphone is turned off, it is the mute mode.

Optionally, the silent mode prompt information includes at least one of the following information: prompt light flashing information, speaker broadcasting information, sound pickup equipment vibration information, and mute icon information corresponding to the silent mode.

Optionally, it also includes a mute icon processing unit, configured to enlarge the mute icon if a trigger operation for the mute icon is not obtained within a preset time, and display the magnified mute icon in the center of the interactive interface of the pickup device.

Optionally, the mute icon processing unit is further configured to, after sending out the mute mode prompt information according to a preset manner, further comprising: obtaining a triggering operation for releasing the feedback for the prompt information of the mute mode, and releasing the triggering operation according to the deactivation operation. the silent mode; or,

If no triggering operation for releasing the prompt information feedback of the mute mode is obtained within a preset time, a release signal for releasing the mute mode is triggered to be generated, and the mute mode is released according to the release signal.

Optionally, it further includes a processing unit configured to determine whether the sound pickup device is in a silent mode, and if so, obtain an image of the user's pronunciation part, and obtain volume information picked up by the sound pickup device.

The third embodiment of the present application also provides a method for prompting an audio working mode of a smart device, as shown in FIG. 4 , which is a flowchart of a method for prompting an audio working mode of a smart device provided by the third embodiment of the present application. The method includes the following steps:

Step S401, acquiring the working mode of the sound pickup device as the speaking mode.

In this step, obtaining the working mode of the sound pickup device as the speaking mode includes: judging that the state of the sound pickup device is set in the relevant application that is running. The working mode of the pickup device is the speaking mode.

Step S402, acquiring an image of the pronunciation part of the user.

In this step, the audio and video working environment includes at least a video conference environment and a video chat environment. The audio working environment includes at least a voice conferencing environment, a voice chatting environment and a telephone communication environment.

In the audio and video working environment, the camera device is turned on, and the camera device generally collects the user's facial information, which naturally includes the image of the pronunciation part. Among them, the pronunciation part of the user mainly refers to the mouth, and the corresponding pronunciation part image mainly refers to the mouth part in the video for the face. After the camera device obtains the image of the voice part of the user, it will send the image of the voice part of the user to the image processor set in the smart device, and the image processor will further process the obtained image of the voice part. The image processor in this embodiment specifically refers to a software program or process for analyzing and processing an image of a speech part to obtain whether there is a sound to be transmitted. Of course, it is not excluded to implement it with special hardware.

Step S403, acquiring volume information picked up by the sound pickup device.

In the audio working environment, obtain the volume information picked up by the sound pickup device. Pickup equipment, also known as pickup head, generally refers to the composition of a microphone (commonly known as a microphone head) and an audio amplifier circuit. A microphone is a device that converts audio vibrations into electrical signals through electromagnetic induction. The audio amplifying circuit is used to shape and amplify the electrical signal collected and converted by the microphone, and transmit it to subsequent components for encoding, decoding and transmission. As mentioned above, even if the microphone has been muted, the essential meaning is that the subsequent codec and transmission procedures of the sound pickup device are stopped, but the sound pickup device itself is still collecting volume information of the surrounding environment.

In this step, acquiring the volume information picked up by the sound pickup device specifically includes: acquiring the sound signal collected by the sound pickup device, the sound signal needs to be preprocessed, the vocalization information is extracted, and the volume of the vocalization information is estimated , obtain sound volume information, and determine the sound volume information as the volume information picked up by the sound pickup device. This process is to distinguish the vocal information of the target object from other acoustic information in the environment. There are many possibilities for specific implementations in the art, especially when the target object is a natural person, it is an achievable technology to distinguish the sound information of the natural person from the sound information in other environments.

In this step, since the volume information involves not only the voice of the user, but also the voice of other users or other devices, in order to accurately determine whether the voice is the voice of the current user, the above steps further include: obtaining The voiceprint feature information in the vocalization information, the voiceprint feature information represents a specific sound standard. For example, the voiceprint feature information of the voice made by the user corresponds to the user standard, and the voiceprint feature information of the sound emitted by the electronic device corresponds to the electronic device standard. After obtaining the voiceprint feature information, the voiceprint feature information is compared with the preset voiceprint feature standard to determine whether there is a judgment standard for the voice information to be transmitted, so as to determine that the current volume information is generated by a specific generated by users. For example, the user of the smart phone can store his own voiceprint information in the mobile phone in advance, and in this step, he can use the pre-stored voiceprint information as a standard to determine whether it is his own voice.

Step S404, according to the image of the pronunciation part or according to the volume information, determine whether there is sound information that needs to be transmitted; if not, go to the next step.

After the sounding part image and the volume information are obtained, it can be determined whether there is sound information to be transmitted according to the sounding part image or the sound volume information. Among them, in the third embodiment of the present application, the sound information to be transmitted refers to the sound made by the current user. Of course, in other embodiments, the sound information to be transmitted may also refer to the sound made by the target object. Including electronic devices that can make sounds, animals, etc. The following will describe the specific content of determining whether there is sound information to be transmitted according to the sounding part image, and determining whether there is sound information to be transmitted according to the volume information.

Wherein, it is determined whether there is sound information that needs to be transmitted according to the image of the pronunciation part, and if not, the next step is entered, which specifically includes: corresponding to the above steps, from the image of the pronunciation part, extracting the voice information of the user in the image of the pronunciation part. After the first image information and the second image information of the pronunciation part, compare the first image information and the second image information of the user's pronunciation part to determine whether there is a change in the pronunciation part. Specifically, compare the first image information and the second image information. Whether there is image difference information in the second image information, if there is no image difference information, it is determined that there is no change in the pronunciation part, and it is determined that there is no sound information to be transmitted, and the next step is entered.

Specifically, the above processing process is to perform frame-by-frame processing on the pronunciation part images in time sequence, so as to extract the first image information and the second image information of the user's pronunciation part in the pronunciation part images, the first image information and the second image information. The information has different acquisition times, and the time intervals of the different acquisition times are appropriately set according to the movement frequency of the observed speech part. For example, the first image information and the second image information may be image information corresponding to adjacent video frames, or may be obtained after obtaining the first image information corresponding to the first frame and then obtaining the second image information corresponding to the tenth frame. The reason for increasing the interval of the video frames between the first image information and the second image information is to obtain the first image information and the second image information whose image information is obviously different. Of course, a variety of different schemes can be adopted to judge whether there is sound information to be transmitted according to the image of the pronunciation part. For example, a special recognition model is trained by using machine learning technology. In this application, the above-mentioned direct comparison first The solution of the image information and the second image information can occupy relatively few computing resources, as long as it is found that there is no difference between the pronunciation parts in the first image information and the second image information. Of course, in the present application, the above-mentioned comparison of the first image information and the second image information is only a simplified solution. In fact, it is possible to continuously intercept a fixed time interval within a certain period of time, such as 10-30 seconds. and compare and judge the adjacent intercepted images, and finally determine whether there is sound information that needs to be transmitted by comparing multiple sets of first image information and second image information in this time period. For example, if all of the comparison results show that there is no movement in the pronunciation part, it can be determined that the user does not continue to vocalize.

It should be noted that, for this application, in the process of making the above judgment, it is necessary to be very careful not to make a wrong judgment. For example, if there is only a change between a set of first image information and The speaker occasionally has movement of the vocal part, not necessarily speaking. For accurate judgment, it is necessary to compare multiple sets of first image information and second image information of the pronunciation part of the user within a period of time to determine whether there is a continuous change in the pronunciation part. For example, the observation time length can be set to 30 seconds, and the interval between each set of first image information and the second image information is 1 second. If 30 sets of comparison results are found within 30 seconds, the first image information and the second image information If there is a change between the two, it can be determined that the user is speaking, that is, there is voice information that needs to be transmitted.

Wherein, according to the volume information, it is judged whether there is sound information that needs to be transmitted, and if not, the next step is entered. Specifically, it is necessary to obtain the sound signal collected by the sound pickup device, preprocess the sound signal, extract the sounding information, estimate the volume of the sounding information, obtain the sounding volume information, and determine the sounding volume information as The volume information picked up by the sound pickup device.

In this step, since the volume information involves not only the voice of the user, but also the voice of other users or other devices, in order to accurately determine whether the voice is the voice of the current user, the above steps further include: obtaining The voiceprint feature information in the vocalization information, the voiceprint feature information represents a specific sound standard. For example, the voiceprint feature information of the voice made by the user corresponds to the user standard, and the voiceprint feature information of the sound emitted by the electronic device corresponds to the electronic device standard. After the voiceprint feature information is obtained, the voiceprint feature information is compared with the preset voiceprint feature standard, so as to determine whether there is a judgment standard for the voice information to be transmitted, so as to determine that the current volume information is generated by the user produced. Obtain the volume value in the sound volume information and the sound duration corresponding to the volume value, compare the volume value with a preset volume value threshold, and determine whether the volume value satisfies the preset volume value threshold; if not, Then it is further judged whether the sound duration satisfies the preset sound duration threshold; if not, it is judged that there is no sound information to be transmitted. For example, if the volume value in the sound volume information is 40 decibels and the preset volume value threshold is 50 decibels, the volume value satisfies the preset volume value threshold. And the sound duration corresponding to the volume value is 5 seconds, and the preset sound duration threshold is 10 seconds, it is determined that there is no sound information to be transmitted.

On the contrary, obtain the volume value in the sound volume information and the sound duration of the corresponding volume value, compare the volume value with the preset volume value threshold, and judge whether the volume value satisfies the preset volume value threshold; , then it is further judged whether the sound duration satisfies the preset sound duration threshold; if so, it is judged that there is sound information to be transmitted. For example, if the volume value in the sound volume information is 40 decibels and the preset volume value threshold is 40 decibels, the volume value satisfies the preset volume value threshold. And the sound duration corresponding to the volume value is 5 seconds, and the preset sound duration threshold is 5 seconds, it is determined that there is sound information to be transmitted.

The purpose of the above judgment process is also to solve the problem of misjudgment. For example, the speaker occasionally whispers and cannot be judged to be speaking. This situation can be judged by whether the volume exceeds a predetermined standard threshold; Cough, although it causes a relatively large ambient volume, has a very short duration; therefore, the volume and duration must be combined, that is, it is judged that the volume exceeds a certain threshold and lasts for a period of time, in order to confirm that the user is in the conference speech state.

Step S405 , according to a preset manner, switch the speaking mode to a mute mode.

After it is determined that the user is in the non-speaking state of the conference, the voice pickup device will switch the speaking mode to the mute mode according to a preset method. Specifically, a switching operation for the speaking mode is obtained, and the speaking mode is switched to the mute mode according to the switching operation. Or, if the switching operation for the speaking mode is not obtained within a preset time, the generation of a switching signal for switching the speaking mode is triggered, and the speaking mode is switched to the mute mode according to the switching signal. Among them, within the preset time, it also includes presenting dynamic timing information on the interactive interface, the dynamic timing information includes at least digital countdown information and light bar weakening timing information, and prompting the user to switch the speech mode to mute through the dynamic timing information. model. It can be seen that in the third embodiment of the present application, the user can manually switch the speaking mode to the silent mode, and can also switch the speaking mode to the silent mode through the control method of the pickup device itself, thereby realizing the control of the speaking mode from various aspects. switch.

A third embodiment of the present application provides a method for prompting a working mode of a sound pickup device, including: obtaining the working mode of the sound pickup device as a speech mode; obtaining an image of a user's pronunciation part; obtaining volume information picked up by the sound pickup device;

According to the pronunciation part image, or according to the volume information, it is judged whether there is sound information to be transmitted; if not, go to the next step; according to the preset mode, the speaking mode is switched to the mute mode. In this embodiment of the present application, it is judged whether there is voice information that the user needs to transmit by using the image of the pronunciation part, or whether there is voice information that needs to be transmitted by the environmental volume monitoring, so that the user can switch the corresponding mode in time, thereby improving intelligent terminals such as teleconferencing. Fluency and efficiency of remote communication.

Corresponding to the method for prompting the working mode of a sound pickup device provided by the third embodiment of the present application, the fourth embodiment of the present application correspondingly provides a device for prompting an audio working mode of a smart device. Since the apparatus embodiment is basically similar to the third embodiment, the description is relatively simple, and reference may be made to part of the description of the third embodiment for related parts. The apparatus embodiments described below are merely illustrative.

Please refer to FIG. 5 , which is a schematic diagram of an apparatus for prompting an audio working mode of a smart device according to a fourth embodiment of the present application. The smart device working mode prompting device includes: a speaking mode acquiring unit 501, used for acquiring the working mode of the sound pickup device as the speaking mode; an image acquiring unit 502, for acquiring an image of a user's pronunciation part; and a volume information acquiring unit 503, for Acquire the volume information picked up by the sound pickup device; the sound information judgment unit 504 is used to judge whether there is sound information that needs to be transmitted according to the image of the pronunciation part, or according to the volume information; if not, enter the next step; switch unit 505, for switching the speaking mode to a mute mode according to a preset manner.

Corresponding to the method for prompting the working mode of the sound pickup device in the first embodiment and the third embodiment of the present application, the fifth embodiment of the present application further provides an electronic device. As shown in FIG. 6 , FIG. 6 is a schematic diagram of an electronic device provided in a fifth embodiment of the present application. The electronic device includes: a processor 601; and a memory 602 for storing a computer program, the computer program being run by the processor to execute the method for prompting the working mode of the sound pickup device of the first embodiment and the third embodiment.

Corresponding to the method for prompting the working mode of a sound pickup device in the first embodiment and the third embodiment of the present application, the sixth embodiment of the present application further provides a computer storage medium, where the computer storage medium stores a computer program, the The computer program is executed by the processor to execute the method for prompting the working mode of the sound pickup device of the first embodiment and the third embodiment.

Although the present application is disclosed above with preferred embodiments, it is not intended to limit the present application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of the present application. Therefore, the present application The scope of protection shall be subject to the scope defined by the claims of this application.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, excludes non-transitory computer-readable media, such as modulated data signals and carrier waves.

It will be appreciated by those skilled in the art that the embodiments of the present application may be provided as a method, a system or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.

Claims (14)

1. An audio working mode prompting method for intelligent equipment is characterized by comprising the following steps:

acquiring a phonation part image of a user;

acquiring volume information picked up by pickup equipment;

judging whether sound information needing to be transmitted exists according to the sound-emitting part image or the volume information; if yes, entering the next step;

judging whether the working mode of the pickup equipment is a mute mode or not; if yes, entering the next step;

and sending out a silent mode prompt message according to a preset mode.

2. The method for prompting the audio working mode of the intelligent device according to claim 1, wherein the step of acquiring the image of the vocal part of the user comprises the following steps:

acquiring a phonation part image of a user acquired by camera equipment;

extracting first image information and second image information of a user's pronunciation part in the pronunciation part image from the pronunciation part image; a predetermined acquisition time interval is arranged between the first image information and the second image information;

judging whether sound information needing to be transmitted exists according to the sound-emitting part image; if yes, entering the next step, including:

comparing a plurality of groups of first image information and second image information of the pronunciation part of the user within a period of specified time, and judging whether the pronunciation part has continuous change; if yes, determining that the voice information needing to be transmitted exists, and proceeding to the next step.

3. The method for prompting the audio working mode of the intelligent device according to claim 1, wherein the obtaining of the volume information picked up by the sound pickup device comprises:

acquiring a sound signal collected by pickup equipment;

preprocessing the sound signal and extracting sound production information;

estimating the volume of the sounding information to obtain sounding volume information;

and determining the sound production volume information as volume information picked up by the sound pickup equipment.

4. The audio working mode prompting method for intelligent equipment according to claim 3, wherein the method comprises the steps of judging whether sound information needing to be transmitted exists or not according to the volume information; the method comprises the following steps:

obtaining a volume value in the sound volume information and a sound duration corresponding to the volume value;

comparing the volume value with a preset volume value threshold value, and judging whether the volume value meets the preset volume value threshold value; if yes, further judging whether the sound duration time meets a preset sound duration time threshold value; if yes, judging that the voice information needing to be transmitted exists.

5. The method for prompting the audio working mode of the intelligent device according to claim 4, further comprising:

acquiring voiceprint characteristic information in the sound production information;

and comparing the voiceprint characteristic information with a preset voiceprint characteristic standard to determine whether the voice information needing to be transmitted exists.

6. The method for prompting the audio working mode of the intelligent device according to claim 1, wherein the step of judging whether the working mode of the sound pickup device is a mute mode comprises the steps of:

and acquiring the state setting of the sound pickup equipment in the related application, and if the state setting is that the microphone is closed, determining that the sound pickup equipment is in a mute mode.

7. The audio operating mode prompting method for intelligent equipment according to claim 1, wherein the silent mode prompting message comprises at least one of the following messages: the sound-absorbing system comprises prompting lamp flicker information, loudspeaker broadcasting information, pickup equipment vibration information and mute icon information corresponding to the mute mode.

8. The method for prompting the audio working mode of the intelligent device according to claim 7, further comprising: and if the triggering operation aiming at the mute icon is not obtained within the preset time, amplifying the mute icon, and displaying the amplified mute icon at the central position of the interactive interface of the pickup equipment.

9. The audio working mode prompting method for intelligent equipment according to claim 1, wherein after sending out the silent mode prompting message according to a preset mode, the method further comprises: obtaining a trigger releasing operation aiming at the prompt information feedback of the mute mode, and releasing the mute mode according to the trigger releasing operation; or,

and in a preset time, if the release trigger operation aiming at the prompt information feedback of the mute mode is not obtained, triggering to generate a release signal aiming at the release of the mute mode, and releasing the mute mode according to the release signal.

10. The intelligent device audio operating mode prompting method according to claim 1, characterized by comprising the following steps: and judging whether the sound pickup equipment is in a mute mode, if so, acquiring a phonation part image of the user and acquiring volume information picked up by the sound pickup equipment.

11. An audio working mode prompting method for intelligent equipment is characterized by comprising the following steps:

acquiring the working mode of the pickup equipment as a speech mode;

acquiring a phonation part image of a user;

acquiring volume information picked up by pickup equipment;

judging whether sound information needing to be transmitted exists according to the sound-emitting part image or the volume information; if not, entering the next step;

and switching the speaking mode into a silent mode according to a preset mode.

12. The utility model provides a smart machine audio frequency mode of operation suggestion device which characterized in that includes:

an image acquisition unit for acquiring a vocal part image of a user;

a volume information acquisition unit for acquiring volume information picked up by the sound pickup apparatus;

a sound information judging unit, configured to judge whether there is sound information to be transmitted according to the sound-emitting portion image or according to the volume information; if yes, entering the next step;

a mute mode judging unit for judging whether the working mode of the pickup apparatus is a mute mode; if yes, entering the next step;

and the silent mode prompt information sending unit is used for sending the silent mode prompt information according to a preset mode.

13. An electronic device, characterized in that the electronic device comprises: a processor; a memory for storing a computer program for execution by the processor to perform the method of any one of claims 1 to 9 or 10.

14. A computer storage medium, characterized in that it stores a computer program that is executed by a processor to perform the method of any one of claims 1-9 or 10.

Images