CN109582976A - A kind of interpretation method and electronic equipment based on voice communication - Google Patents

Abstract

A voice call-based translation method and electronic device relate to the technical field of terminals. The method includes: establishing a voice call connection between a first electronic device and a second electronic device; when the voice call translation function of the first electronic device is enabled, the first electronic device An electronic device collects the voice of the first user, reports the voice of the first user to the translation server, receives the translation result of the voice of the first user sent by the translation server, and sends the translation result of the voice of the first user to the second electronic device equipment; and receive the voice of the second user sent by the second electronic device, report the voice of the second user to the translation server, and receive the translation result of the voice of the second user sent by the translation server, and broadcast the translation of the voice of the second user result. Therefore, this technical solution helps to improve the communication efficiency of users who use different languages.

Description

A kind of translation method and electronic device based on voice call

technical field

The present application relates to the field of terminal technologies, and in particular, to a voice call-based translation method and electronic device.

Background technique

The popularization of electronic devices such as mobile phones makes the communication between people no longer restricted by time and space, which brings great convenience to people's life and work. However, due to the influence of the region, the two communicating parties may have different languages, which may lead to communication barriers.

Therefore, it has important practical value to study how to make communication between two parties using different languages achieve barrier-free communication through mobile phones.

SUMMARY OF THE INVENTION

Embodiments of the present application provide a voice call-based translation method and electronic device, which help to improve the communication efficiency of users who use different languages when using electronic devices to communicate.

In a first aspect, an embodiment of the present application provides a translation method based on a voice call, the method comprising:

The first electronic device establishes a voice call connection with the second electronic device; when the voice call translation function of the first electronic device is enabled, the first electronic device collects the voice of the first user, and reports the first electronic device to the translation server. a user's voice, and receiving the translation result of the first user's voice sent by the translation server, and sending the translation result of the first user's voice to the second electronic device; and receiving the first user's voice The second user's voice sent by the two electronic devices, report the second user's voice to the translation server, receive the translation result of the second user's voice sent by the translation server, and broadcast the second user's voice A translation of the user's speech.

In the embodiment of the present application, since the first electronic device can implement the translation of the double-ended voice during the user's call, it is helpful to improve the communication efficiency of users who use different languages.

In a possible design, the first electronic device communicates with the translation server through a network, and when the network signal strength is less than or equal to a preset threshold, the first electronic device collects the voice of the first user Then, translate the voice of the first user to obtain a translation result of the voice of the first user; after receiving the voice of the second user, translate the voice of the second user to obtain the voice of the second user The translation result of the second user's speech. The above technical solution helps to reduce the possibility of speech translation failure due to network signal deterioration.

In a possible design, when the network signal strength is less than or equal to the preset threshold, the first electronic device prompts the first user to switch networks, or automatically switches to the first electronic device to perform Voice translation, or automatically switch to a network whose network signal strength is greater than the preset threshold. This helps to reduce the possibility of speech translation failure due to poor network signal.

In a possible design, the first electronic device determines the translation server according to the local language and the opposite language, and then reports the voice of the first user or reports the second user to the translation server 's voice. The local language is the language used by the first user, and the peer language is the language used by the second user. Therefore, it is helpful to enable the first electronic device to select a more suitable translation server to translate the speech, thereby improving the reliability of speech translation.

In a possible design, when the first electronic device establishes a voice call connection with the second electronic device or after the first electronic device establishes a voice call connection with the second electronic device, when the local When the language of the terminal is different from the language of the opposite terminal, the voice call translation function is automatically enabled. Helps simplify operations for users.

In a possible design, the first electronic device enables the voice call translation function in response to the user's first operation. It helps to improve the interaction between the first electronic device and the user.

In a possible design, the first electronic device sends, to the second electronic device, prompt information that the voice call translation function of the first electronic device has been enabled, and the prompt information is in the language of the peer language. It helps to improve the interaction between the first electronic device and the user.

In a possible design, the first electronic device acquires the local language and the peer language; wherein the local language is the system language, or the first user and the first user The language used by the first user in the last call record of the two users, or the native language of the home of the first user's phone number, or the home language of the communication network accessed by the first electronic device is located. The native language, or the language set in response to the user operation; the peer language is the native language of the home of the second user's phone number, or the most recent call record between the first user and the second user. The language used by the second user, or the native language of the home location where the communication network accessed by the second electronic device is located, or the language set in response to the user operation. Helps to simplify the acquisition of the local language and the peer language.

In a possible design, the first electronic device broadcasts the translation result of the voice of the second user when the voice of the first user is not collected and the voice of the second user is not received. Helps reduce the possibility of overlapping or incomplete voice announcements.

In a possible design, when the first electronic device receives the voice of the second user and does not receive the translation result of the voice of the second user sent by the translation server within a first period of time, obtain the network signal strength; when the network signal strength is greater than a preset threshold, prompt the second user to reduce the speech rate. Helps reduce the possibility that the translation server cannot recognize the speech for translation due to the user speaking too fast.

In a possible design, the first electronic device displays first prompt information on the display screen, and the first prompt information is used to prompt the first user to notify the second to reduce the speech rate; or, the The first electronic device sends the first voice to the second electronic device, where the first voice is used to prompt the second user to reduce the speaking rate; or, the first electronic device plays the second voice to the first user. voice, and the second voice is used to prompt the first user to notify the second user to reduce the speaking rate. Helps to simplify how users are notified to slow down.

In a possible design, when the translation result of the voice of the second user buffered by the first electronic device exceeds a preset number, the translation result of the voice of the second user is broadcast. Helps reduce the possibility of packet loss in speech translation results.

In a possible design, the first electronic device broadcasts the translation result of the first user's speech.

In a possible design, the first electronic device displays the text of the voice recording of the call between the first user and the second user and the text of the translation result of the voice on the display screen. Helps users understand what the other person is saying.

In a possible design, after the first electronic device establishes a voice call connection with the second electronic device, the local language is used to play or display a prompt message that the voice call translation function has been enabled. Helpful to indicate to the user that voice call translation is turned on.

In a second aspect, an electronic device provided by an embodiment of the present application includes: one or more processors, a memory, multiple application programs, and one or more computer programs; wherein the one or more computer programs are stored in In the memory, when the computer program is executed by the electronic device, the first aspect and any possible design method involved in the first aspect of the embodiments of the present application are implemented.

A third aspect is a chip provided by an embodiment of the present application. The chip is coupled to a memory in an electronic device, so that the chip calls a computer program stored in the memory when running, so as to implement the first aspect of the embodiment of the present application. and any possible design method involved in the first aspect.

In a fourth aspect, a computer storage medium according to an embodiment of the present application, the computer storage medium stores a computer program, and when the computer program runs on an electronic device, enables the electronic device to execute the first aspect and the first aspect of the embodiment of the present application. The method of any possible design involved in the aspect.

A fifth aspect is a computer program product according to an embodiment of the present application. When the computer program product is run on an electronic device, the electronic device is made to execute and implement any of the above-mentioned first aspect and the first aspect of the embodiment of the present application. A possible design method.

In addition, for the technical effect brought by any of the possible design methods in the second aspect to the fifth aspect, reference may be made to the technical effect brought by different design methods in the related section of the method, which will not be repeated here.

Description of drawings

FIG. 1 is a schematic diagram of the architecture of a communication system to which an embodiment of the application is applied;

2 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application;

FIG. 3 is a specific structural schematic diagram of an electronic device provided by an embodiment of the present application;

4 is a schematic diagram of an application scenario of an embodiment of the present application;

5 is a schematic diagram of a user interface for making a phone call according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a user interface of a peer language setting according to an embodiment of the present application;

7 is a schematic diagram of system language setting according to an embodiment of the present application;

FIG. 8 is a schematic diagram of an application scenario of an embodiment of the present application;

9 is a schematic flowchart of a translation method based on a voice call according to an embodiment of the present application;

10 is a schematic diagram of a user interface prompting a user to slow down the speech rate according to an embodiment of the present application;

11 is a schematic flowchart of a voice broadcast method according to an embodiment of the present application;

12 is a schematic diagram of a queue according to an embodiment of the present application;

13 is a schematic diagram of a user interface for text display according to an embodiment of the present application;

14 is a schematic diagram of another user interface according to an embodiment of the present application;

15 is a schematic diagram of another user interface according to an embodiment of the present application;

16 is a schematic diagram of a system setting interface according to an embodiment of the present application;

FIG. 17 is a schematic diagram of a user interface for caller ID according to an embodiment of the present application;

FIG. 18 is a schematic structural diagram of another electronic device according to an embodiment of the present application.

Detailed ways

It should be understood that, in the embodiments of the present application, "at least one" refers to one or more, and "a plurality" refers to two or more. "And/or", which describes the association relationship of associated objects, indicates that there can be three kinds of relationships. For example, A and/or B can represent the following three relationships: A alone exists, A and B exist simultaneously, and B exists alone. A and B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship. "At least one (item) of the following" or its similar expression refers to any combination of these items, including any combination of single item (item) or plural item (item). For example, at least one (a) of a, b or c may represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c Can be single or multiple.

In order to enable communication parties using different languages (for example, communication parties with different native languages) to achieve barrier-free communication through an electronic device, an embodiment of the present application provides a translation method based on a voice call.

As shown in FIG. 1 , it is a schematic structural diagram of a communication system to which this embodiment of the present application is applied. Specifically, the communication system architecture shown in FIG. 1 includes an electronic device 100 , an electronic device 200 and a mobile communication network. The electronic device 100 and the electronic device 200 may communicate through a mobile communication network. The mobile communication network may be a second-generation (2nd-generation, 2G) network, a third-generation (3rd-generation, 3G) network, or a fourth-generation (4th-generation, 4G) network. ) network, as well as a fifth-generation mobile communication (5th-generation, 5G) network, etc.

As shown in FIG. 1 , user A uses electronic device 100 and user B uses electronic device 200. If user A and user B have different languages, for example, user A uses language 1 and user B uses language 2. For the communication of user B, in the embodiment of the present application, electronic device A can translate the collected voice sent by user A in language 1 into language 2 during the conversation between user A and user B, and then translate into language 2 through the mobile communication network The voice of the user B is sent to the electronic device 200, so that the electronic device 200 can directly play the voice translated into language 2 to the user B. On the other hand, the electronic device 200 can send the collected voice sent by user B in language 2 to the electronic device 100 through the mobile communication network. After receiving the voice sent by the electronic device 200, the electronic device 100 translates the received voice into language 1, Then it is played to user A, thereby helping user A and user B to communicate in the case of language barriers.

Take language 1 as Chinese and language 2 as English as an example. For example, if the voice of user A collected by the electronic device 100 is "I'm Lucy, do I need to help you?", the translation result of the voice of user A obtained is "This is Lucyspeaking, may I help you?" , and send the voice of "This is Lucy speaking, may I help you?" to the electronic device 200, so that the electronic device 200 plays the voice of "This is Lucy speaking, may I help you?" to user B, so that user B can play the voice of "This is Lucy speaking, may I help you?" In the case of not knowing Chinese, you can understand the meaning expressed by user A. After collecting the voice "I want to buy a ticket" of the user B, the electronic device 200 sends the voice "I want to buy a ticket" of the user B to the electronic device 100 through the mobile communication network. After receiving the voice of "I want to buy a ticket" sent by the electronic device 200, the electronic device 100 obtains the translation result of the voice of the user B, "I want to buy a ticket", and writes "I want to buy a ticket". The voice of user A is played to user A, so that user A can understand the meaning expressed by user B even if he does not understand English.

In other embodiments, the electronic device 100 may also send the collected voice sent by user A using language 1 to the electronic device 200 through the mobile communication network, so that the electronic device 200 can play the voice sent by user A using language 1 to the electronic device 200. user B. In addition, in still other embodiments, after receiving the voice in language 2 sent by electronic device 200 through the mobile communication network, the electronic device 100 in this embodiment of the present application may also play the voice in language 2 to user A.

In order to reduce the requirements on the processing performance of the electronic device 100, in some embodiments, the communication system architecture shown in FIG. 1 further includes a translation server. The electronic device 100 may send the collected voice of user A or the received voice of user B collected from the electronic device 200 to the translation server for translation. It should be noted that the translation server used to translate the voice of user A collected by the electronic device 100 and the translation server used to translate the voice of user B received by the electronic device 100 may be the same translation server or different translation servers. Server, the embodiment of the present application does not limit the number of translation servers in the communication system. It should be understood that the electronic device 100 may communicate with the translation server through wireless-fidelity (Wi-Fi), Bluetooth, or a mobile communication network.

In the electronic device 100 and the electronic device 200 in the embodiment of the present application, during the call between the user A and the user B, only one party, for example, the electronic device 100, may support the voice call translation function. In the embodiment of the present application, the electronic device 200 may support the voice call. The translation function may also not support the voice call translation function, which is not limited.

It should be understood that the electronic device 100 in this embodiment of the present application may be a portable electronic device, such as a mobile phone, a tablet computer, a wearable device (such as a smart watch) with a wireless communication function, a vehicle-mounted device, and the like. Exemplary embodiments of portable electronic devices include, but are not limited to, carry-on Or portable electronic devices with other operating systems. The aforementioned portable electronic device may also be, for example, a laptop computer (Laptop) having a touch-sensitive surface (eg, a touch panel). It should also be understood that, in some other embodiments of the present application, the electronic device 100 may also be a desktop computer having a touch-sensitive surface (eg, a touch panel).

Exemplarily, FIG. 2 is a schematic diagram of a possible hardware structure of the electronic device 100 . It should be understood that the illustrated hardware structure of the electronic device 100 is only an example. Also, the electronic device 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have different component configurations. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

As shown in FIG. 2, the electronic device 100 includes a processor 110, an internal memory 121, an external memory interface 122, an antenna 1, a mobile communication module 131, an antenna 2, a wireless communication module 132, an audio module 140, a speaker 140A, a receiver 140B, and a microphone 140C, headphone jack 140D, display screen 151, subscriber identification module (SIM) card interface 152, camera 153, button 154, sensor module 160, universal serial bus (universal serial bus, USB) interface 170, charging management module 180 , the power management module 181 and the battery 182 . In other embodiments, the electronic device 100 may also include a motor, an indicator, and the like.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (ISP), a controller, a video encoder A decoder, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

In some embodiments, memory may also be provided in the processor 110 for storing instructions and data. By way of example, the memory in the processor 110 may be a cache memory. This memory may be used to hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from this memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The external memory interface 122 can be used to connect an external memory card (eg, a Micro SD card) to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 122 to realize the data storage function. For example, save files such as music, video, etc. in an external memory card.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 131 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 . The mobile communication module 131 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), and the like. The mobile communication module 131 can receive the electromagnetic wave signal from the antenna 1, perform filtering, amplifying and other processing on the received electromagnetic wave signal, and transmit it to the modulation and demodulation processor for demodulation. The mobile communication module 131 can also amplify the signal modulated by the modulation and demodulation processor, and then convert it into an electromagnetic wave signal and radiate it out through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 131 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 131 may be provided in the same device as at least part of the modules of the processor 110 . For example, the mobile communication module 131 can send voice to the electronic device 200 , and can also receive the voice sent by the electronic device 200 .

The modem processor may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 140A, the receiver 140B, etc.), or displays an image or video through the display screen 151 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 131 or other functional modules.

The wireless communication module 132 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as Wi-Fi networks), bluetooth (BT), global navigation satellite system (GNSS) , frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 132 may be one or more devices integrating at least one communication processing module. The wireless communication module 132 receives the electromagnetic wave signal via the antenna 2 , frequency modulates and filters the electromagnetic wave signal, and sends the processed signal to the processor 110 . The wireless communication module 132 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and then convert it into electromagnetic waves for radiation through the antenna 2 . For example, the wireless communication module 132 can send the voice of the user A in language 1 collected by the electronic device 100 to the translation server, and can also send the voice of the user B in the language 2 collected by the electronic device 200 received by the mobile communication module 131 to the translation server The server can also receive the translation result of the speech sent by the translation server. It should be understood that in this embodiment of the present application, the translation result of the speech is a piece of audio.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 131, and the antenna 2 is coupled with the wireless communication module 132, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM , and/or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou satellite navigation system (BDS), a quasi-zenith satellite system (quasi- zenith satellite system, QZSS) and/or satellite based augmentation system (satellite based augmentation systems, SBAS).

The electronic device 100 may implement audio functions through an audio module 140, a speaker 140A, a receiver 140B, a microphone 140C, an earphone interface 140D, an application processor, and the like. Such as music playback, recording, etc.

The audio module 140 can be used to convert digital audio information to analog audio signal output, and also to convert analog audio input to digital audio signal. Audio module 140 may also be used to encode and decode audio signals. In some embodiments, the audio module 140 may be provided in the processor 110 , or some functional modules of the audio module 140 may be provided in the processor 110 .

Speaker 140A, also referred to as "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or answer a hands-free call through the speaker 140A.

The receiver 140B, also referred to as an "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 140B close to the human ear.

The microphone 140C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound through the human mouth close to the microphone 140C, and the microphone 140C can be used to collect the voice of the user A, and then convert the voice of the user A into an electrical signal. The electronic device 100 may be provided with at least one microphone 140C. In other embodiments, the electronic device 100 may be provided with two microphones 140C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further be provided with three, four or more microphones 140C to implement sound signal collection, noise reduction, identify sound sources, and implement directional recording functions.

The earphone jack 140D is used to connect wired earphones. The earphone interface 140D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface, etc. .

The electronic device 100 may implement a display function through a GPU, a display screen 151, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 151 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 151 may be used to display images, videos, and the like. The display screen 151 may include a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantumdot light emitting diodes, QLED) and so on. In some embodiments, the electronic device 100 may include 1 or N display screens 151 , where N is a positive integer greater than 1.

The electronic device 100 can realize the shooting function through the camera 153, the ISP, the video codec, the GPU, the display screen 151, the application processor, and the like.

The ISP can be used to process the data fed back by the camera 153 . For example, when taking a picture, the shutter is opened, and the light signal is collected by the camera 153, and then the camera 153 converts the collected light signal into an electrical signal, and transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .

Camera 153 may be used to capture still images or video. Typically, the camera 153 includes a lens and an image sensor. Among them, the object is projected through the lens to generate an optical image to the image sensor. The image sensor may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 153 , where N is a positive integer greater than 1.

The keys 154 may include a power key, a volume key, and the like. Keys 154 may be mechanical keys. It can also be a touch key. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .

Sensor module 160 may include one or more sensors. For example, a touch sensor 160A, a fingerprint sensor 160B, a gyro sensor 160C, a pressure sensor 160D, an acceleration sensor 160E, and the like. In some embodiments, the sensor module 160 may also include environmental sensors, distance sensors, proximity light sensors, bone conduction sensors, and the like.

The touch sensor 160A may also be referred to as a "touch panel". The touch sensor 160A may be disposed on the display screen 151 , and the touch sensor 160A and the display screen 151 form a touch screen, also referred to as a “touch screen”. The touch sensor 160A is used to detect touch operations on or near it. The touch sensor 160A may communicate the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through the display screen 151 . In other embodiments, the touch sensor 160A may also be disposed on the surface of the electronic device 100 , which is different from the position where the display screen 151 is located.

The fingerprint sensor 160 may be used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to realize fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering incoming calls with fingerprints, and the like.

The gyro sensor 160C may be used to determine the motion attitude of the electronic device 100 . In some embodiments, the angular velocity of electronic device 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 160C. The gyro sensor 160C can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyroscope sensor 160C detects the shaking angle of the electronic device 100, calculates the distance to be compensated by the lens module according to the angle, and allows the lens to counteract the shaking of the electronic device 100 through reverse motion to achieve anti-shake. The gyro sensor 160C can also be used for navigation and somatosensory game scenarios.

The pressure sensor 160D is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 160D may be disposed on the display screen 151 . There are many types of pressure sensors 160D, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The acceleration sensor 160E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

In other embodiments, the processor 110 may also include one or more interfaces. For example, the interface may be the SIM card interface 152 . For another example, the interface may also be the USB interface 170 . For another example, the interface may also be an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver transmission A universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, and the like. It can be understood that, the processor 110 in this embodiment of the present application may be connected to different modules of the electronic device 100 through an interface, so that the electronic device 100 can implement different functions. For example, taking pictures, processing, etc. It should be noted that, the embodiment of the present application does not limit the connection manner of the interface in the electronic device 100 .

Wherein, the SIM card interface 152 can be used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting into the SIM card interface 152 or pulling out from the SIM card interface 152 . The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 152 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 152 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 152 may also be compatible with different types of SIM cards. The SIM card interface 152 may also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 100 employs an eSIM, ie: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

The USB interface 170 is an interface conforming to the USB standard specification. For example, the USB interface 170 may include a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 170 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The USB interface 170 may also be used to connect other electronic devices, such as augmented reality (AR) devices and the like.

The charging management module 180 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 180 may receive charging input from the wired charger through the USB interface 170 . In some wireless charging embodiments, the charging management module 180 may receive wireless charging input through the wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 182 , the power management module 181 can also supply power to the electronic device.

The power management module 181 is used to connect the battery 182 , the charging management module 180 and the processor 110 . The power management module 181 receives input from the battery 182 and/or the charge management module 180, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 151, the camera 153, the mobile communication module 131 and the wireless communication module 132. The power management module 181 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other embodiments, the power management module 181 may also be provided in the processor 110 . In other embodiments, the power management module 181 and the charging management module 180 may also be provided in the same device.

The following takes the electronic device 100 as an example to describe the translation method based on a voice call in this embodiment of the present application in detail.

As shown in FIG. 3 , it is a schematic diagram of a specific structure of an electronic device 100 according to an embodiment of the present application. Specifically, the electronic device 100 includes an interaction module, a voice collection module, a broadcast module, a communication module and a translation module.

Wherein, the interaction module is used to realize the interaction between the user and the electronic device 100 . For example, an interaction module can be used to display a user interface. In some embodiments, the interaction module may be implemented by the display screen 151 in the hardware architecture of the electronic device 100 shown in FIG. 2 , or may be implemented by the display screen 151 and the touch sensor in the hardware architecture of the electronic device 100 shown in FIG. 2 160A implementation. The voice acquisition module is used to collect voice. In some embodiments, the voice collection module may be implemented by the microphone 140C in the hardware architecture of the electronic device 100 shown in FIG. 2 . The broadcast module is used to broadcast the voice, such as the translation result of the voice during the call, or the untranslated voice, etc. It should be noted that the broadcasting module may be implemented by the receiver 140B, the speaker 140A, or the earphone connected to the earphone interface 140D in the hardware architecture of the electronic device 100 shown in FIG. 2 . The communication module is used to realize the communication between the electronic device and other electronic devices or the translation server. For example, the communication module can be used to receive the voice sent by other electronic devices, and can also be used to send the voice collected by the voice acquisition module to the translation server, or used to send the voice received by the communication module to the translation server, and can also be used to receive the translation server. The translation result of the voice sent, etc. Exemplarily, the communication protocols that the communication module can support include WiFi, Bluetooth, LTE, WCDMA, GSM, next radio communication (next radio, NR) and the like. In this embodiment of the present application, the communication module may be implemented by the mobile communication module 131 and/or the wireless communication module 132 in the hardware architecture of the electronic device 100 shown in FIG. 2 .

The translation module is used to obtain the translation result of the speech. In some embodiments, as shown in FIG. 3 , the translation module may include an access unit, a local translation unit, a peer translation unit, a coordination unit, a main control unit, a broadcast control unit, and a voice detection unit. Illustratively, the access unit may be used to implement selection of translation services. For example, when the network is disconnected or the signal is poor, the access unit adopts offline translation, and performs translation through a translation engine preconfigured in the electronic device 100 . It should be noted that the translation engine pre-configured in the electronic device 100 may be a software program or command for realizing speech translation, and may be stored in the internal memory 121 or in the external memory 110. When the electronic device When translating speech, call the translation engine to obtain the translation result of speech. For another example, when the network signal is good, the access unit adopts online translation, and further selects a corresponding translation server based on a preconfigured policy. The local translation unit can be used to obtain the voice collected by the voice collection module and to cache the translation result of the voice collected by the voice collection module. The peer translation unit may be configured to acquire the speech received by the communication module and buffer the translation result of the speech received by the communication module. The broadcast control unit can be used to control the broadcast module to broadcast the translation result. In some embodiments, the translation unit at the local end or the translation unit at the opposite end may also automatically delete the translation result of the speech after sending the cached translation result of the speech to the broadcasting module for broadcasting, and may also store the translation result of the speech in the internal memory 121 Or in an external memory connected to the external memory interface 122 . The voice detection unit can be used to detect whether there is currently a voice input. The coordination unit can be used to coordinate the translation process and control the playback rhythm of the speech. The main control unit can be used to receive the user's operation instructions, and coordinate each unit module, so as to realize the voice call translation function. It should be noted that the translation module in this embodiment of the present application may be implemented by the processor 110 in the hardware architecture of the electronic device 100 shown in FIG. 2 . Illustratively, the translation module may be implemented by an application processor in the processor 110. In another example, the translation module may also be a dedicated processor, integrated in the processor 110, or not integrated in the processor 110.

The following describes the application scenarios of the voice call-based translation method provided by the embodiments of the present application. The translation method based on a voice call in this embodiment of the present application can be applied to an application scenario where the electronic device 100 is the calling end and the electronic device 200 is the called end, or can be applied to the electronic device 100 as the called end and the electronic device 200 as the calling end end application scenarios. Taking the electronic device 100 as the calling end and the electronic device 200 as the called end to realize the communication between the user A and the user B as an example, the translation method based on the voice call in the embodiment of the present application will be described in detail, wherein the user A uses the electronic device 100 , user B uses the electronic device 200 .

The electronic device 100 in the embodiment of the present application may acquire the translation result of the user A's speech after collecting the user A's speech, and send the translation result of the user A's speech to the electronic device 200, and the electronic device 100 may receive the translation result of the user A's speech. After the voice of the user B sent by the electronic device 200, the translation result of the voice of the user B is acquired, and the translation result of the voice of the user B is played.

In order to facilitate the electronic device 100 to obtain the translation result of user A's voice and the translation result of user B's voice, in some embodiments, the electronic device 100 determines a device for voice translation, and then obtains the device from the device for voice translation The translation result of user A's speech and/or the translation result of user B's speech. It should be noted that the device used for voice translation may be the electronic device 100 itself, or may be a translation server. When the device for performing speech translation is a translation server, the device for performing speech translation may be one translation server, or may be multiple translation servers. In addition, the device for translating the voice of user A and the device for translating the voice of user B may be the same device or different devices. For example, before initiating a call to user B, the electronic device 100 may determine a device for performing speech translation. For example, the electronic device 100 may determine a device for the user to perform voice translation before determining to initiate a call to user B and before initiating a call to user B. In another example, the electronic device 100 may also determine a device for voice translation after initiating a call to user B.

Wherein, in this embodiment of the present application, the electronic device 100 may initiate a call to user B in response to an operation of dialing the phone number of user B.

For example, as shown in FIG. 4 , the display screen 151 of the electronic device 100 displays the user interface 400 . Among them, the user interface 400 includes a phone icon 401 . In other embodiments, the user interface 400 may further include other application icons, such as a settings icon, a WeChat icon, a gallery icon, a mailbox icon, a camera icon, and the like. When the electronic device 100 detects the operation on the phone icon 401 , the user interface 410 may be displayed on the display screen 151 in response to the operation on the phone icon 401 . User interface 410 includes a contact list 411 and a function bar 412 . The contact list 411 is stored by user A according to his own needs. The function bar 412 includes function buttons such as creating a new contact, scanning business cards and more. For example, the electronic device 100 displays the user interface 420 on the display screen 151 in response to the user's operation on the user B in the contact list 411 . The user interface 420 may include user B's name, phone number, mailbox and other information, and may also include function buttons such as sending information, adding to favorites, and blocking caller numbers. The electronic device 100 may initiate a call to the user B in response to the operation on the phone number 12345659876, and display the user interface 430 on the display screen 151 . For example, the operation on the phone number 12345659876 may be a touch operation on the phone number 12345659876. Other operations are also possible.

In addition, user A can also initiate a call to user B by directly inputting the phone number of user B on the user interface 500 of the electronic device 100 . For example, as shown in FIG. 5 , the display screen 151 of the electronic device 100 displays a user interface 500 including a dial pad, an entered phone number “12345659876”, and a dial button 501 . When the input phone number is the phone number of user B, the electronic device 100 initiates a call to user B in response to the operation of the dial button 501 , and displays the user interface 430 shown in FIG. 4 on the display screen 151 . It should be noted that, in this embodiment of the present application, user A may also use the electronic device 100 to initiate a call to user B in other manners, such as initiating a call to user B in a voice manner.

In some embodiments, the electronic device 100 may determine the device for performing speech translation according to the network signal strength. Wherein, when the network signal strength is greater than a preset threshold, the electronic device 100 determines a device for performing speech translation from at least one preset translation server. However, translation servers from different manufacturers vary in the accuracy of language translation. For example, the translation server provided by the manufacturer S is more accurate for the language translation of Southeast Asian languages. For another example, the translation server provided by the manufacturer M is more accurate for language translation of European languages. Therefore, in order to improve the accuracy of speech translation, when using the translation server, the electronic device 100 can determine the translation server for speech translation according to the preset local language and opposite language. For example, when translating between Chinese and Vietnamese, Select the translation server of manufacturer S. It should be noted that the local language is the language used by user A, and the peer language is the language used by user B. When the network signal strength is less than or equal to the preset threshold, the electronic device 100 determines to perform speech translation through the translation engine preconfigured in the electronic device 100 . The above technical solution helps to improve the real-time performance of obtaining the speech translation result under the condition of poor network signal.

It should be noted that, in this embodiment of the present application, the preset threshold may be pre-configured in the electronic device 100, or may be determined by the electronic device 100 according to a pre-configured algorithm. In addition, in the embodiment of the present application, the electronic device 100 may establish communication with the translation server through a mobile communication network (eg, a 4G network, a 5G network, etc.), or may establish communication with the translation server through a WiFi network. In this embodiment of the present application, when the electronic device 100 communicates with the translation server through a mobile communication network, the preset threshold may be set as the first threshold. When the electronic device 100 and the translation server communicate with the translation server through WiFi, the preset threshold may be set as the second threshold. It should be noted that the first threshold and the second threshold are thresholds set according to different networks, and the sizes of the first threshold and the second threshold are not limited here. For example, when the electronic device 100 turns on the mobile communication network but does not turn on the WiFi network, the electronic device 100 may send the voice to the determined translation server through the mobile communication network when the signal strength of the mobile communication network is greater than the first threshold. In another example, when the electronic device 100 opens both the mobile communication network and the WiFi network, when the network signal strength of the WiFi network is greater than the second threshold, in some embodiments, the electronic device 100 uses the WiFi network to communicate with the translation server. Thereby helping to save costs. In another example, when the network signal strength of the mobile communication network is greater than the first threshold and the network signal strength of the WiFi network is less than or equal to the second threshold, in some embodiments, the electronic device 100 uses the mobile communication network to communicate with the translation server. This helps to reduce the communication delay between the electronic device 100 and the translation server.

The electronic device 100 determines the device used for speech translation according to the network signal strength in detail below with reference to the architecture of the electronic device 100 shown in FIG. 3 .

For example, after receiving the operation of initiating a call to user B reported by the interaction module or the operation of inputting the phone number of user B reported by the interaction module, the main control unit of the electronic device 100 sends a translation service access message to the access unit. Notice. It should be noted that the main control unit may directly send a notification of translation service access to the access unit, or may send a notification of translation service access to the access unit through the coordination unit, etc., which is not limited. After receiving the notification of the access of the translation service, the access unit obtains the network signal strength from the communication module, and determines the device used for speech translation according to the network signal strength.

Exemplarily, when the electronic device 100 turns on the WiFi network and the mobile communication network, and the electronic device 100 sends voice to the translation server through the WiFi network or the mobile communication network, when the network signal strength of the WiFi network is less than or equal to the second threshold and the mobile When the network signal strength of the communication network is less than or equal to the first threshold, it is determined to use the translation engine preconfigured in the electronic device 100 to translate the speech. In another example, the electronic device 100 may determine that the device for performing speech translation is a translation server when the network signal strength of the WiFi network is greater than the second threshold. In specific implementation, for example, when the WiFi network signal strength is greater than the second threshold, the access unit of the electronic device 100 obtains the preset local language and peer language, and then determines the local language and peer language according to the local language and peer language. server for speech translation. In some embodiments, the electronic device 100 may store the preset local language and peer language in the public storage space, and the access unit may directly obtain the preset local language and peer language from the public storage space, The pre-set local language and peer language can also be obtained from the public storage space through the main control unit.

The local language and the opposite language may be manually configured by the user in advance, or may be automatically configured by the electronic device 100 .

For example, as shown in FIG. 4 , user A may set the peer language through language setting 422 in user interface 420 . For example, the native language of user B is English, and the electronic device 100 may display the language list 600 on the display screen 151 in response to the operation of the language setting 422 by the user A, as shown in FIG. 6 . The electronic device 100 displays English in the language setting 422 and hides the language list 600 in response to the operation of selecting "English". It should be understood that user A can display different languages by sliding up and down in the area of the language list 600 . It should also be noted that the languages included in the language list 600 are the languages supported by the translation server that can communicate with the electronic device 100 and/or the translation engine pre-configured in the electronic device 100, and may be the languages that are pre-configured before the electronic device 100 leaves the factory. What is set in the electronic device 100 may also be obtained from the translation server after the operation of storing the contacts is detected for the first time. In addition, in the embodiment of the present application, the electronic device 100 may also automatically set the language of the language setting 422 . For example, the electronic device 100 may automatically set the language of the language setting 422 based on the stored attribution of user B's phone number. For example, the electronic device 100 detects that the home location of user B's phone number is London, and automatically sets the language setting 422 to English. For another example, the electronic device 100 may further set the language setting 422 according to the language used by the user B during the call between the user A and the user B. As another example, the electronic device 100 may also set the language setting 422 to a pre-configured default language, for example, the default language is English. The default language may be configured by the electronic device 100 before leaving the factory, or may be set by the user as required.

The local language involved in the embodiments of the present application may be the system language of the electronic device 100 . For example, as shown in FIG. 7 , the display screen 151 of the electronic device 100 displays the user interface 400 . User interface 400 includes settings icon 700 . The electronic device 100 displays a system setting user interface 710 on the display screen 151 in response to the operation of the setting icon 700 . System settings interface 710 includes language and region 711 . In addition, the system setting interface 711 may further include setting buttons for other functions, such as enabling cloud backup, screen locking, and the like. The electronic device 100 displays a user interface 720 on the display screen 151 in response to the operation of the language and region 711 . User interface 720 includes a system language setting button 721 . Additionally, in some embodiments, user interface 720 may also include a locale setting button. The electronic device 100 may display a user interface 730 on the display screen 151 in response to the operation of the system language setting button 721 , and the user interface 730 includes a language list 731 . The language list 731 includes languages supported by the electronic device 100 . In some embodiments, in order to facilitate the user to find the language required by the user from the languages included in the language list 731 , the user interface 730 may further include a search box 732 . For example, the electronic device 100 may find "Simplified Chinese" from the languages included in the language list 731 in response to "Simplified Chinese" input by the user A in the search box 732 . The electronic device 100 may set the system language to Simplified Chinese in response to an operation of selecting "Simplified Chinese" from the language list 732 . In other embodiments, the electronic device 100 may also be automatically set according to the attribution of the local number stored by the user. For example, when the electronic device 100 detects that the home number of the local number is Beijing, it automatically sets the system language to Chinese. For another example, when the electronic device 100 detects that the origin of the local number is Taiwan, China, it automatically sets the system language to traditional Chinese. It should be noted that, in this embodiment of the present application, the user can set the phone number on the user interface 410 shown in FIG. 4 .

Additionally, in some embodiments, a voice translation button 431 may also be included on the user interface 430 . This helps to further simplify the user's operation. For example, the electronic device 100 may also display the user interface 800 on the display screen 151 in response to the operation of the voice translation button 431 . The user interface 800 includes local language settings 803 and peer language settings 802 . The electronic device 100 can set the local language in response to the operation of the local language setting 803 by the user A, and set the peer language in response to the operation of the peer language setting 802 by the user A. For the specific implementation of the electronic device 100 setting the local language in response to the user A's operation on the local language setting 803 and setting the peer language in response to the user A's operation on the peer language setting 802, please refer to the electronic device 100's response to the user A. The operation of the language setting 422 on the user interface 420 implements the manner of setting the language, which will not be repeated here. In addition, in the embodiment of the present application, the electronic device 100 may also automatically perform language settings for the local language setting 803 and the opposite end language setting 802 . For example, the electronic device 100 may automatically set the local language setting 803 to the system language, and automatically set the opposite end language setting 802 to the language set by the language setting 422 in the user interface 420 in response to the operation of dialing a call to user B. For another example, the electronic device 100 may further perform language setting for the local language setting 803 based on the attribution of the local number. For a specific implementation method, refer to the above-mentioned automatic setting method of the system language. For another example, the electronic device 100 may also perform language setting for the local language setting 803 according to the home location of the mobile communication network accessed by the electronic device 100 . For example, if the mobile communication network accessed by the electronic device 100 is China Mobile, the local language is automatically set to Chinese. For another example, the electronic device 100 may further perform language setting on the peer language setting 802 based on the attribution of user B's phone number. For another example, the electronic device 100 can also obtain the most recent call record between user A and user B according to the local number and the phone number used to initiate a call to user B, and set the local language setting 803 to user A in the call record. For the language used, the peer language is set 802 as the language used by user B in the call record. For another example, the electronic device 100 may also perform language setting for the peer language setting 803 according to the home location of the communication network accessed by the electronic device 200 . For example, if the electronic device 100 obtains that the home location of the communication network accessed by the electronic device 200 is located in the United States, it will automatically set the opposite end language to English.

It should be noted that, in order to ensure the reliability of the automatically determined local language and peer language, in some embodiments, the main control unit of the electronic device 100 may respond to the operation of selecting user B or inputting the phone number of user B, Send language setting notification to access unit. After receiving the language setting notification, the access unit acquires the call record with user B. And according to the call record with the user B, the local language setting 803 and the opposite end language setting 802 are set correspondingly. If the access unit does not obtain the call record with user B, it can obtain the attribution of user B's phone number and the attribution of user A's phone number through the communication module, and based on the attribution of user B's phone number to the peer The language setting 802 is set, and the local language setting 803 is set based on the attribution of user A's phone number. It should be understood that, if the access unit has not acquired the call record with user B, the local language setting 803 may also be set based on the system language. If the access unit cannot obtain the attribution of user B's phone number, the peer language setting 802 may also be set as the default language. It should be noted that, if the access unit cannot obtain the attribution of user B's phone number, it may also send a notification to the main control unit that the automatic setting of the peer language setting 803 fails. After receiving the notification that the automatic setting of the peer language setting 803 fails, the main control unit prompts the user to manually set the peer language setting 803 . For example, the main control unit may prompt the user to manually set the terminal language setting 803 by triggering the display screen 151 to display prompt information. For another example, the main control unit may also prompt the user by triggering the broadcasting module to play the prompt information that the user manually sets the terminal language setting 803 . This embodiment of the present application does not limit the manner of prompting the user to manually set the terminal language setting 803 .

It should also be noted that, in order to facilitate user search, the local language setting 803 and the opposite end language setting 802 in this embodiment of the present application may also be set on the user interface 430 .

When the local language and the peer language are the same, the electronic device 100 may not need to perform translation operations on the speech. In some embodiments, the electronic device 100 may directly send the electronic device 200 the electronic device 200 when the local language and the peer language are the same. The voice of user A collected by the device 100, the electronic device 100 receives the voice of user B sent by the electronic device 200, and plays the voice of user B. Therefore, the processing method of the electronic device 100 is improved and simplified. The electronic device 100 can automatically enable the voice call translation function when the local language and the opposite end language are different, and perform the translation process of user A's voice and user B's voice.

E.g. After the access unit automatically sets the local language and the peer language, or obtains the local language and the peer language set by the user, if it detects that the local language and the peer language are different, it executes the determination method for speech translation. server process. Specifically, the process of determining the server for speech translation performed by the access unit may refer to the foregoing embodiments, and details are not described herein again. If the access unit detects that the language of the local end and the language of the opposite end are the same, there is no need to perform the process of determining a server for speech translation.

In order to improve user experience, in other embodiments, after receiving the voice of user B sent by the electronic device 200, the electronic device 100 also broadcasts the voice of user B. For example, the local language preset by the electronic device 100 is simplified Chinese and the opposite language is English. If the voice sent by user B to the electronic device 100 using the electronic device 200 is "Hello, Thisis Mike speaking.", the electronic device 100 receives After reaching "Hello, This is Mike speaking.", broadcast "Hello, This is Mike speaking." to user A, and obtain the translation result of "Hello, This is Mike speaking." "Hello, I am Mike" Then, broadcast "Hello, I'm Mike" to user A. In some embodiments, the electronic device 100 also broadcasts the translation result of User A's speech. For example, if the voice of user A collected by the electronic device 100 is "Hello, I want to buy a ticket.", the translation result of "Hello, I want to buy a ticket." is obtained as "Hello, I want to buy ticket." .", not only the translation result "Hello, I want to buy a ticket." is sent to the electronic device 200, but also the translation result "Hello, I want to buy a ticket." of user A's voice is broadcast to user A. In addition , in some embodiments, the electronic device 100 may also send the collected voice of the user A to the electronic device 200 . After receiving the voice of user A sent by the electronic device 100, the electronic device 200 broadcasts the voice of user A. After receiving the translation result of user A's speech sent by electronic device 100, electronic device 200 broadcasts the translation result of user A's speech. In other embodiments, the electronic device 100 may also send the translation result of user B's speech to the electronic device 200 . After receiving the translation result of user B's speech, the electronic device 200 may also broadcast the translation result of user B's speech.

When the electronic device 100 receives the voice of user B sent by the electronic device 200, it directly broadcasts the voice of user B. In this case, if the electronic device 100 receives the voice translation result of user A, it broadcasts the translation result of user A's voice. , the broadcast of user B's voice and the broadcast of the translation result of user A's voice will overlap. When the electronic device 100 collects the voice of user A, if the translation result of user A's voice is received, in this case, the broadcasting module broadcasting the translation result of user A's voice may cause the meaning expressed by the broadcasting voice to be incomplete.

Therefore, in some embodiments, after receiving the translation result of the speech, the electronic device 100 broadcasts the translation result of the received speech if no speech input is detected. In other embodiments, if the electronic device 100 detects that there is currently a voice input, it will broadcast the translation result of the received voice when no voice input is detected. Therefore, it helps to reduce the possibility of conflict with the broadcast user B's voice, and reduce the possibility that the translation result of the broadcast user A's voice is incomplete. In addition, in other embodiments, when the received translation result is the translation result of user A's speech, the electronic device 100 sends the translation result of user A's speech to the electronic device 200 when no speech input is detected. This helps to reduce the possibility of overlapping voice broadcasts of the electronic device 200 .

It should be noted that, the electronic device 100 detects the voice input in two cases: one is that the voice acquisition module of the electronic device 100 collects the voice of user A, and the other is that the communication module of the electronic device 100 receives the voice collected by the electronic device 200 user B's voice. When the electronic device 100 detects that there is no voice input, the embodiment of the present application refers to that the voice collection module of the electronic device 100 has not collected the voice of user A, and the communication module has not received the voice of user B collected by the electronic device 200 .

The manner of broadcasting the voice and the voice translation result in the embodiment of the present application will be described in detail below with reference to the structure of the electronic device 100 shown in FIG. 3 .

As shown in FIG. 9 , the electronic device 100 first acquires the voice. For example, the electronic device 100 can obtain the voice of user A through the voice acquisition module, and can also receive the voice of user B through the communication module, and then sends the obtained voice to the communication module through the access unit, and then the communication module reports the voice to the translator. The server, and then the translation server translates the speech, returns the translation result to the communication module, and finally broadcasts the translation result of the speech through the broadcasting module. In order to ensure the rhythm of voice acquisition and voice broadcast, in some embodiments, the electronic device 100 may, according to the voice acquisition situation and the voice translation situation, coordinate the voice acquisition situation and the voice translation situation to determine the voice acquisition and translation results. broadcast control.

The control method for the broadcast of the translation result of the user A's speech will be described in detail below.

After detecting that the electronic device 200 answers the call to user B initiated by the electronic device 100, the main control unit notifies the voice detection unit to monitor whether the voice acquisition module has collected the voice of user A, and whether the communication module has received the voice of user B. In the embodiment of the present application, the voice detection unit may report the voice detection result to the coordination unit in real time, or may report the voice detection result to the coordination unit at preset time intervals, and may also monitor that the voice acquisition module has not collected user A's data. When the voice and communication module does not receive the voice of user B, it sends the voice detection result to the coordination unit.

The voice collection module sends the collected voice of user A to the local translation unit. The local translation unit sends the voice of user A to the access unit, and then the access unit sends the voice of user A to the translation server through the communication module. After the translation server translates the user A's speech, it returns the translation result of the user A's speech to the electronic device 100 . The electronic device 100 receives the translation result of user A's speech sent by the translation server by the communication module, and after the communication module receives the translation result of user A's speech, sends the translation result of user A's speech to the local end through the access unit The translation unit, where the translation result of user A's speech is stored by the local translation unit. For example, the local translation unit may save the translation result of user A's speech into a preset first queue.

After receiving the translation result of user A's voice, the local translation unit reports the local end speech translation result notification to the coordination unit. If there is no voice input, a notification is sent to the announcement control unit allowing announcement of the result of the speech translation. It should be understood that, in this embodiment of the present application, the coordination unit may directly send a notification of allowing the broadcast of the voice translation result to the broadcast control unit, or may send the notification of allowing the broadcast of the voice translation result to the broadcast control unit through the main control unit.

After the broadcast control unit receives the notification of permission to broadcast the speech translation result, it notifies the broadcast module to obtain the speech translation result of user A and broadcast it. In addition, if the coordination unit determines that there is no voice input according to the voice detection result reported by the voice detection unit, it also notifies the communication module to send the translation result of user A's voice to the electronic device 200 .

When the coordination unit receives the notification of the local end's voice translation result, if it is determined that there is a voice input according to the voice detection result reported by the voice detection unit, it sends a notification to the broadcast control unit to suspend the broadcast of the translation result. Therefore, the broadcast control unit can realize the control of broadcast of the translation result of the speech by the broadcast module. In the embodiment of the present application, if the coordination unit determines that there is voice input according to the voice detection result reported by the voice detection unit, it may not send a notification to the broadcast control unit. After the coordination unit determines that there is no voice input according to the voice detection result reported by the voice detection unit, Then send a notification to the broadcast control unit to allow the broadcast of the speech translation result. In addition, if the coordination unit determines that the voice input is monitored according to the voice detection result reported by the voice detection unit, the communication module does not send the translation result of user A's voice to the electronic device 200 . For example, the coordination unit may send a notification to the communication module to suspend sending the local-end speech translation result to the electronic device 200 so that the communication module does not send the translation result of user A's speech to the electronic device 200 . For another example, the communication module may also not send the translation result of user A's voice to the electronic device 200 when the notification that allows sending the local-end voice translation result to the electronic device 200 is not received.

In addition, when the electronic device 100 implements user A's speech translation through the translation server, the electronic device 100 may not be able to obtain the translation result of user A's speech due to network signals or speech speed. For example, if the communication connection between the electronic device 100 and the translation server is established through the network, the electronic device 100 may not be able to upload the voice of user A to the translation server due to the poor network signal, or the translation server may not be able to The translation result of user A's speech is returned to the electronic device 100 in time.

In other embodiments, when the electronic device 100 detects user A's voice input, if the translation result of user A's voice is not received within the first time period, the electronic device 100 obtains the current network signal strength of the electronic device 100, and the network signal The strength is the signal strength of the network used by the electronic device 100 to communicate with the translation server, where the translation server is used to translate the user A's speech. It should be noted that, the first duration may be pre-configured in the electronic device 100, or may be determined by the electronic device 100 according to a preset algorithm. It is assumed that the network used by the electronic device 100 to communicate with the translation server is a mobile communication network as an example. If the network signal strength is less than or equal to the first threshold, the electronic device 100 switches to the translation engine pre-configured in the electronic device 100 to perform voice translation, switches to a serving cell with a good network signal, or prompts the user to switch networks, such as in the electronic device 100 When the device 100 is preconfigured with at least two SIM cards using different mobile communication networks, it automatically switches to another mobile communication network and uses another mobile communication network to communicate with the translation server, or when the electronic device 100 opens the WiFi network, automatically switches to another mobile communication network. Switch to a WiFi network whose signal strength is greater than the second threshold, etc. Therefore, the above-mentioned technical solution helps to reduce the possibility that the speech translation is blocked due to the deterioration of the network signal. In some embodiments, when the network signal strength of the mobile communication network is greater than the first threshold or the WiFi network signal strength is greater than the second threshold, the electronic device 100 prompts the user A to slow down the speech rate. For example, as shown in FIG. 10 , the electronic device 100 may prompt the user to reduce the speech rate by displaying prompt information 1000 on the display screen 151 . For example, the prompt information 900 may be "please speak slowly" or the like. In another example, the electronic device 100 may also prompt the user A to slow down the speech rate by playing a prompt sound when detecting that the screen of the electronic device 100 is black. For example, the prompt sound may be the prompt sound of "DiDi", or the voice of "Please slow down". The prompt tone may be preconfigured in the electronic device 100 . Therefore, the above technical solution helps to reduce the possibility of translation disorder caused by the user speaking too fast.

During specific implementation, in some examples, if the coordination unit of the electronic device 100 determines that the voice acquisition module has voice input according to the voice detection result reported by the voice detection unit, but if the coordination unit does not receive a voice input within the preset first time period Notification of the local end's voice translation result, the coordination unit sends a notification of network signal strength detection to the access unit. After receiving the notification of network signal strength detection, the access unit acquires the network signal strength from the communication module. It should be understood that the network signal strength obtained by the access unit from the communication module is the signal strength of the network used by the electronic device 100 to communicate with the translation server. The translation server is used to translate user A's speech. Taking the network used by the electronic device 100 for communication with the translation server to be a mobile communication network as an example, if the network signal strength is greater than the first threshold, a notification that the network is normal is sent to the coordination unit. The control unit sends a notification prompting user A to reduce the speaking rate. After receiving the notification prompting user A to reduce the speaking rate, the main control unit prompts user A to reduce the speaking rate. When the network signal strength obtained from the communication module is not greater than the first threshold, the access unit may send a notification of network abnormality to the coordination unit, and then the coordination unit sends the notification of network abnormality to the main control unit. After receiving the notification of network abnormality, the main control unit prompts the user to switch the network, or automatically switches the network. For example, the main control unit may display the current network abnormality through the display screen 151 to prompt the user to switch the network information. In addition, in some embodiments, when the network signal strength obtained from the communication module is not greater than the first threshold, the access unit may also automatically switch the speech translation service to the translation engine preconfigured in the electronic device 100 . When the access unit detects that the network is normal, it can also switch to the translation server again for voice translation.

When the electronic device 100 detects that there is no voice input for a long time, but receives the translation result of user A's voice, it may also be caused by poor network signal strength or the user speaking too fast. Therefore, in some embodiments, the electronic device 100 acquires the current network signal strength of the electronic device 100 when it detects that there is no voice input within the second time period, but receives the translation result of user A's voice, where the network signal strength is electronic The signal strength of the network used by the device 100 to communicate with the translation server for translating the user A's speech. Specifically, for the manner in which the electronic device 100 achieves coordination according to the network signal strength, see that when the electronic device 100 detects that the user A's voice is input and the translation result of the user A's voice is not received within the first time period, the electronic device 100 will The way network signal strength is coordinated.

In specific implementation, in some embodiments, if the coordination unit of the electronic device 100 determines that the speech acquisition module has no speech input within the second time period according to the speech detection result reported by the speech detection unit, but the coordination unit receives the local end speech translation result notification, the coordination unit sends a notification of network signal strength detection to the access unit. For the subsequent execution steps after the access unit receives the notification of network signal strength detection, please refer to the case where the coordination unit has voice input from the voice acquisition module, but does not receive the notification of the local end's voice translation result within the preset first time period , the subsequent execution steps after the access unit receives the notification of the network signal strength detection will not be repeated here.

It should be noted that when the number of translation results of user A's voice cached by the electronic device 100 exceeds the preset number, it is not necessary to consider whether the electronic device 100 currently collects the voice of user A or receives the voice of user B, and directly broadcasts the result. The translation result of user A's speech. This helps to avoid overflow of the voice translation result of user A cached by the electronic device 100, resulting in loss of information. For example, the first queue is used to cache the translation results of user A's speech, and the preset number is the maximum number of translation results that can be stored in the first queue. For example, in specific implementation, when the local translation unit detects that the number of buffered translation results of user A's speech exceeds a preset number, it sends a notification to the coordination unit to broadcast the translation results preferentially. After receiving the notification that the local end voice translation result is preferentially broadcast, the coordination unit sends a notification to the broadcast control unit to broadcast the local end speech translation result, so that the broadcast module broadcasts the translation result of user A's speech.

The control method for the broadcast of the translation result of the user B's speech will be specifically introduced below.

The communication module is configured to receive the voice of the user B collected by the electronic device 200, and send the received voice of the user B collected by the electronic device 200 to the peer translation unit. The translation unit of the opposite end sends the voice of user B to the access unit. Then the access unit sends the voice of user B to the translation server through the communication module. After the translation server translates the speech of user B, the translation result is returned to the electronic device 100 . The electronic device 100 receives the voice translation result of user B sent by the translation server by the communication module, and after the communication module receives the translation result of user B's voice, sends the translation result of user B's voice to the peer translation through the access unit. unit. The translation result of user B's speech is stored by the peer translation unit. For example, the peer translation unit may save the translation result of user B's speech into a preset second queue.

After receiving the translation result of user B's voice, the peer translation unit reports the peer translation result notification to the coordination unit. If there is no voice input, a notification is sent to the announcement control unit allowing announcement of the result of the speech translation. It should be understood that, in this embodiment of the present application, the coordination unit may directly send a notification of allowing the broadcast of the voice translation result to the broadcast control unit, or may send the notification of allowing the broadcast of the voice translation result to the broadcast control unit through the main control unit.

After the broadcast control unit receives the notification that the speech translation result is allowed to be broadcast, it notifies the broadcast module to obtain the speech translation result of user B and broadcast it. In addition, if the coordination unit determines that there is no voice input according to the voice detection result reported by the voice detection unit, it also notifies the communication module to send the translation result of user B's voice to the electronic device 200 .

After receiving the notification of the voice translation result from the opposite end, the coordination unit sends a notification to the broadcast control unit to suspend the broadcast of the translation result if it is determined that there is a voice input according to the voice detection result reported by the voice detection unit. Therefore, the broadcast control unit can realize the control of broadcast of the translation result of the speech by the broadcast module. In the embodiment of the present application, if the coordination unit determines that there is a voice input according to the voice detection result reported by the voice detection unit, it may not send a notification to the broadcast control unit, and the re-coordination unit determines according to the voice detection result reported by the voice detection unit that there is no voice input. , and then send a notification to the broadcast control unit to allow broadcast of the speech translation result. In addition, in some embodiments, the coordination unit may also not send the translation result of user A's voice to the electronic device 200 when it is determined that there is voice input according to the voice detection result reported by the voice detection unit. For example, the coordinating unit may send a notification to the communication module to suspend the transmission of the opposite-end voice translation result to the electronic device 200, so that the communication module does not send the translation result of user B's voice to the electronic device 200, or the communication module does not receive permission The notification of the voice translation result of the peer end is sent to the electronic device 200 , so that the communication module does not send the translation result of user B's voice to the electronic device 200 .

In addition, when the electronic device 100 implements user B's speech translation through the translation server, the electronic device 100 may not be able to obtain the translation result of user B's speech due to network signals or speech speed. For example, if the communication connection between the electronic device 100 and the translation server is established through the network, the electronic device 100 may not be able to upload the voice of user A to the translation server due to the poor network signal, or the translation server may not be able to The translation result of user B's speech is returned to the electronic device 100 in time.

Therefore, in some other embodiments, the electronic device 100 acquires the current network signal of the electronic device 100 when receiving the voice of the user B sent by the electronic device 200 but not receiving the translation result of the voice of the user B within the third time period strength, the network signal strength is the signal strength of the network used by the electronic device 100 to communicate with the translation server before, and the translation server is used to translate the voice of the user B. It should be noted that, the third duration may be pre-configured in the electronic device 100, or may be determined by the electronic device 100 according to a preset algorithm. In the following, the network used by the electronic device 100 for communication with the translation server is a mobile communication network as an example. When the network signal strength is less than or equal to the first threshold, the electronic device 100 switches to the translation engine pre-configured in the electronic device 100 for voice translation, or prompts the user to switch networks, or automatically switches to a network where the signal strength is greater than the first threshold. the mobile communication network, or automatically switch to a wireless communication network whose network signal strength is greater than the first threshold. This helps to reduce the possibility of speech translation being blocked due to poor network signal. In other embodiments, when the network signal strength is greater than the first threshold, the electronic device 100 prompts the user B to slow down the speech rate. This helps to reduce the possibility of translation disorder caused by the user speaking too fast. For example, the electronic device 100 may prompt the user A to notify the user B to reduce the speech rate by displaying prompt information on the display screen 151 . The electronic device 100 sends to the electronic device 200 the translation result of the speech of the user A prompting the user B to reduce the speech rate, so as to achieve the purpose of prompting the user B to reduce the speech rate. For another example, when the electronic device 100 detects that the screen of the electronic device 100 is black, the electronic device 100 may play a prompt tone to prompt the user A to notify the user B to slow down the speech rate. For example, the prompt sound may be the prompt sound of "DiDi", or the voice of "Please slow down". The prompt tone may be preconfigured in the electronic device 100 . For another example, the electronic device 100 can also automatically send the prompt tone to the electronic device 200, so that the electronic device 200 can play the prompt tone to the user B to achieve the purpose of prompting the user B to reduce the speaking rate.

In specific implementation, in some examples, if the coordination unit of the electronic device 100 determines that the communication module has received the voice from the electronic device 200 according to the voice detection result reported by the voice detection unit, but if the coordination unit presets the third duration If the notification of the voice translation result of the peer end is not received, the coordination unit sends a notification of network signal strength detection to the access unit. After receiving the notification of network signal strength detection, the access unit obtains the network signal strength from the communication module, and if the network signal strength is greater than the first threshold, it sends a notification that the network is normal to the coordination unit, and after the coordination unit receives the notification that the network is normal, Send a notification to the main control unit to prompt user B to reduce the speech rate. After receiving the notification prompting user B to reduce the speaking rate, the main control unit prompts user B to reduce the speaking rate. For example, after receiving the notification prompting user B to reduce the speaking rate, the main control unit may automatically send a prompt tone to the electronic device 200 through the communication module to prompt user B to reduce the speaking rate. As another example, the main control unit may also display prompt information on the display screen 151 or play a prompt sound to the user A through the broadcasting module to prompt the opposite-end user to speak too fast. After viewing the prompt information or hearing the prompt tone, user A verbally prompts user B to reduce the speaking rate, and the electronic device 100 sends the translation result of the voice that user A prompts user B to reduce the speaking rate to the electronic device 200, so as to achieve the prompt. User B's purpose of reducing the speaking rate. When the network signal strength obtained from the communication module is not greater than the first threshold, the access unit may send a notification of network abnormality to the coordination unit, and then the coordination unit sends the notification of network abnormality to the main control unit. After receiving the notification of network abnormality, the main control unit switches the network to the prompt. For example, the main control unit may display the current network abnormality through the display screen 151, prompting the user to switch the network information. In addition, in some embodiments, when the network signal strength obtained from the communication module is not greater than the first threshold, the access unit may also automatically switch the speech translation service to the translation engine preconfigured in the electronic device 100 . When the access unit detects that the network is normal, the voice translation service can also be switched to the translation server again.

When the electronic device 100 detects that there is no voice input for a long time, but receives the translation result of user B's voice, it may also be caused by poor network signal strength or the user speaking too fast. Therefore, in some embodiments, the electronic device 100 acquires the current network signal strength of the electronic device 100 when it detects that there is no voice input within the fourth time period, but receives the translation result of user B's voice, where the network signal strength is electronic The signal strength of the network used by the device 100 to communicate with the translation server. It should be noted that the fourth duration may be pre-configured in the electronic device 100, or may be determined by the electronic device 100 according to a preset algorithm. Specifically, for the manner in which the electronic device 100 achieves coordination according to the network signal strength, see that when the electronic device 100 detects that the user A's voice is input and the translation result of the user A's voice is not received within the first time period, the electronic device 100 will The way network signal strength is coordinated. This helps to improve the reliability of voice translation during calls.

During specific implementation, in some embodiments, if the coordination unit of the electronic device 100 determines that the communication module within the fourth time period has not received the voice from the electronic device 200 according to the voice detection result reported by the voice detection unit, but the coordination unit has received Notification of the voice translation result of the peer end, the coordination unit sends a notification of network signal strength detection to the access unit. For the subsequent execution steps after the access unit receives the notification of network signal strength detection, please refer to the case where the coordination unit has voice input from the voice acquisition module, but does not receive the notification of the local end's voice translation result within the preset first time period , the subsequent execution steps after the access unit receives the notification of the network signal strength detection will not be repeated here.

It should be noted that when the number of translation results of user B's voice cached by the electronic device 100 exceeds the preset number, it does not need to consider whether the electronic device 100 currently collects the voice of user A or receives the voice of user B, and directly broadcasts to the user. The translation result of B's speech. This helps to avoid overflow of the voice translation result of user B cached by the electronic device 100, resulting in loss of information. For example, the second queue is used to cache the translation results of user B's speech, and the preset number is the maximum number of translation results that can be stored in the second queue. Exemplarily, when specifically implemented, the opposite end translation unit sends a notification to the coordination unit to broadcast the result of the opposite end voice translation first, and after the coordination unit receives the notice to broadcast the opposite end speech translation result preferentially, it sends a broadcast of the opposite end speech to the broadcast control unit. The notification of the translation result enables the broadcasting module to announce the translation result of user B's speech.

Illustratively, as shown in FIG. 11 , it is a schematic flowchart of a method for broadcasting voice according to an embodiment of the present application. The following steps are performed by the electronic device 100 .

Step 1101, the translation result of the new speech is received. It should be understood that the translation result of the new speech may include the translation result of user A's speech, and may also include the translation result of user B's speech. The translation result of user A's speech is the translation result of the end-end speech, and the translation result of user B's speech is the translation result of the opposite end's speech.

Step 1102, it is judged whether the translation result of the cached speech exceeds a preset threshold, if so, go to step 1104, otherwise go to step 1103.

Step 1103 , determine whether there is a voice input, if yes, go to Step 1105 , otherwise go to Step 1104 . It should be understood that having a voice input means that the electronic device 100 collects the voice of user A and/or the electronic device 100 receives the voice of user B sent by the electronic device 200 . No voice input means that the electronic device 100 neither collects the voice of the user A nor receives the voice of the user B sent by the electronic device 200 .

Step 1104, broadcast the translation result of the speech, and the process ends. For example, the translation result of the broadcast speech is the translation result of the earliest cached speech.

For example, the translation result of the speech can be cached in a queue. For example, the queue diagram for buffering the translation results of speech is shown in FIG. 12 . When the queue is empty, the electronic device 100 can store the translation result of the unannounced speech translated first in position 1 in the queue, and then when the queue is empty, the electronic device 100 After receiving the translation result of the new speech, if the translation result of the speech stored in the queue at position 1 has not been broadcast, the new speech translation result is stored in the position 2 in the queue, and so on. The electronic device broadcasts the speech translation result starting from position 1 in the queue shown in FIG. 12 .

Step 1105, when the input voice is the voice of the opposite end, broadcast the voice of the opposite end, and obtain the translation result of the voice of the opposite end, and perform step 1101 again, when the input voice is the voice of the end, then obtain the translation of the voice of the local end As a result, step 1101 is re-executed, and the process ends.

In addition, in some other embodiments, during the call between user A and user B, the electronic device 100 displays on the display screen 151 the text corresponding to the voice of the real-time call records of user A and user B and the translation result of the corresponding voice text. Therefore, it is helpful for user A and user B to be able to understand the meaning expressed by the other party in the case of different languages. In some embodiments, the electronic device 100 may display, on the user interface 800 , the text corresponding to the speech of the real-time conversation between user A and user B and the text of the translation result of the corresponding speech. For example, the user interface 800 may include a call record text display area 804, and the call record text display area 804 displays the real-time call record texts of user A and user B. For example, the user A's voice collected by the electronic device 100 is "Hello, I want to buy a flight ticket.", the received voice of the electronic device B is "OK, which day do you prefer", and the acquired voice of the user A is "OK, which day do you prefer". The translation result is "Hello, I want to buy a ticket", and the obtained translation result of user B's voice is "OK, what day do you want to book?", then as shown in Figure 13, it can be displayed in the call log text Area 804 displays the text of "Hello, I want to buy a ticket.", the text of "Hello, I want to buy a ticket", the text of "OK, which day do you prefer", and the text of "Ok, where do you want to book." God?" text.

It should be noted that the text corresponding to the voice of the real-time call records of user A and user B and the text of the translation result of the corresponding voice may be obtained by the electronic device 100 based on voice recognition, or the electronic device 100 may use the user A and the The voice of user B's real-time call record and the translation result of the corresponding voice are reported to the voice translation server, and the voice translation server converts the voice into text and sends it to the electronic device 100 . This embodiment of the present application does not limit the manner in which the electronic device 100 acquires text.

In other embodiments, in order to facilitate both user A and user B to determine that the electronic device 100 has enabled the voice translation service, the electronic device 100 is preconfigured with a prompt tone that the voice call translation function has been enabled, for example, preconfigured in the electronic device The language used for the prompt tone that the voice call translation function in 100 has been turned on can be the system language or the set local language. When the system language or local language changes, the voice pre-configured in the electronic device 100 The language used for the prompt tone that the call translation function has been turned on changes accordingly. After detecting that user B has answered a call from user A, the electronic device 100 broadcasts the prompt tone that the voice call translation function pre-configured in the electronic device 100 has been turned on, and The translation result of the prompt tone that the voice call translation function has been turned on is sent to the electronic device 200 . The language used for the translation result of the prompt tone whose voice call translation function has been enabled is the set language of the peer. After receiving the translation result of the prompt tone that the voice call translation function is enabled, the electronic device 200 plays the prompt tone that the voice call translation function has been enabled, so that user B can know that the voice call translation function of the electronic device 100 has been enabled.

After detecting that user B has answered the call from user A, the electronic device 100 may further display on the display screen 151 the text of the prompt tone that the voice call translation function has been turned on. Taking the text of the prompt tone that the voice call translation function has been turned on can be "Hello, welcome to use the voice call translation service, please start the call after the voice announcement is completed." For example, the electronic device 100 detects that user B answers user A's call. After the incoming call, the user interface 800 displays "Hello, welcome to use the voice call translation service, please start the call after the voice broadcast is completed.", as shown in FIG. 14 .

In order to facilitate the setting of the local language setting 803 and the remote language setting 802 by the electronic device 100 next time, the electronic device 100 saves the local language settings 803 and 802 of the current call between user A and user B after detecting the end of the call with user B. The setting made by the peer language setting 802.

In this embodiment of the present application, a virtual button for enabling or disabling the voice call translation function may also be set on the electronic device 100 . This helps the user to control the voice call translation function on or off. The user can enable or disable the voice call translation function by operating the virtual button, or the electronic device 100 can automatically determine whether to enable or disable the voice call translation service to set the virtual button.

Exemplarily, as shown in FIG. 15 , the user interface 800 includes a virtual button 1400 , and the virtual button 1400 is used to enable or disable the voice call translation function. Specifically, when the virtual button 1200 is turned off (OFF), the electronic device 100 turns off the voice call translation function; when the virtual button 1200 is turned on (ON), the electronic device 100 turns on the voice call translation function. In addition, it should also be noted that when the virtual button 1200 is OFF, the local language setting 803 and the remote language setting can be hidden or grayed out in the user interface 800 . As another example, as shown in FIG. 16 , an open voice translation setting button 1601 may also be added to the system setting interface 1600, wherein the open voice translation setting button 1601 is used to enable or disable the voice call translation function. The electronic device 100 may display a system setting interface 1600 in response to an operation on the setting icon.

It should be noted that when the electronic device 100 is used as the called end and the electronic device 200 is used as the calling end, in the case where the electronic device 200 does not have a voice call translation function, if the electronic device 100 has a voice call translation function, the electronic device 100 After receiving the incoming call from user B, the translation process based on the voice call can be performed. Specifically, the electronic device 100 executes the voice call-based translation method, and reference may be made to the voice call-based translation method when the electronic device 100 acts as the calling end and the electronic device 200 acts as the called end, which will not be repeated here.

For example, as shown in FIG. 17 , after receiving an incoming call from user B, the electronic device 100 may display a user interface 1700 on the display screen 151 . A speech translation button 1701 is included on the user interface 1700 . The electronic device 100 may display the user interface 800 shown in FIG. 8 on the display screen 151 in response to the operation of the voice translation button 1701 . For another example, the electronic device 100 may also enable or disable the voice call translation function in response to the operation of the voice translation button 1701 . This helps the user to turn on the voice call translation function.

In addition, the voice call-based translation method in the embodiment of the present application can also be applied to other applications that can perform real-time voice communication, such as WeChat and the like. In addition, the above embodiments of the present application are only described by two people talking, and the embodiments of the present application can also be applied to application scenarios of multi-person calls, such as a conference call.

The various embodiments involved in this application can be used alone or in combination with each other to achieve different technical effects.

In the above-mentioned embodiments of the present application, the methods provided by the embodiments of the present application are introduced from the perspective of an electronic device as an execution subject. In order to implement the functions in the methods provided by the above embodiments of the present application, the electronic device may include a hardware structure and/or software modules, and implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is performed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

Based on the same concept, FIG. 18 shows an electronic device 1800 provided by the present application. Electronic device 1800 includes at least one processor 1810 , memory 1820 and transceiver 1830 . The processor 1810 is coupled to the memory 1820 and the transceiver 1830, and the coupling in this embodiment of the present application is an indirect coupling or a communication connection between devices, units or modules, which may be electrical, mechanical or other forms, for the device , information exchange between units or modules.

Specifically, the memory 1820 is used to store program instructions.

The transceiver 1830 is used to receive or transmit data.

The processor 1810 is configured to invoke the program instructions stored in the memory 1820, so that the electronic device 1800 executes the voice call-based translation method provided by the embodiment of the present application.

It should be understood that the electronic device 1800 may be used to implement the voice call-based translation method in this embodiment of the present application, and the relevant features can be referred to above, which will not be repeated here.

Those skilled in the art can clearly understand that the embodiments of the present application may be implemented by hardware, firmware, or a combination thereof. When implemented in software, the functions described above may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage medium can be any available medium that a computer can access. Taking this as an example but not limited to: computer readable media may include RAM, ROM, electrically erasable programmable read only memory (EEPROM), compact disc read-Only memory (CD-ROM) ) or other optical disk storage, magnetic disk storage media, or other magnetic storage devices, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and that can be accessed by a computer. also. Any connection can be appropriately made into a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, Then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, wireless, and microwave are included in the fusing of the pertinent medium. As used in the embodiments of the present application, disks and discs include compact discs (CDs), laser discs, optical discs, digital video discs (DVDs), floppy disks, and Blu-ray discs, wherein Disks usually reproduce data magnetically, while discs use lasers to reproduce data optically. Combinations of the above should also be included within the scope of computer-readable media.

In a word, the above descriptions are merely examples of the present application, and are not intended to limit the protection scope of the present application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included within the protection scope of this application.

Claims (14)

1. a translation method based on voice call, is characterized in that, described method comprises: establishing a voice call connection between the first electronic device and the second electronic device; When the voice call translation function is enabled, the first electronic device collects the voice of the first user, reports the voice of the first user to the translation server, and receives the voice of the first user sent by the translation server. translate the result, send the translation result of the voice of the first user to the second electronic device, receive the voice of the second user sent by the second electronic device, and report the second user to the translation server and receive the translation result of the second user's speech sent by the translation server, and broadcast the translation result of the second user's speech. 2. The method of claim 1, wherein the first electronic device communicates with the translation server through a network, the method further comprising: When the network signal strength is less than or equal to a preset threshold, the first electronic device, after collecting the voice of the first user, translates the voice of the first user to obtain a translation of the voice of the first user Result: after receiving the voice of the second user, translate the voice of the second user to obtain a translation result of the voice of the second user. 3. The method according to claim 1 or 2, wherein before the first electronic device reports the voice of the first user or the voice of the second user to the translation server, the method further comprises: : The first electronic device determines the translation server according to the local language and the peer language, the local language is the language used by the first user, and the peer language is used by the second user language. 4. The method of claim 3, wherein the method further comprises: During the establishment of a voice call connection between the first electronic device and the second electronic device or after the first electronic device establishes a voice call connection with the second electronic device, when the local language and the opposite end language are If not, the voice call translation function is automatically enabled. 5. The method according to any one of claims 1 to 3, wherein the method further comprises: The first electronic device enables the voice call translation function in response to the user's first operation. 6. The method of claim 4 or 5, wherein the method further comprises: The first electronic device sends, to the second electronic device, prompt information that the voice call translation function of the first electronic device has been enabled, and the language used for the prompt information is the language of the opposite terminal. 7. The method according to any one of claims 3 to 6, wherein the method further comprises: obtaining, by the first electronic device, the local language and the peer language; Wherein, the local language is the system language, or the language used by the first user in the last call record of the first user and the second user, or the phone number of the first user The native language of the home place of the number, or the native language of the home place where the communication network accessed by the first electronic device is located, or the language set in response to the user operation; The peer language is the native language of the home of the second user's phone number, or the language used by the second user in the last call record between the first user and the second user, or the language used by the second user. The native language of the home where the communication network accessed by the second electronic device is located, or the language set in response to the user operation. 8. The method according to any one of claims 1 to 7, wherein the first electronic device broadcasts the translation result of the voice of the second user, comprising: The first electronic device broadcasts a translation result of the second user's voice when the first user's voice is not collected and the second user's voice is not received. 9. The method of claim 2, wherein the method further comprises: The first electronic device acquires the network signal strength when the voice of the second user is received and the translation result of the voice of the second user sent by the translation server is not received within a first time period; The first electronic device prompts the second user to reduce the speech rate when the network signal strength is greater than the preset threshold. 10. The method of claim 9, wherein the first electronic device prompts the second user to reduce the speech rate, comprising: The first electronic device displays first prompt information on the display screen, where the first prompt information is used to prompt the first user to notify the second speech rate reduction; or, The first electronic device sends a first voice to the second electronic device, where the first voice is used to prompt the second user to reduce the speaking rate; or, The first electronic device plays a second voice to the first user, where the second voice is used to prompt the first user to notify the second user to reduce the speaking rate. 11. The method according to claims 1 to 10, wherein the first electronic device broadcasts the translation result of the voice of the second user, comprising: When the translation result of the voice of the second user buffered by the first electronic device exceeds a preset number, the translation result of the voice of the second user is broadcast. 12. An electronic device, comprising: one or more processors and memories; multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, which, when executed by the electronic device, cause the electronic device to implement as claimed in claims 1 to 11 any of the methods described. 13. A chip, characterized in that, the chip is coupled with a memory in an electronic device, so that the chip invokes a computer program stored in the memory when running, so as to realize the method according to any one of claims 1 to 11. method. 14. A computer storage medium, characterized in that, the computer-readable storage medium comprises a computer program, when the computer program is run on an electronic device, the electronic device is made to execute any one of claims 1 to 11. method.