CN107786714B

CN107786714B - Sound control method, apparatus and system based on vehicle-mounted multimedia equipment

Info

Publication number: CN107786714B
Application number: CN201610799637.0A
Authority: CN
Inventors: 王磊
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2016-08-31
Filing date: 2016-08-31
Publication date: 2019-11-05
Anticipated expiration: 2036-08-31
Also published as: CN107786714A; WO2018040844A1

Abstract

The invention discloses a kind of sound control methods based on vehicle-mounted multimedia equipment, apparatus and system, belong to mobile unit field.This method comprises: receiving the radio broadcasting message of at least one mobile terminal transmission；The cohesion between each mobile terminal and master mobile terminal is calculated according to radio broadcasting message；Determined whether to enable voice play function according to cohesion.The present invention calculates the cohesion of passenger by the time of the appearance of mobile terminal entrained by statistics passenger on a vehicle with number, the voice play function of vehicle mounted multimedia is opened or closed according to cohesion, solve on vehicle there are when other passengers with voice play form word message, speech message or calling voice are played out, the technical issues of privacy of user can be revealed, reached according to the cohesion of other passengers selectively play master mobile terminal transmitted by message, avoid the effect that privacy of user is leaked.

Description

Voice control method, device and system based on vehicle-mounted multimedia equipment

Technical Field

The embodiment of the invention relates to the field of vehicle-mounted equipment, in particular to a voice control method, a voice control device and a voice control system based on vehicle-mounted multimedia equipment.

Background

The vehicle-mounted multimedia equipment is used for providing functions of audio playing, video playing, telephone communication and the like on an automobile. With the development of the mobile terminal, the mobile terminal may establish a wireless connection with the vehicle-mounted multimedia device, where the wireless connection may be: a bluetooth connection or a Wi-Fi (Wireless Fidelity) network connection.

In the prior art, a mobile terminal and a vehicle-mounted multimedia device are in wireless connection in advance. And when the newly received text message, voice message or incoming call voice exists in the mobile terminal, the text message, the voice message or the incoming call voice is sent to the vehicle-mounted multimedia equipment through wireless connection. The vehicle-mounted multimedia equipment plays the newly received text message, voice message or incoming call voice in the mobile terminal in a voice playing mode.

In the process of implementing the embodiment of the present invention, the inventor finds that the prior art has at least the following problems:

when other passengers exist in the automobile, the text message, the voice message or the incoming call voice is played in a voice playing mode, and the privacy of the user can be revealed.

Disclosure of Invention

In order to solve the problems in the prior art, embodiments of the present invention provide a voice control method and apparatus based on a vehicle-mounted multimedia device. The technical scheme is as follows:

in a first aspect, a voice control method based on an in-vehicle multimedia device is provided, and the method includes:

receiving a wireless broadcast message sent by at least one mobile terminal, wherein the wireless broadcast message carries a terminal identifier of the mobile terminal;

counting the appearing time length of each mobile terminal according to the received wireless broadcast message;

for each mobile terminal, counting the occurrence times of the mobile terminal according to the counted occurrence time of the mobile terminal;

calculating the intimacy degree between the mobile terminal and a main mobile terminal according to the appeared times of the mobile terminal, wherein the appeared times and the intimacy degree are in positive correlation, and the main mobile terminal is a mobile terminal which establishes communication connection with the vehicle-mounted multimedia equipment;

and determining whether to start a voice playing function according to the intimacy, wherein the voice playing function is a function of playing the message sent by the main mobile terminal in a voice playing mode.

In a second aspect, a voice control apparatus based on a vehicle-mounted multimedia device is provided, the apparatus comprising:

the message receiving module is used for receiving a wireless broadcast message sent by at least one mobile terminal, wherein the wireless broadcast message carries a terminal identifier of the mobile terminal;

a time length counting unit, configured to count an occurred time length of each mobile terminal according to the received wireless broadcast packet;

the frequency counting unit is used for counting the frequency of occurrence of the mobile terminal according to the counted time length of occurrence of the mobile terminal for each mobile terminal;

the intimacy degree calculating unit is used for calculating intimacy degree between the mobile terminal and a main mobile terminal according to the appeared times of the mobile terminal, the appeared times and the intimacy degree are in positive correlation, and the main mobile terminal is a mobile terminal which establishes communication connection with the vehicle-mounted multimedia equipment;

and the voice playing module is used for determining whether to start a voice playing function according to the intimacy, wherein the voice playing function is a function of playing the message sent by the main mobile terminal in a voice playing mode.

In a third aspect, a speech control system based on a vehicle-mounted multimedia device is provided, the system comprising: the system comprises vehicle-mounted multimedia equipment and a main mobile terminal; the vehicle-mounted multimedia equipment and the main mobile terminal establish communication connection;

the vehicle-mounted multimedia equipment comprises the voice control device based on the vehicle-mounted multimedia equipment according to the second aspect.

In a fourth aspect, there is provided an in-vehicle multimedia device comprising a processor and a memory, the memory having stored therein at least one instruction, at least one program, set of codes, or set of instructions, which is loaded and executed by the processor to implement the method according to the first aspect.

In a fifth aspect, a computer-readable storage medium is provided, having stored thereon a computer program for implementing the method according to the first aspect.

The technical scheme provided by the embodiment of the invention at least comprises the following beneficial effects:

the intimacy degree of the passenger is calculated by counting the wireless broadcast messages sent by the mobile terminal carried by the passenger, and the voice playing function of the vehicle-mounted multimedia is turned on or turned off according to the intimacy degree, so that the technical problem that when other passengers exist in the vehicle, text messages, voice messages or incoming voice are played in a voice playing mode, and the privacy of the user can be revealed is solved, the message sent by the main mobile terminal is selectively played according to the intimacy degrees of the other passengers, and the effect that the privacy of the user is revealed is avoided.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a block diagram of a voice control system based on a vehicle-mounted multimedia device according to an embodiment of the present invention;

FIG. 2 is a flowchart of a voice control method based on a vehicle-mounted multimedia device according to an embodiment of the present invention;

FIG. 3 is a flowchart of a voice control method based on a vehicle-mounted multimedia device according to another embodiment of the present invention;

fig. 4A is a flowchart of a voice control method based on a vehicle-mounted multimedia device according to another embodiment of the present invention;

fig. 4B is a schematic diagram illustrating a principle of counting a wireless broadcast message according to another embodiment of the present invention;

FIG. 4C is a schematic diagram of an interface for generating an unread alert message according to another embodiment of the present invention;

FIG. 5A is a flowchart of an alternative step to step 411 provided by another embodiment of the present invention;

FIG. 5B is a schematic diagram of an interface for enabling the first play mode according to another embodiment of the present invention;

FIG. 5C is a schematic diagram of an interface for enabling a second play mode according to another embodiment of the present invention;

FIG. 5D is a schematic diagram of an interface for enabling a third playback mode according to another embodiment of the present invention;

FIG. 6 is a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to an embodiment of the present invention;

fig. 7 is a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention;

fig. 8 is a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention;

fig. 9 is a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention;

fig. 10 is a block diagram of a vehicle-mounted multimedia device according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

With the popularization of mobile terminals such as mobile phones, tablet computers and the like, people carry the mobile terminals while riding in vehicles and use the mobile terminals in the vehicles. The embodiment of the invention provides a method for calculating intimacy between a driver and a passenger based on a wireless broadcast message sent by a mobile terminal, and further starting or closing a voice playing function on a vehicle-mounted multimedia device according to the intimacy.

Referring to fig. 1, a schematic structural diagram of a voice control system based on a vehicle-mounted multimedia device according to an embodiment of the present invention is shown. The voice control system includes: the vehicle-mounted multimedia device 120 and the main mobile terminal 140.

The in-vehicle multimedia device 120 is a multimedia device provided on a center console or an inside rear view mirror of an automobile. The multimedia device is used for realizing functions of navigation, music playing, video playing, instant messaging, interconnection with the main mobile terminal 140 and the like. The on-board multimedia device 120 and the host mobile terminal 140 are typically located on the same vehicle. The vehicle-mounted multimedia device 120 has a capability of transceiving and parsing a Wireless broadcast message, which may be a WiFi (Wireless Fidelity) message or a bluetooth message. Optionally, the on-board multimedia device 120 also has the capability of acquiring the speed per hour of the vehicle as described above. Such as: the vehicle-mounted multimedia device 120 acquires the speed per hour of the vehicle through an acceleration sensor.

The main mobile terminal 140 is a mobile terminal that establishes a communication connection with the in-vehicle multimedia device 120. The communication connection may be a wireless connection or a wired connection. The wired connection may be a USB (Universal Serial Bus) connection.

The main mobile terminal 140 may be a mobile phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer III, motion Picture Experts Group Audio Layer IV, motion Picture Experts Group Audio Layer 4), an MP4 player, and so on. The main mobile terminal 140 serves to transmit the received message to the in-vehicle multimedia device 120.

Referring to fig. 2, a flowchart of a voice control method based on a vehicle-mounted multimedia device according to an embodiment of the present invention is shown. The embodiment is exemplified by applying the voice control method based on the in-vehicle multimedia device to the in-vehicle multimedia device 120 shown in fig. 1. The method comprises the following steps:

step 201, receiving a wireless broadcast message sent by at least one mobile terminal, where the wireless broadcast message carries a terminal identifier of the mobile terminal.

Optionally, the terminal identity is a MAC (Medium Access Control) address.

Step 202, calculating the intimacy between each mobile terminal and a main mobile terminal according to the wireless broadcast message, wherein the main mobile terminal is a mobile terminal establishing communication connection with the vehicle-mounted multimedia equipment.

Optionally, the primary mobile terminal is a mobile terminal used by the driver. The other mobile terminals are mobile terminals used by passengers.

Step 203, determining whether to start a voice playing function according to the intimacy, wherein the voice playing function is a function of playing the message sent by the main mobile terminal in a voice playing mode.

Optionally, the message sent by the master mobile terminal includes but is not limited to: text messages, voice messages and/or video messages received by a communication program in the host mobile terminal. The communication procedures include, but are not limited to: short messages, social applications, instant messaging programs, microblogs, or other apps (applications) with the ability to receive messages.

In summary, the voice control method based on the vehicle-mounted multimedia device provided in this embodiment receives the wireless broadcast message sent by at least one mobile terminal; calculating the intimacy between each mobile terminal and the main mobile terminal according to the wireless broadcast message; and determining whether to enable the voice playing function according to the intimacy degree. The invention controls the voice playing function of the vehicle-mounted multimedia by counting the time and the times of the mobile terminal carried by the passenger appearing on the vehicle, solves the technical problem that the privacy of the user can be revealed when other passengers play the text message, the voice message or the incoming call voice in a voice playing mode, achieves the effect of selectively playing the message sent by the main mobile terminal and avoids the privacy of the user from being revealed.

Referring to fig. 3, a flowchart of a voice control method based on a vehicle-mounted multimedia device according to another embodiment of the present invention is shown. The embodiment is exemplified by applying the voice control method based on the in-vehicle multimedia device to the in-vehicle multimedia device 120 shown in fig. 1. The method comprises the following steps:

step 301, receiving a wireless broadcast packet sent by at least one mobile terminal, where the wireless broadcast packet carries a terminal identifier of the mobile terminal.

The wireless broadcast messages include, but are not limited to: WIFI broadcast messages and Bluetooth broadcast messages. When the mobile terminal starts the WIFI network connection function, the mobile terminal periodically sends a WIFI broadcast message outwards; when the mobile terminal starts the Bluetooth network connection function, the mobile terminal periodically sends out Bluetooth broadcast messages.

Optionally, the wireless broadcast message is a broadcast message used for detecting a surrounding available network or connectable device, and has a characteristic of periodic transmission.

When the mobile terminal sends a wireless broadcast message, the mobile terminal carries its own terminal identifier in the wireless broadcast message. Optionally, the terminal identity is a MAC address of the mobile terminal.

It should be noted that the mobile terminal does not need to establish a communication connection with the vehicle-mounted multimedia device.

Step 302, counting the occurrence duration of each mobile terminal according to the received wireless broadcast message.

The vehicle-mounted multimedia equipment receives 1 or more wireless broadcast messages sent by each mobile terminal. When two or more wireless broadcast messages carrying the same terminal identification exist, the vehicle-mounted multimedia equipment determines the latest group of continuous wireless broadcast message sequences. And the receiving time difference between the ith wireless broadcast message and the (i + 1) th wireless broadcast message in the continuous wireless broadcast message sequence is smaller than a preset threshold value, wherein i is a positive integer. The preset threshold value is related to the period of the mobile terminal when the wireless broadcast message is periodically sent, and the preset threshold value A corresponding to the WIFI wireless broadcast message and the preset threshold value B corresponding to the Bluetooth wireless broadcast message can be different.

And determining the appearing time length of the mobile terminal according to the difference between the receiving time of the last wireless broadcast message and the receiving time of the first wireless broadcast message in the continuous wireless broadcast message sequence.

Step 303, for each mobile terminal, detecting whether the counted appearing duration of the mobile terminal is greater than a first threshold.

When the time period of the mobile terminal has been short, it is not clear whether the mobile terminal is a mobile terminal used by a passenger who is present in the vehicle or a mobile terminal used by a passerby that has passed by accident. Only mobile terminals that have been present for a long time should be considered as mobile terminals used by passengers located on the vehicle.

For each mobile terminal, it is detected whether the time length of the occurrence of the mobile terminal exceeds a first threshold. Optionally, the first threshold is related to, and inversely related to, the vehicle speed of the vehicle. That is, the faster the vehicle speed, the smaller the first threshold value; the slower the vehicle speed, the larger the first threshold value.

When the appeared time length of the mobile terminal does not exceed the first threshold value, entering step 304;

when the present time of the mobile terminal exceeds the first threshold, step 305 is entered;

and step 304, when the appeared time length of the mobile terminal does not exceed the first threshold value, counting the mobile terminal temporarily.

When the appearing time length of the mobile terminal does not exceed the first threshold value, the mobile terminal is considered as a mobile terminal used by passers-by which the passers-by pass by accidentally, and therefore the mobile terminal is not counted for the time.

And 305, if the number of the historical occurrence times of the mobile terminal is larger than the first threshold, adding one to the number of the historical occurrence times of the mobile terminal to obtain the number of the occurred mobile terminal, wherein the initial value of the historical occurrence times is X.

Mobile terminals that have been present for a period greater than a first threshold are considered mobile terminals used by passengers located on the vehicle.

For each mobile terminal, the historical occurrence times are the times that all the counted occurrence durations of the vehicle-mounted multimedia equipment before the vehicle-mounted multimedia equipment receives the group of continuous wireless messages are larger than a first threshold value. And adding one to the historical occurrence frequency of the mobile terminal to obtain the occurrence frequency of the mobile terminal.

Alternatively, the initial value of the history occurrence number is 0.

And step 306, calculating the intimacy degree between the mobile terminal and the main mobile terminal according to the appeared times of the mobile terminal, wherein the appeared times and the intimacy degree have positive correlation.

Affinity is a mapping of the relationship of the master mobile terminal to other mobile terminals. The intimacy degree is related to the appearing times of the mobile terminal and has positive correlation. That is, the higher the number of times the mobile terminal has appeared, the greater the intimacy; the lower the number of times the mobile terminal has appeared, the smaller the intimacy.

Step 307, determining whether to enable a voice playing function according to the intimacy, wherein the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing mode.

Before determining whether to enable the voice playing function according to the intimacy degree, setting an intimacy degree threshold value.

Optionally, for each mobile terminal, if the intimacy between the mobile terminal and the main mobile terminal is greater than or equal to the intimacy threshold, starting a voice playing function; and if the intimacy between the mobile terminal and the main mobile terminal is less than the intimacy threshold, the voice playing function is not started.

The embodiment also detects whether the counted appearing duration of each mobile terminal is greater than a first threshold value; if the number of the historical occurrences of the mobile terminal is larger than the first threshold, the number of the historical occurrences of the mobile terminal is added by one to obtain the number of the occurrences of the mobile terminal, and the initial value of the historical occurrences is X, so that the problem of how to determine the number of the occurrences of other passengers is solved, and the effect that each passenger can accurately know the number of the occurrences of the passenger is achieved.

Referring to fig. 4A, a flowchart of a voice control method based on a vehicle-mounted multimedia device according to another embodiment of the invention is shown. The embodiment is exemplified by applying the voice control method based on the in-vehicle multimedia device to the in-vehicle multimedia device 120 shown in fig. 1. The method comprises the following steps:

step 401, receiving a wireless broadcast message sent by at least one mobile terminal, where the wireless broadcast message carries a terminal identifier of the mobile terminal.

Step 402, for each terminal identifier, when two or more wireless broadcast messages carrying the terminal identifier exist, determining a latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier.

Referring to fig. 4B, wherein, the terminal identifier a represents a wireless broadcast message sent by the mobile terminal a; the terminal identification B represents a wireless broadcast message sent by the mobile terminal B; the terminal identification C represents a wireless broadcast message sent by the mobile terminal C; the terminal identifier D represents a wireless broadcast packet sent by the mobile terminal D.

For a terminal identification A, 8 wireless broadcast messages A1-A8 are received; the receiving time difference between the wireless broadcast message A1 and the wireless broadcast message A2 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A2 and the wireless broadcast message A3 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A3 and the wireless broadcast message A4 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A4 and the wireless broadcast message A5 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A5 and the wireless broadcast message A6 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A6 and the wireless broadcast message A7 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message A7 and the wireless broadcast message A8 is smaller than a preset threshold value; the vehicle-mounted multimedia equipment determines that the latest group of continuous wireless broadcast message sequences corresponding to the terminal identification A are { A1, A2, A3, A4, A5, A6, A7 and A8 }.

For the terminal identification B, 5 wireless broadcast messages are received; the receiving time difference between the wireless broadcast message B1 and the wireless broadcast message B2 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message B2 and the wireless broadcast message B3 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message B3 and the wireless broadcast message B4 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message B4 and the wireless broadcast message B5 is smaller than a preset threshold value; and the vehicle-mounted multimedia equipment determines that the latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier B are { B1, B2, B3, B4 and B5 }.

For the terminal identifier C, receiving 4 wireless broadcast messages; the receiving time difference between the wireless broadcast message C1 and the wireless broadcast message C2 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message C2 and the wireless broadcast message C3 is greater than a preset threshold value; and the vehicle-mounted multimedia equipment determines that the latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier C are { C1, C2 and C3}.

For the terminal identification D, receiving 5 wireless broadcast messages; the receiving time difference between the wireless broadcast message D1 and the wireless broadcast message D2 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message D2 and the wireless broadcast message D3 is greater than a preset threshold value; the receiving time difference between the wireless broadcast message D3 and the wireless broadcast message D4 is smaller than a preset threshold value; the receiving time difference between the wireless broadcast message D4 and the wireless broadcast message D5 is smaller than a preset threshold value; and the vehicle-mounted multimedia equipment determines that the latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier C are { D3, D4 and D5}.

Step 403, determining the appearing time length of the mobile terminal according to the difference between the receiving time of the last wireless broadcast message in the continuous wireless broadcast message sequence and the receiving time of the first wireless broadcast message.

If the vehicle-mounted multimedia device can receive a group of continuous wireless broadcast message sequences of the mobile terminal, it is assumed that the mobile terminal is located on or near the vehicle in the time period corresponding to the whole continuous wireless broadcast message sequence.

Referring to fig. 4B, according to the latest group of persistent wireless broadcast message sequences { a1, a2, A3, a4, a5, a6, a7, A8} corresponding to the terminal identifier a, the in-vehicle multimedia device determines that the occurred duration corresponding to the primary mobile terminal a is: the receiving time of the wireless broadcast message a1 subtracted from the receiving time of the wireless broadcast message A8 is T8-T1 is 7 time units.

The vehicle-mounted multimedia equipment determines that the appearing time length corresponding to the mobile terminal B is as follows according to the latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier B as { B1, B2, B3, B4 and B5 }: the receiving time of the wireless broadcast message B5 minus the receiving time of the wireless broadcast message B1 is T5-T1 is 4 time units.

The vehicle-mounted multimedia equipment determines that the appearing time length corresponding to the mobile terminal C is as follows according to the latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier C as { C1, C2 and C3 }: the receiving time of the wireless broadcast message C1 subtracted from the receiving time of the wireless broadcast message C3 is T3-T1 is 2 time units.

The vehicle-mounted multimedia equipment determines that the appearing time length corresponding to the mobile terminal D is as follows according to the fact that the latest group of continuous wireless broadcast message sequence corresponding to the terminal identification D is { D3, D4 and D5 }: the receiving time of the wireless broadcast message D3 subtracted from the receiving time of the wireless broadcast message D5 is T5-T3 is 2 time units.

It should be noted that, since the receiving operation of the radio broadcast packet is continuously performed, after a new radio broadcast packet of the mobile terminal is received each time, step 402 and step 404 need to be executed again for the mobile terminal.

Step 404, detecting whether the difference between the receiving time of the last wireless broadcast message in the continuous wireless broadcast message sequence and the current time is greater than a second threshold.

The second threshold is a threshold for identifying whether the mobile terminal has left the vehicle. Optionally, the second threshold is equal to the predetermined threshold in step 402, or the second threshold is slightly larger than the predetermined threshold in step 402.

As a possible implementation manner, the vehicle-mounted multimedia device may detect, at predetermined time intervals, whether a difference between the reception time of the last wireless broadcast message in each continuous wireless broadcast message sequence and the current time is greater than a second threshold.

As another possible implementation manner, the vehicle-mounted multimedia device sets a timer for each mobile terminal, the duration of the timer is a second threshold, and the timer is reset each time a new wireless broadcast message of the mobile terminal is received; and generating an interrupt signal when the timer is overtime, and considering that the difference value between the receiving time of the last wireless broadcast message and the current time is greater than a second threshold value.

When the difference is greater than the second threshold, go to step 405;

when the difference is less than or equal to the second threshold, step 406 is entered.

And 405, if the time length is greater than the second threshold value, resetting the appeared time length of the mobile terminal.

For each mobile terminal, if the difference value between the receiving time of the last wireless broadcast message in the latest group of continuous wireless broadcast message sequences and the current time is larger than a second threshold value, the vehicle-mounted multimedia device judges that the mobile terminal is far away from the vehicle. At this time, the vehicle-mounted multimedia device resets the appeared time length of the mobile terminal. The reset mode can be set to 0; or the corresponding storage space can be directly released.

Referring to fig. 4B, if the difference between the latest wireless broadcast message C4 corresponding to the terminal identifier C and the current time exceeds the second threshold, it is determined that the mobile terminal C has got off the vehicle, or the mobile terminal C is a terminal used by a passerby that accidentally passes through, and the vehicle-mounted multimedia device sets the appearing duration of the mobile terminal C to 0.

And step 406, if the time length is less than or equal to the second threshold, continuing to store the appeared time length of the mobile terminal.

Referring to fig. 4B, if the difference between the current time and the latest one of the wireless broadcast messages corresponding to the terminal identifier a, the terminal identifier B, and the terminal identifier D does not exceed the first threshold, it is determined that the mobile terminal a, the mobile terminal B, and the mobile terminal D are terminals located on the transportation means, and the vehicle-mounted multimedia device continues to store the appeared durations of the main mobile terminal a, the mobile terminal B, and the mobile terminal D.

Step 407, for each mobile terminal, detecting whether the counted appearing duration of the mobile terminal is greater than a first threshold.

Entering step 408 when the present time of the mobile terminal does not exceed the first threshold;

entering step 409 when the appearing duration of the mobile terminal exceeds a first threshold;

and step 408, counting the mobile terminal temporarily when the appeared time length of the mobile terminal does not exceed the first threshold.

Step 409, if the number of the historical occurrence times of the mobile terminal is larger than the first threshold, adding one to the number of the historical occurrence times of the mobile terminal to obtain the number of the occurrence times of the mobile terminal; the initial value of the history occurrence number is X.

The historical occurrence number is the sum of the number of times the mobile terminal has been present on the vehicle, which was previously stored by the in-vehicle multimedia device.

The initial value of the history occurrence number is X. Optionally, X ═ 0. For example, for mobile terminal a, if the historical occurrence number is 7, the occurrence number of the master mobile terminal a is 8; for the mobile terminal B, if the historical occurrence frequency is 1, the occurrence frequency of the mobile terminal B is 2; for mobile terminal D, the historical number of occurrences is 24, and the number of occurrences of mobile terminal D is 25.

Table 1 shows the historical number of occurrences, the last occurrence time, and the frequency of occurrence for each mobile terminal.

	Main mobile terminal A	Mobile terminal B	Mobile terminal D
				Number of historical occurrences	7	1	24
Number of times of occurrence	8	2	25
				Time of last occurrence	2016 (8 months) and 13 days	2016 (7 months) and 28 days	2016 (8 months) and 13 days
Frequency of occurrence	2 times per two weeks	1 time/every two weeks	5 times per two weeks

TABLE 1

And step 410, calculating the intimacy degree with the main mobile terminal according to the appearing times of the mobile terminal.

Affinity is a mapping of the relationship of the master mobile terminal to other mobile terminals. The intimacy is related to the occurrence frequency of the mobile terminal and has a positive correlation relationship, namely, the higher the occurrence frequency of the mobile terminal is, the greater the intimacy is; the lower the number of times the mobile terminal has appeared, the smaller the intimacy.

The step of calculating the intimacy degree between the mobile terminal and the main mobile terminal according to the appeared times of the mobile terminal at least comprises one of the following modes:

optionally, the number of times the mobile terminal has appeared is determined as the intimacy between the mobile terminal and the main mobile terminal.

For example, for mobile terminal a, the number of times mobile terminal a has appeared is 8, and the intimacy with the main mobile terminal is 8; for the mobile terminal B, the number of times that the mobile terminal B has appeared is 2, and the intimacy with the main mobile terminal is 2; for mobile terminal D, the number of times mobile terminal D has appeared is 25, and the intimacy with the main mobile terminal is 25.

Optionally, the intimacy degree between the mobile terminal and the main mobile terminal is calculated according to the appeared times of the mobile terminals as

W＝k1*x+k2*y+k3*z

Wherein x is the number of occurrences, and k1 is the weight of the number of occurrences; the more the occurrence times are, the higher the intimacy is, and the weight of the occurrence times is positive; y is the number of days from the last appearance time to the current time, and k2 is the weight of the number of days from the last appearance time to the current time; the smaller the days of the last appearance time from the current time is, the higher the intimacy is, and the weight of the days of the last appearance time from the current time is negative; z is the frequency of occurrence, k3 is the weight of the frequency of occurrence; the higher the frequency of occurrence and the higher the intimacy, the positive the weight of the frequency of occurrence.

For example, the weight for determining the number of occurrences is 3, the weight for determining the number of days from the last occurrence time to the current time is-1, and the weight for determining the frequency of occurrence is 1. For the mobile terminal A, the number of times of occurrence of the mobile terminal B is 8, the last occurrence time is 2016, 8 and 13 months, the number of days from the current time is 2 days, the occurrence frequency is 2 times/every two weeks, and the intimacy is 24; for the mobile terminal B, the number of times of occurrence of the mobile terminal B is 2, the last occurrence time is 2016, 7, month and 28 days, the number of days from the current time is 18 days, the occurrence frequency is 1 time/every two weeks, and the intimacy is-11; for the mobile terminal D, the number of occurrences of the mobile terminal D is 25, the last occurrence time is 2016, 8, month and 13 days, the number of days from the current time is 2 days, the occurrence frequency is 5 times/every two weeks, and the intimacy is 78.

Optionally, the affinity is determined as a ratio of the number of times the mobile terminal has appeared to the number of times the master mobile terminal has appeared.

For example, the number of occurrences of the main mobile terminal is set to be 46, for the mobile terminal a, the number of occurrences of the main mobile terminal a is 8, and the intimacy with the main mobile terminal is 17.4%; for mobile terminal B, the number of times that mobile terminal B has appeared is 2, and the intimacy with the main mobile terminal is 5.6%; for mobile terminal D, the number of times mobile terminal D has appeared is 25, and the intimacy with the main mobile terminal is 69.4%.

Step 411, determining whether to start a voice playing function according to the intimacy, wherein the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing mode.

Determining whether to enable the voice playing function according to the intimacy degree at least comprises one of the following modes:

optionally, when the intimacy degree is greater than the intimacy degree threshold value, starting a voice playing function;

for example, for the mobile terminal a, in the above three possible ways of calculating the intimacy degree with the main mobile terminal according to the number of times that the mobile terminal has appeared, when the intimacy degree is 8, the voice playing function is not enabled; when the intimacy is 24, the voice playing function is not started; when the intimacy degree is 17.4%, the voice playing function is not started. For the mobile terminal B, in the three feasible ways of calculating the intimacy degree with the main mobile terminal according to the appearing times of the mobile terminal, when the intimacy degree is 2, the voice playing function is not started; when the intimacy is-11, the voice playing function is not started; when the intimacy degree is 5.6%, the voice playing function is not started. For the mobile terminal D, in the three feasible ways of calculating the intimacy degree with the main mobile terminal according to the appearing times of the mobile terminal, when the intimacy degree is 25, starting the voice playing function; when the intimacy is 78, starting a voice playing function; and when the intimacy degree is 69.4%, the voice playing function is started.

Optionally, when the intimacy degree is greater than the intimacy degree threshold value and the message is a message of a preset application program, enabling a voice playing function;

for example, the preset program is determined to be Facebook. For the mobile terminal D, in the above three possible ways of calculating the intimacy degree with the main mobile terminal according to the number of times that the mobile terminal has appeared, when the intimacy degree is 25, and the message is a message from Facebook, the voice playing function is enabled; when the intimacy is 78 and the message is from Facebook, starting a voice playing function; when the intimacy degree is 69.4%, and the message is a message from Facebook, the voice play function is enabled. On the other hand, in the three possible ways of calculating the intimacy degree with the main mobile terminal according to the appeared times of the mobile terminal, when the intimacy degree is 25 and the message is a message from other application programs, the voice playing function is not started; when the intimacy degree is 78 and the message is from other application programs, the voice playing function is not enabled; when the intimacy degree is 69.4%, and the message is from other application programs, the voice playing function is not enabled.

Optionally, when the intimacy degree is greater than the intimacy degree threshold value and the message is a message corresponding to a preset contact, starting a voice playing function;

for example, the preset contact is determined to be X. In the three possible ways of calculating the intimacy degree with the main mobile terminal according to the appearing times of the mobile terminal, when the intimacy degree is 25 and the message is from X, the voice playing function is started; when the intimacy degree is 78 and the message is from X, the voice playing function is started; when the intimacy degree is 69.4%, and the message is a message from X, the voice play function is enabled. On the other hand, in the three possible ways of calculating the intimacy degree with the main mobile terminal according to the appeared times of the mobile terminals, when the intimacy degree is 25 and the message is from other contacts, the voice playing function is not started; when the intimacy degree is 78 and the message is from other contacts, the voice playing function is not started; when the intimacy is 69.4%, and the message is a message from other contacts, the voice play function is not enabled.

Optionally, when the intimacy degree is smaller than the intimacy degree threshold value, unprocessed reminding information corresponding to the message is generated.

For example, referring to fig. 4C, for the mobile terminal B, in the above three possible ways of calculating the intimacy degree with the main mobile terminal according to the number of times that the mobile terminal has appeared, when the intimacy degree is 2, unprocessed reminder information corresponding to the message is generated; when the intimacy is-11, generating unprocessed reminding information corresponding to the message; and when the intimacy is 5.6%, generating unprocessed reminding information corresponding to the message.

It should be noted that the first threshold, the second threshold and the affinity threshold may be customized by a user.

It should be noted that the preset application or the preset contact may be customized by a user.

The embodiment also detects whether the difference value between the receiving time of the last wireless broadcast message in the continuous wireless broadcast message sequence and the current time is greater than the second threshold, and if the difference value is greater than the second threshold, resets the occurred time of the mobile terminal, so that the problem of how to process the occurred time of each passenger when other passengers get off is solved, and the effect that the occurred time of each passenger can be accurately positioned, so that the number of times of occurrence of the passenger is accurately determined is achieved.

In alternative embodiments based on fig. 4, there are other possible implementations of step 411. For example, the play mode in the voice play function is determined to be enabled according to the intimacy, the voice play function includes at least two play modes, and different play modes are used for playing different contents of the message. At this time, step 411 may alternatively be implemented as step 411a to step 411h, as shown in fig. 5:

in step 411a, it is detected whether the intimacy degree is greater than the intimacy degree threshold value.

After receiving the message sent by the main mobile terminal, the vehicle-mounted multimedia detects the intimacy between the mobile terminal corresponding to the currently detected mobile terminal identification and the main mobile terminal.

If the intimacy degree is smaller than the intimacy degree threshold value, entering a step 411 b;

if the intimacy degree is greater than the intimacy degree threshold value, the procedure goes to step 411 c.

In step 411b, if the intimacy degree is smaller than the intimacy degree threshold value, the first playing mode in the voice playing function is started.

And when the intimacy degree is smaller than the intimacy degree threshold value, enabling a first play mode in the voice play function, wherein the first play mode is a mode for playing the message type of the message. At this time, the in-vehicle multimedia device plays only the message type of the message in voice.

Referring to fig. 5b, a schematic diagram of enabling the first play mode in the voice play function is shown. And the vehicle-mounted multimedia detects that the intimacy between the mobile terminals A and B and the main mobile terminal is less than the intimacy threshold value. Therefore, for the mobile terminal a or B, when the vehicle-mounted multimedia device receives the message sent by the main mobile terminal, only "you have a new QQ message" is played.

Step 411c, if the intimacy degree is greater than the intimacy degree threshold value, the second playing mode in the voice playing function is started

The second play mode is a mode in which the message type and the opposite-end contact name of the message are played. And when the intimacy degree is greater than the intimacy degree threshold value, enabling a second play mode in the voice play function, wherein the second play mode is a mode for playing the message type of the message and the name of the opposite-end contact person. At the moment, the vehicle-mounted multimedia equipment plays the message type of the message and the name of the opposite-end contact person in a voice mode.

Referring to fig. 5c, a schematic diagram of enabling the second play mode in the voice play function is shown. And the vehicle-mounted multimedia detects that the intimacy between the mobile terminal D and the main mobile terminal is greater than the intimacy threshold. Therefore, for the mobile terminal D, when the in-vehicle multimedia receives the message sent by the main mobile terminal, only playing "wang XX sends a new QQ message".

Step 411d, receiving a voice control command.

If the user corresponding to the main mobile terminal desires to play the message text in the vehicle-mounted multimedia, the voice control instruction needs to be sent to the vehicle-mounted multimedia.

The voice control instruction is used for indicating the vehicle-mounted multimedia to enable a third play mode, and the third play mode is a mode of playing the opposite-end contact name and the message text of the message. The voice control instruction comprises a preset keyword, and when the vehicle-mounted multimedia receives the voice control instruction comprising the preset keyword, the third play mode is started. In an optional embodiment, after the vehicle-mounted multimedia acquires the voice control instruction containing the preset keyword, whether the voiceprint feature of the voice control instruction is matched with the preset voiceprint feature is detected, and when the voiceprint feature of the voice control instruction is matched with the preset voiceprint feature, the vehicle-mounted multimedia enables the third play mode. The preset voiceprint feature is a voiceprint feature of a user of the master mobile terminal.

For example, the user corresponding to the main mobile terminal speaks a voice control instruction of "play message".

Step 411e, according to the voice control instruction, enabling the third play mode in the voice play function to the message.

And when receiving the voice control instruction, the vehicle-mounted multimedia equipment plays the opposite-end contact name and the message text of the message in a voice mode.

Referring to fig. 5d, a schematic diagram of enabling the third play mode in the voice play function for the message is shown. For the mobile terminal D, when the vehicle-mounted multimedia equipment receives a voice control command of 'play' spoken by a user corresponding to the main mobile terminal, the message sent by 'Wang XX' is played: eating together at night! ".

In step 411f, the enabling condition of the third play mode is recorded.

The enabling conditions include: at least one of a terminal identification of the main mobile terminal, a terminal identification of the mobile terminal, and an opposite-end contact name.

And the vehicle-mounted multimedia records the enabling condition of the third play mode after enabling the third play mode in the voice play function to the message according to the voice control instruction.

For example, the enabling condition is "terminal identification of the master mobile terminal: Z; the terminal identification of the mobile terminal is D; opposite terminal contact name: king XX. "

Step 411g, upon receiving another message, detects whether the enabling condition is met.

And after receiving another message, the vehicle-mounted multimedia detects whether the enabling condition is met.

If the starting condition is met, the vehicle-mounted multimedia starts a third play mode for the other message; if the enabling condition is not satisfied, go to step 411 a.

In step 411h, if the enabling condition is satisfied, the third play mode is enabled for another message.

And if the enabling condition is met, the user corresponding to the main mobile terminal is considered to want to play the opposite-end contact name and the message text of the message under the condition, and at the moment, the vehicle-mounted multimedia enables a third playing mode for another message.

It should be noted that, the preset keywords of the affinity threshold may be customized by the user.

The embodiment also solves the problem that the voice control instruction needs to be repeatedly input under the same condition of starting the third play mode by recording the starting condition of the third play mode, and achieves the effect that the third play mode can be started without inputting the voice control instruction as long as the starting condition of the third play mode is met.

The following are embodiments of the apparatus of the embodiments of the present invention, and for details not described in detail therein, reference may be made to the above-described one-to-one corresponding method embodiments.

Referring to fig. 6, a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to an embodiment of the present invention is shown. The voice control device based on the vehicle-mounted multimedia equipment can be realized to be all or part of the vehicle-mounted multimedia equipment through software, hardware or the combination of the software and the hardware, and the device comprises: a message receiving module 620, an affinity calculating module 640 and a voice playing module 660.

A message receiving module 620, configured to receive a wireless broadcast message sent by at least one mobile terminal, where the wireless broadcast message carries a terminal identifier of the mobile terminal;

the intimacy calculating module 640 is used for calculating intimacy between each mobile terminal and a main mobile terminal according to the wireless broadcast message, wherein the main mobile terminal is a mobile terminal which establishes communication connection with the vehicle-mounted multimedia equipment;

the voice playing module 660 is configured to determine whether to enable a voice playing function according to the intimacy, where the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing form.

Referring to fig. 7, a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention is shown. The voice control device based on the vehicle-mounted multimedia equipment can be realized to be all or part of the vehicle-mounted multimedia equipment through software, hardware or the combination of the software and the hardware, and the device comprises: message receiving module 720, intimacy degree calculating module 740 and voice playing module 760

A message receiving module 720, configured to receive a wireless broadcast message sent by at least one mobile terminal, where the wireless broadcast message carries a terminal identifier of the mobile terminal;

and the affinity calculating module 740 is configured to calculate affinity between each mobile terminal and a main mobile terminal according to the wireless broadcast packet, where the main mobile terminal is a mobile terminal that establishes a communication connection with the vehicle-mounted multimedia device.

Optionally, the intimacy degree calculation module 740 includes: a duration statistic unit 742, a frequency statistic unit 744, and an affinity calculation unit 747. Wherein:

a duration counting unit 742, configured to count an occurred duration of each mobile terminal according to the received wireless broadcast packet;

the number-of-times counting unit 744 is configured to, for each mobile terminal, count the number of times of occurrence of the mobile terminal according to the counted length of occurrence of the mobile terminal.

Optionally, the number counting unit includes: a duration detection sub-unit 744a and a duration reset sub-unit 744 b. Wherein:

a duration detection subunit 744a, configured to detect, for each mobile terminal, whether the counted occurrence duration of the mobile terminal is greater than a first threshold;

the number-of-times counting subunit 744b is configured to, if the number of times is greater than the first threshold, add one to the historical number of times of occurrence of the mobile terminal to obtain the number of times of occurrence of the mobile terminal, where an initial value of the historical number of times of occurrence is X.

The intimacy degree calculating unit 746 is configured to calculate the intimacy degree with the main mobile terminal according to the appeared times of the mobile terminal, where the appeared times and the intimacy degree have a positive correlation.

The voice playing module 760 is configured to determine whether to enable a voice playing function according to the intimacy, where the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing manner.

Referring to fig. 8, a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention is shown. The voice control device based on the vehicle-mounted multimedia equipment can be realized to be all or part of the vehicle-mounted multimedia equipment through software, hardware or the combination of the software and the hardware, and the device comprises: a message receiving module 820, an affinity calculating module 840 and a voice playing module 860.

A message receiving module 820, configured to receive a radio broadcast message sent by at least one mobile terminal, where the radio broadcast message carries a terminal identifier of the mobile terminal.

The affinity calculating module 840 is configured to calculate affinity between each mobile terminal and a main mobile terminal according to the wireless broadcast packet, where the main mobile terminal is a mobile terminal that establishes a communication connection with the vehicle-mounted multimedia device.

Optionally, the intimacy degree calculation module 840 includes: a duration statistic unit 842, a frequency statistic unit 844 and an affinity calculating unit 846. Wherein:

a duration counting unit 842, configured to count an occurred duration of each mobile terminal according to the received wireless broadcast message;

optionally, the duration statistic unit 842 includes: a first determining subunit 842a, a second determining subunit 842b, a first detecting subunit 842c, and a duration resetting subunit 842 d. Wherein:

a first determining subunit 842a, configured to determine, for each terminal identifier, when two or more wireless broadcast messages carrying the terminal identifier exist, a latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier, where a reception time difference between an i-th wireless broadcast message and an i + 1-th wireless broadcast message in the continuous wireless broadcast message sequences is smaller than a preset threshold, and i is a positive integer;

the second determining subunit 842b is configured to determine, according to a difference between the receiving time of the last wireless broadcast packet in the continuous wireless broadcast packet sequence and the receiving time of the first wireless broadcast packet, the occurred duration of the mobile terminal.

A first detecting subunit 842c, configured to detect whether a difference between a receiving time of a last wireless broadcast packet in the continuous wireless broadcast packet sequence and a current time is greater than a second threshold;

a duration resetting subunit 842d, configured to reset the occurred duration of the mobile terminal if the duration is greater than the second threshold.

A number counting unit 844, configured to count, for each mobile terminal, the number of times that the mobile terminal has appeared according to the counted length of time that the mobile terminal has appeared.

Optionally, the count statistics unit 844 includes: a duration detection subunit 844a and a duration reset subunit 844 b. Wherein:

a duration detection subunit 844a, configured to detect, for each mobile terminal, whether a counted elapsed duration of the mobile terminal is greater than a first threshold;

the number-of-times counting subunit 844b is configured to, if the number of times of occurrence of the history of the mobile terminal is greater than the first threshold, add one to the number of times of occurrence of the history of the mobile terminal to obtain the number of times of occurrence of the history of the mobile terminal, where an initial value of the number of times of occurrence of the history is X.

The affinity calculating unit 846 is configured to calculate the affinity with the main mobile terminal according to the number of times that the mobile terminal has appeared, where the number of times that has appeared has a positive correlation with the affinity.

And a voice playing module 860, configured to determine whether to enable a voice playing function according to the intimacy, where the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing form.

Optionally, the voice playing module 860 includes: a first playing unit 862, a second playing unit 864, and a third playing unit 866. Wherein:

a first playing unit 862 for enabling a voice playing function when the intimacy degree is greater than the intimacy degree threshold;

or,

a second playing unit 864, configured to enable a voice playing function when the intimacy degree is greater than the intimacy degree threshold and the message is a message of a preset application;

or,

the third playing unit 866 is configured to enable the voice playing function when the affinity is greater than the affinity threshold and the message is a message corresponding to a preset contact.

Optionally, the voice playing module 860 further includes:

and the unread prompt unit 868 is used for generating unprocessed prompt information corresponding to the message when the intimacy degree is smaller than the intimacy degree threshold value.

Referring to fig. 9, a block diagram of a voice control apparatus based on a vehicle-mounted multimedia device according to another embodiment of the present invention is shown. The voice control device based on the vehicle-mounted multimedia equipment can be realized to be all or part of the vehicle-mounted multimedia equipment through software, hardware or the combination of the software and the hardware, and the device comprises: a message receiving module 920, an affinity calculating module 940, a voice playing module 960, an instruction receiving module 990, a third enabling module 900, a condition recording module 910 and a condition detecting module 930.

The message receiving module 920 is configured to receive a wireless broadcast message sent by at least one mobile terminal, where the wireless broadcast message carries a terminal identifier of the mobile terminal.

The affinity calculating module 940 is configured to calculate affinity between each mobile terminal and a main mobile terminal according to the wireless broadcast packet, where the main mobile terminal is a mobile terminal that establishes a communication connection with the vehicle-mounted multimedia device.

Optionally, the intimacy degree calculation module 940 includes: duration statistic unit 942, number statistic unit 944, and intimacy degree calculation unit 946. Wherein:

a duration counting unit 942, configured to count an occurred duration of each mobile terminal according to the received wireless broadcast packet.

Optionally, the duration statistic unit 942 includes: a first determining sub-unit 942a, a second determining sub-unit 942b, a first detecting sub-unit 942c, and a time length resetting sub-unit 942 d. Wherein:

a first determining subunit 942a, configured to determine, for each terminal identifier, when two or more wireless broadcast messages carrying the terminal identifier exist, a latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier, where a reception time difference between an i-th wireless broadcast message and an i + 1-th wireless broadcast message in the continuous wireless broadcast message sequences is smaller than a preset threshold, and i is a positive integer.

A second determining subunit 942b, configured to determine, according to a difference between the receiving time of the last wireless broadcast packet in the persistent wireless broadcast packet sequence and the receiving time of the first wireless broadcast packet, the appeared time length of the mobile terminal.

A first detecting sub-unit 942c, configured to detect whether a difference between a receiving time of a last wireless broadcast packet in the continuous wireless broadcast packet sequence and a current time is greater than a second threshold.

A duration resetting subunit 942d, configured to reset the appeared duration of the mobile terminal if the time duration is greater than the second threshold.

The number-of-times counting unit 944 is configured to count, for each mobile terminal, the number of times of occurrence of the mobile terminal according to the counted time length of occurrence of the mobile terminal.

Optionally, the time counting unit 944 includes: a duration detection subunit 944a and a duration reset subunit 944 b. Wherein:

a duration detection subunit 944a, configured to detect, for each mobile terminal, whether the counted occurrence duration of the mobile terminal is greater than a first threshold;

the number-of-times counting subunit 944b is configured to, if the number of times of occurrence of the mobile terminal is greater than the first threshold, add one to the historical number of times of occurrence of the mobile terminal to obtain the number of times of occurrence of the mobile terminal, where an initial value of the historical number of times of occurrence is X.

The intimacy degree calculation unit 946 is configured to calculate the intimacy degree with the main mobile terminal according to the number of times of occurrence of the mobile terminal, where the number of times of occurrence and the intimacy degree are in a positive correlation.

The voice playing module 960 is configured to determine whether to enable a voice playing function according to the intimacy, where the voice playing function is a function of playing a message sent by the main mobile terminal in a voice playing form.

Optionally, the voice playing module 960 includes: a first enabling unit 962 and a second enabling unit 964

A first enabling unit 962 configured to enable a first play mode in the voice play function when the intimacy degree is smaller than the intimacy degree threshold;

a second enabling unit 964, configured to enable a second play mode in the voice play function when the affinity is greater than the affinity threshold.

Optionally, the apparatus may further include: an instruction receiving module 990, a third enabling module 900, a condition recording module 910 and a condition detecting module 930.

The instruction receiving module 990 is configured to receive a voice control instruction.

The third enabling module 900 is configured to enable a third play mode in the voice play function for the message according to the voice control instruction.

The third play mode is a mode in which the opposite-end contact name of the message and the message body are played.

A condition recording module 910, configured to record enabling conditions of the third play mode, where the enabling conditions include: at least one of a terminal identification of the main mobile terminal, a terminal identification of the mobile terminal, and an opposite-end contact name.

A condition detecting module 930 configured to detect whether the enabling condition is satisfied when another message is received.

And if the enabling condition is met, enabling a third play mode for the other message.

Referring to fig. 10, a block diagram of a vehicle-mounted multimedia device according to an embodiment of the present invention is shown.

As shown in fig. 10, the multimedia device may include Radio Frequency (RF) circuitry 1001, memory 1002 including one or more computer-readable storage media, input unit 1003, display unit 1004, sensor 1005, audio circuitry 1006, Wireless Fidelity (WiFi) module 1007, processor 1008 including one or more processing cores, and power supply 1009. Those skilled in the art will appreciate that the configuration of the vehicle multimedia device shown in fig. 10 does not constitute a limitation of the vehicle multimedia device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components. Wherein:

the RF circuit 1001 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, receives downlink information from a base station and then sends the received downlink information to the one or more processors 1008 for processing; in addition, data relating to uplink is transmitted to the base station. In general, the RF circuit 1001 includes, but is not limited to, an antenna, at least one Amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 1001 may also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), and the like.

The memory 1002 may be used to store software programs and modules, and the processor 1008 executes various functional applications and data processing by operating the software programs and modules stored in the memory 1002. The memory 1002 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the in-vehicle multimedia device, and the like. Further, the memory 1002 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 1002 may also include a memory controller to provide the processor 1008 and the input unit 1003 with access to the memory 1002.

The input unit 1003 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in one particular embodiment, input unit 1003 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1008, and can receive and execute commands sent by the processor 1008. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 1003 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

The display unit 1004 may be used to display information input by or provided to the user as well as various graphical user interfaces of the in-vehicle multimedia device, which may be made up of graphics, text, icons, video, and any combination thereof. The Display unit 1004 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the processor 1008 to determine the type of touch event, and the processor 1008 then provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 10 the touch sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch sensitive surface may be integrated with the display panel to implement input and output functions.

The in-vehicle multimedia device may also include at least one sensor 1005, such as a light sensor, a motion sensor, a positioning sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the in-vehicle multimedia device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; the positioning sensor can obtain the real-time geographic position of the vehicle-mounted multimedia equipment according to the GPS positioning. As for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured for the vehicle-mounted multimedia device, further description is omitted here.

Audio circuitry 1006, speakers, and microphones may provide an audio interface between the user and the multimedia device in the vehicle. The audio circuit 1006 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1006 and converted into audio data, which is processed by the audio data output processor 1008, and then transmitted to, for example, another vehicle multimedia device via the RF circuit 1001, or the audio message is output to the memory 1002 for further processing. The audio circuitry 1006 may also include an earbud jack to provide communication of a peripheral headset with the vehicle multimedia device.

WiFi belongs to short-distance wireless transmission technology, and the vehicle-mounted multimedia equipment can help a user to send and receive e-mails, browse webpages, access streaming media and the like through the WiFi module 1007, and provides wireless broadband internet access for the user. Although fig. 10 shows the WiFi module 1007, it is understood that it does not belong to the essential constitution of the car-mounted multimedia device, and can be omitted entirely as needed within the scope not changing the essence of the invention.

The processor 1008 is a control center of the in-vehicle multimedia device, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions of the in-vehicle multimedia device and processes data by operating or executing software programs and/or modules stored in the memory 1002 and calling data stored in the memory 1002, thereby integrally monitoring the mobile phone. Optionally, processor 1008 may include one or more processing cores; preferably, the processor 1008 may integrate an application processor, which handles primarily the operating system, user interface, applications, etc., and a modem processor, which handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 1008.

The multimedia device also includes a power source 1009 (e.g., a battery) for providing power to various components, and preferably, the power source may be logically connected to the processor 1008 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 1009 may also include any component such as one or more dc or ac power supplies, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown, the vehicle-mounted multimedia device may further include a camera, a bluetooth module, and the like, which are not described herein again. Specifically, in this embodiment, the processor 1008 in the vehicle-mounted multimedia device executes one or more program instructions stored in the memory 1002, so as to implement the voice control method based on the vehicle-mounted multimedia device provided in the above-mentioned method embodiments.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

It will be understood by those skilled in the art that all or part of the steps of implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The present invention is not limited to the above preferred embodiments, and any modifications, equivalent replacements, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A voice control method based on vehicle-mounted multimedia equipment is characterized by comprising the following steps:

2. The method according to claim 1, wherein the counting the occurrence duration of each mobile terminal according to the received wireless broadcast message comprises:

for each terminal identifier, when two or more than two wireless broadcast messages carrying the terminal identifier exist, determining a latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier, wherein the receiving time difference between the ith wireless broadcast message and the (i + 1) th wireless broadcast message in the continuous wireless broadcast message sequences is smaller than a preset threshold value, and i is a positive integer;

3. The method according to claim 1, wherein for each of the mobile terminals, counting the number of times that the mobile terminal has appeared according to the counted length of time that the mobile terminal has appeared includes:

for each mobile terminal, detecting whether the counted appearing time length of the mobile terminal is greater than a first threshold value;

and if the number of the historical occurrences of the mobile terminal is greater than the first threshold, adding one to the number of the historical occurrences of the mobile terminal to obtain the number of the occurrences of the mobile terminal, wherein the initial value of the historical occurrences is X.

4. The method of claim 2, wherein after determining the time period of the mobile terminal having occurred based on the difference between the time of receipt of the last radio broadcast packet and the time of receipt of the first radio broadcast packet in the sequence of persistent radio broadcast packets, further comprising:

detecting whether the difference value between the receiving time of the last wireless broadcast message in the continuous wireless broadcast message sequence and the current time is greater than a second threshold value;

and if the current time length is greater than the second threshold value, resetting the appeared time length of the mobile terminal.

5. The method according to any one of claims 1 to 4, wherein the determining whether to enable a voice playing function according to the affinity comprises:

enabling the voice playing function when the intimacy degree is larger than an intimacy degree threshold value;

or,

enabling the voice playing function when the intimacy degree is larger than the intimacy degree threshold value and the message is a message of a preset application program;

or,

and when the intimacy degree is greater than the intimacy degree threshold value and the message is a message corresponding to a preset contact person, enabling the voice playing function.

6. The method according to any one of claims 1 to 4, wherein the determining whether to enable a voice playing function according to the affinity comprises:

determining to enable a playing mode in the voice playing function according to the intimacy degree, wherein the voice playing function comprises at least two playing modes, and different playing modes are used for playing different contents of the message;

wherein the content includes: at least one of a message type of the message, a correspondent contact name of the message, and a message body of the message.

7. The method of claim 6, wherein the determining to enable a play mode in the voice play function according to the affinity comprises:

enabling a first play mode in the voice play function when the intimacy degree is smaller than the intimacy degree threshold value;

enabling a second play mode in the voice play function when the intimacy degree is greater than the intimacy degree threshold value;

the first play mode is a mode of playing a message type of the message; the second play mode is a mode of playing a message type and an opposite-end contact name of the message.

8. The method of claim 7, further comprising:

receiving a voice control instruction;

enabling a third play mode in the voice play function to the message according to the voice control instruction;

the third playing mode is a mode for playing the opposite-end contact name and the message text of the message.

9. The method of claim 8, further comprising:

recording enabling conditions of the third play mode, wherein the enabling conditions comprise: at least one of a terminal identifier of the main mobile terminal, a terminal identifier of the mobile terminal, and a name of the opposite-end contact person;

upon receiving another message, detecting whether the enabling condition is met;

and if the enabling condition is met, enabling the third play mode for the other message.

10. A voice control device based on vehicle-mounted multimedia equipment is characterized by comprising:

11. The apparatus of claim 10, wherein the duration statistic unit comprises:

a first determining subunit, configured to determine, for each terminal identifier, when two or more wireless broadcast messages carrying the terminal identifier exist, a latest group of continuous wireless broadcast message sequences corresponding to the terminal identifier, where a reception time difference between an i-th wireless broadcast message and an i + 1-th wireless broadcast message in the continuous wireless broadcast message sequences is smaller than a preset threshold, and i is a positive integer;

and the second determining subunit is configured to determine, according to a difference between the receiving time of the last wireless broadcast packet in the continuous wireless broadcast packet sequence and the receiving time of the first wireless broadcast packet, the occurred duration of the mobile terminal.

12. The apparatus of claim 10, wherein the count unit comprises:

a duration detection subunit, configured to detect, for each mobile terminal, whether the counted occurrence duration of the mobile terminal is greater than a first threshold;

and the frequency counting subunit is used for adding one to the historical occurrence frequency of the mobile terminal to obtain the occurrence frequency of the mobile terminal if the frequency is greater than the first threshold, wherein the initial value of the historical occurrence frequency is X.

13. The apparatus of claim 11, wherein the duration statistic unit further comprises:

a first detecting subunit, configured to detect whether a difference between a receiving time of a last wireless broadcast packet in the continuous wireless broadcast packet sequence and a current time is greater than a second threshold;

and the time length resetting subunit is used for resetting the appeared time length of the mobile terminal if the time length is greater than the second threshold value.

14. The apparatus according to any one of claims 10 to 13, wherein the voice playing module comprises:

the first playing unit is used for starting the voice playing function when the intimacy degree is greater than an intimacy degree threshold value;

or,

a second playing unit, configured to enable the voice playing function when the affinity is greater than the affinity threshold and the message is a message of a preset application program;

or,

and the third playing unit is used for enabling the voice playing function when the intimacy degree is greater than the intimacy degree threshold value and the message is a message corresponding to a preset contact.

15. The apparatus according to any one of claims 10 to 13, wherein the voice playing module is specifically configured to determine to enable a playing mode of the voice playing function according to the affinity, the voice playing function includes at least two playing modes, and different playing modes are used for playing different contents of the message;

16. The apparatus of claim 15, wherein the voice playing module comprises:

a first enabling unit, configured to enable a first play mode in the voice play function when the affinity is smaller than the affinity threshold;

a second enabling unit, configured to enable a second play mode in the voice play function when the affinity is greater than the affinity threshold;

17. The apparatus of claim 16, further comprising:

the instruction receiving module is used for receiving a voice control instruction;

a third enabling module, configured to enable a third play mode in the voice play function for the message according to the voice control instruction;

18. The apparatus of claim 17, further comprising:

a condition recording module, configured to record enabling conditions of the third play mode, where the enabling conditions include: at least one of a terminal identifier of the main mobile terminal, a terminal identifier of the mobile terminal, and a name of the opposite-end contact person;

the condition detection module is used for detecting whether the starting condition is met or not when another message is received;

19. A voice control system based on vehicle-mounted multimedia equipment is characterized by comprising: the system comprises vehicle-mounted multimedia equipment and a main mobile terminal; the vehicle-mounted multimedia equipment and the main mobile terminal establish communication connection;

the vehicle-mounted multimedia equipment comprises the voice control device based on the vehicle-mounted multimedia equipment according to any one of claims 10 to 18.

20. An in-vehicle multimedia device, comprising a processor and a memory, wherein at least one instruction, at least one program, set of codes, or set of instructions is stored in the memory, and wherein the at least one instruction, the at least one program, the set of codes, or the set of instructions is loaded and executed by the processor to implement the method according to any one of claims 1 to 9.

21. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium for implementing the method according to any one of claims 1 to 9.