CN116017029A - A video playing method, device and vehicle - Google Patents

Abstract

The present invention provides a video playback method, device, and vehicle, the method comprising: responding to an AR viewing start command, collecting environmental data in the vehicle, and determining the currently selected first audio and video; acquiring the second audio and video; wherein , the second audio and video is obtained by synthesizing the in-vehicle environment data and the first audio and video by the vehicle or the cloud; sending the second audio and video to AR glasses for playback, and/or, The second audio and video is sent to the display terminal of the vehicle for playback; the present invention provides live effects for users to watch performances by synthesizing images and sounds of the environment inside the car into the live video.

Description

A video playing method, device and vehicle

technical field

The invention relates to the technical field of vehicles, in particular to a video playing method, device and vehicle.

Background technique

At present, users begin to pay attention to the entertainment of vehicles. Therefore, current vehicles are usually equipped with AR devices to realize activities such as movie viewing, games, and conferences. However, it is difficult to provide users with live singing and live performances through current AR devices. Live effects and feel.

Contents of the invention

In view of this, the present invention aims to propose a video playback method, device, and vehicle to solve the problem that the on-site effect and feeling of watching live performances using vehicle-mounted AR are not strong and affect user experience.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

A video playback method applied to a vehicle, comprising:

Responding to the opening command of AR viewing, collecting environmental data in the car, and determining the currently selected first audio and video;

Acquiring a second audio and video; wherein, the second audio and video is obtained by synthesizing the in-vehicle environment data and the first audio and video by the vehicle or the cloud;

Sending the second audio and video to the AR glasses for playback, and/or sending the second audio and video to the display terminal of the vehicle for playback.

Further, the synthesizing the in-vehicle environment data with the first audio and video includes:

According to the time sequence of audio and video collection, data extraction is performed on the first audio and video to obtain multi-frame audio and video data carrying a first time stamp;

According to the chronological sequence of data collection, data extraction is performed on the in-vehicle environment data to obtain user data carrying a second time stamp;

Based on the first timestamp and the second timestamp, multiple frames of the audio and video data and the user data are synthesized to obtain the second audio and video; wherein, all the audio and video in the second audio and video The audio and video data is time-aligned with the user data.

Further, before synthesizing multiple frames of the audio and video data and the user data based on the first time stamp and the second time stamp, and obtaining the second audio and video, the method further includes :

performing tagging processing on the user data, and screening out target user data having characteristics of the target user;

The synthesizing multiple frames of the audio and video data and the user data based on the first timestamp and the second timestamp to obtain the second audio and video includes:

Based on the first time stamp and the second time stamp, multiple frames of the audio and video data and the target user data are synthesized to obtain the second audio and video.

Further, the method also includes:

When playing the second audio and video, the sound of the vehicle is adjusted to be on, and the ambient light of the vehicle is adjusted to be in a rhythmic state, so as to simulate the atmosphere of the scene.

Further, in the case where the first audio and video are synthesized by the cloud, the method further includes:

In response to the opening command of the AR viewing, the in-car environment data is sent to the cloud through the AR glasses, and the identification of the first audio and video data is indicated to the cloud, so that the cloud is based on The identifier acquires the first audio and video.

Compared with the prior art, the video playback method of the present invention has the following advantages:

The present invention collects in-vehicle environmental data in response to the AR viewing start command, and determines the currently selected first audio and video; acquires the second audio and video; wherein, the second audio and video is provided by the vehicle or the cloud, It is obtained by synthesizing the in-vehicle environment data and the first audio and video; sending the second audio and video to AR glasses for playback, and/or sending the second audio and video to the display terminal of the vehicle Play; thus, the present invention superimposes the sound and images in the car on the video of the live meeting by synthesizing the environmental data in the car and the video data of the live meeting, so as to create an effect like watching live for the user, and because the user The sound and movement of the car can also be superimposed on the video of the live meeting. While creating the effect of live viewing, it can also combine the user's interaction in the car with the live video to achieve a personalized interactive experience for users.

Another purpose of the present invention is to propose a video playback method to solve the problem that the on-site effect and feeling of watching live performances using vehicle-mounted AR are not strong and affect user experience.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

A method for playing video, applied to the cloud, comprising:

Receiving in-vehicle environment data and the identification of the first audio and video; wherein, the in-vehicle environment data is sent by the vehicle in response to an AR viewing start instruction;

Acquiring the first audio and video based on the identifier;

Synthesizing the in-vehicle environment data and the first audio and video to obtain a second audio and video;

Send the second audio and video to the vehicle, and/or send it to AR glasses for playback.

Further, said receiving the in-vehicle environment data and the identification of the first audio and video includes:

receiving the in-vehicle environment data sent by the vehicle through the AR glasses and the identification of the first audio and video;

The acquiring the first audio and video based on the identification includes:

According to the identifier of the first audio and video, the first audio and video is acquired from a database in the cloud.

The video playing method has the same advantages as the above-mentioned video playing method over the prior art, and details are not repeated here.

Another object of the present invention is to propose a device to solve the problem that the on-site effect and feeling of watching live performances using vehicle-mounted AR are not strong, which affects user experience.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

A video playing device, applied to a vehicle, comprising:

The collection module is used to collect environmental data in the car in response to the opening command of AR viewing, and determine the first audio and video currently selected;

An acquisition module, configured to acquire a second audio and video; wherein, the second audio and video is obtained by synthesizing the in-vehicle environment data and the first audio and video by the vehicle or the cloud;

The sending module is configured to send the second audio and video to the AR glasses for playback, and/or send the second audio and video to the display terminal of the vehicle for playback.

The advantages of the device and the method above are the same as those of the prior art, and will not be repeated here.

Another object of the present invention is to propose a device to solve the problem that the on-site effect and feeling of watching live performances using vehicle-mounted AR are not strong, which affects user experience.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

A video playback device, applied to the cloud, comprising:

A receiving module, configured to receive in-vehicle environment data and the identification of the first audio and video; wherein, the in-vehicle environment data is sent by the vehicle in response to the opening instruction of AR viewing;

An acquisition module, configured to acquire the first audio and video based on the identification;

A synthesis module, configured to synthesize the in-vehicle environment data and the first audio and video to obtain a second audio and video;

A sending module, configured to send the second audio and video to the vehicle, and/or send it to AR glasses for playback.

The advantages of the device and the above-mentioned method over the prior art are the same, and will not be repeated here.

Another object of the present invention is to propose a vehicle to solve the problem that the on-site effect and feeling of watching live performances using vehicle-mounted AR are not strong and affect user experience.

In order to achieve the above object, technical solution of the present invention is achieved in that way:

A vehicle, comprising: a video playing unit, the video playing unit is used to execute the above video playing method.

The advantages of the vehicle and the above-mentioned video playing method over the prior art are the same, and will not be repeated here.

Description of drawings

The drawings constituting a part of the present invention are used to provide a further understanding of the present invention, and the schematic embodiments and descriptions of the present invention are used to explain the present invention, and do not constitute an improper limitation of the present invention. In the attached picture:

FIG. 1 shows a schematic diagram of an implementation environment of a video playback method provided by Embodiment 1 of the present invention;

FIG. 2 shows a flow chart of the steps of a video playback method provided by Embodiment 1 of the present invention;

Fig. 3 shows a flow chart of the steps of a video playing method provided by another embodiment of the present invention;

FIG. 4 shows a flow chart of steps of a video playing method provided in Embodiment 2 of the present invention;

FIG. 5 shows a schematic structural diagram of a video playback device provided by Embodiment 3 of the present invention;

FIG. 6 shows a schematic structural diagram of a video playback device provided by Embodiment 4 of the present invention.

Detailed ways

It should be noted that, in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

A video playing method, device and vehicle of the present invention will be described in detail below with reference to the accompanying drawings and embodiments.

Embodiment one

An embodiment of the present application provides a video playing method. Please refer to FIG. 1 , which shows a schematic diagram of an implementation environment of the video playing method provided in the embodiment of the present application. The implementation environment may include: vehicles, AR glasses, and the cloud.

The on-board controller of the vehicle is connected to the AR glasses for data transmission. For example, when the user selects the corresponding video to play, the video data can be sent to the AR glasses through the on-board controller for playback by the AR glasses. The car-machine controller and AR glasses can be wired or wirelessly connected. In the case of a wired connection between the car-machine controller and the AR glasses, the data cable connected to the AR glasses is connected to the interface of the car-machine controller so that the car In the case of a wireless connection between the car controller and the AR glasses, the Bluetooth and WIFI of the car body are turned on. After the AR glasses are turned on, they will be actively paired through Bluetooth/WIFI and connected to the car controller. ; In some embodiments, when the AR glasses and the Bluetooth/WIFI of the vehicle body are paired for the first time or the AR glasses and the Bluetooth of the vehicle body are not matched, the pairing can be performed actively by the user.

The AR glasses are connected to the cloud. The cloud is used to connect to the external network to obtain video data. The cloud also has data processing functions to process the video and then send it to the AR glasses for playback.

Referring to FIG. 2, FIG. 2 shows a flow chart of the steps of a video playback method provided by an embodiment of the present invention. As shown in FIG. 2, the video playback method of the embodiment of the present invention is applied to a vehicle, and the method includes:

S101. In response to an AR viewing start instruction, collect in-vehicle environment data, and determine the currently selected first audio and video.

In the embodiment of the present invention, a button or control can be configured on the display end of the vehicle to indicate that the user intends to enable AR viewing. For example, on the map navigation interface of the vehicle, when the user selects a video, the user can choose whether to enable AR viewing , when the user clicks the "AR viewing" button or control, it means that the user indicates to view through AR, thereby collecting the environmental data inside the vehicle based on the user's instruction. For example, the image data inside the vehicle is collected through the camera, and the sound data inside the vehicle is collected through the microphone.

Specifically, when the user selects "AR viewing", determine the video currently selected by the user, where the video can be obtained by selecting multiple videos on the interface, or can be selected after searching on the interface, where the video is selected The selected video can be connected to the external network through the vehicle's external T-BOX (Telematics BOX, intelligent terminal for the Internet of Vehicles) to obtain the first audio and video selected by the user.

S102. Acquire a second audio and video; wherein, the second audio and video is obtained by synthesizing the vehicle environment data and the first audio and video by the vehicle or the cloud.

Specifically, in the case of data synthesis performed by the vehicle, the synthesis is performed directly according to the first audio and video acquired by the vehicle and the vehicle environment data.

In the case of data synthesis by the cloud, the car machine controller sends the vehicle environment data to the cloud through the AR glasses, and sends the selected first audio and video logo to the cloud through the AR glasses, so that the cloud according to the first An audio and video identifier acquires the first audio and video, and thus, the cloud performs data synthesis based on the acquired vehicle environment data and the first audio and video to obtain the second audio and video.

S103. Send the second audio and video to the AR glasses for playback, and/or send the second audio and video to a display terminal of the vehicle for playback.

After synthesizing the vehicle environment data and the first audio and video to obtain the second audio and video, the second audio and video can be sent to the AR glasses for playback according to the user's choice, or sent to the vehicle display for playback, or the AR glasses and the vehicle display side to play at the same time. Wherein, the vehicle display end may be a commonly used vehicle display, including a rearview mirror display, a vehicle DVD, and a vehicle navigation display.

Among them, while sending the second audio and video to the AR glasses or the display terminal of the vehicle, the vehicle audio can also be controlled to turn on through the car machine controller, and the vehicle ambient light can be adjusted to a rhythmic state. Provide users with high-quality audio output, and simulate the lighting atmosphere of the scene through the vehicle ambient light, further enhancing the live effect of watching live performances in the car.

In the embodiment of the present invention, when an AR viewing instruction is received, the vehicle or the vehicle environment data sent to the cloud by the vehicle and the acquired first audio and video are synthesized to obtain the second audio and video, and then the obtained second audio and video are sent to The AR glasses or the vehicle display end play, so that the user can watch the live performance video including the image and sound in the car through the AR glasses or the vehicle display end, creating a live atmosphere for the user. In addition, by controlling the state of the components in the car, it simulates some live effects in the car for users to create a live atmosphere, which further enhances the sense of presence for users watching live performance videos in the car.

Referring to FIG. 3, FIG. 3 shows a flow chart of the steps of a video playing method provided by another embodiment of the present invention. As shown in FIG. 3, the video playing method of the embodiment of the present invention is applied to a vehicle, including:

S201. In response to an AR viewing start instruction, collect in-vehicle environment data, and determine the currently selected first audio and video.

The first audio and video in the embodiment of the present invention can be selected through the car-machine APP, or through the mobile phone APP connected with the car-machine. For example, the user selects the video to watch through the mobile APP, and then sends it to the vehicle according to the first audio and video identifier selected by the mobile APP, and the vehicle accesses the content terminal through the vehicle TBOX to obtain the corresponding audio and video, and obtain the first audio and video .

S202. Perform data extraction on the first audio and video according to the time sequence of audio and video collection, to obtain multi-frame audio and video data carrying a first time stamp.

Specifically, data extraction is performed on the first audio and video according to the video stream to obtain multi-frame audio and video data carrying a first time stamp, wherein the data extraction on the first audio and video may be performed frame by frame, or It can be extracted by means of interval frames.

S203. Perform data extraction on the in-vehicle environment data according to the time sequence of data collection, to obtain user data carrying a second time stamp.

Among them, the purpose of extracting data from the in-vehicle environment data is to obtain the image data and sound data of the AR eye user, so that the user's image and sound can be directly synthesized into the live video to improve the on-site effect of the user's viewing.

In some embodiments, cameras and sound sensors are set up in different areas of the vehicle, and image data and sound data can only be collected for the area where the user of the AR glasses is located. Therefore, only the image and sound need to be cleared when performing data extraction. and other processing to process the user's image and sound.

Wherein, the data extraction from the user data mainly includes: performing tagging processing on the action data in the user data, and performing clear processing on the sound data in the user data. Specifically, identify the user's actions in the image data, and label the user data according to the action recognition results, and then filter out the user data related to video viewing, thereby synthesizing the user's related actions into the video to achieve Composite effect of users interacting with live performances in the vehicle.

S204. Based on the first timestamp and the second timestamp, synthesize multiple frames of the audio and video data and the user data to obtain the second audio and video; wherein, in the second audio and video The audio and video data is time-aligned with the user data.

After obtaining the multi-frame audio and video data carrying the first time stamp and the user data carrying the second time stamp, according to the first time stamp and the second time stamp, the audio and video data and the user data in the same time period are synthesized, Thus, the audio-video data and the user data in the synthesized second audio-video are time-aligned.

S205. Send the second audio and video to the AR glasses for playback, and/or send the second audio and video to a display terminal of the vehicle for playback.

Among them, while sending the second audio and video to the AR glasses or the display terminal of the vehicle, the vehicle audio can also be controlled to turn on through the car machine controller, and the vehicle ambient light can be adjusted to a rhythmic state. Provide users with high-quality audio output, and simulate the lighting atmosphere of the scene through the vehicle ambient light, further enhancing the live effect of watching live performances in the car. For example, when a live concert is played, live music can be provided through a sound system, and a live lighting effect can be simulated through an ambient light, thereby simulating a live atmosphere so that users can experience a better live effect.

In the embodiment of the present invention, when the AR viewing instruction is received, the vehicle collects the vehicle environment data and the obtained first audio and video, and then performs data extraction on the in-vehicle environment data based on time sequence, and performs data extraction on the first audio and video, Obtain user data and audio and video data with time stamps, and synthesize the user data and audio and video data based on the time stamps to obtain the second audio and video, and then send the obtained second audio and video to AR glasses or vehicle display terminals for playback, by Therefore, users can watch the live performance video including the user themselves through AR glasses or the vehicle display terminal, and create a live atmosphere for the user by integrating the user into the video. At the same time, by controlling the status of the components in the car, it simulates some live effects in the car for users to create a live atmosphere, which further enhances the sense of presence for users watching live performance videos in the car. In addition, since the user data is also tagged, when the data is synthesized, the screened tagged data and audio and video data are synthesized, and the user's actions can be displayed in the video, enabling the user to interact with the scene in the car effect to enhance the user's viewing experience.

Embodiment two

Referring to FIG. 4, FIG. 4 shows a flow chart of the steps of the video playback method provided by the embodiment of the present invention. As shown in FIG. 4, the video playback method of the embodiment of the present invention is applied to the cloud, including:

S301. Receive in-vehicle environment data and an identification of the first audio and video; wherein, the in-vehicle environment data is sent by the vehicle in response to an AR viewing start instruction.

Specifically, in the case of synthesizing the second audio and video through the cloud, when the user confirms that AR viewing is enabled, the vehicle sends the collected in-vehicle environmental data and the first audio and video logo selected by the user to the cloud through the AR glasses according to the instruction.

S302. Acquire the first audio and video based on the identifier.

Specifically, the cloud acquires the first audio and video from the cloud connection database according to the received first audio and video identifier.

In some embodiments, the cloud and the vehicle-mounted TBOX are connected through a wireless network, so that after obtaining the first audio-video identifier, the cloud can obtain the first audio-video through the vehicle-mounted TBOX according to the first audio-video identifier.

S303. Synthesize the in-vehicle environment data and the first audio and video to obtain a second audio and video.

Specifically, in the in-vehicle environment data, the voice data and image data of the AR glasses user are extracted to obtain the user data; among them, the image data of the user can be identified, and the user's action tag can be determined, so as to target the user to the live performance. Combining the action into the video, such as the interaction between the user and the scene, so that the user can see the scene with 3D effect, and can see the effect of his interaction in the car and the scene (for example, with the singer Hugs, kisses, handshakes, etc.) for a personalized and private experience.

In some embodiments, data extraction and audio-video data extraction are performed according to the time sequence of data collection, so that the extracted user data and audio-video data have time stamps, and based on the time stamps, the user data and audio-video data are synthesized, thereby , so that the image and sound of the user in the second audio and video are time-aligned with the video, so as to create a live effect for the user.

S304. Send the second audio and video to the vehicle, and/or send it to AR glasses for playback.

The embodiment of the present invention obtains the second audio and video by synthesizing the first audio and video obtained through the identification sent by the vehicle and the in-vehicle environment data sent by the vehicle when the AR viewing instruction is received, and then sends the obtained second audio and video to the AR The glasses or the vehicle display end play, so that the user can watch the live performance video including the image and sound in the car through the AR glasses or the vehicle display end, creating a live atmosphere for the user. In addition, by controlling the state of the components in the car, it simulates some live effects in the car for users to create a live atmosphere, which further enhances the sense of presence for users watching live performance videos in the car.

The above process is described below with a specific example:

First of all, when the user selects the live video to watch on the vehicle operation terminal, such as the vehicle APP or the mobile APP, and chooses to enable the AR viewing mode, the vehicle controller collects the in-vehicle environmental data through the in-vehicle camera, sound sensor, etc. And obtain the logo of the first audio and video selected by the user or the car machine controller sends the environmental data in the car and the logo of the first audio and video selected to the cloud through the AR glasses;

Afterwards, the car-machine controller connects to the external network through the vehicle-mounted TBOX according to the video identification of the first audio and video, and accesses the content terminal to obtain the first audio and video; or the cloud obtains the first audio and video from the cloud database according to the identification of the first audio and video. One audio and video.

After acquiring the first audio and video and the in-vehicle environment data, the car machine controller or the cloud extracts data from the first audio and video according to the time sequence of audio and video collection, and obtains multi-frame audio and video data with the first time stamp ; and according to the time sequence of data collection, data extraction is performed on the in-vehicle environmental data to obtain user data with a second time stamp, wherein, during data extraction, user actions can also be identified to obtain tagged user data, Among them, the label is used to describe user actions.

After the data is extracted, the vehicle-machine controller or the cloud, according to the first timestamp and the second timestamp, time-aligns the user data and the audio-video data when synthesizing them, thereby obtaining the second audio-video.

Finally, the car-machine controller or the cloud will send the second audio and video to the AR glasses and/or to the display terminal of the vehicle for playback, so as to display the synthesized second audio and video to the user, so that the user can use the AR glasses or It is the vehicle display terminal to watch the live video with 3D effect, and can see the interactive effect between oneself and the scene. While playing the second audio and video, you can also control the audio in the car to turn on through the car controller to provide users with a higher-quality audio playback effect, and control the vehicle's ambient light to enter the rhythmic state, so that the ambient light rhythm with the sound, Create a visual and sound effect similar to the scene, and simulate the scene atmosphere for users.

Embodiment Three

Referring to FIG. 5, FIG. 5 shows a schematic structural diagram of a video playback device provided in an embodiment of the present invention. As shown in FIG. 5, the video playback device in an embodiment of the present invention is applied to a vehicle, and the device includes:

The collection module 401 is used to collect the in-vehicle environment data in response to the AR viewing start instruction, and determine the currently selected first audio and video;

An acquisition module 402, configured to acquire a second audio and video; wherein, the second audio and video is obtained by synthesizing the in-vehicle environment data and the first audio and video by the vehicle or the cloud;

The sending module 403 is configured to send the second audio and video to the AR glasses for playing, and/or send the second audio and video to the display terminal of the vehicle for playing.

In some embodiments, the obtaining module 402 also includes:

The data extraction module is used to perform data extraction on the first audio and video according to the time sequence of audio and video collection, to obtain multi-frame audio and video data carrying the first time stamp; and, according to the time sequence of data collection, to the described Carry out data extraction from in-vehicle environment data to obtain user data with a second time stamp;

A synthesis module, configured to synthesize multiple frames of the audio and video data and the user data based on the first timestamp and the second timestamp to obtain the second audio and video; wherein, the second The audio and video data in the audio and video are time aligned with the user data.

In some embodiments, the data extraction module also includes:

A screening module, configured to perform tagging processing on the user data, and screen out target user data having characteristics of the target user;

The synthesis module also includes:

The synthesis submodule is configured to synthesize multiple frames of the audio and video data and the target user data based on the first time stamp and the second time stamp to obtain the second audio and video.

In some embodiments, the device also includes:

The control module is configured to, when playing the second audio and video, adjust the sound of the vehicle to be on, and adjust the ambient light of the vehicle to be in a rhythmic state, so as to simulate the atmosphere of the scene.

Embodiment four

Referring to FIG. 6, FIG. 6 shows a schematic structural diagram of a video playback device provided by an embodiment of the present invention. As shown in FIG. 6, the video playback device of the embodiment of the present invention is applied to the cloud, and the device includes:

The receiving module 501 is configured to receive in-vehicle environment data and the identification of the first audio and video; wherein, the in-vehicle environment data is sent by the vehicle in response to the AR viewing start instruction;

An acquisition module 502, configured to acquire the first audio and video based on the identifier;

A synthesis module 503, configured to synthesize the in-vehicle environment data and the first audio and video to obtain a second audio and video;

A sending module 504, configured to send the second audio and video to the vehicle, and/or send it to AR glasses for playback

In some embodiments, the acquiring module 502 also includes:

The acquisition submodule is configured to acquire the first audio and video from the cloud database according to the identification of the first audio and video.

Based on the same inventive concept, an embodiment of the present invention also provides a system, including: a vehicle, AR glasses, and a cloud; wherein, the vehicle and the cloud are connected through the AR glasses;

The vehicle includes a vehicle-machine controller, and the vehicle-machine control is used to obtain environmental data in the vehicle and determine the identifier of the currently selected first audio and video;

The cloud is used to obtain the first audio and video according to the first audio and video identification and send it to the car machine controller through the AR glasses;

In the case that the second audio and video is synthesized by the vehicle, the vehicle machine controller is also used to perform data synthesis on the in-vehicle environment data and the first audio and video to obtain the second audio and video;

The vehicle also includes a display terminal for receiving and playing the second audio and video sent by the vehicle.

The AR glasses are connected to the vehicle for receiving and playing the second audio and video sent by the vehicle.

In the case where the second audio and video is synthesized by the cloud, the cloud is used to receive the in-vehicle environment data and the identification of the first audio and video sent by the car machine control, and obtain the first audio and video according to the identification of the first audio and video;

The cloud is also used for synthesizing the in-vehicle environment data and the first audio and video to obtain the second audio and video, and sending the second audio and video to the AR glasses and/or to the vehicle through the AR glasses.

Based on the same inventive concept, an embodiment of the present invention further provides a vehicle, the vehicle includes a video playing unit, and the video playing unit executes the video playing method described in any one of the above embodiments.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention shall be included in the scope of the present invention. within the scope of protection;

For the method embodiment, for the sake of simple description, it is expressed as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps Other sequences or concurrently may be used. Secondly, those skilled in the art should also know that the embodiments described in the specification belong to preferred embodiments, and the actions and components involved are not necessarily required by the present invention.

A video playing method, device, and vehicle provided by the present invention have been introduced in detail above. In this paper, specific examples have been used to illustrate the principle and implementation of the present invention. The descriptions of the above embodiments are only used to help understand the present invention. method and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and scope of application. In summary, the content of this specification should not be understood as Limitations on the Invention.

Claims (10)

1. A video playing method, applied to a vehicle, comprising:

responding to an opening instruction watched by the AR, collecting in-vehicle environment data, and determining a first audio and video which is currently selected;

acquiring a second audio and video; the second audio and video is obtained by synthesizing the vehicle or the cloud end, the in-vehicle environment data and the first audio and video;

and sending the second audio and video to the AR glasses for playing, and/or sending the second audio and video to a display end of the vehicle for playing.

2. The video playing method according to claim 1, wherein the synthesizing the in-vehicle environment data and the first audio/video includes:

according to the time sequence of audio and video acquisition, carrying out data extraction on the first audio and video to obtain multi-frame audio and video data carrying a first time stamp;

according to the time sequence of data acquisition, data extraction is carried out on the in-vehicle environment data to obtain user data carrying a second time stamp;

synthesizing a plurality of frames of the audio and video data and the user data based on the first timestamp and the second timestamp to obtain the second audio and video; wherein the audio-video data in the second audio-video is time aligned with the user data.

3. The video playing method according to claim 2, wherein the synthesizing the audio-video data and the user data for a plurality of frames based on the first timestamp and the second timestamp, before obtaining the second audio-video, further comprises:

labeling the user data, and screening target user data with target user characteristics;

the synthesizing the audio and video data and the user data for multiple frames based on the first timestamp and the second timestamp to obtain the second audio and video includes:

and synthesizing a plurality of frames of audio and video data and the target user data based on the first timestamp and the second timestamp to obtain the second audio and video.

4. The video playback method as recited in claim 1, wherein the method further comprises:

and when the second audio and video are played, adjusting the sound of the vehicle to be in an on state, and adjusting the atmosphere lamp of the vehicle to be in a rhythm state so as to simulate the on-site atmosphere.

5. The video playing method according to claim 1, wherein in a case where the first audio and video is synthesized by the cloud, the method further comprises:

responding to an opening instruction of AR watching, sending the in-vehicle environment data to the cloud end through the AR glasses, and indicating the identification of the first audio/video data to the cloud end so that the cloud end obtains the first audio/video based on the identification.

6. A video playing method, which is applied to a cloud, the method comprising:

receiving in-car environment data and a first audio/video identifier; wherein the in-vehicle environment data is sent by the vehicle in response to an on command viewed by the AR;

acquiring the first audio and video based on the identification;

synthesizing the in-vehicle environment data and the first audio and video to obtain a second audio and video;

and sending the second audio and video to the vehicle and/or sending the second audio and video to AR glasses for playing.

7. The method for playing video according to claim 6, wherein the receiving the in-vehicle environment data and the first audio/video identifier includes:

receiving the in-vehicle environment data sent by the vehicle through AR glasses and the identification of the first audio/video;

the obtaining the first audio and video based on the identification includes:

and acquiring the first audio and video from a database of the cloud according to the identification of the first audio and video.

8. A video playback device for use in a vehicle, the device comprising:

the acquisition module is used for responding to an opening instruction watched by the AR, acquiring in-vehicle environment data and determining a first audio/video which is currently selected;

the acquisition module is used for acquiring a second audio and video; the second audio and video is obtained by synthesizing the vehicle or the cloud end, the in-vehicle environment data and the first audio and video;

and the sending module is used for sending the second audio and video to the AR glasses for playing and/or sending the second audio and video to the display end of the vehicle for playing.

9. A video playback device for use in a cloud, the device comprising:

the receiving module is used for receiving the in-vehicle environment data and the identification of the first audio and video; wherein the in-vehicle environment data is sent by the vehicle in response to an on command for the AR to view;

the acquisition module is used for acquiring the first audio and video based on the identification;

the synthesis module is used for synthesizing the in-vehicle environment data and the first audio and video to obtain a second audio and video;

and the sending module is used for sending the second audio and video to the vehicle and/or sending the second audio and video to AR glasses for playing.

10. A vehicle, characterized in that the vehicle comprises: a video playback unit for performing the video playback method as claimed in any one of the preceding claims 1 to 5 or claims 6 to 7.

Images