CN110662109B - Video playing method, electronic equipment and computer readable storage medium - Google Patents

Abstract

The present invention provides a video playback method, an electronic device and a computer-readable storage medium. The generation method is applied to the electronic device. The video playback method includes: receiving at least two video streams with different resolutions of the same video content, and detecting transmission The first transmission bandwidth of the at least two video streams, according to the first transmission bandwidth and the video bit rate of each video stream, determine the playback fluency of the electronic device when playing each video stream independently; parallel playback The at least two video streams are displayed, and the information of the playback fluency of each video stream is displayed. The embodiments of the present invention can intuitively show the difference between the clarity and fluency of each video stream to the user, so as to facilitate the user to compare the clarity and playback fluency on the basis of the same screen content.

Description

A video playback method, electronic device and computer-readable storage medium

technical field

The present invention relates to the technical field of image processing, and in particular, to a video playback method, an electronic device and a computer-readable storage medium.

Background technique

At present, on mainstream online video platforms, video media streams with one or more resolutions are usually provided for the same video content (to simplify the description, the video media streams are also referred to as video streams for short) on the player side. A toggle button for video resolution is provided. After the user clicks the above switch button, the player pops up a definition list including one or more different definition for the user to choose. After the user selects a specific definition, the player loads the video media stream corresponding to the definition for playback.

Although the prior art provides options of various resolutions, users usually cannot preview the playback effect and playback smoothness of each resolution in real time, and can only manually switch the resolutions and compare the image quality by memory of the brain. This comparison method is not intuitive enough.

SUMMARY OF THE INVENTION

At least one embodiment of the present invention provides a video playback method, an electronic device, and a computer-readable storage medium to solve the problem that a user cannot preview the playback effect and playback fluency of each definition in real time in the existing video playback method.

According to one aspect of the present invention, at least one embodiment provides a video playback method, comprising:

Receive at least two video streams with different resolutions of the same video content, and detect the first transmission bandwidth for transmitting the at least two video streams, and determine the The playback fluency of the electronic device when playing each video stream independently;

The at least two video streams are played in parallel, and the information of the playback fluency of each video stream is displayed.

Optionally, after playing the at least two video streams, the method further includes:

receiving a user's selection instruction for the target video stream in the at least two video streams;

According to the selection instruction, stop playing the at least two video streams in parallel, and switch to the target video stream for playing.

Optionally, before the step of receiving at least two video streams with different resolutions of the same video content, the method includes:

Receive a definition preview instruction input by a user, and request at least two video streams of different resolutions of the video content according to the definition preview instruction; or,

During the process of playing the first video stream of the video content by the electronic device, if it is detected that the variation range of the second transmission bandwidth for transmitting the first video stream exceeds a preset range, the electronic device requests a difference in the video content. Resolution of at least two video streams.

Optionally, when the variation range of the second transmission bandwidth exceeds a preset range, the method further includes:

According to the first transmission bandwidth, the at least two video streams corresponding to the first transmission bandwidth are determined, wherein the resolutions of the at least two video streams are positively correlated with the first transmission bandwidth.

Optionally, according to the first transmission bandwidth and the video bit rate of each video stream, the step of determining the playback fluency of the electronic device when playing each video stream independently includes:

For each video stream, when the first transmission bandwidth is greater than or equal to the video bit rate of the video stream, according to the original frame rate of the video stream, determine the playback fluency when the video stream is played alone; When the transmission bandwidth is less than the video bit rate of the video stream, the playback fluency when the video stream is played alone is determined according to the product of the original frame rate of the video stream and a first ratio, where the first ratio is the The ratio of the first transmission bandwidth to the video bit rate.

Optionally, the step of receiving at least two video streams with different resolutions of the same video content includes:

Calculate the sum of the video resolutions of the at least two video streams, and compare it with the current first transmission bandwidth of the electronic device to determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams;

When the first transmission bandwidth supports synchronous playback of the at least two video streams, receiving the at least two video streams and entering the step of playing the at least two video streams in parallel;

When the first transmission bandwidth does not support synchronous playback of the at least two video streams, for each video stream, receive and cache video stream data with a preset playback duration, and when the at least two video streams are cached Then, enter the step of playing the at least two video streams in parallel.

Optionally, the step of playing the at least two video streams in parallel includes:

The video playback interface is divided into a plurality of display areas, and according to the positions of the plurality of display areas, the video picture of the video content is divided into a plurality of sub-pictures, and each display area corresponds to a sub-picture in a channel of video source respectively. ;

The sub-picture corresponding to the display area in each video stream is rendered to the display area corresponding to each video stream.

Optionally, the step of receiving at least two video streams with different resolutions of the same video content includes:

Calculate the sum of the video resolutions of the at least two video streams, and compare it with the current first transmission bandwidth of the electronic device to determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams;

When the first transmission bandwidth supports synchronous playback of the at least two video streams, receiving the at least two video streams, and entering the step of playing the at least two video streams in parallel;

When the first transmission bandwidth does not support synchronous playback of the at least two video streams, receiving the first frame of video data of the at least two video streams, and entering the step of playing the at least two video streams in parallel.

Optionally, the step of playing the at least two video streams in parallel includes:

The video playback interface is divided into a plurality of display areas, and according to the positions of the plurality of display areas, the video picture of the video content is divided into a plurality of sub-pictures, and each display area corresponds to a sub-picture in a channel of video source respectively. ;

When the first transmission bandwidth supports synchronous playback of the at least two video streams, rendering the sub-picture corresponding to the display area in each video stream to the display area corresponding to each video stream;

When the first transmission bandwidth does not support synchronous playback of the at least two video streams, rendering the sub-picture corresponding to the display area in the first frame of each video stream to the display corresponding to each video stream area, the first frame picture is obtained by decoding the first frame data.

According to another aspect of the present invention, at least one embodiment provides an electronic device including a memory, a processor, and a computer program stored on the memory and executable on the processor, the computer program being The steps of the above-mentioned video playback method are realized when the processor is executed.

According to another aspect of the present invention, at least one embodiment provides a computer-readable storage medium on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the above video playback method can be implemented.

The embodiments of the present invention can intuitively show the difference between the clarity and fluency of each video stream to the user by playing in parallel and displaying the smoothness of the playback for the same video content, which is convenient for the user to perform clarity on the basis of the same screen content. Compared with the playback fluency, compared with the prior art, the user can only compare the content of different pictures by memorizing the clarity of each picture and then comparing, the embodiment of the present invention does not require the user to manually switch to each video stream, and can be extremely It is convenient for users to intuitively obtain the difference between each definition and playback fluency.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings that need to be used in the embodiments of the present invention. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

1 is a flowchart of a video playback method according to an embodiment of the present invention;

2 is another flowchart of a video playback method according to an embodiment of the present invention;

3 is an example of a video playback interface provided by an embodiment of the present invention;

4 is another example of a video playback interface provided by an embodiment of the present invention;

5 is a schematic structural diagram of a video playback device according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed ways

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present invention will be more thoroughly understood, and will fully convey the scope of the present invention to those skilled in the art.

The terms "first", "second" and the like in the description and claims of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It is to be understood that the data so used may be interchanged under appropriate circumstances such that the embodiments of the application described herein can, for example, be practiced in sequences other than those illustrated or described herein. Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those expressly listed Rather, those steps or units may include other steps or units not expressly listed or inherent to these processes, methods, products or devices. In the description and the claims, "and/or" means at least one of the connected objects.

The following description provides examples and does not limit the scope, applicability, or configuration set forth in the claims. Changes may be made in the function and arrangement of elements discussed without departing from the spirit and scope of the disclosure. Various examples may omit, substitute, or add various procedures or components as appropriate. For example, the methods described may be performed in an order different from that described, and various steps may be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

As described in the Background Art, although the video platform in the prior art provides video streams of various resolutions for the same video content, it does not support real-time preview of the playback effect and playback fluency of each resolution. For at least one of the problems, an embodiment of the present invention provides a video playback method, which is applied to electronic devices, including but not limited to mobile phones, tablet computers, notebook computers, handheld computers, vehicle-mounted terminals, wearable devices, and pedometers. device, etc. Referring to FIG. 1, a video playback method provided by an embodiment of the present invention includes:

Step 11: Receive at least two video streams with different resolutions of the same video content, and detect the first transmission bandwidth for transmitting the at least two video streams, according to the first transmission bandwidth and the video bit rate of each video stream. , to determine the playback fluency of the electronic device when playing each video stream independently.

Here, the electronic device may receive a video stream from an online video platform that provides the above-mentioned video content. In this embodiment of the present invention, the electronic device may receive at least two video streams of the same video content, and these video streams are usually for the same video. Since the video streams of different resolutions of the content are the same video content, the playback of each video stream is synchronized, that is to say, the content of the first video frame of each video stream and the following video frames are the same. are the same, but there is a difference in sharpness due to different resolutions.

In addition, the embodiment of the present invention will detect the first transmission bandwidth for transmitting the at least two video streams while receiving the above-mentioned at least two video streams, and the first transmission bandwidth is subject to the total bandwidth of the electronic device (the total bandwidth reflects the The bandwidth capability of the device, for example, an electronic device with a 100M bandwidth network card, its total bandwidth is 100M bits), the transmission link bandwidth between the electronic device and the network (for example, the above-mentioned electronic device with a 100M bandwidth network card passes a 10M wired cable The link is connected to the network, and the transmission link bandwidth is 10M bits at this time) and the data transmission bandwidth allocated to the electronic device by the video stream end. Generally, the above-mentioned first transmission bandwidth is less than or equal to the total bandwidth of the electronic device. For example, when the transmission link band and the data transmission bandwidth are not considered, if there is other data transmission between the electronic device and the network other than the above-mentioned at least two video streams, the first transmission bandwidth is smaller than the total bandwidth of the electronic device; However, if there is only data transmission of the at least two video streams between the electronic device and the network, the first transmission bandwidth is usually close to or equal to the total bandwidth of the electronic device. The specific method of detecting the bandwidth of the transmitted video stream can refer to the implementation of the prior art. For example, the occupied bandwidth of each process can be periodically detected, and then the above-mentioned first transmission bandwidth can be determined according to the total bandwidth of the electronic device. The data sending end corresponding to the stream performs an independent data receiving test to obtain the bandwidth from the device to the above-mentioned data sending end, which is not specifically limited in this embodiment of the present invention.

In this embodiment of the present invention, at least two video streams of the same video content can be received at the same time, and when a user actually watches a video, usually only one of the video streams of the definition is selected, so there may be multiple video streams received and played at the same time. There will be stuttering from time to time, but there will be no stuttering problem when only receiving and playing a certain video stream. In order to reflect the playback smoothness when the user actually watches a certain video stream, in the embodiment of the present invention, when determining the playback smoothness when the electronic device plays each video stream independently, the processing may be performed in the following manner. Here, the playback stream level may be Characterized by the frame rate of video playback:

For each video stream:

1) When the first transmission bandwidth is greater than or equal to the video bit rate of the video stream, according to the original frame rate of the video stream, determine the playback smoothness when the video stream is played alone.

Specifically, the original frame rate can be directly used as the playback smoothness when the video stream is played alone. Of course, in this embodiment of the present invention, the original frame rate may be fine-tuned according to the first difference between the first transmission bandwidth and the video bit rate (the first difference is a positive value), and the fine-tuned result may be fine-tuned. as the playback fluency. For example, when the above-mentioned first difference value is greater than a preset threshold, the original frame rate is used as the playback smoothness when the video stream is played alone, and when the above-mentioned first difference value is less than the preset threshold, according to the above-mentioned first For the difference value, an adjustment amount is subtracted from the original frame rate to obtain the playback smoothness when the video stream is played alone. The adjustment amount can usually be positively correlated with the above-mentioned first difference value.

2) when the first transmission bandwidth is less than the video bit rate of the video stream, according to the product of the original frame rate of the video stream and the first ratio, determine the playback fluency when playing the video stream alone, wherein the described The first ratio is a ratio of the first transmission bandwidth to the video bit rate.

Specifically, the product of the original frame rate and the first ratio may be directly used as the playback smoothness when the video stream is played alone. Of course, in this embodiment of the present invention, a fine-tuning can also be performed on the basis of the above product according to the second difference between the video bit rate and the first transmission bandwidth (the second difference is a positive value), and the fine-tuning result is used as The playback smoothness. For example, according to the size of the second difference, an adjustment amount is subtracted from the product to obtain the playback smoothness when the video stream is played alone. The adjustment amount may generally be positively correlated with the second difference.

Step 12: Play the at least two video streams in parallel, and display information about the playback fluency of each video stream.

Here, in this embodiment of the present invention, the at least two video streams can be played in parallel on the video playback interface of the electronic device, and the information on the playback fluency (such as frame rate) of each video stream can be displayed. The specific display method can be directly displayed in the The preset position on the screen of each video stream displays the corresponding frame rate.

Through the above steps, the embodiments of the present invention can intuitively display the difference between the clarity and fluency of each video stream to the user by playing in parallel and displaying the smoothness of playback for the same video content. Since the playback of multiple video streams is synchronized, that is to say, when playing in parallel, the content of the pictures of each video stream is the same, which is convenient for users to perform clarity and playback fluency based on the content of the same picture. Compared with the prior art, the user can only compare the contents of different pictures by memorizing the clarity of each picture and then comparing, the embodiment of the present invention does not require the user to manually switch to each video stream, and can greatly facilitate the user. Intuitively capture the difference between individual sharpness and playback smoothness.

As shown in FIG. 2 , another video playback method provided by an embodiment of the present invention, in addition to steps 11 to 12 shown in FIG. 1 , further includes:

Step 13: Receive a user's selection instruction for a target video stream in the at least two video streams.

Here, users can select their desired video streams according to their needs for clarity and playback fluency. There are various specific selection methods. For example, for electronic devices with touch screen functions, they can select from multiple One of the video pictures of the video streams is selected, and the video stream corresponding to the selected video picture is the target video stream, which is not specifically limited in this embodiment of the present invention.

In addition, when the at least two video streams are played in parallel in the above step 12, the embodiment of the present invention may further adaptively recommend candidate video streams to the user according to the size of the first transmission bandwidth. The resolution is positively correlated with the first transmission bandwidth, thereby prompting the user that the candidate video stream can better adapt to the network environment under the current network environment, so as to achieve full utilization of the bandwidth.

Specifically, when accessing the network through radio access networks of different radio access technologies (RATs), there are obvious differences between network transmission rates. Therefore, as an implementation manner, this embodiment of the present invention may predefine different radio access technologies (RATs) corresponding to different first transmission bandwidths, for example:

A) When the electronic device is connected to the server corresponding to the video content through the 2G wireless access network, the first transmission bandwidth is usually very small;

B) When the electronic device is accessed through the 3G wireless access network, the first transmission bandwidth is usually small;

C) When the electronic device is accessed through the 4G wireless access network, the first transmission bandwidth is usually better;

D) When the electronic device is accessed through a 5G or WIFI wireless access network, the first transmission bandwidth is usually very good.

Therefore, in the cases of A) and B) above, the electronic device can select the video stream with the lowest resolution (traffic saving mode) as the candidate video stream; in the case of C) above, the electronic device can select the resolution of the middle scale. In the case of D) above, the electronic device may select a video stream with higher or highest resolution (such as HD, UHD or Blu-ray mode) as a candidate video stream, The video stream is prompted as a candidate video stream by a preset display manner, for example, by highlighting the frame of the video stream or displaying prompt information on the screen of the video stream.

Certainly, the user may select the candidate video stream as the target video stream by himself or herself, and may also select other video streams other than the candidate video stream as the target video stream, which is not specifically limited in this embodiment of the present invention.

Step 14, according to the selection instruction, stop playing the at least two video streams in parallel, and switch to the target video stream for playing.

Here, after receiving the selection instruction, the electronic device will stop playing the at least two video streams in parallel, and switch to the target video stream. By receiving and playing the target video stream, the video desired by the user is realized. play.

Through the above steps, the embodiment of the present invention can intuitively display the difference between the clarity and fluency of each video stream, which is convenient for the user to select the desired video stream according to his own requirements for the clarity and playback smoothness, which improves the usage of the user. experience.

In this embodiment of the present invention, when a user wishes to compare multiple resolutions of a certain video content, he can actively request to obtain at least two video streams of different resolutions of the video content, and input a request to the electronic device for The preset command of the multi-channel video stream (it is assumed to be a definition preview command), thereby triggering the process of Figure 1/Figure 2. At this time, before the above step 11, the above-mentioned electronic device can receive the definition preview command input by the user, according to The definition preview instruction requests at least two video streams of different resolutions of the video content, and then proceeds to step 11 above.

In addition, in this embodiment of the present invention, the electronic device may also actively trigger the process of FIG. 1/FIG. 2. For example, during the process of the electronic device playing one of the video streams (assuming the first video stream) of the video content, If it is detected that the variation range of the second transmission bandwidth for transmitting the first video stream exceeds a preset range, request at least two video streams of different resolutions of the video content. For example, when the magnitude of the increase or decrease of the second transmission bandwidth is greater than a certain preset range (eg, 30%), the electronic device determines that the current network environment has undergone great changes, and the original network environment in the new network environment The played video stream may freeze, or the new network environment can support the playback of higher-definition video streams. At this time, at least two video streams of different resolutions of the video content can be requested from the network to better It adapts to changes in the network environment and provides video streams that are compatible with the current network environment.

Further, when the variation range of the second transmission bandwidth exceeds a preset range, the electronic device may also select the at least two video streams corresponding to the first transmission bandwidth according to the first transmission bandwidth, wherein , the resolution of the at least two video streams is positively correlated with the first transmission bandwidth. That is to say, when the first transmission bandwidth is relatively large, the sum of the resolutions of the selected at least two video streams is also relatively large, and when the first transmission bandwidth is relatively small, the resolution of the selected at least two video streams is relatively large. The sum of the rates is also smaller. For example, when the first transmission bandwidth is relatively large, a video stream with a higher resolution may be selected from all supported resolutions as the at least two video streams, and when the first transmission bandwidth is relatively small, a resolution may be selected. A video stream with a smaller rate is used as the at least two video streams.

The network environment of the electronic device changes obviously, which is usually caused by network switching. In particular, when switching to a radio access network of a different RAT, the network transmission rate usually changes significantly. Therefore, as an implementation manner, this embodiment of the present invention may predefine different RATs to correspond to different first transmission bandwidths. For example, when an electronic device is connected to a server corresponding to the video content through a 2G wireless access network, the The first transmission bandwidth is usually small; when the electronic device is accessed through the 3G wireless access network, the first transmission bandwidth is usually small; when the electronic device is accessed through the 5G wireless access network, the first transmission bandwidth The transmission bandwidth is usually better; when the electronic device is accessed through the 5G or WIFI wireless access network, the first transmission bandwidth is usually very good. It is assumed that the video content has the following five video streams of different resolutions, which correspond to: data saving mode, standard definition mode, high definition mode, ultra-definition mode and Blu-ray mode, and the resolutions of the above-mentioned modes are sequentially increased. When the electronic device is connected through the 2G or 3G wireless access network, at this time, because the first transmission bandwidth is small, at least two video streams with smaller resolution are selected. For example, the data saving mode and the standard definition mode can be selected as the At least two video streams; when the electronic device is accessed through the 4G wireless access network, at this time, because the first transmission bandwidth is moderate, at least two video streams with moderate resolution are selected, for example, SD mode and high-definition mode can be selected. At least two video streams described above; when the electronic device is connected through the 5G/WIFI wireless access network, at this time, due to the large first transmission bandwidth, at least two video streams with high resolution are selected, for example, ultra-clear can be selected. mode and Blu-ray mode as the at least two video streams. In addition, it should be noted that the above is only an example of the specific implementation of the embodiment of the present invention, and is not intended to limit the present invention.

Considering that the first transmission bandwidth may not be enough to support synchronous playback of the at least two video streams, as an implementation manner, in this embodiment of the present invention, when the first transmission bandwidth does not support synchronous playback of the at least two video streams , using the strategy of buffering first and then playing for parallel playback.

At this time, in the above step 11, the electronic device calculates the sum of the video resolutions of the at least two video streams, and compares it with the current first transmission bandwidth of the electronic device to determine the first transmission bandwidth. Whether the bandwidth supports synchronous playback of the at least two video streams (when the above sum value is greater than or equal to the first transmission bandwidth, it can be considered that the at least two video streams are supported synchronously, otherwise it is considered not to be supported). When the first transmission bandwidth supports synchronous playback of the at least two video streams, the at least two video streams may be received and the process proceeds to step 12 to play the at least two video streams in parallel, while the first When the transmission bandwidth does not support synchronous playback of the at least two video streams, for each video stream, the electronic device may receive and cache the video stream data of the preset playback duration, and cache the at least two video streams after the buffering is completed. Then, go to step 12 to play the at least two video streams in parallel.

In the above step 12, the electronic device may divide its video playback interface into multiple display areas, and according to the positions of the multiple display areas, divide the video picture of the video content into multiple sub-pictures, each display The area corresponds to a sub-picture in one video source, and FIG. 3 shows an example of the relationship between the sub-picture and the complete video picture. Specifically, the video playback interface 300 in FIG. 3 includes 4 display areas, respectively corresponding to 4 sub-pictures with different resolutions, namely SD sub-picture 301, high-definition sub-picture 302, ultra-definition sub-picture 303 and Blu-ray sub-picture 304, these sub-pictures are all a part of the complete video picture, and they are common. form a complete video image. Then, the sub-picture corresponding to the display area in each video stream is rendered to the display area corresponding to each video stream.

Through the above steps, when the present invention plays the at least two video streams in parallel, the sub-pictures of each video stream form a complete video picture, since the resolution of the sub-pictures is not reduced relative to the original video picture (this The sub-picture is a part of the original video picture, and its position and size are the same as those in the original picture), so it can well reflect the actual effect of the definition when the video stream is played alone, and it is also convenient to be displayed in parallel with other video streams. Sub-pictures for sharpness comparison.

As another implementation manner, in this embodiment of the present invention, when the first transmission bandwidth does not support synchronous playback of the at least two video streams, only the first frame of video data of the at least two video streams may be received, and then the first video stream may be played in parallel. The comparison of multiple video streams is carried out in the manner of the first frame picture corresponding to the frame of video data, thereby saving the receiving time of the video stream data.

At this time, in the above step 11, the electronic device may calculate the sum of the video resolutions of the at least two video streams, and compare it with the current first transmission bandwidth of the electronic device to determine the first Whether the transmission bandwidth supports simultaneous playback of the at least two video streams. When the first transmission bandwidth supports the simultaneous playback of the at least two video streams, the at least two video streams are received, and the process proceeds to step 12 to play the at least two video streams in parallel, while the first When the transmission bandwidth does not support synchronous playback of the at least two video streams, only the first frame of video data of the at least two video streams is received, and the process goes to step 12 .

In the above step 12, the electronic device may divide the video playback interface into multiple display areas, and according to the positions of the multiple display areas, divide the video picture of the video content into multiple sub-pictures, each display area They respectively correspond to a sub-picture in one video source (similar to Fig. 3). Then, when the first transmission bandwidth supports synchronous playback of the at least two video streams, the sub-picture corresponding to the display area in each video stream is rendered to the display area corresponding to each video stream, and When the first transmission bandwidth does not support synchronous playback of the at least two video streams, rendering the sub-picture corresponding to the display area in the first frame of each video stream to the display corresponding to each video stream area, the first frame picture is obtained by decoding the first frame data.

In the above two implementation manners, in the embodiment of the present invention, the sub-picture corresponding to the display area in each video stream needs to be rendered to the display area corresponding to each video stream, or the sub-picture of each video stream needs to be rendered The sub-picture corresponding to the display area in the first frame is rendered to the display area corresponding to each video stream. There are several specific rendering methods, which are briefly described below:

The first type: use the same number of players as the at least two sub-pictures, each player corresponds to one video stream; through each player, load and decode each video stream in parallel, and compare each video stream with The sub-picture corresponding to the display area is rendered to the display area corresponding to each video stream. Here, since the position coordinates of each display area are known, the sub-pictures of each display area can be respectively rendered to the corresponding display area. display area.

The second type: use a player for rendering and playback, specifically, extract the video data of the sub-picture corresponding to the display area in the video source from each video stream, and extract the video from each video stream. Data is synthesized to obtain a new video stream; the new video stream is loaded and decoded by the player, and rendered to the video playback interface.

It should be noted that the above are only parallel playback modes that can be used in the embodiments of the present invention, and other playback modes can also be used in the present invention. To save space, they will not be described in detail here.

In addition, in addition to the parallel playback mode shown in FIG. 3 , the present invention can also adopt the parallel playback mode shown in FIG. 4 . As shown in FIG. 4 , the video playback interface 400 of FIG. The display area 401, the high-definition display area 402, the ultra-clear display area 403, and the Blu-ray display area 404 are different from FIG. 4 in that all displayed in these display areas are a complete video picture, and these video pictures are for the same video Synchronized video streaming of the content, so these video images should all be the same when playback is not stuttered. In this way, when the at least two video streams are played in parallel in the above step 12, the video playback interface can be divided into a plurality of display areas, wherein each display area corresponds to one video stream respectively; then each video stream is loaded and decoded in parallel stream, and render to the display area corresponding to each video stream. For example, through multiple players (each player corresponds to a display area), through each player, each video stream is loaded and decoded in parallel, and the video picture of each video stream is rendered to the corresponding display area.

In addition, it should be noted that the sizes of each display area in FIG. 3 and FIG. 4 are the same, and the shapes are all rectangles. In this embodiment of the present invention, irregular-shaped display areas can also be used, and the size, The shapes can be the same or different. Furthermore, each display area may be displayed in a tiled manner as shown in FIG. 3 or FIG. 4 , or may be displayed in a stacked manner (that is, there may be overlap between display areas), which is not performed in this embodiment of the present invention. Specific restrictions.

Please refer to FIG. 5. FIG. 5 is a schematic structural diagram of a video playback apparatus according to an embodiment of the present invention. The video playback apparatus 50 is applied to an electronic device. As shown in Figure 5, the video playback device 50 includes:

The video stream receiving module 51 is configured to receive at least two video streams with different resolutions of the same video content, and detect the first transmission bandwidth for transmitting the at least two video streams, and according to the first transmission bandwidth and each video stream The video bit rate of the stream, to determine the playback fluency of the electronic device when playing each video stream independently;

The video stream playing module 52 is configured to play the at least two video streams in parallel, and display the information of the playing fluency of each video stream.

Through the above modules, the embodiment of the present invention can intuitively show the difference between the clarity and fluency of each video stream to the user, which is convenient for the user to compare the clarity and playback fluency on the basis of the same screen content.

According to at least one embodiment of the present invention, the above-mentioned video playback device may further include the following units (not shown in FIG. 5 ):

a selection instruction receiving module, configured to receive a user's selection instruction for the target video stream in the at least two video streams;

A playback control module, configured to stop playing the at least two video streams in parallel according to the selection instruction, and switch to the target video stream for playback.

Through the above modules, the embodiment of the present invention can switch to the target video stream for playback based on the user's instruction.

According to at least one embodiment of the present invention, the above-mentioned video playback device may further include the following units (not shown in FIG. 5 ):

The triggering module is configured to receive a definition preview instruction input by the user before receiving at least two video streams of different resolutions of the same video content, and request at least two different resolutions of the video content according to the definition preview instruction. two video streams; or, in the process of playing the first video stream of the video content by the electronic device, if it is detected that the variation range of the second transmission bandwidth for transmitting the first video stream exceeds the preset range, At least two video streams of different resolutions of the video content are requested.

Through the above triggering module, the embodiment of the present invention can trigger the video stream receiving module and the video stream playing module in response to the user's instruction or when the network environment changes, so as to intuitively display the clarity and fluency of each video stream to the user. the difference.

According to at least one embodiment of the present invention, the above-mentioned video playback device may further include the following units (not shown in FIG. 5 ):

A video stream determination module, configured to determine the at least two video streams corresponding to the first transmission bandwidth according to the first transmission bandwidth when the variation range of the second transmission bandwidth exceeds a preset range, wherein the The resolution of the at least two video streams is positively related to the first transmission bandwidth.

According to at least one embodiment of the present invention, the above-mentioned video stream receiving module 51 is further configured to, for each video stream, when the first transmission bandwidth is greater than or equal to the video bit rate of the video stream, according to the The original frame rate, to determine the playback fluency when the video stream is played alone; when the first transmission bandwidth is less than the video bit rate of the video stream, according to the product of the original frame rate of the video stream and the first ratio, determine the individual Playback fluency when playing the video stream, wherein the first ratio is the ratio of the first transmission bandwidth to the video bit rate.

According to at least one embodiment of the present invention, the above-mentioned video stream receiving module 51 is further configured to calculate the sum of the video resolutions of the at least two video streams, and compare it with the current first transmission bandwidth of the electronic device , determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams; when the first transmission bandwidth supports synchronous playback of the at least two video streams, receive the at least two video streams and trigger all The video stream playback module; when the first transmission bandwidth does not support synchronous playback of the at least two video streams, for each video stream, receive and cache the video stream data of the preset playback duration, and perform the playback of the at least two video streams in the at least two channels. After all the video streams are cached, the video stream playing module is triggered.

According to at least one embodiment of the present invention, the above-mentioned video stream playback module is further configured to divide the video playback interface into multiple display areas, and divide the video screen of the video content into multiple display areas according to the positions of the multiple display areas. sub-pictures, each display area corresponds to a sub-picture in a channel of video source respectively; the sub-picture corresponding to the display area in each channel of video stream is rendered to the display area corresponding to each channel of video stream.

According to at least one embodiment of the present invention, the above-mentioned video stream receiving module 51 is further configured to calculate the sum of the video resolutions of the at least two video streams, and compare it with the current first transmission bandwidth of the electronic device , determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams; when the first transmission bandwidth supports synchronous playback of the at least two video streams, receive the at least two video streams, and trigger The video stream playing module; when the first transmission bandwidth does not support synchronous playing of the at least two video streams, receiving the first frame of video data of the at least two video streams, and triggering the video stream playing module.

According to at least one embodiment of the present invention, the above-mentioned video stream playback module is further configured to divide the video playback interface into multiple display areas, and divide the video screen of the video content into multiple display areas according to the positions of the multiple display areas. sub-pictures, and each display area corresponds to a sub-picture in a channel of video sources; when the first transmission bandwidth supports synchronous playback of the at least two channels of video streams, the display area of each channel of video streams corresponds to The sub-picture is rendered to the display area corresponding to each video stream; when the first transmission bandwidth does not support synchronous playback of the at least two video streams, the first frame of each video stream is compared with the display The sub-picture corresponding to the area is rendered to the display area corresponding to each video stream, and the first frame of the picture is obtained by decoding the first frame of data.

In addition, an embodiment of the present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the computer program is executed by the processor During execution, each process of the foregoing video playback method embodiments can be implemented, and the same technical effect can be achieved. To avoid repetition, details are not described here.

Specifically, as shown in FIG. 6 , an embodiment of the present invention further provides an electronic device including a bus 61 , a transceiver 62 , an antenna 63 , a bus interface 64 , a processor 65 and a memory 66 .

In an embodiment of the present invention, the electronic device has a folding screen, and the folding screen includes at least two screens. The electronic device also includes a computer program stored on the memory 66 and executable on the processor 65 . Optionally, when the computer program is executed by the processor 65, the following steps may be implemented:

Receive at least two video streams with different resolutions of the same video content, and detect the first transmission bandwidth for transmitting the at least two video streams, and determine the The playback fluency of the electronic device when playing each video stream independently;

The at least two video streams are played in parallel, and the information of the playback fluency of each video stream is displayed.

Understandably, in this embodiment of the present invention, when the computer program is executed by the processor 65, each process of the video playback method embodiment shown in FIG. 1 or FIG. 2 can be implemented, and the same technical effect can be achieved. Repeat, and will not repeat them here.

In FIG. 6, a bus architecture (represented by bus 61), which may include any number of interconnected buses and bridges, bus 61 will include one or more processors represented by processor 65 and memory represented by memory 66 The various circuits are linked together. The bus 61 may also link together various other circuits such as peripherals, voltage regulators and power management circuits, etc., which are well known in the art and therefore will not be described further herein. Bus interface 64 provides an interface between bus 61 and transceiver 62 . Transceiver 62 may be a single element or multiple elements, such as multiple receivers and transmitters, providing means for communicating with various other devices over a transmission medium. The data processed by the processor 65 is transmitted on the wireless medium through the antenna 63 , and further, the antenna 63 also receives the data and transmits the data to the processor 65 .

Processor 65 is responsible for managing bus 61 and general processing, and may also provide various functions including timing, peripheral interface, voltage regulation, power management, and other control functions. Instead, memory 66 may be used to store data used by processor 65 in performing operations.

Optionally, the processor 65 may be a CPU, ASIC, FPGA or CPLD.

Embodiments of the present invention also provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, implements each process of the foregoing video playback method embodiments, and can achieve the same technical effect, In order to avoid repetition, details are not repeated here.

Computer-readable media includes both permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, excludes transitory computer-readable media, such as modulated data signals and carrier waves.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages or disadvantages of the embodiments.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in the various embodiments of the present invention.

The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the principles of the present invention, several improvements and modifications can be made. It should be regarded as the protection scope of the present invention.

Claims (10)

1. a video playback method, applied to electronic equipment, is characterized in that, comprising: Receive at least two video streams with different resolutions of the same video content, and detect the first transmission bandwidth for transmitting the at least two video streams, and determine the The playback fluency of the electronic device when playing each video stream independently; Playing the at least two video streams in parallel, and displaying information about the playback fluency of each video stream; Wherein, the step of receiving at least two video streams of different resolutions of the same video content includes: Calculate the sum of the video resolutions of the at least two video streams, and compare it with the first transmission bandwidth to determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams; When the first transmission bandwidth supports synchronous playback of the at least two video streams, receiving the at least two video streams, and entering the step of playing the at least two video streams in parallel; When the first transmission bandwidth does not support synchronous playback of the at least two video streams, receiving the first frame of video data of the at least two video streams, and entering the step of playing the at least two video streams in parallel. 2. The method according to claim 1, wherein after playing the at least two video streams, the method further comprises: receiving a user's selection instruction for the target video stream in the at least two video streams; According to the selection instruction, stop playing the at least two video streams in parallel, and switch to the target video stream for playing. 3. The method according to claim 1, wherein before the step of receiving at least two video streams of different resolutions of the same video content, the method comprises: Receive a definition preview instruction input by a user, and request at least two video streams of different resolutions of the video content according to the definition preview instruction; or, During the process of playing the first video stream of the video content by the electronic device, if it is detected that the variation range of the second transmission bandwidth for transmitting the first video stream exceeds a preset range, the electronic device requests a difference in the video content. Resolution of at least two video streams. 4. The method according to claim 3, wherein when the variation range of the second transmission bandwidth exceeds a preset range, the method further comprises: According to the first transmission bandwidth, the at least two video streams corresponding to the first transmission bandwidth are determined, wherein the resolutions of the at least two video streams are positively correlated with the first transmission bandwidth. 5. The method according to claim 1, wherein, according to the first transmission bandwidth and the video bit rate of each video stream, it is determined that the electronic device plays smoothly when each video stream is played independently Degree steps, including: For each video stream, when the first transmission bandwidth is greater than or equal to the video bit rate of the video stream, according to the original frame rate of the video stream, determine the playback fluency when the video stream is played alone; When the transmission bandwidth is less than the video bit rate of the video stream, the playback fluency when the video stream is played alone is determined according to the product of the original frame rate of the video stream and a first ratio, where the first ratio is the The ratio of the first transmission bandwidth to the video bit rate. 6. The method according to any one of claims 1 to 5, wherein the step of receiving at least two video streams of different resolutions of the same video content comprises: Calculate the sum of the video resolutions of the at least two video streams, and compare it with the first transmission bandwidth to determine whether the first transmission bandwidth supports synchronous playback of the at least two video streams; When the first transmission bandwidth supports synchronous playback of the at least two video streams, receiving the at least two video streams and entering the step of playing the at least two video streams in parallel; When the first transmission bandwidth does not support synchronous playback of the at least two video streams, for each video stream, receive and cache video stream data with a preset playback duration, and when the at least two video streams are cached Then, enter the step of playing the at least two video streams in parallel. 7. The method according to claim 6, wherein the step of playing the at least two video streams in parallel comprises: The video playback interface is divided into a plurality of display areas, and according to the positions of the plurality of display areas, the video picture of the video content is divided into a plurality of sub-pictures, and each display area corresponds to a sub-picture in a channel of video source respectively. ; The sub-picture corresponding to the display area in each video stream is rendered to the display area corresponding to each video stream. 8. The method according to claim 1, wherein the step of playing the at least two video streams in parallel comprises: The video playback interface is divided into a plurality of display areas, and according to the positions of the plurality of display areas, the video picture of the video content is divided into a plurality of sub-pictures, and each display area corresponds to a sub-picture in a channel of video source respectively. ; When the first transmission bandwidth supports synchronous playback of the at least two video streams, rendering the sub-picture corresponding to the display area in each video stream to the display area corresponding to each video stream; When the first transmission bandwidth does not support synchronous playback of the at least two video streams, rendering the sub-picture corresponding to the display area in the first frame of each video stream to the display corresponding to each video stream area, the first frame of picture is obtained by decoding the first frame of video data. 9. An electronic device comprising a memory, a processor and a computer program stored on the memory and running on the processor, characterized in that, when the computer program is executed by the processor, as claimed in the claim The steps of the video playback method described in any one of requirements 1 to 8 are required. 10. A computer-readable storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the video playback method according to any one of claims 1 to 8 are implemented.

Images