CN111294647B - A video processing method, device and device, and storage medium - Google Patents

Abstract

The embodiment of the application discloses a video processing method, which comprises the following steps: acquiring a video to be processed through an external interface in a transcoding system; preprocessing the video to be processed according to video configuration information set based on user requirements to obtain a preprocessed video; determining the priority of the preprocessed video according to the attribute information of the preprocessed video; according to the priority of the pre-processing video, allocating system resources to the pre-processing video so as to process the pre-processing video; the embodiment of the application also discloses a video processing device, video processing equipment and a storage medium.

Description

A video processing method, device and device, and storage medium

technical field

The embodiments of the present application relate to the technical field of video processing, and relate to, but are not limited to, a video processing method, apparatus and device, and storage medium.

Background technique

In the related art, the transcoding system receives the video sent by the client through the external interface, and stores the video in the database. The transcoding system scans the database in real time. Transcode. However, the transcoding system in the related art cannot meet the needs of users.

SUMMARY OF THE INVENTION

In view of this, embodiments of the present application provide a video processing method, apparatus and device, and storage medium.

The technical solutions of the embodiments of the present application are implemented as follows:

An embodiment of the present application provides a video processing method, the method comprising: acquiring a video to be processed through an external interface in a transcoding system;

Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

According to the priority of the preprocessed video, system resources are allocated to the preprocessed video to process the preprocessed video.

An embodiment of the present application provides a video processing apparatus, the apparatus includes: an acquisition module, a preprocessing module, a first determination module, and an allocation module; wherein,

The acquisition module is used to acquire the video to be processed through an external interface in the transcoding system;

The preprocessing module is configured to preprocess the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

The first determination module is configured to determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

The allocation module is configured to allocate system resources to the pre-processed video according to the priority of the pre-processed video, so as to process the pre-processed video.

Embodiments of the present application further provide a video processing device, including a processor and a memory for storing a computer program that can be run on the processor; wherein, when the processor is used to run the computer program, the processing is applied to a terminal The steps of the video processing method described in the above solution of the device.

Embodiments of the present application further provide a storage medium on which a computer program is stored, and when the computer program is processed by a processor, implements the steps of the video processing method described in the above solution applied to a terminal device.

In the video processing method, device, device, and storage medium provided by the embodiments of the present application, the video to be processed is obtained through an external interface in the transcoding system; and the video to be processed is preprocessed according to video configuration information set based on user requirements , obtain a preprocessed video; determine the priority of the preprocessed video according to the attribute information of the preprocessed video; according to the priority of the preprocessed video, allocate system resources to the preprocessed video to The video is preprocessed for processing; in this way, user requirements can be met, system resources are dynamically allocated to the video according to the determined priority, and video transcoding is performed.

Description of drawings

FIG. 1 is a schematic diagram of an implementation flowchart of a video processing method according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of the implementation of the transcoding system in the related art of the embodiment of the present application;

3 is a schematic structural diagram of a transcoding system according to an embodiment of the application;

FIG. 4 is a schematic flowchart of an implementation of video preprocessing according to an embodiment of the present application;

FIG. 5 is a schematic flowchart of an implementation of video scheduling according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a composition structure of a video processing apparatus according to an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a video processing device according to an embodiment of the present application.

Detailed ways

The present application will be described in further detail below with reference to the accompanying drawings and specific embodiments.

FIG. 1 is a schematic flowchart of the implementation of the video processing method in the embodiment of the present application. As shown in FIG. 1 , the method includes the following steps:

Step 101: Obtain the video to be processed through an external interface in the transcoding system;

Here, the transcoding system is used to process the video. In practical applications, the transcoding system includes an external interface. The client sends the video to be processed to the transcoding system through the external interface, and the transcoding system receives the pending video sent by the client through the external interface. Process the video and save the video to be processed in the storage system.

Step 102: Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

Here, the video configuration information may include: target format, target bit rate, target key frame information and other video-related configuration information.

The video configuration information is determined by user requirements, and video configuration information of the video to be processed can be set based on the user requirements, so that the transcoding system can process the video to be processed according to the user requirements. For example, if the user needs to convert a video in an animation video (Flash Video, FLV) format into a video whose target format is an audio video interleaved (Audio Video Interleaved, AVI) format, the target format of the video configuration information is the AVI format.

According to the video configuration information of the video to be processed, preprocessing the video to be processed may include: processing the format and bit rate of the video, or adding key frame information to the video to be processed, so as to obtain the preprocessed video.

Step 103: Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

Here, the attribute information of the preprocessed video may include: video value, time urgency and other attributes related to the preprocessed video.

After the preprocessed video is obtained, the attribute information of the preprocessed video is determined, and the priority of the preprocessed video is determined according to the attribute information of the preprocessed video.

For example, according to the video value and time urgency of the preprocessed video, the priority of the preprocessed video can be determined as urgent or non-urgent.

Step 104: Allocate system resources to the preprocessed video according to the priority of the preprocessed video, so as to process the preprocessed video.

According to the priority determined by the preprocessed video, system resources are allocated to the preprocessed video, and the preprocessed video is processed by using the allocated system resources.

For example, when the priority determined by the preprocessed video is urgent, more system resources are allocated to the preprocessed video, and the above-mentioned system resources are used to process the preprocessed video, which can ensure that the preprocessed video whose priority is urgent can be processed in time.

When using system resources to process the preprocessed video, the processing type of the preprocessed video can be determined first; the preprocessed video is processed according to the processing type. Here, the processing type may be: transcoding processing type or coding processing type.

For example, when it is determined that the processing type of the preprocessed video is a transcoding processing type or a coding processing type, transcoding processing or coding processing is performed on the preprocessing video according to the processing type.

In the embodiment of the present application, the video to be processed is obtained through an external interface in the transcoding system; the video to be processed is preprocessed according to the video configuration information set based on the user's needs, and the preprocessed video is obtained; according to the preprocessing The attribute information of the video is used to determine the priority of the preprocessed video; according to the priority of the preprocessed video, system resources are allocated to the preprocessed video to process the preprocessed video; According to the determined priority, the system resources are dynamically allocated to the video, and video transcoding is performed.

The embodiment of the present application provides a video processing method, and the method includes the following steps:

Step 201: Determine the type of the video to be processed according to the video configuration information;

Here, the video configuration information may further include: source format, source code rate, and other video-related configuration information.

The type of the video to be processed can be determined according to the source format, source code rate, etc. in the video configuration information. For example, if the video configuration information corresponding to the user's needs is to convert the video to be processed in FLV format into a video in AVI format, then the The source format is FLV format, indicating that the type of the video to be processed is a video in FLV format.

Step 202: Obtain the video to be processed through an external interface in the transcoding system;

In this way, when the video to be processed is obtained through the external interface in the transcoding system, the type of the video to be processed can be determined according to the video configuration information, and the corresponding type of video to be processed can be obtained through the external interface in the transcoding system, instead of obtaining all the videos to be processed. pending video. In this way, only the video that needs to be processed can be acquired, and the processing efficiency can be improved.

Step 203: Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

Here, the video configuration information may include: target format, target bit rate, target key frame information and other video-related configuration information.

The video configuration information is determined by user requirements, and video configuration information of the video to be processed can be set based on the user requirements, so that the transcoding system can process the video to be processed according to the user requirements.

In an embodiment, the video configuration information includes: target format, target bit rate or target key frame information. When the video configuration information is the target format, the format of the video to be processed is adjusted to the target format to obtain the preprocessed video; when the video configuration information is the target bit rate, the format of the video to be processed is adjusted to the target bit rate, thereby obtaining Preprocess the video; when the video configuration information is the target keyframe information, add keyframes to the video to be processed according to the target keyframe information, thereby obtaining the preprocessed video.

For example, if the target format of the video configuration information is AVI format, then the format of the video to be processed is adjusted to AVI format to obtain a preprocessed video; the bit rate format of the video configuration information is 600 bits per second, then the bit rate of the video to be processed is adjusted to AVI format. Adjusted to 600 bits per second to get the preprocessed video.

Step 204: Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

Step 205: Allocate system resources to the preprocessed video according to the priority of the preprocessed video, so as to process the preprocessed video.

In the embodiment of the present application, the to-be-processed video can be obtained according to the video configuration information, which improves the processing efficiency; and the format, bit rate, and key frame information of the to-be-processed video can be preprocessed according to user requirements to meet user requirements.

The embodiment of the present application provides a video processing method, and the method includes the following steps:

Step 301: Obtain the video to be processed through an external interface in the transcoding system;

Step 302: Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

Step 303: Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

Here, the attribute information of the preprocessed video may include: video value, time urgency and other attributes related to the preprocessed video.

After the preprocessed video is obtained, the attribute information of the preprocessed video is determined, and the priority of the preprocessed video is determined according to the attribute information of the preprocessed video.

In one embodiment, the attribute information includes: video value and time urgency, configure the video value of the preprocessed video, the time urgency, the weight corresponding to the video value, and the weight corresponding to the time urgency; According to the priority score, the priority score of the preprocessed video is determined, and the priority of the preprocessed video is determined according to the priority score.

For example: the video value of the configured preprocessed video is 1, the time urgency is 2, the weight corresponding to the video value is 0.6, and the weight corresponding to the time urgency is 0.4. The above parameters are weighted and summed to determine the preprocessed video. The priority is 1.4, and according to the priority score 1.4, the priority of preprocessing video is determined.

In one embodiment, the attribute information further includes: remaining value density, and configuring the remaining value density of the preprocessed video and the weight corresponding to the remaining value density, then when determining the priority score of the preprocessed video, including: according to the video Value, time urgency, residual value density, weight corresponding to video value, weight corresponding to time urgency, and weight corresponding to residual value density, determine the priority score of the preprocessed video.

For example: the video value of the configured preprocessed video is 3, the time urgency is 2, the remaining value density is 1, the weight corresponding to the video value is 0.3, the weight corresponding to the time urgency is 0.4, and the weight corresponding to the remaining value density is 0.4. The value is 0.3, and the above parameters are weighted and summed to determine the priority of the preprocessed video as 2, and according to the priority score of 2, the priority of the preprocessed video is determined.

In one embodiment, the priority of the preprocessed video includes: urgent or non-urgent, when determining the priority of the preprocessed video according to the priority score, if the priority score is greater than or equal to the preset score, it can be determined The priority of processing video is urgent; if the priority score is less than the preset score, it can be determined that the priority of preprocessing video is non-urgent.

For example: the priority score is 1.4, the preset score is 1.5, and the priority score is less than the preset score, then the priority of the preprocessed video is non-urgent; the priority score is 2, the preset score is 1.5, the priority If the score is greater than the preset score, the priority of preprocessing video is urgent.

It should be noted that the time urgency and residual value density can be changed, and when changes occur, the time urgency and residual value density can be reconfigured.

Step 304: Allocate system resources to the preprocessed video according to the priority of the preprocessed video, so as to process the preprocessed video.

In one embodiment, when the priority of the preprocessed video is urgent, all system resources can be allocated to the preprocessed video to ensure that the preprocessed video with the urgent priority is processed first; if the priority of the preprocessed video is When the priority is non-urgent, system resources are not allocated to the preprocessed video, so as to wait for the processing of the preprocessed video whose priority is urgent to be completed.

In this embodiment of the present application, the priority of the preprocessed video can be determined according to the attribute information, so as to dynamically allocate corresponding system resources to process the preprocessed video.

The embodiment of the present application provides a video processing method, and the method includes the following steps:

Step 401: Obtain the video to be processed through an external interface in the transcoding system;

Step 402: Preprocess the video to be processed according to the video configuration information set based on user requirements to obtain a preprocessed video;

Step 403: Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

Step 404: Adjust the determined priority of the preprocessed video according to the system resource occupancy information, so that the priority of the preprocessed video becomes higher or lower;

Here, the system resources may include a central processing unit (Central Processing Unit, CPU) or memory, and the system resource occupancy information is used to represent the percentage of system resources occupied during video processing. When the system resource is a CPU, the system resource occupancy information is used to represent the CPU usage; when the system resource is memory, the system resource occupancy information is used to represent the memory usage.

After determining the priority of the preprocessed video, determine the percentage of system resource occupancy. If the system resource occupied by the preprocessed video exceeds the threshold, the priority of the preprocessed video can be lowered, so that the priority of the preprocessed video corresponds to If the system resources occupied by the preprocessed video do not exceed the threshold, the priority of the preprocessed video can be increased so that the system resources corresponding to the priority of the preprocessed video do not exceed the threshold range.

Here, when adjusting the priority of the preprocessed video, you can use the nice command to adjust the priority of the preprocessed video.

Step 405 : Allocate system resources to the pre-processed video according to the higher or lower priority, so that the allocated system resources become larger or smaller.

Adjust the priority of the preprocessed video so that the priority of the preprocessed video becomes higher or lower. When the priority of the preprocessed video becomes higher, larger system resources are allocated to the preprocessed video; when the priority of the preprocessed video becomes lower, smaller system resources are allocated to the preprocessed video.

In the embodiment of the present application, the priority of the pre-processed video is adjusted, and system resources are allocated to the pre-processed video through the adjusted priority, so that system resources can be dynamically allocated to the pre-processed video.

The embodiment of the present application provides a video processing method, and the method includes the following steps:

Step 501: Obtain the video to be processed through an external interface in the transcoding system;

Step 502: Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video;

Step 503: Determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

Step 504: Determine the system resource threshold corresponding to the preprocessed video according to the priority of the preprocessed video;

According to the priority of the preprocessed video, in the corresponding relationship between the preprocessed video priority and the system resource threshold, determine the system resource threshold corresponding to the preprocessed video, for example: the priority of the preprocessed video is 1, according to the preprocessed video priority The corresponding relationship with the system resource threshold can determine the system resource threshold 60 corresponding to the preprocessed video.

Before determining the system resource threshold corresponding to the preprocessed video according to the priority of the preprocessed video, the corresponding relationship between the preprocessed video priority and the system resource threshold needs to be set. For example, when the preprocessing video priority is 1, the corresponding system resource threshold is 60; when the preprocessing video priority is 2, the corresponding system resource threshold is 40.

Here, when setting the system resource threshold, you can use the cpulimit command to set the system resource threshold.

Step 505: Allocate system resources to the preprocessed video according to the system resource threshold, so that the system resources corresponding to the preprocessed video do not exceed the system resource threshold.

According to the system resource threshold, system resources equal to or less than the system resource threshold are allocated to the preprocessed video, so that the system resources corresponding to the preprocessed video do not exceed the system resource threshold.

In this embodiment of the present application, system resources can be allocated for preprocessing resources according to a system resource threshold, so that the system resources corresponding to the preprocessed video do not exceed the system resource threshold.

The embodiment of the present application uses a video of digital learning as an example to describe the video processing method provided by the embodiment of the present application.

Digital learning refers to a new learning model in which an Internet platform is established in the field of education, and students learn through the Internet, also known as e-learning or e-learning. The integration of information technology and curriculum with digital learning as the core is different from traditional learning methods. It combines the advantages of traditional teaching methods with the advantages of teaching in a digital environment, and makes the two complement each other. It is the trend of social development and educational learning. major changes.

The addition of digital teaching helps to change the shortcomings of current classroom teaching, enrich learning resources, create a relaxed and harmonious learning atmosphere, activate classroom atmosphere, inspire students' thinking, and enable students to experience the joy of learning and success in active participation and full communication. , so as to effectively improve the effectiveness of school teaching. With the in-depth development of digital teaching and the increase of users, the corresponding learning videos are also increasing exponentially.

Due to the different environments of learning video providers, different shooting facilities, etc., the original video format, definition, bit rate, size, etc. are different. Therefore, it is necessary to perform video transcoding on the original learning video. The video transcoding system in the related art generally uses two tools, the FLV metadata injector (yamdi, Yet Another MetaData Injector for FLV) and the Fast Forward Mpeg (FFmpeg, Fast Forward Mpeg).

yamdi adds a lot of metadata information to FLV files, such as creator, whether there are keyframes, whether there is video, whether there is audio, video height and width, etc.

FFmpeg is a free software that can run multiple formats of audio and video recording, conversion and streaming functions, including: audio and video decoder library libavcodec and audio and video format conversion library libavformat. libavcodec is a decoder library for audio and video in several projects, and libavformat is an audio and video format conversion library.

In the related art, the flow of the transcoding system is shown in FIG. 2 . The transcoding system in the related art is divided into two parts: an external module 21 and an internal module 22 . The two parts are connected by a storage system (database) as a bridge. The client sends the video through the external module, and returns it to the client after the video conversion is completed. The transcoding system scans the database in real time and finds unprocessed videos, and then extracts the videos for video transcoding. Video transcoding is generally divided into two parts: transcoding and adding metadata to files.

There are three main types of transcoding: rate conversion, resolution conversion coding, and syntax transcoding. Among them, rate conversion and resolution conversion are mostly used for transcoding within the same code stream syntax. in:

1) Code rate conversion: Mainly used in TV broadcasting and network transmission, its purpose is: compatibility between specific levels in digital broadcasting; and in network transmission, in the case of ensuring effective transmission, save bandwidth as much as possible.

2) Resolution conversion coding: divided into temporal resolution transcoding and spatial resolution transcoding. It is mainly aimed at some limitations of the user's decoder, such as: real-time processing capability, decoding-end processing capability, and user-end display resolution.

3) Syntax transcoding: mainly due to the different compression standards followed by the input and transcoded streams.

The transcoding mechanism in the related art is relatively complete, but it cannot meet the dynamic requirements of user load, which is mainly reflected in:

1) Different users have different requirements for video conversion response speed in different scenarios. If the user imports by himself, this part of the resource should be relatively fast, so that the user can see and correct the problem of the imported resource in time. The administrator can import in batches. This part of the resources does not have such high real-time requirements and can be processed when the system is idle. 2) Different videos have inconsistent requirements after transcoding. Some videos need to be converted into various videos with different resolutions and different bit rates, while others do not.

The embodiments of the present application solve the problem of dynamically satisfying user needs under the transcoding mechanism of the related art, dynamically distributing system resources and priorities according to priorities, inconsistencies between system resources and transcoding products, and performing intelligent operation of resource transcoding.

The video transcoding modular dynamic processing model is shown in Figure 3, which is divided into an external module 30 and an internal module 31, wherein:

The external module 30 is provided for the client to use. The client does not care about the internal implementation logic, transmits the corresponding video through the external module, and then the transcoding system performs video transcoding, and pushes the transcoded video to the client.

The internal module 31 is divided into different sub-modules, including: video preprocessing module 311, system resource allocation module 312, priority calculation module 313, video storage allocation module 314, video task scheduling module 315, processing allocation module 316, transcoding module 317 and coding module 318, etc. in:

1) The video preprocessing module 311 is used to process basic video information and save it to prepare for the next processing. The processing flow of the resource preprocessing module is shown in Figure 4, including:

Step 41: Input the video into the queue and buffer it;

Step 42: Process the format, bit rate, key frame, etc. of the input video;

Step 43: Output the video through the queue.

2) The system resource allocation module 312 is used to adjust the priority of the video by using the nice command, and the video can be paused by using the cpulimit command, so as to control the processing capacity occupied by the video not to exceed a specific limit. in:

The nice command can modify the priority of the video, so that the video can be run less frequently. This feature is especially useful when running CPU-intensive background processes or batch jobs. The value range of the nice value is [-20, 19], -20 represents the highest priority, and 19 represents the lowest priority. The default nice value for Linux processes is 0. Using the nice command without any parameters, you can set the nice value of the process to 10. In this way, the scheduler will treat this video as a lower priority video, thereby reducing the allocation of CPU resources.

The working principle of the cpulimit command is to preset a cpu usage threshold for the video, and monitor whether the process exceeds this threshold in real time. If it exceeds, the video will be suspended for a period of time. cpulimit uses two signals, SIGSTOP to stop and SIGCONT to continue, to control processes. It does not modify the nice value of the video, but makes dynamic adjustments by monitoring the CPU usage of the video. The advantage of cpulimit is that it can control the upper limit of the cpu usage of the video, but it also has a disadvantage compared with the nice command, that is, even if the cpu is idle, the video cannot fully use the entire cpu resource.

3) The priority calculation module 313 is configured to calculate the priority of the preprocessed video according to the video value, processing urgency (time urgency) or remaining value density.

Various functions of the system are always completed by processing related tasks. However, due to the different importance of each function of the system in the whole system, there are also obvious differences in the importance of each task handled by the system. Obviously, the video value is an inherent attribute of the video itself and has nothing to do with the temporal characteristics of the video; in addition, the value of the video is not generated at the moment when the video processing is completed, but a process that gradually accumulates with the processing of the video.

For various videos in the real-time video system, the processing methods of processing urgency are also different: only consider the urgency of the video that can meet the deadline, and directly process the video that cannot meet the deadline; the urgency of processing the video is equal to its The urgency of the most recent start of processing and remains the same during its processing; the urgency of active and waiting videos increases as their waiting time increases; the processing period of dormant videos has not yet arrived, regardless of their urgency .

Assuming that when the real-time video system starts running, all videos are released at the same time, at this time, the video with the highest basic priority obtains the system processing right first. Then, over time, the priorities of individual videos in the system change dynamically.

For processing video, its processing urgency remains, but its residual value density increases with the increase of processed time, which protects processing video from being preempted by other tasks to a certain extent;

For waiting videos and active videos, their residual value density remains the same, but as their waiting time increases, their processing urgency increases, giving them an opportunity to preempt the system’s processing rights.

In addition, by adjusting the value of the parameter, the influence of the remaining video value density and processing urgency on the video dynamic priority can also be adjusted. Videos with high residual value density will be given priority to receive the processing rights of the system, so it can increase the cumulative value income of the system.

In addition, the residual value density of the processed video increases with the processing time, which can reduce the probability that the processed video is preempted and die prematurely, thereby reducing the number of video preemptions and improving the successful processing rate of the video. If the residual value density is high, the video with high processing urgency will be given priority to obtain the processing right of the system, which can increase the chances of the video with high residual value density participating in the system processing. However, the urgency of waiting for videos or active videos increases with the increase of waiting time, which greatly increases the probability of video preemption, which may cause some videos with high value density to die prematurely and reduce the accumulated value of the system.

4) video storage and distribution module 314, for storing different kinds of videos, such as: storing the video of H.264;

5) The video scheduling module 315 is used for uniformly assigning and calling different modules.

When the video request arrives, the video is divided into non-emergency video and emergency video according to the properties of the video. in:

Non-urgent videos are marked with a quantifiable priority. After entering the video queue, they are queued according to the priority. The video priority in the video queue will increase as the time in the video increases. This can prevent the problem of starvation, that is, a video with a low priority cannot get the transcoding service because it is always ranked behind a video with a high priority.

Urgent video has a very high priority and can bypass the general video queue and directly request computing resources to complete the transcoding. When the available computing resources are insufficient, other ongoing non-emergency video tasks can be suspended through scheduling to free up enough computing resources to serve the urgent video task, ensuring that the emergency video task is completed within a relatively short time. The processing flow of the module is shown in Figure 5, which includes:

Step 51: After the video preprocessing module 311 preprocesses the video, the priority calculation module 313 calculates the priority of the video to obtain emergency tasks and non-emergency tasks;

Step 52: For non-urgent tasks, the priority calculation module 313 caches the non-urgent tasks in the task queue 319, and for urgent tasks, allocates resources to the urgent tasks through the system resource allocation module 315;

Step 53: The video scheduling module 315 schedules urgent tasks and non-urgent tasks, and the system resource allocation module 315 allocates resources to the urgent tasks so that the video transcoding module 317 performs transcoding processing on the urgent tasks;

Step 54: The system resource allocation module 315 allocates resources to the urgent tasks so that the video coding module 318 performs coding processing on the urgent tasks. After the urgent tasks are processed, the system resources are dispatched to process the non-urgent tasks.

6) The processing and distribution module 316 is used for processing and distribution of the video, so that it is processed by the transcoding module or the coding module.

7) A transcoding module 317, configured to perform transcoding processing on the video.

8) The coding module 318 is used for coding the video.

The video transcoding modular dynamic processing model transcodes the video as follows:

Step 61: the video receiving module receives the video sent by the client, and stores the video in the storage system;

Step 62: Configure the video preprocessing module according to user requirements, send the configuration information to the video storage and distribution module, and the video storage and distribution module searches for the video corresponding to the configuration information in the storage system through video task scheduling, and returns to the video storage and distribution module. in the module;

Step 63: the video preprocessing module processes the returned video;

Step 64: the video scheduling module calls the priority calculation module to calculate the priority of the video;

Step 65: According to the priority obtained by calculation, the system resource allocation module allocates system resources to the video;

Step 66: The processing allocation module determines that the video is processed by the transcoding module or the coding module;

Step 67: Use the allocated system resources to perform transcoding or coding processing on the video, and after the processing is completed, return the video to the storage system and send it to the client.

With the development of network and multimedia applications, the exchange of information between heterogeneous networks is increasing. In the field of digital video communication at this stage, a variety of image standards coexist. Except for different syntax formats, these image standards have different advantages in compression efficiency, bit rate, etc. The compression formats are different, and they are aimed at specific applications, the network environment, the corresponding decoder performance or display capabilities are different, the importance of the video transcoding system is increasingly prominent. The technical effects of the embodiments of the present application mainly include the following contents:

Dynamically allocate resources to videos through the video of the system: Dynamically add videos and assign video priorities by analyzing the current CPU and memory usage of the system.

Dynamically assign transcoding priority through video attributes: Different videos have different priorities, and the video queue priority is dynamically adjusted through the video's own priority attribute.

The mobile network-oriented video transcoding system implemented in the embodiments of the present application provides pure software real-time code reduction rate and resolution reduction through an efficient transcoding algorithm, with less loss of transcoding quality, high real-time performance, low cost, and scalability. Sex and flexibility. Aiming at the real-time requirements of transcoding, an adaptive strategy for delay guarantee is proposed, which solves the key technical problems of computational complexity and transcoding quality balance, and thus achieves high-efficiency transcoding.

Modular architecture, easy to expand: According to the scale of transcoding and the number of transcoded videos, resources such as hosts can be dynamically added for system expansion.

After the business is divided into modules, the business modules are decoupled. Therefore, each is an independent module, and there is no dependency between them. Each module is responsible for different functions, different business logic, and business decoupling between modules. The function of the module is relatively simple and can be used in multiple projects. Each module is actually a complete project, which can be compiled and debugged separately.

An embodiment of the present application provides a resource processing apparatus. FIG. 6 is a schematic diagram of the composition and structure of the resource processing apparatus according to an embodiment of the present application. As shown in FIG. 6 , the resource processing apparatus 60 includes: an acquisition module 601 , a preprocessing module 602 , a first Determining module 603 and assigning module 604; wherein,

an acquisition module 601, configured to acquire the video to be processed through an external interface in the transcoding system;

A preprocessing module 602, configured to preprocess the video to be processed according to the video configuration information set based on user requirements, to obtain a preprocessed video;

a first determination module 603, configured to determine the priority of the preprocessed video according to the attribute information of the preprocessed video;

The allocation module 604 is configured to allocate system resources to the preprocessed video according to the priority of the preprocessed video, so as to process the preprocessed video.

In other embodiments, the apparatus 60 further includes: a second determining module, configured to determine the type of the video to be processed according to the video configuration information;

Correspondingly, the obtaining module 601 is configured to obtain the video to be processed through an external interface in the transcoding system according to the type of the video to be processed.

In other embodiments, the video configuration information includes: target format, target bit rate or target key frame information, and the preprocessing module includes: a format preprocessing unit, a bit rate preprocessing unit or a key frame preprocessing unit; wherein :

a format preprocessing unit, configured to adjust the format of the video to be processed to the target format to obtain a preprocessed video;

Or, a code rate preprocessing unit, configured to adjust the code rate of the to-be-processed video to the target code rate to obtain a preprocessed video;

Or, a key frame preprocessing unit, configured to add key frames to the to-be-processed video according to the target key frame information to obtain a pre-processed video.

In other embodiments, the attribute information includes: video value and time urgency, and the apparatus further includes: a first configuration module configured to configure the video value, time urgency, and video value of the preprocessed video the corresponding weight and the weight corresponding to the time urgency;

Correspondingly, the first determination module includes: a first determination unit and a second determination unit; wherein:

a first determining unit, configured to determine the priority score of the preprocessed video according to the video value, the time urgency, the weight corresponding to the video value, and the weight corresponding to the time urgency;

A second determining unit, configured to determine the priority of the preprocessed video according to the priority score.

In other embodiments, the attribute information further includes: remaining value density, and the apparatus 60 further includes: a second configuration module configured to configure the remaining value density of the preprocessed video and the weight corresponding to the remaining value density value;

Correspondingly, the first determination unit is configured to determine the value according to the video value, the time urgency, the remaining value density, the weight corresponding to the video value, the weight corresponding to the time urgency, and the remaining value. The weight corresponding to the value density determines the priority score of the preprocessed video;

A second determining unit, configured to determine the priority of the preprocessed video according to the priority score.

In other embodiments, the priority of the preprocessed video includes: urgent or non-urgent; the second determination unit includes: a first determination subunit and a second determination subunit; wherein: the first determination subunit, using When the priority score is greater than or equal to a preset score, determine that the priority of the preprocessed video is urgent; a second determination subunit is used to determine if the priority score is less than the preset score. The priority of the preprocessed video is non-urgent;

Correspondingly, the allocating module includes: a first allocating unit and a second allocating unit; wherein: the first allocating unit is configured to allocate all system resources to the preprocessed video if the priority of the preprocessed video is urgent, so as to It is guaranteed that the preprocessed video whose priority is urgent is processed first; the second allocation unit is used to not allocate system resources to the preprocessed video if the priority of the preprocessed video is not urgent, and wait for the priority to be Urgent preprocessing video processing completed.

In other embodiments, the distribution module includes: an adjustment unit and a third distribution unit; wherein,

an adjustment unit, configured to adjust the determined priority of the preprocessed video according to the system resource occupancy information, so that the priority of the preprocessed video becomes higher or lower;

The third allocating unit is configured to allocate system resources to the preprocessed video according to the priorities that become higher or lower, so that the allocated system resources become larger or smaller.

In other embodiments, the allocation module includes: a third determination unit and a fourth allocation unit; wherein,

a third determination unit, configured to determine a system resource threshold corresponding to the preprocessed video according to the priority of the preprocessed video;

A fourth allocation unit, configured to allocate system resources to the preprocessed video according to the system resource threshold, so that the system resources corresponding to the preprocessed video do not exceed the system resource threshold.

It should be noted that, when the video processing apparatus provided in the above-mentioned embodiments performs video processing, only the division of the above-mentioned program modules is used for illustration. That is, the internal structure of the device is divided into different program modules to complete all or part of the processing described above. In addition, the video processing apparatus and the video processing method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

FIG. 7 is a schematic structural diagram of a video processing device according to an embodiment of the present application. As shown in FIG. 7 , the apparatus includes a processor 702 and a memory 701 for storing a computer program that can run on the processor 702; When the processor 702 is configured to run the computer program, the steps in the video processing methods provided in the above embodiments are implemented.

It should be pointed out here that the descriptions of the above terminal embodiments are similar to the descriptions of the above methods, and have the same beneficial effects as the method embodiments, so they will not be repeated. For technical details that are not disclosed in the terminal embodiments of the present application, those skilled in the art should refer to the description of the method embodiments of the present application to understand, and to save space, details are not repeated here.

In an exemplary embodiment, an embodiment of the present application further provides a storage medium, specifically a computer-readable storage medium, for example, including a memory 701 for storing a computer program, and the computer program can be processed by the processor 702 to complete the aforementioned method. the steps described above. The computer-readable storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, FlashMemory, magnetic surface memory, optical disk, or CD-ROM.

Embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is processed by a processor, implements the steps in the video processing method provided in the foregoing embodiments.

It should be pointed out here that the descriptions of the above computer medium embodiments are similar to the descriptions of the above methods, and have the same beneficial effects as those of the method embodiments, so they will not be repeated. For technical details that are not disclosed in the terminal embodiments of the present application, those skilled in the art should refer to the description of the method embodiments of the present application to understand, and to save space, details are not repeated here.

The methods disclosed in the above embodiments of the present application may be applied to the processor, or implemented by the processor. The processor may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method may be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above-mentioned processor may be a general-purpose processor, a DSP, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The processor may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of this application. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, and the storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the foregoing method in combination with its hardware.

It can be understood that the memory (memory) in this embodiment of the present application may be a volatile memory or a nonvolatile memory, and may also include both a volatile memory and a nonvolatile memory. Among them, the non-volatile memory may be a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-only memory) Only Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Magnetic Random Access Memory (FRAM, ferromagnetic random access memory), Flash Memory (FlashMemory), Magnetic Surface Memory, Optical disk, or Compact Disc Read-Only Memory (CD-ROM); the magnetic surface memory can be a magnetic disk memory or a magnetic tape memory. The volatile memory may be random access memory (RAM, Random Access Memory), which is used as an external cache memory. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory Memory (DRAM, Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM, Synchronous Dynamic Random Access Memory), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), Enhanced Type Synchronous Dynamic Random Access Memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), Synchronous Link Dynamic Random Access Memory (SLDRAM, SyncLink Dynamic Random Access Memory), Direct Memory Bus Random Access Memory (DRRAM, Direct Rambus Random Access Memory). The memories described in the embodiments of the present application are intended to include, but not be limited to, these and any other suitable types of memories.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.

Claims (10)

1. a video processing method, is characterized in that, described method comprises: Obtain the video to be processed through the external interface in the transcoding system; Preprocessing the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video; Determine the priority of the preprocessed video according to the attribute information of the preprocessed video; Allocate system resources to the preprocessed video according to the priority of the preprocessed video to process the preprocessed video; The allocating system resources to the preprocessed video according to the priority of the preprocessed video includes: Adjusting the determined priority of the preprocessed video according to the system resource occupancy information, so that the priority of the preprocessed video becomes higher or lower; According to the higher or lower priority, system resources are allocated to the preprocessed video, so that the allocated system resources become larger or smaller. 2. The method according to claim 1, wherein before acquiring the video to be processed through an external interface in the transcoding system, the method further comprises: According to the video configuration information, determine the type of the video to be processed; Correspondingly, obtaining the video to be processed through the external interface in the transcoding system includes: According to the type of the video to be processed, the video to be processed is acquired through an external interface in the transcoding system. 3. The method according to claim 1, wherein the video configuration information comprises: target format, target bit rate or target key frame information, the video configuration information set based on user requirements, Process the video for preprocessing to obtain a preprocessed video, including: Adjusting the format of the video to be processed to the target format to obtain a preprocessed video; or, adjusting the code rate of the video to be processed to the target code rate to obtain a preprocessed video; or, A key frame is added to the to-be-processed video according to the target key frame information to obtain a preprocessed video. 4. The method according to claim 1, wherein the attribute information comprises: video value and time urgency, and before determining the priority of the preprocessed video according to the attribute information of the preprocessed video , the method also includes: Configure the video value, the time urgency, the weight corresponding to the video value and the weight corresponding to the time urgency of the preprocessed video; Correspondingly, determining the priority of the preprocessed video according to the attribute information of the preprocessed video includes: Determine the priority score of the preprocessed video according to the video value, the time urgency, the weight corresponding to the video value, and the weight corresponding to the time urgency; The preprocessed video is prioritized according to the priority score. 5. The method according to claim 4, wherein the attribute information further comprises: residual value density, before determining the priority of the preprocessed video according to the attribute information of the preprocessed video, the The method also includes: Configuring the remaining value density of the preprocessed video and the weight corresponding to the remaining value density; Correspondingly, according to the video value, the time urgency, the remaining value density, the weight corresponding to the video value, the weight corresponding to the time urgency, and the weight corresponding to the remaining value density, A priority score for the preprocessed video is determined. 6. The method according to claim 4 or 5, wherein the priority of the preprocessed video comprises: urgent or non-urgent; the priority of the preprocessed video is determined according to the priority score Including: if the priority score is greater than or equal to a preset score, determining that the priority of the preprocessed video is urgent; if the priority score is less than a preset score, determining the priority of the preprocessed video Class is non-emergency; Correspondingly, the allocating system resources to the preprocessed video according to the priority of the preprocessed video includes: if the priority of the preprocessed video is urgent, allocating all system resources to the preprocessed video to Ensure that the preprocessed video with the priority priority is processed first; if the priority of the preprocessed video is non-urgent, system resources are not allocated to the preprocessed video to wait for the urgent preprocessed video to be processed. . 7. The method according to claim 1, wherein the allocating system resources to the preprocessed video according to the priority of the preprocessed video comprises: According to the priority of the preprocessed video, determine the system resource threshold corresponding to the preprocessed video; According to the system resource threshold, system resources are allocated to the preprocessed video, so that the system resources corresponding to the preprocessed video do not exceed the system resource threshold. 8. A video processing device, characterized in that the device comprises: an acquisition module, a preprocessing module, a first determination module and an allocation module; wherein, The acquisition module is used to acquire the video to be processed through an external interface in the transcoding system; The preprocessing module is configured to preprocess the to-be-processed video according to the video configuration information set based on user requirements to obtain a preprocessed video; The first determination module is configured to determine the priority of the preprocessed video according to the attribute information of the preprocessed video; the allocation module, configured to allocate system resources to the preprocessed video according to the priority of the preprocessed video, so as to process the preprocessed video; The distribution module includes: an adjustment unit and a third distribution unit; wherein, The adjustment unit is configured to adjust the determined priority of the preprocessed video according to the system resource occupancy information, so that the priority of the preprocessed video becomes higher or lower; The third allocating unit is configured to allocate system resources to the pre-processed video according to the priorities that become higher or lower, so that the allocated system resources become larger or smaller. 9. A video processing device, characterized in that it comprises a processor and a memory for storing a computer program that can be run on the processor; wherein, when the processor is used to run the computer program, it executes claims 1 to 1. 7 the steps of any one of the methods. 10. A storage medium on which a computer program is stored, characterized in that, when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images