CN117425086A - Multimedia data processing method and device, electronic equipment and storage medium - Google Patents

Abstract

The embodiment of the disclosure provides a method and a device for processing multimedia data, electronic equipment and a storage medium. The method comprises the steps of obtaining original multimedia data; acquiring a reference image; and adjusting the image frames in the original multimedia data according to the display attributes of the reference images to obtain target multimedia data, and displaying the target multimedia data, wherein the target multimedia data comprises an image frame sequence which is adjusted based on the display attributes of the reference images in the original multimedia data. According to the embodiment of the disclosure, the display style of the original multimedia data is adjusted based on the color style of the reference image, so that the target multimedia data presents a display effect similar to that of the reference image, the step of manually adjusting the display attribute is omitted, and the color mixing efficiency is improved. Because the reference image can intuitively present the color matching result wanted by the user, the adjustment accuracy can be improved by adjusting the original multimedia data based on the display attribute of the reference image, and repeated parameter modification is avoided.

Description

Multimedia data processing method, device, electronic equipment and storage medium

Technical field

Embodiments of the present disclosure relate to image technology, and in particular, to a multimedia data processing method, device, electronic device, and storage medium.

Background technique

With the popularization of mobile terminals and the Internet, more and more users can capture multimedia data and share multimedia data through the Internet.

Before sharing, users may need to adjust the color style of the multimedia data to obtain a color grading result that meets the requirements. The current color grading method mainly adjusts parameters through manual settings, which makes it difficult to quickly and accurately obtain color grading results that meet color grading requirements.

Contents of the invention

Embodiments of the present disclosure provide a multimedia data processing method, device, electronic device, and storage medium, which can improve color grading efficiency and accuracy.

In a first aspect, embodiments of the present disclosure provide a multimedia data processing method, including:

Obtain original multimedia data;

Get reference image;

Adjust the image frames in the original multimedia data according to the display attributes of the reference image, obtain target multimedia data, and display the target multimedia data, wherein the target multimedia data includes the original multimedia data based on the reference image. A sequence of image frames whose display properties are adjusted.

In a second aspect, embodiments of the present disclosure also provide a multimedia data processing device, which includes:

Data acquisition module, used to obtain original multimedia data;

Image acquisition module, used to acquire reference images;

An image adjustment module, configured to adjust image frames in the original multimedia data according to the display attributes of the reference image, obtain target multimedia data, and display the target multimedia data, wherein the target multimedia data includes the original multimedia data. A sequence of image frames adjusted based on the display attributes of the reference image.

In a third aspect, embodiments of the present disclosure also provide an electronic device, where the electronic device includes:

one or more processors;

a storage device for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the multimedia data processing method described in any embodiment of the present disclosure.

In a fourth aspect, embodiments of the present disclosure further provide a storage medium containing computer-executable instructions that, when executed by a computer processor, are used to perform processing of multimedia data as described in any embodiment of the present disclosure. Approach.

Embodiments of the present disclosure provide a multimedia data processing method, device, electronic device and storage medium. By adjusting the image frames in the original multimedia data with reference to the display attributes of the image, the target multimedia data is obtained and the target multimedia data is displayed, thereby achieving The display style of the original multimedia data is adjusted based on the color style of the reference image, so that the target multimedia data presents a display effect similar to that of the reference image, omitting the step of manually adjusting the display attributes, and improving the color adjustment efficiency. Since the reference image can intuitively present the color grading results desired by the user, adjusting the original multimedia data based on the display attributes of the reference image can improve the adjustment accuracy and avoid repeated modification of parameters.

Description of the drawings

The above and other features, advantages, and aspects of various embodiments of the present disclosure will become more apparent with reference to the following detailed description taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It is to be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

Figure 1 is a schematic flowchart of a multimedia data processing method provided by an embodiment of the present disclosure;

Figure 2 is a schematic flowchart of another multimedia data processing method provided by an embodiment of the present disclosure;

Figure 3 is a schematic diagram of a reference image superimposed on an image frame of original multimedia data provided by an embodiment of the present disclosure;

Figure 4 is a schematic diagram of superimposing line material on a reference image provided by an embodiment of the present disclosure;

Figure 5 is a schematic diagram of a color block special effect provided by an embodiment of the present disclosure;

Figure 6 is a schematic diagram of a color block shift provided by an embodiment of the present disclosure;

Figure 7 is a schematic structural diagram of a multimedia data processing device provided by an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, which rather are provided for A more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that various steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as “first” and “second” mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or Multiple”.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

It can be understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of corresponding laws, regulations and related regulations.

Figure 1 is a schematic flowchart of a multimedia data processing method provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation of video color grading. The method can be executed by a multimedia data processing device, and the device can be executed through software. And/or implemented in the form of hardware, optionally, implemented through electronic equipment. The electronic equipment may be a mobile terminal, PC or server, etc.

As shown in Figure 1, the method includes:

S110. Obtain original multimedia data.

The original multimedia data may be videos or images selected by the user to be color-corrected.

In some embodiments, historical videos in the client may be specified as original multimedia data. Alternatively, the multimedia data captured by the user in real time can be obtained as the original multimedia data. Alternatively, the multimedia data selected by the user from the local photo album can also be obtained as the original multimedia data.

For example, the original multimedia data is obtained, the original multimedia data is played, and the display attributes of the original multimedia data are adjusted without interrupting the playback.

S120. Obtain the reference image.

Wherein, the reference image represents a reference image for adjusting the display attribute of the image frame of the original multimedia data. In the embodiment of the present disclosure, the reference image may be an image uploaded by the user that meets the color grading requirements. The reference image may be an image taken by a user or an image downloaded from the Internet. The embodiment of the present disclosure does not limit the source of the reference image.

For example, after detecting that the color correction function is turned on and obtaining the original multimedia data selected by the user to be color corrected, the reference image uploaded by the user is obtained. Since the display style of the reference image meets the user's color grading needs, it is possible to avoid the steps of repeatedly modifying parameters in the manual color grading process in order to obtain a color grading result that meets the color grading requirements, thereby improving the color grading efficiency.

S130. Adjust the image frames in the original multimedia data according to the display attributes of the reference image to obtain target multimedia data, and display the target multimedia data.

Wherein, the display attribute represents the display effect of the reference image in aspects such as color and brightness. For example, display attributes may include brightness attributes, color attributes, etc.

The target multimedia data can represent the color correction result of the original multimedia data, the target multimedia data includes a sequence of image frames in the original multimedia data adjusted based on the display attributes of the reference image, and the target multimedia data appears similar to the reference image. display effect.

For example, for the reference image and the image frame in the original multimedia data, the target pixel interval corresponding to the image is determined according to the display attribute respectively.

For each target pixel interval, perform attribute matching on the image frames in the original multimedia data based on the display attributes of the pixels of the reference image, and fuse the attribute matching results corresponding to each target pixel interval to obtain the Multimedia data processing results corresponding to image frames. Among them, attribute matching may include matching attributes such as color and brightness. The attribute matching result represents the processing result of transferring the attribute characteristics of the reference image to the image frame of the original multimedia data. By migrating the attribute features of the reference image to the image frames of the original multimedia data, the image frames of the original multimedia data present display attributes similar to those of the reference image.

For each pixel in the skin color area in the image frame of the original multimedia data, adjust the display attribute of the pixel according to the display attribute of the reference image to obtain the skin color adjustment result corresponding to the image frame.

For the image frames in the original multimedia data, the skin color adjustment result and the multimedia data processing result are fused according to the skin color weight to obtain target multimedia data. Wherein, the skin color weight represents the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area.

In the embodiment of the present disclosure, color space conversion is performed on the reference image and the image frame of the original multimedia data respectively. Based on the color space conversion results, the brightness channel data of the image frame of the reference image and the original multimedia data are obtained respectively. Histograms corresponding to the image frames of the reference image and the original multimedia data are respectively determined according to the brightness channel data. According to the number of pixels corresponding to each brightness value in the histogram of the reference image, the brightness segmentation points corresponding to the reference image are determined, and then the reference image is segmented into multiple target pixel intervals according to the brightness segmentation points corresponding to the reference image. According to the number of pixels corresponding to each brightness value in the histogram of the image frame of the original multimedia data, determine the brightness segmentation point corresponding to the image frame in the original multimedia data, and then divide the image frame according to the brightness segmentation point corresponding to the image frame. Divide it into multiple target pixel intervals. For example, the target pixel interval includes shadow interval, midtone interval, highlight interval, etc.

In some embodiments, the pixels of the reference image are counted according to the brightness attributes, the brightness division points are determined according to the pixel statistics results, and then the reference image is divided into several target pixel intervals according to the brightness division points. The number of target pixel intervals is determined based on the number of brightness division points, and adjacent target pixel intervals have overlapping areas.

In some embodiments, the reference image is converted into a YUV color space, the Y channel data is determined as a brightness attribute, and a histogram of the Y channel of the reference image is generated through the Y channel data. Determine the pixels for shadows, midtones, and highlights based on each brightness value in the histogram of the Y channel. Determine alternative split points so that shadows, midtones, and highlights have the same number of pixels. Alternatively, determine alternative split points so that the shadow, midtone, and highlight intervals are all the same area.

In order to avoid color jumps in the pixels corresponding to the backup split points, a certain range can be staggered between adjacent intervals so that adjacent intervals have overlapping areas. The area of the overlapping areas can be set according to the actual application scenario. For example, the overlapping area can be set to n times the area of the color area corresponding to the reference image, and 0<n<1.

The brightness segmentation point is determined based on the brightness value corresponding to the starting point and the brightness value corresponding to the end point of each overlapping area. Taking the target pixel interval as an example, including the shadow interval, midtone interval and highlight interval, there are two overlapping areas, namely the overlapping area between the shadow interval and the midtone interval and the overlapping area between the midtone interval and the highlight interval. There are four brightness divisions. Points are S1, S2, S3 and S4 respectively, and S1＜S2＜S3＜S4, the range of shadow interval [0, S2], the range of midtone interval [S1, S4], the range of highlight interval [S3, 255 ].

A method similar to the above method is used to determine the brightness segmentation point and the range of the target pixel interval of the image frame in the original multimedia data, which will not be described again here.

For each pixel of the image frame in the original multimedia data, if the pixel belongs to the overlapping area of the target pixel interval, then according to the brightness attribute of the pixel and the brightness segmentation point corresponding to the overlapping area, determine the distance between the pixel and each pixel. The first weight corresponding to the target pixel interval.

Alternatively, if the pixel belongs to a non-overlapping area of the target pixel interval, the first weight corresponding to the pixel and each target pixel interval is determined according to the target pixel interval to which the pixel belongs.

After determining the brightness dividing point, for each pixel of the image frame in the original multimedia data, several first weights may be determined for its brightness, where the number of first weights is consistent with the number of target pixel intervals. For example, if the image frames in the original multimedia data are divided into shadow intervals, midtone intervals and highlight intervals, the three first weights of each pixel in the image frames in the original multimedia data can be calculated, that is, the pixels correspond to the shadow intervals. The shadow weight W _shadow , the midtone weight W _mid of the pixel corresponding to the midtone interval, and the highlight weight W _highlight of the pixel corresponding to the highlight interval, and the sum of the three weights is 1.

For each pixel of the image frame in the original multimedia data, if the brightness of the pixel is completely in the shadow interval, the first weight of the pixel corresponding to the shadow interval is W _shadow =1, and the first weight of the pixel corresponding to the midtone interval is W _mid =0, the first weight corresponding to the highlight interval of this pixel is W _highlight =0. The first weight of the pixel completely in the midtone interval and the highlight interval can be determined in the same way, which will not be described again here.

If the brightness of the pixel belongs to the overlapping area of the shadow interval and the midtone interval, the pixel has both a shadow weight and a midtone weight. According to the brightness of the pixel and the brightness dividing points (S1 and S2) of the overlapping area, Brightness, determine the first weight W _shadow of the pixel corresponding to the shadow interval, determine the first weight W _mid of the pixel corresponding to the midtone interval, determine the first weight W _highlight =0 of the pixel corresponding to the highlight interval .

The first weight corresponding to the reference image can be determined using a similar method as described above, which will not be described again here.

In some embodiments, for each target pixel interval, attribute matching is performed on the image frames in the original multimedia data based on the display attributes of the pixels of the reference image, and the attribute matching corresponding to each target pixel interval is merged. As a result, the multimedia data processing results corresponding to the image frames are obtained, including:

Perform brightness matching on the image frames in the original multimedia data based on the brightness attribute of the reference image to obtain a brightness matching result of the image frames in the original multimedia data. In order to match image brightness and color separately, the image frames in the original multimedia data are converted into YUV color space, the UV channel is color matched, and the Y channel is brightness matched. For example, a histogram matching algorithm is used to perform histogram matching between the Y channel of the image frame in the original multimedia data and the Y channel of the reference image to obtain a brightness matching result.

The color features and transformation matrix corresponding to the target pixel interval are determined according to the color attributes of each target pixel interval, wherein the color features represent the targets respectively corresponding to the image frames and reference images in the original multimedia data. The color distribution of pixels in the pixel interval. In the embodiment of the present disclosure, color features may include UV channel mean, covariance matrix, etc.

For the image frames and reference images in the original multimedia data, obtain the UV channel data of the pixels in the shadow interval, midtone interval and highlight interval respectively, calculate the UV mean and covariance matrix based on the UV channel data, and then, according to the UV mean and covariance The matrix determines the transformation matrix M.

In some embodiments, determining the color characteristics and transformation matrix corresponding to the target pixel interval according to the color attribute of each target pixel interval includes:

Determine the first color mean and the first covariance matrix corresponding to the target pixel interval according to the color attributes of the pixels in each target pixel interval of the image frame in the original multimedia data;

Determine the second color mean and the second covariance matrix corresponding to the target pixel interval according to the color attributes of the pixels in each target pixel interval of the reference image;

The transformation matrix corresponding to the target pixel interval is determined according to the first color mean, the second color mean, the first covariance matrix and the second covariance matrix, and the color features include the first color mean and the second color mean.

Taking the shadow interval as an example, for all pixels whose brightness is in the shadow interval, calculate the UV channel mean of all shadow pixels in the image frame in the original multimedia data Covariance matrix ∑ _src , where the first color mean can be expressed as/> and/> The first covariance matrix can be expressed as Σ _src . Calculate the mean UV channel of all shadow pixels in the reference image/> Covariance matrix Σ _ref , where the second color mean can be expressed as/> and/> The second covariance matrix can be expressed as ∑ _ref . The MKL algorithm is used to determine the transformation matrix M based on the above mean and covariance matrices.

In some embodiments, after determining the first color mean and the first covariance matrix corresponding to the target pixel interval, the method further includes:

Determine the eigenvalues of the first covariance matrix, wherein the eigenvalues represent the shape of an ellipse in which the pixels of the image frame in the original multimedia data are presented according to a Gaussian distribution;

When the eigenvalues satisfy the set conditions, the identity matrix is used as the transformation matrix.

Among them, the preset conditions represent the shape threshold of the ellipse presented by the Gaussian distribution in the pixels of the image frames in the original multimedia data. If the color transformation is performed on the Gaussian distribution that exceeds the shape threshold, color outliers may occur, and the calculation of the transformation based on the covariance matrix is abandoned. matrix, but set the transformation matrix M to the identity matrix.

For example, the eigenvalues e1 and e2 of the covariance matrix are determined according to the covariance matrix ∑ _src of the image frame in the original multimedia data, and e1>e2. The eigenvalues of the covariance matrix represent the pixels of the image frame in the original multimedia data according to The Gaussian distribution presents an ellipse with a major axis e1 and a minor axis e2. If e1/e2>set the shape threshold, it means that the ellipse presented by the Gaussian distribution is very flat. At this time, if the Gaussian distribution is color transformed, it is easy to produce color abnormal points. At this time, the transformation matrix M is set to the unit matrix.

Using the above method, the first color average value of the image frame in the original multimedia data in the shadow interval, midtone interval and highlight interval can be calculated respectively, which is and/> and/> and/> And, respectively calculate the covariance matrices of the image frames in the original multimedia data in the shadow interval, midtone interval and highlight interval, which are ∑ _src0 , ∑ _src1 , ∑ _src2 ; and, respectively calculate the image frames in the original multimedia data. Transformation matrices M ₀ , M ₁ , and M ₂ in the shadow interval, midtone interval, and highlight interval.

Color matching is performed on each target pixel interval corresponding to the image frame in the original multimedia data according to the color feature and the transformation matrix.

Exemplarily, for each target pixel interval of the image frame in the original multimedia data, the second weight corresponding to the pixel is determined according to the color information and the first color mean of the pixel in the target pixel interval.

Among them, the second weight represents the degree of deviation of the color of the pixel from the mean value in the Gaussian distribution. The smaller the second weight is, it means that the color value of the pixel deviates from the mean value of the Gaussian distribution. The larger the second weight is, the color value of the pixel is closer to the mean of the Gaussian distribution.

Taking the shadow interval as an example, the color information uv of the pixels in the UV channel of the shadow interval of the image frame in the original multimedia data can be expressed as a two-dimensional vector, The first color mean of the shadow interval of the image frame in the original multimedia data/> It can be expressed as/> According to the color information uv of the pixel, the first color mean/> and the first covariance matrix ∑ _src0 to calculate the second weight. A similar method is used to calculate the second weight corresponding to the pixels in the midtone interval and highlight interval, which will not be described again here.

Color matching is performed on the target pixel interval according to the color characteristics and the transformation matrix, and a first color matching result and a second color matching result corresponding to the target pixel interval are obtained. For example, color matching can be performed on the target pixel interval of the image frame in the original multimedia data based on the transformation matrix to obtain the first color matching result. The first color matching result may be new color information obtained after performing color transformation on the target pixel interval of the image frame in the original multimedia data based on the transformation matrix. Based on the color of the pixel in the image frame in the original multimedia data, the first color mean corresponding to the target pixel interval to which the pixel belongs, and the second color mean corresponding to the target pixel interval in the image, the second color matching is determined result. The second color matching result may be new color information obtained by adjusting the color information of the target pixel interval based on the color average of the image frame in the original multimedia data and the reference image in the target pixel interval.

Taking the shadow interval as an example, perform color transformation on each pixel of the image frame in the original multimedia data in the shadow interval based on the transformation matrix to obtain new color information as the first color matching result. Based on the color average of the image frame in the original multimedia data and the reference image in the shadow interval, the color information of each pixel in the shadow interval of the image frame in the original multimedia data is adjusted to obtain new color information as the second color matching result. For example, the color information uv of the pixels of the image frame in the original multimedia data is combined with the transformation matrix M ₀ corresponding to the shadow interval to obtain the first color matching result corresponding to the shadow interval, thereby migrating the color style of the reference image to the original multimedia data. image frame. The color information uv of the pixels of the image frame in the original multimedia data minus the uv of the image frame in the original multimedia data Then superimpose the reference image/> Obtain the second color matching result corresponding to the shadow interval. Among them,/> Represents the second color mean value of the shadow interval of the reference image, which can be expressed as/>

The first color matching result and the second color matching result are merged according to the second weight to obtain the color matching result of the target pixel interval.

Taking the shadow interval as an example, the fusion coefficient is determined according to the second weight, and the first color matching result and the second color matching result corresponding to the shadow interval are fused according to the fusion coefficient to obtain the color matching result of the shadow interval. Among them, the fusion coefficient includes the second weight, and the sum of each fusion coefficient is 1. The color matching results of the midtone range and the color matching results of the highlight range are calculated in a similar manner, which will not be described again here.

It should be noted that for pixels in the image frames in the original multimedia data whose brightness completely belongs to the shadow interval, midtone interval or highlight interval, only the color matching results of the shadow interval exist. For pixels whose brightness belongs to the overlapping area of the shadow interval and the midtone interval in the image frame in the original multimedia data, there are color matching results for the shadow interval and color matching results for the midtone interval. For pixels in the image frame in the original multimedia data whose brightness belongs to the overlapping area of the midtone interval and the highlight interval, there is a color matching result for the midtone interval and a color matching result for the highlight interval.

For each pixel of the image frame in the original multimedia data, the color matching result of the target pixel interval is fused according to the first weight corresponding to the pixel and each target pixel interval to obtain the image in the original multimedia data. The color matching result of the frame; determine the processing result image of the image frame in the original multimedia data according to the color matching result and brightness matching result of the image frame in the original multimedia data, as the multimedia data processing result corresponding to the image frame.

In some embodiments, for each pixel of the image frame in the original multimedia data, the first weight (i.e., shadow weight, middle) corresponding to each target pixel interval (i.e., shadow interval, midtone interval, and highlight interval) is determined according to the pixel. Adjustment weight and highlight weight), fuse the color matching results of the pixel in the corresponding target pixel interval (ie, shadow weight, midtone weight and highlight weight) to obtain the color matching result of the image frame in the original multimedia data.

For example, for each pixel of the image frame in the original multimedia data, according to the shadow weight, midtone weight and highlight weight of the pixel, the color matching results of the pixel in the shadow interval and the color matching of the pixel in the midtone interval are merged. As a result, and the color matching result of the pixel in the highlight interval, the color matching result of the image frame in the original multimedia data is obtained.

In some embodiments, for the pixels in the skin color area in the image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the display attributes of the skin color area of the reference image to obtain the skin color adjustment result corresponding to the image frame. ,include:

Determine the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area, as the skin color weight, determine the pixels included in the skin color area in the image frame of the original multimedia data according to the skin color weight;

Determine the display attribute mean value of the skin color area in the image frame of the original multimedia data according to the display attributes of the pixels contained in the skin color area in the image frame of the original multimedia data;

For the pixels in the skin color area in the image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the average display attributes of the image frame and the reference image in the skin color area, and the skin color adjustment result corresponding to the image frame is obtained. .

Among them, the skin color adjustment result represents the processing result of migrating the color and brightness characteristics of the reference image to the skin color area in the image frame of the original multimedia data.

Exemplarily, the original multimedia data is input into the skin color segmentation model, and the skin color segmentation model is used to perform skin color segmentation on the image frames in the original multimedia data. The probability that each pixel in the image frame belongs to the skin color area is obtained, and the probability is determined based on the probability. The pixels contained in the skin tone area of the image frame in the original multimedia data. Similarly, the reference image is input into the skin color segmentation model, the skin color segmentation model is used to perform skin color segmentation on the reference image, and the probability that each pixel in the reference image belongs to the skin color area is obtained. Based on the probability, it is determined that the skin color area of the reference image contains of pixels.

According to the brightness of each pixel included in the skin color area of the image frame in the original multimedia data, the average brightness value of the skin color area of the image frame in the original multimedia data is determined. According to the brightness of each pixel included in the skin color area of the reference image, the mean brightness value of the skin color area in the reference image is determined. According to the chromaticity of each pixel contained in the skin color area of the image frame in the original multimedia data, the chromaticity mean value of the skin color area of the image frame in the original multimedia data is determined. According to the chromaticity of each pixel contained in the skin color area of the reference image, the chroma mean value of the skin color area in the reference image is determined.

For each pixel in the skin color area in the image frame of the original multimedia data, calculate the difference between the brightness of the pixel and the mean brightness of the skin color area, and compare the difference with the mean value of the skin color area in the reference image. The brightness averages are superimposed to obtain the brightness adjustment result of the pixel.

For each pixel in the skin color area in the image frame of the original multimedia data, calculate the difference between the chroma of the pixel and the mean chroma of the skin color area, and compare the difference with the skin color of the reference image. The average chromaticity values of the regions are superimposed to obtain the chromaticity adjustment result of the pixel.

According to the brightness adjustment result and the chroma adjustment result of each pixel in the skin color area in the image frame of the original multimedia data, the skin color adjustment result corresponding to the image frame is obtained.

Based on the skin color weight, a linear fusion method is used to fuse the multimedia data processing result of the image frame and the skin color adjustment result to obtain the target multimedia data. For example, the target multimedia data is determined based on the fusion result of the multimedia data processing result corresponding to the image frame sequence included in the target multimedia data and the skin color adjustment result.

The technical solution of the embodiment of the present disclosure adjusts the image frames in the original multimedia data by adjusting the display attributes of the reference image, obtains the target multimedia data, and displays the target multimedia data, thereby realizing the adjustment of the display style of the original multimedia data based on the color style of the reference image, so that The target multimedia data presents a display effect similar to that of the reference image, eliminating the need to manually adjust the display properties and improving color grading efficiency. Since the reference image can intuitively present the color grading results desired by the user, adjusting the original multimedia data based on the display attributes of the reference image can improve the adjustment accuracy and avoid repeated modification of parameters.

FIG. 2 is a schematic flowchart of another multimedia data processing method provided by an embodiment of the disclosure. Based on the above embodiment, the embodiment of the disclosure adds display steps of reference images and special effect elements. As shown in Figure 2, the method includes:

S210. Obtain original multimedia data.

S220. Obtain the reference image.

S230. Generate special effect elements according to the reference image, and superimpose and display the reference image and the special effect element in the original multimedia data.

If only the original multimedia data is displayed during the process of adjusting the display attributes of the image frames in the original multimedia data based on the reference image, the display effect will be relatively simple and the user experience will be poor. It may even cause the user to mistakenly believe that the reference image has not been uploaded successfully and repeat the operation, resulting in Mishandling. By overlaying the display of reference images and special effect elements in the original multimedia data, you can avoid the misoperation of displaying a single effect and repeatedly uploading reference images.

Wherein, the special effect element is superimposed and displayed at a set position of the reference image and moves in a set direction. For example, special effect elements include color block special effects, etc. Among them, the color block special effect can include color blocks of different colors. The color of the color patch represents the color category obtained by clustering the colors of the pixels of the reference image. Alternatively, the color of the color block may also be a fixed color. The embodiment of the present disclosure does not specifically limit the shape and color of the color block.

Exemplarily, the color category contained in the reference image is determined according to the color attributes of the pixels in the reference image; special effect elements corresponding to the colors represented by the color category are generated.

In some embodiments, multiple clustering centers are preset, and the pixels in the reference image are clustered according to the color of the pixels and the color of the pixels corresponding to the clustering centers to obtain multiple pixel groups. The colors corresponding to the cluster centers of all groups of pixels can be used as the color categories contained in the reference image.

For example, the reference image is superimposed and displayed in the image frame of the original multimedia data, and the effect of sliding into the display screen of the original multimedia data along a set direction is presented. FIG. 3 is a schematic diagram of superimposing and displaying a reference image in an image frame of original multimedia data according to an embodiment of the present disclosure. As shown in Figure 3, during the playback of the original multimedia data, the reference image is superimposed and displayed on the first position 310 of the original multimedia data at time _t1 , and slides to the second position 320 at time _t2 .

Line material is superimposed and displayed in the reference image, and the line material moves along the first direction in the reference image. Moving the line material along the first direction in the reference image can present the effect of light scanning the reference image. By superimposing the animation of the line material moving in the first direction onto the reference image displayed in the original multimedia data, the effect of light scanning the reference image is presented. Figure 4 is a schematic diagram of superimposing line material on a reference image provided by an embodiment of the present disclosure. As shown in Figure 4, a mask map 410 with set transparency is generated based on the width and height of the reference image, and there are bright areas 411 and dark areas 412 in the mask map 410. According to multiple mask maps with different positions of the bright areas 411 410 synthesizes animated images, superimposes the animated images onto the reference image, and obtains the effect of light scanning the reference image.

The special effect element is superimposed on the first area in the reference image according to a set superposition form. Among them, setting the overlay form represents the form of superimposing the color block special effect onto the reference image. For example, setting the overlay mode can be to display color blocks at different positions of the reference image in sequence according to the color of the color blocks. The first area may be a preset area within the range of the reference image. Figure 5 is a schematic diagram of a color block special effect provided by an embodiment of the present disclosure. As shown in FIG. 5 , each color block 520 is displayed one by one in the reference image 510 until all color blocks 520 are displayed in the first area of the reference image 510 , and during the display process of each color block 520 , the color blocks 520 are displayed in the reference image 510 . The width and height are transformed from the first state to the second state.

Exemplarily, the display position and brightness arrangement order corresponding to the special effect elements are determined according to the set superposition form; the display order of the special effect elements is determined according to the brightness arrangement order; according to the display position and display order, in The special effect element is superimposed and displayed in the first area of the reference image in the image frame in the original multimedia data. The display position represents the position of the special effect element in the reference image. For example, the display position may include color blocks arranged horizontally (or vertically or obliquely) in the reference image, and the spacing between adjacent color blocks is the same (or gradually increases or gradually decreases). Small). The order of brightness arrangement may include the arrangement of colors or brightness from dark to light, or from light to dark, etc. Because each color block represents the color appearing in the reference image, and the color blocks have different color depths and different brightnesses. The display order of the color blocks in the reference image can be determined according to the brightness sorting order specified in the set overlay form, and then the color blocks are displayed one by one at the display positions corresponding to the color blocks according to the display order. And when each color block is displayed, the first state of the color block is first displayed in the reference image, and the process of converting the color block from the first state to the second state is presented. For example, first display a small color block in the reference image, and then enlarge the small color block to obtain a color block with set width and height.

The special effect element is moved along the second direction from the first area of the reference image to the second area corresponding to the reference image, and the display state of the special effect element in the second area is adjusted. The second area represents the area outside the reference image. FIG. 6 is a schematic diagram of color block shifting provided by an embodiment of the present disclosure. As shown in FIG. 6 , after all the color blocks are displayed in the first area of the reference image, all the color blocks 610 are rotated from the horizontal arrangement to the vertical arrangement, and moved to the second area 620 corresponding to the reference image. After all color patches 610 reach the second area 620, the spacing between adjacent color patches is increased.

S240. Adjust the image frames in the original multimedia data according to the display attributes of the reference image to obtain target multimedia data.

S250: When the display state of the special effect element in the original multimedia data meets the set condition, display the target multimedia data.

The set condition can represent the condition under which the special effect element disappears from the original multimedia data. When the special effect element disappears from the original multimedia data, the target multimedia data is displayed. For example, when the distance between adjacent color blocks is increased so that the distance between adjacent color blocks is a set value, it is determined that the special effect color meets the set conditions. Or, when the distance between adjacent color blocks is increased and the display time of the color blocks reaches the set time, it is determined that the special effect color meets the set conditions.

The technical solution of the embodiment of the present disclosure can intuitively display the color style of the reference image selected by the user by generating special effect elements corresponding to the reference image and superimposing the reference image and special effect elements in the original multimedia data, and can vividly display the color style of the reference image selected by the user. Display special effect elements to avoid misoperations such as a single display effect or repeated uploading of reference images in the process of adjusting the display attributes of original multimedia data based on reference images, increase interactivity and interest, and improve user experience.

Figure 7 is a schematic structural diagram of a multimedia data processing device provided by an embodiment of the present disclosure. The device can be implemented in the form of software and/or hardware, and optionally, can be implemented through an electronic device. The electronic device can be a mobile terminal. , PC or server, etc.

As shown in Figure 7, the device includes: an image acquisition module 710 and an image adjustment module 720.

Data acquisition module 710, used to acquire original multimedia data;

Image acquisition module 720, used to acquire reference images;

The image adjustment module 730 is configured to adjust image frames in the original multimedia data according to the display attributes of the reference image, obtain target multimedia data, and display the target multimedia data, wherein the target multimedia data includes the original multimedia data. A sequence of image frames in the data adjusted based on the display attributes of the reference image.

Optionally, also includes:

A special effect element generation module, configured to generate special effect elements according to the reference image after obtaining the reference image, and superimpose and display the reference image and the special effect element in the original multimedia data, wherein the special effect element is superimposed on the reference image. The set position of the image is displayed and moved in the set direction; when the display state of the special effect element in the original multimedia data meets the set condition, the step of displaying the target multimedia data is performed.

Further, generating special effect elements according to the reference image includes:

Determine the color category contained in the reference image according to the color attributes of the pixels in the reference image;

Special effect elements corresponding to the colors represented by the color categories are generated.

Further, overlaying and displaying the reference image and special effect elements in the original multimedia data includes:

Superimposing and displaying the reference image in the image frame of the original multimedia data;

Line material is superimposed and displayed in the reference image, and the line material moves along the first direction in the reference image;

Superimpose the special effect element to the first area in the reference image according to the set superposition form;

The special effect element is moved along the second direction from the first area of the reference image to the second area corresponding to the reference image, and the display state of the special effect element in the second area is adjusted.

Further, superimposing the special effect element to the first area in the reference image according to the set superposition form includes:

Determine the corresponding display position and brightness arrangement sequence of the special effect elements according to the set superposition form;

Determine the display order of the special effect elements according to the brightness arrangement order;

According to the display position and display order, the special effect element is superimposed and displayed in the first area of the reference image in the image frame of the original multimedia data.

Optionally, the image adjustment module 720 is specifically used to:

For the reference image and the image frame in the original multimedia data, determine the target pixel interval corresponding to the image according to the display attribute;

For each target pixel interval, perform attribute matching on the image frames in the original multimedia data based on the display attributes of the pixels of the reference image, and fuse the attribute matching results corresponding to each target pixel interval to obtain the Multimedia data processing results corresponding to image frames;

For pixels in the skin color area in the image frame of the original multimedia data, adjust the display attributes of the pixels according to the display attributes of the skin color area of the reference image to obtain the skin color adjustment result corresponding to the image frame;

For the image frames in the original multimedia data, the skin color adjustment result and the multimedia data processing result are fused according to the skin color weight to obtain the target multimedia data, where the skin color weight represents that each pixel in the image frame of the original multimedia data belongs to the skin color area probability.

Further, for the pixels in the skin color area in the image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the display attributes of the skin color area of the reference image to obtain the skin color adjustment result corresponding to the image frame. ,include:

Determine the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area, as the skin color weight, determine the pixels included in the skin color area in the image frame of the original multimedia data according to the skin color weight;

Determine the display attribute mean value of the skin color area in the image frame of the original multimedia data according to the display attributes of the pixels contained in the skin color area in the image frame of the original multimedia data;

For the pixels in the skin color area in the image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the average display attributes of the image frame and the reference image in the skin color area, and the skin color adjustment result corresponding to the image frame is obtained. .

The multimedia data processing device provided by the embodiments of the present disclosure can execute the multimedia data processing method provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.

It is worth noting that the various units and modules included in the above-mentioned devices are only divided according to functional logic, but are not limited to the above-mentioned divisions, as long as they can achieve the corresponding functions; in addition, the specific names of each functional unit are just In order to facilitate mutual differentiation, it is not used to limit the protection scope of the embodiments of the present disclosure.

FIG. 8 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring now to FIG. 8 , a schematic structural diagram of an electronic device (such as the terminal device or server in FIG. 8 ) 800 suitable for implementing embodiments of the present disclosure is shown. Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), vehicle-mounted terminals (such as Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 8 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 8, the electronic device 800 may include a processing device (eg, central processing unit, graphics processor, etc.) 801, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 802 or from a storage device 808. The program in the memory (RAM) 803 executes various appropriate actions and processes. In the RAM 803, various programs and data required for the operation of the electronic device 800 are also stored. The processing device 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An editing/output (I/O) interface 805 is also connected to bus 804.

Generally, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 807 such as a computer; a storage device 808 including a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 8 illustrates an electronic device 800 having various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 809, or from storage device 808, or from ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

The electronic device provided by the embodiments of the present disclosure and the multimedia data processing method provided by the above embodiments belong to the same inventive concept. Technical details that are not described in detail in this embodiment can be referred to the above embodiments, and this embodiment has the same characteristics as the above embodiments. Same beneficial effects.

Embodiments of the present disclosure provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the multimedia data processing method provided in the above embodiments is implemented.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. (e.g., communications network) interconnection. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device:

Obtain original multimedia data;

Get reference image;

Adjust the image frames in the original multimedia data according to the display attributes of the reference image, obtain target multimedia data, and display the target multimedia data, wherein the target multimedia data includes the original multimedia data based on the reference image. A sequence of image frames whose display properties are adjusted.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages—such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units involved in the embodiments of the present disclosure can be implemented in software or hardware. Among them, the name of a unit does not constitute a limitation on the unit itself under certain circumstances.

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

The above description is only a description of the preferred embodiments of the present disclosure and the technical principles applied. Those skilled in the art should understand that the disclosure scope involved in the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, but should also cover solutions composed of the above technical features or without departing from the above disclosed concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in this disclosure (but not limited to).

Furthermore, although operations are depicted in a specific order, this should not be understood as requiring that these operations be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims (10)

1. A method for processing multimedia data, comprising:

acquiring original multimedia data;

acquiring a reference image;

and adjusting the image frames in the original multimedia data according to the display attribute of the reference image to obtain target multimedia data, and displaying the target multimedia data, wherein the target multimedia data comprises an image frame sequence which is adjusted based on the display attribute of the reference image in the original multimedia data.

2. The method of claim 1, further comprising, after acquiring the reference image:

generating special effect elements according to the reference image, and displaying the reference image and the special effect elements in the original multimedia data in a superposition manner, wherein the special effect elements are displayed in a superposition manner at a set position of the reference image and move according to a set direction;

And executing the step of displaying the target multimedia data when the display state of the special effect element in the original multimedia data meets a set condition.

3. The method of claim 2, wherein the generating special effects elements from the reference image comprises:

determining the color category contained in the reference image according to the color attribute of the pixel in the reference image;

and generating special effect elements corresponding to the colors represented by the color categories.

4. The method according to claim 2, wherein the superimposing the reference image and the special effects element in the original multimedia data comprises:

superposing and displaying the reference image in the image frame of the original multimedia data;

superposing and displaying line materials in the reference image, wherein the line materials move along a first direction in the reference image;

superposing the special effect element to a first area in the reference image according to a set superposition form;

and moving the special effect element from the first area of the reference image to a second area corresponding to the reference image along a second direction, and adjusting the display state of the special effect element in the second area.

5. The method of claim 4, wherein superimposing the effect element in the set superimposition format onto the first region in the reference image comprises:

determining the display position and the brightness arrangement sequence corresponding to the special effect elements according to the set superposition form;

determining the display sequence of the special effect elements according to the brightness arrangement sequence;

and superposing and displaying the special effect elements in a first area of a reference image in the image frame of the original multimedia data according to the display position and the display sequence.

6. The method according to claim 1, wherein said adjusting the image frames in the original multimedia data according to the display attribute of the reference image to obtain the target multimedia data comprises:

for the reference image and the image frames in the original multimedia data, determining a target pixel interval corresponding to the image according to the display attribute respectively;

for each target pixel interval, performing attribute matching on the image frames in the original multimedia data based on the display attribute of the pixels of the reference image, and fusing attribute matching results corresponding to each target pixel interval to obtain multimedia data processing results corresponding to the image frames;

For pixels in a skin color area in an image frame of the original multimedia data, adjusting display attributes of the pixels according to display attributes of the skin color area of the reference image to obtain a skin color adjusting result corresponding to the image frame;

and fusing the skin color adjustment result and the multimedia data processing result according to skin color weight for the image frame in the original multimedia data to obtain target multimedia data, wherein the skin color weight represents the probability that each pixel in the image frame of the original multimedia data belongs to a skin color region.

7. The method according to claim 6, wherein for the pixels in the skin color region in the image frame of the original multimedia data, adjusting the display attribute of the pixels according to the display attribute of the skin color region of the reference image to obtain the skin color adjustment result corresponding to the image frame, includes:

determining the probability that each pixel in the image frame of the original multimedia data belongs to a skin color region as skin color weight, and determining the pixel contained in the skin color region in the image frame of the original multimedia data according to the skin color weight;

determining a display attribute mean value of the skin color region in the image frame of the original multimedia data according to the display attribute of the pixel contained in the skin color region in the image frame of the original multimedia data;

And for the pixels in the skin color area in the image frame of the original multimedia data, adjusting the display attribute of the pixels according to the average value of the display attribute of the image frame and the reference image in the skin color area, and obtaining a skin color adjustment result corresponding to the image frame.

8. A processing apparatus for multimedia data, comprising:

the data acquisition module is used for acquiring the original multimedia data;

the image acquisition module is used for acquiring a reference image;

and the image adjustment module is used for adjusting the image frames in the original multimedia data according to the display attribute of the reference image to obtain target multimedia data and displaying the target multimedia data, wherein the target multimedia data comprises an image frame sequence which is adjusted based on the display attribute of the reference image in the original multimedia data.

9. An electronic device, the electronic device comprising:

one or more processors;

storage means for storing one or more programs,

when executed by the one or more processors, causes the one or more processors to implement the method of processing multimedia data as recited in any one of claims 1-7.

10. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the method of processing multimedia data as claimed in any one of claims 1 to 7.