WO2020252726A1 - Image encoding and decoding method and device and video encoding and decoding device - Google Patents

Abstract

Provided in the embodiment of the present application are an image encoding and decoding method and device and a video encoding and decoding device. The method comprises: in the process of transform and quantization of image encoding, determining whether a size of a CU is greater than that of a maximum TU; if so, performing division for luma CUs and chroma CUs respectively according to the size of the maximum TU.

Description

Image coding and decoding method, device and video coding and decoding equipment Technical field

The embodiments of the present application relate to the technical field of video coding.

Background technique

In the draft of the new generation video coding standard (VVC, Versatile Video Coding), the image will be partitioned into a series of coding tree units (CTU, Coding Tree Unit), and each CTU contains a luminance component (which can be called a luminance CTU) And chrominance component (can be called chrominance CTU).

A dual-tree partition structure or a single-tree partition structure can be used to divide the luminance CTU and chrominance CTU into coding units (CU, Coding Unit, or also called coding block CB). ). For the single tree division structure, the luminance CTU and the chrominance CTU share one division indication information; for the two tree division structures, the luminance CTU and the chrominance CTU each use independent division indication information. The CU obtained after division includes a luminance component (may be called a luminance CU) and a chrominance component (may be called a chrominance CU).

Currently, transform is applied to residual coefficients generated by inter-frame prediction or intra-frame prediction, that is, the residuals remaining between the original block and its prediction block are transformed into transform coefficients, and the transform coefficients are quantized and encoded into the bitstream . In the current test model designed for the VVC sketch, if the size of the current CU (or called the size) exceeds the size of the largest transform unit (TU, Transform Unit, or also called the transform block TB), it needs to be transformed and quantized In the process, the larger CU is divided into several TUs.

It should be noted that the above introduction to the technical background is only for the convenience of a clear and complete description of the technical solution of the present application, and to facilitate the understanding of those skilled in the art. It should not be considered that the above technical solutions are well-known to those skilled in the art just because these solutions are described in the background art part of this application.

Summary of the invention

However, the inventor found that in the process of image coding transformation and quantization, currently a larger-size CU is divided into several TUs, resulting in chrominance CU being divided into smaller chrominance TUs in certain scenarios, which is not conducive to The increase in compression efficiency also reduces the coding performance of the chrominance component.

In view of at least one of the foregoing problems, embodiments of the present application provide an image encoding and decoding method, device, and video encoding and decoding device.

According to a first aspect of the embodiments of the present application, an image encoding method is provided, including:

During the transformation and quantization process of image coding, determine whether the size of the CU exceeds the size of the largest TU;

In the case where the size of the CU exceeds the size of the largest TU, the luminance component coding unit and the chrominance component coding unit of the CU are respectively divided according to the size of the largest TU; and

Encoding is performed according to the divided luminance component coding unit and chrominance component coding unit.

According to a second aspect of the embodiments of the present application, there is provided an image encoding device, including:

A determining part, which determines whether the size of the CU exceeds the size of the largest TU during the transformation and quantization process of image coding;

A dividing unit, which divides the luma component coding unit and the chroma component coding unit of the CU according to the size of the largest TU when the size of the CU exceeds the size of the largest TU; and

The encoding unit performs encoding according to the divided luminance component coding unit and chrominance component coding unit.

According to a third aspect of the embodiments of the present application, an image decoding method is provided, including:

In the inverse transformation and dequantization process of image decoding, determine whether the size of the CU exceeds the size of the largest TU;

In the case where the size of the CU exceeds the size of the largest TU, the luminance component coding unit and the chrominance component coding unit of the CU are respectively divided according to the size of the largest TU; and

Decoding is performed according to the divided luminance component coding unit and chrominance component coding unit.

According to a fourth aspect of the embodiments of the present application, there is provided an image decoding device, including:

The determining part, which determines whether the size of the CU exceeds the size of the largest TU during the inverse transformation and dequantization process of image decoding;

A dividing unit, which divides the luma component coding unit and the chroma component coding unit of the CU according to the size of the largest TU when the size of the CU exceeds the size of the largest TU; and

The decoding unit performs decoding according to the divided luminance component coding unit and chrominance component coding unit.

According to a fifth aspect of the embodiments of the present application, a video encoding and decoding device is provided, including:

The encoder determines whether the size of the CU exceeds the size of the largest TU during the transformation and quantization process of image encoding; in the case that the size of the CU exceeds the size of the largest TU, the luminance component of the CU is encoded according to the size of the largest TU. And chrominance component coding unit for division; and coding according to the divided luminance component coding unit and chrominance component coding unit;

The decoder determines whether the size of the CU exceeds the size of the largest TU during the inverse transformation and dequantization process of image decoding; in the case that the size of the CU exceeds the size of the largest TU, the luminance component of the CU is calculated according to the size of the largest TU. The coding unit and the chrominance component coding unit are divided; and the decoding is performed according to the divided luminance component coding unit and the chrominance component coding unit.

One of the beneficial effects of the embodiments of the present application is: when the size of the CU exceeds the size of the largest TU, the luminance CU and the chrominance CU are divided according to the size of the largest TU; thus, the chrominance CU can be divided into The chrominance TU with the same size as the maximum TU can not only improve the compression efficiency, but also improve the coding performance of the chrominance component.

With reference to the following description and drawings, specific implementations of the application are disclosed in detail, and the manner in which the principles of the application can be adopted is indicated. It should be understood that the scope of the implementation of the present application is not limited thereby. Within the scope of the spirit and terms of the appended claims, the implementation of the present application includes many changes, modifications and equivalents.

Features described and/or shown for one embodiment can be used in one or more other embodiments in the same or similar manner, combined with features in other embodiments, or substituted for features in other embodiments .

It should be emphasized that the term "comprising/comprising" when used herein refers to the existence of features, components, steps or components, but does not exclude the existence or addition of one or more other features, components, steps or components.

Description of the drawings

The elements and features described in one drawing or one embodiment of the embodiment of the present application may be combined with the elements and features shown in one or more other drawings or embodiments. In addition, in the drawings, similar reference numerals indicate corresponding parts in several drawings, and may be used to indicate corresponding parts used in more than one embodiment.

Figure 1 is a schematic diagram of the division structure of two trees and the division structure of a single tree;

Fig. 2 is a diagram showing an example in which some transform coefficients of a 64×64 TU are cleared;

Fig. 3 is a schematic diagram of an image coding method according to an embodiment of the present application;

4 is an example diagram of dividing a 128×128 CU into TUs according to an embodiment of the present application;

FIG. 5 is an example diagram of dividing a 256×256 CU into TUs according to an embodiment of the present application;

Fig. 6 is a schematic diagram of an image decoding method according to an embodiment of the present application;

Fig. 7 is a schematic diagram of an image coding device according to an embodiment of the present application;

Fig. 8 is a schematic diagram of an image decoding device according to an embodiment of the present application;

Fig. 9 is a schematic diagram of an encoder/decoder according to an embodiment of the present application.

Detailed ways

With reference to the drawings, the foregoing and other features of this application will become apparent through the following description. In the specification and drawings, specific implementations of the application are specifically disclosed, which indicate some implementations in which the principles of the application can be adopted. It should be understood that the application is not limited to the described implementations, on the contrary, the The application includes all modifications, variations and equivalents falling within the scope of the appended claims.

In the embodiments of this application, the terms "first", "second", etc. are used to distinguish different elements from the terms, but they do not indicate the spatial arrangement or temporal order of these elements. These elements should not be used by these terms. Limited. The term "and/or" includes any and all combinations of one or more of the associated listed terms. The terms "comprising", "including", "having" and the like refer to the existence of the stated features, elements, elements or components, but do not exclude the presence or addition of one or more other features, elements, elements or components.

In the embodiments of the present application, the singular forms "a", "the", etc. include plural forms, which should be broadly understood as "a" or "a type" rather than being limited to the meaning of "a"; in addition, the term "so" "Said" should be understood to include both singular and plural forms, unless the context clearly indicates otherwise. In addition, the term "based on" should be understood as "based at least in part on..." and the term "based on" should be understood as "based at least in part on..." unless the context clearly dictates otherwise.

Figure 1 is a schematic diagram of the division structure of two trees and the division structure of a single tree. As shown on the left side of Figure 1, for the division of two trees, the luminance CTU and the chrominance CTU have their own division flags. The CTU can be divided into a quaternary tree first; After the tree is divided, each node is independently divided into a multi-type tree (MTT, Multi-Type Tree).

As shown on the right side of Figure 1, for a single tree division, the luminance CTU and the chrominance CTU share the division flag, and the CTU can be divided into a quadtree first; then, the same for each node after the quadtree division MTT division is performed locally.

For example, MTT division includes vertical binary tree (BT, binary tree) division (SPLIT_BT_VER), horizontal binary tree division (SPLIT_BT_HOR), vertical ternary tree (TT, ternary tree) division (SPLIT_TT_VER), and horizontal ternary tree division (SPLIT_TT_VER). Split (SPLIT_TT_HOR).

As shown in Figure 1, the root of the quadtree is associated with the CTU, and the quadtree blocks are divided until the MTT is determined. MTT is divided recursively until reaching the leaf node, which means that CTU has been divided into CU.

In the current test model designed for the VVC sketch, if the size (or called the size) of the current CU exceeds the size of the largest TU, the larger-size CU needs to be divided into several TUs during the transformation and quantization process. For example, for inter slices, if the size of the largest TU of the Y component is equal to 64×64, then a 128×128 CU with three components in the 4:2:0 format will be divided into four A single tree partition structure of 64×64 luminance TU and eight 32×32 chrominance TUs. However, the 32×32 chroma TU is not conducive to further improving the compression efficiency.

For another example, after the transformation process, the transformation coefficients beyond the 32×32 area in the upper left corner will be zeroed out. Fig. 2 is an example diagram in which some transform coefficients of a 64×64 TU are cleared. As shown in Fig. 2, Residual_Coeff[] represents residual coefficients, and transformed_Coeff[] represents transform coefficients.

That is to say, for 64×64TU, only the upper left 32×32 coefficients need to be coded, because the discrete cosine transform (DCT, Discrete Cosine Transform) is used for 64×64TU, which makes the energy of the two-dimensional residual coefficients concentrate on the upper left angle. However, the human eye is more sensitive to brightness than to chroma; therefore, it is expected that the chroma TU can have a larger size.

Embodiments of the first aspect

The embodiment of the present application provides an image encoding method. Fig. 3 is a schematic diagram of an image coding method according to an embodiment of the present application, and a CU is explained from the coding end. As shown in Figure 3, the method includes:

301. Determine whether the size of the CU exceeds the size of the largest TU during the transformation and quantization process of the image coding;

302: When the size of the CU exceeds the size of the largest TU, divide the luminance component coding unit and the chrominance component coding unit of the CU according to the size of the largest TU respectively; and

303. Perform coding according to the divided luminance component coding unit and chrominance component coding unit.

It is worth noting that Figure 3 above only schematically illustrates part of the relevant content of the embodiments of the present application, but the present application is not limited thereto. For example, the order of execution among various operations can be appropriately adjusted, and some other operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the description of FIG. 3 above.

In some embodiments, the image coding uses inter-frame prediction, but the application is not limited thereto. For example, P and B frames use a single tree division structure, and coding blocks can use intra-frame prediction or inter-frame prediction.

In some embodiments, a CU is subjected to processing such as prediction to obtain residual coefficients. In addition, the CU may be divided into multiple TBs, and operations such as transformation and quantization are performed for each TB. For specific content such as residual coefficients and DCT and how to transform, quantize, and encode, you can refer to related technologies. In addition, if the size of the CU does not exceed the size of the largest TU, the existing technology can be used for subsequent processing, which will not be repeated here.

In some embodiments, the size of the largest TU may be predetermined. For example, the size of the largest TU may be specified as 64×64, but the embodiment of the present application is not limited thereto.

In some embodiments, the luminance component coding unit of the CU (may be called a luminance CU) is divided into a plurality of luminance component transformation units (may be called a luminance TU), and the size of the luminance TU is equal to the size of the largest TU; and in the CU If the size of the chroma component coding unit (can be called chroma CU) does not exceed the size of the largest TU, the size of the chroma CU remains unchanged; when the size of the chroma CU exceeds the size of the largest TU, the chroma The degree CU is divided into multiple chroma TUs, and the size of the chroma TU is equal to the size of the largest TU.

FIG. 4 is an example diagram of dividing a 128×128 CU into TUs according to an embodiment of the present application, taking the encoding of an inter-frame slice in a 4:2:0 format as an example. As shown in FIG. 4, the CU includes a 128×128 luma CU (Y component), a 64×64 chroma CU (U component), and a 64×64 chroma CU (V component).

Assuming that the size of the largest TU is 64×64, if a single tree division structure is used, the Y component is divided into four 64×64 luma TUs, correspondingly, the U component is divided into four 32×32 chroma TUs , The V component is divided into four 32×32 chroma TUs, so the size of the chroma TU is smaller.

As shown in Figure 4, in the embodiment of this application, the Y component is divided into four 64×64 luminance TUs, and the size of the U component and the V component are both 64×64, which is equal to the size of the largest TU, then the U component The dimensions of the and V components remain unchanged. That is, as shown in FIG. 4, the U component is divided into a 64×64 chroma TU, and the V component is divided into a 64×64 chroma TU, so the size of the chroma TU is larger.

Fig. 5 is an example diagram of dividing a 256×256 CU into TUs according to an embodiment of the present application, taking the coding of an inter-frame slice in a 4:2:0 format as an example. As shown in FIG. 5, the CU includes a 256×256 luma CU (Y component), a 128×128 chroma CU (U component), and a 128×128 chroma CU (V component).

Assuming that the size of the largest TU is 64×64, if a single tree division structure is adopted, the Y component is divided into sixteen 64×64 luminance TUs, and accordingly, the U component is divided into sixteen 32×32 colors. The degree TU, V component is divided into sixteen 32×32 chroma TUs, so the size of the chroma TU is smaller.

As shown in Figure 5, in this embodiment of the application, the Y component is divided into sixteen 64×64 luminance TUs, and the size of the U component and the V component are both 128×128. If the size of the largest TU is exceeded, U The size of the component and the V component still needs to be further divided. The embodiment of the application separately divides the luminance CU and the chrominance CU; that is, as shown in FIG. 5, the U component is divided into four 64×64 chrominance TUs, and the V component is divided into four 64×64 The size of the chromaticity TU is larger.

In this way, the chroma CU can be divided into chroma TUs with the same size as the maximum TU, which not only improves the compression efficiency, but also improves the coding performance of the chroma components. In addition, the above description only uses the 4:2:0 format as an example, but the embodiment of the present application is not limited to this. For example, the 4:2:2 format or the 4:4:4 format is also applicable to the embodiments of the present application.

In some embodiments, the residuals in each TU will be input into a two-dimensional N×N matrix, where N is equal to the size of the largest TU. The obtained N×N transform coefficients can be quantized to obtain quantized transform coefficients. Then, the relevant information is encoded into the bit stream and sent to the decoding end. In addition, bitstream encoding of image information such as prediction information and residual coefficients in the image area to be encoded can be implemented using solutions in related technologies, which are not limited in this application.

It is worth noting that the foregoing description of the embodiment of the present application is performed schematically using only one CU as an example, and the foregoing operations may be used for encoding for multiple CUs respectively. The above only describes the content related to the application, but the application is not limited to this. The image coding method may also include other operations or processes. For the specific content of these operations or processes, reference may be made to related technologies.

In addition, the decoder can receive the bit stream accordingly and decode it accordingly. For example, at the decoder, if the CU satisfies the maximum TB division condition, it is divided in the same way as the encoder. Then the quantized transform coefficients are dequantized, and the two-dimensional N×N inverse transform is applied to the dequantized transform coefficients to obtain the residual block of the quantized sample, which is then added to the inter-frame prediction sample to obtain the reconstructed block.

In some embodiments, the indication information for indicating the division of the CU may be encoded; the indication information indicates the division according to the size of the largest TU when the size of the CU exceeds the size of the largest TU. Therefore, it is possible to flexibly choose whether to implement this method.

For example, 1 bit can be set to indicate, 1 represents the method of implementing the embodiment of this application, that is, when the size of the CU exceeds the size of the largest TU, it is divided according to the size of the largest TU, and 0 represents that the structure is still divided according to a single tree. Way; the value of this bit can be compiled into the bitstream.

The above embodiments only exemplify the embodiments of the present application, but the present application is not limited to this, and appropriate modifications may also be made on the basis of the above various embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.

It can be seen from the above embodiment that when the size of the CU exceeds the size of the largest TU, the luma CU and the chroma CU are divided according to the size of the largest TU; the chroma CU can be divided into the same chroma as the largest TU size TU can not only improve compression efficiency, but also improve the coding performance of chrominance components.

Embodiments of the second aspect

The embodiment of the present application also provides an image decoding method, and the same content as in the embodiment of the first aspect will not be repeated. At the decoding end, for convenience, the area of the image to be processed is still referred to as a coding unit (CU), but the present application is not limited to this, for example, it may also be referred to as a decoding unit.

Fig. 6 is a schematic diagram of an image decoding method according to an embodiment of the present application, and a CU is explained from the decoding end. As shown in Figure 6, the method includes:

601: In the process of inverse transformation and dequantization of image decoding, determine whether the size of the CU exceeds the size of the largest TU;

602. In a case where the size of the CU exceeds the size of the largest TU, divide the luminance component coding unit and the chrominance component coding unit of the CU according to the size of the largest TU respectively; and

603: Perform decoding according to the divided luminance component coding unit and chrominance component coding unit.

It is worth noting that Figure 6 above only schematically illustrates part of the relevant content of the embodiments of the present application, but the present application is not limited thereto. For example, the order of execution among various operations can be appropriately adjusted, and some other operations can be added or some operations can be reduced. Those skilled in the art can make appropriate modifications based on the above content, and are not limited to the description of FIG. 6 above.

In some embodiments, the luma CU is divided into a plurality of luma TUs, the size of the luma TU is equal to the size of the largest TU, and the size of the chroma CU does not exceed the size of the largest TU. Change; In the case where the size of the chroma CU exceeds the size of the largest TU, the chroma CU is divided into multiple chroma TUs, and the size of the chroma TU is equal to the size of the largest TU.

In some embodiments, the indication information for indicating the division of the CU is also decoded; the indication information indicates that the division is performed according to the size of the largest TU when the size of the CU exceeds the size of the largest TU.

In some embodiments, the image decoding uses inter-frame prediction, but the application is not limited thereto.

The above embodiments only exemplify the embodiments of the present application, but the present application is not limited to this, and appropriate modifications may also be made on the basis of the above various embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.

It can be seen from the above embodiment that when the size of the CU exceeds the size of the largest TU, the luma CU and the chroma CU are divided according to the size of the largest TU; the chroma CU can be divided into the same chroma as the largest TU size TU can not only improve compression efficiency, but also improve the coding performance of chrominance components.

Embodiments of the third aspect

The embodiment of the present application also provides an image encoding device, and the same content as in the embodiment of the first aspect will not be repeated.

FIG. 7 is a schematic diagram of an image encoding device according to an embodiment of the present application. As shown in FIG. 7, the image encoding device 700 includes:

The determining unit 701, which determines whether the size of the CU exceeds the size of the largest TU during the transformation and quantization process of image coding;

A dividing unit 702, which divides the luma component coding unit and the chroma component coding unit of the CU according to the size of the largest TU when the size of the CU exceeds the size of the largest TU; and

The encoding unit 703 performs encoding according to the divided luminance component coding unit and chrominance component coding unit.

In some embodiments, the luminance component coding unit (luminance CU) of the CU is divided into a plurality of luminance component transformation units (luminance TU), the size of the luminance TU is equal to the size of the largest TU; and the size of the chrominance CU does not exceed In the case of the size of the largest TU, the size of the chroma CU remains unchanged; in the case that the size of the chroma CU exceeds the size of the largest TU, the chroma CU is divided into multiple chroma TUs, and the size of the chroma TU is equal to The size of the largest TU.

In some embodiments, the encoding unit 703 also encodes indication information for indicating the division of the CU; the indication information indicates that the division is carried out according to the size of the largest TU when the size of the CU exceeds the size of the largest TU.

In some embodiments, the image coding uses inter-frame prediction, but the application is not limited thereto.

It is worth noting that the above only describes the components or modules related to the application, but the application is not limited thereto. The image encoding device 700 may also include other components or modules, and for the specific content of these components or modules, reference may be made to related technologies.

In addition, for the sake of simplicity, FIG. 7 only exemplarily shows the connection relationship or signal direction between various components or modules, but it should be clear to those skilled in the art that various related technologies such as bus connection can be used. The foregoing components or modules may be implemented by hardware facilities such as processors and memories; the implementation of this application does not limit this.

The above embodiments only exemplify the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may also be made on the basis of the above embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.

It can be seen from the above embodiment that when the size of the CU exceeds the size of the largest TU, the luma CU and the chroma CU are divided according to the size of the largest TU; the chroma CU can be divided into the same chroma as the largest TU size. TU can not only improve compression efficiency, but also improve the coding performance of chrominance components.

Embodiment of the fourth aspect

The embodiment of the present application also provides an image decoding device, and the same content as in the embodiment of the second aspect will not be repeated.

FIG. 8 is a schematic diagram of an image decoding device according to an embodiment of the present application. As shown in FIG. 8, the image decoding device 800 includes:

The determining unit 801, which determines whether the size of the CU exceeds the size of the largest TU during the inverse transform and dequantization process of image decoding;

A dividing unit 802, which divides the luminance component coding unit and the chrominance component coding unit of the CU according to the size of the largest TU when the size of the CU exceeds the size of the largest TU; and

The decoding unit 803 performs decoding according to the divided luminance component coding unit and chrominance component coding unit.

In some embodiments, the luminance component coding unit (luminance CU) of the CU is divided into a plurality of luminance component transformation units (luminance TU), the size of the luminance TU is equal to the size of the largest TU; and the size of the chrominance CU does not exceed In the case of the size of the largest TU, the size of the chroma CU remains unchanged; in the case that the size of the chroma CU exceeds the size of the largest TU, the chroma CU is divided into multiple chroma TUs, and the size of the chroma TU is equal to The size of the largest TU.

In some embodiments, the decoding unit 803 also decodes indication information used to indicate the division of the CU; the indication information indicates the division according to the size of the maximum TU when the size of the CU exceeds the size of the maximum TU.

In some embodiments, the image decoding uses inter-frame prediction, but the application is not limited thereto.

It is worth noting that the above only describes the components or modules related to the application, but the application is not limited thereto. The image decoding device 800 may also include other components or modules, and for the specific content of these components or modules, reference may be made to related technologies.

In addition, for the sake of simplicity, FIG. 8 only exemplarily shows the connection relationship or signal direction between various components or modules, but it should be clear to those skilled in the art that various related technologies such as bus connection can be used. The foregoing components or modules may be implemented by hardware facilities such as processors and memories; the implementation of this application does not limit this.

The above embodiments only exemplify the embodiments of the present application, but the present application is not limited thereto, and appropriate modifications may also be made on the basis of the above embodiments. For example, each of the above embodiments may be used alone, or one or more of the above embodiments may be combined.

It can be seen from the above embodiment that when the size of the CU exceeds the size of the largest TU, the luma CU and the chroma CU are divided according to the size of the largest TU; the chroma CU can be divided into the same chroma as the largest TU size TU can not only improve compression efficiency, but also improve the coding performance of chrominance components.

Embodiment of the fifth aspect

An embodiment of the present application also provides a video codec device, where the video codec device performs image processing or video processing, including:

The encoder determines whether the size of the CU exceeds the size of the largest TU during the transformation and quantization process of image encoding; in the case that the size of the CU exceeds the size of the largest TU, the luminance component of the CU is encoded according to the size of the largest TU. And chrominance component coding unit; and coding according to the divided luminance component coding unit and chrominance component coding unit;

The decoder determines whether the size of the CU exceeds the size of the largest TU during the inverse transformation and dequantization process of image decoding; in the case that the size of the CU exceeds the size of the largest TU, the luminance component of the CU is calculated according to the size of the largest TU. The coding unit and the chrominance component coding unit are divided; and the decoding is performed according to the divided luminance component coding unit and the chrominance component coding unit.

Fig. 9 is a schematic diagram of an encoder/decoder according to an embodiment of the present application. As shown in FIG. 9, the encoder/decoder 900 may include: a processor 901 and a memory 902; the memory 902 is coupled to the processor 901. The memory 902 can store various data; in addition, it also stores an information processing program 903, and the program 903 is executed under the control of the processor 901.

In some embodiments, the functions of the image encoding device 700 may be integrated into the processor 901. Wherein, the processor 901 may be configured to implement the image encoding method described in the embodiment of the first aspect.

For example, the processor 901 may be configured to perform the following control: in the process of image coding transformation and quantization, determine whether the size of the CU exceeds the size of the largest TU; in the case that the size of the CU exceeds the size of the largest TU, according to the maximum The size of the TU divides the luminance component coding unit and the chrominance component coding unit of the CU respectively; and performs coding according to the divided luminance component coding unit and the chrominance component coding unit.

In some embodiments, the functions of the image decoding device 800 may be integrated into the processor 901. The processor 901 may be configured to implement the image decoding method described in the embodiment of the second aspect.

For example, the processor 901 may be configured to perform the following control: in the inverse transform and dequantization process of image decoding, determine whether the size of the CU exceeds the size of the largest TU; in the case where the size of the CU exceeds the size of the largest TU, The luminance component coding unit and the chrominance component coding unit of the CU are respectively divided according to the size of the largest TU; and the decoding is performed according to the divided luminance component coding unit and the chrominance component coding unit.

In addition, as shown in FIG. 9, the encoder/decoder 900 may further include: an input/output (I/O) device 904 and a display 905, etc.; wherein the functions of the above-mentioned components are similar to those of the prior art, and will not be repeated here. It is worth noting that the encoder/decoder 900 does not necessarily include all the components shown in FIG. 9; in addition, the encoder/decoder 900 may also include components not shown in FIG. 9, and you can refer to related technologies. .

An embodiment of the present application provides a computer-readable program, wherein when the program is executed in an electronic device, the program causes the electronic device to execute the image encoding method as described in the embodiment of the first aspect.

An embodiment of the present application provides a storage medium storing a computer-readable program, wherein the computer-readable program enables an electronic device to execute the image encoding method described in the embodiment of the first aspect.

An embodiment of the present application provides a computer-readable program, wherein when the program is executed in an electronic device, the program causes the electronic device to execute the image decoding method described in the embodiment of the second aspect.

An embodiment of the present application provides a storage medium storing a computer-readable program, wherein the computer-readable program enables an electronic device to execute the image decoding method described in the embodiment of the second aspect.

The above devices and methods of this application can be implemented by hardware, or by hardware combined with software. This application relates to such a computer-readable program, when the program is executed by a logic component, the logic component can realize the above-mentioned device or constituent component, or the logic component can realize the above-mentioned various methods Or steps. This application also relates to storage media for storing the above programs, such as hard disks, magnetic disks, optical disks, DVDs, flash memory, etc.

The method/device described in combination with the embodiments of the present application may be directly embodied as hardware, a software module executed by a processor, or a combination of the two. For example, one or more of the functional block diagrams and/or one or more combinations of the functional block diagrams shown in the figure may correspond to each software module of the computer program flow or each hardware module. These software modules can respectively correspond to the steps shown in the figure. These hardware modules can be implemented by solidifying these software modules using a field programmable gate array (FPGA), for example.

The software module can be located in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, removable disk, CD-ROM or any other form of storage medium known in the art. A storage medium may be coupled to the processor, so that the processor can read information from the storage medium and write information to the storage medium; or the storage medium may be an integral part of the processor. The processor and the storage medium may be located in the ASIC. The software module can be stored in the memory of the mobile terminal, or can be stored in a memory card that can be inserted into the mobile terminal. For example, if the device (such as a mobile terminal) uses a larger-capacity MEGA-SIM card or a large-capacity flash memory device, the software module can be stored in the MEGA-SIM card or a large-capacity flash memory device.

One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can be implemented as general-purpose processors, digital signal processors (DSPs) for performing the functions described in this application. ), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any appropriate combination thereof. One or more of the functional blocks described in the drawings and/or one or more combinations of the functional blocks can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, or multiple micro-processing Processor, one or more microprocessors in communication with the DSP, or any other such configuration.

The application is described above in conjunction with specific implementations, but it should be clear to those skilled in the art that these descriptions are all exemplary and do not limit the scope of protection of the application. Those skilled in the art can make various variations and modifications to the application according to the spirit and principle of the application, and these variations and modifications are also within the scope of the application.

Regarding the implementation including the above examples, the following supplementary notes are also disclosed:

Supplement 1. An image coding method, the method includes:

During the transformation and quantization process of image coding, determine whether the size of the coding unit CU exceeds the size of the maximum transformation unit TU;

In the case where the size of the coding unit CU exceeds the size of the maximum transformation unit TU, the luminance component coding unit and the chrominance component coding unit of the coding unit CU are divided according to the size of the maximum transformation unit TU. ;as well as

Encoding is performed according to the divided luminance component coding unit and chrominance component coding unit.

Supplement 2. The method according to Supplement 1, wherein the luminance component coding unit of the coding unit CU is divided into a plurality of luminance component transformation units, and the size of the luminance component transformation unit is equal to the maximum transformation unit TU Size, and

In the case that the size of the chroma component coding unit of the coding unit CU does not exceed the size of the maximum transformation unit TU, the size of the chroma component coding unit of the coding unit CU remains unchanged; in the coding unit CU In the case where the size of the chrominance component coding unit exceeds the size of the maximum transformation unit TU, the chrominance component unit of the coding unit CU is divided into a plurality of luminance component transformation units. The size is equal to the size of the largest transformation unit TU.

Appendix 3. The method according to Appendix 1 or 2, wherein the method further includes:

Encoding indication information for indicating coding unit division; the indication information indicating division according to the size of the maximum transformation unit TU when the size of the coding unit CU exceeds the size of the maximum transformation unit TU.

Supplement 4. The method according to any one of Supplements 1 to 3, wherein the image coding uses inter-frame prediction.

Appendix 5. An image decoding method, the method comprising:

In the process of inverse transformation and dequantization of image decoding, it is determined whether the size of the coding unit CU exceeds the size of the maximum transformation unit TU;

In the case where the size of the coding unit CU exceeds the size of the maximum transformation unit TU, the luminance component coding unit and the chrominance component coding unit of the coding unit CU are divided according to the size of the maximum transformation unit TU. ;as well as

Decoding is performed according to the divided luminance component coding unit and chrominance component coding unit.

Appendix 6. The method according to Appendix 5, wherein the luminance component coding unit of the coding unit CU is divided into a plurality of luminance component transformation units, and the size of the luminance component transformation unit is equal to the maximum transformation unit TU Size, and

In the case that the size of the chroma component coding unit of the coding unit CU does not exceed the size of the maximum transformation unit TU, the size of the chroma component coding unit of the coding unit CU remains unchanged; in the coding unit CU In the case where the size of the chrominance component coding unit exceeds the size of the maximum transformation unit TU, the chrominance component unit of the coding unit CU is divided into a plurality of luminance component transformation units. The size is equal to the size of the largest transformation unit TU.

Appendix 7. The method according to Appendix 5 or 6, wherein the method further includes:

Decoding indication information for indicating coding unit division; the indication information indicating division according to the size of the maximum transformation unit TU when the size of the coding unit CU exceeds the size of the maximum transformation unit TU.

Supplement 8. The method according to any one of Supplements 5 to 7, wherein the image decoding uses inter-frame prediction.

Claims (9)

An image coding device, the device comprising: A determining part, which determines whether the size of the coding unit exceeds the size of the maximum transformation unit during the transformation and quantization process of image coding; A dividing unit that, when the size of the coding unit exceeds the size of the maximum transformation unit, divides the luminance component coding unit and the chrominance component coding unit of the coding unit according to the size of the maximum transformation unit ;as well as The encoding unit performs encoding according to the divided luminance component coding unit and chrominance component coding unit. The apparatus according to claim 1, wherein the luminance component coding unit of the coding unit is divided into a plurality of luminance component transformation units, the size of the luminance component transformation unit is equal to the size of the maximum transformation unit, and In the case that the size of the chroma component coding unit of the coding unit does not exceed the size of the maximum transformation unit, the size of the chroma component coding unit of the coding unit remains unchanged; When the size of the coding unit exceeds the size of the maximum transformation unit, the chrominance component unit of the coding unit is divided into a plurality of chrominance component transformation units, and the size of the chrominance component transformation unit is equal to the size of the chrominance component transformation unit. The size of the largest transformation unit. The apparatus according to claim 1, wherein the encoding section also encodes indication information for indicating the division of coding units; the indication information indicates that the size of the coding unit exceeds the size of the maximum transformation unit In this case, the division is performed according to the size of the largest transformation unit. The apparatus according to claim 1, wherein the image encoding uses inter prediction. An image decoding device, the device includes: A determining part, which determines whether the size of the coding unit exceeds the size of the largest transformation unit during the inverse transformation and dequantization process of image decoding; A dividing unit that, when the size of the coding unit exceeds the size of the maximum transformation unit, divides the luminance component coding unit and the chrominance component coding unit of the coding unit according to the size of the maximum transformation unit ;as well as The decoding unit performs decoding according to the divided luminance component coding unit and chrominance component coding unit. The apparatus according to claim 5, wherein the luminance component encoding unit of the encoding unit is divided into a plurality of luminance component transformation units, the size of the luminance component transformation unit is equal to the size of the maximum transformation unit, and In the case that the size of the chrominance component coding unit of the coding unit does not exceed the size of the maximum transformation unit, the size of the chrominance component coding unit of the coding unit remains unchanged; When the size of the coding unit exceeds the size of the maximum transformation unit, the chrominance component unit of the coding unit is divided into a plurality of chrominance component transformation units, and the size of the chrominance component transformation unit is equal to the The size of the largest transformation unit. The apparatus according to claim 5, wherein the decoding unit further decodes indication information for indicating the division of coding units; the indication information indicates that the size of the coding unit exceeds the size of the maximum transformation unit In this case, the division is performed according to the size of the largest transformation unit. The device of claim 5, wherein the image decoding uses inter prediction. A video encoding and decoding device, including: The encoder determines whether the size of the coding unit exceeds the size of the maximum transformation unit during the transformation and quantization process of the image encoding; in the case that the size of the coding unit exceeds the size of the maximum transformation unit, according to the maximum transformation The size of the unit separately divides the luminance component coding unit and the chrominance component coding unit of the coding unit; and performs coding according to the divided luminance component coding unit and the chrominance component coding unit; The decoder determines whether the size of the coding unit exceeds the size of the maximum transformation unit during the inverse transformation and dequantization process of image decoding; in the case that the size of the coding unit exceeds the size of the maximum transformation unit, follow the The size of the largest transformation unit divides the luminance component coding unit and the chrominance component coding unit of the coding unit respectively; and performs decoding according to the divided luminance component coding unit and the chrominance component coding unit.

Images