CN117058255B - Color card identification method and device, electronic equipment and storage medium - Google Patents

Abstract

The disclosure relates to a color card identification method and device, an electronic device and a storage medium, wherein the method comprises the following steps: performing color lump identification on the color lump image to obtain an identified initial color lump, wherein the initial color lump is at least part of color lump in the color lump image of the color lump; determining an average size of the initial color patch; determining a rectangular frame formed by the color blocks at the outermost periphery in the color card image according to the initial color blocks; determining a spacing between adjacent color blocks based on the rectangular box; and determining the positions of all color blocks in the color card image according to the average size and the distance between adjacent color blocks by taking the rectangular frame as a reference. According to the embodiment of the disclosure, all color blocks in the color card can be accurately identified, and the efficiency is high.

Description

Color card identification method and device, electronic device and storage medium

Technical Field

The present disclosure relates to the field of computer technology, and in particular to a color card recognition method and device, an electronic device, and a storage medium.

Background technique

Image signal processing (ISP) algorithms can extract high-quality digital images from the raw data captured by image sensors. Clear and accurate images can be obtained by denoising, enhancing, and optimizing the raw data. ISP algorithms are widely used in various application scenarios related to image acquisition, such as smartphones, cameras, security monitoring, medical image processing, and autonomous driving.

The Color Correction Matrix (CCM) is a very important module in the ISP processing flow. Since the image sensor's response to the three primary colors is quite different from that of the human eye, and there is crosstalk between pixels, the image data output by the image sensor can only be restored to the true color that conforms to human eye perception after passing through the CCM module.

In the process of color correction through the CCM module, it is necessary to calculate the CCM value through a color card. A color card is a pre-set card including multiple color blocks. Each color block has a preset color. The colors of the color blocks are different. Multiple color blocks (commonly used are 24 color blocks) are used to cover a wide color range as much as possible. It is used for color selection, comparison, and communication to achieve the unification of color standards within a certain range.

In this process, a color card is usually photographed with an image sensor, and then the position of the color block in the image needs to be accurately located before subsequent CCM value calculation. However, the existing method often locates the position of the color block through manual calibration, which is inefficient.

Summary of the invention

The present disclosure proposes a color card recognition technology solution.

According to one aspect of the present disclosure, a color card recognition method is provided, comprising:

Performing color block recognition on the color card image to obtain recognized initial color blocks, wherein the initial color blocks are at least part of the color blocks in the color card image;

Determining an average size of the initial color blocks;

According to the initial color blocks, a rectangular frame formed by the outermost color blocks in the color card image is determined;

Determine the spacing between adjacent color blocks based on the rectangular frame;

Taking the rectangular frame as a reference, the positions of all color blocks in the color card image are determined according to the average size and the spacing between adjacent color blocks.

In a possible implementation, the performing color block recognition on the color card image to obtain the recognized initial color block includes:

Graying the color card image and binarizing the gray value to obtain a binary image;

Reversing the binary image to obtain a reversed image;

White contour detection is performed on the inverted image, and the position of the detected white contour is used as the position of the initial color block.

In a possible implementation manner, determining the average size of the initial color block includes:

Add the heights of the detected initial color blocks and divide the sum by the number of initial color blocks to obtain the average height of the initial color blocks;

The widths of the detected initial color blocks are added together and divided by the number of initial color blocks to obtain the average width of the initial color blocks.

In a possible implementation manner, determining the average size of the initial color block includes:

The largest color block among the initial color blocks is removed, and the sizes of the remaining initial color blocks are averaged to obtain the average size of the initial color blocks.

In a possible implementation, determining a rectangular frame formed by outermost color blocks in the color card image according to the initial color blocks includes:

Determine the center point coordinates of each initial color block;

Construct a rectangular box using the minimum and maximum values in the horizontal direction, as well as the minimum and maximum values in the vertical direction of all center point coordinates.

In a possible implementation manner, determining the spacing between adjacent color blocks based on the rectangular frame includes:

Determine the length of the rectangular frame in the horizontal direction, and divide it by the preset number of color blocks in the horizontal direction to obtain the horizontal spacing between adjacent color blocks;

The length of the rectangular frame in the vertical direction is determined, and divided by the preset number of color blocks in the vertical direction to obtain the vertical spacing between adjacent color blocks.

In a possible implementation, taking the rectangular frame as a reference and determining the positions of all color blocks in the color card image according to the average size and the spacing between adjacent color blocks, includes:

Determine the slope of the horizontal frame line passing through the target vertex, and the slope of the vertical frame line;

The target vertex is taken as the center point of a color block, and the target vertex is taken as the starting point. According to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation, taking the rectangular frame as a reference and determining the positions of all color blocks in the color card image according to the average size and the spacing between adjacent color blocks, includes:

Determine the midpoints of the four frame lines of the rectangular frame;

Connect the midpoints of the two vertical lines to get the horizontal center line, and connect the midpoints of the two horizontal lines to get the vertical center line;

determining the slope of the horizontal centerline, and the slope of the vertical centerline;

According to the arrangement rules of the color cards in the color card, the intersection of the horizontal center line and the vertical center line is used as the center point of the color block arrangement, and according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation, after determining the rectangular frame formed by the outermost color blocks in the color card image according to the initial color blocks, the method further includes:

Determining the horizontal and vertical ratios of the rectangular frame;

The step of determining the spacing between adjacent color blocks includes:

When the horizontal and vertical ratios meet a preset ratio range, the spacing between adjacent color blocks is determined. The preset ratio range is a reasonable range of the horizontal and vertical ratios of the preset rectangular frame.

According to one aspect of the present disclosure, there is provided a color card recognition device, comprising:

An initial recognition module, used to perform color block recognition on the color card image to obtain recognized initial color blocks, wherein the initial color blocks are at least part of the color blocks in the color card image;

An average size determination module, used to determine the average size of the initial color blocks;

A rectangular frame determination module, used to determine a rectangular frame formed by the outermost color blocks in the color card image according to the initial color blocks;

A spacing determination module, used to determine the spacing between adjacent color blocks based on the rectangular frame;

The position determination module is used to determine the positions of all color blocks in the color card image based on the rectangular frame and the average size and the spacing between adjacent color blocks.

In a possible implementation, the initial recognition module is used to grayscale the color card image and binarize the grayscale values to obtain a binary image; reverse the binary image from black to white to obtain an inverted image; perform white contour detection on the inverted image, and use the position of the detected white contour as the position of the initial color block.

In a possible implementation, the average size determination module is used to:

Add the heights of the detected initial color blocks and divide the sum by the number of initial color blocks to obtain the average height of the initial color blocks;

The widths of the detected initial color blocks are added together and divided by the number of initial color blocks to obtain the average width of the initial color blocks.

In a possible implementation, the average size determination module is used to:

The largest color block among the initial color blocks is removed, and the sizes of the remaining initial color blocks are averaged to obtain the average size of the initial color blocks.

In a possible implementation, the rectangular frame determination module is used to:

Determine the center point coordinates of each initial color block;

Construct a rectangular box using the minimum and maximum values in the horizontal direction, as well as the minimum and maximum values in the vertical direction of all center point coordinates.

In a possible implementation, the distance determination module is used to:

Determine the length of the rectangular frame in the horizontal direction, and divide it by the preset number of color blocks in the horizontal direction to obtain the horizontal spacing between adjacent color blocks;

The length of the rectangular frame in the vertical direction is determined, and divided by the preset number of color blocks in the vertical direction to obtain the vertical spacing between adjacent color blocks.

In a possible implementation, the location determination module is used to:

Determine the slope of the horizontal frame line passing through the target vertex, and the slope of the vertical frame line;

The target vertex is taken as the center point of a color block, and the target vertex is taken as the starting point. According to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation, the location determination module is used to:

Determine the midpoints of the four frame lines of the rectangular frame;

Connect the midpoints of the two vertical lines to get the horizontal center line, and connect the midpoints of the two horizontal lines to get the vertical center line;

determining the slope of the horizontal centerline, and the slope of the vertical centerline;

According to the arrangement rules of the color cards in the color card, the intersection of the horizontal center line and the vertical center line is used as the center point of the color block arrangement, and according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation manner, the device further includes:

A ratio determination module, used to determine the horizontal and vertical ratios of the rectangular frame;

The spacing determination module is used to determine the spacing between adjacent color blocks when the horizontal and vertical ratios meet a preset ratio range, and the preset ratio range is a reasonable range of the horizontal and vertical ratios of the preset rectangular frame.

According to one aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor.

In the disclosed embodiment, the color block recognition is performed on the color card image to obtain the recognized initial color block; then the average size of the initial color block is determined, and based on the initial color block, the rectangular frame formed by the outermost color blocks in the color card image is determined; then the spacing between adjacent color blocks is determined based on the rectangular frame; based on the rectangular frame, the positions of all color blocks in the color card image are determined according to the average size and the spacing between adjacent color blocks. Thus, by using the pre-recognized initial color block, the average size and spacing of the color block can be accurately obtained, and then the outermost rectangular frame of the color block is determined, and the area where all color blocks are located can be accurately determined, and then the color blocks are arranged in the rectangular frame according to the average size and spacing of the color blocks, and finally the positions of all color blocks are obtained, and other color blocks that have not been preliminarily recognized are accurately identified, and no manual click is required, which is highly efficient.

It should be understood that the above general description and the following detailed description are exemplary and explanatory only and do not limit the present disclosure. Other features and aspects of the present disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used to illustrate the technical solutions of the present disclosure together with the specification.

FIG. 1 is a schematic diagram showing a color chart image output by an image sensor before and after CCM correction.

FIG. 2 shows a flow chart of a color block recognition method according to an embodiment of the present disclosure.

FIG. 3 is a schematic diagram showing the positions of initial color blocks according to an embodiment of the present disclosure.

FIG. 4 is a schematic diagram showing the position of a rectangular frame according to an embodiment of the present disclosure.

FIG. 5 is a schematic diagram showing a color card image after grayscale processing and inversion according to an embodiment of the present disclosure.

FIG. 6 is a schematic diagram showing the positions of color cards obtained according to an embodiment of the present disclosure.

FIG. 7 shows a block diagram of a color block recognition device according to an embodiment of the present disclosure.

FIG8 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

The term "and/or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and/or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

The function of CCM image correction is to correct the spectral response of the image sensor. After correction, the image is more consistent with the real color perceived by the human eye. Figure 1 shows a schematic diagram of the color card image output by the image sensor before and after CCM correction. Part (a) of Figure 1 is the color card image output before CCM correction, and part (b) of Figure 1 is the color card image output after CCM correction.

CCM is a 3×3 matrix. When calculating the CCM matrix value of an image sensor, the image sensor is usually used to shoot a color card, and then the R, G, B average values of each color block in the color card image are polynomially fitted with the R, G, B target values of each color block in the X-Rite standard to obtain the optimized CCM matrix coefficients.

In the process of calculating the CCM value, the position of the color block in the color card image must be accurately located before the R, G, and B average values of each color block can be calculated. In the related art, the position of each color block can be manually specified by clicking the mouse, but this method is too inefficient and prone to errors. In addition, in some methods of identifying color blocks using image recognition algorithms, some special color blocks often need to be manually specified, and color blocks cannot be fully automatically identified. The efficiency is low, and the recognition accuracy is not high, and it is easy to fail to recognize.

FIG2 is a flow chart of a color block recognition method according to an embodiment of the present disclosure. As shown in FIG2 , the method includes:

In step S11, color block recognition is performed on the color card image to obtain recognized initial color blocks, where the initial color blocks are at least part of the color blocks in the color card image;

The color card image is an image of the color card captured by the image sensor. For example, the two images shown in Figure 1 include all the color blocks in the color card. To facilitate subsequent color block recognition, when the color card is captured by the image sensor, the image sensor can be directed toward the color card to minimize the size differences of the multiple color blocks in the color card image, thereby facilitating subsequent color block recognition based on the size of the color blocks in the image.

In this step, the recognition of color blocks is only preliminary, and there can be many specific recognition methods. In one example, the color blocks can be identified by threshold segmentation based on the difference between the pixel value of the color block and the background pixel value; in another example, the color blocks can be identified by edge detection-based segmentation based on the change of the grayscale value of the edge of the color block; in another example, the color blocks can be identified by encoding image features based on a deep learning algorithm and using a neural network, which can be, for example, a convolutional neural network, a residual neural network, and the like.

It should be noted that the color blocks in the color card often have multiple colors in order to cover a wider color range, so that the image sensor is universally applicable to multiple colors. Since the color blocks have many colors, image recognition based solely on color may not be able to recognize all the color blocks, that is, the initial color blocks recognized may be part of the color blocks in the color card image. For example, in a standard 24-color card, the color block in the lower right corner of the image is black, and the background color of the color block is often also black, resulting in the color block being unable to be recognized.

Figure 3 shows a schematic diagram of the position of the initial color blocks according to an embodiment of the present disclosure. As shown in Figure 3, the identified initial color blocks are only some of the color blocks (the color blocks surrounded by white frames) among all the color blocks. In particular, for the pure black color block in the lower right corner, its color is exactly the same as the background color, which makes it difficult for the color-based color block recognition algorithm to recognize it.

In step S12, determining the average size of the initial color blocks;

After the initial color block is identified, its position and size in the color card image can be obtained. The position here can be the position of the center point of the color card, and the size can be the length and width of the color card. The average size here can be the size of the initial color block in the color card image, which can be obtained by taking the average value of the initial color block.

In a possible implementation, determining the average size of the initial color blocks includes: adding the heights of the detected initial color blocks and dividing the sum by the number of the initial color blocks to obtain the average height of the initial color blocks; adding the widths of the detected initial color blocks and dividing the sum by the number of the initial color blocks to obtain the average width of the initial color blocks. Thus, by determining the average size of the initial color blocks, other color blocks that have not been initially identified can be accurately identified using the average size.

As another possible implementation of this step, determining the average size of the initial color block includes: removing the largest color block in the initial color block, averaging the sizes of the remaining initial color blocks, and obtaining the average size of the initial color block. In this implementation, considering that due to various reasons, there may be distortion in the collected color card image, resulting in the color block at the edge of the image being elongated, that is, the size of the color block is significantly enlarged, while the size of other color blocks in the image is relatively small, thus, by removing the largest color block in the initial color block, the color blocks with inconsistent sizes at the edge of the image due to lens distortion can be excluded, avoiding affecting the recognition of most color blocks in the area without image distortion. In addition, since the size of the initial color block at the edge of the image is large, the local area in the initial color block at the edge of the image can still be accurately identified by using a smaller average size. Since the entire area of a single color block does not need to be used in CCM image correction, only using the identified local area for CCM image correction does not affect the accuracy of image correction. Obviously, by removing the largest color block in the initial color blocks, the influence on the average size of the initial color blocks is reduced, and the accuracy of subsequent color block positioning based on the average size of the initial color blocks is improved.

In step S13, based on the initial color blocks, a rectangular frame formed by the outermost color blocks in the color card image is determined;

Since the initial color block recognition may only recognize part of the color blocks, as shown in FIG3, among these initial color blocks, at least one color block is recognized on each of the four outermost edges, and through a large number of experiments, in most cases, at least one color block is recognized on each of the four outermost edges through initial color block recognition. Therefore, the coordinate values of the initial color blocks can be used to determine the rectangular frame formed by the outermost color blocks in the color card image.

The rectangular frame here can be a rectangular frame formed by connecting the center points of the outermost color blocks in the color card image, or it can also be a rectangular frame formed by connecting the vertices on the same side of the color block. Therefore, the rectangular frame can be determined by determining the center point of the initial color block, or by determining the vertices of the initial color block. For details, please refer to the possible implementation methods provided in the present disclosure, which will not be repeated here.

Fig. 4 is a schematic diagram showing the position of a rectangular frame according to an embodiment of the present disclosure. The rectangular frame is a rectangular frame formed by connecting the center points of the outermost color blocks in the color card image.

In step S14, the spacing between adjacent color blocks is determined based on the rectangular frame;

The spacing between adjacent color blocks may be the distance between the center points of adjacent color blocks, or may also be the distance between the vertices on the same side of adjacent color blocks, for example, the distance between the lower left corner vertices of adjacent color blocks.

In a possible implementation, determining the spacing between adjacent color blocks based on the rectangular frame includes: determining the length of the rectangular frame in the horizontal direction, and dividing it by a preset number of color blocks in the horizontal direction to obtain the horizontal spacing between adjacent color blocks; determining the length of the rectangular frame in the vertical direction, and dividing it by a preset number of color blocks in the vertical direction to obtain the vertical spacing between adjacent color blocks.

After determining the rectangular frame, the length of the rectangular frame in the horizontal and vertical directions can be determined. Specifically, it can be determined by the coordinates of the vertices of the rectangular frame, which will not be described here. The arrangement rules of the color blocks in the color card are known. For example, as shown in Figure 3, in the 24-color card, there are 6 color blocks in the horizontal direction and 4 color blocks in the vertical direction. Then, the spacing between adjacent color blocks can be determined by dividing the length of the rectangular frame in a certain direction by the number of color blocks in that direction.

For example, for 24 color blocks, the length of the rectangular frame in the horizontal direction can be determined, and then divided by the number of color blocks in the horizontal direction, 6, to obtain the horizontal spacing between adjacent color blocks; then the length of the rectangular frame in the vertical direction can be determined, and then divided by the number of color blocks in the vertical direction, 4, to obtain the vertical spacing between adjacent color blocks. The number of color blocks in the horizontal direction and the number of color blocks in the vertical direction are both preset.

In the disclosed embodiment, the horizontal distance between adjacent color blocks is obtained by determining the length of the rectangular frame in the horizontal direction and dividing it by the preset number of color blocks in the horizontal direction; the vertical distance between adjacent color blocks is obtained by determining the length of the rectangular frame in the vertical direction and dividing it by the preset number of color blocks in the vertical direction. Thus, the distance between adjacent color blocks in the color card image can be accurately determined based on the preset number of color blocks in the horizontal and vertical directions by using the initially identified partial color blocks (initial color blocks).

In step S15, the positions of all color blocks in the color card image are determined based on the rectangular frame and the average size and the distance between adjacent color blocks.

Since the rectangular frame determines the area where all color blocks are located in the color card, and the color blocks are arranged in the color card according to the equal spacing rule, after determining the spacing and average size between the color blocks, the rectangular frame can be used as a reference. According to the spacing between adjacent color blocks, the color blocks of average size can be arranged in the rectangular frame at equal spacing to obtain the positions of all color cards in the color card image.

In the disclosed embodiment, the color block recognition is performed on the color card image to obtain the recognized initial color block; then the average size of the initial color block is determined, and based on the initial color block, the rectangular frame formed by the outermost color blocks in the color card image is determined; then the spacing between adjacent color blocks is determined based on the rectangular frame; based on the rectangular frame, the positions of all color blocks in the color card image are determined according to the average size and the spacing between adjacent color blocks. Thus, by using the pre-recognized initial color block, the average size and spacing of the color block can be accurately obtained, and then the outermost rectangular frame of the color block is determined, and the area where all color blocks are located can be accurately determined, and then the color blocks are arranged in the rectangular frame according to the average size and spacing of the color blocks, and finally the positions of all color blocks are obtained, and other color blocks that have not been preliminarily recognized are accurately identified, and no manual click is required, which is highly efficient.

In a possible implementation, the color block recognition of the color card image to obtain the recognized initial color block includes: graying the color card image and binarizing the grayscale value to obtain a binary image; inverting the binary image in black and white to obtain an inverted image; and detecting a white contour on the inverted image, and using the position of the detected white contour as the position of the initial color block.

Fig. 5 shows a schematic diagram of a color card image after grayscale processing according to an embodiment of the present disclosure. The color card image is grayscaled to remove RGB color information, and the grayscale value of each pixel in the color card image is obtained, and then the grayscale value is binarized. In an example, the binarization can be to set the value of the pixel whose grayscale value is greater than a certain threshold to 1, and to set the value of the pixel whose grayscale value is less than a certain threshold to 0, so as to obtain a binary image. The binary image can simplify the subsequent image processing process and reduce the processing resources consumed in the image processing process.

Then, the binary image is inverted from black to white to obtain an inverted image. The inversion process is to set 0 to 1 and 1 to 0 to obtain an inverted image. In this way, the edge area of the color block on the obtained inverted image is white. Then, by performing white contour detection on the inverted image, the position of the initial color block can be detected.

In the disclosed embodiment, the color card image is grayed and the gray value is binarized to obtain a binarized image; the binarized image is black-white inverted to obtain an inverted image; white contour detection is performed on the inverted image, and the position of the detected white contour is used as the position of the initial color block. Since the number of white pixels on the inverted image is small after the graying, binarization and black-white inversion operations, the white contour detection on the inverted image can reduce the amount of calculation and improve the efficiency of color card recognition.

In a possible implementation, a rectangular frame formed by the outermost color blocks in the color card image is determined based on the initial color blocks, including: determining the center point coordinates of each initial color block; and constructing a rectangular frame using the minimum and maximum values in the horizontal direction and the minimum and maximum values in the vertical direction of all center point coordinates.

The coordinates of the center point of the initial color block can be determined based on the detected position of the initial color block. Continuing with the above example, the initial position of the initial color block can be the position of the white contour line, specifically the coordinate values of multiple white pixels. Based on these coordinate values, the average values in the horizontal and vertical directions are taken to obtain the center point of the initial color block.

After determining the center point coordinates of each initial color block, the minimum value in the horizontal direction of all center point coordinates can be used as the x value of the two vertices on the left side of the rectangular frame; the maximum value in the horizontal direction of all center point coordinates can be used as the x value of the two vertices on the right side of the rectangular frame; the minimum value in the vertical direction of all center point coordinates can be used as the y value of the two vertices at the bottom of the rectangular frame; the maximum value in the vertical direction of all center point coordinates can be used as the y value of the two vertices at the top of the rectangular frame. After determining the x and y values of the four vertices, connect the four vertices of the rectangular frame to get the rectangular frame.

In the embodiment of the present disclosure, by determining the center point coordinates of each initial color block, and using the minimum and maximum values in the horizontal direction and the minimum and maximum values in the vertical direction of all the center point coordinates, a rectangular frame is constructed. Thus, the range where all the color blocks in the color card image are located can be accurately determined, which facilitates the subsequent arrangement of the color blocks in the range to accurately determine the positions of the color blocks.

In a possible implementation, the positions of all color blocks in the color card image are determined based on the rectangular frame as a reference and the average size and the spacing between adjacent color blocks, including: determining the slope of the horizontal frame line passing through the target vertex and the slope of the vertical frame line; taking the target vertex as the center point position of a color block, and taking the target vertex as the starting point, arranging multiple color blocks in sequence in the rectangular frame according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, to obtain the positions of all color blocks in the color card image.

The slope of the horizontal frame line can be the slope of any horizontal frame line, or can also be the average of the slopes of two horizontal frame lines. Taking the horizontal frame line as the horizontal frame line at the bottom of the rectangular frame as an example, its slope _k1 can be specifically expressed as:

k ₁ =( y ₁ –y ₂ )/( x ₁ –x ₂ ) (1)

Among them, _y1 represents the y value of the lower left vertex, _y2 represents the y value of the lower right vertex, _x1 represents the x value of the lower left vertex, and _x2 represents the x value of the lower right vertex.

The slope of the vertical frame line can be the slope of any vertical frame line, or can also be the average of the slopes of two vertical frame lines. Taking the vertical frame line on the right side of the rectangular frame as an example, its slope _k2 can be specifically expressed as:

k ₂ =( y ₃ –y ₄ )/( x ₃ –x ₄ ) (2)

Among them, y ₃ represents the y value of the upper right vertex, y ₄ represents the y value of the lower right vertex, x ₃ represents the x value of the upper right vertex, and x ₄ represents the x value of the lower right vertex.

The target vertex can be any vertex of the rectangular box. Taking the target vertex as the lower right corner vertex as an example, the lower right corner vertex of the target vertex can be used as the center point of the lower right color block, and then according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular box to obtain the positions of all color blocks in the color card image.

Taking the 24-color card shown in Figure 4 as an example, the specific mathematical process of determining the positions of all color blocks in the color card image can be implemented as follows: a rectangular coordinate system is established with the lower right corner as the origin, with the positive direction of the horizontal axis from right to left and the positive direction of the vertical axis from bottom to top; the horizontal spacing between adjacent color blocks is multiplied by the slope of the horizontal frame line to obtain the ordinate value of the center point of the first color block in the horizontal direction adjacent to the lower right color block, and its horizontal coordinate value is the horizontal spacing between adjacent color blocks; twice the horizontal spacing between adjacent color blocks is multiplied by the slope of the horizontal frame line to obtain the ordinate value of the center point of the second color block in the horizontal direction adjacent to the lower right corner, and its horizontal coordinate value is twice the horizontal spacing between adjacent color blocks, and so on, the coordinates of the center points of the six color blocks in the horizontal direction of the bottom row can be obtained.

By multiplying the vertical spacing between adjacent color blocks by the slope of the vertical frame line, we can get the horizontal coordinate value of the center point of the first color block in the vertical direction adjacent to the lower right character block, and its vertical coordinate value is the vertical spacing between adjacent color blocks; by multiplying twice the vertical spacing between adjacent color blocks by the slope of the vertical frame line, we can get the horizontal coordinate value of the center point of the second color block in the vertical direction adjacent to the lower right corner, and its vertical coordinate value is twice the vertical spacing between adjacent color blocks; and so on, we can get the coordinates of the center points of the four color blocks in the rightmost vertical direction. Then, take the center points of the three rightmost color blocks as the origin, multiply them by the spacing between adjacent color blocks, and get the coordinates of the center points of the remaining 15 color blocks in turn. The specific process will not be repeated.

After determining the coordinates of the center points of each color block, since the average size of the color block is known, the coordinates of the pixel points at the outermost edge of each color block are determined by each center point, and the position of each color block can be obtained. FIG6 shows a schematic diagram of the color card positions obtained according to an embodiment of the present disclosure, wherein the 24 positions framed by the black frame are the positions of the 24 identified color cards, and color correction can be performed using the colors in the black frame. Although the position in the black frame is not the outermost border of the entire color block, the identified color block portion is sufficient for subsequent color correction.

In a possible implementation, the rectangular frame is used as a reference, and the positions of all color blocks in the color card image are determined according to the average size and the spacing between adjacent color blocks, including: determining the midpoints of the four frame lines of the rectangular frame; connecting the midpoints of two vertical frame lines to obtain a horizontal center line, and connecting the midpoints of two horizontal frame lines to obtain a vertical center line; determining the slope of the horizontal center line and the slope of the vertical center line; according to the arrangement rules of the color cards in the color card, taking the intersection of the horizontal center line and the vertical center line as the center point of the color block arrangement, arranging multiple color blocks in sequence in the rectangular frame according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, to obtain the positions of all color blocks in the color card image.

The midpoints of the four frame lines of the rectangular frame can be determined based on the vertices of the rectangular frame, and then the midpoints of the two vertical frame lines (i.e., the left and right midpoints) are connected to obtain the horizontal midline, and the midpoints of the two horizontal frame lines (i.e., the upper and lower midpoints) are connected to obtain the vertical midline.

The intersection of the vertical center line and the horizontal center line is the midpoint of the rectangular frame. A rectangular coordinate system is established with the midpoint as the origin, with the positive direction of the horizontal axis from left to right and the positive direction of the vertical axis from bottom to top. Multiplying half of the horizontal spacing between adjacent color blocks by the slope of the horizontal center line can give the vertical coordinate value of the center point of the first color block to the upper right of the origin, and its horizontal coordinate value is half of the horizontal spacing between adjacent color blocks. The specific process is similar to the aforementioned implementation method, and the process of determining the positions of other color blocks will not be repeated here.

In this implementation, the center point of the rectangular frame is determined, and the position of each color block is determined using the center point as the starting point, thereby reducing the possibility of inaccurate positioning due to image distortion when using the edge as the starting point, and improving the accuracy of the determined color block position.

In a possible implementation, after determining the rectangular frame formed by the outermost color blocks in the color card image based on the initial color blocks, the method further includes: determining the horizontal and vertical ratios of the rectangular frame; determining the spacing between adjacent color blocks includes: determining the spacing between adjacent color blocks when the horizontal and vertical ratios are within a preset ratio range, and the preset ratio range is a reasonable range of the horizontal and vertical ratios of the preset rectangular frame.

The horizontal and vertical ratio of the rectangular frame may be the ratio of any horizontal frame line to any vertical frame line, or may be the ratio of the vertical center line to the horizontal center line.

In some extreme cases, a color block in a column or a row at the outermost edge of the color card does not recognize any initial color block during the initial recognition. In order to improve the accuracy of the constructed rectangular frame, a reasonable range of the horizontal and vertical ratios of the rectangular frame can be preset. If the reasonable range is exceeded, it is considered that a color block in a column or a row at the outermost edge of the color card may not recognize any initial color block during the initial recognition. The specific preset ratio range can be determined according to actual applications, and the present disclosure does not limit this.

Therefore, by determining the spacing between adjacent color blocks when the horizontal and vertical ratios meet the preset ratio range, the accuracy of the positions of all color blocks in the final color card image can be improved.

In one possible implementation, the color block recognition method can be executed by electronic devices such as terminal devices and servers. The terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. The method can be implemented by a processor calling computer-readable instructions stored in a memory.

In addition, the present disclosure also provides a color block recognition device, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any color block recognition method provided by the present disclosure. The corresponding technical solutions and descriptions are referred to the corresponding records in the method part and will not be repeated here.

FIG. 7 shows a block diagram of a color block recognition device according to an embodiment of the present disclosure. As shown in FIG. 7 , the device 70 includes:

An initial recognition module 71 is used to perform color block recognition on the color card image to obtain recognized initial color blocks, where the initial color blocks are at least part of the color blocks in the color card image;

An average size determination module 72, used to determine the average size of the initial color blocks;

A rectangular frame determination module 73 is used to determine a rectangular frame formed by the outermost color blocks in the color card image according to the initial color blocks;

A spacing determination module 74, configured to determine the spacing between adjacent color blocks based on the rectangular frame;

The position determination module 75 is used to determine the positions of all color blocks in the color card image based on the rectangular frame and the average size and the distance between adjacent color blocks.

In a possible implementation, the initial recognition module is used to grayscale the color card image and binarize the grayscale values to obtain a binary image; reverse the binary image from black to white to obtain an inverted image; perform white contour detection on the inverted image, and use the position of the detected white contour as the position of the initial color block.

In a possible implementation, the average size determination module is used to:

Add the heights of the detected initial color blocks and divide the sum by the number of initial color blocks to obtain the average height of the initial color blocks;

The widths of the detected initial color blocks are added together and divided by the number of initial color blocks to obtain the average width of the initial color blocks.

In a possible implementation, the average size determination module is used to:

The largest color block among the initial color blocks is removed, and the sizes of the remaining initial color blocks are averaged to obtain the average size of the initial color blocks.

In a possible implementation, the rectangular frame determination module is used to:

Determine the center point coordinates of each initial color block;

Construct a rectangular box using the minimum and maximum values in the horizontal direction, as well as the minimum and maximum values in the vertical direction of all center point coordinates.

In a possible implementation, the distance determination module is used to:

Determine the length of the rectangular frame in the horizontal direction, and divide it by the preset number of color blocks in the horizontal direction to obtain the horizontal spacing between adjacent color blocks;

The length of the rectangular frame in the vertical direction is determined, and divided by the preset number of color blocks in the vertical direction to obtain the vertical spacing between adjacent color blocks.

In a possible implementation, the location determination module is used to:

Determine the slope of the horizontal frame line passing through the target vertex, and the slope of the vertical frame line;

The target vertex is taken as the center point of a color block, and the target vertex is taken as the starting point. According to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation, the location determination module is used to:

Determine the midpoints of the four frame lines of the rectangular frame;

Connect the midpoints of the two vertical lines to get the horizontal center line, and connect the midpoints of the two horizontal lines to get the vertical center line;

determining the slope of the horizontal centerline, and the slope of the vertical centerline;

According to the arrangement rules of the color cards in the color card, the intersection of the horizontal center line and the vertical center line is used as the center point of the color block arrangement, and according to the spacing between adjacent color blocks, along the slope of the horizontal frame line and the slope of the vertical frame line, multiple color blocks are arranged in sequence in the rectangular frame to obtain the positions of all color blocks in the color card image.

In a possible implementation manner, the device further includes:

A ratio determination module, used to determine the horizontal and vertical ratios of the rectangular frame;

The spacing determination module is used to determine the spacing between adjacent color blocks when the horizontal and vertical ratios meet a preset ratio range, and the preset ratio range is a reasonable range of the horizontal and vertical ratios of the preset rectangular frame.

In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the above method.

The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

The electronic device may be provided as a terminal, a server, or a device in other forms.

8 shows a block diagram of an electronic device 800 according to an embodiment of the present disclosure. For example, the electronic device 800 may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, or other terminal devices.

8 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , a sensor component 814 , and a communication component 816 .

The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations on the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

I/O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open/closed state of the electronic device 800, the relative positioning of the components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as a wireless network (Wi-Fi), a second generation mobile communication technology (2G), a third generation mobile communication technology (3G), a fourth generation mobile communication technology (4G), a long-term evolution (LTE) of a universal mobile communication technology, a fifth generation mobile communication technology (5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by a processor 820 of an electronic device 800 to perform the above method.

The present disclosure may be a system, a method and/or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

Computer readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. Computer readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (non-exhaustive list) of computer readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, for example, a punch card or a convex structure in a groove on which instructions are stored, and any suitable combination thereof. The computer readable storage medium used here is not interpreted as a transient signal itself, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagated by a waveguide or other transmission medium (for example, a light pulse by an optical fiber cable), or an electrical signal transmitted by a wire.

The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing/processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device.

The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be personalized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

Various aspects of the present disclosure are described herein with reference to the flowcharts and/or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and/or block diagram and the combination of each box in the flowchart and/or block diagram can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions/actions specified in one or more boxes in the flowchart and/or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and/or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions/actions specified in one or more boxes in the flowchart and/or block diagram.

Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions/actions specified in one or more boxes in the flowchart and/or block diagram.

The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is embodied as a computer storage medium, and in another optional embodiment, the computer program product is embodied as a software product, such as a software development kit (SDK) and the like.

The above description of various embodiments tends to emphasize the differences between the various embodiments. The same or similar aspects can be referenced to each other, and for the sake of brevity, they will not be repeated herein.

Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

If the technical solution of this application involves personal information, the product using the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing the personal information. If the technical solution of this application involves sensitive personal information, the product using the technical solution of this application has obtained the individual's separate consent before processing the sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, clear and prominent signs are set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that he or she agrees to the collection of his or her personal information; or on the device that processes personal information, the personal information processing rules are notified by obvious signs/information, and the individual's authorization is obtained through pop-up information or by asking the individual to upload his or her personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.

The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (11)

1. A color chart identification method, comprising:

performing color lump identification on the color lump image to obtain an identified initial color lump, wherein the initial color lump is at least part of color lump in the color lump image of the color lump;

Determining an average size of the initial color patch;

Determining a rectangular frame formed by the color blocks at the outermost periphery in the color card image according to the initial color blocks, wherein the rectangular frame is a rectangular frame formed by connecting lines of central points of the color blocks at the outermost periphery in the color card image or a rectangular frame formed by connecting lines of vertexes at the same side of the color blocks;

determining a spacing between adjacent color blocks based on the rectangular box;

The rectangular frame is taken as a reference, color blocks with average size are arranged in the rectangular frame at equal intervals according to the average size and the interval between the adjacent color blocks, and the positions of all the color blocks are determined in the color card image;

the determining a spacing between adjacent color blocks based on the rectangular frame includes:

Determining the length of the rectangular frame in the horizontal direction, and dividing the length by the preset number of color blocks in the horizontal direction to obtain the horizontal distance between the adjacent color blocks;

And determining the length of the rectangular frame in the vertical direction, and dividing the length by the preset number of color blocks in the vertical direction to obtain the vertical distance between the adjacent color blocks.

2. The method of claim 1, wherein performing patch recognition on the color chip image to obtain a recognized initial patch comprises:

Carrying out gray scale treatment on the color card image, and carrying out binarization on gray scale values to obtain a binarized image;

Performing black-white inversion on the binarized image to obtain an inverted image;

And performing white contour detection on the inverted image, and taking the position of the detected white contour as the position of the initial color block.

3. The method of claim 1, wherein determining the average size of the initial color block comprises:

adding the detected heights of the initial color blocks, and dividing the heights by the number of the initial color blocks to obtain the average heights of the initial color blocks;

the widths of the detected initial color patches are added and divided by the number of initial color patches to obtain an average width of the initial color patches.

4. The method of claim 1, wherein determining the average size of the initial color block comprises:

And removing the color block with the largest size in the initial color blocks, and averaging the sizes of the rest initial color blocks to obtain the average size of the initial color blocks.

5. The method of claim 1, wherein determining a rectangular box of outermost color patches in the color card image based on the initial color patches, comprises:

Determining the center point coordinates of each initial color block;

And constructing a rectangular frame by utilizing the minimum value and the maximum value in the horizontal direction and the minimum value and the maximum value in the vertical direction in all the center point coordinates.

6. The method of claim 1, wherein determining the locations of all color patches in the color card image based on the average size and the spacing between adjacent color patches based on the rectangular box comprises:

determining the slope of the horizontal wire passing through the target vertex and the slope of the vertical wire;

and taking the target vertex as the center point of one color block, and taking the target vertex as the starting point, and sequentially arranging a plurality of color blocks in the rectangular frame according to the slope of the horizontal frame line and the slope of the vertical frame line and the interval between the adjacent color blocks to obtain the positions of all the color blocks in the color card image.

7. The method of claim 1, wherein determining the locations of all color patches in the color card image based on the average size and the spacing between adjacent color patches based on the rectangular box comprises:

determining the midpoints of four frame wires of the rectangular frame;

Connecting the midpoints of the two vertical frame wires to obtain a horizontal midline, and connecting the midpoints of the two horizontal frame wires to obtain a vertical midline;

determining the slope of the horizontal midline, and the slope of the vertical midline;

According to the arrangement rule of the color cards in the color cards, taking the intersection point of the horizontal central line and the vertical central line as the central point of the color block arrangement, and according to the interval between the adjacent color blocks, sequentially arranging a plurality of color blocks in the rectangular frame along the slope of the horizontal frame line and the slope of the vertical frame line to obtain the positions of all the color blocks in the color card image.

8. The method of claim 5, wherein after determining a rectangular frame formed by a color block at the outermost periphery of the color card image according to the initial color block, the method further comprises:

determining the transverse-longitudinal proportion of the rectangular frame;

The determining the spacing between adjacent color blocks includes:

And under the condition that the transverse and longitudinal proportion accords with a preset proportion range, determining the distance between the adjacent color blocks, wherein the preset proportion range is a reasonable range of the transverse and longitudinal proportion of the preset rectangular frame.

9. A color chart identification device, comprising:

The initial identification module is used for carrying out color lump identification on the color card image to obtain an identified initial color lump, wherein the initial color lump is at least part of color lump in the color lump of the color card image;

An average size determining module, configured to determine an average size of the initial color patch;

The rectangular frame determining module is used for determining a rectangular frame formed by the color blocks at the outermost periphery in the color card image according to the initial color blocks, wherein the rectangular frame is a rectangular frame formed by connecting lines of the central points of the color blocks at the outermost periphery in the color card image or a rectangular frame formed by connecting lines of vertexes at the same side of the color blocks;

A spacing determining module for determining a spacing between adjacent color blocks based on the rectangular frame;

the position determining module is used for arranging color blocks with average size in the rectangular frame at equal intervals according to the average size and the interval between the adjacent color blocks by taking the rectangular frame as a reference, and determining the positions of all the color blocks in the color card image;

The interval determining module is used for:

Determining the length of the rectangular frame in the horizontal direction, and dividing the length by the preset number of color blocks in the horizontal direction to obtain the horizontal distance between the adjacent color blocks;

And determining the length of the rectangular frame in the vertical direction, and dividing the length by the preset number of color blocks in the vertical direction to obtain the vertical distance between the adjacent color blocks.

10. An electronic device, comprising:

A processor;

a memory for storing processor-executable instructions;

Wherein the processor is configured to invoke the instructions stored in the memory to implement the method of any of claims 1 to 8.

11. A computer readable storage medium having stored thereon computer program instructions, which when executed by a processor, implement the method of any of claims 1 to 8.