CN117011134B - Direct scaling method for display sub-pixel diamond arrangement image - Google Patents
Direct scaling method for display sub-pixel diamond arrangement image Download PDFInfo
- Publication number
- CN117011134B CN117011134B CN202310525396.0A CN202310525396A CN117011134B CN 117011134 B CN117011134 B CN 117011134B CN 202310525396 A CN202310525396 A CN 202310525396A CN 117011134 B CN117011134 B CN 117011134B
- Authority
- CN
- China
- Prior art keywords
- pixel
- sub
- triangular
- triangular area
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4023—Scaling of whole images or parts thereof, e.g. expanding or contracting based on decimating pixels or lines of pixels; based on inserting pixels or lines of pixels
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
- G09G3/3208—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED] organic, e.g. using organic light-emitting diodes [OLED]
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/391—Resolution modifying circuits, e.g. variable screen formats
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0457—Improvement of perceived resolution by subpixel rendering
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域Technical Field
本发明属于显示器技术领域,尤其涉及一种针对显示器子像素菱形排布图像的直接缩放方法。The present invention belongs to the technical field of displays, and in particular relates to a direct scaling method for a diamond-arranged image of sub-pixels of a display.
背景技术Background Art
如图1所示,目前大部分OLED显示器使用了具有菱形排列子像素的排列方式,以Pentile排列为代表,这种方式在保证显示质量的同时降低子像素的密度从而降低工艺难度和成本。此种排列并非是Green子像素1、Red子像素2和Blue子像素3三种颜色子像素数目一一对应的,其显示的时候,通常G的子像素数目是R或B的数目的两倍。在这种情况下,对于输入的信号源就可以降低到原来数据的2/3,或者保持原来100%数据但在显示驱动芯片上重新做子像素排列的空间渲染(SPR—Sub Pixel Rendering)。比如苹果手机使用的是前一种传输方案,而大部分安卓手机则使用的是后一种。As shown in Figure 1, most OLED displays currently use a diamond-shaped arrangement of sub-pixels, represented by the Pentile arrangement. This method reduces the density of sub-pixels while ensuring display quality, thereby reducing process difficulty and cost. This arrangement does not correspond to the number of sub-pixels of the three colors, Green sub-pixel 1, Red sub-pixel 2, and Blue sub-pixel 3. When displayed, the number of G sub-pixels is usually twice the number of R or B. In this case, the input signal source can be reduced to 2/3 of the original data, or the original 100% data can be maintained but the spatial rendering (SPR—Sub Pixel Rendering) of the sub-pixel arrangement can be re-performed on the display driver chip. For example, Apple phones use the former transmission solution, while most Android phones use the latter.
在某些特定的使用情况下,需要对显示图像分辨率做缩放处理,比如当输入的数据分辨率与显示分辨率不同时,或者当某些算法处理需要对输入图像数据做插值处理时。对于RGB子像素数目相同的输入信号,传统的缩放插值处理通常使用双三次(bi-cubic)插值等等处理,但是对于已经做了子像素排列的空间渲染(SPR)的输入(以下简称为SPR输入数据),通常的做法是还原到完整的图像数据(RGB数目相同),再做如上插值处理,最后再做一次子像素排列的空间渲染(SPR)处理。In some specific use cases, it is necessary to scale the display image resolution, such as when the input data resolution is different from the display resolution, or when some algorithm processing requires interpolation of the input image data. For input signals with the same number of RGB sub-pixels, traditional scaling interpolation processing usually uses bi-cubic interpolation and other processing, but for input that has been subjected to sub-pixel spatial rendering (SPR) (hereinafter referred to as SPR input data), the usual practice is to restore it to the complete image data (same number of RGB), then perform the above interpolation processing, and finally perform sub-pixel spatial rendering (SPR) processing again.
对于SPR的输入数据,其绿色子像素数目和屏幕分辨率是一致的,所以在做分辨率缩放(Scaling)的时候,直接通过插值处理就可以,通常使用双三次插值(bi-cubicinterpolation)效果比较好,且比较常用。For the SPR input data, the number of green sub-pixels is consistent with the screen resolution, so when scaling the resolution (Scaling), it can be directly processed by interpolation. Usually, bi-cubic interpolation has a better effect and is more commonly used.
对于红蓝两色的子像素,其排列是菱形排布的,且数目是屏幕分辨率的一半。传统的缩放方法,如图2A至图2E所示,需要先将缺失的另一半子像素补齐,这一步骤称作anti-SPR。这样,红蓝两色的子像素数目也和绿色一样,且一一对应。接下来就可以直接使用双三次插值(Bi-Cubic)处理。缩放处理完毕后,还要将缩放完的数据,进行SPR处理,才能正确在显示屏上显示。图中原始图像的子像素4用带阴影线的菱形表示,补齐的子像素5用空心的菱形表示,缩放后的目标子像素6用黑色菱形表示。For the red and blue sub-pixels, they are arranged in a diamond shape, and the number is half of the screen resolution. The traditional scaling method, as shown in Figures 2A to 2E, requires first filling in the missing half of the sub-pixels, a step called anti-SPR. In this way, the number of red and blue sub-pixels is the same as that of green, and they correspond one to one. Next, you can directly use bicubic interpolation (Bi-Cubic) processing. After the scaling process is completed, the scaled data must also be subjected to SPR processing before it can be correctly displayed on the display. In the figure, the sub-pixel 4 of the original image is represented by a shaded diamond, the filled sub-pixel 5 is represented by a hollow diamond, and the scaled target sub-pixel 6 is represented by a black diamond.
现有技术存在以下三点的缺点:The prior art has the following three disadvantages:
1、补齐像素的anti-SPR步骤和缩放后的SPR步骤均会引入额外的误差,且SPR算法质量直接关系到显示的质量;1. The anti-SPR step of padding pixels and the SPR step after scaling will introduce additional errors, and the quality of the SPR algorithm is directly related to the quality of the display;
2、整个过程冗长且复杂,占用显示屏驱动芯片的面积和功耗负担较高。2. The whole process is lengthy and complicated, and occupies a high area and power consumption burden of the display driver chip.
发明内容Summary of the invention
有鉴于此,本发明的目的在于提供一种针对显示器子像素菱形排布图像的直接缩放方法,对于子像素菱形排布的图像数据,通过选取斜向排列的像素点直接而准确的进行双三次插值处理,避免在驱动芯片能做复杂的anti-SPR和SPR运算,大大节省了驱动芯片的功耗、面积和制造成本。In view of this, an object of the present invention is to provide a direct scaling method for a display sub-pixel diamond-arranged image. For the image data of the sub-pixel diamond-arranged image, bicubic interpolation processing is directly and accurately performed by selecting obliquely arranged pixel points, thereby avoiding complex anti-SPR and SPR operations in the driver chip, thereby greatly saving the power consumption, area and manufacturing cost of the driver chip.
本发明要解决的技术问题是提供一种直接斜向选取SPR输入数据中的参考像素点集做插值缩放的方法,如图3A至图3C所示,方法直接而且简洁,最大限度的减少了额外的误差和开销。对于插值缩放常用的双三次插值算法,通常要求X,Y方向正交,首先计算X方向上的插值结果,再计算Y方向的插值结果,对于菱形排列的子像素,因为奇偶行相位错开了,显然无法适用于常规的双三次算法。本发明将实际的子像素的参考坐标轴旋转45°,旋转后新的X,Y方向重新正交,所以常规的双三次算法完全适用。The technical problem to be solved by the present invention is to provide a method for directly obliquely selecting a reference pixel point set in the SPR input data for interpolation and scaling, as shown in Figures 3A to 3C, the method is direct and concise, and minimizes additional errors and overhead. For the bicubic interpolation algorithm commonly used for interpolation and scaling, it is usually required that the X and Y directions are orthogonal. First, the interpolation result in the X direction is calculated, and then the interpolation result in the Y direction is calculated. For sub-pixels arranged in a diamond shape, because the phases of the odd and even rows are staggered, it is obviously not applicable to the conventional bicubic algorithm. The present invention rotates the reference coordinate axis of the actual sub-pixel by 45°, and the new X and Y directions are orthogonal again after rotation, so the conventional bicubic algorithm is fully applicable.
为实现上述目的,本发明提供了一种针对显示器子像素菱形排布图像的直接缩放方法,包括如下步骤:To achieve the above object, the present invention provides a direct scaling method for a display sub-pixel diamond arrangement image, comprising the following steps:
步骤S1:确定新分辨率的每个子像素的参考像素点集,所述参考像素点集包括斜向排列的若干行乘以若干列的原分辨率下真实存在的参考像素点;Step S1: determining a reference pixel point set for each sub-pixel of the new resolution, wherein the reference pixel point set includes a number of rows and a number of columns of reference pixel points that actually exist at the original resolution and are arranged obliquely;
步骤S2:根据所述子像素相对所述参考像素点集的位置关系确定斜向等效相位(xs,ys);所述斜向等效相位为:以所述原分辨率下真实存在的像素点为格点的旋转坐标系中的等效相位;Step S2: determining an oblique equivalent phase ( xs , ys ) according to the positional relationship of the sub-pixel relative to the reference pixel point set; the oblique equivalent phase is: an equivalent phase in a rotating coordinate system with the actual pixel points at the original resolution as grid points;
步骤S3:根据所述斜向等效相位和所述参考像素点集的各个像素点亮度值计算所述子像素的插值亮度Zs。Step S3: Calculate the interpolated brightness Z s of the sub-pixel according to the oblique equivalent phase and the brightness value of each pixel point in the reference pixel point set.
优选地,步骤S1具体包括步骤S1.1至步骤S1.3:Preferably, step S1 specifically includes steps S1.1 to S1.3:
步骤S1具体包括步骤S1.1至步骤S1.3:Step S1 specifically includes steps S1.1 to S1.3:
步骤S1.1:获取新分辨率相对于原分辨率在x方向和y方向上的尺寸倍率ratiox和ratioy;Step S1.1: Obtaining the size ratios of the new resolution in the x direction and the original resolution in the y direction, namely, ratio x and ratio y ;
步骤S1.2:对于新分辨率的每个子像素,计算其在原分辨率下的坐标位置的整数部分(xt,yt)以及小数部分(Δxt,Δyt);Step S1.2: For each sub-pixel of the new resolution, calculate the integer part (x t , y t ) and the fractional part (Δx t , Δy t ) of its coordinate position at the original resolution;
步骤S1.3:步骤S1.2中所述的坐标位置的整数部分(xt,yt)对应的像素格子为第一像素格子;Step S1.3: The pixel grid corresponding to the integer part (x t , y t ) of the coordinate position described in step S1.2 is the first pixel grid;
根据第一像素格子的顶点处的原分辨率下真实存在的像素点的连线,将第一像素格子分为两个三角形区域,所述两个三角形区域包括第一三角形区域和第二三角形区域;根据所述两个三角形区域的排布方式的情况和所述子像素位于第一三角形区域或者第二三角形区域的情况,计算坐标基准值(x0,y0);According to the connection lines of the real pixel points at the original resolution at the vertices of the first pixel grid, the first pixel grid is divided into two triangular areas, the two triangular areas include a first triangular area and a second triangular area; according to the arrangement of the two triangular areas and the situation that the sub-pixel is located in the first triangular area or the second triangular area, the coordinate reference value (x 0 , y 0 ) is calculated;
所述坐标基准值(x0,y0)为所述参考像素点的坐标基准;The coordinate reference value (x 0 , y 0 ) is the coordinate reference of the reference pixel point;
步骤S2具体为:根据所述坐标位置的小数部分(Δxt,Δyt)以及步骤S3中所述两个三角形区域的排布方式的情况和所述子像素位于第一三角形区域或者第二三角形区域的情况得到所述斜向等效相位(xs,ys),所述斜向等效相位(xs,ys)为所述子像素在所述旋转坐标系中对应的坐标值的小数部分;Step S2 specifically comprises: obtaining the oblique equivalent phase ( xs , ys ) according to the decimal part of the coordinate position (Δxt, Δyt), the arrangement of the two triangular regions in step S3, and the situation that the sub-pixel is located in the first triangular region or the second triangular region, wherein the oblique equivalent phase ( xs , ys ) is the decimal part of the coordinate value corresponding to the sub-pixel in the rotating coordinate system;
步骤S3具体包括步骤S3.1至步骤S3.3:Step S3 specifically includes steps S3.1 to S3.3:
步骤S3.1:获取所述参考像素点集的各个像素点亮度值;Step S3.1: Obtain the brightness value of each pixel in the reference pixel set;
步骤S3.2:根据所述斜向等效相位(xs,ys)计算所述像素点亮度值对应的权重值;Step S3.2: Calculating a weight value corresponding to the brightness value of the pixel point according to the oblique equivalent phase (x s , y s );
步骤S3.3:根据所述权重值和所述像素点亮度值计算所述子像素的插值亮度Zs。Step S3.3: Calculate the interpolated brightness Z s of the sub-pixel according to the weight value and the brightness value of the pixel point.
优选地,步骤S1.3所述两个三角形区域的排布方式的情况和所述子像素位于第一三角形区域或者第二三角形区域的情况,具体包括:Preferably, the arrangement of the two triangular regions in step S1.3 and the situation where the sub-pixel is located in the first triangular region or the second triangular region specifically include:
第一情况:第一三角形区域位于第一像素格子右上方,第二三角形区域位于第一像素格子左下方,所述子像素位于第二三角形区域;Case 1: the first triangular area is located at the upper right of the first pixel grid, the second triangular area is located at the lower left of the first pixel grid, and the sub-pixel is located in the second triangular area;
第二情况:第一三角形区域位于第一像素格子左上方,第二三角形区域位于第一像素格子右下方,所述子像素位于第二三角形区域;Second situation: the first triangular area is located at the upper left of the first pixel grid, the second triangular area is located at the lower right of the first pixel grid, and the sub-pixel is located in the second triangular area;
第三情况:第一三角形区域位于第一像素格子右上方,第二三角形区域位于第一像素格子左下方,所述子像素位于第一三角形区域;The third situation: the first triangular area is located at the upper right of the first pixel grid, the second triangular area is located at the lower left of the first pixel grid, and the sub-pixel is located in the first triangular area;
第四情况:第一三角形区域位于第一像素格子左上方,第二三角形区域位于第一像素格子右下方,所述子像素位于第一三角形区域。Fourth situation: the first triangular area is located at the upper left of the first pixel grid, the second triangular area is located at the lower right of the first pixel grid, and the sub-pixel is located in the first triangular area.
优选地,步骤S1.3所述计算坐标基准值(x0,y0),具体为根据公式(1)和公式(2)计算坐标基准值(x0,y0):Preferably, the calculation of the coordinate reference value (x 0 , y 0 ) in step S1.3 is specifically to calculate the coordinate reference value (x 0 , y 0 ) according to formula (1) and formula (2):
x0=xt-2-p (1);x 0 = x t -2-p (1);
y0=yt-2-q (2);y 0 =y t -2-q (2);
其中:p在第一情况和第四情况时为1,在第二情况和第三情况时为0;q在第一情况和第二情况时为0,在第三情况和第四情况时为1。Among them: p is 1 in the first and fourth cases, and is 0 in the second and third cases; q is 0 in the first and second cases, and is 1 in the third and fourth cases.
优选地,所述参考像素点集包括的参考像素点的个数为16个,所述参考像素点的坐标值以坐标基准值(x0,y0)表示,分别为:Preferably, the reference pixel set includes 16 reference pixel points, and the coordinate values of the reference pixel points are expressed as coordinate reference values (x 0 , y 0 ), which are respectively:
(x0+0,y0+3)、(x0+1,y0+2)、(x0+2,y0+1)、(x0+3,y0+0)、(x0+1,y0+4)、(x0+2,y0+3)、(x0+3,y0+2)、(x0+4,y0+1)、(x0+2,y0+5)、(x0+3,y0+4)、(x0+4,y0+3)、(x0+5,y0+2)、(x0+3,y0+6)、(x0+4,y0+5)、(x0+5,y0+4)、(x0+6,y0+3)。(x 0 +0,y 0 +3), (x 0 +1,y 0 +2), (x 0 +2,y 0 +1), (x 0 +3,y 0 +0), (x 0 +1,y 0 +4), (x 0 +2,y 0 +3), (x 0 +3,y 0 +2), (x 0 +4,y 0 +1), (x 0 + 2,y 0 +5), (x 0 +3,y 0 +4), (x 0 +4,y 0 +3), (x 0 +5,y 0 +2), (x 0 +3, y 0 +6), (x 0 +4, y 0 +5), (x 0 +5, y 0 +4), (x 0 +6, y 0 +3).
优选地,步骤S2具体为:Preferably, step S2 specifically includes:
根据公式(3)和公式(4)计算斜向等效相位(xs,ys):The oblique equivalent phase (x s ,y s ) is calculated according to formula (3) and formula (4):
其中,p和q的取值情况与步骤S1.3相同。The values of p and q are the same as those in step S1.3.
优选地,步骤S3.2具体为:Preferably, step S3.2 is specifically:
所述权重值包括x方向权重值和y方向权重值;The weight values include an x-direction weight value and a y-direction weight value;
根据xs和滤波器基函数计算所述参考像素点对应的x方向权重值;根据ys和所述滤波器基函数计算所述参考像素点对应的y方向权重值;所述x方向权重值和对应的y方向权重值的乘积为对应的参考像素点的权重值;Calculate the x-direction weight value corresponding to the reference pixel point according to xs and the filter basis function; calculate the y-direction weight value corresponding to the reference pixel point according to ys and the filter basis function; the product of the x - direction weight value and the corresponding y-direction weight value is the weight value of the corresponding reference pixel point;
所述滤波器基函数为公式(5):The filter basis function is formula (5):
式中:a为预设参数,x为根据xs或ys计算出的参考像素点相对于所述子像素的x方向或y方向位置,分别对应x方向权重值和y方向权重值的计算。In the formula: a is a preset parameter, x is the x - direction or y-direction position of the reference pixel point relative to the sub-pixel calculated according to xs or ys , corresponding to the calculation of the x-direction weight value and the y-direction weight value, respectively.
优选地,所述参考像素点的个数为16个,所述像素点亮度值根据公式(6)形成像素点亮度值矩阵Z;Preferably, the number of the reference pixels is 16, and the pixel brightness values form a pixel brightness value matrix Z according to formula (6);
其中,Z(x,y)表示坐标为(x,y)的所述参考像素点对应的像素点亮度值,所述参考像素点的坐标均以坐标基准值(x0,y0)表示;Wherein, Z(x,y) represents the brightness value of the pixel corresponding to the reference pixel with coordinates (x,y), and the coordinates of the reference pixel are all represented by the coordinate reference value (x 0 ,y 0 );
所述x方向权重值形成x方向行权重系数向量Wx;所述y方向权重值形成y方向行权重系数向量Wy;所述步骤S3.3具体为根据公式(7)通过矩阵乘法计算所述子像素的亮度值Zs;The x-direction weight values form an x-direction row weight coefficient vector W x ; the y-direction weight values form a y-direction row weight coefficient vector W y ; the step S3.3 specifically calculates the brightness value Z s of the sub-pixel by matrix multiplication according to formula (7);
本发明有益效果在于:对于子像素菱形排布的图像数据,通过选取斜向排列的像素点直接而准确的进行双三次插值处理,避免在驱动芯片能做复杂的anti-SPR和SPR运算,大大节省了驱动芯片的功耗、面积和制造成本。The beneficial effect of the present invention is that for image data with sub-pixels arranged in a diamond shape, bicubic interpolation processing is directly and accurately performed by selecting obliquely arranged pixel points, thereby avoiding complex anti-SPR and SPR operations in the driver chip, greatly saving the power consumption, area and manufacturing cost of the driver chip.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
图1为现有技术中子像素排列方式的示意图;FIG1 is a schematic diagram of a sub-pixel arrangement in the prior art;
图2A至图2E为现有技术对红蓝两色的子像素进行处理的流程示意图;2A to 2E are schematic diagrams of a process of processing red and blue sub-pixels in the prior art;
图3A至图3C为本发明对红蓝两色的子像素进行处理的流程示意图;3A to 3C are schematic diagrams of a process of processing red and blue sub-pixels according to the present invention;
图4A至图4D为本发明的三角形区域的排布方式的具体情况的示意图;4A to 4D are schematic diagrams of specific situations of the arrangement of the triangular regions of the present invention;
1Green子像素;2Red子像素;3Blue子像素;4原始图像的子像素;5补齐的子像素;6缩放后的目标子像素;7新分辨率下的子像素;8第一三角区域;9第二三角区域。1Green sub-pixel; 2Red sub-pixel; 3Blue sub-pixel; 4Sub-pixel of the original image; 5Padded sub-pixel; 6Target sub-pixel after scaling; 7Sub-pixel at the new resolution; 8First triangular area; 9Second triangular area.
具体实施方式DETAILED DESCRIPTION
本发明的核心之一在于提供一种针对显示器子像素菱形排布图像的直接缩放方法,对于子像素菱形排布的图像数据,通过选取斜向排列的像素点直接而准确的进行双三次插值(或者其他插值方法)处理,避免在驱动芯片能做复杂的anti-SPR和SPR运算,大大节省了驱动芯片的功耗、面积和制造成本。One of the core points of the present invention is to provide a direct scaling method for images with diamond-shaped sub-pixels arranged on a display. For image data with diamond-shaped sub-pixels, bicubic interpolation (or other interpolation methods) is directly and accurately performed by selecting obliquely arranged pixel points, thereby avoiding complex anti-SPR and SPR operations in the driver chip, greatly saving the power consumption, area and manufacturing cost of the driver chip.
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
本实施例中所公开针对显示器子像素菱形排布图像的直接缩放方法,应用于OLED显示屏、Mini LED显示屏以及未来的Micro LED显示屏的驱动芯片中。本实施例中所公开的直接缩放方法包括以下步骤:The direct scaling method for the diamond-shaped arrangement of sub-pixels of the display disclosed in this embodiment is applied to the driver chips of OLED display screens, Mini LED display screens and future Micro LED display screens. The direct scaling method disclosed in this embodiment includes the following steps:
步骤S1:确定新分辨率的每个子像素的参考像素点集,所述参考像素点集包括斜向排列的若干行乘以若干列的原分辨率下真实存在的参考像素点;Step S1: determining a reference pixel point set for each sub-pixel of the new resolution, wherein the reference pixel point set includes a number of rows and a number of columns of reference pixel points that actually exist at the original resolution and are arranged obliquely;
具体包括:1、获取新分辨率相对于原分辨率在x方向和y方向上的尺寸倍率ratiox和ratioy;确定输入的SPR的数据的分辨率和几何尺寸,记为一个单位长度,即长宽都为“1”(因为长宽需要分开计算,所以长宽可以不同,但都是各自维度上的一个单位长度),在此基础上确定要做缩放后的新的分辨率的尺寸。Specifically, it includes: 1. Obtaining the size ratios (ratio x) and (ratio y) of the new resolution in the x-direction and y-direction relative to the original resolution; determining the resolution and geometric dimensions of the input SPR data, recorded as a unit length, that is, both the length and width are "1" (because the length and width need to be calculated separately, the length and width can be different, but they are both a unit length in their respective dimensions), and on this basis determining the size of the new resolution after scaling.
2、对于新分辨率的每个子像素7,计算其在原分辨率下的坐标位置的整数部分(xt,yt)以及小数部分(Δxt,Δyt);比如对于新分辨率的第(m,n)子像素,其位置在(m×ratiox,n×ratioy),计算其落在原分辨率下的位置和偏移量即:2. For each sub-pixel 7 of the new resolution, calculate the integer part (x t , y t ) and the fractional part (Δx t , Δy t ) of its coordinate position at the original resolution; for example, for the (m,n)th sub-pixel of the new resolution, its position is (m×ratio x ,n×ratio y ), calculate its position and offset at the original resolution, that is:
其中:xt和yt为整数;Δxt,Δyt∈[0,1];即将位置分割为整数和小数部分。Where: x t and y t are integers; Δx t , Δy t ∈[0,1]; that is, the position is divided into integer and decimal parts.
3、坐标位置的整数部分(xt,yt)对应的像素格子,即四个顶点坐标为{(xt,yt),(xt+1,yt),(xt,yt+1),(xt+1,yt+1)}的像素格子,记为第一像素格子;当前目标子像素落在第一像素格子内;3. The pixel grid corresponding to the integer part of the coordinate position (x t , y t ), that is, the pixel grid with four vertex coordinates {(x t , y t ), (x t +1, y t ), (x t , y t +1), (x t +1, y t +1)}, is recorded as the first pixel grid; the current target sub-pixel falls within the first pixel grid;
根据第一像素格子的顶点处的原分辨率下真实存在的像素点的连线,将第一像素格子分为两个三角形区域,两个三角形区域包括第一三角形区域8和第二三角形区域9;比如,对于SPR数据来说,如果是红色子像素,一般当xt与yt同奇偶的时候是真实存在的像素点的位置,即{(xt,yt),(xt+1,yt+1)},如图4A或图4C所示;对于蓝色子像素,一般当xt与yt异奇偶的时候是真实存在的像素点的位置,即{(xt+1,yt),(xt,yt+1)},如图4B或图4D所示。According to the connection lines of the real pixel points at the original resolution at the vertices of the first pixel grid, the first pixel grid is divided into two triangular areas, and the two triangular areas include a first triangular area 8 and a second triangular area 9; for example, for the SPR data, if it is a red sub-pixel, generally when xt and yt have the same parity, it is the position of the real pixel point, that is, {( xt , yt ), ( xt + 1, yt+1)}, as shown in FIG4A or FIG4C; for the blue sub-pixel, generally when xt and yt have different parities, it is the position of the real pixel point, that is, {( xt +1, yt ), ( xt , yt +1)}, as shown in FIG4B or FIG4D.
进一步地,根据两个三角形区域的排布方式的情况和子像素位于第一三角形区域或者第二三角形区域的情况,计算坐标基准值(x0,y0);在本实施例中,坐标基准值(x0,y0)定为斜向选取的4×4个参考像素点,在旋转前的坐标系中划出的7×7正方形区域的左上角的坐标值,在其他的一些实施例中,也可以取其他的位置作为坐标基准值。Furthermore, the coordinate reference value (x 0 , y 0 ) is calculated according to the arrangement of the two triangular areas and whether the sub-pixel is located in the first triangular area or the second triangular area. In the present embodiment, the coordinate reference value (x 0 , y 0 ) is defined as the coordinate value of the upper left corner of a 7×7 square area defined by 4×4 reference pixels selected obliquely in the coordinate system before rotation. In other embodiments, other positions may also be used as the coordinate reference value.
各个参考像素点的坐标可以用相对坐标基准值的位置来表示,在本实施例中,分别为:The coordinates of each reference pixel point can be expressed by the position of the relative coordinate reference value, which in this embodiment are:
(x0+0,y0+3)、(x0+1,y0+2)、(x0+2,y0+1)、(x0+3,y0+0)、(x0+1,y0+4)、(x0+2,y0+3)、(x0+3,y0+2)、(x0+4,y0+1)、(x0+2,y0+5)、(x0+3,y0+4)、(x0+4,y0+3)、(x0+5,y0+2)、(x0+3,y0+6)、(x0+4,y0+5)、(x0+5,y0+4)、(x0+6,y0+3)。(x 0 +0,y 0 +3), (x 0 +1,y 0 +2), (x 0 +2,y 0 +1), (x 0 +3,y 0 +0), (x 0 +1,y 0 +4), (x 0 +2,y 0 +3), (x 0 +3,y 0 +2), (x 0 +4,y 0 +1), (x 0 + 2,y 0 +5), (x 0 +3,y 0 +4), (x 0 +4,y 0 +3), (x 0 +5,y 0 +2), (x 0 +3, y 0 +6), (x 0 +4, y 0 +5), (x 0 +5, y 0 +4), (x 0 +6, y 0 +3).
计算坐标基准值(x0,y0)时,按图4A至图4D分为四种情况:When calculating the coordinate reference value (x 0 , y 0 ), there are four cases as shown in FIG. 4A to FIG. 4D :
第一情况:如图4A所示,第一三角形区域8位于第一像素格子右上方,第二三角形区域9位于第一像素格子左下方,子像素位于第二三角形区域;Case 1: As shown in FIG. 4A , the first triangular area 8 is located at the upper right of the first pixel grid, the second triangular area 9 is located at the lower left of the first pixel grid, and the sub-pixel is located in the second triangular area;
第二情况:如图4B所示,第一三角形区域8位于第一像素格子左上方,第二三角形区域9位于第一像素格子右下方,子像素位于第二三角形区域;Second situation: as shown in FIG4B , the first triangular area 8 is located at the upper left of the first pixel grid, the second triangular area 9 is located at the lower right of the first pixel grid, and the sub-pixel is located in the second triangular area;
第三情况:如图4C所示,第一三角形区域8位于第一像素格子右上方,第二三角形区域9位于第一像素格子左下方,子像素位于第一三角形区域;The third situation: as shown in FIG4C , the first triangular area 8 is located at the upper right of the first pixel grid, the second triangular area 9 is located at the lower left of the first pixel grid, and the sub-pixel is located in the first triangular area;
第四情况:如图4D所示,第一三角形区域8位于第一像素格子左上方,第二三角形区域9位于第一像素格子右下方,子像素位于第一三角形区域;Fourth situation: as shown in FIG4D , the first triangular area 8 is located at the upper left of the first pixel grid, the second triangular area 9 is located at the lower right of the first pixel grid, and the sub-pixel is located in the first triangular area;
根据公式(1)和公式(2)计算像素点坐标基准值(x0,y0):Calculate the pixel coordinate reference value (x 0 ,y 0 ) according to formula (1) and formula (2):
x0=xt-2-p (1);x 0 = x t -2-p (1);
y0=yt-2-q (2);y 0 =y t -2-q (2);
其中:p在第一情况和第四情况时为1,在第二情况和第三情况时为0;q在第一情况和第二情况时为0,在第三情况和第四情况时为1。Among them: p is 1 in the first and fourth cases, and is 0 in the second and third cases; q is 0 in the first and second cases, and is 1 in the third and fourth cases.
步骤S2:根据坐标位置的小数部分(Δxt,Δyt)以及第一情况至第四情况的分类,得到子像素在以原分辨率下真实存在的像素点为格点的旋转坐标系中的斜向等效相位(xs,ys),斜向等效相位(xs,ys)即为子像素在旋转坐标系中对应的坐标值的小数部分;具体过程为根据公式(3)和公式(4)计算等效相位(xs,ys):Step S2: According to the decimal part of the coordinate position (Δx t , Δy t ) and the classification of the first to fourth cases, the oblique equivalent phase (x s , y s ) of the sub-pixel in the rotating coordinate system with the pixel points actually existing at the original resolution as grid points is obtained. The oblique equivalent phase (x s , y s ) is the decimal part of the coordinate value corresponding to the sub-pixel in the rotating coordinate system. The specific process is to calculate the equivalent phase (x s , y s ) according to formula (3) and formula (4):
其中,p和q的取值情况与前述步骤相同;Among them, the values of p and q are the same as those in the previous steps;
将p和q的取值代入得到:Substituting the values of p and q into this equation, we get:
第一情形下, In the first case,
第二情形下, In the second case,
第三情形下, In the third case,
第四情形下, In the fourth case,
步骤S3:根据所述斜向等效相位和所述参考像素点集的各个像素点亮度值计算所述子像素的插值亮度Zs,具体包括:Step S3: calculating the interpolated brightness Z s of the sub-pixel according to the oblique equivalent phase and the brightness value of each pixel point of the reference pixel point set, specifically comprising:
1、获取16个参考像素点对应的16个像素点亮度值。1. Get the brightness values of 16 pixels corresponding to 16 reference pixels.
2、根据斜向等效相位(xs,ys)计算16个像素点亮度值对应的权重值,分为x方向权重值和y方向权重值,此处x方向和y方向均为旋转后的坐标系中的横向和纵向(对于原坐标系而言即为斜向);16个像素点亮度值对应的总权重值分别为对应的x方向权重值和y方向权重值的乘积;2. Calculate the weight values corresponding to the brightness values of the 16 pixels according to the oblique equivalent phase ( xs , ys ), which are divided into the x-direction weight value and the y-direction weight value. Here, the x-direction and the y-direction are the horizontal and vertical directions in the rotated coordinate system (for the original coordinate system, they are oblique directions); the total weight values corresponding to the brightness values of the 16 pixels are the products of the corresponding x-direction weight values and the y-direction weight values;
计算权重值时使用的滤波器基函数为公式(5):The filter basis function used to calculate the weight value is formula (5):
式中:a为预设参数,x为根据xs或ys计算出的参考像素点相对于所述子像素的x方向或y方向位置,分别对应x方向权重值和y方向权重值的计算。In the formula: a is a preset parameter, x is the x - direction or y-direction position of the reference pixel point relative to the sub-pixel calculated according to xs or ys , corresponding to the calculation of the x-direction weight value and the y-direction weight value, respectively.
利用矩阵计算的方法表示,得到的x方向权重值形成x方向行权重系数向量Wx,即Wx=(Wx0,Wx1,Wx2,Wx3);y方向权重值形成y方向行权重系数向量Wy,即Wy=(Wy0,Wy1,Wy2,Wy3)。Using the matrix calculation method, the obtained x-direction weight values form the x-direction row weight coefficient vector Wx , that is, Wx = ( Wx0 , Wx1 , Wx2 , Wx3 ); the y-direction weight values form the y-direction row weight coefficient vector Wy , that is, Wy = ( Wy0 , Wy1 , Wy2 , Wy3 ).
3、根据权重值和像素点亮度值计算子像素的亮度值Zs;利用矩阵计算的方法表示,16个像素点亮度值根据公式(6)形成像素点亮度值矩阵Z;3. Calculate the brightness value Z s of the sub-pixel according to the weight value and the brightness value of the pixel point; using the matrix calculation method, the brightness values of the 16 pixels form a pixel brightness value matrix Z according to formula (6);
根据公式(7)通过矩阵乘法计算子像素的亮度值Zs;Calculate the brightness value Z s of the sub-pixel by matrix multiplication according to formula (7);
本实施例对于某片OLED显示屏在实际测试过程中,具体实例如下:In this embodiment, during the actual test of a certain OLED display screen, the specific example is as follows:
1、某片OLED显示屏集成了使用本发明算法的显示驱动芯片;1. A certain OLED display screen integrates a display driver chip using the algorithm of the present invention;
2、根据输入数据和待驱动显示屏的尺寸和分辨率设置合适的ratiox和ratioy,或依据其他IP所需的分辨率;2. Set appropriate ratio x and ratio y according to the input data and the size and resolution of the display to be driven, or according to the resolution required by other IPs;
3、将Δxt和Δyt量化到4bit精度,预先计算出各个相位的滤波器系数,并存入显示驱动芯片;3. Quantize Δx t and Δy t to 4-bit precision, pre-calculate the filter coefficients of each phase, and store them in the display driver chip;
4、计算每个目标子像素的Δxt和Δyt,判断属于图4A至图4D中的哪种情形,挑选对应的坐标基准值;4. Calculate Δx t and Δy t of each target sub-pixel, determine which of the situations in FIG. 4A to FIG. 4D it belongs to, and select the corresponding coordinate reference value;
5、通过矩阵运算,计算出目前子像素的插值亮度。5. Calculate the interpolated brightness of the current sub-pixel through matrix operations.
6、完成缩放后进行输出。6. Output after scaling is completed.
本说明书中各个实施例采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似部分互相参见即可。The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
对所公开的实施例的上述说明,使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
Claims (7)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310525396.0A CN117011134B (en) | 2023-05-09 | 2023-05-09 | Direct scaling method for display sub-pixel diamond arrangement image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310525396.0A CN117011134B (en) | 2023-05-09 | 2023-05-09 | Direct scaling method for display sub-pixel diamond arrangement image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117011134A CN117011134A (en) | 2023-11-07 |
| CN117011134B true CN117011134B (en) | 2024-08-09 |
Family
ID=88573465
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310525396.0A Active CN117011134B (en) | 2023-05-09 | 2023-05-09 | Direct scaling method for display sub-pixel diamond arrangement image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117011134B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103034973A (en) * | 2012-12-05 | 2013-04-10 | 焦点科技股份有限公司 | Self-adaptive image scaling method based on bicubic interpolation |
| CN104461440A (en) * | 2014-12-31 | 2015-03-25 | 上海天马有机发光显示技术有限公司 | Rendering method, rendering device and display device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7123277B2 (en) * | 2001-05-09 | 2006-10-17 | Clairvoyante, Inc. | Conversion of a sub-pixel format data to another sub-pixel data format |
| CN1571990A (en) * | 2001-10-19 | 2005-01-26 | 皇家飞利浦电子股份有限公司 | Method of and display processing unit for displaying a colour image and a display apparatus comprising such a display processing unit |
| JP2006127410A (en) * | 2004-11-01 | 2006-05-18 | Tomoyuki Suwa | Floor plan image processing method |
| WO2007098803A1 (en) * | 2006-02-28 | 2007-09-07 | Humanitas Mirasole S.P.A. | Method and apparatus for analyizing clusters of objects |
| CN110047417B (en) * | 2019-04-24 | 2022-05-17 | 格兰菲智能科技有限公司 | Sub-pixel rendering method and device |
| CN111445827B (en) * | 2020-04-16 | 2022-08-23 | Tcl华星光电技术有限公司 | Display device and driving method thereof |
-
2023
- 2023-05-09 CN CN202310525396.0A patent/CN117011134B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103034973A (en) * | 2012-12-05 | 2013-04-10 | 焦点科技股份有限公司 | Self-adaptive image scaling method based on bicubic interpolation |
| CN104461440A (en) * | 2014-12-31 | 2015-03-25 | 上海天马有机发光显示技术有限公司 | Rendering method, rendering device and display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117011134A (en) | 2023-11-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100481890C (en) | Image special effect device, graphic processor and recording medium | |
| US7876378B1 (en) | Method and apparatus for filtering video data using a programmable graphics processor | |
| US8564609B2 (en) | Full-scene anti-aliasing method and system | |
| CN101477793B (en) | Conversion of one sub-pixel format data to another sub-pixel data format | |
| US6496608B1 (en) | Image data interpolation system and method | |
| US7432936B2 (en) | Texture data anti-aliasing method and apparatus | |
| US5793379A (en) | Method and apparatus for scaling images having a plurality of scan lines of pixel data | |
| US6366292B1 (en) | Scaling method and apparatus for a flat panel display | |
| TWI503791B (en) | Computing level of detail for anisotropic filtering | |
| US20150093039A1 (en) | Image super-resolution reconstruction system and method | |
| TW201730847A (en) | Computer graphics system and a graphics processing method | |
| US20080055338A1 (en) | Multi-stage edge-directed image scaling | |
| US7884825B2 (en) | Drawing method, image generating device, and electronic information apparatus | |
| CN1809840B (en) | Method and apparatus for creating sampling pattern | |
| CN113496471A (en) | Content-based antialiasing for image downscaling | |
| US20010030650A1 (en) | System, method and program for computer graphics rendering | |
| CN117011134B (en) | Direct scaling method for display sub-pixel diamond arrangement image | |
| JP3547250B2 (en) | Drawing method | |
| US6801923B2 (en) | System and method for a single-pass multiple tap filter | |
| CN100550096C (en) | The conversion of one sub-pixel format data to another | |
| US7940283B2 (en) | Method and apparatus for pixel sampling | |
| JP3327986B2 (en) | Image creation device | |
| CN115049564A (en) | Picture sharpening processing method and processing terminal | |
| JPH0652300A (en) | Image processing device | |
| JPH1153513A (en) | Method and device for setting region in image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: Room 10-401, No. 2846 Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province, 510330 (Office only) Applicant after: Weidu Microelectronics (Guangdong) Co.,Ltd. Address before: 201306 building C, No. 888, Huanhu West 2nd Road, Lingang New District, China (Shanghai) pilot Free Trade Zone, Pudong New Area, Shanghai Applicant before: Weichuang Microelectronics (Shanghai) Co.,Ltd. Country or region before: China |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20241122 Address after: 510330 Room 410, No. 2846-10 Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province (Office only) Patentee after: Weidu Chuangxin (Guangzhou) Semiconductor Co.,Ltd. Country or region after: China Address before: Room 10-401, No. 2846 Xingang East Road, Haizhu District, Guangzhou City, Guangdong Province, 510330 (Office only) Patentee before: Weidu Microelectronics (Guangdong) Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right |