Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The embodiment of the present invention splits multiple image subblocks of rear generation to high dynamic range images by obtaining, in conjunction with the attribute information of each image subblock in the plurality of image subblock, the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock, again according to the brightness value of each pixel in each image subblock after adjustment, generate low dynamic range echograms, and this low dynamic range echograms is closer to this high dynamic range images, drastically increase the display effect of the low dynamic range echograms of generation.
Below in conjunction with specific embodiment, specific implementation of the present invention is described in detail:
embodiment one:
Fig. 1 shows the realization flow of the method for high dynamic range image display that first embodiment of the invention provides, and details are as follows:
In step S101, according to the image segmentation algorithm preset, high dynamic range images is split, obtains multiple image subblock.
In specific implementation process, in order to pursue, local display effect is better and performance that is algorithm is better, the embodiment of the present invention mainly addresses the mapping effect aspect problem of high dynamic range images from these two aspects, by adopting the local mapping method of Region Segmentation, solve the high/low brightness of local in image, the problem such as dizzy, and in operating process, regulate local parameter can not affect the display effect in other regions.Particularly, the existing image segmentation algorithm based on graph theory can be adopted, the scene image of complexity should can be cut into the more consistent regional area of multiple internal feature based on the image segmentation algorithm of graph theory, then, after segmentation, multiple image subblocks of this high dynamic range images can be obtained.
In step s 102, according to the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock.
In step s 103, according to the brightness value of each pixel in each image subblock after adjustment, generate and show low dynamic range echograms.
In specific implementation process, add up the attribute information of each image subblock in the plurality of image subblock, this attribute information comprises the maximum L of the pixel intensity of this each image subblock
max, mean value L
mean, variance L
stddeng.Shown in this following formula of linearity mapping relations (1) preset:
Wherein, H (p) represents the brightness value of arbitrary pixel p in this high dynamic range images corresponding position in this each image subblock, and L (p) represents the brightness value of this arbitrary pixel p in each image subblock described after adjustment.
Suppose arbitrary image subblock Image1, corresponding attribute information comprises L1
max, L1
mean, L1
stdand the brightness value of each pixel in this high dynamic range images corresponding position in this Image1 known, then substitute into above-mentioned formula (1) and the respective pixel brightness value of each pixel in this image subblock Image1 can be obtained, thus carried out adjusting upgrading to the brightness value of each pixel in this Image1.Equally, through above-mentioned steps can to the plurality of image subblock in the brightness value of all pixels of each image subblock adjust.Then according to the brightness value of all pixels in all image subblocks after adjustment, the low dynamic range echograms corresponding with this high dynamic range images can be generated, show on the display device to make this low dynamic range echograms.
In embodiments of the present invention, by first carrying out Region Segmentation to high dynamic range images, mapping relations are used respectively to the different image subblock got or claims mapping curve to process, finally be converted to the image in low-dynamic range, to more directly process the problem of local display, and it is also fairly simple to adjust mapping curve corresponding to each image subblock, can not the display effect of other area image sub-blocks in effect diagram picture, when the low state range image got the most at last or title LDR image show on the display device, display effect is better.
embodiment two:
Fig. 2 shows the realization flow of the method for high dynamic range image display that second embodiment of the invention provides, and details are as follows:
In step s 201, high dynamic range images is compressed, obtain the low dynamic range echograms that display device can show.
In step S202, according to the image segmentation algorithm preset, this low dynamic range echograms is split, obtains multiple image subblock.
In specific implementation process, for high dynamic range images or the title HDR image of higher pixel, directly process is more consuming time, in order to reduce the processing time, first can carry out down-sampling to it, after obtaining lower pixel or claiming the image of low-dynamic range, carry out relevant treatment again.Such as, first HDR image to be mapped to LDR image, global map method can be used, as Linear Mapping method or S curve global map method, by HDR image data compression to LDR image data, specifically can use 0-1 algorithm that HDR image is compressed into LDR image.Then after being compressed into LDR image, the region segmentation method can applied based on graph theory is split LDR image, and adds up corresponding attribute information respectively to each image subblock of segmentation, comprises pixel intensity maximum L
max, mean value L
mean, variance L
stddeng.Fig. 3 (a) is depicted as and carries out the display result after 0-1 compression algorithm to this HDR image, and Fig. 3 (b) adopts based on the display effect figure after the region segmentation method of graph theory.
In step S203, according to the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock.
In step S204, according to the brightness value of each pixel in each image subblock after adjustment, generate and show low dynamic range echograms.
Wherein, in the plurality of image subblock, the attribute information (or claiming mapping parameters) of each image subblock comprises the pixel intensity maximum L of this each image subblock
max, mean value L
mean, variance L
std.
As the present invention one example, in conjunction with formula in above-described embodiment (1), by step S203, step S204, then can obtain the low dynamic range echograms after being mapped by this high dynamic range images, and can show on the display device.
As another example of the present invention, due to L
meanvalue represents the average characteristics of image subblock brightness; L
stdrepresent the intensity of the pixel intensity of image subblock and the degrees of offset of mean intensity and distribution, and L
stdless, offset less, brightness is more concentrated.In order to better image display effect can be obtained, L can be got according to practical experience
stdvalue is 0.5; L
maxit is the maximum brightness value of image subblock, because Region Segmentation is not very accurate, so it well can not characterize the characteristic of target area, directly be used as mapping parameters improper, and for darker target area, in order to can better its true effect be shown, need its overall brightness to promote, in addition owing to now adding up the L obtained to image subblock
maxusually very little, when being directly used as mapping parameters, display result remains very dark, in actual mechanical process, can estimate L according to reliable relational expression
maxvalue, statistics finds, works as L
meanwhen being worth less, the L of use
maxshould be comparatively large, L
meanwhen being worth larger, the L of use
maxvalue should be less, but L
meanwith L
maxit is not strict inversely prroportional relationship.Then based on principle of least square method, the result of a large amount of statistical analysis is carried out linear polynomial fit, obtain L
meanwith L
maxcorresponding relation, shown in following formula (2):
Further, at the maximum L of the pixel intensity by arranging each image subblock according to above-mentioned formula
max, corresponding variance L is set
stdvalue be 0.5, corresponding mean value L is set
meanremain unchanged, in conjunction with formula in above-described embodiment (1), by step S203, step S204, then can obtain the low dynamic range echograms after being mapped by this high dynamic range images, and the low dynamic range echograms that can show on the display device more efficiently and accurately after this mapping, also enhance Consumer's Experience effect, user satisfaction is provided.
In embodiments of the present invention, due to highly sensitive in colourity to brightness of human eye, when luminance difference is larger between adjacent image sub-block or region, easily cause human eye uncomfortable.And in actual displayed process, for the adjacent image sub-block that average brightness difference is less, if the L of latter two sub-block of adjustment pixel brightness value
meandifference is comparatively large, then can produce false edge in procedure for displaying; And larger adjacent domain is differed for average brightness, then in follow-up adjustment pixel brightness value process, the edge originally existed should be retained.For this problem, can be optimized on the whole the low dynamic range echograms after mapping further.Also, namely in this step S203, after the brightness value of this arbitrary pixel of this adjustment in this each image subblock, before this step S204, this method for high dynamic range image display can also comprise:
Multiple continuous and nonoverlapping range of luminance values and one to one brightness degree are set;
According to the range of luminance values belonging to the mean value of the pixel intensity of each image subblock, obtain the brightness degree that this each image subblock is corresponding;
According to the level spacing between the brightness degree that adjacent image sub-block is corresponding, adjust the maximum of the pixel intensity corresponding to image subblock that pixel brightness level is high in this adjacent image sub-block.
In specific implementation process, such as can be, but not limited to arrange four kinds of continuous and nonoverlapping range of luminance values and four kinds of brightness degrees etc., as shown in following table one:
Table one
| Range of luminance values (unit: candela/metre2) |
Brightness degree |
Brightness level |
| (-∞,0.1] |
First |
Darker |
| (0.1,0.8] |
Second |
Intermediate light |
| (0.8,3] |
3rd |
Brighter |
| (3,+∞) |
4th |
Highlighted |
Further, can mark the plurality of image subblock, the image subblock such as arranging the maximum number of pixels in other words of image subblock area maximum is level-1 area, or the nearest image subblock in the center arranging whole image is level-1 area etc., after this arranging all regions adjacent with this level-1 area is level-2 area, if all regions adjacent with this level-1 area have multiple, then can continue to be labeled as level-2 area 1, level-2 area 2 etc., equally, according to this markedness theory, the adjacent area continuing the unmarked mistake of mark level-2 area is tertiary zone, by that analogy, until marked all image subblocks.
Such as, first to some level-2 areas of this level-1 area, such as level-2 area 1 is optimized, if the average brightness of this level-1 area belongs to (-∞, 0.1] scope, then corresponding first brightness degree, belong to darker region, if corresponding 3rd brightness degree of level-2 area 1, belong to brighter region, if or corresponding 4th brightness degree of level-2 area 1, belong to highlighted region, then can know that the interval between the brightness degree that this adjacent image sub-block is corresponding differs at least one grade, then now, do not need to carry out brightness optimization to the image subblock of this level-2 area 1, if corresponding second brightness degree of level-2 area 1, belong to the region of intermediate light, if or corresponding first brightness degree of level-2 area 1, then can know that the interval between the brightness degree that this adjacent image sub-block is corresponding is more or less the same in a grade, then now, continue to judge whether the absolute value of the difference of the average brightness that this adjacent image sub-block is corresponding is less than preset difference value, be, then do not need to carry out brightness optimization to the image subblock of level-2 area 1, no, then keep the average brightness L of the image subblock of level-2 area 1
meanand L
stdvalue all constant, and upgrade corresponding L
maxvalue is the L of this adjacent level-1 area
maxidentical value.By that analogy, other adjacent level-2 areas of this level-1 area can be optimized.Afterwards, the tertiary zone optimizing the mark adjacent with level-2 area is continued, until travel through all image subblocks.
In embodiments of the present invention, by compressing high dynamic range images, obtain the low dynamic range echograms that display device can show, according to the image segmentation algorithm preset, this low dynamic range echograms is split, obtain multiple image subblock, again according to the attribute information of each image subblock in the plurality of image subblock, the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in this each image subblock, realize the adjustment to the brightness value of this arbitrary pixel in this each image subblock, thus according to the brightness value of each pixel in each image subblock after adjustment, can generate and show the low dynamic range echograms with better display effect.Further, can also according to the brightness degree between adjacent image sub-block, the image of final display is optimized, and state in Optimum Operation process on the implementation, multiple continuous and nonoverlapping range of luminance values and one to one brightness degree, brightness level etc. can also need be set according to reality, under the prerequisite ensureing preferably display effect, also improve the flexibility ratio etc. of this method for high dynamic range image display.
One of ordinary skill in the art will appreciate that all or part of step realized in above-described embodiment method is that the hardware that can carry out instruction relevant by program has come, described program can be stored in a computer read/write memory medium, described storage medium, as ROM/RAM, disk, CD etc.
embodiment three:
Fig. 4 shows the structure of the high dynamic range images display unit that third embodiment of the invention provides, and for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
This high dynamic range images display unit comprises processor 41 and display 42, wherein:
This processor 41, for according to preset image segmentation algorithm, high dynamic range images is split, obtain multiple image subblock, according to the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock, according to the brightness value of each pixel in each image subblock after adjustment, generate and send low dynamic range echograms to this display 42; And
This display 42, for receiving this low dynamic range echograms that this processor 41 sends, and shows this low dynamic range echograms.
In embodiments of the present invention, because the scene image of complexity can be cut into the more consistent regional area of multiple internal feature by the image segmentation algorithm based on graph theory, segmentation effect is better, then this image segmentation algorithm based on graph theory can be adopted to be split by original high dynamic range images by this processor 41, generate and the multiple image subblocks corresponding to this high dynamic range images.Afterwards, this processor 41 obtains the brightness value etc. of arbitrary pixel in this high dynamic range images corresponding position in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, and wherein the attribute information of this each image subblock comprises the maximum L of the pixel intensity of each image subblock
max, mean value L
mean, variance L
stddeng, according to the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock, according to the brightness value of each pixel in each image subblock after adjustment, generate and send low dynamic range echograms in this display 42.By this processor 41, the process operations such as the pixel brightness value of each image subblock are adjusted to the segmentation of this high dynamic range images, area maps, the low dynamic range echograms comparatively close with this high dynamic range images display effect can be generated simply and effectively.
In addition, the variance L of each image subblock above-mentioned can also be set by processor further
stdbe 0.5, the maximum L of the pixel intensity of each sub-block
maxall according to mean value L
meanobtain, the concrete formula that obtains is by above-mentioned formula (2).
This high dynamic range images display unit can also comprise:
Memory, for arranging and storing multiple continuous and nonoverlapping range of luminance values and one to one brightness degree;
Processor, also for the pixel intensity according to each image subblock mean value belonging to range of luminance values, obtain the brightness degree that this each image subblock is corresponding, according to the level spacing between the brightness degree that adjacent image sub-block is corresponding, adjust the maximum of the pixel intensity corresponding to image subblock that pixel brightness level is high in this adjacent image sub-block.
In embodiments of the present invention, after showing this low dynamic range echograms over the display, if when luminance difference is larger between adjacent image sub-block or region, due to highly sensitive in colourity to brightness of human eye, then, during human eye viewing, easily produce sense of discomfort.Such as, in actual displayed process, for the adjacent image sub-block that average brightness difference is less, if the L of latter two sub-block of adjustment pixel brightness value
meandifference is comparatively large, then can produce false edge in procedure for displaying; And larger adjacent domain is differed for average brightness, then in follow-up adjustment pixel brightness value process, the edge originally existed should be retained.Occur that in order to avoid the low dynamic range echograms after display the problems such as false edge occur, further can optimize the display effect of this low dynamic range echograms.Also namely by this memory of the embodiment of the present invention, processor can head it off, concrete step is shown in described in above-described embodiment two, does not repeat them here.
embodiment four:
Fig. 5 shows the structure of the high dynamic range images display unit that fourth embodiment of the invention provides, and for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
This high dynamic range images display unit can be the software unit run in terminal, also can be integrated in terminal as independently suspension member or run in the application system of terminal, this high dynamic range images display unit comprises the first cutting unit 51, adjustment unit 52, image generation unit 53 and display unit 54, wherein:
This first cutting unit 51, for according to the image segmentation algorithm preset, splits high dynamic range images, obtains and send multiple image subblock to this adjustment unit 52;
This adjustment unit 52, for receiving the plurality of image subblock that this first cutting unit 51 sends, according to the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in the attribute information of each image subblock in the plurality of image subblock, this each image subblock, adjust the brightness value of this arbitrary pixel in this each image subblock, and the brightness value of each pixel in each image subblock after adjustment is sent to this image generation unit 53;
This image generation unit 53, for receiving the brightness value of each pixel in each image subblock after this adjustment that this adjustment unit 52 sends, and according to the brightness value of each pixel in each image subblock after adjustment, generate and send low dynamic range echograms to this display unit 54; And
This display unit 54, for receiving this low dynamic range echograms that this image generation unit 53 sends, shows this low dynamic range echograms.
In embodiments of the present invention, by this first cutting unit 51 according to the image partition method pre-set, original HDR image is formed multiple image subblock after over-segmentation, this adjustment unit 52 can add up three the statistical attribute information obtaining each image subblock, also namely comprises the maximum L of the pixel intensity of each image subblock
max, mean value L
mean, variance L
stdand many local S curve can be produced according to above-mentioned formula (1) correspondence, also the curve of mapping relations between brightness value H (p) of arbitrary pixel p in this high dynamic range images corresponding position and the brightness value L (p) of this arbitrary pixel p in each image subblock described after adjusting in each image subblock is namely represented, because this curve is S-type, therefore can be described as S curve.Then by carrying out corresponding curve mapping to each image subblock, the adjustment of the brightness value to pixels all in all image subblocks can be realized, further according to the brightness value after adjustment, the low dynamic range echograms corresponding with this high dynamic range images can be realized, by this low dynamic range echograms after display unit 54 shows, reach the object making the LDR image of acquisition closer to the actual acceptable effect of user.
In addition, for promoting display effect further, can also continue in the embodiment of the present invention adjust S curve parameter or claim the attribute information of each image subblock, after making to map each sub-image, obtaining better display effect.Such as, still obtain the attribute information of each image subblock, but now, L is set
meanbe worth constant, L
stdvalue is 0.5, L
maxobtain according to above-mentioned formula (2), then, after above-mentioned formula (1) etc. maps, the low dynamic range echograms of generation will have more excellent display effect,
In embodiments of the present invention, adopt the local mapping method of image region segmentation, the high/low brightness of local in image can be solved, the problem such as dizzy, regulate local parameter can not affect the display effect in other regions, and the statistical property of localized area is combined with the curve mapping method in formula (1), only realize mapping process with the attribute information of each image subblock itself as parameter, and the adjustment operation of careful complexity need not be carried out, more be conducive to the characteristic keeping original image itself, the display effect that the final image shown on the display device is concrete better.
embodiment five:
Fig. 6 shows the structure of the high dynamic range images display unit that fifth embodiment of the invention provides, and for convenience of explanation, illustrate only the part relevant to the embodiment of the present invention.
This high dynamic range images display unit comprises compression unit 61, second cutting unit 62, adjustment unit 63, Computer image genration list 64 and display unit 65, and adjustment unit 52, Computer image genration list 53 and display unit 54 one_to_one corresponding described in this adjustment unit 63, Computer image genration list 64 and display unit 65 branch and above-described embodiment four, be not repeated herein, wherein:
This compression unit 61, for compressing high dynamic range images, obtaining the low dynamic range echograms that display device can show, and this low dynamic range echograms is sent to this second cutting unit 62;
This second cutting unit 62, for this low dynamic range echograms sent by this compression unit 61 of reception, and according to the image segmentation algorithm preset, splits this low dynamic range echograms, obtains multiple image subblock.
In embodiments of the present invention, through the pretreatment operation of HDR image, also a width LDR image display of this HDR image is namely obtained by this compression unit 61, by this second cutting unit 62, this LDR image is shown to the image segmentation algorithm adopted based on graph theory again, the scene image of complexity can be realized to be cut into the more consistent regional area of multiple internal feature or multiple image subblock, and the segmentation result of the segmentation result of this width LDR image and this HDR image original is close.Because existing image partition method all realizes in LDR image.First one width HDR image uses 0-1 algorithm to carry out compression pretreatment operation and obtains LDR image by the present invention, again this LDR image is split, better segmentation effect can be obtained, amount of calculation can be reduced for the HDR image containing mass data simultaneously and improve the speed of compression, because processing speed is higher, the present invention has obvious advantage, as being applied in the scenes such as wide dynamic video monitoring for needing the scene of process in real time.
The present invention is after statistics is to the attribute information of each image subblock after low dynamic range echograms segmentation, adjustment unit 63 is in conjunction with the attribute information of each image subblock, the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in this each image subblock, realize the adjustment to the brightness value of this arbitrary pixel in this each image subblock, by the brightness value of this image generation unit 64 according to each pixel in each image subblock after adjustment, generate low dynamic range echograms, display unit 65 shows this low dynamic range echograms.
In embodiments of the present invention, after triggering adjustment unit 63, before trigger image generation unit 64, this high dynamic range images display unit can also comprise:
Setting unit, for arranging multiple continuous and nonoverlapping range of luminance values and one to one brightness degree;
Grade acquiring unit, for the pixel intensity according to each image subblock mean value belonging to range of luminance values, obtain the brightness degree that this each image subblock is corresponding;
Brightness adjustment unit, for according to the level spacing between brightness degree corresponding to adjacent image sub-block, adjusts the maximum of the pixel intensity corresponding to image subblock that pixel brightness level is high in this adjacent image sub-block.
In embodiments of the present invention, after triggering adjustment unit 63 achieves the brightness value adjustment of all pixels in all image subblocks, in order to avoid due to when between adjacent image sub-block or region, luminance difference is larger, the problem of human eye discomfort is caused to occur, can also according to the difference of the average brightness between adjacent image sub-block, the brightness maxima of further adjustment image subblock, such as, adjust the maximum etc. of the pixel intensity of maximum corresponding to the image subblock low with pixel brightness level in this adjacent image sub-block of the pixel intensity corresponding to image subblock that pixel brightness level is high in this adjacent image sub-block.The optimization to image subblock brightness maxima is realized especially by setting unit, grade acquiring unit, brightness adjustment unit etc., its concrete performing step is shown in described in above-described embodiment two, and then when the linearity mapping relations by presetting to realize by high dynamic range images to the mapping of low dynamic range echograms, the display effect of the low dynamic range echograms generated more meets the viewing comfort of human eye, and this low dynamic range echograms is closer to original high dynamic range images, also make display effect better.
The embodiment of the present invention is by carrying out Region Segmentation to high dynamic range images, mapping relations are used respectively to the different image subblock got or claims mapping curve to process, be specially the attribute information of each image subblock in the multiple image subblocks after according to segmentation, the brightness value of arbitrary pixel in this high dynamic range images corresponding position and default linearity mapping relations in this each image subblock, adjust the brightness value of this arbitrary pixel in each image subblock described, finally be converted to the image in low-dynamic range, to more directly process the problem of local display, and it is also fairly simple to adjust mapping curve corresponding to each image subblock, can not the display effect of other area image sub-blocks in effect diagram picture, solve and utilize prior art by after HDR image boil down to LDR image, the problem that LDR image display effect is not good, when making the low state range image that gets or claim LDR image to show on the display device, display effect is better.
The foregoing is only preferred embodiment of the present invention, not in order to limit the present invention, all any amendments done within the spirit and principles in the present invention, equivalent replacement and improvement etc., all should be included within protection scope of the present invention.