CN118474318B - Projection fusion method, device, system and electronic equipment - Google Patents

Abstract

The invention provides a projection fusion method, a device, a system and electronic equipment, and relates to the technical field of projection, wherein the method comprises the following steps: acquiring a target image to be projected; determining a projection image area corresponding to each projection device in the target image; controlling each projection device to project a projection image area corresponding to each projection device so as to form a projection picture corresponding to the target image on the projection surface; collecting color information of each non-fusion area and fusion area of the projection picture, wherein the color information comprises brightness and color coordinates; and if the color information of the non-fusion area is not matched with the color information of the fusion area, adjusting the brightness and the chromaticity of an image area corresponding to the fusion area in the target image so as to enable the brightness and the color coordinates of the non-fusion area to be matched with the brightness and the color coordinates of the fusion area. By applying the method provided by the embodiment of the invention, the color consistency of different areas of the projection picture can be improved.

Description

Projection fusion method, device, system and electronic equipment

Technical Field

The present invention relates to the field of projection technology, and in particular to a projection fusion method, device, system and electronic equipment.

Background Art

With the rapid development of science and technology, projection fusion technology has been widely used in various occasions, such as multimedia exhibitions, exhibition hall multimedia equipment, new product launches, command and monitoring centers, network management center construction, video conferences, academic reports, technical lectures, and multi-functional conference rooms. Projection fusion technology overlaps the edges of the images projected by a group of projectors and applies specific fusion technology to display a seamless, bright, ultra-large, high-resolution whole picture, which greatly meets people's needs for large-screen, multi-color, high-brightness, and high-resolution display effects.

In the existing projection fusion technology, brightness adjustment technology is usually the main technology, which can make the brightness of the projection screen of each projection device consistent. However, as the core device of projection fusion technology, the spectral characteristics of the output of the projection device directly determine the color performance of the projection screen. Since different projection devices may have differences in key components such as light sources, lenses, filters, etc., the spectral characteristics of their outputs will also be different. This leads to errors in color during the projection fusion process, even if the brightness of the entire picture is made consistent through brightness adjustment. This color error is visually manifested as unnatural and uneven colors of the fused picture, and even obvious color difference bands, which seriously affects the overall effect and viewing experience of the projection picture.

Summary of the invention

The technical problem to be solved by the present invention is to provide a projection fusion method, device, system and electronic device, which can improve the color consistency of different areas of the projection screen. The specific scheme is as follows:

A projection fusion method, comprising:

Acquire a target image to be projected;

Determining in the target image a projection image area corresponding to each of the projection devices;

Controlling each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

Collecting color information of a first reference point of each non-fusion area and a second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

If the color coordinates of the first reference points of each of the non-fused areas meet the preset color standard conditions, then determining a target reference point among each of the first reference points;

If the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, adjusting the brightness of the image area corresponding to the fusion area in the target image so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

If the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

The above method, optionally, the process of determining the second reference point of the fusion area based on the reflectivity distribution information of the projection surface includes:

When the reflectivity information of the projection surface satisfies a preset reflectivity distribution condition, determining the center point of the fusion area as a second reference point;

When the reflectivity information of the projection surface does not satisfy a preset reflectivity distribution condition, the fusion area is divided into a plurality of sub-fusion areas, and a center point of each of the sub-fusion areas is determined as a second reference point.

In the above method, optionally, adjusting the brightness of the image area corresponding to the fusion area in the target image includes:

When the brightness of the target reference point is greater than the brightness of the second reference point, increasing the grayscale value of each color channel of the image area corresponding to the fusion area in the target image according to a preset step size;

When the brightness of the target reference point is less than the brightness of the second reference point, the grayscale value of each color channel of the image area corresponding to the fusion area in the target image is reduced according to a preset step size.

In the above method, optionally, adjusting the chromaticity of the image area corresponding to the fusion area in the target image includes:

Determining a target color channel to be adjusted according to a coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point;

The grayscale value of the target color channel of the image area corresponding to the fusion area in the target image is adjusted.

In the above method, optionally, the projection fusion system further includes a wireless chromaticity detector, and the acquisition of the brightness and color coordinates of the first reference point of each non-fusion area and the second reference point of the fusion area includes:

Sending a detection instruction to the wireless chromaticity detector, wherein the detection instruction instructs the wireless chromaticity detector to measure and obtain the brightness and color coordinates of a first reference point of each of the non-fusion areas and a second reference point of the fusion area;

The brightness and color coordinates of each of the first reference point and the second reference point measured by the wireless chromaticity detector based on the detection instruction are received.

A projection fusion device is applied to a fusion device in a projection fusion system, wherein the projection fusion system further includes at least two projection devices, and the device includes:

An acquisition unit, used for acquiring a target image to be projected;

A first determining unit, configured to determine, in the target image, a projection image area corresponding to each of the projection devices;

A control unit, used for controlling each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

A collection unit, used for collecting color information of a first reference point of each non-fusion area and a second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

A second determining unit, configured to determine a target reference point from among the first reference points if the color coordinates of the first reference points of the non-fused areas all meet a preset color standard condition;

a brightness adjustment unit, configured to adjust the brightness of an image area corresponding to the fusion area in the target image when a brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

A chromaticity adjustment unit is used to adjust the chromaticity of the image area corresponding to the fusion area in the target image when the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

The above device, optionally, a collection unit, comprises:

A first determining subunit, configured to determine the center point of the fusion area as a second reference point when the reflectivity information of the projection surface meets a preset reflectivity distribution condition;

The second determining subunit is used to divide the fusion area into a plurality of sub-fusion areas when the reflectivity information of the projection surface does not meet a preset reflectivity distribution condition, and determine the center point of each of the sub-fusion areas as a second reference point.

A projection fusion system, comprising: a fusion device, a wireless chromaticity detector and at least two projection devices;

The fusion device acquires a target image to be projected, and determines in the target image a projection image area corresponding to each of the projection devices;

Each of the projection devices is used to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

The wireless colorimetric detector is used to measure the color information of the first reference point of each non-fusion area and the second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

The fusion device is also used to determine a target reference point among the first reference points of each of the non-fusion areas when the color coordinates of the first reference points of each of the non-fusion areas meet the preset chromaticity standard conditions; if the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, the brightness of the image area corresponding to the fusion area in the target image is adjusted so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter; if the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

In the above system, optionally, the wireless chromaticity detector comprises:

Signal acquisition module, processing module and wireless transmission module;

The signal acquisition module is used to acquire optical signals of a first reference point of the non-fusion area and a second reference point of the fusion area;

The processing module is used to process the optical signal of each of the first reference point and the second reference point to obtain the color information of each of the first reference point and the second reference point;

The wireless transmission module is used to send the color information of each of the first reference points and the second reference points to the fusion device.

An electronic device includes a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to be executed by one or more processors to perform the projection fusion method as described above.

Based on the above-mentioned implementation of the present invention, a projection fusion method, device, system and electronic device are provided, the method comprising: acquiring a target image to be projected; determining the projection image area corresponding to each of the projection devices in the target image; controlling each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen comprises a non-fusion area and a fusion area corresponding to each of the projection devices; the fusion area is a screen area formed by overlapping projections of at least two of the projection devices; collecting color information of a first reference point of each of the non-fusion areas and a second reference point of the fusion area; the color information comprises brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface; if the color of the first reference point of each of the non-fusion areas If the coordinates of the target reference point and the second reference point meet the preset chromaticity standard conditions, a target reference point is determined among the first reference points; if the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, the brightness of the image area corresponding to the fusion area in the target image is adjusted so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter; if the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter. Through the method provided by the embodiment of the present invention, the brightness and color coordinates of different areas of the projection screen can be measured in real time, and then the brightness and chromaticity of the image area corresponding to the fusion area in the target image can be adjusted according to the measured brightness and color coordinates, so as to achieve accurate and efficient automatic fusion effect and improve the color consistency of different areas of the projection screen.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

FIG1 is a method flow chart of a projection fusion method provided by the present invention;

FIG2 is an example diagram of a target image provided by the present invention;

FIG3 is an example diagram of an implementation scenario provided by the present invention;

FIG4 is a flow chart of a process for adjusting brightness and chromaticity of an image provided by the present invention;

FIG5 is an exemplary diagram of a deployment method of a wireless chromaticity detector provided by the present invention;

FIG6 is a schematic diagram of the structure of a projection fusion device provided by the present invention;

FIG7 is a schematic diagram of the structure of a projection fusion system provided by the present invention;

FIG8 is a schematic structural diagram of an electronic device provided by the present invention.

DETAILED DESCRIPTION

The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

In this application, the terms "comprises", "comprising" or any other variation thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element.

In the existing projection fusion technology, brightness adjustment technology is usually the main technology, which can make the brightness of the projected images of various projection devices consistent; however, the spectral characteristics of the outputs of different projection devices may be different, and the reflection characteristics of the projection surface may be different. This leads to the fact that in the projection fusion process, even if the brightness of the entire picture is made consistent through brightness adjustment, there will still be errors in color. This color error is visually manifested as unnatural and uneven colors of the fused picture, and even obvious color difference bands, which seriously affects the overall effect and viewing experience of the projected picture.

Based on this, an embodiment of the present invention provides a projection fusion method applied to a fusion device in a projection fusion system, and the fusion device can be a personal computer, a platform, a mobile phone, a server or various intelligent wearable devices; the projection fusion system also includes at least two projection devices; the method flow chart of the method is shown in FIG1, and specifically includes:

S101: Acquire a target image to be projected.

In this embodiment, the target image may be any image selected by the user for projection, for example, a test image, a photo, a video image, etc.

Optionally, the test image may be a pure color image, for example, an image of various colors such as white, red, green, blue, etc.

S102: Determine, in the target image, a projection image area corresponding to each of the projection devices.

In this embodiment, the projection image area corresponding to each of the projection devices may be determined in the target image according to the number and deployment mode of the projection devices.

For example, the projection system includes a projection device 1 and a projection device 2 horizontally deployed from left to right, and the target image has 1920 pixels in the horizontal direction. As shown in FIG2 , the target image can be divided into three parts, image area 1 of the left part is 860 pixels, image area 2 of the right part is 860 pixels, and image area 3 of the middle part is 200 pixels. The image area of image area 1 + image area 3 with a total of 1060 pixels is used as the projection image area of the left projection device 1, and the image area of image area 2 + image area 3 with a total of 1060 pixels is used as the projection image area of the right projection device 2.

S103: Control each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices.

In this embodiment, the picture content in the fusion area formed by projection of multiple projection devices is consistent with the image content of the overlapping part of the projection image areas corresponding to the multiple projection devices.

Optionally, the fusion device may send the projection image area corresponding to each projection device to each projection device, and then control each projection device to project its corresponding projection image area.

Optionally, the number of non-fused areas is the same as the number of projection devices, and the number of fused areas can be one or more, and the number of fused areas can be determined based on the layout and number of projection devices; the layout may include one or a combination of horizontal arrangement and vertical arrangement; optionally, the number of fused areas formed by the projection of N projection devices arranged horizontally or vertically can be N-1.

S104: Collect color information of the first reference point of each non-fusion area and the second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface.

In this embodiment, the color information of the first reference point of each non-fused area and the color information of the second reference point of the fused area may be collected by a chromaticity detector.

Optionally, the projection surface may be a wall, a screen, etc., for presenting the projection image.

In this embodiment, the number of the second reference points may be one or more; the reflectivity information of the projection surface may include the reflectivity of multiple sampling points in the fusion area. If the error between the reflectivities of the multiple sampling points is greater than a preset first error threshold, the second reference point may be determined in the sub-fusion area where each sampling point is located; if the error between the reflectivities of the respective sampling points is not greater than the first error threshold, any point in the fusion area may be determined as the second reference point, and specifically, the center point of the fusion area may be set as the second reference point.

S105: If the color coordinates of the first reference points of the non-fused areas all meet the preset color standard conditions, a target reference point is determined from the first reference points.

In this embodiment, if the errors between the color coordinates of the first reference points of each non-fusion area and the preset standard value are not greater than the preset second error threshold, it is determined that the color coordinates of the first reference points of each non-fusion area meet the preset chromaticity standard conditions; if there is at least one first reference point whose color coordinates have an error greater than the preset second error threshold than the preset standard value, the parameters of the corresponding projection device can be adjusted so that the errors between the color coordinates of the first reference points of each non-fusion area and the preset standard value are not greater than the preset second error threshold.

Optionally, any first reference point may be determined as the target reference point.

In this embodiment, the brightness of the target reference point can be compared with the brightness of the second reference point, and the color coordinates of the target reference point can be compared with the color coordinates of the second reference point to determine whether brightness and chromaticity adjustments need to be performed on the corresponding image area in the target image.

S106: If the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, the brightness of the image area corresponding to the fusion area in the target image is adjusted so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter.

In this embodiment, the first preset parameter may be a proportional coefficient, for example, it may include but is not limited to values such as 0, 0.5%, 1%, 2%, etc. The brightness of the target reference point may be multiplied by the first preset parameter to obtain a first difference threshold.

Optionally, the brightness difference value may reflect the degree of difference between the brightness of the target reference point and the brightness of the second reference point. In some embodiments, the brightness difference value may be the absolute value of the difference between the brightness of the target reference point and the brightness of the second reference point.

S107: If the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

In this embodiment, the second preset parameter is similar to the first preset parameter and may also be a proportional coefficient, which may include but is not limited to values such as 0, 0.5%, 1%, 2%, etc. The horizontal coordinate in the color coordinate of the target reference point can be multiplied by the second preset parameter, and the vertical coordinate in the target color coordinate can be multiplied by the second preset parameter to obtain the second difference threshold, that is, the second difference threshold includes the difference threshold of the horizontal coordinate and the difference threshold of the vertical coordinate.

Optionally, the coordinate difference may reflect the degree of difference between the color coordinates of the target reference point and the color coordinates of the second reference point. In some embodiments, the coordinate difference may include the absolute value of the difference between the horizontal coordinate in the color coordinates of the target reference point and the horizontal coordinate in the color coordinates of the second reference point, and the absolute value of the difference between the vertical coordinate in the color coordinates of the target reference point and the vertical coordinate in the color coordinates of the second reference point. If the absolute value of the difference in the horizontal coordinates is less than the difference threshold of the horizontal coordinates, or the absolute value of the difference in the vertical coordinates is less than the difference threshold of the vertical coordinates, the chromaticity of the image area corresponding to the fusion area in the target image may be adjusted. As shown in FIG. 2 , the image area corresponding to the fusion area is image area 2.

In some embodiments, after the chromaticity of the image area corresponding to the fusion area in the target image is adjusted in S107, the brightness may change, so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than the first difference threshold. In this case, the color information of the second reference point of the fusion area can be re-collected to make a brightness judgment. If the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than the first difference threshold, return to execute S106 until the number of iterations reaches the preset number of iterations threshold, or the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold, and the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold, stop adjusting the brightness and chromaticity, and more accurate projection fusion can be achieved. Optionally, the number of iterations threshold can be set according to actual needs, for example, it can be set to any value such as 3, 4, 5, etc.

In some embodiments, the first difference threshold and the second difference threshold may be set to zero.

In some embodiments, S106 may be executed first and then S107, or S107 may be executed first and then S106.

Through the method provided by the embodiment of the present invention, the brightness and color coordinates of different areas of the projection screen can be measured in real time, and then the brightness and chromaticity of the image area corresponding to the fusion area in the target image can be adjusted according to the measured brightness and color coordinates, so as to achieve accurate and efficient automatic fusion effect and improve the color consistency of different areas of the projection screen.

In an embodiment provided by the present invention, based on the above implementation process, optionally, the process of determining the second reference point of the fusion area based on the reflectivity distribution information of the projection surface includes:

When the reflectivity information of the projection surface satisfies a preset reflectivity distribution condition, determining the center point of the fusion area as a second reference point;

When the reflectivity information of the projection surface does not satisfy a preset reflectivity distribution condition, the fusion area is divided into a plurality of sub-fusion areas, and a center point of each of the sub-fusion areas is determined as a second reference point.

In this embodiment, it can be determined whether the reflectivity information of the projection surface satisfies a preset reflectivity distribution condition. If the reflectivities contained in the reflectivity information of the projection surface are consistent, or the difference between the maximum reflectivity and the minimum reflectivity in the reflectivity information is less than a preset reflectivity difference threshold, it can be determined that the reflectivity information of the projection surface satisfies the reflectivity distribution condition; otherwise, it is determined that the reflectivity information of the projection surface does not satisfy the reflectivity distribution condition.

Optionally, when there are multiple second reference points, for each sub-fusion area's second reference point, if the brightness difference between the brightness of the second reference point and the brightness of the target reference point is greater than the first difference threshold, or the coordinate difference between the color coordinates of the second reference point and the color coordinates of the target reference point is greater than the second difference threshold, then the image area corresponding to the sub-fusion area in the target image can be adjusted accordingly. By applying the method provided in the embodiment of the present invention, by dividing the fusion area into multiple sub-fusion areas, the adjustment accuracy can be more effectively improved, thereby enabling the color display consistency of the projected image.

Optionally, after the fusion device adjusts the target image, it returns to execute step S102 until the brightness difference between the brightness of the second reference point and the brightness of the target reference point is no greater than the first difference threshold, and the coordinate difference between the color coordinates of the second reference point and the color coordinates of the target reference point is no greater than the second difference threshold, so as to complete the projection fusion.

Optionally, the reflectivity information may include the reflectivity of a plurality of preset sampling points of the surface area where the fusion area is located, and the reflectivity of each sampling point may be measured by a measuring device such as a reflectance photometer or a spectroscopic reflectometer.

In some embodiments, the second reference point of the fusion area can also be determined according to the flatness information of the projection surface; specifically, if the reflectivity information of the projection surface does not meet the preset reflectivity distribution condition, and the flatness information does not meet the preset flatness condition, the fusion area can be divided into a first number of sub-fusion areas, and the center point of each sub-fusion area is used as the second reference point; if the reflectivity information of the projection surface does not meet the preset reflectivity distribution condition or the flatness information does not meet the preset flatness condition, the fusion area can be divided into a second number of sub-fusion areas, and the center point of each sub-fusion area is used as the second reference point; if the reflectivity information of the projection surface meets the preset reflectivity distribution condition, and the flatness information meets the flatness condition, the center point of the fusion area can be used as the second reference point; the first number is greater than the second number; the second number is greater than 1. Optionally, the flatness information may include the flatness of the projection surface, and the flatness condition can be set by the user according to actual needs; for example, if the flatness is less than the preset flatness threshold, it is determined that the flatness does not meet the flatness condition.

Optionally, the elevation data of each preset sampling point can be measured by a measuring device such as a photoelectric measuring device or a laser ranging device, and then the flatness information of the projection surface can be determined by the elevation data.

In an embodiment provided by the present invention, based on the above implementation process, optionally, adjusting the brightness of the image area corresponding to the fusion area in the target image includes:

When the brightness of the target reference point is greater than the brightness of the second reference point, increasing the grayscale value of each color channel of the image area corresponding to the fusion area in the target image according to a preset step size;

When the brightness of the target reference point is less than the brightness of the second reference point, the grayscale value of each color channel of the image area corresponding to the fusion area in the target image is reduced according to a preset step size.

In this embodiment, the preset step size can be set to any value, for example, it can be 1.

Optionally, the grayscale values of each color channel may be simultaneously added to the preset step size to increase the brightness of the fused area; the grayscale values of each color channel may be simultaneously subtracted from the preset step size to reduce the brightness of the fused area.

Optionally, the grayscale values of each color channel of the image area corresponding to the fusion area are continuously adjusted until the brightness difference between the brightness of the target reference point and the brightness of the second reference point is no greater than a first difference threshold.

In an embodiment provided by the present invention, based on the above implementation process, optionally, adjusting the chromaticity of the image area corresponding to the fusion area in the target image includes:

Determining a target color channel to be adjusted according to a coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point;

The grayscale value of the target color channel of the image area corresponding to the fusion area in the target image is adjusted.

In this embodiment, the coordinate difference includes the difference on the X-axis and the difference on the Y-axis of the color coordinate.

In this embodiment, the target color channel may be at least one color channel of the three color channels of RGB.

Optionally, the color coordinates of the second reference point of the fusion area can be continuously collected, and then the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point can be calculated, the target color channel can be determined according to the coordinate difference, and the grayscale value of the target color channel of the image area corresponding to the fusion area can be adjusted until the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is no greater than the first difference threshold.

In this embodiment, the specific process of adjusting the chromaticity of the image area corresponding to the fusion area in the target image is as follows:

The comparison result between the color coordinates of the target reference point and the color coordinates of the second reference point can be determined according to the coordinate difference;

If the comparison result indicates that the abscissa of the second reference point is greater than the abscissa of the target reference point, and the ordinate of the second reference point is greater than or equal to the ordinate of the target reference point, then the target color channel may be the B channel of the RGB three-color channels; in this case, a preset grayscale setting value may be added to the grayscale value in the B channel to perform chromaticity adjustment, and then the color coordinates of the second reference point are re-collected, and the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is re-determined to determine a new comparison result;

If the comparison result indicates that the abscissa of the second reference point is greater than the abscissa of the target reference point, and the ordinate of the second reference point is less than or equal to the ordinate of the target reference point, the target color channel may be the G channel of the RGB three color channels. In this case, the grayscale value in the G channel may be added with a preset grayscale setting value to perform chromaticity adjustment, and then the color coordinates of the second reference point are re-collected, and the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is re-determined to determine a new comparison result;

If the comparison result indicates that the abscissa of the second reference point is smaller than the abscissa of the target reference point, and the ordinate of the second reference point is greater than or equal to the ordinate of the target reference point, the target color channel may be the R channel of the RGB three-color channels. In this case, the grayscale value in the R channel may be added with a preset grayscale setting value to perform chromaticity adjustment, and then the color coordinates of the second reference point are re-collected, and the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is re-determined to determine a new comparison result;

If the comparison result indicates that the abscissa of the second reference point is smaller than the abscissa of the target reference point, and the ordinate of the second reference point is smaller than or equal to the ordinate of the target reference point, then the target color channel may be the B channel of the RGB three color channels. In this case, the grayscale value in the B channel may be added with a preset grayscale setting value to perform chromaticity adjustment, and then the color coordinates of the second reference point are re-collected, and the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is re-determined to determine a new comparison result;

If the comparison result indicates that the abscissa of the second reference point is equal to the abscissa of the target reference point, and the ordinate of the second reference point is equal to the ordinate of the target reference point, then the chromaticity adjustment is completed.

Optionally, after the chromaticity adjustment is completed, it may be detected again whether the brightness difference between the brightness of the second reference point and the brightness of the target reference point is greater than the first difference threshold.

In an embodiment provided by the present invention, based on the above implementation process, optionally, the projection fusion system further includes a wireless chromaticity detector, and the acquisition of the brightness and color coordinates of the first reference point of each non-fusion area and the second reference point of the fusion area includes:

Sending a detection instruction to the wireless chromaticity detector, wherein the detection instruction instructs the wireless chromaticity detector to measure and obtain color information of a first reference point of each of the non-fusion areas and a second reference point of the fusion area;

Receive color information of each of the first reference points and the second reference points measured by the wireless chromaticity detector based on the detection instruction.

In order to clearly introduce the principle of this solution, an example is given below:

First, preparations are made. The fusion device and two projectors of the same specification and with the same brightness can be deployed first. In this embodiment, the deployment method of the fusion device and the two projectors is shown in FIG3. The fusion device is connected to the two projectors, and the two projectors are arranged in the horizontal direction or in the vertical direction. Then the target image to be projected is transmitted to the fusion device, and the fusion device divides the target image into the left and right sides and the middle area according to the required screen length, width, and number of pixels of the middle fusion zone. As shown in FIG2, image area 1 and image area 3, a total of 1060 pixels, are projected through the left projection device 1, and image area 2 + image area 3, a total of 1060 pixels, are projected through the right projection device 2. Optionally, since the two identical projectors can basically ensure the consistency of the brightness and color of the left and right images, it is not considered. Since the black field of the middle fusion zone will be brighter when superimposed (cannot be reduced), the black fields on the left and right sides need to be brightened. The 200 pixels in the middle part need to be adjusted. Specifically, the brightness and chromaticity of the middle area can be adjusted. It is mainly based on white field and the three colors of red, green and blue, supplemented by the adjustment of other colors.

Specifically, after the preparation work is completed, the specific brightness and chromaticity adjustment process is shown in FIG4, including:

Step 1: Both projectors project white fields, and the fusion device issues instructions to halve the brightness of the 200 pixels in the middle area of the left and right projectors, that is, the grayscale values of RGB are adjusted to 128. Use the wireless detector module to measure the brightness L0 and color coordinates (x0, y0) of the center positions on the left and right sides respectively. If the color coordinate value is consistent with the white balance point you want to set, proceed to the next step; if the color coordinate value is inconsistent with the white balance point you want to set, adjust the projector to make it consistent.

Step 2: Place the wireless detector module near the center of the middle area, deviate from the normal direction of the vertical projection surface at a small angle (such as <5°), receive the reflected light, detect the brightness L1 and color coordinates (x1, y1), and send them back to the fusion device. As shown in Figure 5, the wireless detector module can be fixed at any desired position on the projection surface through the base and the connecting rod.

Step 3: Execute brightness judgment, obtain a first judgment result, and adjust the brightness according to the first judgment result.

In this embodiment, the brightness adjustment process for the middle image area 3 is as follows:

If L1>L0, the RGB grayscale values of the corresponding pixels in image area 3 are all lowered by 1; if L1<L0, the RGB grayscale values of the corresponding pixels in image area 3 are all increased by 1; a command is issued to drive the wireless detector to measure the brightness of the center point of the fusion area, return the new brightness L1, re-execute the brightness judgment, and obtain a new first judgment result.

If the new L1>L0, then continue to reduce the RGB grayscale values of the corresponding pixels in image area 3 by 1; otherwise, increase the RGB grayscale values of the corresponding pixels in image area 3 by 1; issue a command to drive the wireless detector to measure and return the new brightness L1; loop until L1=L0, where the judgment condition of L1=L0 is: |(L1-L0)/L0|<=1%.

Step 4: Perform color coordinate judgment, obtain a second judgment result, and adjust the chromaticity according to the second judgment result. In this embodiment, if |(x1-x0)/x0|<=1%, it is recognized that x1=x0, and the rest is similar.

Usually, the set color temperature is D65 (x0=0.3127, y0=0.3290). The present invention takes this white point as an example to introduce the adjustment process.

If x1>0.3127, and y1>=0.3290, the gray value of color channel B is +1, and the color coordinates of the center point of the fusion area are remeasured, and the judgment is re-executed to obtain a new second judgment result.

If x1>0.3127, and y1<=0.3290, the gray value of the color channel G is +1, and after re-measuring the color coordinates of the center point of the fusion area, the judgment is re-executed to obtain a new second judgment result.

If x1<0.3127, and y1>=0.3290, the gray value of the color channel R is +1, and after re-measuring the color coordinates of the center point of the fusion area, the judgment is re-executed to obtain a new second judgment result.

If x1<0.3127, and y1<=0.3290, the grayscale value of color channel B is -1, and after re-measuring the color coordinates of the center point of the fusion area, the judgment is re-executed to obtain a new second judgment result.

When x1=0.3127 and y1=0.3290, the loop stops, and the white field of the fused area is given and output according to the RGB value at this time.

Step 5: Loop through the brightness adjustment process in step 3 and the chromaticity adjustment process in step 4. The goal will be achieved after no more than 3 cycles.

Step 6: Repeat the adjustment process from Steps 1 to 5 for the red, green, blue monochrome fields and other hue test images to make the different colors consistent.

In this embodiment, for colors including white, red, green, blue and other various shades, by adjusting the brightness and chromaticity of the fusion area to make it consistent with the brightness and chromaticity of other areas, accurate and efficient automatic fusion effect can be achieved, so that the colors of each area remain highly consistent.

Corresponding to the method shown in FIG. 1 , an embodiment of the present invention further provides a projection fusion device, which is applied to a fusion device in a projection fusion system. The projection fusion device can be used to specifically implement the method shown in FIG. 1 , and its structural schematic diagram is shown in FIG. 6 , including:

An acquisition unit 601 is used to acquire a target image to be projected;

A first determining unit 602 is used to determine the projection image area corresponding to each of the projection devices in the target image;

The control unit 603 is used to control each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

The collecting unit 604 is used to collect color information of the first reference point of each non-fusion area and the second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

A second determining unit 605 is configured to determine a target reference point from among the first reference points if the color coordinates of the first reference points of the non-fused areas all meet a preset color standard condition;

a brightness adjustment unit 606, configured to adjust the brightness of the image area corresponding to the fusion area in the target image when the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

A chromaticity adjustment unit 607 is used to adjust the chromaticity of the image area corresponding to the fusion area in the target image when the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

In an embodiment provided by the present invention, based on the above solution, optionally, the acquisition unit includes:

A first determining subunit, configured to determine the center point of the fusion area as a second reference point when the reflectivity information of the projection surface meets a preset reflectivity distribution condition;

The second determining subunit is used to divide the fusion area into a plurality of sub-fusion areas when the reflectivity information of the projection surface does not meet a preset reflectivity distribution condition, and determine the center point of each of the sub-fusion areas as a second reference point.

The specific principles and execution processes of each unit and module in the projection fusion device disclosed in the above embodiment of the present invention are the same as the projection fusion method disclosed in the above embodiment of the present invention. Please refer to the corresponding parts of the projection fusion method provided in the above embodiment of the present invention, and will not be repeated here.

Referring to FIG. 7 , a schematic diagram of the structure of a projection fusion system is provided in an embodiment of the present invention. The projection fusion system includes: a fusion device 701 , a wireless chromaticity detector 702 , and at least two projection devices 703 ;

The fusion device 701 acquires a target image to be projected, and determines in the target image a projection image area corresponding to each of the projection devices;

Each of the projection devices 703 is used to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

The wireless chromaticity detector 702 is used to measure the color information of the first reference point of each non-fusion area and the second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

The fusion device 701 is also used to determine a target reference point among the first reference points of each non-fusion area when the color coordinates of the first reference points of each non-fusion area meet the preset chromaticity standard conditions; if the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, the brightness of the image area corresponding to the fusion area in the target image is adjusted so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter; if the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

In an embodiment provided by the present invention, based on the above solution, optionally, the wireless chromaticity detector 702 includes:

Signal acquisition module, processing module and wireless transmission module;

The signal acquisition module is used to acquire optical signals of a first reference point of the non-fusion area and a second reference point of the fusion area;

The processing module is used to process the optical signal of each of the first reference point and the second reference point to obtain the color information of each of the first reference point and the second reference point;

The wireless transmission module is used to send the color information of each of the first reference points and the second reference points to the fusion device.

Optionally, the processing module may include a data processing unit and a control chip. The control chip may receive detection instructions through the wireless transmission module, and then control the data processing unit to perform measurements, obtain measurement results of the data processing unit, and send the measurement results to the fusion device through the wireless transmission module.

An embodiment of the present invention further provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned projection fusion method.

An embodiment of the present invention further provides an electronic device, whose structural schematic diagram is shown in FIG8 , and specifically includes a memory 801 and one or more instructions 802, wherein the one or more instructions 802 are stored in the memory 801 and are configured to be executed by one or more processors 803 to perform the following operations:

Acquire a target image to be projected;

Determining in the target image a projection image area corresponding to each of the projection devices;

Controlling each of the projection devices to project the projection image area corresponding to each of the projection devices, so as to form a projection screen corresponding to the target image on a preset projection surface; the projection screen includes a non-fused area and a fused area corresponding to each of the projection devices; the fused area is a screen area formed by overlapping projections of at least two of the projection devices;

Collecting color information of a first reference point of each non-fusion area and a second reference point of the fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; the second reference point of the fusion area is determined based on the reflectivity information of the projection surface;

If the color coordinates of the first reference points of each of the non-fused areas meet the preset color standard conditions, then determining a target reference point among each of the first reference points;

If the brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, adjusting the brightness of the image area corresponding to the fusion area in the target image so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

If the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, the chromaticity of the image area corresponding to the fusion area in the target image is adjusted so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter.

It should be noted that each embodiment in this specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other. For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

Finally, it should be noted that, in this article, relational terms such as first and second, etc. are merely used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations.

For the convenience of description, the above device is described as being divided into various units according to their functions. Of course, when implementing the present invention, the functions of each unit can be implemented in the same or multiple software and/or hardware.

It can be known from the above description of the implementation mode that those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of the present invention can be essentially or partly contributed to the prior art in the form of a software product, which can be stored in a storage medium such as ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in the various embodiments of the present invention or certain parts of the embodiments.

The above is a detailed introduction to a projection fusion method provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims (8)

1. A projection fusion method, characterized by being applied to a fusion device in a projection fusion system, the projection fusion system further comprising at least two projection devices, the method comprising:

acquiring a target image to be projected;

Determining a projection image area corresponding to each projection device in the target image;

Controlling each projection device to project a projection image area corresponding to each projection device so as to form a projection picture corresponding to the target image on a preset projection surface; the projection picture comprises non-fusion areas and fusion areas corresponding to the projection equipment; the fusion area is a picture area formed by overlapping projections of at least two projection devices;

Collecting color information of a first reference point of each non-fusion area and a second reference point of each fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; a second reference point of the fusion area is determined based on reflectivity information of the projection surface;

If the color coordinates of the first reference points of the non-fusion areas meet the preset chromaticity standard conditions, determining a target reference point in each first reference point;

If the brightness difference between the brightness of the target reference point and the brightness of the second reference point is larger than a first difference threshold, adjusting the brightness of an image area corresponding to the fusion area in the target image so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not larger than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

If the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, adjusting the chromaticity of an image area in the target image corresponding to the fusion area so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter;

a process for determining a second reference point of the fused region based on reflectivity distribution information of the projection surface, comprising:

Determining a center point of the fusion area as a second reference point under the condition that the reflectivity information of the projection surface meets a preset reflectivity distribution condition;

and dividing the fusion area into a plurality of sub-fusion areas under the condition that the reflectivity information of the projection surface does not meet the preset reflectivity distribution condition, and determining the center point of each sub-fusion area as a second reference point.

2. The method of claim 1, wherein adjusting the brightness of the image region of the target image corresponding to the fused region comprises:

when the brightness of the target reference point is larger than the brightness of the second reference point, increasing the gray value of each color channel of the image area corresponding to the fusion area in the target image according to a preset step length;

And when the brightness of the target reference point is smaller than that of the second reference point, reducing the gray value of each color channel of the image area corresponding to the fusion area in the target image according to a preset step length.

3. The method of claim 1, wherein adjusting the chromaticity of the image region of the target image corresponding to the fused region comprises:

Determining a target color channel to be adjusted according to a coordinate difference value between the color coordinates of the target reference point and the color coordinates of the second reference point;

and adjusting the gray value of a target color channel of an image area corresponding to the fusion area in the target image.

4. The method of claim 1, wherein the projection fusion system further comprises a wireless chromaticity detector that acquires color information for a first reference point of each of the non-fused regions and a second reference point of the fused region, comprising:

sending a detection instruction to the wireless chromaticity detector, wherein the detection instruction is used for indicating the wireless chromaticity detector to measure and obtain color information of a first reference point of each non-fusion area and a second reference point of each fusion area;

And receiving color information of each first reference point and each second reference point measured by the wireless chromaticity detector based on the detection instruction.

5. A projection fusion apparatus for use with a fusion device in a projection fusion system, the projection fusion system further comprising at least two projection devices, the apparatus comprising:

an acquisition unit configured to acquire a target image to be projected;

a first determining unit, configured to determine a projection image area corresponding to each projection device in the target image;

The control unit is used for controlling each projection device to project a projection image area corresponding to each projection device so as to form a projection picture corresponding to the target image on a preset projection surface; the projection picture comprises non-fusion areas and fusion areas corresponding to the projection equipment; the fusion area is a picture area formed by overlapping projections of at least two projection devices;

The acquisition unit is used for acquiring color information of a first reference point of each non-fusion area and a second reference point of each fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; a second reference point of the fusion area is determined based on reflectivity information of the projection surface;

The second determining unit is used for determining a target reference point in each first reference point if the color coordinates of the first reference points of the non-fusion areas meet preset chromaticity standard conditions;

A brightness adjustment unit, configured to adjust, when a brightness difference between the brightness of the target reference point and the brightness of the second reference point is greater than a first difference threshold, the brightness of an image area corresponding to the fusion area in the target image so that a brightness difference between the brightness of the target reference point and the brightness of the second reference point is not greater than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter;

A chromaticity adjusting unit, configured to adjust chromaticity of an image area corresponding to the fusion area in the target image, in a case where a coordinate difference between a color coordinate of the target reference point and a color coordinate of the second reference point is greater than a second difference threshold, so that a coordinate difference between the color coordinate of the target reference point and the color coordinate of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter;

an acquisition unit comprising:

A first determining subunit, configured to determine, when the reflectivity information of the projection surface meets a preset reflectivity distribution condition, a center point of the fusion area as a second reference point;

And the second determining subunit is used for dividing the fusion area into a plurality of sub-fusion areas and determining the center point of each sub-fusion area as a second reference point under the condition that the reflectivity information of the projection surface does not meet the preset reflectivity distribution condition.

6. A projection fusion system, comprising: the system comprises a fusion device, a wireless chromaticity detector and at least two projection devices;

the fusion equipment acquires a target image to be projected and determines a projection image area corresponding to each projection equipment in the target image;

each projection device is used for projecting a projection image area corresponding to each projection device so as to form a projection picture corresponding to the target image on a preset projection surface; the projection picture comprises non-fusion areas and fusion areas corresponding to the projection equipment; the fusion area is a picture area formed by overlapping projections of at least two projection devices;

The wireless chromaticity detector is used for measuring color information of a first reference point of each non-fusion area and a second reference point of each fusion area; the color information includes brightness and color coordinates; the first reference point of the non-fusion area is the center point of the non-fusion area; a second reference point of the fusion area is determined based on reflectivity information of the projection surface;

The fusion device is further configured to determine a target reference point in each first reference point when the color coordinates of the first reference points of each non-fusion area meet a preset chromaticity standard condition; if the brightness difference between the brightness of the target reference point and the brightness of the second reference point is larger than a first difference threshold, adjusting the brightness of an image area corresponding to the fusion area in the target image so that the brightness difference between the brightness of the target reference point and the brightness of the second reference point is not larger than the first difference threshold; the first difference threshold is calculated based on the brightness of the target reference point and a first preset parameter; if the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is greater than a second difference threshold, adjusting the chromaticity of an image area in the target image corresponding to the fusion area so that the coordinate difference between the color coordinates of the target reference point and the color coordinates of the second reference point is not greater than the second difference threshold; the second difference threshold is calculated based on the color coordinates of the target reference point and a second preset parameter;

Wherein determining a second reference point of the fused region based on the reflectivity distribution information of the projection surface comprises:

Determining a center point of the fusion area as a second reference point under the condition that the reflectivity information of the projection surface meets a preset reflectivity distribution condition;

and dividing the fusion area into a plurality of sub-fusion areas under the condition that the reflectivity information of the projection surface does not meet the preset reflectivity distribution condition, and determining the center point of each sub-fusion area as a second reference point.

7. The system of claim 6, wherein the wireless chromaticity detector comprises:

the system comprises a signal acquisition module, a processing module and a wireless transmission module;

the signal acquisition module is used for acquiring optical signals of a first reference point of the non-fusion area and a second reference point of the fusion area;

the processing module is used for processing the optical signals of each first reference point and each second reference point to obtain color information of each first reference point and each second reference point;

the wireless transmission module is used for transmitting the color information of each first reference point and each second reference point to the fusion device.

8. An electronic device comprising a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to perform the projection fusion method of any of claims 1-4 by one or more processors.