JP2006197443A - Image processing system, projector, program, information storage medium, and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system and the like capable of easily and quickly detecting a change in relative position between a projection object and a projection means.
An adjustment unit that generates edited image information for projecting an edited image including a content image based on input image information and a position change detection image provided at least at a part of the outside of the content image. An imaging unit 180 that captures the screen on which the edited image is projected and generates imaging information indicating the captured image, a projection unit 190 that projects the edited image based on the edited image information, and a projection based on the imaging information. The projector includes a determination unit 160 that determines whether the relative position between the unit 190 and the screen has changed.
[Selection] Figure 2

Description

  The present invention relates to an image processing system, a projector, a program, an information storage medium, and an image processing method for detecting a change in relative position between a projection target and a projector based on imaging information.

  In recent years, there has been proposed a projector that projects an image onto a projection object such as a screen using a projector having a CCD camera, captures the projected image with a CCD camera, and executes calibration processing such as image distortion. Yes.

  However, in such a conventional projector, after the calibration process is performed, the user may accidentally collide with the projector or the screen, or the user may hit the screen with a pointing stick, so that the relative position between the projector and the screen is changed. If it has changed, an appropriate image cannot be displayed.

  In such a case, since the user thinks that an appropriate image can be displayed by executing the calibration process, the user may not be aware that the appropriate image cannot be displayed.

  In order to solve such a problem, the projector needs to detect a change in the relative position between the projector and the screen.

  Patent Document 1 describes a projector that stores image data captured by a CCD camera in a frame memory and detects the movement of an image from a change in the contents of the frame memory.

As described above, the general motion detection method using the camera detects the motion by comparing the imaging data at time t stored in the memory with the imaging data at time t + 1.
JP 2001-109422 A

  However, in the case of a general motion detection method, it is necessary to hold imaging data of one unit time ago, and the use efficiency of the memory is poor, and the processing for comparing the imaging data becomes complicated.

  Even if the user notices that the relative position between the projector and the screen has changed, the projector needs to execute the calibration process again.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an image processing system, a projector, and a projector that can easily and quickly detect a relative position change between a projection object and a projection unit. To provide a program, an information storage medium, and an image processing method.

In order to solve the above problems, an image processing system according to the present invention projects an edited image including a content image based on input image information and a position change detection image provided at least at a part of the outside of the content image. Adjusting means for generating edited image information for
Imaging means for imaging the projection object on which the edited image is projected and generating imaging information indicating the captured image;
Projecting means for projecting the content image based on the input image information and projecting the edited image based on the edited image information;
A determination unit that determines whether a relative position between the projection unit and the projection target has changed based on the imaging information;
Including
The determination unit determines the relative change in position by determining the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image. .

  A projector according to the present invention includes the image processing system.

Further, a program according to the present invention is a program readable by a computer having an imaging unit, a projection unit, and a determination unit,
In the computer,
The projecting means projects an image including a position change detection image on at least a part of the content image based on the input image information;
The imaging means captures a projection object on which the image is projected and generates imaging information indicating the captured image;
The determination unit executes a process for determining whether or not a relative position between the projection unit and the projection target has changed based on the imaging information;
The imaging means captures an image within an imaging range including the projection target area;
The determination unit determines the relative change in position by determining the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image. .

An information storage medium according to the present invention is an information storage medium storing a computer-readable program,
The program is stored.

An image processing method according to the present invention is an image processing method by a computer having an imaging means, a projection means, and a determination means,
The projecting means projects an image including a position change detection image on at least a part of the content image based on the input image information;
The imaging means captures a projection object on which the image is projected and generates imaging information indicating the captured image;
The determination means determines whether the relative position of the projection means and the projection object has changed based on the imaging information;
The imaging means captures an image in an imaging range including the projection target area when imaging the projection target object,
When determining the relative position change, the determination unit determines the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image, thereby determining the relative position. It is characterized by determining a change in the general position.

  According to the present invention, an image processing system or the like adds a position change detection image to a normal content image and projects it, and determines whether or not there is a position change detection image in the projection target area, thereby projecting the projection object and the projection object. A change in position relative to the means can be detected easily and quickly.

In the image processing system, the projector, the program, the information storage medium, and the image processing method, the position change detection images are provided on the top, bottom, left, and right outside the content image, respectively.
The determination unit may determine at least one of a movement direction and a movement amount of the relative position according to a detection state of the position change detection image in the captured image.

  According to this, the image processing system or the like can appropriately detect the moving direction of the projection target or the like by providing the position change detection images on the top, bottom, left, and right outside the content image.

Further, in the image processing system, the projector, the program, the information storage medium, and the image processing method, the position of the projection target area in the captured image based on a difference in image signal values for each pixel in the captured image. Projection target area information generating means for generating projection target area information regarding,
The determination unit may determine the relative position change based on the imaging information and the projection target area information information.

  According to this, the image processing system or the like can appropriately determine the projection target area and detect a relative change.

  In the image processing system, the projector, the program, the information storage medium, and the image processing method, when the adjustment unit determines that the relative position has changed by the determination unit, the input image At least one of the correction amount for the information and the control amount of the projection control unit included in the projection unit may be adjusted according to the determination result of the determination unit.

  According to this, an image processing system or the like can project an appropriate image according to a relative change in position without performing a second calibration process.

Further, the image processing system, the projector, the program, the information storage medium, and the image processing method are based on a difference in image signal values for each pixel in the captured image, and a projection area corresponding to the image in the captured image Projection area information generating means for generating projection area information related to the position of
Correction value deriving means for deriving a correction value for distortion of the image in the projection target based on the projection target area information and the projection area information;
Including
The adjustment unit may adjust at least one of the correction amount and the control amount so that distortion of the image is corrected based on the correction value.

  According to this, the image processing system or the like can project an appropriate image without distortion in accordance with the relative position change without performing the calibration process again.

  The image processing system, the projector, the program, the information storage medium, and the image processing method change the relative position when the determination unit determines that the relative position has changed. This may include notification means for notifying the user using at least one of image, sound, and light.

  According to this, the image processing system or the like can notify the user that the relative position has changed.

  Hereinafter, a case where the present invention is applied to a projector that detects a change in the relative position between a projection object and a projection unit will be described as an example with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all of the configurations shown in the following embodiments are not necessarily essential as means for solving the problems described in the claims.

(First embodiment)
FIG. 1 is a schematic diagram showing a state during image projection in the first embodiment.

  A projector 20 having an image processing system projects an image onto a screen 10 that is a kind of projection object. In the present embodiment, the projector 20 is not facing the screen 10. Further, the projected image 12 formed by the projection light from the projector 20 protrudes from the screen 10. In this embodiment, the sensor 60 that is a part of the imaging unit captures an image within the imaging range 8 including the projected image 12.

  Further, in the present embodiment, the projector 20 calculates the aspect ratio (aspect ratio) of the screen 10 based on the imaging information by the sensor 60. Then, the projector 20 distorts the image so that the content image included in the projection image 12 fits in the screen 10 and has the desired aspect ratio based on the aspect ratio and the known desired aspect ratio. Make corrections.

  Furthermore, the projector 20 according to the present embodiment detects a change in the relative position between the screen 10 and the projector 20 after performing the calibration process such as the distortion correction in this way.

  Next, functional blocks of the projector 20 for implementing such functions will be described.

  FIG. 2 is a functional block diagram of the projector 20 in the first embodiment.

  The projector 20 includes an image information input unit 110 that inputs input image information from a PC or the like, an adjustment unit 130 that corrects input image information so that image distortion is corrected, and the corrected image information. The image information output unit 112 to output, a projection unit 190 that projects an image based on the corrected image information, and a calibration image information generation unit 170 that generates calibration image information are configured.

  Further, the adjustment unit 130 generates edit image information for projecting an edit image including position change detection images on the top, bottom, left, and right outside the content image based on the input image information based on the input image information. The adjustment unit 130 includes a correction unit 132 that corrects image information and a control unit 134 that generates control information for the projection unit 190.

  In addition, the projector 20 captures an area including the projection image 12 (imaging range 8) through an imaging surface to generate imaging information, and the screen 10 in the imaging area of the sensor 60 based on the imaging information. Projection area information generating section 140 for detecting the area of the projection area, projection area information generating section 150 for detecting the area of the projected image 12 in the imaging area of the sensor 60, and a correction value deriving section for deriving a correction value for distortion correction. 120 and a determination unit 160 that determines a change in the relative position between the screen 10 and the projector 20. Note that the imaging unit 180 includes a sensor 60.

  The projection unit 190 controls the spatial light modulator 192, the zoom unit 196 that adjusts the size of the projection image 12, the lens shift unit 198 that adjusts the projection position of the projection image 12, the zoom unit 196, and the like. And a projection control unit 194.

  Further, as hardware for mounting each unit of the projector 20 described above, for example, the following can be applied.

  FIG. 3 is a hardware block diagram of the projector 20 in the first embodiment.

  For example, the image information input unit 110 includes, for example, an A / D converter 930, the adjustment unit 130, the determination unit 160 includes, for example, the image processing circuit 970, the RAM 950, the CPU 910, and the image information output unit 112 includes, for example, a D / D As the A converter 940, the correction value deriving unit 120, the projection target region information generating unit 140, the projection region information generating unit 150, and the calibration image information generating unit 170, for example, the image processing circuit 970, the RAM 950, etc. As the spatial light modulator 192 such as a CCD sensor, a CMOS sensor, or an RGB sensor, for example, a liquid crystal panel 920, a ROM 960 that stores a liquid crystal light valve driving driver for driving the liquid crystal panel 920, or the like can be used.

  Note that these units can exchange information with each other via the system bus 980.

  In addition, some or all of these units may be implemented as hardware such as a circuit, or may be implemented as software such as a driver.

  Further, the program may be read from the information storage medium 900 that stores the program for causing the computer to execute the process of the determination unit 160 and the like, and the process of the determination unit 160 and the like may be executed by the computer.

  As such an information storage medium 900, for example, a CD-ROM, a DVD-ROM, a ROM, a RAM, an HDD, or the like can be applied, and the program reading method may be a contact method or a non-contact method. Good.

  Also, in place of the information storage medium 900, a program for causing a computer to execute the processing of each unit described above is downloaded from a host device or the like via a transmission path to cause the computer to execute the processing of each unit described above. Is also possible.

  Next, the flow of image processing using these units will be described.

  FIG. 4 is a flowchart showing the flow of image processing in the first embodiment.

  First, the projector 20 executes calibration processing such as trapezoidal distortion correction (step S1). More specifically, the projector 20 executes the calibration process by the following procedure, for example.

  First, the calibration image information generation unit 170 generates image information for a single color calibration image (all black image) whose entire image is black, and the image information output unit 112 outputs a digital signal of the image information as a projection unit. To 190. The projection unit 190 projects an all-black image toward the screen 10 based on the digital signal. As a result, an all-black image is displayed on the screen 10.

  The imaging unit 180 captures an area including the projected image 12 via the imaging surface to generate first imaging information. Here, the imaging information is information indicating, for each pixel of the sensor 60, an image signal value that can generate a luminance value such as a luminance value or an XYZ value. Here, the XYZ value is an international standard defined by the International Lighting Commission (CIE), and is a kind of image signal value of a device independent color.

  FIG. 5 is a schematic diagram showing the imaging region 17 in the first embodiment.

  The imaging area 17 is an area corresponding to an imaging surface where the sensor 60 captures an image, and is also an area schematically showing imaging information of the sensor 60 in a rectangle. Specifically, the imaging area 17 corresponds to an area on the imaging surface of a CCD sensor, for example.

  In this embodiment, the optical axis of the sensor 60 and the optical axis of the lens 198 are oriented in the same direction, and the screen 10 and the projector 20 are not facing each other. For this reason, as shown in FIG. 5, when viewed from the sensor 60, the projection area 13 that is the area of the projected image 12 looks rectangular like the imaging area 17, and the projection target area 11 that is the area of the screen 10 is distorted. It looks in.

  Further, in the present embodiment, the projection target area information generation unit 140 is based on the imaging information from the imaging unit 180, and is the intersection of the diagonal lines of the projection area 13, that is, the center of the projection area 13 (not necessarily the center, The region EFGH having a constant luminance value is determined as the projection target region 11 by searching for the luminance value radially outward from the center), and the four corners of the region EFGH in the imaging region 17 are determined. The projection target area information indicating the position is output to the correction value deriving unit 120.

  Then, the calibration image information generation unit 170 generates image information for a calibration image (center white image) in which the central area obtained by dividing the entire projection image 12 into nine equal parts is white and the remaining area is black. The information output unit 112 outputs a digital signal of the image information to the projection unit 190. The projection unit 190 projects a central white image toward the screen 10 based on the digital signal. The imaging unit 180 captures the projected central white image and generates second imaging information.

  Based on the first and second imaging information, the projection area information generation unit 150 compares the luminance values for each pixel of the all black captured image and the central white captured image, and determines the area ABCD having a constant luminance ratio as the central projection area. 15 is extracted. The projection area information generation unit 150 outputs projection area information indicating the positions of the four corners of the area ABCD in the imaging area 17 to the correction value deriving unit 120.

  The correction value deriving unit 120 derives a correction value for correcting image distortion based on the projection target area information and the projection area information. The correction value deriving unit 120 derives the correction value by employing, for example, a method for deriving image distortion correction information described in Japanese Patent Application No. 2004-78412 as a correction value deriving method. Can do.

  Then, the adjustment unit 130 corrects the image information based on the correction value so as to correct image distortion. Thereby, the projection unit 190 can project an image in which the distortion of the image is corrected. The calibration process is completed by the above procedure. The calibration process and the trapezoidal distortion correction process are not limited to the above methods, and various methods can be employed.

  FIG. 6 is a schematic diagram of a captured image after trapezoidal distortion correction in the first embodiment.

  After the calibration process is completed, the adjustment unit 130 sets an area in which the content image (an image based on the input image information) is not displayed due to the correction of the image information in the projection area 13 in the initial state to an arbitrary color (for example, red Etc.) is generated to project an edited image including the position change detection image.

  The projection unit 190 projects an edited image based on the edited image information (step S2).

  In this embodiment, among the edited images, an image other than the content image after the trapezoidal distortion correction is used as the position change detection image. The position change detection image is an image for detecting a relative position change between the screen 10 and the projector 20. For example, in FIG. 6, a white rectangular area including the characters ABCD is a content image area, a black area around the area is a position change detection image area, and an area including both is a projection area 13 (edited image). Area).

  For example, when the aspect ratio and the desired aspect ratio of the screen 10 are 4: 3, the content image is displayed so as to coincide with the screen 10 as shown in FIG. Is displayed in red. Actually, since there is no object that reflects the projection light of the projection image 12 behind the screen 10, only the content image reflected by the screen 10 can be captured by the user and the sensor 60.

  In addition, after the calibration process is completed, the determination unit 160 in the imaging area 17, attention areas 14-1 to 14-14 for detecting position changes in the content image, that is, the top, bottom, left, and right outside the projection target area 11. -4 is set.

  The imaging area 17 is originally displayed as shown in FIG. 5, but FIG. 6 and FIGS. 7 to 10 shown below are taken from the front of the screen 10 for easy understanding. Yes.

  The imaging unit 180 captures an area including the screen 10 on which the edited image is projected, and generates imaging information (step S3).

  The determination unit 160 determines the color in the attention area 14 in the captured image based on the imaging information (step S4).

  Then, the determination unit 160 determines whether or not there has been a change in position by determining whether or not the color in the attention area 14 is red (step S5).

  FIG. 7 is a schematic diagram of a captured image after movement in the first embodiment.

  For example, when the screen 10 moves to the right side as viewed from the sensor 60, a part of the right side of the position change detection image is projected on the screen 10 as shown in FIG. Thereby, the captured image includes the partial image. As a result, the red color of the position change detection image is reflected by the screen 10, and the red color is displayed in an area including the attention area 14-3 in the captured image.

  In such a case, the determination unit 160 determines that the position has changed by detecting red in the attention area 14-3.

  If there is a change in position, the projector 20 re-executes the calibration process in step S1 (step S6).

  If it is not the end of the image processing (step S7), the projector 20 repeatedly executes the processing of steps S2 to S7.

  As a result, the projector 20 can always project an appropriate image by determining whether or not the position has changed and correcting the distortion of the image when the position has changed.

  As described above, according to the present embodiment, the projector 20 projects a normal content image with a position change detection image added thereto, and determines whether or not there is a position change detection image in the attention area 14. A change in the relative position between the projector 10 and the projector 20 can be detected easily and quickly.

  That is, the projector 20 uses the characteristic of reflection by the screen 10, so that a memory for holding imaging information of one unit time ago and a process using a difference image are not necessary, so that the image processing can be performed more efficiently. it can.

  Further, according to the present embodiment, the projector 20 can determine the outer shape of the projection target (for example, the screen 10) based on the difference in the image signal value (for example, the luminance value) based on the imaging information. it can.

  Further, according to the present embodiment, even when the calibration image 12 is projected larger than the screen 10, the projector 20 determines the shape and the like of the projection image 12 by using the central white image. be able to.

  Further, according to the present embodiment, the projector 20 can automatically correct image distortion based on the determined shape of the screen 10 and the projected image 12.

  In addition, according to the present embodiment, the projector 20 compares the luminance value from the center toward the outside when detecting the projection target region 11, thereby being less affected by the obstacle on the screen 10 and more accurately. Thus, the projection target area 11 can be detected.

(Second embodiment)
The determination unit 160 sets the attention area 14 outside the projection target area 11 in the first embodiment, but may set the attention area 14 inside the projection target area 11.

  FIG. 8 is a schematic diagram of a captured image after trapezoidal distortion correction in the second embodiment. FIG. 9 is a schematic diagram of a captured image after movement in the second embodiment.

  In such a case, as shown in FIG. 8, the correction unit 132 displays the content image in an area smaller than the screen 10 (projection target area 11), and adds a position change detection image around the content image. As described above, the image information is corrected.

  Then, the determination unit 160 determines that the screen 10 or the projector 20 does not move when the red color of the position change detection image exists in the attention area 14. For example, as shown in FIG. 9, when the screen 10 moves to the right side, the attention area 14-1 on the left side of the content image is detached from the screen 10. In this case, since the determination unit 160 cannot detect red (position change detection image) in the attention area 14-1, it can determine that the screen 10 has moved to the right side.

  As in the second embodiment, the attention area 14 may be provided inside the projection target area 11. The determination unit 160 may determine that the screen 10 has moved when the position change detection image does not exist in the attention area 14.

  As described above, even with such a technique, the projector 20 projects a position change detection image added to a normal content image, and determines the presence or absence of the position change detection image in the attention area 14. A change in the relative position between the projector 10 and the projector 20 can be detected easily and quickly.

(Third embodiment)
In the above-described embodiment, the calibration needs to be re-executed. However, even when the screen 10 moves, the projector 20 does not re-execute the calibration, and does not re-execute the calibration. It is also possible to display a content image on the screen 10 by adjusting the size.

  FIG. 10 is a schematic diagram of a captured image after movement in the third embodiment.

  For example, when the screen 10 moves to the right in the state shown in FIG. 6, a part of the content image becomes invisible as shown in FIG. 7, so the projector 20 reduces the size of the projected image 12. .

  More specifically, the determination unit 160 determines the adjustment value of the zoom unit 196 according to the proportion of the position change detection image in the attention area 14-3. Since the ratio increases as the moving amount of the screen 10 increases, for example, the determination unit 160 determines the adjustment value so that the reduction ratio increases as the ratio increases, that is, the projected image 12 becomes smaller. To do.

  The control unit 134 generates control information based on the adjustment value and outputs the control information to the projection unit 190. The projection control unit 194 controls the zoom unit 196 based on the control information.

  As a result, the content image is reduced and projected onto the screen 10 as shown in FIG.

  As described above, according to the third embodiment, the projector 20 can display the content image on the screen 10 without performing the calibration process again even when the screen 10 moves. .

  Note that the projector 20 may change not only the size of the projection image 12 but also the position of the projection image 12 by the same processing. More specifically, the projector 20 can adjust the projection position by controlling the lens shift unit 198.

(Modification)
In addition, this invention is not limited to the Example mentioned above, A various deformation | transformation is possible.

  For example, in the third embodiment, the projector 20 reduces the projected image 12 by hardware, but may reduce it by software by correcting image information.

  Further, when the screen 10 moves, the projector 20 may notify the user that the screen 10 has moved by projecting a message image for the user. For example, when the screen 10 is moved to the right, the projector 20 is “screen 10 has moved to the right. Please move the screen to the left.”, “The screen 10 has moved to the right. A message image indicating the message “Please move” may be projected. In addition to the notification means for displaying the message image, for example, the projector 20 may be provided with a notification means for notifying the user using sound or light.

  Thereby, the projector 20 can give an appropriate instruction to the user, and it is not necessary to re-execute the calibration process.

  Further, the projection object is not limited to the screen 10, and various projection objects that reflect an image can be adopted. For example, a white board, a balloon, a balloon or the like may be employed as the projection target. That is, for example, the present invention can be applied to the case where an advertisement is made by projecting an image on a balloon.

  Further, the aspect ratio of the screen 10 does not need to match the desired aspect ratio. For example, when the screen 10 is horizontally long compared to the desired aspect ratio, the adjustment unit 130 may use an edited image in which the margin portions at both ends of the content image are black and the portion protruding from the screen 10 is red.

  In the above-described embodiment, the position change detection image is provided around the content image. However, the position change detection image may be provided only on the top and bottom of the content image or only on the left and right. It may be provided.

  In the above-described embodiment, the determination unit 160 determines the presence / absence of a position change based on the color of the attention area 14. For example, the luminance value of all pixels constituting the attention area 14 and the average value of the luminance values of all pixels are used. The presence / absence of a position change may be determined by, for example.

  Further, the configuration of the projector 20 is not limited to the example shown in FIG. For example, the adjustment unit 130 may be provided with only one function of the correction unit 132 and the control unit 134.

  In the above-described embodiment, the projection image 12 is divided into nine parts and the center region, which is the center region, is used as a reference. However, the projector 20 can capture the center region of the projection image in the screen 10. If so, the size and position of the central region may be arbitrary.

  In the above-described embodiment, the projector 20 detects that the position of the screen 10 has changed, but it is needless to say that the position of the projector 20 can be detected.

  The determination unit 160 may set the attention area 14 outside and inside the projection target area 11.

  In the above-described embodiment, the projector 20 is used as the image processing system. However, a projection display device other than the projector 20 may be used.

  Further, as the projector 20, for example, a liquid crystal projector, a projector using a DMD (Digital Micromirror Device), or the like may be used. DMD is a trademark of Texas Instruments Incorporated.

  Further, the functions of the projector 20 described above may be implemented, for example, by a single projector, or may be implemented by being distributed by a plurality of processing devices (for example, distributed processing by a projector and a PC).

It is a schematic diagram which shows the state at the time of the image projection in 1st Example. It is a functional block diagram of the projector in a 1st Example. It is a hardware block diagram of the projector in a 1st Example. It is a flowchart which shows the flow of the image processing in a 1st Example. It is a schematic diagram which shows the imaging area in a 1st Example. It is a schematic diagram of the captured image after trapezoid distortion correction in the first embodiment. It is a schematic diagram of the captured image after movement in the first embodiment. It is a schematic diagram of the captured image after trapezoid distortion correction in the second embodiment. It is a schematic diagram of the captured image after the movement in a 2nd Example. It is a schematic diagram of the captured image after the movement in a 3rd Example.

Explanation of symbols

  10 screen (projection object), 12 projection image, 20 projector (image processing system), 60 sensor, 120 correction value derivation unit, 130 adjustment unit, 140 projection target area information generation unit, 150 projection area information generation unit, 160 determination , 170 Calibration image information generation unit, 180 imaging unit, 190 projection unit, 900 information storage medium

Claims (10)

Adjusting means for generating edit image information for projecting an edit image including a content image based on the input image information and a position change detection image provided at least in part outside the content image;
Imaging means for imaging the projection object on which the edited image is projected and generating imaging information indicating the captured image;
Projecting means for projecting the content image based on the input image information and projecting the edited image based on the edited image information;
A determination unit that determines whether a relative position between the projection unit and the projection target has changed based on the imaging information;
Including
The determination unit determines the relative change in position by determining the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image. Image processing system. In claim 1,
The position change detection images are provided on the top, bottom, left, and right outside the content image, respectively.
The determination means determines at least one of a movement direction and a movement amount of the relative position according to a detection state of the position change detection image in the captured image. In any one of Claims 1, 2.
Projection target area information generating means for generating projection target area information related to the position of the projection target area in the captured image based on a difference in image signal value for each pixel in the captured image;
The image processing system characterized in that the determination means determines the relative position change based on the imaging information and the projection target area information information. In any one of Claims 1-3,
When the determination unit determines that the relative position has changed, the adjustment unit determines at least one of a correction amount for the input image information and a control amount of a projection control unit included in the projection unit. An image processing system that adjusts according to the determination result of the means. In claim 4 dependent on claim 3,
Projection area information generating means for generating projection area information relating to the position of the projection area corresponding to the image in the captured image based on the difference in image signal value for each pixel in the captured image;
Correction value deriving means for deriving a correction value for distortion of the image in the projection target based on the projection target area information and the projection area information;
Including
The image processing system, wherein the adjustment unit adjusts at least one of the correction amount and the control amount so that distortion of the image is corrected based on the correction value. In any one of Claims 1-5,
A notification means for notifying the user using at least one of an image, sound, and light that the relative position has changed when the determination means determines that the relative position has changed; An image processing system comprising:   A projector comprising the image processing system according to claim 1. A computer-readable program having an imaging unit, a projection unit, and a determination unit,
In the computer,
The projecting means projects an image including a position change detection image on at least a part of the content image based on the input image information;
The imaging means captures a projection object on which the image is projected and generates imaging information indicating the captured image;
The determination unit executes a process for determining whether or not a relative position between the projection unit and the projection target has changed based on the imaging information;
The imaging means captures an image within an imaging range including the projection target area;
The determination unit determines the relative change in position by determining the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image. program. An information storage medium storing a computer-readable program,
An information storage medium storing the program according to claim 8. An image processing method by a computer having an imaging means, a projection means, and a determination means,
The projecting means projects an image including a position change detection image on at least a part of the content image based on the input image information;
The imaging means captures a projection object on which the image is projected and generates imaging information indicating the captured image;
The determination means determines whether the relative position of the projection means and the projection object has changed based on the imaging information;
The imaging means captures an image in an imaging range including the projection target area when imaging the projection target object,
When determining the relative position change, the determination unit determines the presence or absence of the position change detection image in a projection target area corresponding to the projection target in the captured image, thereby determining the relative position. An image processing method characterized by determining a change in position.

Images