JP2006072455A - Visual point position identification device for multiple view point images constituting three-dimensional image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a visual point position identification device for multiple view point images constituting a three-dimensional image, capable of identifying visual point positions of a plurality of visual point images constituting the three-dimensional image. <P>SOLUTION: This device comprises: a first storage means storing a subject image group; a second storage means for storing a reference image group; a display device for displaying subject images and reference images; and a means for switchingly displaying, based on a visual point order attached to the subject image group, the subject images on the display device in this order of visual points and, synchronously therewith, switchingly displaying, according to a visual point order attached to the reference image group, the reference images on the display device in this order of visual points. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

    The present invention relates to a viewpoint position identification device for a plurality of viewpoint images constituting a stereoscopic image.

  In a stereoscopic image composed of a plurality of viewpoint (parallax) images, the correspondence between each image and the viewpoint position may be unclear. For example, the two-viewpoint image is composed of a left-eye image and a right-eye image, but it may not be clear which image is the left-eye image. If the left-eye image and the right-eye image are mistakenly displayed on the stereoscopic display device, a stereoscopic image cannot be obtained.

  In a two-viewpoint image, if L and R representing the viewpoint position are added as file names of two files storing the left-eye image and the right-eye image, problems are less likely to occur. In many multi-view images, a number is often assigned as each file name, and it is easy to cause a problem that it is impossible to determine which viewpoint position each file represents.

  An object of the present invention is to provide a viewpoint position identifying device for a plurality of viewpoint images constituting a stereoscopic image, which can identify viewpoint positions of the plurality of viewpoint images constituting the stereoscopic image.

  The invention according to claim 1 is composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but the order is assigned sequentially from the right side position or from the left side position. First storage means for storing test image groups that are unknown whether they are assigned in sequence, generating a plurality of viewpoint images having the same number of viewpoints as the test image groups, or generating a plurality of viewpoint images having the same number of viewpoints as the test image group A viewpoint image is composed of possible data and each viewpoint image is assigned a viewpoint order, and a reference image group in which it is known in advance whether the viewpoint order is assigned sequentially from the right side position or from the left side position. Based on the second storage means stored, the display device for displaying the test image and the reference image, and the viewpoint order attached to the test image group, the test image is switched to the display device in the order of the viewpoint. Simultaneously with the example displayed, it synchronously according viewpoint order that are attached to the reference image group, characterized in that it comprises a means for switching display the reference image on the viewpoint in order to display.

  The invention according to claim 2 is composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but the order is assigned from the right side position or from the left side position. First storage means for storing test image groups that are unknown whether they are assigned in sequence, generating a plurality of viewpoint images having the same number of viewpoints as the test image groups, or generating a plurality of viewpoint images having the same number of viewpoints as the test image group A viewpoint image is composed of possible data and each viewpoint image is assigned a viewpoint order, and a reference image group in which it is known in advance whether the viewpoint order is assigned sequentially from the right side position or from the left side position. Second storage means for storing, a display device for displaying the test image and the reference image, display mode switching means for switching the display mode between the first display mode and the second display mode, When the display mode is the first display mode, based on the viewpoint order attached to the test image group, the display device switches the test image to the viewpoint order and simultaneously attaches the test image to the reference image group in synchronization therewith. First display means for switching and displaying the reference image in the order of viewpoints on the display device based on the order of viewpoints, and when the display mode is the second display mode, the viewpoint order attached to the test image group Based on the viewpoint order assigned to the reference image group, the reference image is displayed in the order of the viewpoint based on the viewpoint order attached to the reference image group at the same time. A second display means is provided.

  The invention according to claim 3 is composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but the order is assigned from the right side position or from the left side position. First storage means for storing test image groups that are unknown whether they are assigned in sequence, generating a plurality of viewpoint images having the same number of viewpoints as the test image groups, or generating a plurality of viewpoint images having the same number of viewpoints as the test image group A viewpoint image is composed of possible data and each viewpoint image is assigned a viewpoint order, and a reference image group in which it is known in advance whether the viewpoint order is assigned sequentially from the right side position or from the left side position. Second storage means for storing, a display device for displaying the test image and the reference image, display mode switching means for switching the display mode between the first display mode and the second display mode, When the display mode is the first display mode, based on the viewpoint order attached to the test image group, the display device switches the test image to the viewpoint order and simultaneously attaches the test image to the reference image group in synchronization therewith. First display means for switching and displaying the reference image in the order of viewpoints on the display device based on the order of viewpoints, and when the display mode is the second display mode, the viewpoint order attached to the test image group Based on the viewpoint order attached to the reference image group, the reference image is switched on the display device in the order opposite to the viewpoint order. It has the 2nd display means to display, It is characterized by the above-mentioned.

  According to the fourth aspect of the present invention, the movement of the test image and the movement of the reference image are the same when the test image and the reference image are displayed on the display device by the first display means or the second display means. An input means for allowing the user to input a confirmation signal when the user determines that there is a determination means; a determination means for determining whether the display mode is the first mode or the second mode when the confirmation signal is input; In addition, when the display mode is determined to be the second mode by the determination unit, there is provided a means for changing the viewpoint order attached to the test image group to the reverse order.

  According to the present invention, it is possible to identify viewpoint positions of a plurality of viewpoint images constituting a stereoscopic image.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows a configuration of an apparatus for identifying viewpoint positions of a plurality of viewpoint images constituting a stereoscopic image.

  An apparatus for identifying viewpoint positions of a plurality of viewpoint images is realized by a personal computer. A display (monitor) 21, a mouse 22 and a keyboard 23 are connected to the personal computer 10. The personal computer 10 includes a CPU 11, a memory 12, a hard disk 13, and a removable disk drive (disk drive) 14 such as a CD-ROM.

  In addition to the OS (operating system), the hard disk 13 stores a viewpoint position identification program for identifying the viewpoint positions of a plurality of viewpoint images constituting a stereoscopic image. The viewpoint position identification program is installed in the hard disk 13 using the CD-ROM 20 in which it is stored.

  In addition, the hard disk 13 includes viewpoint image files that have different viewpoint positions that constitute a stereoscopic image and the viewpoint positions are recognized in advance, and the viewpoint positions that mutually constitute the stereoscopic image. Are different viewpoint image files, and two-viewpoint test image files G0 and G1 to be identified as viewpoint positions are stored in advance. “H” and “G” in the file names H0, H1, G0, and G1 are file identification names, and the numbers “0” and “1” indicate the viewpoint order. The viewpoint order indicates the order of viewpoint positions, and is assigned so that the viewpoint position is in ascending order from the file on the right side, or the viewpoint position is in ascending order from the file on the left side. In this embodiment, it is assumed that the viewpoint order is a positive integer starting from 0.

  In this example, the viewpoint order of the reference image files H0 and H1 is assigned in ascending order from the one on the rightmost viewpoint position. Therefore, the viewpoint of the reference image file H0 is on the right side of the viewpoint of the reference image file H1. The viewpoint order of the test image files G0 and G1 is unknown whether the viewpoint position is assigned in ascending order from the one on the right side, or the viewpoint position is assigned in ascending order from the one on the left side.

  Actually, as the reference image file, not only a two-viewpoint image file but also a multi-viewpoint image file (for example, a four-viewpoint image file) having a larger number of viewpoints is stored in the hard disk 13.

  FIG. 2 shows an example of a viewpoint position identification screen displayed on the monitor 21 when the viewpoint position identification program is started.

  At the center of the viewpoint position identification screen, a test image display unit 101 for displaying a test image is provided. In addition, a reference image display unit 102 for displaying a reference image is provided above and below the test image display unit 101 on the viewpoint position identification screen.

  An image reading button 111 and an OK button (confirmation signal input means) 112 are arranged side by side in the upper left part of the viewpoint position identification screen. A reverse check box (display mode switching means) 113 is arranged below the image reading button 111. In addition, an end button 114 for ending the viewpoint position identification program is arranged in the upper right part of the viewpoint position identification screen.

  The determiner presses the image reading button 111. Then, since a file selection screen (not shown) is displayed as a pop-up screen, the determiner selects the test image file G. The test image file G is composed of a plurality of image files G0 and G1 corresponding to the number of viewpoints, and the determiner selects one with a viewpoint order of 0 (G0 in this example). The CPU 11 can specify all the test image files G0 and G1 having the identification name G as a file name from the identification name G of the selected image file G0, and specify the number of viewpoints of those test images. be able to.

  When the test image file G0 is selected by the user, the CPU 11 specifies all the test image files G0 and G1 having the identification name G as a file name from the identification name G of the selected image file G0, and The number of viewpoints of the test image is specified. Then, these image files G0 and G1 are read into the memory 12, and reference image files H0 and H1 having the same number of viewpoints as the number of viewpoints of the selected test image file G0 are read into the memory 12.

  Then, the reference image display unit 102 displays the reference image files H0 and H1 in the order of viewpoint as shown in FIG. Specifically, the right-eye image H0 and the left-eye image H1 are alternately displayed as H0, H1, H0, and H1. The test image display unit 101 displays the viewpoint position images G0 and G1 in the order of viewpoints in synchronization with the display of the reference image H, as shown in FIG. Specifically, the viewpoint position images G0 and G1 are alternately displayed as G0, G1, G0, and G1. That is, the first viewpoint position image H0 of the reference image and the first viewpoint position image G0 of the test image G are displayed simultaneously, and the second viewpoint position image H1 of the reference image and the second viewpoint position image G1 of the test image G are displayed. Displayed at the same time.

  With reference to FIGS. 4 and 5, the two-view reference images H0 and H1 will be described.

  As shown in FIG. 4, for example, it is assumed that a rectangular parallelepiped 300 is captured by two cameras Q0 and Q1. The camera Q0 is located on the right side of the camera Q1. The broken line S0 indicates the optical axis (line of sight) of the camera Q0, and the broken line S1 indicates the optical axis (line of sight) of the camera Q1. Images captured by the cameras Q0 and Q1 are H0 and H1, respectively.

  As shown in FIG. 5, switching the display image from the captured image H0 of the camera Q0 to the captured image H1 of the camera Q1 moves the camera to the left so that the direction of the optical axis of the camera always faces the point C. Therefore, it is recognized that the subject 300 is rotated around the point C. At this time, the point before point C moves to the right, and the point B far behind point C moves to the left. When the display image is switched from the captured image H1 of the camera Q1 to the captured image H0 of the camera Q0, it is recognized that the subject 300 is rotated around the point C in the opposite direction.

  In this embodiment, as the reference image H, an automobile image is used as shown in FIG. Further, the test image G is an image having fish as a subject. The determiner compares the movement of the reference image H with the movement of the test image G. If the movements of both images H and G are similar, the determiner determines that the viewpoint order of the test image G and the viewpoint order of the reference image H are the same. In such a case, the determiner presses the OK button 111.

  If the movements of the images H and G are not similar, the determiner checks the reverse check box 113. When the reverse check box 113 is checked, the display order of the test images G is reversed from the viewpoint order. Accordingly, the first viewpoint position image H0 of the reference image and the second viewpoint position image G1 of the test image G are simultaneously displayed, and the second viewpoint position image H1 of the reference image and the first viewpoint position image G0 of the test image G are displayed. It will be displayed at the same time. If the movements of both images H and G are similar, the determiner determines that the viewpoint order of the test image G and the viewpoint order of the reference image H are the same. In such a case, the determiner presses the OK button 111.

  When the OK button 111 is pressed, the CPU 11 determines whether or not the reverse check box 113 is checked. If the check is not entered, the current process is terminated as it is. When the check is on, the file names of the image files G0 and G1 of the test image G are corrected so that the viewpoint order is reversed. Specifically, the file name of the image file G0 is corrected to G1, and the file name of the image file G1 is corrected to G0. And this process is complete | finished. As a result, the viewpoint order of each image file of the test image G is the same as the viewpoint order of the image files H0 and H1 of the reference image H, so that the determiner recognizes the viewpoint position of the image file of the test image G. Will be able to.

  FIG. 6 shows an identification processing procedure performed by the CPU 11 when the viewpoint position identification program is activated.

  Here, a case where two-viewpoint test image files G0 and G1 are selected as the test image file G will be described.

  When the viewpoint position identification program is started, a viewpoint position identification screen as shown in FIG. 2 is displayed on the monitor 21 and a flag F indicating whether or not the reverse state is set is reset (F = 0) (step 0). S1). The flag F is set (F = 1) when the reverse check box 113 is checked, and is reset (F = 0) when the reverse check box 113 is not checked. .

  When the image reading button 111 is pressed (step S2), a file selection screen (not shown) is displayed as a pop-up screen (step S3). When the test image file G (G0) is selected by the determiner (step S4), the file selection screen is deleted and the test image files G0 and G1 and the reference image file corresponding to the number of viewpoints of the test image files G0 and G1 are displayed. H0 and H1 are read into the memory 12 (step S5).

  Next, it is determined whether or not the reverse check box 113 is checked (step S6). That is, it is determined whether or not the flag F is set. When the check box 113 is not checked (F = 0), G0 of the test image files G0 and G1 is displayed on the test image display unit 101, and H0 of the reference image files H0 and H1 is used as a reference. The image is displayed on the image display unit 102 (step S7). That is, the test image file G0 and the reference image file H0 are displayed simultaneously. Thereafter, the test image file G1 is displayed on the test image display unit 101 (display is switched from G0 to G1), and the reference image file H1 is displayed on the reference image display unit 102 (display is switched from H0 to H1) ( Step S8). That is, the test image file G1 and the reference image file H1 are displayed simultaneously.

  Then, it is determined whether or not the OK button 111 is pressed (step S11). If the OK button 111 has not been pressed, the process returns to step S6. That is, in a state where the check box 113 is not checked, the processes of steps S6, S7, S8 and S11 are repeated.

  If it is determined in step S6 that the check box 113 is checked (F = 1), G1 of the test image files G0 and G1 is displayed on the test image display unit 101, and the reference image is displayed. Of the files H0 and H1, H0 is displayed on the reference image display unit 102 (step S9). That is, the test image file G1 and the reference image file H0 are displayed simultaneously. Thereafter, the test image file G0 is displayed on the test image display unit 101 (the display is switched from G1 to G0), and the reference image file H1 is displayed on the reference image display unit 102 (the display is switched from H0 to H1) ( Step S10). That is, the test image file G0 and the reference image file H1 are displayed simultaneously.

  Then, it is determined whether or not the OK button 111 is pressed (step S11). If the OK button 111 has not been pressed, the process returns to step S6. That is, when the check box 113 is checked, the processes of steps S6, S9, S10, and S11 are repeated.

  If it is determined in step S11 that the OK button 111 is pressed, it is determined whether or not the check box 113 is checked (step S12). If the check box 113 is not checked (F = 0), the current process is terminated. When the check box 113 is checked (F = 1), the file names of the image files G0 and G1 of the test image G are corrected so that the viewpoint order is reversed (step S13). Specifically, the file name of the image file G0 is corrected to G1, and the file name of the image file G1 is corrected to G0. And this process is complete | finished.

  Next, a case where test image files G (G0, G1,..., Gi,..., Gn) having two or more viewpoints are selected as the test image files G will be described. Assume that the hard disk 13 of the personal computer 10 stores test image files G (G0, G1,..., Gi,..., Gn) having two or more viewpoints. If the number of viewpoints is N, N = n + 1. For example, when the number of viewpoints N is 4, the test image file G includes G0, G1, G2, and G3.

  FIG. 7 shows an identification processing procedure performed by the CPU 11 when the viewpoint position identification program is activated.

When the viewpoint position identification program is started, a viewpoint position identification screen as shown in FIG. 2 is displayed on the monitor 21 and the flag F _t and the flag F _t−1 are reset (F _t = F _t−1 = 0) (step S21). The flag F _t is set (F _t = 1) when the reverse check box 113 is checked, and is reset (F _t = 0) when the reverse check box 113 is not checked. ) The flag F _t-1 is a flag for storing the determination result of step S27 for determining whether or not the flag F _t is set as the previous determination result.

  When the image reading button 111 is pressed (step S22), a file selection screen (not shown) is displayed as a pop-up screen (step S23). When the examiner selects the test image file G (G0) (step S24), the file selection screen is deleted and the test image files G0, G1,..., Gi,. ..., reference image files H0, H1, ..., Hj, ..., Hn corresponding to the number of viewpoints N (= n + 1) of Gn are read into the memory 12 (step S25).

  The test image files G0, G1,..., Gn are represented by Gi (i = 0, 1,..., N) and the reference image files H0, H1,..., Hn are represented by Hj (j = 0, 1,..., N). It will be expressed as

i and j are set so that i = −1 and j = −1 (step S26). Next, it is determined whether or not the reverse check box 113 is checked (step S27). That is, it is determined whether or not the flag F _t is set (F _t−1 = 1). If the check box 113 is not checked (F _t = 0), it is determined whether or not the flag F _t-1 is set (F _t-1 = 1) (step S28). If the flag F _t-1 is not set (F _t-1 = 0), it is determined that the non-reverse state has occurred in the previous time, and the value of F _t (0 in this case) is determined as F _t-1. (Step S29), the values of i and j are updated by the calculation of i = i + 1 and j = j + 1 (step S30). Then, it is determined whether i = N or not (step S31). If i = N, the process proceeds to step S40. If i = N, i and j are set so that i = 0 and j = 0 (step S33), and then the process proceeds to step S40.

  In step S40, the test image Gi and the reference image Hj are displayed. That is, the test image file Gi is displayed on the test image display unit 101, and the reference image file Hj is displayed on the reference image display unit 102. Then, it is determined whether or not the OK button 111 has been pressed (step S41). If the OK button 111 has not been pressed, the process returns to step S27. That is, in a state where the check box 113 is not checked, the processes of steps S27 to S31, S33, S40, and S41 are repeated. As a result, for example, in the case of an image of four viewpoints, a set of G0 and H0, a set of G1 and H1, a set of G2 and H2, and a set of G3 and H3 are sequentially displayed.

In the above step S28, in a case where the flag F _t-1 is set _{(F t-1 = 1)} , determined to have changed from the reverse state to the non-reverse state, the F _t-1 as F _t After setting a value (in this case, 0) (step S32), the process proceeds to step S33, and i and j are set so that i = 0 and j = 0. Then, the process proceeds to step S40.

If it is determined in step S27 that the check box 113 is checked (F _t = 1), it is determined whether the flag F _t-1 is reset (F _t-1 = 0). It discriminate | determines (step S34). When the flag F is reset (F _t-1 = 0), it is determined that the state has changed from the non-reverse state to the reverse state, and the value of F _t (1 in this case) is set as F _{t -1} Later (step S38), the process proceeds to step S39, and i and j are set so that i = N-1, j = 0. Then, the process proceeds to step S40.

In step S34, in a case where the flag F _t-1 is set _{(F t-1 = 1)} , even in the last, it is determined that the reverse state, the value of F _t-1 as F _t (this In this case, after 1) is set (step S35), the values of i and j are updated by the calculation of i = i-1, j = j + 1 (step S36). Then, it is determined whether i <0 or not (step S37). If i ≧ 0, the process proceeds to step S40. If i <0, i and j are set so that i = N−1 and j = 0 (step S39), and then the process proceeds to step S40.

  In step S40, the test image Gi and the reference image Hj are displayed. That is, the test image file Gi is displayed on the test image display unit 101, and the reference image file Hj is displayed on the reference image display unit 102. Then, it is determined whether or not the OK button 111 has been pressed (step S41). If the OK button 111 has not been pressed, the process returns to step S27. That is, in a state where the check box 113 is checked, the processes of steps S27, S34 to S37, S39, S40, and S41 are repeated. As a result, for example, in the case of a four-viewpoint image, the group G3, H0, the group G2, H1, the group G1, H2, and the group G0, H3 are displayed in sequence.

If it is determined in step S41 that the OK button 111 is pressed, it is determined whether or not the flag _Ft is set (step S42). If the flag F _t is reset (F _t = 0), the current process is terminated. If the flag F _t is set (F _t = 1), the file names of the image files G0, G1,..., Gn of the test image G are corrected so that the viewpoint order is reversed (step 43). ). For example, if the test image G is a four-viewpoint image G0, G1, G2, G3, the file name of the image file G0 is G3, the file name of the image file G1 is G2, and the file name of the image file G2 is G1. Then, the file name of the image file G3 is corrected to G0. And this process is complete | finished.

  A plurality of viewpoint images constituting the test image or the reference image may be stored in one file. For example, a plurality of viewpoint images may be combined and stored in a file as a single image (see Japanese Patent Application Laid-Open No. 2003-111101). A plurality of viewpoint images may be stored in one file by using a function similar to the multi-page function of the TIFF image format. In any case, the viewpoint order is associated with each viewpoint image by tag information or the like. In the image reading in step S5 of FIG. 6 or step S25 of FIG. 7, the viewpoint image and the viewpoint order are stored in the memory. Are associated and read.

  The reference image may not exist as a file. For example, it may be included as image data in the program body. Alternatively, a reference image may be generated in real time from a three-dimensional object by computer graphics while fixing the object and changing the camera position, or fixing the camera and rotating the object. In this embodiment, for example, when the camera is fixed and the object is rotated counterclockwise when viewed from above, the image changes from an image viewed from the right side to an image viewed from the left side.

  In the above example, the display in the non-reverse state and the display in the reverse state are switched, but the display in the non-reverse state and the display in the reverse state are performed side by side and the one that rotates correctly is selected. You may make it make it.

  The reference image may be a simple diagram or marker as long as it is a figure that can grasp the rotation of the space. In the minimum configuration, it is only necessary to have two points arranged at the front and rear.

  Further, each viewpoint image of the test image or the reference image may be a still image or a moving image.

  When the display device is a stereoscopic image display device (see Japanese Patent Application Laid-Open No. 07-181429), it may be considered as follows. When observing a stereoscopic image with the stereoscopic image display device, the observer observes different images with the left and right eyes. If the images observed by the left and right eyes are the same image, the observer observes a normal flat (two-dimensional) image. When this is used, both planar display and stereoscopic display are possible.

  If the number of viewpoints of the test image is 4, in the case of flat display, for example, in the non-reverse state in FIG. 7, the images observed with the left and right eyes are both G0, H0 set, G1, H1 set, A set of G2 and H2, and a set of G3 and H3, and these sets may be displayed in order.

  When the number of viewpoints of the test image is 4, in the case of stereoscopic display, for example, in the non-reverse state in FIG. 7, when the image observed with the right eye is a set of G0 and H0, it is observed with the left eye. When the image observed with the right eye is a set of G1 and H1, the image observed with the left eye is the set of G2 and H2, and the image observed with the right eye is G2. , H2, the image observed with the left eye is set as G3, H3, and these combinations may be displayed in order. Thus, the reference image H is always observed as a stereoscopic image, and the test image G is observed as a stereoscopic image that rotates in the same direction as the reference image if the viewpoint order is correct.

  In the reverse state, when the image observed with the right eye is a set of G3 and H0, the image observed with the left eye is set as G2 and H1, and the image observed with the right eye is set as G2 and H1. In this case, the image observed with the left eye is set as G1 and H2, and when the image observed with the right eye is set as G1 and H2, the image observed with the left eye is set as G0 and H3. These combinations may be displayed in order. Thus, the reference image H is always observed as a stereoscopic image, and the test image G is observed as a stereoscopic image that rotates in the same direction as the reference image if the reverse state is the correct viewpoint order.

  Since the test image and the reference image may be displayed on the screen at the same time, they may be displayed separately as in the present embodiment, or may be displayed in an overlapping manner. That is, the reference image may be displayed with a smaller size superimposed on the test image, or the test image may be displayed with a smaller size superimposed on the reference image. Both images may be displayed translucently and superimposed, and in this case, the two spaces are recognized overlapping. In order to realize this, a value obtained by adding 50% of the pixel data of the reference image and the test image may be used as the pixel data of the display image.

  In order to make it easier to confirm the viewpoint position of each viewpoint image constituting the test image, the amount of change in the viewpoint of the test image or the reference image may be variable. At the time of image capture, the wider the camera interval, the greater the amount of rotation when switching and displaying each viewpoint image. In such a case, it is easier to determine if the rotation amount of the reference image is also increased. In order to realize this, viewpoint images having a larger number of viewpoints than the number of viewpoints of the test image are prepared as reference images in advance, and the image selection order may be changed when the rotation amount is increased. For example, when determining a four-viewpoint image, a reference image composed of 13 images from 0 to 12 taken at an equal camera interval is prepared, and normally “4 → 5 → 6 → 7” in the center is sequentially displayed. When increasing the jump, display is made in the order of “2 → 4 → 6 → 8” or “0 → 4 → 8 → 12”.

  When generating from a three-dimensional object in real time, the movement amount of the camera or the rotation angle of the object may be increased.

  A marker may be further added to the test image for comparison with the reference image. A marker is added to a pixel (group) representing the same point in each viewpoint image. Markers may be manually input to all viewpoint images, or after manually inputting a marker to one viewpoint image, matching points matching (refer to Japanese Patent Laid-Open Nos. 11-339021 and 2002-170111) ) Etc., a marker may be automatically added to another viewpoint image. If a marker for one viewpoint image is randomly determined, it can be automatically added to all viewpoint images. The marker may be a figure, a color of the corresponding portion of the corresponding image of the viewpoint image may be changed, or a luminance of the viewpoint image may be changed.

  The horizontal display position of the viewpoint image may be changed depending on the viewpoint. For example, if H0 and H1 are images in which the position of the subject is biased as shown in FIG. 8, even if the display is switched from H0 to H1, all the points A, B, and C of the rectangular parallelepiped are all right as shown in FIG. Move in the direction. In this state, since the rotation axis is not in the rectangular parallelepiped, the determination of the rotation direction may be wrong. Therefore, by displaying H0 on the right and H1 on the left, the rotation axis moves into the rectangular parallelepiped as shown in FIG. 10, and the rotation can be determined as in FIG. Thus, the horizontal display position of the image (H0) before movement may be changed in the same direction as the movement of each point, and the horizontal display position of the image (H1) after movement may be changed in the direction opposite to the movement of each point. This change may be performed by a button input on the window. Alternatively, corresponding point matching (see Japanese Patent Application Laid-Open Nos. 11-339021 and 2002-170111) is used to check the movement direction of each point, and if many points are moving in the same direction, the above change is automatically performed. You may make it apply.

It is a block diagram which shows the structure of the apparatus for identifying the viewpoint position of the several viewpoint image which comprises a stereo image. It is a schematic diagram which shows an example of the screen for viewpoint position identification displayed on the monitor when a viewpoint position identification program is started. It is a schematic diagram which shows the state by which the reference | standard image and the test image were displayed on the screen for viewpoint position identification. It is a schematic diagram which shows the case where the rectangular parallelepiped 300 is imaged with two cameras Q0 and Q1, and two viewpoint position images H0 and H1 are imaged. It is a schematic diagram which shows the state which switched the display image from the captured image H0 of FIG. 4 to the captured image H1. It is a flowchart which shows the identification process procedure performed by CPU11 when a viewpoint position identification program is started. It is a flowchart which shows the identification process procedure performed by CPU11 when a viewpoint position identification program is started. It is a schematic diagram which shows the example of two viewpoint position images H0 and H1. It is a schematic diagram which shows the state which switched the display from the viewpoint position image H0 of FIG. 8 to the viewpoint position image of FIG. FIG. 9 is a schematic diagram illustrating a state in which the display position of the viewpoint position image H0 in FIG. 8 is moved to the right side and the display position of the viewpoint position image H1 in FIG. 8 is moved to the left side.

Explanation of symbols

10 Personal computer 11 CPU
12 memory 13 hard disk 14 drive (disk drive)

Claims (4)

A test composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but it is unknown whether the order is assigned from the right position or the left position. First storage means for storing image groups;
It is composed of data that can generate a plurality of viewpoint images having the same number of viewpoints as the test image group or a plurality of viewpoint images having the same number of viewpoints as the test image group, and each viewpoint image is assigned a viewpoint order. Second storage means for storing a reference image group in which it is known in advance whether the order is assigned in order from the right side position or in order from the left side position;
A display device for displaying the test image and the reference image, and based on the viewpoint order attached to the test image group, the test image is switched and displayed in the order of the viewpoint on the display device. Means for switching and displaying the reference image in the order of viewpoints on the display device in accordance with the order of viewpoints attached to the group;
A viewpoint position identifying device for a plurality of viewpoint images constituting a stereoscopic image. A test composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but it is unknown whether the order is assigned from the right position or the left position. First storage means for storing image groups;
It is composed of data that can generate a plurality of viewpoint images having the same number of viewpoints as the test image group or a plurality of viewpoint images having the same number of viewpoints as the test image group, and each viewpoint image is assigned a viewpoint order. Second storage means for storing a reference image group in which it is known in advance whether the order is assigned in order from the right side position or in order from the left side position;
A display device for displaying a test image and a reference image;
Display mode switching means for switching the display mode between the first display mode and the second display mode;
When the display mode is the first display mode, based on the viewpoint order assigned to the test image group, the display device switches the test image to the viewpoint order and simultaneously attaches the test image to the reference image group in synchronization with the display order. First display means for switching and displaying the reference image in the order of viewpoints on the display device based on the order of viewpoints, and when the display mode is the second display mode, the viewpoint order attached to the test image group Based on the viewpoint order assigned to the reference image group, the reference image is displayed in the order of the viewpoint based on the viewpoint order attached to the reference image group at the same time. Second display means,
A viewpoint position identifying device for a plurality of viewpoint images constituting a stereoscopic image. A test composed of a plurality of viewpoint images constituting a stereoscopic image, and each viewpoint image is assigned a viewpoint order, but it is unknown whether the order is assigned from the right position or the left position. First storage means for storing image groups;
It is composed of data that can generate a plurality of viewpoint images having the same number of viewpoints as the test image group or a plurality of viewpoint images having the same number of viewpoints as the test image group, and each viewpoint image is assigned a viewpoint order. Second storage means for storing a reference image group in which it is known in advance whether the order is assigned in order from the right side position or in order from the left side position;
A display device for displaying a test image and a reference image;
Display mode switching means for switching the display mode between the first display mode and the second display mode;
When the display mode is the first display mode, based on the viewpoint order assigned to the test image group, the display device switches the test image to the viewpoint order and simultaneously attaches the test image to the reference image group in synchronization with the display order. First display means for switching and displaying the reference image in the order of viewpoints on the display device based on the order of viewpoints, and when the display mode is the second display mode, the viewpoint order attached to the test image group Based on the viewpoint order attached to the reference image group, the reference image is switched on the display device in the order opposite to the viewpoint order. Second display means for displaying;
A viewpoint position identifying device for a plurality of viewpoint images constituting a stereoscopic image. When the user determines that the movement of the test image and the movement of the reference image are the same in the state where the test image and the reference image are displayed on the display device by the first display means or the second display means, Input means for allowing the user to input a confirmation signal;
When the confirmation signal is input, the determining means for determining whether the display mode is the first mode or the second mode, and if the determining means determines that the display mode is the second mode, Means for changing the order of viewpoints assigned to the images to the reverse order;
The viewpoint position identifying device for a plurality of viewpoint images constituting a stereoscopic image according to any one of claims 2 and 3.

Images