JP4901928B2 - Image composition method, image composition apparatus, and program - Google Patents

Description

The present invention relates to an image synthesizing how, images synthesized equipment and program for synthesizing a plurality of images.

  There has been proposed a technique for generating a panoramic image viewed from an arbitrary viewpoint by combining a plurality of images captured from different viewpoints based on a point where the images are captured and an angle at which the images are captured (for example, a patent) Reference 1).

  Also, for example, a printing apparatus that reads a document image that is larger than the reading area of the scanner device in a plurality of times and that can synthesize and print the divided and read data is also known (for example, Patent Document 2). reference).

  Furthermore, as another device corresponding to the fetching of the divided data, for example, a writing data input device capable of capturing and processing writing data of the entire area of the form with a small tablet about half the size of the form. Is also known (see, for example, Patent Document 3). In other words, this device determines whether the part on the form placed on the tablet is the first half part or the second half part by using the clip / position detector, and based on the determination result, the first half part or second half part of the form. For this purpose, character data is recognized by selectively reading out format data.

JP 2002-213984 A JP 2001-96708 A Japanese Patent Laid-Open No. 10-283098

  By the way, when combining a plurality of divided images read from a document as described in Patent Document 2, the system recognizes the position of each divided image on the document. It is necessary to let Here, as in Patent Document 3, it is also possible to artificially specify the position of the divided image on the document by applying a clip-type position detector or the like. However, in this case, in addition to the necessity of human labor for specifying the position, there is a concern about an error in specifying the position when the number of divided images is large.

The present invention has been made to solve such a problem, an image synthesizing how a plurality of images obtained by dividing the original can be easily synthesized, images synthesized equipment and program The purpose is to provide.

In order to achieve the above object, an image composition method according to an aspect of the present invention is a sheet that is set on a scanner while holding an object to be scanned, and is scanned in a plurality of times together with the object. The position determination image indicating a reference position for positioning to the scanner and a number for specifying the position of a part of the object on the object is printed at a plurality of different positions. An image acquisition step of acquiring a plurality of divided images including a partial image of the object and the position determination image using a sheet, and recognition for performing pattern recognition of the position determination image for each of the acquired divided images steps and, based on the recognition result by the pattern recognition, a synthetic step of generating a synthesized image obtained by arranging the plurality of divided images, that have a.

According to the present invention, it is possible to provide an image synthesizing how, images synthesized equipment and programs that a plurality of images obtained by dividing the original can be easily synthesized.

1 is a configuration diagram illustrating an image composition processing system including an image composition apparatus according to a first embodiment of the present invention. FIG. 2 is a functional block diagram showing an image composition program that operates on the image composition apparatus of FIG. 1. FIG. 2 is a diagram of a scan clear sheet and a document used in the image composition processing system of FIG. 1 as viewed from the front side. FIG. 4 is a diagram of a scan clear sheet and a scanner viewed from the front side in a state where the document of FIG. 3 is inserted with the back side up. The figure which shows the state of the setting at the time of dividing and reading the original document inserted in the scan clear sheet of FIG. 3 into 6 times. FIG. 4 is a diagram of another scan clear sheet having a structure different from that of FIG. 3 as viewed from the front side. The figure which looked at the state which set the scan clear sheet of the state in which the original was inserted on the scanner from the surface side. The figure which shows the division | segmentation image read in the set state of FIG. The figure which shows the state which displayed on the display part the divided image which character recognition of the character for position determination was completed among the divided images read sequentially. The figure for demonstrating the process in the case of synthesize | combining the read divided images. 2 is a flowchart showing an image composition method by the image composition apparatus of FIG. 1. FIG. 7 is a view of another scan clear sheet having a configuration different from that of the scan clear sheet of FIGS. FIG. 13 is a view of another scan clear sheet having a configuration different from that of the scan clear sheet of FIGS. FIG. 14 is a view of another scan clear sheet having a configuration different from that of the scan clear sheet of FIGS. 3, 6, 12, and 13 mainly viewed from the front surface side. The figure which looked at the scan clear sheet of FIG. 14 mainly from the back side. The functional block diagram which shows the image composition program which operate | moves on the image composition apparatus of 2nd Embodiment. The figure which shows the division | segmentation image obtained by each when the scan clear sheet is set with the correct orientation with respect to the scanner, and when it is set with the wrong orientation. 17 is a flowchart showing an image composition method realized by the image composition program of FIG. The functional block diagram which shows the image composition program which operate | moves on the image composition apparatus of 3rd Embodiment. The figure which looked at the scan clear sheet applied in 3rd Embodiment from the surface side. The figure which shows the division | segmentation image divided | segmented and read from the original document through the scan clear sheet | seat of FIG. The functional block diagram which shows the image composition program which operate | moves on the image composition apparatus of 4th Embodiment. The figure which looked at the scan clear sheet applied in 4th Embodiment from the surface side. FIG. 10 is a diagram of a scan clear sheet and a document applied in the fifth embodiment as viewed from the front side. The figure which looked at the scan clear sheet | seat of FIG. 24 in which the original was inserted facing up from the surface side. The functional block diagram which shows the image composition program which operate | moves on the image composition apparatus of 5th Embodiment. The functional block diagram which shows the image composition program which operate | moves on the image composition apparatus of 6th Embodiment. The figure which looked at the scan clear sheet applied in 6th Embodiment from the surface side. The figure which looked at the scan clear sheet | seat of FIG. 28 in which the original was inserted facing up from the surface side. The figure for demonstrating the geometric distortion of the image of the scan clear sheet image | photographed with the digital video camera. 14 is a flowchart illustrating an image composition method realized by an image composition program according to the sixth embodiment.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
[First Embodiment]
As shown in FIG. 1, an image composition processing system 1 according to this embodiment is an image acquisition auxiliary member for setting an image composition device 10 realized by a computer device such as a PC, a scanner 2, and a document 3 such as a form. Scan clear sheet 7 (or 17).

  As shown in FIG. 1, the image composition device 10 includes a CPU 5, an input operation unit 12, a display unit 14, a main memory 9 serving as an execution area for the image composition program 8, an external (auxiliary) storage device 16, a video memory 15, and an interface. 6 is provided. The input operation unit 12 is configured by a mouse, a keyboard, and the like, and is an input device for giving various instructions to the main body of the image composition device 10. The display unit 14 is configured by a CRT monitor, a liquid crystal display, or the like, and is a display device that visually displays various types of information to the user.

  The external storage device 16 is realized by an HDD or the like, and an operating system and an image composition program main body are installed in advance. The interface 6 connects the scanner 2 to the main body of the image composition apparatus 10 by USB connection, IEEE1394 connection, or the like. The video memory (frame memory) 15 is configured by a VRAM or the like, and is a frame buffer that temporarily stores images. Here, a part of the storage area of the main memory 9 may be allocated as a temporary storage area for images without providing the video memory 15.

  As shown in FIGS. 1 and 4, the scanner 2 is a flat bed type device, and is a portable image scanner in which the maximum readable document size is, for example, A6 size. The scanner 2 is provided with a rectangular (rectangular) contact glass 2 a configured as an image reading surface. On the outer edge of one corner portion of the contact glass 2a, an alignment reference mark 2b indicating a reference position for alignment of the reading object is provided.

  In addition, a lid that closes the upper surface of the contact glass 2a is attached to the scanner 2 via, for example, a hinge structure. On the inner side surface of the lid portion of the scanner 2 (the surface facing the contact glass 2a with the document 3 interposed therebetween), a background forming portion for forming the background of the image image read through the contact glass 2a in black is provided. Here, in the document 3, for example, a black image (document or the like) is arranged (printed or filled in) on a white paper surface. Note that the image on the document 3 shown in the drawings of the present embodiment is shown in an enlarged view of the letter “F”, but this is simply when the document 3 is viewed from the front, back, portrait, landscape, etc. The letter “F” is illustrated so that the user can easily grasp the viewpoint.

  Next, the scan clear sheet 7 will be described in detail with reference to FIGS. Here, FIG. 3 is a view of each of the scan clear sheet 7 and the document 3 as viewed from the front surface (surface facing the inner side of the lid portion of the scanner 2). FIG. 4 is a view of the scan clear sheet 7 and the scanner 2 in a state where the document 3 is inserted with the back side up, as viewed from the front (front) side.

  As shown in FIGS. 3 and 4, the scan clear sheet 7 is a clear folder-like sheet configured by superposing two transparent or translucent rectangular (rectangular) sheets made of, for example, vinyl chloride. In the present embodiment, it is assumed that an A4 size document is applied as the document 3 to be read, and the scan clear sheet 7 is configured to be slightly larger than the A4 size.

  That is, as shown in FIGS. 3 and 4, the scan clear sheet 7 includes a document holding unit 7 a that holds the document 3 and a clear area 7 b as an image placement unit. Specifically, one long side portion of the scan clear sheet 7 is configured as an opening 7f, and the inner side of the other long side portion and the inner side of both short side portions are the bag closing portions 7c and 7d. , 7e.

  The document holding portion 7a is a rectangular region surrounded by a portion slightly inside the opening end of the opening 7f and the bag closing portions 7c, 7d, and 7e. As shown in FIG. 4, the opening 7f The inserted original 3 is held. Here, as shown in FIG. 4, the document 3 is inserted with the back side facing up with respect to the scan clear sheet 7 with the front side facing up. That is, the surface of the document 3 is read by the scanner 2 through the scan clear sheet 7.

  Here, the image composition processing system 1 according to the present embodiment reads the A4 size document 3 by dividing the A4 size document 3 into six times by the scanner 2 having the maximum readable document size of A6 size, and reads the six images divided and read. Are combined into one image. FIG. 5 is a diagram showing a setting state when the original 3 inserted in the scan clear sheet 7 is divided into six times and read.

  That is, as shown in FIGS. 3 and 4, the clear area 7b is configured by an area of the outer frame of the document holding portion 7a. In the clear area 7b, a plurality of (six) positioning reference marks 7g represented by arrows and a plurality of position determinations represented by numbers [numbers (1) to (6)] functioning as position determination images. The characters 7h are arranged inside the long side portion of the main body of the scan clear sheet 7. In the present embodiment, a black positioning reference mark 7g and a white position determination character 7h are applied.

  As shown in FIGS. 3 and 4, three positioning reference marks 7 g and position determination characters 7 h on the clear area 7 b are arranged on one long side portion and the other long side portion of the main body of the scan clear sheet 7. ing. The directions of the arrows and numerals described above are arranged in the opposite direction of 180 ° between one and the other of the long side portions. Further, the reference marks 7g and the position determination characters 7h, which are six each, are arranged in the vicinity of each other.

  Further, the individual position determination characters 7h are respectively arranged corresponding to the positions of the document 3 inserted in the document holding portion 7a. More specifically, the position determination character 7h is used as information for specifying which position on the document 3 the six images read by dividing the document 3 into six times from the document 3 are read.

  On the other hand, each positioning reference mark 7g is used to align the tip of the arrow with the positioning reference mark (tip of the triangular mark) 2b on the scanner 2, as shown in FIGS. Is provided. That is, as shown in FIG. 5, the clear area of the scan clear sheet 7 with the six positioning reference marks 7 g aligned with the alignment reference mark 2 b on the scanner 2 once (a total of six times). The image on 7b (position determination character 7h) and the image on the document 3 are divided into six times and read.

  Further, as shown in FIG. 5, in the state where the positioning reference mark 7g of the scan clear sheet 7 is aligned with the alignment reference mark 2b on the scanner 2, there is always an overlap between the read adjacent images. Generated. This overlapping portion is used when images are combined as described later. Here, in the present embodiment, since the scanner 2 having the specification that the background color is black is applied, the image read from the clear area 7b includes the black positioning reference mark 7g and is basically black. However, the position determination character 7h appears white.

  In addition, as shown in FIG. 5, the scan qualification sheet 7 is set such that its long side forms an angle of 90 ° with the long side of the contact glass. In the present embodiment, the position determination characters 7h in the vicinity of the positioning reference mark 7g are represented by numbers (1) to (6). However, as shown in FIG. ) Need not be set in numerical order, and for the reason described later, six readings may be performed in different set states even in random numerical order.

  FIG. 6 is a view of the scan clear sheet 17 having a partially different configuration from the above-described scan clear sheet 17 as seen from the front (front) surface side. In FIG. 6, the same components as those in the scan clear sheet 7 in FIG. That is, in the image composition processing system 1 of the present embodiment, the scan clear sheet 17 shown in FIG. 6 can be used instead of the scan clear sheet 7 shown in FIG. The scan clear sheet 17 can be easily created by processing a general-purpose clear folder. The scan clear sheet 17 is configured by replacing the bag closing portion 7e of the scan clear sheet 7 with an opening 17a.

  In the scan clear sheet 17 and the scan clear sheet 7 described above, the positioning reference mark 7g and the position determination character 7h arranged on the clear area 7b may be printed on the clear area 7b. For example, it may be handwritten. Further, the position determination characters 7h may be numbers without parentheses, or may be any images as long as they are different characters that can be recognized.

  Next, as shown in FIGS. 1 and 2, an image composition program 8 that operates on the image composition apparatus 10 will be described. The image synthesis program 8 loaded on the main memory 9 from the external storage device 16 by the CPU 5 includes an image acquisition unit 22, an edge detection unit 23, a character recognition unit 24 functioning as a pattern recognition unit, an image synthesis unit 25, and an image output. The unit 26 and the image processing control unit 21 that comprehensively controls each unit are realized by software.

  Here, FIG. 7 is a view of the state in which the scan clear sheet 17 with the document 3 inserted is set on the scanner 2 (the state in which the arrows in the vicinity of the numeral 1 are aligned) viewed from the front side. FIG. 8 is a diagram showing a divided image read in the set state of FIG. Further, FIG. 9 is a diagram showing a state in which the divided image in which the character recognition of the position determination character 7h has been completed among the sequentially read divided images is displayed on the display unit 14. FIG. 10 is a diagram for explaining processing in the case where the read divided images are combined.

  As shown in FIGS. 2, 7, and 8, the image acquisition unit 22 reads a plurality of (six in this embodiment) divided images that are read by the scanner 2 through the scan clear sheet 17 and binarized, for example. 31a... 31f are obtained individually using the storage area of the video memory 15. As shown in FIG. 8, each of the divided images 31a... 31f includes first image areas 32a... 32f corresponding to a part of the document 3 and position determination characters indicating the position of the part on the document 3. Second image regions 34a... 34f including 7h images 33a.

  As shown in FIGS. 2 and 8, the edge detection unit 23 finds the boundary between the white area portion and the black area portion in the binarized divided images 31a. Detect edges.

  As shown in FIG. 8, the character recognition unit 24 performs character recognition (pattern recognition) of the image 33a of the position determination character 7h for each of the divided images 31a ... 31f. Here, in the black image corresponding to the position of the clear area 7b, the position determination character 7h appears white. That is, the character recognition unit 24 cuts out the images 33a... 33f of the position determination character 7h located in the vicinity of the edge detected by the edge detection unit 23, reverses the image horizontally, and performs character recognition of the horizontally inverted character. In the example of FIG. 8, the character recognition unit 24 obtains the number (1) and the number (2) as the character recognition result.

  In this case, the image processing control unit 21 recognizes that the divided image 31a illustrated in FIG. 8 is an image of a region surrounded by a broken line of the contact glass 2a illustrated in FIG. That is, as shown in FIGS. 5, 7, and 8, the image processing control unit 21 recognizes the numbers (2) and (3) when the numbers (1) and (2) are recognized. In this case, six types of recognition result patterns including the case where only the number (3) is recognized, and the layout of the six area portions to be divided on the document 3 are stored in the form of a table, for example. ing.

  The image output unit 26 uses the storage area of the video memory 15, and among the divided images 31a... 31f sequentially acquired by the image acquisition unit 22, character recognition of the position determination character 7h (when scanning is completed) is performed. As shown in FIG. 9, display control is performed to visually display the completed divided image on the display unit 14. The image output unit 26 displays the divided images whose character recognition has been completed in accordance with the layout of the six area portions on the document 3 described above.

  As shown in FIG. 9, the image output unit 26 for the divided images 31a... 31f for which the scanning has not been completed (and the character recognition for the position determination character 7h has not been completed). Then, “unscanned” characters are displayed at the corresponding positions in the layout. This makes it easy to determine which part of the document 3 has been scanned, so that an easy-to-understand user interface that can scan each part on the document 3 in an arbitrary order is realized. Further, for example, the user can easily grasp the part on the document 3 where scanning or character recognition has failed.

  The image composition unit 25 secures a storage area of the video memory 15 and composes a plurality of divided images 31a... 31f arranged according to the layout of the document 3 based on the recognition result by the character recognition unit 24 (pattern recognition). Generate an image. Further, the image composition unit 25 generates a composite image so that the above-described overlapping portions of adjacent divided images overlap each other.

  Here, the image composition unit 25 selects the plurality of divided images 31a... 31f based on the physical positional relationship between the position determination characters 7h (position determination images) included in the individual divided images 31a. Make corrections to the array. That is, as shown in FIG. 10, the image composition unit 25 divides the divided image 31a and the divided image 31b so that the numbers (2) that are the position determination characters 7h in the divided image 31a and the divided image 31b overlap each other. A composite image is generated while correcting the position and inclination of each other.

  Further, as shown in FIG. 10, the image composition unit 25 generates a composite image so that the boundary between the white region portion and the black region portion between the divided images 31a and 31b whose edges are detected, for example, is a straight line. Add corrections to. With the image composition unit 25 having these functions, stable image composition processing can be realized even if the document 3 is a document having many white areas (a document in which overlapping portions between divided images are difficult to obtain). .

  Next, an image composition method by the image composition apparatus 10 configured as described above will be described based on a flowchart shown in FIG. First, as shown in FIGS. 8 and 11, the image acquisition unit 22 acquires, for example, a divided image 31a read by the scanner 2 via the scan clear sheet 17 (S1). Subsequently, the edge detection unit 23 detects the edge of the peripheral edge of the document 3 by finding the boundary between the white area and the black area in the divided image 31a (S2).

  Next, as shown in FIGS. 8 and 11, the character recognition unit 24 cuts out the image 33a of the position determination character 7h located in the vicinity of the detected edge, and performs left-right inversion to perform character recognition (number recognition). (S3). Next, the image output unit 26 causes the display unit 14 to display the divided image 31a in which the character recognition of the position determination character 7h is completed (S4 is completed) (S4). Subsequently, the image processing control unit 21 determines whether or not all the divided images 31a to 31f are displayed on the display unit 14 (S5).

  When the image processing control unit 21 determines that all the divided images 31a... 31f have been displayed on the display unit 14 (YES in S5), the image composition unit 25 based on the recognition result by the character recognition unit 24. A composite image in which a plurality of divided images 31a... 31f are arranged in accordance with the layout is generated.

  As described above, according to the image composition processing system 1 provided with the image composition device 10 of the present embodiment, the plurality of divided images 31a... 31f obtained by dividing the document 3 into a plurality of times can be easily combined. be able to.

  In the image composition processing system 1 of the present embodiment, instead of the scan clear sheet 17, document size identification images 27a and 37a are arranged in the clear area 7b of the scan clear sheet 17 as shown in FIGS. The scan clear sheets 27 and 37 may be applied. The document size identification images 27a and 37a use, for example, a character recognizable identification symbol (star mark) or a character string (A4, B4, A3) in order to specify the document size to be held by the scan clear sheet.

  In other words, in the above-described example, the case where the A4 size scan clear sheets 7 and 17 are applied is shown. However, the image composition processing system 1 may separately capture images of documents of other sizes such as B4 size. Assumed. Therefore, in the image composition processing system described above, the number and position of the plurality of positioning reference marks 7g (number of arrows and their arrangement) and the number and position of position determination characters 7h (number of numbers and their arrangement) Therefore, it is necessary to prepare a plurality of types of scan clear sheets that differ for each document size.

  Therefore, the scan clear sheets 27 and 37 having the document size identification images 27a and 37a shown in FIGS. 12 and 13 are useful. Here, the image composition apparatus recognizes each original size identification image and original so that the scan clear sheets 27 and 37 correspond to which original size from the character recognition result of the original size identification images 27a and 37b. A mode in which a table or the like associated with the size is stored in the image processing control unit 21 is exemplified.

  With such a configuration, the user can easily select a scan clear sheet corresponding to the document size, and the image composition device side displays the number of times the document should be scanned on the display unit 14, and this is displayed on the user screen. It is possible to notify the user.

  In the image composition processing system 1 of this embodiment, it is also possible to apply a scan clear sheet having a different structure. Here, FIG. 14A is a view of the scan clear sheet 47 as viewed from the front surface (surface facing the inner side of the lid portion of the scanner 2), and FIG. 14B is a cross-sectional view corresponding to the illustrated direction. It is. 15A is a view of the scan clear sheet 47 as viewed from the back surface (the surface facing the contact glass 2a of the scanner 2), and FIG. 15B is a cross-sectional view corresponding to the illustrated direction. is there.

  In other words, the scan clear sheet 47 is configured with a black sheet 47a on the front (front) side and a transparent (or translucent) sheet 47b on the back side. On the black sheet 47a on the surface, a white positioning reference mark 7g and a position determination character 7h are arranged (printed or written). On the other hand, white position-determining characters 7h are also printed or written on the back side (transparent or translucent) sheet 47b.

  In the scan clear sheet 47 having such a structure, the case where the scanner 2 having the specification of forming the background of the read image image in black is applied, and the case of applying the scanner having the specification of forming the background of the image image in white are applied. In both cases, as in the examples of FIGS. 8 and 10, edge portions and position determination characters 7h appear on the divided images 31a, 31b. That is, with the scan clear sheet 47, even when using a scanner with specifications for forming the background in white, the alignment when combining the divided images is preferably performed with reference to the edge portion and the position determination character 7h. It can be carried out.

[Second Embodiment]
Next, a second embodiment of the present invention will be described based on FIG. 16, FIG. 17 (a) to FIG. 17 (d) and FIG. 18 in addition to FIG. 5 described above. 16 to 18, the same components as those illustrated in FIGS. 2 to 10 of the first embodiment are denoted by the same reference numerals and description thereof is omitted. Here, FIG. 16 is a functional block diagram showing an image composition program 8a operating on the image composition apparatus of the present embodiment.

  FIGS. 17A and 17C are diagrams showing the divided images 31a and 31b obtained when the scan clear sheet 17 is set in the scanner 2 in the correct orientation. FIGS. 17B and 17D are diagrams showing the divided images 41a and 41b obtained when the scan clear sheet 17 is set in the scanner 2 in the wrong direction. FIG. 18 is a flowchart showing an image composition method realized by the image composition apparatus (image composition program 8a) of this embodiment.

  The image composition processing system according to this embodiment has an image composition program 8a as shown in FIG. 16 instead of the image composition program 8 of the image composition processing system 1 according to the first embodiment. As shown in FIG. 5, in the first embodiment, the scan clear sheet 17 (7) needs to be set so that its long side forms an angle of 90 ° with the long side of the contact glass. there were. In this set state, on the premise that a plurality of images having the same orientation in each part of the document 3 are combined, as shown in FIGS. 17A and 17C, divided images 31a and 31b having the correct orientation are obtained. Acquired by the image acquisition unit 22.

  On the other hand, the scan clear sheet 17 (7) is set with its long side facing the same direction as the long side of the contact glass, and the divided images 41a and 41b shown in FIGS. 17 (b) and 17 (d). Even if obtained, the image synthesizing apparatus (image synthesizing program 8a) of this embodiment can synthesize the divided images by correcting such erroneous settings.

  That is, as shown in FIG. 16, in addition to the configuration of the image composition program 8, the image composition program 8 a further includes a side color determination unit 28 and a character direction determination unit 29, and an image of the image composition program 8. Instead of the combining unit 25, an image combining unit 25a is provided. The side color determination unit 28 determines whether the color around the four sides of the divided image acquired by the image acquisition unit 22 is substantially white or black. As shown in FIGS. 17A to 17D, the side color determination unit 28 detects two or three white sides from the divided image acquired by the image acquisition unit 22, and Then, one or two sides of the black side are detected.

  The character recognition unit 24 recognizes the white position determination characters 7h (numeric characters) included around the black side portion. The character direction determination unit 29 determines the direction of the position determination character 7 h based on the recognition result by the character recognition unit 24. From the discrimination results by the side color discriminating unit 28 and the character direction discriminating unit 29, the image synthesis unit 25a, as shown in FIGS. 17 (b) and 17 (d), split images 41a and 41b with the 90 ° wrong orientation. When it is determined that the divided images 41a and 41b are synthesized, the divided images 41a and 41b are synthesized after being corrected in the directions shown in FIGS. 17A and 17C when the divided images 41a and 41b are synthesized.

  Next, an image composition method using the image composition program 8a configured as described above will be described with reference to the flowchart shown in FIG. First, the image acquisition unit 22 acquires a divided image read by the scanner 2 via the scan clear sheet 17 (S11). Next, the side color determination unit 28 determines whether the color around the four sides of the acquired divided image is white or black (S12). The character recognition unit 24 recognizes the position determination character 7h around the black side (S13), and the character direction determination unit 29 determines the direction of the position determination character 7h recognized by the character recognition unit 24. It discriminate | determines (S14).

  Next, when the image processing control unit 21 recognizes that the determination of the character direction of the position determination characters 7h in all the divided images has been completed (YES in S15), the image composition unit 25a performs the division as necessary. After correcting the orientation of the image, a composite image in which a plurality of divided images 31a... 31f are arranged according to the layout of the document 3 is generated (S16).

  Therefore, in the image composition device of the present embodiment, the orientation of the acquired divided image can be determined by detecting the arrangement relationship of the black sides in the divided image and the direction of the position determination character 7h. . As a result, even when the scan clear sheet 17 is set on the scanner 2 with a 90 ° misorientation, it is possible to generate a composite image after correcting the divided image to the correct orientation.

[Third Embodiment]
Next, the 3rd Embodiment of this invention is described based on FIGS. 19 to 21, the same components as those of the first embodiment illustrated in FIGS. 2 to 8 are denoted by the same reference numerals and description thereof is omitted. Here, FIG. 19 is a functional block diagram showing an image composition program 8b operating on the image composition apparatus of the present embodiment. FIG. 20 is a view of the scan clear sheet 57 as viewed from the front side. Further, FIG. 21 is a diagram showing a divided image 51 a that is read from the document through the scan clear sheet 57.

  In the image composition processing system according to this embodiment, the background of the read image image is formed in white instead of the scanner 2 having the specification for forming the background in black, which is included in the image composition processing system 1 of the first embodiment. A scanner having a background forming portion on the inner side surface of the lid portion is applied. Further, instead of the scan clear sheet 17 of the first embodiment, a scan clear sheet 57 is used as shown in FIG.

  That is, as shown in FIG. 20, a black positioning reference mark 57g is arranged (printed or filled in) on the surface of the scan clear sheet 57. Further, on the scan clear sheet 57, there are black position determination characters 57h that differ for each divided image, and square timing marks 57k that are filled with black and that are arranged in the vicinity of the individual position determination characters 57h. Printed or entered as a position discrimination image.

  In addition, on the image composition apparatus, an image composition program 8b operates instead of the image composition program 8 of the first embodiment. That is, the image synthesis program 8b replaces the edge detection unit 23, the character recognition unit 24, and the image synthesis unit 25 of the image synthesis program 8 with each other as shown in FIG. 19 with a timing mark detection unit 23b, a character recognition unit 24b, and an image. A synthesizer 25b is provided.

  That is, the timing mark detection unit 23b detects a square portion filled with black in the area corresponding to the clear area 7b as the timing mark 57k. The character recognition unit 24b recognizes the black position determination character 57h located in the vicinity of the timing mark 57k. The image composition unit 25b divides the divided images so that the directions and positions of the timing marks 57k (and the position determination characters 57h) included in the divided images overlap when the adjacent divided images are superimposed and synthesized. A composite image is generated while correcting the position and inclination of each other.

  Here, as in this embodiment, when a scanner with a white background is applied, there is a drawback that the edge of the document 3 cannot be seen on the divided image 51a. However, according to the image synthesizing apparatus of the present embodiment, it is possible to easily detect the position determination character 57h with reference to the timing mark 57k in the form of a rectangle that is relatively easy to detect. Furthermore, according to the image composition apparatus of the present embodiment, it is possible to correct the composition of the divided images using the timing mark 57k as a reference for alignment.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described with reference to FIGS. 22 and 23 in addition to FIG. 5 described above. 22 and 23, the same reference numerals are given to the same components as those of the first embodiment shown in FIGS. 2 to 8, and the description thereof is omitted. Here, FIG. 22 is a functional block diagram showing an image composition program 8c operating on the image composition apparatus of the present embodiment. FIG. 23 is a view of the scan clear sheet 67 viewed from the front side.

  In the image composition processing system according to this embodiment, instead of the scanner 2 having the specification of forming the background in black, which is included in the image composition processing system 1 of the first embodiment, reading is performed in the same manner as in the third embodiment. A scanner having a specification for forming a white background of the image is applied. Further, instead of the scan clear sheet 17 of the first embodiment, a scan clear sheet 67 is used as shown in FIG. The scan clear sheet 67 is configured by deleting the timing mark 57k from the scan clear sheet 57 of the third embodiment.

  On the image composition device, an image composition program 8c operates instead of the image composition program 8 of the first embodiment. That is, in the image composition program 8c, as shown in FIG. 22, the edge detection unit 23 of the image composition program 8 is deleted, and instead of the image processing control unit 21 and the character recognition unit 24 of the image composition program 8, An image processing control unit 21c and an image acquisition order detection unit 24c are provided.

  As illustrated in FIG. 5, the image acquisition order detection unit 24 c stores each divided image acquired by the image acquisition unit 22 after being read by the scanner and their acquisition order in association with each other. On the other hand, the image processing control unit 21 stores in advance the layout of the six area portions to be divided on the document 3 and the acquisition order of the divided images described above in the form of a table. That is, the image processing control unit 21 refers to the detection result of the image acquisition order detection unit 24c, and automatically acquires the first acquired divided image, for example, as the upper left partial image (of the document 3) shown in FIG. And the sixth acquired divided image is automatically assigned as the lower right partial image shown in FIG.

  Therefore, in the image composition processing system of this embodiment, the numbers (1) to (6) represented by the position determination characters 57h on the scan clear sheet 67 shown in FIG. Applied. That is, in the image composition processing system of the present embodiment, as shown in FIG. 5, each positioning reference mark 57g (arrow) in the vicinity of the numbers (1) to (6) with respect to the alignment reference mark 2b on the scanner. Must be set 6 times in numerical order.

  However, in the image composition apparatus (image composition program 8c) of the present embodiment, since it is not necessary to recognize the character 57h for position determination, the character recognition unit, the edge detection unit that can be used during the character recognition process, and the like are deleted. be able to. In addition, as described above, the image synthesis apparatus according to the present embodiment does not require character recognition processing. For example, when a scanner having a specification that forms the background of an image image in black is applied, the position is included in the divided image. The restriction of arranging the character 57h is inevitably avoided. Accordingly, the scan clear sheet 67 shown in FIG. 23 in which the position determination characters 57h are black can be applied without problem to both the scanner whose background is black and the scanner whose background is white.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described with reference to FIGS. 24 to 26, the same components as those of the third embodiment illustrated in FIGS. 19 to 21 are denoted by the same reference numerals and description thereof is omitted. Here, FIG. 24 is a view of the scan clear sheet 57 and the document 3 applied in this embodiment as seen from the front side. FIG. 25 is a view of the scan clear sheet 57 in a state where the document 3 is inserted with the front side facing up, as viewed from the front side. Furthermore, FIG. 26 is a functional block diagram showing an image composition program 8d operating on the image composition apparatus of the present embodiment.

  In the image composition processing system according to this embodiment, instead of the scanner 2 provided in the image composition processing system 1 of the first embodiment, as shown in FIG. 25, a digital video such as a Web camera for capturing a moving image is shown. A camera 2d is applied. Further, instead of the scan clear sheet 17 of the first embodiment, as shown in FIGS. 24 and 25, a scan clear sheet 57 is used as in the third embodiment.

  In the embodiment, a divided image is captured from the document 3 by a digital video camera 2d capable of capturing a color image, for example, instead of the scanner. For this reason, the scan clear sheet 57 in a state where the document 3 is inserted with the front side facing up is imaged by the digital video camera 2d from the front side.

  Here, usually, the digital video camera 2d has a problem that the resolution is lowered when the whole document 3 is shot at once. Therefore, in this embodiment, the six areas on the scan clear sheet 57 including the document 3 that has been scanned six times by the scanner in each of the above-described embodiments are allocated as six shooting areas by the digital video camera 2d. . That is, as shown in FIG. 25, a moving image is shot while moving the shooting region 2e of the digital video camera 2d to six locations on the scan clear sheet 57 including the document 3.

  Further, on the image composition apparatus, an image composition program 8d operates as shown in FIG. 26 instead of the image composition program 8b of the third embodiment. That is, the image synthesis program 8d is provided with an image acquisition unit 22d having a still image extraction unit 22e instead of the image acquisition unit 22 of the image synthesis program 8b.

  The image acquisition unit 22d acquires a moving image captured by the digital video camera 2d so that the document 3 is divided into six parts. The still image extraction unit 22e extracts a still image serving as a snapshot as a divided image from a plurality of image frames that are constituent units of the acquired moving image. Specifically, the still image extraction unit 22e extracts six divided images (still images) on the document 3. Here, the still image extraction unit 22e may operate in cooperation with the character recognition unit 24b, for example. That is, the still image extraction unit 22e selectively extracts an image frame in which the character recognition result of the position determination character 57h is first obtained by the character recognition unit 24b from among a plurality of image frames. Also good.

  As described above, the image composition processing system according to the present embodiment is excellent in portability because a Web camera or the like that can be easily configured as a smaller device than a scanner can be applied. In addition, by applying a mobile PC with a camera, a notebook PC, or the like to the image composition processing system, an image composition device integrated with the camera can be configured. Thereby, the further improvement of portability can be aimed at.

[Sixth Embodiment]
Next, a sixth embodiment of the present invention will be described with reference to FIGS. 27 to 31, the same components as those of the fifth embodiment illustrated in FIGS. 24 to 26 are denoted by the same reference numerals and description thereof is omitted. Here, FIG. 27 is a functional block diagram showing an image composition program 8e operating on the image composition apparatus of the present embodiment. FIG. 28 is a view of the scan clear sheet 77 as seen from the front (front) surface. Furthermore, FIG. 29 is a view of the scan clear sheet 77 in a state where the document 3 is inserted with the front side facing up, as viewed from the front side.

  FIG. 29 is a functional block diagram showing an image composition program 8e that operates on the image composition apparatus of the present embodiment. FIG. 30 is a view for explaining the geometric distortion of the image of the scan clear sheet 77 photographed by the digital video camera 2d. Further, FIG. 31 is a flowchart showing an image composition method realized by the image composition apparatus (image composition program 8a) of the present embodiment.

  As shown in FIGS. 28 and 29, the scan clear sheet 77 of this embodiment is mainly on the front surface of the document holder 7a on the scan clear sheet 57 of the third and fifth embodiments. A plurality of ruled lines 77a (images of a plurality of line segments) are arranged in a grid pattern. The plurality of ruled lines 77 a are drawn with a density that allows the image on the document 3 inserted into the scan clear sheet 77 to pass therethrough. Specifically, these ruled lines 77a are configured as yellow fluorescent lines.

  In the image composition processing system of this embodiment, an image composition program 8e is applied as shown in FIG. 27 in place of the image composition program 8d applied in the image composition processing system of the fifth embodiment. Yes. That is, the image composition program 8e includes a fluorescence component extraction unit 28e and a ruled line detection unit 29e as shown in FIG. 27 in addition to the configuration of the image composition program 8d, and an image composition unit 25e instead of the image composition unit 25d. It has.

  Here, the image acquisition unit 22d acquires a plurality of color divided images including line segment images (images of ruled lines 77a) arranged in a grid pattern, which are captured by the digital video camera 2d. The fluorescent component extraction unit 28e extracts the fluorescent yellow component of the ruled line 77a on the scan clear sheet 77 from the color divided image acquired by the image acquisition unit 22d. Specifically, the fluorescent yellow component has a characteristic that the reflectance of red light and green light is high, while the reflectance of blue light is low. Therefore, the fluorescence component extraction unit 28e performs image processing in which the blue light reflection component is enhanced so as to obtain a contrast with the white background of the document 3, and extracts the fluorescence yellow component of the ruled line 77a. In the binarized image processing in this case, the ruled line 77a cannot be discriminated only in the region where the ruled line 77a and the image on the document 3 (for example, a black image) overlap.

  Accordingly, the ruled line detection unit 29e detects the entire ruled line 77a by a process of connecting the ruled lines 77a that are interrupted on the image of the document 3 in a straight line. In addition, as shown in FIG. 30, the image composition unit 25e corrects the ruled line 77a in each divided image so as to correct the geometric distortion of the divided image 61a caused by the inclination at the time of shooting by the digital video camera 2d. Based on the arrangement relationship, correction is performed when the divided images are combined. That is, the image composition unit 25e corrects the composition of the divided images so that the ruled lines 77a of the adjacent divided images are directly connected and the ruled lines 77a intersecting each other form an angle of 90 °.

  Next, an image composition method by the image composition program 8e configured as described above will be described with reference to a flowchart shown in FIG. First, when the image acquisition unit 22d acquires a color divided image (S21), the fluorescent component extraction unit 28e extracts a fluorescent yellow component in the acquired divided image. (S22). The ruled line detection unit 29e detects the ruled line 77a by the process of connecting the fluorescent yellow components interrupted on the image of the document 3 in a straight line (S23). Thereafter, the character recognizing unit 24 recognizes the position determination character 57h from the divided image returned to the color (S24). When character recognition of all the divided images has been completed (YES in S25), a plurality of divided images are arranged according to the layout of the document 3, and the divided images are synthesized while correcting so as to correct the distortion of the ruled line 77a. (S26).

  Therefore, according to the image composition device of the present embodiment, the ruled line 77a on the scan clear sheet 77 is used even when the divided image 61a is distorted due to the inclination of the digital video camera 2d at the time of shooting. Thus, a composite image can be generated while correcting the distortion of each divided image 61a.

  The present invention has been specifically described with reference to the first to sixth embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention. . For example, other image composition processing systems and image composition devices may be configured by appropriately combining some of the constituent elements exemplified in the first to sixth embodiments. Further, instead of the digital video camera that shoots the moving image of the fifth and sixth embodiments, a digital still camera that directly shoots a still image may be applied. When a digital still camera is applied, it is not necessary to extract an image frame from a plurality of objects, so that the configuration of the image acquisition unit can be simplified. In the first to fourth embodiments, a divided image may be obtained using such a digital still camera or digital video camera 2d instead of the scanner 2. Further, the scan clear sheet 77 in which the ruled lines 77a of the sixth embodiment are arranged in a lattice shape is also applied to the first to fifth embodiments, and the first to fifth embodiments to which the scan clear sheet 77 is applied are divided images. You may implement | achieve the synthetic | combination process which correct | amends a geometric distortion.

  DESCRIPTION OF SYMBOLS 1 ... Image composition processing system, 2 ... Scanner, 8, 8a, 8b, 8c, 8d, 8e ... Image composition program, 2a ... Contact glass, 2d ... Digital video camera, 7, 17, 27, 37, 47, 57, 67, 77: Scan clear sheet, 7a: Document holding unit, 7b: Clear area, 7h, 57h ... Position determination character, 10 ... Image composition device, 14 ... Display unit, 22, 22d ... Image acquisition unit, 22e ... Stationary Image extraction unit, 23 ... edge detection unit, 23b ... timing mark detection unit, 24, 24b ... character recognition unit, 24c ... image acquisition order detection unit, 25, 25a, 25b, 25d, 25e ... image synthesis unit, 31a, 31b , 31f, 41a, 51a, 61a ... divided image, 32a ... first image region, 33a ... character for position determination, 34a ... second image region, 57k ... Timing mark, 77a ... borders.

Claims (6)

An image representing a reference position for positioning to the scanner, and a part of the object, which is a sheet that is set in a scanner with the object to be scanned held and is divided and scanned together with the object A position determination image representing a number for specifying the position of the object on the object includes an image of a part of the object and the position determination image using the sheet printed at a plurality of different positions. An image acquisition step of acquiring a plurality of divided images;
A recognition step of performing pattern recognition of the position determination image for each of the acquired divided images;
A synthesis step of generating a synthesized image in which the plurality of divided images are arranged based on a recognition result by the pattern recognition;
Images synthetic methods that have a. With split picture image complete pattern recognition of the position determination image by the recognition step, the area on the object to scan and pattern recognition has not been completed to that effect together with the number corresponding to the position corresponding to the region A display step to be displayed on the display device;
Further, the image synthesis method according to claim 1 Symbol placement that have a. In the synthesis step,
Based on the physical positional relationship between the position determination images respectively included in the individual divided images acquired in the image acquisition step, a correction is made to the synthesis of the plurality of divided images .
請 Motomeko image composition method according to 1 to any one of 2. The image representing the reference position is printed as a mark in the vicinity of the position determination image on the sheet .
請 Motomeko image composition method according to 1 to any one of the three. An image representing a reference position for positioning to the scanner, and a part of the object, which is a sheet that is set in a scanner with the object to be scanned held and is divided and scanned together with the object A position determination image representing a number for specifying the position of the object on the object includes a plurality of images including a partial image of the object and the position determination image from the sheet printed at a plurality of different positions . An image acquisition unit for acquiring divided images;
A pattern recognition unit that performs pattern recognition of the position determination image for each divided image acquired by the image acquisition unit;
An image synthesis unit that generates a synthesized image in which the plurality of divided images are arranged based on a recognition result by the pattern recognition unit;
It provided the images synthesizer. An image representing a reference position for positioning to the scanner, and a part of the object, which is a sheet that is set in a scanner with the object to be scanned held and is divided and scanned together with the object A position determination image representing a number for specifying the position of the object on the object includes a plurality of images including a partial image of the object and the position determination image from the sheet printed at a plurality of different positions. An image acquisition procedure for acquiring divided images;
A pattern recognition procedure for performing pattern recognition of the position determination image for each of the divided images acquired by the image acquisition procedure;
An image synthesis procedure for generating a synthesized image in which the plurality of divided images are arranged based on a recognition result by the pattern recognition procedure;
A program that causes a computer to execute.

Images