JP3495948B2 - Image processing method, image processing apparatus, and storage medium - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and an image processing method, for example, an image processing apparatus and an image processing method capable of forming a mosaic image by combining material images.

[0002]

2. Description of the Related Art A conventional mosaic image is "a technique in which small pieces of stones, glass, marble, etc. of various colors are combined and fitted into a floor, wall, etc., or a technique thereof" (Sanseido Modern Japanese Dictionary). Has been widely known as.

Using this technique, it is possible to combine a large number of photographic images to form a design or a single photographic image.

[0004]

However, in the image generation method by the conventional mosaic method described above, an extremely large number of material images are prepared, and material images that match the image characteristics of each area are selected from among them. I had to generate a mosaic image.

Therefore, even if many material images are used, only a part of the material images are used, most of the images are not used, and most of the material images collected cannot be seen. There was a problem.

The present invention has been made for the purpose of solving the above-mentioned problems. For example, after creating a mosaic image, the remaining material images are displayed so that many material images can be confirmed. An object is to provide an image processing device and method.

[0007]

In order to achieve the above object, an embodiment of the present invention according to the present invention has the following configuration.

The present invention is an image processing apparatus capable of forming a mosaic image by combining material images, wherein the dividing means divides an image on which the mosaic image is based into M × N regions, and the dividing means. Calculate the average density of each divided area
Calculating means to be output, and each of the areas calculated by the calculating means
Selection means for selecting a material image corresponding to each area based on the average density of the area, and pasting the material image selected by the selection means to each corresponding area Generating means for generating a mosaic image by
Material images corresponding to each area of the mosaic image and display means that displays switched one after another in another material image, the
The display means displays a plurality of material images as the other material images.
Switch and display material images randomly selected from
Characterized in that it.

The present invention also combines material images.
An image processing device capable of forming a mosaic image, comprising:
Divide the base image of the mosaic image into M × N regions
The dividing means and the average density of each area divided by the dividing means.
Calculating means for calculating the degree, and before calculating by the calculating means
Corresponding to each area based on the average density of each area
Selection means for selecting the material images to be used and the selection means.
Paste the selected material image to each corresponding area
A generation means for generating a mosaic image, and the generation means
Other material images corresponding to each area of the created mosaic image
And display means to switch and display the material images one after another.
Well, the other material images are close to the average density of each area.
When it is selected in order and the display of the other material images goes round
The mosaic image generated by the generating means is displayed again.
Characterized in that it is.

[0010]

[0011]

[0012]

[0013]

DETAILED DESCRIPTION OF THE INVENTION An embodiment of the present invention will be described in detail below with reference to the drawings. FIG. 8 is a diagram showing the relationship between a plurality of types of images used in the mosaic method. The mosaic image processing technique will be described below with reference to FIG.

In FIG. 8, a first image 201 is a design or an image which is a basis for constructing an image using the mosaic method. The second image 202 is an image formed by a mosaic method using a plurality of small images.

The material image 203 is a material image used to form the second image 202, and P sheets are prepared in the example of FIG. The number P of material images is a sufficiently large number that can generally prepare the types of colors and textures required to form the second image.

Then, for each of the divided image areas, the average density of RGB is calculated according to the following equation.

Rd_av = 1 / p × q · ΣRi Gd_av = 1 / p × q · ΣGi Bd_av = 1 / p × q · Σbi Note that “d” means “destination”.

Subsequently, the average densities of R, G and B were calculated for the P material images to be fitted in the respective divided areas according to the following equations.

Rs_av = 1 / p × q · ΣRi Gs_av = 1 / p × q · ΣGi Bs_av = 1 / p × q · Σbi Note that “S” means “source”.

RGB3 of each divided area and each material image
The distance ΔE of the stimulus value is calculated, and the material image having the smallest value is selected as the material image to be fitted into the corresponding divided area. [First Embodiment] FIG. 1 is a block diagram showing a mosaic image generation apparatus which constitutes an image processing apparatus according to the first embodiment of the present invention.

In FIG. 1, a reading unit 100 can read the image to be processed by using a scanner device, a video reproducing device, or the like. 101 is a storage unit capable of storing processed images and the like, 102 is a display unit for displaying processed images and the like,
Reference numeral 103 denotes a control unit (CPU) that controls the entire apparatus according to the present embodiment in accordance with a control procedure stored in the ROM 104 and shown in a later-described flowchart, and 104 denotes a CP.
A ROM that stores the control procedure of the U103 and the like, and a RAM 105 that stores the progress of processing and the like.

The storage unit 101 can store moving images and still images, and often uses a database. The display unit 102 can display the image stored by the storage unit 101 and the image read by the reading unit 100.

The mosaic image generating apparatus according to the first embodiment is provided with various constituent elements other than those described above, but this is not the main subject of the present invention, and the description thereof will be omitted.

Also in the present embodiment, the basic structure of mosaic image generation is the same as the example shown in FIG.

Also in this embodiment, basically, the first image 201 shown in FIG. 7 becomes a design or an image which becomes a base when the image is constructed by using the mosaic method.
02 is a second image formed by using a plurality of small images by the mosaic method.

The material image 203 is the second image 202.
In the example of FIG. 7, the size of the P images is the same as the tile, but this does not necessarily have to match the size of the tile. Not all the sheets need to be the same size.

In this case, the size of the material image needs to be converted to the tile size when the image is pasted on the corresponding tile portion.

Next, with reference to FIGS. 2 to 7, an image construction method by the mosaic method of the present embodiment will be described.

Next, the operation of generating a mosaic image in the mosaic image generating apparatus configured as above will be described with reference to the flowchart of FIG.

FIG. 4 is a flow chart showing a mosaic image generating method according to the first embodiment of the present invention.

In FIG. 4, first, in step S301, the first image is divided into M × N tiles. As a result M ×
N rectangular tiles TL (0,0), TL (1,0), T
L (2,0) ..., TL (2,4), TL (3,4) are generated.

FIG. 2 shows the first image divided into M × N rectangles, and the example of FIG. 2 shows an example in which it is divided into 5 × 4 rectangles. In FIG. 2, X and Y are the numbers of pixels of the first image 201 in the horizontal and vertical directions, respectively.

P and q are M × N rectangular tiles TL (0,0), TL (1,0), TL (2,0) for the first image.
.., TL (2,4), and TL (3,4) are the number of pixels in the horizontal and vertical directions of each tile.

Therefore, the relations X = p × M and Y = q × N are established.

FIG. 3 shows the structure of individual tiles.
Each tile is decomposed into p × q three primary colors, red (R), green (G), and blue (B).

Next, in step S302 of FIG. 4, the average density value of RGB is calculated according to the following equation for each of the M × N tiles divided in step S301.

Rd_av = 1 / p × q · ΣRi Gd_av = 1 / p × q · ΣGi Bd-av = 1 / p × q · Σbi Note that “d” means “destination”.

Next, in step S303, the average densities of R, G, B of each material image are calculated according to the following equation, and step S3
Go to 04.

Rs_av = 1 / p × qΣRi Gs_av = 1 / p × q · ΣGi Bs_av = 1 / p × q · Σbi Note that “S” means “source”.

Then, in a succeeding step S304, a counter X_Pos (0≤X_Pos) indicating the position of the tile being processed in order to set the upper right tile area of the first image as the processing start position.
Pos ≦ M−1) and counter Y_Pos (0 ≦ Y_Po
Both s ≦ N−1) are initialized to 0. (X_Pos, Y
-Pos) = (0,0) indicates the top left tile of the first image.

Next, in step S305, the position counter X_
An image most suitable for the tile indicated by Pos and Y_Pos is selected from the material images. The selection method calculates the distance ΔE of the RGB tristimulus values and selects the one with the smallest value.

The evaluation formula for selection is shown below.

ΔE = (Rs_av-Rd_av) ∧2 + (Gs_av-Gd_av) ∧2 +
(Bs_av-Bd_av) ∧2 This makes it possible to select the material image having the density value closest to the average density value of the tile portion.

In the subsequent step S306, the processing position is moved to the right, and if the right end is reached, the processing position is moved to the left end in the downward direction. Then, in the following step S307, it is checked whether or not there is no next processing position in the movement processing of step S306 and the processing for all tiles is completed. If there is a next processing tile position, step S30
In step 5, the material image pasting process is performed at the next tile position.

On the other hand, in step S307, the pasting process is successively performed in the horizontal direction and the vertical direction successively, and when it is determined that the process has been completed for all tiles, the process is completed. As a result of the processing described above, a mosaic image is generated.

Next, the processing for displaying the mosaic image generated as described above in this embodiment will be described below with reference to FIG. FIG. 5 is a flowchart showing the mosaic image generation operation in this embodiment.

In displaying the mosaic image of the present embodiment, first, in step S400 of FIG. 5, the mosaic image generated by the control shown in FIG. 4 is displayed on the display unit 102.

Then, in step S401, the counter t is set to "0" for initialization. Then, in step S402, a random number from 0 to (M-1) is generated in order to determine at which position in the X direction the material image is switched, and the generated value is determined as the X coordinate Xr.

Next, in step S403, in order to determine at which position in the Y direction the material image is to be switched,
A random number from 0 to (N-1) is generated, and the generated value is determined as the Y coordinate Yr. And step S404
In, the image in TL (Xr, Yr) is replaced with another material image.

Then, in step S405, the counter t is incremented by one, and in the following step S406, it is checked whether or not the counter t is larger than the number of times of repetition T. If the counter t is smaller than the number of repetitions T, the process returns to step S402.

On the other hand, if the counter t is equal to or greater than T in step S406, the process proceeds to step S407. In step S407, it is determined whether or not the process is finished. If the processing is not to be ended, step S400
If the processing is completed, the processing is completed.

As described above, according to the present embodiment, the material image of the tile is constantly changing, and the mosaic image can be displayed after displaying a certain number of material images.

[Second Embodiment] In the first embodiment described above, an example in which the material image of the tile is replaced with another material image randomly selected has been described. However, the tile processing method is not limited to this, and may be determined as described in the second embodiment below.

In the second embodiment, the structure of the mosaic image generating apparatus is the same as that of the first embodiment shown in FIG. 1 described above, and detailed description of common parts will be omitted. Hereinafter, the parts different from the first embodiment will be mainly described.

FIG. 6 is a flow chart showing a mosaic image generating method according to the second embodiment of the present invention.

In the second embodiment, first, in step S500 of FIG. 6, an array T indicating the processing order of tiles is first set.
-Turn [MxN-1] stores the order of processing tiles.

Array T-Tur in step S500
FIG. 7 shows the details of the processing for storing the processing order in n [M × N−1]. FIG. 7 shows the array T-T of the second embodiment.
It is a flowchart which shows the detail of the process which stores the processing order in urn [MxN-1]. Specifically, the sequence T
-MnN-1 numbers are randomly mixed and stored in Turn [MxN-1].

In FIG. 7, in step S600, an array T-Turn [M × N-] indicating the tile processing order is first displayed.
1] to T-Turn [0] = 0, T-Turn [1] =
1, T-Turn [2] = 2, ..., T-Turn [M ×
N-1] = M × N-1 is stored.

In subsequent step S601, "M × N-1" is set in the counter i. Next, in step S602, a random number R of 1 to i is generated. And step S603
, T-Turn according to the generated random number R
The numbers stored in [R] and T-Turn [i] are exchanged.

Next, in step S604, the counter i is decremented by 1 and the value of the counter i is decremented by 1 to set i = (i-1). In a succeeding step S605, it is checked whether or not the counter value i ≧ 0. If the counter value i is a positive value i ≧ 0, the process returns to step S602, and the above-described operation is repeated. On the other hand, if the counter value i is a negative value, the process ends.

As described above, the array T-Turn [M × n-1] indicating the processing order of random tiles is created.

Returning to the explanation of the processing in FIG. 6 again, step S
When the process of 500 is completed, the process proceeds to step S501, and the mosaic image generated by the process shown in the flowchart of FIG. 4 is displayed.

Then, in step S502, the counter t is set to "0" for initialization and the similarity rank k is initialized to "1". Subsequently, in step S503, "0" is set to the counter j for initialization.

Next, in step S504, T-Tu
From the material images, n pieces (1 <n <total number of material images) are selected in the order in which the average density is closest to the tile indicated by the number stored in rn [j]. Then, in step S505, the current material image is replaced with an image that is the k-th closest to the selected tile.

Next, in step S506, the counter j is incremented by one. And step S507
At, it is checked whether the counter value j is smaller than M × N. If the counter value j is smaller than M × N, the process returns to step S504.

On the other hand, if the counter value j is larger than M × N in step S507, the process proceeds to step S508, in which the counter t is incremented by 1 and 1 is added.
Then, in step S509, it is checked whether the counter value t is larger than the number of times T of repetition. If the counter value t is not larger than the number of times T of repetition and is smaller than it, the process proceeds to step S510, where "0" is set to the counter j for initialization, and the similarity rank k is incremented by 1 to k.
= K + 1, and the process returns to step S504.

On the other hand, if the counter value t is larger than the number of times T of repetition in step S509, the process proceeds to step S511. Then, in step S511, it is determined whether or not there is an instruction input for ending the process. If the processing has not ended, the process advances to step S501 to repeatedly execute the above-described processing.

On the other hand, in step S511, if the process is to be ended, the process of the flowchart of FIG. 6 is ended.

By repeatedly executing the above-described processing of FIG. 6, the material images of the tiles are changed from similar ones to dissimilar ones several times, and then again. Return to the mosaic image with the highest image quality.

As described above, according to the second embodiment, in displaying a mosaic image, the mosaic image as a whole gradually changes from a mosaic image with good image quality to a mosaic image with poor image quality. In the meantime, many material images can be seen. [Other Embodiments] Even when the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus including one device (for example, , Copiers, facsimile machines, etc.).

Another object of the present invention is to supply a storage medium (or recording medium) recording a program code of software for realizing the functions of the above-described embodiments to a system or apparatus, and to supply a computer of the system or apparatus ( Alternatively, by the CPU or MPU) reading and executing the program code stored in the storage medium,
It goes without saying that it will be achieved. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.
Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also based on the instruction of the program code,
It goes without saying that an operating system (OS) or the like running on a computer performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion card inserted in the computer or the function expansion unit connected to the computer, based on the instruction of the program code. , The CPU provided in the function expansion card or the function expansion unit performs some or all of the actual processing,
It goes without saying that the processing includes the case where the functions of the above-described embodiments are realized.

When the present invention is applied to the above storage medium, the storage medium has been described above (shown in FIGS. 5 to 7).
The program code corresponding to the flowchart will be stored.

[0074]

As described above, according to the present invention, there is provided an image processing apparatus and method capable of confirming many material images by, for example, creating a mosaic image and then displaying the remaining material images. Can be provided.

When an image is generated by using the mosaic method, it is possible to display the mosaic image at regular intervals while displaying many material images.

Furthermore, in displaying a mosaic image, the mosaic image as a whole gradually changes from a mosaic image with good image quality to a mosaic image with poor image quality, and many material images can be seen during that time.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a mosaic image generation device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating an operation of dividing a first image into tile areas according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining a configuration of individual tiles in the first exemplary embodiment of the present invention.

FIG. 4 is a flowchart showing a mosaic image generation operation in the present embodiment.

FIG. 5 is a flowchart showing display control of a mosaic image in the present embodiment example.

FIG. 6 is a flowchart showing display control of a mosaic image in the second embodiment according to the book and title.

FIG. 7 shows an array T-Turn [M ×] of the second embodiment.
[N-1] is a flowchart showing a procedure of randomly cutting and storing M * N-1 numbers.

FIG. 8 is a diagram for explaining an image composing method by a mosaic method.

[Explanation of symbols]

100 reading section 101 storage unit 102 display 103 control unit (CPU) 104 ROM 105 RAM

─────────────────────────────────────────────────── ─── Continuation of the front page (56) References JP 10-269353 (JP, A) JP 7-302271 (JP, A) JP 56-46371 (JP, A) JP 63- 222595 (JP, A) Actual Kaihei 4-24794 (JP, U) Special Tables 9-512147 (JP, A) (58) Fields investigated (Int.Cl. ⁷ , DB name) H04N 1/387 G06T 1 / 00 500

Claims (9)

(57) [Claims] 1. An image processing apparatus capable of forming a mosaic image by combining material images, comprising: dividing means for dividing an image on which the mosaic image is based into M × N areas; Calculate the average density of each area
Based on the calculation means and the average density of each area calculated by the calculation means.
There, the selection means for selecting a material images corresponding to the respective regions, a generation unit for generating a mosaic image material image selected by the selection means respectively corresponding to the pasted to each area, generated by the generation means A material image corresponding to each area of the generated mosaic image is displayed by switching to another material image one after another , and the display means includes a plurality of materials as the other material images. Picture
Switch and display the material images randomly selected from the image
The image processing apparatus characterized by Shimesuru. 2. A mosaic image is formed by combining material images.
A formable image processing device, wherein an image serving as a base of the mosaic image is divided into M × N regions.
Dividing means for calculating the average density of each area divided by the dividing means
Based on the calculation means and the average density of each area calculated by the calculation means.
Select the material image corresponding to each area.
The selecting means and the material images selected by the selecting means.
Corresponding to each generation area that is pasted to each area to generate a mosaic image and each area of the mosaic image generated by the generation means
Switch the material images to other material images one after another
Display means for displaying the other material images in the order of being closer to the average density of each area.
Once the other material images have been selected and the display of the other material images has completed, the generating means is generated again.
The image processing apparatus , wherein the mosaic image generated in step 1 is displayed . 3. A storage means for storing the material image and a second calculating means for calculating an average density of the material image.
In preparation for the above, the selection means is configured to calculate each of the values calculated by the calculation means.
The average density of the area and the above calculated by the second calculating means.
If the distance of RGB3 stimulus value from the average density of the material image is the minimum
The image processing apparatus according to claim 1 or 2, wherein the material image is selected from the storage means . 4. The material image selected by the selecting means
The conversion to the size of the area divided by the dividing means.
Further comprising a conversion unit , wherein the generation unit is the material image converted by the conversion unit.
Attach the image to each area divided by the dividing means
Claim 1 also and generates a mosaic image Te
Is an image processing apparatus according to 2. 5. A mosaic image is formed by combining material images.
An image processing method which can be formed, wherein an image which is a basis of the mosaic image is divided into M × N regions.
And the average density of each area divided in the dividing step
Based on the calculation step and the average density of each area calculated in the calculation step.
Select the material image corresponding to each area.
The selection step and the material image selected in the selection step
Corresponds to the generation process of pasting to each area to generate a mosaic image and each area of the mosaic image generated in the generation step.
Switch the material images to other material images one after another
The display step includes a plurality of material images as the other material images.
Switch and display the material images randomly selected from the image
Image processing method, characterized in that Shimesuru. 6. A mosaic image is formed by combining material images.
An image processing method which can be formed, wherein an image which is a basis of the mosaic image is divided into M × N regions.
And the average density of each area divided in the dividing step
Based on the calculation step and the average density of each area calculated in the calculation step.
Select the material image corresponding to each area.
The selection step and the material image selected in the selection step
Corresponds to the generation process of pasting to each area to generate a mosaic image and each area of the mosaic image generated in the generation step.
Switch the material images to other material images one after another
And the other material images are arranged in the order of being closer to the average density of each area.
Once the other material images have been selected and the display of the other material images has completed, the generating means is generated again.
Wherein the mosaic image is displayed in the generated
Image processing method. 7. The material image is stored in a storage means.
Ri, a second calculation step of calculating an average density of the material image
In addition, the selection step includes each of the calculated in the calculation step.
The average density of the region and the above calculated in the second calculation step
If the distance of RGB3 stimulus value from the average density of the material image is the minimum
And characterized by selecting a material image consisting of said storage means
The image processing method according to claim 5, wherein 8. The material image selected in the selecting step
The conversion to the size of the area divided in the dividing step.
The conversion step further includes a conversion step, and the generation step includes the material image converted in the conversion step.
Attach the image to each area divided in the dividing step
5. Further and generates a mosaic image Te
Is the image processing method described in 6. 9. An image processing method according to claim 5 or 6.
Stored the program to be executed by the computer
A computer-readable storage medium characterized in that
body.