JP6279025B2 - Image processing apparatus, image processing apparatus control method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method for the image processing apparatus, and a program.

  In recent years, when creating a document, advanced functions have been used, such as simply embedding characters, decorating fonts, creating drawings freely, or incorporating photos, etc. .

  The higher the content of the creation, the greater the effort required to create a completely new document. Therefore, it is desired that a part of a document created in the past as much as possible can be reused as it is or after being edited and edited.

  In addition, with the spread of networks such as the Internet, opportunities for electronic distribution of documents have increased, but electronic documents are often distributed as paper documents printed on paper.

  A technique for allowing the contents of a paper document to be obtained as reusable data even when only the paper document exists at hand is considered.

  For example, when a paper document is electronically read, a technique is disclosed in which a document that matches the content is retrieved from a database and can be used in place of the read paper document data (for example, patents). Reference 1).

  If the same document cannot be retrieved from the database, the content of the paper document is converted into electronic data that can be easily reused. In this case as well, the content of the paper document can be reused.

  Regarding data from such a paper document, there is an OCR technique as a technique for converting character information in a document image into electronic data that can be easily reused. Further, there is a vectorization technique as a technique for converting graphic information composed of lines and planes into data that can be easily reused.

  Using such a technique, Patent Document 1 discloses a technique for converting a character in a document image into a character code or converting a figure outline into vector data to convert it into reusable data.

  Further, Patent Document 1 discloses a technique for identifying areas such as characters, line drawings, natural images, and tables in a document image and constructing data that represents the relationship between the areas in a tree structure.

  In this technique, the character code, vector data, image data, and the like are arranged in accordance with the same structure to convert the document into an electronic document page that can be edited by an application.

  The data obtained in this way has the same layout as the original document, and changes the position and size of characters and figures, as well as geometric deformation and coloring, just like an electronic document page newly created by a document creation application. The data can be easily performed.

  There is also a technique for recognizing the structure of a tabular area in a document image. For example, a technique for acquiring a matrix structure constituted by rectangular frame regions in a table is disclosed (for example, see Patent Document 2).

  By combining the line structure of the frame area obtained by this technique and the OCR result of the character in the frame by the above technique, it is possible to convert the table area in the document image into electronic data having a table structure.

JP 2004-265384 A JP-A-1-129358

  According to the above-described conventional technology, it is possible to divide into foreground images and background images indicating vector data and cut-out images (regions (objects) such as characters, line drawings, natural images, and tables).

  This background image is generated by erasing the pixel information of the area where the foreground image exists from the original image.

  6A and 6B are diagrams for explaining the background image, where FIG. 6A shows the original image and FIG. 6B shows the background image.

  In FIG. 6A, the line graphic portions, that is, the line graphic portion pixels of the character pixel block 601 to 603, the line drawing pixel block 608, and the table frame pixel block 604 are filled with the surrounding pixel colors in the background image of FIG. It is in the state.

  Further, regarding the natural image region 609, the entire rectangular range is filled with surrounding pixel colors.

  With respect to such a background image, a function of generating data without adding a background image is known in order to improve reusability for the user.

  If this function is enabled, data is not generated for a page in which no foreground image such as character data exists in the image, so the page (image) itself is not output.

  Therefore, there is a problem that the number of pages of the original and the number of pages of the generated data are different. If the number of pages is different and the number of originals is large, it is difficult to grasp which pages are missing.

  Also, if the person holding the manuscript is different from the person receiving the data document, the person who received the document does not know that the page is missing.

An object of the present invention is to provide a without can extract objects from a document image, no omission of the page corresponding to that image works.

In order to achieve the above object, an image processing apparatus according to claim 1 is a document reading unit that reads a document, an extraction unit that extracts an object from an image of a document read by the reading unit, and the extraction unit extracts the object. look including the object, and a generating means for generating a page image that does not include the rest which has not been extracted by the extraction means, said generating means also be able to extract an object by said extracting means, the image A page corresponding to is generated.

According to the present invention, even without can extract objects from a document image, it is possible to prevent the occurrence omission of the page corresponding to that image.

1 is a diagram illustrating an example of an image processing system including an MFP according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a schematic configuration of an MFP in FIG. 1. It is a flowchart which shows the procedure of the image generation process performed by CPU in FIG. It is a flowchart which shows the procedure of the modification of the image generation process performed by CPU in FIG. It is a figure which shows the notification image in FIG. It is a figure for demonstrating a background image, (A) shows the original image, (B) has shown the background image.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the present embodiment, an embodiment in which the image processing apparatus according to the present invention is applied to an MFP (Multi Function Peripheral) will be described.

  FIG. 1 is a diagram illustrating an example of an image processing system including an MFP 100 according to an embodiment of the present invention.

  In FIG. 1, the image processing system 1 includes an MFP 100, a proxy server 103, and a client PC 101, which are connected via a LAN 102.

  The MFP 100 is a multi-function machine that implements a plurality of types of functions related to image processing (for example, a copy function, a print function, a transmission function, etc.).

  For example, the client PC 101 can print a printed matter based on the print data by the MFP 100 by transmitting the print data to the MFP 100.

  The LAN 102 is connected to a network 104 that enables communication with the outside via a proxy server 103.

  This network 104 only needs to be able to transmit and receive data. Specific examples of the network 104 include the Internet, a LAN, a WAN, a telephone line, a dedicated digital line, an ATM, a frame relay line, a communication satellite line, a cable TV line, a data broadcasting wireless line, or a combination thereof. It is done.

  Each of the various terminals of the client PC 101 and the proxy server 103 has standard components mounted on a general-purpose computer. Specific examples of this component include a CPU, RAM, ROM, hard disk, external storage device, network interface, display, keyboard, and mouse.

  FIG. 2 is a diagram showing a schematic configuration of MFP 100 in FIG.

  2, the MFP 100 includes a CPU 117, a storage unit 111, a display unit 116, an operation unit 113, an image reading unit 110, a printing unit 112, a data processing unit 115, and a network interface 114.

  CPU 117 controls MFP 100 as a whole. The storage unit 111 includes a ROM, a RAM, an HDD, and the like. A program such as a boot program is stored in the ROM. In the RAM, images and programs are developed or used as a work area. The HDD stores programs, images, databases, and the like.

  The display unit 116 displays information to the user, such as an operation input status display and an image being processed. The operation unit 113 includes keys and buttons that are operated by the user. When the display unit 116 is provided with a touch panel, the touch panel also configures the operation unit 113.

  The data processing unit 115 performs data processing such as signal processing. The network interface 114 is an interface for connecting to the LAN 102.

  The image reading unit 110 includes an auto document feeder (ADF), irradiates a document with a light source, and forms a document reflection image on a solid-state image sensor with a lens. Then, the image reading unit 110 acquires a raster-like image reading signal from the solid-state imaging device as an image having a predetermined density (for example, 600 DPI).

  The printing unit 112 prints an image on a recording medium. For example, the printing unit 112 prints an image corresponding to the image reading signal on a recording medium. When copying one original image, the image reading signal obtained from the image reading unit 110 is image-processed by the data processing unit 115 to generate a recording signal, which is printed on the recording medium by the printing unit 112. .

  On the other hand, when copying a plurality of document images, a process of temporarily storing a recording signal for one page in the storage unit 111 and then outputting the recording signal to the printing unit 112 is sequentially repeated on the recording medium. To print the image.

  Further, when printing the print data output from the client PC 101 and received by the network interface 114, the printing unit 112 prints an image on a recording medium using the raster data processed by the data processing unit 115. .

  Further, the MFP 100 has a function of transmitting an image via the network interface 114.

  At the time of transmission, the image acquired by the image reading unit 110 is converted by the data processing unit 115 into an image file in a compressed image file format such as TIFF or JPEG or a vector data file format such as PDF and output from the network interface 114. To do.

  The output image is transmitted to the client PC 101 via the LAN 102, and further transferred to an external terminal (for example, another MFP or client PC) via the network 104.

  Although the MFP 100 is described as an example in the present embodiment, the present embodiment may be applied to a scanner device that can read a document.

  FIG. 3 is a flowchart showing a procedure of image generation processing executed by the CPU 117 in FIG. The CPU 117 performs the processing shown in the flowchart of FIG. 3 by reading and executing the program stored in the storage unit 111.

  In FIG. 3, the CPU 117 causes the image reading unit 110 to read one side of a document, and acquires one page image. Then, the CPU 117 extracts a foreground image from the acquired image by the data processing unit 115 (step S101). Taking FIG. 6 as an example, the foreground image shown in FIG. 6B is extracted. The acquired original image can be divided into a foreground image and a background image. The foreground image is vector data or an image to be cut out (an area (object) such as a character, line drawing, natural image, or table). The background image is an image generated by deleting pixel information of an area where the foreground image exists from the original image. 6A shows the original image, and FIG. 6B shows the background image after the foreground image is extracted from the original image.

  Next, the CPU 117 determines whether or not to add a background image to the generated image (step S102). Here, for example, whether or not a background image is added to the generated image is set by the user, and the CPU 117 determines whether or not to add a background image to the generated image according to the setting.

  If a background image is added as a result of the determination in step S102 (YES in step S102), the CPU 117 generates an image to which the foreground image and the background image are added (step S106), and ends this process.

  On the other hand, if no background image is added as a result of the determination in step S102 (NO in step S102), the CPU 117 determines whether there is an extracted foreground image (step S103).

  As a result of the determination in step S103, if there is an extracted foreground image (YES in step S103), the CPU 117 generates an image of only the foreground image (step S105), and ends this process.

  On the other hand, if the result of determination in step S103 is that there is no extracted foreground image (NO in step S103), the CPU 117 generates a blank image (an image indicating that the foreground image could not be extracted) (step S104). This process is terminated.

  The images generated in S104, S105, and S106 are each generated as one page image. When there are a plurality of documents or when a plurality of images are acquired, such as when both sides of the document are read, the CPU 117 repeats the above process for the number of reading sides of the document, and displays the foreground corresponding to each image. An image including or a blank image is generated. Here, the CPU 117 generates one document data (image data) in which images including foreground corresponding to each image or blank images are arranged in a predetermined order. The document data may be filed by the CPU 117 into an image file in a compressed image file format such as TIFF or JPEG or a vector data file format such as PDF.

  The predetermined order may be the order in which the acquired images are acquired. This order is the order of the pages of the document data.

  In addition, regarding the order in which the acquired images are acquired, for example, when a plurality of originals are read, images are acquired in accordance with the read order. This order is given as an example.

  3 is an instruction to execute an image generation process (foreground extraction process) from the operation unit 113 on the image read by the image reading unit 110 and stored in the storage unit 111 of the MFP 100. It may be done when accepted. At this time, the predetermined order described above may be the order in which the image including the foreground and the image indicating that the foreground image could not be extracted are generated by the generation unit. For example, when multiple pages of document data are stored in the storage unit 111 and execution of an image generation process (foreground extraction process) is instructed for the document data, the CPU 117 performs a diagram for the document data. 3 is executed. At that time, since the image generation processing is executed in the page order of the original document data, the page order of the newly generated document data indicates that the image including the foreground and the foreground image could not be extracted by the generation unit. The order in which the images are generated may be used.

  The image generation process of FIG. 3 is executed every time an image is acquired by the image reading unit 110 or for each page included in the original document data stored in the storage unit 111. When the foreground image is not extracted in this way, a blank page image is generated to prevent missing pages.

  Specifically, in step S104, if the foreground image is not extracted and the background image of the acquired image is not added to the image to be generated, a blank image indicating that the foreground image has not been extracted is generated. , It is possible to prevent missing pages. In steps S105 and S106, if a foreground image is extracted, an image including the foreground image is generated. The image including the foreground image is an image to which only the foreground image is added, or an image to which the foreground image and the background image are added. As described above, a blank image is generated even if there is an image without a foreground image. Therefore, even if an image without a foreground image exists, no page loss occurs.

  FIG. 4 is a flowchart showing the procedure of a modification of the image generation process executed by the CPU 117 in FIG.

  In FIG. 4, since the same number is used for the step which performs the same process as the step of FIG. 3, a different point from FIG. 3 is step S204.

  Therefore, if the result of determination in step S103 is that there is no extracted foreground image (NO in step S103), the CPU I 17 generates a notification image as an image indicating that the foreground image could not be extracted (step S204). This process ends.

  FIG. 5 is a diagram showing the notification image 600 in FIG.

  In FIG. 5, the notification image 600 displays a message “This page has no character data.” And notifies that the foreground image has not been extracted from the corresponding page of the original image data. Yes. This makes it possible to distinguish whether the original image was a blank image or only an image of the background.

  Further, the CPU 117 may generate the notification image 600 including the link 6001. The CPU 117 uses the page of only the background image from which the foreground image is extracted and the foreground image is removed as a page (reference image) that can be referred to only when the link 6001 is designated, and is the final page of the generated image. It is added afterwards. Thereby, when the link 6001 is designated, a page of only the background image is displayed.

  In the process of FIG. 4, when the foreground image is not extracted and the background image of the acquired image is not added to the generated image, the reference image includes the background image of the acquired image from which the foreground image is not extracted in addition to the notification image. An image is generated, and a link to a reference image is included in the notification image.

  The images generated in S204, S105, and S106 are each generated as one page image. In the processing shown in the flowchart of FIG. 4, when there are a plurality of originals or when a plurality of images are acquired as in the case of reading both sides of the original, the CPU 117 performs the above-described processing for the number of original reading surfaces. repeat. Then, the CPU 117 generates an image including a foreground corresponding to each image or a blank paper image. Here, the CPU 117 generates one document data in which an image including a foreground corresponding to each image or a blank image is arranged in the above-described predetermined order. The document data may be filed by the CPU 117 into an image file in a compressed image file format such as TIFF or JPEG or a vector data file format such as PDF.

  In addition, the document data generated by the method described in the above embodiment is stored in the storage unit 111 by the CPU 117. This document data may be printed in response to receiving an instruction from the operation unit 113 or the external client PC 101, or may be transmitted to an external apparatus via the network 104. When the generated document data is printed, the CPU 117 may control to print an image other than the reference image included in the generated image data and not to print the reference image. May also be printed. Further, whether or not to print the reference image may be set by the user from the operation unit 113 or the external client PC 101. In addition, when the generated document data is transmitted to an external device, the CPU 117 may control to transmit an image other than the reference image included in the generated image data and not transmit the reference image. A reference image may also be transmitted. Further, whether or not to transmit the reference image may be set by the user from the operation unit 113 or the external client PC 101.

(Other embodiments)
The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program code. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

100 MFP
110 Image reading unit 115 Data processing unit 117 CPU

Claims (8)

Reading means for reading a document;
Extraction means for extracting an object from an image of a document read by the reading means;
See contains the objects extracted by the extraction means, and a generating means for generating a page image that does not include the rest which has not been extracted by the extraction means,
The image processing apparatus according to claim 1, wherein the generation unit generates a page corresponding to the image even if the extraction unit cannot extract the object. The reading unit reads a plurality of documents,
The extraction means extracts an object from each image of the plurality of documents,
The generation unit generates a page image including the object extracted by the extraction unit for each image of the plurality of documents.
The image processing apparatus according to claim 1, wherein even if an object cannot be extracted by the extraction unit, a page corresponding to an image in which the object cannot be extracted is generated.   The image processing apparatus according to claim 2, further comprising a file generation unit configured to generate a plurality of page images generated by the generation unit and a file including pages. The image processing apparatus according to any one of claims 1 to 3, characterized in that the image of the page is blank image. The image processing apparatus according to any one of claims 1 to 4, further comprising a transmitting means for transmitting the document data including the page image and the page has been generated by the generating means. The image processing apparatus according to any one of claims 1 to 4, further comprising a printing means for performing printing based on the document data including the page image and the page has been generated by the generating means. A method for controlling an image processing apparatus having reading means for reading a document,
An extraction step of extracting an object from an image of a document read by the reading unit;
The viewing including the extracted object in the extraction step, and a generating step of generating a page image that does not include the rest which has not been extracted by the extraction step,
In the generation step, a page corresponding to the image is generated even if an object cannot be extracted in the extraction step. A program for causing a computer to execute the control method for an image processing apparatus according to claim 7 .