JP2007082021A - Image processing apparatus, program, and image data processing method - Google Patents

Abstract

To simplify processing area designation for processing of image data displayed on a display device.
Image data is analyzed according to a specified extraction level to extract constituent elements (S104), the extracted constituent elements are superimposed on the image data and displayed on a display device (S105), and superimposed on the image data. When the displayed component is designated by the pointing member via the information input device (Yes in S108), the process associated with the designated component is executed on the image data related to the component (S109). Thereby, a component of a desired level is designated in advance, and when executing processing for image data displayed on the display device on the information input device, the component may be designated. Therefore, it is possible to simplify the process area designation for the process for the image data.
[Selection] Figure 6

Description

  The present invention relates to an image processing apparatus, a program, and an image data processing method.

  Conventionally, an image processing apparatus such as a scanner for reading an original image, a copying machine for printing an original image read by the scanner, a printer or a facsimile apparatus for printing image data input from the outside, or a multifunction machine having these functions Is used.

  In recent years, in this type of image processing apparatus, it is possible to freely select an image area from various image areas in a document image, and to specify adjustment contents of image characteristics for each selected image area The thing which made it possible to do is proposed (for example, refer patent document 1).

  It is also possible to display the original image read by the scanner on the display unit of the operation panel of the image processing apparatus, and to perform editing operations such as area deletion, area movement, and area inversion on the image area in the displayed original image. It has been.

JP 2002-112022 A

  By the way, in the above-described image processing (density / color adjustment, etc.) and editing work (area deletion, area movement, area inversion, etc.), a display unit is wide like a PC (Personal Computer), and a large amount of information is stored. When there is a pointing device that can be finely designated like a mouse as a pointing device, the area can be designated easily.

  However, like an operation panel of an image processing apparatus such as a multi-function device, the display unit is narrow and cannot display so much information, and a device on which a detailed position specification is difficult to specify with a finger on the touch panel on the display unit, There is a problem that it is difficult to specify an area.

  The present invention has been made in view of the above, and an object of the present invention is to simplify the designation of a processing area for processing on image data displayed on a display device.

  In order to solve the above-described problems and achieve the object, an image processing apparatus according to a first aspect of the present invention provides the display according to an operation by an instruction member for an information input device disposed in a display device that displays image data. In an image processing apparatus that performs processing on the image data displayed on the apparatus, an extraction level designating unit that designates an extraction level for a component constituting the image data, and an extraction level designated by the extraction level designating unit A component extracting unit that analyzes the image data and extracts the component, and a component that displays the component extracted by the component extracting unit on the display device so as to overlap the image data Display means, and the constituent element displayed on the display device by the constituent element display means so as to overlap the image data. If specified by the pointing member through a device provided with a associated with the specified the component processing, a process execution means for executing on the image data relating to the component, the.

  According to a second aspect of the present invention, in the image processing apparatus according to the first aspect, the constituent element display means displays a frame indicating the constituent element in a superimposed manner on the image data.

  According to a third aspect of the present invention, in the image processing apparatus according to the first aspect, the component display means changes the color in the component and displays the image data in a superimposed manner.

  According to a fourth aspect of the present invention, in the image processing apparatus according to any one of the first to third aspects, when there are a plurality of processes associated with the component, the component is associated with the component. A list of processes is displayed on the display device, and a process associated with the desired component is selected by an instruction from the instruction member via the information input apparatus.

  According to a fifth aspect of the present invention, in the image processing apparatus according to the fourth aspect, the processes associated with the constituent elements are displayed as a list on the display device in a balloon display.

  According to a sixth aspect of the present invention, in the image processing device according to any one of the first to fifth aspects, the extraction level designating unit configures the image data based on a display size in the display device. Specifies the extraction level for the element.

  According to a seventh aspect of the present invention, in the image processing apparatus according to any one of the first to fifth aspects, the extraction level designating unit extracts the constituent elements constituting the image data according to an editing function. Specify the level.

  According to an eighth aspect of the present invention, there is provided a program for performing processing on the image data displayed on the display device in response to an operation by an instruction member for an information input device disposed on the display device for displaying the image data. A program to be executed, an extraction level designating function for designating an extraction level for a component constituting the image data, and analyzing the image data according to the extraction level designated by the extraction level designating function, A component extraction function for extracting a component, a component display function for displaying the component extracted by the component extraction function on the display device so as to overlap the image data, and the component display function The component displayed on the display device so as to overlap the image data is transmitted through the information input device. If specified by the wood, it was associated with the specified the component processing to execute a process execution function to be executed for the image data relating to the components, to the computer.

  According to a ninth aspect of the present invention, in the program according to the eighth aspect, the component display function displays a frame indicating the component superimposed on the image data.

  According to a tenth aspect of the present invention, in the program according to the eighth aspect, the component display function changes the color in the component and displays the image data in a superimposed manner.

  Further, in the invention according to claim 11, in the program according to any one of claims 8 to 10, when there are a plurality of processes associated with the component, the process associated with the component is performed. A list is displayed on the display device, and a process associated with the desired component is selected by an instruction from the instruction member via the information input device.

  According to a twelfth aspect of the present invention, in the program according to the eleventh aspect, the process associated with the component is displayed as a list on the display device in a balloon display.

  According to a thirteenth aspect of the present invention, in the program according to any one of the eighth to twelfth aspects, the extraction level designating function is for the constituent elements constituting the image data based on a display size in the display device. Specify the extraction level.

  According to a fourteenth aspect of the present invention, in the program according to any one of the eighth to twelfth aspects, the extraction level designation function sets an extraction level for the constituent elements constituting the image data in accordance with an editing function. specify.

  According to a fifteenth aspect of the present invention, there is provided an image data processing method for processing the image data displayed on the display device in response to an operation by an instruction member for an information input device disposed on the display device for displaying the image data. An image data processing method in an image processing apparatus for performing an extraction level designating process for designating an extraction level for a component constituting the image data, and according to the extraction level designated by the extraction level designating process A component extraction step of analyzing the image data to extract the component, and a component display step of displaying the component extracted by the component extraction step on the display device so as to overlap the image data; The component displayed on the display device in an overlapping manner with the image data by the component display step is the information input device. If specified by the pointing member through, including associated with the specified the component processing, a processing execution step to be executed for the image data relating to the component, the.

  According to a sixteenth aspect of the present invention, in the image data processing method according to the fifteenth aspect, the component element display step displays a frame indicating the component element so as to overlap the image data.

  According to a seventeenth aspect of the present invention, in the image data processing method according to the fifteenth aspect, the component display step changes the color in the component and superimposes it on the image data.

  In the image data processing method according to any one of claims 15 to 17, when there are a plurality of processes associated with the component, the invention according to claim 18 is associated with the component. The processing is displayed as a list on the display device, and the processing associated with the desired component is selected by an instruction from the instruction member via the information input device.

  According to a nineteenth aspect of the present invention, in the image data processing method according to the eighteenth aspect, the processes associated with the constituent elements are displayed as a list on the display device in a balloon display.

  The invention according to claim 20 is the image data processing method according to any one of claims 15 to 19, wherein the extraction level designation step configures the image data based on a display size in the display device. Specify the extraction level for the component.

  The invention according to claim 21 is the image data processing method according to any one of claims 15 to 19, wherein the extraction level designating step is performed on the constituent elements constituting the image data according to an editing function. Specify the extraction level.

  According to the first aspect of the present invention, image data is analyzed in accordance with a specified extraction level to extract a component, the extracted component is superimposed on the image data and displayed on the display device, and is superimposed on the image data. When the component displayed in this manner is designated by the pointing member via the information input device, the process associated with the designated component is executed on the image data related to the component in advance. When a component of a desired level is specified and processing is performed on image data displayed on the display device on the information input device, the component may be specified. There is an effect that it is possible to simplify the designation of the processing area for the processing for the above.

  In addition, according to the second aspect of the present invention, there is an effect that it is possible to intuitively specify a region by displaying a frame indicating a constituent element superimposed on the image data.

  Further, according to the invention of claim 3, there is an effect that the area can be specified intuitively by changing the color in the component and displaying it by superimposing it on the image data.

  According to the invention of claim 4, when there are a plurality of processes associated with the component, the process associated with the component is displayed in a list on the display device, and an instruction is sent via the information input device. By selecting a process associated with a desired component by an instruction from a member, there is an effect that the desired process can be executed on the image data relating to the desired component.

  According to the invention of claim 5, the process associated with the constituent element is displayed in a list on the display device in a balloon display, so that the process can be easily selected. .

  According to the sixth aspect of the present invention, by specifying the extraction level for the constituent elements constituting the image data based on the display size in the display device, it is possible to further simplify the processing area designation for the processing for the image data. There is an effect that can be achieved.

  According to the seventh aspect of the present invention, it is possible to further simplify the process area designation for the processing on the image data by designating the extraction level for the constituent elements constituting the image data in accordance with the editing function. There is an effect that can be.

  According to the invention of claim 8, the image data is analyzed according to the designated extraction level to extract the constituent elements, and the extracted constituent elements are displayed on the display device so as to overlap the image data. When the component displayed in a superimposed manner is designated by the instruction member via the information input device, the processing associated with the designated component is executed on the image data related to the component Since a component of a desired level is designated in advance and processing is performed on image data displayed on the display device on the information input device, the component may be designated. There is an effect that it is possible to simplify the designation of a processing area for processing on image data.

  In addition, according to the ninth aspect of the invention, there is an effect that it is possible to intuitively specify a region by displaying a frame indicating a constituent element so as to be superimposed on the image data.

  According to the tenth aspect of the present invention, there is an effect that it is possible to intuitively specify a region by changing the color in the component and displaying the image superimposed on the image data.

  According to the invention of claim 11, when there are a plurality of processes associated with the constituent element, the processes associated with the constituent element are displayed in a list on the display device, and an instruction via the information input device is provided. By selecting a process associated with a desired component by an instruction from a member, there is an effect that the desired process can be executed on the image data relating to the desired component.

  According to the twelfth aspect of the present invention, the processes associated with the constituent elements are displayed as a list on the display device in a balloon display, thereby providing an effect that the process can be easily selected. .

  According to the thirteenth aspect of the present invention, by specifying the extraction level for the components constituting the image data on the basis of the display size in the display device, it is possible to further simplify the processing area designation for the processing on the image data. There is an effect that can be achieved.

  According to the fourteenth aspect of the present invention, it is possible to further simplify the designation of the processing area for the processing on the image data by designating the extraction level for the components constituting the image data in accordance with the editing function. There is an effect that can be.

  According to the fifteenth aspect of the present invention, the image data is analyzed according to the specified extraction level to extract the component, and the extracted component is superimposed on the image data and displayed on the display device. When the component displayed in a superimposed manner is designated by the instruction member via the information input device, the processing associated with the designated component is executed on the image data related to the component Since a component of a desired level is designated in advance and processing is performed on image data displayed on the display device on the information input device, the component may be designated. There is an effect that it is possible to simplify the designation of a processing area for processing on image data.

  According to the sixteenth aspect of the present invention, there is an effect that it is possible to intuitively specify a region by displaying a frame indicating a constituent element so as to be superimposed on the image data.

  According to the seventeenth aspect of the present invention, there is an effect that it is possible to intuitively specify a region by changing the color in the component and displaying it superimposed on the image data.

  According to the invention of claim 18, when there are a plurality of processes associated with a component, the processes associated with the component are displayed in a list on the display device, and an instruction is sent via the information input device. By selecting a process associated with a desired component by an instruction from a member, there is an effect that the desired process can be executed on the image data relating to the desired component.

  According to the nineteenth aspect of the invention, the process associated with the component is displayed as a list on the display device in a balloon display, so that the process can be easily selected. .

  According to the twentieth aspect of the present invention, by specifying the extraction level for the constituent elements constituting the image data based on the display size in the display device, it is possible to further simplify the processing area designation for the processing on the image data. There is an effect that can be achieved.

  According to the twenty-first aspect of the present invention, it is possible to further simplify the designation of the processing area for the processing on the image data by designating the extraction level for the constituent elements constituting the image data in accordance with the editing function. There is an effect that can be.

  Exemplary embodiments of an image processing apparatus, a program, and an image data processing method according to the present invention will be explained below in detail with reference to the accompanying drawings.

[First Embodiment]
A first embodiment of the present invention will be described with reference to FIGS. In this embodiment, as an image processing apparatus, a copy function, a facsimile (FAX) function, a print function, a scanner function, an input image (a document image read by a scanner function, an image input by a printer or a FAX function), etc. This is an example to which a so-called MFP (Multi Function Peripheral) that combines the above is applied.

  FIG. 1 is a functional block diagram of a multifunction machine 10 according to the first embodiment of the present invention. 1 includes a scanner 11, an ADF (Auto Document Feeder) 111, a scanner controller 112, an image storage unit 12, an image processing unit 13, a printer 14, a printer controller 142, a finishing processing unit 141, an information input unit. An operation display unit 15, an operation display control unit 151, a system control unit 16, and a communication control unit 17 that are output devices are provided. The multifunction machine 10 is connected to the network 18 via the communication control unit 17. Then, the multifunction machine 10 reads the image of the document 19 and performs image processing, and then outputs it as a printed matter 20. Further, the multifunction machine 10 includes an image analysis unit 21 and a specific area extraction unit 22.

  The system control unit 16 is connected to each component unit and controls the entire multifunction machine 10. The system control unit 16 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like (not shown), and the CPU is based on a program stored in the ROM. Various processes are executed by operating while using the work area.

  The program executed in the multifunction machine 10 is an installable or executable file and can be read by a computer such as a CD-ROM, a flexible disk (FD), a CD-R, or a DVD (digital Versatile Disk). The program may be recorded on a recording medium. In this case, the CPU of the system control unit 16 reads the program from the storage medium and loads it on a main storage device (not shown), thereby causing the multifunction peripheral 10 to realize various functions. Further, the program may be provided by being stored on a computer connected to the network 18 such as the Internet and downloaded via the network. Alternatively, the program may be provided or distributed via a network such as the Internet.

  The communication control unit 17 is connected to a network 18 such as a LAN (local area network) or the Internet, and exchanges image data, control data, and the like with other devices connected to the network according to a communication protocol. It is.

  The scanner controller 112 receives a command from the system control unit 16 and controls the scanner 11.

  The scanner 11 is controlled by the scanner controller 112 and converts the image of the document 19 into digital image data. The ADF 111 can sequentially feed a set of multiple pages of documents to the reading position of the scanner 11 one by one. By using this ADF 111, the scanner 11 automatically and continuously prints multiple pages of documents. Can read. In addition, since the ADF 111 can invert not only a single-sided original printed on one side of a sheet but also a double-sided original printed on both sides and send it to the scanner 11, the scanner 11 can read a double-sided original. is there.

  The image storage unit 12 is a buffer memory that temporarily stores image data read by the scanner 11 in response to an instruction from the system control unit 16, image data input from the outside via the network 18, and the like. The multifunction machine 10 of this embodiment can form an image by processing both image data read from the scanner 11 provided therein and image data input from the outside via the network 18 or the like.

  The image processing unit 13 receives a command from the system control unit 16 on the multi-value data sent from the scanner 11 and temporarily stored in the image storage unit 12 and performs γ correction, MTF correction processing, and the like. Then, gradation processing such as slice processing or dither processing is performed to perform binarization (or multi-value processing). The image processing unit 13 also performs various image processing (enlargement / reduction, density / color adjustment, etc.) corresponding to the function set by the user, image area editing processing (area deletion, area movement, area inversion, etc.) and layout. Processing (double-sided / single-sided printing, aggregate printing, margin size adjustment, etc.) is performed.

  The image processing unit 13 includes a coordinate information acquisition unit 131 and a screen information generation unit 132. The coordinate information acquisition unit 131 acquires coordinate information related to the input image stored in the image storage unit 12. The screen information generation unit 132 generates predicted finished image information, which is a predicted finished image displayed on the display panel 15b described later, according to the input image data. Here, the information generated by the screen information generation unit 132 is referred to as a predicted finished image information. As will be described below, information for an input screen for a predicted finished image to be printed and a processing item related to the predicted finished image is used. Since they are generated, the two are collectively referred to as predicted finished image information.

  The printer controller 142 receives a command from the system control unit 16 and controls the printer 14.

  The printer 14 is controlled by the printer controller 142, deflects and scans the light beam based on the image data processed by the image processing unit 13, develops the electrostatic latent image formed on the photoreceptor using toner, and generates it. This is a printer using an electrophotographic technique in which a toner image is transferred onto a transfer sheet and a fixing process is performed. In addition to the electrophotographic method, various methods such as an inkjet method, a sublimation type thermal transfer method, a silver salt photography method, a direct thermal recording method, and a fusion type thermal transfer method can be used as the printing method of the printer 14.

  The printer 14 includes a finishing processing unit 141. The finishing processing unit 141 accepts automatic setting or setting by the user, sort processing for sorting the printed matter 20 that has been subjected to printing processing by the number of copies or page units, stapling processing for aligning a plurality of print media and binding them with staples, Alternatively, finishing processing such as punching processing for punching holes for binding a plurality of print media into a binder or file is performed.

  The operation display control unit 151 receives input from the system control unit 16 and controls input / output of the operation display unit 15. For example, the operation display control unit 151 controls the output of the data processed by the image processing unit 13 to the touch panel 15a that is an information input device provided in the operation display unit 15 and the display panel 15b that is a display device. More specifically, the operation display control unit 151 displays a predicted finished image on the display panel 15b according to the generated predicted finished image information. Further, the operation display control unit 151 performs input control from the touch panel 15a.

  The operation display unit 15 is controlled by the operation display control unit 151, receives input of setting content via the touch panel 15a, and displays a menu item of setting content for setting a predicted finished image and screen finishing on the display panel 15b.

  The operation display unit 15 displays functions to be executed by the multifunction machine 10 as menu items on the setting screen, and accepts setting input by the user from the displayed menu items. For example, the operation display unit 15 sets a reading condition in the scanner 11 according to the state of the document, a setting in the image processing unit 13 that processes the read image data, a setting of a printing condition in the printer 14, or a printed matter after printing. The finishing processing unit 141 that performs finishing processing such as sorting, stapling, and punching is received.

  Although the display panel 15b and the touch panel 15a are illustrated separately in the drawing, they are integrally configured here. When the display panel 15b is touched by an operator's finger, stylus pen, or the like (hereinafter referred to as a pointer) that is an instruction member, the touch panel 15a simultaneously receives a touch input. Touch input is accepted by contact with an operator's finger or stylus pen. Here, the touch panel 15a detects a position where the pointer contacts the panel electrically or magnetically. The display panel 15b may be a dedicated display device provided in the multifunction machine 10.

  FIG. 2 is a schematic diagram illustrating an example of a predicted finished image generated by inputting image data by the multifunction machine 10. A finished image 402 is displayed in the display area 401 of the touch panel 15a.

  Here, as shown in FIG. 2, it is assumed that the operator uses the pointer to touch the position 403. When the operator touches with a pointer while looking at the predicted finished image displayed on the display panel 15b, the touch panel 15a inputs position information which is a spatial position in the finished state of the printed matter on the displayed predicted finished image. Accept. In such a case, the coordinate information acquisition unit 131 analyzes the position information received by the touch panel 15a, and acquires the coordinate information on the image touched by the pointer.

  The image analysis unit 21 performs OCR (Optical Character Recognition) processing that performs optical character recognition on the image data stored in the image storage unit 12, and displays various image attributes of the document image. An image characteristic value is calculated. The image characteristic values can be broadly divided into three types: image relationship, layout relationship, and ADF (automatic document conveyance) relationship. For example, in the image relationship, the image type (character area, photographic area, illustration, or a mixture thereof), the color used (color information used in the document, monochrome / color distinction), document density, edge amount, pixel The density (area ratio of the pixel portion in the entire document), the character size used, etc. are quantified.

  For example, the method proposed in Japanese Patent Laid-Open Nos. 5-233873, 6-4704, and the like can be used for determining the image type. As a method for extracting non-character elements (ruled lines, photographs, drawings, etc.) that are non-character parts, a known technique described in, for example, Japanese Patent Laid-Open No. 6-20092 can be used. Schematically, the black pixel connected component is classified and discriminated into character candidates, vertical / horizontal separators (region dividing lines made up of original black pixels), photographs, drawings, and the like according to their sizes, shapes (aspect ratio, etc.). As a method for extracting the frame of the table, for example, a known technique described in JP-A-2001-266068 can be used. Schematically, circumscribed rectangles are extracted from the connected components of black pixels, and the extracted circumscribed rectangles are classified as character candidate rectangles or frame candidate rectangles. Then, for the rectangle classified as the character candidate, the position of the rectangle is filled with white on the original image, the rectangular frame remaining as the frame candidate is extracted, and the table frame line is extracted from the extracted frame.

  In addition, the layout relationship is a numerical value of the document direction (positional relationship information on the top, bottom, left, and right of the document), document size, top, bottom, left and right margin dimensions, layout information (whether it is a columnar document) or the like. Further, in the ADF relation, the number of pages of a document, the document surface (a distinction between double-sided documents / single-sided documents), and the like are quantified. Of these characteristic values, as for quantitative values, statistical values such as an average value, a maximum value, and a minimum value can also be calculated and used.

  The specific area extraction unit 22 extracts various specific areas based on various image characteristic values calculated by the image analysis unit 21. The specific area, which is a constituent element of the image data extracted by the specific area extracting unit 22, is displayed on the display panel 15b together with the predicted finished image and presented to the operator. As shown in FIG. 3, the operator is presented with a frame indicating the specific area superimposed on the predicted finished image as shown in FIG. 3, or displayed on the predicted finished image by changing the color in the specific area. Is done. Thereby, area specification can be performed intuitively. More specifically, the character area is displayed with a different color such as a red frame, and the photograph area is displayed with a green frame, or a different specific area is displayed by changing the RGB value of the image in the specific area. The specific area may be displayed before the operator selects the specific area using the specific area extracting unit 22, and when the user designates coordinates on the predicted finished image, the specific area corresponding to the coordinates is displayed. May be extracted and displayed by the specific area extraction unit 22.

  By the way, in the present embodiment, the specific area is divided into levels, and the specific area extraction unit 22 extracts the specific area according to the designated level (extraction level). In other words, the operation display unit 15 receives a level specification at the time of extraction of the specific region by the specific region extraction unit 22, and the specified extraction level is determined by the specific region extraction unit via the operation display control unit 151 and the system control unit 16. 22 is output.

  Here, an example of extracting a specific area corresponding to the specified level will be described. For example, when “level 1” is designated, a character area and a photograph area are extracted as shown in FIG. On the other hand, when “level 2” is designated, as shown in FIG. 5, the paragraph area and the photographic area in the character area are respectively extracted. The paragraph area in the character area can be distinguished by a punctuation mark “.”, For example. In addition to the exemplified areas, extraction of various areas such as words, characters, pictures, tables, and partition lines can be set as appropriate. In this way, the area changes depending on how the components are separated.

  Next, an image forming process realized by the CPU of the system control unit 16 operating based on a program stored in the ROM will be described.

  FIG. 6 is a flowchart showing a flow of image forming processing according to the present embodiment. As shown in FIG. 6, in the image forming process, the input image data is stored in the image storage unit 12 (step S101), and the predicted image information (image data) to be displayed on the display panel 15b is stored in the screen information generation unit 132. The generated predicted image based on the predicted image information is displayed on the display panel 15b (step S103), and the specific area is extracted by the specific area extracting unit 22 (step S104). It is displayed on the display panel 15b together with the predicted finished image (step S105). Here, the functions of the component extraction means and the component display means are executed.

  Here, as the specific area extracted in step S104, a specific area corresponding to the level designation already accepted in the operation display unit 15 is designated. For example, a case where the character color of the predicted finished image displayed on the display panel 15b is changed will be described. When the document is a document image, one of the specific areas representing various image attributes such as “character”, “word”, “character line”, “paragraph area”, and “character area” is designated. Specified according to the specified level.

  Here, when it is determined that the print command is received by pressing the execution button on the touch panel 15a when the operator determines to execute printing (Yes in step S106), the printer 14 executes printing. The finishing processing unit 141 is subjected to finishing processing (step S110).

  On the other hand, when it is not determined that the print command has been received (No in step S106), when the operator touches the touch panel 15a to make a contact input and the coordinate information acquisition unit 131 acquires the coordinate information (Yes in step S107). It is determined whether or not the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (step S108).

  If the acquired coordinate information is not the specific area displayed on the display panel 15b together with the predicted finished image (No in step S108), the process returns to step S106.

  On the other hand, when the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (Yes in step S108), a process associated with the specific area is executed (step S109: process execution). Means), the process returns to step S106. The process associated with the specific area is, for example, a process of changing the character color of the predicted finished image, a process of deleting the specific area, enlargement / reduction, or the like.

  If there are a plurality of processes associated with the specific area, as shown in FIG. 7, a balloon display X displaying a list of processes associated with the specific area is displayed on the display panel 15b, and the operator What is necessary is just to make it select the process matched with the desired specific area | region. Thereby, a desired process can be executed on the image data relating to the desired component. In addition, the processes associated with the constituent elements can be easily selected by being displayed as a list on the display panel 15b in a balloon display.

  Thereafter, when it is determined that the print command is received by pressing the execution button on the touch panel 15a when the operator determines to execute printing (Yes in step S106), the printer 14 executes the printing and finishes. A finishing process is performed on the processing unit 141 (step S110).

  As described above, according to the present embodiment, the image data is analyzed according to the designated extraction level to extract the constituent elements, and the extracted constituent elements are displayed on the display panel 15b so as to overlap the image data. When the component displayed in an overlapping manner is designated by the pointer via the touch panel 15a, by executing the processing associated with the designated component on the image data related to the component, When a component of a desired level is designated and processing is performed on the image data displayed on the display panel 15b on the touch panel 15a, the component may be designated. Therefore, it is possible to simplify the process area designation for the process for.

[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to FIGS. The same parts as those in the first embodiment described above are denoted by the same reference numerals, and description thereof is also omitted.

  In the present embodiment, the designation of the specific area (that is, the designation of the level) extracted by the specific area extraction unit 22 is switched according to the display size on the display panel 15b.

  FIG. 8 is a flowchart showing a flow of image forming processing according to the present embodiment. As shown in FIG. 8, the image forming process stores the input image data in the image storage unit 12 (step S201), and causes the screen information generation unit 132 to generate predicted image information to be displayed on the display panel 15b (step S201). (S202) The final predicted image based on the predicted image information is displayed on the display panel 15b (step S203), and the specific area extraction unit 22 specifies the specific area to be extracted based on the display size on the display panel 15b (that is, the level After specifying (step S204), the specific area extraction unit 22 extracts the specific area (step S205), and the extracted specific area is displayed on the display panel 15b together with the predicted finished image (step S206). Here, the functions of the component extraction means and the component display means are executed.

  Here, a method for specifying a specific area (that is, specifying a level) to be extracted by the specific area extracting unit 22 in step S204 will be described. In the present embodiment, the correspondence between the display size and the specific area displayed at that time is determined according to a table T1 as shown in FIG. According to the table T1, when the display size is 100%, “paragraph”, “table”, “picture”, “photo”, “partition line” are designated as specific areas, and when the display size is 125%. Only "text" is specified as the specific area, only "word" is specified as the specific area when the display size is 150%, and only "character" is specified as the specific area when the display size is 175% Has been. That is, according to the table T1 as shown in FIG. 9, as the display size is enlarged, a finer region is designated as the specific region. At the start of operation, 100% is set as the initial display size.

  Here, when the operator determines that the extracted specific area and the predicted finished image on the display panel 15b are small, numerical input from a scaling button or a numeric keypad (both not shown) prepared on the screen Therefore, if it is determined that the scaling command has been received (Yes in step S207), the magnification is determined according to the input (step S208), and the predicted image information to be displayed on the display panel 15b with the magnification is displayed in the screen information generation unit 132. Generate (step S202).

  If the operator determines that printing is to be executed and presses the execution button on the touch panel 15a to determine that a print command has been received (Yes in step S209), the printer 14 executes printing and finishes. The processing unit 141 is subjected to a finishing process (step S213).

  On the other hand, when it is not determined that the print command has been received (No in step S209), when the operator touches the touch panel 15a to perform contact input and the coordinate information acquisition unit 131 acquires the coordinate information (Yes in step S210). It is determined whether or not the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (step S211).

  When the acquired coordinate information is not the specific area displayed on the display panel 15b together with the predicted finished image (No in step S211), the process returns to step S207.

  On the other hand, if the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (Yes in step S211), a process associated with the specific area is executed (step S212: process execution). Means), the process returns to step S207. The process associated with the specific area is, for example, a process of changing the character color of the predicted finished image, a process of deleting the specific area, enlargement / reduction, or the like.

  Thereafter, when it is determined that the print command is received by pressing the execution button on the touch panel 15a when the operator determines to execute printing (Yes in step S209), the printer 14 executes printing and finishes. The processing unit 141 is subjected to a finishing process (step S213).

  As described above, according to the present embodiment, by specifying the extraction level for the constituent elements constituting the image data based on the display size on the display panel 15b, it is possible to further simplify the processing area designation for the processing on the image data. Can be achieved.

[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to FIGS. In addition, the same part as 1st Embodiment mentioned above or 2nd Embodiment is shown with the same code | symbol, and description is also abbreviate | omitted.

  In the present embodiment, designation of a specific area (that is, designation of a level) extracted by the specific area extraction unit 22 is switched according to an editing function (for example, area deletion, area movement, area inversion, etc.). It is.

  FIG. 10 is a flowchart showing a flow of image forming processing according to the present embodiment. As shown in FIG. 10, in the image forming process, input image data is stored in the image storage unit 12 (step S301), and then a magnification is determined (step S302).

  Here, the magnification determination method in step S302 will be described. In the present embodiment, the magnification (display size) is determined according to the editing function corresponding to the specific area extracted by the specific area extraction unit 22. Specifically, the correspondence between the editing function (for example, deletion of a specific area) and the display size at that time is determined according to a table T2 as shown in FIG. According to the table T1, when “deletion of paragraph”, “deletion of table”, “deletion of picture”, “deletion of photo”, “deletion of dividing line” is designated, 100% is designated as the display size, and “text” When "Delete" is specified, 125% is specified as the display size, when "Delete word" is specified, 150% is specified as the display size, and "Delete character" is specified 175% is designated as the display size. That is, according to the table T2 as shown in FIG. 11, the display size is increased as the specific area as the target of the editing function (for example, deletion of the specific area) is specified. . At the start of the operation, “paragraph” is set in the specific area targeted for the editing function (for example, deletion of the specific area). By searching the table T1 as shown in FIG. 9 based on this magnification, it is possible to specify the extraction level for a specific area (component) constituting the image data.

  Thereafter, the screen information generation unit 132 generates predicted image information to be displayed on the display panel 15b at the magnification determined in step S302 (step S303), and displays a predicted finished image based on the predicted image information on the display panel 15b (step S303). S304) After specifying the specific area to be extracted by the specific area extraction unit 22 based on the editing function (step S305), the specific area extraction unit 22 extracts the specific area (step S306), and the extracted specific area Is displayed on the display panel 15b together with the predicted finished image (step S307). Here, the functions of the component extraction means and the component display means are executed.

  Here, when it is determined that the operator wants to change the editing function, when it is determined that a function change command has been received by inputting a function change button (not shown) prepared on the screen (step S308). Yes), the magnification is determined according to the input (step S302), and the screen information generation unit 132 is caused to generate the predicted image information to be displayed on the display panel 15b with the magnification (step S303).

  If it is determined that the print command has been received by pressing the execution button on the touch panel 15a when the operator determines that the print is to be executed (Yes in step S309), the printer 14 executes the print and finishes the process. A finishing process is performed on the processing unit 141 (step S313).

  On the other hand, when it is not determined that the print command has been received (No in step S309), when the operator touches the touch panel 15a to make a contact input and the coordinate information acquisition unit 131 acquires the coordinate information (Yes in step S310). ), It is determined whether or not the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (step S311).

  If the acquired coordinate information is not the specific area displayed on the display panel 15b together with the predicted finished image (No in step S311), the process returns to step S308.

  On the other hand, when the acquired coordinate information is a specific area displayed on the display panel 15b together with the predicted finished image (Yes in step S311), a process associated with the specific area is executed (step S312: process execution). Means), the process returns to step S207. The process associated with the specific area is, for example, a process of changing the character color of the predicted finished image, a process of deleting the specific area, enlargement / reduction, or the like.

  Thereafter, when it is determined that the print command is received by pressing the execution button of the touch panel 15a when the operator determines to execute printing (Yes in step S309), the printer 14 executes printing and finishes. A finishing process is performed on the processing unit 141 (step S313).

  As described above, according to the present embodiment, by specifying the extraction level for the components constituting the image data in accordance with the editing function (for example, deletion of the specific area), the processing for the processing on the image data is further performed. It is possible to simplify the area designation.

1 is a functional block diagram of a multifunction machine according to a first embodiment of the present invention. FIG. 6 is a schematic diagram illustrating an example of a predicted finished image generated by inputting image data by a multifunction machine. It is a schematic diagram which shows an example which displayed the frame which shows a specific area on the predicted finishing image. It is a schematic diagram which shows an example from which the character area | region and the photography area | region were each extracted. It is a schematic diagram which shows an example from which the paragraph area | region and the photography area | region were each extracted. 6 is a flowchart illustrating a flow of image forming processing. It is a schematic diagram which shows the balloon display which displayed as a list the process matched with the specific area | region. 10 is a flowchart showing a flow of image forming processing according to the second embodiment of the present invention. It is a schematic diagram which shows the table which matches display size and the specific area | region displayed at that time. 10 is a flowchart showing a flow of image forming processing according to a third embodiment of the present invention. It is a schematic diagram which shows the table which matches an edit function and the display size at that time.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image processing apparatus 15 Information input / output apparatus 15a Information input apparatus 15b Display apparatus

Claims (21)

In an image processing apparatus that performs processing on the image data displayed on the display device in response to an operation by an instruction member on an information input device disposed on the display device that displays image data.
Extraction level designating means for designating an extraction level for a component constituting the image data;
Component extraction means for analyzing the image data according to the extraction level designated by the extraction level designation means and extracting the component;
Component display means for displaying the component extracted by the component extraction means on the display device so as to overlap the image data;
When the constituent element displayed on the display device by the constituent element display unit so as to overlap the image data is designated by the instruction member via the information input device, the constituent element is associated with the designated constituent element. Processing execution means for executing processing on the image data related to the component;
An image processing apparatus comprising: The component display means displays a frame indicating the component superimposed on the image data;
The image processing apparatus according to claim 1. The component display means changes the color in the component and displays it superimposed on the image data.
The image processing apparatus according to claim 1. In the case where there are a plurality of processes associated with the constituent element, the processes associated with the constituent element are displayed in a list on the display device, and the desired member is instructed by an instruction from the instruction member via the information input device Select the process associated with the component,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The process associated with the component is displayed in a list on the display device in a balloon display.
The image processing apparatus according to claim 4. The extraction level designation means designates an extraction level for the component constituting the image data based on a display size in the display device;
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The extraction level designation means designates an extraction level for the component constituting the image data according to an editing function;
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. A program for causing a computer to execute a process on the image data displayed on the display device in response to an operation by an instruction member on an information input device arranged on the display device for displaying image data,
An extraction level designating function for designating an extraction level for components constituting the image data;
A component extraction function that analyzes the image data according to the extraction level specified by the extraction level specification function and extracts the component;
A component display function for displaying the component extracted by the component extraction function on the display device so as to overlap the image data;
When the component element displayed on the display device by the component element display function is displayed by being superposed on the image data by the instruction member via the information input device, the component element is associated with the designated component element. A process execution function for executing a process on the image data related to the component;
That causes the computer to execute the program. The component display function displays a frame indicating the component superimposed on the image data.
The program according to claim 8, wherein: The component display function changes the color in the component and displays it superimposed on the image data.
The program according to claim 8, wherein: In the case where there are a plurality of processes associated with the constituent element, the processes associated with the constituent element are displayed in a list on the display device, and the desired member is instructed by an instruction from the instruction member via the information input device Select the process associated with the component,
The program according to any one of claims 8 to 10, wherein: The process associated with the component is displayed as a list on the display device in a balloon display.
12. The program according to claim 11, wherein: The extraction level designation function designates an extraction level for the constituent elements constituting the image data based on a display size in the display device.
The program according to any one of claims 8 to 12, wherein: The extraction level designation function designates an extraction level for the component constituting the image data according to an editing function.
The program according to any one of claims 8 to 12, wherein: An image data processing method in an image processing apparatus that performs processing on the image data displayed on the display device in response to an operation by an instruction member on an information input device disposed on a display device that displays image data,
An extraction level designating step of designating an extraction level for a component constituting the image data;
A component extraction step of extracting the component by analyzing the image data according to the extraction level specified by the extraction level specifying step;
A component display step of displaying the component extracted by the component extraction step on the display device in an overlapping manner with the image data;
In the case where the constituent element displayed on the display device so as to overlap the image data by the constituent element display step is designated by the instruction member via the information input device, the constituent element is associated with the designated constituent element. A process execution step of executing a process on the image data related to the component;
An image data processing method comprising: The component display step displays a frame indicating the component superimposed on the image data,
The image data processing method according to claim 15. In the component display step, the color in the component is changed and displayed superimposed on the image data.
The image data processing method according to claim 15. In the case where there are a plurality of processes associated with the constituent element, the processes associated with the constituent element are displayed in a list on the display device, and the desired member is instructed by an instruction from the instruction member via the information input device Select the process associated with the component,
The image data processing method according to any one of claims 15 to 17, wherein The process associated with the component is displayed in a list on the display device in a balloon display.
The image data processing method according to claim 18. The extraction level designation step designates an extraction level for the component constituting the image data based on a display size in the display device.
20. The image data processing method according to claim 15, wherein the image data processing method is performed. The extraction level designation step designates an extraction level for the component constituting the image data according to an editing function.
20. The image data processing method according to claim 15, wherein the image data processing method is performed.

Images