JP2010128908A - Information processing apparatus, control method for the same, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve construction of a logic (a process flow) of efficient image processing. <P>SOLUTION: In a PC 110, the following process is executed when executing process of an image input from a camera 140. At first, a process flow-input/output information table is stored. The table includes each module of a process flow formed by combining a plurality of modules respectively showing a process to be executed to an image, and information or the like showing the execution order of each module. When a change regarding the module is instructed to the process flow, information of the process flow-input/output information table is changed according to the change instruction. Process is executed for each module of the changed process flow-input/output information table. A resulting image for each module obtained by the execution is displayed on a CRT 130. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus that performs image processing, a control method thereof, and a program for causing a computer to execute the control method.

  2. Description of the Related Art Conventionally, for example, an image processing apparatus that performs image processing of image data to be inspected with a camera with a certain logic (processing flow) for the purpose of positioning a substrate or a component in a chip mounter or inspecting a finished product. Widely used.

  As such an image processing apparatus, for example, a general-purpose type image processing apparatus equipped with a predetermined image processing logic, or a dedicated user that can construct a logic that meets the user's needs. There are types of image processing devices.

  Here, the general-purpose type image processing apparatus does not require the construction of a new image processing logic (processing flow), so it does not require the user's effort to introduce it into the actual manufacturing process, but the user's needs are completely met. It is rare that the logic satisfies the above. On the other hand, a dedicated type image processing apparatus can construct image processing logic that completely satisfies the user's needs. For this reason, it is necessary to develop the image processing logic each time, so a great amount of development effort is required. The development period and the cost were high.

  Therefore, conventionally, for example, a technique for improving the efficiency of logic development as shown in Patent Document 1 below has been proposed. Specifically, in Patent Document 1, a plurality of image processing modules are registered in advance in a computer that develops logic, the developer selects a module that meets the needs of the user, and is necessary for the selected module. By setting parameters and creating source code after creating source code, logic development is made more efficient.

JP 2003-296112 A

  Here, when a logic (processing flow) is constructed in the above-described dedicated type image processing apparatus, it is usually performed by combining a plurality of modules. In this case, even if the logic (processing flow) is created by combining a plurality of image processing modules each of which obtains an ideal result, there are various types of images to be processed. The target result may not be obtained. Therefore, it is usual to change the parameters of each module, change the order of modules, add new modules, etc. for various images using the built logic, and perform trial and error. It is necessary to make adjustments repeatedly.

  However, when such a module adjustment is performed, the technique disclosed in Patent Document 1 described above requires that a module is selected from the beginning and a parameter is set every time the adjustment is performed, which is a burden on the developer. There is a problem that a large work must be done.

  In addition, in the constructed logic (processing flow), for which module among the plurality of combined modules, adjustments such as change of parameters and order or addition of new ones, that is, modules to be adjusted are performed. Need to be identified.

  However, in the technique of Patent Document 1 described above, the processing result of the module in the middle of the processing flow is unknown and only the final processing result is known in the constructed logic. However, there is a problem that a heavy workload is required for the developer.

  The present invention has been made in view of such problems, and an object thereof is to provide an information processing apparatus, an information processing method, and a program capable of realizing the construction of an efficient image processing logic (processing flow). And

  An information processing apparatus according to the present invention is an information processing apparatus that performs image processing, and includes a module / source code master table in which a module indicating processing related to image processing and a source code corresponding to each module are associated. , Storing each module of the processing flow in which a plurality of the modules are combined, information indicating the execution order of the modules, and a processing flow / input / output information table including input information and output information related to processing of the modules A table storage means, a change means for changing information in the processing flow / input / output information table in response to the change instruction when an instruction to change the module is given to the processing flow, and The processing flow / input / output information table information changed by the changing means and the module / source code Using the master table information, source code generation means for generating source code for each module, object code generation means for generating object code based on the source code generated by the source code generation means, Using the object code generated by the object code generation means, a process execution means for executing the process for each module of the processing flow / input / output information table changed by the change means, and a process executed by the process execution means And a result image display means for displaying a result image for each module obtained by execution on a display device.

  A method for controlling an information processing apparatus according to the present invention is a method for controlling an information processing apparatus that performs image processing, wherein a module that indicates processing related to image processing and a source code corresponding to each module are associated with each other A processing flow including an input code and output information relating to processing of each module, information indicating the execution order of each module, a source code master table, each module of a processing flow combining a plurality of the modules, A storage step of storing an output information table in a table storage unit; and when an instruction to change the module is given to the processing flow, the processing flow / input / output information table Change step for changing information, and processing flow / input / output information changed by the change step A source code generation step for generating a source code for each module, and an object code based on the source code generated by the source code generation step, using the information on the table and the information on the module / source code master table An object code generation step, and a process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step; And a result image display step of displaying on the display device a result image for each of the modules obtained by executing the processing in the processing execution step.

  A program according to the present invention is a program for causing a computer to execute a control method of an information processing apparatus that performs image processing, in which modules indicating processing related to image processing are associated with source codes corresponding to the modules. Including a module / source code master table, a module of a processing flow in which a plurality of the modules are combined, information indicating an execution order of the modules, input information and output information related to the processing of the modules A storage step for storing a flow / input / output information table in a table storage means; and when a change instruction for the module is given to the processing flow, the processing flow / input / output is determined according to the change instruction. A change step for changing the information in the information table, and the change step A source code generation step for generating a source code for each module using the information of the processed processing flow / input / output information table and the information of the module / source code master table, and the source generated by the source code generation step An object code generating step for generating an object code based on the code; and for each module of the processing flow / input / output information table changed by the changing step, using the object code generated by the object code generating step. A process execution step for executing a process and a result image display step for displaying a result image for each module obtained by executing the process in the process execution step on a display device are executed by a computer.

  According to the present invention, it is possible to realize efficient image processing logic (processing flow).

  The best mode (embodiment) for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system 100 according to an embodiment of the present invention.

  As shown in FIG. 1, the image processing system 100 includes a personal computer (hereinafter referred to as “PC”) 110, an operation input device 120, a CRT display (hereinafter referred to as “CRT”) 130, and a camera 140. The illumination device controller 150, the illumination device 160, the external device controller 170, and the stage 180 on which the inspection object 181 is placed.

  The PC 110 is an information processing apparatus that comprehensively controls operations in the image processing system 100. Here, in the present embodiment, an example will be described in which the PC 110 is applied as an apparatus that supports development of an image processing program of an image processing apparatus introduced into an actual manufacturing process, but the present invention is not limited to this. However, the present invention includes a form applied as an image processing apparatus introduced into an actual manufacturing process or the like, for example.

  The PC 110 is configured to be able to communicate with a camera 140 that captures an image of the inspection object 181 via a predetermined cable or the like. The PC 110 is configured to be able to communicate with a lighting device controller 150 that controls the lighting device 160 via a predetermined cable or the like. The PC 110 is configured to be able to communicate with an external device controller 170 such as a programmable controller (PLC) that controls the stage 180 via a predetermined cable or the like. Further, the PC 110 is configured to be able to communicate with the operation input device 120 and the CRT 130 via a predetermined cable or the like. That is, the PC 110 controls the operation in the image processing system 100 by controlling the operation input device 120, the CRT 130, the camera 140, the lighting device controller 150, and the external device controller 170 connected via a predetermined cable or the like. To control.

  The operation input device 120 is operated by the user when the user gives an input instruction to the PC 110, for example, and inputs the input instruction to the PC 110 when the user gives an input instruction. is there. The operation input device 120 includes, for example, a keyboard (KB) and a mouse.

  The CRT 130 displays various images and various information on the display screen according to the control of the PC 110.

  The camera 140 performs imaging (imaging) of the inspection object 181 placed on the stage 180 according to the control of the PC 110, and transmits image data obtained by the imaging to the PC 110 via a predetermined cable or the like.

  The illumination device controller 150 controls illumination in the illumination device 160 according to the control of the PC 110. Based on the control of the lighting device controller 150, the lighting device 160 switches lighting / non-lighting of the illumination on the inspection target 181 according to the inspection content of the inspection target 181.

  The external device controller 170 controls the stage 180 according to the control of the PC 110. The stage 180 moves the placed inspection object 181 to a target position and carries in or out the inspection object 181 based on the control of the external device controller 170.

Next, the internal hardware configuration of the PC 110 will be described.
FIG. 2 is a schematic diagram illustrating an example of an internal hardware configuration of the PC 110 illustrated in FIG. Here, in FIG. 2, in addition to the internal configuration of the PC 110, a device connected to the PC 110 is also described.

  As shown in FIG. 2, the PC 110 has a hardware configuration including a CPU 111, a RAM 112, a ROM 113, a system bus 114, various controllers 115 (115 a to 115 f), and an external memory 116. . Specifically, as various controllers 115, an input controller 115a, a video controller 115b, a memory controller 115c, communication I / F controllers 115d and 115e, and an image input controller 115f are configured.

  The CPU 111 controls each device connected to the system bus 114 based on a program or the like stored in the ROM 113 or the external memory 116, and comprehensively controls the operation in the PC 110.

  The RAM 112 functions as a main memory and work area for the CPU 111. The CPU 111 implements various operations in the PC 110 by loading a necessary program or the like into the RAM 112 and executing the program when executing the processing.

  The ROM 113 stores a BIOS (Basic Input / Output System) and an operating system program (hereinafter referred to as “OS”), which are control programs for the CPU 111, and various programs necessary for the CPU 111 to realize the functions of the PC 110. Has been. Note that these programs may be stored in the external memory 116.

  The system bus 114 connects the CPU 111, RAM 112, ROM 113, input controller 115a, video controller 115b, memory controller 115c, communication I / F controllers 115d and 115e, and image input controller 115f so that they can communicate with each other.

  The input controller 115a controls input from the operation input device 120 such as a keyboard (KB) and a mouse.

  The video controller 115b controls display on the CRT 130 which is a display device.

  The memory controller 115 c controls access to the external memory 116. Here, the external memory 116 is composed of, for example, a hard disk (HD) or a flexible disk (FD), and stores a boot program, various application programs, editing files, various data, various information, and the like. The external memory 116 also stores various tables, various inspection result information, and the like used when the CPU 111 performs processing using a program.

  The communication I / F controller 115d controls communication with the external device controller 170. Further, the communication I / F controller 115e controls communication with the lighting device controller 150.

  The image input controller 115 f is configured to be able to receive image data from the camera 140 by communicating with the camera 140. In the present embodiment, the description is based on the assumption that image data is input from the camera 140, but an image file may be read and input.

Next, the functional configuration of the PC 110 will be described.
FIG. 3 is a schematic diagram illustrating an example of a functional configuration of the PC 110 illustrated in FIG.

  As shown in FIG. 3, the PC 110 includes a table storage unit 310, a flow creation unit 320, a source code conversion unit 330, a compilation unit 340, a (verification) execution unit 350, a data storage unit 360, and a data input / output unit. Each functional configuration of 370 is configured. The table storage unit 310 holds a module / source code master table 311, a processing flow / input / output parameter table 312, a source code table 313, an object code table 314, and a project file table 315.

  Here, in the present embodiment, the table storage unit 310 in FIG. 3 is configured in the external memory 116 shown in FIG. 2, for example (including a case where the table storage unit 310 is configured in the external memory 116 after being once configured in the RAM 112). Also, the flow creation unit 320, the source code conversion unit 330, the compilation unit 340, the (verification) execution unit 350, the data storage unit 360, and the data input / output unit 370 shown in FIG. And a program stored in the memory 116.

  First, various tables held in the table storage unit 310 of FIG. 3 will be described.

FIG. 4 is a schematic diagram showing an example of the module / source code master table 311 shown in FIG.
In the module / source code master table 311, as shown in FIG. 4, a module (image processing module) related to image processing and a source code corresponding to each module are associated with each index. This source code is used when the source code conversion unit 330 converts a module to be processed into a source code.

FIG. 5 is a schematic diagram showing an example of the processing flow / input / output parameter table 312 shown in FIG.
As illustrated in FIG. 5, the processing flow / input / output parameter table 312 includes, for each index 501, a module 503 relating to image processing, an order 502 of each module 503, and a flow registration name 504 of each module 503. The input parameter 505 and the output parameter 506 in each module 503 are associated with each other. An input parameter 505 indicates an image buffer, a processing area, and the like used in each module. The output parameter 506 indicates a result image buffer, a threshold value, and the like when each module is executed.

  The index (Index) 501 in the processing flow / input / output parameter table 312 shown in FIG. 5 and the index (Index) in the module / source code master table 311 shown in FIG. In this case, each table may be created.

  The source code table 313 converts all modules 503 stored in the processing flow / input / output parameter table 312 into source codes using the module / source code master table 311 and registers them in the source code conversion unit 330. The source code in the module or a part of the modules is stored.

  The object code table 314 stores the object code of an executable module obtained by converting the source code stored in the source code table 313 by the compiling unit 340.

  The project file table 315 stores initial setting parameters relating to image processing, processing flow sequences, source codes, input / output parameters, and the like.

  Next, the flow creation unit 320, the source code conversion unit 330, the compilation unit 340, the (verification) execution unit 350, the data storage unit 360, and the data input / output unit 370 in FIG. 3 will be described.

  The flow creation unit 320 creates a processing flow / input / output parameter table 312 for managing the processing sequence of modules included in the module / source code master table 311 and the processing flow drawing area (702 in FIG. 7 described later). It has a function to draw a module in

  The source code conversion unit 330 collates the processing data of each module stored in the processing flow / input / output parameter table 312 created by the flow creation unit 320 with the module / source code master table 311 to source each module. It has a function of converting into code and storing it in the source code table 313.

  The table modules shown in FIGS. 4 and 5 include not only image processing but also image processing such as pre-processing for acquiring images and post-processing for outputting processing results to external devices. Any process related to the process may be used. For example, a control command for setting the imaging conditions of the camera 140, a control command for the lighting device controller 150 for controlling the lighting device 160, or a control command for the external device controller 170 for controlling movement of the stage, etc. It may be what performs.

  The compiling unit 340 has a function of generating executable object code from the source code stored in the source code table 313 and storing the generated object code in the object code table 314.

  There are two types of compilation performed by the compiling unit 340: debug compilation and release compilation. Here, in this embodiment, during the process flow creation, debugging / compilation that enables step execution at the source code level is performed, and release / compilation that generates a file that can be used online is performed when data is saved. Do. At this time, both the debug compilation and the release compilation refer to the source code generated by the same conversion method.

  The (verification) execution unit 350 executes the object code stored in the object code table 314 created by the compiling unit 340, results image display area (703 in FIG. 7 described later), processing flow / input / output parameter table 312 is updated.

  For example, the data storage unit 360 outputs the source code table 313, the object code table 314, and the project file table 315 in the RAM 112 to the external memory 116, and performs data storage processing.

  The data input / output unit 370 has a function of managing input / output parameters used in each module.

Next, the processing procedure of the control method by the PC 110 will be described.
FIG. 6 is a flowchart illustrating an example of a processing procedure of a control method performed by the PC 110 illustrated in FIG.

  First, in step S101 of FIG. 6, the CPU 111 of the PC 110 performs a process of displaying an image processing program development screen for developing an image processing program on the CRT 130 based on an input instruction from the operation input device 120, for example. .

  FIG. 7 is a schematic diagram illustrating an example of the image processing program development screen 700 according to the embodiment of this invention. The image processing program development screen 700 is configured with, for example, a GUI.

  An image processing program development screen 700 shown in FIG. 7 includes a tool box 701 that displays available processing units (that is, modules related to image processing such as “camera capture”), and an execution order of image processing (that is, , The execution order of each module) in a flowchart, a process flow drawing area 702, a result image display area 703 for displaying a result image executed in each image process (that is, each module process), a menu bar 706, and a tool bar 707, a close button 708 that is operated when the development of the image processing program is finished, and the like. Further, the image processing program development screen 700 shown in FIG. 7 includes parameters used in each step (that is, each module) of the flowchart of the processing flow drawing area 702 when, for example, a new module is registered or a parameter is edited. A parameter editing screen 704 for setting the parameter and a result image display window 705 for displaying the result image executed by setting the parameter are displayed. In the example shown in FIG. 7, the parameter editing screen 704 shows a screen for setting parameters related to the “binarization” module.

Here, it returns to description of FIG. 6 again.
When the process of step S101 ends, the process proceeds to step S102. In step S102, the CPU 111 of the PC 110 determines whether or not to newly develop an image processing program using the image processing program development screen 700 displayed in step S101 based on an input instruction from the operation input device 120. to decide. Specifically, in this example, whether or not to newly develop an image processing program is determined according to whether or not a new creation button 707a is selected on the toolbar 707 of the image processing program development screen 700. That is, in this example, when the new creation button 707a is selected, it is determined that a new image processing program is to be developed.

  If it is determined in step S102 that no new image processing program is to be developed (S102 / NO), the process proceeds to step S103.

  In step S 103, the CPU 111 of the PC 110 reads the project file table 315 saved in the external memory 116 and stores it in the RAM 112.

  When the process of step S103 is completed, or when it is determined in step S102 that a new image processing program is to be developed (S102 / YES), the process proceeds to step S104.

  In step S104, the CPU 111 of the PC 110 determines whether there is an input instruction from the operation input device 120 (specifically, an input instruction for the image processing program development screen 700 displayed in step S101).

  If there is no input instruction from the operation input device 120 as a result of the determination in step S104 (S104 / NO), the process waits in step S104 until there is an input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S104, if there is an input instruction from the operation input device 120 (S104 / YES), the process proceeds to step S105.

  In step S105, the CPU 111 of the PC 110 performs a process for determining the selected process content based on an input instruction from the operation input device 120. In this example, the processing contents determined in step S105 include “new addition processing”, “change processing”, “move processing”, “insertion processing”, “overall execution processing”, “save processing”, and “development processing”. It is “end processing”. Note that the processing content given here is an example, and other processing content can be determined in step S105.

  Here, in the determination process of step S105, for example, the following processes are determined by making the following inputs on the image processing program development screen 700 shown in FIG.

  First, when a module is selected from the tool box 701 shown in FIG. 7 and dragging and dropping at the end of the processing flow sequence in the processing flow drawing area 702 or when a module in the tool box 701 is double-clicked, the CPU 111 of the PC 110 , It is determined that the event is a “new addition process” of the module. When a module already registered in the processing flow drawing area 702 is double-clicked, the CPU 111 of the PC 110 determines that the event is a module parameter “change process” event. When a module already registered in the processing flow drawing area 702 is dragged and dropped between other modules, the CPU 111 of the PC 110 determines that the event is a “movement process” of the module. When a module is selected from the toolbox 701 shown in FIG. 7 and dragged and dropped between modules already registered in the processing flow drawing area 702, the CPU 111 of the PC 110 performs the “insertion processing” of the module. Judged to be an event. When execution of the menu bar 706 or the tool bar 707 is selected, the CPU 111 of the PC 110 determines that the event is an “all execution process” event of the process flow set in the process flow drawing area 702. When saving of the menu bar 706 or the toolbar 707 is selected, the CPU 111 of the PC 110 determines that the event is a “save process” event of the process flow set in the process flow drawing area 702. For example, when the close button 708 or the end of the menu bar 706 is selected, the CPU 111 of the PC 110 determines that the event is a “development end process” event of the image processing program.

  In this embodiment, the processing content is determined in this way. However, this is an example. For example, an icon or the like corresponding to the processing content such as “add new” is added to the menu bar 706 or the toolbar 707. A function may be provided, and is not limited to the above-described form.

  Subsequently, in step S <b> 106, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S <b> 105 is a “new addition process” of the module.

  As a result of the determination in step S106, if the processing content determined in step S105 is a “new addition process” for the module (S106 / YES), the process proceeds to step S107.

  In step S107, the CPU 111 of the PC 110 performs a “new addition process” for the selected module. Details of step S107 will be described later with reference to FIG. When the process of step S107 is completed, the process returns to step S104, and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S106, if the processing content determined in step S105 is not the “new addition processing” of the module (S106 / NO), the process proceeds to step S108.

  In step S108, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is a “parameter change process” for the module.

  As a result of the determination in step S108, when the processing content determined in step S105 is “change processing” of the module parameter (S108 / YES), the process proceeds to step S109.

  In step S109, the CPU 111 of the PC 110 performs “change processing” for the parameter of the selected module. Details of step S109 will be described later with reference to FIG. When the process of step S109 is completed, the process returns to step S104, and waits for a next input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S108, if the processing content determined in step S105 is not a “parameter change process” for the module parameter (S108 / NO), the process proceeds to step S110.

  In step S110, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is a “movement process” of the module.

  As a result of the determination in step S110, if the processing content determined in step S105 is a “movement process” of the module (S110 / YES), the process proceeds to step S111.

  In step S111, the CPU 111 of the PC 110 performs “move processing” for the selected module. Details of step S111 will be described later with reference to FIG. When the process of step S111 is completed, the process returns to step S104 and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S110, if the processing content determined in step S105 is not the “movement process” of the module (S110 / NO), the process proceeds to step S112.

  In step S112, the CPU 111 of the PC 110 determines whether or not the processing content determined in step S105 is the “insertion processing” of the module.

  As a result of the determination in step S112, when the processing content determined in step S105 is “insertion processing” of the module (S112 / YES), the process proceeds to step S113.

  In step S113, the CPU 111 of the PC 110 performs “insertion processing” for the selected module. Details of step S113 will be described later with reference to FIG. When the process of step S113 is completed, the process returns to step S104 and waits until the next input instruction is received from the operation input device 120.

  On the other hand, as a result of the determination in step S112, when the processing content determined in step S105 is not the “insertion processing” of the module (S112 / NO), the process proceeds to step S114.

  In step S114, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “overall execution processing” in the processing flow.

  As a result of the determination in step S114, when the processing content determined in step S105 is “overall execution processing” in the processing flow (S114 / YES), the process proceeds to step S115.

  In step S 115, the CPU 111 of the PC 110 performs “overall execution processing” of the processing flow set in the processing flow drawing area 702. Details of step S115 will be described later with reference to FIG. When the process of step S115 is completed, the process returns to step S104, and waits for a next input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S114, if the processing content determined in step S105 is not the “overall execution processing” in the processing flow (S114 / NO), the process proceeds to step S116.

  In step S116, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “save processing” in the processing flow.

  As a result of the determination in step S116, when the processing content determined in step S105 is “save processing” in the processing flow (S116 / YES), the process proceeds to step S117.

  In step S117, the CPU 111 of the PC 110 performs a source conversion process for the entire processing flow set in the processing flow drawing area 702. Specifically, in step S117, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 converts the processing flow / input / output parameter table 312 stored in the RAM 112 into source code, and stores the source stored in the RAM 112. Processing for updating the code table 313 is performed. Further, the CPU 111 (for example, the compiling unit 340) of the PC 110 releases and compiles the source code of the source code table 313, converts it into a release version of the object code, and updates the object code table 314 stored in the RAM 112. I do.

  Subsequently, in step S118, the CPU 111 (for example, the data storage unit 360) of the PC 110 stores the source code table 313 on the RAM 112 as a source file, the object code table 314 as an EXE file or DLL file, and a project file table. A process of storing 315 in the external memory 116 is performed. Then, when the process of step S118 ends, the process returns to step S104, and waits for a next input instruction from the operation input device 120.

  On the other hand, as a result of the determination in step S116, if the processing content determined in step S105 is not “save processing” in the processing flow (S116 / NO), the process proceeds to step S119.

  In step S119, the CPU 111 of the PC 110 determines whether the processing content determined in step S105 is “development end processing” of the image processing program.

  As a result of the determination in step S119, when the processing content determined in step S105 is not the “development end processing” of the image processing program (S119 / NO), the process returns to step S104 until an input instruction is received from the operation input device 120. stand by.

  On the other hand, as a result of the determination in step S119, when the processing content determined in step S105 is “development end processing” of the image processing program (S119 / YES), the processing of the flowchart shown in FIG.

  Next, details of steps S107, S109, S111, S113, and S115 in FIG. 6 will be described. Specifically, processing is performed in the order of modules of “camera capture” → “binarization” → “particle analysis”. An example of registering a flow and performing subsequent processing will be described.

First, detailed processing in step S107 in FIG. 6 will be described.
FIG. 8 is a flowchart showing an example of a detailed processing procedure of the “new addition processing” of the module in step S107 of FIG.

  In the process of step S107 of FIG. 6, first, in step S201 of FIG. 8, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs a process of specifying the module selected in the input of step S104. Here, in this example, first, the first “camera capture” module is specified.

  Subsequently, in step S202, the CPU 111 (for example, the flow creation unit 320) of the PC 110 performs processing for displaying the parameter editing screen 704 of the module specified in step S201 on the CRT 130. Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. If the “camera capture” module is specified in step S201, a parameter editing screen 704 related to the “camera capture” module is displayed on the image processing program development screen 700 shown in FIG. It will be.

  In the parameter editing screen 704, parameters related to each module, input parameters such as processing areas (input parameters 505 shown in FIG. 5), and output parameters for storing processing results (output parameters 506 shown in FIG. 5) are set. It is configured to be possible.

  Subsequently, in step S203, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. Specifically, here, when the OK button 7041 on the parameter editing screen 704 shown in FIG. 7 is selected, it is determined that the parameter edited on the parameter editing screen 704 is registered, and the parameter editing screen shown in FIG. When the cancel button 7042 of 704 or the like is selected, it is determined that the parameter edited on the parameter editing screen 704 is not registered.

  If the parameter edited on the parameter editing screen 704 is registered as a result of the determination in step S203 (S203 / YES), the process proceeds to step S204.

  In step S204, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for adding the information obtained in the processing in steps S201 and S202 as one record to the processing flow / input / output parameter table 312.

For example, a case where a record relating to the “camera capture” module is first added to the processing flow / input / output parameter table 312 shown in FIG. 5 will be described.
In this case, “camera capture” is set as the module 503, “1” is set as the index 501, “1” is set as the order 502, and “U00001” is set as the flow registration name 504. . For example, as the output parameter 506, information (address, etc.) of “image buffer A” that is the storage destination of the result image is set. Here, since the “camera capture” process is the first module in the process flow, the input parameter 505 does not store image buffer information (such as an address).

Here, it returns to description of FIG. 8 again.
When the process of step S204 is completed, in step S205, the CPU 111 of the PC 110 (for example, the flow creation unit 320) adds the module identified in step S201 to the process flow drawing area 702 and draws (displays) it. In the present embodiment, the order of the processing related to the processing flow / input / output parameter table 312 in step S204 and the drawing processing in the processing flow drawing area 702 in step S205 may be reversed.

  Subsequently, in step S206, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) converts the module added to the processing flow drawing area 702 in step S205 into the source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313. At this time, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) modifies the source code read from the module / source code master table 311 to reflect the parameter edited in step S202 as necessary. The obtained source code is stored in the source code table 313.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313 and stores it in the object code table 314 as a debug version of the object code.

  Subsequently, in step S207, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) stores the result image buffer of the previous step stored as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Is used to execute the object code generated in step S206. As a result, the image data from the camera 140 is acquired as a processing result image. For example, the flow creation unit 320 sets information on a buffer for storing the processing result image in the output parameter 506 of the processing flow / input / output parameter table 312. To do.

  However, in the case of the “camera capture” module, since this is the first step, image buffer information (address, etc.) is not stored in the input parameter 505. Therefore, in the case of the first “camera capture”, the image data from the camera 140 is simply captured. Therefore, in the execution process of step S207, the process is executed with reference to the input parameter and output parameter set in step S202, and the result image (image data captured from the camera 140) is displayed in the result image display window 705. It will be.

  In step S208, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) displays a result image based on the result image data stored in the address of the image buffer A in the output parameter 506 of the record added in step S204. Draw (display) in the result image display area 703. In the result image display area 703, the processing result image for each module is displayed. With this, the developer should know which processing has a problem and which module should be corrected. It becomes possible to make a judgment.

  When the process of step S208 is completed, or when it is determined not to register the parameter edited on the parameter edit screen 704 in step S203 (S203 / NO), the “new addition process” is entered from the operation input device 120. When the termination is instructed, the process of the flowchart of FIG. 8 is terminated. When the operation input device 120 is instructed to continue the “new addition process”, the process returns to step S201, and the processes after step S201 are performed again. Will do.

  Here, in this example, as described above, the processing flow is registered in the order of modules of “camera capture” → “binarization” → “particle analysis”. The case of adding “binarization” and “particle analysis” modules to the processing flow will be described. In the following description, the description will focus on differences from the processing in the “camera capture” module described above.

  Adding a “binarization” module to the processing flow is basically the same as the above-described “camera capture”, but in step S204, a new index (Index) shown in FIG. ) “2” of 501 is set to “binarization” as the module 503, “2” is set as the order 502, and “U00002” is set as the flow registration name 504. Further, as the input parameter 505, information (such as an address) of the image buffer A that stores the result image of the previous step (that is, “camera capture”) is stored. In other words, the input parameter 505 of the “binarization” module stores information of the image buffer stored in the input parameter 505 of “camera capture” which is the previous step.

  Subsequently, in step S205, the module ("binarization") specified in step S201 is added to the processing flow drawing area 702 and drawn (displayed). In step S206, the module additionally registered in step S205 is converted into source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated.

  In step S207, the object code stored in the object code table 314 is executed to perform binarization processing using the input parameter 505 of the “binarization” module. As a result, the binarized image data is acquired as a processing result image. For example, the flow creation unit 320 includes information on the buffer B that stores the processing result image and a threshold value (for example, numerical value = 98). Is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Thereafter, in step S208, a result image based on the image data stored in the address of the image buffer B in the output parameter 506 of the record added in step S204 is drawn (displayed) in the result image display area 703.

  In addition, when the “particle analysis” module is added to the processing flow, the processing is basically the same as the case of the above-described module, but in step S204, the module 503 is added to “3” of the index 501. “Particle analysis” is set as “3”, “3” is set here as the order 502, and “U00003” is set here as the flow registration name 504. In addition, as the input parameter 505, information (such as an address) of the image buffer B that stores the result image of the previous step (here, “binarization”) is stored.

  Subsequently, in step S205, the module (“particle analysis”) specified in step S201 is drawn (displayed) in the processing flow drawing area 702. In step S206, the module additionally registered in step S205 is converted into source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Also, the source code of the source code table 313 is debugged and compiled, and this is stored in the object code table 314 and updated.

  Subsequently, in step S207, the object code stored in the object code table 314 is executed to perform particle analysis processing using the input parameter 505 of the “particle analysis” module. As a result, the image data subjected to particle analysis is acquired as a processing result image. For example, the flow creation unit 320 includes information on the buffer C storing the processing result image and the number of particles at that time (here, for example, the number of particles). = 51) is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Thereafter, in step S208, a result image based on the image data stored at the address of the image buffer C in the output parameter 506 of the record added in step S204 is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, as shown in FIG. 7, the order of the processing flows set in the processing flow drawing area 702 (in other words, “camera capture” in order from the left side) ”→“ binarization ”→“ particle analysis ”module order), the processing result image is displayed.

  As described above, the “new addition process” for the module in step S107 in FIG. 6 is performed.

Next, detailed processing in step S109 in FIG. 6 will be described.
FIG. 9 is a flowchart showing an example of a detailed processing procedure of the “change processing” of the module parameter in step S109 of FIG. Here, an example will be described in which the parameters of the “binarization” module already registered in the processing flow of the processing flow drawing area 702 are changed by the processing shown in FIG.

  In the process of step S109 of FIG. 6, first, in step S301 of FIG. 9, the CPU 111 of the PC 110 (for example, the flow creation unit 320) specifies the module that has been selected as the input of step S104 and has already been registered as the process flow. Perform the process. Here, in this example, a “binarization” module is specified.

  Subsequently, in step S302, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for displaying the parameter editing screen 704 of the module identified in step S301 on the CRT 130. In this example, a parameter editing screen 704 related to the “binarization” module is displayed.

  FIG. 10 is a schematic diagram illustrating an example of the parameter editing screen 704 according to the embodiment of this invention. The parameter editing screen 704 shown in FIG. 10 is a screen for editing the parameters of the “binarization” module. The binarization type setting unit 1001 for setting the binarization type and the binarization A threshold value setting unit 1002 for setting the threshold value, an OK button 7041, a stop button 7042, and the like are provided.

  Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. Here, when the threshold value of the threshold value setting unit 1002 shown in FIG. 10 is changed, the image displayed in the result image display window 705 is updated and displayed as needed according to the change of the threshold value.

  Subsequently, in step S303, the CPU 111 of the PC 110 (for example, the flow creation unit 320) converts the parameter of the module identified in step S301 into the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. Determine whether to change. Specifically, here, when the parameter is changed on the parameter edit screen 704 and the OK button 7041 on the parameter edit screen 704 shown in FIG. 10 is selected, it is determined that the parameter of the module specified in step S301 is changed. .

  As a result of the determination in step S303, when the parameter of the module identified in step S301 is changed to the parameter edited in the parameter editing screen 704 (S303 / YES), the process proceeds to step S304.

  In step S304, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 converts the module after the module determined to change the parameter in step S303 into the source code using the module / source code master table 311. The source code obtained by the conversion is stored in the source code table 313 and updated. Specifically, in this example, since the parameter of the “binarization” module is changed, the processing flow registered in the processing of FIG. 8, that is, “camera capture” → “binarization” → Among the “particle analysis” modules, source code conversion is performed for the “binarization” and “particle analysis” modules. At this time, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 modifies the source code read from the module / source code master table 311 to reflect the parameter edited in step S302 as necessary. The obtained source code is stored in the source code table 313. In this way, by performing source code conversion processing only for modules after the module determined to be changed, development time can be shortened together with compilation processing described later, and efficient image processing logic (processing) Flow) can be realized.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S305, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer indicated as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S304 is performed. Specifically, in this example, since the processing target is a “binarization” module, the module is stored in the image buffer A stored as the input parameter 505 of the processing flow / input / output parameter table 312 shown in FIG. The binarization process is performed by executing the object code generated in step S304 using the existing image data. As a result, the binarized image data is acquired as a processing result image. For example, the flow creation unit 320 displays information about the buffer B that stores the processing result image and information about the threshold value at that time. The output parameter 506 of the input / output parameter table 312 is set.

  Subsequently, in step S306, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, in order from the left side, the order of the processing flows set in the processing flow drawing area 702 (ie, “camera capture” → “binarization” → “particle” The processing result image is displayed according to the order of the “analysis” module). For example, the processing result image after the “binarization” module is changed and displayed with respect to the display in step S208 of FIG. Will be.

  When the process of step S306 is completed, or when it is determined in step S303 that the parameter of the corresponding module is not changed to the parameter edited on the parameter edit screen 704 (S303 / NO), the operation input device 120 reads “ When instructed to end the “change process”, the process of the flowchart of FIG. 9 ends, and when the operation input device 120 instructs to continue the “change process”, the process returns to step S301, and after step S301. Processing will be performed again.

  As described above, the module parameter “change process” in step S109 of FIG. 6 is performed.

Next, detailed processing in step S111 in FIG. 6 will be described.
FIG. 11 is a flowchart showing an example of a detailed processing procedure of the “move processing” of the module in step S111 of FIG. The order of processing flow is changed by the movement processing of this module.

  In the process of step S111 in FIG. 6, first, in step S401 of FIG. 11, the CPU 111 (for example, the flow creation unit 320) of the PC 110 identifies a module that has been selected as an input in step S104 and has already been registered as a process flow. Perform the process.

  Subsequently, in step S402, the CPU 111 of the PC 110 (for example, the flow creation unit 320) drops the module identified in step S401 for the processing flow drawn (displayed) in the processing flow drawing area 702 in step S104. A process for moving between modules and redrawing (redisplaying) the processing flow drawing area 702 is performed.

  At this time, the CPU 111 (for example, the flow creation unit 320) of the PC 110 also performs processing for changing the processing flow / input / output parameter table 312 in accordance with the movement processing of the module identified in step S401. Here, a specific example is not shown, but first, in accordance with the order of modules in the processing flow of the processing flow drawing area 702 redrawn in step S402, the order 502 of the processing flow / input / output parameter table 312 (and the flow registration name). 504) is changed. Next, in accordance with the order of modules in the processing flow of the processing flow drawing area 702 redrawn in step S402, the input parameters 505 and output parameters 506 of the modules associated with the change in the order are changed. For example, the input parameter 505 of the module to be moved stores the image buffer information of the output parameter 506 in the immediately preceding module. At this time, the output parameter 506 of the module to be moved may not be changed. However, the input parameter 505 in the next-order module stores image buffer information of the output parameter 506 of the module to be moved.

  Subsequently, in step S403, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) stores the module / source code master table 311 for modules after the module whose order 502 is changed in the processing flow / input / output parameter table 312. The source code is converted into a source code, and the source code obtained by the conversion is stored in the source code table 313 and updated. At this time, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) once deletes the source code corresponding to the module whose order has been changed in the source code table 313, and performs conversion to the source code again. The source code table 313 is updated.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S404, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer indicated as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S403 is performed.

  Subsequently, in step S405, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, the processing result images are displayed in order from the left side according to the order of the processing flows set in the processing flow drawing area 702.

  When the process of step S405 is completed, when the operation input device 120 instructs to end the “movement process”, the process of the flowchart of FIG. 11 is ended, and the operation input device 120 performs the “movement process”. When continuation is instructed, the process returns to step S401, and the processes after step S401 are performed again.

  As described above, the “move process” of the module in step S111 in FIG. 6 is performed.

Next, detailed processing in step S113 in FIG. 6 will be described.
FIG. 12 is a flowchart showing an example of a detailed processing procedure of the “insertion processing” of the module in step S113 of FIG. Here, the processing flow (“camera capture” → “binarization” → “particle analysis”) registered in the processing flow drawing area 702 by the processing shown in FIG. Next, “insertion processing” for adding a “morphology” module will be described. That is, here, an example of “camera capture” → “binarization” → “morphology” → “particle analysis” as in the processing flow drawing area 702 shown in FIG. 7 will be described.

  In the process of step S113 in FIG. 6, first, in step S501 of FIG. 12, the CPU 111 of the PC 110 (for example, the flow creation unit 320) specifies the insertion destination into which a new module is to be inserted dropped in the input of step S104. Process. Here, in this example, between “binarization” and “particle analysis” is specified as the insertion destination.

  Subsequently, in step S502, the CPU 111 (for example, the flow creation unit 320) of the PC 110 performs processing for specifying the module selected in the input in step S104. Here, in this example, a “morphology” module is specified. In the present embodiment, the processing order of the insertion destination specifying process in step S501 and the module specifying process in step S502 may be reversed.

  Subsequently, in step S503, the CPU 111 (for example, the flow creation unit 320) of the PC 110 performs processing for displaying the parameter editing screen 704 of the module specified in step S502 on the CRT 130. Then, the CPU 111 of the PC 110 (for example, the flow creation unit 320) accepts editing by the operation input device 120 regarding the parameter editing screen 704. In this example, a parameter editing screen 704 related to the “morphology” module is displayed on the image processing program development screen 700 shown in FIG.

  Subsequently, in step S504, the CPU 111 of the PC 110 (for example, the flow creation unit 320) determines whether or not to register the parameter edited on the parameter editing screen 704 based on the input instruction from the operation input device 120. As a specific determination method in step S504, the same method as in step S203 of FIG. 8 is used.

  As a result of the determination in step S504, when the parameter edited on the parameter editing screen 704 is registered (S504 / YES), the process proceeds to step S505.

  In step S505, the CPU 111 of the PC 110 (for example, the flow creation unit 320) performs processing for adding the information obtained in the processing in steps S502 and S503 as one record to the processing flow / input / output parameter table 312. Based on the insertion destination information specified in step S501, information in the processing flow / input / output parameter table 312 is changed and updated.

  In this example, first, as shown in FIG. 5, information on the module of “morphology” that is the module to be inserted is added to “4” of the index (Index) 501 of the processing flow / input / output parameter table 312. Specifically, “morphology” is set as the module 503, “3” is set as the order 502, “U00003” is set as the flow registration name 504, and image buffer information (address, etc.) of the input parameter 505 The information (address etc.) of the image buffer B shown in the output parameter 506 of the previous step (“binarization”) is set as the information (address etc.) of the image buffer C as the image buffer information (address etc.) of the output parameter 506. ) Is set. At this time, the order 502 is changed from “3” to “4” for the information of the “particle analysis” module whose index (Index) 501 is registered as “3” in the processing flow / input / output parameter table 312. For example, the image buffer C is set as image buffer information (address or the like) of the input parameter 505, and the image buffer D is set as image buffer information (address or the like) of the output parameter 506.

  Subsequently, in step S506, the CPU 111 of the PC 110 (for example, the flow creation unit 320) draws (displays) the processing flow drawing area 702 by adding the module specified in step S502 to the insertion destination specified in step S501. . In the present embodiment, the order of the process of the process flow / input / output parameter table 312 in step S505 and the process of drawing in the process flow drawing area 702 in step S506 may be reversed.

  Subsequently, in step S507, the CPU 111 (for example, the source code conversion unit 330) of the PC 110 starts with the module whose order 502 is changed in the processing flow / input / output parameter table 312 (that is, after the module inserted in step S506). The module is converted into source code using the module / source code master table 311, and the source code obtained by the conversion is stored in the source code table 313 and updated.

  Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 debugs and compiles the source code of the source code table 313, and stores and updates the source code in the object code table 314 as a debug version of the object code.

  Subsequently, in step S508, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) is stored in the image buffer shown as the input parameter 505 of the processing flow / input / output parameter table 312 as necessary. Using the image data, processing for executing the object code generated in step S403 is performed. Specifically, for example, for the “morphology” module inserted in the current process, the result image data (stored in the image buffer B) of the previous process module (in this example, the “binarization” module) The object code generated in step S507 is executed using the result image data). In the case of this example, image data that has undergone morphology processing is acquired as a processing result image. For example, the flow creation unit 320 includes information on a buffer that stores the processing result image and the number of particles at that time (here, for example, particle Number = 46) is set in the output parameter 506 of the processing flow / input / output parameter table 312.

  Subsequently, in step S509, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) results image based on the result image data stored at the address of the image buffer in the output parameter 506 of the processing flow / input / output parameter table 312. Is drawn (displayed) in the result image display area 703. In this example, in the result image display area 703, for example, in order from the left side, the order of the processing flows set in the processing flow drawing area 702 (ie, “camera capture” → “binarization” → “morphology”). "→" Particle analysis "module order), the processing result image is displayed.

  As described above, the “insertion process” of the module in step S113 in FIG. 6 is performed.

Next, detailed processing in step S115 in FIG. 6 will be described.
FIG. 13 is a flowchart showing an example of a detailed processing procedure of “overall execution processing” in the processing flow in step S115 of FIG.

  In step S115 of FIG. 6, first, in step S601 of FIG. 13, the CPU 111 of the PC 110 (for example, the source code conversion unit 330) relates to a series of processing flows set in the processing flow / input / output parameter table 312. The module is converted into source code, and the source code obtained by the conversion is stored in the source code table 313. Thereafter, the CPU 111 (for example, the compiling unit 340) of the PC 110 generates an executable object code from the source code stored in the source code table 313, and stores the generated object code in the object code table 314. At this time, the CPU 111 (for example, the compiling unit 340) of the PC 110 releases and compiles the source code of the source code table 313 and stores it in the object code table 314 as a release version of the object code.

  In step S602, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) uses the image data stored in the result image buffer stored as the input parameter 505 of the processing flow / input / output parameter table 312. Thus, processing for executing the object code generated in step S601 is performed. As a result, a plurality of image data that has undergone image processing or the like is acquired as a processing result image. For example, the flow creation unit 320 processes information about a buffer that stores the processing result image and information about numerical values at that time. Set to the output parameter 506 of the input / output parameter table 312.

  Subsequently, in step S <b> 603, the CPU 111 of the PC 110 (for example, the (verification) execution unit 350) draws various result images in the result image display area 703 in accordance with the order of the process flows set in the process flow drawing area 702. (indicate.

When the process of step S603 ends, the process of the flowchart of FIG. 13 ends.
As described above, the “overall execution process” of the process flow in step S115 of FIG. 6 is performed.

As described above, the PC 110 (information processing apparatus) of the image processing system 100 according to the present embodiment performs the following processing.
Specifically, in the PC 110, a module / source code master table 311 (FIG. 4) in which a module indicating processing related to image processing and a source code corresponding to each module are associated with each other, and a processing flow in which a plurality of modules are combined. 5, a processing flow / input / output information table (processing flow / input / output parameter table 312 in FIG. 5) including information indicating the execution order of the modules, input information and output information related to processing of the modules. ) Is stored in the external memory 116 (or RAM 112) (storage step).
When an instruction to change the module is given to the processing flow (for example, S104 / YES in FIG. 6), the information in the processing flow / input / output parameter table 312 is changed according to the instruction to change. (For example, S204 in FIG. 8, S402 in FIG. 11, S505 in FIG. 12, etc .: change step).
Then, the source code is generated for each module using the information in the processing flow / input / output parameter table 312 and the information in the module / source code master table 311 changed in the changing step (for example, FIG. 8). S206, S304 in FIG. 9, S403 in FIG. 11, S507 in FIG. 12, etc .: source code generation step). Thereafter, an object code is generated based on the source code generated in the source code generation step (object code generation step).
Then, using the generated object code, processing is executed for each module of the processing flow / input / output parameter table 312 changed in the changing step (for example, S207 in FIG. 8, S305 in FIG. 9, S404 in FIG. 11, S508 in FIG. 12, etc .: processing execution step). Thereafter, the result image for each module obtained by executing the process in the process execution step is displayed in the result image display area 703 of the CRT 130 as the display device (for example, S208 in FIG. 8, S306 in FIG. 9, (S405 in FIG. 11, S509 in FIG. 12, etc .: result image display step).
According to such a configuration, for each module in the processing flow in which a plurality of modules are combined, the processing result image is displayed on the display device. Therefore, even when an instruction to change the module is given, Modules can be specified, and the development load of logic related to image processing (that is, processing flow related to image processing) can be reduced. This makes it possible to construct an efficient image processing logic (processing flow).

  Furthermore, the PC 110 displays the processing flow set in the processing flow / input / output parameter table 312 in the processing flow drawing area 702 of the CRT 130 (processing flow display step), and further, the processing flow / input changed by the changing step. The processing flow of the output parameter table 312 is changed and displayed in the processing flow drawing area 702 of the CRT 130 (for example, S205 in FIG. 8, S402 in FIG. 11, S506 in FIG. 12, etc .: processing flow change display step).

  Furthermore, when an instruction to change a module is given to the processing flow in the processing flow drawing area 702, the PC 110 further displays a parameter editing screen 704 for editing parameters of the module on the CRT 130 (for example, FIG. S202 of FIG. 8, S302 of FIG. 9, S503 of FIG. 12, etc .: parameter edit screen display step), and in the source code generation step, the source code is further generated using the parameters of the module edited on the parameter edit screen 704. It is trying to generate.

(Other embodiments of the present invention)
3 constituting the PC 110 (information processing apparatus) according to the embodiment of the present invention described above, and the steps shown in FIGS. 6, 8, 9, and 11 to 13 showing the control method of the PC 110. Can be realized by the CPU (111) of the computer executing a program stored in the ROM (113), the external memory (116) or the like. This program and a computer-readable recording medium recording the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  In the present invention, a software program for realizing the functions of the above-described embodiments (in the embodiment, programs corresponding to the flowcharts shown in FIGS. 6, 8, 9, and 11 to 13) is stored in a system or apparatus. Includes those that are supplied directly or remotely. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

1 is a schematic diagram illustrating an example of a schematic configuration of an image processing system according to an embodiment of the present invention. It is a schematic diagram which shows an example of the hardware constitutions inside PC shown in FIG. It is a schematic diagram which shows an example of a function structure of PC shown in FIG. It is a schematic diagram which shows an example of the module source code master table shown in FIG. It is a schematic diagram which shows an example of the process flow and input / output parameter table shown in FIG. It is a flowchart which shows an example of the process sequence of the control method by PC shown in FIG. It is a schematic diagram which shows embodiment of this invention and shows an example of an image processing program development screen. 7 is a flowchart illustrating an example of a detailed processing procedure of “new addition processing” of a module in step S107 of FIG. FIG. 7 is a flowchart illustrating an example of a detailed processing procedure of “change processing” of a module parameter in step S <b> 109 of FIG. 6. FIG. It is a schematic diagram which shows embodiment of this invention and shows an example of a parameter edit screen. 7 is a flowchart illustrating an example of a detailed processing procedure of a “move process” of a module in step S111 in FIG. 6. 7 is a flowchart illustrating an example of a detailed processing procedure of “insertion processing” of a module in step S113 in FIG. 6. It is a flowchart which shows an example of the detailed process sequence of the "all execution process" of the process flow in step S115 of FIG.

Explanation of symbols

100 image processing system 110 PC (information processing apparatus)
120 Operation input device 130 CRT (CRT display)
140 Camera 150 Illumination Device Controller 160 Illumination Device 170 External Device Controller 181 Inspection Target 180 Stage 111 CPU
112 RAM
113 ROM
114 System bus 115a Input controller 115b Video controller 115c Memory controller 115d, 115e Communication I / F controller 115f Image input controller 116 External memory

Claims (9)

An information processing apparatus for processing an image,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the modules are associated, modules of a processing flow in which a plurality of the modules are combined, and execution of the modules Table storage means for storing a processing flow / input / output information table including information indicating the order, input information and output information relating to processing of each module;
A change unit that changes information in the process flow / input / output information table in response to the change instruction when an instruction to change the module is given to the process flow;
Source code generation means for generating source code for each module, using the processing flow / input / output information table information changed by the changing means and the information of the module / source code master table;
Object code generation means for generating an object code based on the source code generated by the source code generation means;
Processing execution means for executing the processing for each module of the processing flow / input / output information table changed by the changing means, using the object code generated by the object code generating means;
An information processing apparatus comprising: a result image display unit configured to display a result image for each module obtained by execution of processing by the processing execution unit on a display device.   2. The information processing according to claim 1, wherein the result image display means displays the result image according to information indicating the order of the processing flow / input / output information table changed by the changing means. apparatus. Processing flow display means for displaying the processing flow set in the processing flow / input / output information table on the display device;
3. The information processing according to claim 1, further comprising: a processing flow change display unit that changes and displays the processing flow of the processing flow / input / output information table changed by the changing unit on the display device. apparatus. A parameter editing screen display means for displaying a parameter editing screen for editing parameters of the module on the display device when an instruction to change the module is given to the processing flow;
4. The information according to claim 1, wherein the source code generation unit further generates the source code using a parameter of the module edited on the parameter editing screen. 5. Processing equipment.   The change instruction for the module is an instruction for at least one of the instructions relating to the new addition process of the module, the process of moving the module, the process of inserting the module, and the process of changing the parameter of the module. The information processing apparatus according to claim 1, wherein the information processing apparatus includes the information processing apparatus.   The source code generation means includes a processing flow / input / output information table changed by the changing means for modules subsequent to the module determined to be changed when an instruction to change the module is given to the processing flow. 6. The information processing apparatus according to claim 1, wherein a source code is generated for each module using the information on the module and the information on the module / source code master table. The input information and the output information in the processing flow / input / output information table are obtained by executing information of an image buffer for storing an image to be processed by each module and executing the processing by each module, respectively. Information of an image buffer for storing the result image is set,
The information processing apparatus according to claim 1, wherein the changing unit changes the input information and the output information as necessary according to a change instruction related to the module. . A method for controlling an information processing apparatus that performs image processing,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the modules are associated, modules of a processing flow in which a plurality of the modules are combined, and execution of the modules A storage step of storing in the table storage means a processing flow / input / output information table including information indicating the order, input information and output information relating to processing of each module;
A change step of changing information in the process flow / input / output information table in response to the change instruction when an instruction to change the module is given to the process flow;
A source code generation step for generating a source code for each module using the information of the processing flow / input / output information table changed by the changing step and the information of the module / source code master table;
An object code generation step for generating an object code based on the source code generated by the source code generation step;
A process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step;
A result image display step of displaying on a display device a result image for each module obtained by executing the processing in the processing execution step. A program for causing a computer to execute a control method of an information processing apparatus that performs image processing,
Modules indicating processes related to image processing, module / source code master tables in which source codes corresponding to the modules are associated, modules of a processing flow in which a plurality of the modules are combined, and execution of the modules A storage step of storing in the table storage means a processing flow / input / output information table including information indicating the order, input information and output information relating to processing of each module;
A change step of changing information in the process flow / input / output information table in response to the change instruction when an instruction to change the module is given to the process flow;
A source code generation step for generating a source code for each module using the information of the processing flow / input / output information table changed by the changing step and the information of the module / source code master table;
An object code generation step for generating an object code based on the source code generated by the source code generation step;
A process execution step for executing the process for each module of the process flow / input / output information table changed by the change step using the object code generated by the object code generation step;
A program for causing a computer to execute a result image display step of displaying on a display device a result image for each of the modules obtained by executing the processing in the processing execution step.

Images