JP5810826B2 - Image processing system, image forming apparatus, control method, and control program - Google Patents

Description

  The present invention relates to an image processing system, an image forming apparatus, a control method, and a control program, and in particular, displays an operation screen of the image forming apparatus on an external terminal and controls the image forming apparatus based on an operation on the operation screen on the external terminal. The present invention relates to an image processing system, an image forming apparatus, a control method, and a control program.

  A system has been proposed in which the operation screen of the first device is transferred to the second device, the operation screen is displayed on the second device, and the first device is controlled based on the operation on the operation screen. This function is also called a remote desktop function, and the operation screen (desktop screen) of the first device is used by the second remote device, and the operation screen is displayed on the second device as if it were the first device. Can be operated.

  The first device is a copier, printer, facsimile transmitter / receiver, and MFP (Multi-Functional Peripheral) which is a combination of these, and the second device is a terminal device such as a PC, notebook PC, or mobile phone. It is conceivable to perform similar control in the image processing system.

  In the above-described system, the first device and the second device communicate with each other to exchange information on the operation screen and information for specifying an instruction input on the operation screen. Processing in the first device proceeds according to the operation.

Japanese Patent Laid-Open No. 11-120016

  As described above, in order to realize the above-described control, it is necessary that communication between the first device and the second device is normally established. If trouble occurs, communication will be interrupted. If communication is interrupted during a work involving a series of operations, the work is interrupted.

  In such a case, for example, there is a problem that it is inconvenient for the user because it is necessary to prepare an alternative terminal device and perform the operation again from the connection to the first device.

  The present invention has been made in view of such problems, and is an image processing system that controls an image forming apparatus based on an operation on the operation screen in an external terminal. An image forming apparatus, a control method for the system, and a control program.

In order to achieve the above object, according to one aspect of the present invention, an image processing system includes an image forming apparatus and a control apparatus that can communicate with each other. The image forming apparatus includes communication means for communicating with the control device, storage means, image forming means, and control means for controlling the image forming apparatus based on a control signal from the control device. In response to a request from the control device, the control means updates the screen transmitted to the control device in response to a process for transmitting the operation screen to the control device and a control signal representing an operation on the operation screen from the control device. , Processing for transmitting the updated screen to the control device, processing for controlling the image forming unit in response to a control signal representing an operation on the operation screen from the control device, and contents of the operation screen transmitted to the control device The process of storing the information for identifying the storage means, and when the disconnection of communication with the control device is detected, the necessity of reconnection is determined based on the control signal from the control device transmitted before the disconnection. Generates an operation screen based on information for identifying the contents of the latest operation screen transmitted to the control device stored in the storage means when it is determined to perform the determination process and reconnection. Operation And a process of transmitting to the control device after reconnecting the screen.

  Preferably, in the process of determining whether or not reconnection is necessary, the control unit differs from the content of the latest operation screen transmitted to the control device from the content of the operation screen first transmitted after the request from the control device. If it is, it is determined that reconnection is necessary.

  Preferably, in the process of determining whether or not reconnection is necessary, the control means, when the disconnection timing is within a predetermined time after receiving the control signal representing the operation on the operation screen from the control device, Judge that reconnection is necessary.

  Preferably, in the process of determining whether or not reconnection is necessary, the control unit performs reconnection when the disconnection timing is after the image forming process in the image forming unit specified by the control signal from the control device is completed. Judge that connection is unnecessary.

  Preferably, when the control unit determines that reconnection is necessary in the process of determining whether reconnection is necessary, the control unit further executes a process of determining whether reconnection to the control device is possible based on the state of the control device. To do.

  More preferably, in the process of determining whether or not reconnection to the control device is possible, the control means performs control when there is a response from the control device within a predetermined time after requesting reconnection to the control device. It is determined that reconnection to the device is possible.

  Preferably, in the process of determining whether or not reconnection to the control device is possible, the control means controls the control device when the battery amount of the control device immediately before disconnection obtained from the control device is equal to or higher than a predetermined level. Judge that reconnection to is possible.

  Preferably, when it is determined that reconnection to the control device is impossible in the process of determining whether reconnection to the control device is possible, the control unit further selects a control device other than the control device as the device to be reconnected. Execute the search process.

  More preferably, the control unit further executes a process of storing the communication history of the control device in the storage unit when the communication disconnection is detected, and the control unit uses a predetermined search condition in the search process. The communication history is searched, and the device specified by the corresponding communication history is determined as another control device.

  More preferably, the search condition includes at least one of a user, a communication time, and an operating system (OS) used.

  Preferably, when the control unit reconnects to another control apparatus, the process of requesting reconnection to another control apparatus prior to the process of transmitting the operation screen to the control apparatus after reconnection. When a control signal instructing reconnection is received from another control device in response to a request, the control means executes processing for transmitting the operation screen to the reconnected control device.

  Preferably, when reconnecting to another control device, the control means further executes a process of notifying reconnection to a destination associated with the user of the control device that transmitted the control signal before disconnection of communication. .

According to another aspect of the present invention, the image forming apparatus is an image forming apparatus capable of communicating with the control device, and includes communication means for communicating with the control apparatus, storage means, image forming means, and control device. Control means for controlling the image forming apparatus based on the control signal. In response to a request from the control device, the control means updates the screen transmitted to the control device in response to a process for transmitting the operation screen to the control device and a control signal representing an operation on the operation screen from the control device. , Processing for transmitting the updated screen to the control device, processing for controlling the image forming unit in response to a control signal representing an operation on the operation screen from the control device, and contents of the operation screen transmitted to the control device The process of storing the information for identifying the storage means, and when the disconnection of communication with the control device is detected, the necessity of reconnection is determined based on the control signal from the control device transmitted before the disconnection. Generates an operation screen based on information for identifying the contents of the latest operation screen transmitted to the control device stored in the storage means when it is determined to perform the determination process and reconnection. Operation And a process of transmitting to the control device after reconnecting the screen.

According to still another aspect of the present invention, the control method is a control method for an image processing system including an image forming apparatus and a control apparatus that can communicate with each other, and the image forming apparatus receives a request from the control apparatus. and transmitting the operation screen in the control device, control device, and a table Shimesuru step an operation screen, the control device, when receiving an operation in the operation screen displayed, images a control signal corresponding to the operation A step of transmitting to the forming apparatus, a step of the image forming apparatus updating the screen transmitted to the control apparatus in response to the control signal, a step of transmitting the updated screen to the control apparatus, and the image forming apparatus receiving the control signal and performing the images forming process according, the image forming apparatus, and storing information specifying the content of the transmission operation screen to the control device to memorize means, the image forming apparatus, control When disconnection of the communication with the device is detected, and determining the necessity of re-connection based on a control signal from than disconnected previously transmitted control device, an image forming apparatus, a reconnection If it is determined that the performing, serial generates an operation screen based on information specifying the contents of the latest operation screen has been transmitted to the control device stored in憶means, after reconnecting the generated operation screen Transmitting to the control device.

According to still another aspect of the present invention, the control program is a control program for causing a computer included in the image forming apparatus to execute processing, and transmits an operation screen to the control device in response to a request from the control device. In response to a control signal representing an operation on the operation screen from the control device, the step of updating the screen transmitted to the control device and transmitting the updated screen to the control device, and the operation screen from the control device The step of controlling the image forming unit included in the image forming apparatus according to the control signal representing the operation and the information specifying the content of the operation screen transmitted to the control unit are stored in the storage unit included in the image forming apparatus. a step of, the control unit and when the disconnection of the communication has been detected, the re-connection based on the control signal from the control unit that was previously transmitted from the cutting The operation screen is generated based on the information for identifying the content of the latest operation screen transmitted to the control device stored in the storage means when it is determined to perform reconnection and the step of determining whether or not to reconnect. And causing the computer to execute a step of transmitting the generated operation screen to the control device after reconnection.

  According to the present invention, in an image processing system that controls an image forming apparatus based on an operation on the operation screen on an external terminal, even when communication between the external terminal and the image forming apparatus is disconnected, it is possible to seamlessly The image forming apparatus can be controlled.

It is a figure which shows the specific example of a structure of the image processing system concerning embodiment. 2 is a diagram illustrating a specific example of a hardware configuration of an MFP included in an image processing system. FIG. 3 is a diagram illustrating a specific example of an operation panel of an MFP. FIG. It is a figure which shows the specific example of the hardware constitutions of the external device contained in an image processing system. It is a figure showing the operation | movement outline | summary in an image processing system. It is a figure showing the specific example of connection information. It is a figure which shows the specific example of the setting information of a remote desktop. It is a figure which shows the specific example of the operation screen displayed on an external device. It is a figure which shows the specific example of log | history information. It is a figure showing the flow of operation | movement for the reconnection in FIG.5 S9. 2 is a diagram illustrating a specific example of a functional configuration of an MFP. FIG. 3 is a flowchart showing an operation flow in the MFP. It is a flowchart showing the specific flow of the operation | movement for reconnection in step S113 of FIG.

  Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same parts and components are denoted by the same reference numerals. Their names and functions are also the same.

<System configuration>
FIG. 1 is a diagram showing a specific example of the configuration of the image processing system according to the present embodiment.

  Referring to FIG. 1, the image processing system includes an MFP (Multi-Functional Peripheral) 100 as an image forming apparatus, and a portable terminal 200A and a PC (Personal Computer) 200B as control apparatuses, and these are a network 300. It is connected to the. The portable terminal 200A and the PC 200B are representatively referred to as an external device 200.

  The external device 200 may be any device as long as it can be connected to the network 300 and can input an instruction from the user. Examples of the mobile terminal 200A include a mobile phone, a tablet terminal, and a small PC.

  The network 300 corresponds to a local area network (LAN), for example, and may be a wired connection or a wireless connection.

  The image processing apparatus is not limited to the MFP, and may be other apparatuses such as a printer, a facsimile transceiver, and a copier. The MFP 100 is an image processing apparatus having a combination of these functions.

<Device configuration>
FIG. 2 is a diagram illustrating a specific example of the hardware configuration of the MFP 100.

  Referring to FIG. 2, MFP 100 includes a CPU (Central Processing Unit) 10 that is an arithmetic device for overall control, a ROM (Read Only Memory) 11 for storing a program executed by CPU 10, and the like. A RAM (Random Access Memory) 12 for functioning as a work area when the CPU 10 executes the program, a scanner 13 for optically reading a document placed on a document table (not shown), and obtaining image data; A printer 14 for fixing image data on printing paper, an operation panel 15 including a touch panel for displaying information and receiving operation inputs to the MFP 100, and a memory 16 for storing image data A network controller 17 for controlling communication via the network 300

FIG. 3 is a diagram illustrating a specific example of the operation panel 15.
Referring to FIG. 3, operation panel 15 includes a touch panel 51 and an operation key group 52. The touch panel 51 is configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel, and displays an operation screen to specify an indicated position on the operation screen. CPU10 displays an operation screen on a touchscreen based on the data for displaying the screen memorize | stored beforehand.

FIG. 4 is a diagram illustrating a specific example of the hardware configuration of the external device 200.
Referring to FIG. 4, external device 200 includes a CPU 20 that is an arithmetic device for overall control, a ROM 21 for storing a program executed by CPU 20, and a work area when the CPU 20 executes the program. An operation panel 25 including a touch panel for displaying information and receiving an operation input to the external device 200, a network controller 27 for controlling communication via the network 300, And a memory 28 for storing telephone directory data and the like.

  Operation panel 25 may have the same configuration as operation panel 15 of MFP 100. That is, as an example, a touch panel configured by overlapping a display device such as a liquid crystal display device and a position indicating device such as an optical touch panel or a capacitive touch panel, and an operation key are included.

  The operation panel 25 of the external device 200 is a specific example of a device that serves as both a display device and an input device. For example, when the external device 200 is a PC 200B, a display, a mouse, and a keyboard are used instead of the operation panel 25. May be provided.

  The CPU 200 displays an operation screen on the touch panel based on data for displaying a screen stored in advance. On the touch panel, an indicated position on the operation screen is specified, and an operation signal indicating the position is input to the CPU 20. An operation signal indicating the pressed key is input to the CPU 20. The CPU 20 specifies the operation content from the pressed key or the displayed operation screen and the indicated position, and executes processing based on the specified operation content.

<Overview of operation>
FIG. 5 is a diagram showing an outline of operations in the image processing system according to the present embodiment.

  In the external apparatus 200, an application for operating the remote desktop is resident and operating. This application corresponds to the MFP model.

  Referring to FIG. 5, when an operation for the application is accepted from operation panel 15 or the like and MFP 100 as an object to be operated on the remote desktop is specified, a screen is requested from external device 200 to MFP 100 (steps). S1). In step S1, for example, a host name and IP address as information for specifying the MFP 100, and a user ID, IP address, host name, and OS (Operating System) version as information for specifying the external device 200 or the user operating the external device 200 are used. The screen is requested by transmitting the application version or the like to the MFP 100.

  When communication for remote desktop is established with the external device 200, the MFP 100 stores information regarding the external device 200 connected by the remote desktop operation as connection information (step S2).

FIG. 6 shows a specific example of connection information.
Referring to FIG. 6, for each external device 200 connected by a remote desktop operation, MFP 100 uses the external device 200 user ID, operating OS version, host as information for identifying external device 200. Name, IP address, application version information, etc. are stored. All of these pieces of information may be transmitted from the external device 200 at the time of the screen request in step S1, or may be stored in advance in the memory 16 and the screen request in step S1. The information may be read from the memory 16 based on the identifiable information included and stored as connection information. Further, the connection information includes information for specifying remote desktop setting information to be described later. In addition to the information shown in FIG. 6, information specifying the timing (date and time) at which the connection is started is also included. Connection information is generated and stored as many as the number of external devices 200 connected by remote desktop.

  In response to the request in step S1, the MFP 100 transmits screen information to the external device 200 (step S3-1). Then, the MFP 100 stores information for specifying the screen information transmitted to the external apparatus 200 for each external apparatus 200 as remote desktop setting information (step S3-2). Remote desktop setting information is generated and stored as many as the number of external devices 200 connected by the remote desktop.

FIG. 7 is a diagram showing a specific example of setting information of the remote desktop.
Referring to FIG. 7, when MFP 100 transmits the screen information in step S <b> 3-1, information specifying the content displayed on the operation screen and information specifying the corresponding connection information are displayed on the remote desktop. Store as setting information. For example, when the information for the operation screen of FIG. 3 is transmitted, the display contents of each setting item of the copy mode displayed on the screen are stored as information for specifying the contents displayed on the operation screen. The

  Note that the screen information transmitted in step S3-1 is screen information for displaying an initial screen having a predetermined content for remote desktop.

  When screen information is received from MFP 100, external device 200 displays an operation screen based on the information (step S4). If the screen shown in FIG. 3 is the initial screen in step S3 and information for the screen is transmitted, an operation screen as shown in FIG. 8 is displayed on the external device 200 in step S4.

  Here, as shown in FIG. 3, the screen of MFP 100 includes an operation screen displayed on touch panel 51 and an operation key group 52, and is used for the operation screen displayed on touch panel 51. Information is transmitted to the external device 200 in step S3.

  Referring to FIG. 8, the operation screen displayed on external device 200 includes an operation screen portion 53 corresponding to the operation screen displayed on touch panel 51 of MFP 100, and a screen portion 54 representing operation key group 52. By executing the application on external device 200, operation screen portion 53 is generated based on information from MFP 100. Also, a screen portion 54 representing operation key group 52 of MFP 100 preset by the application is generated, and these are combined to display the operation screen of FIG.

  External device 200 receives an operation input for the displayed operation screen, and transmits an operation signal based on the operation input to MFP 100 (step S5).

  As an example, a coordinate system as shown in FIG. 8 is set on the operation screen displayed on external device 200, and an operation signal representing the detected touch position in coordinates is transmitted to MFP 100. For example, when it is detected that the position (20, 30) is touched in the coordinate system of FIG. 8, a signal TouchPoint (20, 30) indicating that the position is touched is transmitted as an operation signal.

  When MFP 100 receives the operation signal from external device 200, MFP 100 updates the operation screen on the assumption that the operation has been performed on the operation screen based on the transmitted information, with the coordinate position represented in the operation signal as the touch position. Then, the screen information for displaying the updated screen is transmitted to the external device 200 (step S6-1). Further, the MFP 100 updates the setting information of the remote desktop stored in step S3-2 based on the updated screen information (step S6-2).

  In the image processing system, the above steps S4 to S6-2 are repeated. Thereby, the operation screen of MFP 100 displayed on external device 200 can be operated in the same manner as the operation screen displayed on MFP 100 is operated.

  Here, while communication for remote desktop is established between MFP 100 and external device 200, communication status is regularly notified from external device 200 to MFP 100 (steps S5-1 and S5-). 2, ...).

  This notification can also be used as the transmission of the operation signal in step S5. In other words, when a touch on the operation screen displayed on the external device 200 is detected between the previous notification and the next notification, an operation signal indicating the touched position is transmitted as the communication status. Good. On the other hand, if no touch is made between the previous notification and the next notification, a signal such as NoTouch may be transmitted as a signal indicating that the touch is not made.

  The MFP 100 detects the disconnection of communication with the external device 200 by monitoring the notification from the external device 200 or the transmission of an operation signal also used as the notification (step S7). In other words, while communication is established, notification is made at a predetermined interval as described above. Therefore, if there is no notification beyond the interval, MFP 100 can determine that communication has been disconnected. .

  When the disconnection of communication is detected in step S7, the MFP 100 uses the connection information stored for the external device 200 in step S2 to generate history information that the external device 200 has connected to the remote desktop. (Step S8).

FIG. 9 is a diagram showing a specific example of history information.
9, MFP 100 stores, as history information, in addition to the connection information shown in FIG. 6, the timing at which the connection is started (connection start date and time) and the completion timing (connection completion date and time). To do.

  When MFP 100 detects disconnection in step S7, MFP 100 performs an operation for reconnection (step S9). After the reconnection, the above-described operation is repeated.

FIG. 10 is a diagram showing the flow of operations for reconnection in step S9.
Referring to FIG. 10, as an operation for reconnection, communication is established immediately before the first determination (# 1) for determining whether or not reconnection is performed for the user. Three operations are performed: a second determination (# 2) for determining whether or not reconnection to the external device 200 is possible, and a connection operation (# 3) based on these determination results. Details of these will be described later.

<Functional configuration>
FIG. 11 is a diagram showing a specific example of a functional configuration of MFP 100 for performing the above operation. Each function shown in FIG. 11 is a function mainly formed in the CPU 10 when the CPU 10 reads a program stored in the ROM 11 and executes it on the RAM 12. However, at least a part of the functions may be formed by the hardware configuration shown in FIG.

  Referring to FIG. 11, in memory 16, a connection information storage unit 601 that is a storage area for storing connection information, and a setting information storage unit 602 that is a storage area for storing setting information of a remote desktop, A connection history storage unit 603, which is an area for storing the connection history, is provided.

  Further, referring to FIG. 11, as a function for performing the above operation, MFP 100 receives request input unit 101 for receiving a connection request at the remote desktop from external device 200 via network controller 17, and the request. The connection information management unit 102 for generating connection information about the external device 200 using the information contained in the connection information and storing it in the connection information storage unit 601, and the screen information in response to the request via the network controller 17 A transmission unit 103 for transmitting to the external device 200, an input of an operation signal according to an operation input in the external device 200 based on the screen information, and a signal input unit 106 for receiving notification of a communication status; A screen information management unit 104 for setting an initial screen and updating the operation screen according to an operation signal; Based on the setting information management unit 105 for generating the setting information of the remote desktop, storing it in the setting information storage unit 602, and updating the stored setting information, and the communication status notification from the external device 200 A detection unit 107 for detecting disconnection of communication, and a connection history management unit 108 for generating a connection history for the external device 200 using setting information according to the disconnection of communication and storing the connection history in the connection history storage unit 603. When the disconnection of communication is detected, the first determination that is a determination as to whether or not reconnection is necessary for the user, and the second determination that is a determination as to whether or not reconnection to the external device 200 is possible. A determination unit 109 for performing a search, a search unit 110 for searching for an alternative device when it is determined in the second determination that connection to the external device 200 is impossible, and a determination unit 109 And a connection processing section 111 for performing the process of reconnection in accordance with the cross-sectional results.

  When a notification indicating that the operation on the remote desktop is completed or an operation signal corresponding to the operation indicating completion is input from the external device 200, the setting information management unit 105 deletes the setting information about the external device 200 To do.

  Also, the connection information management unit 102 deletes connection information about the external device 200 from the connection information storage unit 601 when disconnection of communication is detected.

  As a first example of the first determination by the determination unit 109, the determination unit 109 sets in advance the contents of the operation screen represented by the setting information at the time of communication disconnection stored in the setting information storage unit 602. Compared with the contents of the initial screen that has been set, if these are different, and if the communication is disconnected without performing the operation for executing the set mode, the user is reconnected. Is deemed necessary.

  As a second example of the first determination by the determination unit 109, the determination unit 109 displays the contents of the operation screen represented by the setting information at the time of communication disconnection stored in the setting information storage unit 602. Referring to, when communication is disconnected during the operation of external device 200 or within a predetermined time after the operation, it is determined that reconnection is required for the user.

  Note that the operation of the external device 200 means that, for example, a touch position close to the operation panel 25 according to an operation involving a continuous touch for a predetermined time, such as a tap operation, a flick operation, a drag operation, or a pinch operation. This can be detected when the operation signal to be expressed is continuously input. In this case, the determination unit 109 detects that the communication is interrupted at this timing, assuming that the operation is in progress after receiving the operation signal indicating the touch position and then receiving the signal indicating that the touch is not performed. In such a case, it can be determined that the communication has been disconnected during the operation of the external device 200.

  Further, in the first determination, the determination unit 109 combines the determinations of the first example and the second example, and determines that reconnection is necessary when either condition is met. Also good.

  Alternatively, as a third example of the first determination by the determination unit 109, the determination unit 109 stores the contents of the operation screen represented by the setting information at the time of communication disconnection stored in the setting information storage unit 602 or Referring to the last input operation signal, the external device 200 sends an end notification corresponding to an operation such as an operation for ending the remote desktop or an operation for forcibly ending an application for executing the operation of the remote desktop when disconnected. If it is received from, it is determined that reconnection is not necessary for the user.

  As a fourth example of the first determination by the determination unit 109, the determination unit 109 refers to an operation signal input from the external device 200 and performs an operation on the operation screen for a predetermined time before disconnection. If not, it is determined that the user has completed the operation or has forgotten the termination instruction, and it is determined that reconnection is not necessary for the user.

  Further, in the first determination, the determination unit 109 combines the determinations of the third example and the fourth example, and determines that reconnection is not necessary if any one of the conditions is met. Alternatively, the first to fourth examples may be combined.

  When the determination unit 109 determines that reconnection is necessary in the first determination, the determination unit 109 further uses the setting information about the external device 200 stored in the setting information storage unit 602 to further perform the second determination. To do.

  As a first example of the second determination by the determination unit 109, the determination unit 109 makes a connection request to the external device 200 that has performed remote desktop communication, and operates on the external device 200. When a connection response is made within a predetermined time from an application for operating the remote desktop, it is determined that connection to the external device 200 is possible, and when there is no response or no response within a predetermined time, the external device It is determined that connection to the device 200 is impossible.

  When the application receives a connection request from MFP 100 during operation, the application automatically returns a connection response.

  As a second example of the second determination by the determination unit 109, assuming that the battery amount is notified from the external device 200 together with the communication status, the determination unit 109 determines the level at which the battery amount immediately before disconnection is defined. If it is above (for example, 10% or more), it is determined that connection is possible, and otherwise, it is determined that connection to the external device 200 is impossible.

  Further, the determination unit 109 may combine the determinations of the first example and the second example in the second determination.

  The search unit 110 performs an operation for searching for an alternative device when it is determined in the second determination by the determination unit 109 that connection to the external device 200 is not possible.

  As a first example of a search in the search unit 110, the search unit 110 refers to a stored connection history and determines an external terminal that can be substituted from the connection history. In the case of this example, the priority of items used as search conditions among the items stored as the connection history is set in the search unit 110 in advance. The setting may be performed in advance, or may be set or changed by a predetermined operation on the operation panel 15 or an operation by a predetermined user.

  As a search condition, for example, a connection history with which the user matches, a connection history with a new use time, a connection history with a matching OS, and the like can be set. Moreover, these combinations may be sufficient.

  The search unit 110 compares the connection information of the remote desktop and the connection history for the external device 200 whose communication is disconnected according to the setting, and extracts a connection history corresponding to the search condition. Then, the external device corresponding to the connection history is specified as a device that replaces the external device 200.

  As a second example of the search in the search unit 110, the search unit 110 extracts external devices that are in a sleep state (not in use) among external devices connected to the network 300 as candidates for external terminals that can be substituted. To do. In this case, the search unit 110 transmits an availability request to the external device. This request includes a host name, an IP address, and the like as information specifying the MFP 100 that has made the request.

  When an application for remote desktop operation is running on the external device and the external device is in the sleep state, the application sends a response that can be used to the MFP 100 in response to the request. . This response includes a host name, an IP address, and the like as information for specifying the external device that has made the response.

  The search unit 110 receives the response from the external device and identifies the external device as a device that replaces the external device 200.

  The connection processing unit 111 transmits a remote desktop reconnection notification to the original external device 200 when it is determined that the connection is possible, and to the alternative external device when it is determined that the connection is not possible. This notification includes information necessary for reconnection such as a host name and an IP address as information for identifying the MFP 100 that has made the notification, connection information of a remote desktop, and the like.

  The external device that has received this notification is notified by the running application that the notification has been received. This notification may be made, for example, by displaying a shortcut key for instructing reconnection on the operation panel, or a screen including a button for instructing whether reconnection is required pops up on the operation panel. It may be done by displaying. Then, by accepting an operation input instructing reconnection, the application uses the information included in the notification to request the MFP 100 to connect to the remote desktop.

  At this time, the MFP 100 reads out the setting information at the time of disconnection of the external device 200 whose communication has been disconnected from the setting information storage unit 602, generates screen information based on the information, and reconnects to the external device to be reconnected. Send. As a result, the reconnected external device resumes display from the operation screen that was displayed when communication with the external device 200 was disconnected.

  In the second determination by the determination unit 109, when it is determined that reconnection to the original external device 200 is possible, when the external device 200 is reconnected without the notification and communication is disconnected. Screen information for the displayed operation screen may be transmitted.

  Further, in the second determination by the determination unit 109, when it is determined that reconnection to the original external device 200 is possible and reconnection is made to an alternative external device, the connection processing unit 111 You may make it notify to the transmission destination linked | related with the user of the external apparatus 200 by mail etc. that it was reconnected with respect to the said external apparatus. As information specifying the external device, for example, a host name or an IP address can be used. In this way, when reconnection is performed with an external device different from the original, the user can easily grasp which device is reconnected.

<Operation flow>
FIG. 12 is a flowchart showing an operation flow in MFP 100. The operation shown in the flowchart of FIG. 12 is realized by the CPU 10 reading out a program stored in the ROM 11 and executing it on the RAM 12 to exhibit the functions shown in FIG.

  Referring to FIG. 12, upon receiving a remote desktop connection request from external device 200 (YES in step S101), CPU 10 establishes the communication in step S103 and generates connection information. Generate and store remote desktop configuration information based on

  In step S105, the CPU 10 generates screen information and transmits the screen information to the external device. In the first operation in step S <b> 105, the CPU 10 generates screen information for an initial screen and transmits it to the external device 200.

  Thereafter, when an operation signal based on an operation on the operation screen is transmitted from the external device that transmitted the screen information (YES in step S107), in step S109, the CPU 10 updates and transmits the screen information according to the operation signal, Update the setting information of the remote desktop according to the updated screen information.

  When detecting disconnection of remote desktop communication (YES in step S111), the CPU 10 creates and stores a connection history for the external device in step S112, and then performs an operation for reconnection in step S113.

  While the communication is established (NO in step S111), the operations in and after step S105 are repeated until the remote desktop connection is completed (NO in step S115). When the remote desktop connection is completed (YES in step S115), in step S117, the CPU 10 ends the remote desktop communication, and creates and stores a connection history for the external device.

  FIG. 13 is a flowchart showing a specific flow of the operation for reconnection in step S113.

  Referring to FIG. 13, in step S <b> 201, the CPU 10 determines whether reconnection is necessary for the user of the external device 200 as the first determination.

  As a result, if it is determined that reconnection is necessary for the user (YES in step S203), in step S205, the CPU 10 can reconnect the external device 200, which is the original external device, as the second determination. Judge whether there is.

  As a result, when it is determined that the external device 200 can be reconnected (YES in step S207), in step S209, the CPU 10 reads the remote desktop setting information for the original external device 200 and generates an operation screen. Then, screen information for displaying the operation screen is transmitted to the external device 200.

  Thereafter, the operation returns to the operation shown in the flowchart of FIG. 12 and waits for the input of the transmitted operation signal from the external device 200.

  On the other hand, if it is determined in the second determination that reconnection to the original external device 200 is impossible (NO in step S207), the CPU 10 searches for a replaceable external device in step S211.

  As a result, when a replaceable external device is extracted (YES in step S213), the CPU 10 transmits the above information to the extracted external device in step S215, thereby reconnecting with the remote desktop. Notice. In step S217, the CPU 10 notifies the user of the original external device 200 that the user is reconnecting to the substitute external device by transmitting information specifying the substitute external device.

  In step S219, the CPU 10 reads the remote desktop setting information about the original external device 200, generates an operation screen, and transmits the operation screen to the external device that substitutes the screen information for displaying the screen.

  Thereafter, the operation returns to the operation shown in the flowchart of FIG. 12 and waits for the input of the transmitted operation signal from the external device.

  If it is determined that reconnection is not necessary for the user of the original external device 200 (NO in step S203), or if a replaceable external device is not extracted (YES in step S213), FIG. The operation shown in the flowchart ends.

<Effect of Embodiment>
By performing the above operation in MFP 100, in the image processing system, when communication is disconnected during communication with a remote desktop, an operation for reconnecting with the external device or an alternative external device is performed. Reconnection is possible without performing a complicated operation such as an operation for searching and starting communication. Therefore, the MFP can be seamlessly operated on the remote desktop using an external device.

  Furthermore, a program for causing the CPU 10 of the MFP 100 to execute the above-described operation can be provided. Such a program is recorded on a computer-readable recording medium such as a flexible disk attached to the computer, a CD-ROM (Compact Disk-Read Only Memory), a ROM, a RAM, and a memory card, and provided as a program product. You can also. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program according to the present invention is a program module that is provided as a part of a computer operating system (OS) and calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. Also good. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present invention.

  The program according to the present invention may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present invention.

  The provided program product is installed in a program storage unit such as a hard disk and executed. The program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  10 CPU, 11 ROM, 12 RAM, 13 Scanner, 14 Printer, 15, 25 Operation panel, 16, 28 Memory, 17, 27 Network controller, 51 Touch panel, 52 Operation key group, 53, 54 Screen area, 100 MFP, 101 Request input unit, 102 Connection information management unit, 103 Transmission unit, 104 Screen information management unit, 105 Setting information management unit, 106 Signal input unit, 107 Detection unit, 108 Connection history management unit, 109 Judgment unit, 110 Search unit, 111 Connection processing unit, 200 external device, 200A portable terminal, 200B PC, 300 network, 601 connection information storage unit, 602 setting information storage unit, 603 connection history storage unit.

Claims (15)

An image processing system including an image forming apparatus and a control device that can communicate with each other,
The image forming apparatus includes:
Communication means for communicating with the control device;
Storage means;
Image forming means;
Control means for controlling the image forming apparatus based on a control signal from the control apparatus,
The control means includes
A process of transmitting an operation screen to the control device in response to a request from the control device;
In accordance with a control signal representing an operation on the operation screen from the control device, the screen transmitted to the control device is updated, and the updated screen is transmitted to the control device;
Processing for controlling the image forming means in response to a control signal representing an operation on the operation screen from the control device;
Processing for storing in the storage means information identifying the contents of the operation screen transmitted to the control device;
A process of determining whether reconnection is necessary based on a control signal from the control device transmitted before the disconnection when disconnection of communication with the control device is detected;
When it is determined that the reconnection is to be performed, an operation screen is generated based on information specifying the content of the latest operation screen transmitted to the control device stored in the storage unit, and the generated An image processing system for executing a process of transmitting the operation screen to the control device after reconnection.   In the process of determining whether reconnection is necessary, the control means includes the content of the latest operation screen transmitted to the control device and the content of the operation screen transmitted first after the request from the control device. The image processing system according to claim 1, wherein if it is different, it is determined that reconnection is necessary.   In the process of determining whether or not reconnection is required, the control means is configured such that the disconnection timing is within a predetermined time after receiving a control signal representing an operation on the operation screen from the control device. The image processing system according to claim 1, wherein it is determined that reconnection is necessary.   In the process of determining whether or not the reconnection is necessary, the control unit is configured such that the disconnection timing is after the image forming process in the image forming unit specified by the control signal from the control device is completed. The image processing system according to claim 1, wherein it is determined that reconnection is unnecessary.   When the control unit determines that reconnection is necessary in the process for determining whether reconnection is necessary, the control unit further performs processing for determining whether reconnection to the control device is possible based on the state of the control device. The image processing system according to claim 1, wherein the image processing system is executed.   In the process of determining whether or not reconnection to the control device is possible, the control means, when there is a response from the control device within a predetermined time after requesting reconnection to the control device, The image processing system according to claim 5, wherein it is determined that reconnection to the control device is possible. In the process of determining whether or not reconnection to the control device is possible, the control means, when the battery amount of the control device immediately before disconnection obtained from the control device is equal to or higher than a predetermined level, The image processing system according to claim 5, wherein it is determined that reconnection to the control device is possible.   When the control means determines that reconnection to the control device is impossible in the process of determining whether reconnection to the control device is possible, the control means further controls other than the control device as the reconnecting device. The image processing system according to claim 6, wherein a process for searching for an apparatus is executed. The control means further executes a process of storing a communication history of the control device in the storage means when the disconnection of the communication is detected,
9. The control unit according to claim 8, wherein the control unit searches the communication history using a predetermined search condition in the searching process, and determines a device specified by the corresponding communication history as the other control device. Image processing system.   The image processing system according to claim 9, wherein the search condition includes at least one of a user, a communication period, and an operating system (OS) used. When reconnecting to the other control device, the control means requests reconnection to the other control device prior to processing for transmitting the operation screen to the control device after the reconnection. Execute the process to
In response to the request, when the control signal instructing the reconnection is received from the other control device, the control means executes a process of transmitting the operation screen to the control device after the reconnection. The image processing system according to claim 8.   When the control means reconnects to the other control device, the control means further includes a process of notifying reconnection to a destination associated with a user of the control device that transmitted the control signal before disconnecting the communication. The image processing system according to claim 8, which is executed. An image forming apparatus capable of communicating with a control device,
Communication means for communicating with the control device;
Storage means;
Image forming means;
Control means for controlling the image forming apparatus based on a control signal from the control apparatus,
The control means includes
A process of transmitting an operation screen to the control device in response to a request from the control device;
In accordance with a control signal representing an operation on the operation screen from the control device, the screen transmitted to the control device is updated, and the updated screen is transmitted to the control device;
Processing for controlling the image forming means in response to a control signal representing an operation on the operation screen from the control device;
Processing for storing in the storage means information identifying the contents of the operation screen transmitted to the control device;
A process of determining whether reconnection is necessary based on a control signal from the control device transmitted before the disconnection when disconnection of communication with the control device is detected;
When it is determined that the reconnection is to be performed, an operation screen is generated based on information specifying the content of the latest operation screen transmitted to the control device stored in the storage unit, and the generated An image forming apparatus that executes processing for transmitting the operation screen to the control device after reconnection. A control method for an image processing system comprising an image forming apparatus and a control device capable of communicating with each other,
The image forming apparatus receives a request from the controller, and transmitting the operation screen before Symbol controller,
Wherein the controller, the operation screen and table Shimesuru step,
Wherein the controller, when receiving an operation in the displayed the operation screen, and transmitting the control signal corresponding to the operation before Symbol image forming apparatus,
The image forming apparatus updating the screen transmitted to the control device in response to the control signal, and transmitting the updated screen to the control device;
The image forming apparatus, and performing the images forming process in response to said control signal,
A step wherein the image forming apparatus, for storing information for identifying the content of the transmission operation screen to the control device to memorize means,
The image forming apparatus, the step of determining the necessity of re-connection based on a control signal from the control unit and when the disconnection of the communication is detected, and the control unit previously transmitted than before Symbol cutting When,
The image forming apparatus, wherein when it is determined that performing reconnection, the previous SL operation screen based on the information specifying the contents of the latest operation screen has been transmitted to the control device stored in the storage means And generating and transmitting the generated operation screen to the control device after reconnection. A control program for causing a computer included in the image forming apparatus to execute processing,
Transmitting an operation screen to the control device in response to a request from the control device;
Updating the screen transmitted to the control device in response to a control signal representing an operation on the operation screen from the control device, and transmitting the updated screen to the control device;
Controlling image forming means included in the image forming apparatus in response to a control signal representing an operation on the operation screen from the control apparatus;
Storing information specifying the content of the operation screen transmitted to the control device in a storage unit included in the image forming device;
When disconnection of communication with the control device is detected, determining whether reconnection is necessary based on a control signal from the control device transmitted before the disconnection;
When it is determined that the reconnection is to be performed, an operation screen is generated based on information specifying the content of the latest operation screen transmitted to the control device stored in the storage unit, and the generated A control program for causing the computer to execute a step of transmitting the operation screen to the control device after reconnection.

Images