JP2016066159A - Information processing device, information processing system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow communication between an information processing device and a display device for displaying an operation image used for the operation of the information processing device to be performed via common intermediary means regardless of going through or not going through another communication device.SOLUTION: Intermediary means 101 mediates communication in accordance with a web standard between a device including the intermediary means and a user device 20 connected via an external device having a function to mediate communication and an operation device 30 connected without going through the external device. Providing means 102 provides the user device 20 and the operation device 30 with an operation image by communication via the intermediary means 101. Control means 105 controls processing means 103 to perform requested processing when the user device 20 and the operation device 30 have requested the processing on the basis of operation to the operation image.SELECTED DRAWING: Figure 5

Description

  The present invention relates to an information processing apparatus, an information processing system, and a program.

  Patent Document 1 describes a technique for displaying display screen data as an operation panel on an operation unit of an image forming apparatus and a display unit of an external information terminal.

JP2013-256016A

  According to the present invention, communication between an information processing device and a display device that displays an operation image used for the operation is performed via a common mediation unit, whether or not via another communication device. With the goal.

  An information processing apparatus according to claim 1 of the present invention is connected to a processing unit that performs processing, and a first device and a second device that request the processing, and are connected via an external device having a function of mediating communication. Mediating means for mediating communication between the first device and the second device connected without going through the external device and the own device, and an image for inputting the processing request to the first and second devices. And providing means provided via the intermediary means, and control means for controlling the processing means to perform the requested processing when the processing is requested.

  An information processing apparatus according to a second aspect of the present invention is the information processing apparatus according to the first aspect, wherein the intermediary means conforms to a WWW (World Wide Web) standard for the first apparatus, the second apparatus, and the own apparatus. It is characterized by mediating compliant communication.

  An information processing apparatus according to a third aspect of the present invention is the information processing apparatus according to the first or second aspect, wherein the first device includes a communication unit that communicates with the external device, and the second device includes the external device. It has the communication means which communicates with an own apparatus without going through an apparatus, It is characterized by the above-mentioned.

  According to a fourth aspect of the present invention, there is provided an information processing apparatus according to any one of the first to third aspects, wherein the processing by the processing means is performed by communication via the mediation means with the first and second devices. It is characterized by comprising notifying means for notifying the situation.

  An information processing apparatus according to claim 5 of the present invention is characterized in that, in the configuration according to any one of claims 1 to 4, the notification means notifies the situation by communication transmitted from the own apparatus. To do.

  An information processing apparatus according to a sixth aspect of the present invention is characterized in that, in the configuration according to the fifth aspect, the communication transmitted from the own apparatus is a communication based on a WebSocket standard.

  An information processing system according to a seventh aspect of the present invention includes the information processing apparatus according to any one of the first to sixth aspects, and a request unit that requests a process corresponding to the operation when an operation on the operation image is performed. A first device connected to the information processing device via an external device having a function of mediating communication, and request means for requesting processing corresponding to the operation when an operation image is operated. And a second device connected to the information processing device without going through the external device.

  A program according to claim 8 of the present invention connects a computer via processing means for performing processing, and an external device having a function of mediating communication, which is a first device and a second device that request the processing. Mediating means for mediating communication between the first device and the second device connected without going through the external device and the own device, and an image for inputting the processing request, the first and second devices And providing means provided via the intermediary means, and functioning as control means for controlling the processing means to perform the requested processing when the processing is requested.

According to the first, second, third, seventh, and eighth aspects of the invention, the communication between the information processing device and the device for operating the information processing device may or may not pass through another communication device. Can be done through.
According to the invention which concerns on Claim 4, the situation of a process can be transmitted to a user via a common mediation means, also when not via other communication apparatuses.
According to the inventions according to claims 5 and 6, the processing status can be transmitted to the user more quickly than when the status information is transmitted in response to a request from the operating device. Can do.

1 is a block diagram showing an example of the overall configuration of an information processing system according to an embodiment The block diagram which shows an example of the hardware constitutions of a user apparatus Block diagram showing an example of the hardware configuration of the operating device Block diagram showing an example of a hardware configuration of an information processing apparatus Block diagram showing an example of a functional configuration of an information processing system The figure which shows an example of the displayed operation image The figure which shows the example of the status information which is displayed The figure which shows the example of the status information which is displayed The figure which shows another example of the displayed status information The figure which shows an example of the hierarchical structure showing the structure of an information processing system The figure which shows an example of the module group contained in a function part The figure which shows an example of the hierarchical structure showing the structure of the information processing system 1 Sequence diagram showing an example of operation of each device in execution processing Sequence diagram showing another example of operation of each device in execution processing The sequence diagram which shows an example of operation | movement of each apparatus in case the 1st notification method is used The sequence diagram which shows an example of operation | movement of each apparatus in case the 2nd notification method is used The sequence diagram which shows an example of operation | movement of each apparatus in case the 3rd notification method is used Sequence diagram showing an example of the operation of each device when the fourth notification method is used The figure which shows an example of the hardware constitutions of the information processing apparatus of a modification The figure which shows an example of the hardware constitutions of the information processing apparatus of a modification Diagram showing an example of the installation section

[1] Embodiment First, the overall configuration, hardware configuration, and functional configuration of an information processing system according to an embodiment will be described with reference to FIGS.
[1-1] Overall Configuration FIG. 1 is a block diagram illustrating an example of the overall configuration of the information processing system. In FIG. 1, an information processing system 1 including a communication line 2, a communication device 3, an information processing device 10, and a plurality of user devices 20 is illustrated. In the present embodiment, the information processing system 1 is a system that provides a user with functions such as copying, scanning, FAX (facsimile), and printing (output of image data to a medium).

  The communication line 2 is a system for communication including at least one of the Internet, a mobile communication network, a telephone line, and the like. The communication line 2 mediates communication between devices connected to the own system. An information processing apparatus 10 and a communication device 3 are connected to the communication line 2. The communication device 3 is a communication device having a function of mediating communication, such as a router, a hub, and an access point. In this embodiment, the communication device 3 is an access point and performs wireless communication in accordance with the wireless LAN standard.

  The communication device 3 communicates with the information processing device 10 via the communication line 2 while performing wireless communication with the user device 20. That is, the information processing apparatus 10 communicates with the user apparatus 20 via a communication system called the communication line 2 and an external communication apparatus called the communication device 3. Note that the communication device 3 is an example of a communication device to which the user device 20 is connected, and the user device 20 may communicate with the information processing device 10 via another communication device. However, the “other communication device” here does not include the information processing device 10 and the operation device 30. Hereinafter, the term “other communication device” refers to a communication device that is not one of the information processing device 10, the user device 20, and the operation device 30.

  The information processing apparatus 10 is an apparatus that performs processes such as an image forming process for forming an image on a medium and an image reading process for reading an image formed on the medium. These processes are performed when the above-described functions such as copying, scanning, FAX, and printing are provided to the user. The information processing apparatus 10 includes an operation device 30 that is used to operate the own device. The operating device 30 is a device for operating the information processing apparatus 10. The operation device 30 is fixed to the housing of the information processing device 10 and is used by a user who has come to a place where the information processing device 10 is installed. The operation device 30 includes, for example, a liquid crystal display and displays an image for operating the information processing device 10 (hereinafter referred to as “operation image”). The operation image will be described with reference to FIG.

  FIG. 6 is a diagram illustrating an example of the displayed operation image. In the example of FIG. 6, an operation image group A1 for using the copy function is displayed. The operation image group A1 includes an operation image A11 for starting copying. By tapping (tapping) this operation image A11, the user performs an operation corresponding to the operation image A11, that is, an operation for starting copying. When an operation is performed on the displayed operation image, the operation device 30 makes a request corresponding to the operation to the information processing device 10. If the operation image A11 is operated, the operation device 30 performs a process for providing a copy function (specifically, a series of processes including an image reading process and an image forming process; hereinafter referred to as “copy process”). Is made to the information processing apparatus 10. As described above, the operation image includes an image (operation image A11 or the like) for the user to input a processing request to the information processing apparatus 10.

  The user device 20 displays the operation image, and when the operation is performed on the displayed operation image, the user device 20 makes a request for processing corresponding to the operation to the information processing device 10. doing. The user device 20 is, for example, a tablet terminal or a personal computer, and may be carried and used by a user or may be installed and used on a desk. Further, the present invention is not limited to the operation of the information processing apparatus 10 and may be used for other purposes (such as company business).

When the information processing apparatus 10 executes a process based on a request from the operation apparatus 30 or the user apparatus 20, the information processing apparatus 10 transmits information indicating the status of the process being executed (hereinafter referred to as “situation information”) to these apparatuses. Then, the processing status is notified to these devices.
FIG. 7 is a diagram illustrating an example of the displayed status information. If the information processing apparatus 10 executes a copy process, for example, as shown in FIG. 7A, the number information C11 indicating the number of copies completed (the number of copies and the number of pages) or “copying” is performed. ”And status information C1 including copy parameters such as“ monochrome ”,“ A4 ”,“ 100% ”, and“ sort ”.

  Further, when the copy process proceeds and the requested number of copies is completed, the information processing apparatus 10, as shown in FIG. 7B, the number information C21 indicating that the requested number of copies has been completed. And status information C2 including a character string such as “Copy completed” is transmitted. Note that the number information C11 and C21 are expressed in fractions with the number of copies requested as a denominator and the number of copies completed as a numerator. As described above, the status information includes information indicating the progress of the process, information indicating the result of the process, information on the parameters used for the process, and the like. The operation device 30 and the user device 20 are both display devices that display the notified status as shown in FIG. Hereinafter, when the operation device 30 and the user device 20 are not distinguished, they are referred to as the display device 4.

[1-2] Hardware Configuration FIG. 2 is a block diagram illustrating an example of a hardware configuration of the user device 20. The user device 20 is a computer that includes a control unit 21, a storage unit 22, a communication unit 23, a display unit 24, and an operation unit 25. The control unit 21 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and a real-time clock. The CPU is stored in the ROM or the storage unit 22 using the RAM as a work area. The operation of each part is controlled by executing a program. The real time clock calculates the current date and time and notifies the CPU.

  The storage unit 22 includes a hard disk or the like, and stores data, programs, image data, and the like used by the control unit 21 for control. The communication unit 23 is a communication unit including a communication circuit and an antenna that perform wireless communication in accordance with a wireless LAN (Local Area Network) standard. For example, the communication unit 23 performs wireless communication with the communication device 3 illustrated in FIG. That is, the communication unit 23 is a unit that communicates with the above-described other communication devices (communication devices that are not any of the information processing device 10, the user device 20, and the operation device 30. The communication device 3 is an example thereof). The display unit 24 includes, for example, a liquid crystal display and is controlled by the control unit 21 to display an image on the display surface.

  For example, when the device itself is a tablet terminal, the operation unit 25 includes a touch sensor (also referred to as a touch screen or a touch panel) provided on the display surface, a button provided on the housing, and the like described above. The operation data indicating the content of the operation is supplied to the control unit 21. In the case where the own apparatus is a personal computer, the operation unit 25 may include a keyboard and a mouse. The control unit 21 performs control according to the supplied operation data.

  FIG. 3 is a block diagram illustrating an example of a hardware configuration of the controller device 30. The operation device 30 is a computer that includes a control unit 31, a storage unit 32, a communication unit 33, a display unit 34, and an operation unit 35. Hereinafter, blocks (respective units other than the communication unit 33) representing hardware common to the blocks illustrated in FIG. The communication unit 33 includes a communication circuit that performs communication in accordance with a wired LAN standard, and a port into which a connector included in a communication cable (specifically, a LAN cable) is inserted. The communication unit 33 is means for communicating with the information processing apparatus 10 without passing through the other communication apparatuses described above.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus 10. The information processing apparatus 10 is a computer including a control unit 11, a storage unit 12, an image reading unit 13, an image forming unit 14, a first communication unit 15, a second communication unit 16, and a connection unit 17. is there. Hereinafter, blocks (control unit 11 and storage unit 12) representing hardware common to the blocks shown in FIGS. 2 and 3 are given common names and description thereof is omitted. The information processing apparatus 10 includes the above-described operation device 30 that functions as a UI (User Interface) unit. In this embodiment, the control unit 11 controls each unit other than the operation device 30.

  The image reading unit 13 performs an image reading process for reading an image drawn on a document using, for example, a CCD (Charge Coupled Devices) system. The image reading unit 13 optically reads an image of content formed on a medium such as paper and supplies image data representing the read image to the control unit 11. The image forming unit 14 performs an image forming process for forming an image on a medium using, for example, an electrophotographic method. The image forming unit 14 forms an image indicated by the image data supplied from the control unit 11 on a medium such as paper. Note that the above-described methods used for image reading and image formation are examples, and other methods may be used.

  The first communication unit 15 includes a communication circuit that performs communication in conformity with a wired LAN standard, and a port into which a connector included in a communication cable (LAN cable) is inserted, and a device that is connected via the cable. Perform communication processing to communicate. The first communication unit 15 is connected to the communication line 2 illustrated in FIG. 1 and communicates with, for example, the user device 20 via an external device (an external device for the information processing device 10, for example, the communication device 3). The first communication unit 15 is connected to the communication unit 33 of the controller device 30 via a communication cable, and communicates with the controller device 30 without using the above-described external device. That is, the communication unit 33 also communicates with the information processing apparatus 10 without using the external device described above.

  The second communication unit 16 includes a communication circuit for performing FAX communication, and performs processing for exchanging FAX data, that is, FAX communication processing. The connection unit 17 has a slot and the like for connecting storage media such as an SD memory card, and is connected to those storage media. The control unit 11 reads data stored in the storage medium and writes data to the storage medium via the connection unit 17. The operating device 30 has the configuration described in the description of FIG. 3 and communicates with the first communication unit 15. For example, the operation device 30 displays an image indicated by data transmitted from the control unit 11 or transmits data for operating the information processing device 10 to the control unit 11 by performing this communication. It functions as an interface unit (UI unit).

[1-3] Functional configuration Each control unit of the information processing device 10, the user device 20, and the operation device 30 executes a program stored in each storage unit to control each unit, thereby realizing the functions described below. Is done.
FIG. 5 is a block diagram illustrating an example of a functional configuration of the information processing system 1. The information processing apparatus 10 includes an intermediary unit 101, a providing unit 102, a processing unit 103, a notification unit 104, and a control unit 105. The operation device 30 includes an operation unit 300, and the user device 20 includes an operation unit 200.

[1-3-1] Mediation Unit The mediation unit 101 of the information processing device 10 is a unit that mediates communication between the own device (the information processing device 10) and the display device 4. More specifically, the mediating means 101 is an example of the display device 4 (the “first device” of the present invention) connected to the own device via the above-described other communication device (for example, the communication device 3). For example, the user device 20 ) The mediating means 101 mediates communication with a display device (an example of the “second device” of the present invention, for example, the operation device 30) connected to the device itself without passing through another communication device. A communication procedure (so-called communication protocol) used by the mediation unit 101 will be described below.

  The mediating unit 101 mediates communication between the display device 4 (the user device 20 and the operation device 30) and its own device in accordance with the WWW (World Wide Web: hereinafter referred to as “web”) standard. The mediating means 101 is based on the SOAP (Simple Object Access Protocol) standard among the web standards, and mediates communication of data described in XML (Extensible Markup Language) (hereinafter referred to as “XML data”). The mediation unit 101 receives, for example, XML data indicating an HTTP (Hypertext Transfer Protocol) request transmitted from the display device 4 and supplies the XML data to the providing unit 102 described later, or is supplied from the providing unit 102 described later in response thereto. XML data indicating an HTTP response is received and transmitted to the display device 4.

  The mediation unit 101 also complies with the WebSocket standard. Based on this standard, the mediation means 101 provides not only communication of XML data indicating an HTTP request and an HTTP response but also, for example, provision after the display device 4 is connected once by a TCP (Transmission Control Protocol) handshake procedure. It mediates the transmission of XML data from the means 102 to the display device 4 performed at an arbitrary timing. Thereby, in the information processing system 1, not only the so-called pull-type communication based on the HTTP request transmitted from the display device 4, but also the push-type communication transmitted from the information processing device 10 is performed.

  The mediating means 101 includes a providing means 102, a notification means 104, a control means 105, display means 201 and 301 (hereinafter referred to as “display means 401” if they are not distinguished from each other), request means 202 and 302 (hereinafter referred to as “display means 401”). If they are not distinguished from each other, the communication of “request means 402” is mediated. Specifically, the mediating unit 101 mediates communication performed by the providing unit 102 and the notification unit 104 of the information processing device 10 with the display unit 401 of the display device 4, and the requesting unit 402 of the display device 4 is used for the information processing device 10. Each communication with the control means 105 is mediated. In any case, the mediation unit 101 mediates communication with the user device 20 and the operation device 30 using a common communication procedure (communication procedure based on standards such as WWW, SOAP, and WebSocket).

[1-3-2] Providing Unit The providing unit 102 of the information processing apparatus 10 is a unit that provides the operation image described above to the display device 4 via the mediating unit 101. The providing unit 102 provides an operation image to the user device 20 which is an example of the “first device” of the present invention by communication via the mediating unit 101 and the other communication devices described above. The providing unit 102 provides an operation image to the operation device 30 which is an example of the “second device” of the present invention through communication via the mediation unit 101 but not via another communication device.

  The providing unit 102 stores an operation image (specifically, image data indicating the operation image), and XML data indicating an HTTP request for requesting the operation image (hereinafter referred to as “operation image request data”) is an intermediary unit 101. Is transmitted via the intermediary means 101 to the request source, XML data indicating an HTTP response including the operation image requested by the XML data (hereinafter referred to as “operation image data”).

  When the operation image request data is transmitted from the user device 20, the providing unit 102 transmits the operation image data to the user device 20 in response thereto. Further, when the operation image request data is transmitted from the operation device 30, the providing unit 102 transmits the operation image data to the operation device 30 in response thereto. By transmitting the operation image data to the operation image request sources (the user device 20 and the operation device 30) as described above, the providing unit 102 provides the operation images to the request sources.

[1-3-3] Processing Unit The processing unit 103 of the information processing apparatus 10 is a unit that executes processing. The processing unit 103 executes a scan process, a FAX process, a print process (a process for providing a scan function, a FAX function, and a print function, respectively) in addition to the copy process described above. The copy process includes an image reading process by the image reading unit 13 and an image forming process by the image forming unit 14 shown in FIG. The scanning process includes an image reading process, and the FAX process includes a FAX communication process by the second communication unit 16. The print process includes a communication process and an image forming process by the first communication unit 15. In addition to the scan process and the FAX process, the data communication process using the second communication unit 16 and the write process for writing the data to the storage unit 12 and the stored data according to the data acquisition and output method Read processing from the storage unit 12 is included. When executing the process, the processing unit 103 supplies the above-described status information (information indicating the status of the process being executed) to the notification unit 104.

[1-3-4] Notification Unit The notification unit 104 of the information processing apparatus 10 is a unit that notifies the display apparatus 4 of the status of processing executed by the processing unit 103 by communication via the mediation unit 101. In this embodiment, the notification means 104 performs notification using four notification methods from first to fourth. In the first and second notification methods, the notification unit 104 notifies the processing status in response to a request from the display device 4. Specifically, the notification unit 104 describes the status information supplied from the processing unit 103 in the HTTP response to the HTTP request when an HTTP request is transmitted from the display device 4 via the mediation unit 101. By sending the HTTP response to the display device 4 via the mediation unit 101, the processing status is notified.

  In the first notification method, the notification unit 104 first completes the processing executed by the processing unit 103 when there is a processing request (hereinafter referred to as “processing request”) by the HTTP request from the display device 4. Wait until. That is, the “processing” requested here is processing performed by the processing means 103. Then, the notification unit 104 notifies the display device 4 of the described processing result by describing and transmitting the situation when the processing is completed, that is, the processing result, in the HTTP response to the HTTP request that requested the processing. To do.

  In the second notification method, when there is a processing request by the HTTP request from the display device 4, the notification means 104 does not wait for completion of the requested processing, and first receives a processing request by an HTTP response to the HTTP request. Notify that it has been accepted. Thereafter, when an HTTP request describing a request for notification of the status of the processing (hereinafter referred to as “notification request”) is transmitted from the display device 4, the notification means 104 displays the status in the HTTP response to the HTTP request. The state of processing is notified by describing and transmitting information. The display device 4 repeatedly performs a notification request by this HTTP request (so-called polling), and the notification means 104 notifies the status of processing by a response each time it receives a notification request by polling. In the present embodiment, the display device 4 performs polling until a processing result is notified, and the notification unit 104 repeatedly notifies the processing status until the processing result is notified.

  In summary, when the first notification method is used, the notification unit 104 notifies the requesting display device 4 of the processing result by an HTTP response to the HTTP request that has requested the processing. In addition, when the second notification method is used, the notification unit 104 uses a communication different from the HTTP response to the HTTP request that requests the processing, that is, the processing result by the HTTP response to the HTTP request that requests the notification. And the status of other processing is notified to the requesting display device 4. As described above, when the first and second notification methods are used, the notification unit 104 notifies when there is a request (processing request or notification request) from the display device 4 in response to the request (so-called so-called). Pull-type notification).

  When the third and fourth notification methods are used, the notification unit 104 notifies the situation by communication according to a standard different from the HTTP request. Specifically, the notification unit 104 notifies the situation by communication based on the WebSocket standard. In the third and fourth notification methods, the intermediary unit 101 performs a TCP handshake procedure when the display device 4 transmits the above-described operation image request data, for example, and the own device (information processing device 10). And the display device 4 is connected. In this state, for example, when the status information is supplied from the processing unit 103, the notification unit 104 describes the status information in XML data that conforms to the WebSocket standard. The notification unit 104 notifies the processing status by transmitting the XML data to the display device 4 via the mediation unit 101.

  In the third notification method, the notification means 104 first receives a processing request without waiting for completion of the requested processing as in the second notification method when there is a processing request by the HTTP request from the display device 4. The acceptance is notified by an HTTP response to the HTTP request. Thereafter, when the status information is supplied from the processing unit 103, the notification unit 104 transmits XML data describing the supplied status information to the display device 4 even if the notification request by the HTTP request is not received. The processing result and the status of the other processing are notified to the requesting display device 4.

  That is, when the third notification method is used, the notification unit 104 performs the process by communication (specifically, communication conforming to the WebSocket standard) different from the HTTP response to the HTTP request that requested the process. And the status of other processes are notified. This notification is common to the second notification method in that the result of the process and the status of other processes are notified by communication different from the HTTP response to the HTTP request that requests the process. Note that “another communication” in the second notification method refers to an HTTP request transmitted from the display device 4 separately from an HTTP request that requests processing, that is, an HTTP request that requests notification in the above example. It is an HTTP response.

  In the fourth notification method, the notification means 104 is an XML describing the supplied status information when the status information is supplied from the processing means 103 regardless of the presence or absence of a processing request by the HTTP request from the display device 4. The data is transmitted to the display device 4, and the requesting display device 4 is notified of the status represented by the status information. When the fourth notification method is used, the notification unit 104 notifies a predetermined situation such as “out of toner” or “out of paper”. Note that the notification unit 104 may notify the status of the processing individually determined for each display device 4.

As described above, when the third and fourth notification methods are used, the notification unit 104 performs active notification (so-called “so-called notification request”) regardless of whether there is a request (processing request and notification request) based on an HTTP request from the display device 4. Push-type notification).
The first, second, and third notification methods are all methods for notifying the status of the requested process (including the result of the process). In this embodiment, when the display device 4 requests a process, a method for notifying the result of the process is specified. The notification unit 104 notifies the result of processing using the notification method specified by the display device 4.

[1-3-5] Operation Unit The operation unit 200 of the user device 20 and the operation unit 300 of the operation device 30 (referred to as “operation unit 400” if they are not distinguished from each other) are units for operating the information processing apparatus 10. It is. The operation unit 400 is realized, for example, when the display device 4 executes a browser program. The operation unit 200 includes a display unit 201 and a request unit 202, and the operation unit 300 includes a display unit 301 and a request unit 302. When the user device 20 and the operation device 30 are not distinguished from each other, they are referred to as “display unit 401” and “request unit 402”.

[1-3-5-1] Display Unit The display unit 401 (the display unit 201 of the user device 20 and the display unit 301 of the operation device 30) is a unit that displays information and images transmitted from the information processing apparatus 10. is there. The display unit 401 displays, for example, status information described in the XML data transmitted from the notification unit 104 of the information processing apparatus 10 (information indicating a processing result or other processing status). The display unit 401 displays, for example, the situation information C1 and C2 shown in FIG. Another example of the situation information will be described with reference to FIGS.

  FIG. 8 is a diagram illustrating an example of the displayed status information. In this example, status information indicating a status that the toner has run out is displayed. Specifically, status information C3 including a character string “Toner has run out. Please replace.” Is displayed.

  FIG. 9 is a diagram illustrating another example of the displayed status information. In this example, when a storage medium such as an SD memory card storing a plurality of images is connected to the connection unit 17 of the information processing apparatus 10 shown in FIG. 4, a list of thumbnail images of the images stored in the storage medium. The status and result of the process for displaying are displayed. In FIG. 9A, status information C4 including a character string “image list is displayed” and thumbnail images (10 thumbnail images in this example) generated from the loaded image is shown. Has been. FIG. 9B shows status information C5 including a character string “Image list displayed” and a list of thumbnail images generated from all images read from the storage medium.

  In addition, the display unit 401 transmits the above-described operation image request data to the information processing apparatus 10 when the user performs an operation to access a URL (Uniform Resource Locator) of the information processing apparatus 10, for example. The operation image indicated by the operation image data transmitted from the providing unit 102 of the apparatus 10 is displayed. Specifically, the display unit 401 displays the operation image based on parameters such as the arrangement and size of the operation image described in the HTTP response indicated by the operation image data. The operation image displayed in this way is, for example, the operation image group A1 shown in FIG.

  In the operation image group A1, an operation image A11 corresponding to the request to start copying, an operation for selecting parameters such as a magnification of the image to be copied, a sheet on which the copied image is formed, and a color mode of the copied image, respectively. Image groups A12, A13, and A14 are included. The operation image group A12 includes an operation image A15 corresponding to the request to increase the copy magnification by 1% and an operation image A16 corresponding to the request to decrease the copy magnification by 1%. Yes. The operation image group A1 includes operation images displayed by selecting tags such as “image quality adjustment”, “reading method”, “output format”, and “job editing”.

  The operation image groups A12, A13, and A14 are operation images for selecting parameters that should be transmitted to the processing unit 103 when using the copy function. The operation image A11 is an operation image for requesting to execute processing using the parameter selected when the self-portrait is operated. That is, the operation image A11 is an operation image for determining (that is, determining) the content of the request. The display unit 401 displays these operation images based on the above-described operation image data.

  The display unit 401 displays an image (hereinafter referred to as “parameter transmission image”) for transmitting the contents of the currently selected parameter to the user. The display unit 401 displays, for example, a character string of the magnification of the currently selected copy (in this example, “110%”) as a parameter transmission image in the display area B11, and displays the currently selected paper and color mode. The operation image to be represented (in this example, the character string “other magnification”, “A4 plain paper”, “black and white”) is drawn in a different form from the selected image that is not selected (in this example, the line is thickened). (An aspect such as a highlight may be used.) The image expressed in () is displayed as a parameter transmission image. The display unit 401 displays these parameter transmission images based on operations performed on operation images for selecting parameters (for example, operation images A15 and A16).

  The display unit 401 supplies data relating to the displayed operation image to the request unit. The data related to the operation image is data used to determine whether or not the operation image has been operated. For example, the operation image is a data indicating a region where the operation image is displayed (hereinafter referred to as “operation image region”). The display unit 401 supplies data relating to the displayed parameter transmission image to the request unit. The data relating to the parameter transmission image is data indicating the content of the parameter transmitted by the parameter transmission image.

[1-3-5-2] Request means The request means 402 (the request means 202 of the user device 20 and the request means 302 of the operation device 30) responds to the operation of the user when an operation on the operation image is performed by the user. This is a means for making a request to the information processing apparatus 10 by an HTTP request. The request unit 402 makes a request for processing executed by the processing unit 103 (the above-described processing request), a request for notification of the status and result of the processing (the above-described notification request), and the like according to a user operation.

  For example, when the user taps the touch sensor of the operation unit, the request unit 402 determines whether the tapped position is included in the operation image area based on the data supplied from the display unit 401. When the request unit 402 determines that the image is included in the operation image area, the request unit 402 receives an operation on the operation image displayed in the operation image area. When the request unit 402 receives an operation on the above-described request content determination image (the operation image A11 in the example of FIG. 6), the request unit 402 uses the parameters indicated by the data related to the parameter transmission image supplied from the display unit 401. The information processing apparatus 10 is requested to perform processing indicated by the request content determination image. If the operation on the operation image A11 is performed in the state shown in FIG. 6, the request unit 402 requests the information processing apparatus 10 to perform black and white copying on A4 plain paper at a magnification of 110%.

  Specifically, the request unit 402 describes an instruction to perform processing corresponding to the operated request content determination image (in this example, copy processing) using parameters transmitted by the parameter transmission image (this instruction). XML data indicating an HTTP request is generated. The request unit 402 sends the generated XML data to the information processing apparatus 10, thereby requesting the information processing apparatus 10 to process using an HTTP request. The XML data transmitted by the request unit 402 to request processing in this manner is hereinafter referred to as “processing request data”.

  Further, the requesting unit 402 makes a description for designating one of the three notification methods from the first to the third described above in the processing request data. When the copy process is requested, process request data including an instruction is generated. However, depending on the requested process, the process request data may not include the instruction. For example, when a process for turning off the power of the information processing apparatus 10 is requested, the instruction is not included in the process request data.

[1-3-6] Control Unit The control unit 105 of the information processing apparatus 10 requests processing based on the operation on the operation image (for example, the operation image A11 illustrated in FIG. 6) described above. The processing means 103 is controlled to perform the requested processing. Specifically, when the processing request data from the display device 4 is transmitted via the mediation unit 101, the control unit 105 controls the processing unit 103 to perform the processing requested by the processing request data. Let it run. That is, when a process is requested by the HTTP request from the display device 4, the control unit 105 controls the processing unit 103 to execute the requested process. The processing request data, which is XML data transmitted from the display device 4 as an HTTP request, is mediated by the mediating means 101 and supplied to the control means 105.

  For example, the control unit 105 analyzes an instruction included in the processing request data, and controls the processing unit 103 so that the process is executed according to the content of the analyzed instruction. Specifically, the control unit 105 causes the designated process (for example, copy process) to be executed with the designated parameter. Accordingly, the processing unit 103 reads an image from the medium with an image quality and a reading method determined by a user operation, for example, and forms the read image in an output format, magnification, paper, and color mode determined by the user operation. To do.

  When the control unit 105 executes the process, it issues a transaction ID as information for identifying the process to be executed. The control unit 105 stores the issued transaction ID and the communication destination of the request source display device 4 in the storage unit 12 in association with each other. When executing the processing, the control unit 105 supplies the issued transaction ID to the processing unit 103, and the processing unit 103 supplies the transaction ID together with the above-described status information to the notification unit 104.

  The control unit 105 also stores the notification method (any one of the first to third notification methods) described in the processing request data in association with the transaction ID. The notification unit 104 transmits XML data describing the status information supplied together to the communication destination associated with the transaction ID supplied from the processing unit 103. At this time, the notification means 104 transmits the XML data by the notification method associated with the transaction ID, so that the notification by the designated notification method is performed.

[1-4] Hierarchical Structure The configuration of the information processing system 1 will be described with reference to FIGS. 10 and 11 in which the configuration is represented by a hierarchical structure.
FIG. 10 is a diagram illustrating an example of a hierarchical structure representing the configuration of the information processing system 1. The information processing system 1 includes a presentation layer 40, an interface 50, a function layer 60, a middleware layer 70, and a hardware layer 80. The presentation layer 40 is a layer that realizes a function (so-called user interface) for accepting an operation by the user, and functions as the operation unit 400 shown in FIG.

  The presentation layer 40 includes a UI control unit 41, a device control unit 42, and a communication unit 43. The UI control unit 41 is a part that controls the user interface, and displays the above-described operation image and situation information or accepts a user operation. The UI control unit 41 is realized by the display unit 401 shown in FIG. The device control unit 42 requests the information processing apparatus 10 to perform processing as described above based on a user operation, and controls a function layer 60 described later. The device control unit 42 is realized by the request unit 402. The communication unit 43 controls communication performed by the UI control unit 41 and the device control unit 42 with the information processing apparatus 10.

  The interface 50 is a layer that realizes a function that mediates the connection between the presentation layer 40 and the function layer 60. The connection between the presentation layer 40 and the interface 50 is through an external device having a communication function such as the communication device 3 shown in FIG. 1 (connection with the user device 20) or not through such an external device (operation device 30). Connection). The function layer 60 is a layer that realizes a function of processing data in accordance with a target application such as a copy function and a scan function. The middleware layer 70 is a layer that executes general-purpose processing between the function layer 60 and the hardware layer 80. The hardware layer 80 is a layer that physically realizes processing such as image reading and image formation.

  The function layer 60 includes a reception / response unit 61, an event notification unit 62, an operation image management unit 63, an operation image DB (Data Base) 64, a function unit 65 that provides a copy function, a scan function, and the like. Is provided. The reception / response unit 61 receives a processing request indicated by the processing request data transmitted from the presentation layer 40 via the interface 50 and requests the functional unit 65 to perform processing. At this time, the reception / response unit 61 also issues the above-described transaction ID and client ID. The reception / response unit 61 transmits response data indicating a response to the received request to the presentation layer 40 via the interface 50. The response data may only indicate that the request has been accepted, or may indicate status information. That is, the reception / response unit 61 may notify the processing status, and the notification is a pull-type notification by the first and second notification methods described above.

  The event notification unit 62 is supplied with status information via the function unit 65. The event notification unit 62 describes the supplied status information in XML data that conforms to WebSocket, and transmits the XML data to the presentation layer 40 via the interface 50. That is, the notification performed by the event notification unit 62 is a push-type notification using the third and fourth notification methods described above. The operation image management unit 63 manages operation images transmitted to the presentation layer 40. The operation image DB 64 is a database that stores operation images. The function unit 65 is a module group for realizing the function provided to the user by the information processing apparatus 10.

  FIG. 11 is a diagram illustrating an example of a module group included in the functional unit 65. The function unit 65 includes a copy function, a scan function, a FAX function, a print function, a destination table management function (a function for managing destination information), a device management function (a document set state of the image reading unit 13 and a medium of the image forming unit 14). , A function for managing the state of consumables, etc.), an authentication function, a confidential box function (a function for managing an electronic document stored in the information processing apparatus 10), a preview function, a download function (a function for controlling program updates) Modules for realizing a maintenance function (a function for maintaining hardware according to a request from a remote) and a diagnosis function (a function for diagnosing hardware) are included.

  The interface 50 shown in FIG. 10 functions as the mediation unit 101 shown in FIG. The operation image management unit 63 and the operation image DB 64 cooperate to function as the providing unit 102, and the middleware layer 70 and the hardware layer 80 cooperate to function as the processing unit 103. Further, the reception / response unit 61 and the event notification unit 62 function as the notification unit 104 in cooperation, and the reception / response unit 61 and the function unit 65 function as the control unit 105 in cooperation.

  FIG. 12 is a diagram illustrating an example of a hierarchical structure representing the configuration of the information processing system 1. The module group shown in FIG. 11 includes a control unit (hereinafter referred to as “utilization”) that is used in each of the request unit 651, the management unit 652, the image formation control unit 653, the image reading control unit 654, and the communication control unit 655. Control section). For example, when realizing the copy function, the image formation control unit 653 and the image reading control unit 654 serve as a usage control unit, and when realizing the print function, the image formation control unit 653 serves as a usage control unit. In the following, the role of each module will be described by taking as an example the case where a module that implements the print function is executed.

  When an operation for requesting image printing is performed by the user, request data for requesting job activation is transmitted from the presentation layer 40 to the function layer 60 via the interface 50. The reception / response unit 61 receives this request data, analyzes the received request data, and supplies the request data to the module request unit 651 (in this example, the print function request unit 651) according to the content of the request. . The request unit 651 analyzes the supplied request data and requests the middleware layer 70 to generate a job. The middleware layer 70 performs processing for generating the requested job, and notifies the request unit 651 of the processing result. The request unit 651 notifies the presentation layer 40 of the notified processing result via the reception / response unit 61 and the interface 50.

  The presentation layer 40 displays the notified processing result. The middleware layer 70 supplies the generated job to the above-described use control unit (image formation control unit 653 in the case of a print function). The usage control unit generates a user job representing the supplied job in a format for presenting to the user, and supplies data indicating the content of the user job to the management unit 652 via the middleware layer 70. The management unit 652 generates XML data indicating the contents of the user job indicated by the supplied data. The contents of this user job correspond to the situation information described above, and the XML data generated by the management unit 652 is the situation information data described above. The management unit 652 transmits the generated status information data to the presentation layer 40 via the notification unit 62 and the interface 50. In this way, push-type notification regarding the job is performed.

  When an operation requesting processing such as job suspension, cancellation, continuation, and priority change is performed by a user, request data requesting the processing is transmitted from the presentation layer 40 to the function layer 60 via the interface 50. The The reception / response unit 61 receives this request data, analyzes the received request data, and supplies the request data to the module management unit 652 (in this example, the print function management unit 652) according to the content of the request. . The management unit 652 analyzes the supplied request data and requests the middleware layer 70 to perform the requested processing. The middleware layer 70 performs the requested processing and notifies the management unit 652 of the processing result. The management unit 652 notifies the presentation layer 40 of the notified processing result via the reception / response unit 61 and the interface 50. The presentation layer 40 displays the notified processing result.

[1-5] Operation [1-5-1] Operation Based on User Operation The information processing system 1 executes an execution process for executing a process such as image formation according to a user operation based on the above configuration. Do. Operations performed by each device included in the information processing system 1 in the execution process will be described with reference to FIGS. 13 and 14.
FIG. 13 is a sequence diagram illustrating an example of the operation of each device in the execution process. In the example of FIG. 13, a case where the user operates the user device 20 will be described. The execution process is started, for example, when the user performs an operation for starting the browser and accessing the URL of the information processing apparatus 10 on the user apparatus 20.

  First, the user device 20 transmits request data for requesting an operation image to the information processing device 10 via the communication device 3 (step S11). When receiving the request data, the information processing apparatus 10 generates operation image data including the operation image requested by the request data (step S12), and transmits the operation image data to the user apparatus 20 via the communication device 3 (step S13). . The user device 20 displays the operation image included in the received operation image data (step S14). Steps S11 and S14 are operations performed by the display unit 301, and steps S12 and S13 are operations performed by the providing unit 102.

  Next, when the user performs an operation on the displayed operation image, the user device 20 receives the user operation (step S21). Upon receiving a user operation on the instruction content determination image such as the operation image A11 shown in FIG. 6 in step S21, the user device 20 generates process request data indicating a process request determined by the operation on the operation image. (Step S22), the information is transmitted to the information processing apparatus 10 via the communication device 3 (Step S23). When the information processing apparatus 10 receives the processing request data, the information processing apparatus 10 executes the processing according to the instruction indicated by the processing request data (step S24). Steps S21, S22, and S23 are operations performed by the request unit 302. Step S24 is an operation performed by the processing unit 103 and the control unit 105 in cooperation.

  For example, every time the processing status is updated, the information processing device 10 generates the above-described status information data (step S31), and transmits it to the user device 20 via the communication device 3 (step S32). When the situation information data is transmitted, the user device 20 displays the situation information indicated by the situation information data (step S33). Steps S31 and S32 are operations performed by the notification unit 104, and step S33 is an operation performed by the display unit 301. In addition, the communication in steps S11, S13, S23, and S32 are all performed via the mediating means 101 and the communication device 3.

  FIG. 14 is a sequence diagram illustrating another example of the operation of each device in the execution process. FIG. 14 shows a case where the user operates the operation device 30. Also in this case, the operation of each step shown in FIG. 13 is performed, and the operation device 30 performs the operation performed by the user device 20. In addition, the communication in steps S11, S13, S23, and S32 is performed through the mediation unit 101 but not through the communication device 3.

  In the present embodiment, the transmission of the operation image to the user device 20 and the operation device 30 is performed via a common interface called the mediation unit 101. The user device 20 is connected to the mediation unit 101 via the other communication device described above, and the operation device 30 is connected to the mediation unit 101 without going through the other communication device. According to this embodiment, communication between the information processing device and the display device 4 (the user device 20 and the operation device 30 in this embodiment) is common regardless of whether or not the communication is performed via another communication device. It will be done via an intermediary.

  Since the operation device 30 communicates with the information processing device 10 via a communication cable without passing through another communication device, the operation device 30 is installed near the information processing device 10 to some extent in order to maintain communication quality. There is a need. For this reason, in this embodiment, the operating device 30 is used by the user as a local display device 4 that is fixed to the information processing device 10 and used in a place where the information processing device 10 is installed. Yes. On the other hand, since the user device 20 communicates with the information processing device 10 via another communication device, the user device 20 can be installed anywhere away from the information processing device 10. Therefore, the user device 20 is used by the user as a remote display device 4 that is mainly used at a location distant from the information processing device 10. As described above, the information processing apparatus according to the present embodiment communicates with both the local display device 4 and the remote display device 4 via the common mediating means.

  For example, an information processing apparatus having an operation panel needs to include both an interface for an operation panel which is a local display device 4 and an interface for a remote display device 4 connected via a communication device. It was. On the other hand, in this embodiment, since both display devices 4 are connected via a common interface called the mediation means 101, man-hours required for development of the interface are reduced as compared with an information processing device having an operation panel.

  Further, in the present embodiment, the mediation means 101 that realizes the interface mediates communication in accordance with a widely used standard called web, so compared with the case where an interface that does not comply with web standard is used. It is easy to secure developers, and as a result, development costs can be kept low. For the same reason, it is easier for developers to enter. In addition, any device capable of executing a browser by conforming to the web standard can be used as the display device 4.

In addition, the status information is transmitted to the display device 4 by this communication, so that the status of the process is transmitted to the user via the common mediating means whether or not the communication device is connected via another communication device. . In this embodiment, the notification unit 104 uses the WebSocket standard to transmit the status information to the display device 4 via the mediation unit 101, so that when the request from the display device 4 is made, Compared to the case where this transmission is performed in response, the processing status is transmitted to the user earlier.
[1-5-2] Operation by Four Notification Methods Operation performed by each device when the notification unit 104 of the information processing apparatus 10 notifies the situation by the above-described first to fourth notification methods. Will be described with reference to FIGS. 15 to 18. 15 to 17, the device control unit 42 of the display device 4, the reception / response unit 61, the event notification unit 62, the middleware layer 70, and the hardware layer 80 of the information processing apparatus 10 are the main operations. Show. In FIG. 18, among the main subjects of these operations, the reception / response unit 61 is shown instead of the interface 50.

  FIG. 15 is a sequence diagram illustrating an example of the operation of each device when the first notification method is used. The operation shown in FIG. 15 is started, for example, when the user performs an operation of changing parameters for copying (magnification, paper size, color mode, etc.) before copying. First, when the device control unit 42 of the display device 4 accepts an operation for changing a parameter (step S111), XML data (processing request data in this example) describing a request for changing the parameter is sent to the information processing device 10. (Step S112). Step S111 corresponds to step S21 (accepting user operation) shown in FIGS. 13 and 14, and step S112 corresponds to steps S22 and S23 (generation and transmission of processing request data).

  Upon reception of the XML data, the reception / response unit 61 of the information processing apparatus 10 interprets the content of the request described therein (step S113), and executes the processing with the interpreted content in the middleware of the information processing apparatus 10 The layer 70 is instructed (step S114). The middleware layer 70 cooperates with the hardware layer 80 to execute the instructed process, that is, the parameter change (step S115). Steps S113 to S115 correspond to step S24 (execution of processing) shown in FIGS.

  The middleware layer 70 and the hardware layer 80 supply information representing the processing result to the reception / response unit 61 as status information (step S116). The reception / response unit 61 generates XML data (situation information data in this example) describing the supplied situation information (parameter change result in this example) (step S117), and the display device that is the processing request source 4 (step S118). The device control unit 42 of the display device 4 displays the status information described in the transmitted XML data on the display unit of the own device (step S119). Steps S116 and S117 correspond to step S31 (generation of status information data) shown in FIGS. Step S118 corresponds to step S32 (transmission of status information data), and step S119 corresponds to step S33 (display of status information).

  FIG. 16 is a sequence diagram illustrating an example of the operation of each device when the second notification method is used. The operation illustrated in FIG. 16 is started, for example, when the user sets a document on the image reading unit 13 of the information processing apparatus 10 and performs an operation to start copying on the display device 4. First, upon receiving an operation for starting copying (step S121), the device control unit 42 of the display device 4 creates an instruction according to the received operation (step S122). The device control unit 42 transmits the processing request data describing the created instruction sheet to the information processing apparatus 10 via the communication unit 43 illustrated in FIG. 10 (step S123). Upon receipt of the processing request data via the interface 50 shown in FIG. 10, the reception / response unit 61 of the information processing apparatus 10 interprets the content of the requested processing based on the written instruction (Step S124). A transaction ID corresponding to the process is issued (step S125).

  When the reception / response unit 61 generates information indicating a processing instruction (in this example, a copy job; hereinafter referred to as “instruction information”) based on the interpreted processing content, and supplies the information to the middleware layer 70 together with the transaction ID (step) In step S126, the middleware layer 70 and the hardware layer 80 cooperate to execute processing (copy processing) based on the supplied instruction information (step S127). After supplying the instruction information, the reception / response unit 61 is XML data describing information indicating that a request for a copy process has been received (for example, a character string “copy accepted”) and the issued transaction ID. Is transmitted as an HTTP response to the display device 4 (step S131). Note that the operation of step S131 may be performed in parallel with or before the operation of step S126. The device control unit 42 of the display device 4 refers to the HTTP response, displays information indicating that the request has been accepted on the display unit of the own device (step S132), and stores the transaction ID in the storage unit of the own device. (Step S133).

  After receiving the response to the copy processing request, the device control unit 42 of the display device 4 sends the XML data describing the notification request for notification of the copy processing status and the transaction ID stored in step S133 to HTTP. It transmits as a request (step S141). If the copy processing status information associated with the transaction ID has not been supplied yet, the reception / response unit 61 of the information processing apparatus 10 transmits an HTTP response describing that fact to the display apparatus 4 (step S142). ). The operations in steps S141 and S142 are repeated.

  When the middleware layer 70 of the information processing apparatus 10 outputs a copy (an image showing the read original document) to the medium, the middleware layer 70 detects the situation (step S151), and provides status information indicating a situation in which the copy is output to the medium. The transaction ID is supplied to the reception / response unit 61 in association with the transaction ID supplied in step S126 (step S152). The reception / response unit 61 stores the supplied status information and transaction ID in the storage unit 12 (step S153). Upon receiving an HTTP request in which a notification request and a transaction ID are described after step S153 (step S141), the reception / response unit 61 receives status information associated with the transaction ID described in the HTTP request from the storage unit 12. The HTTP response which read and described the status information is produced | generated (step S154).

  When the HTTP response generated by the reception / response unit 61 is transmitted to the display device 4 (step S155), the device control unit 42 of the display device 4 transmits the status information described in the HTTP response to the own device as in step S132. It is displayed on the display unit (step S156). As described above, the information regarding the processing requested by the display device 4 is associated with the transaction ID, so that the processing status is notified to the display device 4 that is the request source of the processing. Thereafter, the operations from step S151 to S156 are repeated until the processing result is notified when the copy processing is completed.

  FIG. 17 is a sequence diagram illustrating an example of the operation of each device when the third notification method is used. The operation shown in FIG. 17 is started when the user performs an operation to start copying as shown in FIG. First, when the device control unit 42 of the display device 4 accepts an operation to start copying (step S121), the XML data describing that the event notification unit 62 applies for a push-type notification is transmitted to the information processing device 10. (Step S161). When receiving the XML data, the reception / response unit 61 of the information processing apparatus 10 transmits the contents of the application described therein to the middleware layer 70 (step S162). The middleware layer 70 receives the transmitted application, and performs settings for future push notification by the event notification unit 62 on the display device 4 (step S163). For example, the middleware layer 70 turns on a flag indicating whether or not to perform the notification.

  Next, the operations from steps S122 to S127 and the operations from steps S131 to S133 shown in FIG. 16 are performed. Subsequently, when the middleware layer 70 and the hardware layer 80 of the information processing apparatus 10 perform the operation of step S151 (detection of copy output), the above-described flag is ON, so that a copy is output to the medium. The situation information indicating the situation and the transaction ID are supplied not to the reception / response unit 61 but to the event notification unit 62 (step S172). The event notification unit 62 generates XML data describing the supplied status information (the number of copies, etc.) and the transaction ID (step S173), and transmits it to the display device 4 (step S174). The device control unit 42 of the display device 4 displays the contents described in the XML data (for example, the status information C1 shown in FIG. 7A) on the display unit of the own device (step S175). Thereafter, the operations from step S151 and steps S172 to S175 are repeated until the processing result is notified when the copy processing is completed.

  FIG. 18 is a sequence diagram illustrating an example of the operation of each device when the fourth notification method is used. The operation illustrated in FIG. 18 is started when a browser is activated in the display device 4 and an operation (such as input of a URL or selection of a bookmark) for accessing the information processing device 10 is performed. First, the device control unit 42 of the display device 4 receives an operation for the access (step S191), and cooperates with the communication unit 43 to connect the interface 50 of the information processing device 10 and the WebSocket standard. Is performed (step S192).

  Thereafter, when a predetermined situation (out of toner, out of paper, etc.) occurs in the information processing apparatus 10, the middleware layer 70 and the hardware layer 80 of the information processing apparatus 10 cooperate to determine the predetermined situation. Is detected (step S201), and status information indicating the detected status is supplied to the event notification unit 62 (step S202). The event notification unit 62 generates XML data describing the supplied status information (step S203), and transmits the XML data to the display device 4 connected to the WebSocket via the interface 50 (step S204). ). The device control unit 42 of the display device 4 displays the status information described in the XML data received in step S204 on the display unit of the own device (step S205).

  As described above, a different situation may be notified for each display device 4. In that case, after step S192, the device control unit 42 transmits XML data describing a situation to be notified to the own device to the information processing device 10 via the communication unit 43. The event notification unit 62 that has received it via the interface 50 stores the status to be notified in association with the destination of the display device 4. When the status information supplied in step S202 represents the stored status to be notified, the event notification unit 62 notifies the status.

[2] Modification The above-described embodiment is merely an example of the present invention, and may be modified as follows. Moreover, you may implement combining embodiment mentioned above and each modification shown below as needed.

[2-1] Communication Standard In the embodiment, the user device 20 includes a communication unit that performs wireless communication in conformity with the wireless LAN standard. Thus, a communication unit that performs communication conforming to the standard of the wired LAN may be provided. In this case, the user device 20 is connected to a wired LAN router or hub via a communication cable. In this case, the communication unit of the user device 20 also functions as a communication unit that communicates with the above-described other communication device (a communication device different from the information processing device 10, such as a router or a hub).

  In the embodiment, the first communication unit 15 of the information processing device 10 and the communication unit 33 of the operation device 30 communicate according to the standard of the wired LAN. However, the present invention is not limited to this. For example, USB (Universal Serial) (Bus) and HDMI (registered trademark) (High-Definition Multimedia Interface) and other communications may be performed. In addition, wireless LAN, Bluetooth (registered trademark), NFC (Near field communication), etc. Wireless communication complying with the standard may be performed. In any case, the communication unit 33 of the controller device 30 communicates with the first communication unit 15 of the information processing device 10 without passing through another communication device such as a router or a hub.

[2-2] Configuration of Operating Device The operating device 30 includes the control unit 31 and the storage unit 32 as illustrated in FIG. 2 in the embodiment, but may not include these.
FIG. 19 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present modification. In the example of FIG. 19, an information processing device 10 a including each unit other than the display unit among the units illustrated in FIG. Also in this modification, the operating device 30a is fixed to the housing of the information processing device 10a. The operating device 30a includes a communication unit 33 and a UI unit 36 illustrated in FIG.

  The communication unit 33 and the UI unit 36 are connected to a bus in the information processing apparatus 10 a and are controlled by the control unit 11. The communication unit 33 is also connected to the first communication unit 15. The UI unit 36 includes a display surface and a touch sensor superimposed on the display surface, and receives an operation from the user and displays an image. The UI unit 36 supplies operation data corresponding to the received user operation to the control unit 11, and the control unit 11 performs processing according to the operation data.

  In the present modification, the function of the operation unit 300 shown in FIG. 5 is realized by the control unit 11 executing a browser program. For example, the display unit 301 receives the operation image data transmitted via the first communication unit 15 via the communication unit 33 and displays the operation image data on the UI unit 36. In addition, the request unit 302 receives an operation on the operation image when the UI unit 36 is tapped. Further, the request unit 302 transmits instruction data indicating an instruction determined by the received operation through the communication unit 33 and the first communication unit 15. As described above, also in this modification, communication between the information processing apparatus and the display apparatus 4 is performed via the common mediating unit whether or not the communication is performed via another communication apparatus.

[2-3] Installation of Operation Device The operation device 30 is fixed to the housing of the information processing device in the embodiment and the modified example described above, but may not be fixed.
FIG. 20 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the present modification. In the example of FIG. 20, the information processing apparatus 10b provided with each part other than a display part among each part shown in FIG. 4, and the operating device 30b are shown. The operating device 30b is a device that includes the units shown in FIG. 3 and functions as the operating means 200 shown in FIG. The housing of the information processing device 10b has a portion (hereinafter referred to as “installation portion”) formed in a shape in which the operation device 30b can be installed.

  FIG. 21 is a diagram illustrating an example of the installation unit. In the example of FIG. 21, the installation part 5 formed in the housing 4 of the information processing apparatus 10b is shown. The installation part 5 has an installation surface 6 and a support part 7. The installation surface 6 is a flat surface formed so as to form an angle with respect to a horizontal plane when the information processing device 10b is installed in a horizontal place, and the operation device 30b is installed. The support portion 7 is a protrusion provided at the lower end of the installation surface 6 and supports the operation device 30b installed on the installation surface 6 from below so that it does not fall off.

  The operating device 30b is connected to the first communication unit 15 via a communication cable, and is used by the user in a state where it is installed on the casing of the information processing device 10b or a desk around it. The operation device 30b communicates with the information processing device 10 without using another communication device (for example, the communication device 3 illustrated in FIG. 1) like the operation device 30 of the embodiment. The operation device 30b may be used for another application by removing the communication cable and taking it to another location. In the example of FIG. 20, instead of the operation device 30b, another device functioning as an operation unit (for example, the user device 20 shown in FIG. 1 or the like) may be connected. Further, the controller device 30b may be connected to the communication device 3 to communicate with the information processing device 10b via the communication device 3 and the communication line 2.

[2-4] Processing means The processing performed by the processing means 103 is not limited to the processing described in the embodiment, and may be any processing. For example, when the information processing apparatus includes a factory machine and an apparatus that controls the information processing apparatus 103, the processing unit 103 performs a process of transporting or processing a material using the machine. Also in this case, the information processing apparatus is operated by performing communication via the common mediating means 101 from either the user apparatus 20 or the operation apparatus 30.

[2-5] Requesting unit In the embodiment, the requesting unit 402 accepts an operation with a touch sensor. However, the present invention is not limited to this, and if the device itself is a tablet terminal, it accepts an operation with a button provided on the housing. Alternatively, if the device itself is a personal computer, an operation may be received with a keyboard, a mouse, or the like.

[2-6] Mediating Means In the embodiment, the mediating means 101 conforms to the SOAP standard. However, the mediating means 101 is not limited to this. Communication may be mediated in compliance. In short, the mediation means 101 may be any mediating means that mediates communication in accordance with standards used on the web. As a result, most devices that can execute the browser can be used as the display device 4.

[2-7] Push Type Notification In the embodiment, the notification unit 104 transmits XML data that conforms to the WebSocket standard in the push type notification in the third and fourth notification methods described above. Not limited to. For example, the notification means 104 maintains the HTTP request transmitted by the request means 402 of the display device 4 using a technique called Comet, and the notification is triggered when the status information to be transmitted is supplied from the processing means 103. The means 104 may transmit an HTTP response describing the status information in response to the maintained HTTP request. In addition, any technique may be used as long as push-type notification is possible.

[2-8] Category of Invention In addition to an information processing device, a display device, a communication device, and an information processing system including these devices, the present invention provides an information processing method for realizing processing performed by these devices. It can be seen as. The present invention can also be understood as a program for causing a computer called an information processing apparatus and a display apparatus to function as the above-described units. This program is provided in the form of a recording medium such as an optical disk storing the program, or in the form of being downloaded and installed on a computer via a communication line such as the Internet, etc. Or you may.

DESCRIPTION OF SYMBOLS 1 ... Information processing system, 2 ... Communication line, 3 ... Communication apparatus, 4 ... Case, 5 ... Installation part, 10 ... Information processing apparatus, 20 ... User apparatus, 30 ... Operation apparatus, 11, 21, 31 ... Control part , 12, 22, 32 ... storage unit, 13 ... image reading unit, 14 ... image forming unit, 15 ... first communication unit, 16 ... second communication unit, 17 ... connection unit, 23, 33 ... communication unit, 24, 34: Display unit, 25, 35 ... Operation unit, 101: Mediation unit 101 ... Providing unit, 103 ... Processing unit, 104 ... Notification unit, 105 ... Control unit, 106 ... Acquisition unit, 200, 300 ... Operation unit, 201, 301 ... Display means, 202, 302 ... Request means

Claims (8)

Processing means for performing processing;
The first device and the second device that request the processing, the first device connected via an external device having a function of mediating communication, and the second device connected without going through the external device. Mediating means for mediating communication with the device;
Providing means for providing an image for inputting the processing request to the first and second devices via the mediating means;
An information processing apparatus comprising: a control unit that controls the processing unit to perform the requested processing when the processing is requested. The information processing apparatus according to claim 1, wherein the mediation unit mediates communication based on a WWW (World Wide Web) standard between the first device, the second device, and the device itself. The first device has communication means for communicating with the external device,
The information processing apparatus according to claim 1, wherein the second apparatus includes a communication unit that communicates with the self apparatus without using the external apparatus. The information processing according to any one of claims 1 to 3, further comprising a notification unit that notifies the first and second devices of a status of processing by the processing unit through communication via the mediation unit. apparatus. The information processing apparatus according to any one of claims 1 to 4, wherein the notification unit notifies the situation by communication transmitted from the own apparatus. The information processing apparatus according to claim 5, wherein the communication transmitted from the own apparatus is communication based on a WebSocket standard. The information processing apparatus according to any one of claims 1 to 6,
A first device connected to the information processing device via an external device having a requesting unit for requesting processing corresponding to the operation when an operation on the operation image is performed, and having a function of mediating communication;
An information processing system comprising: a requesting unit that requests processing corresponding to an operation when an operation on the operation image is performed, and a second device connected to the information processing device without going through the external device. Computer
Processing means for performing processing;
The first device and the second device that request the processing, the first device connected via an external device having a function of mediating communication, and the second device connected without going through the external device. Mediating means for mediating communication with the device;
Providing means for providing an image for inputting the processing request to the first and second devices via the mediating means;
A program for functioning as a control means for controlling the processing means to perform the requested processing when the processing is requested.

Images