Information processing terminal, information processing method, and non-transitory computer-readable recording medium to display printer screen转让专利
申请号 : US16979243
文献号 : US11457112B2
文献日 : 2022-09-27
发明人 : Koichi Saito
申请人 : SATO HOLDINGS KABUSHIKI KAISHA
摘要 :
权利要求 :
The invention claimed is:
说明书 :
A present disclosure relates to an information processing terminal, an information processing method, and a program.
Conventionally, a printer connected to a network such as a local area network (LAN) is known (see Japanese Laid-open patent publication 2010-124357 for example).
Incidentally, there is a demand to share a screen of a printer connected to a LAN with an external terminal that is present outside of the LAN. For example, it would be convenient if one can confirm a status of a printer at a location remote from the printer, or one can instruct a specific operation method of the printer, in a situation in which an error occurs in the printer or other person does not understand the operation method of the printer.
However, in order for an external terminal, which is connected to a network outside of a LAN, to acquire an image that is being displayed on a printer connected to the LAN through HTTP/HTTPS communication, the information processing terminal needs to know a private address of the printer from which the image is acquired. Further, since a firewall is conventionally provided to the LAN to which the printer is connected, the external terminal is not able to access the printer, and thus not able to acquire the image that is being displayed on the printer.
Accordingly, the present disclosure aims to allow an information processing terminal that is provided outside of a network to display a screen of a printer connected to the network.
An embodiment according to the present disclosure is an information processing terminal capable of communicating with a server, the information processing terminal including: a request unit configured to request a server to acquire first information that have been displayed on a display screen of a printer capable of communicating with the server; an acquisition unit configured to acquire the first information from the server based on a request from the request unit; and a display control unit configured to control a display unit to display the first information acquired by the acquisition unit.
According to a present disclosure, an information processing terminal that is provided outside of a network is allowed to display a screen of a printer connected to the network.
The present invention relates to a Japanese patent application No. 2018-169724 filed on Sep. 11, 2018 with the Japan Patent Office, entire content of which is incorporated into this specification by reference.
Hereinafter, an embodiment of an information processing system and an information processing method according to the present invention will be explained in detail with reference to the drawings.
(1-1) Overview of an Information Processing System 1
The information processing system 1 according to the present embodiment will be described with reference to
The printers 2A, 2B, . . . in the information processing system 1 of
The management server 5, which is a so-called “cloud server”, receives a message periodically or non-periodically from each of the printers 2A, 2B, . . . to manage an operation status of each printer.
It should be noted that each of the printers 2A, 2B, . . . connected to the LAN 10 will be hereinafter collectively represented as “printer 2” when referred to common issues to the printers.
The printer 2 is capable of communicating with the management server 5 using Message Queuing Telemetry Transport (MQTT) communication, Hyper Text Transfer Protocol Secure (HTTPS), MQTT over Web Socket, or the like. “MQTT” is a lightweight message queue protocol for publish-subscribe type data distribution using TCP/IP. A port number “8883” is allocated for “MQTT” to realize MQTT communication. “HTTPS” realizes HTTP communication securely. A port number “443” is allocated for MQTT over WebSocket to realize MQTT communication through a web browser.
When communicating using MQTT (port: 8883), the printer 2 communicates with the management server 5 via the MQTT broker 7, without the proxy server 6. The MQTT broker is a server that transports messages from a publisher to a subscriber in compliance with MQTT protocol.
When communicating using HTTPS (port: 443) or MQTT over WebSocket (port: 443), the printer 2 communicates with the management server 5 via the proxy server 6.
As illustrated in
The power button 23a is a button for activating power of the printer 2. The display panel 24a is a display panel for providing image information to a user, and may be a liquid crystal panel (LCD) for example.
The operation panel 23b includes a plurality of operation buttons for: selecting an item in a menu screen displayed on the display panel 24a; selecting a function among a plurality of functions; or instructing the printer 2 to perform a predetermined process.
The information processing terminal 3 is remotely situated from the printer 2 for example. The information processing terminal 3 may be a desktop, laptop, or tablet-type computer device, etc. having a communication function. In the information processing system 1 according to the present embodiment, the information processing terminal 3 is a help desk terminal with which one can diagnose the printer 2, or a terminal of a user who wishes to check a screen of the printer 2. Such user may work abroad collaboratively with a user of the printer 2.
In the present embodiment, a user of the information processing terminal 3 does not recognize a private address of the printer 2 connected to the LAN 10. Thus, the user cannot directly access the printer 2 with the information processing terminal 3 via HTTP/HTTPS communication.
In light of the above, the printer 2 and the information processing terminal 3 are arranged to share screen image data. This arrangement will be described later.
(1-2) Block Diagram of Each Apparatus in Information Processing System 1
Next, internal structure of each apparatus of the information processing system 1 according to the present embodiment will be described with reference to
(1-2-1) Printer 2
As illustrated in
The controller 21 includes a microcontroller and memories (namely, a random access memory (RAM) and a read-only memory (ROM)) to control operations of the printer 2. The microcontroller loads a firmware from the ROM when the printer 2 is activated, and executes the firmware. Functions realized by execution of the firmware include: a function for generating print data to be provided to the print unit 25; a function for updating a screen of the display unit 24 based on input signals from the operational input unit 23; and a function for generating image data in response to a command from the outside, etc.
The storage 22 is a storage device such as a hard disk drive (HDD) or a solid state drive (SDD).
The operational input unit 23 includes the power button 23a, the display panel 24a, which are illustrated in
The display unit 24 includes the display panel 24a, which is illustrated in
The print unit 25 includes an ink ribbon, a thermal head having a plurality of heating elements, and a stepping motor (not illustrated) for driving a platen roller to rotate. The print unit 25 is configured to print information on a label as print medium. The print unit 25 causes current to flow through the heating elements of the thermal head selectively, based on the print data. The heating elements heated by the current are pushed, through the ink ribbon, to the label that is fed by the platen roller, and then, color is developed at a portion of the label to which the heating elements are pushed, thereby printing information on the label.
The communication unit 26 is configured to communicate with the external apparatus via MQTT (port: 8883), HTTPS (port: 443), or MQTT over WebSocket (port: 443), etc. When communicating using MQTT (port: 8883), the communication unit 26 communicates with the management server 5 via the MQTT broker 7. When communicating using HTTPS (port: 443) or MQTT over Web Socket (port: 443), the communication unit 26 communicates with the management server 5 via the proxy server 6.
(1-2-2) Management Server 5
As illustrated in
The controller 51 includes a microcontroller and memories (namely, a RAM and a ROM) to control operations of the management server 5. The storage 52 is a large-sized storage device such as a hard disk drive (HDD) to store a variety of databases. The variety of databases may include a database having data of an apparatus name, a connection type, a model name, a status, an installation location, and an operation status for each of a plurality of printers to be managed, that is, the plurality of printers 2A, 2B, . . . connected to the LAN 10.
The controller 51 periodically or non-periodically receives data of a status and an operation status of the printer 2, and updates the database in the storage 52 accordingly.
The communication unit 53 is configured to communicate with the printer 2 via the proxy server 6 using HTTPS (port: 443) or MQTT over WebSocket (port: 443), or communicate with the printer 2 via the MQTT broker 7 using MQTT (port: 8883) for example. Further, the communication unit 53 is configured to communicate with the information processing terminal 3 using HTTPS (port: 443) for example.
The controller 51 records screen image data in the storage 52. The screen image data is uploaded from the printer 2. In response to a screen image data request from the information processing terminal 3, the controller 51 transmits screen image data of the printer 2 stored in the storage 52, to the information processing terminal 3.
(1-2-3) Information Processing Terminal 3
As illustrated in
The controller 31 includes a microcontroller and memories (namely, a RAM and a ROM) to control operations of the information processing terminal 3. A web application for printer management (hereinafter referred to simply as “web application”), which is used on a web browser for example, is installed in the information processing terminal 3.
When predetermined processing is executed by the web application, the web browser acquires data of statuses of the printers 2A, 2B, . . . stored in the management server 5. Then, the web browser acquires data of an operation status of any printer selected from the printers 2A, 2B, . . . , and displays the acquired data on the display unit 34.
Meanwhile, when the web application executes predetermined processing, the web browser acquires screen image data from the management server 5 and displays the screen image on the display unit 34. The screen image data is uploaded by the printer 2 to the management server 5.
The controller 31 functions as a request unit configured to request the management server 5 to acquire screen image data (exemplary information that have been displayed on a display screen) of the printer 2.
The controller 31 functions as an acquisition unit configured to acquire the screen image data of the printer 2 based on a request from the request unit.
The controller 31 functions as a display control unit configured to control the display unit 34 to display the screen image data acquired by the acquisition unit.
The storage 32 is a storage device such as a SSD to store the web browser and the web application.
The operational input unit 33 is an input interface configured to receive an operational input from a user. The operational input unit 33 receives an operational input for a button operation to activate the information processing terminal 3, and an operation input for executing the web browser and the web application, etc. The display unit 34 includes a liquid crystal display panel and a drive circuit that displays image, for example.
The communication unit 35 is configured to communicate with the management server 5 using HTTPS (port: 443) for example.
(1-3) Behavior of Information Processing System
Next, a behavior of the information processing system 1 will be described with reference to
The sequence chart of
Base on the operation, the web browser acquires, from the management server 5, data of each printer in the database stored in the management server 5, and displays a list of the acquired data as shown in a screen G1 of
When receiving a selection input for selecting a printer from the list of printers displayed in the screen G1 (step S10), the web browser of the information processing terminal 3 displays data acquired from the management server 5 with regard to the selected printer (referred to hereinafter printer 2A), as shown by an example in a screen G2 of
For example, the screen G2 includes, with regard to the selected printer 2A, a display area D1 indicating an operation status, a display area D2 indicating time of replacement for consumable parts, and a display area D3 indicating a display status. The display area D3 includes an image IM1 representing the screen of the selected printer 2A and an update button b1 for updating the image IM1.
No image is being displayed as the image IM1 in the screen G2 at this time, since the web browser of the information processing terminal 3 has not acquired screen image data of the printer 2A from the management server 5.
When the update button b1 is operated by the user, the web browser of the information processing terminal 3 transmits a screen image generation request to the management server 5 (step S12). The screen image generation request includes information identifying the printer 2A. When receiving the screen image generation request from the information processing terminal 3, the management server 5 transmits a screen image acquisition command to the printer 2A via the MQTT broker 7 using MQTT (port: 8883) for example (step S14).
In response to the screen image acquisition command, the printer 2A generates screen image data (that is, image data of the screen of the printer 2A), and then transmits the screen image data to the management server 5 using MQTT (port: 8883) for example (step S18). In other words, the screen image data is uploaded by the printer 2A.
It should be noted that, when the port 8883 is blocked at the printer 2A, communication between the printer 2A and the management server 5 may be performed via the proxy server 6 using HTTPS (port: 443) for example.
Once the screen image data is uploaded, the management server 5 records the screen image data in the storage 52, and transmits a upload completion notice to the information processing terminal 3 (step S20).
At step S20, the information processing terminal 3 recognizes that the screen image data corresponding to the screen image generation request has been available. The information processing terminal 3 then transmits a screen image data request to the management server 5 (step S22). The management server 5 responds to the request by transmitting a HTML document including the screen image data (step S24).
The web browser of the information processing terminal 3 analyzes the HTML document which it receives at step S24, and updates the screen of the web application (step S26). For example, the image IM1 in the screen G2 of
As described above, according to the information processing system 1 of the present embodiment, even when the information processing terminal 3, which is situated outside of the LAN 10 to which the printer 2 is connected, does not know a private address of the printer 2, the information processing terminal 3 is able to acquire screen image data of the printer 2 via the management server 5 and display the acquired screen image data. The screen image data is displayed by the web browser, as if the screen image data was acquired and displayed through public internet communication. Therefore, any special procedure is not required by the user of the information processing terminal 3.
Next, the information processing system according to the second embodiment of the present invention will be described. It is to be noted that identical elements in the present embodiment to those in the first embodiment will be denoted by the identical signs, and redundant explanation to the identical elements will be omitted.
The information processing system 1A according to the second embodiment will be described with reference to
The information processing system 1A according to the present embodiment is configured such that a help desk terminal, which is situated outside of the LAN 10 to which the printer 2 is connected, is able to remotely operate the printer 2, even when the help desk terminal does not know a private address of the printer 2. Since the help desk terminal may include the identical configuration to the information processing terminal 3 of the first embodiment, the help desk terminal is denoted as “help desk terminal 3” in the present embodiment. The web application referred to in the first embodiment is installed in the help desk terminal 3.
Although the user terminal 4 is connected to the LAN 10 in the illustration of
In the present embodiment, the controller 31 of the help desk terminal 3 functions as an operation request unit configured to request the management server 5 to operate a specific button among a plurality of buttons (exemplary operation targets) of the printer 2.
The controller 31 of the present embodiment functions as an acquisition unit configured to acquire updated screen image data from the management server 5. The updated screen image data is screen image data that has been updated from the previous screen image data based on an operation request from the operation request unit.
The controller 31 of the present embodiment functions as a display control unit configured to control the display unit 34 to display the updated screen image data acquired by the acquisition unit.
Next, a behavior of the information processing system 1A will be described with reference to
When a person in charge of the help desk terminal 3 tries to operate the printer 2A on the user of the printer 2A behalf, the person selects the printer 2A among the plurality of printers 2A, 2B, . . . on the web application, and performs a remote operation mode. The remote operation mode is one of the functions that the web application provides. With the remote operation mode, an image is displayed as shown in a screen G4 of
When any key is selected among the software keys 401 to 404, the web browser of the help desk terminal 3 transmits a button operation request the management server 5 (step S28). The button operation request includes information of the button that corresponds to the selected key. When receiving the button operation request, the management server 5 transmits a button operation command to the printer 2A (step S40). In the button operation command, the selected button is identified.
In response to the button operation command, the firmware of the printer 2A generates a button operation event with respect to the selected button (step S42).
Based on the button operation event, the firmware of the printer 2A updates the status of the printer 2A as if the selected button was actually operated (step S44), and generates screen image data with respect to a screen after the status has been updated (step S46).
The printer 2A then transmits the screen image data, which is generated at step S46, to the management server 5 (step S48). That is, the screen image data is uploaded by the printer 2A.
It should be noted that, when the port 8883 is blocked at the printer 2A, communication between the printer 2A and the management server 5 may be performed via the proxy server 6 using HTTPS (port: 443) for example.
Once the screen image data is uploaded, the management server 5 records the screen image data in the storage 52, and transmits an upload completion notice to the help desk terminal 3 (step S50).
Due to step S50, the help desk terminal 3 recognizes that the screen image data corresponding to the button operation request has been available. The help desk terminal 3 then transmits a screen image data request to the management server 5 (step S52). The management server 5 responds to the request by transmitting a HTML document including the screen image data (step S54).
The web browser of the help desk terminal 3 analyzes the HTML document which it receives at step S54, and updates the screen of the web application (step S56). For example, when the software key 403 (see
As described above, according to the information processing system 1A of the present embodiment, even when the help desk terminal 3, which is situated outside of the LAN 10 to which the printer 2 is connected, does not know a private address of the printer 2, the help desk terminal 3 is able to remotely perform an operation of the printer 2 via the management server 5.
Next, the information processing system according to the third embodiment of the present invention will be described. It is to be noted that identical elements in the present embodiment to those in the first or the second embodiment will be denoted by the identical signs, and redundant explanation to the identical elements will be omitted.
The information processing system according to the present embodiment is the same as that according to the second embodiment in that the help desk terminal 3 remotely performs an operation of the printer 2 via the management server 5. Different from the second embodiment is that, in the third embodiment, a user terminal 4 (exemplary user terminal device) connected to the LAN 10 is involved. It is to be noted that a system configuration of the information processing system according to the present embodiment is as shown in
In the present embodiment, the help desk terminal 3 does not select a software key corresponding to a button to be remotely operated. Rather, the help desk terminal 3 serves to support a user of the user terminal 4 connected to the LAN 10 in operating a software key. An operation of a software key (that is, an operation of a software key corresponding to a button to be remotely operated) is performed by the user terminal 4. In response to the operation to the software key by the user terminal 4, the corresponding remote operation to the printer 2 is performed. In order to realize this scheme, the web application, which has been referred to in the first embodiment, is installed in both the help desk terminal 3 and the user terminal 4.
As shown in
The controller 41 includes a microcontroller and memories (namely, a RAM and a ROM) to control operations of the user terminal 4. The same web application as that installed in the help desk terminal 3 is also installed in the user terminal 4.
The storage 42 is a storage device such as a SSD to store a web browser and the web application.
The operational input unit 43 is an input interface configured to receive an operational input from a user. For example, the operational input unit 43 receives an operational input for a button operation to activate the user terminal 4, an operation input for executing the web browser and the web application, etc. The display unit 44 includes a liquid crystal display panel and a drive circuit that displays image, for example.
The communication unit 45 is configured to communicate with the printer 2 in the LAN 10, and with the management server 5 via the proxy server 6 using HTTPS (port: 443) for example.
The controller 31 of the help desk terminal 3 functions as a display style change request unit configured to request the management server 5 to display the plurality of software keys (exemplary operation targets) of the printer 2 on a display unit 44 of the user terminal 4, such that a display style of a selected software key is different from that of the software key(s) among the plurality of software keys.
The controller 31 of the help desk terminal 3 functions as an acquisition unit configured to acquire information from the management server 5. The acquired information is information (namely, updated information) that is updated based on an operation with respect to the selected software key that have been displayed on the display unit 44.
The controller 31 of the help desk terminal 3 functions as a display control unit configured to control the display unit 44 to display the updated information acquired by the acquisition unit.
Next, a behavior of the information processing system will be described with reference to
It is to be noted that processes in the sequence chart of
It is assumed in the sequence chart of
In the present embodiment, apart from the second embodiment, when any key is selected among the software keys 401 to 410 in the remote operation mode of
When receiving the button lighting request, the management server 5 transmits a button lighting notice to the user terminal 4 (step S32). The button lighting notice includes information regarding the selected software key that has been selected at step S30.
When receiving the button lighting notice, the web browser of the user terminal 4 displays an image in the remote operation mode in such a style that the selected software key is lit. For example, a screen G7 of
When the lit software key is operated by the user, (step S34: YES), the web browser of the user terminal 4 transmits a button operation command to the management server 5 (step S36). The button operation command includes information regarding the operated software key. The management server 5 then transmits a notice of button operation command to the printer 2A (step S40). The notice of button operation command includes information regarding a button corresponding to software key selected at step S36.
Subsequent processes after step S42 are basically the same as those after step S42 in
It is to be noted that, in
Each of the web browsers of the help desk terminal 3 and the user terminal 4 analyzes the HTML document which each receives at steps S54, S55, and updates the screen of the web application (steps S56, S57).
Since the screen of the help desk terminal 3 is updated, a person in charge of the help desk terminal 3 is able to confirm whether or not the user has performed an appropriate operation.
As described above, with the information processing system of the present embodiment, similarly to the second embodiment, the printer 2 can be operated remotely via the management server 5. Further, in the present embodiment, since a user of the printer 2 is involved in a remote operation, the user is able to voluntarily perform an operation of the printer 2, while the help desk terminal 3 supports the user.
The embodiments of the information processing system, the information processing method, and the program according to the present invention have been described in details. However, scope of the present invention is not limited to the aforementioned embodiments described above. The aforementioned embodiments may be improved or modified in a variety of ways to such an extent that does not depart from the spirit of the present invention.
For example, the aforementioned third embodiment has disclosed an example that the screen of the user terminal 4 is displayed such that the selected software key among the plurality of software keys is lit; however, the present invention is not limited to this example. Any other displaying manner may be applied, as long as the selected software key is displayed in a different manner from the other software keys. For example, the selected software key among the plurality of software keys may be displayed in a different color, brightness, pattern, or etc.
The program according to the present invention may be stored in a non-transitory recording medium.