JP2022105891A - Information processing apparatus, information processing system, and control method of information processing apparatus - Google Patents

Abstract

To improve a convenience of a user when using a browser on a cloud.SOLUTION: An information processing apparatus capable of communicating with a communication terminal includes acquisition means that acquires Web information, processing means that performs processing of interpreting the Web information, and transmission means that transmits a processing result by the processing means to the communication terminal. The transmission means transmits, when instruction information that can be executed by the communication terminal is acquired by the processing means, the instruction information with priority over image data that is generated by the processing means and is displayed on the communication terminal.SELECTED DRAWING: Figure 4

Description

The present invention relates to an information processing device, an information processing system, a control method of the information processing device, and a program.

Currently, communication terminals equipped with a Web browser (hereinafter referred to as a browser) and having a function of browsing a Web page on the browser have become widespread. By displaying the Web page of the external service through the browser, the communication terminal can cooperate with the external service.
By the way, there is a technique of generating a drawing result of a Web page in a browser operating on a cloud server and transmitting the drawing result to a communication terminal to display the Web page on a terminal device having no browser. Such a browser on the cloud runs on a virtual machine running on a cloud server. Various equipment resources required for the PC are virtually allocated to the virtual machine. Therefore, the browser running on the virtual machine can be operated in the same manner as when running on the PC. Patent Document 1 describes a cloud system that switches the type of browser depending on whether or not it handles privacy-related information.

Japanese Unexamined Patent Publication No. 2014-200072

However, when a browser designed to be able to call the function of the communication terminal is used on the cloud, there is a problem that the communication terminal cannot execute a predetermined function until the drawing result is received. For example, consider a browser designed to make a sound from a communication terminal when a display item generated by an element to which the disabled attribute is given is pressed. The purpose of sounding is to make the user aware that the corresponding element cannot be operated. Here, it is assumed that the Web page has a plurality of <button> elements that await user operation input, and one of the <button> elements is given the disabled attribute. When using a general embedded browser, when the user presses a button based on the <button> element to which the disabled attribute is added, an immediate sound is sounded. However, when using a browser on the cloud, a sound is emitted in accordance with the notification of the drawing result as the processing result of the Web page. Therefore, when it takes time to generate the drawing result, it takes time from the user pressing the button until the sound is heard, which may be confusing to the user.

Therefore, an object of the present invention is to improve the convenience of the user when using the browser on the cloud.

The information processing device of the present invention is an information processing device capable of communicating with a communication terminal, and is transmitted by a first transmission means for transmitting a drawing result of a Web page to the communication terminal and the first transmission means. The drawing of the Web page is updated according to the acquisition means for acquiring the information indicating the operation of the communication terminal for the Web page and the operation indicated by the information acquired from the acquisition means, and the updated drawing result is transmitted to the communication. The second transmission means to be transmitted to the terminal and the processing instruction according to the operation indicated by the information acquired from the acquisition means are given priority over the transmission of the updated drawing result by the second transmission means. It is characterized by having a third transmission means for transmitting to a communication terminal.
The information processing device of another aspect of the present invention is an information processing device capable of communicating with a communication terminal, which is an acquisition means for acquiring Web information, a processing means for interpreting the Web information, and the processing means. The transmission means includes a transmission means for transmitting the processing result of the above to the communication terminal, and the transmission means is generated by the processing means when the instruction information that can be executed by the communication terminal is acquired by the processing means. It is characterized in that the command information is preferentially transmitted over the image data to be displayed on the communication terminal.

According to the present invention, it is possible to improve the convenience of the user when using the browser on the cloud.

It is a figure which shows the hardware configuration example of a virtual machine. It is a figure which shows the hardware configuration example of a communication terminal and a web server. It is a figure which shows the whole configuration example of an information processing system. It is a flowchart which shows the processing flow of the communication terminal of 1st Embodiment. It is a flowchart which shows the process flow of the virtual machine of 1st Embodiment. It is a figure which shows the description example and the drawing result of the Web page of 1st Embodiment. It is a figure which shows an example of the instruction table of 1st Embodiment. It is a flowchart which shows the process flow of the virtual machine of 2nd Embodiment. It is a figure which shows the description example and the drawing result of the Web page of 2nd Embodiment. It is a figure which shows an example of the instruction table of the 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. It should be noted that the following embodiments do not limit the present invention in terms of the scope of claims, and all combinations of features described in the present embodiments are essential for the means for solving the present invention. Not necessarily. The same configuration will be described with the same reference numerals.

<First Embodiment>
The virtual machine 100 in this embodiment operates a browser that can be used by the communication terminal 110 on the cloud. When the virtual machine 100 processes a Web page, if there is an execution command that can be executed by the communication terminal 110, the virtual machine 100 provides the execution command to the communication terminal 110 with priority over the drawing result of the Web page. This makes it possible to promptly execute the operation on the communication terminal 110 even if it takes time to generate the drawing result. In this embodiment, an example of sounding a sound from a communication terminal 110 according to a user operation for a specific element included in a Web page described in HTML format will be described. Specifically, when the user presses a <button> element to which a diskable attribute or a ready attribute is added, or a display item based on the <input> element, a sound is sounded from the communication terminal. A web page is an example of web information. In the present embodiment, the virtual machine 100 is configured to acquire an execution command when a predetermined operation is performed, but the present invention is not limited to this, and the virtual machine 100 is also configured to acquire an execution command when an error notification or the like is received. good.

FIG. 1A is a diagram showing a hardware configuration example of the virtual machine 100 according to the present embodiment. The virtual machine 100 is configured on a cloud server and mainly includes a CPU 101, a ROM 102, a RAM 103, and an interface 104. These are interconnected via a bus 105. The virtual machine 100 is an example of an information processing device. The CPU (Central Processing Unit) 101 controls the entire virtual machine 100. By reading and executing the program stored in the ROM 102 or the like, the CPU 101 executes the processing of the flowchart described later and various functions. The ROM (Read Only Memory) 102 stores a program executed by the CPU 101 and an instruction table 204 (FIG. 2). The RAM (Random Access Memory) 103 functions as a work area of the CPU 101, and temporarily stores data used during program execution.

The interface 104 is a network interface for connecting to the gateway 201 (FIG. 2). Further, even if the interface 104 has a function of connecting to a display device for displaying data held in the ROM 102 or the like or data supplied from the outside, or an input device for inputting data in response to an operation from a user. good. Further, the virtual machine 100 may have a hard disk, a memory card, or the like virtually installed. Further, the virtual machine 100 accesses an external storage device including a virtually removable flexible disk (FD), an optical disk such as a Compact Disk (CD), a magnetic or optical card, an IC card, a memory card, and the like to input data. You may output.

FIG. 1B is a diagram showing a hardware configuration example of the communication terminal 110 and the Web server 120 in the present embodiment. The communication terminal 110 is a terminal device for a user to view and operate a screen, and is, for example, a PC (personal computer) or a tablet terminal. The communication terminal 110 may be an MFP (Multifunction Peripheral). The Web server 120 is a server device for storing a Web page. Hereinafter, the same configuration of the communication terminal 110 and the Web server 120 will be described with respect to the communication terminal 110, and the description of the Web server 120 will be omitted.

The communication terminal 110 mainly includes a CPU 111, a ROM 112, a RAM 113, an HDD 114, an interface 115, and a touch panel 116. These are interconnected via bus 117. The CPU 111 controls the entire device. By reading and executing the program stored in the ROM 112 or the like, the CPU 111 executes the processing of the flowchart described later and various functions. The ROM 112 stores a program executed by the CPU 111. The RAM 113 functions as a work area of the CPU 111, and temporarily stores data used during program execution. The HDD 114 stores various data, setting information, and the like. Further, the HDD 114 of the Web server 120 has a database for storing Web pages.

The interface 115 is a network interface for connecting to a network such as the Internet. Further, the interface 115 of the communication terminal 110 is connected to a peripheral device such as a scanning device or a printer. The communication terminal 110 executes scanning and printing under the control of the CPU 111.
The touch panel 116 has both a screen display function and a user-operated input function. The communication terminal 110 displays the drawing result of the Web page on the touch panel 116 of the communication terminal 110 under the control of the CPU 101. The touch panel 116 of the communication terminal 110 is an example of a display unit. Hereinafter, the touch panel 116 of the communication terminal 110 is referred to as a screen. The drawing result of the Web page includes display items (buttons, input fields, etc.) that accept input operations from the user. The touch panel 116 includes a touch sensor. When the touch operation is detected by the user's finger or the like, the signal detected by the touch sensor is processed by the program for the touch sensor stored in the ROM 112, and the touched position is calculated as the coordinate information on the touch panel 116.
Further, the communication terminal 110 has a built-in voice output device (not shown) and an LED lamp (not shown). The communication terminal 110 sounds a sound and lights an LED lamp under the control of the CPU 101.

Next, an example of the overall configuration of the information processing system according to the present embodiment will be described with reference to FIG. In this system, the image generation system 200 including the virtual machine 100 and the gateway 201, the communication terminal 110, and the Web server 120 can communicate with each other via a network. The image generation system 200 is a cloud system that acquires a Web page from the Web server 120 in response to a request from the communication terminal 110 and generates image data as a drawing result of the acquired Web page. When the image generation system 200 transmits the drawing result of the Web page to the communication terminal 110, the communication terminal 110 displays the drawing result received from the image generation system 200 on the screen. Further, when the communication terminal 110 detects a touch operation on the screen on which the drawing result is displayed, the communication terminal 110 transmits the coordinate information of the touched position to the image generation system 200.

The gateway 201 connects to a network such as the Internet and controls communication between the communication terminal 110 and the virtual machine 100, and communication between the Web server 120 and the virtual machine 100. In the example of FIG. 2, the image generation system 200 is configured by one virtual machine 100, but a load balancer may be arranged so that the load can be distributed, and the image generation system 200 may be configured by a plurality of virtual machines.

The virtual machine 100 performs a process of interpreting a Web page received from the Web server 120, and transmits the process result to the communication terminal 110. In the present embodiment, the virtual machine 100 has functions as a browser 202 and a command transmission unit 203.
The browser 202 performs a process of interpreting a Web page and generates image data (drawing result) to be displayed on the screen of the communication terminal 110. Further, in the present embodiment, the browser 202 acquires an execution command to be transmitted when it is determined that a predetermined operation related to the Web page has been performed on the communication terminal 110. Here, the browser 202 determines that the predetermined operation has been performed when the display position of the predetermined element included in the Web page is pressed. The predetermined element here is a user interface element such as a <button> element or an <input> element to which a predetermined attribute such as a diskable attribute or a ready attribute is added. When the coordinate information is received from the communication terminal 110, the browser 202 determines whether or not the predetermined operation has been performed by comparing the received coordinate information with the coordinate information of the predetermined element. When it is determined that the predetermined operation has been performed, the browser 202 acquires the execution instruction associated with the predetermined operation. The content of the operation and the content of the execution instruction are related by the instruction table 204. The browser 202 reads the instruction table 204 stored in the ROM 102 and acquires an execution instruction related to the content of the operation. After that, the command transmission unit 203 performs a process of transmitting an execution command before the browser 202 performs a process of generating a drawing result. That is, the virtual machine 100 preferentially transmits the instruction information over the drawing result of the Web page.

Next, the flow of processing executed in the information processing system will be described. FIG. 3 is a flowchart showing a processing flow of the communication terminal 110 according to the present embodiment. The processing of the flowchart of FIG. 3 is realized by the CPU 111 of the communication terminal 110 reading the program stored in the ROM 112 into the RAM 113 and executing the program. In the following description, the notation of the process (step) is omitted by adding S at the beginning of each process (step). The processing content shown in the flowchart starts when, for example, the user inputs the URL of the Web page desired to be viewed.

First, in S301, the communication terminal 110 transmits the URL of the input Web page to the virtual machine 100. After that, in S302, the communication terminal 110 displays the drawing result of the Web page received from the virtual machine 100. As a result, the user interface (display item) included in the Web page is displayed on the screen. It is assumed that the Web page of this embodiment contains a moving image.
Next, in S303, the communication terminal 110 determines whether or not to end the screen display. When it is determined that the communication terminal 110 ends the screen display, the display end instruction is transmitted to the virtual machine 100, and the processing of this flowchart ends. If it is determined that the communication terminal 110 does not end the screen display, the process proceeds to S304.
In S304, the communication terminal 110 determines whether or not the screen has been pressed by the user. When the communication terminal 110 determines that the screen has been pressed (Yes in S304), the communication terminal 110 calculates the coordinate information of the pressed position and transmits it to the virtual machine 100 (S305). On the other hand, when the communication terminal 110 determines that the screen is not pressed (No in S304), the process proceeds to S306.

Next, in S306, the communication terminal 110 determines whether or not information has been received from the virtual machine 100. When it is determined that the communication terminal 110 has received the information (Yes in S306), the communication terminal 110 determines whether or not the information is an execution command (S307). On the other hand, when it is determined that the communication terminal 110 has not received the information (No in S306), the process returns to S304.
Subsequently, as a result of the determination in S307, when it is determined that the information received by the communication terminal 110 is an execution command (Yes in S307), the communication terminal 110 performs processing according to the execution command (S308). For example, the communication terminal 110 uses a voice output device to make a sound.
On the other hand, as a result of the determination of S307, when it is determined that the information received by the communication terminal 110 is not an execution command (No of S307), it is determined that the information is the drawing result of the Web page, and the process returns to S302. .. In the present embodiment, the next frame in the moving image is displayed on the screen.

According to the processing of the communication terminal 110 as described above, when the user performs a predetermined operation related to the Web page, the processing corresponding to the operation is promptly executed without waiting for the screen display to be updated. Will be done. That is, when using a browser on the cloud, the delay in the response corresponding to the operation is suppressed, and the user is not confused.

FIG. 4 is a flowchart showing a processing flow of the virtual machine 100 according to the present embodiment. The processing of the flowchart of FIG. 4 is realized by the CPU 101 of the virtual machine 100 reading the program stored in the ROM 102 into the RAM 103 and executing the program.
First, in S401, the virtual machine 100 receives a URL from the communication terminal 110.
Next, in S402, the virtual machine 100 acquires the Web page of the URL received in S401 from the Web server 120. Here, the Web page includes an HTML document, Javascript (registered trademark), a CSS file, an external font, an image, a moving image, and the like. The virtual machine 100 transmits the drawing result of the Web page indicated by the URL received from the communication terminal 110 to the communication terminal 110.
Next, in S403, the virtual machine 100 performs a process of interpreting the Web page acquired in S402. The virtual machine 100 acquires information indicating an operation in the communication terminal 110 for a Web page transmitted to the communication terminal 110, and determines a process based on the information. For example, the virtual machine 100 determines whether or not it is necessary to update the drawing of the Web page based on the information indicating the operation in the communication terminal 110.
Next, in S404, the virtual machine 100 determines whether or not the coordinate information (position information) indicating the pressed position on the screen has been received from the communication terminal 110. When it is determined that the virtual machine 100 has received the coordinate information (Yes in S404), the virtual machine 100 determines whether or not a predetermined operation has been performed in the communication terminal 110 based on the received coordinate information (S405). On the other hand, when it is determined that the virtual machine 100 has not received the coordinate information (No in S404), the process proceeds to S407.

Here, the process of S405 will be specifically described by showing an example of a Web page in FIG. FIG. 5A is a diagram showing a description example of an HTML file constituting a Web page. FIG. 5B is a diagram showing a drawing result generated when the HTML file of FIG. 5A is processed. The drawing result of FIG. 5B includes two buttons 511 and 512 and a moving image area 513 in which the moving image is played.
The description code 501 of FIG. 5 (A) indicates a <button> element to which the diskable attribute is added, and corresponds to the button 511 of FIG. 5 (B). The description code 502 in FIG. 5 (A) indicates a <button> element to which the diskable attribute is not added, and corresponds to the button 512 in FIG. 5 (B). The description code 503 in FIG. 5 (A) indicates a <video> element, and corresponds to the moving image region 513 in FIG. 5 (B).

Subsequently, FIG. 6 shows an example of the instruction table 204. In the instruction table 204, the "Web process process" indicating the operation content 601 related to the Web page and the "Device API" indicating the instruction information 602 that can be executed by the communication terminal 110 are associated with each other. For example, since "Push diskeelement" and "beep01 ()" are associated with each other, when the user presses a display item based on an element to which the diskable attribute is given, a sound (beep01) is sounded on the communication terminal 110. You can see that. That is, the virtual machine 100 instructs the communication terminal 110 to output a sound (beep01) indicating an error when the press is detected in the communication terminal 110 for an element for which the press is not valid. In the example of FIG. 5, when the user presses the button 511 on the screen, a sound is emitted from the communication terminal 110. Similarly, since "Push readonly element" and "beep02 ()" are associated with each other, when the user presses a display item based on an element to which the readonly attribute is given, a sound (beep02) is sounded on the communication terminal 110. You can see that it does. That is, the virtual machine 100 instructs the communication terminal 110 to output a sound (beep02) indicating an error when the communication terminal 110 detects a press on an element for which only reading is permitted. The instruction information 602 is not limited to the sounding, and may be lighting or the like as long as it is an execution instruction that can be executed by the communication terminal 110.

Returning to the description of FIG. In S405, the virtual machine 100 determines whether or not there is an operation registered in the instruction table 204. In the examples of FIGS. 5 and 6, the virtual machine 100 determines whether or not the button 511 is pressed. When it is determined that the virtual machine 100 has an operation registered in the instruction table 204 (Yes in S405), the virtual machine 100 acquires an execution instruction related to the operation from the instruction table 204, assuming that the predetermined operation has been performed. .. In the examples of FIGS. 5 and 6, the virtual machine 100 acquires the execution instruction “beep01 ()”. After that, the virtual machine 100 transmits the acquired execution instruction to the communication terminal 110 (S406). In this case, in the processing flow of the communication terminal 110, it is determined that the information received in S307 is an instruction to be executed, and the execution instruction "beep01 ()" is executed in S306.

In the present embodiment, the virtual machine 100 transmits an execution command to the communication terminal 110, but even if the element name pressed by the user and the attribute given to the element name are transmitted to the communication terminal 110 as command information. good. In that case, it is determined whether or not there is an instruction to be executed based on the instruction information received by the communication terminal 110, and if there is an instruction to be executed, the instruction is executed. The instruction table stored in the communication terminal 110 side is used to determine whether or not there is an instruction to be executed.

Subsequently, in S407, the virtual machine 100 determines whether or not the process of interpreting the Web page is completed. When it is determined that the process to be interpreted by the virtual machine 100 is completed (Yes in S407), the virtual machine 100 generates a drawing result of the Web page (S408) and transmits the drawing result to the communication terminal 110 (S409). The virtual machine 100 updates the drawing of the Web page according to the operation indicated by the information indicating the operation of the communication terminal 110 for the Web page. In this case, in the processing flow of the communication terminal 110, the drawing result of the Web page is displayed on the screen in S302. That is, the virtual machine 100 transmits the updated drawing result to the communication terminal 110. On the other hand, when it is determined that the process to be interpreted by the virtual machine 100 is not completed (No in S407), the process returns to S403. In this way, the virtual machine 100 acquires the information indicating the operation of the communication terminal 110 for the Web page, and gives priority to the transmission of the drawing result of the Web page updated accordingly, and processes the communication terminal 110 according to the operation. Send instructions.
Subsequently, in S410, the virtual machine 100 determines whether or not the display end instruction has been received from the communication terminal 110. When it is determined that the virtual machine 100 has received the display end instruction (Yes in S410), the processing of this flowchart ends. When it is determined that the virtual machine 100 has not received the display end instruction (No in S410), the process returns to S403.

According to the first embodiment as described above, the communication terminal 110 is notified of an instruction to be executed by the communication terminal 110 prior to the drawing result of the Web page. As a result, when the user presses a specific button, for example, a sound is emitted without waiting for the next frame in the video to be displayed, and the user is promptly notified that the specific button cannot be pressed. be able to. That is, when the user operates the screen of the communication terminal 110, the virtual machine 100 can display the screen and output the sound as if the user is operating the browser incorporated in the communication terminal 110. Therefore, it is possible to improve the convenience of the user when using the browser on the cloud.

<Second embodiment>
In the first embodiment described above, when the virtual machine 100 acquires an execution instruction that can be executed by the communication terminal 110, an example of immediately transmitting the execution instruction to the communication terminal 110 has been described. Here, when the communication band connecting the communication terminal 110 and the image generation system 200 is tight, it is necessary to preferentially transmit an execution instruction whose delay cannot be tolerated. For example, if the sound is delayed when the user operates the user interface of the Web page, the user is often confused. On the other hand, even if it takes several hundred ms (milliseconds) from the time when the user presses the print execution button in the Web page until the start of printing, it does not confuse the user. Therefore, in the second embodiment, an example of transmitting an instruction that needs to be linked to the user's operation with priority over an instruction that does not need to be linked to the user's operation will be described. The configuration in this embodiment is the same as in FIGS. 1A, 1B and 2. The processing flow of the communication terminal 110 executed in this embodiment is the same as that in FIG. Therefore, in the present embodiment, the description of the same part as that of the first embodiment will be omitted.

FIG. 7 is a flowchart showing a processing flow of the virtual machine 100 according to the present embodiment. The flowchart of FIG. 7 is a flowchart in which S406 of FIG. 3 is replaced with S701 to S703. Therefore, S701 to S703 will be described, and the description of other steps (steps) will be omitted.
First, FIG. 8 shows an example of a Web page and explains it concretely. FIG. 8A is a diagram showing a description example of an HTML file constituting a Web page. FIG. 8B is a diagram showing a drawing result generated when the HTML file of FIG. 8A is processed. The drawing result of FIG. 8B is the same as that of FIG. 5B. The difference between FIG. 8A and FIG. 5A is that the description code 502 is replaced with the description code 801. The description code 801 of FIG. 8A indicates a <button> element in which "print ()" is registered in the event handler, and corresponds to the button 512 of FIG. 8B. The button 512 is a print execution button that instructs the communication terminal 110 to execute printing.

Subsequently, FIG. 9 shows an example of the instruction table 204. The first difference between FIGS. 9 and 6 is that data associated with "Perform print ()" and "print ()" is added. By adding this data, when the user presses the print execution button, printing is executed on the communication terminal 110.
Here, if there is a delay in the time from the user's button operation to the sounding, the user is often confused. That is, the sounding is a process that needs to be linked to the user's operation. The execution instruction of such a process is referred to as the first instruction information. As the first command information, in addition to the sounding, lighting of light and the like can be mentioned. On the other hand, even if there is a delay in the time from when the user presses the print execution button to when the print execution is started, the user is less likely to be confused. That is, printing is a process that does not need to be linked to the user's operation. The execution instruction of such a process is referred to as a second instruction information. The second command information includes scanning, changing the setting of the communication terminal 110, and the like, in addition to printing.

The second difference between FIG. 9 and FIG. 6 is that the item “Delay” indicating the delay time 901 is further associated. The delay time 901 is time information for designating the time from the acquisition of the execution instruction to the transmission. For example, when "Delay" is specified in 0 ms, the virtual machine 100 transmits the execution instruction immediately after acquisition. Further, when "Delay" is specified for 500 ms, the virtual machine 100 transmits the execution command 500 milliseconds after the acquisition of the execution command. In the present embodiment, the delay time 901 of the first command information is made shorter than the delay time 901 of the second command information. That is, the virtual machine 100 transmits the first instruction information with priority over the second instruction information. The information set in the instruction table 204 is not limited to the delay time 901 as long as the information can determine the transmission order when there are a plurality of instruction information to be transmitted.

First, in S701, the virtual machine 100 registers an instruction transmission job, which is a job for transmitting an execution instruction acquired from the instruction table 204, in the timer. Here, the virtual machine 100 acquires the delay time 901 of the execution instruction from the instruction table 204 and registers it in the timer. For example, since "Delay" is 500 ms, "Perform print ()" is registered to transmit the execution instruction "print ()" after 500 milliseconds have elapsed.
Next, in S702, the virtual machine 100 determines whether or not the elapsed time from the registration of the instruction transmission job has reached the designated time. When it is determined that the elapsed time has reached the designated time (Yes in S702), the virtual machine 100 executes the corresponding instruction transmission job (S703), and then the process proceeds to S407. On the other hand, if it is determined that the elapsed time has not reached the designated time (No in S702), the process proceeds to S407.

According to the second embodiment as described above, when the execution instruction that needs to be linked to the user's operation and the execution instruction that does not need to be linked to the user's operation occur almost at the same time, it is necessary to link them. Execution instructions can be sent with priority over execution instructions that do not need to be linked. Therefore, even if the communication band connecting the communication terminal 110 and the image generation system 200 is tight, when the user presses a specific button on the communication terminal 110, a sound is sounded without delay and the user can press the specific button. Can be promptly notified that is not pressable. That is, as in the first embodiment, it is possible to improve the convenience of the user when using the browser on the cloud.

As a modification of the second embodiment, in FIG. 7, the drawing generation process (S408) is started after the lapse of the designated time, but is started at the same time as the timer registration of the instruction transmission job or after the lapse of a predetermined time from the timer registration. May be done. This makes it possible to transmit the drawing result to the communication terminal 110 as soon as possible.

Although the present invention has been described above with each embodiment, the above-described embodiment is merely an example of the embodiment of the present invention, and the technical scope of the present invention is limitedly interpreted by these. It should not be. That is, the present invention can be implemented in various forms without departing from the technical idea or its main features.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100: Virtual machine 100: Communication terminal, 120: Web server, 200: Image generation system, 202: Browser, 203: Command transmitter, 204: Command table

Claims (16)

An information processing device that can communicate with a communication terminal.
A first transmission means for transmitting the drawing result of the Web page to the communication terminal,
An acquisition means for acquiring information indicating an operation in the communication terminal for the Web page transmitted by the first transmission means, and an acquisition means.
A second transmission means that updates the drawing of the Web page according to the operation indicated by the information acquired from the acquisition means and transmits the updated drawing result to the communication terminal.
A third transmission means for transmitting the processing instruction according to the operation indicated by the information acquired from the acquisition means to the communication terminal in preference to the transmission of the updated drawing result by the second transmission means. ,
An information processing device characterized by having. An information processing device that can communicate with a communication terminal.
Acquisition method for acquiring Web information and
A processing means for interpreting the Web information and
It has a transmission means for transmitting the processing result by the processing means to the communication terminal.
When the processing means acquires command information that can be executed by the communication terminal, the transmitting means preferentially transmits the command information over the image data to be displayed on the communication terminal generated by the processing means. An information processing device characterized by doing so. The information processing apparatus according to claim 2, wherein the processing means acquires the command information when a predetermined operation regarding the Web information is performed on the communication terminal. Further having a storage means for storing the contents of the predetermined operation in association with the command information.
The information processing apparatus according to claim 3, wherein the processing means acquires the command information related to the predetermined operation when the predetermined operation is performed. The information processing apparatus according to claim 3 or 4, wherein the predetermined operation is an operation for a display item based on a predetermined element included in the Web information. Further having a receiving means for receiving the position information operated with respect to the screen on which the image data is displayed from the communication terminal.
The processing means is characterized in that it determines whether or not there has been an operation on the display item based on the position information received by the receiving means and the position information of a predetermined element included in the Web information. The information processing apparatus according to 5. The transmitting means said that the first instruction information, which is the instruction information of the processing that needs to be executed in conjunction with the predetermined operation, does not need to be executed in conjunction with the predetermined operation. The information processing apparatus according to claim 3, wherein the information processing apparatus is characterized in that it is transmitted with priority over the second instruction information which is instruction information. Further having a storage means for storing the contents of the predetermined operation, the command information, and the time information for designating the time from the acquisition of the command information to the transmission thereof.
The time information of the first command information is shorter than the time information of the second command information.
The processing means acquires the command information and the time information related to the predetermined operation when the predetermined operation is performed.
The information processing apparatus according to claim 7, wherein the transmission means transmits the second command information later than the first command information based on the time information. The information processing apparatus according to claim 7, wherein the first instruction information is at least one instruction information of ringing a sound and lighting a light. The information according to any one of claims 7 to 9, wherein the second instruction information is at least one instruction information of printing, scanning, and setting change of the communication terminal. Processing equipment. The information processing apparatus according to claim 5 or 6, wherein the Web information includes an HTML document. The information processing apparatus according to claim 11, wherein the predetermined element is an element to which a predetermined attribute of the HTML document is given. An information processing system consisting of a communication terminal and an information processing device capable of communicating with the communication terminal.
The information processing device is
Acquisition method for acquiring Web information and
A processing means for interpreting the Web information and
It has a transmission means for transmitting the processing result by the processing means to the communication terminal.
When the processing means acquires command information that can be executed by the communication terminal, the transmitting means gives priority to the command information over the image data to be displayed on the communication terminal generated by the processing means. Send to
The communication terminal is
A receiving means for receiving the processing result from the information processing device, and
When the processing result received by the receiving means is the command information, the processing of the command information is controlled to be executed, and when the processing result is the image data, the image data is displayed on the display unit. Control means to control to display,
An information processing system characterized by having. A control method for information processing devices that can communicate with communication terminals.
The first transmission step of transmitting the drawing result of the Web page to the communication terminal,
An acquisition step for acquiring information indicating an operation in the communication terminal for the Web page transmitted by the first transmission step, and an acquisition step.
A second transmission step of updating the drawing of the Web page according to the operation indicated by the information acquired from the acquisition step and transmitting the updated drawing result to the communication terminal.
A third transmission step of transmitting the processing instruction according to the operation indicated by the information acquired from the acquisition step to the communication terminal in preference to the transmission of the updated drawing result by the second transmission step. ,
A method for controlling an information processing apparatus, which comprises. A control method for information processing devices that can communicate with communication terminals.
The acquisition step to acquire Web information and
A processing step for interpreting the Web information and
A transmission step of transmitting the processing result of the processing step to the communication terminal is included.
When the instruction information that can be executed by the communication terminal is acquired by the processing step, the transmission step preferentially transmits the instruction information over the image data to be displayed on the communication terminal generated by the processing step. A control method for an information processing device, which is characterized by the fact that the information processing device is used. A program for making a computer function as each means of the information processing apparatus according to any one of claims 1 to 12.

Images