JP2016119029A - Information processing device, apparatus, information processing system, information processing method, program, and installation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the necessity of modifying an existing portion in order to increase functions available for display data acquired via a network.SOLUTION: An information processing device acquires display data through a network, and has a display control part for displaying a screen on the basis of the display data. The display control part inputs data designated by the display data to a first program which corresponds to a user of the information processing device and is related to identification information designated by the display data in programs installed by the information processing device on a user-by-user basis.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an information processing apparatus, a device, an information processing system, an information processing method, a program, and an installation method.

  Web pages including HTML (HyperText Markup Language), CSS (Cascading Style Sheets), scripts, etc., perform processing corresponding to operations on the screen displayed based on the Web page on the device to which the Web page is downloaded. It can function as an application to be executed. Specifically, when a Web page makes a request to the Web browser, the Web browser causes the device to execute processing according to the request.

  Basically, functions that a web page can request from a web browser are limited to functions related to the API provided by the web browser. For example, a script that can be described for a Web page is limited to a script that can be interpreted by a Web browser.

  Therefore, for example, when a new function is implemented in a device to which a web page is downloaded, in order to make the new function available from the web page, the web browser is modified and the interface for the new function is changed to the web page. It needs to be available for the page.

  If a plug-in for the Web browser is used, the necessity of modifying the Web browser can be reduced. However, some Web browsers provided in smart devices such as smartphones and tablet terminals do not have a plug-in mechanism.

  The present invention has been made in view of the above points, and an object thereof is to reduce the need to modify an existing part in order to increase the functions that display data acquired via a network can use. To do.

  Therefore, in order to solve the above problem, the information processing apparatus has a display control unit that acquires display data via a network and displays a screen based on the display data, and the display control unit includes the information processing apparatus. Among the programs installed for each user, the data specified in the display data is input to the first program corresponding to the identification information specified by the display data corresponding to the user of the information processing apparatus.

  It is possible to reduce the need to modify the existing part in order to increase the functions available for the display data acquired via the network.

It is a figure which shows the structural example of the information processing system in embodiment of this invention. It is a figure which shows the hardware structural example of the information processing terminal in embodiment of this invention. It is a figure which shows the software structural example of the information processing terminal in embodiment of this invention. It is a sequence diagram for demonstrating an example of the process sequence at the time of the call of the additional module from a Web application. It is a sequence diagram for demonstrating the 1st example of the process sequence performed at the time of the notification of the information from an additional module. It is a sequence diagram for demonstrating the 2nd example of the process sequence performed at the time of the notification of the information from an additional module. It is a flowchart for demonstrating an example of the process sequence which a browser performs regarding the call of an additional module. It is a flowchart for demonstrating an example of the process sequence which a browser performs regarding the notification of the information from an additional module. It is a figure which shows the specific example of an additional module.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a configuration example of an information processing system according to an embodiment of the present invention. In the information processing system 1 shown in FIG. 1, the image forming apparatus 10 is connected to the information processing terminal 20 so as to be communicable. Communication between the image forming apparatus 10 and the information processing terminal 20 is performed via a network such as USB (Universal Serial Bus), short-range wireless communication, or LAN (whether wired or wireless).

  The image forming apparatus 10 is a multifunction machine that realizes two or more functions of printing, scanning, copying, FAX transmission / reception, and the like with a single casing. However, a device having any one function may be used as the image forming apparatus 10. The image forming apparatus 10 in the present embodiment is an example of a device, and a device such as a projector, a video conference system, or a digital camera may be used instead of the image forming device 10.

  The information processing terminal 20 is a smart device that can execute complete information processing independently, such as a smartphone or a tablet-type terminal. In the present embodiment, the information processing terminal 20 functions as an operation unit of the image forming apparatus 10. More specifically, the information processing terminal 20 is connected to the image forming apparatus 10 instead of an operation panel that has been conventionally installed as a dedicated operation unit of the image forming apparatus 10. Hereinafter, the “operation panel” simply refers to an operation panel installed in the conventional image forming apparatus 10.

  For example, the information processing terminal 20 is fixedly installed at a predetermined position (for example, a position where the operation panel is disposed) of the image forming apparatus 10. Therefore, the information processing terminal 20 and the image forming apparatus 10 may be grasped as one apparatus. Alternatively, the information processing terminal 20 may be removable (separable) from the image forming apparatus 10. In a state where the information processing terminal 20 is removed, the information processing terminal 20 may be able to function as an operation unit of the image forming apparatus 10 via Bluetooth (registered trademark) or wireless communication such as infrared rays.

  In FIG. 1, an information processing terminal 20 can communicate with a Web server device 30 via a network such as a LAN or the Internet. However, the communication between the information processing terminal 20 and the Web server apparatus 30 may be mediated by the image forming apparatus 10. The Web server device 30 is a computer that stores Web pages including HTML (HyperText Markup Language), CSS (Cascading Style Sheets), Java (registered trademark) scripts, and the like. The Web page not only functions as display data, but also functions as an application using a script or the like. Therefore, in the present embodiment, the Web page is referred to as “Web application”. Note that the information processing terminal 20 may be able to communicate with a plurality of or unspecified Web server devices 30.

  FIG. 2 is a diagram illustrating a hardware configuration example of the information processing terminal according to the embodiment of the present invention. 2, the information processing terminal 20 includes a CPU 201, a memory 202, an auxiliary storage device 203, a touch panel 204, a wireless communication device 205, a device interface 206, and the like.

  The auxiliary storage device 203 stores programs installed in the information processing terminal 20. The memory 202 reads the program from the auxiliary storage device 203 and stores it when there is an instruction to start the program. The CPU 201 implements functions related to the information processing terminal 20 in accordance with programs stored in the memory 202.

  The touch panel 204 is an electronic component having both an input function and a display function, and displays information, accepts input from a user, and the like. The touch panel 204 includes a display device 211, an input device 212, and the like.

  The display device 211 is a liquid crystal display or the like, and bears the display function of the touch panel 204. The input device 212 is an electronic component that includes a sensor that detects contact of a contact object with the display device 211. The contact detection method of the contact object may be any known method such as an electrostatic method, a resistive film method, or an optical method. The contact object refers to an object that contacts the contact surface (surface) of the touch panel 204. Examples of such an object include a user's finger and a dedicated or general pen.

  The wireless communication device 205 is an electronic component such as an antenna necessary for performing communication in a wireless local area network (LAN) or a mobile communication network. The device interface 206 is an interface for communicating with the image forming apparatus 10. That is, the device interface 206 communicates with the image forming apparatus 10.

  FIG. 3 is a diagram illustrating a software configuration example of the information processing terminal according to the embodiment of the present invention. In FIG. 3, the information processing terminal 20 includes an OS 21, an additional module 22, and a browser 23. These are programs that cause the CPU 201 to execute processing.

  The OS 21 is a general OS (Operating System). Other programs such as the additional module 22 and the browser 23 operate as processes or threads on the OS 21.

  The browser 23 is a web browser. That is, the browser 23 acquires (downloads) the Web application 31 from the Web server device 30 and causes the CPU 201 and the display device 211 to display a screen according to the definition included in the Web application 31. The definition regarding the screen is described using, for example, HTML (HyperText Markup Language), CSS (Cascading Style Sheets), and the like. The browser 23 also causes the CPU 201 to execute processing according to an API (Application Program Interface) that is included in the Web application 31 and is called by a script. That is, the browser 23 includes implementations (processing definitions) for various APIs called from scripts. As one of such APIs, the browser 23 has a general-purpose API 231. The general-purpose API 231 is different from other APIs in that it is not specialized for a specific function. The general-purpose API 231 is a function group for making it possible to use the function of an arbitrary additional module 22 from the Web application 31. That is, the general-purpose API 231 provides a means or path for transparently calling the additional module 22 to the Web application 31. For example, one function of the general-purpose API 231 has the following interface specifications, for example.

<Additional module call function name> (module ID, input data)
<Additional module call function name> is a name of a function for calling the additional module 22 (hereinafter referred to as “additional module call function”). The module ID is identification information of the additional module 22 to be called. The module ID may be the file name of the additional module 22 or other identification information. The module ID may be any information that allows the browser 23 to identify one additional module 22. However, in the present embodiment, a plurality of additional modules 22 having the same module ID can be installed in one information processing terminal 20. Specifically, the additional module 22 is stored (installed) in the auxiliary storage device 203 while being distinguished into different storage areas (for example, different folders) for each user. For example, a folder is generated for each user name (for each user), and an additional module 22 for the user is stored in each folder. The installation folder of the additional module 22 may be determined based on, for example, a login user name at the time of installation, or may be determined based on a user name specified at the time of installation. The additional module 22 called at the time of calling is an additional module 22 that corresponds to the user name of the login user to the information processing terminal 20 (that is, corresponds to the user who operates the information processing terminal 20).

  The input data is data input to the additional module 22. For example, the data may be a character string type. However, the content of the data may not be a character string. Note that the general-purpose API 231 is a common API for the plurality of additional modules 22, as is apparent from the module ID specified in the argument.

  When the additional module call function is called from the Web application 31, the browser 23 inputs the input data specified in the argument to the additional module 22 associated with the module ID specified in the argument.

  The general-purpose API 231 may include the following functions.

<Callback registration function name> (module ID, callback function address)
<Callback registration function name> is a function for registering a callback function which is an example of an interface for receiving a response or notification from the additional module 22 (hereinafter referred to as “callback registration function”). Name. The module ID is an additional module 22 that is a target of the callback function. The callback function address is address information of the callback function.

  The additional module 22 is a program that is installed to expand the function of the browser 23. The additional module 22 has an additional module API 221 that is an API in a format planned by the browser 23 in order to receive input data from the browser 23. The additional module 22 executes processing according to the data input via the additional module API 221. Although only one additional module 22 is shown in FIG. 3, multiple types of additional modules 22 may be installed in the information processing terminal 20 for each user. By installing the additional module 22, functions related to the additional module 22 are pseudo-plugged into the browser 23 via the general-purpose API 231 of the browser 23.

  FIG. 3 also shows a Web application 31. The web application 31 is not installed in advance on the information processing terminal 20, but is dynamically acquired by the browser 23 in accordance with an operation of the information processing terminal 20 by the user. The web application 31 can call the additional module 22 via the general-purpose API 231 of the browser 23. As an example, an example in which the Web application 31 and the additional module 22 correspond one-to-one can be given. That is, when a certain web application 31 wants to use a function that cannot be realized by the existing API of the browser 23, an additional module 22 that can provide the function is created and installed in the information processing terminal 20. Therefore, the additional module 22 may be developed by the developer of the web application 31.

  In general, a function expansion method using a plug-in format is adopted in a Web browser of a PC, and an API for plug-in is prepared. However, the web browser of the smart device does not have a plug-in mechanism, and it is difficult to perform function expansion using the plug-in. Therefore, in the present embodiment, the general-purpose API 231 and the additional module 22 are used as means for replacing the plug-in.

  The general-purpose API 231 is provided by a script that is a language that can be handled by the Web application 31. The additional module API 221 is provided in a language that can be executed on the OS 21, for example.

  Note that the browser 23, the additional module 22, and the like are installed in the information processing terminal 20 by installation processing executed by the information processing terminal 20.

  Hereinafter, a processing procedure executed by the information processing terminal 20 will be described. In the following, for convenience, each program is described as a subject of processing, but strictly speaking, each program causes the CPU 201 to execute processing.

  FIG. 4 is a sequence diagram for explaining an example of a processing procedure when an additional module is called from a Web application. In FIG. 4, it is assumed that the web application 31 corresponding to the URL specified according to the operation by the user is acquired by the browser 23. Further, the processing by the web application 31 is based on a script defined in the web application 31.

  In step S101, the Web application 31 calls a callback registration function, which is one of the general-purpose APIs 231. That is, the Web application 31 requests the browser 23 to register a callback function. As the arguments of the callback registration function, the module ID of the additional module 22 designated as the call destination in step S102 and the address information of the callback function to be registered are designated. In response to the call of the callback registration function, the browser 23 associates the module ID specified as the argument of the function with the address information and stores it in the memory 202, for example.

  Subsequently, the web application 31 is one of the general-purpose APIs 231. Call additional module call function. That is, the Web application 31 requests the browser 23 to call the additional module 22. In the argument of the additional module call function, the module ID of the additional module 22 to be called and the input data for the additional module 22 are specified.

  Subsequently, the browser 23 specifies a login user name, and specifies a storage area (for example, a folder) of the additional module 22 corresponding to the login user name (S103). The login user name can be specified by inquiring of the OS 21, for example. This is because the OS 21 has a function of authenticating the user (identifying the user) when the user logs in.

  The browser 23 sends input data via the additional module API 221 to the additional module 22 identified by the module ID specified in the argument among the additional modules 22 stored in the storage area specified in step S103. Input (S104). In response to input of input data, the additional module 22 responds (S105). In response to the response, the browser 23 makes a response to the additional module call function (S106).

  After the response, the additional module 22 performs a process on the input data. When the processing is completed, the additional module 22 notifies the processing result to the browser 23 (S107). The processing result may be information indicating the success or failure of the processing, or data generated by the processing. The browser 23 has an interface for receiving notification of processing results and the like from the additional module 22.

  Subsequently, the browser 23 calls a callback function related to the address information stored in the memory 202 in association with the module ID of the processing result notification source (S108). The processing result is specified as an argument of the callback function. As a result, the processing result is notified to the Web application 31.

  Note that if the Web application 31 does not require notification of the processing result of the additional module 22, steps S101 and S108 may not be executed.

  Also, in steps S105 and S106 in FIG. 4, the response is performed before the processing by the additional module 22 in the present embodiment, where the additional module 22 and the browser 23 operate in different threads or processes, and the additional module 22 This is because the process 22 and the process of the browser 23 are performed asynchronously. Therefore, if the processing result from the additional module 22 is responded synchronously to step S104, steps S105 and S106 do not have to be executed. Also, the callback function for accepting the processing result need not be registered. This is because the browser 23 can return the processing result of the additional module 22 as a return value of the additional module call function.

  However, even if the processing result from the additional module 22 is synchronously responded to step S104, if the browser 23 wants to acquire information notified asynchronously from the additional module 22 side, the callback Function registration is valid.

  FIG. 5 is a sequence diagram for explaining a first example of a processing procedure executed at the time of notification of information from the additional module.

  For example, when any of the additional modules 22 stored in the storage area corresponding to the login user name detects the occurrence of some event, the browser 23 is notified of information related to the event (S111). The information may be notified to the browser 23 by using the same interface as that of the browser 23 in order to receive the notification of the processing result of the additional module 22. Alternatively, the browser 23 may have an interface for receiving notification of asynchronous information separately from the interface for receiving notification of processing results.

  Subsequently, the browser 23 calls a callback function related to the address information stored in the memory 202 in association with the module ID of the additional module 22 that is the notification source of the information (S112). The information is specified as an argument of the callback function. As a result, the information is notified to the Web application 31.

  Note that when the browser 23 can display a plurality of Web applications 31 using tabs, a plurality of callback functions for one additional module 22 may be registered by the plurality of Web applications 31.

  In this case, the processing procedure of FIG. 5 is as shown in FIG. 6, for example. FIG. 6 is a sequence diagram for explaining a second example of a processing procedure executed when information is notified from the additional module. In FIG. 6, the same steps as those in FIG.

  In FIG. 6, two Web applications 31, that is, a Web application 31 a and a Web application 31 b, are displayed on different tabs of the browser 23, and each displays a callback function for the same additional module 22. The processing that is executed when registered in. In this case, the browser 23 calls the callback function registered from each Web application 31 in response to the notification of information from the additional module 22 (S111) (S112, S113). As a result, the same information is distributed to each Web application 31.

  Subsequently, a processing procedure executed by the browser 23 in FIGS. 4, 5, and 6 will be described. FIG. 7 is a flowchart for explaining an example of a processing procedure executed by the browser regarding the calling of the additional module.

  In step S <b> 201, the browser 23 acquires (downloads) the Web application 31 related to the URL specified by the operation by the user from the Web server device 30. Next, the browser 23 displays an operation screen on the display device 211 based on the acquired definition contents of the Web application 31 (S202).

  Subsequently, the browser 23 receives a call for an additional module call function from the Web application 31 (S203). In other words, the browser 23 analyzes the definition content of the Web application 31 and detects an additional module call function. Note that the timing of calling the additional module call function depends on the definition of the Web application 31. For example, a call may be made according to acquisition of the Web application 31, or a call may be made according to an operation on an operation screen displayed based on the Web application 31.

  Subsequently, the browser 23 specifies a login user name, and specifies a storage area (for example, a folder) of the additional module 22 corresponding to the login user name (S204).

  Subsequently, the browser 23 responds to the additional module 22 associated with the module ID specified in the argument of the called additional module call function among the additional modules 22 stored in the storage area specified in step S204. Then, input data designated as an argument of the function is input (S205). If the callee additional module 22 does not require input data, the input data argument may be omitted in the additional module call function.

  If the additional module 22 has been successfully called (Yes in S206), the processing by the browser 23 regarding the additional module call function ends normally (S207). In this case, for example, in step S106 of FIG. 4, a response indicating normal termination is made. When the call to the additional module 22 has failed (No in S206), the processing by the browser 23 regarding the additional module call function ends abnormally (S208). In this case, for example, a response indicating abnormal termination is made in step S106 of FIG.

  FIG. 8 is a flowchart for explaining an example of a processing procedure executed by the browser regarding notification of information from the additional module.

  When the browser 23 receives the callback registration function call from the Web application 31 (S211), the browser 23 stores the module ID specified in the argument of the function and the address information of the callback function in association with each other in the memory 202. (S212).

  Thereafter, when the browser 23 receives a notification of processing results or asynchronous information from the additional module 22, the browser 23 determines whether or not there is a callback function in which address information is stored in association with the module ID of the additional module 22 ( S214). If there is a corresponding callback function (Yes in S214), the browser 23 calls the callback function (S215). The notified information is specified as an argument of the callback function.

  Next, a specific example of the additional module 22 will be described. FIG. 9 is a diagram illustrating a specific example of the additional module.

  In FIG. 9, an NFC (Near field communication) device is added to the information processing terminal 20. For example, the NFC device 207 is initially added to the information processing terminal 20 that does not have the NFC device 207 by USB connection or the like. Therefore, the browser 23 does not provide a script API for accessing the NFC device 207. A method for making the NFC device 207 available from the Web application 31 in such a case will be described. The NFC device 207 is hardware that performs near field communication.

  In this case, for example, the developer of the Web application 31 creates the NFC control module 22a for controlling the NFC device 207. At this time, the NFC control module 22 a is created so as to have the additional module API 221. The created NFC control module 22a is installed in the information processing terminal 20 as one of the additional modules 22 at an arbitrary timing. FIG. 9 shows a state where the NFC control module 22a is installed. In this state, the NFC control module 22a can be used from the Web application. That is, the Web application 31 can use the NFC control module 22a via the additional module call function of the general-purpose API 231.

  For example, when the process of FIG. 4 is executed for the NFC control module 22a, the module ID of the NFC control module 22a is specified as arguments of the callback registration function and the additional module call function. In addition, information indicating an acquisition request for the connection status with the communication partner is specified in the input data of the argument of the additional module call function. That is, as input data, not only data to be processed in the additional module 22 but also data indicating a processing request for the additional module 22 can be specified.

  The NFC control module 22a confirms the connection status with the communication partner by the NFC device 207, and notifies the confirmation result to the browser 23 in step S107. The browser 23 notifies the confirmation result to the Web application 31 using a callback function (S108). As a result, the Web application 31 can grasp the connection status of the NFC device 207.

  Further, regarding the NFC control module 22a, when FIG. 5 and FIG. 6 and the like are executed, an example of information notified from the NFC control module 22a is information indicating a change in the connection status with the communication partner. For example, the web application 31 using the NFC control module 22a is notified via the callback function that the connection with the communication partner has been established or the connection with the communication partner has been released.

  As described above, according to the present embodiment, the Web application 31 can call one of the additional modules 22 installed by the information processing terminal 20 via the general-purpose API 231 of the browser 23. That is, the function related to the additional module 22 can be substantially added to the browser 23. As a result, it is possible to reduce the necessity of modifying the existing part (browser 23) in order to increase the functions that can be used by the Web application 31.

  Further, according to the present embodiment, the additional module 22 is installed for each user. Therefore, for example, even when calling the general-purpose API 231 related to the same function name, different processes can be executed for each user. For example, when an additional module 22 that reads information from an IC card is added, the storage area of data to be read from the user's IC card is different for each user. In such a case, each additional module 22 is executed to acquire data from the storage area of the IC card corresponding to the user related to the additional module 22, thereby reading the data from the storage area corresponding to the user. Is possible.

  In the present embodiment, an example is shown in which each additional module is associated with a user name by distinguishing the storage area of the additional module 22 for each user. However, the association between the additional module 22 and the user name is as follows: It may be realized by different forms. For example, correspondence information between each additional module 22 and each user name may be stored in the auxiliary storage device 203. In this case, when the additional module 22 is called, the additional module 22 associated with the login user name in the corresponding information may be set as a call target. A plurality of user names may be associated with one additional module 22. That is, one additional module 22 may be shared by a plurality of users. For example, when a certain user tries to install the additional module 22, the OS 21 determines whether or not the additional module 22 that is the same as the additional module 22 has been installed. When the same additional module 22 has been installed, the OS 21 may newly associate the user name of the user with the installed additional module 22 in the correspondence information and complete the installation process.

  Note that the present embodiment may be applied to a smart device that functions as an operation unit of a device other than the image forming apparatus 10, such as a projector, a video conference system, a digital camera, or a home appliance. In addition, this embodiment may be applied to a smart device that functions as a single information processing terminal 20 instead of functioning as an operation unit of a device.

  Further, the present embodiment may be applied to a Web browser in a PC (Personal Computer), that is, a plug-in Web browser.

  In the present embodiment, the information processing terminal 20 is an example of an information processing apparatus. A Web application is an example of display data. The browser 23 is an example of a display control unit.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

1 Information processing system 10 Image forming apparatus 20 Information processing terminal 21 OS
22 Additional module 22a NFC control module 23 Browser 30 Web server device 31 Web application 201 CPU
202 Memory 203 Auxiliary Storage Device 204 Touch Panel 205 Wireless Communication Device 206 Device Interface 207 NFC Device 211 Display Device 212 Input Device 221 Additional Module API
231 General-purpose API

Japanese Patent Application No. 2010-1470

Claims (11)

An information processing apparatus,
A display control unit that acquires display data via a network and displays a screen based on the display data,
The display control unit corresponds to the first program related to the identification information specified by the display data corresponding to the user of the information processing apparatus among the programs installed in the information processing apparatus for each user. Enter the data specified in
An information processing apparatus characterized by that. The display control unit inputs data specified in the interface to the first program through a common interface for a plurality of programs.
The information processing apparatus according to claim 1. The interface is an API (Application Program Interface).
The information processing apparatus according to claim 2. The display control unit notifies the display data of information related to processing that the first program causes the information processing apparatus to execute with respect to input data.
The information processing apparatus according to any one of claims 1 to 3. The display control unit notifies the display data of information related to the processing via an interface registered by the display data.
The information processing apparatus according to claim 4. The first program causes the information processing apparatus to execute control of hardware added to the information processing apparatus.
The information processing apparatus according to claim 5.   The apparatus which has the information processing apparatus as described in any one of Claims 1 thru | or 6 as an operation part. An information processing system including an information processing device and a device having the information processing device as an operation unit,
A display control unit that acquires display data via a network and displays a screen based on the display data,
The display control unit corresponds to the first program related to the identification information specified by the display data corresponding to the user of the information processing apparatus among the programs installed in the information processing apparatus for each user. Enter the data specified in
An information processing system characterized by this. An information processing method in an information processing apparatus having a display control unit for acquiring display data via a network and displaying a screen based on the display data,
The display control unit corresponds to the user of the information processing apparatus among the programs installed for each user in the information processing apparatus, and the display data is included in the first program related to the identification information specified by the display data. Enter the data specified in
An information processing method characterized by the above. Information processing device
Acquire display data via a network, function as a display control unit that displays a screen based on the display data,
The display control unit corresponds to the first program related to the identification information specified by the display data corresponding to the user of the information processing apparatus among the programs installed in the information processing apparatus for each user. Enter the data specified in
A program characterized by that. A computer executes a procedure for installing the program according to claim 10.
An installation method characterized by that.

Images