JP2008090486A - Screen operation controller and information processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a screen operation controller and an information processing system by which various user interfaces can flexibly be realized. <P>SOLUTION: This screen operation controller is provided with: an operation detection means for detecting an operation performed by a user on an operation screen displayed on the display screen of terminal equipment for achieving the transfer of information between a user and information processor; an analyzing means for analyzing an operation detected by the operation detecting means, and for specifying the content of change relating to the operation screen to be presented according to an operation on the operation screen; a component control means for controlling the behavior of an operation object component included in the operation screen and the generation of a new operation component based on the analytic result acquired by the analyzing means; and a cooperation means for requesting proper display information corresponding to the content of the change relating to the operation screen to be presented to an information processor based on the analytic result acquired by the analyzing means, and for reflecting the display information acquired from the information processor on the display of the operation screen on the display screen of the terminal equipment in response to the request. The screen operation controller is arranged in the terminal equipment independently of the information processor. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a screen operation control device for controlling an operation screen of a graphical user interface used for information exchange between a user and an information processing device in various information processing devices, and an information processing system to which the screen operation control device is applied. About.

  In a conventional client-server type information processing system, a graphical user interface provided to a user via a client terminal is an operation screen displayed on a display unit provided in the client terminal and operations such as a pull-down list and a check box. This is realized by defining the screen formation and the behavior when the user operates these operation target components, including the arrangement of the target components, in the client application program on the client terminal.

  Therefore, as shown in FIG. 8, each client application 410 includes an event analysis unit 412 that analyzes the detected key operation event and mouse operation event and performs appropriate display control processing. Based on the analysis result by the event analysis unit 412, the function processing unit 413 exchanges information with the server application 420 of the back-end server device via the communication processing unit 414 as necessary, and based on the obtained information. Thus, for example, display data for displaying a new pull-down list or another operation screen is created and used for display processing by the display unit 416 via the display control unit 415.

On the other hand, in a WEB-type information processing system, a graphical user interface is provided via a browser software function by sending a JAVA script (JAVA: registered trademark) or the like from a server application on a back-end server device to the browser software of a client terminal. Realized.
In such a WEB type information processing system, as shown in FIG. 9, an event detected by the basic function unit 431 provided in the browser software 430 on the client terminal is received, and the back end is received via the APL 432. Passed to the server application 440 on the server. In response to this, an appropriate JAVA script is formed in accordance with the user interface (I / F) program 441 and returned to the browser software 430, and the APL 432 performs appropriate display control processing in accordance with the JAVA script. In addition to display and control of an operation target such as a tool tip, transition to another operation screen is realized by starting another browser screen.

  In the information processing system to which the above-described conventional graphical interface is applied, an event is detected and an event is detected by a display data creation process by a program in the client application 410 or a JAVA script formation process by a program in the server application 440. By closely linking the control of the corresponding operation screen, for example, using the information defined in the operation screen being worked on, an advanced user interface that opens the operation screen for another work and takes over the processing Is realized.

In order to realize an advanced user interface including such a screen transition, conventionally, a response (for example, display of a pull-down list) corresponding to an operation on each operation screen should be presented in the operation screen. ), The types of other operation screens that may change for each operation screen, and the information to be inherited for each screen transition, etc., are determined as detailed specifications at the client application or server application development stage. However, it was developed as a closed package for each system (see Patent Document 1).
Japanese Patent Laid-Open No. 5-250117

  However, what display is appropriate for what operation on each screen is appropriate, and what operation screen should be transferred from each operation screen and what information should be taken over at that time. Rather, it is a property that is gradually recognized by users after the information processing system is operated, so it is very difficult to clarify these matters as specifications at the development stage of client applications or server applications. is there.

For this reason, in the development of conventional information processing systems, it takes a lot of labor and time to determine user interface specifications that reflect the user's intentions, and it takes time to develop individual information processing systems. It was.
On the other hand, the range of work that individual users are in charge of is increasing. For example, one user performs necessary work through a maintenance system based on information obtained by a monitoring system. As described above, cooperation has been demanded even between systems that have conventionally been independent.

However, in the development of individual information processing systems, various possible linkages with other information processing systems are assumed without omission, and efforts are made to enable linkage with programs related to user interfaces. Obviously it is wasteful and it is also difficult to identify the required collaboration at the development stage.
In addition, as in the conventional operation screen control technology in the information processing system, the operation performed by the user on the operation screen and the processing such as button and list display on the operation screen, or transition to another operation screen In a system in which screen control processing such as the above is extremely tightly coupled by a program, an advanced user interface that reflects the user's intention can be provided within the assumed range, but work procedures that were not assumed at the specification decision stage It is almost impossible to deal with these later.

  An object of the present invention is to provide a screen operation control device and an information processing system that can flexibly realize a wide variety of user interfaces including transitions to operation screens provided by different information processing systems.

A first screen operation control device according to the present invention is configured by operation detection means, analysis means, component control means, and linkage means.
The principle of the first screen operation control device according to the present invention is as follows.
The operation detecting means detects an operation performed by the user on the operation screen displayed on the display screen of the terminal device in order to realize exchange of information between the user and the information processing apparatus. The analysis unit analyzes the operation detected by the operation detection unit, and specifies the content of the change related to the operation screen to be presented according to the operation on the operation screen. The component control unit controls the behavior of the operation target component included in the operation screen and the generation of a new operation component based on the analysis result obtained by the analysis unit. Based on the analysis result obtained by the analysis means, the cooperation means requests the information processing apparatus for appropriate display information corresponding to the content of the change regarding the operation screen to be presented, and obtains the information from the information processing apparatus in response to this request. The displayed display information is reflected on the display of the operation screen on the display screen of the terminal device. The screen operation control device provided with each of these means is arranged on the terminal device independently of the information processing device.

The operation of the first screen operation control device configured as described above is as follows.
For the operation screen displayed on the display screen of the terminal device, a process for detecting an operation performed by a user using an input device such as a mouse, a process for analyzing the detected operation, and an analysis result The process of reacting the parts is performed independently of the information processing apparatus by the operation detection means, analysis means, and parts control means provided in the screen operation control device arranged in the terminal device. In addition, according to the analysis result obtained by the analysis means, for example, when display information using information unique to the information processing apparatus is required to display an appropriate pull-down list or a new operation screen, Such display information is requested from the information processing apparatus by the cooperation means, and the obtained display information is reflected on the display of the operation screen.

  As described above, when the above-described first screen operation control device is applied, the detection of the operation on the operation screen and the analysis thereof are separated from the information processing device and are shared by the screen operation control device. Since the processing device and the screen operation control device are roughly coupled while maintaining their independence, the information processing device does not need to be aware of a specific operation on the operation screen. Therefore, in the analysis means of the screen operation control device, for example, in response to a new operation on the operation target such as an icon in the operation screen, the behavior of the operation target to be provided in the newly required work procedure and the appropriate operation By defining the analysis result indicating the display on the screen, it is possible to flexibly deal with work procedures that were not assumed at the specification decision stage.

The second screen operation control device according to the present invention is configured such that, in the above-described first screen operation control device, the linkage unit includes a relay unit corresponding to each information processing device.
The principle of the second screen operation control device according to the present invention is as follows.
In the cooperation means provided in the first screen operation control apparatus described above, the relay means is provided corresponding to the plurality of information processing apparatuses, and the corresponding information processing apparatus is based on the analysis result obtained by the analysis means. The request regarding the display information to be created is selectively relayed to the information processing apparatus, and a response from the corresponding information processing apparatus is received.

The operation of the second screen operation control device configured as described above is as follows.
By providing the link means with a relay means corresponding to each information processing apparatus, the screen operation control apparatus can be shared by a plurality of information processing apparatuses. In addition, since each relay means relays a request for the corresponding information processing apparatus, it is relayed, for example, in response to an operation on the operation target in the operation screen corresponding to one information processing apparatus. By defining the display of the operation screen provided by the information processing apparatus in the analysis means, a plurality of information processing apparatuses can be linked to each other.

The third screen operation control device according to the present invention is the above-described second screen operation control device, wherein the relay means corresponding to each information processing device is provided with a device interface.
The principle of the third screen operation control device according to the present invention is as follows.
In the relay means provided for each information processing apparatus in the second screen operation control apparatus described above, the apparatus interface corresponds to information corresponding to a request corresponding to the analysis result obtained by the analysis means and a response to the request. It mediates in consideration of unique processing within the processing device.

The operation of the third screen operation control device configured as described above is as follows.
Content corresponding to a request regarding display information for realizing, for example, the content of change related to the operation screen corresponding to the analysis result by the device interface provided in the relay means corresponding to each information processing device. Is converted into a request related to display information for representing the information, and display information obtained as a response to the request is converted into information in a format suitable for processing in the screen operation control device.

In this way, by adopting a configuration provided with an apparatus interface corresponding to each information processing apparatus, it is possible to realize an advanced user interface as provided by creating a program for the information processing apparatus.
In the information processing system according to the present invention, a relay unit corresponding to each information processing apparatus is provided in the link unit of the screen operation control apparatus including the operation detection unit, the analysis unit, the component control unit, and the link unit, and the relay unit includes And an apparatus interface arranged in combination with a corresponding information processing apparatus.

The principle of the information processing system according to the present invention is as follows.
In a state in which at least one information processing device displays an operation screen provided by each terminal device in order to realize exchange of information with the user, the operation detection unit performs the operation on the operation screen. Detect operations performed by. The analysis unit analyzes the operation detected by the operation detection unit, and specifies the content of the change related to the operation screen to be presented according to the operation on the operation screen. The component control unit controls the behavior of the operation target component included in the operation screen and the generation of a new operation component based on the analysis result obtained by the analysis unit. Based on the analysis result obtained by the analysis means, the cooperation means requests the information processing apparatus for appropriate display information corresponding to the content of the change regarding the operation screen to be presented, and obtains the information from the information processing apparatus in response to this request. The displayed display information is reflected on the display of the operation screen on the display screen of the terminal device. In the linking means, the relay means is provided corresponding to at least one information processing apparatus, and selectively selects a request regarding display information to be created by the corresponding information processing apparatus based on the analysis result obtained by the analysis means. Relay to the information processing apparatus and receive a response from the corresponding information processing apparatus. In the relay means corresponding to each information processing device, the device interface is arranged in combination with the corresponding information processing device, and the information processing corresponding to the request corresponding to the analysis result obtained by the analysis means and the transmission / reception of the response to this request It mediates in consideration of unique processing within the device.

The operation of the information processing system configured as described above is as follows.
The operation on the part in the operation screen displayed on the display screen corresponding to each information processing device is detected by the operation detection means, and in response to this, a request for display information corresponding to the analysis result obtained by the analysis means is made. Then, the information is transferred to an appropriate information processing apparatus by the relay means provided in the cooperation means. At this time, the request described above is converted into, for example, information required in a format specific to each information processing device by the device interface arranged in combination with each information processing device. In addition, a response including display information obtained by processing unique to the information processing apparatus performed in response to this request is performed by using the above-described apparatus interface to display a new operation screen or a change related to display of components in the operation screen. After the information is converted in a format suitable for the processing in the screen operation control device, it is subjected to a reflection process on the operation screen by the cooperation means.

  As described above, in the device interface coupled to each information processing device, conversion processing between information expressed in a format suitable for processing in the screen operation control device and information in a format unique to the information processing device is performed. Thus, by standardizing information exchanged between the screen operation control device and each information processing device, it becomes possible to share and link the screen operation control device among a wide variety of information processing devices. .

  According to the first screen operation control apparatus according to the present invention, the information processing apparatus distributes the operation detection and the analysis on the operation screen to the screen operation control apparatus. Since it is possible to receive a request regarding control of a required operation screen as an analysis result regarding the operation on the screen, there is no need to be aware of a specific operation on the operation screen. This eliminates the need for cumbersome work to determine detailed specifications regarding the specific procedure for operations on individual operation screens during the development phase of application software used in information processing devices, and significantly shortens the development period. Can be achieved.

Also, for example, in response to a new operation on an operation target such as an icon in the operation screen, the analysis result indicating the behavior of the operation target to be provided in the newly required work procedure, the display of the new operation screen, etc. Is defined in the screen operation control device, it is possible to flexibly cope with work procedures and specific operation changes that were not assumed at the specification determination stage.
In addition, according to the second screen operation control device according to the present invention, it is possible to share the screen operation control device among a plurality of information processing devices, and it corresponds to a specific operation on each operation screen. In the scenario describing the analysis result, describe the procedure for requesting the display of the operation screen related to the processing of another information processing device in response to the operation on the part in the operation screen related to the processing of one information processing device. As a result, the operation screen can be linked between these information processing apparatuses.

  Furthermore, according to the third screen operation control device according to the present invention, information unique to each information processing device and components within the screen operation control device can be transmitted by the device interface provided for each information processing device. Since it is possible to reliably associate the analysis result regarding the operation by the forgiveness of information exchange for control, it is possible to realize an advanced user interface as provided by the creation of the program of the information processing apparatus.

  In addition, according to the information processing system according to the present invention, it is possible to standardize information exchanged between the screen operation control device and each information processing device. A platform capable of sharing and linking devices is provided, business processing can be performed between information processing devices in various fields, and a more flexible workflow can be realized.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
FIG. 1 shows an embodiment of an information processing system to which a screen operation control device according to the present invention is applied.
In the information processing system shown in FIG. 1, a client-server type information processing apparatus a that performs independent information processing is formed by a client application (CL-APL) 204 and a back-end server 206 incorporated in the terminal device 201. Has been. Similarly, the browser 205 and the back-end server 207 illustrated in FIG. 1 form a web-type information processing apparatus b that performs another independent information process.

  The client application 204 illustrated in FIG. 1 includes a function processing unit 208a corresponding to the client application 410 illustrated in FIG. 8, and the function processing unit 208a allows a function screen (for example, a function screen unique to the information processing apparatus a) Display data for the operation screen and the inquiry screen) is created and displayed on the display unit 203 via the operating system (OS) 202 of the terminal device 201. Similarly, in the browser 205 shown in FIG. 1, the function processing unit 208 b corresponds to the browser software 430 shown in FIG. 9, and in accordance with the JAVA script or the like sent from the back-end server 407, Display data for a unique function screen is created and used for display processing by the operating system 202 described above, and is provided via the display unit 203.

Also, the client application 204 and the browser 205 shown in FIG. 1 are provided with external interfaces (I / F) 209a and 209b, respectively, for exchanging information with the screen operation control mechanism 210 described later.
On the other hand, in the screen operation control mechanism 210 shown in FIG. 1, the operation reception unit 211 detects an event detected from the scenario file 213 via the scenario management unit 212 in response to an input such as a key operation event or a mouse operation event. Functions corresponding to the information processing apparatuses a and b are searched as described below by searching corresponding screen operation scenarios and controlling the operations of the component control unit 214 and the device cooperation units 215a and 215b according to the received scenario. Controls parts such as pop-ups in the screen and transitions between operation screens.

In the scenario file 213 shown in FIG. 1, for example, as shown in FIG. 2, presentation is provided corresponding to the screen label for specifying each functional screen, the part label for specifying the operation target part, and the type of operation. A screen operation scenario including a procedure indicating the screen operation to be performed and auxiliary information is stored.
Hereinafter, the operation of the screen operation control device will be described based on the example of the screen operation scenario shown in FIG.

FIG. 3 shows a sequence diagram in the case of presenting the operation target component with the information defined in the screen operation scenario.
When the user performs a mouse operation, as shown in FIG. 3, for example, an event detection result indicating that a right click has been performed in a text display portion (text 01) in the operation screen (screen 1) is displayed in the operation accepting unit. 211 is input. In response to this, the operation reception unit 211 instructs the scenario management unit 212 to search for a screen operation scenario using the screen label (screen 1), the component label (text 01), and the operation (right click) as search keys.

When the scenario management unit 212 searches the scenario file 213 according to the above-described instruction, for example, as shown in FIG. 2A, a list of items (items 1 and 2) defined in the auxiliary information is displayed. A screen operation scenario indicating a procedure related to the generation and pop-up display of the generated list is retrieved and read out and returned to the operation reception unit 211 (see FIG. 3).
In accordance with the procedure defined in the screen operation scenario obtained in this way, the operation receiving unit 211 instructs the component control unit 214 to create and display the specified component (list). Display data for displaying an appropriate part is created by the unit 214 and is used for display processing by the operating system 202.

As described above, when it is necessary to change the screen so as to newly display a component for which information such as an item to be displayed can be defined in advance, the change is necessary by the processing in the screen operation control mechanism 210. The change in the operation screen to be displayed can be presented.
Furthermore, if a hierarchical structure is applied to the auxiliary information of the screen operation scenario stored in the scenario file 213, for example, a different menu screen is displayed according to the user ID input on the user authentication screen. Complex screen operations including simple procedures can also be realized.

  On the other hand, when cooperation with an information processing apparatus that provides an operation screen including an operation target component is required, instead of defining information on items to be displayed in auxiliary information, FIG. Create a screen operation scenario that includes a procedure for requesting information from the information processing device of the provider (list request) and a procedure for acquiring information returned from the information processing device (list acquisition). Registration corresponding to the search key indicating the correct operation.

For example, as shown in FIG. 4, when an event detection result indicating that the pull-down button on the operation screen 1 is operated is notified to the operation reception unit 211, a scenario is generated according to a search instruction from the operation reception unit 211. The screen operation scenario shown in FIG. 2B is read out by the management unit 212 and returned to the operation reception unit 211.
At this time, the operation reception unit 211 first inquires the information processing apparatus a for a list of items to be displayed in the pull-down list via the apparatus cooperation unit 215a corresponding to the information processing apparatus a that provides the operation screen 1. An information transfer request is sent out. Next, the operation reception unit 211 acquires information returned from the information processing apparatus a in response to this request, passes this return information to the component control unit 214 as item information of the pull-down list, and instructs creation of the pull-down list. To do.

In this way, by linking the information processing apparatus a and the screen operation control mechanism 210, a pull-down list using list items managed by the information processing apparatus a can be displayed.
In the cooperation operation with the information processing apparatus described above, as shown in FIG. 5, an information transfer request describing the content of information required in a predetermined common format is created by the apparatus cooperation unit 215a. This information transfer request is then passed to the external interface 209a of the client application 204. Then, the information transfer request in the common format is converted into an information request in the individual format suitable for the function processing unit 208a in the external interface 209a, and then passed to the function processing unit 208a. The creation process is performed.

The item information created in this way is converted to a common format in the external interface 209a, then returned to the screen operation control mechanism 210, and used for processing of the operation reception unit 211 via the device cooperation unit 215a.
As described above, conversion between the common format information in the screen operation control mechanism 210 and the unique format information unique to the client application 204 is performed by the external interface 205a of the client application 204 arranged in the terminal device 201. Thus, an advanced user interface equivalent to that of the conventional client application 430 can be provided.

Further, as shown in FIG. 2C, by registering a screen operation scenario including a procedure (screen generation) for instructing the information processing apparatus a corresponding to the operation screen 1 to generate a new operation screen, information processing is performed. Transition to any operation screen included in the processing content handled by the apparatus can be realized.
FIG. 6 shows a sequence diagram representing the screen transition operation.
For example, in response to a notification of an event detection result indicating that an item in the pop-up list in the operation screen 1 has been selected, the operation reception unit 211 designates the corresponding search key to the scenario management unit 212 and displays the screen. An operation scenario search is instructed, and a screen operation scenario as shown in FIG.

At this time, the operation reception unit 211 first follows the procedure of the screen operation scenario. The parameter including the item of the selected list is edited, the obtained parameter is designated, and the information processing apparatus a is requested to create a new operation screen via the apparatus cooperation unit 215a.
In response to this request, the function processing unit 208a of the client application 204 constituting the information processing apparatus a creates display data for displaying a new operation screen specified by the above-described parameters. The display data created in this way is directly used for display processing of the operating system 202 as in the past, and in response to this, a new operation screen is provided to the user via the display unit 203, Screen transition is realized.

Next, a method for coordinating business with another information processing apparatus b that performs business processing independent of the information processing apparatus a that provides an operation screen to be operated will be described.
For example, as shown in FIG. 2D, in response to an operation on the operation screen 1 provided by the information processing apparatus a, a procedure for requesting execution of a business process specifying the information processing apparatus b by auxiliary information (start request) 7 is read out, the operation accepting unit 211 instructs the device cooperation unit 215b corresponding to the information processing device b to send an activation request, as shown in FIG.

  In response to this instruction, in response to the activation request sent to the information processing apparatus b by the apparatus cooperation unit 215b, the information processing apparatus b creates display data for an operation screen for starting business processing. Is subjected to display processing by the operating system 202 of the terminal device 201. Based on this display data, the operating system 202 performs a process of providing a new operation screen to the user via the display unit 203, so that an operation on the operation screen 1 provided by the information processing apparatus a is performed. It is possible to make a transition to an operation screen of another information processing apparatus b.

  As described above, in the information processing system to which the screen operation control mechanism 210 shown in FIG. 1 is applied, the processing related to the detection and interpretation of the operation on each operation screen displayed on the display unit 203 of the terminal device 201 is performed by the client. It is separated from the application 204 and is shared by the screen operation control mechanism 210. Similarly, processing related to detection and interpretation of operations on individual operation screens displayed on the display unit 203 of the terminal device 201 is separated from the back-end server 207 constituting the WEB-type information processing device b, The screen operation control mechanism 210 is shared.

  Therefore, at the development stage of the server application of the client application 204 and the back-end server 207, it is sufficient to determine the specifications regarding the configuration of the individual operation screens, and the behaviors of the individual components corresponding to the operations on the respective operation screens are determined. There is no need to determine the specifications for transition to another screen. In addition, cooperation between independent information processing apparatuses can be easily realized.

  Further, by registering a new screen operation scenario in the scenario file 213 of the screen operation control mechanism 210 shown in FIG. 1, a desired change can be reflected on the operation screen in response to a new operation on the operation screen. it can. Further, by changing the search key corresponding to the existing screen operation scenario, it is possible to change the operation for starting the procedure defined in the screen operation scenario.

  As described above, according to the screen operation control device according to the present invention, it is possible to release application programs and server programs that constitute individual information processing devices from consideration for operations related to each component in the operation screen. . As a result, it is possible to drastically reduce the time required to develop programs that make up various information processing systems that require various screen operations in response to user operations. It is very useful as a means of improving the efficiency of program development in various information processing systems including management systems.

In addition, by applying the screen operation control apparatus according to the present invention, it becomes possible to flexibly cope with the addition or change of the operation procedure after operating the information processing system. It is also very useful in the field of maintenance management.
Furthermore, since it is possible to easily realize cooperation between independent information processing devices, it is possible to flexibly cope with complex workflows and to follow changes in workflows. It is also useful in terms of efficiency.

It is a figure which shows embodiment of the information processing system to which the screen operation control apparatus concerning this invention is applied. It is a figure which shows the example of a screen operation scenario. It is a sequence diagram in the case of presenting a part to be operated with scenario definition information. It is a sequence diagram in the case of cooperating with a direct information processing apparatus. It is a sequence diagram showing cooperation operation with an information processor. It is a sequence diagram showing screen transition operation. It is a sequence diagram showing the operation | movement cooperated with another information processing apparatus. It is a figure which shows the structural example of the conventional client-server type | mold information processing system. It is a figure which shows the structural example of the conventional WEB type | mold information processing system.

Explanation of symbols

201 terminal device 202 operating system (OS)
203, 416 Display unit 204, 410 Client application (CL-APL)
205 Browser 206, 207 Back-end server 208, 413 Function processing unit 209 External interface (I / F)
210 Screen operation control mechanism 211 Operation reception unit 212 Scenario management unit 213 Scenario file 214 Component control unit 215 Device cooperation unit 410 Client application 412 Event analysis unit 414 Communication processing unit 415 Display control unit 420, 440 Server application 430 Browser software 431 Basic functions Part 432 APL
441 User interface (I / F) program

Claims (4)

Operation detecting means for detecting an operation performed by the user on the operation screen displayed on the display screen of the terminal device in order to realize exchange of information between the user and the information processing device;
Analyzing the operation detected by the operation detection means, and analyzing means for specifying the content of the change related to the operation screen to be presented according to the operation on the operation screen;
Based on the analysis result obtained by the analysis means, the component control means for controlling the behavior of the operation target part included in the operation screen and the generation of a new operation part;
Based on the analysis result obtained by the analyzing means, the information processing device is requested for appropriate display information corresponding to the content of the change relating to the operation screen to be presented, and obtained from the information processing device in response to the request. And a link means for reflecting the displayed display information on the display of the operation screen on the display screen of the terminal device,
A screen operation control device arranged in the terminal device independently of the information processing device The screen operation control device according to claim 1,
The cooperation unit is provided corresponding to the plurality of information processing devices, and selectively requests for display information to be created by the corresponding information processing device based on the analysis result obtained by the analysis unit. A screen operation control device comprising relay means for relaying to an information processing device and receiving a response from the corresponding information processing device. The screen operation control device according to claim 2,
The relay means corresponding to each information processing apparatus,
A screen operation characterized by comprising a device interface that mediates a request corresponding to the analysis result obtained by the analysis means and exchange of a response to the request in consideration of unique processing in the corresponding information processing device Control device. Information processing for displaying on the display screen of the terminal device via the screen operation control device an operation screen provided on the display screen of the terminal device in order for at least one information processing device to exchange information with the user In the system,
The screen operation control device includes:
Operation detecting means for detecting an operation performed by the user on the operation screen;
Analyzing the operation detected by the operation detection means, and analyzing means for specifying the content of the change related to the operation screen to be presented according to the operation on the operation screen;
Based on the analysis result obtained by the analysis means, the component control means for controlling the behavior of the operation target part included in the operation screen and the generation of a new operation part;
Based on the analysis result obtained by the analyzing means, the information processing device is requested for appropriate display information corresponding to the content of the change relating to the operation screen to be presented, and obtained from the information processing device in response to the request. And a link means for reflecting the displayed display information on the display of the operation screen on the display screen of the terminal device,
The linkage means is provided corresponding to the at least one information processing apparatus, and selectively requests for display information to be created by the corresponding information processing apparatus based on the analysis result obtained by the analysis means. Relaying to the information processing apparatus, comprising a relay means for receiving a response from the corresponding information processing apparatus;
The information processing apparatus corresponding to each information processing apparatus is arranged to be coupled to the corresponding information processing apparatus, and corresponds to a request corresponding to the analysis result obtained by the analysis means and a response to the request. An information processing system characterized by having a device interface that mediates the processing inherent in the system.

Images