JP6574156B2 - Terminal device, event generation method, and event generation method program - Google Patents

Description

  The present invention relates to a terminal device, an event generation method, and an event generation method program.

  A technique for causing a terminal to automatically execute processing is known. For example, a technique for automatically starting an application when an event prepared in advance occurs in an OS (Operating System) or an application is known (see, for example, Non-Patent Document 1 or 2).

Yukihisa Fujita, Takao Sakurai, Takeshi Naono, "Improvement of application operability with PC operation support agent", IEICE Transactions D, Vol.J95-D, No.12, pp.2059-2071, 2012 Yukihisa Fujita, Takao Sakurai, Ken Naono, "Improvement of application operability with PC operation support agent" BM2 "", HAI Symposium 2010, 3B-2

  However, the conventional technology for automatically executing processing on the terminal has a problem that it may not be able to flexibly cope with various operations of the user. For example, when an operation that is not defined as an event on the system is performed by the user, it is difficult for the conventional technology to automatically cause the terminal to execute a process corresponding to the operation.

  The terminal device according to the present invention includes an execution unit that executes an application that displays a GUI on a display unit, a state acquisition unit that acquires a state of the application every time a specific operation is performed by a user, and the state acquisition unit. If the first state of the application is acquired, whether there is a difference between the first state and the second state acquired by the state acquisition unit immediately before the first state A difference determination unit for determining whether or not there is a difference by the difference determination unit, a condition determination unit for determining whether or not the first state satisfies a preset specific condition, When the condition determination unit determines that the first state satisfies the specific condition, an event generation unit that generates a specific event corresponding to the specific condition; Based on the events generated by the vent generator, and having a an automatic execution unit for executing predetermined processing to the application.

  The event generation method of the present invention is an event generation method executed by a terminal device having an execution unit that executes an application for displaying a GUI, and acquires the state of the application every time a specific operation is performed by a user. And when the first state of the application is acquired by the state acquisition step, the first state and the second state acquired by the state acquisition step immediately before the first state A difference determination step for determining whether or not there is a difference between the state and the difference determination step, when the difference determination step determines that there is a difference, the first state satisfies a predetermined condition set in advance. A condition determination step for determining whether or not the first state satisfies the specific condition by the condition determination step; An event generation step for generating a specific event corresponding to a condition, and an automatic execution step for causing the application to execute a predetermined process based on the event generated by the event generation step. .

  ADVANTAGE OF THE INVENTION According to this invention, when making a terminal perform a process automatically, it comes to be able to respond flexibly to a user's various operation.

FIG. 1 is a diagram illustrating an example of a configuration of a terminal device according to the first embodiment. FIG. 2 is a diagram illustrating an example of a virtual event according to the first embodiment. FIG. 3 is a diagram illustrating an example of a GUI of the terminal device according to the first embodiment. FIG. 4 is a diagram illustrating an example of a virtual event according to the first embodiment. FIG. 5 is a diagram illustrating an example of a GUI of the terminal device according to the first embodiment. FIG. 6 is a diagram illustrating an example of a list of virtual events according to the first embodiment. FIG. 7 is a diagram for explaining automatic execution by the terminal device according to the first embodiment. FIG. 8 is a diagram for explaining automatic execution by the terminal device according to the first embodiment. FIG. 9 is a flowchart illustrating a process flow of the terminal device according to the first embodiment. FIG. 10 is a flowchart illustrating a flow of processing of the terminal device according to the first embodiment. FIG. 11 is a flowchart illustrating a processing flow of the terminal device according to the first embodiment. FIG. 12 is a diagram illustrating an example of a computer in which a terminal device is realized by executing a program.

  Embodiments of a terminal device, an event generation method, and an event generation program according to the present application will be described below in detail with reference to the drawings. In addition, this invention is not limited by this embodiment.

[Configuration of First Embodiment]
First, the configuration of the terminal device according to the first embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of a configuration of a terminal device according to the first embodiment. The terminal device 10 is a personal computer, for example. As illustrated in FIG. 1, the terminal device 10 includes a display unit 11, an operation unit 12, a control unit 13, and a storage unit 14. The display unit 11 is a display device such as a display. The operation unit 12 is an input device such as a mouse or a keyboard.

  The control unit 13 controls the terminal device 10 as a whole. The control unit 13 is, for example, an electronic circuit such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 13 has an internal memory for storing programs and control data defining various processing procedures, and executes each process using the internal memory. The control unit 13 functions as various processing units when various programs are operated.

  The control unit 13 includes an OS 131, an application 132, a virtual event generation unit 133, and an automatic execution unit 134. The application 132 displays a GUI (Graphical User Interface) on the display unit 11. The application 132 is, for example, an e-mail client, a web browser, a file manager, spreadsheet software, or the like. The number of applications 132 is not limited to the number in the figure, and can be an arbitrary number.

  The virtual event generation unit 133 generates an event when a predetermined condition is satisfied when an operation by the user is performed. Hereinafter, an event generated by the virtual event generation unit 133 is referred to as a virtual event. When the virtual event is generated, the automatic execution unit 134 causes the OS 131 or the application 132 to execute processing corresponding to the generated virtual event.

  The virtual event generation unit 133 includes a state acquisition unit 201, a difference determination unit 202, a condition determination unit 203, and an event generation unit 204. The storage unit 14 includes a state storage unit 141 and a condition storage unit 142.

  The state acquisition unit 201 acquires the state of the application every time a specific operation is performed by the user. For example, the state acquisition unit 201 may directly acquire the state from each application each time a mouse click or a keyboard press is performed, or the value input to the GUI component displayed on the display unit 11 may be obtained. You may acquire as an application state. At this time, the state acquisition unit 201 receives a mouse click or keyboard pressing event from the OS 131, for example. Then, the state acquisition unit 201 acquires, for example, a text box character string, a check box ON / OFF value, a list box selected value, and the like as values input to the GUI component.

  The state acquisition unit 201 transmits the acquired application state to the difference determination unit 202 and stores it in the state storage unit 141. Further, the state acquisition unit 201 stores the event received from the OS 131 in the state storage unit 141.

  When the first state of the application is acquired by the state acquisition unit 201, the difference determination unit 202 includes the first state, the second state acquired by the state acquisition unit 201 immediately before the first state, It is determined whether there is a difference between the two. Specifically, the difference determination unit 202 sets the application state received from the state acquisition unit 201 as the first state, and excludes the first state from the application states stored in the state storage unit 141. Is stored in the second state.

  Normally, the GUI object has a predetermined event that can be notified for each type. Many GUI objects do not have a notification function. Therefore, in the present embodiment, the difference determination unit 202 determines whether or not there is a difference in the GUI state, so that an application state change can be acquired as an event.

  When the difference determining unit 202 determines that there is a difference, the condition determining unit 203 determines whether or not the first state satisfies a specific condition set in advance. The condition storage unit 142 stores a list of conditions used by the condition determination unit 203 for determination.

  In addition, the condition storage unit 142 may store a table in which specific conditions that are arbitrarily set and specific events that are arbitrarily set are associated with each other as a list of conditions. At this time, the condition determination unit 203 performs determination using a specific condition acquired from the condition storage unit 142. In addition, the event generation unit 204 generates a specific event acquired from the condition storage unit 142.

  “Generating an event” means generating an event, and the event generating unit 204 generates an event in a format that can be interpreted by an automation tool not included in the virtual event generating unit 133.

  In addition, the event generation unit 204 generates a specific event corresponding to the specific condition when the condition determination unit 203 determines that the first state satisfies the specific condition. The automatic execution unit 134 functions as an automation tool that interprets virtual events and causes the application 132 to execute processing.

  The virtual event will be described with reference to FIGS. First, the virtual event “start detailed setting” will be described with reference to FIGS. FIG. 2 is a diagram illustrating an example of a virtual event according to the first embodiment. FIG. 3 is a diagram illustrating an example of a GUI of the terminal device according to the first embodiment.

  As shown in FIG. 3, a window 301 that is a GUI has a check box 302. The virtual event “start detailed setting” is generated when the check box 302 of the window 301 is turned ON.

  First, the state acquisition unit 201 receives an event “Window1.Checkbox1 clicked” from the OS 131, that is, “the check box 302 of the window 301 has been clicked”. Then, the state acquisition unit 201 acquires the state of the GUI object including the window 301, transmits the acquired state to the difference determination unit 202, and stores it in the state storage unit 141.

  Here, the difference determination unit 202 displays the state of each application received from the state acquisition unit 201 among the state of each application received from the state acquisition unit 201 and the state of each application stored in the state storage unit 141. Compare the latest state with the exception, and identify an application that has a difference in the state. Here, it can be inferred that an application having a difference in state is an application subject to a mouse click or a keyboard pressing event.

  If there is a difference in the state of the window 301, the condition determination unit 203 determines whether or not the state of the window 301 satisfies a condition for generating the virtual event “start detailed setting”. As shown in Figure 2, after the system event "Window1.Checkbox1 clicked" occurs, "Window1.title == 'Setting'", "Window1.Checkbox1.text = ~ 'Advanced setting'", "Window1 If the condition “Checkbox1.previousValue == 0” is satisfied, the condition determination unit 203 determines that the state of the window 301 satisfies the condition for generating the virtual event “start detailed setting”.

  The condition “Window1.title ==“ setting ”” is satisfied when the title of the window 301 is “setting”. Further, the condition “Window1.Checkbox1.text = ~“ advanced setting ”” is satisfied when the text in the check box 302 includes the character string “advanced setting”. Further, “Window1.Checkbox1.previousValue == 0” is satisfied when the previous value of the check box 302 is 0, that is, when it is not checked.

  When the condition determining unit 203 determines that the state of the window 301 satisfies the condition for generating the virtual event “detailed setting start”, the event generating unit 204 generates a virtual event “detailed setting start”. When the virtual event “start detailed setting” is generated, the automatic execution unit 134 activates, for example, the application 132 for performing detailed setting.

  Next, the virtual event “facility registration” will be described with reference to FIGS. FIG. 4 is a diagram illustrating an example of a virtual event according to the first embodiment. FIG. 5 is a diagram illustrating an example of a GUI of the terminal device according to the first embodiment.

  As shown in FIG. 5, a window 401 that is a GUI has a button 402. The window 401 is called from the window 403. The virtual event “facility registration” is generated when the button 402 is pressed.

  Here, a dialog like the window 401 is often used in various places in the system. A dialog such as the window 401 is displayed immediately before an irreversible operation is performed, for example. For this reason, it is desirable that different virtual events be generated depending on the context even when the operations are performed on the same dialog.

  First, the state acquisition unit 201 receives an event “Window1.Button1 clicked”, that is, an event “the button 402 of the window 401 has been clicked” from the OS 131. Then, the state acquisition unit 201 acquires the state of the GUI object including the window 401, transmits the acquired state to the difference determination unit 202, and stores the acquired state in the state storage unit 141. Then, as in the case of the virtual event “start detailed setting”, the difference determination unit 202 identifies an application having a difference in state.

  If there is a difference in the state of the window 401, the condition determination unit 203 determines whether or not the state of the window 401 satisfies a condition for generating the virtual event “facility registration”. As shown in FIG. 4, after the system event "Window1.Button1 clicked" occurs, "Window1.title == 'confirmation'", "Window1.Button1.text = ~ 'Yes'", "Window2.title == If the condition “new equipment registration” is satisfied, the condition determination unit 203 determines that the state of the window 401 satisfies the condition for generating the virtual event “facility registration”.

  The condition “Window1.title ==“ confirmation ”” is satisfied when the title of the window 401 is “confirmation”. Further, the condition “Window1.Button1.text = ˜‘Yes’ ”is satisfied when the text of the button 402 includes the character string“ Yes ”. Further, “Window2.title ==“ new equipment registration ”” is satisfied when the window 401 that called the window 401, that is, the title of the window 403 is “new equipment registration”.

  When the condition determination unit 203 determines that the state of the window 401 satisfies the condition for generating the virtual event “facility registration”, the event generation unit 204 generates a virtual event “facility registration”. When the virtual event “facility registration” is generated, the automatic execution unit 134 activates, for example, the application 132 for performing facility registration.

  The virtual event generation unit 133 may generate various virtual events as shown in FIG. 6 in addition to the above-described “detailed setting start” and “facility registration”. FIG. 6 is a diagram illustrating an example of a list of virtual events according to the first embodiment.

  The list of virtual events shown in FIG. 6 assumes that, for example, when a user receives an email about a business trip, an operation related to the business trip is performed on the terminal device 10. By generating a virtual event as shown in FIG. 6, the terminal device 10 can automatically execute processing such as searching for an address of a business trip destination and creating a file related to the business trip in accordance with a user operation. . In addition, in FIG. As illustrated in 1 to 4, the virtual event generation unit 133 may further generate a virtual event using the virtual event as a generation condition.

  For example, in FIG. One virtual event “mail open” is a case where a mouse click or a keyboard press occurs and there is a difference in the state of the email client, which is one of the applications 132, “the email client is the frontmost window”. , “The text is displayed” and “The text content is different from that before the event” is satisfied.

  In addition, in FIG. The second virtual event “Mail Read Completion” is generated when the virtual event “Mail Open” occurs and the condition “A certain time has elapsed since the text was displayed” is satisfied.

  In addition, in FIG. The virtual event “business trip notification” 3 is generated when the virtual event “mail read-out” occurs and the condition “there is an address in the text” is satisfied. Furthermore, when the virtual event “business trip notification” is generated, the automatic execution unit 134 causes the web browser, which is one of the applications 132, to execute an address search from a map on the web.

  In addition, in FIG. The virtual event “format specification” No. 4 is generated when the virtual event “mail read-out” occurs and the condition “the body has a path of the shared file server” is satisfied. Further, when the virtual event “format specification” is generated, the automatic execution unit 134 causes the file manager, which is one of the applications 132, to execute a process of opening a folder specified by the path of the shared file server.

  In addition, in FIG. The virtual event “format file copy” of No. 5 is “file copy to desktop”, “file name includes“ day trip expense ”” when a file copy occurs and there is a difference in the state of the file manager. It is generated when the condition is satisfied. Further, when the virtual event “format file copy” is generated, the automatic execution unit 134 causes the file manager to add today's date to the end of the file name of the copied file. Note that the status regarding the file, such as whether or not the file has been copied to the desktop, may not be acquired from the GUI, so the status acquisition unit 201 may acquire the status regarding the file from the file system.

  In addition, in FIG. The virtual event “cell content change” of No. 6 occurs when a mouse click or a keyboard press occurs and there is a difference in the state of the spreadsheet software. It is generated when the conditions “change” and “the value of the cell at the position where the focus was placed before the event change” are satisfied.

  In addition, in FIG. The virtual event “Destination Confirmation” of No. 7 occurs when the virtual event “cell contents change” occurs, and the conditions “file name includes“ day trip expenses ”” and “change cell is destination designated cell” are satisfied. Is generated. Further, when the virtual event “Destination Determination” is generated, the automatic execution unit 134 causes the web browser to execute a route search at the route search site A.

  In addition, in FIG. The virtual event “Route Confirmation” in FIG. 8 indicates that when a mouse click or a keyboard press occurs and there is a difference in the state of the web browser, “Web browser is frontmost window” and “URL is route search site A It is generated by satisfying the condition that “the selected route is different from that before the event”. Further, when the virtual event “confirm route” is generated, the automatic execution unit 134 causes the spreadsheet software to transfer the selected route information and fee to the day trip expense file. Here, the day trip expense file is a document of spreadsheet software in which the virtual event “confirm destination” occurs.

  Here, an example of a screen displayed on the display unit 11 when automatic execution is performed will be described with reference to FIGS. 7 and 8 are diagrams for explaining automatic execution by the terminal device according to the first embodiment. First, in FIG. 7, when the virtual event is generated in the order of “mail open”, “mail read completed”, “business trip notification”, and “format setting”, and the processing by the automatic execution unit 134 is performed, the display unit 11 Shows the screen displayed. As shown in FIG. 7, “A prefecture B city C1-7-1” is displayed as an address on the e-mail client 132a, and the web browser 132b searches for the address from a map on the web. . Further, “\\ server 1 \ 00_application \ 03_travel expense” is displayed as the path of the shared file server on the e-mail client 132a, and the file manager 132c opens the folder specified by the path.

  FIG. 8 shows a case where virtual events are generated in the order of “format file copy”, “cell contents change”, and “destination determination” from the state of FIG. 7 and processing by the automatic execution unit 134 is performed. The screen displayed on the display part 11 is shown. In the spreadsheet software 132d, a value is set in a business trip destination cell that is a destination designation cell, and the web browser 132b searches the route search site A for a route having the value as a destination. Thereafter, when the generation condition is satisfied and the virtual event “route confirmation” is generated, the route selected on the web browser 132b is input to the route input field of the spreadsheet software 132d.

[Process of First Embodiment]
The process flow of the terminal device 10 will be described with reference to FIG. FIG. 9 is a flowchart illustrating a process flow of the terminal device according to the first embodiment. As illustrated in FIG. 9, first, the state acquisition unit 201 of the terminal device 10 waits until a specific operation is performed by the user (No in Step S101). When a specific operation by the user is performed (step S101, Yes), the state acquisition unit 201 acquires the state of the application (step S102).

  The difference determination unit 202 determines whether there is a difference between the state of the application acquired by the state acquisition unit 201 and the state of the previous application stored in the state storage unit 141 (step S103). When the difference determination unit 202 does not determine that there is a difference (No in step S103), the terminal device 10 ends the process.

  If the difference determination unit 202 determines that there is a difference (step S103, Yes), the state acquisition unit 201 stores the acquired application state in the state storage unit 141 (step S104). Note that the timing at which the state acquisition unit 201 stores the application state in the state storage unit 141 may be before the difference determination by the difference determination unit 202.

  Next, the condition determination unit 203 determines whether or not a condition for generating a virtual event is satisfied (step S105). When the condition determination unit 203 does not determine that the condition is satisfied (step S105, No), the terminal device 10 ends the process. If the condition determining unit 203 determines that the condition is satisfied (step S105, Yes), the event generating unit 204 generates a virtual event (step S106). At this time, when the process corresponding to the virtual event is set, the automatic execution unit 134 automatically executes the process (step S107).

  Further, an example in which a virtual event “cell value change” is generated will be described with reference to FIG. FIG. 10 is a flowchart illustrating a flow of processing of the terminal device according to the first embodiment. If the spreadsheet software document is not being edited (No at Step S201), the terminal device 10 does not generate the virtual event “cell value change”, and thus ends the process. When the document of the spreadsheet software is being edited (step S201, Yes), the state acquisition unit 201 acquires the coordinates of the focused cell (step S202).

  Here, the difference determination unit 202 determines whether or not the cell coordinates acquired by the state acquisition unit 201 are the same as the previously acquired cell coordinates (step S203). When the difference determination unit 202 determines that the coordinates of the cell acquired by the state acquisition unit 201 are the same as the coordinates of the cell acquired last time (step S203, Yes), the terminal device 10 ends the process. .

  When the difference determination unit 202 determines that the cell coordinates acquired by the state acquisition unit 201 are not the same as the previously acquired cell coordinates (No in step S203), the state acquisition unit 201 The coordinates and contents of the cell being stored are stored in the state storage unit 141 (step S204). Thus, the difference determination unit 202 can determine the presence or absence of a difference based on the coordinates of the focused cell, which is an example of the application state.

  Here, the state acquisition unit 201 further acquires the content (current value) of the previous coordinate (step S205). Here, the previous coordinate is a coordinate before the focus moves. Then, the condition determination unit 203 compares the content stored in the state storage unit 141 of the cell before the focus moves with the current value, and if they match (Yes in step S206), the process ends. . If they do not match (step S206, No), the event generation unit 204 generates a virtual event “cell value change” (step S207). In this case, for example, the automatic execution unit 134 can execute a process of starting a web browser and writing the result of searching the changed cell contents on the search site in a predetermined cell.

  An example of generating virtual events “check box ON” and “check box OFF” will be described with reference to FIG. FIG. 11 is a flowchart illustrating a processing flow of the terminal device according to the first embodiment. When a mouse click event that is a system event occurs, the state acquisition unit 201 acquires the state of the GUI at the click position. At this time, if the difference determination unit 202 is the check box at the click position (step S301, Yes) or the check box is focused (step S302, Yes), the difference determination unit 202 It is determined whether or not the value indicating ON / OFF matches the value stored in the state storage unit 141 (step S303).

  Note that if neither of the conditions in steps S301 and S302 is satisfied, the terminal device 10 ends the process. When the difference determination unit 202 determines that the value indicating ON / OFF of the check box matches the value stored in the state storage unit 141 (step S303, Yes), the terminal device 10 The process ends.

  When the difference determination unit 202 determines that the value indicating ON / OFF of the check box does not match the value stored in the state storage unit 141 (No in step S303), the state acquisition unit 201 A value indicating ON / OFF of the acquired check box is stored in the state storage unit 141 (step S304).

  The condition determination unit 203 determines whether or not the current value of the check box is a value indicating ON (step S305). When the condition determination unit 203 determines that the current value of the check box is a value indicating ON (step S305, Yes), the event generation unit 204 generates a virtual event “check box ON” (step S306). If the condition determination unit 203 determines that the current value of the check box is not a value indicating ON (step S305, No), the event generation unit 204 generates a virtual event “check box OFF” (step S306). .

[Effect of the first embodiment]
The control unit 13 executes an application 132 that causes the display unit 11 to display a GUI. The state acquisition unit 201 acquires the state of the application every time a specific operation is performed by the user. In addition, when the state acquisition unit 201 acquires the first state of the application, the difference determination unit 202 includes the first state and the second state acquired by the state acquisition unit 201 immediately before the first state. And whether there is a difference between them.

  When the difference determining unit 202 determines that there is a difference, the condition determining unit 203 determines whether or not the first state satisfies a specific condition set in advance. In addition, the event generation unit 204 generates a specific event corresponding to the specific condition when the condition determination unit 203 determines that the first state satisfies the specific condition. The automatic execution unit 134 causes the application 132 to automatically execute a predetermined process based on the event generated by the event generation unit 204.

  As a result, even when a user operation cannot be acquired as a system event, by defining it as a virtual event, the terminal can automatically execute processing based on the user operation. Become. As described above, according to the present embodiment, it is possible to flexibly cope with various operations of the user when the terminal automatically executes the process.

  The state acquisition unit 201 may acquire a value input to the GUI component displayed on the display unit 11 as an application state each time a mouse click or a keyboard press is performed. In particular, in a personal computer, the user's operation is often a value input by mouse click or keyboard press, so by performing a process of generating a virtual event triggered by mouse click or keyboard press, it is possible to perform many operations. Can respond.

  The condition storage unit 142 stores a table in which specific conditions that are arbitrarily set and specific events that are arbitrarily set are associated with each other. At this time, the condition determination unit 203 performs determination using a specific condition acquired from the condition storage unit 142. In addition, the event generation unit 204 generates a specific event acquired from the condition storage unit 142. Thereby, since arbitrary conditions and events can be set in advance, various events corresponding to various operations of the user can be generated.

[System configuration, etc.]
Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or a part of the distribution / integration is functionally or physically distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. Furthermore, all or a part of each processing function performed in each device may be realized by a CPU and a program that is analyzed and executed by the CPU, or may be realized as hardware by wired logic.

  Also, among the processes described in this embodiment, all or part of the processes described as being performed automatically can be performed manually, or the processes described as being performed manually can be performed. All or a part can be automatically performed by a known method. In addition, the processing procedure, control procedure, specific name, and information including various data and parameters shown in the above-described document and drawings can be arbitrarily changed unless otherwise specified.

[program]
As an embodiment, the terminal device 10 can be implemented by installing a virtual event generation program for executing the above virtual event generation as package software or online software on a desired computer. For example, the information processing apparatus can function as the terminal apparatus 10 by causing the information processing apparatus to execute the virtual event generation program. The information processing apparatus referred to here includes a desktop or notebook personal computer. In addition, the information processing apparatus includes mobile communication terminals such as smartphones, mobile phones and PHS (Personal Handyphone System), and slate terminals such as PDA (Personal Digital Assistant).

  The terminal device 10 can also be implemented as a virtual event generation server device that uses a terminal device used by a user as a client and provides the client with the above-described service related to virtual event generation. For example, the virtual event generation server device is implemented as a server device that provides a virtual event generation service that receives a system event and an application state as an input and outputs a virtual event. In this case, the virtual event generation server device may be implemented as a Web server, or may be implemented as a cloud that provides the above-described service related to virtual event generation by outsourcing.

  FIG. 12 is a diagram illustrating an example of a computer in which a terminal device is realized by executing a program. The computer 1000 includes a memory 1010 and a CPU 1020, for example. The computer 1000 also includes a hard disk drive interface 1030, a disk drive interface 1040, a serial port interface 1050, a video adapter 1060, and a network interface 1070. These units are connected by a bus 1080.

  The memory 1010 includes a ROM (Read Only Memory) 1011 and a RAM 1012. The ROM 1011 stores a boot program such as BIOS (Basic Input Output System). The hard disk drive interface 1030 is connected to the hard disk drive 1090. The disk drive interface 1040 is connected to the disk drive 1100. For example, a removable storage medium such as a magnetic disk or an optical disk is inserted into the disk drive 1100. The serial port interface 1050 is connected to a mouse 1110 and a keyboard 1120, for example. The video adapter 1060 is connected to the display 1130, for example.

  The hard disk drive 1090 stores, for example, an OS 1091, an application program 1092, a program module 1093, and program data 1094. That is, a program that defines each process of the terminal device 10 is implemented as a program module 1093 in which a code executable by a computer is described. The program module 1093 is stored in the hard disk drive 1090, for example. For example, a program module 1093 for executing processing similar to the functional configuration in the terminal device 10 is stored in the hard disk drive 1090. Note that the hard disk drive 1090 may be replaced by an SSD.

  The setting data used in the processing of the above-described embodiment is stored as program data 1094 in, for example, the memory 1010 or the hard disk drive 1090. Then, the CPU 1020 reads the program module 1093 and the program data 1094 stored in the memory 1010 and the hard disk drive 1090 to the RAM 1012 and executes them as necessary.

  The program module 1093 and the program data 1094 are not limited to being stored in the hard disk drive 1090, but may be stored in, for example, a removable storage medium and read out by the CPU 1020 via the disk drive 1100 or the like. Alternatively, the program module 1093 and the program data 1094 may be stored in another computer connected via a network (LAN, WAN (Wide Area Network), etc.). Then, the program module 1093 and the program data 1094 may be read by the CPU 1020 from another computer via the network interface 1070.

DESCRIPTION OF SYMBOLS 10 Terminal device 11 Display part 12 Operation part 13 Control part 14 Storage part 131 OS
132 Application 132a Email Client 132b Web Browser 132c File Manager 132d Spreadsheet Software 133 Virtual Event Generation Unit 134 Automatic Execution Unit 141 State Storage Unit 142 Condition Storage Unit 201 Status Acquisition Unit 202 Difference Determination Unit 203 Condition Determination Unit 204 Event Generation Unit 301 , 401, 403 Window 302 Check box 402 button

Claims (5)

An execution unit for executing an application for displaying a GUI on the display unit;
A state acquisition unit that acquires the state of the application each time a specific operation is performed by the user;
When the first state of the application is acquired by the state acquisition unit, between the first state and the second state acquired by the state acquisition unit immediately before the first state A difference determination unit that determines whether there is a difference; and
A condition determination unit that determines whether or not the first state satisfies a specific condition set in advance when the difference determination unit determines that there is a difference;
An event generation unit that generates a specific event corresponding to the specific condition when the condition determination unit determines that the first state satisfies the specific condition;
Based on the event generated by the event generation unit, an automatic execution unit that causes the application to execute a predetermined process;
The terminal device characterized by having.   2. The state acquisition unit acquires a value input to a GUI component displayed on the display unit as the state of the application every time a mouse click or a keyboard press is performed. The terminal device described in 1. A condition storage unit for storing a table in which the specific condition arbitrarily set and the specific event arbitrarily set are associated;
The condition determination unit performs determination using the specific condition acquired from the condition storage unit,
The terminal device according to claim 1, wherein the event generation unit generates the specific event acquired from the condition storage unit. An event generation method executed by a terminal device having an execution unit for executing an application for displaying a GUI,
Each time a specific operation is performed by the user, a state acquisition step of acquiring the state of the application;
When the first state of the application is acquired by the state acquisition step, between the first state and the second state acquired by the state acquisition step immediately before the first state. A difference determination step for determining whether there is a difference; and
A condition determining step for determining whether or not the first state satisfies a predetermined condition when it is determined that there is a difference in the difference determining step;
An event generation step of generating a specific event corresponding to the specific condition when the condition determination step determines that the first state satisfies the specific condition;
An automatic execution step for causing the application to execute a predetermined process based on the event generated by the event generation step;
The event generation method characterized by including.   An event generation program for causing a computer to function as the terminal device according to any one of claims 1 to 3.

Images