JP2011108039A - Input support system, input support method and input support program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input support system capable of reducing user's efforts for preparatory work accompanying automatic input, and capable of automatically predicting the inputted content with accuracy, even if the content is not one which has previously been inputted. <P>SOLUTION: An operation information specifying means 83 specifies, when data is inputted into an input column for operation target content, operation information that associates the position of the input column for operation target content and the data position of reference content to be inputted into the input column, through a data position selection operation and a data input operation into the input column. An operation information history registering means 85, based on the operation information, associates and registers the position of the input column and the data position of the reference content in an operation information history retaining means 84. An input content estimating means 86 estimates the data displayed in the data position of the reference content stored, in the operation information history retaining means 84 as the data to be inputted into the input column for the operation target content associated with the data position, and displays the data in the input column. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an input assist system, an input assist method, and an input assist program for predicting input contents and assisting user input.

  With the spread of mobile phones and personal computers, various information such as e-mails and schedule management is often managed by information devices. Therefore, there are increasing opportunities for users to input data through the device, and it is an issue to reduce the burden of input work.

  In view of this, a method has been proposed in which input candidates are presented by predicting the content input by the user using a dictionary or history prepared in advance, or input is automatically performed instead of the user. According to these methods, the user only has to select the input content from the presented options, and it is only necessary to confirm the automatically input content, thereby reducing the burden on input.

  Further, systems and methods for realizing the above-described method are described in Patent Document 1 and Patent Document 2.

  Patent Document 1 describes an input support system that simplifies information input in an information home appliance using personal data recorded in a portable information terminal. In the input support system described in Patent Document 1, the data extraction unit extracts personal data that matches the item name of the input form in the document file from personal information such as an address and name stored in another information device. To do. The document file conversion unit converts the extracted information into a pull-down format option for display on the input form. Thus, by converting the input form into a pull-down menu and presenting it, the user can input data simply by selecting the content to be input from the options. Therefore, it is not necessary to input all data, and the burden can be reduced.

  Patent Document 2 describes an input operation support method that collectively predicts input operations for a plurality of operation target items belonging to the same window. In the method described in Patent Document 2, in a multi-window system, an input operation history and an active window transition history in each window are stored. Thereafter, when a similar active window transition is performed, an input frequently performed in the window is presented as a candidate from the recorded input history. Thus, by presenting input operation candidates based on the history, a frequently performed input operation can be automatically performed, so that the user's trouble can be reduced.

  Patent Document 3 describes an input support program for realizing an efficient data input operation. In a database of a computer equipped with the input support program described in Patent Document 3, a variable assigned to an input field is used as a search key, and the search key and data are stored in association with each other. And a data acquisition means acquires the data matched with the variable provided to the input field to display from a database. Further, when the user manually designates data in the input field, the designation storage means stores the variable assigned to the input field in the database in association with the selected data.

JP 2009-70189 A (paragraphs 0046 to 0048) JP 2007-58737 A (paragraph 0006) JP 2004-246647 A (paragraphs 0027, 0031)

  In general, the contents automatically input or supplemented with respect to the data input position are limited to fixed contents prepared in advance by a dictionary or a history. For example, assume that the content displayed on a recently viewed page is copied and used as input information. In this case, if the input information is managed as history information, the input information can be predicted as the content to be automatically input.

  Hereinafter, a specific example will be described. For example, it is assumed that a mail address retrieved from the address book is copied and entered in the mail address field. After that, when trying to send an e-mail again, it is possible to automatically enter the e-mail address previously input to the e-mail address field by using the history. On the other hand, it is assumed that another mail address is searched from the address book by another operation. However, when using a history registered in advance, it is difficult to automatically enter the mail address in the mail address field. That is, it is difficult to automatically input other information by diverting recently browsed information. The same applies to the case where the address of the store searched on the Web is input in the body of the mail.

  In order to solve such a problem, it is conceivable to prepare a large amount of information for automatic input in advance. However, such a preparation work has a problem of increasing the burden on the user.

  Further, in the input support system described in Patent Document 1, the input content displayed on the menu is limited to personal information stored in advance in another device. On the other hand, in the method described in Patent Document 2, it is not necessary to prepare information like a dictionary in advance. However, the automatically input information is limited to fixed contents such as user IDs and passwords input in past operations. Also, when using the input support program described in Patent Document 3, there is a problem that only data that has been input in the past can be automatically input to the input form.

  Therefore, the present invention can reduce the labor of a user's preparatory work associated with automatic input, and can assist the input assist system and the input assist method that can predict the contents to be automatically input with high accuracy even if the contents have not been input in the past. And to provide an input assistance program.

  The input assistance system according to the present invention displays an operation content display means for displaying operation target content that is content including an input field for inputting data, and reference content that is content including data input to the operation target content. An operation for associating the position of the input field of the operation target content with the data position of the reference content input to the input field when data is input to the input field of the operation target content. Operation information specifying means for specifying the operation information, which is the information to be indicated by the selection operation of the data position and the data input operation to the input field, and the operation of storing the position of the input field and the data position of the reference content in association with each other Based on the operation information specified by the information history holding means and the operation information specifying means, Information history registration means for associating the data position of the reference content data with the operation information history holding means, and the data displayed at the reference content data position stored in the operation information history holding means for the data position. An input content estimation means for estimating data to be input to the input field of the operation target content associated with and displaying the data in the input field is provided.

  The input assist method according to the present invention displays operation target content that is content including an input field in which data is input, displays reference content that is content including data input to the operation target content, and operates target content. When data is input to the input field, the operation information, which is information indicating an operation for associating the position of the input field of the operation target content with the data position of the reference content input to the input field, It is specified by the position selection operation and the data input operation to the input field, and based on the specified operation information, the position of the input field and the position of the reference content data are associated and registered in the operation information history holding means. The data displayed at the data position of the reference content stored in the operation information history holding means is associated with the data position. Estimates that data input to the input section of the operation target content, and displaying the data on the input field.

  The input auxiliary program according to the present invention is an operation content display process for displaying an operation target content that is a content including an input field for inputting data on a computer, and a reference content that is content including data input to the operation target content. The reference content display processing for displaying the operation, the operation of associating the position of the input column of the operation target content with the data position of the reference content input to the input column when data is input to the input column of the operation target content Operation information, which is information indicating the position of the input field and the reference content of the reference content based on the operation information specifying process for specifying the data position by the selection operation of the data position and the data input operation to the input field. Registering operation information history to associate with data position and register in operation information history holding means And the data displayed in the data position of the reference content stored in the operation information history holding means is estimated as data to be input to the input field of the operation target content associated with the data position, and the input field An input content estimation process for displaying data is executed.

  According to the present invention, it is possible to reduce the labor of the user's preparation work associated with automatic input, and it is possible to predict the content to be automatically input with high accuracy even if the content has not been input in the past.

It is a block diagram which shows the structural example of the input assistance system in 1st Embodiment by this invention. It is explanatory drawing which shows an example of the system screen structure in 1st Embodiment. It is explanatory drawing which shows the example of the method of designating the relationship between reference data and an input form. 6 is an explanatory diagram illustrating an example of operation information stored in an operation information history holding unit 104. FIG. It is a flowchart which shows the example of operation | movement at the time of recording operation information in 1st Embodiment. It is a flowchart which shows the example of operation | movement at the time of estimating input operation in 1st Embodiment. It is a block diagram which shows the structural example of the input assistance system in 2nd Embodiment by this invention. It is explanatory drawing which shows an example of the system screen structure in 2nd Embodiment. It is explanatory drawing which shows an example of the operation information memorize | stored in the operation information log | history holding means. It is a flowchart which shows the example of operation | movement at the time of recording operation information in 2nd Embodiment. It is a flowchart which shows the example of operation | movement at the time of estimating input operation in 2nd Embodiment. It is a block diagram which shows the structural example of the input assistance system in 3rd Embodiment by this invention. It is explanatory drawing which shows an example of the method of designating the relationship and reference information of reference data and an input form. It is explanatory drawing which shows an example of the operation information memorize | stored in the operation information log | history holding means. It is a flowchart which shows the example of operation | movement at the time of recording operation information in 3rd Embodiment. It is a block diagram which shows the minimum structural example of the input assistance system by this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

Embodiment 1. FIG.
First, a configuration example of the first embodiment will be described. FIG. 1 is a block diagram showing a configuration example of an input assistance system according to the first embodiment of the present invention. As illustrated in FIG. 1, the input assist system according to the first embodiment includes an operation content display unit 101, a reference content display unit 102, an operation information identification unit 103, an operation information history holding unit 104, and input contents. And estimation means 105. In the following description, a portion where the operation content display unit 101, the reference content display unit 102, the operation information specifying unit 103, and the operation information history holding unit 104 are combined is also referred to as an operation information recording unit 106. is there. In addition, a part in which the operation content display unit 101 and the input content estimation unit 105 are combined may be referred to as an input content estimation unit 107.

  The operation content display unit 101 displays content to which data is input in accordance with a user operation (hereinafter referred to as operation target content). That is, the operation content display unit 101 displays the operation target content and performs an operation on the content. The operation target content is determined according to an instruction from the user of the content. For example, when the user clicks a link of a page displayed according to the Web browser, the operation content display unit 101 may determine the page specified by the link as the operation target content. Alternatively, when the operation target content is a file system, the operation content display unit 101 may determine the file as the operation target content when the user specifies a file to be displayed from the file list. In the above description, a case has been described in which the operation target content is determined according to an instruction from the user of the content. However, the method of determining the operation target content is not limited to the method of determining according to the user's instruction. For example, when the content in which the data input order is determined is to be displayed, the operation content display unit 101 may determine the operation target content based on the determined input order. The operation content display unit 101 displays the operation target content on an output device (not shown) such as a display device, for example. In the following description, the operation content display unit 101 includes an output device such as a display device.

  The reference content display unit 102 displays content (hereinafter referred to as reference content) including data to be input to the operation target content. That is, the reference content display unit 102 displays content including data used as input data for the operation target content. The reference content displayed on the reference content display unit 102 is, for example, content specified based on history information stored in a storage device (not shown). Examples of history information include, for example, URLs and file paths of contents that have been referred to in the past, and copies of documents stored on the local disk. The reference content display unit 102 displays content satisfying a predetermined standard from the history information. For example, the reference content display unit 102 may determine the reference content to be displayed based on the browsing time or browsing frequency. These criteria may be specified by the user. The reference content display means 102 displays the reference content on an output device (not shown) such as a display device. In the following description, the reference content display unit 102 includes an output device such as a display device.

  When data is input to the input form, the operation information specifying unit 103 performs an operation of associating the position of the input form of the operation target content to which data is input with the data position of the reference content input to the input form. The information to be shown (hereinafter referred to as operation information) is specified. Specifically, the operation information specifying unit 103 specifies at which position of the reference content data is input to the input form of the operation target content simultaneously with the input to the operation target content.

  Further, the operation information specifying unit 103 associates the position of the input form and the position of the data of the reference content based on the specified operation information, and registers them in the operation information history holding unit 104 described later.

  The operation information history holding unit 104 stores the input form position and the reference content data position in association with each other. That is, the operation information history holding unit 104 stores the reference data position specified by the operation information specifying unit 103 and the input form position. The operation information history holding unit 104 is realized by, for example, a magnetic disk device.

  The input content estimation unit 105 estimates the data displayed in the data position of the reference content stored in the operation information history holding unit 104 as the data to be input to the input form of the operation target content associated with the data position. At this time, the input content estimation means 105 may estimate data that satisfies a predetermined condition as input data. Then, the input content estimation unit 105 displays the estimated data on the corresponding input form of the operation content display unit 101. That is, the input content estimation unit 105 estimates the input content for the operation target content using the information obtained from the operation information history holding unit 104, and automatically inputs the content. In addition, as described above, the input content estimation unit 105 presents information to the user based on the information stored in the operation information history holding unit 104, so that it is recommended that the input information is recommended to the user. You can also.

  As described above, the operation information recording unit 106 (more specifically, the operation content display unit 101, the reference content display unit 102, the operation information specifying unit 103, and the operation information history holding unit 104 shown in FIG. ) Can be said to specify the information of the operation by the user. Hereinafter, the operation of each element will be described.

  FIG. 2 is an explanatory diagram illustrating an example of a system screen configuration according to the first embodiment. In the example shown in FIG. 2, the screen displayed by the operation content display unit 101 is shown on the left side, and the screen displayed by the reference content display unit 102 is shown on the right side. In the example shown in FIG. 2, the operation content display unit 101 displays the Web page that the user is currently browsing, and the reference content display unit 102 displays the content specified by the history of the page that the user has recently viewed. it's shown. Here, it is assumed that the operation content display unit 101 displays a “schedule registration page of the schedule management system” as the operation target content. In addition, it is assumed that the reference content display unit 102 displays “Recently viewed conference room reservation system web page” which is history data as reference content.

  The operation content display unit 101 displays an operation target content and provides an interface for operating the operation target content at the same time. When data is input to the operation target content, the operation content display unit 101 notifies the operation information specifying unit 103 of information on the input form in which the data is input. Specifically, the operation content display unit 101 notifies the operation information specifying unit 103 of which input form of the operation target content data specified in the reference content displayed on the reference content display unit 102 is input. . The information related to the input form includes the position of the input form in which data is input and information for identifying the operation target content (for example, an identifier of the operation target content).

  Further, the operation content display unit 101 receives the input content estimated by the input content estimation unit 105, receives input of the estimation result, and performs input assistance such as presenting input content candidates or automatically inputting the input content.

  The reference content display unit 102 displays reference content including data used for input to the operation target content. When the user specifies data to be input to the operation target content from the data in the reference content and inputs the data to the operation target content input form displayed on the operation content display unit 101, the reference content display unit 102 Information about the data is notified to the operation information specifying means 103. Specifically, the reference content display unit 102 notifies the operation information specifying unit 103 which data is input to the operation target content in the operation content display unit 101. The information related to the specified data includes the position of the specified data (sometimes referred to as reference data) and information for identifying the reference content (for example, an identifier of the reference content).

  In the example shown in FIG. 2, the reference content display unit 102 displays one page of reference content, but the reference content displayed by the reference content display unit 102 is not limited to one page. The reference content display unit 102 may display a plurality of contents satisfying a predetermined standard, such as 10 pages displayed immediately before or one day before.

  The operation information specifying unit 103 includes the position of the reference data designated on the reference content display unit 102 and the identifier of the reference content, the position of the input form designated on the operation content display unit 101, and the identifier of the operation target content. And receive each. The operation information specifying unit 103 specifies operation information based on the received information, and registers (that is, stores) the operation information in the operation information history holding unit 104. Further, the operation information specifying unit 103 may register the number of times the operation indicated by the operation information is performed in the operation information history holding unit 104 in association with the operation information.

  For example, when the operation information specifying unit 103 receives the information that the copy operation has been performed on the reference content display unit 102 and the information that the copied data has been pasted to the form on the operation content display unit 101, This series of operations may be specified as an operation that associates the position of the input form with the data position of the reference content (that is, operation information). In this case, the operation information specifying unit 103 may estimate the reference data position and the position of the input form from the data copy operation performed in the reference content and the paste operation to the operation target content. In addition, the operation information specifying unit 103 may specify operation information based on an operation performed using a mouse cursor.

  However, the device used for specifying the operation information is not limited to the mouse, and may be a pointing device such as a trackball, a touch pad, a pointing stick, or a touch panel. The operation information specifying unit 103 may specify the operation information based on the cursor operation by such a pointing device. Specifically, the operation information specifying unit 103 is information that the data selected on the reference content display unit 102 is dragged, and information that the dragged data is dropped on the form on the operation content display unit 101. May be specified as the operation information. However, the method by which the operation information specifying unit 103 specifies the operation information is not limited to the so-called copy and paste operation and drag and drop operation described above. As described above, the operation information specifying unit 103 specifies the operation information by the selection operation of the data position of the reference content and the input operation to the input field of the operation target content.

  Here, the identifier of the reference content and the identifier of the operation target content are information for designating from which content to which content data is input, and the operation information specifying unit 103 holds these information in the operation information history. Register in the means 104. For example, when the content is a Web page, the operation information specifying unit 103 registers the URL (Uniform Resource Locator) of the page in the operation information history holding unit 104.

  Further, the position of the reference data and the position of the input form are information for designating which part of the content data is input to which form, and the operation information specifying unit 103 stores the information in the operation information history. Register in the holding means 104. For example, when the content is a Web page, the operation information specifying unit 103 registers an XPath that can uniquely specify the position of the data in the operation information history holding unit 104. When the display position of the data displayed on the Web page is fixed, the operation information specifying unit 103 may register coordinates indicating the position of the data in the operation information history holding unit 104.

  For example, it is assumed that information 112 (room name “601 conference room”) of “Web page of conference reservation system” illustrated in FIG. 2 is input to the place form 111 of the “schedule registration page” of the operation target content. At this time, the reference content display unit 102 and the operation content display unit 101 display the URL of the “conference reservation system Web page”, the XPath of the position of the information 112 describing the room name, the URL of the schedule registration page, and the location form 111. The operation information specifying unit 103 is notified of the XPath of the position.

  As described above, the information notified to the operation information specifying unit 103 is information for recording in which input form in the operation target content data at which position in the reference content is input. Therefore, the identifier of each content is not limited to the URL, and may be an ID, a tag, or the like assigned to each content. Further, the method of representing the position of the reference data and the position of the input form is not limited to XPath. As a method for representing the position, an ID, a tag, or the like assigned to each reference data or input form may be used. Further, if the positions where the reference data and the input form are displayed are fixed, these positions may be expressed using coordinates.

  An example of a method in which the operation information specifying unit 103 specifies the operation information based on the reference data position specified by the reference content display unit 102 and the input form position specified by the operation content display unit 101 will be described with reference to FIG. explain. FIG. 3 is an explanatory diagram showing an example of a method for specifying the relationship between the reference data and the input form. In the example shown in FIG. 3, the user displays the room name “601 conference room” of the conference room reservation system displayed by the reference content display unit 102 and the location form of the schedule registration page displayed by the operation content display unit 101. It is assumed that data is input to 111. Specifically, the user drags the character string “601 conference room” displayed by the reference content display unit 102 with the cursor 108 and drops it on the place form 111 displayed by the operation content display unit 101. This operation is indicated by an arrow from the information 112 to the place form 111. At this time, the operation information specifying unit 103 specifies the position of the reference data and the position of the input file at the same time that the data “601 meeting room” displayed in the information 112 is input to the place form 111. As described above, since the operation information specifying unit 103 specifies the operation information when the user inputs data to the input form, it is possible to reduce the labor of the user's preparation work accompanying the automatic input.

  Based on the input data specified on the reference content displayed by the reference content display unit 102 and the input destination form specified on the operation target content displayed by the operation content display unit 101, the operation information specifying unit Another example of a method for specifying operation information 103 will be described with reference to FIG. For example, when the user selects the character string “601 conference room” on the reference content and performs an operation of copying to the clipboard, the operation information specifying unit 103 records the reference data position in a memory (not shown) or the like. Keep it. When the user performs an operation of pasting clipboard data (“601 meeting room”) into the place form 111, the operation information specifying unit 103 inputs “601 meeting room” into the place form 111, Locate reference data and input form. That is, the operation information specifying unit 103 can specify the position of the reference data and the input form also by such processing.

  As described above, the operation information specifying unit 103 specifies the relationship between the reference data and the input form (sometimes referred to as a takeover relationship). Therefore, the method for specifying the relationship is not limited to the method described above. For example, the operation information specifying unit 103 may specify the takeover relationship based on information selected by the user using a keyboard, a command by the user's voice, or the like. Further, the operation information specifying unit 103 may compare the data input to the operation target content with the data displayed in the reference content and specify the takeover relationship based on the data estimated to be the same.

  The operation information history holding unit 104 stores the operation information specified by the operation information specifying unit 103. FIG. 4 is an explanatory diagram illustrating an example of operation information stored in the operation information history holding unit 104. The operation information history holding unit 104 illustrated in FIG. 4 includes the reference content URL, the position of the reference data, the operation target content URL, the position of the input form, and the number of operations in which the reference data is input to the input form. Are stored in association with each other. For example, in the first line, the operation information history holding unit 104 displays the room name of the conference room reservation system displayed by the reference content display unit 102 in the place form of the schedule registration page displayed by the operation content display unit 101. This indicates that the operation information in the case of input and the number of times that the operation has been performed are recorded.

  Specifically, the URL of the web page of the conference room reservation system as the reference content URL, the XPath of “room name” as the reference data position, the URL of the schedule registration page as the operation target content URL, and the “location” form as the input form position XPath is recorded in the operation information history holding unit 104. In the example shown in the first line, the operation information “the operation of inputting“ the room name ”of the conference room reservation system in the“ place ”form” of the schedule registration page ”, which is the same operation as this example, was performed four times. It is recorded in the history holding means 104. The same applies to the contents registered in the second and third lines.

  Next, the operation of each element of the input content estimation unit 107 in which input content estimation processing (processing for recommending input content to the user) is performed in this system will be described.

  First, the input content estimation unit 105 reads the operation information history from the operation information history holding unit 104. The input content estimation unit 105 receives the operation target content currently displayed from the operation content display unit 101 and the reference content list from the reference content display unit 102, respectively. After that, the input content estimation means 105, when there is an input from the reference content having the same identifier with respect to the operation target content having the same identifier in the past, the information input to the operation target content from these pieces of information And the operation content display unit 101 is notified of the estimation result.

  Specifically, the input content estimation unit 105 determines whether or not the received operation target content and reference content information is included in the operation information history of the operation information history holding unit 104. When the received content information is included in the operation information history, the input content estimation unit 105 converts the data displayed at the position corresponding to the data position of the reference content to the operation target content associated with the data position. Estimated as data to be input at the corresponding position on the input form. Then, the input content estimation unit 105 notifies the operation content display unit 101 of the estimation result and displays the estimation result.

  An example of how the input content estimation unit 105 estimates data will be described with reference to FIG. First, the input content estimation unit 105 obtains operation information in which the reference content URL and the operation target content URL match both the current reference content URL and the operation target content URL received from the reference content display unit 102 and the operation content display unit 101. Search from the operation information history holding means 104.

  For example, the operation content display means 101 currently displays “schedule registration page” (http://www.abc.co.jp/schedule) as the operation target content, and “conference reservation system page” (http: //Www.abc.co.jp/roomreserve) is included in the reference content as a history. Here, in the operation information history illustrated in FIG. 4, the operation target content URL is a schedule registration page (http://www.abc.co.jp/schedule), and the reference content URL is a page of the conference room reservation system. There are two pieces of operation information (http://www.abc.co.jp/roomreserve) (first and second lines in FIG. 4).

  The input content estimation unit 105 notifies the operation content display unit 101 of operation information that satisfies a certain standard from the operation information. For example, a criterion “target an operation performed three times or more” may be set in advance. In this example, the input content estimation unit 105 reads operation information for inputting the “room name” of the conference room reservation system in the “place” form of the schedule registration page from the operation information history holding unit 104. And the input content estimation means 105 estimates the information of the 1st line in which operation was performed 3 times or more among the read operation information as input content. Finally, the input content estimation unit 105 causes the operation content display unit 101 to output an estimation result. Thus, since the input content estimation means 105 estimates that the data that satisfies the predetermined condition is input, it is possible to predict the content to be automatically input with high accuracy. The estimation result can also be referred to as a result of estimating an input operation (that is, an operation estimation result).

  As described above, when the number of times stored in the operation information history holding unit 104 is equal to or greater than the predetermined number, the input content estimation unit 105 displays the data displayed at the data position of the reference content associated with the number of times. Is estimated to be data to be input to the input form of the operation target content associated with the data position.

  In the above description, when the operation information used for estimating the input content is searched from the operation information history holding unit 104, the input content estimation unit 105 reads the operation information whose URLs match. In addition, the input content estimation unit 105 may search for the operation information by comparing the layout and details of the reference content and operation target content included in the operation information with the current reference content and operation target content.

  The operation content display unit 101 receives the operation estimation result from the input content estimation unit 105 and executes the input operation received on the displayed operation target content. For example, it is assumed that the operation content display means 101 receives from the input content estimation means 105 an “operation for inputting“ room name ”of the conference room reservation system into the“ place ”form of the schedule registration page”. In this case, the operation content display unit 101 extracts the data in which “room name” is displayed from the conference room reservation system page displayed in the reference content, and displays the “location” on the currently displayed schedule registration page. Fill out the form.

  The operation content display unit 101, the reference content display unit 102, the operation information identification unit 103, and the input content estimation unit 105 are realized by a CPU of a computer that operates according to a program (input auxiliary program). For example, the program is stored in a storage unit (not shown) of an information processing terminal applied to this system, and the CPU reads the program and operates with the operation content display unit 101 and the reference content display unit 102 according to the program. The information specifying unit 103 and the input content estimation unit 105 may operate. Further, the operation content display unit 101, the reference content display unit 102, the operation information specifying unit 103, and the input content estimation unit 105 may each be realized by dedicated hardware. Further, the operation content display unit 101 and the reference content display unit 102 may include an output device such as a display.

  Next, the operation of the above configuration example will be described.

  FIG. 5 is a flowchart showing an example of an operation when recording operation information in the present embodiment, and corresponds to processing in the operation information recording unit 106 of FIG. First, the operation information specifying unit 103 receives the URL of the reference content and the position of the reference data from the reference content display unit 102 (step S1). Next, the operation information specifying unit 103 receives the URL of the operation target content and the position of the input form from the operation content display unit 101 (step S2). Next, the operation information specifying unit 103 specifies the operation information based on the information received from the reference content display unit 102 and the operation content display unit 101, and updates the operation information history holding unit 104 using the operation information. (Step S3).

  FIG. 6 is a flowchart illustrating an example of an operation when an input operation is estimated in the present embodiment, and corresponds to processing in the input content estimation unit 107 in FIG. First, the input content estimation unit 105 receives a list of URLs of reference contents currently displayed from the reference content display unit 102 (step S11). Next, the input content estimation unit 105 receives the URL of the operation target content currently displayed from the operation content display unit 101 (step S12). Thereafter, the input content estimation unit 105 checks whether or not an operation history that matches the received URL is stored in the operation information history holding unit 104, and an operation performed between the reference content and the operation target content has been performed in the past. It is determined whether or not it is being performed (step S13). When the matching history is not stored (NO in step S13), the input content estimation unit 105 ends the process without estimating the input content. On the other hand, if a matching history is stored (YES in step S13), the input content estimation unit 105 causes the operation content display unit 101 to output data based on operation information that satisfies a certain standard (step S14). . Thereafter, the operation content display unit 101 extracts data from the reference content based on the operation information received from the input content estimation unit 105, and inputs the data to the input form of the operation target content (step S15).

  As described above, according to the present embodiment, the operation content display unit 101 displays the operation target content, and the reference content display unit 102 displays the user browsing history as the reference content. The operation information specifying unit 103, when data is input to the input form of the operation target content, associates the position of the input form of the operation target content with the data position of the reference content input to the input form. Is identified. Then, the operation information specifying unit 103 registers the position of the input form and the reference content data in the operation information history holding unit 104 in association with each other based on the specified operation information. Then, the input content estimation unit 105 estimates the data displayed at the data position of the reference content stored in the operation information history holding unit 104 as the data to be input to the input form of the operation target content associated with the data position. And display the data on the input form. Therefore, it is possible to reduce the labor of the user's preparatory work accompanying automatic input, and it is possible to predict the content to be automatically input with high accuracy even if the content has not been input in the past.

  Specifically, when using reference content and operation target content in the same format as the content operated in the past, even if the content of the reference content is different from the content at the time of association, the content according to the content of the reference content The input content can be automatically input to the operation content.

  For example, as described in the present embodiment, “schedule registration page” is displayed on the operation content display unit 101 as the currently browsed web page, and “conference room reservation page” is the recently browsed web page. It is assumed that it is displayed on the reference content display means 102. Here, when data included in a part of a recently browsed page is often used for inputting a currently browsed page, it is desirable that the data can be automatically input regardless of the content of the data. In this embodiment, input can be automated based on the positional relationship of data input in the past. Therefore, for example, when a conference room is reserved and the schedule is registered, the data included in the recently viewed page is often used for inputting the currently viewed page. Even if it is a content, the content to be automatically input can be predicted with high accuracy. In other words, since only the positional relationship between the reference data and the input form is recorded as information for automatic input, even if the content of the reference data changes, the content corresponding to the change can be estimated and input.

  Further, the operation information specifying unit 103 specifies the operation information when data is input to the operation target content input form. Specifically, operation information is specified when a drag and drop operation or a copy and paste operation is performed as a data input operation. Thus, since the reference data position and the input form position can be designated with little effort, the user's preparation work accompanying automatic input can be reduced.

  Further, according to the present embodiment, the position of the reference data and the position of the input form are expressed using XPath and coordinates, so that it becomes easy to specify target information. Usually, when there are fluctuations in the notation of item names, or when item names are not properly assigned, it is difficult to narrow down and present input candidates. For example, in comparison with the input support system described in Patent Document 1, in the input support system that determines which personal information is presented as a menu by narrowing down from the item name attached to the input form, the item name is notated. If there is an item name or the item name is not properly assigned, it is difficult to narrow down and present input candidates. On the other hand, according to the present embodiment, it is easy to specify target information even when the notation of the item name is fluctuated or when the item name is not appropriately assigned.

  Further, according to the present embodiment, the reference content display unit 102 displays the user browsing history as the reference content, and the operation information specifying unit 103 uses the history to operate the operation information operated by the operation information history holding unit 104. Register with. Then, the input content estimation means 105 estimates the input content based on this operation information. Therefore, it is possible to predict the contents to be automatically input with high accuracy. In general, it is difficult to perform highly accurate automatic input and candidate presentation with little effort. When automatic input or candidate presentation is performed, even if a large number of histories and dictionaries are held, if only appropriate contents cannot be selected and presented, the burden on the user is increased. Therefore, when performing automatic input or candidates, improvement of accuracy is a problem. For example, in the method described in Patent Document 2, since the input content is presented from statistical information of window transition and input history, it is not necessary to give an item name or ID to the input form. However, in this method, it is difficult to present an appropriate candidate when there are many fluctuations in the window transition or input order. On the other hand, according to the present embodiment, even when there are many fluctuations in the order of window transitions and inputs, it is possible to predict automatically input contents with high accuracy.

Embodiment 2. FIG.
Next, a configuration example of the second embodiment will be described. FIG. 7 is a block diagram showing a configuration example of the input assist system in the second embodiment according to the present invention. As illustrated in FIG. 7, the input assist system in the second embodiment includes an operation content display unit 101, a context data display unit 202, an operation information identification unit 203, an operation information history holding unit 204, and input contents. Estimating means 205 is provided. That is, the input assistance system in the second embodiment is different from the first embodiment in the context data display unit 202, the operation information specifying unit 203, the operation information history holding unit 204, and the input content estimation unit 205. Other configurations are the same as those in the first embodiment. Constituent elements similar to those in the first embodiment are denoted by the same reference numerals as those in FIG. 1, and detailed description thereof is omitted.

  The context data display unit 202 displays context data used for input to the operation target content. The context data is data representing the current state measured by the device, and represents time, position data (hereinafter also referred to as GPS data) by GPS (Global Positioning System), temperature, and the like. Examples of devices that measure the current state include timers, temperature sensors, and GPS receivers that receive signals from GPS satellites. For example, the user specifies the context data to be input to the operation content display unit 101 from the context data displayed on the context data display unit 202 and inputs the operation target content input form displayed on the operation content display unit 101 Suppose that At this time, the context data display unit 202 notifies the operation information specifying unit 203 of the specified context data. Specifically, the context data display unit 202 notifies the operation information specifying unit 203 which data is input to the operation target content in the operation content display unit 101. The context data displayed on the context data display means 202 may be data measured by a timer (not shown) or a temperature sensor (not shown), and a GPS receiver that has received a signal from a GPS satellite. It may be GPS data detected by (not shown). In addition, in this way, it can be said that the content on which the context data is displayed is content including data input to the operation target content (that is, reference content).

  FIG. 8 is an explanatory diagram illustrating an example of a system screen configuration according to the second embodiment. In the example shown in FIG. 8, the screen displayed by the operation content display unit 101 is shown on the left side, and the screen displayed by the context data display unit 202 is shown on the right side. The content displayed by the operation content display unit 101 is the same as the content displayed by the operation content display unit 101 illustrated in FIG. In the example shown in FIG. 8, the context data display unit 202 displays context data. In the example shown in FIG. 8, “GPS” represents the current GPS data, and “10:33” represents the current time. “Sunny” represents the current weather, and “Company”, “Home”, and “Mr. A” represent respective telephone numbers.

  Thus, the context data display unit 202 displays context data that changes according to the current situation, such as time and place. Therefore, the context data to be displayed is not limited to the above example. For example, the context data display unit 202 may display “recently received mail delivery address” or other context data obtained from an external device as the context data. The type of context data displayed by the context data display unit 202 may be a predetermined type of context data, or may be a type of context data that can be freely selected by the user. In the following description, it is assumed that the context data display unit 202 includes an output device such as a display device.

  The operation information specifying unit 203 indicates an operation of associating the position of the input form of the operation target content to which data is input and the position of the context data input to the input form when data is input to the input form. Information (that is, operation information) is specified. Further, the operation information specifying unit 203 associates the position of the input form with the context data based on the specified operation information, and registers it in the operation information history holding unit 204 described later.

  In other words, the operation information specifying unit 203 includes information for specifying the context data specified on the context data display unit 202 (for example, an identifier of the context data), the position of the input form specified on the operation content display unit 101, and The identifier of the operation target content is received. Then, the operation information specifying unit 203 specifies the operation information based on the received information, and registers this operation information in the operation information history holding unit 204. The method of specifying the operation information by the operation information specifying unit 203 is the same as the method of specifying the operation information by the operation information specifying unit 103 in the first embodiment.

  The operation information history holding unit 204 stores the position of the input form and the context data in association with each other. That is, the operation information history holding unit 204 stores the operation information specified by the operation information specifying unit 203. FIG. 9 is an explanatory diagram illustrating an example of operation information stored in the operation information history holding unit 204. The operation information history holding unit 204 illustrated in FIG. 9 stores the context data, the operation target content URL, the position of the input form, and the number of times that the context data is input to the input form in association with each other. Yes. That is, the example shown in FIG. 9 indicates that which context data is used for the operation target content. For example, the first line indicates operation information in which the current time is input, and the second line indicates operation information in which GPS data is input. The meanings indicated by the operation target content URL, the input form position, and the number of times are the same as in the example shown in FIG. 4 in the first embodiment.

  The input content estimation unit 205 estimates the context data stored in the operation information history holding unit 204 as data to be input at a corresponding position on the input form of the operation target content associated with the context data. At this time, the input content estimation unit 205 may estimate operation information that satisfies a predetermined condition as input data. Then, the input content estimation unit 205 causes the operation content display unit 101 to display the estimated data on the input form.

  That is, the input content estimation unit 205 first reads the operation information history from the operation information history holding unit 204. Further, the input content estimation unit 205 receives the operation target content currently displayed from the operation content display unit 101 and the list of context data from the context data display unit 202, respectively. After that, the input content estimation unit 205 determines the content to be input to the operation target content when there is input from the context data having the same identifier with respect to the operation target content having the same identifier in the past. Estimate and notify the operation content display means 101 of the estimation result.

  Specifically, the input content estimation unit 205 determines whether or not the received operation target content and context data are included in the operation information history of the operation information history holding unit 204. When the received content information and context data are included in the operation information history, the input content estimation unit 205 inputs the context data to a corresponding position in the input form of the operation target content associated with the context data. Estimated as data. The input content estimation unit 205 notifies the operation content display unit 101 of the estimation result and displays the estimation result. Note that the method of estimating the data displayed by the input content estimation unit 205 is the same as the method of estimation by the input content estimation unit 105 in the first embodiment.

  The operation content display unit 101, the context data display unit 202, the operation information specifying unit 203, and the input content estimation unit 205 are realized by a CPU of a computer that operates according to a program (input auxiliary program). Further, the operation content display unit 101, the context data display unit 202, the operation information specifying unit 203, and the input content estimation unit 205 may each be realized by dedicated hardware. Further, the operation content display unit 101 and the context data display unit 202 may include an output device such as a display.

  Next, the operation of the above configuration example will be described.

  FIG. 10 is a flowchart illustrating an example of an operation when recording operation information in the present embodiment. First, the operation information specifying unit 203 receives context data from the context data display unit 202 (step S21). Next, the operation information specifying unit 203 receives the URL of the operation target content and the position of the input form from the operation content display unit 101 (step S2). Next, the operation information specifying unit 203 specifies the operation information based on the information received from the context data display unit 202 and the operation content display unit 101, and updates the operation information history holding unit 204 using the operation information. (Step S3). The processes in steps S2 and S3 are the same as the processes in steps S2 and S3 illustrated in FIG.

  FIG. 11 is a flowchart showing an example of an operation when an input operation is estimated in the present embodiment. About the operation | movement similar to 1st Embodiment, the code | symbol same as FIG. 6 is attached | subjected and detailed description is abbreviate | omitted. First, the input content estimation unit 205 receives a list of context data currently displayed from the context data display unit 202 (step S31). Thereafter, the processing until the input content estimation unit 205 determines whether there is a history that matches the operation information history holding unit 204 and causes the operation content display unit 101 to output operation information that satisfies a certain standard is shown in FIG. This is the same as the processing in steps S12 to S15 illustrated in FIG.

  That is, the second embodiment is different from the first embodiment in that the operation information specifying unit 203 receives context data from the context data display unit 202 when recording operation information (step S21 in FIG. 10). Also, the input content estimation unit 205 receives a list of context data currently displayed from the context data display unit 202 when the input operation is estimated (step S31 in FIG. 11), which is different from the first embodiment. .

  As described above, according to the present embodiment, the context data display unit 202 displays context data as reference content. The operation information specifying unit 203 specifies operation information that associates the position of the input form with the data position of the context data input to the input form, and based on the operation information, the position of the input form and the data of the context data The information is registered in the operation information history holding unit 204 in association with the position. Then, the input content estimation unit 205 estimates the data displayed at the data position of the context data as the data to be input to the operation target content input form associated with the data position. Therefore, it is possible to reduce the labor of the user's preparatory work accompanying automatic input, and it is possible to predict the content to be automatically input with high accuracy even if the content has not been input in the past.

  That is, in this embodiment, context data that changes according to the current situation such as time and place is used for input to the operation target content. Therefore, even in the case of data whose input contents change according to the operation status such as the current time and current position, if the same operation has been performed in the past, the data can be automatically input.

Embodiment 3. FIG.
Next, a configuration example of the third embodiment will be described. FIG. 12 is a block diagram showing a configuration example of the input assist system in the third embodiment according to the present invention. As shown in FIG. 12, the input assist system in the third embodiment includes an operation content display unit 101, a reference content display unit 102, an operation information specifying unit 303, an operation information history holding unit 304, and an input content estimation. Means 305. That is, the input assist system in the third embodiment is different from the first embodiment in the operation information specifying unit 303, the operation information history holding unit 304, and the input content estimation unit 305, and the other configurations are the first. This is the same as the embodiment. Constituent elements similar to those in the first embodiment are denoted by the same reference numerals as those in FIG. 1, and detailed description thereof is omitted.

  The operation information specifying unit 303 is similar to the operation information specifying unit 103 in the first embodiment, the position of the reference data specified on the reference content display unit 102 and the identifier of the reference content, and the operation content display unit 101. The position of the designated input form and the identifier of the operation target content are received from each. Then, the operation information specifying unit 303 specifies operation information based on the received information, and registers this operation information in the operation information history holding unit 304. Further, the operation information specifying unit 303 specifies information (hereinafter referred to as processing information) indicating a method of processing the reference data, associates the reference data to be processed with the processing information, and stores it in the operation information history holding unit 304. sign up. Specifically, the operation information specifying unit 303 specifies the processing information by a drag operation or an input operation specified when specifying the operation information.

  For example, the item “reservation time” displayed on the conference reservation system page that is the reference content is “09: 0”, and the reservation time is set to 30 in the “start date / time form” of the schedule registration page that is the operation target content. A case where “09:30” delayed by a minute is displayed will be described. At this time, the operation information specifying unit 303 displays the URL of the conference room reservation system, the XPath of the “reservation time”, the URL of the schedule registration page, and the XPath of the “start date / time form”, respectively, as the reference content display unit 102 and the operation content display unit 101. Receive from. Then, the operation information specifying unit 303 adds the processing information “delay time 30 minutes” to the operation information and registers it in the operation information history holding unit 304.

  An example of a method in which the operation information specifying unit 303 specifies the operation information based on the reference data position specified by the reference content display unit 102, the input destination form position specified by the operation content display unit 101, and the processing information. Will be described with reference to FIG. FIG. 13 is an explanatory diagram illustrating an example of a method for specifying the relationship between the reference data and the input form and the processing information. In the example illustrated in FIG. 13, a method for specifying processing information using the conversion processing module 309 will be described. The contents of the operation target content and the reference content illustrated in FIG. 13 are the same as the contents illustrated in FIG.

  The conversion processing module 309 is a module that displays a list of information for processing reference data on a display device (not shown) or the like. In the example illustrated in FIG. 13, as information for the conversion processing module 309 to process the reference data, “+15” advanced to the reference data by 15 minutes, “+30” advanced by 30 minutes to the reference data, “+45” advanced by 45 minutes to the reference data, “−15” delayed by 15 minutes from the reference data, “−30” delayed by 30 minutes from the reference data, and “−45” delayed by 45 minutes from the reference data are displayed on the display device (not shown).

  For example, the reservation time 113 (“09: 0”) of the conference room reservation system displayed on the reference content display unit 102 is displayed on the operation content display unit 101 with a delay of 30 minutes (ie, “09:30”). It is assumed that an input is made to the start date / time form 114 of the schedule registration page. At this time, for example, the user drags the character string “09:00” displayed on the reference content display unit 102 with the cursor 308 and passes “+30” of the conversion processing module 309 which means that the user advances 30 minutes. Then, it is assumed that the operation content display means 101 drops the “start date and time” form. This operation is indicated by an arrow from the reserved time 113 to the start date / time form 114 via the conversion processing module 309. In this case, the operation information specifying unit 303 can specify the relationship between the reservation time 113 and the start date / time form 114 and the processing information “progress 30 minutes to the data”. In other words, the user can specify “09:30” in the start date / time form 114 and simultaneously specify the relationship between the reference data and the input form and the processing information.

  In the above description, the case where the conversion processing module 309 is used to specify the processing information has been described. However, the method of specifying the processing information is not limited to the case where the conversion processing module 309 is used. For example, if the operation information is specified by a copy and paste operation, the operation information specifying unit 303 determines that the processing information specified between the copy operation and the paste operation is the processing information associated by the copy and paste operation. May be.

  The operation information history holding unit 304 stores the operation information specified by the operation information specifying unit 303. FIG. 14 is an explanatory diagram illustrating an example of operation information stored in the operation information history holding unit 304. The operation information history holding unit 304 illustrated in FIG. 14 includes the reference content URL, the position of the reference data, the operation target content URL, the position of the input form, and the number of operations in which the reference data is input to the input form. In addition, the processing information is stored in association with each other. That is, the operation information history holding unit 304 stores processing information in addition to the information stored in the operation information history holding unit 104 in FIG. For example, the first line indicates that information indicating that “reference data is delayed by 30 minutes” is stored as processing information.

  The input content estimation unit 305 first reads the operation information history from the operation information history holding unit 304. The input content estimation unit 305 receives the operation target content currently displayed from the operation content display unit 101 and the reference content list from the reference content display unit 102. After that, the input content estimation means 305, based on these pieces of information, when there is an input from the reference content having the same identifier with respect to the operation target content having the same identifier in the past, the input content estimation means 305 Estimate and notify the operation content display means 101 of the estimation result. The method by which the input content estimation unit 305 estimates the input content is the same as the method by which the input content estimation unit 105 estimates in the first embodiment. Note that the input content estimation unit 305 causes the operation content display unit 101 to output reference data processed based on the processing information read from the operation information history holding unit 304.

  The operation content display unit 101, the reference content display unit 102, the operation information specifying unit 303, and the input content estimation unit 305 are realized by a CPU of a computer that operates according to a program (input auxiliary program). In addition, the operation content display unit 101, the reference content display unit 102, the operation information identification unit 303, and the input content estimation unit 305 may be realized by dedicated hardware. Further, the operation content display unit 101 and the reference content display unit 102 may include an output device such as a display.

  Next, the operation of the above configuration example will be described.

  FIG. 15 is a flowchart illustrating an example of an operation when recording operation information in the present embodiment. First, the operation information specifying unit 303 receives the URL of the reference content and the position of the reference data from the reference content display unit 102, and also receives processing information for processing the reference data (step S41). Next, the operation information specifying unit 303 receives the URL of the operation target content and the position of the input form from the operation content display unit 101 (step S2). Next, the operation information specifying unit 303 specifies the operation information based on the information received from the reference content display unit 102 and the operation content display unit 101, and uses the operation information including the processing information to store the operation information history holding unit. 304 is updated (step S3). The processes in steps S2 and S3 are the same as the processes in steps S2 and S3 illustrated in FIG.

  Next, the operation when the input operation is estimated in the present embodiment will be described with reference to the flowchart illustrated in FIG. Note that detailed description of operations similar to those of the first embodiment is omitted. The processing until the input content estimation unit 305 determines whether or not operation information that matches the URL list of the reference content and the URL of the operation target content is stored is the same as the processing from steps S11 to S13 in FIG. It is. If a matching history is stored (YES in step S13), the input content estimation unit 305 causes the operation content display unit 101 to output data based on operation information that satisfies a certain standard (step S14). At this time, the input content estimation unit 305 causes the operation content display unit 101 to output information obtained by processing the reference data based on the processing information read from the operation information history holding unit 304. Thereafter, the operation content display unit 101 extracts data from the reference content based on the operation information received from the input content estimation unit 305, and inputs the data to the input form of the operation target content (step S15).

  That is, the third embodiment is different from the first embodiment in that the operation information specifying unit 303 specifies processing information when recording operation information (step S41 in FIG. 15).

  As described above, according to the present embodiment, the operation information specifying unit 303 specifies the processing information, and registers the processing information in association with the reference data to be processed in the operation information history holding unit 304. Then, the input content estimation means 305 displays the reference data processed based on the processing information on the input form of the operation target content. Therefore, in addition to the effects of the first embodiment and the second embodiment, the load of the user's input work can be further reduced.

  That is, in the present embodiment, the processing information for the input data to the operation target content is also recorded in the operation information history holding unit 304 at the same time. Therefore, even if the content of the reference data changes and the data is processed and input in the same way each time, if the same operation has been performed in the past, the processed data is automatically input. Can do.

  Next, an example of the minimum configuration of the input assist system according to the present invention will be described. FIG. 16 is a block diagram showing a minimum configuration example of the input assist system according to the present invention. The input assist system according to the present invention includes an operation content display unit 81 (for example, an operation content display unit 101) that displays operation target content that is content including an input field in which data is input, and data that is input to the operation target content. The reference content display means 82 (for example, the reference content display means 102) for displaying the reference content, which is the content including the content, and the operation when data is input to the input field (for example, input form) of the operation target content Operations (for example, drag-and-drop operation, copy-and-paste operation) for associating the position (for example, the place form 111) of the input field of the target content with the data position (for example, information 112) of the reference content input to the input field ) Operation information, which is information indicating Operation information specifying means 83 (for example, operation information specifying means 103) specified by the data position selection operation and data input operation to the input field, and an operation for storing the input field position and the reference content data position in association with each other Based on the operation information specified by the information history holding means 84 (for example, the operation information history holding means 104) and the operation information specifying means 83, the operation information history is associated with the position of the input field and the position of the reference content data. The operation information history registration means 85 (operation information specifying means 103) to be registered in the holding means 84 and the data displayed at the data position of the reference content stored in the operation information history holding means 84 are associated with the data position. Input content estimation means 86 (e.g., displaying data in the input field presumed to be input to the input field of the operation target content) And an input content estimating means 105) and.

  With such a configuration, it is possible to reduce the labor of the user's preparation work accompanying automatic input, and it is possible to predict the content to be automatically input with high accuracy even if the content has not been input in the past.

  Note that at least an input assist system as described below is also disclosed in any of the embodiments described above.

(1) Operation content display means (for example, operation content display means 101) for displaying operation target content that is content including an input field for inputting data, and content including data input to the operation target content. Reference content display means for displaying reference content (for example, reference content display means 102) and the position of the operation target content input field when data is input to the operation target content input field (for example, input form) An operation that is information indicating an operation (for example, a drag-and-drop operation or a copy-and-paste operation) that associates (for example, the place form 111) with the data position (for example, information 112) of the reference content input to the input field. Information is selected in the data position and entered into the input field. Operation information specifying means (for example, operation information specifying means 103) specified by a data input operation, and operation information history holding means (for example, operation information history holding) for storing the input column position and the reference content data position in association with each other Means 104) and the operation information history registration means (operation information) for registering the position of the input field and the reference content data in the operation information history holding means in association with each other based on the operation information specified by the operation information specifying means. The data displayed at the data position of the reference content stored in the specifying means 103) and the operation information history holding means is estimated as the data to be input to the input field of the operation target content associated with the data position. An input assistance system comprising input content estimation means (for example, input content estimation means 105) for displaying data in an input field.

(2) The reference content display means (for example, the reference content display means 102) displays the user's browsing history as the reference content, and the operation information specifying means (for example, the operation information specifying means 103) The operation information associated with the data position of the user's browsing history input to the input field is specified, and the operation information history registration means (for example, the operation information specifying means 103) is based on the operation information specified by the operation information specifying means. In addition, the position of the input field and the data position of the user's browsing history are associated and registered in the operation information history holding means (for example, the operation information history holding means 104), and the input content estimation means (for example, the input content estimation means 105). However, the data displayed at the data position of the user's browsing history is input to the input field of the operation target content associated with the data position. Input auxiliary system for estimating the other.

(3) Reference content display means (for example, context data display means 202) displays context data (for example, time, GPS data, temperature, etc.) that is data representing the current state measured by the device as reference content. Then, the operation information specifying unit (for example, the operation information specifying unit 203) specifies the operation information that associates the position of the input field with the data position of the context data input to the input field, and the operation information history registering unit (for example, The operation information specifying unit 203) associates the position of the input field with the data position of the context data based on the operation information specified by the operation information specifying unit (operation information history holding unit 204). The input content estimation means (for example, the input content estimation means 205) Input assistant system for estimating the data displayed in the position, the data input to the input section of the operation target content associated with that data location.

(4) The operation information history registration means registers the number of times the operation indicated by the operation information is performed in association with the operation information in the operation information history holding means, and the input content estimation means is stored in the operation information history holding means. Data that is displayed at the data position of the reference content associated with the number of times when the number of times is equal to or greater than a predetermined number of times, Input assist system to estimate.

(5) When the operation information specifying means (for example, the operation information specifying means 303) specifies the operation information for the processing information (for example, 30 minutes to the reference data) indicating the method of processing the reference data. The operation information history registering means (for example, the operation information specifying means 303) associates the reference data to be processed with the processing information, and stores the operation information history holding means (for example, operation information history holding). An input assist system that displays the reference data registered in the means 304) and input by the input content estimation means (for example, the input content estimation means 305) based on the processing information in the input field of the operation target content.

(6) An input assist system in which the operation information specifying means specifies operation information based on a cursor operation (for example, a drag and drop operation) by a pointing device.

(7) An input assist system in which the operation information specifying unit specifies operation information from a data copy operation performed in the reference content and a paste operation (for example, a copy and paste operation) to the operation target content.

(8) The operation information specifying means includes a combination of the identifier of the reference content, the position of the reference data in the reference content, the identifier of the operation target content, the position of the input field in the operation target content, and the operation Input assist system that identifies operation information including the number of times.

  The present invention is preferably applied to an input assistance system using an browsing history or context information, and an input prediction system. Further, the present invention is preferably applied to an input assistance system and an input prediction system that utilize the data takeover relationship (association) specified by the user for assistance or prediction of subsequent input.

101 Operation content display means 102 Reference content display means 103, 203, 303 Operation information identification means 104, 204, 304 Operation information history holding means 105, 205, 305 Input content estimation means 106 Operation information recording section 107 Input content estimation section 202 Context Data display means

Claims (10)

Operation content display means for displaying operation target content that is content including an input field in which data is input;
Reference content display means for displaying reference content which is content including data input to the operation target content;
An operation that is information indicating an operation for associating the position of the input field of the operation target content with the data position of the reference content input to the input field when data is input to the input column of the operation target content Operation information specifying means for specifying information by the data position selection operation and the data input operation to the input field;
Operation information history holding means for associating and storing the position of the input field and the position of the data of the reference content;
Based on the operation information specified by the operation information specifying means, an operation information history registering means for associating and registering the position of the input field and the position of the data of the reference content in the operation information history holding means;
The data displayed at the data position of the reference content stored in the operation information history holding unit is estimated as data to be input to the input field of the operation target content associated with the data position, and the data is input to the input field. An input auxiliary system comprising: an input content estimation means for displaying a message. The reference content display means displays the user's browsing history as reference content,
The operation information specifying means specifies operation information that associates the position of the input field and the data position of the user's browsing history input to the input field,
The operation information history registration means registers the position of the input field and the data position of the user browsing history in the operation information history holding means in association with the operation information specified by the operation information specifying means,
The input assist system according to claim 1, wherein the input content estimation means estimates the data displayed at the data position of the browsing history of the user as the data to be input to the input field of the operation target content associated with the data position. . The reference content display means displays, as reference content, context data that is data representing the current state measured by the device,
The operation information specifying means specifies operation information that associates the position of the input field and the data position of the context data input to the input field,
The operation information history registration means registers the position of the input field and the data position of the context data in the operation information history holding means in association with the operation information specified by the operation information specifying means,
The input assistance system according to claim 1, wherein the input content estimation unit estimates the data displayed at the data position of the context data as data to be input to the input field of the operation target content associated with the data position. The operation information history registration unit registers the number of times the operation indicated by the operation information is performed in the operation information history holding unit in association with the operation information,
When the number of times stored in the operation information history holding unit is greater than or equal to a predetermined number, the input content estimation unit converts the data displayed at the data position of the reference content associated with the number of times into the data position The input assistance system according to any one of claims 1 to 3, wherein the input data is estimated to be data to be input to an input field of an operation target content associated with. The operation information specifying means specifies processing information, which is information indicating a method of processing reference data, by an operation specified in accordance with specifying operation information,
The operation information history registration means associates the reference data to be processed with the processing information and registers it in the operation information history holding means,
The input assist system according to any one of claims 1 to 4, wherein the input content estimation means displays reference data processed based on the processing information in an input field of operation target content. The input assistance system according to any one of claims 1 to 5, wherein the operation information specifying unit specifies operation information based on a cursor operation by a pointing device. The input according to any one of claims 1 to 6, wherein the operation information specifying unit specifies operation information from a data copy operation performed in the reference content and a paste operation to the operation target content. Auxiliary system. The operation information specifying means includes a combination of the reference content identifier, the position of the reference data in the reference content, the identifier of the operation target content, the position of the input field in the operation target content, and the number of operations. The input assistance system according to any one of claims 1 to 7, wherein operation information is specified. Display the operation target content that is the content including the input field where data is input,
Displaying reference content which is content including data input to the operation target content;
An operation that is information indicating an operation for associating the position of the input field of the operation target content with the data position of the reference content input to the input field when data is input to the input column of the operation target content The information is specified by the data position selection operation and the data input operation to the input field,
Based on the specified operation information, the position of the input field and the position of the data of the reference content are associated and registered in the operation information history holding unit,
The data displayed at the data position of the reference content stored in the operation information history holding unit is estimated as data to be input to the input field of the operation target content associated with the data position, and the data is input to the input field. An input assist method characterized by displaying. On the computer,
Operation content display processing for displaying operation target content that is content including an input field in which data is input,
Reference content display processing for displaying reference content that is content including data input to the operation target content;
An operation that is information indicating an operation for associating the position of the input field of the operation target content with the data position of the reference content input to the input field when data is input to the input column of the operation target content An operation information specifying process for specifying information by a selection operation of the data position and a data input operation to the input field;
Based on the identified operation information, an operation information history registration process for registering in the operation information history holding means in association with the position of the input field and the position of the data of the reference content, and
The data displayed at the data position of the reference content stored in the operation information history holding unit is estimated as data to be input to the input field of the operation target content associated with the data position, and the data is input to the input field. An input auxiliary program for executing the input content estimation process.

Images