JP2012252629A - Input support program, input support method and input support device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a generated file to have more detailed association with data referenced when information is input.SOLUTION: When an input of information to an auxiliary input area (window 911) is complete, insertion of the information inputted to the auxiliary input area to an input area (window 951) is determined. Here, link information and a degree of association are also added in the input area. Accordingly, in the input area, there is added information on which reference information area is referenced when the information input by a user in the input area is input, and on how much degree of association the reference information area and the input area have.

Description

  The present invention relates to provision of information relating to interrelationships between data.

  There are various workflows in the office. It is also recognized that waste is generated in the workflow. And it is important to identify the cause of the generated waste from the viewpoint of improving the efficiency of business.

  Conventionally, various proposals have been made regarding the visualization of work for identifying the cause of waste.

  For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2006-146458) proposes a method for detecting the relevance of a plurality of files opened simultaneously by searching using a keyword.

JP 2006-146458 A

  However, with the above-described conventional technology, it is not possible to detect the relevance when the files opened simultaneously are of different applications.

  In addition, with the conventional technology described above, it has been impossible to detect the relevance of a single file to a plurality of files.

  The present invention has been conceived in view of such circumstances, and its purpose is to enable more detailed association of a generated file with data referred to when information is input. .

  An input support program according to the present invention is a computer-readable program, wherein a computer detects an input area as an information input target from a window displayed on a screen of a display device; A step of detecting a reference information area for displaying the information to be referred to, a step of displaying an auxiliary area for accepting input of information in the vicinity of the reference information area, and information input to the auxiliary area for reference Storing in association with the information area and the input area.

  Preferably, the step of causing the computer to further execute a step of determining the degree of association between the content including the reference information area and the content including the input area, and storing the associated level in association with the information input in the auxiliary area. And store it in association with.

  Preferably, the step of determining the degree of association determines the degree of association between the content portion corresponding to the reference information area and the content portion corresponding to the input area.

  Preferably, in the step of determining the degree of association, the degree of association is determined to be higher as the amount of information input to the auxiliary area is larger.

  Preferably, the step of determining the degree of association determines the degree of association of the reference information area whose information is input to the corresponding auxiliary area higher than the degree of association of the other reference information areas.

  Preferably, in the step of detecting the reference information area, the step of detecting two or more reference information areas and displaying the auxiliary area displays the auxiliary area in the vicinity of each reference information area, and one auxiliary area When information is input to, the display of other auxiliary areas is stopped.

  Preferably, in the step of displaying the auxiliary area, the auxiliary area is displayed at a position that does not overlap the content in the reference information area and is closer to the reference information area than the input area.

  Preferably, the step of detecting the input area detects two or more input areas, and the computer inputs one input from the two or more input areas based on a predetermined priority order for the application corresponding to each input area. A step of determining an area is further executed.

  Preferably, the step of detecting the input area detects two or more input areas and specifies a user operation position on the computer, and one input based on the user operation position from the two or more input areas. And a step of determining an area.

  Preferably, the step of specifying the user's operation position specifies the user's operation position based on the user's line-of-sight information.

  Preferably, the step of detecting the reference information area detects the reference information area based on an attribute of the display content of the window or based on a priority order predetermined for an application corresponding to the window.

  Preferably, the computer confirms the input to the input area of the information input to the auxiliary area on the condition that the completion of the input to the auxiliary area is detected and the completion of the input to the auxiliary area is detected. The step of detecting the completion of input to the auxiliary area is performed when an operation on a specific display unit displayed in the auxiliary area or a specific operation on the computer is executed. Detect completion.

  Preferably, the computer includes a first computer and a second computer communicable with the first computer, and information specifying a user who uses the first computer is stored in the first computer. A display device connected to the second computer when the user who uses the first computer matches the user of the second computer. A step of detecting an input area from a window displayed on the screen, and a step of transmitting information instructing the detection of the reference information area to the first computer, and causing the first computer to execute a second step. Connected to the first computer according to instructions from the computer A step of detecting a reference information area from a window displayed on the screen of the display device, a step of displaying an auxiliary area for receiving information input in the vicinity of the reference information area, and an input of information for the auxiliary area And a step of transmitting the information input to the auxiliary area to the second computer together with information for identifying the reference information area to which the auxiliary area corresponds, and causing the second computer to The step of storing the information input to the auxiliary area transmitted from the computer and the information specifying the reference information area corresponding to the auxiliary area in association with the input area is executed.

  An input support method according to the present invention is a method for supporting input of information in a computer, wherein the computer detects an input area to be input information from a window displayed on a screen of a display device; Detecting a reference information area for displaying the information to be referred to from the window; displaying an auxiliary area for accepting input of information in the vicinity of the reference information area; and information input to the auxiliary area. And storing the information in association with the reference information area and the input area.

  An input support apparatus according to the present invention is an apparatus for supporting input of information in a computer, and is a first apparatus for detecting an input area as an information input target from a window displayed on a screen of a display device. A first detection means, a second detection means for detecting a reference information area for displaying the referenced information, and an auxiliary area for receiving input of information in the vicinity of the reference information area. Display control means, and storage means for storing information input to the auxiliary area in association with the reference information area and the input area.

  According to the present invention, an input area to be input information and a reference information area for displaying referenced information are detected from a screen displayed on the display device, and further, in the vicinity of the reference information area. An auxiliary area for receiving input of information is displayed. When information is input to the auxiliary area, the input information is stored in association with the reference information area and the input area.

  Thus, when the file is generated, the input information is stored in association with the reference information area that is a reference source of the information.

  Therefore, the generated file is stored in association with the data referred to when the information is input in more detail.

It is a figure which shows typically the hardware constitutions of the personal computer (PC) which is one Embodiment of the input assistance apparatus of this invention. It is a figure which shows typically the function structure of PC of FIG. It is a flowchart of the input assistance process which CPU performs in PC of FIG. It is a figure which shows an example of the screen displayed on the monitor of FIG. It is a figure which shows the other example of the screen displayed on the monitor of FIG. It is a figure which shows the state in which the input of the information to an auxiliary input area is received on the display screen of PC of FIG. FIG. 7 is a diagram for explaining another example of a change in display mode of another auxiliary input area when information is input to a certain auxiliary input area in the PC of FIG. 1. It is a figure which shows the modification of the function structure of PC of FIG. FIG. 3 is a diagram for explaining an example of a method for determining a display position of an auxiliary input area in the PC of FIG. 1. FIG. 3 is a diagram for explaining a method of detecting completion of information input to an auxiliary input area in the PC of FIG. 1. It is a figure which shows the outline | summary of the system at the time of an input assistance process being performed in several information processing apparatus. It is a figure which shows typically the function structure of one PC of FIG. It is a figure which shows typically the function structure of the other PC of FIG. It is a flowchart of the input assistance process performed in the system of FIG.

<Hardware configuration>
FIG. 1 is a diagram schematically showing a hardware configuration of a personal computer (hereinafter, PC) 200 which is an embodiment of an input support apparatus of the present invention.

  Referring to FIG. 1, PC 200 stores a CPU (Central Processing Unit) 250 that generally controls the operation of PC 200, a RAM (Random Access Memory) 254 that functions as a work area of CPU 250, programs, data, and the like. A ROM (Read Only Memory) 256, an input device 260 such as a keyboard for inputting information to the PC 200, a communication device 262 for communicating with another PC 200 or another network, and a hard disk for storing programs and files. A hard disk device (HDD) 264, a storage medium 252A that can be attached to and detached from the PC 200, a media drive 252 that accesses the monitor 266, and a monitor 266 are provided. The CPU 250 accepts input of information input via the input device 260, can be connected to other terminals and networks via the communication device 262, and displays information processed in the PC 200 on the monitor 266. Can be made.

  The program executed by the CPU 250 may be stored in the hard disk of the ROM 256 or the HDD 264, or may be stored in the storage medium 252A accessed by the CPU 250 via the media drive 252, or the CPU 250 via the communication device 262. May be stored in an external storage device to be accessed. The storage medium 252A includes a CD-ROM (Compact Disc-Read Only Memory), a DVD-ROM (Digital Versatile Disk-Read Only Memory), a USB (Universal Serial Bus) memory, a memory card, an FD (Flexible Disk), a hard disk, Magnetic tape, cassette tape, MO (Magnetic Optical Disc), MD (Mini Disc), IC (Integrated Circuit) card (excluding memory cards), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory) For example, a medium for storing the program in a nonvolatile manner.

  In addition, files stored in the storage medium 252A via the media drive 252 and files stored in an external storage device that can be accessed via the communication device 262 are stored in the HDD 264 hard disk. Installed) and may be executed by the CPU 250.

  Further, the PC 200 may be configured integrally with the monitor 266 or may be configured separately. Further, a display device such as the monitor 266 may be omitted, and information for displaying information on the display device may be transmitted.

<Functional configuration>
The PC 200 displays a screen such as an application execution screen on the monitor 266, and is an area assumed to be an information input destination (hereinafter referred to as “input area” as appropriate) and an information reference destination on the screen. (Hereinafter referred to as “reference information area” as appropriate). Further, the PC 200 displays an auxiliary input area (an example of an auxiliary area) in the vicinity of the reference information area. Then, the information input to the auxiliary input area is stored in association with the reference information area and the input area corresponding to the auxiliary input area.

  FIG. 5 is a diagram schematically showing an example of the display screen of the monitor 266. Referring to FIG. 5, windows 901 to 905 that are processing screens of CPU 250 are displayed on screen 900. Each of the windows 901 to 905 is a processing screen (window) by an application program executed by the CPU 250, for example. That is, the screen 900 may indicate a state in which a plurality of applications are activated on the PC 200 and a processing screen of each application is displayed at the same time. Note that the applications corresponding to the windows 901 to 905 are browsing applications such as an electronic dictionary application and a Web browser, for example.

  On the screen 900, auxiliary input areas 911 to 915 are displayed near the windows 901 to 905, respectively. The auxiliary input areas 911 to 915 may be displayed so as to be understood to be associated with the windows 901 to 905, respectively, and do not need to be displayed so as to be stored inside the windows 901 to 905. Of course, it may be displayed so as to be accommodated inside.

  A window 950 is further displayed on the screen 900. The window 950 is configured by a processing screen of a creation-type application such as a document creation application or a table creation application.

FIG. 2 is a diagram schematically illustrating a functional configuration of the PC 200.
Referring to FIG. 2, PC 200 includes a user interface 201, an auxiliary input area unit 202, and an association degree calculation unit 203 as its functions.

  The user interface 201 includes an input device 260 and receives information input from the user.

  The auxiliary input area unit 202 displays the auxiliary input area as described above, and includes an auxiliary input area integration management unit B01, a reference information area detection unit B02, an input area detection unit B03, and an auxiliary input area creation unit B04. , An auxiliary input area display manager B05 and an auxiliary input data manager B06. These functions are realized, for example, when the CPU 250 executes a program recorded in the HDD 264 or the like. Note that at least one of these may be realized by a hardware element such as a dedicated circuit.

  The reference information area detection unit B02 extracts a window that displays content that can be handled as reference information from the windows displayed on the monitor 266. This extraction is performed based on, for example, the type (attribute) of the application displaying the content window. Specifically, for example, in the case of a browsing-type application as described above, it is determined that the content can be handled as reference information, and the window is extracted.

The extraction of the reference information area may be performed by the following method.
For example, a read-only area (image area, Web, PDF, etc.) may be extracted as the reference information area. Further, an area of data different from the user who is operating the PC 200 (logged in to the PC 200) may be extracted as the reference information area. User identification can be performed by providing the PC 200 with the functions of the other device management unit B07, the user data management unit B08, and the user DBD01 as described later with reference to FIG. The user identification may be executed by a device other than the PC 200, and the PC 200 may receive the result. Further, an area of data with a past creation date or update date may be extracted as a reference information area rather than data having an input area. In addition, a window displaying content in a certain area or more on the monitor 266 may be extracted as a reference information area.

  Further, it may be extracted as a reference information area according to the priority of the application registered in the HDD 264 (for example, the priority is 1) document creation application, 2) spreadsheet application, 3) presentation application. If it is set to go down and all of them are running, 1) the document creation application and 2) the spreadsheet application are extracted as reference information areas, and 3) the presentation application is the input area. Extracted as, etc.).

  When the user inputs to the extracted area after being extracted as the reference information area, the area may not be extracted as the reference information area thereafter.

  The table for determining the priority as described above may be automatically determined by the system or may be changed by the user.

  The input area detection unit B03 extracts an app that can be handled as an input area displayed on the monitor 266 and its area. This extraction is performed based on the type of application corresponding to the window displayed on the monitor 266, for example. Specifically, for example, if the application is a creation-type application as described above, a window displayed by the application is extracted as an input area.

  In the PC 200, for example, the HDD 264 stores information for specifying the browsing application and the creation application. Then, the reference information area detecting unit B02 and the input area detecting unit B03 execute the extraction with reference to the information.

  In addition, as extraction of an input area, you may pick up all the places considered as an input area in the application which the user is starting on PC200 at that time (location where information input is received). And the area | region which became Active last in it may be extracted as an input area. Alternatively, what is extracted as the input area may be determined according to the priority of the table stored in advance in the HDD 264 or the like. Alternatively, an area that is within the user's field of view and has the largest area may be extracted as the input area.

  The input area can also be detected dynamically using an OS (Operating System) function or the like (Input method, etc.). In this case, the input support processing described later can be applied to a new application that was not created when the input support device (program stored in the HDD 264 for functioning as an input support device) according to the present embodiment was created. Therefore, it is possible to use the extraction method using the function of the OS in combination with other extraction methods.

  In the PC 200, the auxiliary input area integration management unit B01 determines whether or not to create the auxiliary input area based on the extraction result of the reference information area and the input area. Specifically, on the condition that both have been extracted, the auxiliary input area integration management unit B01 determines to create and display the auxiliary input area.

  When the auxiliary input area integration management unit B01 determines the creation of the auxiliary input area, the auxiliary input area creation unit B04 determines the input format and size of information for the auxiliary input area.

  As another determination mode of the information input format, there is a determination based on the information input format allowed by the application corresponding to the input area. For example, when the application corresponding to the input area allows only text input, or when it is determined in advance that text input is mainly permitted, text input is determined as the input format. “Predetermined” means that, for example, in the HDD 264, setting contents for an input format preferentially permitted for the application are registered. When the application corresponding to the input area is a drawing application, image input (pen input or the like) is determined as the input format.

  Further, the information input format determination mode may be based on the data input format of the input area. When the input area is a text area, text input is determined as the input mode. On the other hand, when the input area is an area that accepts image input, image input (pen input) is accepted as an input mode. In this case, a partial area in the target window is extracted as the input area, and the data input format is a data input format corresponding to the extracted area.

  In this case, the PC 200 is configured as shown in FIG. 8, for example, in order to extract the region. FIG. 8 is a diagram illustrating a modification of the functional configuration of the PC 200. In this modification, the reference information area and the input area are detected using the user's line of sight.

  Referring to FIG. 8, PC 200 further includes a data input / output unit A10 as its function. The data input / output unit A10 is realized by the communication device 262, for example. The data input / output unit A10 is connected to the detection device 300.

  As the extraction of the area, the auxiliary input area creation unit B04 is connected to, for example, a camera that captures an area where the user's face is likely to exist, and the CPU 250 applies a facial image to an image captured by the camera. It is realized by specifying the position where the user is paying attention in the window by specifying the position of the inside eye and nose by pattern recognition etc. and detecting the user's gaze based on the position of the eye and nose The That is, a certain area including the position where the line of sight intersects in the window is extracted as a reference information area or an input area. As another method, the PC 200 is configured to be able to communicate with a line-of-sight detection device worn on the user's head, and identifies and identifies the user's line of sight based on a reception mode such as infrared rays received from the device. The reference information area and the input area are extracted based on the line of sight.

The detection apparatus 300 in FIG. 8 corresponds to the camera or the line-of-sight detection device.
Returning to FIG. 2, the size of the auxiliary input area may be determined according to a size predetermined in the HDD 266, for example, or may be determined according to the size of the window corresponding to each reference information area. The reference information area may be determined according to the size of the largest (or smallest) window among the corresponding windows.

  Then, the auxiliary input area creation unit B04 displays the auxiliary input areas (auxiliary input areas 911 to 915 in FIG. 6) in the vicinity of the window corresponding to each reference information area with the determined size.

  As a result of the above processing, a plurality of windows are displayed on the monitor 266 as shown in FIG. 5, one or more of these windows are extracted as reference information areas, and one or more other windows are input. Extracted as an area. An auxiliary input area is displayed in the vicinity of the reference information area.

  The auxiliary input data management unit B06 manages data input to the auxiliary input area. For example, the data is managed by storing the input data in the RAM 254 or the like in association with the reference information area in which the auxiliary input area where the data is input is displayed correspondingly, or the auxiliary input where the data is input It may be displayed in an area and / or reflected in an input area.

  When the data input to the auxiliary input area is completed, the auxiliary input area display management unit B05 ends the display of the auxiliary input area. Then, the auxiliary input area display management unit B05 associates the data input to the auxiliary input area, the information specifying the reference information area, and the information specifying the input area with each other, and sends the data to the auxiliary input data management unit B06. Send. The information specifying the reference information area may be the content itself including the reference information area, or information specifying the portion displayed on the monitor 266 as the reference information area in the content (for example, the content It may be the number of pages inside). Also, the information specifying the input area may be the content itself including the input area, or a portion of the content displayed on the monitor 266 as the input area (for example, the number of pages in the content). It may be.

  In the PC 200, the relevance calculation unit C01 can also calculate the relevance between the reference information and the input area. The relevance is calculated by, for example, calculating the content rate of the same keyword in the content including the reference information area and the content including the input area. Alternatively, the relevance level is calculated based on the content of the same keyword in the portion displayed as the reference information area in the content, not the entire content, and the portion displayed as the input area in the content including the input area. May be calculated. Alternatively, the relevance may be calculated by creating a summary (semantic data or digest data) of these data and calculating the content of the same keyword between them.

  Then, the auxiliary input area display management unit B05 may further transmit the data input to the auxiliary input area to the auxiliary input data management unit B06 in association with the above degree of association.

<Outline of processing>
Next, details of processing executed as input support for the user in the PC 200 will be described in detail.

FIG. 3 is a flow of input support processing executed by the CPU 250 in the PC 200.
Referring to FIG. 3, when a plurality of windows are displayed on monitor 266 according to the application being executed, CPU 250 first extracts an input area in step S10 and advances the process to step S20. As an example, the extraction of the input area is executed according to the contents described as the function of the input area detection unit B03.

  In step S20, CPU 250 extracts a reference information area and proceeds to step S30. As an example, the extraction of the reference information area is executed in accordance with the contents described as the function of the reference information area detection unit B02 described above.

  In step S30, the CPU 250 displays an auxiliary input area. As an example, the display of the auxiliary input area is executed according to the contents described as the function of the auxiliary input area creating unit B04. If the input area cannot be extracted in step S10, or if the reference information area cannot be extracted in step S20, the processing after step S30 is not executed, and the input support processing ends at that time. To do.

  In step S40, CPU 250 creates link information and advances the process to step S50. The link information is information associated with the auxiliary input area described above, and is information for specifying the reference information area and the input area. Further, when the degree of association is calculated, the degree of association is also included. The creation of these pieces of information is executed in accordance with the content described as the function of the auxiliary input data management unit B06, for example.

The processing so far will be described in detail with reference to FIGS.
FIG. 4 is a diagram illustrating an example of a screen displayed on the monitor 266. FIG. 4 shows a state in which a plurality of windows 901 to 905 and 950 displayed according to the application executed on the PC 200 are displayed on the screen 900 at the same time.

  In step S10 and step S20, an input area and a reference information area are extracted from the windows 901 to 905 and 950. In the example of FIG. 4, it is assumed that the window 950 is extracted as an input area and the windows 901 to 905 are extracted as reference information areas.

  Then, by extracting the input area and the reference information area, the auxiliary input area is displayed in the vicinity of each reference information area in step S30. In FIG. 5, auxiliary input areas 911 to 915 are displayed in the vicinity of the windows 901 to 905, respectively. In FIG. 5, a window 951 in which input information before confirmation is displayed is shown in the window 950.

  As a specific display position determination method for the display position of the auxiliary input area, for example, an area that does not overlap the content (text or image) in the reference information area can be set near the content. FIG. 9 is a diagram for explaining an example of a method for determining the display position of the auxiliary input area. FIG. 9 shows a window 901 selected as the reference information area. The window 901 includes contents (text and images) 901A and 901B. The auxiliary input area 911 is an auxiliary input area corresponding to the reference information area indicated by the window 901. The auxiliary input area 911 is positioned so as not to overlap the contents 901A and 901B and in the vicinity thereof. In addition, the auxiliary input area may slightly overlap the content in the reference information area, and may be arranged near the outer periphery of the window in the reference information area. Further, the display form of the auxiliary input area may be translucent, and the reference information area may be displayed as a visible background. Alternatively, the reference information area may be displayed so that the reference information area of the overlapped portion cannot be visually recognized. It should be noted that the setting contents regarding the display position and display form of the auxiliary input area can be modified by a user instruction.

  Returning to FIG. 3, in step S40, link information is created. Here, as the link information, if the processing screen of the application is simultaneously displayed as shown in FIG. 4, the minimum value “1” is assigned as the level as the association.

  That is, in the RAM 254, link information having a degree of association “1” is generated between the application corresponding to the window 950 and the applications corresponding to the windows 901 to 905, respectively.

  Thereafter, as will be described later with reference to FIG. 6, when information is input to any auxiliary input area, the degree of association between the application in the reference information area corresponding to the auxiliary input area and the application corresponding to the window 950 For example, a predetermined value such as “+1” is incremented.

  Note that the degree of association may be generated only with other applications that are displayed when the input area is displayed on the screen, and the application that has started displaying the processing screen after the input area is displayed The relevance may also be generated.

  Returning to FIG. 3, in step S50, CPU 250 accepts input of information to the auxiliary input area, and proceeds to step S60. The information input reception is executed, for example, according to the contents described as the function of the auxiliary input data management unit B06. When a data input format is determined for the auxiliary input area, data input is accepted in this format.

  FIG. 6 is a diagram illustrating a state where input of information to the auxiliary input area is accepted. In FIG. 6, information input by the auxiliary input data management unit B60 in the auxiliary input area 911 which is one of the auxiliary input areas (in the example of FIG. 6, the text “xxxx according to”). Is displayed. Similar information is also displayed in the window 951 in the input area by the auxiliary input data management unit B60.

  In FIG. 6, windows 912 to 915 that are indicated by solid lines in FIG. 5 are indicated by broken lines. A solid line indicates a state that is displayed without being subjected to a transparent process, and a broken line indicates a state that is displayed after being subjected to a transparent process. As shown in FIG. 6, when information is input to a certain auxiliary input area (auxiliary input area 911), the display mode of other auxiliary input areas (windows 912 to 915) may be changed.

  FIG. 7 is a diagram for explaining another example of a change in the display mode of another auxiliary input area when information is input to a certain auxiliary input area. In FIG. 7, windows 912 to 915 are not displayed. As shown in FIG. 7, when information is input to a certain auxiliary input area (auxiliary input area 911), the display of other auxiliary input areas (windows 912 to 915) may be stopped.

  In step S60, CPU 250 (auxiliary input area display management unit B05) determines whether or not the input of information to the auxiliary input area has been completed.

  As a method of determining completion of input, when information is directly input to the auxiliary input area by operating the input device 260, input is performed by operating a specific key (for example, Enter key). You may judge that it was completed. In addition, when an input format is adopted in which information input to the auxiliary input area is not fixed until a specific key is operated, as shown in FIG. 10, the auxiliary input area (auxiliary input area 911) is used. ), A button 911A that is operated when the input is completed may be displayed, and it may be determined that the input has been completed by operating the button 911A.

  The auxiliary input area display management unit B05 may change the information input to the auxiliary input area into data that can be input according to the data input format of the input area.

  If the input area is a text area, only text input is accepted (if there is a limit on the number of characters, it is applied), and if it is image input (such as pen input), the auxiliary input area similarly accepts pen input.

  When the input of information to the auxiliary input area is completed, insertion of information input to the auxiliary input area is confirmed in the input area. At this time, link information and the degree of association are also added to the input area (including the application file). As a result, in the input area (including the application file), the information input by the user while referring to which reference information area is input to the input area, and the reference information area Information about how much the input area is related to each other is added. In addition, when an auxiliary input area is created corresponding to the portion of the reference information area, and when the input area is specified, it is specified to which part of the file (content) the input area is extracted In the generated file, information that can identify the part of the input area in the file and which part of the reference information area is referenced is created. Will be. As a method for determining the position in the reference information area, for example, it is possible to determine by specifying which part of the content the window displayed on the monitor 266 is. The link information described above also includes information indicating the relationship with all the reference information areas displayed simultaneously with the input area. For the purpose of reducing the amount of information attached to the input area, the link information includes information indicating the relationship with the reference information area other than the reference information area in which information is input to the auxiliary input area. It may be deleted when the input of information to is started.

  As shown in FIG. 6 and FIG. 7, information input to the auxiliary input area may be sequentially reflected in the input area, or reflected in accordance with the completion of input of information to the auxiliary input area. May be.

<Modifications>
In the present embodiment described above, in PC 200, a window is displayed, a reference information area and an input area are extracted, an auxiliary input area is displayed, and information input in the auxiliary input area is inserted into the input area. It was done. Note that these processes may be executed separately in a plurality of information processing apparatuses.

  FIG. 11 is a diagram illustrating an overview of a system when input support processing is executed in a plurality of information processing apparatuses. The system shown in FIG. 11 includes a first PC 701 and a second PC 702. Since these hardware configurations can be the same as those of PC 200, this description will not be repeated.

FIG. 12 is a diagram schematically illustrating a functional configuration of the PC 701.
Compared with the functional block diagram of FIG. 2, in FIG. 12, the PC 701 further includes a network unit 204 (data transmission / reception unit A02), another device management unit B07, a user data management unit B08, and a user DB (database) D01. The input area detection unit B03 is omitted.

  The other device management unit B07 and the user data management unit B08 are realized by the CPU 250 executing appropriate programs, for example. It may be realized by a hardware element such as a dedicated circuit. The user DBD01 is realized by the HDD 264, for example. The data transmitting / receiving unit A02 is realized by the communication device 262, for example.

  The user DBD01 stores information (for example, ID and password) that identifies the user. The other device management unit B07 interprets information received from other devices such as the PC 702 and generates information to be transmitted to other devices. The user data management unit B08 searches the user DBD01 and specifies a user based on information input via the input unit A01 or information transmitted from another device.

FIG. 13 is a diagram schematically illustrating a functional configuration of the PC 702.
The PC 702 includes, as its functions, an auxiliary input area unit 202, a user interface 201, and a network unit 204, and the relevance calculation unit 203 is omitted.

  FIG. 14 is a flowchart of input support processing executed in the system of FIG. The left input support (1) process is executed by the PC 701, and the right input support (2) process is executed by the PC 702.

  When communication for executing the input support process is established between the PC 701 and the PC 702, the CPU 250 of the PC 701 specifies the user of the PC 701 and transmits the result to the PC 702 in step S01. The identification of the user is realized, for example, by searching the user DBD01 for the ID and password input by the user via the input device 260 of the PC 701. Note that the input information (here, ID and password as an example) may be transmitted to the PC 702 as it is.

  In response to this, the CPU 250 of the PC 702 collates the information received from the PC 701 with the user of the PC 702 in step S02, and if the same user, the process proceeds to step S10 and subsequent steps. For example, the CPU 250 of the PC 702 searches for a user in the user DBD01 and determines whether or not they are the same user as the CPU 250 of the PC 701.

  In step S10, the CPU 250 of the PC 702 extracts the input area from the window displayed on the monitor 266 of the PC 702 and transmits the result to the PC 701 as described with reference to step S10 of FIG. The result transmitted here may be, for example, the application and / or file name detected as the input area, and the portion (number of pages, etc.) that is the display target of the monitor 266 in the file. It may be accompanied.

  In response to this, the CPU 250 of the PC 701 temporarily stores the information received from the PC 702 in step S11, and advances the processing to step S20.

  In step S20, the CPU 250 of the PC 701 extracts the reference information area from the window displayed on the monitor 266 of the PC 701 as described with reference to step S20 of FIG. 3, and advances the process to step S30.

  In step S30, as described with reference to step S30 in FIG. 3, the CPU 250 of the PC 701 displays an auxiliary input area corresponding to each extracted reference information area, and proceeds to step S40.

  In step S40, the CPU 250 of the PC 701 creates link information as described with reference to step S40 of FIG. 3, and advances the process to step S50. In creating the link information, the information received in step S11 is used as the information regarding the input area.

  In step S50, as described with reference to step S50 of FIG. 3, the CPU 250 of the PC 701 accepts input of information for the auxiliary input area, and advances the process to step S60.

  In step S60, as described with reference to step S60 of FIG. 3, the CPU 250 of the PC 701 determines whether or not the input of information to the auxiliary input area is completed, and if it is determined, the process proceeds to step S71. Proceed.

  In step S71, the CPU 250 of the PC 701 transmits information input to the auxiliary input area to the PC 702 together with link information and the like.

  In response to this, the CPU 250 of the PC 702 inserts the information received from the PC 701 into the input area specified in step S10 in step S72 so as to end the process.

  In the present modification described above, reference information is displayed on one information processing apparatus, and can be reflected on a document edited by the other information processing apparatus.

  In the process described with reference to FIG. 14, input completion information is collectively transmitted to the PC 702 after completion of input is detected in the PC 701. Note that each time data is input to the auxiliary input area on the PC 701 (for example, each time a text is input), the CPU 250 of the PC 701 transmits the data to the PC 702 in step S71, and accordingly, the PC 702 The CPU 250 may insert the data into the input area in step S72.

  The PC 701 and the PC 702 include the user DBD01 and the like, and the user can be identified by each. However, the identification of the user is executed by another device (server or the like), and the PC 701 and the PC 702 receive the result. You may do it.

  Each embodiment and its modification disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  200,701,702 PC, 250 CPU, 254 RAM, 256 ROM, 260 input device, 262 communication device, 266 monitor.

Claims (15)

A computer-readable program that can be
Detecting an input area as an input target of information from a window displayed on the screen of the display device;
Detecting a reference information area for displaying the referenced information from the window;
Displaying an auxiliary area for receiving input of information in the vicinity of the reference information area;
An input support program causing the information input to the auxiliary area to be stored in association with the reference information area and the input area. Causing the computer to further execute a step of determining a degree of association between the content including the reference information area and the content including the input area;
The input support program according to claim 1, wherein the step of storing in association stores the association degree in association with information input to the auxiliary area.   The input support program according to claim 2, wherein the step of determining the degree of association determines the degree of association between the content portion corresponding to the reference information area and the content portion corresponding to the input area.   The input support program according to claim 2 or 3, wherein the step of determining the degree of association determines the degree of association higher as the amount of information input to the auxiliary area increases.   The step of determining the degree of association determines a degree of association of the reference information area whose information is input to the corresponding auxiliary area higher than the degree of association of the other reference information areas. The input support program according to claim 4. The step of detecting the reference information area detects two or more reference information areas,
The step of displaying the auxiliary area includes:
Display the auxiliary area in the vicinity of each reference information area,
The input support program according to any one of claims 1 to 5, wherein when information is input to one auxiliary area, display of the other auxiliary area is stopped.   The step of displaying the auxiliary area displays the auxiliary area at a position that does not overlap the content in the reference information area and is closer to the reference information area than the input area. The input support program according to claim 6. The step of detecting the input area detects two or more input areas,
The computer is further configured to further execute a step of determining one input area from two or more of the input areas based on a predetermined priority order for applications to which the input areas correspond. 8. The input support program according to any one of 7 above. The step of detecting the input area detects two or more input areas,
On the computer,
Identifying the user's operating position;
The input support program according to claim 1, further causing a step of determining one input area based on an operation position of the user from two or more input areas.   The program for input support according to claim 9, wherein the step of specifying the operation position of the user specifies the operation position of the user based on the line-of-sight information of the user.   The step of detecting the reference information area detects the reference information area based on an attribute of display content of the window or based on a predetermined priority order for an application corresponding to the window. The input support program according to any one of claims 1 to 10. On the computer,
Detecting completion of input to the auxiliary area;
Further executing the step of confirming the input to the input area of the information input to the auxiliary area on the condition that the completion of the input to the auxiliary area is detected,
The step of detecting completion of input to the auxiliary area detects completion of input when an operation on a specific display unit displayed in the auxiliary area or a specific operation on the computer is executed. An input support program according to any one of claims 1 to 11. The computer includes a first computer and a second computer communicable with the first computer,
In the first computer,
Transmitting information identifying a user who uses the first computer to the second computer;
In the second computer,
A step of detecting the input area from a window displayed on a screen of a display device connected to the second computer when a user using the first computer matches a user of the second computer; When,
Transmitting information instructing detection of the reference information area to the first computer,
In the first computer,
Detecting the reference information area from a window displayed on a screen of a display device connected to the first computer in response to the instruction from the second computer;
Displaying an auxiliary area for receiving input of information in the vicinity of the reference information area;
Receiving input of information for the auxiliary area;
Transmitting the information input to the auxiliary area to the second computer together with information for specifying the reference information area to which the auxiliary area corresponds; and
In the second computer,
The information input to the auxiliary area transmitted from the first computer and the information specifying the reference information area to which the auxiliary area corresponds are stored in association with the input area. The input support program according to claim 12. A method for supporting information input in a computer, wherein the computer
Detecting an input area as an input target of information from a window displayed on the screen of the display device;
Detecting a reference information area for displaying the referenced information from the window;
Displaying an auxiliary area for receiving input of information in the vicinity of the reference information area;
And a step of storing the information input in the auxiliary area in association with the reference information area and the input area. A device for supporting the input of information on a computer,
First detection means for detecting an input area as an information input target from a window displayed on the screen of the display device;
Second detection means for detecting a reference information area for displaying the referenced information from the window;
Display control means for displaying an auxiliary area for receiving input of information in the vicinity of the reference information area;
An input support apparatus comprising: storage means for storing information input to the auxiliary area in association with the reference information area and the input area.

Images