JP2005182603A - Information processor, information processing method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor and an information processing method for efficiently operating data search processing. <P>SOLUTION: Sight line information during data browsing by a user is acquired and fixation point position history information serving as a temporal history information of the fixation point coordinate is generated, while display data history information having window positional information and the like about display data is generated. Based on the generated display data history information and the fixation point positional history information, browsing time information associating a browsing time and display data identification information (URL) with each other is generated. When a search result list is adjusted based on the browsing time information to be displayed in a display, recognition and extraction of browsed data can be carried out efficiently, and consequently, data can be searched and extracted efficiently. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus, an information processing method, and a computer program. More specifically, for example, when displaying a search result such as a keyword search for various information that can be acquired from the Internet on a display device such as a display such as a PC (Personal Computer), it is based on the user's reference history information and line-of-sight information. The present invention relates to an information processing apparatus, an information processing method, and a computer program that enable efficient data search and information browsing by presenting regenerated list display data to a user.

  In recent years, data communication via the Internet has become popular, and information collection using the Internet has become very common. There are many search sites on the Internet. For example, by inputting a keyword corresponding to information required by the user to a PC (personal computer) used by the user, data search is executed at the search site. Index information indicating a part of a Web site or document corresponding to is displayed on the user's PC as a search result.

  Various search algorithms for calculating a search result based on a keyword have been developed. For example, a result display method using a text match, a keyword appearance frequency, or the like is common.

  The user can select arbitrary information from the list of list information indicating the search results presented on the PC, and the PC can record the information selected by the user as reference history information in its own PC. Is possible. For example, from a list of search result information, reference history information about a Web site or an electronic document browsed by a user by a click operation or the like is recorded on the PC.

  Such history information is stored in the PC. For example, when a user newly searches using a search site, the history information is displayed in a search result list presented on the display in the past. Processing such as changing the color scheme is performed only for the document, and the user can know previously browsed information from the new search result display list.

  For example, Patent Document 1 discloses a technique disclosed for the storage and use processing configuration of such reference history information. Patent Document 1 discloses a configuration for recording and holding URL information corresponding to browsing information and access time information of information corresponding to each URL as reference history information of a user in information search processing using the Internet. Yes. Based on the reference history information consisting of this URL and access time information, it is possible to search for history specifying a retroactive time, or to search historical information by setting the number of retroactive URLs.

Patent Document 2 acquires line-of-sight information of a user who is viewing information such as a document displayed on a display, detects an area in a document referred to by the user based on the line-of-sight information, and displays the display color of the detection area. The structure which changes the data attribute of is disclosed. According to this configuration, for example, it is possible to change and store attributes such as the character color, font, character size, and background color of the area that the user has focused on in the past, and display the same document at a later date. In this case, it is possible to easily find out information on a part that the user has viewed in the past from the document displayed on the display.
JP-A-11-249993 JP-A-2002-14988

  With the recent spread of the Internet, the number of information providing sites has also increased explosively, and the storage capacity and processing capacity of PCs used by users are also making significant progress. Along with this, the access frequency to Web information using a PC tends to increase. However, due to the increase in the number of information providing sites, it is difficult for users to search for data because it takes a lot of labor and time to reach the target information even if data search processing is executed. The nature is increasing.

  The configuration of Patent Document 1 described above is a configuration in which URL information and access time information are recorded in association with each other as user reference history information, but when performing re-extraction processing of information using reference history information, When performing information re-extraction using time information set in the reference history information, the user needs to specify a time range and a retroactive time. Further, when performing information re-extraction using the URL information set in the reference history information, processing such as specifying the number of retroactive URLs is required.

  When performing such time specification or URL number specification, the user needs to rely on his / her memory to determine the specified range. Therefore, if you remember the date and time when you saw the information that the user needs, you can re-extract information you have seen in the past by specifying a specific time based on the user's memory or by specifying the number of URLs that go back. Although it can be performed easily, there is a problem that information re-extraction using the reference history information cannot be performed effectively if the user has forgotten to see it in the past but forgets when it has been viewed. Therefore, the configuration described in Patent Document 1 lacks certainty, and there is a problem that not only the work efficiency is poor, but also a large cognitive load is given to the user.

  In addition, the configuration described in Patent Document 2 extracts a region of interest in a document by measuring the line of sight when the line of sight is directed to the document without performing a special operation such as manually specifying a history. However, this configuration is not a process for data retrieval information, but only detects a user's attention area in specific document data and sets this as attribute information of document data. It does not show the configuration applied to the display data of the result list.

  The present invention provides, for example, a user's reference history information and user line-of-sight information in a search result list display process for information that can be acquired via the Internet or the like without the user manually specifying a reference history. The search result list to be stored and displayed on a display device such as a display is subjected to processing such as setting the order of the list by applying the stored user reference history information and user gaze information, or changing the display mode An object of the present invention is to provide an information processing apparatus, an information processing method, and a computer program that can be executed to immediately detect user-referenced information or noticed information.

The first aspect of the present invention is:
An information processing device that executes display data generation processing of search result list information,
A display device as data display means;
A gazing point position history information generating unit that acquires biometric information of the user and generates gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating unit that generates display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, browsing time information in which display data identification information displayed on the display device is associated with browsing time information of a user corresponding to the display data is generated. A browsing time information generation unit;
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generator;
There is an information processing apparatus characterized by having.

  According to this configuration, the time correspondence information of the gazing point position corresponding to the user gaze position on the display device is acquired to generate the gazing point position history information, and the display data displayed on the display device as the history information Browsing by generating data history information and associating display data identification information displayed on the display device with user browsing time information corresponding to the display data based on the generated gazing point position history information and display data history information Generate time information, and based on this browsing time information, sort the search result list information obtained as a result of the search process for the search target, change the display mode, and perform adjustment processing such as selection display data Since it is configured to display on a display device as a display means, it is possible to display search results in consideration of the user's browsing time. For example, discrimination and extraction of browsed data Etc. it is possible to perform efficiently.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the information processing apparatus includes a line-of-sight information measurement unit that detects a user line-of-sight direction for each predetermined sampling time, and the gazing point position history information generation unit includes: The gaze position history information is generated based on user gaze direction information input from the gaze information measurement unit.

  According to this configuration, since the user viewing time is calculated by detecting the user gaze direction, it is possible to acquire the user viewing information without any user operation.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the browsing time information generation unit includes display area information of display data in which the gazing point position coordinates included in the gazing point position history information are included in the display data history information. If it is included, the total time when the gazing point position coordinates exist in the display area information of the display data is calculated as the browsing time, and the calculated time information is displayed as the display data. The browsing time information associated with the identification information is generated.

  According to this configuration, the viewing time information is generated by determining whether or not the gazing point position coordinates included in the gazing point position history information are included in the display area information of the display data included in the display data history information. Therefore, it is possible to accurately measure the time actually viewed by the user, and to generate browsing time information that accurately reflects the user's interest compared to a configuration that simply records the displayed time Is possible.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the browsing time information generation unit includes display data identification information for each display data, when display area information of a plurality of different display data exists in the display device. It is the structure which produces | generates the browsing time information which matched the browsing time information of the user corresponding to this display data.

  According to this configuration, even when display area information of a plurality of different display data exists in the display device, the configuration is such that individual browsing time information is generated, so that accurate browsing time information in display information units is generated. Is possible.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display data generation unit performs a search in ascending order of the browsing time corresponding to each display data stored in the browsing time information as the adjustment process of the search result list information. A process for sorting the result list is executed, and the search result list subjected to the sort process is generated as output data for the display device.

  According to this configuration, the search result list information can be displayed in order from the top in consideration of the user's browsing time, and browsing data can be efficiently identified and extracted.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display data generation unit displays only data corresponding to the display data identification information stored in the browsing time information as the adjustment processing of the search result list information. The change processing is executed, and a search result list subjected to the change processing is generated as output data for the display device.

  According to this configuration, whether or not the user has been browsed can be identified based on the search result list information, and browsed data can be efficiently identified and extracted.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display data generation unit selects only data corresponding to the display data identification information stored in the browsing time information as the adjustment process of the search result list information. Is executed, and a search result list including only selected information is generated as output data for the display device.

  According to this configuration, whether or not the user has been browsed can be identified based on the search result list information, and browsed data can be efficiently identified and extracted.

  Furthermore, in one embodiment of the information processing apparatus of the present invention, the display data identification information stored in the browsing time information is a URL (Uniform Resource Locator).

  This configuration makes it possible to perform search processing corresponding to URL-compatible data acquired via the Internet, acquisition of search results, and adjustment processing, and it is efficient in searching for huge URL-compatible data and extracting data. Processing is realized.

Furthermore, the second aspect of the present invention provides
An information processing method for executing display data generation processing of search result list information,
A gazing point position history information generating step for acquiring biometric information of the user and generating gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating step for generating display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, the display data identification information displayed on the display device and the viewing time information corresponding to the user viewing time information corresponding to the display data are generated. Browsing time information generation step,
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generation step;
There is an information processing method characterized by comprising:

  According to this configuration, the time correspondence information of the gazing point position corresponding to the user gaze position on the display device is acquired to generate the gazing point position history information, and the display data displayed on the display device as the history information Browsing by generating data history information and associating display data identification information displayed on the display device with user browsing time information corresponding to the display data based on the generated gazing point position history information and display data history information Generate time information, and based on this browsing time information, sort the search result list information obtained as a result of the search process for the search target, change the display mode, and perform adjustment processing such as selection display data Since it is configured to display, it is possible to display the search result in consideration of the browsing time of the user, for example, efficiently discriminating and extracting the browsed data. Theft is possible.

  Furthermore, in one embodiment of the information processing method of the present invention, the information processing method further includes a gaze information measurement step of detecting a user gaze direction for each predetermined sampling time, and the gazing point position history information generation step Generates gazing point position history information based on the user gaze direction information measured in the gaze information measurement step.

  According to this configuration, since the user viewing time is calculated by detecting the user gaze direction, it is possible to acquire the user viewing information without any user operation.

  Furthermore, in one embodiment of the information processing method of the present invention, the browsing time information generation step includes display area information of display data in which the gazing point position coordinates included in the gazing point position history information are included in the display data history information A step of determining whether or not it is included, and when it is determined that it is included, a total of time when the gazing point position coordinates exist in the display area information of the display data is calculated as a browsing time, and the calculation time Generating browsing time information in which information is associated with display data identification information.

  According to this configuration, the viewing time information is generated by determining whether or not the gazing point position coordinates included in the gazing point position history information are included in the display area information of the display data included in the display data history information. Therefore, it is possible to accurately measure the time actually viewed by the user, and to generate browsing time information that accurately reflects the user's interest compared to a configuration that simply records the displayed time Is possible.

  Furthermore, in one embodiment of the information processing method of the present invention, the browsing time information generation step includes display data identification information for each display data, when display area information of a plurality of different display data exists in the display device. Browsing time information in which user browsing time information corresponding to the display data is associated is generated.

  According to this configuration, even when display area information of a plurality of different display data exists in the display device, the configuration is such that individual browsing time information is generated, so that accurate browsing time information in display information units is generated. Is possible.

  Furthermore, in one embodiment of the information processing method of the present invention, the display data generation step performs a search in ascending order of the browsing time corresponding to each display data stored in the browsing time information as the adjustment processing of the search result list information. This is a step of executing a process of sorting the result list and generating a search result list subjected to the sort process as output data for the display device.

  According to this configuration, the search result list information can be displayed in order from the top in consideration of the user's browsing time, and browsing data can be efficiently identified and extracted.

  Furthermore, in one embodiment of the information processing method of the present invention, the display data generation step includes a display mode of only data corresponding to the display data identification information stored in the browsing time information as the adjustment processing of the search result list information. This change processing is executed, and a search result list subjected to the change processing is generated as output data for the display device.

  According to this configuration, whether or not the user has been browsed can be identified based on the search result list information, and browsed data can be efficiently identified and extracted.

  Furthermore, in an embodiment of the information processing method of the present invention, the display data generation step includes a selection process of only data corresponding to the display data identification information stored in the browsing time information as the adjustment process of the search result list information. , And generating a search result list including only selected information as output data for the display device.

  According to this configuration, whether or not the user has been browsed can be identified based on the search result list information, and browsed data can be efficiently identified and extracted.

Furthermore, the third aspect of the present invention provides
A computer program that executes display data generation processing of search result list information,
A gazing point position history information generating step for acquiring biometric information of the user and generating gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating step for generating display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, the display data identification information displayed on the display device and the viewing time information corresponding to the user viewing time information corresponding to the display data are generated. Browsing time information generation step,
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generation step;
There is a computer program characterized by comprising:

  According to this configuration, the time correspondence information of the gazing point position corresponding to the user gaze position on the display device is acquired to generate the gazing point position history information, and the display data displayed on the display device as the history information Browsing by generating data history information and associating display data identification information displayed on the display device with user browsing time information corresponding to the display data based on the generated gazing point position history information and display data history information Generate time information, and based on this browsing time information, sort the search result list information obtained as a result of the search process for the search target, change the display mode, and perform adjustment processing such as selection display data Since it is configured to display, it is possible to display the search result in consideration of the browsing time of the user, for example, efficiently discriminating and extracting the browsed data. Theft is possible.

  The computer program of the present invention is, for example, a storage medium or communication medium provided in a computer-readable format to a computer system capable of executing various program codes, such as a CD, FD, or MO. It is a computer program that can be provided by a recording medium or a communication medium such as a network. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the computer system.

  Other objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

  The information processing apparatus according to the present invention acquires gaze information when a user browses data to generate gaze position history information, and generates display data history information having window position information of display data and the like. The browsing time information that associates the browsing time with the display data identification information (URL) is generated based on the display data history information and the gazing point position history information, and the search result list is adjusted based on the browsing time information. Thus, the search result list information can be changed in consideration of the browsing time of the user, and for example, it is possible to efficiently discriminate and extract the browsed data.

  Furthermore, according to the configuration of the present invention, since the user browsing time is calculated by detecting the user's line-of-sight direction, the user browsing information can be acquired without requiring any user operation. In addition, since it is configured to generate browsing time information by determining whether or not the gazing point position coordinates included in the gazing point position history information are included in the display area information of the display data included in the display data history information. The time actually viewed by the user can be accurately measured, and browsing time information that accurately reflects the user's interest can be generated as compared to a configuration in which the displayed time is simply recorded.

  Further, according to the configuration of the present invention, the search result list in which the search result list is sorted in the order of long browsing time, the search result list in which the display mode of only the browsed data is changed, or the browsed selection is selected Processing such as outputting a search result list consisting only of information to a display device becomes possible, and browsing data can be efficiently identified and extracted.

  Details of the information processing apparatus, information processing method, and computer program of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing the overall configuration of an embodiment of an information processing apparatus of the present invention. The information processing apparatus includes a display 10, a data processing unit 20, a line-of-sight information measurement unit 30, and an input device 40. Note that these configurations can be realized by a computer having a CPU as a control unit and loaded with programs for executing various processes described below. A specific hardware configuration including a CPU, a memory, and other devices will be described later. Here, the display will be described by using a display such as a CRT or a liquid crystal display device as an example, but the configuration of the present invention can use any display device such as a projector display device.

  The input device 10 includes, for example, a keyboard and a mouse, and is used for data input by a user, command input for starting and ending a processing program, and other processing instruction input. The data processing unit 20 executes, for example, connection processing to various information providing sites accessible via the Internet 60, control for displaying information provided by the site on the display 10, and the like. A CPU as a control unit executes processing according to the program in accordance with a program stored in the data processing unit 20 in advance. As a specific processing example, search result information obtained from a data search service providing site connected via the Internet 60 is displayed on the display 10. The user 50 browses various information such as search results displayed on the display 10.

  The line-of-sight information measurement unit 30 performs a line-of-sight measurement process of the user 50 when the user 50 is directing his / her line of sight to the display 10. The line-of-sight information measurement unit 30 measures at which position on the plane of the display 10 the line of sight of the user 50 is. Note that the line of sight of the user 50 on the plane of the display 10 is referred to as a gazing point.

  FIG. 2 is a block diagram illustrating specific processing of the data processing unit 20 and the line-of-sight information measurement unit 30 in the information processing apparatus of the present invention. The data processing unit 20 includes a display data history information generation unit 21, a gazing point position history information generation unit 22, a browsing time information generation unit 23, a browsing time information storage unit 24, a display data generation unit 25, a display control unit 26, and communication control. The line-of-sight information measurement unit 30 includes a line-of-sight detection unit 31 and a gazing point position detection unit 32.

  First, an outline of processing executed by each processing unit will be described, and then specific detailed processing will be described.

  The line-of-sight detection unit 31 in the line-of-sight information measurement unit 30 detects the line of sight of the user 50 when the user 50 is browsing data displayed on the display 10, for example, a website. The point-of-gaze position detection unit 32 acquires, from the line of sight of the user 50 detected by the line-of-sight detection unit 31, position coordinate (gaze point position coordinate) information on the display of the line of sight directed toward the display 10 in association with time. .

  The display data history information generation unit 21 of the data processing unit 20 displays a window display history indicating display information provided by the website displayed on the display 10 by the user 50 using the input device 40 such as a mouse or a keyboard. Record. Specifically, information indicating the position and size of a window indicating display information presented on the display 10 on the display 10, for example, upper left and lower right coordinates of the window, and display data identification information, for example, the website A URL (Uniform Resource Locator) as specific information and information indicating whether the window is active are recorded in association with time. Details of the display data history information will be described later in detail with reference to FIG.

  The gazing point position history information generation unit 22 generates gazing point position history information in which temporal transition data of the gazing point position coordinates acquired by the gazing point position detection unit 32 in the line-of-sight information measurement unit 30 is recorded. Details of the gazing point position history information will be described later in detail with reference to FIG.

  The browsing time information generation unit 23 integrates the display time history information generated by the display data history information generation unit 21 and the viewing time information obtained by integrating the gazing point position history information generated by the gazing point position history information generation unit 22. Generate. The browsing time information is data in which the total time when the user looks at the window of the website displayed on the display 10 is associated with the URL of the website. Details of the browsing time information will be described later in detail with reference to FIG.

  For example, the browsing time information generation unit 23 also determines whether the line-of-sight object of the user 50 is directed to the window of the Web site or the background screen of the window on the display 10. The browsing time information storage unit 24 stores the browsing time information generated by the browsing time information generation unit 23.

  The display data generating unit 25 generates display data such as various Web site provided information received by the communication control unit 27 via the Internet 60 or an index information list as a search result provided by the search service site. The display control unit 26 outputs the display data generated by the display data generation unit 25 to the display 10.

  The display data generation unit 26 displays the index information list as the search result provided by the search service site based on the browsing time information corresponding to the display data of the user held in the browsing time information storage unit 24. Then, display data adjustment processing such as index information list sorting processing or display mode changing processing such as display color of display data is executed. That is, a process of generating display data that can be easily identified for data that has been browsed by the user in the past is executed. Details of this processing will be described later.

  Next, a specific processing example will be described. The user 50 accesses a data search service providing site connected via, for example, the Internet 60, and displays a list of search results acquired by, for example, keyword search processing on the display 10.

  For example, the communication control unit 26 receives a search result from the data search service providing site via the Internet 60, and the display data generation unit 25 uses the search result list information as display data including, for example, HTML data. Is output and displayed on the display 10.

  The user 50 selects information determined to be related to the information intended by the user from a search list composed of index information including, for example, several lines of explanatory text in text format displayed on the display 10. By an operation such as a mouse click on the index indicating the information, access to the URL (Uniform Resource Locator) linked to the index is executed, and the website corresponding to the URL can be accessed. Information to be provided is received via the communication control unit 27 and is displayed in a window format on the display 10 based on the control of the display data generation unit 25 and the display control unit 26.

  The display data history information generation unit 21 is information input from the input device 40 such as a mouse click process executed in the URL designation process or the like, or a display data generation process of URL corresponding data executed in the display data generation unit 25 An event occurrence time such as information is detected, and a display start (or access start) time of URL-compatible data is recorded. Further, display data in which the position coordinates of the display window on the display 10 of the data specified by the URL, URL information, and active information indicating whether the display window is in an active state or an inactive state are associated with time. Generate as history information.

  An example of the display data history information generated in the display data history information generation unit 21 is shown in FIG. As shown in FIG. 3, the display data history information generated by the display data history information generation unit 21 includes items of [time], [URL], [upper left corner coordinates], [lower right corner coordinates], and [active information]. Have

  [Time] is a field for recording the display start time of the provided data of the URL-compatible website set in [URL]. Specifically, for example, an event in which a user clicks on URL information presented on a display or link information for the URL with a mouse is detected, and the time of this event is recorded as the access start time for the URL.

  The URL information set in [URL] is URL information accessed by the user. [Upper left corner coordinates] and [Lower right corner coordinates] are coordinate information of the upper left corner and the lower right corner indicating the position of the window set when the URL-compatible data is displayed on the display. For example, it is recorded in units of pixels.

  [Active information] is information indicating whether or not the uppermost active window is set when, for example, a plurality of URL-compatible windows are displayed on the display 10 in an overlapping manner. [1] when active, and [0] when inactive, that is, when the window is set in a lower layer.

  The example shown in FIG. 3 is a recording example when only one window is displayed on the display. The time indicating the event that occurred to access a specific Web site, the URL of the Web site being accessed, the window position coordinates on the display, and active information are sequentially recorded according to the switching timing of the display Web site. The

  When a plurality of windows are activated on the display, the time when the windows are activated, the URL of the website being accessed, the window position coordinates on the display, and active information are recorded for each window. .

  FIG. 4 shows an example in which a plurality of windows are displayed overlapping each other. In the example of FIG. 4, two windows 12 and 13 are displayed on the display 10, the upper layer window is the active window 12, and the lower layer window is the inactive window. Thus, in a state where a plurality of windows are activated on the display, the time when the window is activated, the URL of the website being accessed, the position coordinates of the window on the display, and the active information are displayed for each window. To be recorded.

  The line-of-sight detection unit 31 in the line-of-sight information measurement unit 30 illustrated in FIG. 2 detects the line of sight of the user 50 when the URL designation data is displayed on the display 10. Specifically, the direction in which the line of sight is directed can be detected by imaging the user's eyes from an eye camera arranged in front of the user and mathematically processing the captured image. This method is a common method in the field of eye gaze detection.

  The gaze point position detection unit 32 in the gaze information measurement unit 30 receives gaze direction data to which the user's 50 gaze is directed from the gaze detection unit 31 and corresponds to the gaze direction to which the gaze of the user 50 is directed. The position coordinates are measured at regular sampling times.

  The measurement information is input to the gazing point position history information generating unit 22 of the data processing unit 20, and the gazing point position history information generating unit 22 records the gazing point position history information, which is data in which temporal transition of the gazing point position coordinates is recorded. Is generated.

  A data example of the gazing point position history information generated by the gazing point position history information generation unit 22 is shown in FIG. The gazing point position detection unit 32 measures the gazing point position coordinates on the display of the line of sight at every constant sampling time, acquires the gazing point coordinates as a measurement result, and the gazing point position history information generation unit 22 samples these points. Based on the data, gaze point position history information indicating the transition of the gaze point position coordinates for each sampling time is generated as shown in FIG.

  When the user's line of sight is off the display, data indicating that the line of sight is off is recorded. The example shown in FIG. 5 is an example in which the sampling interval is 1 second (1 Sec) and the position coordinates (x, y) of the point of interest on the display are recorded in association with the time.

  The browsing time information generation unit 23 includes the display data history information described above with reference to FIG. 3, that is, the display data history information generated by the display data history information generation unit 21 and the gazing point position history information generation unit 22. The generated gazing point position history information (see FIG. 5) is input. Based on these input data, the browsing time information generation unit 23 calculates the total time that the user 50 has turned his / her line of sight toward the window on the display 10 and the URL corresponding to the data displayed in the window having his / her line of sight. The associated browsing time information is generated.

  An example of browsing time information generated by the browsing time information generation unit 23 is shown in FIG. As shown in FIG. 6, the browsing time information is data in which display data identification information (URL) corresponding to the browsed data displayed on the display by the user and the browsing time are recorded in association with each other. That is, it is data in which the total time during which the user 50 has turned his / her line of sight to the window displaying data corresponding to the specific URL on the display 10 and the URL of the website displayed in the window having his / her line of sight recorded. is there.

In the example of browsing time information shown in FIG.
The user was watching the URL [http://www.aaa.co.jp/index1.html] for 140 seconds, and the URL [http://www.aaa.co.jp/index2.html] The user was watching for 3 seconds, the URL [http://www.aaa.co.jp/index3.html] was being watched for 45 seconds, and the URL [http: // www .bbb.co.jp / index1.html] is 105 seconds.

  A sequence of browsing time information generation processing executed by the browsing time information generation unit 23 will be described with reference to a flowchart of FIG.

  The browsing time information generation unit 23 first inputs the display data history information (see FIG. 3) generated by the display data history information generation unit 21 in step S101, and further generates the gazing point position history information generation unit 22. The gazing point position history information (see FIG. 5) is input.

  Next, in step S102, the position coordinate data of the upper left corner and the lower right corner of the window is acquired from the display data history information (see FIG. 3), and the size and display position of the window are detected.

  Next, in step S103, the gazing point position coordinate data recorded in the gazing point position history information (see FIG. 5) is acquired.

  In step S104, the display position data of the window acquired in step S102 and the gazing point position coordinate data acquired in step S103 are collated to determine the data area that the user was viewing, that is, the window including the gazing point. . If the gazing point position coordinate is within the window position, it is determined that the line of sight is directed to the window, and the process proceeds to step 105, where the total time when the gazing point position coordinate is within the window position is calculated as the viewing time. Then, an entry of browsing time information (see FIG. 6) is set in association with the URL information of the Web site shown in the window.

  In addition, when the entry which has already recorded the same URL is recorded in browsing time information, the data update process which adds the browsing time newly acquired to the browsing time of browsing time information is performed.

  In step S106, it is determined whether or not processing of all display data history information and gazing point position history information has been completed. If there is unprocessed data, the processing in step S102 and subsequent steps is repeatedly executed. When the processing of all display data history information and gazing point position history information is completed, the browsing time information generation process in the browsing time information generation unit is ended. The generated browsing time information is stored in the browsing time information storage unit 24 shown in FIG.

  When the display area information of a plurality of different display data exists on the display, the browsing time information generation unit 23 displays the display data identification information (URL) for each display data and the user browsing time corresponding to the display data. Browsing time information associated with the information is generated.

  The display data generation unit 25 shown in FIG. 2 displays browsing time information corresponding to display data of the user held in the browsing time information storage unit 24 when displaying an index information list as a search result provided by the search service site. Based on the above, sort processing of the index information list or processing for changing the display mode such as the display color of the display data is executed to generate display data that allows the user to easily identify data that has been browsed in the past. Details of this processing will be described with reference to FIGS.

  FIG. 8 (A) shows a browsing of a Web site based on the acquired search result when the user executes a search process in a state where the browsing time information is not generated, acquires the search result from the search service execution site. The processing sequence in which the information processing device generates display data history information and gazing point position history information, further generates browsing time information, and records based on the user's browsing processing is shown.

  FIG. 8B shows that the browsing time information is generated, the user executes a search process, acquires the search result from the search service execution site, and adjusts the acquired search result based on the browsing time information. The processing sequence for presenting the adjusted search result list to the user is shown. The display data generation unit 25 illustrated in FIG. 2 executes processing for adjusting the search result in FIG. 8B based on the browsing time information.

  First, the processing sequence in FIG. 8A will be described. 8A and 8B, the left side shows the processing on the information processing apparatus side, and the right side shows the processing on the user side.

  In step S201, the user starts data search. For example, a keyword corresponding to target information is input to execute a search. For example, when a keyword is input and a search start command is input to the information processing apparatus, the information processing apparatus transmits search information such as a keyword input by the user to the search service providing site in step S202.

  When the search result is received from the search service providing site in step S203, the information processing apparatus displays a search result list including, for example, URL information or an index list having link information of URL information as a search result on the display in step S204. indicate.

  When the search result list is displayed on the display, in step S205, the user selects information of interest from the search result list, designates the URL, and displays the corresponding data on the window. Data display based on URL designation by the user is continuously executed as data display corresponding to a plurality of URLs.

  As a process corresponding to the data browsing process by the user, the information processing apparatus executes a process of generating display data history information and gazing point position history information in step S206, and further, in step S207, the display data history information, and The browsing time information is generated based on the gazing point position history information, and the generated browsing time information is stored in the browsing time information storage unit.

  The processes in steps S206 and S207 are executed in accordance with the process sequence described with reference to FIG. 7, and as a result, for example, display data identification information (URL) as shown in FIG. The browsing time information added and recorded is stored in the browsing time information storage unit.

  Next, the processing sequence illustrated in FIG. 8B will be described. FIG. 8B shows a state in which the browsing time information is generated, the user executes the search process, acquires the search result from the search service execution site, and displays the generated search result for the display data generation unit 25. Shows a processing sequence for presenting an adjusted search result list generated by performing adjustment processing based on browsing time information to the user.

  In step S301, the user starts data search. For example, a keyword corresponding to target information is input to execute a search. For example, when a keyword is input and a search start command is input to the information processing apparatus, the information processing apparatus transmits search information such as a keyword input by the user to the search service providing site in step S302.

  In step S303, when the search result is received from the search service providing site, the display data generation unit 25 of the information processing apparatus executes an adjustment process based on the browsing time information on the received search result in step S304.

  A specific example of the adjustment process based on the browsing time information executed by the display data generation unit 25 will be described with reference to FIG.

  For example, it is assumed that the browsing time information generated based on past browsing information by the user and stored in the browsing time information storage unit 24 has the data configuration shown in FIG.

  The input search result shown in FIG. 9B shows an example of the search result received from the search service providing site. The search result received from the search service providing site is data in which information corresponding to, for example, an input keyword of the user is listed in the order set on the search service providing site side.

  The display data generation unit 25 adjusts the reception search result based on the browsing time information stored in the browsing time information storage unit 24, and generates a search result list to be presented on the display.

  There are several modes of the search result list adjustment process based on the browsing time information executed by the display data generation unit 25. For example, as shown in FIG. 9C, the results sorted in order from the longest browsing time data stored in the browsing time information of FIG. 9A are displayed on the display as the output search results. The display data generation unit 25 acquires the browsing time of the entry stored in the browsing time information of FIG. 9A, and sorts the input search results shown in FIG. 9B in descending order of the browsing time. Is executed, and the adjusted search result list shown in FIG. 9C is generated and output to the display 10 via the display control unit 26.

  Alternatively, as shown in FIG. 9D, the display data generation unit 25 changes the display mode such as changing the display color or setting bold type only for the data corresponding to the URL stored in the browsing time information of FIG. 9A. The search result list adjusted without changing the list order of the input search results shown in FIG. 9B is generated and output to the display 10 via the display control unit 26.

  Alternatively, as shown in FIG. 9 (e), the display data generation unit 25 uses only the data corresponding to the URL stored in the browsing time information in FIG. 9 (a) as the input search result shown in FIG. 9 (b). A search result list including only selected information is generated from the list, and is output to the display 10 via the display control unit 26.

  The adjusted search result list generated in the display data generation unit 25 is displayed on the display in step S305 in FIG. When the adjusted search result list generated by the display data generation unit 25 is displayed on the display, in step S306, the user selects information of interest from the search result list, designates the URL, and displays the corresponding data in the window. To display.

  The adjusted search result list displayed on the display is configured so that the URL correspondence data browsed in the past by the user can be easily discriminated as shown in FIGS. 9C, 9D, and 9E. Can easily select information browsed in the past.

  In step S306, when the user selects information of interest from the search result list, specifies a URL, and starts processing to display corresponding data on the window, the information processing apparatus performs processing corresponding to the data browsing processing. In step S307, display data history information and gazing point position history information are generated. In step S308, browsing time information entries are generated based on the display data history information and gazing point position history information. Entry update processing is executed as browsing time addition processing, and updated browsing time information is stored in the browsing time information storage unit.

  Subsequent data search by the user is executed according to the processing sequence of FIG. 8B, and the search result list displayed on the display by the user search process is adjusted by the display data generation unit 25 based on the browsing time information. The result list is presented to the user as identifiable information according to the viewing time of the user.

  Thus, the information processing apparatus of the present invention acquires line-of-sight information when a user browses data, generates gazing point position history information as time history information corresponding to gazing point coordinates, and displays data Display data history information having window position information, etc., and viewing time information in which browsing time and display data identification information (URL) are associated with each other based on the generated display data history information and gazing point position history information. Since the search result list is adjusted based on the generated browsing time information and displayed on the display, the user can efficiently extract data browsed in the past.

  Next, a hardware configuration example of the information processing apparatus that performs the above-described processing will be described with reference to FIG.

  A CPU (Central Processing Unit) 501 includes an OS (Operating System), a communication control program, display data history information described with reference to FIG. 7, attention point position history information acquisition processing, browsing time and display data identification information (URL) ) Is associated with various computer programs, such as a browsing time information generation processing program.

  A ROM (Read Only Memory) 502 stores programs used by the CPU 501, calculation parameters, and the like. A RAM (Random Access Memory) 503 stores programs used in the execution of the CPU 501, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 504 including a CPU bus.

  The host bus 504 is connected to an external bus 506 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 505.

  A keyboard 508 and a pointing device 509 are input devices operated by a user, and are used, for example, for inputting a search start command and inputting a keyword applied to search processing. The display 510 includes a liquid crystal display device, a CRT (Cathode Ray Tube), or the like, and displays various types of information as text and images. An HDD (Hard Disk Drive) 511 drives a built-in hard disk and records or reproduces a program executed by the CPU 501 and information. The hard disk stores information such as gazing point position history information, display data history information, browsing time information, and various processing programs. Note that the gazing point position history information and the display data history information only need to be temporarily stored for generating the browsing time information. Therefore, the gazing point position history information and the display data history information are temporarily stored in the RAM without being stored in the hard disk, and the browsing time information is generated. It may be erased later.

  The drive 512 reads data or a program recorded on a removable recording medium 521 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and the data or program is read out from the interface 507 and the external bus 506. , And supplied to the RAM 503 connected via the bridge 505 and the host bus 504.

  The connection port 514 is a port for connecting the external connection device 522 and has a connection unit such as USB or IEEE1394. The connection port 514 is connected to the CPU 501 and the like via the interface 507, the external bus 506, the bridge 505, the host bus 504, and the like.

  The communication unit 515 is connected to a network, stores data supplied from the CPU 501, the HDD 511, or the like, for example, information such as a search request command and a search keyword in a packet of a predetermined method, The data is transmitted to the search service providing sites, and the data received from these sites is displayed on the display 510 under the control of the CPU 501 via the network.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present invention. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims section described at the beginning should be considered.

  The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run.

  For example, the program can be recorded in advance on a hard disk or ROM (Read Only Memory) as a recording medium. Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored (recorded). Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the removable recording medium as described above, or is wirelessly transferred from the download site to the computer, or is wired to the computer via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this manner and install it on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

  As described above, according to the configuration of the present invention, the line-of-sight position history information as time history information corresponding to the point-of-gaze coordinates is generated by acquiring the line-of-sight information when the user browses the data. Display data history information having window position information of display data, etc., and viewing time and display data identification information (URL) associated with each other based on the generated display data history information and gazing point position history information Since the time information is generated and the search result list is adjusted based on the generated browsing time information and presented on the display, the user can efficiently extract data browsed in the past. Therefore, efficient data retrieval and extraction can be performed by executing the processing of the present invention in a personal computer or the like that performs data retrieval processing.

It is a figure explaining the whole information processor concerning the present invention, and use composition. It is a block diagram explaining the structure of the information processing apparatus which concerns on this invention. It is a figure which shows the data example of the display data historical information produced | generated in the information processing apparatus which concerns on this invention. It is a figure explaining the coordinate position information and active information which are included in the display data history information produced | generated in the information processing apparatus which concerns on this invention. It is a figure which shows the data example of the watch point position log | history information produced | generated in the information processing apparatus which concerns on this invention. It is a figure which shows the data example of the browsing time information produced | generated in the information processing apparatus which concerns on this invention. It is a flowchart figure which shows the production | generation processing sequence of the browsing time information produced | generated in the information processing apparatus which concerns on this invention. It is a figure explaining the process in the data search process to which the information processing apparatus which concerns on this invention is applied, and the process of a display data generation part. It is a figure explaining the data example of the search result list which the display data generation part in the information processor concerning the present invention generates. It is a figure explaining the hardware structural example of the information processing apparatus which concerns on this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Display 11 Gaze point 12 Active window 13 Inactive window 20 Data processing part 21 Display data history information generation part 22 Gaze point position history information generation part 23 Browsing time information generation part 24 Browsing time information storage part 25 Display data generation part 26 Display Control unit 27 Communication control unit 30 Gaze information measurement unit 31 Gaze detection unit 32 Gaze point detection unit 40 Input device 50 User 60 Internet 501 CPU (Central processing Unit)
502 ROM (Read-Only-Memory)
503 RAM (Random Access Memory)
504 Host bus 505 Bridge 506 External bus 507 Interface 508 Keyboard 509 Pointing device 510 Display 511 HDD (Hard Disk Drive)
512 drive 514 connection port 515 communication unit 521 removable recording medium 522 external connection device

Claims (16)

An information processing device that executes display data generation processing of search result list information,
A display device as data display means;
A gazing point position history information generating unit that acquires biometric information of the user and generates gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating unit that generates display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, browsing time information in which display data identification information displayed on the display device is associated with browsing time information of a user corresponding to the display data is generated. A browsing time information generation unit;
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generator;
An information processing apparatus comprising: The information processing apparatus includes:
Having a line-of-sight information measurement unit for detecting a user line-of-sight direction for each predetermined sampling time;
2. The information processing according to claim 1, wherein the gazing point position history information generation unit is configured to generate gazing point position history information based on user gaze direction information input from the line-of-sight information measurement unit. apparatus. The browsing time information generator
It is determined whether or not the gazing point position coordinate included in the gazing point position history information is included in the display area information of the display data included in the display data history information. The display time information is calculated by calculating the total time existing in the display area information of the display data as the browsing time, and generating the browsing time information in which the calculated time information is associated with the display data identification information. Item 4. The information processing apparatus according to Item 1. The browsing time information generator
When display area information of a plurality of different display data exists in the display device, browsing time information is generated by associating display data identification information for each display data with user browsing time information corresponding to the display data. The information processing apparatus according to claim 1, wherein the information processing apparatus is configured. The display data generation unit
As the adjustment processing of the search result list information, processing for sorting the search result list is performed in descending order of the browse time corresponding to each display data stored in the browse time information, and the search result list subjected to the sort processing is converted into the search result list. The information processing apparatus according to claim 1, wherein the information processing apparatus is generated as output data for a display device. The display data generation unit
As a search result list information adjustment process, a display mode change process for only data corresponding to display data identification information stored in the browsing time information is executed, and the search result list subjected to the change process is displayed on the display device. The information processing apparatus according to claim 1, wherein the information processing apparatus is configured to generate output data. The display data generation unit
As a search result list information adjustment process, a process for selecting only data corresponding to display data identification information stored in the browsing time information is executed, and a search result list including only selected information is output to the display device. The information processing apparatus according to claim 1, wherein the information processing apparatus is configured to generate data.   The information processing apparatus according to claim 1, wherein the display data identification information stored in the browsing time information is a URL (Uniform Resource Locator). An information processing method for executing display data generation processing of search result list information,
A gazing point position history information generating step for acquiring biometric information of the user and generating gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating step for generating display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, the display data identification information displayed on the display device and the viewing time information corresponding to the user viewing time information corresponding to the display data are generated. Browsing time information generation step,
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generation step;
An information processing method characterized by comprising: The information processing method further includes:
A line-of-sight information measurement step of detecting a user line-of-sight direction for each predetermined sampling time;
The gazing point position history information generating step includes:
The information processing method according to claim 9, wherein gaze point position history information is generated based on user gaze direction information measured in the gaze information measurement step. The browsing time information generation step
Determining whether the gazing point position coordinates included in the gazing point position history information are included in display area information of display data included in the display data history information; and
When it is determined that it is included, the total time when the gazing point position coordinates exist in the display area information of the display data is calculated as the browsing time, and the browsing time information in which the calculated time information is associated with the display data identification information A step of generating
The information processing method according to claim 9, further comprising: The browsing time information generation step
When display area information of a plurality of different display data exists in the display device, browsing time information is generated by associating display data identification information for each display data with user browsing time information corresponding to the display data. The information processing method according to claim 9. The display data generation step includes
As the adjustment processing of the search result list information, processing for sorting the search result list is performed in descending order of the browse time corresponding to each display data stored in the browse time information, and the search result list subjected to the sort processing is converted into the search result list. The information processing method according to claim 9, wherein the information processing method is a step of generating as output data for a display device. The display data generation step includes
As a search result list information adjustment process, a display mode change process for only data corresponding to display data identification information stored in the browsing time information is executed, and the search result list subjected to the change process is displayed on the display device. The information processing method according to claim 9, wherein the information processing method is a step of generating as output data. The display data generation step includes
As a search result list information adjustment process, a process for selecting only data corresponding to display data identification information stored in the browsing time information is executed, and a search result list including only selected information is output to the display device. The information processing method according to claim 9, wherein the information processing method is a step of generating the data. A computer program that executes display data generation processing of search result list information,
A gazing point position history information generating step for acquiring biometric information of the user and generating gazing point position history information as time correspondence information of the gazing point position corresponding to the user gaze position on the display device;
A display data history information generating step for generating display data history information as history information of display data to be displayed on the display device;
Based on the gazing point position history information and the display data history information, the display data identification information displayed on the display device and the viewing time information corresponding to the user viewing time information corresponding to the display data are generated. Browsing time information generation step,
Display that executes adjustment processing of search result list information acquired as a result of search processing for a search target based on the browsing time information, and generates a search result list subjected to adjustment processing as output data for the display device A data generation step;
A computer program characterized by comprising:

Images