JP2014215911A - Interest area estimation device, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To specify a selection range while securing freedom in range designation.SOLUTION: An interest area estimation device according to the present embodiment includes a first acquisition unit, a second acquisition unit, a conversion unit, and an estimation unit. The first acquisition unit acquires a document composed of a plurality of elements. The second acquisition unit accepts input of a stroke to the document displayed on a screen and obtains a sampling point of the stroke represented by a coordinate value on the screen. The conversion unit converts the sampling point into a correspondence point indicating a position in the document corresponding to a portion displayed on the screen or an element in the document including the position. The estimation unit estimates, from the element, an area of interest in accordance with the correspondence point, which is an area in which a user has interest.

Description

  Embodiments described herein relate generally to a region-of-interest estimation apparatus, method, and program.

  2. Description of the Related Art Handwritten character input methods using pen input or the like have been widely used for electronic devices. Not only PDA (Personal Digital Assistant: portable information terminal) but also smartphones, tablet-type terminals, and devices with pen input functions are increasing with the spread of game machines.

  In such an environment, there is a method of designating an area by underlining a user's attention in a document by hand-drawing or underlining. This is more flexible than selecting a character string by dragging the start point and end point of a character string with a mouse that has been used in the past, and allows the user to specify an area that the user is more intuitively interested in. .

JP 2006-85695 A

  However, when the user's attention area is specified by a handwritten stroke with a pen or the like or a free form of a mouse, the range specified by the stroke is not clear due to the high degree of freedom. It is difficult to do.

  The present disclosure has been made to solve the above-described problem, and an object thereof is to provide a region-of-interest estimation apparatus, method, and program capable of specifying a selection range while ensuring a degree of freedom in range specification. And

  The attention area estimation apparatus according to the present embodiment includes a first acquisition unit, a stroke acquisition unit, a conversion unit, and an estimation unit. The first acquisition unit acquires a document composed of a plurality of elements. The stroke acquisition unit receives an input of a stroke to the document displayed on the screen, and obtains a sampling point of the stroke represented by a coordinate value on the screen. The conversion unit converts the sampling point into a corresponding point indicating a position in the document corresponding to a portion displayed on the screen or an element in the document including the position. The estimation unit estimates a region of interest, which is a region of interest to the user, from the elements according to the corresponding points.

The block diagram which shows the attention area estimation apparatus which concerns on 1st Embodiment. The figure which shows the specific example of the input stroke. The table which shows an example of stroke information. The figure which shows the estimation method of an attention area. The figure which shows another example of the estimation method of an attention area. The figure which shows an example of the detection and estimation process in a character segment estimation part. The flowchart which shows operation | movement of an attention area estimation part. The block diagram which shows the attention area estimation apparatus which concerns on 2nd Embodiment. The figure which shows an example of the correction process in the determination part and an area | region correction part. The figure which shows the example of marking to the beginning of the sentence. The block diagram which shows the attention area estimation apparatus which concerns on 3rd Embodiment. The figure which shows an example of the keyword search in a search part. The figure which shows the example of a display of the document relevant to browsing content.

Hereinafter, an attention area estimation apparatus, method, and program according to the present embodiment will be described in detail with reference to the drawings. Note that, in the following embodiments, the same reference numerals are assigned to the same operations, and duplicate descriptions are omitted as appropriate.
(First embodiment)
The attention area estimation apparatus according to the first embodiment will be described with reference to the block diagram of FIG.
A region of interest estimation apparatus 100 according to the first embodiment includes a browsing information acquisition unit 101, a stroke acquisition unit 102, a position conversion unit 103, and a region of interest estimation unit 104.

  The browsing information acquisition unit 101 acquires a document composed of a plurality of elements, for example, a structured document from the outside. The structured document is an HTML (Hyper Text Markup Language) document, an XML (Extensible Markup Language) document, an EPUB (registered trademark) (Electronic PUBlication) document, or a document created by a document creation application. If the structured document is, for example, an HTML document, it has a plurality of HTML elements described by tags, and these HTML elements are derived from a start tag and an end tag, and a character string (text data) surrounded by them. Composed. In addition, when the structured document is an electronic book, chapters such as chapters, sections and paragraphs are used as elements. In the present embodiment, a Web page having an HTML structure will be described as an example of a structured document browsed by a user. Here, the Web page may include still images and moving images in addition to text information.

The stroke acquisition unit 102 acquires the stroke from the user by sampling the stroke drawn on the display screen at regular intervals to obtain sampling points. Further, stroke information, which is information in which a two-dimensional coordinate value on the screen where the stroke is input and the time when the coordinate value is acquired, is associated from the sampling point is obtained. The stroke information will be described later with reference to FIG.
The stroke input from the user may be, for example, a handwritten stroke input with a pen or a finger on a display screen of a tablet terminal or a smartphone, or may be a stroke drawn freehand by the user operating the mouse.

The position conversion unit 103 acquires a structured document from the browsing information acquisition unit 101 and stroke information from the stroke acquisition unit 102. The position conversion unit 103 converts the sampling points into corresponding points based on the coordinates included in the stroke information. The corresponding point indicates a position in the structured document corresponding to a portion displayed on the screen or an element in the structured document including the position. The conversion process in the position conversion unit 103 may be an existing process for extracting which part of the structured document the image displayed on the screen when displaying the web page on the screen. The detailed description in is omitted.
The attention area estimation unit 104 receives the corresponding points from the position conversion unit 103, and estimates the attention area, which is the area in which the user who has input the stroke is interested, according to the relationship between the elements in the structured document and the corresponding points. .

Next, a specific example of the input stroke will be described with reference to FIG.
The user can designate a range by drawing an underline or enclosing the target character string or range with a line.
For example, as shown in FIG. 2A, if the user is interested in a character string “a terminal that can be handwritten with a pen smoothly,” the underlined character string can be designated. Further, as shown in FIG. 2B, the user may surround a character string “terminal that can be handwritten with a pen with a pen” with a line. By doing in this way, the range of the sentence which a user is interested can be designated.

Next, an example of stroke information obtained by the stroke acquisition unit 102 will be described with reference to FIG.
The stroke acquisition unit 102 obtains an association between the stroke ID 301 and the stroke information 302 including the coordinate value and time as shown in FIG.
The stroke ID 301 indicates a stroke identification number. The stroke information 302 includes a two-dimensional coordinate value of a sampling point and a two-dimensional coordinate value at a certain time interval of the stroke from when the pen or finger touches the screen until the pen or finger leaves the screen. The sampling time. That is, one stroke ID 301 represents one stroke from the start point to the end point of the stroke.
Specifically, for example, stroke ID 301 “1” and stroke information 302 “(x ₁ , x ₁ , t ₁ ), (x ₂ , x ₂ , t ₂ ),. It is stored in a buffer (not shown).

Next, an attention area estimation method in the attention area estimation unit 104 will be described with reference to FIG.
FIG. 4A shows a stroke 401 on a web page displayed on the screen, and a black circle is a sampling point that is a representative point of the stroke. FIG. 4B shows stroke corresponding points 402 on the HTML structure of the web page displayed on the screen.

In the estimation of the attention area, for example, the block area of the element having the largest number of stroke corresponding points 402 included in the elements of the structured document is estimated as the attention area.
Referring to FIG. 4B, the number of corresponding points 402 included in the HTML tag element 403 is compared with the number of corresponding points 402 included in the HTML tag element 404. Since the number of corresponding points 402 included in the element 403 is larger than the number of corresponding points 402 included in the element 404, the element 403 may be estimated as a region of interest to which the user pays attention.

Next, another example of an attention area estimation method in the attention area estimation unit 104 will be described with reference to FIG.
FIG. 5A shows a stroke 501 on a web page displayed on the screen, and a black circle is a sampling point as a representative point of the stroke. FIG. 5B shows stroke corresponding points 502 on the HTML structure of the web page displayed on the screen.

  As shown in FIG. 5A, when the density of adjacent sampling points (corresponding points) of the stroke is high, it indicates that the stroke is slowly drawn. In such a case, the density of sampling points (corresponding points) of the stroke is low, that is, there is a possibility that marking is performed by specifying only the keyword or sentence that the user is interested in, compared to the case where the range is specified quickly. high. Therefore, in such a case, the character string included in the element is estimated as the attention area in units of characters.

Next, the determination of the attention area based on the relationship between the screen display range of the HTML element and the structure of the HTML source will be described with reference to FIG.
FIG. 6 shows an entire page 601 when a Web page is displayed, a screen display range 602, a web page paragraph 603 partially displayed in the display range 602, an attention area 604 surrounded by strokes, and an HTML structure. The relationship with the document (source of the web page) described by using is shown. As a way of attention of the user with respect to the contents of the Web page, there is a first stage as to whether or not it is displayed on the screen in the entire page. Next, there is a second stage whether or not there is a range where the stroke is input in the page displayed on the screen.

  In the screen display range 602 shown in FIG. 6A, the word “IT news” in the page is also displayed on the screen display range 602 at the time when the word “slurry can be written” is surrounded by a stroke with a pen. Since the text is included in the entire page 601 that is not displayed in the paragraph 603, the user does not pay attention.

  On the other hand, since the words “new terminal”, “advertisement”, “character recognition”, and “can be written as slack” are displayed in the display range 602 of the screen, it is understood that they are included in the attention area in the first stage. Further, the word “slurry can be written” is an attention area 604 surrounded by strokes, and is a second stage attention area having a higher priority than the first stage. As described above, the attention area may be estimated by providing the display range and the stage and associating the display range with the priority according to the stage.

Next, the operation of the attention area estimation unit 104 according to the first embodiment will be described with reference to the flowchart of FIG.
In step S701, the browsing information acquisition unit 101 acquires a structured document.
In step S702, the stroke acquisition unit 102 acquires a stroke from the user.
In step S703, the position conversion unit 103 converts the sampling point of the stroke on the screen into a corresponding point in the structured document.

In step S704, the attention area estimation unit 104 determines whether the density of corresponding points is equal to or higher than a threshold value. If the density of the corresponding points is greater than or equal to the threshold, the process proceeds to step S705. If the density of the corresponding points is less than the threshold, the process proceeds to step S706.
In step S705, the character string in the element of the structured document is extracted in character units according to the corresponding points, and is estimated as the attention area.
In step S706, it is determined whether or not the corresponding point is included across a plurality of elements. If the corresponding point extends over a plurality of elements, the process proceeds to step S707. If the corresponding point does not extend over a plurality of elements, that is, falls within one element, the process proceeds to step S708.

In step S707, the character string in the element including the most corresponding points is estimated as the attention area.
In step S708, the character string in the element including the corresponding point is estimated as the attention area. Above, operation | movement of the attention area estimation apparatus which concerns on 1st Embodiment is complete | finished.

  According to the first embodiment described above, the selection range can be selected while ensuring the degree of freedom in range specification by estimating the attention area that the user pays attention to according to the position and density of the input stroke. Can be identified.

(Second Embodiment)
The second embodiment is different from the first embodiment in that the attention area is adjusted according to the newly acquired stroke.
Once the attention area is estimated, it is conceivable that the user inputs a stroke again and rewrites the attention area or deletes a part of the attention area. In such a case, by allowing the attention area to be corrected, the user can specify the selection range more flexibly.

A region of interest estimation apparatus according to the second embodiment will be described with reference to the block diagram of FIG.
A region of interest estimation apparatus 800 according to the second embodiment includes a browsing information acquisition unit 101, a stroke acquisition unit 102, a position conversion unit 103, a region of interest estimation unit 104, a determination unit 801, and a region correction unit 802.
Since the browsing information acquisition unit 101, the stroke acquisition unit 102, the position conversion unit 103, and the attention area estimation unit 104 perform the same operation as the configuration of the attention area estimation device 100 according to the first embodiment, description will be given here. Is omitted.

The determination unit 801 receives the corresponding points from the position conversion unit 103 and determines what processing the user has applied to the attention area. Examples of processing that the user adds to the attention area include addition of another attention area, enlargement of the attention area, and total deletion or partial deletion of the attention area. The determination unit 801 determines the process added by the user according to the position and density of the corresponding points.
The area correction unit 802 receives the determination result from the determination unit 801 and corrects the attention area according to the determination result.

Next, correction processing in the determination unit 801 and the region correction unit 802 will be described with reference to FIG.
FIG. 9 shows the text displayed on the screen and the stroke input by the user. The broken line is the text outside the attention area, the solid line is the text within the attention area, and the elliptical solid line surrounded by the freehand Each stroke is shown.

When the stroke is added, the determination unit 801 determines which process is necessary based on the relationship with the position of the attention area based on the existing stroke according to the type and area of the added stroke.
For example, FIG. 9A shows an example in which another attention area is added to the existing attention area. First, as shown in (a1), the case where the existing attention area is estimated is assumed. Subsequently, as shown in (a2), when a stroke is input to an area away from the existing attention area, it is determined as another attention area. In this case, as shown in (a3), a new attention area is added as in the case where the first stroke is input.

FIG. 9B shows an example of adding a region of interest. First, when an existing attention area is estimated as shown in (b1) and a stroke is entered in an area adjacent to the existing attention area as shown in (b2), a new area including the additional range is newly created. Is set as the attention area. The determination of the overlap of the regions can be made based on, for example, whether or not the point or area that overlaps the smallest rectangle circumscribing the existing stroke is equal to or greater than a threshold value. As a result, the attention area can be expanded as shown in (b3).
In order to clarify that the area has been enlarged, for example, as shown in (b4), the areas included in the largest rectangle inscribed in the two strokes are hidden so that the areas are combined. May be displayed in an easy-to-understand manner.

  FIG. 9C shows an example in which the attention area is reduced by a stroke expressing deletion. When a stroke indicating cancellation with a wavy line or the like is input to the attention area as in (c1), the attention area is reduced as in (c3). As a method of determining that the input is cancellation, a deletion is expressed when a stroke that fills a narrow area in a short time, such as filling, to increase the density of corresponding points. What is necessary is just to determine with the stroke to perform.

  In addition, as a treatment when a part of the attention area is canceled, the priority of the canceled area may be set to the same first level as the display range 602 in FIG. 6 or the same priority as that of the area not displayed on the screen. It may be a degree.

Next, an example of marking at the beginning of a line will be described with reference to FIG.
As shown in FIG. 10, when marking is performed at the beginning of a document, the marked line and the paragraph including the marked line may be estimated as the attention area.
When marking a part of a sentence, a word including a line, a word surrounded by the line, and a sentence including the marked word may be estimated as a region of interest.
Further, in the case where marking is performed on the entire sentence, a sentence with a line and a sentence surrounded by the line may be set as the attention area.

  According to the second embodiment described above, it is possible to estimate the attention area more flexibly by determining what kind of intention the user adds to the added stroke.

(Third embodiment)
The third embodiment is different from the above-described embodiment in that a document including a region of interest is searched using a keyword. By searching for a keyword from the attention area marked by the user, it is possible to provide information in accordance with the user's request.

An attention area estimation apparatus according to a third embodiment will be described with reference to the block diagram of FIG.
An attention area estimation device 1100 according to the third embodiment includes a browsing information acquisition unit 101, a stroke acquisition unit 102, a position conversion unit 103, an attention area estimation unit 104, a determination unit 801, an area correction unit 802, and an attention keyword extraction unit 1101. , An attention area storage unit 1102, a search unit 1103, and a display unit 1104. Note that the attention area estimation device 1100 according to the third embodiment may not include the determination unit 801 and the area correction unit 802.
About the browsing information acquisition part 101, the stroke acquisition part 102, the position conversion part 103, the attention area estimation part 104, the determination part 801, and the area correction part 802, it is the same as that of the structure of the attention area estimation apparatus 100 which concerns on 2nd Embodiment. Since the operation is performed, the description here is omitted.

The attention keyword extraction unit 1101 receives the attention region from the attention region estimation unit 104 and extracts a keyword from a character string included in the attention region. The keyword extraction may be performed using a general keyword extraction method such as a morphological analysis process, a specific expression extraction process, or an extraction process based on matching with a word included in a dictionary registered in advance, and a description thereof is omitted here.
The attention area storage unit 1102 receives and stores the keyword, the element in the structured document corresponding to the attention area, and the element in the structured document corresponding to the display range from the attention keyword extraction unit 1101.

The search unit 1103 receives an input of a search word that is a character string to be searched from the user, searches the keyword stored in the attention area storage unit 1102 for a keyword that matches the search word, The attention area including the keyword is obtained as a search result. A display range in which keywords that match the search word are displayed may be used as the search result.
The display unit 1104 receives a character string, a keyword, and a region of interest to be searched from the search unit 1103, and displays them on the screen according to priority.

When obtaining the search result, the priority of the keyword to be presented to the user is set depending on whether the area including the keyword is the attention area, the display range, or the area other than the attention area and the display range. May be.
For example, referring to FIG. 6, the priority of the keyword included in the attention area 604 is the highest, the priority of the keyword included in the display range 602 is the second highest, and the display is performed outside the attention area and the display range. The priority of the keyword included in the paragraph 603 of the web page partially displayed in the range 602 may be set to the third highest, and the priority of the keyword included in the entire page 601 other than the above may be set to the fourth. .

  In addition, the attention area estimation apparatus 1100 according to the third embodiment does not include the attention area storage unit 1102, but corresponds to the keywords in the external storage device, the elements in the structured document corresponding to the attention area, and the display range. And an element in the structured document to be stored.

Next, an example of a keyword search according to the third embodiment will be described with reference to FIG.
FIG. 12 is an example in which a document including the searched attention area is searched by a keyword. In the present embodiment, the search indicates searching the internal storage of the handwritten tablet terminal or an external web document. In the example of FIG. 12, when searching with the keyword “execution”, the document 1201 and the document 1202 in the attention area where the user has marked the word “execution” are displayed as attention areas as the attention area. In addition, although the marked range is different, a document 1203 including the keyword “execution” is displayed in the attention area of the display screen. That is, in Document 1203, “Twenty years from the date of patent application” is marked in Article 67, Paragraph 1 of the Patent Act, but the word “Implementation” is stated in Article 67, Paragraph 2 of Patent Act in Document 1203. Therefore, as a search result, Patent Law Article 67, Paragraph 1 and Paragraph 2 are displayed together.

  In this way, for example, in learning using a handwritten tablet terminal, a part of a document related to the searched keyword can be displayed together, and the learning efficiency of the user can be improved.

Next, a display example of a document related to browsing contents will be described with reference to FIG.
The example in FIG. 13A shows a case where a document marked with the word “publicly implemented” is being browsed on the document browsing screen. When the user wants to know information related to the contents of the document being browsed, when the related material search button 1301 is pressed, a document having contents related to the currently browsed document is displayed as shown in FIG. Displayed as “Related Materials List”.
Note that a document including “publicly implemented” in the currently viewed document is displayed at the top, but a word related to a keyword in a document that is not marked may be displayed. For example, by scrolling down the scroll bar 1302 on the right side of the “related material list”, documents that are connected to the currently viewed document are sequentially displayed. Thereby, the learning efficiency of the user who uses a tablet terminal including the attention area estimation device can be improved.

  According to the attention area estimation device according to the third embodiment described above, by searching for a keyword from the accumulated attention area, the keyword is presented from the attention area that the user is interested in, Further, since a document of a related region of interest can be presented, the user's items of interest can be expanded, and learning efficiency can be improved in the case of learning.

The instructions shown in the processing procedure shown in the above-described embodiment can be executed based on a program that is software. A general-purpose computer system stores this program in advance and reads this program, so that the same effect as that obtained by the attention area estimation device described above can be obtained. The instructions described in the above-described embodiments are, as programs that can be executed by a computer, magnetic disks (flexible disks, hard disks, etc.), optical disks (CD-ROM, CD-R, CD-RW, DVD-ROM, DVD). ± R, DVD ± RW, Blu-ray (registered trademark) Disc, etc.), semiconductor memory, or a similar recording medium. As long as the recording medium is readable by the computer or the embedded system, the storage format may be any form. If the computer reads the program from the recording medium and causes the CPU to execute instructions described in the program based on the program, the same operation as the attention area estimation device of the above-described embodiment can be realized. . Of course, when the computer acquires or reads the program, it may be acquired or read through a network.
In addition, the OS (operating system), database management software, MW (middleware) such as a network, etc. running on the computer based on the instructions of the program installed in the computer or embedded system from the recording medium implement this embodiment. A part of each process for performing may be executed.
Furthermore, the recording medium in the present embodiment is not limited to a medium independent of a computer or an embedded system, but also includes a recording medium in which a program transmitted via a LAN, the Internet, or the like is downloaded and stored or temporarily stored.
Further, the number of recording media is not limited to one, and when the processing in this embodiment is executed from a plurality of media, it is included in the recording medium in this embodiment, and the configuration of the media may be any configuration.

The computer or the embedded system in the present embodiment is for executing each process in the present embodiment based on a program stored in a recording medium. The computer or the embedded system includes a single device such as a personal computer or a microcomputer. The system may be any configuration such as a system connected to the network.
In addition, the computer in this embodiment is not limited to a personal computer, but includes an arithmetic processing device, a microcomputer, and the like included in an information processing device. ing.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 100,800,1100 ... attention area estimation apparatus, 101 ... browsing information acquisition part, 102 ... stroke acquisition part, 103 ... position conversion part, 104 ... attention area estimation part, 301 ... Stroke ID, 302 ... stroke information, 401,501 ... stroke, 402,502 ... corresponding points, 403,404 ... element, 601 ... entire page, 602 ... display range, 603... Paragraph, 604... Attention area, 801... Determination section, 802... Area correction section, 1101. Search unit, 1104... Display unit, 1201, 1202
1203 ... Document, 1301 ... Related material search button, 1302 ... Scroll bar.

Claims (11)

A first acquisition unit for acquiring a document composed of a plurality of elements;
A second acquisition unit that receives an input of a stroke to the document displayed on the screen and obtains a sampling point of the stroke represented by a coordinate value on the screen;
A conversion unit for converting the sampling point into a corresponding point indicating a position in the document corresponding to a portion displayed on the screen or an element in the document including the position;
An attention area estimation apparatus comprising: an estimation unit that estimates an attention area, which is an area of interest to a user, from the elements according to the corresponding points. The first acquisition unit acquires a structured document including a plurality of elements,
The estimation unit obtains the corresponding point by mapping the coordinate value to a corresponding position in the structured document in the structured document, and sets a block region for each element including the corresponding point as a region of interest. The attention area estimation apparatus according to claim 1, wherein estimation is performed. The second acquisition unit obtains stroke information in which the coordinate value is associated with the time when the coordinate value is acquired,
The estimation unit pays attention to a block region included in an element including the most corresponding points when the input time of the stroke is short and the adjacent density of the sampling points is less than a threshold based on the stroke information. When the stroke input time is long and the adjacent density of the sampling points is greater than or equal to the threshold value, the character string included in the element is estimated as the attention area in units of characters. The attention area estimation apparatus according to claim 1 or 2.   The estimation unit extracts a display range that is a part of the document displayed on the entire screen and the attention area, and weights the attention area to have a higher priority than the display range. The attention area estimation apparatus according to any one of claims 1 to 3, wherein: A determination unit for determining whether the newly acquired stroke is to enlarge the existing attention area, to delete a part or all of the existing attention area, or to be another stroke;
When the newly acquired stroke is to enlarge an existing attention area or to delete a part or all of the existing attention area, a correction unit for correcting the range of the attention area, The attention area estimation apparatus according to any one of claims 1 to 4, further comprising:   6. The method according to claim 1, further comprising a keyword extraction unit that performs morphological analysis and specific expression extraction processing on the character string included in the region of interest, and extracts a keyword. The noted region of interest estimation device. A character string input by the user is used as a search word, and further includes a search unit for searching for a keyword,
If the area from which the keyword that matches the search word is extracted is the attention area, the search unit sets the highest priority for presenting the keyword to the user, and the area from which the keyword is extracted is the display range. If so, the priority is set lower than the attention area, and if the area from which the keyword is extracted is other than the attention area and the display range, the priority is set lower than the display range, The attention area estimation apparatus according to claim 6.   The attention according to claim 4, further comprising a storage unit that stores an element in the document corresponding to the display range and an element in the document corresponding to the attention area. Area estimation device.   8. The element in the document corresponding to the display range and the element in the document corresponding to the attention area are stored in an external storage device. The noted region of interest estimation device. Get a document composed of multiple elements,
Accepting stroke input to the document displayed on the screen, obtaining the sampling point of the stroke represented by the coordinate value on the screen,
Converting the sampling point into a corresponding point indicating a position in the document corresponding to a portion displayed on the screen or an element in the document including the position;
A region-of-interest estimation method, wherein a region of interest, which is a region of interest to a user, is estimated from the elements according to the corresponding points. Computer
Document acquisition means for acquiring a document composed of a plurality of elements;
Stroke acquisition means for accepting an input of a stroke to the document displayed on the screen and obtaining a sampling point of the stroke represented by a coordinate value on the screen;
Conversion means for converting the sampling point into a corresponding point indicating a position in the document corresponding to a portion displayed on the screen or an element in the document including the position;
A region-of-interest estimation program for causing a region of interest, which is a region of interest to a user, to function as an estimation unit that estimates from the element according to the corresponding point.

Images