JP2020052442A - Information processing apparatus and program - Google Patents

Abstract

To provide means for, when there is a user who adds a comment to at least one content among a plural pieces of content formed on paper and a user who views the added comments, letting the user who browses the comment understand what content the comment is for.SOLUTION: An information processing apparatus 10 includes a sheet detection unit 11 that detects a document viewed by a reviewer through a spectacle 40, a line of sight detection unit 13 that detects a line of sight of the reviewer viewing the sheet through the spectacle 40 and a movement of the line of sight, a line of sight analysis unit 14 that detects content the reviewer watches by analyzing the movement of the reviewer, a writing detection unit 15 that detects that the reviewer writes the comment, and an association processing unit 17 that associates content and a comment added to the content in association with each other.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing device and a program.

  When writing a comment on a sheet, it is common practice to write a comment in a margin on the sheet. If there is no margin for writing on the paper, the back side of the paper (original) or another paper is prepared and written.

  By the way, there has been proposed a technique in which a viewing area of a web page is determined from a line of sight and a currently viewed area is highlighted (for example, Patent Document 1).

JP-A-2017-194864

  Among a plurality of contents formed on a sheet, when there is a user who adds a comment to at least one or more contents and a user who views the added comment, for a user who views the comment, It was not possible to know what content the comment was for.

  An information processing apparatus according to the present invention, when a sheet is a sheet to which a comment is to be added, a content position acquisition unit that acquires position information of a plurality of contents formed on the sheet, and a line of sight of a user who views the sheet. Gaze detecting means for detecting a comment, when the user writes a comment, specifying means for specifying, as the content to be commented, a content having a user's gaze before writing the comment, among the plurality of contents, Associating means for associating the target content with the comment, and when the comment is viewed by a viewing user who is a user different from the user and who views the comment, the content associated with the comment is Controlling display so that it can be recognized as comment target content Display control means that, and having a.

  In addition, the specifying means extracts one or a plurality of contents on the sheet as viewed by the user who wrote the comment by moving his / her gaze as a candidate content for comment, and extracts the candidate content for comment from among the extracted candidate content for comment. Before writing a comment, a candidate content for comment that the user has a line of sight is specified as the content for comment.

  Further, when the user looks at the comment candidate content on the sheet after writing the comment and then writes the comment again, the specifying unit treats the comment candidate content as the comment target content.

  Further, the identification means replaces the existing comment target content with the comment target candidate content viewed after the user writes the comment.

  Further, the specifying means adds a comment candidate content viewed after the user writes the comment as a comment target content.

  Further, the display control means causes the user to select the comment target candidate content, and the specifying means specifies one or more comment target candidate contents selected by the user as the comment target content. Features.

  Further, it is characterized by having a receiving means for receiving a comment written on a comment writing sheet.

  Further, when the paper and the comment writing paper are the same paper, the receiving means receives a comment written in a margin of a surface of the paper on which the content is formed.

  Further, when the paper and the comment writing paper are the same paper, the receiving means receives a comment written on a back surface of the paper on which the content is formed.

  Further, when the paper and the comment writing paper are different papers, the receiving means receives the comment written on the comment writing paper.

  Further, the display control means performs display control so that the image of the comment target content is visually recognized in the vicinity of a comment writing position associated by the association means.

  Further, the display control means displays an image of the comment target content on the paper in a display mode different from that of the comment target content.

  Further, the display control unit enlarges and displays an image of the comment target content according to a space on a sheet on which the comment target content is displayed.

  Further, the display control means, when a comment associated with the comment target content by the association means already exists, displays the image of the comment near the position of the comment currently written by the user. I do.

  The information processing apparatus according to the present invention includes: a line-of-sight detection unit configured to detect a line of sight of a user who views a sheet to which a comment is to be added; The identification information of the content, the position information specifying the position of the content on the paper, the identification information of the comment writing paper on which the comment for the content is written, the identification information of the comment, and the comment are generated in association with each other. Acquisition means for acquiring association information, and when the user views the content on the paper, controls the display by referring to the association information so that the content and the comment added to the content are within the field of view. And display control means.

  Further, the display control means displays an image of a comment added to the content on the sheet viewed by the user near the position of the content on the sheet.

  Further, the display control means causes a display to be performed in a margin portion of the paper.

  Further, the display control means displays the content at a position of the content other than the content on the paper.

  Further, the display control means displays an image of the content associated with the comment written on the comment writing paper on a surface of the comment writing paper.

  Further, the display control means enlarges and displays the image of the content in accordance with the size of the area where the comment is not written on the comment writing paper.

  A program according to the present invention provides a computer, when a sheet is a sheet to which a comment is to be added, content position acquisition means for acquiring position information of a plurality of contents formed on the sheet, and a line of sight of a user who views the sheet. Line of sight detecting means for detecting, when the user has written a comment, specifying means for specifying, as the content to be commented, the content of which the user had a line of sight before writing the comment, among the plurality of contents, the content to be commented out Associating means for associating the comment with the comment, and when the comment is browsed by a browsing user who is a user different from the user and browses the comment, the content associated with the comment is the comment target content. I will display that you can recognize Control to display control means, to function as a.

  The program according to the present invention is a program for causing a computer to detect a line of sight of a user who looks at a sheet to which a comment is to be added, and the identification information of the sheet to be a content on the sheet and a comment to be added. The identification information of the content, the position information specifying the position of the content on the paper, the identification information of the comment writing paper on which the comment for the content is written, the identification information of the comment, and the comment are generated in association with each other. Acquisition means for acquiring association information, display for controlling display so that when the user views the content on the paper, the content and the comment added to the content are within the field of view by referring to the association information Function as control means.

  According to the first aspect of the present invention, there are a user who adds a comment to at least one or more of a plurality of contents formed on a sheet and a user who browses the added comment. In such a case, the user who views the comment can be made aware of the content to which the comment belongs.

  According to the second aspect of the present invention, the comment target candidate content and the comment target content can be specified from the movement of the line of sight.

  According to the third aspect of the present invention, it is possible to handle comment candidate content as comment target content.

  According to the invention described in claim 4, it is possible to change the content associated with the comment.

  According to the invention described in claim 5, it is possible to add a content associated with a comment.

  According to the invention described in claim 6, it is possible to allow the user to specify the content to be commented.

  According to the invention described in claim 7, a comment written by a user can be accepted.

  According to the invention described in claim 8, it is possible to associate the comment target content with the comment written in the margin of the sheet.

  According to the ninth aspect of the present invention, the content to be commented and the comment written on the back surface of the sheet can be linked.

  According to the tenth aspect, it is possible to associate a comment target content with a comment written on a sheet different from the sheet on which the comment target content is formed.

  According to the eleventh aspect of the present invention, it is possible to write a comment while visually recognizing the comment target content even when the comment target content and the comment writing position on the sheet are far from each other.

  According to the twelfth aspect, an image of the content to be commented can be displayed in a state that is easy for the user to see.

  According to the thirteenth aspect, an image of the content to be commented can be displayed in a size that is easy for the user to see.

  According to the invention described in claim 14, even when a comment for the content to be commented has already been written at a position distant from the current comment writing position, the comment already written without moving the line of sight is changed. You can write comments while viewing.

  According to the invention described in claim 15, the content and the comment added to the content can be browsed without moving the line of sight so much.

  According to the sixteenth aspect, a comment can be displayed on a sheet viewed by a user.

  According to the seventeenth aspect, a comment can be displayed in a margin of a sheet.

  According to the eighteenth aspect, a comment can be displayed even when there is no space required for display on a sheet.

  According to the nineteenth aspect, the content can be displayed on the comment writing paper on which the comment is written.

  According to the twentieth aspect, the content image can be displayed in a size that is easy for the user to see.

  According to the twenty-first aspect, there are a user who adds a comment to at least one or more contents among a plurality of contents formed on a sheet, and a user who browses the added comment. In such a case, the user who views the comment can be made aware of the content to which the comment belongs.

  According to the invention described in claim 22, the content and the comment added to the content can be browsed without moving the line of sight so much.

FIG. 3 is a block diagram of an information processing apparatus used by a person who reviews a document in the present embodiment. FIG. 2 is a hardware configuration diagram of the information processing apparatus according to the present embodiment. FIG. 3 is a diagram illustrating an example of a document to be reviewed in the present embodiment. FIG. 3B is a diagram showing contents included in the document shown in FIG. 3A. FIG. 4 is a diagram illustrating an example of a data configuration of document information stored in a document information storage unit according to the present embodiment. 6 is a flowchart illustrating a process of associating a content with a comment in the present embodiment. FIG. 3 is a diagram illustrating an example of a document and a separate sheet that a reviewer sees through glasses in the present embodiment. FIG. 9 is a diagram illustrating another example of a document and a separate sheet that a reviewer sees through glasses in the present embodiment. FIG. 9 is a diagram illustrating another example of a document and a separate sheet that a reviewer sees through glasses in the present embodiment. FIG. 9 is a diagram illustrating another example of a document and a separate sheet that a reviewer sees through glasses in the present embodiment. FIG. 9 is a diagram illustrating another example of a document and a separate sheet that a reviewer sees through glasses in the present embodiment. It is a figure showing an example of composition of each contents of an attention spot extracted in this embodiment, and a related candidate. It is a figure showing an example of composition of each contents of a point of interest and a related candidate changed in this embodiment. FIG. 4 is a diagram illustrating an example of a data configuration of comment information stored in a comment information storage unit according to the present embodiment. It is a figure showing composition of a comment written on a separate sheet in this embodiment. FIG. 4 is a diagram illustrating an example of a data configuration of association information stored in an association information storage unit according to the present embodiment. It is a figure which shows an example when the comment target candidate content is displayed on the separate sheet in this embodiment in a selectable manner. It is a figure which shows an example at the time of displaying the comment candidate content in this Embodiment on a separate sheet. FIG. 7 is a diagram illustrating an example of a state in which content is displayed in association with a separate sheet in the present embodiment. FIG. 14 is a diagram illustrating another example of a state in which content is displayed in association with a separate sheet in the present embodiment. FIG. 2 is a block diagram of an information processing apparatus used by a person who reviews reviews on a document in the present embodiment. It is a flowchart which shows the display processing of the comment in this Embodiment.

  Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings.

《Writing a comment by a reviewer》
FIG. 1 is a block diagram showing an embodiment of the information processing apparatus according to the present invention. The information processing apparatus 10 shown in FIG. 1 is an apparatus used by a user who reviews a document (hereinafter, “reviewer”).

  FIG. 2 is a hardware configuration diagram of a computer forming the information processing apparatus 10 according to the present embodiment. The information processing apparatus 10 according to the present embodiment has a configuration in which glasses 40 are connected to a conventional general-purpose hardware configuration such as a personal computer (PC). That is, the information processing apparatus 10 connects the CPU 31, the ROM 32, the RAM 33, the hard disk drive (HDD) 34, the mouse 35 and the keyboard 36 provided as input means, and the display 37 provided as display means shown in FIG. An input / output controller 38, a network controller 39 provided as communication means, and a glasses controller 41 for performing input / output control on glasses 40 are connected to an internal bus 42.

  The glasses 40 have a function of detecting the movement of the user's line of sight by always detecting the line of sight of the wearing user, that is, which position the user is looking at in cooperation with the glass controller 41. Also. A transparent display screen is mounted on the lens portion of the glasses 40. By displaying the image on the display screen, the glasses controller 41 can present the image to the user as if the user views through the lens portion of the glasses 40, for example, as if the image is being displayed on paper.

  FIG. 3A is a diagram illustrating an example of a document to be reviewed in the present embodiment. Although not shown, the document is provided with a document ID code and a tag capable of specifying paper identification information (hereinafter, “document ID”) for identifying the document. As the document ID code, for example, a data code such as a QR code (registered trademark) or a bar code may be used. Tags are attached to, for example, four corners of the document to detect the position of the document within the field of view.

  FIG. 3B is a diagram showing contents included in the document shown in FIG. 3A. In FIG. 3B, the content is shown by being surrounded by a broken line. The “content” is a document, an image, or the like described in a manuscript, and in the present embodiment, is a target to which a comment is added. The "comment" is an opinion or opinion on the manuscript, but in the present embodiment, a comment is attached to the content included in the manuscript. That is, the comment is associated with one of the contents, and is managed in association with the content. The comment may be described in a document or may be expressed by another method such as a drawing.

  For a portion of the document where the document is described, the content is formed, for example, for each paragraph. Further, for example, a series of documents may be divided where the form of characters such as fonts, character sizes, and bold characters change, or where labels (headings) are considered, to form content for each division unit. Similarly, in the drawings, the content may be divided for each type of drawing and each type of graph. The formation of the content itself may utilize a conventional technology.

  Returning to FIG. 1, the information processing apparatus 10 according to the present embodiment includes a paper detection unit 11, a paper analysis unit 12, a visual line detection unit 13, a visual line analysis unit 14, a write detection unit 15, a comment information generation unit 16, an association process It has a unit 17, a display control unit 18, a correction processing unit 19, a document information storage unit 21, a line-of-sight holding unit 22, a comment information storage unit 23, and an association information storage unit 24. Note that components not used in the description of the present embodiment are omitted from the drawings. The paper detection unit 11 detects the paper that the user is looking through the glasses 40. When the sheet detected by the sheet detection unit 11 is a document that has not been reviewed in the past, the sheet analysis unit 12 analyzes the document to generate document information for the document. The line-of-sight detection unit 13 detects the line-of-sight and the line-of-sight movement of the user who views the paper through the glasses 40. The information specifying the position of the user to be detected is stored in the line-of-sight holding unit 22, and the line-of-sight analyzing unit 14 analyzes the movement of the user's line of sight held in the line-of-sight holding unit 22, and thereby the user's line of sight is viewed. Detecting content The write detection unit 15 detects that the reviewer is writing a comment. The comment information generation unit 16 generates comment information for the entered comment. The association processing unit 17 associates a content with a comment written by a reviewer on the content. When the comment is browsed by a user who browses the comment written by the reviewer (hereinafter, “review”), the display control unit 18 associates the content associated with the comment with the comment by the association processing unit 17. The display control on the display screen of the glasses 40 is performed so that the display can be recognized as the content being displayed. The association processing unit 17 generates association information by associating the content with the comment. The modification processing unit 19 has a function of modifying the association information generated by the association processing unit 17.

  The data configuration of each of the storage units 21 to 24 will be described as necessary together with the description of the operation.

  Each of the components 11 to 19 in the information processing device 10 is realized by a cooperative operation of a computer that forms the information processing device 10 and a program that runs on a CPU 31 mounted on the computer. Each of the storage units 21 to 24 is realized by the HDD 34 mounted on the information processing apparatus 10. Alternatively, the RAM 33 or an external storage means may be used via a network.

  In addition, the program used in the present embodiment can be provided not only by communication means but also stored in a computer-readable recording medium such as a CD-ROM or a USB memory. The program provided from the communication means or the recording medium is installed in the computer, and various processes are realized by the CPU 31 of the computer sequentially executing the program.

  Next, the operation in the present embodiment will be described. First, the process of detecting a document created by the reviewer and a sheet (hereinafter, referred to as “separate sheet”) in which a comment is to be written will be described.

  The reviewer puts on the glasses 40 when starting the review. The reviewer keeps wearing the glasses 40 until the generation of the association information described later is completed. Also, it is necessary to wear glasses 40 when correcting the generated association information. That is, the reviewer needs to wear the glasses 40 when performing the review.

  While the reviewer wears the glasses 40, the gaze detection unit 13 detects the view point of the reviewer, that is, the gaze, and stores the gaze in the gaze holding unit 22 unless otherwise specified. The configuration and format of the data stored in the line-of-sight storage unit 22 need not be particularly limited. In FIG. 6, the movement of the line of sight on the document is indicated by a broken line. However, the line of sight analysis unit 14 shows the position of the document in the field of view and the information held in the line of sight holding unit 22 by analyzing the information. Detects gaze movement.

  The reviewer first places the manuscript to be reviewed in the field of view. As a result, the paper detection unit 11 detects the document by detecting the document ID code and tag of the document viewed through the glasses 40. The paper detection unit 11 always specifies the position of the document in the field of view by detecting the position of the tag.

  When a document is detected, the paper analysis unit 12 generates document information for the document if the document information corresponding to the document ID obtained by decoding the document ID code is not registered in the document information storage unit 21. I do. The case where the document information is not registered in the document information storage unit 21 is a document which has not been subject to review in the past. Note that when the reviewer once removes the original from the field of view and then returns the original, original information has already been generated.

  FIG. 4 is a diagram illustrating an example of a data configuration of document information stored in document information storage unit 21 according to the present embodiment. The document information is generated for each document by associating the content information with the document ID of the document. The content information is information on each content included in the document, and includes a content ID, position information, and content. The content ID is identification information for identifying the content. The position information is information indicating the position of the content on the document. For example, the coordinates may be represented by coordinate information based on a certain point on the document. Although the content is the content itself, in the present embodiment, the content is stored as image information regardless of the type of the content (text, figure, etc.).

  The paper analysis unit 12 analyzes the image of the document to extract contents included in the document, assigns a content ID to each content, and detects position information for specifying a region of the content on the document. Also, image information of each content is extracted from the image of the document. The paper analysis unit 12 generates document information from the information thus extracted and stores the document information in the document information storage unit 21.

  In the present embodiment, the paper analyzing unit 12 analyzes the image of the original to generate the original information. For example, when the original is generated, the original information is generated in advance, and the paper analyzing unit 12 generates the original information. May obtain the generated document information and store it in the document information storage unit 21. A manuscript may include a drawing and a document describing the drawing.For example, if the reviewer generates manuscript information in advance, for example, a drawing and a drawing that can be specified from the semantic content of the document may be included. It is possible to include relationship information indicating the relationship with the document in the document information. As described above, if the document information is generated in advance, it is possible to include the above-described related information and the like that cannot be obtained by analyzing the image of the document by the sheet analysis unit 12 in the document information.

  Further, not only information about contents but also information about margins may be acquired and stored in the document information storage unit 21. If there is a margin in the document, the reviewer may write in the margin. Therefore, as in the case of the content, the paper analysis unit 12 extracts, as a blank, a blank portion that is an area having a size equal to or larger than a predetermined threshold from the blank portion (a portion other than the content on the document). As in the case of the content, identification information (hereinafter, “margin ID”) is allocated to the margin, and position information for specifying the margin area on the document is detected and stored in the document information. Of course, the information to be stored may be information that can be discriminated as a margin instead of content, for example, flag information, and it is necessary to be able to discriminate the content by applying a setting rule different from the content ID to the margin ID.

  When the reviewer sees a document whose document ID is registered in the document information storage unit 21, the process of generating document information may be omitted. Of course, in consideration of the case where the reviewer reviews the document whose layout has been changed in accordance with the result of the review, the paper analyzing unit 12 may analyze the image of the document each time to generate document information. In this case, the original information is updated by overwriting the original information.

  In addition, the reviewer prepares in advance a sheet (hereinafter, referred to as “separate sheet”) different from the manuscript in order to write some comment on the manuscript so that the manuscript is included in the field of view. For convenience of explanation, it is assumed that the separate sheet is provided with a separate sheet ID code and a tag capable of specifying the identification information (hereinafter, “separate sheet ID”) of the sheet for identifying the separate sheet, as in the case of the original. Here, a blank sheet is used as a separate sheet.

  The paper detection unit 11 detects a separate sheet by detecting a separate sheet ID code and a tag of the separate sheet that can be seen through the glasses 40. The paper detection unit 11 always specifies the position of the separate sheet in the field of view by detecting the position of the tag.

  The sheet analysis unit 12 determines that the sheet is a separate sheet from the separate sheet ID acquired by decoding the separate sheet ID code. For example, a separate sheet ID generated according to a setting rule for determining a separate sheet is allocated. Alternatively, it may be determined that the document is a separate sheet because it is different from the setting rule of the document ID, or may be determined by analyzing an image of the separate sheet.

  FIG. 5 is a flowchart illustrating a process in which a reviewer associates a content with a comment described for the content in the present embodiment. 6A to 6E are diagrams illustrating a document and a separate sheet that the reviewer sees through the glasses 40. FIG. Hereinafter, a process of associating a content with a comment will be described with reference to these drawings.

  The reviewer may write a comment on the margin of the front side of the document (the surface on which the content is written) or on the back side of the document in addition to the separate sheet prepared in advance as described above. This will be described by taking a case where a comment is described as an example. In addition, it is assumed that there is one document (one page document having content only on the front side) and one separate sheet is prepared.

  Reviewers view the manuscript for review. The gaze detection unit 13 starts recording the movement of the gaze to the gaze holding unit 22 when recognizing that the reviewer is looking at the original from the position of the document detected by the paper detection unit 11 and the position of the gaze detected. (Step 101). 6A to 6E, the movement of the line of sight on the document is indicated by a broken line. In the example of FIG. 6A, the line of sight is moved from the first (upper left) portion of the document to the current arrow. Is shown. The gaze detection unit 13 continues recording on the gaze holding unit 22 while the gaze of the reviewer does not deviate from the document (N in step 102). Then, it is assumed that the reviewer moves his / her line of sight to the position of the arrow on the document and then moves his / her line of sight on a separate sheet to add a comment. The gaze detection unit 13 stops recording on the gaze holding unit 22 when detecting that the gaze of the reviewer has deviated from the document (Y in Step 102) (Step 103).

  When the recording in the line-of-sight holding unit 22 is stopped, the line-of-sight analyzing unit 14 analyzes the movement of the line of sight recorded in the line-of-sight holding unit 22, and extracts the content viewed by the reviewer as the comment candidate content. According to the example of FIG. 6A, the contents 51, 52, and 53 correspond to the comment candidate contents. Then, from among the comment target candidate contents, the comment target candidate content, that is, the content 53, which is viewed immediately before the line of sight from the content on the document is identified, is specified as the comment target content (point of interest). , 52 as related candidates (step 104).

  FIG. 7 shows the content extracted by this processing. The notable portion is a content that is assumed to have been noticed by the reviewer as a comment target, that is, a comment target content. Specifically, the content 52 is classified. Related candidates include content that is not presumed to be the commenter's attention as a comment target, but is a content that can be a comment target content because the reviewer has seen (passed the line of sight) in a series of line-of-sight movements. This is a comment candidate content that has not been extracted as a content, and specifically, the contents 51 and 53 are classified.

  The reviewer gazes at the attachment to make a comment and writes the comment. The situation at this time is shown in FIG. 6B.

  The write detection unit 15 detects that the reviewer is writing a comment on a separate sheet. A known technique may be used for the presence or absence of writing and the writing position. For example, any method may be used, such as using a pen for detecting pen pressure, measuring the distance between a separate sheet and the pen tip, and the like.

  Assume that the reviewer once returned his gaze to the manuscript while writing a comment on a separate sheet. The situation at this time is shown in FIG. 6C. While the line of sight of the reviewer does not deviate from the separate sheet (N in step 105), the line of sight detection unit 13 determines that the reviewer is writing a comment on the separate sheet. Then, the reviewer removes his / her line of sight from the attached sheet (Y in step 105), and assuming that the return of this line of sight is not the point of interest (content 52) but a related candidate (content 53) as illustrated in FIG. 6C, the reviewer comments It is inferred that the content 53 is the content 53, and the content 53 is changed to the point of interest. The content 52 that was the attention point may be left as the attention point. In this case, the content 53 is added to the point of interest. However, here, the content 52 is changed to a related candidate so that the comment corresponds to one content. FIG. 8 shows an example in which the target portion and the related candidates are exchanged in this way. In addition, when the destination to which the line of sight is returned is the attention point (content 52), the comment target content is maintained as the content 52.

  In addition, since the line of sight is once removed from the separate sheet, the comment written before the removal is handled as one comment (content). For this purpose, when detecting that the line of sight has been removed from the separate sheet, the comment information generating section 16 generates comment information for the comment written on the separate sheet (step 106) and registers it in the comment information storage section 23.

  FIG. 9 is a diagram illustrating an example of a data configuration of comment information stored in comment information storage unit 23 according to the present embodiment. The comment information is generated for each comment. The comment information includes a document ID, a noted portion, a related candidate, and detailed comment information. The document ID is a document ID of a document including a content to which a comment is added. The content ID of the content to be commented (the content 53 after replacement in this example) is set in the noted portion. In the related candidate, the content ID of the comment target candidate content (contents 51 and 52 in this example) other than the noted portion is set. The comment detailed information is detailed information related to the comment, and includes a sheet ID, a comment ID, position information, and a comment. As the sheet ID, a sheet ID (separate sheet ID) of a sheet (separate sheet in this example) in which the comment is written is set. The comment ID is identification information for identifying a comment assigned to the comment by the comment information generation unit 16. The position information is information indicating the position of the comment on the separate sheet. For example, the coordinate information may be represented by using a certain point on a separate sheet as a reference. The comment is the comment itself, but in the present embodiment, the comment is stored as image information regardless of the type of the comment (text, figure, etc.).

  The comment information generation unit 16 generates comment information having the above data configuration for the comment entered when detecting that the line of sight has been removed from the attached sheet as described above.

  When the reviewer returns the line of sight to the original, the line of sight detection unit 13 starts recording the movement of the line of sight in the line of sight line holding unit 22 (step 107). The line-of-sight detection unit 13 continues recording on the line-of-sight holding unit 22 while the line of sight of the reviewer does not deviate from the document (N in step 108). Then, it is assumed that the reviewer moves his / her line of sight to the position of the arrow on the document as shown in FIG. 6C, and then moves his / her line of sight to separate comments. The gaze detection unit 13 stops recording on the gaze holding unit 22 when detecting that the gaze of the reviewer has deviated from the document (Y in Step 108) (Step 109).

  When the recording in the line-of-sight holding unit 22 is stopped, the line-of-sight analysis unit 14 analyzes the line-of-sight movement recorded in the line-of-sight holding unit 22 and extracts the content viewed by the reviewer. Here, the contents to be extracted are the contents 52 and 53 as illustrated in FIG. 6C, and overlap the contents 51, 52 and 53 when the document was viewed immediately before. In the present embodiment, it is determined whether or not the entry of the comment in the content to be commented is completed based on the attention ratio to the content. The “attention ratio” refers to the ratio of the content viewed immediately before on the manuscript and the content viewed on the manuscript this time, as described above, and the composition of the contents viewed this time or immediately before or the content is viewed. Expressed as a ratio such as time. Focusing on the structure of the contents, since the contents 52 and 53 viewed this time are 100% included in the contents 51, 52 and 53 previously viewed on the manuscript, the comment on the noted portion (content to be commented) continues. Guess that it will be filled out.

  In other words, it can be inferred that the reviewer moved his / her gaze from a separate sheet to the document in order to confirm the content of the content while writing the comment. In this case (N in step 110), the process returns to step 105. The reviewer then writes a new comment on a separate sheet. This is shown in FIG. 6D.

  Thereafter, when the line of sight is removed from the attached sheet, the comment information generating unit 16 generates comment information for the newly entered comment (step 106). As shown by broken lines in FIG. 10, the comments 55 and 56 are generated as one comment each time the line of sight deviates from the separate sheet. If there is no change in the point of interest (content 53), a plurality of comments are associated with one content 53.

  Assume that the reviewer returns his / her gaze to the document and then moves his / her gaze as shown in FIG. 6E. According to this example, after viewing the previous comment target candidate contents 52 and 53, the reviewer moves his / her gaze to a different content 54, and after that, it is understood that the reviewer takes time to look at the content 54. This means that after checking the content 53 corresponding to the comment, the review target has been advanced to the next content 54. In consideration of the attention ratio described above, the content has a long ratio of the time of viewing the different content 54, although the content 52 and 53 overlap the previous content. Therefore, it is assumed that the reviewer has moved the attention destination (review target) to the content 54. In addition, when the reviewer turns his / her eyes directly to the different contents 54 without turning to the contents 51 to 53, it can be determined that the review target has been moved to the content 54 without any problem.

  As described above, when it can be inferred that the reviewer has focused on different contents (Y in step 110), the association processing unit 17 generates related information for linking the contents with the comments (step 111).

  FIG. 11 is a diagram illustrating an example of a data configuration of association information stored in the association information storage unit 24 according to the present embodiment. The association information includes, in association with the document ID, content information on content to which a comment is attached and comment information on a comment to be attached to the content. In the content information, the content ID is set to the content to which the comment is attached, that is, the content ID of the content corresponding to the noted portion. The position information is position information of the content, and the content is image information of the content. These may be set by reading from the document information of the document stored in the document information storage unit 21. In the comment information, a separate sheet ID of the separate sheet in which the comment is written is set as the sheet ID. The comment ID, the position information, and the comment may be set by reading from the comment detailed information of the comment stored in the comment information storage unit 23.

  In the case of the above example, content information corresponding to one or a plurality of contents is set for one document (document ID). Further, comment information corresponding to one or a plurality of comments is set for one piece of content information.

  According to the present embodiment, by detecting the movement of the line of sight of the reviewer, the content to be commented can be associated with the comment attached to the content. In the above processing, one or more comments are linked to one content. However, as described above, instead of using the content 53 which is a related candidate in accordance with the movement of the line of sight of the reviewer, the content 53 of the related candidate is set as the noted location. 52 and 53 may be set as noticed portions. That is, in this case, a plurality of contents 52 and 53 are linked to one comment. In this manner, the content and the comment may be in a many-to-one relationship instead of a one-to-many relationship.

  In the above description, for convenience of explanation, a case has been described in which a document to be reviewed and one separate sheet are prepared in advance as a comment writing sheet for the document. However, there may be cases where the amount of comments increases and a plurality of separate sheets are required. Even in this case, in the present embodiment, it is possible to cope with the above configuration by assigning the sheet ID to each separate sheet.

  It is also conceivable to write a comment on the back side of the manuscript without preparing a separate sheet. In this case, the back side of the original is used as a comment writing sheet, but by assigning a paper ID different from the front side of the original on which the content is described to the back side of the original, the same as the separate sheet described above. Can be processed.

  Further, when there is a margin on the front side of the document for writing a comment, the same processing as when a separate sheet is prepared can be performed by simply using the sheet ID of the front side of the document instead of the separate sheet ID. In this case, the surface of the document is used as a comment writing sheet. However, in the above description, recording is stopped when the line of sight is removed from the original.However, in the case of using a margin, the line of sight does not deviate from the original. It must be processed to stop.

  Regardless of which comment is entered, the write detector 15 detects that the reviewer is writing a comment and accepts the detected comment.

  Note that a case may be considered in which one separate sheet is used in common for a plurality of documents, but this case can be dealt with by performing the same processing as described above. However, it is necessary to set and register the document ID in the comment information in association with the comment ID as shown in FIG.

  By the way, in the above description, the content and the comment are linked by the movement of the line of sight, but it is not always possible to link correctly. Therefore, in the present embodiment, the correction processing unit 19 is provided so that the generated association information can be corrected. This correction processing will be described with reference to FIG.

  FIG. 12 is a diagram illustrating an example of a case where the comment target candidate content is displayed on a separate sheet. When the reviewer performs a predetermined operation such as pointing to the content with a pen or adding a circle around the content (surrounding) after the related information is generated, the correction processing unit 19 Then, the content IDs of the comment target candidate contents 51 to 53 are extracted from the related candidates, and the image information of the content corresponding to the content ID is read from the document information storage unit 21. Note that a comment to be linked may be specified on a separate sheet, and a noted portion and a related candidate linked to the specified comment may be extracted.

  The display control unit 18 causes the glasses 40 to display the image information of the content read in response to the instruction from the correction processing unit 19. By being displayed on the glasses 40, the reviewer looks as if the contents 51 to 53 are being displayed on a sheet such as a separate sheet being viewed. The reviewer selects one or a plurality of contents to be linked from the displayed contents 51 to 53 by performing a predetermined selection operation such as pointing with a pen. Upon receiving the selected content, the correction processing unit 19 updates the content ID of the related information with the content ID of the content. In accordance with this update, the location information and the content included in the content information of the related information are also updated.

  For simplification of the description, it has been described that the paper used in the present embodiment is provided with a tag for defining the paper ID and the size (area) of the paper, respectively. Even if it is attached, it is not necessary to attach a physical object, and a tag may be printed. Also, it is not always necessary to limit the method to using tags. For example, using a sheet of a color different from the color of the table, the sheet may be identified by determining the color. Further, the reviewer may specify whether the paper in the field of view is an original or a separate paper.

  Next, a function provided by the present embodiment for supporting review by a reviewer will be described. Note that, as described above, the display control unit 18 displays the image of the content on the transparent display screen provided on the glasses 40, so that the reviewer can read the image as if the user passed through the glasses 40, for example, It looks as if the content is displayed above. As described above, the image is displayed on the display screen of the glasses 40. In the following description, for the sake of convenience, the display control unit 18 controls the display on the glasses 40 by displaying the image on a separate sheet. Is omitted.

  In the above description, the case where a comment is written on a separate sheet has been described as an example. In the case of a separate sheet, if it is placed side by side with the document, the comment can be written on the separate sheet while viewing the content on the document. However, comments may be entered on the back of the manuscript. In this case, the reviewer needs to interrupt the entry of the comment and turn over the manuscript in order to view the content when the comment is entered on the back side. Then, while checking the content, it is not possible to enter a comment.

  Therefore, the display control unit 18 according to the present embodiment reads the image of the candidate content for comment from the document information storage unit 21 and sends the image to the glasses 40 so that the content is displayed in the space on the back side where the comment is not written. Control the display. The state of this display is shown in FIG. FIG. 13 shows an example in which images of comment target candidate contents 51 to 53 are displayed on the back side of the document. Thus, the reviewer can write a comment while checking the comment target candidate contents 51 to 53 without turning over the original and looking at the surface of the original. Here, the comment target candidate content is set as the display target, but only the comment target content (attention point) may be set as the display target due to the display space or the like. As described above, the display control unit 18 controls the display so that the image of the comment target candidate content is visually recognized near the writing position of the linked comment.

  In the above description, a case has been described as an example in which a comment is entered on the back side of a document. However, display control may be similarly performed on a separate sheet so that the content is displayed on the separate sheet. If the content is displayed on a separate sheet, the reviewer does not need to return his / her gaze to the document to confirm the content.

  Also, the content need not necessarily be displayed on paper. It may be displayed at a position closer to a separate sheet than the original.

  When the content is displayed on the back of the document or on a separate sheet, the comment target candidate content cannot always be displayed in the same form as the document on an empty space of the sheet (an area where no comment is entered). Therefore, in the present embodiment, the display mode of the image of the content can be displayed in a display mode different from that of the original (original).

  FIG. 14 is a diagram illustrating an example of display of a content image. As shown in FIG. 14, when a comment has already been written on the separate sheet and the content on the document cannot be displayed in its original form, the content may be displayed three-dimensionally as shown in FIG. As described above, the display mode of the content may be controlled according to the free space of the separate sheet. Here, the case of displaying three-dimensionally is described as an example, but the present invention is not limited to this. For example, the content may be enlarged or reduced according to the free space of the separate sheet and displayed. The reduced display makes it easier to secure a display space for the content. On the other hand, if the display space can be secured, the display may be enlarged. Enlarged display makes the content easier to see.

  FIG. 15 is a diagram illustrating an example of display of a document and a separate sheet. As described above, the comment 58 can be written in the margin of the document corresponding to the content 57 of the document. However, although the comment is written in the margin, there is no space for further writing the comment on the manuscript, and the continuation of the comment may be written on a separate sheet. In this case, it is convenient to display the comment 58 written in the margin together with the content 57 on a separate sheet. In this way, the subsequent comment can be entered on a separate sheet with reference to the comment 58 that has been entered. Note that the display control unit 18 can display information on the content 57 to be commented on the separate sheet by acquiring the information on the comment 58 written in the margin or the comment information from the document information.

  Here, the description has been given by taking the comment entered in the margin as an example, but the comment entered on the back side of the document may be displayed on a separate sheet. Conversely, when a comment is written on the back of the document, a comment written on a margin or a separate sheet may be displayed on the back of the document. As described above, when the comment linked to the comment target content already exists, the display control unit 18 controls the display so that the image of the comment is displayed near the position where the user writes the comment.

  As described above, one comment can be linked to a plurality of contents. For example, as described with reference to FIG. 12, the reviewer may specify a plurality of contents. However, instead of the reviewer arbitrarily designating a plurality of contents, a plurality of contents may be automatically selected according to the relationship between the contents and a comment may be linked thereto.

  For example, when a figure number is described in the content of the document, the content of the document is considered to be a description of the drawing corresponding to the figure number. That is, it is considered that the content of the document and the content of the drawing have some relationship. When the content of the document is the content to be commented, the comment information generation unit 16 also extracts the content of the drawing related to the content of the document as the content to be commented. Alternatively, when the document information is prepared in advance and the related information of the content is included therein, the information may be referred to.

<< Viewing comments by reviewer >>
The review of the manuscript by the reviewer is as described above. Next, a process for browsing comments by a reviewer will be described.

  FIG. 16 is a block diagram showing an embodiment of the information processing apparatus according to the present invention. Note that the hardware configuration of the information processing device 60 may be the same as that in FIG. The information processing device 60 used by the reviewer has a paper detection unit 61, an association information specifying unit 62, a line-of-sight detection unit 63, a line-of-sight analysis unit 64, a display control unit 65, a line-of-sight holding unit 66, and an association information storage unit 67. ing. Note that components not used in the description of the present embodiment are omitted from the drawings. The paper detection unit 61 has the same processing function as the paper detection unit 11 described above, and detects the paper that the user is looking through the glasses 40. The association information specifying unit 62 specifies the association information corresponding to the document by analyzing the document detected by the sheet detection unit 61. The line-of-sight detection unit 63 has the same processing function as the line-of-sight detection unit 13 described above, and detects the line-of-sight and the line-of-sight movement of the user who views the paper through the glasses 40. The information for specifying the detected user's viewing position is stored in the line-of-sight storage unit 66. The line-of-sight analysis unit 64 has the same processing function as the line-of-sight analysis unit 14 described above, and detects content viewed by the user by analyzing the movement of the user's line of sight held in the line-of-sight holding unit 66. . The display control unit 65 controls the display of the glasses 40 on the display screen in the same manner as the display control unit 18 described above.

  The line-of-sight holding unit 66 and the association information storage unit 67 may be the same as the line-of-sight holding unit 22 and the association information storage unit 24 described above. The association information storage unit 67 is generated by acquiring and storing the association information generated by the information processing device 10.

  Each of the components 61 to 65 in the information processing device 60 is realized by a cooperative operation of a computer forming the information processing device 60 and a program operated by the CPU 31 mounted on the computer. Each of the storage units 66 and 67 is realized by the HDD 34 mounted on the information processing device 60. Alternatively, the RAM 33 or an external storage means may be used via a network.

  Next, a comment display process according to the present embodiment will be described with reference to a flowchart shown in FIG.

  The reviewer returns the manuscript to the reviewer after completing the review. Upon receiving the manuscript, the reviewer wears glasses 40 when confirming the comment. The reviewer will continue to wear glasses 40 while checking the comment. While the reviewer wears the glasses 40, the gaze detection unit 63 detects the viewing destination of the reviewer, that is, the gaze and the movement thereof, and stores the gaze in the gaze holding unit 66 unless otherwise specified. The configuration and format of the data stored in the line-of-sight storage unit 66 need not be particularly limited.

  Reviewer places the returned manuscript in view. As a result, the paper detection unit 61 detects the document by detecting the document ID code and tag of the document viewed through the glasses 40 (step 121). The paper detecting unit 61 always specifies the position of the document in the field of view by detecting the position of the tag.

  When a document is detected, the association information specifying unit 62 obtains the document ID by decoding the document ID code on the document, and searches the association information storage unit 67 with the obtained document ID to retrieve the association information. It is specified (Step 122). Then, the line-of-sight analysis unit 64 specifies the content on the document that the reviewer is watching by analyzing the line-of-sight movement recorded in the line-of-sight holding unit 22 (step 123). When the content is specified, the display control unit 65 acquires the association information identified by the association information identification unit 62, and acquires comment information corresponding to the content in the association information (Step 124). Then, the comment image is displayed on the display screen of the glasses 40 as follows (step 125). By displaying the comment image on the display screen of the glasses 40, the reviewer can see the comment image at a position described below on the document.

  First, the display control unit 65 displays an image of a comment added to the content watched by the reviewer near the position of the content on the document. This allows the reviewer to see the comment from the content without moving the gaze too much. That is, the “nearby” here is a position where the reviewer can see the comment from the content without moving his or her eyes so much. However, the positional relationship between the content and the comment cannot be specifically indicated by the physical distance. This is because it depends on the distance between the manuscript and the eyes of the reviewer. Therefore, it may be determined based on the magnitude relationship between the angle between the line of sight to the content and the line of sight to the comment and the predetermined threshold whether or not the object is in the vicinity. In the case of a document described in two columns illustrated in FIG. 3A, the vicinity of the content on the left side of the paper is considered to be the left half. However, if the content on the left side of the page is the content on the right side, the right half may be included in the vicinity of the content.

  First, if there is a margin for displaying a comment near the position of the content on the document, the display control unit 65 causes the comment to be displayed in the margin. If there is no blank space, the comment is superimposed and displayed on another content at a position close to the content to be displayed. However, if they are simply superimposed, characters and the like may be overlapped, making it difficult to read. Therefore, it is preferable to display comments after white-painting other content, for example.

  As described above, according to the present embodiment, by displaying an image of a comment written by a reviewer on a manuscript, both the content and the comment linked to the content are read by the reviewer on the manuscript. Can be made.

  When the comment is displayed, the reviewer sees the content and the comment. The gaze detection unit 63 detects the movement of the gaze of the reviewer during that time, and the gaze analysis unit 64 sends the comment to the gaze holding unit 22. By analyzing the recorded gaze movement, the content which the reviewer is looking at is specified. If the reviewer sees the same content (N in step 125), while the document is detected in the field of view (N in step 127), it is determined that the reviewer still sees the comment, and the process proceeds to step 126. Return.

  On the other hand, if the gaze analysis unit 64 detects that the reviewer has removed his / her gaze from the content currently being viewed and has shifted his / her gaze to another content (Y in step 126), the gaze analysis unit 64 identifies the other content that the reviewer is looking at. (Step 123). Then, as described above, the display control unit 65 displays a comment image corresponding to the newly viewed content (step 125). When the document is no longer detected in the field of view (Y in step 127), it is determined that the comment check by the reviewer has been completed, and the process is terminated.

  By the way, in the above description, the case where the separate sheet on which the comment is written is not prepared is described, but the reviewer may look at the separate sheet.

  That is, when a separate sheet is detected in the field of view by the sheet detecting section 61, the sheet analyzing section 12 obtains the separate sheet ID by decoding the separate sheet ID code, and stores the associated sheet ID in the association information storage section 67 with the obtained separated sheet ID. Identify association information by searching. Then, the line-of-sight analysis unit 64 specifies the comment on the document that the reviewer is watching by analyzing the line-of-sight movement recorded in the line-of-sight holding unit 22. When the comment is specified, the display control unit 65 acquires the content information corresponding to the comment, and displays the image of the content on the display screen of the glasses 40 as follows. By displaying the content on the display screen of the glasses 40, the reviewer can see the image of the content at a position described below on a separate sheet.

  Regardless of whether the manuscript is in the field of view or not, displaying the image of the content near the comment allows the reviewer to read both the content and the comment linked to the content on a separate sheet. The display control unit 65 displays the image of the content corresponding to the comment watched by the reviewer in the vicinity of the position of the comment on the separate sheet, so that the reviewer can view the content without moving the line of sight from the comment so much. it can.

  As is clear from the above description, the process of displaying the content on the separate sheet may be performed in the same manner as the process of displaying the comment on the document described above. Here, a separate sheet has been described as an example, but the same processing may be performed even when a comment is written on the back side of the document.

  When the content is to be displayed on a separate sheet, the display control unit 65 may display the image of the content in an enlarged or reduced scale according to the size of the area on the separate sheet where no comment is written. The reduced display makes it easier to secure a display space for the content. On the other hand, if the display space can be secured, the display may be enlarged. Enlarged display makes the content easier to see. Alternatively, the content may be displayed three-dimensionally as shown in FIG.

  In the above description, by displaying the comment image on the manuscript even if the commented comment is not in the field of view, or the content image on the separate sheet even if the document is not in the field of view, the reviewer can You do not need to move your gaze too much. Of course, both the original and the separate sheet may be detected in the field of view. In this case, when the reviewer views the content on the document, the display control unit 65 displays the comment associated with the content in a display format different from other comments, and selects the comment from the comments on the separate sheet. You may make it easier to find comments associated with the content. For example, the comment associated with the content may be highlighted, the color may be changed, or a frame surrounding the comment may be displayed. Alternatively, a comment other than the comment associated with the content may be displayed in a light color so as to be inconspicuous.

  Conversely, when the reviewer sees the comment on the separate sheet, the display control unit 65 displays the content associated with the comment in a display mode different from that of the other content, and selects from among the content on the document. Content associated with the comment may be easily found.

  In the present embodiment, by displaying an image on the display screen provided in the lens portion of the glasses 40 for detecting the line of sight, it is as if the image of the content or the comment is displayed near the comment or the content. Display control. However, the display of the image need not be limited to this. For example, an image projection unit may be provided, and the image may be displayed by projecting the image beyond the line of sight.

10, 60 information processing device, 11, 61 paper detection unit, 12 paper analysis unit, 13, 63 line-of-sight detection unit, 14, 64 line-of-sight analysis unit, 15 write detection unit, 16 comment information generation unit, 17 association processing unit, 18, 65 display control unit, 19 correction processing unit, 21 original information storage unit, 22, 66 line-of-sight storage unit, 23 comment information storage unit, 24, 67 association information storage unit, 31 CPU, 32 ROM, 33 RAM, 34 hard disk Drive (HDD), 35 mouse, 36 keyboard, 37 display, 38 input / output controller, 39 network controller, 40 glasses, 41 glasses controller, 42 internal bus, 62 association information specifying unit.

Claims (22)

When the sheet is a sheet to which a comment is to be added, content position acquisition means for acquiring position information of a plurality of contents formed on the sheet,
Line-of-sight detection means for detecting the line of sight of a user looking at the paper,
When the user writes a comment, a specifying unit that specifies, as the comment target content, a content in which the user has a line of sight before writing the comment, among the plurality of contents,
Association means for associating the comment target content with the comment;
When the comment is browsed by a browsing user who is a user different from the user and browses the comment, a display that can recognize that the content associated with the comment is the comment target content is displayed. Display control means for controlling
An information processing apparatus comprising:   The specifying means extracts one or a plurality of contents on the sheet viewed by the user who wrote the comment by moving his / her gaze as a candidate content for a comment, and extracts the comment from the candidate content for a comment. The information processing apparatus according to claim 1, wherein a comment target candidate content having a user's line of sight before writing is specified as the comment target content.   3. The method according to claim 2, wherein the specifying unit treats the comment candidate content as the comment target content when the user looks at the comment candidate content on the sheet after writing the comment and then writes the comment again. An information processing apparatus according to claim 1.   4. The information processing apparatus according to claim 3, wherein the specifying unit replaces the existing comment target content with a comment target candidate content viewed after the user writes the comment. 5.   4. The information processing apparatus according to claim 3, wherein the specifying unit adds, as a comment target content, a comment target candidate content viewed after the user writes a comment. 5. The display control means causes the user to select and display the comment target candidate content,
The information processing apparatus according to claim 2, wherein the specifying unit specifies one or a plurality of candidate content to be comment selected by a user as the content to be commented.   2. The information processing apparatus according to claim 1, further comprising a receiving unit that receives a comment written on a comment writing sheet.   8. The apparatus according to claim 7, wherein, when the sheet and the comment writing sheet are the same sheet, the receiving unit receives a comment written in a margin of a surface of the sheet on which the content is formed. Information processing device.   8. The apparatus according to claim 7, wherein when the sheet and the comment writing sheet are the same sheet, the receiving unit receives a comment written on a back surface of the sheet on which the content is formed. Information processing device.   8. The information processing apparatus according to claim 7, wherein the receiving unit receives a comment written on the comment writing sheet when the sheet and the comment writing sheet are different sheets.   2. The information processing apparatus according to claim 1, wherein the display control unit performs display control so that the image of the content to be commented is visually recognized near a writing position of a comment associated with the association unit. 3.   The information processing apparatus according to claim 11, wherein the display control unit displays an image of the comment target content on the sheet in a display mode different from that of the comment target content.   13. The information processing apparatus according to claim 12, wherein the display control unit enlarges or displays the image of the comment target content according to a space on a sheet on which the comment target content is displayed.   When the comment associated with the content to be commented by the associating means already exists, the display control means displays an image of the comment near the position of the comment currently written by the user. Item 12. The information processing device according to item 11. Gaze detection means for detecting a gaze of a user who looks at a sheet to which a comment is to be added;
The identification information of the sheet includes identification information of the content on the sheet to which a comment is to be added, position information specifying the position of the content on the sheet, and a comment in which a comment for the content is written. Acquiring means for acquiring the identification information of the writing sheet, the identification information of the comment, and the association information generated by associating the comment with the comment;
Display control means for controlling display such that when the user views the content on the paper, the content and the comment added to the content fall within the field of view by referring to the association information;
An information processing apparatus comprising:   16. The information processing apparatus according to claim 15, wherein the display control unit displays an image of a comment added to the content on the sheet viewed by the user near a position of the content on the sheet. apparatus.   The information processing apparatus according to claim 16, wherein the display control unit causes a display in a margin portion of the sheet.   17. The information processing apparatus according to claim 16, wherein the display control unit displays the content at a position on the sheet other than the content.   16. The information processing apparatus according to claim 15, wherein the display control unit displays an image of a content associated with a comment written on the comment writing sheet on a surface of the comment writing sheet.   20. The information processing apparatus according to claim 19, wherein the display control means displays the image of the content in an enlarged or reduced manner in accordance with the size of an area on the comment writing sheet where a comment is not written. . Computer
When the sheet is a sheet to which a comment is to be added, content position acquisition means for acquiring position information of a plurality of contents formed on the sheet,
Line-of-sight detecting means for detecting the line of sight of a user looking at the paper,
When the user writes a comment, a specifying unit that specifies, as the comment target content, a content in which the user has a line of sight before writing the comment, among the plurality of contents.
Association means for associating the comment target content with the comment,
When the comment is browsed by a browsing user who is a user different from the user and browses the comment, a display that can recognize that the content associated with the comment is the comment target content is displayed. Display control means for controlling
Program to function as Computer
Gaze detection means for detecting a gaze of a user who views a sheet to which a comment is added;
The identification information of the sheet includes identification information of the content on the sheet to which a comment is to be added, position information specifying the position of the content on the sheet, and a comment in which a comment for the content is written. Acquisition means for acquiring identification information of a writing sheet, identification information of the comment, and association information generated by associating the comment with the comment;
Display control means for controlling display so that when the user views the content on the paper, the content and the comment added to the content fall within the field of view by referring to the association information;
Program to function as