WO2006095443A1 - Information management system - Google Patents

Abstract

An information management system comprises a contents server for storing data, and a terminal for inputting/outputting the data. The contents server includes a storage unit for storing document data and stroke information. The document data contains the information printed on the paper used in an event by a user, and the stroke information contains the position specified on the paper relating to the document data, and the time at which the position was specified. The terminal acquires, based on information capable of specifying the event, the stroke information created in relation to the event, from the contents server, classifies the stroke information on each user, for which the acquired stroke information was created, and displays the classified stroke information as the event proceeds.

Description

 Information management system

TECHNICAL FIELD The present invention relates to an information management system for managing documents and the like, and more particularly, to a technique for retrieving memorandums written in managed documents. Light

Background art

 Rice field

 In recent years, with the development of electronic technology, handwritten information entered on paper has become easily electronic. At present, only electronic documents obtained by digitizing paper documents are managed on the computer. In this way, handwritten information entered on paper documents is not managed electronically, and handwritten information cannot be used effectively.

 As a technique for solving this problem, an information search method described in Japanese Patent Application Laid-Open No. 2004-19999484 is known. In this information retrieval method, the document ID and annotation position are registered in annotation DB. At the time of an annotation search, an annotation for a search instruction is assigned to the document being browsed, and an annotation search by another person with the same viewpoint as the viewpoint to which the annotation is assigned is requested. The annotation processing device first searches for all annotations assigned to the document being viewed. The annotation processing device identifies the annotation to be returned to the document viewer as a search result by sequentially comparing the search request received from the document viewer and the rectangle information of the annotation obtained by searching the annotation DB. To do. As a result, information can be efficiently searched using annotations.

In addition, the conference system described in Japanese Patent Laid-Open No. 7_1 8 2 3 6 5 is a camera. Search files by extracting key words from multimedia information input from video input devices such as microphones, voice input devices such as microphones, pen input devices, pointing devices such as mice, and key input devices such as keyboards 3 Create When creating the minutes, you can easily edit the minutes in a short time by referring to this search file and searching and editing the scenes where important items meet.

 In addition, pen-type input devices (digital pens) that electronically acquire the pen tip trajectory have been put into practical use. The digital pen inputs the acquired pen tip trajectory to the computer. For example, digital pens include the “Anotopen” developed by Sweden's Annoto. Details of this digital pen are described in International Publication No. 0 1 Z 7 1 4 7 3. Digital pens have the advantage of being easy to use even if they are not familiar with the use of keyboards and mice, and are expected to be applied to e-government applications and other fields. Disclosure of the invention

 Among the above-described prior arts, the information retrieval method described in Japanese Patent Application Laid-Open No. 2 0 4 _ 1 9 9 4 8 4 uses another person who has given the same (or similar) annotation as his / her annotation. The search is based on the information of the place where the annotation is added. However, in this prior art, the search is not performed in consideration of the time when the annotation is given. In addition, displaying search results in a list format is not considered.

 In addition, the conference system described in Japanese Patent Application Laid-Open No. 7-1 8 2 3 6 5 aggregates the frequency of annotations and displays them in time series. That is not taken into account.

 In addition, none of the prior arts attaches disclosure restriction information to annotations and does not consider restricting disclosure of annotations.

An information management system according to an embodiment of the present invention includes a contentor that stores data. And the content server has a storage unit for storing document data and stroke information, and the document data is stored in an event (conference etc.) by a user. The stroke information includes the position specified on the paper surface related to the document data and the time when the position is specified, and the terminal specifies the event. Based on the available information, the stroke information created in relation to the event is acquired from the content server, and the stroke information is classified for each user who created the acquired stroke information. The classified stroke information is displayed as the event progresses.

 According to an embodiment of the present invention, when a user designates an annotation, the annotation related to the annotation is searched, aggregated, and displayed, so that the relationship between the annotation of a specific person and the annotation of another person can be easily performed. Can be grasped. Brief Description of Drawings

 FIG. 1 is a conceptual diagram of processing of the document management system according to the embodiment of the present invention. FIG. 2 is an explanatory diagram of a screen displayed on the information terminal according to the embodiment of the present invention. FIG. 3 is a block diagram of the configuration of the document management system according to the embodiment of the present invention. FIG. 4 is a block diagram of the content server according to the embodiment of the present invention. FIG. 5 is a block diagram of the information terminal according to the embodiment of the present invention.

 FIG. 6 is a configuration diagram of event information stored in the content server according to the embodiment of the present invention.

 FIG. 7 is a configuration diagram of distributed material information stored in the content server according to the embodiment of the present invention.

FIG. 8 is an explanatory diagram of coordinate acquisition on the paper surface by the digital pen according to the embodiment of the present invention. is there.

 FIG. 9 is an explanatory diagram of a document in which information is written by the digital pen according to the embodiment of the present invention.

 FIG. 10A shows an example of a stroke set according to the embodiment of the present invention.

 FIG. 10B is a configuration diagram of the stroke set information stored in the content server according to the embodiment of this invention.

 FIG. 10C is a configuration diagram of the stroke coordinate information stored in the content server according to the embodiment of this invention.

 FIG. 11 is a configuration diagram of user information stored in the content server according to the embodiment of the present invention. ,

 FIG. 12 is a flowchart showing the entire search process according to the embodiment of the present invention.

 FIG. 13 is a flowchart of stroke set filtering processing according to the embodiment of the present invention.

 FIG. 14 is a flowchart of stroke set tabulation processing according to the embodiment of the present invention.

 FIG. 15 is a flowchart of the two-dimensional map display process according to the embodiment of the present invention.

 FIG. 16 is a flowchart of the two-dimensional map display process according to the embodiment of the present invention.

 FIG. 17 is a flowchart of the statistical graph display process according to the embodiment of the present invention.

 FIG. 18 is a flowchart of the co-occurrence statistical graph display process according to the embodiment of the present invention.

FIG. 19 is a flowchart of the security check process according to the embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION

 Embodiments of the present invention will be described with reference to the drawings.

 FIG. 1 is a conceptual diagram of processing of the document management system according to the embodiment of the present invention. First, the information accumulation phase process will be described. The information storage phase is mainly executed during the conference, and the content server stores the conference information.

 First, when an event (meeting, etc.) is held, the camera installed in the conference room records the video of the event. The content server collects the video of the event taken by the camera via the network and stores the video of the event (1). Participants at the meeting (digital pen users) use the digital pen to enter notes related to the contents of the meeting in the handouts (or notebooks they bring) during the meeting (1,). The digital pen connects to the information terminal used by the user and transfers the stroke information written during the conference to the information terminal (2). The stroke information can be transferred from the digital pen to the information terminal not after the conference but after the conference.

 When the information terminal receives the stroke information from the digital pen, it transmits this stroke information to the content server. The content server stores the token information of handwritten characters (3).

 Next, we will explain the information access phase process. The information access phase is executed after the conference, and the content server provides the information that the user needs. The user can use the digital pen on the handout (or their notes) after the conference. Select an annotation and request electronic information related to that annotation (4). The digital pen connects to the information terminal used by the user and transfers the selected annotation position (position specified by the user with the digital pen) to the information terminal.

The information terminal sends the location selected by the user with the digital pen to the content server. And request a search for an annotation at the specified position (5).

 When the content server receives a request for searching for an annotation, the content server searches for electronic information related to the annotation (for example, video recorded during the event) using the person who entered the annotation and the entry time (6 ) At this time, it may be determined whether the user who has requested the electronic information has the right to view the searched electronic information.

 Then, the content server transmits the searched video, audio, electronic data of distribution material, annotation information, etc. to the requesting information terminal (7).

 The information terminal displays the electronic information transmitted from the content server. According to the present invention, the user can obtain electronic information related to an annotation by selecting the annotation.

 FIG. 2 is an explanatory diagram of a screen displayed on the information terminal 12 according to the embodiment of this invention.

 The display screen includes a media display unit 3 00, a document display unit 3 2 0, a two-dimensional map display unit 3 4 0, and a graph display unit 3 60.

 This display screen is configured by a content viewer realized by software operating on the information terminal 12. This content viewer operates when the user views or listens to the content sent from the content server 11.

 The media display unit 3 00 has a display area 3 0 2. In the display area 30 2, content (mainly video files) sent from the content server 11 1 is displayed.

 A file name display section 3 0 1 is provided in the upper part of the display area 3 0 2. The file name display area 3 0 1 displays the file name of the video being replayed.

A progress bar 3 0 3 is provided at the bottom of the display area 3 0 2. The progress bar 3 0 3 is provided with a progress marker 3 0 4. Progressma One power 3 0 4 moves through the progress bar 3 0 3 and indicates the progress of the video being played. In addition, the user can change the viewing location by moving the progress marker 3 4.

 Below the progress bar 3 0 3 are an OPEN button 3 0 5, a volume bar 3 1 0, a fast-forward button 3 0 9, a rewind button 3 0 8, a stop button 3 0 7 and a play button 3 0 6 ing. The OPEN button 3 0 5 is used to open a file selection screen for playback.

 The document display unit 3 2 0 has a display area 3 2 2. In the display area 3 2 2, the documents sent from the content server 1 1 are displayed. In the document displayed in the display area 3 2 2, the annotation (stroke set) attached to the document is displayed.

 Marker 3 2 3 is displayed in display area 3 2 2. Markers 3 2 3 indicate the currently specified stroke set. In the document display area 320, an annotation can be selected directly. When annotation (attention stroke set) is selected, attention areas 3 4 6 and 3 6 6 move.

 A document name display section 3 2 1 is provided at the top of the display area 3 2 2. The document name display section 3 2 1 displays the file name of the currently displayed document.

 A progress bar 3 2 4 is provided on the right side of the display area 3 0 2. The progress bar 3 2 4 is provided with a progress marker 3 2 5. Progressive force 3 2 5 moves through the progress bar 3 2 4 and indicates the position in the file of the document that is not displayed. The progress marker 3 2 5 is linked with the progress power 3 0 4 of the media display unit 3 0 0. In addition, the user can change the display location by moving the progress marker 3 2 5.

On the right side of the display area 3 0 2 (to the right of the progress bar 3 2 4), there is a previous page button 3 2 7 that returns the document to the previous page, and a next page button 3 2 8 that sends the document to the next page. Yes. The previous page button 3 2 7 and next page button 3 2 8 display the contents of the corresponding page reduced. Also, at the bottom of the next page button 3 2 8 is an OPEN button 3 2 6 that opens a screen for selecting a document file to be displayed.

 In the upper part of the display area 3 4 1, a horizontal axis selection field 3 4 2 is provided. The user can select the unit of the horizontal axis of the two-dimensional map using the horizontal axis selection field 3 4 2. For example, the horizontal axis is time in the state shown in the figure, but the 2D map can be displayed by changing the horizontal axis of the 2D map to the number of characters (or the number of lines) in the document. At this time, an appropriate location in the document is calculated using the corresponding rectangular coordinates 2 4 4 of the stroke set information. For example, the character with the coordinates closest to the center of gravity of the rectangle can be used as the stroke set position.

 In the state shown in the figure, since time is selected on the horizontal axis, the scale of the horizontal axis of the two-dimensional map is displayed in the upper part of the display area 3 41.

 The keystroke set display area 3 4 3 is provided at the top of the display area 3 4 1. Key stroke set display area 3 4 3 displays information on annotations (stroke sets) entered by the owner of the stroke set (entry of the annotation specified in the document display section 320). Is done.

 When another person's annotation is specified on the 2D map display section 3 4 0, the specified person moves to the keystroke set display area 3 4 3. The display order of the stroke set holders also changes in the order closer to the person who became the new key.

 In the lower part of the key stroke set display area 3 4 3, other stroke sets are classified and displayed for each stroke set owner (entrant of the stroke set).

 The left part of the display area 3 4 1 displays the owner of the stroke set and the similarity between the stroke set of the owner and the keystroke set.

Stroke set owners are displayed in order of similarity from the top (from the row near display area 3 4 1). Strokeset owners may also appear anonymously. is there. That is, if anonymous disclosure (1) is set by the fourth digit of stroke set information 2 4 9 A and 2 4 9 B, which will be described later, the name of the stroke set owner is anonymous. Is displayed.

 The similarity of the stroke set is obtained by judging the overlap between the key stroke set and the owner's stroke set and the key stroke set. (Duplicate judgment process in the 2D map display process (S1 in Fig. 16) 4 See 5)).

 The two-dimensional map display unit 3 4 0 has a display area 3 4 1. The display area 3 4 1 displays the time when the annotation (stroke set) attached to the document related to the event is entered.

 In the display area 3 4 1, a stroke set display 3 4 4 corresponding to the stroke set entry time is displayed.

 A progress marker 3 4 5 is provided in the display area 3 4 1. Progress marker 3 4 5 moves through display area 3 4 1 and indicates the progress of the video being played. The progress marker 3 45 is linked to the progress marker 3 0 4 of the media display unit 3 0 0 and the progress marker 3 2 4 of the document display unit 3 2 0.

 Further, the attention area 3 4 6 is provided in the display area 3 4 1. The attention part 3 4 6 indicates the designated annotation. This attention part 3 4 6 makes it easy to grasp the relationship between a specified annotation and other annotations. If multiple stroke sets are specified, multiple attention areas 3 4 6 are displayed. The attention part 3 46 can be specified directly even in the two-dimensional map display part 3 40.

The graph display unit 3 60 has a display area 3 61. In the display area 3 61, a statistical graph or a co-occurrence statistical graph is displayed. The statistical graph is a histogram that summarizes the entry time of the stroke set held by everyone, and shows how many people entered the annotation at that time. The co-occurrence statistical graph is the person who entered the annotation at the same time (same time and near time) as the attention part 3 4 6 and 3 6 6 It is the histogram which totaled the entry time of the stroke set which has. In the state shown in the figure, the co-occurrence statistics graph is a collection of only the three annotations A, Anonymous 1 and D, and shows how many of the three individuals entered the annotation at that time.

 As will be described later, in the statistical graph, the stroke set held by the user whose owner user information is hidden is also the subject of aggregation. On the other hand, the co-occurrence statistics graph does not cover the stroke set owned by the user whose owner user is hidden.

 In the upper part of the graph display area 360, a selection area for a statistical graph and a co-occurrence statistical graph is provided. When "Overall" 3 6 2 is selected, the statistical graph is displayed in the display area 3 6 1, and when "Co-occurrence" 3 6 3 is selected, the co-occurrence statistical graph is displayed in the display area 3 6 1 The

 In the lower part of the display area 3 6 1, the horizontal axis scale of the statistical graph is displayed. In the display area 3 61, a frequency distribution 3 6 4 is displayed. Frequency distribution 3 6 4 shows how many people were annotating at that time.

 In addition, a progress marker 3 65 is provided in the display area 3 61. Progress marker 3 6 5 moves through display area 3 6 1 and indicates the progress of the video being played. The progress marker 3 65 is linked to the progress marker 3 0 4 of the media display unit 3 0 0 and the progress marker 3 2 4 of the document display unit 3 2 0.

 In the display area 3 61, a target part 3 6 6 is provided. The attention part 3 6 6 indicates the entry time of the specified annotation. This attention part 3 6 6 makes it easy to grasp the relationship between the specified annotation and other annotations. When multiple stroke sets are specified, multiple attention parts 3 6 6 are displayed.

The attention part 3 6 6 can also be directly specified in the two-dimensional map display part 3 40. When the attention area changes, the annotation will be at approximately the same time as the attention area 3 4 6 and 3 6 6 The co-occurrence statistics graph changes because the person who entered the letter changes.

 Further, the number of publishers and the number of non-publishers 3 6 7 are displayed in the display area 3 61. As mentioned above, the statistical graph also includes the stroke sets held by users whose owner user information is hidden.

 Media display unit 3 0 0 progress marker 3 0 4 described above, document display unit 3

2 0 Progress Progress 3 2 5 2D Map Display 3 4 0 Progress Marker

3 4 5, Progress indicator 3 6 5 of graph display part 3 6 0 are all linked. FIG. 3 is a block diagram of the document management system according to the embodiment of the present invention. Document management system includes content server 1 1, information terminal 1 2, digital pen 1

4. Event information input device 1 5, Network 17 and Location information server 19

 The content server 11, the information terminal 12, the event information input device 15, and the location information server 19 are connected to each other via a network 17. Each information terminal 12 is connected to one or more digital pens 14. The information terminal 12 and the digital pen 14 may be connected by wire using a protocol such as USB (Universal Serial Bus). Also, it may be connected by wireless such as Bluetooth, wireless LAN, mobile phone system or infrared.

 The content server 11 manages the content for each event, and transmits the requested content to the information terminal 12. The content includes documents, audio and video related to the event. Documents are all information printed and presented on paper.

 The information terminal 12 is a computer device used by each person, and transfers information received from the digital pen 14 to the content server 11. Further, the information terminal 12 displays the content received from the content server 11.

The digital pen 14 can write characters, figures, etc. on a paper medium in the same way as a normal pen. In addition, the digital pen 14 has a small camera at the tip and touches the paper. Get the dot pattern at the specified position. In addition, the digital pen 14 retains a preset pen ID. The digital pen 14 includes a communication interface for connecting to the information terminal 12 by wire or wireless.

 For example, as shown in FIG. 8, the digital pen 14 acquires a dot pattern printed on a document. The coordinates on the paper surface can be specified from the dot pattern acquired by the digital pen 14.

 In addition, the digital pen 14 sends the specified absolute coordinates, the time when the dot pattern was acquired, and the pen ID to the content server 11 via the mobile phone system or the wireless LAN system without going through the information terminal 12. May be.

 The event information input device 15 is a computer device installed in the conference room, and creates information related to the event (for example, video, image, sound and / or slide, etc.). Also, the event information input device 15 registers the content such as the document and the created video in the content server 11 in association with the event.

 In addition, the event information input device 15 is connected to the digital pen 14 during the conference, acquires information such as absolute coordinates specified by the digital pen 14, and sends the acquired information to the content server 11. You can send it.

 The location information server 19 is a computer device equipped with a CPU, memory, storage device, etc., and has a data base that correlates the amount of deviation from the reference point of the dot pattern on the paper with the coordinates on the paper. keeping. The position information server 19 provides coordinates on the paper based on the dot pattern on the paper.

 A printer may be provided in the document management system of this embodiment. The printer prints contents such as documents in response to instructions from the information terminal 12.

 FIG. 4 is a block diagram of the content server 11 according to the embodiment of the present invention. The content server 11 includes a CPU 1 1 1, a memory 1 1 2, a storage unit 1 1 3, and a data communication unit 1 1 8.

CPU 1 1 1 calls and executes various programs stored in memory 1 1 3 By doing so, various processes are performed.

 The memory 112 has a work area for temporarily storing data used by the CPU 111 for various processes.

 The storage unit 113 is composed of a nonvolatile storage medium (for example, a magnetic disk drive). The storage unit 113 stores an event management program 114, a document management program 115, a pen data management program 116, and a user management program 117. These programs are loaded into the memory 112 and then executed by the CPU 111 to perform various processes.

 The storage unit 113 stores event information 21, distribution material information 22, stroke set information 24, and user information 27.

 The event management program 114 manages the event information 21 (FIG. 6). The document management program 115 manages handout information 22 (Fig. 7). The pending management program 116 manages the stroke information 24 (FIG. 10B). The user management program 117 manages user information 27 (FIG. 11). The data communication unit 118 is a network interface. For example, TC

It is a LAN card that can communicate using the PZIP protocol. As a result, the content server 11 can communicate with devices connected to the network 17 such as the information terminal 12.

 FIG. 5 is a block diagram of the information terminal 12 according to the embodiment of this invention.

 The information terminal 12 includes a CPU 121, a memory 122, a pen data input unit 123, an operation input unit 124, a data display unit 125, a data communication unit 126, and a data totaling unit 127.

 The CPU 121 performs various processes by calling and executing various programs stored in a storage device (not shown).

The memory 122 has a work area for temporarily storing data used by the CPU 111 for various processes. Content server 11 and digital pen 14 etc. The data sent from is temporarily stored.

 The pen input unit 1 2 3 communicates with the digital pen 14 by wire or wirelessly and collects information such as coordinates acquired by the digital pen 14.

 The operation input unit 1 2 4 is, for example, a keyboard, and information is input by the user.

 The data display unit 1 25 is composed of a liquid crystal display, for example, and displays contents such as documents obtained from the container bar 11.

 The data communication unit 1 2 6 is a network interface. For example, a LAN card that can communicate using the TC P Z I P protocol. As a result, the information terminal 12 can communicate with the content server 11 via the network 17.

 The pen data input unit 1 2 3 and the data communication unit 1 2 6 may be a single interface.

 The data totaling unit 1 2 7 totals the stroke set information 24 and generates a two-dimensional map and a statistical graph.

 Next, the event information input device 15 according to the embodiment of the present invention will be described. The event information input device 15 includes a CPU, a memory, an operation recording unit, a video input unit, a voice input unit, a data display unit, a pen data input unit, and a data communication unit.

 The CPU performs various processes by calling and executing various programs stored in a storage device (not shown).

 The memory has a word querier that temporarily stores data used by the CPU for various processes. In addition, it temporarily stores data sent from the content server 11 and the digital pen 14.

The operation recording unit records operations on the document management system during the meeting. For example, the keyboard operation by the presenter (operations such as rewinding and fast-forwarding the video used during the conference) are recorded. The video input unit collects video data taken during the conference by a camera installed in the conference room.

 The voice input unit collects the voice data recorded during the conference by the microphone installed in the conference room.

 The data display unit is composed of a large-screen display device such as a projector installed in the conference room, and displays data used during the conference. For example, presentation materials used by the presenter and documents obtained from the content server 11 are displayed.

 The pen data input unit communicates with the digital pen 14 by wire or wireless and collects information such as coordinates acquired by the digital pen 14.

 The data communication unit is a network interface. For example, a LAN card that can communicate using the TCPZIP protocol. As a result, the event information input device 15 can communicate with the content server 11 via the network 17.

 FIG. 6 is a configuration diagram of event information 21 stored in the content server 11 according to the embodiment of the present invention.

 Event information 2 1 is event ID 2 1 0, event name 2 1 1, date and time 2 1 2, place 2 1 3, number of attendees 2 1 4 A, attendee 2 1 4 B, number of additional information 2 1 7 A And additional information 2 1 7 B included. As the event information 21, one record is generated every time an event such as a meeting is performed. Event information 21 can be searched using any item as a key.

 The event ID 2 1 0 is an identifier that uniquely identifies the event. For example, the event management program 1 1 4 automatically determines an event ID 2 10 according to an arbitrary rule and records it in the event information 2 1.

 Event name 2 1 1 is the name of the event.

Date 2 1 2 is the start time and end time of the event. Place 2 1 3 is where the event took place.

 Number of attendees 2 1 4 A is the number of attendees at the event. The same number of attendees 2 1 4 B as 2 1 4 A are recorded.

 Attendee 2 1 4 B is a user ID that uniquely identifies the attendee of the event. The number of additional information 2 1 7 A is the number of additional information related to the event. The same number of additional information 2 1 7 B as the number of additional information 2 1 7 A is recorded.

 The additional information 2 1 7 B is information such as video, image, sound or slide related to the event. Specifically, in the additional information 2 17 B, information such as video data obtained by capturing the event, audio data recording the event, and slides used in the event are recorded. The additional information 2 1 7 B records the type of additional information, the file name of the additional information, and the content security set in the additional information.

 Also, additional information 2 1 7 B includes the security level of each additional information. The security level of additional information is the degree of secrecy of the additional information. As described later, the security level 2 26 of the additional information and the security level 2 76 of the user (see Fig. 11) determine whether the user can access the additional information.

 FIG. 7 is a configuration diagram of the distribution material information 22 stored in the content server 11 according to the embodiment of the present invention.

Handout information 2 2 is document ID 2 2 0, dot pattern ID 2 2 1, owner user ID 2 2 2, event ID 2 2 3, electronic file 2 2 4, document size 2 2 5, security level 2 2 6, Including stroke set number 2 2 7 and stroke set ID 2 2 8 Handout information 2 2 can be searched using any item as a key. The document ID 2 2 0 is an identifier for uniquely identifying the document. Even if the documents have the same information, they will be different if the owners are different. ID 2 2 0 is generated, and different records of distribution material information 2 2 are generated. Normally, documents distributed to different users are distributed after printing with different dot patterns.

 The dot pattern I D 2 2 1 is an identifier of the dot pattern printed on the document.

 The owning user ID 2 2 2 is an identifier that uniquely identifies the user who owns the document.

 Event ID 2 2 3 is an identifier that uniquely identifies the event with which the document is associated. Normally, the event ID of the meeting to which the document has been distributed is recorded and corresponds to the event ID 2 10 of event information 21.

 Electronic file 2 2 4 is the file name of the electronic data of the document.

 Document size 2 2 5 indicates the paper size suitable for printing the document, and stores the coordinates of the upper left corner and the lower right corner of the area. In the illustrated case, the document size 2 2 5 is expressed in millimeters with the origin at the top left corner.

 Security level 2 2 6 is the degree of confidentiality of the document. As will be described later, security level 2 2 6 and user security level 2 7 6 (see Fig. 1 1) determine whether the user can view the document. The number of stroke sets 2 2 7 is the number of stroke sets described with the digital pen 14 in the document. The same number of stroke sets I D 2 2 8 as the number of stroke sets 2 2 7 are recorded.

 A stroke set is a group of lines (strokes) that are grouped together. For example, the stroke set is obtained using layout analysis in character recognition. In layout analysis, a set of lines is identified and a stroke set is obtained based on the time when the lines are entered or the positional relationship between the lines. In other words, strokes written at positions close to each other in a short time constitute one stroke set.

Stroke set ID 2 2 8 is the stroke set described in the document. This identifier uniquely identifies the link to the stroke set information 24 (Fig. 10B).

 FIG. 8 is an explanatory diagram of coordinate acquisition on the paper surface by the digital pen 14 according to the embodiment of the present invention.

 The digital pen 14 includes a CPU, a memory, a processor, a communication interface, a camera 14 1, a battery, and a pen pressure sensor. In addition, the digital pen 14 is equipped with a pen tip capable of writing letters, symbols, etc. on paper with ink or graphite.

 The digital pen 14 is used together with the paper 20 on which dots 20 3 for position detection are printed. Here, a part 2 0 1 of the paper 2 0 is enlarged to explain the dots 2 0 3. A plurality of small dots 20 3 are printed on the paper 20. The dots 20 3 are printed at positions shifted vertically and horizontally from the intersection (reference point) 2 0 2 of the virtual grid lines.

 When text and figures are entered on the paper with a digital pen 14, the information remains visible on the paper. When the pen pressure sensor detects that the pen tip is in contact with the paper, the digital pen 14 takes a picture of the dots 20 3 printed on the paper by the camera 14 1. For example, the digital pen 14 captures an area including 6 × 6 dots 2 0 3.

 The digital pen 14 obtains the absolute coordinates where the dot pattern exists from the captured dot pattern. This absolute coordinate is a coordinate where the dot pattern exists in a vast plane area. This vast plane area is the entire area where the dot patterns can be arranged so as not to overlap.

 The digital pen 14 sends the obtained absolute coordinates to the information terminal 12. The information terminal 12 transmits the absolute coordinates transmitted from the digital pen 14 to the content server 11.

The content server 11 transmits the absolute coordinates obtained by the digital pen 14 to the position information server 19. The position information server 19 is based on the absolute coordinates transmitted from the content server 11, and the position of the paper (dot pattern) in the vast plane area. ID) and coordinates (relative coordinates) on a certain sheet of paper, and the specified dot pattern ID and relative coordinates are transmitted to the content server 11.

 In this way, the content server 11 acquires the dot pattern ID and relative coordinates from the dot pattern photographed by the digital pen 14.

 By acquiring information on the position where the pen tip is in contact at a predetermined timing (for example, periodically), the movement of the pen tip can be understood.

 That is, the digital pen 14 transmits the absolute coordinates corresponding to the shot dot pattern, the shooting time of the dot pattern, and the pen ID to the information terminal 12. The content server 11 acquires relative coordinates from the position information server 19 based on the absolute coordinates obtained by the digital pen 14. The content server 11 obtains the trajectory (distribution material information) of the pen tip from the acquired relative coordinates and the time when the dot pattern was captured.

 In addition, the location server 19 can be included in the content server 1 1 without providing it separately.

 Further, the digital pen 14 need not use the position information server 19 in order to specify the dot pattern ID and relative coordinates. For example, the paper is identified from an IC tag or a two-dimensional barcode embedded in the paper 20. Furthermore, the position (relative coordinates) on the paper can be specified using a tablet. Note that either the specification of the paper using a muchip or the like or the specification of the position on the paper using a tablet may be combined with the specification of the absolute coordinate by the position information server 19. In this way, the document management system can reduce the process of specifying the dot pattern ID and relative coordinates.

 FIG. 9 is an explanatory diagram of the document 3 1 registered in the content server 11 according to the embodiment of the present invention, and shows a state in which information is entered by the digital pen 14.

Documents (distribution materials) 3 1 as shown in the figure will be distributed at the meeting. These documents 3 1 are associated with the event that they are distributed to be registered.

 Document 31 has a different dot pattern between documents. That is, when printing the contents of each document, a different dot pattern is printed for each document. Documents having different dot patterns have different document IDs 2 20 and are distributed to different users.

 The handout document 31 may be a document created electronically by document creation software, etc., or a handwritten document may be digitized.

 The user enters information (characters, symbols, etc.) 3 1 1 in the document 3 1 with the digital pen 14 during the event (or after the event ends). Then, the digital pen 14 periodically acquires the absolute coordinates of the position where the characters etc. are written (the position where the pen tip touches) and the time when the absolute coordinates are measured. Next, the digital pen 14 transmits the acquired absolute coordinate and acquisition time to the content server 11.

 The content server 11 inquires the position information server 18 to identify the dot pattern ID and relative coordinate corresponding to the absolute coordinate included in the received stroke information, and identifies the document ID from the dot pattern ID.

 Then, the content server 11 determines the stroke of the entered information based on the specified relative coordinate and measurement time, and creates the stroke coordinate information 25 (see FIG. 10C). Then, using the identified document ID, new stroke set information 24 (see Fig. 10B) is created.

FIG. 10A shows an example of the stroke set 26 according to the embodiment of the present invention. Stroke set 2 6 shows “Tokyo” 3 1 1 shown in FIG. 9 filled in with digital pen 14. In the present embodiment, as shown in the figure, the stroke position is determined with the upper left as the origin, the horizontal direction as the X axis, and the vertical direction as the Y axis. As described above, a stroke set is a group of lines (strokes) that are grouped together, and is specified based on the time when the lines are written and / or the positional relationship between the lines. FIG. 10B is a configuration diagram of the stroke set information 24 stored in the content server 11 1 according to the embodiment of the present invention.

 This configuration diagram is the stroke set information of the stroke set 26 shown in FIG.

 Stroke set information 2 4 includes stroke set ID 2 4 1, pen ID 2 4 2, event ID 2 4 7, document ID 2 4 8, entry start date and time 2 4 3, corresponding rectangular coordinates 2 4 and 4, disclosure Restriction information 2 4 9 A, 2 4 9 B, number of strokes 2 4 5 and stroke information 2 4 6 are included. The stroke set information 24 can be searched using any item as a key.

 The stroke set ID 2 4 1 is an identifier for uniquely identifying the stroke set.

 The pen ID 2 4 2 is an identifier of the digital pen 1 4 in which the stroke set is written.

 Event I D 2 4 7 is an identifier that uniquely identifies the event associated with the stroke set. Usually, the event ID of the meeting to which the document with the stroke set is distributed is recorded and corresponds to the event ID 2 1 0 of the event information 21.

 Document ID 2 4 8 is an identifier that uniquely identifies the document in which the stroke set has been entered. Document I D 2 4 8 corresponds to document I D 2 2 0 of handout document information 2 2.

 Start date and time 2 4 3 is the date and time when the stroke set started to be written. The corresponding rectangular area 2 4 4 is a rectangular area including the stroke set. The corresponding rectangular area 2 4 4 is the coordinates (relative coordinates) in the document in which the stroke set is entered, and is expressed by the coordinates of the upper left corner and the lower right corner of the rectangular area.

The public restriction information includes public restriction information 2 4 9 A for attendees and public restriction information 2 4 9 B for non-attendants. Separate disclosure restriction information for attendees and non-attendants This makes it possible to set various security settings for the stroke set.

 Each public restriction information 2 4 9 A and 2 4 9 B has a plurality of patterns prepared in advance for each security level. In the present invention, since the public restriction information is determined from the user security level 2 76 (see FIG. 11), the same public restriction information is set for all stroke sets entered by the same user. Public restriction information may be defined for each stroke set.

 The public restriction information 2 4 9 A and 2 4 9 B can be defined by, for example, a 4-digit code as shown in FIG. The fourth digit (the most significant digit) from the bottom of this code indicates whether or not to disclose the information of the owner of the stroke set. Specifically, whether to release the user information (2), whether to make it anonymous (1), or not

Indicates (0).

 The third digit from the bottom indicates whether the entry start date is disclosed (1) or not (0). The second digit from the bottom indicates whether the corresponding rectangular coordinates are disclosed (1) or not (0). The first digit (lowest digit) from the bottom indicates whether to disclose the stroke information (1) or not (0).

 The number of strokes 2 4 5 is the number of lines (strokes) included in the stroke set. The same number of stroke information 2 4 6 as the number of strokes 2 4 5 is recorded.

 Stroke information 2 4 6 includes the number of sample points 2 4 6 A and serial number 2 4 6 B. The number of sample points 2 4 6 A is the number of relative coordinates that make up the stroke acquired by the digital pen 1 4. is there.

The serial number 2 4 6 B is an identifier obtained by the digital pen 1 4 for uniquely identifying the relative coordinates constituting the stroke, and the stroke coordinate information 2 5 (Fig. 10 C) Is a link to FIG. 10C is a configuration diagram of the stroke coordinate information 25 stored in the content server 11 according to the embodiment of the present invention.

 The stroke coordinate information 2 5 includes a serial number 2 5 1, an X coordinate 2.5 2, a Y coordinate 2 5 3, and an acquisition time 2 5 4.

 The serial number 2 51 is an identifier that uniquely identifies the relative coordinates acquired by the digital pen 14.

 The X coordinate 2 52 is a relative coordinate in the X-axis direction shown in FIG. 10A, for example, expressed in millimeters.

 Y coordinates 2-5 3 are relative coordinates in the Y-axis direction shown in FIG. 10A, and are expressed in units of millimeters, for example.

 Acquisition time 2 5 4 represents the time when the relative coordinates were acquired by the digital pen 14. In this explanatory diagram, the acquisition time 2 5 4 records the elapsed time of entry start time 2 4 2 and others.

 FIG. 11 is a configuration diagram of user information 27 stored in the content server 11 according to the embodiment of the present invention.

 The user information 27 includes a user ID 2 7 1, a name 2 7 2, an affiliation 2 7 3, a title 2 7 4, a possessed pen ID 2 7 5, and a security level 2 7 6. User information 27 can be searched using any item as a key.

 User ID 2 7 1 is an identifier that uniquely identifies the user.

 Name 2 7 2 is the name of the user.

 Affiliation 2 7 3 is the department to which the user belongs.

 Title 2 7 4 is the title of the user.

 The possessed pen ID 2 75 is a unique identifier of the digital pen 14 possessed by the user.

Security level 2 7 6 is the right to access the user's confidential documents. As described below, user security level 2 7 6 and document security Level 2 2 6 (see Figure 7) determines whether the user can view the document.

 For security level 2 76, a plurality of patterns are prepared in advance. Security level 2 7 6 specifies the pattern. For example, Revenore 3 discloses all information to conference participants but makes it anonymous to non-participants. In addition, media information is disclosed to both participants and non-participants. Next, processing of the document management system according to the embodiment of this invention will be described.

 FIG. 12 is a flowchart showing the entire search process according to the embodiment of the present invention.

 In this embodiment, when a searcher specifies an annotation, the annotation related to the annotation is searched, and the searched annotations are aggregated and displayed.

 The user specifies the stroke set (1 0 0 1). In other words, the user uses the digital pen 14 to specify the position on the document in which the stroke set as a search key is entered. The digital pen 14 finds the absolute coordinates of the specified position. The digital pen 14 transmits the obtained absolute coordinates and pen ID to the pen data input unit 1 2 3 of the information terminal 12.

Note that the user may specify an annotation attached to the document on the document displayed on the data display unit 1 25 of the information terminal 12 with a mouse or the like. The annotation specified at this time becomes the attention stroke set. In this embodiment, annotation and stroke set mean the same thing. In addition, the user designates a document to be searched (1 0 0 2). That is, the user operates the operation input unit 1 2 4 and inputs the document ID and searcher ID to be searched, and the user designates the search target medium (additional information) (1 0 0 3). That is, the user operates the operation input unit 1 2 4 to search additional information to be searched and a search. Enter the user ID.

 Upon receiving a search request from the information terminal 12, the content server 11 searches for documents, events, and stroke sets related to the search request (1 0 11 to 1 0 16). First, the content server 11 transmits the absolute coordinates obtained by the digital pen 14 to the position information server 19. The position information server 19 is based on the absolute coordinates sent from the content server 11, and the position (dot pattern ID) of the paper surface in the vast plane area and the coordinates (relative And the specified dot pattern ID and relative coordinates are transmitted to the content server 11. Next, the content server (document management program 1 1 5) searches for documents (documents associated with events such as handouts) based on the information transmitted from the information terminal 12 (1 0 1 1). . For example, the dot pattern ID is specified from the position specified by the digital pen, and the document ID 2 2 0 corresponding to the specified dot pattern I D 2 2 1 is specified. It also identifies events (event ID 2 2 3) related to the identified documents.

 Then check the security level of the identified document (1 0 1 2). This security check process will be described later with reference to FIG.

 Then, identify the electronic file of the identified document and the stroke set ID 2 28 attached to the document. The set of stroke sets I D specified here becomes the key stroke set set (for example, “K” in FIG. 14).

 Next, the stroke set information 24 is identified by each stroke set ID included in the keystroke set set, and stroke set filtering (described later in Fig. 13) is performed. This makes it possible to obtain detailed information about the stroke set included in the keystroke set set.

In addition, the target stroke set is identified from each stroke set included in the key stroke set set. In other words, depending on the position specified by the user (position of the target stroke set), the strokes included in the keystroke set set Search the set information to identify the target stroke set.

 The content server 11 transmits the information obtained by the above processing to the information terminal 12. The information terminal 12 displays the received information on the data display unit 1 2 5 (1 0 0 4). Specifically, the document display unit 3 20 is displayed, and the key stroke set display region 3 4 3 of the two-dimensional map display unit 3 40 is displayed.

 Next, the event management program 1 1 4 obtains the detailed information of the event by the previously identified event ID 2 2 3. In the present embodiment, date 2 1 2, attendee 2 1 4 B, and additional information 2 1 7 B are acquired.

 Then, the security level of the acquired additional information is checked (1 0 1 4). This security check process 1 0 1 4 is the same as the process of 1 0 1 2 and will be described later with reference to FIG.

 The content server 11 transmits the additional information file obtained by the above processing to the information terminal 12. The information terminal 12 displays the received additional information file on the data display unit 1 2 5 (1 0 0 5). Specifically, the received content is displayed on the media display unit 300. At this time, the content is cued using the entry start date and time 2 4 3 of the target stroke set so that the content can be played back from this time.

 Next, the pen data management program 1 1 6 searches for the stroke set information based on the event ID 2 3 3 specified earlier (1 0 1 5). Then, all stroke set identifiers (stroke set I D 2 4 1) related to the event are identified. Then, the stroke set information 2 4 of the identified stroke set I D 2 4 1 is acquired. The set of stroke sets ID specified here becomes the set of stroke sets to be aggregated (for example, “A” in FIG. 14).

Then, a stroke set filtering process for determining the disclosed level of the stroke set is performed (1 0 16). The stroke set filtering process allows information that the stroke set owner does not want to reveal as needed. Hidden. In other words, the corresponding item is masked (blackened). This stroke set finalizing process 10 0 16 will be described later with reference to FIG.

 Further, the information terminal 12 2 totals the searched stroke sets by the data totaling unit 1 27 and displays the total stroke sets by the data display unit 1 25 (1 0 0 6). Stroke set aggregation processing and stroke set display processing 1 0 0 6 will be described later with reference to FIG. .

 When a re-aggregation instruction is input to the operation input unit 1 2 4 (1 0 0 8), the process returns to the process 1 0 6 and the stroke set is totaled again (1 0 0 6).

 Specifically, the user can set the target stroke set on the displayed screen by instructing another stroke set with a mouse or the like. Attention When the stroke set is changed, the data tabulation unit 1 2 7 recalculates as necessary. Then, the data display unit 1 2 5 redisplays the screen.

 Note that the target stroke set can be selected from the current set of key stroke sets, but it can also be selected from other (stroke sets owned by other people). By specifying another person's stroke set, the keystroke set is also reset. And the display order of the vertical axis of the 2D map changes. That is, they are rearranged in order from the specified person's stroke set pattern. FIG. 13 is a flowchart of stroke set filtering processing according to the embodiment of the present invention, which is executed by the content server 11.

 First, parameters for selecting a stroke set are input to the stroke set filtering process (S 1 0 1). Specifically, the target stroke set, searcher ID, and attendees are given to the stroke set filtering process.

The stroke set to be given to the stroke set finalizing process is the stroke set that should be identified and aggregated as a result of the search and displayed on the information terminal. The searcher ID is entered by the searcher into the document management system. This is the user ID 271 input to the information terminal 12 in order to win.

 In addition, the attendee must identify the target stroke set (stroke set ID) 2

Identifies distribution information 22 including 41, and identifies the specified distribution information

It is attendee 214B who identified ID 223 and is included in the identified event information. Next, it is determined whether or not the searcher's user ID 271 is included in the attendee 214 B (S 102).

 As a result of the determination, if the user ID 271 of the searcher is included in the attendee 214 B, it is determined that the searcher is an attendee, and the public restriction information 249 A for the attendee is applied (S 103). On the other hand, if the user ID 27 1 of the searcher is not included in the attendee 214 B, it is determined that the searcher is not an attendee and the public restriction information 249 B for non-attendants is applied (S 104). .

 Next, it is determined whether or not to disclose the information of the user who owns the stroke set by the fourth digit (the most significant digit) from the lower order of the publication restriction information 249 A and 249 B (S 105).

 If the fourth digit of the disclosure restriction information is “1” as a result of the determination, the user ID of the owning user is made anonymous and published (S106). If the fourth digit of the public restriction information is “0”, the owning user is not disclosed and the user ID is hidden (S 107). That is, the user ID is blackened. Also, if the 4th digit of the public restriction information is "2", the owned user information may be disclosed, so no processing is performed.

 Next, it is determined whether or not to disclose the date and time of entry of the stroke set according to the third digit from the lower order of the publication restriction information 249 A and .249 B (S 108).

 If the third digit of the disclosure restriction information is “0” as a result of the judgment, the entry start date / time is not disclosed and the entry start date / time is hidden (S109). If the third digit of the restriction information is “1”, the entry start date and time may be disclosed, so no processing is performed.

Next, it is determined whether or not to release the entry position of the relevant token set according to the second digit from the lower order of the publication restriction information 249 A and 249 B (S 110). If the second digit of the disclosure restriction information is “0” as a result of the determination, the entry position is not disclosed and the corresponding rectangular coordinates are hidden (S 1 1 1). If the second digit of the disclosure restriction information is "1", the entry position may be disclosed, so no processing is performed.

 Next, it is determined whether or not the entry position of the stroke set is disclosed by the first digit (least significant digit) from the lower order of the disclosure restriction information 2 4 9 A and 2 4 9 B (S 1 1 2 ) If the first digit of the disclosure restriction information is “0” as a result of the determination, the stroke information is not disclosed, so this stroke set information is excluded from the aggregation target (S 1 1 3). If the first digit of the disclosure restriction information is "1", the stroke set can be disclosed and no processing is performed.

 In this way, the stroke set filtering process (Fig. 13) uses the public restriction information to determine the extent to which information on the stroke set information to be aggregated is disclosed.

 FIG. 14 is a flowchart of the stroke set totaling process and the stroke set display process according to the embodiment of the present invention, and is executed by the information terminal 12.

 First, in the stroke set aggregation process, a set of stroke sets for aggregation of stroke sets is set (S 1 2 1). Specifically, the key stroke set set is set in set K, the target stroke set set is set in set F, and the aggregated stroke set set is set in set A.

The keystroke set set (set K) is a set that satisfies the security conditions (passed through the stroke set filtering process) among all the stroke sets included in the specified document. The target stroke set set (set F) is a stroke set specified as a search key, and is included in the key stroke set. The set of stroke sets to be aggregated (set A) is the one that satisfies the security conditions among all the stroke sets entered by all users who attended the meeting to which the specified document was distributed (the stroke set finalizing process Passed). Next, the first loop is started (S 1 2 2). In this first loop, each stroke set included in the set A or the set K (that is, each stroke set belonging to the collection target stroke set set or the key stroke set set) is counted in order. Therefore, set the stroke set to be aggregated in this loop to a. In the first loop, whether or not the user ID of the owning user is hidden by the 4th digit (the most significant digit) from the lower order of the disclosure restriction information 2 4 9 A and 2 4 9 B of the relevant stroke set. Is determined (S 1 2 3). If the owning user is not hidden, the aggregate stroke set a is added to the set of 2D map display stroke sets (S 1 2 4).

 On the other hand, if the owning user is hidden, the stroke set a to be aggregated is not added to the 2D map display stroke set collection.

 Thereafter, in any case, the stroke set a to be counted is added to the set of statistical graph display stroke sets (S 1 2 5).

 Thus, if the owning user ID is hidden, the stroke set is only counted in the statistical graph. If the owning user ID is not hidden, the stroke set is aggregated in a statistical graph and a two-dimensional map.

 When the summation of all stroke sets included in the set A or the set K is finished, the first loop is finished (S 1 26).

 After that, the 2D map is displayed using the 2D map display stroke set set (S 1 2 7). This two-dimensional map display process will be described later with reference to FIG. In addition, a statistical graph is displayed using a set of strokes for displaying the statistical graph (S 1 2 8). This statistical graph display process will be described later with reference to FIG.

Thereafter, it is determined whether or not the target stroke set set (F) is empty (S 1 29). As a result, if the target stroke set set (F) is not empty, a co-occurrence statistics graph is displayed (S 1 3 0). This co-occurrence statistical graph display process will be described later in FIG. FIG. 16 is a flowchart of the two-dimensional map display process according to the embodiment of the present invention, which is executed by the information terminal 12.

 First, in the two-dimensional map display process, a set of stroke sets for executing the display process is set (S 1 5 1). Specifically, a keystroke set set is set for set K, a set of two-dimensional map display strokes is set for set A, and an attention stroke set set is set for set F.

 The keystroke set (set) is a set that satisfies the security conditions (passed through the stroke set filtering process) among all the stroke sets included in the specified document. The 2D map display stroke set set (set A) is the set generated in step S 1 2 4 of the stroke set tabulation process (FIG. 14). The target stroke set set (set F) is a stroke set specified as a search key, and is included in the keystroke set.

 Next, the stop set information 24 included in the set A (two-dimensional map display stroke set set) is collected for each user ID 2 4 2 (S 1 5 2).

 Next, the horizontal axis of the two-dimensional map is set (S 1 5 3). The user can specify what to display the 2D map on the horizontal axis, but it can also set it automatically. For example, the horizontal axis of a 2D map can be time. The horizontal axis of the 2D map can be the number of characters (or lines) from the beginning of the document.

 Also, the horizontal axis may display all of the conference start time to end time, or a part of the conference time may be extracted and displayed. For example, you can automatically set the horizontal scale so that the number of stroke sets included in one 2D map is within a specified range.

Further, the horizontal axis may display all the start time and end time of the conference, and the stroke set display 3 4 4 may be highlighted. For example, if the meeting time is long, each stroke set display 3 4 4 becomes thin, making it difficult to see. If this is the case, Set display 3 4 4 is deformed and displayed. More specifically, a predetermined multiplier X may be determined, and the stroke set display 3 4 4 may always be displayed with the width multiplied by X. The stroke set display 3 4 4 may be expanded to 10 dots only when the width is 10 dots or less.

 Next, the stroke set included in the set (keystroke set set) is displayed at the top of the two-dimensional map (S 1 5 4).

 Next, the vertical axis of the two-dimensional map is set (S 1 5 5). Specifically, the owned users I D in the set A are arranged in the descending order of the degree of overlap in the horizontal axis direction with the stroke set included in the set K (for example, in the order in which the overlapping time is long). In this overlap determination, a relationship in which one is included in the other may be determined as overlap. When determining the overlap of two stroke sets, the overlap may be determined after adding a certain amount of time (for example, 30 seconds before and after) to each stroke set.

 Next, the third loop is started (S 1 5 6). In this third loop, processing is performed for each user ID for the queue set included in the set A. Here, the user IDs are arranged in the order close to the keystroke in the setting of the vertical axis (S 1 5 5). First, a set of stroke sets is generated for each user ID.

 Then, in the third loop, each stroke set included in the stroke set set of the same user ID is displayed at the corresponding event progress position on the same stage (S 1 5 7). After that, proceed to the next level display and process the stroke set for the next user ID (S 1 5 8)

 When the process is completed for each user ID for all stroke sets included in the set A, the third loop is terminated (S 1559).

 After that, the position corresponding to the target stroke set is highlighted and displayed on the two-dimensional graph (S 1 60).

FIG. 17 is a flowchart of the statistical graph display process according to the embodiment of the present invention, which is executed by the information terminal 12. First, in the statistical graph display process, a set of stroke sets for executing the display process is set (S 1 7 1). Specifically, a keystroke set set is set in set K, a set of statistical graph display stroke sets is set in set A, and an attention stroke set set is set in set F.

 The keystroke set set (set K) is a set that satisfies the security conditions (passed through the stroke set finalizing process) among all the stroke sets included in the specified document. The statistical graph display stroke set set (set A) is the set generated in step S 1 25 of the stroke set tabulation process (FIG. 14). The attention stroke set set (set F) is a stroke set designated as a search key, and is included in the key stroke set. Next, the horizontal axis of the statistical graph is set (S 1 7 2). The user can specify what to display the statistical graph on the horizontal axis, but based on the number of stroke sets included in one statistical graph (the stroke set included in one statistical graph). You can set the horizontal axis automatically so that the number of ridges is close to the specified number). Also, the horizontal axis may be equal to the 2D map.

 For example, the horizontal axis of a statistical graph can be time. The horizontal axis of the statistical graph can be the number of characters (or the number of lines) from the beginning of the document.

Next, each stroke set included in set A is aggregated on the set horizontal axis to create a histogram (S 1 7 3) ₀ At this time, the bin width of the histogram may be determined appropriately. For example, the bin width is determined so that the histogram changes smoothly.

 Next, the created histogram is displayed (S 1 7 4).

 After that, the position corresponding to the target stroke set is highlighted on the two-dimensional graph (S 1 75).

FIG. 18 is a flowchart of the co-occurrence statistical graph display process according to the embodiment of the present invention. And executed on the information terminal 1 2.

 First, in the co-occurrence statistical graph display process, a set of stroke sets for executing the display process is set (S 1 8 1). Specifically, a keystroke set set is set in set K, a stroke set set for 2D map display is set in set A, and a focus stroke set set is set in set F.

 The keystroke set set (set K) is a set that satisfies the security conditions (passed through the stroke set filtering process) among all the stroke sets included in the specified document. The 2D map display stroke set set (set A) is the set generated in step S 1 2 4 of the stroke set tabulation process (FIG. 14). Also, the target stroke set set (set F) is a stroke set specified as a search key, and is included in the key stroke set.

 Note that the co-occurrence statistical graph display process uses only information that does not hide the owning user, so it is used for 2D map display that includes a stroke set whose fourth digit of the restriction information is “2” or “1”. Use a stroke set set.

 Next, the horizontal axis of the co-occurrence statistics graph is set (S 1 8 2). The user can specify what to display the co-occurrence statistics graph on the horizontal axis, but based on the number of stroke sets included in one co-occurrence statistics graph (one co-occurrence statistics The horizontal axis may be set automatically so that the number of stroke sets included in the graph is close to the specified number). Also, the horizontal axis may be equal to the 2D map.

For example, the horizontal axis of the co-occurrence statistics graph can be time. The horizontal axis of the co-occurrence statistics graph can be the number of characters (or the number of lines) from the beginning of the document. Next, among the stroke sets included in set A, only those that overlap with the stroke set included in set F are collected. In this duplication determination, a relationship that overlaps within a predetermined width range may be determined as duplication. After that, the collected stroke sets are totaled on the set horizontal axis, and a histogram is created (S 1 83). This The bin width of the histogram can be determined as appropriate. For example, the bin width is determined so that the histogram changes smoothly.

 Next, the created histogram is displayed (S 184).

 After that, the position corresponding to the target stroke set is highlighted on the co-occurrence statistics graph (S185).

 FIG. 19 is a flowchart of the security check process according to the embodiment of the present invention, which is executed by the content server 11 (101 2 and 1014 in FIG. 12).

) o

 First, security check parameters are input to the security check process (S 191). Specifically, the security level of the document or additional information, the searcher ID and attendees are given to the security check process. The security level given to the security check process is the security level set in the document or additional information identified as relevant as a result of the search. The searcher ID is a user ID 271 input to the information terminal 12 for the searcher to log in to the document management system.

 Also, the attendee is the attendee 214 B identified in the event information by identifying the event ID 223 based on the document and the target additional information.

 Next, it is determined whether or not the searcher's user ID 271 is included in the attendee 214 B (S 192).

 As a result of the determination, if the searcher's user ID 271 is included in the attendee 214 B, it is determined that the searcher is an attendee. Then, it is determined whether or not the security level S is a level that can be disclosed to attendees (S 193).

As a result, if security level S can be disclosed to attendees, it is determined that the document and / or additional information can be disclosed (S 1 94). On the other hand, if the security level S cannot be disclosed to attendees, it is determined that the document and Z or additional information are not disclosed (S 1 95). On the other hand, if the user ID 2 7 1 of the searcher is not included in the attendee 2 1 4 B, it is determined that the searcher is a non-attendant. Then, it is determined whether or not the security level S is a level that can be disclosed to non-attendants (S 1 96).

 If the security level S can be disclosed to non-attendants as a result of the determination, it is determined that the document and / or the additional information can be disclosed (S 1 97). On the other hand, if the security level S is a level that cannot be disclosed to non-attendants, it is determined that the document and / or additional information are not disclosed (S 19 8).

 In this way, in the security check process of this embodiment (Fig. 19), different security levels are set for attendees and non-attendants, and the disclosure of documents and / or additional information is controlled. be able to.

 The series of processes executed in the information terminal 12 can be easily summarized in the flowchart of FIG. Hereinafter, the processing at the information terminal 12 will be described again with reference to FIG.

 First, information for identifying an event is input to the 2D map display process (S 1 4 1). Specifically, the user selects the position of the annotation (stock set) with the digital pen 14. Then, the digital pen 14 finds the absolute coordinates of the specified position. The digital pen 14 transmits the pen ID and the obtained absolute coordinates and the Ben ID to the information terminal 12. When the information terminal 12 acquires the absolute coordinates from the digital pen 14, the information terminal 1 2 makes an inquiry to the position information server 19 to determine the position (dot pattern ID) of the paper surface in the vast plane area and the coordinates (relative Get the coordinates).

 Next, the information terminal 12 specifies the event ID (S 1 4 2).

Specifically, the information terminal 12 transmits the dot pattern ID acquired from the location information server 19 to the content server 11. The content server (document management program 1 1 5) searches the distribution material information 2 2 based on the dot pattern ID sent from the information terminal 1 2, and identifies the document matching the dot pattern ID 2 2 1. The Then, the content server 11 transmits the event ID 2 2 3 associated with the identified document to the information terminal 12.

 Next, collect all stroke sets in the event (S 1 4 3).

 Specifically, the information terminal 12 sends the identified event ID to the content server 11. The content server (pen data management program 1 1 6) searches the stroke set information 24 by the event ID transmitted from the information terminal 12, and identifies the stroke set matched by the event ID 2 47. Then, the content server 11 transmits the specified stroke set information to the information terminal 12.

 Here, if necessary, check the security level assigned by the creator of each stroke set and the searcher ID for information that the creator of the stroke set restricts disclosure. In some cases, information is concealed or anonymized. If the stroke set information can always be disclosed to an unspecified number of searchers, the above processing is unnecessary.

 Note that the content server 1 1 power event ID (S 1 4 2) and the collection of token sets (S 1 4 3) can be processed together. That is, when the information terminal 12 transmits the dot pattern ID acquired from the location information server 19, the information terminal 12 obtains a stroke set from the content server 11.

 Further, the content server 11 may make an inquiry to the location information server 19. That is, when the information terminal 12 transmits the absolute coordinates acquired from the digital pen 14, it obtains a stroke set from the content server 11.

 Next, the information terminal 12 classifies the collected stroke set information according to the user ID 2 4 2 (S 1 4 4).

 Next, the second loop is started (S 1 4 5). In this second loop, the classified stroke set is processed for each user ID.

And in the second loop, it is included in the stroke set set of the same user ID. Each stroke set to be displayed is displayed at the corresponding event progress position on the same stage (S 1 4 6). After that, proceed to the next line display and process the stroke set for the next user ID (S 1 4 7)

 When the processing is completed for each user ID for all the stroke sets included in the set A, the second loop is ended (S 1 4 8).

 As described above, in FIG. 15, the method of specifying an event by specifying a stroke set using the digital pen 14 has been described, but an event can also be specified by other methods.

 As a first modification, there is a method in which the user inputs a stroke set selection operation to the operation input unit 1 2 4 of the information terminal 12.

 For example, the user displays the document on the document display section (3 2 0 in FIG. 2) of the display screen of the information terminal 12. At this stage, no events related to the document have been identified. Then, an operation input unit (for example, a mouse) of the information terminal is operated to select an annotation (stroke set) on the document displayed on the document display unit 320.

 Then, the information terminal 12 transmits the designated position (relative coordinates) on the document and the document ID to the content server 11. The content server (document management program 1 1 5) searches the distribution material information 2 2 by the document ID transmitted from the information terminal 1 2, and identifies the document that the document ID 2 20 matches. Then, the content server 11 sends an event ID 2 2 3 associated with the identified document to the information terminal 12.

As a second modification, there is a method of directly specifying a video file or the like. For example, the user displays the content on the media display section (3 0 0 in FIG. 2) of the display screen of the information terminal 12. At this stage, no event related to the content has been identified. Then, by operating the operation input unit (eg, keyboard) of the information terminal, the file name of the content displayed on the media display unit 300 To get.

 Then, the information terminal 12 transmits the file name of the acquired content to the content server 11. The content server (event management program 1 1 4) searches the event information 21 based on the file name transmitted from the information terminal 12, and identifies the event that matches the file name and the additional information 2 1 7 B. Then, the content server 11 transmits the identified event identifier (event ID 2 23) to the information terminal 12.

 At this stage, the keystroke set and document are not displayed because the keystroke set is not selected.

 As described above, in the embodiment of the present invention, the content server 11 is set with a link to additional information related to the event (content such as video and audio at the time when the annotation is added). Store the annotation given to the document. Then, an annotation created by a specific person is designated, and related additional information and annotations are searched and displayed.

 As a result, annotations created by different persons at events such as conferences are aggregated from the two points of annotation creation time and annotation creator. Then, by displaying the aggregated results, you can find people with the same viewpoint.

 You can also find places that others have noticed. In addition, you can find another location that is related to the location you are interested in.

 Also, disclosure restrictions information is set for each annotation. Since many annotations do not want to be disclosed, it is possible to manage annotations with consideration of disclosure restrictions.

In other words, searchers can only search for information that can be obtained with their authority. For example, restrict people who did not participate in the conference to search for information about other participants even if they specify annotations on the notes of those who participated in the conference with their pens be able to.

 Also, since annotations are classified by owner and displayed in the order of event progress, the relationship between a handwritten memo of a specific person (for example, oneself) and a handwritten memo of another person can be easily grasped. In particular, many people can find out where an annotation was granted. In addition, the annotation related to the specified annotation is known.

 In particular, since the annotations classified by owner are displayed in the order of time during the event, it is possible to know the person who gave the annotation at the same time as the specified annotation.

 In addition, since the information is displayed in relation to the positions in the distribution materials of the annotations classified by owner, it is possible to know the person who gave the annotation to the same position as himself.

 In addition, since the annotations related to (co-occurring with) the specified annotation are extracted and displayed, the person who created the annotation in the scene where the specified annotation was generated creates the annotation in any other scene. You can know if you are.

Industrial applicability

 INDUSTRIAL APPLICABILITY The present invention is useful for a system for managing information recorded on paper and electronic data, and is particularly suitable for a document management system.

Claims

The scope of the claims

 1. a terminal connected to a content server for storing data and inputting / outputting the data;

 The content server has a storage unit for storing document data and stroke information,

 The document data includes information printed on paper used by the user at the event,

 The stroke information includes a position specified on the paper surface related to the document data and a time when the position is specified,

 The terminal is

 Based on the information that can identify the event, the stroke information created in relation to the event is acquired from the content server,

 For each user who created the acquired stroke information, the stroke information is classified,

 The classified stroke information is displayed according to the progress of the event.

2. The terminal according to claim 1, wherein the classified stroke information is displayed according to a time at which the stroke information is created.

3. The terminal according to claim 1, wherein the classified stroke information is displayed in accordance with a position of the stroke information in the document data.

4. The terminal according to claim 1, wherein

The information that can identify the event is the stroke information, The terminal

 Based on the selected stroke information, the event related to the selected stroke information is identified,

 Determining for each user the degree of overlap between the creation time of the selected stroke information and the creation time of other stroke information,

 The classified stroke information is displayed in the order of the determined users with the highest degree of duplication.

5. The terminal according to claim 1, wherein

 The information that can identify the event is the stroke information,

 刖 End of ¾

 Based on the selected stroke information, an event related to the selected stroke information is identified,

 Aggregate other stroke information created at the same time as the selected stroke information,

 The total number of stroke information is displayed according to the progress of the event.

6. The terminal according to claim 1, wherein the stroke information includes disclosure restriction information of the stroke information.

7. The terminal according to claim 6, wherein, when the stroke information is disclosed, the disclosure restriction information indicates a person who created the stroke information, and discloses a person who created the stroke information. It is characterized by including at least one of the following three types: Anonymously disclosed or those who have created the stroke information are not disclosed.

8. A content server connected to a terminal for inputting / outputting data and storing the data,

 The content server has a storage unit for storing document data and stroke information,

 The document data includes information printed on paper used by the user at the event,

 The stroke information includes a position specified on the page related to the document data, a time when the position is specified, event information related to the stroke information, and disclosure restriction information of the stroke information. It is characterized by that.

9. A content server according to claim 8, wherein

 There are three types of disclosure restriction information: the person who created the stroke information is disclosed, the person who created the stroke information is anonymously disclosed, or the person who created the stroke information is not disclosed. Including at least one of

 The content server

 If the disclosure restriction information does not disclose the person who created the stroke information, the information of the person who created the stroke information is concealed and transmitted to the terminal, and the disclosure restriction information If the created person is anonymously disclosed, the information of the person who created the stroke information is anonymized and sent to the terminal.

 If the disclosure restriction information discloses the person who created the stroke information, the information of the person who created the stroke information is transmitted to the terminal as it is.

1 0. The content server according to claim 8,

The person who requested the aggregation of stroke information related to the event Determine if you are an attendee,

 If the requester is an attendee of the event, whether or not the stroke information can be disclosed is determined based on the disclosure restriction information for the attendee of the stroke information, and the requester is not an attendee of the event. It is characterized in that whether or not the stroke information can be disclosed is determined based on the restriction information for the non-participants of the stroke information.

1 1. An information display method used for an information management system comprising a content server for storing data and a terminal for inputting / outputting the data,

 The content server has a storage unit for storing document data and stroke information,

 The document data includes information printed on paper used by the user at the event,

 The stroke information includes a position specified on the paper surface related to the document data and a time when the position is specified,

 刖 言 己 ΐ¾ 未 は 、

 Based on the information that can identify the event, the stroke information created in relation to the event is acquired from the content server,

 For each user who created the acquired stroke information, the stroke information is classified,

 The classified stroke information is displayed according to the progress of the event.

1 2. The information display method according to claim 1 1,

 The terminal

Based on the selected stroke information, the selected stroke information Identify the events involved,

 The degree of duplication between the creation time of the selected stroke information and the creation time of other stroke information is determined for each user,

 The classified stroke information is displayed in the order of the determined users with the highest degree of duplication.

1 3. The information display method according to claim 1 1,

 Eye ij diffi end

 Based on the selected stroke information, an event related to the selected stroke information is identified,

 Aggregate other stroke information created at the same time as the selected stroke information,

 The total number of stroke information is displayed according to the progress of the event.

 ,

 14. The information display method according to claim 11, wherein the stroke information includes event information related to the stroke information and disclosure restriction information of the stroke information.

1 5. The information display method according to claim 14, wherein the disclosure restriction information discloses the person who created the stroke information, discloses the person who created the stroke information anonymously, or It contains at least one of the following three types, which do not disclose the person who created the stroke information.

1 6. The information display method according to claim 15,

The content server If the disclosure restriction information does not disclose the person who created the stroke information, the information of the person who created the stroke information is concealed and transmitted to the terminal, and the disclosure restriction information is sent to the stroke. If the person who created the information is anonymous, if it is, the information of the person who created the stroke information is anonymized and sent to the terminal, and the disclosure restriction information discloses the person who created the stroke information Then, the information of the person who created the stroke information is transmitted to the terminal as it is.

1 7. The information display method according to claim 1 1,

 It is determined whether the person who requested the aggregation of the stroke information related to the event is an attendee of the event,

 If the requester is an attendee of the event, whether or not the stroke information can be disclosed is determined based on the disclosure restriction information for the attendee of the stroke information, and the requester must be an attendee of the event. For example, whether or not the stroke information can be disclosed is determined based on the restriction information for non-participants of the stroke information.