JP2005352923A - Device and method for storing information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To store information which is extremely useful to an individual. <P>SOLUTION: An information storage device 1 is provided with an annotation button 44 indicating that information is characteristic for a user and then an annotation can be added to experience information for the user which is obtained from a GPS 41, a CCD 42, or a microphone 43. Once the annotation is added, an object as contents for presentation is generated from contents nearly at the time when the annotation is added. For example, when the user presses the annotation button 44 for an experience A, time information and GPS information are added as an annotation A to part of contents being acquired at the time. Thus, the annotation can be added to the experience information being recorded, and then experience information can be classified into user's categories and stored. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information storage device and an information storage method, and more particularly, to an information storage device and an information storage method for storing information related to an event experienced by a user and an annotation privately required by the user in association with each other. .

  2. Description of the Related Art In recent years, an environment in which a vast amount of information can be provided and obtained has been improved due to the development of a network such as the Internet and the spread of a large-capacity recording medium. Along with this, various information providing services have been proposed, and these information providing services have been devised in various ways to handle a large amount of information efficiently and effectively. One of the important factors is how to efficiently provide information that an individual needs from a vast amount of information.

  As an example, the information providing side characterizes each individual by extracting the personal preference of the user who is the providing destination, and provides information and services that match this (a personal information provider). )). This is adopted for an online service or the like that can purchase goods from a site on a network, for example.

  In a service that allows you to purchase books on the network, by introducing information personalization, when a user purchases a book, a function that presents a recommended book from the work list of the author of the purchased book, the same book as this user A function of presenting other books purchased by other user groups who purchased the product, a function of notifying other users of information that the user thinks useful, and the like are realized. In addition, the side receiving information (the side viewing information) can customize (change) the operating environment, settings, and the like according to individual user preferences. The customization includes, for example, a function of changing the responsiveness of the mouse and changing the color scheme and font of the window according to personal preference in an electronic device such as a personal computer or a portable personal information terminal. As described above, a system that can use information efficiently and effectively by performing personalization and customization of the information is already known.

  Also, as an advanced form of personalization, technology that profiles user behavior on the network in real time, technology that provides user-preferred GUIs by learning user behavior, and monitoring user reactions Therefore, a technique for observing the user's preference and response to the content recommended by the agent is considered.

  As described above, it is now possible to provide so-called push-type information that provides optimal information suitable for a user who wants information or services, and for the information receiving side, desired information is provided. Can now be easily obtained.

  However, in order to realize personalization that matches the provided information to each individual, the information provider collects personal level information through questionnaires such as paper and websites, and the user's action history ( In the example of the book, it is necessary to collect purchase history and the like.

  For example, some information services using the Internet have already used information on rates, atmosphere, service contents, etc. related to wedding ceremony / banquet halls, English conversation classes, various culture schools, etc. By using a questionnaire, etc. and applying the collected results to a predetermined rule, information that matches them, that is, information about the facility and experience information from the user will be displayed together on the display screen, so that it will be used in the future. There is a service that provides a judgment material for determining a facility or a provider to the one to be performed (for example, see Patent Document 1).

  In this information providing service, when the information is made available among a plurality of users, when the user publishes the experience data, the user can provide the information according to the experience level, and the user who searches for information has high accuracy. By visualizing the collected experience data of each user so that the information or information close to the desired information can be acquired, the search operation step for searching for the desired information from a lot of character information can be simplified. Yes.

  In the technique described in Patent Document 1, much of the information collected from users who have already used the wedding / banquet hall is character information, and the user attaches importance to the provided character information. It is difficult to immediately recognize whether or not information content is included. Therefore, in the conventional system, the user has to read a lot of character information that is not originally required, and it may be difficult for the user to find the information that is required. In addition, many personalization technologies for matching provided information to each individual are information providers who use the technology to extract user preference models. Although personalized services can provide services that are tailored to individual users, the same information is provided for multiple users with similar preferences. It was not always possible to reflect the fine palatability of users. In addition, there is a problem that information (events) related to individual behavior cannot be used.

JP 2003-16202 A

  The present invention manages information related to events experienced by the user so that it can be stored and read efficiently, so that the response is better than the keyword search method in the network, and the desired information is selected from the extracted information. An object of the present invention is to provide an information storage device and an information storage method that can efficiently extract information that is highly effective for an individual.

  In order to achieve the above-described object, an information storage device according to the present invention stores information acquisition means for acquiring experience information related to an event experienced by a user, and experience information acquired by the information acquisition means. Accumulation means, annotation information input means for inputting annotation information to be annotated with respect to the experience information acquired by the information acquisition means, and experience information to which the annotation information is added by the annotation information input means are extracted to present content for presentation The presentation content generation means to be generated, the presentation content list storage means for storing the generated presentation content and the annotation information in association with each other, and the experience information as the information acquisition means have been acquired. When the annotation information is input by the annotation information input means, the presentation content generation means is instructed to generate the presentation content Presentation content list creation control means for performing control for storing the generated presentation content together with annotation information in the presentation content list storage means, search input means for inputting search conditions as annotation information by the user, and user Information presenting means for presenting the search result to the user, and search control means for extracting the experience information corresponding to the annotation information as the search condition inputted by the search input means from the presentation content list storage means and presenting it to the information presenting means With.

  Thereby, the information storage device according to the present invention enables annotation information indicating characteristic information for the user to be added to the acquired experience information for the user, and stores the annotation information using the annotation information. Specific information is extracted from the content that has been recorded. Here, time information and position information are used as the annotation information input by the annotation information input means. The presentation content is obtained by extracting a period before and after the time when the annotation information is input based on the time information for a predetermined period. Since the annotation information can be added to the acquired experience information, the experience information can be classified and stored in a category unique to the user.

  In order to achieve the above-described object, an information storage method according to the present invention includes an information acquisition step of acquiring experience information related to an event experienced by a user, and the experience information acquired in the information acquisition step is stored in a memory. Content for presentation, extracting the annotation information added in the annotation information input step, the annotation information input step in which the annotation information for the experience information acquired in the information acquisition step is input, and the content for presentation A presentation content generation step for generating the content, a presentation content list storage step for storing the generated presentation content and the annotation information in association with each other in the presentation content list memory, and a search condition by the user Search input process in which is input as annotation information and experience information corresponding to the annotation information as the search condition input in the search input process Extracted from use content list memory and an information presenting step of presenting to the user.

  Thus, the information storage method according to the present invention allows annotation information indicating characteristic information for the user to be added to the acquired experience information for the user, and stores using the annotation information. Specific information is extracted from the content that has been recorded. Here, time information and position information are used as the annotation information input in the annotation information input step. The presentation content is obtained by extracting a period before and after the time when the annotation information is input based on the time information for a predetermined period. Since the annotation information can be added to the acquired experience information, the experience information can be classified and stored in a category unique to the user.

  According to the information storage device of the present invention, when an event that the user is experiencing is recorded, the experience at that time is classified by the user's category by inputting with the annotation information input means. Can be accumulated. As a result, when the accumulated information is presented to the user, the response is better than using a keyword search method using an Internet search engine, and the process of selecting desired information from the extracted information is also efficient. Information that is more relevant to the individual's behavior and is more profitable for the individual can be extracted.

  The present invention proposes a mechanism for accumulating information related to an event experienced by a user and information required by the user so that the information can be used later. The information storage device shown as a specific example of the present invention can record information around the user. For example, the information storage device includes personal information necessary for the user and characteristic information. In this case, an annotation for this information can be added.

  The annotation shown in this specific example is a mark (hereinafter referred to as a pointer) indicating that it is characteristic information for the user. This pointer is used as a “category” to classify the acquired information. Alternatively, information can be searched using the pointer as one of “search conditions”.

  In a specific example of the present invention, information such as the date and place where the user “experienced” and the video and audio at that time are described as experience information related to the event experienced by the user. The information added by is described as an annotation. Hereinafter, the annotation added by the user to the experience information is referred to as annotation.

  The information storage device shown as an example of the present invention can also present information to which the above-described annotation is added to the user. For example, if the user presses an annotation input button provided as a button for extracting an annotation when information presentation is desired, a part of content to which an annotation has been added in the past can be taken out. Information such as the date / time and location of the information that has previously been added with the same annotation is presented. In addition, based on the annotation input by the user, the information with the annotation can be preferentially presented.

  An outline of an information storage apparatus 1 shown as a specific example of the present invention is shown in FIG. The information storage device 1 includes an information registration unit 10 for an information registration phase for inputting information, means for storing these information, and an information use unit 30 for an information use phase for using the acquired information later. I have.

  The information storage device 1 is input as an information registration unit 10 when adding an information acquisition unit 11 for acquiring experience information related to an experienced event and an annotation that serves as a landmark for the acquired experience information. An annotation input unit 12 used for processing, a data recognition processing unit 13 for recognizing acquired information, a data definition processing unit 14 for classifying recognized data according to a predetermined definition, and data classified according to a definition And a data storage unit 15 to be stored.

  The information acquisition unit 11 has a function of acquiring information around the user, and includes an acquisition unit that can acquire image information, audio information, position information, date and time, such as a camera, a microphone, and a GPS (Global Positioning System) unit. .

  The data recognition processing unit 13 performs processing for extracting specific information from image information, audio information, position information, date and time, etc. acquired by a camera, a microphone, GPS, or the like. The data recognition processing unit 13 includes an image recognition unit 16, a text processing unit 17, and an audio processing unit 18. Image data acquired from the camera is subjected to image recognition processing and image processing by the image recognition unit 16 and the text processing unit 17. Text recognition processing is performed to extract specific image data and text data. If it is voice data acquired from a microphone, the voice recognition unit 19 recognizes the voice, the language processing unit 20 converts the voice information into text data, and the keyword extraction unit 21 extracts a keyword from the converted text data. To do.

  The data extracted by the data recognition processing unit 13 is classified by the data definition processing unit 14 according to a predetermined definition. For example, the definition includes a person image, family, brother, spouse, work relationship, friend, age group, residence area, nationality and other identification information related to this person image, and density determined from image data (high / low) , Type of building identified from image data (type of service industry by signboard, etc.), building name (character string), date and time, weather (clear, rainy, cloudy, etc.), temperature (high / low), humidity (high -Low), wind (strong / weak), location information (latitude, longitude, altitude), nearest station, common name that can be understood only by the user, etc., and the acquired data is classified based on these definitions. The data storage unit 15 stores data classified based on the above definition.

  The information registration unit 10 generates presentation content from recorded information when an annotation is added to the information acquired by the information acquisition unit 11 and stored in the data storage unit 15 by a user input operation. And a data processing unit 22 that creates an annotation list by associating the presentation content and the annotation, and a list storage unit 23 that stores the presentation content and the annotation list created by the data processing unit 22. .

  Next, the case where the user's annotation registered in the information registration unit 10 is used in the information use unit 30 will be described.

  The information storage device 1 includes an information acquisition unit 31 that acquires a current state, a search input unit 32 that receives a search condition, a data recognition processing unit 33 that recognizes the acquired information, and data A search unit 34 that extracts information suitable for the search condition or similar information from the storage unit 15 and an information presentation unit 35 that presents the extracted information to the user are provided.

  The information acquisition unit 31 and the data recognition processing unit 33 acquire and recognize the current location information and other information by the same method as in the information registration phase. Search conditions are input to the search input unit 32 by the user. Examples of input methods include voice input, text input, and image input. If it is input as speech by the search input unit 32, the data recognition processing unit 33 extracts keywords related to time, place, and person from the speech, and if text data is input to the search input unit 32, the data recognition processing unit 33 extracts a keyword from the text, and if image data is input to the search input unit 32, the data recognition processing unit 33 extracts the keyword from the image. Data recorded in the schedule management software can also be used.

  The search unit 34 includes a presentation data reasoning unit 37 that extracts information similar to the search condition from the data storage unit 15, and a presentation data search unit 38 that extracts information that matches the search condition from the data storage unit 15. . When retrieving information from the data storage unit 15, the priority of the content to be presented is determined by referring to the annotation list stored in the list storage unit 23. Content for presentation consisting of text data, voice guidance, image display, or a combination thereof extracted by the search unit 34 is presented to the user by the information presentation unit 35.

  According to the information storage device 1, an event that the user has experienced can be accumulated by the user adding annotations according to the characteristics of the experience. In addition, since the information obtained by searching the data storage unit 15 of this device is information that the user has experienced once, information that is more efficient and more profitable than a keyword search method using a network such as the Internet. It can be taken out.

  A feature of the present invention is that the registered person uses the information managed by the information storage device 1. Therefore, in the system using the information storage device 1 described above, the information obtained by the user through experience, and the annotation that becomes the pointer of this experience information are, for example, the annotation that is attached when eating, or when smoking a cigarette There is no need to decide clearly, such as annotations to be attached. It may simply be a flag added to the experience information. For example, the meaning and category of information extracted by the flag can be easily understood by the user.

  Acquisition of information related to an experienced event is preferably acquired automatically as much as possible using a camera, a microphone, a GPS, or the like, as in the example described above. The information storage device 1 according to the present invention is required because it is actually difficult to consciously leave “memo writing” and “memorandum” for every event experienced by the user. This is because there is a situation that it is sometimes difficult to record the previous experience and to make use of this experience in the current experience even if the situation becomes similar again.

  The following are examples of situations in which an annotation list creation process or update process is performed. For example, (1) processing for creating presentation content when annotation is added to content as experience information acquired in the information registration phase; and (2) presentation content listed in the annotation list to the user. And processing to present. Here, a case where an annotation list is created for “time information” and “position information” among the information stored in the database 53 will be described.

(1) Processing for Creating Presentation Content When Annotation is Added to Content as Experience Information Acquired in the Information Registration Phase Hereinafter, the information storage device 1 shown as a specific example of the present invention will be described with reference to FIGS. Will be described in detail.

  FIG. 2 is a diagram showing an information registration phase and an information use phase performed using the information storage device 1 separately, and FIG. 3 shows a specific configuration of the information storage device 1. FIG. 2 illustrates a case where experience information “a user eats at a restaurant (store)” is recorded. In FIG. 2, in the information registration phase, there is surrounding information when eating at a restaurant and information that the user wants to characterize and record at this time, and an annotation as a mark is added to the characteristic part of the information for the event experienced here. It is a scene to add. The information use phase is a scene in which information obtained by adding annotations to past experiences is retrieved at another opportunity.

  When a user experiences an event, it is important to always have the information storage device 1. Therefore, in this specific example, the information storage device 1 is a portable type. Further, even if the information storage device itself is portable, for example, it can be connected to a device equivalent to a home stationary PC 100 or server device, and the acquired information can be stored in the stationary PC 100 or server device. A configuration is preferable. In this case, a data storage unit that can function as the data storage unit 15 of the information storage device 1 is prepared on the stationary PC 100 or the server device side, and information is exchanged with the information storage device 1 via a wireless or wired communication interface. Can be sent and received.

  As shown in FIG. 3, the information storage device 1 includes a GPS unit 41 that acquires position information, a CCD (Charge Coupled Device) 42 that acquires information around the user, and a microphone 43. These also serve as the information acquisition unit 11 for the information registration phase and the information acquisition unit 31 for the information use phase shown in FIG. The information storage device 1 can automatically acquire image data and audio data without any user operation. The CCD 42 and the microphone 43 acquire data triggered by a change in the environment around the predetermined interval or the user, Storage format data is generated based on the data model, and this data is stored in a database 53 to be described later. For example, when a sudden loud sound is detected or a keyword specified by the keyword extraction unit 51 described later is detected, the trigger for database creation is used. In the description of this specific example, information about the user's experience acquired by the information acquisition unit 11 in this way is referred to as experience information as necessary.

  The information storage device 1 also includes an annotation button 44 as an annotation input unit 12 for performing an input operation for a user to add an annotation to the stored information, a search input in the information use phase, and an operation input of this device. An operation input unit 45 is provided. The content to which the annotation is added is content acquired by the information acquisition unit 11. Examples include audio data acquired by the microphone 43 shown in FIG. 3, image data acquired by the CCD 42, and the like. Also, GPS information when the annotation button 44 is pressed is added at the same time.

  The operation input unit 45 selects a search mode or a recording mode, and further selects an automatic search mode or a manual search mode. The operation input unit 45 may be a touch panel type input unit combined with an LCD 54 as a display unit, or may be a method of selecting a GUI displayed on the LCD 54.

  Note that the information storage device 1 may include a configuration for acquiring weather information such as temperature, humidity, and weather in addition to the configuration described above as a configuration corresponding to the information acquisition unit 11. As a method for acquiring the position information and the weather information, for example, in addition to the base station information periodically transmitted from the base station, which is already realized by a mobile phone, the position information and the weather information are periodically transmitted. There is a method of distribution. The information storage device 1 may be provided with a simple temperature sensor and humidity sensor.

  The information storage device 1 includes an image recognition unit 46, a text recognition unit 47, and a voice recognition unit 48 that recognize the acquired image data, text data, and voice data. The image recognition unit 46 performs image recognition processing on the image data acquired from the CCD 42, for example, performs processing for recognizing and extracting a human face portion. In addition, the text recognition unit 47 performs text recognition processing on the image data acquired from the CCD 42, and recognizes a character string or a symbol in the image like a character such as a signboard to recognize a building or a sign. A process of extracting the name as text data is performed. The voice recognition unit 48 includes a voice recognition processing unit 49, a language processing unit 50, and a keyword extraction unit 51. The voice recognition processing unit 40 performs voice recognition processing on the voice data acquired from the microphone 43, and the language processing unit 50. The voice information is converted into text data at, and the keyword extraction unit 51 extracts keywords from the converted text data.

  The information storage device 1 also includes a data definition processing unit 52 that defines data extracted from the image recognition unit 46, the text recognition unit 47, and the voice recognition unit 48. The data definition processing unit 52 corresponds to the data definition processing unit 14 for the information registration phase and the search unit 34 for the information use phase. The data definition processing unit 52 classifies the extracted data according to a predetermined definition or sets it as a search condition. In response, information is retrieved from the database 53.

  For example, in the information storage device 1, image data and text data describing information on the image data are registered in the database 53. For example, a friend's name, address, contact information, age, and the like are stored in association with image data of a person's face. In addition, if there is information on the person, such as family, brother, spouse, work-related person, friend, etc., they are stored together. A person, type of building, name of building (character string), and the like determined from the image data, text data, and voice data extracted by the image recognition unit 46, the text recognition unit 47, and the voice recognition unit 48 are stored in the database 53. Compared with the stored data, it is classified and accumulated as new data. The definition includes the position information (latitude, longitude, altitude), date / time data, weather information (sunny, rainy, cloudy, etc.), temperature (high / low), humidity (high / low), wind (strong / high). Weak), nearest station, popular name that can be understood only by the user, evaluation value, evaluation target (location conditions, evaluation of store clerk, evaluation of products, store atmosphere, pricing, serving time, other conditions, etc.) The acquired information is classified based on these definitions.

  After acquisition, the defined data is model-converted according to the data model and stored in the database 53 using a database management system (DBMS). Examples of model conversion include, for example, a method of defining each data in a tabular format and managing it using a relational database (RDB) as a DBMS, or classifying each data using RDFs / OWL and using RDFDB or XMLDB as the DBMS There is a method to manage. The presentation content generated by adding information and annotations related to the events experienced by the user stored in the database 53 may be edited later by the user's intention.

  In addition, the information storage device 1 includes an LCD 54 as a display unit, a display device 55, a speaker 56, and an audio output device 57 as a configuration for presenting information to the user.

  The information storage device 1 includes a data processing unit 59 for creating an annotation list and presentation content. The data processing unit 59 extracts part of the information specified by the annotation input by the user to create a presentation content, and creates an annotation list by associating the created presentation content with the annotation. Further, the data processing unit 59 functions as the search unit 34. The data processing unit 59 automatically extracts presentation content with annotations added from the acquired position information and time information, and is similar to the search conditions when an annotation that the user wants to search is input. A process for extracting the presented content, a process for editing the annotation list and the presented content, and the like are executed.

  The data processing unit 59 acquires the user with the “experience that has occurred” and records the information as experience information recorded in the database 53 to the user including information before and after the time when the annotation is input. A presentation content to be presented is created. Then, an annotation list in which the annotation and the presentation content are associated is created. The annotation list created by the data processing unit 59 is stored in the annotation list storage unit 60. The presentation content created by the data processing unit 59 is registered in the presentation content list 61.

  Each configuration described above is centrally controlled by the control unit 58 including a CPU, a ROM storing processing programs, and a RAM as a work area of the CPU.

  Next, the annotation button 44 will be described with reference to FIGS. As shown in FIG. 4, the information storage device 1 includes an annotation button 44 on the side or front. A plurality of annotation buttons 44 may be provided so that a plurality of annotations can be distinguished and designated. In consideration of user operability, buttons for inputting the same annotation may be provided at a plurality of locations. The installation position of the annotation button 44 is not limited to the type shown in FIG. 4, and may be the back surface of the information storage device 1, for example. When the size of the information storage device 1 increases to some extent, the annotation input unit can be separated from the main body of the information storage device 1 and provided as an independent input device including a button and a display unit. In this case, it is possible to communicate with the main body device by wireless communication or the like.

  FIG. 5 shows an input device of a type in which the annotation input unit is made independent. The independent annotation input device 440 shown in FIGS. 5A to 5D includes an annotation button 44 and a display panel 441 capable of displaying simple text data and the like. An annotation input device 440 shown in FIGS. 5A and 5B is a type provided with one annotation button 44. The annotation button 44 may be provided on the same surface as the display panel 441 as shown in FIG. 5A or may be provided on the side surface with respect to the display panel 441 as shown in FIG. Also, the annotation input device 440 shown in FIGS. 5C and 5D is a type including a plurality of annotation buttons 44. A type in which a plurality of annotation buttons 44 are provided on the same surface as the display panel 441 as shown in FIG. 5C, and a type provided on the side surface with respect to the display panel 441 as shown in FIG. ing.

  Also in the independent annotation input device 440, the installation position of the annotation button 44 is not limited to the illustrated type. What is necessary is just to provide in the location which considered the operativity of the user.

  FIG. 6 shows a configuration of an independent type annotation input device 440 in which the annotation input unit is independent from the information storage device. The annotation input device 440 includes a liquid crystal display panel (LCD) 441 as a display unit, a display device 442, a communication interface 443 for communicating with the main device, an annotation button 44, and input detection. An annotation input unit 12 including a unit 444 is provided. Detection of input to the annotation button 44 and communication between the main body apparatus are controlled by the control unit 445.

  By pressing the annotation button 44 described above, the user can add an annotation to information that is particularly useful to the user among the contents being acquired in the configuration as the information acquisition units 11 and 31. The annotation added by the user when the experience information acquired from the GPS 41, the CCD 42, and the microphone 43 is accumulated in the database 53 described later will be described with reference to FIG.

  When one annotation button 44 is provided and one annotation is assigned to the annotation button 44, an annotation added by the annotation button 44 is shown in FIG. FIG. 7B shows annotations added by a plurality of annotation buttons 44 when a plurality of annotation buttons 44 are provided and different annotations are assigned to the individual annotation buttons 44. Time information and position information are used as annotations that serve as pointers indicating characteristic information for the user. That is, when an annotation is added, time information when the user operates the annotation button 44 and its position information are added to the content being acquired. For example, if the time information is 1:23:45 AM on January 1, 2004, the time information is represented as “20040101012345”. As the position information and time information, latitude and longitude sent from a GPS satellite are used. The horizontal axis in the figure represents the positive direction of the time axis of the acquired content.

  As shown in FIG. 7A, for example, when the user presses the annotation button 44 for the experience of A, time information and GPS information are added as annotation A to a part of the content being acquired at that time. The When a plurality of annotation buttons 44 are prepared, as shown in FIG. 7B, the annotation buttons are assigned to experience A, experience B, and experience C, and the user annotates the experience of A. When button A is pressed, time information and GPS information are added as annotation A to a part of the content being acquired at that time. For the experience of B, the time information and GPS information at that time are added as the annotation B, and for the experience of C, the time information and GPS information at that time are added as the annotation C.

  The data processing unit 59 may calculate the annotation tendency by statistically automatically organizing the information with the annotation according to the position information or the time information. This makes it possible to classify annotations statistically into a certain group. In this way, a plurality of annotations can be input with one annotation button. In this method, the accuracy of classification is improved according to the number of input annotations.

  Details of processing for adding annotations to recorded content will be described later. In this way, if an annotation can be added to the recorded content, the information with the annotation can be easily searched in the search.

  The experience used for the description here includes actions determined by the user as annotations, information determined by the user as annotations, and the like. For example, “I listened to the music I was interested in”, “I smoked”, “I met Mr. XX”, “I received a call from Mr. XX”, “I ate”, etc. If the annotation A is “smoking”, the user can know the content acquired at the location and time of smoking by searching for the annotation added to the recorded content.

  Since the information input by the annotation button 44 may be a simple mark for the recorded content, it is not necessary to set the meaning of the annotation input by the annotation button 44 on the information storage device. Therefore, for example, when the annotation input device 440 includes a plurality of buttons, the user assigns the annotation “smoking” to the button A, assigns the annotation “meal” to the button B, and assigns the annotation “shopping” to the button C. This setting operation need not be performed on the information storage device 1 or the annotation input device 440 in advance. The user can use which button to use in which situation or for which experience information. Of course, what the annotation added by the annotation button 44 to the information storage device 1 or the annotation input device 440 may be set for the device. In this case, what is assigned to the annotation button 44 is displayed on the LCD 441.

  Next, an example of the presentation content and annotation list created by the data processing unit 59 will be described with reference to FIGS.

  The annotation list will be described with reference to FIG. The annotation list is stored in the annotation list storage unit 60. The memory area of the annotation list storage unit 60 is partitioned into an array of M × N elements (hereinafter referred to as a large area), and one of the M × N elements is further partitioned into an m × n array. (Hereinafter referred to as the middle region). And the bit showing the presence or absence of the content for presentation is provided. If presentation content is prepared, that is, if an annotation is added, 1 is set, and if no annotation is added, 0 is set. Further, an array describing time information for one element in the middle region is determined. Administrative divisions such as countries, prefectures, and municipalities, divisions within specific regions, company branches, school campuses, and the like can be assigned to large or middle regions. For example, the Tokyo 23 wards can be a large area, and a predetermined number of areas divided from the latitude and longitude can be a middle area. As shown in FIG. 8, the annotation list is associated with position information and time information and arranged in this order. Further, the number of times may be described in correspondence with the elements in the middle region.

  The presentation content will be described with reference to FIG. In FIG. 9, content 530 as a series of experience information recorded in the database 53 is represented in time series. An annotation is added to the recorded content 530. Here, it is assumed that the information storage apparatus 1 is a type in which a plurality of annotation buttons 44 are provided, the annotation A is input by the button A, and the annotation B is input by the button B. For inputting an annotation, an annotation input device 440 provided with a plurality of annotation buttons 44 may be used.

  When an annotation is input by the user, the data processing unit 59 obtains content for presentation from a part of the date, time, position, image data, and audio data acquired by the information acquisition unit 12 such as the GPS 41, the CCD 42, and the microphone 43 as needed. Generate. Hereinafter, this presentation content is referred to as an object. When an annotation is added by the annotation button 44, the data processing unit 59 extracts content for a predetermined period before and after the time information described in the memory structure described with reference to FIG. To generate an object as a presentation content. Further, the data processing unit 59 similarly generates an object for the annotation B.

  In this specific example, the data processing unit 59 extracts content for a predetermined period of 5 seconds before and after the time when the annotation A is input, and outputs audio data or video data for 10 seconds before and after the time when the annotation A is added. Prepare as presentation content. In the case of image data, for example, moving image data for 10 seconds may be generated, or still image data for one sheet may be generated per second, and an object may be created by collecting 10 sheets as a group.

  The data processing unit 59 stores the generated object in the object list storage unit 61, and stores address information indicating a storage location or the like in the annotation list storage unit 60 as an annotation list associated with the annotation. An example of the annotation list is shown in FIGS. 10 (a) and 10 (b). 10A shows an example of an annotation list for the annotation added by the button A of the annotation button 44 created in the data processing unit 59. FIG. 10B shows an example of the annotation button 44. An example of an annotation list for the annotation added with the button B is shown. The annotation has a structure linked to the corresponding object by the annotation list. In the annotation list, the bit arrangement shown in FIG. 8 is described in the order of position information and time information. Further, an object number for specifying an object in the database 53, address information where the object is recorded, and the like are described. Yes.

  Next, a process of registering information (experience information) and annotation related to an event experienced by the user using the information storage device 1 described above will be described. When a user eats at a restaurant (store), content related to this experience is recorded, annotations are added, and an object and annotation list are generated based on the added annotations.

  When the user eats at the restaurant 200 with the information storage device 1 carried (experience event: arrow A in FIG. 2), the information storage device 1 uses the audio data and video in relation to the experience of eating at the restaurant. Content such as data and position information is acquired (arrow B in FIG. 2). The experience information is mainly automatically acquired at this time by the information storage device 1. The annotation is input by the user (arrow C in FIG. 2). However, the annotation input may not be simultaneously with the acquisition of information about the experienced event.

  The timing at which content as experience information is acquired may be switched to a mode in which the user automatically acquires the content at a predetermined interval before entering the restaurant 200, but the recording operation may be performed all the time. Further, usually, the user often cannot consciously perform this mode setting operation itself. Since it is desirable that the content related to the experienced event is acquired so that it is not conscious of the user, in this specific example, it is possible to automatically acquire the experience information by using a surrounding situation change as a trigger as much as possible. . For example, assuming that the word “welcome” is defined in advance as a keyword as a trigger for starting recording, when the user enters the restaurant 200 and the information storage device 1 detects the word “welcome”, this is used as a trigger. The information acquisition mode for recording content is entered (step S1 and step S2 shown in FIG. 11).

  The annotation is added to the acquired experience information and stored. The timing at which the user adds an annotation (arrow C in FIG. 2) is during the acquisition of experience information, but it can also be added later in time to the acquired information.

  If a trigger is detected when the information storage apparatus 1 is waiting while starting CCD, GPS, etc. as step S1, it will move to a data creation mode and will acquire experience information in step S2. The experience information acquired in step S2 is recognized and processed after step S3. If it is image data, image recognition processing is executed on the image data acquired from the CCD 42 in step S3. At this time, if it is image data and character information is included in the image, the text recognition unit 47 executes text recognition processing on the image data acquired from the CCD 42 in step S4. It recognizes character strings and symbols in images like characters and extracts the names of buildings and signs as text data. In the case of voice data, in step S5, the acquired voice data is subjected to voice recognition processing in the voice recognition processing unit 40. In step S6, the voice information is converted into text data in the language processing unit 50. The extraction unit 51 extracts keywords from the text data. Since the position information acquired by the GPS 41, GPS data such as date and time data, and text data input from the operation unit 35 can be used as they are, the process proceeds to the next step. The acquired content is classified based on the definition in step S8, and registered in the database 53 in step S9.

  The information storage apparatus 1 determines whether or not an annotation has been input in step S10. If an annotation has been input by the user, the information storage device 1 registers an annotation list and creates an object in step S11. In step S12, the annotation and the object are associated with each other.

  The annotation list registration process in step S12 will be described in more detail with reference to FIG. Since the memory area of the annotation list storage unit 60 is associated with the position information, the data processing unit 59 acquires the position information in step S111 as shown in FIG. In step S112, the data processing unit 59 compares the acquired position information with the bit string A in the large area of the M × N array stored in the annotation list storage unit 60, and the predetermined bit corresponding to the current position information is 1. In step S113, the bit string B in the middle region of the m × n array is checked. If 0 in step S113, the process returns to step S10. In step S113, if the predetermined bit corresponding to the current position information is 1 in the array of the middle region of the m × n array, in step S114, the data processing unit 59 displays the current time information for this element. The described and created object is added to the end of the object list, and the process proceeds to step S12. If the predetermined bit corresponding to the current position information is 0 in the middle area array of the m × n array, 1 is set to the corresponding bit in the middle area list in step S115, and the created object is added to the end of the object list. Then, the process proceeds to step S13.

  The annotation and the object are associated with each other in step S12 and stored in the annotation list storage unit 60 in step S13. In this way, the information storage device 1 can organize and register in the database 53 so that content related to a situation that the user is particularly interested in can be easily searched among the user's experience information.

  An example of the experience information acquired by the process of FIG. 11 is shown in FIG. In the following figure, for the sake of convenience, it is assumed that data is entered only for the part related to the explanation, but other data is also included in the blank part. In FIG. 13, the acquired time information associated with the acquired information number is represented as “200307221730” if it is 17:30 on July 22, 2003, and the position information is “ 605958, 1354536, 546 ″ (latitude 60 ° 59′58 ″, longitude 135 ° 45′36 ″, altitude 546 m). In addition, for example, information on incidental conditions such as weather information transmitted from the base station is added. Furthermore, if there is a fact that has been clarified from information acquired before the acquisition of this experience information, that information is also added. The time information acquired here may be accurate time information included in the GPS data. For example, “2003/07/22 night”, simply “day”, “night”, “holiday”, “weekday” An abstract expression is also included. Similarly, the position information may be represented by a station name, a building name, a facility name, a common name familiar to the user, or the like instead of the latitude and longitude. This is because when the user searches in the information use phase, it can be extracted as information that is easier to understand and use. These pieces of experience information are recorded together with contents such as video and audio acquired by the CCD 42 and the microphone 43.

  As an example, when the user decides to press the annotation button 44 every time he or she smokes, when the annotation button A is pressed, information indicating the time and place of smoking as an annotation for the recorded content is displayed. To be recorded. At this time, an object is created from image data acquired from the CCD 42 of the information storage device 1 and audio data acquired from the microphone during smoking. The created object is content related to the user by the annotation of smoking. By adopting a method of statistically processing the trend of annotation position information and time information and automatically classifying them, a plurality of types of annotations can be input to one annotation button 44. In this method, as the number of objects increases, the tendency of the statistically classified annotation group appears as the number of objects increases, and the accuracy of keywords that group the group improves.

  As described above, by creating an annotation list for each content to which annotations are added among the content registered in the database 53, it is easy to extract user experience information and content related to a characteristic experience from the experience information. can do. Details regarding processing from input of an object to creation of an annotation list will be described later.

  As described above, the most basic method of adding annotation can be realized by automatic detection of experience information and simple annotation input by turning on / off the annotation button 44. For example, the LCD 54 as a display unit, the operation input unit 45, etc. By using together, it becomes possible to input and present more complicated information. In this case, the following registration process is given.

  In the registration process shown in FIGS. 14 and 15, an operation by the user from the annotation button 44 and the operation input unit 45 and an operation of the data processing unit 59 based on the operation are shown.

  When the annotation button 44 is pressed by the user in step S21, the data processing unit 59 receives a detection signal that detects the pressing, and presents a selection menu such as a place, date and time on the LCD 54 as a display unit in step S22. In step S23, when a GUI button for designating a location is selected by the user via a GUI (Graphical User Interface) representing the presented selection menu, the location is designated in step S24, and the data processing unit 59 In S25, a selection menu for selecting the current position or an arbitrary place is displayed.

  For this selection menu, in step S26, a location is selected via the GUI representing the presented selection menu, but in the case where further detailed location information is not selected in step S27, step S311 in step S31 following FIG. 15A is performed. The annotation list is searched using the current location as a search key.

  In addition, after a location is selected via the GUI representing the selection menu presented in step S26, if an arbitrary location is specified in more detail in step S27, the data processing unit 59 executes the map software in step S28. to start. When the location desired by the user is designated by the GUI displayed together with the map on the LCD 54 in step S29, the data processing unit 59 receives the designated location information in step S30. The data processing unit 59 searches the annotation list using the location information and time specified in step S313 of step S31 following FIG. 15C using the current time as a search key.

  On the other hand, if the location is not specified by the user in step S24, in step S32, the data processing unit 59 selects an arbitrary time (future), the same time after the next day, the same day after the next week, the same day after the next month, A selection menu for selecting the same month after the following year and the same month and day after the following year is displayed.

  When a menu for inputting an arbitrary time is selected in step S33, the data processing unit 59 displays on the LCD 54 a time input GUI for inputting the arbitrary time in step S34. When the time is specified by the user via this input interface, the data processing unit 59 recognizes the time, and the data processing unit 59 uses the current time as the search key with the location information and time specified in step S313 of step S31 following FIG. 15C. Search the annotation list. If the menu for inputting an arbitrary time is not selected in step S33, the data processing unit 59 searches the annotation list using the specified date and time as a search key in step S312 of step S31 following FIG. 15B.

  Step S31 and subsequent steps are in accordance with the annotation list creation processing shown in FIG. That is, in step S35, the data processing unit 59 determines whether or not the bit corresponding to the corresponding time information or position information is 1. If the predetermined bit is 0, an object is created in step S36, the created object is registered at the end of the object list, and is associated with the annotation list and added to the annotation list, and the process is terminated. On the other hand, when the predetermined bit is 1, in step S37, the data processing unit 59 updates the object as necessary and re-registers the annotation list.

  In the registration process described above, the information on the location selected by the user may be received via the network.

  As described above, the information storage device 1 manages the acquired information as individual-dependent data by providing the annotation button 44 as an interface that allows the user to freely give meaning to the acquired information. Is possible. Since the user can collect contents obtained from his / her experience by carrying the information storage device 1 and a database based on the experience is created, the user searches for information by inputting a search term into the so-called Internet. In comparison, the stored information and content are highly useful for the user and are close to the information desired by the user. The information storage apparatus 1 can classify contents that are automatically acquired and stored in large quantities based on annotations added by the user.

  The information storage device 1 can also perform a skewer search using an annotation as a search key. Even if the search keyword is not input, if the annotation button 44 is selected in the search mode, the content grouped with the annotation added using the annotation button 44 can be extracted.

(2) Processing for Presenting Object to User Based on Annotation List Next, processing for searching for an object based on the annotation list will be described with reference to FIGS. This processing corresponds to the information use phase in the information storage device 1 shown as a specific example of the present invention.

  The information storage device 1 is provided with a search mode. Normally, when the search mode is selected, a search result is always presented using position information (location) and time information (time) as search keys. It is like that. Further, when the annotation button 44 is pressed in the search mode, a search using the annotation assigned to the annotation button as a search key may be executed. In the information storage apparatus 1 of this specific example, an information search mode and an information registration mode are provided, and the search is performed only when the search mode is explicitly selected by the user.

  As an example of search mode for searching for objects and annotations, manual search mode that allows users to specify the annotation conditions that they want to search, and automatically added objects with common annotations from the annotation list based on time information or location information There is an automatic search mode to do.

  The automatic search mode will be described with reference to FIG. The control unit 58 in the information storage device 1 activates the CCD, the GPS, etc. as step S41, and acquires the current position information and time information as step S42. In step S43, the control unit 58 determines whether the search mode is selected by the user in the operation input unit 45. When the search mode is selected, it is determined whether or not the mode further selected in step S44 is the automatic search mode. The processing when the manual search mode is selected will be described with reference to FIG. When the control unit 58 detects that the automatic selection mode has been selected by the user, the control unit 58 instructs the data processing unit 59, and the data processing unit 59 positions the current position information, time information, and annotation list acquired in step S42. Information and time information are compared in step S45 and step S46.

  FIG. 17 shows a process in which the data processing unit 59 compares position information in step S45. In step S451, the data processing unit 59 compares the current position information acquired in step S42 with the position information described in the annotation list stored in the annotation list storage unit 60. Here, the data processing unit 59 does not always match the latitude and longitude (x, y) of the GPS data acquired as the current position information completely, but for example, a certain accuracy range, (x + α, If y + α) substantially matches, it may be determined that they match.

  As a result, even if the location is not exactly the same, information in the vicinity registered in the annotation list can be presented together. In step S452, if the data processing unit 59 determines that there is an annotation having position information that matches the acquired current position information, the data processing unit 59 creates a result list for presentation as step S453, In addition to the list, the process proceeds to step S46. If there is no matching annotation in step S452, the process also proceeds to step S46.

  Subsequently, a process in which the data processing unit 59 compares position information in step S46 is shown in FIG. In step S461, the data processing unit 59 compares the current time information acquired in step S42 with the time information described in the annotation list stored in the annotation list storage unit 60. When the matching data cannot be obtained at the time, the data processing unit 59 searches for time information that matches the date, day of the week, and month.

  Further, the data processing unit 59 may compare the acquired time information with the time information in the annotation list, for example, using a value having a certain range as a search value. Thereby, even if it is not exactly the same time, the nearby information registered in the annotation list can be presented together. If the data processing unit 59 determines in step S462 that there is no matching annotation, it returns in step S463 that no annotations matching the conditions are registered in the annotation list, and the process proceeds to step S47. On the other hand, if the data processing unit 59 determines that there is an annotation having time information that matches the acquired current time information, the data processing unit 59 adds an annotation that matches the presentation result list in step S464, and proceeds to step S47. Here, the order of the processes in steps S45 and S46 is not limited to the order shown in FIG.

  When there are a plurality of annotation lists, the control unit 58 performs the determination processing in step S47, and causes the data processing unit 59 to repeatedly execute the processing in steps S45 and S46 for each annotation list. It is also possible to search the annotation list for the annotation button selected by the user in the search mode. When the search is completed for all annotation lists, the control unit 58 presents a result list to the user in step S48.

  As described above, the most basic method for presenting an object can be realized by searching for an annotation by comparing the current information with the position information and time information of the annotation list. By using the unit 45 and the like together, it becomes possible to input and present more complicated information. Manual search processing will be described with reference to FIGS. 19 and 20.

  When detecting that the manual search mode is selected in step S44 shown in FIG. 16, the control unit 58 in the information storage device 1 instructs the data processing unit 59 to execute the manual search mode. In the search processing shown in FIGS. 19 and 20, an operation by the user from the annotation button 44 and the operation input unit 45 and an operation of the data processing unit 59 based on the operation are shown.

  When the manual search mode is selected by the user in step S51, the data processing unit 59 receives a detection signal by selection, and presents a selection menu such as a place, date and time on the LCD 54 as a display unit in step S52. In step S53, when a GUI button for designating a location is selected from the user via the GUI representing the presented selection menu, the location is designated in step S54. In step S55, the data processing unit 59 displays a selection menu for selecting whether the current position or an arbitrary place. In response to this selection menu, in step S56, a location is selected by the user via the GUI representing the presented selection menu, but if more detailed location information is not selected in step S57, the step following FIG. 20A is performed. In step S611 of S61, the annotation list is searched using the current location as a search key.

  In addition, after the user selects a location via the GUI representing the selection menu presented in step S56, if an arbitrary location is specified in more detail in step S57, the data processing unit 59 determines in step S58. Start the map software. When the location desired by the user is designated by the GUI displayed together with the map on the LCD 54 in step S59, the data processing unit 59 receives the designated location information in step S60. The data processing unit 59 searches the annotation list using the location information and time specified in step S612 of step S61 following FIG.

  On the other hand, if the location is not specified by the user in step S54, in step S62, the data processing unit 59 selects an arbitrary time (future), the same time after the next day, the same day after the next week, the same day after the next month, A selection menu for selecting the same month after the following year and the same month and day after the following year is displayed.

  When the data processing unit 59 selects a menu for inputting an arbitrary time in step S63, the data input unit 59 displays a time input GUI for inputting the arbitrary time on the LCD 54 in step S64. When the time is specified by the user via this input interface, the data processing unit 59 recognizes the time, and the data processing unit 59 uses the location information and time specified in step S612 of step S61 following FIG. Search the annotation list. If the menu for inputting an arbitrary time is not selected in step S63, the data processing unit 59 searches the annotation list using the specified date and time as a search key in step S612 of step S61 following FIG. 20B.

  If there is an annotation that matches the search condition in step S65, the data processing unit 59 creates a result list in step S66. The result list is presented to the user. If there is no matching annotation, in step S67, the data processing unit 59 displays that the corresponding annotation is not found and returns to step S52.

The result list created in steps S453 and S464 described above will be described.
FIG. 21A shows a result list based on position information, and FIG. 21B shows a result list based on time information. If the information storage device 1 is a type having a plurality of annotation buttons 44, the result list is prepared for the number of annotations assigned to the annotation buttons 44. When the user selects an object presented in the result list by the operation input unit 45, the user is linked to the corresponding object, and the object is reproduced.

  In the information storage device 1, the user can also edit and delete the annotation list and the object from the result list. In addition, the information providing apparatus 1 has a function of counting the number of times an object is referred to. Thus, when the object is used through the result list, the information providing apparatus 1 may register the usage status of the annotation list by the user as “usage” in the list.

  FIG. 22 shows a process in which the information storage device 1 adds an object reference pointer by an operation input from the user via the result list.

  When the data processing unit 59 detects in step S71 that an object has been selected from the result list, in step S72, the data processing unit 59 determines whether or not a confirmation button has been selected. When the confirmation button is selected, the selected object is reproduced in step S73, and the reference counter of the result list and the annotation list associated with this object is incremented by 1 in step S74.

  On the other hand, in step S72 and step S75, when the data processing unit 59 detects that the delete button is selected instead of the confirmation button, the data processing unit 59 presents a message confirming the deletion to the user in step S76, and in step S77. When it is detected that the confirmation button has been selected, the data processing unit 59 deletes the object selected in step S78 from the object list. Also, the annotation in the annotation list associated with the object is deleted. At this time, it is not necessary to delete the original content stored in the database 53.

  If there is another object in the result list in step S79, the data processing unit 59 repeats the processing from step S71.

  As described above, when the object of the search result is displayed, for example, if it is possible to count “referred (used)”, the user can effectively use the object created by the information processing apparatus 1. You can know what is being done.

  According to the search processing described above, the information storage device 1 can perform a skewer search using an annotation as a search key. In addition, the information storage device 1 can search for information that is highly useful for the user and that is close to the information desired by the user because the content managed by adding the annotation by the annotation button 44 is a database.

  As described above, according to the annotation registration process and the annotation search process by the information storage device 1, for example, the following can actually be performed. For example, when the user assigns an annotation button to one of his friends and meets this friend, calls this friend, when the friend's topic comes out, etc., the content is acquired by the information storage device 1 by pressing the annotation button. If an annotation is added, the acquired content can be classified by this friend.

  Further, since the annotation button is a user-specific mark for the acquired content, for example, when the user has added annotation to the content acquired at 17:00 on the 12th in the past, the 17:00 on the 12th of the next month It is also possible to reproduce the object to call the user's attention when it comes (or approaches). If the annotation button is assigned by the user to the user's “favorite”, the acquired content can be automatically classified by this annotation. Next time, if the search result searched by this annotation is location information, this is the user's “favorite place”, and if the searched object is music content, this is the user ’s “favorite music”. If there is a person in the retrieved object, this is the user's “favorite person”.

  If an annotation button is assigned to the user's “failure”, the acquired content can be automatically classified by this annotation. Next time, the search result searched by this annotation is “the place where the user is lost” if it is position information, and if the searched object is music content, it is “music that the user did not like”. If a person is reflected in the searched object, it means that the user has “lost”. As described above, the information storage device 1 can automatically classify the acquired content based on the annotation.

  The present invention may be any device that can acquire, store, and present information related to an event experienced by a user. In the specific example, it is shown as a portable information processing terminal, but the function as an information processing terminal, information acquisition functions such as a camera, a microphone, etc. are prepared as a plurality of units, and these are distributed to each part of the user's body. It is suitable for use in a so-called wearable computer of the type to be mounted.

It is a block diagram explaining the information storage device shown as the best form of this invention. It is a figure explaining the case where information is acquired using the information storage device shown as a specific example of the present invention, and the case where information is searched. It is a block diagram explaining the said information storage device. It is an external view explaining the information storage device provided with the annotation button. (A) And (b) is an external view explaining the annotation input device provided with the annotation button and the simple display part. (C) And (d) is an external view explaining the annotation input device provided with the some annotation button. It is a block diagram explaining the independent type annotation input device which made the annotation input part independent of the information storage device. (A) is a figure explaining the annotation input by this button when one annotation is assigned to one annotation button, (b) is a figure explaining the annotation inputted by a plurality of annotation buttons. is there. It is a schematic diagram explaining the memory structure which memorize | stores an annotation list. It is a schematic diagram explaining the process which produces an object in the object data generation part of the said information storage device. (A) is a figure explaining the annotation list with respect to the annotation added with the button A created in the object data generation part of the said information storage apparatus, (b) explains the annotation list with respect to the annotation added with the button B. It is a figure to do. It is a flowchart explaining the process which the said information storage device records experience information and the annotation input by the user. It is a flowchart explaining the registration process of an annotation list. It is a figure explaining an example of the experience information acquired by the process of FIG. It is a flowchart explaining the registration process of an annotation when complicated information input and information presentation are possible. It is a flowchart explaining the registration process of an annotation when complicated information input and information presentation are possible. It is a flowchart explaining the search process of the content in the said information storage device. It is a flowchart explaining the process which compares the present position information acquired in search mode, and the position information of an annotation list. It is a flowchart explaining the process which compares the present time information acquired in search mode, and the time information of an annotation list. It is a flowchart explaining the search process of an annotation when complicated information input and information presentation are possible. It is a flowchart explaining the search process of an annotation when complicated information input and information presentation are possible. It is a figure explaining the result list shown to a user as a search result in the above-mentioned information storage device. It is a figure which shows the process in which the said information storage device adds a reference pointer by the user's operation input via a result list.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Information storage device, 10 Information registration part, 11 Information acquisition part, 12 Annotation addition part, 13 Data recognition processing part, 14 Data definition processing part, 15 Data storage part, 16 Image recognition part, 17 Text processing part, 18 Voice processing Unit, 19 voice recognition unit, 20 language processing unit, 30 information utilization unit, 31 information acquisition unit, 32 search input unit, 33 data recognition processing unit, 34 search unit, 35 information presentation unit 41 GPS, 42 CCD camera, 43 microphone , 44 annotation buttons, 45 operation input unit, 46 image recognition unit, 47 sentence recognition unit, 48 speech recognition unit, 49 speech recognition processing unit, 50 language processing unit, 51 keyword extraction unit, 52 data definition processing unit, 53 database 54 LCD, 55 display device, 56 speaker, 57 audio output device, 58 control unit, 60 annotation list storage unit, 61 object list storage unit

Claims (7)

Information acquisition means for acquiring experience information related to the event experienced by the user;
Storage means for storing the experience information acquired by the information acquisition means;
Annotation information input means for inputting annotation information as an annotation for the experience information acquired by the information acquisition means;
Presentation content generation means for extracting the experience information with the annotation information added by the annotation information input means and generating the presentation content;
A presentation content list storage unit that stores the generated presentation content and the annotation information in association with each other as a presentation content list;
When the empirical information is acquired by the information acquisition unit, when the annotation information is input by the annotation information input unit, the presentation content generation unit is instructed to generate the presentation content, and the generated presentation content is displayed. Presentation content list creation control means for performing control to store the annotation information together with the presentation content list storage means;
Search input means for inputting search conditions as annotation information by the user,
Information presenting means for presenting search results to the user;
And search control means for extracting experience information corresponding to the annotation information as the search condition input by the search input means from the presentation content list storage means and presenting the information to the information presentation means. Information storage device. The annotation information input means inputs time information as annotation information for the experience information acquired by the information acquisition means,
The presentation content list creation control means presents to the presentation content generation means when time information as annotation information is input by the annotation information input means when experience information is acquired by the information acquisition means. Control to store the presentation content generated instructing the generation of the presentation content in the presentation content list storage unit together with the time information,
The information storage apparatus according to claim 1, wherein the search control means extracts experience information corresponding to the time information from the presentation content list storage means. Comprising location information acquisition means for acquiring location information;
The annotation information input means inputs position information as annotation information for the experience information acquired by the information acquisition means,
The presenting content list creation control means is configured to present information to the presenting content generation means when position information as annotation information is input by the annotation information input means when certain experience information is acquired by the information acquisition means. Instructing the generation of content and performing control to store the generated content for presentation together with the position information in the content list storage unit for presentation,
The information storage apparatus according to claim 1, wherein the search control means extracts experience information corresponding to the position information from the presentation content list storage means. The information acquisition means is voice data acquisition means for acquiring external voice data, and includes voice recognition means for recognizing a pronunciation of a feature word from the voice data acquired by the voice data acquisition means,
The presentation content creation control means provides a presentation content to the presentation content generation means when the annotation information is input by the annotation information input means when the voice data of the characteristic word is acquired by the voice data acquisition means. 2. The information storage apparatus according to claim 1, wherein an instruction to generate content is given, and the content generation means for presentation extracts audio data for a predetermined period from the time when the annotation information is added as content for presentation. The information acquisition means is image data acquisition means for acquiring external image data, and includes image recognition means for recognizing a feature image from the image data acquired by the image data acquisition means,
The presentation content creation control means provides a presentation content generation means for presentation when annotation information is input from the user by the annotation information input means when the image data of the feature image is acquired by the image data acquisition means. 2. The information storage apparatus according to claim 1, wherein an instruction to generate content is given, and the content generation means for presentation extracts image data for a predetermined period from the time when the annotation information is added as content for presentation.   2. The information storage device according to claim 1, wherein the annotation information input unit and the search input unit are provided as a plurality of input units and are assigned for each attribute of the experience information. An information acquisition process for acquiring experience information related to the event experienced by the user;
An accumulation step in which the experience information acquired in the information acquisition step is accumulated in a memory;
An annotation information input step in which annotation information for the experience information acquired in the information acquisition step is input;
A presentation content generation step of generating the presentation content by extracting the experience information with the annotation information added in the annotation information input step;
A presentation content list storage step of storing the generated presentation content and annotation information in association with each other in a presentation content list memory as a presentation content list;
A search input process in which search conditions are input as annotation information by the user,
And an information presentation step of extracting experience information corresponding to the annotation information as the search condition input in the search input step from the presentation content list memory and presenting the information to the user. .

Images