JP2008252356A - Information editing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prepare a personal history of a subject by editing information data and specified material information. <P>SOLUTION: The information editing apparatus comprises: biological information data 5a in which biological information 5a indicating the state of the subject is recorded; information data in which the information data relating to video images and sound that can be felt by the subject are recorded; time information acquisition data in which the recording time information relating to the time of recording the information data is acquired; a material information acquisition means for acquiring the specified material information generated for the time of recording the information data based on the recording time information in a material information group when decided that the state of the subject is a specified state on the basis of the biological information 5a; and an information editing means for editing the information data and the specified material information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information editing apparatus that can leave video or audio that can be felt through a certain experience as a life log and edit these to create a personal history.

  2. Description of the Related Art In recent years, technology for handling video and audio (hereinafter referred to as “video and the like”) has been remarkably developed, and technical development relating to improvement in performance of so-called digital video cameras has been actively conducted. In recent years, a system for automatically recording video and audio by applying such technology has been devised (see Patent Document 1 and Patent Document 2). An idea has been proposed in which this system is applied to constantly collect life logs such as images and sounds that humans can feel with at least one of the five senses.

Such an idea can be applied to leave one's own history in a sense in that the user can leave his / her own experience without being conscious of it. In order to constantly collect the user's life log in this way, for example, a method is adopted in which the user keeps collecting the life log on a daily basis by wearing a digital video camera that the user can wear without affecting their life. can do. The user can edit his / her life log collected on a daily basis to create a desired personal history.
Japanese Patent Laying-Open No. 2005-117541 (paragraph numbers 0141 to 0152, FIG. 11) JP 2002-204419 A (paragraph numbers 0006 to 0007, FIG. 1)

  However, with this known technology, when creating the user's own history in this way, if created from the life log collected by himself, there is a problem that himself does not appear in the video etc. as the material constituting his history. is there. This made it difficult to create a personal history that would satisfy users.

  The problem to be solved by the present invention includes the above-described problem as an example.

  In order to solve the above-mentioned problem, the invention according to claim 1 manages a material information group that can be adopted as a material in association with material time information indicating a generation time of each material information, and associates the material information group with the material time information. The material information providing means capable of providing the material information, and the subject's state in the material information group when the subject's state is determined to be a prescribed state based on the biological information representing the state of the subject. Material information acquisition means for acquiring the specific material information generated with respect to the recording time of the information data in which the possible information is recorded, and information editing means for editing the information data and the specific material information.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
<First Embodiment>
FIG. 1 is a system configuration diagram showing a configuration example of a self-history creation system 100 as a first embodiment of the present invention.
The self-history creation system 100 uses not only video and sound based on the user's own experience but also other materials (material information) to edit the history based on the user's experience (hereinafter referred to as “self history”). ”).

  The personal history creation system 100 includes a plurality of life log recording devices 1. The plurality of life log recording apparatuses 1 have the same configuration and function. Each life log recording device 1 is a terminal device used by a user or others as a user. The life log recording apparatus 1 has a function of recording information (information data) that a user can feel on a daily basis with at least one sense.

  Each life log recording device 1 includes a camera 2 (self-information recording unit), a microphone 3 (self-information recording unit), a biological information acquisition unit 5 (biological information acquisition unit), an interface unit 4, a buffer 6 (information storage device), Communication unit 7 (material information acquisition unit), positioning unit 8, timing unit 11, display unit 99 (self history output unit), speaker 12 (self history output unit), acquisition output control unit 9 (material information acquisition unit) and control A unit 10 (information editing means) is provided.

  The camera 2 and the microphone 3 are provided, for example, on eyeglass-shaped members that can be worn by the user. The camera 2 is arranged in the vicinity of the user's eyes in the glasses-shaped member, and has a function of photographing the periphery from the user's viewpoint. The video imaged by the camera 2 is output from the camera 2 as video data 2a. This image represents, for example, any one of color, shape, temperature, movement (speed), or any combination thereof.

  The microphone 3 is disposed, for example, in the vicinity of the user's ear in the eyeglass-shaped member, and has a function of collecting sounds around the user. The sound collected by the microphone 3 is output from the microphone 3 as sound data 3a (for example, voice data). As this sound, for example, any one or a combination of environmental sound, human speech, and own speech can be cited.

  In the present embodiment, information representing the user's experience such as the video data 2a and the sound data 3a is collectively referred to as “life log”. Note that the life log includes not only both the video data 2a and the sound data 3a, but also only one or other data (for example, data on any one of odor, position, taste, temperature, humidity, pressure, or a combination thereof). May be adopted.

  The biometric information acquisition unit 5 has a function of acquiring the biometric information of the user when the user wears the life log recording device 1. Here, the biological information is a general term for information related to a user's biological body, and includes, for example, information related to at least one of a heart rate (pulse), blood pressure, sweat volume, and tear volume, or a combination thereof. This biological information may be other information (such as body temperature) related to the user.

  The interface unit 4 is connected to the camera 2, the microphone 3, and the biological information acquisition unit 5, and is connected to a buffer 6. The interface unit 4 has an interface function between the camera 2, the microphone 3, the biological information acquisition unit 5 and the buffer 6.

  The buffer 6 is an information recording medium (information storage device) capable of storing the video data 2a, the sound data 3a, and the biological information 5a input via the interface unit 4, respectively. Examples of the biological information 5a include heart rate, sweating amount, grip strength, body temperature, blink, blood pressure, electromyogram, smell, and tear volume, or any combination thereof. The positioning unit 8 is a positioning device that acquires the position information by positioning the current location of the life log recording device 1 using, for example, GPS (Global Positioning System).

  The timekeeping unit 11 has a timekeeping function for measuring time in synchronization with the recording of the video data 2a and the sound data 3a. The timer unit 11 has a function of measuring time when the video data 2a and the sound data 3a are recorded and acquiring time information (time information acquisition means).

  The control unit 10 controls the recording of the video data 2a and the sound data 3a in the buffer 6 while synchronizing with the acquired time information and further associating with the acquired position information. In this buffer 6, video data 2a and sound data 3a are constantly recorded as user life log data (hereinafter referred to as "life log constant recording function").

  The acquisition output control unit 9 has a function of acquiring the other person's video data 2a and sound data 3a as the other person's life log from the life log recording device 1 used by the other person under the control of the control unit 10 (acquisition of another person's life log). function). Specifically, when it is determined that the state of the user has shifted to the specified state based on the biological information 5a, the control unit 10 activates the other person's life log acquisition function. In the present embodiment, as the above-mentioned prescribed state, for example, a state in which the user of the life log recording apparatus 1 feels “happy” will be described, but this prescribed state is a state of various emotions depending on the purpose. May be adopted.

  The control unit 10 controls the communication unit 7 to acquire the other person's video data 2a and the other person's sound data 3a recorded in the life log recording device 1 used by another person. The communication unit 7 has a function of performing data communication between the other person's life log recording device 1 and the other person's video data 2a and the other person's sound data 3a by wireless or wired under the control of the control unit 10.

  Further, the acquisition output control unit 9 has a function of causing the display unit 99 to display an image and causing the sound output unit 12 to output a sound. The display unit 99 is a display device such as a liquid crystal display. The sound output unit 12 is a sound output device such as a speaker.

FIG. 2 is a block diagram illustrating a configuration example of the buffer 6 and the acquisition output control unit 9 illustrated in FIG.
Further, the acquisition output control unit 9 shown in FIG. 2 has a function of editing the life log (video data 2a and sound data 3a) acquired by the operation of the other person's life log acquisition function (life log editing function).

  The acquisition output control unit 9 includes a designation unit 21 (material information acquisition unit), a search unit 22 (material information acquisition unit), an acquisition unit 23 (material information acquisition unit), a personal history data creation unit 24 (information editing unit), and an output. A control unit 25 is included. The buffer 6 stores video data 2a and sound data 3a (corresponding to “self life log data 28” in the illustrated example) acquired by the user with his / her life log recording device 1 by the life log constant recording function. It is recorded as a log.

The designation unit 21 includes a main designation unit 21a, a sub designation unit 21b, and a viewing designation unit 21c.
The main designating unit 21a has a function of designating its own life log data 28 (hereinafter referred to as “self life log data”) to be used as a material when creating its own history (self life log designating function).

  The sub-designating unit 21b has a function of designating a search condition for other person life log data 27 (hereinafter referred to as “other person life log data”) that is desired to be used as a material in creating the personal history. As the other person life log data 27, for example, at the time specified based on the recording time information attached to the life log data 28 (the time when the self life log data 28 was recorded), the other person life log data 27 is attached to the specified life log data 28. The life log data acquired by another person's life log recording apparatus 1 arranged near the position specified based on the recording position information to be performed (in the vicinity of the own life log recording apparatus 1) can be exemplified.

  Depending on how the personal history (electronic personal history) to be edited finally is shown, the view designating unit 21c shows how to show the personal history, for example, a movie director style (△ ○ director style) or a documentary style. Has the function to specify. Each of these designations can adopt, for example, designation by voice input, or designation by manual input using, for example, a PDA (Personal Digital Assistant) type input device.

  The search unit 22 has a function of searching the other person's life log data 27 in accordance with the search condition specified by the specifying unit 21 and searching for a material desired by the user. When there is a record hit when the search unit 22 searches, the acquisition unit 23 acquires other person's life log data 27 (other person's video data 2a and other person's sound data 3a) from the other person's life log recording apparatus 1. . The acquisition unit 23 records the acquired other person life log data 27 in the buffer 6.

  The other person's life log is acquired in this way because his / her own life log recording apparatus 1 can record the sound data 3a around him / herself but cannot record his / her own video data 2a himself / herself. . In this way, when the user creates his / her own history, his / her own video or sound can be procured as a material from another person's life log.

  The personal history data creation unit 24 has a function of editing the other person's life log data 27 and the personal life log data 28 acquired in this way to create electronic data relating to his / her own experience (hereinafter referred to as “self history data”). . Specifically, the personal history data creation unit 24 creates, as personal history data, for example, display data for realizing a display appealing visually as personal history, or outputs a sound appealing to hearing as personal history, for example. Create sound output data.

  The output control unit 25 causes the display unit 99 to display the history as a video based on the display data created in this way, or causes the sound output unit 12 to display the sound output data created in this way. Output your own history as sound.

  FIG. 3 is an image diagram showing an example of data used in the present embodiment. Note that the letters “DB” illustrated in FIG. 3 represent “database”.

  The self life log database 28 a has at least one self life log data 28. The other person life log database 27 a includes at least one other person life log data 27. The biological information database 5b has at least one biological information 5a, for example. The biometric information 5a here can include, for example, an “α wave” that is output as an electroencephalogram when the user feels comfortable.

  Moreover, in this embodiment, the said control part 10 produces | generates the emotion database 30 from this biometric information database 5b using a predetermined algorithm. The emotion database 30 is a collection of emotion data 31 generated from the biological information 5a included in the biological information database 5b.

  This emotion data 31 represents a user's emotional state (for example, a happy state, a pleasant state, a sad state) specified by at least one biological information 5a. That is, when the user has transitioned to a certain emotional state, the emotional state can be specified by one biological information 5a regarding the user or a combination of a plurality of biological information 5a. In the present embodiment, the template (pattern) of the emotion data 31 representing the specific emotional state of the user is referred to as a “specific emotion pattern”.

  If such emotion data 31 (specific emotion pattern) is registered in the emotion database 30, when the emotion data is determined from the user's biological information 5a, the emotion data is stored in the emotion database 30 as the specific emotion. Compared with the pattern, it is possible to determine what emotional state the user is currently transitioning to.

  As a specific determination method, for example, it is determined whether or not the emotion data specified by the user's biological information 5a substantially matches the specific emotion pattern in the emotion database 30. That is, in this determination method, the number of matching points between emotion data and a specific emotion pattern within a predetermined time is measured, and when the number of points is equal to or greater than a predetermined number (for example, 10), the user determines that the specific emotion pattern is It is presumed that the state has changed to an emotional state (for example, a happy state, a pleasant state, or a sad state).

The personal history creation system 100 is configured as described above. Next, an example of the operation of the personal history creation system 100 will be described with reference to FIGS.
FIG. 4 is a flowchart showing an example of the procedure of the personal history creation process.
In the present embodiment, information (experience life log data 27) related to experiences sensed by others visually or auditorily is used as material (material information), while information (self life log data 28) regarding experiences experienced by oneself visually or auditorily is used. ) Edit to create your own (electronic) history.

  First, the outline will be described. In step S10, an emotion database (emotion DB) generation process described later is executed. Next, in step S20, a life log search process described later is executed. In step S40, the personal history editing process is executed based on the other person life log data 27 and the self life log data 28 stored in the buffer 6. Each process will be specifically described below.

<Emotion database generation processing>
FIG. 5 is a flowchart showing an example of the generation process of the emotion database 31 shown in FIG.
In the life log recording device 1, video data 2 a obtained by the camera 2 shooting a video around the user is constantly recorded in the buffer 6. In the life log recording device 1, the microphone 3 constantly records sound data 3 a obtained by collecting sounds around the user in the buffer 6. These video data 2a and sound data 3a are recorded in the buffer 6 in a synchronized state. These video data 2a and sound data 3a have time codes that can specify the acquisition time of the video and sound, respectively.

  In synchronization with these, the biometric information acquisition unit 5 constantly records the biometric information 5a obtained by acquiring information about the user's biometrics in the buffer 6. In the following description, the video data 2a and the sound data 3a stored in the buffer 6 in this way are called life log data 28, and an aggregate of the life log data 28 is called a life log database.

  In step S <b> 11, the control unit 10 acquires at least one prescribed biological information 5 a from the biological information database 5 b stored in the buffer 6. Here, as a method for selecting the biometric information 5a, for example, when generating a personal history based on a happy experience, at least one biometric information 5a that appears characteristically when the user is happy can be selected. For example, if the user is happy, an α wave or the like can be selected as the biological information, and therefore the control unit 10 collects the user's “α wave” or the like using the biological information 5a.

  In step S12, emotion database algorithm processing is executed. This emotion database algorithm process utilizes the fact that a user's emotion can be specified by at least one biological information 5a (or a combination of a plurality of biological information 5a). That is, for example, when the “α wave” as the biological information 5a is equal to or greater than a predetermined threshold, it can be assumed that the user feels “joyful”.

  Next, in step S13, the combination (graph characteristic) of the biological information 5a such as “α wave” is stored in the emotion database 30 as emotion data 31 (specific emotion pattern). If it does in this way, the control part 10 may produce | generate the emotion database 30 (secondary database: secondary DB) previously from the biometric information database 5b (primary database: primary DB), as shown in FIG. it can.

  FIG. 6 is a characteristic diagram showing an example of emotion data existing in the emotion database 30. In the illustrated example of emotion data characteristics, the vertical axis indicates the intensity N of emotion data, and the horizontal axis indicates time t [sec]. The horizontal axis is illustrated so that time elapses from left to right.

  The emotion data shown in the figure shows a high characteristic at first, but gradually decreases to the middle and finally increases at a stroke. When the compared emotion data as a comparison target shows the characteristics of emotion data as shown in FIG. 6, it can be determined that the compared emotion data is in a state in which the user is happy. Therefore, in the emotion database 30, for example, an emotion characteristic as shown in the figure is registered with the passage of time as a specific emotion pattern representing an emotional state of “happy”.

  FIG. 7 is a characteristic diagram showing another example of emotion data existing in the emotion database 30. FIG. 7 shows an example of emotional state for each user's time. In FIG. 7, the vertical axis indicates a specific example of the type of emotion, and the horizontal axis indicates time t [sec]. The horizontal axis is represented such that time elapses from left to right. On the vertical axis, from above, “happy state (joy)”, “fun state (easy)”, “躁 depression state (躁)”, “relief state (relief)”, “anxiety state (anxiety)”, “depressed state” (Depressed) "and" sorrowful state (sorrow) "are illustrated.

  A small circle (o) arranged beside each emotional state indicates the emotional state of the user at each time. The fact that circles are arranged in a plurality of emotional states at the same time (vertical direction in the drawing) indicates that the user has transitioned to these emotional states. In the case where the emotional state of the user is mapped as shown in FIG. 7, it is considered that the user corresponds to the emotion of the place where the circles are continuously arranged, for example. For example, in a time zone where the time t [sec] is early, the circles are continuous, and it can be determined that the user's emotion is “happy”. The emotion database 30 manages emotion data according to the passage of time so that the transition of the user's emotion at each time can be understood.

<Life log search processing>
FIG. 8 is a flowchart illustrating an example of the procedure of the life log search acquisition process.
In this life log search acquisition process, for example, two life log data are acquired. One is the self life log data 28 of the user himself / herself, and the other is the other person life log data 27 relating to a person (other person) other than the user himself / herself.

  In the present embodiment, for example, a case where a user's own history based on the feeling of “happy” is created will be described. First, in step S21, the acquisition output control unit 9 sets an emotion desired by the user (for example, happy). Next, in step S <b> 22, the acquisition output control unit 9 confirms whether or not the specific emotion pattern related to the emotion of “happy” is registered in the emotion database 30. When the specific emotion pattern does not exist (is not registered) in the emotion database 30, the acquisition output control unit 9 proceeds to step S28 described later. If this emotion data pattern exists (is registered) in the emotion database 30, the control unit 10 proceeds to step S23.

  The user specifies life log data to be used as a material in creating his / her own history as follows. First, under the control of the acquisition output control unit 9, a designation screen such as the type of life log data as shown in FIG. This designation screen includes a main life log data ID input area 99a, a view designation area 99c, a sub life log data ID input area 99b, a view designation area 99d, and a decision button 99d.

  The user inputs an identifier (IDentification) of a desired self-life log data 28 in the main life log data ID input area 99a, for example, a file name and an arrangement location, and for example, “○ × Designated as “Director Style”. Further, the user inputs the file name and location of the desired other person's life log data 27 in the sub life log data ID input area 99b, and designates “Δ ○ supervisory style” as the desired way of viewing in the view designation area 99d, for example. To do. When the user confirms that the input content is the desired input content, the user clicks the enter button 99d to confirm the input content.

  When the determination button 99d is clicked, the main designation unit 21a, the sub designation unit 21b, and the view designation unit 21c shown in FIG. 2 operate as follows. That is, the main designation unit 21a designates the self life log data 28 based on the input contents of the main life log data ID input area 99a shown in FIG. The sub-specification unit 21b of FIG. 2 specifies the life log data 27 of the other person based on the input contents of the sub-life log data ID input area 99b shown in FIG. The view designating unit 21c shown in FIG. 2 arranges its own life log data 28 in the “supervision style” according to the designation content of the view designation area 99d shown in FIG. Specify how to show your history to arrange and edit.

<Obtain self-life log data>
Here, since the user is trying to create an electronic history based on a past happy experience, the acquisition output control unit 9 is happy, for example, as an emotional state desired by the user (self) under the control of the control unit 10. Set the state. As described above, the biological information acquisition unit 5 constantly acquires the biological information 5a, and stores the biological information 5a in the buffer 6 together with the acquisition time of the biological information 5a.

  In step S <b> 21 of FIG. 8, first, the acquisition output control unit 9 specifies a specific emotion pattern representing a desired emotion state (for example, a happy state) in the emotion database 30. Then, in step S23, the acquisition output control unit 9 determines whether or not there is a portion that matches the specific emotion pattern in the emotion data based on the biological information 5a or a combination thereof. In this step S23, if there is a matching part, the acquisition output control unit 9 uses the acquisition time as a key and from the own life log database 28a, the same time of the own life log data 28 (video data 2a and sound data 3a). Is acquired as a material of electronic history. The acquisition output control unit 9 stores the part acquired from its own life log data 28 in the buffer 6.

<Acquisition of other person's life log data>
In step S24 of FIG. 8, the acquisition output control unit 9 has another person who was present at the position based on the recording position information (the vicinity of the self) at the time based on the recording time information (the time when the self-life log data 28 was collected). The other person's life log data 27 recorded in the life log recording device 1 is acquired. The other person life log data 27 here includes, for example, at least one of the other person's video data 2a and the other person's sound data 3a. Since the sound is originally low in directivity, when the self and another person are close to each other, the sound data 3a can often record the same sound source by itself and the other person. For this reason, when the acquisition output control unit 9 acquires only the video data 2a, the data amount by which the acquisition output control unit 9 acquires the other person's life log data 27 can be reduced.

  In step S25, the acquisition output control unit 9 (face detection means) executes a pattern matching process. Specifically, in step S26, the acquisition output control unit 9 performs pattern matching by image processing, and the self is reflected in the video based on the video data 2a from the video data 2a of the other person acquired from the other person's life log. Specify the time zone part. If the self is reflected (the self video is present in the life log of another person), the process proceeds to step S27, and the self is not reflected (the self video is not present in the life log of the other person). In this case, the process proceeds to step S28 described later.

  In step S26, the acquisition output control unit 9 (speech detection means) includes, for example, own voice as own sound data 3a in the environmental sound based on the other person's sound data 3a acquired from the other person's life log. Determine whether or not. If the self voice is included (the self voice is present in the other person's life log), the process proceeds to step S27, and the self voice is not included (the self voice is present in the life log of the other person). If not, the process proceeds to step S28 described later. If it is not necessary to check in detail whether the self is reflected in the other person's life log or whether the person's voice is included in the other person's life log, the above-described steps S25 and S26 are omitted. May be.

  Next, in step S27, the acquisition output control unit 9 extracts the own video data 2a and the own sound data 3a extracted from the self life log data 28 as materials, and the other person's video data extracted as materials from the other person life log data 27 2a and other person's sound data 3a are left in the buffer 6. As described above, the user can align the video data 2a and the sound data 3a, which should be used as materials, in the buffer 6 with the function of the acquisition output control unit 9, in the buffer 6.

<Equivalent to step S40 in FIG. 4>
The personal history data creation unit 24 uses the video data 2a and the sound data 3a arranged in the buffer 6 as described above. For example, all of the own video data 2a and the sound data 3a are used for creating personal history data, and others. At least a part of the video data 2a and the other person's sound data 3a can be used as a material for creating personal history data. The personal history created in this way includes video data 2a and sound data 3a relating to the life log of the person and the life log of another person in a state where he / she feels “happy” as specified at the time of searching the emotion database 30. Will be created. In other words, the user can create personal history data that can be viewed most comfortably.

  In the information editing apparatus 100 (self history creation system) in the above embodiment, a material information group that can be adopted as a material is managed in association with the material time information indicating the generation time of each material information, and is associated with this material time information. Based on the material information providing means 1 (for example, another person's life log recording device) capable of providing material information and the biological information 5a representing the state of the subject (user), the state of the subject is a prescribed state (for example, feels comfortable) State), the specific material information generated with respect to the recording time of the information data 28 that records the information that can be felt by the subject in the material information group 27 (the life log data of the other person) is acquired. Material information acquisition means 21, 22, 23 (part of the acquisition output control unit) and information for editing this information data 28 and specific material information 27 And having a collecting means 24 (information editing means).

  When the subject (user) wears the information editing apparatus 1 (its own life log recording apparatus) and records the information data 28 constantly, the subject edits the information data 28 and creates an electronic history. be able to. Moreover, the user can feel a sense of peace of mind by reviving a nostalgic memory by touching this electronic history.

  Here, the recorded information data 28 is recorded from its own viewpoint, and it is considered that the image based on this information data 28 has almost no appearance of itself. In this case, even if an electronic personal history is created, the enjoyment of the user (self) may be reduced.

  However, according to such a configuration, the created electronic self-history includes not only the portion of the self-information data 28 (self-life log data) at a good time (for example, the time when it was shining in life) but also the material information 27. (Others' life log data) is also edited as material. Therefore, the created electronic self-history includes one's own figure that cannot be obtained by itself, and a user who contacts this discovers his / her own figure in the electronic self-history and is deeply moved by this self-history. You can enjoy while doing.

  In addition to the above-described configuration, the information editing apparatus 1 (self history creation system) according to the present embodiment further includes material information providing means that records information that can be felt by another person as a subject as the material information. The information information 27 of the other person who recorded the information is provided, and the material information acquisition means 21, 22, 23 (part of the acquisition output control unit) at the acquisition time of the information data 28 based on the recording time information, A part of the time zone specified based on the recording time information is obtained from the material information (other person life log data 27).

  According to such a configuration, the electronic history to be created includes the own information data 28 (self-life log data) and the other person's information data 27 (recorded by another person's life log recording device), for example. Others' life log data). Therefore, it is considered that the other person's information data 27 includes his / her state. Therefore, since the electronic history created by the project includes its own state, users who come in contact with it are deeply impressed by their own past state, and users can relax their minds. it can.

  In the information editing apparatus 1 (self-history creation system) in the above embodiment, in addition to the above configuration, the material information is video data, and information search means 21, 22, 23 (designation unit, search unit, acquisition unit) Is a face detection means for detecting whether or not the face of the subject (user) is reflected in the video data 2a by image processing, and when the face detection means detects its own face, from the video data 2a Video acquisition means for acquiring a portion of a time zone in which the face of the subject is included.

  According to such a configuration, the user can visually enjoy his / her own electronic history including the image of his / her past face, so that he / she can touch the image including the user's own image and feel nostalgic. Can be soaked in.

  In the self-history creation system 1 in the above embodiment, in addition to the above configuration, the material information is voice data, and the information search means 21, 22, 23 (designation part, search part, acquisition part) are voice data 2a. Voice detecting means for detecting whether or not the voice of the subject (user) is included, and when detected by the voice detecting means, the time zone portion including the voice of the subject is recognized from the voice data. And voice acquisition means for acquiring by processing.

  According to such a configuration, the user can enjoy not only his / her face but also his / her own electronic history including his / her voice, not only by his / her eyes but also by his / her hearing. You can feel the progress and immerse yourself in nostalgia.

  In addition to the above configuration, the information editing apparatus 1 (self history creation system) in the above embodiment further includes an electronic self based on the experience of the subject (user) edited by the information editing means 24 (self history data creation unit). It has personal history output means 12, 99 (sound output unit, display unit) for outputting history.

  According to such a configuration, the user can enjoy touching the created electronic personal history, so that, for example, the user can immerse deeply in nostalgic memories in one corner of the memory and relax the mind.

Second Embodiment
In the second embodiment, the configuration is almost the same as that of the first embodiment and the operation is almost the same. Therefore, the same reference numerals as in FIGS. 1 to 9 in the first embodiment are used for the same configuration and operation. The description will be omitted, and the following description will focus on different points.

FIG. 10 is a block diagram illustrating a configuration example of the personal history creation system 100a as the second embodiment, and FIG. 11 is a block diagram illustrating a configuration example of the buffer 6 and the acquisition output control unit 9 illustrated in FIG. . The configuration examples shown in FIGS. 10 and 11 are substantially the same configuration examples as in FIGS. 1 and 2 in the first embodiment.
The self-history creation system 100a as the second embodiment has a Web server 101 (material information providing means) as shown in FIG. 10 instead of the life log recording device 1 of another person in the first embodiment. Is different.

  That is, the life log recording device 1a (information editing device) uses content data (material information) prepared in advance in the Web server 101 instead of using the other person's life log data 27 in creating the user's own history. The point is different. In addition, self life log recording device 1a performs substantially the same operation except that it acquires content data (material information) as shown in FIGS. 10 and 11 instead of other person life log data 27 from the outside. In order to execute, the following description will focus on the different points.

  The Web server 101 has a content providing unit 61 and content data 60. The content data 60 includes video and audio data representing an arbitrary target. The content data 60 is associated with time information related to the time (collection time) at which the object is collected and position information at the time of the collection of the object. The content providing unit 61 has a function of providing the content data 60.

  In the own life log recording device 1, the acquisition output control unit 9 acquires the corresponding content data 60 from the Web server 101 based on the position information and time information of the own life log data 28. Specifically, when acquiring the content data, the acquisition output control unit 9 uses the position information and the time information as search keys as in the first embodiment, so the content captured in the buffer 6 as shown in FIG. There is a high possibility that the material based on the data 60 reflects the self or the voice of the self is included.

  FIG. 12 is a flowchart illustrating an example of a procedure of content search acquisition processing. The flowchart in FIG. 12 includes almost the same procedure as the flowchart in FIG. 8 in the first embodiment, except that the acquisition output control unit 9 acquires the content data 60 instead of the other person life log data 28. .

  That is, in the self life log recording device 1, the acquisition output control unit 9 requests the content data 60 from the Web server 101 using the position information and the time information as search keys as in the first embodiment (step). S24). In the Web server 101, the content data providing unit 61 has a function of providing the corresponding content data 60 to the life log recording device 1 wirelessly or by wire based on the designated position information and time information.

  The content data 60 may be any data as long as it is a material that is considered to be related to the user (self), not the other person life log data 27 described above. Examples of the content data 60 include music data associated with time information. If such content data 60 is prepared, the user's life log recording apparatus 1 can create an electronic history with music by the acquisition output control unit 9, so that the user is accompanied by nostalgic music. You can enjoy electronic history.

  According to the second embodiment, the created electronic history is created by editing the material information 60 (content data) instead of the other person's information data 27 (other person life log data). In this case, if a large amount of information is prepared in the Web server 101 as the material information 60, the personal history data creation unit 24 can create personal history data related to the electronic personal history using various material information. The (electronic) personal history created using such enormous content data 60 that can be procured can take various forms depending on the times, etc. It can be.

<Display example 1>
FIG. 13 is an image diagram showing a display example of the personal history created according to each of the above embodiments.
In the illustrated example, the display area of the display unit 99 is divided into left and right two parts. In the display area 91 on the right side, for example, a state where the parents of the user are relaxing is displayed. In the display area 91 on the right side, based on the user's own life log data 28, scenery that the user himself / herself has seen in the past is displayed. On the other hand, the left display area 92 displays the child's childhood appearance based on the other person's life log data 27 that physically corresponds to the user. That is, in the display area 92 on the left side, instead of using the user's own life log data 28, the scenery that the parents have seen in the past is displayed.

  By adopting such a display mode, the user can view two types of personal history side by side at the same time, and can soak up past memories with more images at the same time.

<Display example 2>
FIG. 14 is an image diagram showing a display example of one's own history created according to the above embodiments.
In the illustrated example, the display unit 99 itself is divided into two parts. The right display unit 993 displays the same personal history as the right display area 91 in the display example 1 described above. On the other hand, the left display unit 994 displays the same personal history as the left display area 92 in the display example 1 described above.

  When such a display mode is adopted, for example, when a floor structure between the two screens moves in accordance with the walking speed of the user, the display unit 993 is adapted to the walking speed of the user. , 994 images can be moved forwards or backwards, making it possible to use them as if they were taking a walk through their history. In addition, since the user can view two types of personal history side by side at the same time, the user can immerse in memories of the past with more images. In addition, the user can see these two types of personal history at an easy-to-view angle.

<Display example 3>
FIG. 15 is an image diagram showing a display example of the personal history created according to each of the above embodiments.
In the illustrated example, the display area of the display unit 99 is divided into left and right and four vertically and horizontally. These display modes represent a state in which one's own history is displayed using a plurality of life logs. Examples of the plurality of life logs include one's life log, a friend's life log, and a dog's life log. The display area 95 on the upper right side displays a state where the owner is relaxing with the dog. The display area 95 on the upper right side is displayed based on the owner's own life log data 28.

  In the display area 96 on the lower right side, for example, a graphic meaning “?” Question is displayed. In the display area 96 on the lower right side, based on the user's own life log data 28, the scenery that the user himself has viewed in the past is displayed.

  In the upper left display area 98, the scenery that the user's friend has seen everyday is displayed. In the display area 98 on the upper right, the scenery that the friend has viewed in the past is displayed based on the other person's life log data 27 of the user's friend.

  By adopting such a display mode, the user can view four types of personal history side by side at the same time, and can soak in past memories with more images at the same time. Furthermore, as shown in the display area 97 on the lower left side, for example, it is interesting to display the movement (degree of joy) of one's emotion (joy) at that time in a graph, and the user can be immersed in his / her memories. Can do.

In addition, this embodiment is not restricted above, A various deformation | transformation is possible. Hereinafter, such modifications will be described in order.
<Modification 1>
In each of the above embodiments, the life log recording device 1 of another person is exemplified as one unit. However, the present invention is not limited to this, and an example in which a number of life log recording devices 1 of other people are present is illustrated. Also good. That is, the acquisition output control unit 9 shown in FIG. 1 and FIG. 10 not only edits other person life log data 27 related to one other person to create an electronic personal history but also relates to a plurality of other persons. The other person's life log data 27 may be edited to create an electronic personal history.

<Modification 2>
In the above-described embodiment, the life log recording device 1 shown in FIGS. 1 and 10 is a recording medium (information recording medium) in which the created electronic personal history data about the electronic personal history can be attached to and detached from the life log recording device 1. You may make it memorize and carry it. In this way, the user can distribute the created electronic history to a third party.

<Modification 3>
In the above embodiment, the acquisition output control unit 9 edits the combination of the self life log data 28 and the other person life log data 27 or the content data 60 in the self life log recording device 1 shown in FIG. 1 and FIG. The electronic personal history is created, but it is not limited to this. That is, the acquisition output control unit 9 treats the self-life log data 28 as material search data for creating an electronic self-history to the last, does not adopt it as a material, and includes at least the life log data 27 and the content data 60 of other people. Electronic personal history may be created using one of the materials.

<Modification 4>
In the above embodiment, the electronic personal history is created by exemplifying “happy state” as the emotional state of the user. However, the electronic personal history is not limited to this. For example, the electronic personal history is created in a sad state or other emotional state. May be.

<Modification 5>
In the above embodiment, there is no provision for the time period of electronic personal history to be created. For example, when making electronic personal history only for student days, first categorized into elementary school age, junior high school age, high school age, university age, In each period, the emotion data pattern of the emotion database 30 is mainly the one with the longest joyful time or the one with the highest joyfulness (for example, taking a long time during viewing time), and the electronic personal history. May be edited. In this way, the user can create the electronic personal history that he / she feels most happy among in elementary school, junior high school, high school and university, and can fully look back on his happy time.

  In each of the embodiments described above, information (specific information) that the subject can feel with at least one of the five senses, such as video, audio, temperature, and atmospheric pressure, is handled as the information data. Moreover, in each of the embodiments described above, biological information (for example, biological information data) representing the state of the subject such as heart rate, blood pressure, and sweating amount is handled as the biological information.

  In the above embodiments, the life log includes, for example, any one of these specific information, biological information, time data (material time information, etc.), location data (position information), or any combination thereof. . In each of the above embodiments, not only the specific information but also this life log can be set as a recording target or an editing target. Regarding this life log, not only the specific information but also the biological information is to be recorded or edited. In the above embodiment, the biological information may be included as at least one of such a recording target and an editing target.

It is a system configuration figure showing an example of composition of a personal history creation system as a 1st embodiment of the present invention. It is a block diagram which shows the structural example of the buffer and acquisition output control part which are shown in FIG. It is an image figure which shows an example of the data used in this embodiment. It is a flowchart which shows an example of the procedure of a self-history creation process. It is a flowchart which shows an example of the production | generation process of the emotion database shown in FIG. It is a characteristic view which shows an example of the emotion data which exists in an emotion database. It is a characteristic view which shows another example of the emotion data which exist in an emotion database. It is a flowchart which shows an example of the procedure of a life log search acquisition process. It is a figure which shows an example of a mode that the life log which should be employ | adopted as a raw material is selected. It is a block diagram which shows the structural example of the self-history creation system as 2nd Embodiment. It is a block diagram which shows the structural example of the buffer and acquisition output control part which are shown in FIG. It is a flowchart which shows an example of the procedure of a content search acquisition process. It is an image figure which shows the example of a display of the self history produced by each said embodiment. It is an image figure which shows the example of a display of the self history produced by each said embodiment. It is an image figure which shows the example of a display of the self history produced by each said embodiment.

Explanation of symbols

1 Life log recording device (information editing device, material information providing means)
1a Life log recording device (information editing device, material information providing means)
2 Camera 2a Video data (part of information data)
3 Microphone 3a Sound data (part of information data)
5 Biometric information acquisition unit (Biometric information acquisition means)
5a Biological information 6 Buffer (Material information recording device)
9 Acquisition output control unit (material information acquisition means)
11 Timekeeping section 12 Sound output section (personal history output means)
21 Designation part (material information acquisition means)
22 Search part (material information acquisition means)
23 Acquisition unit (material information acquisition means)
24 Self-history data creation department (information editing means)
27 Others life log data (material information)
28 Self-life log data (information data)
60 content (material information)
99 Display (personal history output means)
100 Self-history creation system 101 Web server (material information providing means)

Claims (5)

A material information providing unit capable of managing a material information group that can be adopted as a material in association with material time information indicating a generation time of each material information, and providing the material information in association with the material time information;
When it is determined that the state of the subject is a prescribed state based on the biological information representing the state of the subject, it is generated with respect to the recording time of the information data in which the information that can be felt by the subject is recorded in the material information group Material information acquisition means for acquiring specific material information;
An information editing apparatus comprising: information editing means for editing the information data and the specific material information. The information editing apparatus according to claim 1,
The material information providing means provides, as the material information, other person's information data in which information that can be felt by another person as a subject is recorded,
The material information acquisition means
An information editing apparatus, wherein a part of a time zone specified based on the recording time information is acquired from the information data of the other person at an acquisition time of the information data based on the recording time information. In the information editing device according to claim 1 or 2,
The material information is video data,
The information search means includes
Face detection means for detecting whether or not the subject's face is reflected in the video data by image processing;
An information editing apparatus, comprising: a video acquisition unit that acquires, from the video data, a portion of a time zone in which the face of the subject is included when the face detection unit detects the subject's face. The information editing apparatus according to any one of claims 1 to 3,
The material information is audio data,
The information search means includes
Voice detection means for detecting whether the subject's voice is included in the voice data;
An information editing apparatus comprising: a voice acquisition unit that acquires, by voice recognition processing, a portion of a time zone in which the voice of the subject is included from the voice data when detected by the voice detection unit. The information editing apparatus according to any one of claims 1 to 4,
An information editing apparatus comprising: a personal history output unit that outputs an electronic personal history based on the experience of the subject edited by the information editing unit.

Images