JP2006185187A - Information processor, information processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processor by which a user can see or hear a scene that the user has missed to see or hear. <P>SOLUTION: An information retrieval system 1 is provided with; a gaze object determination part 10 for determining an object which a prescribed person gazes, on the basis of biological information of persons synchronized with video information obtained by photographing a prescribed space; a sound pressure object determination part 10 for determining a sound pressure object on the basis of sound information synchronized with the video information; an indexing part 12 for indexing missed scenes within the video information on the basis of the gaze object of the person and the sound pressure object; a retrieval part 16 for referring to indexes given by the indexing part 12 to retrieve missed scenes; and a display control part 17 for displaying missed scenes retrieved by the retrieval part 16. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

  Traditionally, meetings have been held almost every day, every hour. For this reason, the conference data captured and stored for each conference is enormous. The number increases daily. Here, it is troublesome to specify a desired meeting and search for a desired portion (scene) from the meeting data when it is desired to reuse the meeting data, such as looking back on matters to be determined in the meeting. It is difficult or impossible to find this.

  In addition, decisions made at meetings and the like can be reviewed by reviewing the minutes issued later. However, since the details of the decision are not recorded in the minutes, it is not possible to efficiently look back on the scene you want to see. Also, you may want to remember later things that are not listed in the minutes, such as the content of utterances and materials that seem important to you. In addition, the following technologies have been proposed as conventional technologies for supporting the review.

  The device described in Patent Document 1 presents a scene (still image) extracted from a moving image at a certain time interval as a representative image to the user, and the user estimates the temporal context based on the representative image. , You can get to the scene you want to see.

  The device described in Patent Document 2 provides utterance information of the scene as a minutes when a meeting attendee is in the middle.

JP 2002-262240 A JP 2002-99530 A

  However, during conferences and seminars, there is a problem that scenes are frequently overlooked or missed due to writing notes or making calls on mobile phones. In addition, when all conferences and seminar attendances are recorded, the amount of information becomes enormous and the searchability is remarkably lowered.

  The technique described in Patent Document 1 has poor searchability because it is necessary to find a missed scene or a missed scene while looking at a representative scene extracted from a moving image at a certain time interval.

  In addition, in the technology described in Patent Document 2, when the attendees of the conference are in the middle, the minutes of missed or missed points are created. Therefore, according to the minutes, it is not possible to look back on all missed or missed scenes.

  Therefore, the present invention has been made in view of the above problems, and an object thereof is to provide an information processing apparatus, an information processing method, and a program capable of efficiently looking back on a missed scene or a missed scene.

  In order to solve the above problems, the present invention provides gaze target determination means for determining a gaze target of a person based on biological information of the person synchronized with video information obtained by photographing a predetermined space, and gaze of the person An information processing apparatus comprising: an assigning unit that assigns an index to the person's missed scene or missed scene in the video information based on a target. According to the present invention, since an index can be assigned to a person's missed scene or missed scene in the video information depending on the person's gaze target, it is possible to efficiently look back on the person's missed scene or missed scene. .

  The present invention further includes sound pressure target determination means for determining a sound pressure target based on audio information synchronized with the video information, and the granting means includes the person's gaze target and the sound in the video information. Based on the pressure target, an index is assigned to a scene that is missed or missed by a person in the video information. According to the present invention, since an index can be assigned to a person's missed scene or missed scene in the video information depending on the person's gaze target and sound pressure target, the person's missed scene or missed scene can be efficiently handled. You can look back.

  The present invention further includes sound pressure target determination means for determining a sound pressure target based on audio information synchronized with the video information, wherein the assigning means is a target in the scene in the video information. A scene with the same sound pressure target is excluded from candidates for the person's missed scene or missed scene. According to the present invention, when the person's gaze target and the sound pressure target are the same, the viewer is looking at the speaker, so the scene is excluded from the candidates for the missed scene or the missed scene.

  The present invention further includes sound pressure target determination means for determining a sound pressure target based on audio information synchronized with the video information, wherein the assigning means is a target in the scene in the video information. Scenes with different sound pressure targets are extracted as candidates for the person's missed scene or missed scene. According to the present invention, when the gaze target and the sound pressure target are different, the viewer does not look at the lecturer. Thus, it is possible to efficiently find a person's missed scene or missed scene.

  The present invention comprises a sound pressure target determining means for determining a sound pressure target based on audio information synchronized with the video information, and the providing means is different from the sound pressure target of the person and A scene in which the person is generating sound pressure is extracted as a candidate for the person's missed scene. According to the present invention, when the gaze target and the sound pressure target are different and the viewer is generating sound pressure, it is considered that the scene is a missed scene. You can look back at the missed scenes efficiently.

  The present invention provides a sound pressure target determination means for determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space, and a person in the video information based on the sound pressure target. An information processing apparatus includes an adding unit that assigns an index to an overlooked scene or an overlooked scene. According to the present invention, it is possible to index a person's missed scene or missed scene in the video information based on the sound pressure target, so that the person's missed scene or missed scene can be efficiently looked back. it can.

  The present invention further includes synchronization means for synchronizing the person's biological information with the video information. The present invention further includes synchronization means for synchronizing the audio information with the video information. The present invention further includes search means for searching for the person's missed scene or missed scene with reference to the index assigned by the assigning means. In addition, the present invention further includes display control means for displaying a person's missed scene or missed scene searched by the search means. According to the present invention, it is possible to efficiently look back on a person's missed scene or missed scene.

  The present invention uses a gaze target of a predetermined person obtained from the biological information of the person synchronized with the video information obtained by photographing the predetermined space, and gives the missed scene or the missed scene of the person in the video information. Storage means for storing the index, and display control means for displaying the person's missed scene or missed scene in the video information with reference to the index stored in the storage means. According to the present invention, it is possible to efficiently look back on a person's missed scene or missed scene.

  The present invention includes a step of determining a gaze target of a predetermined person based on the biological information of the person synchronized with video information obtained by photographing a predetermined space, and a step in the video information based on the gaze target of the person. And a granting step of assigning an index to a missed scene or a missed scene. According to the present invention, since an index can be assigned to a missed scene or a missed scene in the video information depending on a person's gaze target, the missed scene or the missed scene can be looked back on efficiently.

  The present invention further includes a step of determining a sound pressure target based on audio information synchronized with the video information, and the adding step includes determining the video based on the gaze target of the person and the sound pressure target. An index is assigned to the person's missed scene or the missed scene in the information. According to the present invention, since an index can be assigned to a person's missed scene or missed scene in the video information depending on the person's gaze target and sound pressure target, the person's missed scene or missed scene can be efficiently handled. You can look back.

  The present invention includes a step of determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space, and a person's missed scene or listening in the video information based on the sound pressure target. And an indexing step for the missed scene. According to the present invention, it is possible to index a person's missed scene or missed scene in the video information based on the sound pressure target, so that the person's missed scene or missed scene can be efficiently looked back. it can.

  The present invention further includes a step of displaying a person's missed scene or missed scene with reference to the index. According to the present invention, it is possible to efficiently look back on a person's missed scene or missed scene.

  The present invention includes a step of determining a gaze target of a predetermined person based on biometric information of a person synchronized with video information obtained by photographing a predetermined space, and based on the gaze target of the person, the video information in the video information It is a program for causing a computer to execute an assigning step of assigning an index to a person's missed scene or a missed scene. According to the present invention, since an index can be assigned to a person's missed scene or missed scene in the video information depending on the person's gaze target, the person's missed scene or missed scene can be efficiently looked back on. .

  The present invention includes a step of determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space, and a missed scene or a missed scene in the video information based on the sound pressure target. A program for causing a computer to execute an indexing step. According to the present invention, it is possible to index a person's missed scene or missed scene in the video information based on the sound pressure target, so that the person's missed scene or missed scene can be efficiently looked back. it can.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus, the information processing method, and program which can look back at a missed scene or a missed scene efficiently can be provided.

  Hereinafter, the best mode for carrying out the present invention will be described. FIG. 1 is a block diagram of an information search system 1 according to an embodiment of the present invention. As shown in FIG. 1, the information retrieval system 1 includes a biological information detection unit 2, a voice information detection unit 3, a conference video detection unit 4, a biological information storage unit 5, a voice information storage unit 6, a conference video storage unit 7, and a synchronization. Unit 8, conference information storage unit 9, gaze target determination unit 10, sound pressure target determination unit 11, index assignment unit 12, index file storage unit 13, search request input unit 14, search request recording unit 15, search unit 16, display A control unit 17 and a display unit 18 are provided.

  This information search system 1 enables searching for a person's missed scene or missed scene from a conference video. The biometric information detection unit 2 detects information related to the eyeball such as blinks, pupil diameters, gaze targets, and gaze times of conference viewers, and biometric information such as facial skin temperature. It is preferable that the biometric information acquired here is information that can be acquired without attaching the measuring device to the viewer of the conference.

  The biological information detection unit 2 includes a camera and an image processing device, and extracts information related to blinking and pupil diameter from a face image obtained by capturing a viewer's face using a known technique. Is obtained by counting the number of blinks or measuring the pupil diameter. For the gaze target and the gaze time, use an image captured by a camera or the like arranged on the gaze target candidate side, identify the eye region by the above method, identify the gaze target from the captured camera position, and capture the eye region It can be obtained by specifying the gaze time from the shooting time. The facial skin temperature can be obtained without wearing a measuring device for the viewer by using an infrared camera, thermography or the like.

  The voice information detection unit 3 includes, for example, a sound collecting microphone and detects the voices of conference viewers and speakers. The conference video detection unit 4 is composed of a video camera or the like and detects a conference video. The conference video detection unit 4 may be a camera that can capture presentation materials and viewers used in a conference at a wide angle. The biological information detection unit 2, the audio information detection unit 3, and the conference video detection unit 4 are installed at predetermined positions in the conference room. During the shooting of the conference video by the conference video detector 4, the biometric information and audio information of the conference participants are detected.

  The biological information storage unit 5 stores the biological information detected by the biological information detection unit 2 in the form of a data sheet. FIG. 2 is a diagram illustrating a data sheet stored in the biometric information storage unit 5. In FIG. 2, the biological information includes pupil diameter x, y, gaze target, gaze time, blink, and facial skin temperature. This biometric information is stored for each viewer in association with time t. This time t corresponds to the conference video detected by the conference video detection unit 4. The gaze target is set as the gaze target by specifying the camera position that can be imaged from the camera installed on the gaze target side. The gaze time is calculated and recorded for each subject. In the example of FIG. 2, the viewer A can see that the gaze target is moving in the order of 1, 2, 3, and 1.

  The voice information storage unit 6 stores the voice detected by the voice information detection unit 3 in the form of a data sheet. FIG. 3 is a view showing a data sheet stored in the audio information storage unit 6. In FIG. 3, the audio information includes utterance presence / absence, volume, speaker utterance presence / absence, speaker volume, and environmental sound. This biometric information is stored for each viewer in association with time t. In particular, the environmental sound includes acoustic information generated accompanying the video. In the example illustrated in FIG. 3, the viewer A generates sound pressure during the utterance “Y”.

  The conference video storage unit 7 stores the conference video detected by the conference video detection unit 4 in a list format data sheet. FIG. 4 is a view showing a data sheet stored in the conference video storage unit 7. As shown in FIG. 4, the conference video is stored in correspondence with the identification symbol ID.

  The synchronization unit 8 synchronizes the biological information of the person stored in the biometric information storage unit 5 and the audio information stored in the audio information storage unit 6 with the video information stored in the conference video storage unit 7. The conference information storage unit 9 is configured by a recording device such as a semiconductor memory, a hard disk, or a flexible disk, and holds information synchronized by the synchronization unit 8 as a conference index file.

  FIG. 5 is a view showing a data sheet stored in the conference information storage unit 9. As shown in FIG. 5, the conference information includes biological information such as time, pupil diameter, gaze target, gaze time, blink, and facial skin temperature, utterance presence / absence, volume, speaker utterance presence / absence, speaker volume, and environmental sound. Such as sound information and conference video information data ID. The meeting information is associated with the time for each viewer.

  The gaze target determination unit 10 determines a gaze target of a predetermined person based on the biometric information of the person acquired from the conference information storage unit 9. The sound pressure target determination unit 11 determines a sound pressure target based on the audio information acquired from the conference information storage unit 9. The sound pressure target is a target that is speaking. The index assigning unit 12 assigns an index to a missed scene or a missed scene in the video information based on a person's gaze target and sound pressure target. The index assigning unit 12 may assign an index to a missed scene or a missed scene in the video information based only on a person's gaze target. The index file storage unit 13 stores the missed scene ID or the missed scene ID in association with the index of the missed scene or the missed scene. Therefore, the index file storage unit 13 uses a person's gaze target obtained from the biometric information of the person synchronized with the video information obtained by photographing a predetermined space to detect a missed scene or a missed scene in the video information. Stores the assigned index.

  The search request input unit 14 is configured by, for example, a touch panel, a mouse, a keyboard, or the like. The user can input a specific search request by operating the search request input unit 14. For example, the user designates a specific viewer from the search request input unit 14. The search request recording unit 15 is configured by a recording device such as a semiconductor memory, a hard disk, or a flexible disk, and records the search conditions input by the search request input unit 14.

  Based on the search request input from the search request input unit 14, the search unit 16 accesses the index file storage unit 13 and sends a missed scene ID or a missed scene ID to the display control unit 14. The display control unit 17 acquires video information corresponding to the missed scene ID or the missed scene ID from the conference video storage unit 7, generates drawing information, and sends it to the display unit 18. The display unit 18 displays a missed scene or a missed scene based on the drawing information from the display control unit 17. The display control unit 17 may display a thumbnail of the video information based on the missed scene ID or the missed scene ID.

  FIG. 6 is a diagram for explaining detection and recording of biometric information, audio information, and conference video information. As shown in FIG. 6, in the conference room 200, viewers A to D are sitting on a chair around a table 201. The projector 204 projects a slide on the slide display unit 205. Along with this slide, the speaker 206 gives a lecture. The video camera 203 corresponds to the conference video detection unit 4 described above and detects a conference video. Video cameras 211, 212, 213, and 214 correspond to the biological information detection unit 2 described above. Here, the slide display unit 205 is a gaze target (visual target) (1), the speaker 206 is a gaze target (2), the notebook computer 207 placed in front of the viewer A is the gaze target (3), and the rest The other position (other) is set as the gaze target (4).

  When the viewer A gazes at the slide display unit 205, the face image information is detected by the video camera 211, and the gaze target of the viewer A is (1). When the viewer A gazes at the speaker 206, the face image information is detected by the video camera 212, and the gaze target of the viewer A is (2). When the viewer A gazes at the notebook computer 207, the face image information is detected by the video camera 213, and the gaze target of the viewer A is (3). When the viewer A gazes at another position, the face image information is detected by the video camera 214, and the viewer A's gaze target is (4).

  The gaze target determination unit 10 identifies the gaze target of the viewer A based on the biological information. The sound pressure sensors 301 and 302 correspond to the sound information detection unit 3. The sound pressure sensor 301 detects the audio information of the viewer A, and the sound pressure sensor 302 detects the audio information of the speaker 206. The sound pressure target determination unit 11 specifies a sound pressure target based on the sound information detected by the sound pressure sensors 301 and 302.

  FIG. 7 is a diagram for explaining scene extraction of missed candidates and missed candidates. In FIG. 7, the upper diagram is a diagram showing a viewer A's gaze target (visual target), and the lower diagram is a diagram showing a sound pressure target. (1)-(4) show the gaze object shown in FIG. It can be seen that the watching target of the viewer A moves in the order of (1), (2), (3), (4), and (1). In the lower diagram of FIG. 7 showing the sound pressure target, a portion indicated by a solid line indicates the utterance section of the speaker 206, and a portion indicated by a broken line indicates the utterance section of the viewer A. If the viewer A's gaze target is (2) and the sound pressure target is the speaker 206, the viewer A is looking at the speaker 206. exclude. On the other hand, when the viewer A's gaze target is (4) and the sound pressure target is the viewer A, the viewer A is talking by himself while looking at people other than the speaker 206. Candidates for missing or missing scenes.

  Next, the process of extracting missed scene and missed scene candidates will be described with reference to FIGS. FIG. 8 is a flowchart of the process of extracting a missed scene or a missed scene. FIG. 8 shows a flow of extracting a missed scene or a missed scene for one scene.

  In step S <b> 101, the biological information detection unit 2 acquires facial image information of the conference participant and detects biological information including a gaze target. The voice information detection unit 3 detects the voice information of the speaker 206 and the viewer A. In step S <b> 102, the synchronization unit 8 stores biometric information and audio information in the conference information storage unit 9 in synchronization with the conference video. In step S <b> 103, the gaze target determination unit 10 determines the gaze target of the viewer A based on the biological information acquired from the conference information storage unit 9. The sound pressure target determination unit 11 determines a sound pressure target based on the audio information acquired from the conference information storage unit 9.

  In step S <b> 104, the index assignment unit 12 shifts the sound pressure target from the gaze target based on the viewer A's gaze target acquired from the gaze target determination unit 10 and the sound pressure target acquired from the sound pressure target detection unit 11. If it is determined that the sound pressure target and the gaze target are the same, the process proceeds to step 107, and the determined scene is excluded from the missed / missed bulletin scene. For example, in FIG. 7, when the viewer A's gaze target is (2) and the sound pressure target is the speaker 206, the person's gaze target is the same as the sound pressure target. Will be watching. In such a case, the index assigning unit 12 excludes a scene in which a person's gaze target and sound pressure target are the same as a missed scene or a missed scene candidate.

  In step S104, when the index assigning unit 12 determines that the sound pressure target and the gaze target are different from each other, the process proceeds to step S105, where it is determined whether or not the viewer A generates sound pressure. If the sound pressure is not generated, it is extracted as a missed candidate in step S108, an index for identifying the missed scene is assigned to this scene, and the index file storage unit 13 stores the index. For example, in FIG. 7, when the viewer A's gaze target is (3) and the sound pressure target is the speaker 206, the gaze target and the sound pressure target are different, so the viewer looks at the speaker. Will not be. In such a case, the index assigning unit 12 overlooks a scene in which a person's gaze target and a sound pressure target are different and extracts them as scene candidates.

  If it is determined in step S105 that the viewer A is generating sound pressure, the index assigning unit 12 extracts this scene as a missed candidate in step S106 and specifies a missed scene for this scene. The index is stored and stored in the index file storage unit 13. For example, in FIG. 7, when the viewer A's gaze target is (4) and the sound pressure target is the viewer A, the gaze target is different from the sound pressure target, and the viewer generates sound pressure. It is considered to be a missed scene. In such a case, the index assigning unit 12 determines that the person's gaze target is different from the sound pressure target, and the person is generating a sound pressure, and extracts it as a missed scene candidate.

  Next, the display process will be described. The search unit 16 searches for a missed scene or a missed scene with reference to the index stored in the index file storage unit 13 based on the search request of the search request input unit 14. . The display control unit 17 extracts the conference video corresponding to the missed scene or the missed scene searched by the search unit 16 from the conference video storage unit 7 and displays it via the display unit 18. By looking at the display on the display unit 18, a missed scene or a missed scene can be looked back efficiently.

  In the above embodiment, an example in which an index is assigned using a gaze target and a sound pressure target has been described, but an index may be assigned to a scene using only the sound pressure target. In this case, the information processing apparatus includes: a sound pressure target determination unit 11 that detects a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space; The index assigning unit 12 assigns an index to the missed scene or the missed scene. The information retrieval system 1 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), a hard disk device, and a display device.

  Note that the information processing method of the present invention is realized using, for example, a CPU, ROM, RAM, and the like, and the program is installed from a hard disk device, a portable storage medium such as a CD-ROM, DVD, or a flexible disk, or communicated. Each step is realized by downloading from the circuit and executing this program by the CPU.

  The program detects a person's gaze target based on the biometric information of the person synchronized with the video information obtained by photographing a predetermined space, the missed scene in the video information based on the person's gaze target, or The computer is caused to execute an assigning step for assigning an index to the missed scene. Further, the program detects a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space, and a missed scene or a missed scene in the video information based on the sound pressure target. Causing the computer to execute an indexing step. The gaze target determination unit 10 corresponds to the gaze target determination unit, the sound pressure target determination unit 11 corresponds to the sound pressure target determination unit, and the index assignment unit 12 corresponds to the provision unit. The information processing apparatus is incorporated in the information search system 1.

  Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed. For example, in each of the embodiments described above, the conference video is used as the video, but the video of the present invention is not limited to the conference video.

It is a block diagram of the information search system in the embodiment of the present invention. It is a figure which shows the data sheet stored in the biometric information storage part. It is a figure which shows the data sheet stored in the audio | voice information storage part. It is a figure which shows the data sheet stored in the meeting image | video storage part. It is a figure which shows the data sheet stored in the meeting information storage part. It is a figure for demonstrating the detection and recording of biometric information, audio | voice information, and conference video information. It is a figure for demonstrating the scene extraction of an oversight candidate and an oversight candidate. It is an extraction process flowchart of a missed scene or a missed scene.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Information search system 11 Sound pressure object extraction part 2 Biometric information detection part 12 Index provision part 3 Audio | voice information detection part 13 Index storage part 4 Conference video detection part 14 Search request input part 8 Synchronization part 16 Search part 9 Conference information storage part 17 Display control unit 10 Gaze target extraction unit

Claims (17)

Gaze target determination means for determining a gaze target of the person based on the biometric information of the person synchronized with the video information obtained by photographing the predetermined space;
An information processing apparatus comprising: an assigning unit that assigns an index to the person's missed scene or missed scene in the video information based on the person's gaze target. A sound pressure target determining means for determining a sound pressure target based on the audio information synchronized with the video information;
2. The indexing unit according to claim 1, wherein the assigning unit assigns an index to an overlooked scene or an overlooked scene of the person in the video information based on the gaze target and the sound pressure target of the person. Information processing device. A sound pressure target determining means for determining a sound pressure target based on the audio information synchronized with the video information;
2. The apparatus according to claim 1, wherein the adding unit excludes a scene in the video information in which the person's gaze target and the sound pressure target are the same from candidates for the person's missed scene or missed scene. Information processing device. A sound pressure target determining means for determining a sound pressure target based on the audio information synchronized with the video information;
The said giving means extracts a scene in which the person's gaze target and the sound pressure target are different in the scene in the video information as candidates for the person's missed scene or missed scene. Information processing device. A sound pressure target determining means for determining a sound pressure target based on the audio information synchronized with the video information;
The assigning means extracts a scene in which the person's gaze target and the sound pressure target are different in the scene in the video information and the person is generating sound pressure as candidates for the person's missed scene. The information processing apparatus according to claim 1. Sound pressure target determination means for determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space;
An information processing apparatus comprising: an assigning unit that assigns an index to a person's missed scene or missed scene in the video information based on the sound pressure target. The information processing apparatus according to claim 1, further comprising synchronization means for synchronizing the biological information of the person with the video information. The information processing apparatus according to any one of claims 2 to 6, further comprising a synchronization unit configured to synchronize the audio information with the video information. 7. The apparatus according to claim 1, further comprising a search unit that searches for an overlooked scene or an overlooked scene of the person with reference to the index provided by the assigning unit. Information processing device. The information processing apparatus according to claim 9, further comprising display control means for displaying an overlooked scene or a missed scene of the person searched by the search means. An index assigned to the person's missed scene or missed scene in the video information using the gaze target of the predetermined person obtained from the biological information of the person synchronized with the video information obtained by photographing the predetermined space. Storage means for storing;
An information processing apparatus comprising: display control means for displaying an overlooked scene or an overlooked scene of the person in the video information with reference to an index stored in the storage means. Determining a gaze target of the predetermined person based on the biological information of the person synchronized with the video information obtained by photographing the predetermined space;
An information processing method comprising: adding an index to the person's missed scene or missed scene in the video information based on the person's gaze target. Further comprising the step of determining a sound pressure target based on the audio information synchronized with the video information;
13. The index according to claim 12, wherein the assigning step assigns an index to the missed scene or the missed scene of the person in the video information based on the gaze target of the person and the sound pressure target. Information processing method. Determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space;
Providing an index to a person's missed scene or missed scene in the video information based on the sound pressure target. The information processing method according to claim 12, further comprising a step of displaying a missed scene or a missed scene of the person with reference to the index. Determining a gaze target of the predetermined person based on the biological information of the person synchronized with the video information obtained by photographing the predetermined space;
A program for causing a computer to execute an assigning step of assigning an index to the person's missed scene or missed scene in the video information based on the person's gaze target. Determining a sound pressure target based on audio information synchronized with video information obtained by photographing a predetermined space;
The program for making a computer perform the step which provides an index with respect to the person's missed scene or the missed scene in the said video information based on the said sound pressure object.

Images