JP2007006082A - Image reproducer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an "image reproducer" capable of reducing complicated labor and a time for retrieving a desired scene from a recorded image. <P>SOLUTION: The image reproducer retrieves a partial scene from an image in which music corresponds to at least a part of the image. The image reproducer has an image/music storage 1 storing image data required for reproducing the image and the music and music data and a retrieval-condition setting section 3 setting retrieval conditions capable of specifying the place of the reproduction of the music. The image reproducer further has a music retriever 4 specifying the place of the reproduction of the music satisfying retrieval conditions set by the retrieval-condition setting section 3, and an image retriever 5 specifying the partial scene of the image corresponding to the place of the reproduction of the music specified by the music retriever 4. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video playback apparatus that searches for a desired scene from recorded video.

Since movies such as movies recorded on a DVD or the like have a long playback time, it is convenient if only characteristic scenes can be extracted from the video. For example, prior to the purchase of a DVD, if only a characteristic digest scene can be seen, this is a reference for determining whether or not to purchase this DVD. In addition, there may be a case where only a featured climax scene is desired for a movie or the like that has been seen once. As a conventional technique for selectively extracting a part of a scene from the entire recorded video, a video system that generates a digest image including a multi-angle video is known (for example, see Patent Document 1). ).
Japanese Patent Laying-Open No. 2003-230127 (page 5-11, FIG. 1-8)

  By the way, in the system disclosed in Patent Document 1 described above, a digest video is generated on the premise that a multi-angle video is used only for an important scene. However, since the scene that the user wants to search is not necessarily a multi-angle video, if the video is searched on condition that it is multi-angle, the desired scene cannot always be searched, and eventually fast-forwarding is performed. There is a problem that it takes a lot of trouble and time to search for the video because it depends on such operations as the above. In addition, since there are not so many videos such as movies that incorporate a multi-angle video as a part at present, a desired scene cannot be searched for such a video.

  The present invention was created in view of the above points, and an object of the present invention is to provide a video reproducing apparatus capable of reducing the troublesome time and time for searching for a desired scene from recorded video. It is to provide.

  In order to solve the above-described problem, the video playback apparatus of the present invention searches for a part of scenes from video corresponding to music at least in part, and video necessary for playback of video and music Video / music storage means for storing data and music data, search condition setting means for setting search conditions for specifying the music playback position, and music playback position satisfying the search conditions set by the search condition setting means And music search means for specifying a partial scene of the video corresponding to the music playback position specified by the music search means. When music is played along with video, this music can be searched by specifying a predetermined search condition, and video corresponding to the searched music can be searched to search for video using the music as a clue. Therefore, when characteristic music corresponding to a desired video scene is used, it is possible to reduce troublesome labor and time required to search for this scene. For example, in climax scenes such as movies and dramas, music that is more impressive than other scenes is often used to enhance the realistic sensation of the video, so playback can be requested by specifying this characteristic music. The search for the climax scene to be performed becomes easy.

  Further, the search condition set by the search condition setting means described above is music data that can specify a temporal change pattern of sound volume, and the music search means stores music data stored in the video / music storage means. From the time-varying pattern of the sound volume of the music that is obtained during playback, the part that matches or resembles the sound volume time-varying pattern as the search condition is specified as the music playback position that satisfies the search condition. It is desirable to do. As a search condition for searching for music, by specifying music data that can specify the time change pattern of the sound volume, that is, the waveform pattern, the playback position of music having the same content as this waveform pattern is searched. can do.

  The search condition set by the search condition setting means described above is a musical instrument to be used, and the music search means is selected from among music obtained when music data stored in the video / music storage means is reproduced. It is desirable to specify a place played using the musical instrument specified by the search condition as a music playback position that satisfies the search condition. By specifying an instrument as a search condition for searching for music, you can search for the playback position of the music that uses the instrument, so you can search for video scenes that have a strong impression of the instrument playing the music. In this case, it is possible to reduce the troublesome time and time required to search for this scene.

  In addition, the music search means described above searches for a location including a timbre specific to the instrument specified by the search condition from music obtained when the music data stored in the video / music storage means is reproduced. It is desirable to specify the music playback position that satisfies the above. This makes it possible to specify the music playback position using the musical instrument designated as the search condition.

  Further, the search condition set by the search condition setting means described above is at least one of tune and genre, and the music search means is the music that is obtained when the music data stored in the video / music storage means is reproduced. It is desirable to specify a position where the music tone or genre specified by the search condition matches as a music playback position satisfying the search condition. When searching for video scenes with a strong impression of the music tone or genre by specifying the tone or genre as a search condition for searching for music, the playback position of the music or genre music can be searched. In addition, it is possible to reduce the troublesome time and time required to search for this scene.

  Also, a playback means for reading the video data and music data stored in the video / music playback means described above to play back the video and music, and a playback for designating a playback start position and instructing the start of the playback operation by the playback means An instruction means, and when a part of the scene is specified by the video search means, the reproduction instruction means designates a reproduction start position corresponding to the part of the scene and reproduces video and music on the reproduction means. It is desirable to indicate. As a result, both music and video can be played from the music playback position that meets the search conditions.

  Further, when there are a plurality of scenes specified by the above-described video search means, it is desirable that the reproduction instruction means designates a reproduction start position corresponding to the scene with the earliest reproduction position. As a result, when there are a plurality of music playback positions that meet the search conditions, it is possible to play back from the first scene and check the contents.

  In addition, it further includes an operation unit that receives an instruction to change the reproduction position described above, and the reproduction instruction unit corresponds to each of the plurality of scenes specified by the video search unit when the change instruction is made using the operation unit. It is desirable to switch the reproduction start position in a predetermined order. As a result, when there are multiple music playback positions that match the search conditions, it is possible to play back multiple scenes corresponding to each playback position in order according to the user's operation and confirm the contents. become.

  In addition, when there are a plurality of scenes specified by the video search means described above, the playback instruction means sequentially specifies the playback start positions corresponding to each of the plurality of scenes, and the playback means is controlled by the playback instruction means. It is desirable to reproduce video and music corresponding to each of a plurality of scenes according to the order of the designated reproduction start positions. As a result, when there are a plurality of music playback positions that meet the search conditions, a plurality of scenes corresponding to the respective playback positions can be automatically played back in order and the contents can be confirmed.

  A video playback apparatus according to an embodiment to which the present invention is applied will be described below with reference to the drawings. FIG. 1 is a diagram illustrating a basic configuration of a video playback apparatus according to an embodiment. 1 includes a video / music storage unit 1, a video search processing unit 2, a playback unit 7, and an operation unit 8. This video playback apparatus is for playing back a video with music added at least in part together with the music, and has a function of searching for a part of the scene from the video scene.

  The video / music storage unit 1 stores video data and music data necessary for playback of video and music. Although it is necessary to have a predetermined capacity for storing video data, the recording medium itself may be a hard disk device, a DVD, or a CD. In addition, necessary video data and music data may be obtained from a predetermined distribution server each time via a network using a broadband communication means. In this case, the video / music storage unit is provided in a distribution server connected via a network.

  The video search processing unit 2 performs a process of searching for a specific scene of a video that the user desires to reproduce by setting a predetermined search condition. The specific scene may exist in a plurality of locations in the video to be played back. The video search processing unit 2 includes a search condition setting unit 3, a music search unit 4, a video search unit 5, and a playback position designation unit 6.

The search condition setting unit 3 sets a search condition that can specify the playback position of music added to a video. There are the following three methods for setting search conditions.
(1) A method for designating or inputting music data capable of specifying a time change pattern of a loudness, that is, a waveform pattern. The music data that can specify the waveform pattern is PCM data of music to be searched or data compressed in a format such as MP3. For example, when the same music is always used in a climax scene in a movie or a drama, the music itself used in the climax scene is designated by this method.
(2) A method for specifying the instrument to be used. For example, this method is used when searching for a playback position of music including a piano performance.
(3) A method of designating the tune or genre. For example, this method is used when a music playback location is searched by specifying a melody indicating a minor, major, or mood (atmosphere), or a genre such as rock, pop, or jazz.

  The music search unit 4 specifies a playback position that satisfies the search condition set by the search condition setting unit 3 from the music added to the video stored in the video / music storage unit 1. The playback position that satisfies the search condition includes information that can specify the playback range from the playback start position to the playback end position. When the music search position is specified by the music search unit 4, the video search unit 5 searches for a partial scene of the video to which this music is added. The reproduction position designating unit 6 designates the reproduction start position of a part of the scene of the video searched by the video search unit 5 to the reproduction unit 7 and instructs the reproduction unit 7 to start the reproduction operation. The playback unit 7 reads video data and music data stored in the video / music storage unit 1 from the playback start position specified by the playback position specifying unit 6 and plays back video and music. The operation unit 8 is used for a user input operation when the search condition setting unit 3 sets the search condition, and includes various keys necessary for setting the search condition. In addition, the operation unit 8 is a case where there are a plurality of music playback locations that satisfy the search conditions, and during playback of a video scene corresponding to any of these locations, the operation unit 8 skips this scene and selects other scenes. A “skip” key is provided for accepting a playback position change instruction when playback is desired.

  The video / music storage unit 1 is the video / music storage unit, the search condition setting unit 3 is the search condition setting unit, the music search unit 4 is the music search unit, the video search unit 5 is the video search unit, and the playback unit. 7 corresponds to the reproduction means, the reproduction position designation unit 6 corresponds to the reproduction instruction unit, and the operation unit 8 corresponds to the operation unit.

  FIG. 2 is a diagram showing a configuration when the video playback device shown in FIG. 1 is applied to a DVD playback device. A DVD playback apparatus 100 shown in FIG. 2 performs amplification of the read signal with a spindle motor 12, an optical pickup 14, a feed motor 16 and a servo control unit 18 for reading video and music signals recorded on the DVD 10. An RF amplifier 22, a digital signal processing unit 24, four buffer RAMs 26, 34, 38, 42, a stream separation unit 30, an audio decoder 32, a video decoder 36, and a sub-picture decoder 40. , Video processor 44, video encoder 46, display device 47, digital-analog (D / A) converter 48 and speaker 49, operation unit 58 for a user to input various operation instructions, and DVD playback device 100. Including a system controller 60 for controlling the entire system It has been made.

  The spindle motor 12 rotates the DVD 10 at a constant linear velocity. The optical pickup 14 detects data recorded on the DVD 10, and includes, for example, a semiconductor laser and a photodiode. The feed motor 16 moves the optical pickup 14 in the radial direction of the DVD 10.

  The servo control unit 18 drives the spindle motor 12 and the feed motor 16 described above in accordance with an instruction from the system controller 60 and moves an objective lens (not shown) built in the optical pickup 14 to move the semiconductor laser. The focal position is moved vertically and horizontally with respect to the recording surface of the DVD 10. The servo control unit 18 performs various servo (focus servo, tracking servo, rotation servo) control necessary for reading data from the DVD 10.

  The RF amplifier 22 amplifies an electric signal output from a photodiode built in the optical pickup 14, and when a track jump occurs due to a large vibration or impact on the DVD playback apparatus 100, a track jump detection signal is generated. It also has a function to output.

  The digital signal processing unit 24 converts the signal output from the RF amplifier 22 into digital data, and then performs signal demodulation processing (8-16 demodulation processing) and error correction processing according to the data format of the DVD 10, and the RAM 26. To store. The digital signal processing unit 24 extracts VMGI and VTSI from the data stored in the RAM 26 in accordance with an instruction from the system controller 60 and outputs the VMGI and VTSI to the system controller 60, and also extracts VOBU and outputs it to the stream separation unit 30. To do.

  The stream separation unit 30 analyzes the pack header constituting the VOBU output from the digital signal processing unit 24 in accordance with an instruction from the system controller 60, thereby performing audio pack (A_PCK), video pack (V_PCK), sub-picture. The pack (SP_PCK) and the navigation pack (NV_PCK) are separated. The audio pack separated by the stream separation unit 30 is output to the audio decoder 32, the video pack is output to the video decoder 36, the sub-picture pack is output to the sub-picture decoder 40, and the navigation pack is transferred to the system controller 60. .

  The audio decoder 32 performs a predetermined decoding process on the audio pack output from the stream separator 30 and outputs audio data. The video decoder 36 performs a predetermined decoding process on the video pack output from the stream separator 30 and outputs video data. When the image data compression technique based on MPEG2 is employed, the video decoder 36 uses the image data corresponding to the I picture, the image data corresponding to the P picture, and the B picture included in the plurality of video packs output from the stream separation unit 30. Based on the image data corresponding to the picture, three types of video data of I picture, P picture, and B picture are generated and output. The sub-picture decoder 40 performs a predetermined decoding process on the sub-picture pack output from the stream separation unit 30 and outputs sub-picture data.

  The video processor 44 generates image data obtained by synthesizing the video data output from the video decoder 36 and the sub-picture data output from the sub-picture decoder 40 in accordance with an instruction from the system controller 60, and outputs the generated image data to the video encoder 46. To do. The video encoder 46 converts the image data output from the video processor 44 into an image signal for display. By outputting this image signal to the display device 47, an image is displayed.

  The D / A converter 48 converts the audio data output from the audio decoder 32 into an analog audio signal. By outputting the audio signal to the speaker 49, audio sound (music) is reproduced.

  The operation unit 58 records a playback key for giving a title playback instruction, a stop key for instructing a stop of title playback, a pause key for instructing a pause of the title playback, and a position where the playback operation has stopped. Stop position recording key for giving an instruction to perform, Stop position menu screen display key for giving an instruction to display a stop position menu screen described later, Left / right / up / down cursor keys, Confirming the item at the cursor position on the display screen Various operation keys such as a setting key to be performed are provided, and a signal corresponding to the operation state of the key is output to the system controller 60.

  The system controller 60 controls all the functional blocks such as outputting various servo commands to the servo control unit 18 and outputting an image generation command corresponding to a user operation command to the video processor 44. Specifically, the system controller 60 receives VMGI and VTSI included in the data output from the digital signal processing unit 24, and NV_PCK output from the stream separation unit 30, and executes a navigation command included in these. Thus, various controls necessary for the reproduction operation are performed, such as outputting various servo commands to the servo control unit 18 and outputting an image generation instruction corresponding to a user operation instruction to the video processor 44.

  In the configuration described above, the DVD 10 is in the video / music storage unit 1, the display unit 47 that outputs video and music based on the signals read from the DVD 10, and the speaker 49 are in the playback unit 7, and the operation unit 58 is in operation. Each corresponds to part 8. Further, the system controller 60 has the function of the video search processing unit 2 shown in FIG. 1, and includes a search condition setting unit 3, a music search unit 4, a video search unit 5, and a playback position designation unit 6.

  FIG. 3 is a diagram showing the structure of the volume space of the DVD. As shown in the figure, the volume space of the DVD is composed of a volume file structure, a DVD-Video zone, and a DVD other zone from the inner periphery to the outer periphery of the DVD. Among these, the DVD-Video zone includes various data necessary for the reproduction operation. The DVD-Video zone includes a video manager (VMG) and one or more video title sets (VTS) corresponding to each title.

  FIG. 4 is a diagram showing the data structure of VMG. As shown in the figure, the VMG includes video manager information (VMGI), a VMG menu video object set (VMGM_VOBS), and a VMGI backup file (VMGI_BUP).

  VMGI includes information about VTS (number of VTSs, VTS number for identifying each VTS, storage position of each VTS in the DVD, etc.), display order of titles displayed in the title menu, and one or more program chain information (PGCI), a disc ID (DVD_ID) for identifying a DVD, a disc name (for example, a movie title), and the like are included. VMGM_VOBS is composed of one or more video objects (VOB). This VOB includes video data which is reproduction data when reproducing a menu screen (title menu screen) for selecting a title.

  FIG. 5 shows the data structure of the VTS. As shown in the figure, the VTS is composed of video title set information (VTSI), VTS menu video object set (VTSM_VOBS), VTS title video object set (VTSTT_VOBS), and a VTSI backup file (VTSI_BUP). Yes.

  The VTSI includes information on a title, a PTT number for identifying each chapter (PTT) in the VTS, one or more PGCIs, and the like. The VTSM_VOBS and VTSTT_VOBS are configured by one or more VOBs. This VOB includes reproduction data such as video data and audio data.

  The playback data of the title is included in VOB # 1 to #i in VTSTT_VOBS. A chapter is a unit obtained by dividing a title, and chapter reproduction data is included in one or a plurality of VOBs in VTSTT_VOBS. For example, as shown in FIG. 5, the title is divided into chapters # 1 to #p, the reproduction data of chapter # 1 is included in VOB # 1 to # 3, and the reproduction data of chapter # 2 is It is included in VOB # 4 and # 5.

  FIG. 6 is a diagram illustrating a data structure of a VOB included in the above-described VMGM_VOBS, VTSM_VOBS, and VTSTT_VOBS. As shown in the figure, the VOB is composed of a plurality of cells. Each cell is composed of a plurality of video object units (VOBU). Each VOBU includes at least one of a navigation pack (NV_PCK), a video pack (V_PCK), a sub-picture pack (SP_PCK), and an audio pack (A_PCK).

  NV_PCK includes playback control information (PCI) and data search information (DSI). The PCI and DSI are set with information such as the amount of VOBU data, the playback time from the start of playback of a title to the start of playback of the corresponding VOBU, and the position of the VOBU to be played next.

  V_PCK, SP_PCK, and A_PCK are respectively a pack header, packet header, data-compressed video data, sub-picture data, and audio data (compressed) that include information such as the type of reproduction data (moving image, sub-picture, audio). Playback data).

  The DVD playback apparatus to which the video playback apparatus of this embodiment is applied has such a configuration, and the operation thereof will be described next. FIG. 7 is a flowchart showing an operation procedure of a video scene search operation in the present embodiment. When the DVD playback apparatus 100 is turned on and is ready to start a playback operation, the search condition setting unit 3 in the system controller 60 determines whether or not search condition setting has been instructed (step 100). This instruction is performed using the operation unit 58. If the search condition setting is not instructed, a negative determination is made and this determination is repeated. This search condition setting instruction is not limited to immediately after the DVD playback apparatus 100 is turned on, but can be performed during the playback operation, and the search condition setting unit 3 makes this determination during a period excluding a predetermined operation prohibition period. It is carried out.

  When a search condition setting instruction is issued using the operation unit 58, an affirmative determination is made in the determination of step 100, and the search condition setting unit 3 sets a search condition according to the operation content of the operation unit 58 (step). 101). As described above, search conditions that can be set include (1) specifying or inputting music data that can specify a waveform pattern, (2) specifying a musical instrument to be used, and (3) specifying a musical tone or genre. , Either can be selected. For example, the search condition setting unit 3 displays a menu screen including these three types of search condition input methods as selection items on the display device 47. The user can select which search condition input method is adopted by operating the operation unit 58. When one of the search condition input methods is selected by the user, the search condition setting unit 3 displays a search condition setting screen for each search condition input method on the display device 47 next. The user can operate the operation unit 58 to set a predetermined search condition using the displayed search condition setting screen. For example, when a musical instrument to be used is designated, a selection screen including selectable musical instruments as options may be displayed and any one or a plurality of musical instruments may be selected. Further, when designating a tune or genre, a selection screen including selectable tunes and genres as options may be displayed to select a tune or genre. As for music data for which a waveform pattern can be specified, there is a case where a waveform pattern is directly input from an input terminal (not shown), or a case where music data (whole or part) is stored in advance and designated. Conceivable.

  When the search conditions are set, the music search unit 4 sequentially reads out the audio packs recorded on the DVD 10 (step 102), and determines whether there is music that satisfies the search conditions (step 103). . For example, when music data that can specify a waveform pattern is specified as a search condition, pattern recognition processing using this waveform pattern is performed, and a playback position of music having the same or similar waveform pattern is specified. The When a musical instrument is designated as the search condition, the playback location of music played using the designated musical instrument is specified. In general, a musical instrument has a unique timbre, and each timbre has a unique frequency component and waveform. Therefore, by extracting a reproduction portion that matches a frequency component or waveform peculiar to each timbre, it is possible to specify a reproduction portion of music played using a designated instrument. Further, when a music tone or genre is designated as a search condition, a music playback location having the designated music tone or a music playback location corresponding to the designated genre is specified. The specific search method is basically the same as in the case of musical instruments, and general frequency components and waveforms peculiar to the tone or genre have been obtained in advance, and the frequency corresponding to the specified tone or genre. By extracting the playback location that matches the component or waveform, the playback location of the corresponding music is identified.

  If music satisfying the search condition is included and an affirmative determination is made in step 103, the music search unit 4 records the playback location of the searched music (step 104) or sets the search condition. After the music to be satisfied is not included in the read audio pack and a negative determination is made in the determination in step 103, it is determined whether or not the reading of the video pack has been completed to the playback end position (step 105). If not completed, a negative determination is made, and the process returns to step 102 to repeat the process after reading the audio pack.

  When the reading of the video pack reaches the reproduction end position, an affirmative determination is made in the determination of step 105, and then the video search unit 5 determines whether or not there is music that satisfies the search condition (step 106). . If there is no corresponding music, a negative determination is made, a message to that effect is displayed on the display device 47 (step 107), and a series of processing relating to the search for the video scene is terminated.

  If there is music that satisfies the search condition, an affirmative determination is made in the determination of step 106, and then the video search unit 5 searches for the first video scene corresponding to the music that satisfies the search condition ( Step 108), the playback position designation unit 6 designates the playback start position of the searched first video scene, and instructs each component operating as the playback unit 7 to play video and music (Step 109). . In response to this instruction, the video scene corresponding to the searched music playback location is played back with music (step 110).

  In parallel with this playback operation, the playback position designating unit 6 determines whether or not a change instruction for skipping the video scene has been performed using the “skip” key of the operation unit 58 (step 111). If no change instruction is given, a negative determination is made, and then the playback position designating unit 6 determines whether or not the playback of the video scene corresponding to the music satisfying the search condition has ended (step 112). ). If reproduction has not ended, a negative determination is made, and the process returns to step 110 to repeat the video and music reproduction operations.

  Also, after a change instruction is given in the middle of the playback operation and an affirmative determination is made in the determination of step 111, or after the reproduction of the video scene is finished and an affirmative determination is made in the determination of step 112, the playback is performed. The position specifying unit 6 determines whether or not there is a next video scene corresponding to the music that satisfies the search condition (step 113). If there is no other applicable video scene, a negative determination is made, and the series of processing relating to the search for the video scene is terminated. If there is any other video scene, an affirmative determination is made in the determination of step 113, and then the playback position designating unit 6 designates the playback start position of the next video scene and plays the playback unit 7 Are instructed to play back video and music (step 114). Thereafter, the process returns to step 110 and the video and music playback operations are repeated.

  FIG. 8 is a diagram showing a specific example of video scene search. As shown in FIG. 8, scenes 1, 2,... Are included in a movie image to be played, and among these, scenes 1, 3, 4, 6, 7 have music 1, 2, 3, 4 and 5 correspond to each other. Among these music, music 5 satisfies the search condition A (for example, music flowing in the climax scene where the leading actor plays an active role). Music 2 and 3 satisfy search condition B (for example, they are played on a piano). The music 3 and 5 satisfy the search condition C (for example, the music 3 and 5 have a tone corresponding to “sorrow” in emotions).

  When the search condition A is specified for the video with music having such contents, the music 5 satisfying the search condition A is searched, the scene 7 of the video corresponding to the music 5 is searched, and this scene 7 is the music 5. Played with. Thus, it is possible to reproduce the video of the climax scene simply by specifying the music flowing in the climax scene.

  When the search condition C is designated, the music 3 and 5 satisfying the search condition C are searched, and the scene 4 of the video corresponding to the music 3 is searched first, and this scene 4 is reproduced together with the music 3. When the playback of the scene 4 is completed, or when a “skip” key is pressed during playback and a change instruction is given, the video scene 7 corresponding to the music 5 is searched for, and this scene 7 is stored in the music. 5 is played. This makes it possible to play back the corresponding video simply by designating music that feels “sad”.

  In this way, when music is played back together with the video, the music is searched by specifying a predetermined search condition, and the video corresponding to the searched music is searched, so that the video can be searched using the music as a clue. Therefore, when characteristic music corresponding to a desired video scene is used, it is possible to reduce troublesome labor and time required to search for this scene. For example, in climax scenes such as movies and dramas, music that is more impressive than other scenes is often used to enhance the realistic sensation of the video, so playback can be requested by specifying this characteristic music. The search for the climax scene to be performed becomes easy.

  In particular, as a search condition for searching for music, a time change pattern of sound volume, that is, music data that can specify a waveform pattern is specified, and a music playback position having the same content as this waveform pattern is specified. Can be searched.

  In addition, by specifying a musical instrument as a search condition for searching for music, it is possible to search the playback position of the music in which the musical instrument is used, so a video scene with a strong impression of the musical instrument playing the music When searching, it is possible to reduce the troublesome time and time required to search for this scene. In particular, it is possible to specify the music playback position using the instrument specified as the search condition by specifying the location that contains the tone specific to the instrument specified in the search condition as the music playback position that satisfies the search condition. Become.

  Also, by specifying the tune and genre as the search condition for searching for music, you can search for the playback position of the tune or genre of music, so you can search for video scenes that have a strong impression of tune or genre of music. In this case, it is possible to reduce the troublesome time and time required to search for this scene.

  Also, when there are multiple music playback locations that satisfy the search conditions, it is possible to play back the first video scene and check its contents by playing the video scene with the earliest playback position as the playback start position. become. In addition, by switching the playback start position corresponding to each of the plurality of video scenes in a predetermined order, it is possible to play back the plurality of video scenes in order according to the user's operation and confirm the contents. Become. Alternatively, when there are a plurality of music playback positions that meet the search conditions, a plurality of scenes corresponding to the respective playback positions can be automatically played in order and the contents can be confirmed.

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation implementation is possible within the range of the summary of this invention. In the embodiment described above, when music satisfying the search condition is searched, a video scene corresponding to this music is searched for and played back. However, the playback range of this video scene is not necessarily the same as the playback range of the searched music. It is not necessary to match. For example, when a part of characteristic music is designated, the playback range of the video scene corresponding to this music is often wider than this part of music. Therefore, in the case of having the data structure shown in FIG. 5, when the playback position of music satisfying the search condition is specified, the entire VOB or the entire chapter including this playback position is searched as the playback range of the video scene. Also good.

  In the operation procedure shown in FIG. 7, only the video scene corresponding to the searched music is played back. However, this video scene and the video scene following the video scene may be played back.

  In the above-described embodiment, a specific example in which the present invention is applied to a DVD playback apparatus has been described. However, the present invention can be applied to any apparatus capable of playing video and music. For example, video / music data stored in a DVD or hard disk device may be read out and reproduced by a personal computer.

It is a figure which shows the basic composition of the video reproduction apparatus of one Embodiment. It is a figure which shows the structure at the time of applying the video reproduction apparatus shown in FIG. 1 to a DVD reproduction apparatus. It is a figure which shows the structure of the volume space of DVD. It is a figure which shows the data structure of VMG. It is a figure which shows the data structure of VTS. It is a figure which shows the data structure of VOB. It is a flowchart which shows the operation | movement procedure of the search operation | movement of the video scene in this embodiment. It is a figure which shows the specific example of a video scene search.

Explanation of symbols

1 Video / Music Storage Unit 2 Video Search Processing Unit 3 Search Condition Setting Unit 4 Music Search Unit 5 Video Search Unit 6 Playback Position Designation Unit 7 Playback Unit 8 Operation Unit

Claims (9)

A video playback device for searching for a part of a scene from video corresponding to at least a part of music,
Video / music storage means for storing video data and music data necessary for reproduction of the video and music;
Search condition setting means for setting a search condition capable of specifying the music playback position;
Music search means for specifying the playback position of the music that satisfies the search conditions set by the search condition setting means;
Video search means for specifying a partial scene of the video corresponding to the music playback position specified by the music search means;
A video playback apparatus comprising: In claim 1,
The search condition set by the search condition setting means is music data capable of specifying a time change pattern of sound volume,
The music search means includes a time duration of sound volume as the search condition from a time change pattern of music sound volume obtained when the music data stored in the video / music storage means is reproduced. A video playback apparatus that identifies a location that matches or is similar to a change pattern as a playback position of the music that satisfies the search condition. In claim 1,
The search condition set by the search condition setting means is a musical instrument used,
The music search means is configured to select a place played using the musical instrument specified in the search condition from among the music obtained when the music data stored in the video / music storage means is reproduced. A video playback apparatus characterized by being specified as a playback position of the music satisfying the above. In claim 3,
The music search means includes a search condition for a location including a timbre unique to the musical instrument specified by the search condition from music obtained when the music data stored in the video / music storage means is reproduced. A video playback apparatus characterized by being specified as a playback position of the music satisfying the above. In claim 1,
The search condition set by the search condition setting means is at least one of tune and genre,
The music search means is configured to search for a position where the tune or genre specified by the search condition matches from the music obtained when the music data stored in the video / music storage means is reproduced. A video playback apparatus characterized by being specified as a playback position of the music to be satisfied. In any one of Claims 1-5,
Reproduction means for reading the video data and the music data stored in the video / music reproduction means and reproducing the video and music;
Reproduction instruction means for designating a reproduction start position and instructing start of a reproduction operation by the reproduction means;
And when the part of the scene is specified by the video search means, the playback instruction means designates a playback start position corresponding to the part of the scene, and the video and music for the playback means are specified. A video playback apparatus characterized by instructing playback. In claim 6,
When there are a plurality of scenes specified by the video search means, the playback instruction means specifies a playback start position corresponding to a scene with the earliest playback position. In claim 7,
An operation means for receiving an instruction to change the reproduction position;
The reproduction instruction means switches a reproduction start position corresponding to each of a plurality of scenes specified by the video search means in a predetermined order when a change instruction is made using the operation means. Video playback device. In claim 6,
When there are a plurality of scenes specified by the video search unit, the playback instruction unit sequentially specifies playback start positions corresponding to the plurality of scenes,
The video playback apparatus, wherein the playback means plays back video and music corresponding to each of a plurality of scenes according to the order of the playback start positions designated by the playback instruction means.

Images