WO2007145281A1 - dispositif de reproduction vidéo, procédé DE REPRODUCTION VIDÉO, et programme de reproduction vidéo - Google Patents

dispositif de reproduction vidéo, procédé DE REPRODUCTION VIDÉO, et programme de reproduction vidéo Download PDF

Info

Publication number
WO2007145281A1
WO2007145281A1 PCT/JP2007/062007 JP2007062007W WO2007145281A1 WO 2007145281 A1 WO2007145281 A1 WO 2007145281A1 JP 2007062007 W JP2007062007 W JP 2007062007W WO 2007145281 A1 WO2007145281 A1 WO 2007145281A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
fast
section
feature quantity
common
Prior art date
Application number
PCT/JP2007/062007
Other languages
English (en)
Japanese (ja)
Inventor
Eiji Kasutani
Original Assignee
Nec Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nec Corporation filed Critical Nec Corporation
Publication of WO2007145281A1 publication Critical patent/WO2007145281A1/fr

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005—Reproducing at a different information rate from the information rate of recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4333—Processing operations in response to a pause request
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4532—Management of client data or end-user data involving end-user characteristics, e.g. viewer profile, preferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4755—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for defining user preferences, e.g. favourite actors or genre
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/78—Television signal recording using magnetic recording
    • H04N5/781—Television signal recording using magnetic recording on disks or drums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/84—Television signal recording using optical recording
    • H04N5/85—Television signal recording using optical recording on discs or drums

Definitions

  • Video playback device video playback method, and video playback program
  • the present invention relates to a video playback device, video playback method, and video playback program that reduce video playback time, and in particular, video playback device and video playback that reduce video playback time using a viewing operation history in another video.
  • the present invention relates to a method and a video reproduction program.
  • Patent Document 1 An example of a method for shortening the video playback time is described in Patent Document 1.
  • Patent Document 1 describes that an importance level is set for each video scene, and digest playback is performed in which only the main part of video data is played based on the specified importance level.
  • Patent Document 1 has a problem that a desired scene of the viewer (user) is not always selected as a digest reproduction target in the summary process.
  • the videos since all the videos are summarized in the same way, there is a problem that the videos cannot be efficiently reproduced according to the viewing mode of the viewer. Therefore, the following video playback methods have been proposed.
  • Patent Document 2 when playing a video and audio, when a scene that you do not want to see starts, you specify the video at the start of the scene that the user does not want to view by operating the remote controller. When the scene you do not want to watch is finished, the user operates the remote controller to specify the video at the end of the scene you do not want to see, and then the video specified by the user matches the video being played back If it matches, the movie being played is It is described to fast-forward the image.
  • Patent Document 3 whether or not a highlight scene is power is determined based on highlight information of a section in which a scene start point and end point are specified. It is described that the other parts are controlled to be shortened by fast-forwarding and played back. It also describes that highlight information is automatically generated by analyzing video features.
  • Patent Document 4 stores history information related to the type of user operation (such as CM skip and fast forward) and the time period during which the user operation was performed in relation to the content, and reproduces the content.
  • the history information it is described that the content to be played is played according to the operation type and time zone indicated by the history information.
  • Patent Document 1 Japanese Patent Application Laid-Open No. 2000-299829 (paragraphs 0065-0069)
  • Patent Document 2 Japanese Patent Laid-Open No. 2004-23465 (paragraphs 0013, 0028-003 0)
  • Patent Document 3 Japanese Patent Laid-Open No. 2005-236527 (paragraphs 0034, 0035, 00 62-0065)
  • Patent Document 4 Japanese Patent Laid-Open No. 2006-24259 (paragraphs 0037, 0041, 004 3)
  • the video section in which the user is less interested may be included in other content that has not been played back by the user.
  • each week's program may include corners that are not of interest to the user, such as opening or ending the specific program.
  • the user ’s
  • Patent Documents 2 to 4 have not been proposed to automatically detect such a video section. The video cannot be viewed efficiently and in a short time without the hassle of.
  • An object of the present invention is to provide a video playback device, video playback method, and video playback program.
  • the video may be both a moving image and an audio signal, or only a moving image or only an audio signal.
  • a video playback apparatus includes a video storage unit that stores a plurality of videos, a fast-forward section detection unit that detects a section of a video that has been fast-forwarded or skipped during playback, and a video storage unit that stores the video
  • the common detection means for detecting a video section common to the video of the section detected by the fast-forward section detection means in the video being played, and the video playback for fast-forwarding or skipping the video section detected by the common detection means
  • a control means for detecting a video section common to the video of the section detected by the fast-forward section detection means in the video being played.
  • An operation history recording unit that records a history of fast-forwarding or skipping operation during playback
  • the fast-forward section detecting unit is configured to perform fast-forwarding or skipping during playback based on the history recorded by the operation history recording unit. It may be configured to detect a section of a video on which an operation has been performed. According to such a configuration, since a section in which fast-forwarding or the like is operated in real time is detected when fast-forwarding or the like is being performed, a section in which fast-forwarding or the like is operated can be detected at an arbitrary timing. Will be able to.
  • the common detection means generates first feature quantity generation means for generating the feature quantity of the video in the section detected by the fast-forward section detection means, and first feature quantity for generating the video feature quantity stored in the video storage means.
  • the feature quantity generated by the second feature quantity generation means is compared with the feature quantity generated by the second feature quantity generation means, and the feature quantity generated by the second feature quantity generation means is compared.
  • It may be configured to include a common video section detecting means for detecting a video section that is common to the video of the section detected by the fast-forward section detecting means. According to such a configuration, it is ensured that the video stored in the video storage means is included in the video. It is possible to detect a video section that is not of interest to the user.
  • the image processing apparatus includes a fast-forward section feature amount storage unit that stores the feature amount generated by the first feature amount generation unit, and the common video section detection unit includes the feature amount stored in the fast-forward section feature amount storage unit. Compares the feature quantity generated by the second feature quantity generation means, and detects the video section common to the section detected by the fast-forward section detection means in the video stored in the video storage means. It may be configured to. According to such a configuration, it is possible to determine whether or not a plurality of videos that are not of interest to the user are stored in the video storage means and included in the video.
  • the video stored in the video storage means may include a video that has been fast-forwarded or skipped during playback. According to such a configuration, not only the unreproduced video but also the reproduced video can be detected as a fast-forward section.
  • a video playback method includes a fast-forward section detecting step in which a control unit in a video playback apparatus detects a section of a video in which a fast-forward or skip operation is performed during playback according to a control program;
  • the common detection step for detecting a video segment common to the video of the segment detected in the fast-forward segment detection step, and the fast-forward of the segment of the video detected in the common detection step Or a video playback control step for skipping.
  • An operation history recording step for recording a history of fast-forwarding or skipping operations during playback is provided, and the fast-forwarding section detecting step performs fast-forwarding or skipping during playback based on the history recorded in the operation history recording step. It may be configured to detect a section of a video on which an operation has been performed. According to such a configuration, since a section in which fast-forwarding or the like is operated in real time is detected when fast-forwarding or the like is performed, it is possible to detect a section in which fast-forwarding or the like is operated at an arbitrary timing. become able to.
  • the first feature value generation step for generating the feature value of the video in the section detected in the fast-forwarding section detection step and the feature value of the video stored in the video storage means!
  • the second feature value generation step to be generated, the feature value generated in the first feature value generation step, and the feature value generated in the second feature value generation step are compared and stored in the video storage means.
  • the video of the section detected in the fast-forward section detection step It may be configured to include a common video section detection step for detecting a common video section. According to such a configuration, it is possible to reliably detect a video segment that is not of interest to the user in the video stored in the video storage unit.
  • the common video section detection step is stored in the fast-forward section feature quantity storage means for storing the feature quantity generated in the first feature quantity generation step !, and the second feature quantity generation step.
  • the feature amount generated in step (b) is compared, and is stored in the video storage means so that a video segment that is the same as the segment detected in the fast-forward segment detection step is detected. May be. According to such a configuration, it is possible to determine whether a plurality of videos that are not of interest to the user are stored in the video storage means and are included in the video. That's it.
  • a video playback program stores a fast-forward section detection process for detecting a section of a video in which a fast-forward or skip operation has been performed at the time of playback to a control unit in the video playback apparatus, and the video storage means In the video, the common detection process for detecting a video segment common to the video of the section detected by the fast-forward section detection process, and the video playback for fast-forwarding or skipping the video section detected by the common detection process Control processing is executed.
  • the present invention it is possible to efficiently shorten the video playback time. Since it is configured to detect the fast-forward target section from the operation history for the video played back in the past, detect the video section that matches the fast-forward target section, detect the playback target video force, and store the start and end points. This is because the section with a bookmark can be fast-forwarded or skipped automatically or when a single operation is performed. Moreover, even if the content has never been viewed by the user, it is possible to automatically fast-forward the desired V and scene without the user's designation.
  • FIG. 1 is a block diagram showing a first embodiment of a video reproduction apparatus according to the present invention.
  • FIG. 2 is a flowchart showing the operation of the video section position generation unit 1 in the first embodiment of the present invention.
  • FIG. 3 is a block diagram for explaining a process for setting a fast-forward target section for unreproduced content.
  • FIG. 4 is a flowchart showing the operation of the video reproduction unit 3 in the first embodiment of the present invention.
  • FIG. 5 is a block diagram showing a second embodiment of the video reproduction apparatus according to the present invention.
  • FIG. 6 is a block diagram showing a modification of the first embodiment of the video reproduction apparatus according to the present invention.
  • FIG. 7 is a block diagram showing a case where the video playback device is configured by a computer.
  • FIG. 1 is a block diagram showing a first embodiment of a video reproduction apparatus according to the present invention.
  • the first embodiment of the present invention includes an input device 4, a video section position generation unit 1 that operates by program control, a storage unit 2 that stores information, and a video playback unit 3 And a display device 5.
  • the input device 4 also has input device power such as a button, a keyboard, a keypad, a pointing device, and a remote controller, and can input instructions regarding video playback when the video to be played back is designated.
  • the display device 5 is an output device such as a liquid crystal display or a CRT, and displays an image.
  • the storage unit 2 includes a video storage unit 21, an operation history storage unit 22, a fast forward target section feature amount storage unit 23, and a fast forward target section position storage unit 24.
  • the video storage means 21 stores various video to be played back.
  • the video storage unit 21 may be in the video playback device or in a place where it can be acquired via a network.
  • the video storage means 21 is provided in the server 42, and the storage unit 2, the video section position generation unit 1, the video playback unit 3, the input device 4, and the display device 5 excluding the video storage unit 21 are provided.
  • a video playback device can be configured by providing the video playback terminal 40 and connecting the server 42 and the video playback terminal 40 via the network 41.
  • one, two, or all of the operation history storage unit 22, the fast-forwarding target section feature amount storage unit 23, and the fast-forwarding target section position storage unit 24 of the storage unit 2 may be provided in the server 42.
  • the operation history storage means 22 records a history of operations performed when viewing each video. That is, the operation history storage means 22 stores operation histories for various videos viewed by the user in the past. Specifically, the history of operations includes: normal playback (start point, end point), fast-forward (start point, end point), skipped point (start point, end point), Locations that have been viewed repeatedly (starting point, ending point) are recorded.
  • fast forward refers to the act of playing video faster than the normal playback speed
  • skip refers to the action of moving forward by partially skipping playback, etc.
  • the fast-forwarding target section feature quantity storage means 23 stores the feature quantity for the fast-forwarding target section corresponding to the part that the user fast-forwarded among various videos that the user has viewed in the past.
  • the feature quantity for the fast-forward target section is the fast-forward target section feature quantity generation means 11. Is stored in the fast-forwarding target section feature amount storage means 23.
  • the fast-forwarding target section position storage means 24 stores the feature amount of the playback target video specified by the user and the feature amount of the fast-forwarding target section stored in the fast-forwarding target section feature amount storage means 23.
  • the bookmark information indicating the common part is stored.
  • the bookmark information is information indicating where the common part of each feature amount is located in the reproduction target video, and is information indicating the start point and end point of the common part.
  • the video section position generation unit 1 includes a fast-forward target section detection unit 10, a fast-forward target section feature amount generation unit 11, a feature amount generation unit 12, and a common section detection unit 13.
  • the fast-forwarding target section detection means 10 calls the operation history of each video stored in the operation history storage means 22, and identifies a point (start point, end point) that is considered to have a low level of user interest during playback. Identified as a fast forward target section. Specifically, the fast-forward target section may be a part where fast-forwarding was performed during playback (start point, end point) or a part where playback was skipped.
  • the fast-forward target section detecting means 10 calls (reads out) the video of the specified fast-forward target section and sends it to the fast-forward target section feature value generating means 11.
  • the fast-forward target section feature value generation means 11 is included in the fast-forward target section after calling the corresponding video (may be video content including the fast-forward target section) from the video storage means 21.
  • the feature amount is extracted from each frame cover.
  • the feature amount may be extracted from the video signal or may be extracted from the acoustic signal.
  • the feature quantity extracted from each video portion that has been viewed is stored in the fast-forward target section feature quantity storage means 23. That is, the fast-forwarding target section feature value generating means 11 extracts the feature values for the video in the fast-forwarding target section and stores them in the fast-forwarding target section feature value storage means 23.
  • Non-Patent Document 1 BSManjunath, J.-R. Ohm, VV Vasudevan, A. Yamada, "COLOR AND TEXTURE DESCRIPTORS” IEEE TRANSACTIONS ON CIRC UITS AND SYSTEMS FOR VIDEO TRCHNOLOGY, JUNE2001, VOLll, No. 6, pp. 703-715 (hereinafter referred to as Non-Patent Document 1), representative colors, color arrangements, textures, patterns, shapes, and the like.
  • Non-Patent Document 2 S. Quackenbush, A ⁇ indsay, "Overview of MP EG-7 audio" IEEE TRAN SACTIONS ON CIRCUITS AND SYSTEMS FOR VIDE O TRCHNOLOGYJUNE2001, VOL11, No.6, pp.725-729 (hereinafter referred to as Non-Patent Document 2)
  • the feature quantity generation means 12 calls the video to be reproduced from the video storage means 21, and extracts the feature quantity from each frame cover of the video.
  • the feature quantity extracted here is a feature quantity of the same type as the feature quantity extracted by the fast-forwarding target section feature quantity generation means 11. That is, the feature quantity generation means 12 extracts the feature quantity for the playback target video designated by the user and outputs it to the common section detection means 13.
  • the common section detection means 13 includes a feature quantity for the video to be reproduced extracted by the feature quantity generation means 12, and a feature quantity for the video of the fast-forward target section stored in the fast-forward target section feature quantity storage means 23. Are compared to detect a portion having a common feature amount. If there is a common part, an identification signal (bookmark) is set at the start point and end point of the common part included in the video to be played. The set start point bookmark and end point bookmark are stored in the fast forward target section position storage means 24 as bookmark information. Examples of the feature amount comparison method include, for example, the distance between representative colors and color arrangement feature amounts as described in Non-Patent Document 1 and Non-Patent Document 2.
  • the feature amount for the video in the fast-forwarding target section may be compared when the same video is fast-forwarded a plurality of times. For example, you can compare the feature quantity of the video that the user has fast-forwarded twice or more with the feature quantity of the video to be played.
  • the video playback unit 3 includes a fast-forward target section reading unit 31, a video operation history recording unit 32, and a video playback control unit 33.
  • the fast-forward target section reading unit 31 acquires the bookmark of the video section corresponding to the video specified by the input device 4 from the fast-forward target section position storage unit 24. That is, the fast-forward target section reading means 31 acquires the bookmark information for the playback target video designated by the user from the fast-forward target section position storage means 24 and outputs it to the video playback control means 33.
  • the video operation history recording means 32 records, in the operation history storage means 22, a history of operations performed by the input device 4 in response to a user operation when viewing each video.
  • the operation history specifically, normal playback location (start point, end point), fast forward There are places that have been visited (start point, end point) and places that have been viewed repeatedly (start point, end point).
  • the video reproduction control means 33 sequentially reproduces the video specified by the input device 4. However, when playing back the position where the start point bookmark is set, fast forward to the section where the end point bookmark is assigned. That is, the video playback control means 33 acquires the video specified by the input device 4 from the video storage means 21, refers to the bookmark information output by the fast-forward target section reading means 31, and fast-forwards the bookmark portion. Play the playback target video on the display device 5.
  • the video of the fast-forwarded portion matches the video of the portion that has been fast-forwarded in the past. For example, if you fast-forward the start of a program while recording and playing back a television program, the same start is automatically fast-forwarded even if you record and play back that television program that was broadcast the next week. . Similarly, if a particular song is fast-forwarded in a song program, the same song is automatically fast-forwarded. In addition, when a certain commercial is fast-forwarded, the same commercial is automatically fast-forwarded even when playing a different television program. Note that fast-forwarding does not have to be performed automatically. For example, a message may be displayed on the display device to prompt the user to confirm whether or not fast-forwarding is possible.
  • a fast-forwarding method when the playback position reaches the start point of the bookmark, a method of automatically fast-forwarding to the end point, or clearly indicating the existence of the section with the bookmark attached, A method of fast-forwarding to the location of the identification signal behind and skipping is also conceivable.
  • the playback start position can be aligned with the shot start point.
  • each means constituting the video playback unit and the video section position generation unit in the video playback device is stored in a storage unit such as a control unit memory such as a CPU, and is processed (controlled) according to the control program. It is realized by executing.
  • the storage unit 2 can be realized by a storage medium such as a hard disk.
  • FIG. 2 is a flowchart showing the operation of the video section position generation unit 1 according to the first embodiment of the present invention.
  • FIG. 3 is a block diagram for explaining the setting process of the fast-forward target section to the unreproduced content.
  • a plurality of videos for example, a first video and a second video
  • the video operation history recording unit 32 records the user operation history during the reproduction of the first video in the operation history storage unit 22. Therefore, the operation history storage means 22 stores operation histories such as fast-forward and skip during playback of the first video.
  • the fast-forward target section detecting means 10 is, for example, when the viewing of the first video is finished or when the operation such as fast-forwarding during the viewing of the first video is finished. Then, the process for detecting the fast forward target section is executed.
  • the fast-forward target section detection process the fast-forward target section detection means 10 calls the first video operation history stored in the operation history storage means 22, and the fast-forward point is considered to have a low level of interest during playback. And the start point and end point of the skip part are specified as the fast-forward target section (Step S1 Do)
  • the fast-forward target section feature value generation means 11 is included in each part included in the part of the first video that has been determined to be of low interest.
  • the frame force is also extracted (step S12).
  • the feature quantity generation means 12 performs feature quantity extraction from each frame included in the second video to be played back (step S13).
  • the common section detection means 13 includes the feature quantity of the second video to be reproduced extracted by the feature quantity generation means 12 and the fast forward target in the first video extracted by the fast forward target section feature quantity generation means 11. The feature quantity of the section is compared, and a portion common to the fast-forward target section and the playback target video in the viewed video is detected (step S14). If there is a common part, the common section detection means 13 stores the start point and end point of the common part included in the playback target video as the start point bookmark and end point bookmark in the fast forward target section position storage means 24 ( Step S 15).
  • a start point bookmark and an end point bookmark are set for each video. Also, since the first video that has already been viewed is also playable, the first video is also viewed again. It is included in the second video to be played. Therefore, it is determined whether or not there is a part in common with the feature value of each frame in the fast-forward section for the first video, and the start point and end point of the common part are set as the start point bookmark and the end point bookmark. Is set.
  • the detection of the fast-forward target section has exemplified the time when viewing of the first video is finished or the time when operations such as fast-forwarding during viewing of the first video are finished. For example, it may be the time after the first video has been viewed and the force after a predetermined period has elapsed.
  • FIG. 4 is a flowchart showing the operation of the video playback unit 3 in the first embodiment of the present invention.
  • the fast-forward target section reading means 31 The bookmark of the video section corresponding to the video specified by 4 is acquired from the fast-forward target section position storage means 24 (step S22).
  • the video reproduction control means 33 sequentially reproduces the video specified by the input device 4 (step S23). In step S24, it is determined whether or not the video reproduction is completed. If the video playback has not ended (No), the process proceeds to step S25, and if the video playback has ended (Yes), the series of processing ends.
  • step S25 the video reproduction control means 33 reproduces the start position where the bookmark is set, and confirms whether or not the power is correct. If the bookmark is at the set position (Yes), the video is fast-forwarded to the end point corresponding to the bookmark start point (step S26).
  • a fast-forward method when the playback position reaches the start point of the bookmark, it is automatically fast-forwarded to the end point, or the presence of the bookmarked section is clearly indicated, and the identification signal in the back is specified by the user's instruction. A method of fast-forwarding to a point can also be considered. Furthermore, when fast-forwarding automatically, alignment can be performed so that the playback start position matches the start point of the shot.
  • Steps S23 to S26 are repeated until the video playback ends or an end command is input from the input device 4 (step S24).
  • the video section position generation unit 1, the storage unit 2, and the video playback unit 3 in the first embodiment are places where each unit can be accessed via a network even if they are all in the video playback device. May be.
  • the video section position generation unit 1 and the video playback unit 3 may be in a video playback terminal, and the video playback terminal may be connected to a server having the storage unit 2 via a network.
  • the video playback unit 3 may be in a video playback terminal, and the video playback terminal may be connected to a server having the video section position generation unit 1 and the storage unit 2 via a network.
  • the fast-forward target section is detected in advance and then the fast-forward target section is fast-forwarded during playback.
  • the fast-forward target section is detected while detecting the fast-forward target section during playback. You may fast forward through the section.
  • the first embodiment it is configured to detect a video segment that matches a video segment that has been determined to be of low interest in the past, and to store the start point and end point thereof.
  • the video playback time can be shortened efficiently by fast-forwarding or skipping the section with the bookmark attached automatically or by a single operation.
  • the scene can be automatically fast-forwarded without being specified by the user.
  • FIG. 5 is a block diagram showing a second embodiment of the video reproduction apparatus according to the present invention.
  • the video operation history recording means 32 in the video playback unit 3 of FIG. 1 is deleted.
  • the configuration of the operation history storage means 22 in the storage unit 2 of FIG. 1 is deleted.
  • the other configuration of the video playback device is the same as the configuration in the first embodiment (see FIG. 1), and thus the description thereof is omitted.
  • the fast-forward target section detection means 10 starts operations such as fast-forward during video playback, which does not detect (specify) the fast-forward target section based on the operation history stored in the operation history storage means 22. Is detected and the start point of the fast forward target section is detected. Then, the fast-forward target section detecting means 10 performs fast-forward target section feature value generating means 1 for the video being played back. Output to 1.
  • the target section feature quantity generation means 11 generates each frame force feature quantity of the video from the fast-forward target section detection means 10 and stores the generated feature quantity in the fast-forward target section feature quantity storage means 23.
  • a video segment that matches a video segment that has been determined to be of low interest in the past is detected from the playback target video, and its start and end points are detected. Since the end point is stored, when playing the playback target video, the video playback time can be reduced by fast-forwarding or skipping the bookmarked section automatically or by a single operation. It can be shortened efficiently. Moreover, even if the content has not been viewed by the user, it is possible to automatically fast forward an undesired scene without the user's designation.
  • the fast-forward section detecting means is realized by the fast-forward target section detecting means 10, and the common detecting means is the fast-forward target section feature amount generating means 11, the feature amount generating means 12, and the common section detection.
  • the operation history recording means is realized by the video operation history recording means 32.
  • the first feature quantity generating means is realized by the fast-forward target section feature quantity generating means 11, the second feature quantity generating means is realized by the feature quantity generating means 12, and the common video section detecting means is the common section detecting means.
  • the fast-forward section feature quantity storage means is realized by the fast-forward target section feature quantity storage means 23.
  • the video stored in the video storage means corresponds to the second video in FIG. 3 (for example, an unplayed video), and the video that has been fast-forwarded or skipped during playback is the first video in FIG. Video (played video) corresponds.
  • the section (period) in which fast-forwarding or the like is performed by the user during video playback is the fast-forward target section.
  • the section in which fast-forwarding or the like is performed by the user Force It is also possible that the video section (scene) is not of interest to the user. For example, a few seconds have passed since the start of a video segment that was not of interest to the user This is the case where a fast-forward operation is performed later, or the case where a fast-forward operation is performed several seconds after the end of the video section that the user is not interested in.
  • the fast-forward target section detection means 10 or the fast-forward target section feature value generation means 11 switches the video at the start point of the fast-forward target section from the video before and after the start point of the fast-forward target section (multiple frames before and after). Determine if it is a point (scene or scene switching point). If it is not the video switching point, the video switching point immediately before the start point of the fast-forward target section is detected, and the detected switching point is set as the start point of the fast-forward target section.
  • the fast-forwarding target section detecting means 10 or the fast-forwarding target section feature value generating means 11 determines whether the end point of the fast-forwarding target section is based on the images before and after the end point of the fast-forwarding target section (a plurality of frames before and after). It is determined whether or not it is a video switching point. If it is not the video switching point, the video switching point immediately before the end point of the fast-forward target section is detected, and the detected switching point is set as the end point of the fast-forward target section. Whether or not the video switching power is high can be determined, for example, based on whether or not the feature amount of the frame has changed more than a predetermined threshold.
  • the section in which the operation is performed is the fast-forwarding target section, but the operation such as fast-forwarding is the same video ( (It may be a video of the same content and may be a video included in different content). It may be set as a fast-forward target section on condition that it has been performed twice or more times.
  • the video feature quantity of the fast-forward target section generated by the fast-forward target section feature quantity generation unit 11 and the video feature quantity of the fast-forward target section feature quantity storage means 23 that are already stored match.
  • the common section detecting means 13 is configured to execute the common section detection process only for the video feature amount of the matching fast-forward target section.
  • a section in which operations such as fast-forwarding two or more times are performed is set as a fast-forwarding target section in which fast-forwarding is performed, and a section in which one operation such as fast-forwarding is performed is semi-automatic. It can also be used as a fast-forward target section (for example, confirming whether or not to fast-forward to the user and instructing the user to perform fast-forward).
  • the force skip operation which was the fast forward operation during the previous playback of the fast forward target section, is performed. If a fast-forward operation is performed, fast-forward playback control is performed, and if a skip operation is performed, a skip operation may be performed. Further, it is also possible to always perform fast-forward or skip reproduction control regardless of whether or not a fast-forward operation has been performed during the previous reproduction and a force-skip operation has been performed.
  • the functions of the means of the video playback unit 3 and the video section position generation unit 1 are realized by the CPU executing processing (control) according to the control program.
  • Each means of the video playback unit 3 and the video segment position generation unit 1 can be configured by a hardware such as an IC. That is, in the video playback unit 3, the fast-forward target section reading means 31 can be configured as a fast-forward target section reader, the video operation history recording means 32 can be configured as a video operation history memory, and the video playback control means 33 can be configured as a video playback controller.
  • the fast-forward target section detecting means 10 is a fast-forward target section detector
  • the fast-forward target section feature quantity generating means 11 is a fast-forward target section feature quantity generator
  • the feature quantity generating means 12 is a feature quantity.
  • the generator and common section detection means 13 can be configured as a common section detector.
  • the storage unit 2 When the storage unit 2 is realized by a storage medium such as a hard disk, the video storage means 21, the operation history storage means 22, the fast-forward target section feature quantity storage means 23, and the fast-forward target section position storage means 24 are the recording areas of the recording medium. Correspond to each. Each means can also be constituted by a memory such as a semiconductor memory. However, the video storage means 21 is preferably a large-capacity memory such as a hard disk for storing video.
  • each means constituting the video playback unit 3 and the video section position generation unit 1 in the video playback device is in accordance with a control program stored in a storage unit such as a memory by a control unit such as a CPU. This can be realized by executing processing (control).
  • the video playback device can be configured by a computer as shown in FIG. 7 to realize its functions.
  • the CPU 53 performs processing based on a program (in this case, the program is stored in the ROM 52) in which the functions of the video playback unit 3 and video section position generation unit 1 described above are described.
  • the functions of each means constituting the playback unit 3 and the video section position generation unit 1 are realized.
  • the storage unit 2 includes a disk device 54 such as a hard disk.
  • the present invention is realized as a program product having a code stored in a storage means such as a memory of a computer and causing the computer to execute the function of the video playback device.
  • a display device 51 such as an LCD (liquid crystal display) displays an image.
  • a bus 55 such as a data bus connects an input device 50, a display device 51, a ROM 52, a CPU 53, and a disk device 54.
  • the input device 50 is an input device such as a button, a keyboard, a keypad, a pointing device, or a remote control.
  • a computer-readable information recording medium such as a semiconductor memory such as an FD (floppy disk), a CDROM, or a flash memory.
  • ROM is used as the storage means.
  • the storage means is constituted by a disk device such as a hard disk, and the program recorded in the FD, CDROM, etc. is read into the disk device of the computer and executed. Therefore, it can function as a video playback device.
  • the present invention can be applied to any device that can reproduce video content.
  • it can be applied to playback and display of video on a hard disk recorder, home server, computer, mobile phone, DVD, digital camera, and so on.
  • the video content stored on the storage media can also be applied to playback of content contained in recording media by accessing the recording media such as a server via a network such as the Internet that allows only playback of the content.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)

Abstract

L'invention permet de réduire de manière efficace le temps de reproduction vidéo et de lire en avance rapide ou de sauter automatiquement une section vidéo non souhaitée par un utilisateur même pour un contenu n'ayant pas été reproduit par l'utilisateur. Selon l'invention un moyen de détection de section commune (13) compare une quantité caractéristique pour une vidéo en tant qu'objet de reproduction extrait par un moyen de génération de quantité caractéristique (12) à une quantité caractéristique pour une vidéo en tant que section d'objet d'avance rapide stockée dans un moyen de stockage de quantité caractéristique de section d'objet rapide (23), de sorte que le point de départ et le point final de la partie commune soient stockés dans le moyen de stockage de position de section d'objet d'avance rapide (24). Un moyen de lecture de section d'objet rapide (31) acquiert le point de départ et le point final de la partie commune de la section vidéo correspondant à la vidéo spécifiée par un dispositif de saisie (4) à partir du moyen de stockage de position de section d'objet d'avance rapide (24). En cas de reproduction successive de la vidéo spécifiée par le dispositif de saisie (4), le moyen de commande de reproduction vidéo (33) lit en avance rapide la section à partir de l'endroit auquel le point de départ de la partie commune est défini jusqu'à l'endroit auquel le point final de la partie commune est défini.
PCT/JP2007/062007 2006-06-14 2007-06-14 dispositif de reproduction vidéo, procédé DE REPRODUCTION VIDÉO, et programme de reproduction vidéo WO2007145281A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2006-164746 2006-06-14
JP2006164746A JP2009239322A (ja) 2006-06-14 2006-06-14 映像再生装置、映像再生方法および映像再生プログラム

Publications (1)

Publication Number Publication Date
WO2007145281A1 true WO2007145281A1 (fr) 2007-12-21

Family

ID=38831795

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/062007 WO2007145281A1 (fr) 2006-06-14 2007-06-14 dispositif de reproduction vidéo, procédé DE REPRODUCTION VIDÉO, et programme de reproduction vidéo

Country Status (2)

Country Link
JP (1) JP2009239322A (fr)
WO (1) WO2007145281A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010258615A (ja) * 2009-04-22 2010-11-11 Fujitsu Ltd 再生装置及びプログラム

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120148216A1 (en) * 2010-12-14 2012-06-14 Qualcomm Incorporated Self-editing video recording
US11539992B2 (en) 2018-02-28 2022-12-27 Google Llc Auto-adjust playback speed and contextual information

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002354406A (ja) * 2001-05-23 2002-12-06 Fujitsu Ltd 動画像再生装置
JP2003339010A (ja) * 2002-05-20 2003-11-28 Sony Corp 信号記録再生装置及び方法、信号再生装置及び方法、並びにプログラム及び記録媒体
JP2005078684A (ja) * 2003-08-29 2005-03-24 Orion Denki Kk 編集再生装置
JP2005102058A (ja) * 2003-09-26 2005-04-14 Nec Corp 番組記録再生装置、番組管理方法、プログラムおよび記録媒体
JP2006134383A (ja) * 2004-11-02 2006-05-25 Canon Inc 再生装置、再生方法及びそのプログラム
JP2006352353A (ja) * 2005-06-14 2006-12-28 Funai Electric Co Ltd 記録再生装置及びその映像音声信号編集方法
JP2007104632A (ja) * 2005-09-12 2007-04-19 Casio Comput Co Ltd 番組録画装置および番組録画処理のプログラム
WO2007063670A1 (fr) * 2005-11-30 2007-06-07 Adc Technology Inc. Dispositif de reproduction

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002354406A (ja) * 2001-05-23 2002-12-06 Fujitsu Ltd 動画像再生装置
JP2003339010A (ja) * 2002-05-20 2003-11-28 Sony Corp 信号記録再生装置及び方法、信号再生装置及び方法、並びにプログラム及び記録媒体
JP2005078684A (ja) * 2003-08-29 2005-03-24 Orion Denki Kk 編集再生装置
JP2005102058A (ja) * 2003-09-26 2005-04-14 Nec Corp 番組記録再生装置、番組管理方法、プログラムおよび記録媒体
JP2006134383A (ja) * 2004-11-02 2006-05-25 Canon Inc 再生装置、再生方法及びそのプログラム
JP2006352353A (ja) * 2005-06-14 2006-12-28 Funai Electric Co Ltd 記録再生装置及びその映像音声信号編集方法
JP2007104632A (ja) * 2005-09-12 2007-04-19 Casio Comput Co Ltd 番組録画装置および番組録画処理のプログラム
WO2007063670A1 (fr) * 2005-11-30 2007-06-07 Adc Technology Inc. Dispositif de reproduction

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010258615A (ja) * 2009-04-22 2010-11-11 Fujitsu Ltd 再生装置及びプログラム
US8406606B2 (en) 2009-04-22 2013-03-26 Fujitsu Limited Playback apparatus and playback method

Also Published As

Publication number Publication date
JP2009239322A (ja) 2009-10-15

Similar Documents

Publication Publication Date Title
JP5232296B2 (ja) ビデオストリーム内の広告コンテンツを基準としてアドレス指定可能な見出しマークを挿入する電子装置及び方法
US7738767B2 (en) Method, apparatus and program for recording and playing back content data, method, apparatus and program for playing back content data, and method, apparatus and program for recording content data
EP1954041A1 (fr) Dispositif de production de condense et programme utilise a cette fin
US20070179786A1 (en) Av content processing device, av content processing method, av content processing program, and integrated circuit used in av content processing device
US20070286584A1 (en) Information processing system, recording/playback apparatus, playback terminal, information processing method, and program
JP2007026493A (ja) 再生装置、再生方法、再生方法のプログラム及び再生方法のプログラムを記録した記録媒体
CN101141584A (zh) 记录/再现装置、显示控制方法以及程序
JP2001285760A (ja) 映像信号再生装置及び映像信号再生方法
JP4883318B2 (ja) 画像再生システム、画像再生方法および画像再生プログラム
JP4953545B2 (ja) オーバービュー再生モードを有する再生装置
JP2008193585A (ja) 放送番組記録再生装置および放送番組記録再生方法
WO2007145281A1 (fr) dispositif de reproduction vidéo, procédé DE REPRODUCTION VIDÉO, et programme de reproduction vidéo
JP4900246B2 (ja) タイムシフト視聴時に即時に提供すべき放送を優先する放送受信装置
JP2008048297A (ja) コンテンツ提供方法、コンテンツ提供方法のプログラム、コンテンツ提供方法のプログラムを記録した記録媒体及びコンテンツ提供装置
EP1942671A1 (fr) Dispositif de creation de condense et programme associe
KR20070013782A (ko) 디지털 영상 파일의 재생 목록 관리 방법
JP4136815B2 (ja) 記録再生装置
JP4921262B2 (ja) プレイリスト生成装置およびプレイリスト再生装置
JP2009094966A (ja) 再生装置、再生方法および再生制御プログラム
JP2006024259A (ja) コンテンツ再生装置、コンテンツ記録装置、方法、プログラム、及び記録媒体
KR100771613B1 (ko) 기록/재생 장치 및 그 방법
JP5682167B2 (ja) 映像音声記録再生装置、および映像音声記録再生方法
KR20070082701A (ko) 방송 수신기의 방송 프로그램 하이라이트 구간 처리 방법
KR101525482B1 (ko) 미리보기 콘텐츠 재생 장치 및 방법
JP2008234798A (ja) キューポイント設定装置及び方法、並びに情報再生装置及び情報記録装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07745264

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07745264

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)