WO2011121696A1 - Video playback method and video playback device - Google Patents

Video playback method and video playback device Download PDF

Info

Publication number
WO2011121696A1
WO2011121696A1 PCT/JP2010/007614 JP2010007614W WO2011121696A1 WO 2011121696 A1 WO2011121696 A1 WO 2011121696A1 JP 2010007614 W JP2010007614 W JP 2010007614W WO 2011121696 A1 WO2011121696 A1 WO 2011121696A1
Authority
WO
WIPO (PCT)
Prior art keywords
speed
video
playback
switching
frame
Prior art date
Application number
PCT/JP2010/007614
Other languages
French (fr)
Japanese (ja)
Inventor
福川尚史
橘賢一
田島香
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Publication of WO2011121696A1 publication Critical patent/WO2011121696A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/782Television signal recording using magnetic recording on tape
    • H04N5/783Adaptations for reproducing at a rate different from the recording rate
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/005Reproducing at a different information rate from the information rate of recording
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42202Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof
    • H04N21/42646Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/20Disc-shaped record carriers
    • G11B2220/25Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537Optical discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/84Television signal recording using optical recording
    • H04N5/85Television signal recording using optical recording on discs or drums

Definitions

  • the present invention relates to a technology for playing back video content, and more particularly to special playback functions such as fast forward, fast reverse, and frame advance.
  • video contents in various formats including video contents in DVD-Video format
  • various viewing modes such as viewing with an optical disk video playback device such as a DVD player or a BD player, or viewing with video playback software running on a personal computer.
  • the video playback apparatus or video playback software generally has special playback functions such as fast forward, fast reverse, and frame advance that change the playback speed. For this reason, the special playback function is required to operate on video contents in various formats.
  • Special playback function allows playback speed to be switched by user input via remote control or main unit buttons.
  • the playback speed is switched such that when the fast-forward key 14 is pressed once, the fast-forward key 1 is pressed, and when the fast-forward key 14 is pressed once, the fast-forward key 2 is pressed.
  • the playback speed is switched such that when the fast reverse key 13 is pressed once, the fast reverse is in one stage, and when the fast reverse key 13 is pressed once, the fast reverse is in two stages.
  • the playback speed can be switched using the jog dial instead of the fast forward / rewind keys.
  • the speed stage is switched depending on the angle of rotation, such as a fast-forward 1 stage when rotated 30 degrees to the right and a fast-forward 2 stage when rotated 60 degrees. Rotate counterclockwise to switch between fast reverse steps.
  • the video playback device and video playback software include an OSD (On Screen Display) that is displayed on a video monitor such as an LCD (Liquid Crystal Display), TV, or display. ) Is generally equipped with a function to display the speed stage.
  • the speed stage can be displayed by the arrow-shaped display position of the OSD, such as the OSD display 20 at the first stage of fast-forwarding and the OSD display 21 at the third stage of fast-forwarding in FIG.
  • the intermittent frame interval for each speed stage is, for example, fast forward 1 stage 5 seconds and fast forward 2 stages 10 seconds. It is decided beforehand as follows.
  • the fast-forwarding and winding are accurately performed by making the size of the access unit of the recording medium a common multiple of the size of the minimum access unit for the recording medium and the size of the processing unit in the information material playback means.
  • There is a technique of performing special reproduction such as return see, for example, Patent Document 1).
  • an AVI (Audio Visual Interleaving) file which is one of video contents, has a data structure as shown in FIG. 16, and is composed of three areas: a header area, a frame data area, and an index area.
  • the header area describes attribute information such as video stream and audio stream codec information, frame rate, and bit rate.
  • video frame data and audio frame data are described in units of chunks.
  • the video frame data and the audio frame data are MPEG-compressed, for example, and an I frame that can be decoded independently is called a key frame.
  • entry information 22 for directly accessing each video frame data and audio frame data in the frame data area is described.
  • the entry information 22 includes Chunk ID for determining video data or audio data, Flags for determining whether the frame is a key frame, Offset which is an offset position from the file head or frame data area, and Size which is a data size.
  • the video playback device or video playback software uses the header area description frame rate, bit rate, and index area entry information to determine time information such as PTS (Presentation Time Stamp) and the number of frames. Are converted into position information such as an offset position and stored as index information at the start of reproduction.
  • PTS Presentation Time Stamp
  • index information acquired at the start of playback is used to extract key frames.
  • the intermittent frame interval is determined in advance, for example, fast-forward 1 stage 5 seconds and fast-forward 2 stages 10 seconds.
  • the current fast-forwarding speed is one step, the key frame closest to the frame position 5 seconds after the current image output frame position is calculated from the index information, and the calculated key frame is directly accessed to output the next image. Decode as a frame.
  • the key frame closest to the frame position after 5 seconds is further calculated from the index information, and the calculated key frame is directly accessed and decoded as the next image to be output.
  • the fast-forwarding speed is two steps, the key frame position after 10 seconds is calculated from the index information.
  • the key frame interval of the AVI file is not particularly specified, and the key frame interval may be larger than the predetermined intermittent frame interval depending on the playback location. For example, if the AVI file has a key frame interval of 10 seconds, even if the fast-forwarding speed is 1 stage and the intermittent frame interval is 5 seconds, there is no key frame at the position after 5 seconds. The key frame to be displayed is 10 seconds later. For this reason, even if the user switches the fast-forward speed to two levels with the fast-forward key or jog dial on the remote control, the OSD display switches from the OSD display 20 to the OSD display 23. There was a problem that the speed change was not felt.
  • the present invention solves the above-mentioned problem, and even when the interval between frames that can be independently output in video content is various, it is possible to reliably obtain a speed change before and after switching the playback speed in special playback.
  • An object is to provide a video reproduction technology capable of performing the above.
  • a video playback method for performing special playback by selecting and displaying a frame that can be independently output for video content includes: a reception step of receiving a request for switching playback speed; When a request for switching the playback speed is received in the reception step, the next screen frame at the playback speed after switching is identified, and the speed change due to switching is detected on the video by comparison processing using the position or time of this next screen frame.
  • the next picture frame at the playback speed after the switching is specified, and the speed change due to the switching is performed by the comparison process using the position or time of the next picture frame. It is determined whether or not the image is recognized. When it is determined that it is not recognized, the next image frame is re-specified so that the speed change due to switching is recognized on the video. For this reason, when switching the playback speed in the special playback, the user can surely recognize the speed change on the video.
  • a video playback apparatus that performs special playback by selecting and displaying a frame that can be output independently for video content, inputs the video content data, and outputs audio.
  • a playback unit that outputs a video signal and a control unit that controls the playback unit, the control unit specifying a next image frame at the playback speed after switching in response to a request for switching the playback speed;
  • a comparison unit that determines whether or not a speed change due to switching is recognized on the video, and when the comparison unit determines that it is not recognized, An adjustment unit that re-specifies the next image frame so that a change in speed is recognized on the video;
  • the next picture frame at the playback speed after the switching is specified, and the speed change due to the switching is performed by the comparison process using the position or time of the next picture frame. It is determined whether or not the image is recognized. When it is determined that it is not recognized, the next image frame is re-specified so that the speed change due to switching is recognized on the video. For this reason, when switching the playback speed in the special playback, the user can surely recognize the speed change on the video.
  • the user when the playback speed is switched in special playback, the user can surely recognize the change in speed on the video.
  • FIG. 4 is a flowchart showing processing at the time of switching playback speed in the first embodiment.
  • 6 is a diagram illustrating a specific processing example at the time of playback speed switching in Embodiment 1.
  • FIG. It is a figure which shows an example of the speed step in Embodiment 1, and a skip width.
  • 10 is a flowchart illustrating processing at the time of switching playback speed in the second embodiment.
  • 10 is a flowchart illustrating processing in a steady state after switching the reproduction speed in the second embodiment.
  • FIG. 10 is a diagram illustrating a specific processing example at the time of playback speed switching in the second embodiment.
  • FIG. 10 is a diagram for explaining a specific processing example of speed information storage in the second embodiment.
  • FIG. 10 is a flowchart showing processing at the time of switching playback speed in the third embodiment.
  • 14 is a flowchart illustrating processing in a steady state after switching the reproduction speed in the third embodiment.
  • FIG. 10 is a diagram illustrating a specific processing example at the time of playback speed switching in the third embodiment. It is a figure which shows an example of the remote control of the video reproduction apparatus by which the special reproduction
  • FIG. 1 is a diagram showing a schematic configuration of a video reproduction apparatus according to Embodiment 1 and the following embodiments.
  • 1 includes an LSI 102 including a decoding unit 103 and a control unit 104, a storage device 107, a ROM 108, and an input device 109.
  • Compressed video data, audio data, and the like are recorded on the recording medium 101.
  • the recording medium 101 includes, for example, an optical disk such as a DVD or a flash memory such as a USB memory.
  • the recording medium 101 may be built in the video playback device 100 or may be attached to the video playback device 100 from the outside.
  • the decoding unit 103 as a reproduction unit decodes input data into video data and audio data under the control of the control unit 104, and outputs the data to the video / audio output device 110 as a video signal / audio signal. Note that the decoding unit 103 can output the OSD together with the video signal and display information related to reproduction on a display or the like.
  • the control unit 104 performs playback control of a file acquired from the recording medium 101, playback instruction control according to a request from the input device 109, and overall control of the video playback device 100. Further, the control unit 104 performs a comparison process using a position or time of a next image frame at the playback speed after switching in order to determine whether or not a speed change due to switching of the playback speed is recognized on the video. Unit 105 and adjustment unit 106 that re-specifies the next image frame so that a change in speed due to switching of the playback speed is recognized on the video.
  • the input device 109 includes a plurality of keys, a remote controller, a jog dial, and the like for the user to give a control instruction to the control unit 104.
  • a navigation device or a control microcomputer may be connected to the input device 109.
  • the video / audio output device 110 includes, for example, a display and a speaker.
  • the video / audio output device 110 converts the video signal obtained from the decoding unit 103 so that the video signal can be displayed on the display, and similarly, the audio signal obtained from the decoding unit 103 is converted into a speaker. So that it can be output as audio.
  • the video playback device 100 in FIG. 1 is capable of executing special playback such as fast forward playback, fast reverse playback, and frame advance for video content in addition to normal playback.
  • special playback such as fast forward playback, fast reverse playback, and frame advance for video content in addition to normal playback.
  • the user can switch the playback speed with the input device 109 during special playback.
  • FIG. 2 is a flowchart showing a video reproduction method in the present embodiment.
  • fast-forward playback is performed as an example of special playback in the video playback device 100 of FIG.
  • FIG. 2 shows processing when switching the playback speed of fast-forward playback.
  • the comparison unit 105 executes the comparison step S102
  • the adjustment unit 106 executes the adjustment step S103.
  • FIG. 3 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
  • fast forward playback is performed in a forward direction at a speed higher than the normal speed, but it is assumed that the playback speed has a plurality of stages. In this specific example, it is assumed that five speed stages are provided as shown in FIG.
  • the next frame to be output is specified using the index information described in the AVI file.
  • the index information describes the position information and time information of all the key frames in the file, and the key frame position information and time information include an offset value from the data area and the PTS.
  • the key frame to be output next is searched from the index information and directly accessed.
  • an offset closest to the playback direction in the LSN obtained by adding a predetermined amount of skip width according to the speed stage to the LSN (logical sector number) of the last displayed key frame.
  • a key frame having a value is specified as the next image frame.
  • the skip width is 100 sectors (WS1) in one step, 200 sectors (WS2) in two steps, 400 sectors (WS3) in three steps, 800 sectors (WS4) in four steps, 5
  • the number of sectors is 1600 (WS5).
  • the position of the next image frame is compared before and after the speed switching. Then, from the comparison result, when it is determined that the speed change due to switching is not recognized on the video, the next output frame is re-specified by adjusting the stage of the playback speed so that the speed change due to switching is recognized on the video. .
  • the control unit 104 receives a playback speed switching request and determines whether to perform playback speed switching (receiving step S101).
  • a switching instruction is given to increase the playback speed one step from the fast-forward playback speed one step.
  • the next image frame at the playback speed after switching is specified, and the position of the next image frame before the speed switching is compared with the position of the next image frame after the speed switching (comparison step).
  • the position of the next image frame at the first speed (before speed switching) is compared with the position of the next image frame at the second speed (after speed switching).
  • the next image frame after the speed switching is determined as the actual next image frame.
  • a determination method for example, when the frame position interval is larger than a predetermined value, it is determined that a speed change due to switching is recognized, while when it is equal to or less than a predetermined value, it is determined that a speed change due to switching is not recognized.
  • a method is conceivable.
  • the key frame moves forward from the position of the current key frame (last output key frame) LSN + speed 1 step skip width WS1.
  • Searching for. A key frame K1 having the closest offset value is detected.
  • the key frame is searched in the forward direction from the position of the current key frame LSN + the two speed skip width WS2.
  • a key frame K2 having the closest offset value is detected.
  • the offset values of the key frames K1 and K2 are compared, and when the frames are the same or when the frame interval is within a predetermined range, it is determined that the expected speed change cannot be obtained.
  • the playback speed stage is changed and the next output frame is re-specified so that the speed change due to switching is recognized on the video (adjustment step S103).
  • the fast-forward playback speed is switched from one stage to two stages
  • the speed change is recognized on the video if the next image frame is specified in three stages.
  • the playback speed after switching is automatically switched from 2 levels to 3 levels.
  • the speed stage is adjusted so that a speed change can be obtained on the video. If a search is performed from a position advanced in the forward direction with respect to the key frame K2, a key frame (for example, key frame K3) at a position advanced more than the key frame K2 is detected, and the speed change is detected on the video. There is a high possibility that it can be recognized. A speed step having such a skip width is selected from the speed steps closest to the current speed step. Here, it is assumed that three stages correspond to this.
  • the key frame K4 is specified again as the next image frame.
  • the playback speed after switching is adjusted in three stages.
  • the OSD display also displays the speed stage after adjustment.
  • the OSD display shown in FIG. 15 changes from the one-stage display 20 to the three-stage display 21.
  • the position of the next image frame is compared before and after switching the playback speed stage, and the speed stage is adjusted so that the expected speed change can be obtained on the video.
  • FIG. 5 and 6 are flowcharts showing the video reproduction method in the present embodiment. Also in the present embodiment, as in the first embodiment, fast-play playback is performed as an example of special playback in the video playback device 100 of FIG.
  • FIG. 5 shows processing when switching the playback speed of fast-forward playback
  • FIG. 6 shows processing in a steady state after switching the playback speed.
  • the comparison unit 105 executes comparison step S202
  • the adjustment unit 106 executes adjustment step S203.
  • FIG. 7 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
  • information related to the position interval of the output frame is stored as speed information. Then, when the playback speed is switched, a comparison process using speed information is performed. From the comparison result, when it is determined that the speed change due to switching is not recognized on the video, the frame skip width related to the speed step is changed based on the speed information so that the speed change due to switching is recognized on the video. Respecify the output frame.
  • the actual skip width of a frame that is, the interval between the previous output key frame and the next output key frame is stored as speed information. Or you may memorize
  • the average value it is possible to effectively adjust the next output frame even in a file in which the distribution of frames that can be output independently is biased.
  • the control unit 104 receives a playback speed switching request and determines whether to perform playback speed switching (receiving step S201).
  • a switching instruction is given to increase the fast-forward playback speed from one stage to two stages.
  • the corrected skip width is as shown in FIG. Assume that the stored key frame interval average value ⁇ is 397 sectors.
  • the next image frame after the speed switching is determined as the actual next image frame.
  • a determination method for example, when the position interval is larger than a value obtained by adding a predetermined value to the average value ⁇ , it is determined that a speed change due to switching is recognized, but otherwise, a speed change due to switching is recognized. A method of determining that it is not performed is conceivable. Note that the same comparison process as in comparison step S102 of the first embodiment may be performed.
  • the search is performed from the position of the current key frame K5 LSN + speed two-stage corrected skip width WS32.
  • a key frame K6 having the closest offset value is detected.
  • the interval between the key frames K5 and K6 is 380 sectors, and the stored average value ⁇ of the key frame intervals at one speed is 397 sectors.
  • the skip width is updated so that the speed change due to the switching is recognized on the video, and the next image frame is re-specified (adjustment step S203). For example, when the fast-forward playback speed is switched from one stage to two stages, if it is determined that the speed change is not recognized on the video, the two-stage corrected skip width WS32 is updated.
  • the post-correction skip width WS32 in two stages is updated to the average value ⁇ of the key frame position interval in one stage of speed + a constant value.
  • the constant value is 0 here. Therefore, the two-step corrected skip width WS32 is updated to 397 sectors.
  • the key frame K7 is searched in the forward direction from the position of the skipped width WS32 (397 sectors after correction using ⁇ ) of the LSN + speed in two steps of the key frame K5, and the key frame K7 having the closest offset value is found. Detected. The key frame K7 is re-specified as the next image output frame.
  • the next output frame specification (S211) and the output (S213) are repeatedly executed. Speed information is also stored (S212) for each image. As described above, when the post-correction skip width in the speed stage after switching is updated in the adjustment step S203, the subsequent output frame specification is performed using the updated post-correction skip width.
  • the present embodiment it is expected by adjusting the skip width for determining the output frame so that the expected speed change can be obtained on the video at the time of speed stage switching such as fast-forward playback. A speed change can be reliably obtained on the image.
  • FIG. 10 and 11 are flowcharts showing the video reproduction method in the present embodiment. Also in the present embodiment, as in the first embodiment, fast-forward playback is performed as an example of special playback in the video playback device 100 of FIG.
  • FIG. 10 shows processing when switching the playback speed of fast-forward playback
  • FIG. 11 shows processing in a steady state after switching the playback speed.
  • the comparison unit 105 executes comparison steps S302 and S305
  • the adjustment unit 106 executes adjustment steps S303 and S306.
  • FIG. 12 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
  • the comparison step and the adjustment step described in the first embodiment and the second embodiment are performed not only when the playback speed is switched, but also in a steady state after switching the playback speed. This is repeatedly executed for each image step S307.
  • the positions of the next image frames before and after the switching of the playback speed stage may be compared, or as shown in the second embodiment.
  • the comparison process using the average value of the output frame position intervals may be performed.
  • the speed level may be switched as shown in the first embodiment, and the frame skip width is updated as shown in the second embodiment. Also good. However, in the present embodiment, as shown in FIG. 12, the switching of the speed stage and the adjustment of the skip width are performed only when the next image output frame is specified, and the actual speed adjustment is not performed. And
  • the user reliably recognizes the speed change even in a file having a biased distribution of frames that can be output independently. be able to.
  • the speed can be adjusted according to the distribution of index information near the playback location.
  • the comparison step and the adjustment step are performed only when the reproduction speed is switched, there is an advantage that the special reproduction processing can be speeded up.
  • the video playback method has been described as being executed in the video playback device 100 using the storage medium 101.
  • the present invention is not limited to this.
  • video playback software that runs on a personal computer.
  • the same video reproduction method can be adopted and the same effect can be obtained.
  • a comparison process using the frame position is performed using the position information of each frame included in the index information, and the next image frame is specified using the sector as the frame skip width.
  • the time information of each frame included in the index information is used to perform the comparison process using the time of the frame, and the next image frame is specified using the time as the frame skipping width. It does n’t matter.
  • the user in special playback of video content, the user can surely recognize a change in the speed on the video when the speed is switched.
  • video playback software that operates on an AV device such as a DVD player or a BD player, a personal computer, etc. It is effective for improving the function of
  • Video playback device 103 Decoding unit (playing unit) 104 Control unit 105 Comparison unit 106 Adjustment unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Ecology (AREA)
  • Emergency Management (AREA)
  • Environmental & Geological Engineering (AREA)
  • Environmental Sciences (AREA)
  • Remote Sensing (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)

Abstract

Video speed change can be reliably perceived when playback speed is switched in special playback. When a request to switch the playback speed is received (S101), the next output image frame at the playback speed after switching is specified. It is then determined whether or not the speed change due to switching is perceived in the video, by means of a comparison process using the position or time of the next output image frame (S102). If it is determined that the change is not perceived, the next output image frame is specified again in such a way that the speed change due to switching is perceived in the video (S103). The next output image frame which is determined is output (S104).

Description

映像再生方法及び映像再生装置Video playback method and video playback apparatus
 本発明は、映像コンテンツを再生する技術に関するものであり、特に、早送り、早戻し、コマ送り等の特殊再生機能に関する。 The present invention relates to a technology for playing back video content, and more particularly to special playback functions such as fast forward, fast reverse, and frame advance.
 近年、DVD-Video形式の映像コンテンツをはじめとして、様々なフォーマット形式の映像コンテンツが普及している。その視聴形態も、DVDプレーヤ、BDプレーヤ等の光ディスク映像再生装置による視聴やパーソナルコンピュータ上で動作する映像再生ソフトによる視聴など様々である。また、映像再生装置または映像再生ソフトは一般に、再生速度を変化させる早送り、早戻し、コマ送りといった特殊再生機能を備えている。このため特殊再生機能は、様々なフォーマット形式の映像コンテンツに対して動作するように求められている。 In recent years, video contents in various formats, including video contents in DVD-Video format, have become widespread. There are various viewing modes, such as viewing with an optical disk video playback device such as a DVD player or a BD player, or viewing with video playback software running on a personal computer. In addition, the video playback apparatus or video playback software generally has special playback functions such as fast forward, fast reverse, and frame advance that change the playback speed. For this reason, the special playback function is required to operate on video contents in various formats.
 特殊再生機能では、リモコンや本体ボタン等によるユーザからの入力により再生速度の切り替えができる。例えば図13のようなリモコンの場合、早送りキー14を一回押すと早送り1段階、さらに早送りキー14を一回押すと早送り2段階といったように再生速度が切り替わる。早戻しは早戻しキー13を一回押すと早戻し1段階、さらに早戻しキー13を一回押すと早戻し2段階といったように再生速度が切り替る。 Special playback function allows playback speed to be switched by user input via remote control or main unit buttons. For example, in the case of a remote control as shown in FIG. 13, the playback speed is switched such that when the fast-forward key 14 is pressed once, the fast-forward key 1 is pressed, and when the fast-forward key 14 is pressed once, the fast-forward key 2 is pressed. For fast reverse, the playback speed is switched such that when the fast reverse key 13 is pressed once, the fast reverse is in one stage, and when the fast reverse key 13 is pressed once, the fast reverse is in two stages.
 早送り・早戻しキーの代わりに、ジョグダイヤルにより再生速度の切り替えも可能である。例えば図14のようなジョグダイヤルの場合、右方向に30度回転させると早送り1段階、60度回転させると早送り2段階というように、回転させる角度によって速度段階が切り替る。左方向に回転させると、早戻しの段階が切り替る。 The playback speed can be switched using the jog dial instead of the fast forward / rewind keys. For example, in the case of a jog dial as shown in FIG. 14, the speed stage is switched depending on the angle of rotation, such as a fast-forward 1 stage when rotated 30 degrees to the right and a fast-forward 2 stage when rotated 60 degrees. Rotate counterclockwise to switch between fast reverse steps.
 さらに現在の再生速度段階がユーザに分かるように、映像再生装置や映像再生ソフトには、本体にあるLCD(Liquid Crystal Display)やTV、あるいはディスプレイ等の映像モニタ上に表示するOSD(On Screen Display)により速度段階を表示する機能も一般的に備わっている。例えば図15の早送り1段階時のOSD表示20や早送り3段階時のOSD表示21のように、OSDの矢印形の表示位置によって速度段階を表示することができる。 Furthermore, in order for the user to know the current playback speed stage, the video playback device and video playback software include an OSD (On Screen Display) that is displayed on a video monitor such as an LCD (Liquid Crystal Display), TV, or display. ) Is generally equipped with a function to display the speed stage. For example, the speed stage can be displayed by the arrow-shaped display position of the OSD, such as the OSD display 20 at the first stage of fast-forwarding and the OSD display 21 at the third stage of fast-forwarding in FIG.
 次に映像再生装置や映像再生ソフトにおける特殊再生方法について説明する。 Next, the special playback method in the video playback device and video playback software will be described.
 通常速度での再生の場合、映像コンテンツ内の全ての映像フレームを出画する。特殊再生の場合は、特定映像フレームのみを抽出し、間欠的に出画する。MPEG(Moving Picture Expert Group)圧縮された映像コンテンツでは、フレーム間予測に従いフレームデータが作成され、前方向予測のみを用いて符号化されるフレームはPフレームと呼ばれ、前方向予測、両方向予測、後方向予測のうちいずれかを選択し符号化されるフレームはBフレームと呼ばれ、フレーム間予測を用いずに符号化される単独でデコード可能なフレームはIフレームと呼ばれる。特殊再生の場合は、単独でデコード可能なIフレームを抽出し出画している。また、抽出する映像フレーム間隔が大きい程、特殊再生速度が大きくなり、一般的に映像再生装置や映像再生ソフトでは速度段階毎の間欠フレーム間隔を例えば早送り1段階5秒、早送り2段階10秒というように予め決めている。 When playing at normal speed, all video frames in the video content are output. In the case of special playback, only specific video frames are extracted and output intermittently. In MPEG (Moving Picture Expert Group) compressed video content, frame data is created according to inter-frame prediction, and a frame encoded using only forward prediction is called a P frame. A frame that is encoded by selecting one of the backward predictions is called a B frame, and a frame that can be decoded independently without using inter-frame prediction is called an I frame. In the case of special reproduction, an I frame that can be decoded independently is extracted and output. Also, the larger the video frame interval to be extracted, the higher the special playback speed. Generally, in the video playback apparatus and video playback software, the intermittent frame interval for each speed stage is, for example, fast forward 1 stage 5 seconds and fast forward 2 stages 10 seconds. It is decided beforehand as follows.
 情報素材を再生する再生装置において、記録媒体のアクセス単位のサイズを、記録媒体に対する最小アクセス単位のサイズと、情報素材再生手段における処理単位のサイズとの公倍数とすることで、正確に早送りや巻き戻し等の特殊再生を行うという技術がある(例えば、特許文献1参照)。 In a playback device that plays back information material, the fast-forwarding and winding are accurately performed by making the size of the access unit of the recording medium a common multiple of the size of the minimum access unit for the recording medium and the size of the processing unit in the information material playback means. There is a technique of performing special reproduction such as return (see, for example, Patent Document 1).
特開平10-269706号公報Japanese Patent Laid-Open No. 10-269706
 ところで、映像コンテンツの一つであるAVI(Audio Visual Interleaving)ファイルは図16のようなデータ構造になっており、ヘッダ領域、フレームデータ領域、インデックス領域の3つの領域で構成されている。 Incidentally, an AVI (Audio Visual Interleaving) file, which is one of video contents, has a data structure as shown in FIG. 16, and is composed of three areas: a header area, a frame data area, and an index area.
 ヘッダ領域には映像ストリーム、音声ストリームのコーデック情報、フレームレート、ビットレート等の属性情報が記述されている。 The header area describes attribute information such as video stream and audio stream codec information, frame rate, and bit rate.
 フレームデータ領域には、映像フレームデータおよび音声フレームデータがチャンク単位で記述されている。映像フレームデータおよび音声フレームデータは例えばMPEG圧縮されており、単独でデコード可能なIフレームはキーフレームと呼ばれる。 In the frame data area, video frame data and audio frame data are described in units of chunks. The video frame data and the audio frame data are MPEG-compressed, for example, and an I frame that can be decoded independently is called a key frame.
 インデックス領域にはフレームデータ領域の各映像フレームデータ、音声フレームデータをダイレクトアクセスするためのエントリ情報22が記述されている。エントリ情報22には、映像データか音声データを判断するChunkID、キーフレームか否かが判断できるFlags、ファイル先頭もしくはフレームデータ領域からのオフセット位置であるOffset、データサイズであるSizeがある。特定のフレームを抽出する時を考慮し、映像再生装置や映像再生ソフトでは、ヘッダ領域記述のフレームレート、ビットレートとインデックス領域のエントリ情報から、PTS(Presentation Time Stamp)やフレーム数等の時間情報とオフセット位置等の位置情報に変換し、インデックス情報として再生開始時等に保存している。 In the index area, entry information 22 for directly accessing each video frame data and audio frame data in the frame data area is described. The entry information 22 includes Chunk ID for determining video data or audio data, Flags for determining whether the frame is a key frame, Offset which is an offset position from the file head or frame data area, and Size which is a data size. In consideration of the time when a specific frame is extracted, the video playback device or video playback software uses the header area description frame rate, bit rate, and index area entry information to determine time information such as PTS (Presentation Time Stamp) and the number of frames. Are converted into position information such as an offset position and stored as index information at the start of reproduction.
 実際に特殊再生をする場合、キーフレームを抽出するために、再生開始時等で取得したインデックス情報が使用される。 In the case of actual special playback, index information acquired at the start of playback is used to extract key frames.
 例えば早送り1段階5秒、早送り2段階10秒というように間欠フレーム間隔をあらかじめ決めている場合について説明する。現在の早送り速度が1段階であれば、現在の出画フレーム位置から5秒後のフレーム位置に最も近いキーフレームをインデックス情報から算出し、算出したキーフレームをダイレクトアクセスして次に出画するフレームとしてデコードする。デコードし出画完了すると、さらに5秒後のフレーム位置に最も近いキーフレームをインデックス情報から算出し、算出したキーフレームをダイレクトアクセスして次に出画するフレームとしてデコードする。早送り速度が2段階の場合は、10秒後のキーフレーム位置をインデックス情報から算出することになる。 For example, a description will be given of a case where the intermittent frame interval is determined in advance, for example, fast-forward 1 stage 5 seconds and fast-forward 2 stages 10 seconds. If the current fast-forwarding speed is one step, the key frame closest to the frame position 5 seconds after the current image output frame position is calculated from the index information, and the calculated key frame is directly accessed to output the next image. Decode as a frame. When the image is decoded and output is completed, the key frame closest to the frame position after 5 seconds is further calculated from the index information, and the calculated key frame is directly accessed and decoded as the next image to be output. When the fast-forwarding speed is two steps, the key frame position after 10 seconds is calculated from the index information.
 しかしながら、AVIファイルが持つキーフレームの間隔には特に規定がなく、再生場所によってはキーフレームの間隔があらかじめ決めていた間欠フレーム間隔より大きい場合がある。例えばAVIファイルが持つキーフレーム間隔が10秒のファイルの場合、早送り速度が1段階中で間欠フレーム間隔が5秒であっても、5秒後の位置にはキーフレームが存在しないため、次に出画するキーフレームは10秒後となる。そのためユーザがリモコンの早送りキーやジョグダイヤルによって早送り速度2段階に切り替えたとしても、OSD表示はOSD表示20からOSD表示23に切り替るが、結果的に早送り速度1段階と同様の出画フレーム間隔となり速度変化が感じられないといった課題があった。 However, the key frame interval of the AVI file is not particularly specified, and the key frame interval may be larger than the predetermined intermittent frame interval depending on the playback location. For example, if the AVI file has a key frame interval of 10 seconds, even if the fast-forwarding speed is 1 stage and the intermittent frame interval is 5 seconds, there is no key frame at the position after 5 seconds. The key frame to be displayed is 10 seconds later. For this reason, even if the user switches the fast-forward speed to two levels with the fast-forward key or jog dial on the remote control, the OSD display switches from the OSD display 20 to the OSD display 23. There was a problem that the speed change was not felt.
 なお、AVIファイル内で各キーフレーム間隔は異なっているため、特許文献1の従来技術のように、速度毎の出画フレーム間隔をある特定のキーフレーム間隔の倍数にしても、正確な特殊再生速度を得ることができない。 Since each key frame interval is different in the AVI file, accurate special reproduction can be performed even if the output frame interval for each speed is a multiple of a specific key frame interval as in the prior art of Patent Document 1. I can't get the speed.
 本発明は、前記の課題を解決するものであり、映像コンテンツにおいて単独で出画可能なフレームの間隔が様々な場合であっても、特殊再生における再生速度切り替え前後で確実に速度変化を得ることができる映像再生技術を提供することを目的とする。 The present invention solves the above-mentioned problem, and even when the interval between frames that can be independently output in video content is various, it is possible to reliably obtain a speed change before and after switching the playback speed in special playback. An object is to provide a video reproduction technology capable of performing the above.
 本発明の一態様では、映像コンテンツに対し、単独で出画可能なフレームを選択して出画することによって特殊再生を行う映像再生方法は、再生速度切替の要求を受信する受信ステップと、前記受信ステップにおいて再生速度切替の要求を受信したとき、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する比較ステップと、前記比較ステップにおいて、認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する調整ステップと、前記比較ステップおよび調整ステップの結果、確定した次出画フレームの出画を行う出画ステップとを備えている。 In one aspect of the present invention, a video playback method for performing special playback by selecting and displaying a frame that can be independently output for video content includes: a reception step of receiving a request for switching playback speed; When a request for switching the playback speed is received in the reception step, the next screen frame at the playback speed after switching is identified, and the speed change due to switching is detected on the video by comparison processing using the position or time of this next screen frame. A comparison step for determining whether or not to be recognized, and an adjustment step for respecifying the next output frame so that a speed change due to switching is recognized on the video when it is determined that the recognition is not recognized in the comparison step; And an image output step of outputting the next image frame determined as a result of the comparison step and the adjustment step.
 この態様によると、特殊再生における再生速度切り替えの際に、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する。そして認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する。このため、特殊再生における再生速度切り替えの際に、ユーザは確実に速度変化を映像上認識することができる。 According to this aspect, when switching the playback speed in the special playback, the next picture frame at the playback speed after the switching is specified, and the speed change due to the switching is performed by the comparison process using the position or time of the next picture frame. It is determined whether or not the image is recognized. When it is determined that it is not recognized, the next image frame is re-specified so that the speed change due to switching is recognized on the video. For this reason, when switching the playback speed in the special playback, the user can surely recognize the speed change on the video.
 また、本発明の別の態様では、映像コンテンツに対し、単独で出画可能なフレームを選択して出画することによって特殊再生を行う映像再生装置は、前記映像コンテンツのデータを入力し、音声・映像信号を出力する再生部と、前記再生部を制御する制御部とを備え、前記制御部は、再生速度切替の要求に応じて、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する比較部と、前記比較部によって、認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する調整部とを備えている。 In another aspect of the present invention, a video playback apparatus that performs special playback by selecting and displaying a frame that can be output independently for video content, inputs the video content data, and outputs audio. A playback unit that outputs a video signal and a control unit that controls the playback unit, the control unit specifying a next image frame at the playback speed after switching in response to a request for switching the playback speed; By the comparison process using the position or time of the next image frame, a comparison unit that determines whether or not a speed change due to switching is recognized on the video, and when the comparison unit determines that it is not recognized, An adjustment unit that re-specifies the next image frame so that a change in speed is recognized on the video;
 この態様によると、特殊再生における再生速度切り替えの際に、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する。そして認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する。このため、特殊再生における再生速度切り替えの際に、ユーザは確実に速度変化を映像上認識することができる。 According to this aspect, when switching the playback speed in the special playback, the next picture frame at the playback speed after the switching is specified, and the speed change due to the switching is performed by the comparison process using the position or time of the next picture frame. It is determined whether or not the image is recognized. When it is determined that it is not recognized, the next image frame is re-specified so that the speed change due to switching is recognized on the video. For this reason, when switching the playback speed in the special playback, the user can surely recognize the speed change on the video.
 本発明によると、特殊再生における再生速度切り替えの際に、ユーザが確実に映像上速度変化を認識することができる。 According to the present invention, when the playback speed is switched in special playback, the user can surely recognize the change in speed on the video.
各実施形態に係る映像再生装置の概略構成を示す図である。It is a figure which shows schematic structure of the video reproduction apparatus concerning each embodiment. 実施の形態1における再生速度切替時の処理を示すフローチャートである。4 is a flowchart showing processing at the time of switching playback speed in the first embodiment. 実施の形態1における再生速度切替時の具体的処理例を示す図である。6 is a diagram illustrating a specific processing example at the time of playback speed switching in Embodiment 1. FIG. 実施の形態1における速度段階と飛ばし幅の一例を示す図である。It is a figure which shows an example of the speed step in Embodiment 1, and a skip width. 実施の形態2における再生速度切替時の処理を示すフローチャートである。10 is a flowchart illustrating processing at the time of switching playback speed in the second embodiment. 実施の形態2における再生速度切替後の定常状態における処理を示すフローチャートである。10 is a flowchart illustrating processing in a steady state after switching the reproduction speed in the second embodiment. 実施の形態2における再生速度切替時の具体的処理例を示す図である。FIG. 10 is a diagram illustrating a specific processing example at the time of playback speed switching in the second embodiment. 実施の形態2における速度情報記憶の具体的処理例を説明するための図である。FIG. 10 is a diagram for explaining a specific processing example of speed information storage in the second embodiment. 実施の形態2における速度段階と飛ばし幅の一例を示す図である。It is a figure which shows an example of the speed step in Embodiment 2, and a skip width. 実施の形態3における再生速度切替時の処理を示すフローチャートである。10 is a flowchart showing processing at the time of switching playback speed in the third embodiment. 実施の形態3における再生速度切替後の定常状態における処理を示すフローチャートである。14 is a flowchart illustrating processing in a steady state after switching the reproduction speed in the third embodiment. 実施の形態3における再生速度切替時の具体的処理例を示す図である。FIG. 10 is a diagram illustrating a specific processing example at the time of playback speed switching in the third embodiment. 特殊再生キーが実装された映像再生装置のリモコンの一例を示す図である。It is a figure which shows an example of the remote control of the video reproduction apparatus by which the special reproduction | regeneration key was mounted. 映像再生装置のジョグダイヤルの特殊再生での使用例を示す図である。It is a figure which shows the usage example in the special reproduction | regeneration of the jog dial of a video reproduction apparatus. 映像再生装置の特殊再生中のOSD表示例を示す図である。It is a figure which shows the example of OSD display during special reproduction of a video reproduction apparatus. AVIファイルのイメージ図である。It is an image figure of an AVI file.
 以下、本発明を実施するための形態について、図面を参照しながら説明する。 Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
 (実施の形態1)
 図1は実施の形態1および以下の各実施形態に係る映像再生装置の概略構成を示す図である。図1の映像再生装置100は、デコード部103および制御部104を有するLSI102と、記憶装置107と、ROM108と、入力装置109とを備えている。記録媒体101には、圧縮された映像データおよび音声データ等が記録されており、例えばDVDなどの光ディスクやUSBメモリ等のフラッシュメモリなどによって構成される。なお、記録媒体101は、映像再生装置100に内蔵されていてもよいし、映像再生装置100に外部から装着されていてもよい。
(Embodiment 1)
FIG. 1 is a diagram showing a schematic configuration of a video reproduction apparatus according to Embodiment 1 and the following embodiments. 1 includes an LSI 102 including a decoding unit 103 and a control unit 104, a storage device 107, a ROM 108, and an input device 109. Compressed video data, audio data, and the like are recorded on the recording medium 101. The recording medium 101 includes, for example, an optical disk such as a DVD or a flash memory such as a USB memory. The recording medium 101 may be built in the video playback device 100 or may be attached to the video playback device 100 from the outside.
 再生部としてのデコード部103は、制御部104の制御に従って、入力されたデータを映像データや音声データにデコードし、映像音声出力装置110に映像信号・音声信号として出力する。なお、デコード部103はOSDを映像信号と共に出力し、再生に関わる情報等をディスプレイ等で表示できる。 The decoding unit 103 as a reproduction unit decodes input data into video data and audio data under the control of the control unit 104, and outputs the data to the video / audio output device 110 as a video signal / audio signal. Note that the decoding unit 103 can output the OSD together with the video signal and display information related to reproduction on a display or the like.
 制御部104は、記録媒体101から取得したファイルの再生制御、入力装置109からの要求による再生指示制御、及び映像再生装置100全体の制御を行う。さらに、制御部104は、再生速度切替による速度変化が映像上認識されるか否かを判定するために、切替後の再生速度における次出画フレームの位置または時間を用いた比較処理を行う比較部105と、再生速度切替による速度変化が映像上認識されるように、次出画フレームを再特定する調整部106とを含む。 The control unit 104 performs playback control of a file acquired from the recording medium 101, playback instruction control according to a request from the input device 109, and overall control of the video playback device 100. Further, the control unit 104 performs a comparison process using a position or time of a next image frame at the playback speed after switching in order to determine whether or not a speed change due to switching of the playback speed is recognized on the video. Unit 105 and adjustment unit 106 that re-specifies the next image frame so that a change in speed due to switching of the playback speed is recognized on the video.
 入力装置109は、ユーザが制御部104に制御指示を出すための複数のキーやリモコン、ジョグダイヤル等を備えている。キーやリモコン以外にも、例えばナビゲーション装置や制御マイコンが入力装置109に接続される場合がある。 The input device 109 includes a plurality of keys, a remote controller, a jog dial, and the like for the user to give a control instruction to the control unit 104. In addition to the keys and the remote control, for example, a navigation device or a control microcomputer may be connected to the input device 109.
 映像音声出力装置110は、例えばディスプレイ及びスピーカ等によって構成されており、デコード部103から得た映像信号をディスプレイ等で表示できるように変換し、同様に、デコード部103から得た音声信号をスピーカ等で音声として出力できるように変換する。 The video / audio output device 110 includes, for example, a display and a speaker. The video / audio output device 110 converts the video signal obtained from the decoding unit 103 so that the video signal can be displayed on the display, and similarly, the audio signal obtained from the decoding unit 103 is converted into a speaker. So that it can be output as audio.
 図1の映像再生装置100は映像コンテンツに対して、通常再生の他に、早送り再生、早戻し再生およびコマ送り等の特殊再生を実行可能であるものとする。また、特殊再生中に、ユーザは入力装置109によって再生速度を切替えることができるものとする。 The video playback device 100 in FIG. 1 is capable of executing special playback such as fast forward playback, fast reverse playback, and frame advance for video content in addition to normal playback. In addition, it is assumed that the user can switch the playback speed with the input device 109 during special playback.
 図2は本実施形態における映像再生方法を示すフローチャートである。ここでは、図1の映像再生装置100において、特殊再生の一例として早送り再生を行うものとする。図2は早送り再生の再生速度を切り替えるときの処理を示している。比較部105が比較ステップS102を実行し、調整部106が調整ステップS103を実行する。また図3は、一例としてのAVIファイル再生における、本実施形態に係る具体的処理を示す図である。 FIG. 2 is a flowchart showing a video reproduction method in the present embodiment. Here, it is assumed that fast-forward playback is performed as an example of special playback in the video playback device 100 of FIG. FIG. 2 shows processing when switching the playback speed of fast-forward playback. The comparison unit 105 executes the comparison step S102, and the adjustment unit 106 executes the adjustment step S103. FIG. 3 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
 ここで、早送り再生は、通常速度よりも速い速度で順方向に再生するが、再生速度に関して複数の段階を有することを前提とする。ここでの具体例では、図4のように5段階の速度段階を備えるものとする。 Here, fast forward playback is performed in a forward direction at a speed higher than the normal speed, but it is assumed that the playback speed has a plurality of stages. In this specific example, it is assumed that five speed stages are provided as shown in FIG.
 早送り再生中は、次に出画するフレームの特定処理および出画処理を繰り返し実行し、間欠的にフレームを出画する。そして、出画フレームの特定方法を各速度段階に応じて変更することによって、複数段階の早送り速度を実現する。 During fast-forward playback, the process of specifying the next frame to be output and the image output process are repeatedly executed, and the frame is output intermittently. Then, by changing the output frame specifying method according to each speed stage, a multi-stage fast-forward speed is realized.
 AVIファイル再生の例では、早送り再生において、次に出画するフレームをAVIファイル内に記述されたインデックス情報を用いて特定する。インデックス情報にはファイル内の全キーフレームの位置情報および時間情報が記述されており、キーフレームの位置情報、時間情報にはデータ領域からのオフセット値およびPTSが含まれる。早送り再生では、次に出画するキーフレームをインデックス情報より検索しダイレクトアクセスする。インデックス情報から検索する方法では、最後に出画したキーフレームのLSN(論理セクタ番号)に、速度段階に応じた所定量の飛ばし幅を加えて得たLSNに、再生方向に向かって最も近いオフセット値をもつキーフレームを、次出画フレームとして特定する。具体例では、飛ばし幅は図4のように、1段階で100セクタ(WS1)、2段階で200セクタ(WS2)、3段階で400セクタ(WS3)、4段階で800セクタ(WS4)、5段階で1600セクタ(WS5)とする。 In the example of AVI file playback, in the fast forward playback, the next frame to be output is specified using the index information described in the AVI file. The index information describes the position information and time information of all the key frames in the file, and the key frame position information and time information include an offset value from the data area and the PTS. In fast-forward playback, the key frame to be output next is searched from the index information and directly accessed. In the method of searching from the index information, an offset closest to the playback direction in the LSN obtained by adding a predetermined amount of skip width according to the speed stage to the LSN (logical sector number) of the last displayed key frame. A key frame having a value is specified as the next image frame. In the specific example, as shown in FIG. 4, the skip width is 100 sectors (WS1) in one step, 200 sectors (WS2) in two steps, 400 sectors (WS3) in three steps, 800 sectors (WS4) in four steps, 5 The number of sectors is 1600 (WS5).
 本実施形態に係る映像再生方法では、再生速度を切り替えるときに、次出画フレームの位置を、速度切り替え前後で比較する。そして、比較結果から、切替による速度変化が映像上認識されないと判定したとき、切替による速度変化が映像上認識されるように、再生速度の段階を調整して、次出画フレームを再特定する。 In the video playback method according to the present embodiment, when the playback speed is switched, the position of the next image frame is compared before and after the speed switching. Then, from the comparison result, when it is determined that the speed change due to switching is not recognized on the video, the next output frame is re-specified by adjusting the stage of the playback speed so that the speed change due to switching is recognized on the video. .
 図2において、早送り再生中、ユーザが入力装置109により再生速度切り替え指示を行うと、制御部104は再生速度切り替え要求を受信し、再生速度切り替えを行うか判断する(受信ステップS101)。ここでは、早送り再生速度1段階から、再生速度が速くなる方向に1段階上げる切り替え指示を行うとする。 Referring to FIG. 2, during fast-forward playback, when the user issues a playback speed switching instruction using the input device 109, the control unit 104 receives a playback speed switching request and determines whether to perform playback speed switching (receiving step S101). Here, it is assumed that a switching instruction is given to increase the playback speed one step from the fast-forward playback speed one step.
 再生速度切り替えを行う場合、切替後の再生速度における次出画フレームの特定を行い、速度切り替え前の次出画フレームの位置と速度切り替え後の次出画フレームの位置とを比較する(比較ステップS102)。ここでは、速度1段階(速度切り替え前)における次出画フレームの位置と、速度2段階(速度切り替え後)における次出画フレームの位置とを比較する。比較処理の結果、切替による速度変化が映像上認識されると判定したときは、速度切り替え後の次出画フレームを実際の次出画フレームとして確定する。判定方法としては例えば、フレーム位置の間隔が、所定値よりも大きいときは、切替による速度変化が認識されると判定する一方、所定値以下のときは、切替による速度変化が認識されないと判定する方法が考えられる。 When switching the playback speed, the next image frame at the playback speed after switching is specified, and the position of the next image frame before the speed switching is compared with the position of the next image frame after the speed switching (comparison step). S102). Here, the position of the next image frame at the first speed (before speed switching) is compared with the position of the next image frame at the second speed (after speed switching). As a result of the comparison processing, when it is determined that the speed change due to the switching is recognized on the video, the next image frame after the speed switching is determined as the actual next image frame. As a determination method, for example, when the frame position interval is larger than a predetermined value, it is determined that a speed change due to switching is recognized, while when it is equal to or less than a predetermined value, it is determined that a speed change due to switching is not recognized. A method is conceivable.
 図3の例では、速度1段階における次出画フレーム特定において、現在のキーフレーム(最後に出画したキーフレーム)のLSN+速度1段階の飛ばし幅WS1の位置から、順方向に向かってキーフレームの検索を行っている。最も近いオフセット値を持つキーフレームK1が検出されている。また、速度切り替え後の速度2段階における次出画フレーム特定において、現在のキーフレームのLSN+速度2段階の飛ばし幅WS2の位置から、順方向に向かってキーフレームの検索を行う。最も近いオフセット値を持つキーフレームK2が検出されている。キーフレームK1,K2のオフセット値を比較し、同一フレームであるとき、またはフレーム間隔が所定範囲内のとき、期待した速度変化が得られないと判定する。 In the example of FIG. 3, in specifying the next image frame at the speed 1 step, the key frame moves forward from the position of the current key frame (last output key frame) LSN + speed 1 step skip width WS1. Searching for. A key frame K1 having the closest offset value is detected. Further, in specifying the next image frame at the two speed levels after the speed switching, the key frame is searched in the forward direction from the position of the current key frame LSN + the two speed skip width WS2. A key frame K2 having the closest offset value is detected. The offset values of the key frames K1 and K2 are compared, and when the frames are the same or when the frame interval is within a predetermined range, it is determined that the expected speed change cannot be obtained.
 切替による速度変化が映像上認識されないと判定したときは、切替による速度変化が映像上認識されるように、再生速度の段階を変更して、次出画フレームの再特定を行う(調整ステップS103)。例えば、早送り再生速度を1段階から2段階に切り替える場合において、速度変化が映像上認識されないと判定したとき、3段階で次出画フレームを特定すると速度変化が映像上認識されるのであれば、切替後の再生速度を2段階から3段階に自動的に切り替える。 When it is determined that the speed change due to switching is not recognized on the video, the playback speed stage is changed and the next output frame is re-specified so that the speed change due to switching is recognized on the video (adjustment step S103). ). For example, in the case where the fast-forward playback speed is switched from one stage to two stages, if it is determined that the speed change is not recognized on the video, the speed change is recognized on the video if the next image frame is specified in three stages. The playback speed after switching is automatically switched from 2 levels to 3 levels.
 図3の例では、キーフレームK1,K2が同一フレームであるため、期待した速度変化が映像上得られないと判定される。このため、速度変化が映像上得られるように、速度段階の調整を行う。キーフレームK2よりも順方向側に進んだ位置から検索を行えば、キーフレームK2よりも大きく進んだ位置にあるキーフレーム(例えばキーフレームK3)が検出されることになり、速度変化が映像上認識できる可能性が高い。このような飛ばし幅を持つ速度段階のうち現速度段階に最も近いものを選ぶ。ここでは3段階がこれに該当したとする。現在のキーフレームのLSN+3段階の飛ばし幅WS3の位置から順方向に向かってキーフレームの検索を行い、最も近いオフセット値を持つキーフレームK4が検出される(図3の例ではK4=K3)。キーフレームK4が、次出画フレームとして再特定される。また、切替後の再生速度が3段階に調整される。 In the example of FIG. 3, since the key frames K1 and K2 are the same frame, it is determined that the expected speed change cannot be obtained on the video. Therefore, the speed stage is adjusted so that a speed change can be obtained on the video. If a search is performed from a position advanced in the forward direction with respect to the key frame K2, a key frame (for example, key frame K3) at a position advanced more than the key frame K2 is detected, and the speed change is detected on the video. There is a high possibility that it can be recognized. A speed step having such a skip width is selected from the speed steps closest to the current speed step. Here, it is assumed that three stages correspond to this. A key frame search is performed in the forward direction from the position of the skip width WS3 in the LSN + 3 stage of the current key frame, and the key frame K4 having the closest offset value is detected (K4 = K3 in the example of FIG. 3). The key frame K4 is specified again as the next image frame. In addition, the playback speed after switching is adjusted in three stages.
 そして、確定した次出画フレームの出画を行う(出画ステップS104)。OSD表示も、調整後の速度段階を表示する。この例では、図15に示すOSD表示は、1段階表示20から3段階表示21に変化する。 Then, the determined next output frame is output (output step S104). The OSD display also displays the speed stage after adjustment. In this example, the OSD display shown in FIG. 15 changes from the one-stage display 20 to the three-stage display 21.
 再生速度の切替後は、次出画フレームの特定および出画を繰り返し実行する。なお、上述のように調整ステップS103において切替後の速度段階を調整した場合は、以降の出画フレームの特定は、調整後の速度段階において行われる。 ∙ After switching the playback speed, specify the next screen frame and repeat the screen. When the speed stage after switching is adjusted in the adjustment step S103 as described above, the subsequent output frame is specified at the speed stage after adjustment.
 以上のように本実施形態によると、早送り再生等の速度段階切り替え時に、再生速度段階切り替え前後の次出画フレームの位置を比較し、期待する速度変化が映像上得られるように速度段階の調整を行うことにより、期待する速度変化を映像上確実に得ることができる。 As described above, according to the present embodiment, when the speed stage is switched such as fast-forward playback, the position of the next image frame is compared before and after switching the playback speed stage, and the speed stage is adjusted so that the expected speed change can be obtained on the video. By performing the above, it is possible to reliably obtain the expected speed change on the video.
 (実施の形態2)
 図5および図6は本実施形態における映像再生方法を示すフローチャートである。本実施形態においても実施の形態1と同様に、図1の映像再生装置100において、特殊再生の一例として早送り再生を行うものとする。図5は早送り再生の再生速度を切り替えるときの処理を示し、図6は再生速度切替後の定常状態における処理を示している。比較部105が比較ステップS202を実行し、調整部106が調整ステップS203を実行する。また図7は、一例としてのAVIファイル再生における、本実施形態に係る具体的処理を示す図である。
(Embodiment 2)
5 and 6 are flowcharts showing the video reproduction method in the present embodiment. Also in the present embodiment, as in the first embodiment, fast-play playback is performed as an example of special playback in the video playback device 100 of FIG. FIG. 5 shows processing when switching the playback speed of fast-forward playback, and FIG. 6 shows processing in a steady state after switching the playback speed. The comparison unit 105 executes comparison step S202, and the adjustment unit 106 executes adjustment step S203. FIG. 7 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
 本実施形態に係る映像再生方法では、出画フレームの位置間隔に関する情報を、速度情報として記憶する。そして再生速度を切り替えるときに、速度情報を用いた比較処理を行う。比較結果から、切替による速度変化が映像上認識されないと判定したとき、切替による速度変化が映像上認識されるように、速度段階に係るフレームの飛ばし幅を速度情報に基づいて変更して、次出画フレームを再特定する。 In the video reproduction method according to the present embodiment, information related to the position interval of the output frame is stored as speed information. Then, when the playback speed is switched, a comparison process using speed information is performed. From the comparison result, when it is determined that the speed change due to switching is not recognized on the video, the frame skip width related to the speed step is changed based on the speed information so that the speed change due to switching is recognized on the video. Respecify the output frame.
 ここでは図8に示すように、早送り再生において、フレームの実際の飛ばし幅、すなわち前回の出画キーフレームと次の出画キーフレームとの間隔を、速度情報として記憶するものとする。あるいは、それまでの平均値αを記憶してもよい。平均値を用いることによって、単独で出画可能なフレームの分布に偏りがあるファイルにおいても、効果的に次出画フレームを調整することができる。 Here, as shown in FIG. 8, in fast-forward playback, the actual skip width of a frame, that is, the interval between the previous output key frame and the next output key frame is stored as speed information. Or you may memorize | store the average value (alpha) until then. By using the average value, it is possible to effectively adjust the next output frame even in a file in which the distribution of frames that can be output independently is biased.
 また図9に示すように、各速度段階の飛ばし幅は、初期値から順次補正されるものとする。 Also, as shown in FIG. 9, it is assumed that the skip width at each speed step is corrected sequentially from the initial value.
 図5において、早送り再生中、ユーザが入力装置109により再生速度切り替え指示を行うと、制御部104は再生速度切り替え要求を受信し、再生速度切り替えを行うか判断する(受信ステップS201)。ここでは、早送り再生速度1段階から2段階に上げる切り替え指示を行うとする。このとき、補正後飛ばし幅は図9に示すようになっていたとする。また記憶していたキーフレーム間隔の平均値αは397セクタとなっていたとする。 In FIG. 5, when the user gives a playback speed switching instruction using the input device 109 during fast-forward playback, the control unit 104 receives a playback speed switching request and determines whether to perform playback speed switching (receiving step S201). Here, it is assumed that a switching instruction is given to increase the fast-forward playback speed from one stage to two stages. At this time, it is assumed that the corrected skip width is as shown in FIG. Assume that the stored key frame interval average value α is 397 sectors.
 再生速度切り替えを行う場合、切替後の再生速度における次出画フレームの特定を行い、現在の出画フレームと次出画フレームとの位置間隔と、記憶していた出画フレームの位置間隔の平均値αとを比較する(比較ステップS202)。比較処理の結果、切替による速度変化が映像上認識されると判定したときは、速度切り替え後の次出画フレームを実際の次出画フレームとして確定する。判定方法としては例えば、位置間隔が、平均値αに所定値を加えた値よりも大きいときは、切替による速度変化が認識されると判定する一方、そうでないときは、切替による速度変化が認識されないと判定する方法が考えられる。なお、実施の形態1の比較ステップS102と同様の比較処理を行ってもかまわない。 When switching the playback speed, specify the next output frame at the playback speed after switching, and the average of the position interval between the current output frame and the next output frame and the stored position interval of the output frame The value α is compared (comparison step S202). As a result of the comparison processing, when it is determined that the speed change due to the switching is recognized on the video, the next image frame after the speed switching is determined as the actual next image frame. As a determination method, for example, when the position interval is larger than a value obtained by adding a predetermined value to the average value α, it is determined that a speed change due to switching is recognized, but otherwise, a speed change due to switching is recognized. A method of determining that it is not performed is conceivable. Note that the same comparison process as in comparison step S102 of the first embodiment may be performed.
 図7の例では、速度切り替え後の速度2段階における次出画フレーム特定において、現在のキーフレームK5のLSN+速度2段階の補正後飛ばし幅WS32の位置から、検索を行っている。最も近いオフセット値を持つキーフレームK6が検出されている。ここで、キーフレームK5,K6の間隔は380セクタ、記憶していた速度1段階におけるキーフレーム間隔の平均値αは397セクタとなっていたとする。これらを比較し、平均値αの方が大きいため、期待した速度変化が得られないと判定する。 In the example of FIG. 7, in specifying the next image frame at the two speed levels after the speed switching, the search is performed from the position of the current key frame K5 LSN + speed two-stage corrected skip width WS32. A key frame K6 having the closest offset value is detected. Here, it is assumed that the interval between the key frames K5 and K6 is 380 sectors, and the stored average value α of the key frame intervals at one speed is 397 sectors. These are compared and it is determined that the expected speed change cannot be obtained because the average value α is larger.
 切替による速度変化が映像上認識されないと判定したときは、切替による速度変化が映像上認識されるように、飛ばし幅を更新して、次出画フレームの再特定を行う(調整ステップS203)。例えば、早送り再生速度を1段階から2段階に切り替える場合において、速度変化が映像上認識されないと判定したとき、2段階の補正後飛ばし幅WS32を更新する。 When it is determined that the speed change due to the switching is not recognized on the video, the skip width is updated so that the speed change due to the switching is recognized on the video, and the next image frame is re-specified (adjustment step S203). For example, when the fast-forward playback speed is switched from one stage to two stages, if it is determined that the speed change is not recognized on the video, the two-stage corrected skip width WS32 is updated.
 図7の例では、速度1段階におけるキーフレーム位置間隔の平均値αよりも大きな飛ばし幅の位置から検索を行えば、キーフレームK6よりも進んだ位置にあるキーフレームが検出されることになり、速度変化が映像上認識できる可能性が高い。そこで、2段階の補正後飛ばし幅WS32を速度1段階におけるキーフレーム位置間隔の平均値α+一定の値に更新する。一定の値はここでは0とする。よって2段階の補正後飛ばし幅WS32は397セクタに更新される。キーフレームK5のLSN+速度2段階の補正後飛ばし幅WS32(αを用いた補正後の397セクタ)の位置から順方向に向かってキーフレームの検索を行い、最も近いオフセット値を持つキーフレームK7が検出される。キーフレームK7が、次出画フレームとして再特定される。 In the example of FIG. 7, if a search is performed from a position with a skip width larger than the average value α of the key frame position intervals at one speed, a key frame at a position advanced from the key frame K6 is detected. It is highly possible that the speed change can be recognized on the video. Therefore, the post-correction skip width WS32 in two stages is updated to the average value α of the key frame position interval in one stage of speed + a constant value. The constant value is 0 here. Therefore, the two-step corrected skip width WS32 is updated to 397 sectors. The key frame K7 is searched in the forward direction from the position of the skipped width WS32 (397 sectors after correction using α) of the LSN + speed in two steps of the key frame K5, and the key frame K7 having the closest offset value is found. Detected. The key frame K7 is re-specified as the next image output frame.
 そして、確定した次出画フレームの出画を行う(出画ステップS204)。このとき、速度情報の記憶も行う。 Then, the determined next output frame is output (output step S204). At this time, speed information is also stored.
 再生速度の切替後は、図6に示すように、次出画フレームの特定(S211)と、出画(S213)を繰り返し実行する。また、速度情報の記憶(S212)も出画毎に行う。なお、上述のように、調整ステップS203において切替後の速度段階における補正後飛ばし幅を更新した場合は、以降の出画フレームの特定は、更新した補正後飛ばし幅を用いて行われる。 After the playback speed is switched, as shown in FIG. 6, the next output frame specification (S211) and the output (S213) are repeatedly executed. Speed information is also stored (S212) for each image. As described above, when the post-correction skip width in the speed stage after switching is updated in the adjustment step S203, the subsequent output frame specification is performed using the updated post-correction skip width.
 以上のように本実施形態によると、早送り再生等の速度段階切り替え時に、期待する速度変化が映像上得られるように、出画フレームを決定するための飛ばし幅の調整を行うことによって、期待する速度変化を映像上確実に得ることができる。 As described above, according to the present embodiment, it is expected by adjusting the skip width for determining the output frame so that the expected speed change can be obtained on the video at the time of speed stage switching such as fast-forward playback. A speed change can be reliably obtained on the image.
 (実施の形態3)
 図10および図11は本実施形態における映像再生方法を示すフローチャートである。本実施形態においても実施の形態1と同様に、図1の映像再生装置100において、特殊再生の一例として早送り再生を行うものとする。図10は早送り再生の再生速度を切り替えるときの処理を示し、図11は再生速度切替後の定常状態における処理を示している。比較部105が比較ステップS302,S305を実行し、調整部106が調整ステップS303,S306を実行する。また図12は、一例としてのAVIファイル再生における、本実施形態に係る具体的処理を示す図である。
(Embodiment 3)
10 and 11 are flowcharts showing the video reproduction method in the present embodiment. Also in the present embodiment, as in the first embodiment, fast-forward playback is performed as an example of special playback in the video playback device 100 of FIG. FIG. 10 shows processing when switching the playback speed of fast-forward playback, and FIG. 11 shows processing in a steady state after switching the playback speed. The comparison unit 105 executes comparison steps S302 and S305, and the adjustment unit 106 executes adjustment steps S303 and S306. FIG. 12 is a diagram showing specific processing according to the present embodiment in AVI file playback as an example.
 本実施形態に係る映像再生方法では、実施の形態1および実施の形態2において説明した比較ステップおよび調整ステップを、再生速度の切替時のみではなく、再生速度の切替後の定常状態においても、出画ステップS307毎に、繰り返し実行する。 In the video playback method according to the present embodiment, the comparison step and the adjustment step described in the first embodiment and the second embodiment are performed not only when the playback speed is switched, but also in a steady state after switching the playback speed. This is repeatedly executed for each image step S307.
 本実施形態における比較ステップS302,S305は、実施形態1で示したように、再生速度段階切替前後の次出画フレームの位置を比較するようにしてもよいし、実施形態2で示したように、出画フレーム位置間隔の平均値を用いた比較処理を行ってもかまわない。 In the comparison steps S302 and S305 in the present embodiment, as shown in the first embodiment, the positions of the next image frames before and after the switching of the playback speed stage may be compared, or as shown in the second embodiment. The comparison process using the average value of the output frame position intervals may be performed.
 また、本実施形態における調整ステップS303,S306は、実施形態1で示したように、速度段階を切り替えてもよいし、実施形態2で示したように、フレームの飛ばし幅を更新するようにしてもよい。ただし、本実施形態では、図12に示すように、速度段階の切替や飛ばし幅の調整は、そのときの次出画フレームの特定の際にのみ行うものとし、実際の速度調整は行わないものとする。 In the adjustment steps S303 and S306 in the present embodiment, the speed level may be switched as shown in the first embodiment, and the frame skip width is updated as shown in the second embodiment. Also good. However, in the present embodiment, as shown in FIG. 12, the switching of the speed stage and the adjustment of the skip width are performed only when the next image output frame is specified, and the actual speed adjustment is not performed. And
 なお、方法によっては、ファイル中の任意の位置において確実に全速度段階で異なるフレームを次出画フレームとするように調整可能である。例えば、1~5段階の速度段階があるとする。現出画位置から1個先のキーフレームを1段階目の次出画フレームとする。現出画位置から2個先のキーフレームを2段階目の次出画フレームとする。同様にして現出画位置から4、8、16個先のキーフレームを3、4、5段階目の次出画フレームとする。 It should be noted that depending on the method, it is possible to adjust so that a different frame is surely set as the next output frame at any speed position in the file at all speed stages. For example, assume that there are 1 to 5 speed stages. The key frame that is one key ahead from the current image position is set as the next image frame at the first stage. The key frame that is two frames ahead of the current image position is set as the next image frame in the second stage. Similarly, the 4, 8, and 16 key frames ahead of the current image position are set as the next image frames at the third, fourth, and fifth stages.
 以上のように本実施形態によると、比較ステップおよび調整ステップを出画毎に行うことによって、単独で出画可能なフレームの分布に偏りがあるファイルにおいても、ユーザが確実に速度変化を認識することができる。また、インデックス情報の分布に偏りがあるファイルにおいて、再生箇所付近のインデックス情報の分布に応じた速度調整が可能となる。一方、実施の形態1,2のように、比較ステップおよび調整ステップを再生速度の切替時のみに行う場合には、特殊再生処理が高速化できるという利点がある。 As described above, according to the present embodiment, by performing the comparison step and the adjustment step for each output, the user reliably recognizes the speed change even in a file having a biased distribution of frames that can be output independently. be able to. In addition, in a file in which the distribution of index information is biased, the speed can be adjusted according to the distribution of index information near the playback location. On the other hand, as in the first and second embodiments, when the comparison step and the adjustment step are performed only when the reproduction speed is switched, there is an advantage that the special reproduction processing can be speeded up.
 なお上述の各実施形態では、記憶媒体101を用いた映像再生装置100において映像再生方法を実行するものとして説明したが、これに限られるものではなく、例えばパーソナルコンピュータ上で動作する映像再生ソフトにおいても同様の映像再生方法が採用でき、同様の効果が得られる。 In each of the above-described embodiments, the video playback method has been described as being executed in the video playback device 100 using the storage medium 101. However, the present invention is not limited to this. For example, in video playback software that runs on a personal computer. The same video reproduction method can be adopted and the same effect can be obtained.
 また上述の各実施形態では、インデックス情報に含まれた各フレームの位置情報を用いて、フレームの位置を用いた比較処理を行い、フレームの飛ばし幅としてセクタを用いて次出画フレームの特定を行ったが、これに限られるものではない。例えば、インデックス情報に含まれた各フレームの時間情報を用いて、フレームの時間を用いた比較処理を行い、フレームの飛ばし幅として時間を用いて、次出画フレームの特定を行うようにしても、かまわない。この場合、実施の形態2において、出画フレームの時間間隔に関する情報を、速度情報として記憶するのが好ましい。 Further, in each of the above-described embodiments, a comparison process using the frame position is performed using the position information of each frame included in the index information, and the next image frame is specified using the sector as the frame skip width. Yes, but not limited to this. For example, the time information of each frame included in the index information is used to perform the comparison process using the time of the frame, and the next image frame is specified using the time as the frame skipping width. It does n’t matter. In this case, in the second embodiment, it is preferable to store information on the time interval of the output frame as speed information.
 また上述の各実施形態では、早送り再生の速度段階を1段階上げる切替えを行った場合について説明したが、2段階以上切替える場合や、速度段階を下げる切替えを行った場合についても、同様に行うことができる。さらには、早戻し、コマ送り等の他の特殊再生についても、同様の映像再生方法が採用でき、同様の効果が得られる。 Further, in each of the above-described embodiments, the case has been described where switching is performed to increase the speed stage of fast-forward playback by one stage. However, the same operation is performed when switching two or more stages or when switching is performed to decrease the speed stage. Can do. Furthermore, the same video reproduction method can be adopted for other special reproductions such as fast reverse and frame advance, and the same effect can be obtained.
 本発明では、映像コンテンツの特殊再生において、速度切り替え時にユーザが確実に映像上速度変化を認識できるので、例えば、DVDプレーヤ、BDプレーヤ等のAV機器やパーソナルコンピュータ上等で動作する映像再生ソフト等の機能向上に有効である。 In the present invention, in special playback of video content, the user can surely recognize a change in the speed on the video when the speed is switched. For example, video playback software that operates on an AV device such as a DVD player or a BD player, a personal computer, etc. It is effective for improving the function of
100 映像再生装置
103 デコード部(再生部)
104 制御部
105 比較部
106 調整部
100 Video playback device 103 Decoding unit (playing unit)
104 Control unit 105 Comparison unit 106 Adjustment unit

Claims (9)

  1.  映像コンテンツに対し、単独で出画可能なフレームを選択して出画することによって特殊再生を行う映像再生方法であって、
     再生速度切替の要求を受信する受信ステップと、
     前記受信ステップにおいて再生速度切替の要求を受信したとき、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する比較ステップと、
     前記比較ステップにおいて、認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する調整ステップと、
     前記比較ステップおよび調整ステップの結果、確定した次出画フレームの出画を行う出画ステップとを備えた
    ことを特徴とする映像再生方法。
    A video playback method for performing special playback by selecting and displaying a frame that can be output independently for video content,
    A receiving step for receiving a request for switching the playback speed;
    When a request for switching the playback speed is received in the receiving step, the next picture frame at the playback speed after the switching is specified, and the speed change due to the switching is detected by the comparison process using the position or time of the next picture frame. A comparison step for determining whether or not to be recognized;
    An adjustment step for re-specifying the next image frame so that a change in speed due to switching is recognized on the video when it is determined in the comparison step that it is not recognized;
    An image reproduction method comprising: an image output step of outputting an image of a next image frame determined as a result of the comparison step and the adjustment step.
  2.  請求項1記載の映像再生方法において、
     前記比較ステップは、
     切替後の再生速度における次出画フレームの位置または時間を、切替前の再生速度における次出画フレームの位置または時間と比較し、その差が所定値よりも大きいときは、切替による速度変化が認識されると判定する一方、所定値以下のときは、切替による速度変化が認識されないと判定する
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 1, wherein
    The comparison step includes
    The position or time of the next image frame at the playback speed after switching is compared with the position or time of the next image frame at the playback speed before switching, and if the difference is greater than a predetermined value, the speed change due to switching is A video reproduction method characterized by determining that a change in speed due to switching is not recognized when it is determined that it is recognized while being less than or equal to a predetermined value.
  3.  請求項1記載の映像再生方法において、
     前記特殊再生は、再生速度に関して複数の段階を有するものであり、
     前記調整ステップは、
     再生速度の段階を変更して、次出画フレームの再特定を行うものである
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 1, wherein
    The special playback has a plurality of stages with respect to the playback speed,
    The adjustment step includes
    A video playback method characterized by re-specifying the next image frame by changing the stage of playback speed.
  4.  請求項1記載の映像再生方法において、
     前記出画ステップは、出画フレームの位置間隔または時間間隔に関する情報を、速度情報として記憶する
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 1, wherein
    The video output method is characterized in that, in the video output step, information relating to the position interval or time interval of the video output frame is stored as speed information.
  5.  請求項4記載の映像再生方法において、
     前記比較ステップは、
     切替後の再生速度における次出画フレームと現在の出画フレームとの位置間隔または時間間隔を、前記速度情報から得られた、切替前の再生速度における出画フレームの位置間隔または時間間隔の平均値と比較し、この平均値に所定値を加えた値よりも大きいときは、切替による速度変化が認識されると判定する一方、そうでないときは、切替による速度変化が認識されないと判定する
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 4, wherein
    The comparison step includes
    The position interval or time interval between the next output frame and the current output frame at the playback speed after switching is the average of the position intervals or time intervals of the output frames at the playback speed before switching obtained from the speed information. When it is larger than the value obtained by adding a predetermined value to this average value, it is determined that the speed change due to switching is recognized, and otherwise, it is determined that the speed change due to switching is not recognized. A video playback method characterized by the above.
  6.  請求項4記載の映像再生方法において、
     前記特殊再生は、再生速度に関して複数の段階を有するものであり、かつ、各速度段階において、フレームの飛ばし幅が設定されており、
     前記調整ステップは、
     切替後の速度段階に係る飛ばし幅を、前記速度情報に基づいて変更して、次出画フレームの再特定を行う
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 4, wherein
    The special reproduction has a plurality of stages with respect to the reproduction speed, and a frame skip width is set at each speed stage,
    The adjustment step includes
    A video reproducing method, wherein a skip width relating to a speed stage after switching is changed based on the speed information to re-specify a next output frame.
  7.  請求項1記載の映像再生方法において、
     前記比較ステップおよび前記調整ステップは、再生速度の切替後の定常状態において、出画毎に、繰り返し実行される
    ことを特徴とする映像再生方法。
    The video playback method according to claim 1, wherein
    The video reproduction method according to claim 1, wherein the comparison step and the adjustment step are repeatedly executed for each image output in a steady state after switching of the reproduction speed.
  8.  請求項1記載の映像再生方法において、
     前記比較ステップおよび前記調整ステップは、前記映像コンテンツから取得したインデックス情報を用いて、実行され、
     前記インデックス情報は、各フレームの位置情報または時間情報を少なくとも含む
    ことを特徴とする映像再生方法。
    The video reproduction method according to claim 1, wherein
    The comparison step and the adjustment step are executed using index information acquired from the video content,
    The video reproduction method, wherein the index information includes at least position information or time information of each frame.
  9.  映像コンテンツに対し、単独で出画可能なフレームを選択して出画することによって特殊再生を行う映像再生装置であって、
     前記映像コンテンツのデータを入力し、音声・映像信号を出力する再生部と、
     前記再生部を制御する制御部とを備え、
     前記制御部は、
     再生速度切替の要求に応じて、切替後の再生速度における次出画フレームを特定し、この次出画フレームの位置または時間を用いた比較処理によって、切替による速度変化が映像上認識されるか否かを判定する比較部と、
     前記比較部によって、認識されないと判定したとき、切替による速度変化が映像上認識されるように、次出画フレームを再特定する調整部とを備えている
    ことを特徴とする映像再生装置。
    A video playback device that performs special playback by selecting and displaying a frame that can be output independently for video content,
    A playback unit that inputs the video content data and outputs an audio / video signal;
    A control unit for controlling the reproduction unit,
    The controller is
    In response to a request for switching the playback speed, whether the next output frame at the playback speed after switching is identified, and whether the speed change due to the switching is recognized on the video by comparison processing using the position or time of this next output frame A comparison unit for determining whether or not,
    An image reproduction apparatus comprising: an adjustment unit that re-specifies a next output frame so that a change in speed due to switching is recognized on the image when it is determined by the comparison unit that it is not recognized.
PCT/JP2010/007614 2010-03-29 2010-12-28 Video playback method and video playback device WO2011121696A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010075967A JP2011211416A (en) 2010-03-29 2010-03-29 Video playback method and video playback device
JP2010-075967 2010-03-29

Publications (1)

Publication Number Publication Date
WO2011121696A1 true WO2011121696A1 (en) 2011-10-06

Family

ID=44711492

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/007614 WO2011121696A1 (en) 2010-03-29 2010-12-28 Video playback method and video playback device

Country Status (2)

Country Link
JP (1) JP2011211416A (en)
WO (1) WO2011121696A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979149A (en) * 2016-06-24 2016-09-28 深圳市金立通信设备有限公司 Shooting method and terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004208076A (en) * 2002-12-25 2004-07-22 Mitsubishi Electric Corp Signal generator unit for detecting video image, video image detection signal recorder unit, video signal regenerator unit, and methods for the units method of video image detection signal generation, video image detection signal recording and video signal regeneration
JP2007124576A (en) * 2005-10-31 2007-05-17 Sharp Corp Video-reproducing apparatus, video-reproducing method, video-reproducing program, and recording medium with video-reproducing program recorded thereon
JP2008259119A (en) * 2007-04-09 2008-10-23 Hitachi Ltd Video distribution apparatus, video receiver, and key frame distribution method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004208076A (en) * 2002-12-25 2004-07-22 Mitsubishi Electric Corp Signal generator unit for detecting video image, video image detection signal recorder unit, video signal regenerator unit, and methods for the units method of video image detection signal generation, video image detection signal recording and video signal regeneration
JP2007124576A (en) * 2005-10-31 2007-05-17 Sharp Corp Video-reproducing apparatus, video-reproducing method, video-reproducing program, and recording medium with video-reproducing program recorded thereon
JP2008259119A (en) * 2007-04-09 2008-10-23 Hitachi Ltd Video distribution apparatus, video receiver, and key frame distribution method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979149A (en) * 2016-06-24 2016-09-28 深圳市金立通信设备有限公司 Shooting method and terminal

Also Published As

Publication number Publication date
JP2011211416A (en) 2011-10-20

Similar Documents

Publication Publication Date Title
US8437408B2 (en) Decoding with reference image stored in image memory for random playback
KR20190017614A (en) Display device for visualizing contents as the display is rotated and control method thereof
CN110675841A (en) Image device, method thereof, and recording medium
JP4396555B2 (en) Video data playback device
WO2009139302A1 (en) Recording/playback device
JP4297080B2 (en) Playback apparatus and control method
US7433288B2 (en) Recording device and method, recording medium and program
WO2011121696A1 (en) Video playback method and video playback device
JP2006279262A (en) Coded video conversion apparatus, conversion method and program therefor
JP4744345B2 (en) Thumbnail creation method and moving picture data playback device
US20070180405A1 (en) Information reproduction device and method, and computer program
JP2006100982A (en) Image reproducing apparatus and method
JP4442420B2 (en) Image reproducing apparatus and method, and program
JP2008016100A (en) Information reproducing device and method
US20050002645A1 (en) Reproducing device and method, recording medium and program
JP5050588B2 (en) Disk device and reproducing method
JP2012029216A (en) Reproduction device, reproduction method, and program
JP4336737B2 (en) Information reproducing apparatus and method, and computer program
US8149679B2 (en) Recording/reproducing device and method, recording medium, and program
JPH1021035A (en) Video data reproduction control method and computer using the same method
JP5023829B2 (en) Image recording apparatus and program
JP3909298B2 (en) VIDEO REPRODUCTION DEVICE, VIDEO REPRODUCTION METHOD, ITS PROGRAM, AND RECORDING MEDIUM CONTAINING THE PROGRAM
JP4665921B2 (en) Combined recording / reproducing device
JP2012157013A (en) Image recorder and program
JP2009044210A (en) Reproducer, program and method for configuring electronic screen

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10848878

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10848878

Country of ref document: EP

Kind code of ref document: A1