JP2015097426A - Method and device for optimal playback positioning in digital content - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and device for optimal playback positioning in video content.SOLUTION: In a mechanism of tagging scenes or significant points in content in a prioritized way, a mechanism is defined to utilize this tagging associated with the content to facilitate stopping or starting at appropriate points for playback when pressing a scene skip button to jump forward or back to another scene or when pressing 308 a play button after inputting 306 a fast-forward (FF) or rewind (Rew) instruction.

Description

Reference to related provisional application This application claims priority from provisional application 61/314700 filed March 17, 2010, entitled "Content Tagging in DVR for Optimal Playback Positioning" To do.

TECHNICAL FIELD OF THE INVENTION The present disclosure relates generally to digital content systems and digital video recording systems, and more particularly to methods and apparatus for optimal playback positioning in digital video content.

  When using a digital video recorder (DVR), you often want to skip ahead or behind in content, such as a movie or TV show. However, there is currently no mechanism for determining an appropriate start or end point for a scene or an appropriate point for starting content playback. Many DVRs simply start playing when the user presses the play button. Some, however, assume a fixed amount of delay and automatically compensate by a certain amount, depending on how fast the fast-forward (FF) or rewind (Rew) is. The playback start point is determined by skipping to In the best of the current implementations that exist today, content playback does not necessarily start at some kind of scene boundary, it simply brings the user closer to what he wants.

  A method and apparatus for optimal playback positioning in digital video content is provided.

  The present disclosure relates to a mechanism for tagging scenes or significant points in content in a prioritized manner, for example when pressing a scene skip button to jump to another scene forward or backward, or fast forward ( Use this tagging associated with the content to define a mechanism that facilitates stopping or starting at an appropriate point for playback when the play button is pressed after a FF) or Rew command is entered To do.

  According to one aspect of the present disclosure, a method is provided for determining an optimal playback position in video content that includes a plurality of frames. The method, among other things, displays video content at a playback speed for audition, receives a first navigation instruction for navigating the video content at a speed faster than the playback speed for audition, and plays it for preview. A second navigation instruction that resumes playing the video content at a speed, and a playback position of the video content in response to the second navigation instruction based on at least one tagged frame of the video content Including determining.

  According to another aspect of the present disclosure, an apparatus for playing video content including a plurality of frames is provided. The device includes, among other things, a video processor that provides video content to the playback device at a playback speed for previewing, and a first navigation instruction for navigating the video content at a speed faster than the playback speed for previewing. A user interface that receives a second navigation instruction for receiving and resuming playback of the video content at a playback speed for listening; and at least one tagged frame of the video content for receiving the second navigation instruction And a controller coupled to the user interface for determining a playback position of the video content based on the video content and providing the determined playback position to the video processor.

  These and other aspects, features and advantages of the present disclosure will be described and will become apparent from the following detailed description of the preferred embodiments to be read in conjunction with the accompanying drawings.

In the drawings, like reference numerals represent like elements throughout the drawings.
1 is a block diagram of an exemplary system for delivering video content in accordance with the present disclosure. FIG. 2 is a block diagram of an exemplary set top box / digital video recorder (DVR) in accordance with the present disclosure. FIG. 4 is a flowchart of an exemplary method for playing content in an environment when the content is pre-tagged according to the present disclosure. 2 is a flowchart of an exemplary method for playing content in an environment when the content is dynamically tagged in accordance with the present disclosure. 4 is a flowchart of an exemplary method for playing content and navigating content with a scene skip function, in accordance with the present disclosure. 4 is a flowchart of an exemplary method for playing content and navigating content with a scene skip function, according to another embodiment of the present disclosure. FIG. 4 illustrates a video playback timeline and how various zone searches are determined for tagged frames of video content in accordance with the present disclosure. It should be understood that the drawings are for purposes of illustrating the concepts of the disclosure and are not necessarily the only possible configuration for illustrating the disclosure.

  It should be understood that the elements shown in the drawings can be implemented in various forms of hardware, software, or combinations thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general purpose devices that may include a processor, memory and input / output interfaces. In this paper, the expression “coupled” is defined to mean directly connected or indirectly connected through one or more intermediate components. Such intermediate components may include both hardware and software based components.

  This article illustrates the principles of this disclosure. Thus, those skilled in the art will be able to devise various arrangements that embody the principles of the present disclosure and fall within the spirit and scope thereof, even if not explicitly described or shown herein. Will be understood.

  All examples and conditional phrases described in this article are intended for educational purposes to help readers understand the principles of this disclosure and the concepts contributed by the inventors to advance the technology. And are not to be construed as limiting to such individually described examples and conditions.

  Moreover, any statement herein that sets forth principles, aspects, and embodiments of the disclosure and specific examples thereof is intended to encompass both its structural and functional equivalents. Furthermore, such equivalents are intended to include both presently known equivalents and future equivalents, i.e., any developed element that performs the same function regardless of structure. .

  Thus, for example, those skilled in the art will appreciate that the block diagram presented herein represents a conceptual diagram of an exemplary circuit that embodies the principles of the present disclosure. Similarly, if there are flowcharts, flowcharts, state transition diagrams, pseudocode, etc., it is understood that they all represent various processes that are substantially represented in a computer-readable medium and that may be executed by a computer or processor. It will be. This does not depend on whether such a computer or processor is explicitly indicated.

  The functionality of the various elements shown in the drawings may be provided through the use of dedicated hardware or through the use of hardware capable of executing software in the context of appropriate software. When provided by a processor, functionality may be provided by a single dedicated processor, by a single shared processor, or by multiple individual processors that may be partially shared. Furthermore, the explicit use of the terms “processor” or “controller” should not be construed to refer only to hardware capable of executing software, but implicitly, without limitation, digital signal processors ( “DSP”) hardware, read only memory (“ROM”) for storing software, random access memory (“RAM”) and non-volatile storage.

  Other hardware, including conventional and / or custom, may also be included. Similarly, if there is a switch shown in the drawings, it is merely conceptual. The function may be performed through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually. The particular technique can be selected by the implementer so that it can be understood more individually from the context.

  In the claims of this application, any element expressed as a means for performing a specified function may be performed in any way, for example a) a combination of circuit elements performing that function, or b) any form of Thus, it is intended to encompass software, including firmware, microcode, etc., combined with appropriate circuitry to execute the software to perform the function. The present disclosure, as defined by such claims, resides in the fact that the functionality provided by said various described means is combined and brought together in the manner described by the claims. It is thus regarded that any means that can provide those functionalities are equivalent to those shown herein.

  A method and apparatus for optimal playback position in digital video content is provided. The present disclosure relates to a mechanism for tagging scenes or significant points in content in a prioritized manner, for example when pressing a scene skip button to jump to another scene forward or backward, or fast forward ( Use this tagging associated with content to define a mechanism that facilitates stopping or starting at an appropriate point for playback when pressing play after entering a FF) or Rew command .

  Turning now to FIG. 1, a block diagram of one embodiment of a system 100 for delivering video content to a home or end user is shown. The content comes from a content source 102, such as a movie studio or production company. Content can be provided in at least one of two forms. One form may be a form in which content is broadcast. The broadcast content is provided to the broadcast affiliate manager 104. Broadcast affiliate managers are typically national broadcast services such as ABC (American Broadcasting Company), NBC, and CBS. A broadcast affiliate manager may collect and store content and may schedule delivery of content through a delivery network, illustrated as delivery network 1 (106). Delivery network 1 (106) may include satellite link transmissions from national centers to one or more regional or local centers. Delivery network 1 (106) may also include local content delivery using local delivery systems such as over the air broadcast, satellite broadcast or cable broadcast. Locally delivered content is provided to the user's set top box / digital video recorder (DVR) 108 in the user's home.

  The second form of content is called special content. Special content may include content delivered as premium audition, pay-per-view, or other content that would otherwise not be provided to the broadcast affiliate manager. In many cases, the special content may be content requested by the user. Special content may be delivered to the content manager 110. Content manager 110 may be a service provider, such as an Internet website, affiliated with a content provider, a broadcast service or a delivery network service or the like. Content manager 110 may incorporate Internet content into the delivery system. The content manager 110 may deliver the content to the user's set top box / digital video recorder 108 through the delivery network 2 (112), which is a separate delivery network. Delivery network 2 (112) may include a high-speed broadband Internet type communication system. Content from the broadcast affiliate manager 104 may be delivered using all or part of the delivery network 2 (112), and content from the content manager 110 uses all or part of the delivery network 1 (106). It is important to note that it may be delivered at a time. Furthermore, the user may acquire content directly from the Internet via the delivery network 2 (112) without necessarily having the content managed by the content manager 110.

  Set top box / digital video recorder 108 may receive various types of content from one or both of delivery network 1 and delivery network 2. Set top box / digital video recorder 108 processes the content and provides separation of the content based on user preferences and commands. The set top box / digital video recorder may also include a storage device, such as a hard drive or optical disc drive, for recording and playing audio and video content. Further details of the operation of the set top box / digital video recorder 108 and functions related to the playback of stored content are described below in connection with FIG. The processed content is provided to the display device 114. The display device 114 may be a normal 2D type display, or may be an advanced 3D display.

  Turning now to FIG. 2, a block diagram of an embodiment of a set top box / digital video recorder 200 is shown. The illustrated device 200 may be incorporated into other systems, including the display device 114 itself. In any case, some components necessary for full operation of the system are well known to those skilled in the art and are not shown for the sake of brevity.

  In the apparatus 200 shown in FIG. 2, the content is received at the input signal receiver 202. Input signal receiver 202 is for receiving, demodulating and decoding signals provided through one of several possible networks including air, cable, satellite, Ethernet, fiber and telephone line networks. It may be one of several known receiver circuits used. At the input signal receiver 202, a desired input signal is selected and obtained based on user input provided through a control interface (not shown). The decoded output signal is provided to the input stream processor 204. The input stream processor 204 performs final signal selection and processing, including separation of video content from audio content for the content stream. Audio content is provided to audio processor 206 for conversion from a received format, such as a compressed digital signal, to an analog waveform signal. The analog waveform signal is provided to the audio interface 208 and further to the display device 114 or an audio amplifier (not shown). Alternatively, the audio interface 208 can be an HDMI (High-Definition Multimedia Interface) cable or SPDIF (Sony / Philips Digital Interconnect Format). An alternative audio interface may be used to provide the digital signal to the audio output device or display device. Audio processor 206 performs any necessary conversions for storage of the audio signal.

  Video output from the input stream processor 204 is provided to the video processor 210. The video signal may be in one of several formats. Video processor 210 provides conversion of video content as needed based on the input signal format. Video processor 210 performs any necessary conversions for storage of the video signal.

  Storage device 212 stores audio and video content received at the input. The storage device 212 is subject to subsequent acquisition of content under the control of the controller 214 and based on commands received from the user interface 216, such as navigation commands such as fast forward (FF) and rewind (Rew). And allow playback. The storage device 212 may be one or more mass integrated electronic memories such as a hard disk drive, static random access memory or dynamic random access memory, or a compact disk drive. It may be a replaceable optical disk storage system such as a drive or a digital video disk drive.

  Regardless of whether the input originates from storage 212, the converted video signal from video processor 210 is provided to display interface 218. The display interface 218 further provides display signals to display devices of the type described above. The display interface 218 may be an analog signal interface such as red green blue (RGB), or a digital interface such as a high definition multimedia interface (HDMI).

  The controller 214 is interconnected via a bus to some of the components of the device 200, including the input stream processor 202, the audio processor 206, the video processor 210, the storage device 212, and the user interface 216. The controller 214 manages the conversion process for converting the input stream signal into a signal for storage or display on the storage device. The controller 214 also manages the acquisition and playback of stored content. The controller 214 further includes a control memory 220 (eg, random access memory, static RAM, dynamic RAM, read only memory, programmable ROM, flash memory, etc.) for storing information and instruction codes for the controller 214. Volatile or non-volatile memory (including EPROM, EEPROM, etc.). Further, a memory implementation may include several possible embodiments such as a single memory device or two or more memory circuits connected together to form a shared or common memory. . Further, the memory may be included with other circuits, such as portions of the bus communication circuit, within a larger circuit.

  A method for controlling the fast forward (FF) and rewind (Rew) functions in the video recording apparatus will be described below. The physical implementation of the algorithm or function may be performed in hardware, such as a discrete circuit associated with the video processor 210 or in control memory 220, and in software such as software read and executed by the controller 214. Good. The method includes analyzing the content to recognize and tag important points in the content that may represent the start of a scene or other important reference points. Then, under some circumstances, the device 200 can automatically determine the correct position to jump based on several criteria. The analysis may be performed prior to broadcasting, upon ingestion into the device, or during playback. However, the preferred embodiment would be when ingested into the device or when content is written to the disc.

  One practical example of this disclosure is that a user can easily start at the right point when pressing play after fast-forwarding through a commercial (or advertising) break, or simply rewinding to the end of the previous commercial break. Is to make it easier. In this case, the correct starting point or playback position is determined by looking at the speed of FF or Rew. When the play button is pressed, the controller 214 examines the "tagged" locations that were recently passed, determines if any scene tags have been passed recently, and their priority, and in effect starts playing Proximity to previously or dynamically recognized scene transition points representing valid points to be determined. In the case of "Black Reference Frame", this can represent a significant marker (since a black reference frame is usually used at the beginning and end of commercial breaks), and a black reference in FF or REW If the frame has been passed recently, it is used as a starting point. Alternatively, reference frames that are out of regular spacing can also be tagged as less significant trigger points because they can represent the beginning of the scene.

  The speed of the FF / Rew function needs to be considered along with the user reaction time to determine the area to search for content in search of tags. If the FF / Rew speed is fast, the user may have passed several reference points while looking at where he wants to start playback, and playback must start at the appropriate reference point. At slower speeds, the last reference point passed is likely to be a good starting point.

  The methods and apparatus of the present disclosure are based on associating tags with content so that the information on which the decision is made becomes available when the content is played. This tag information can be obtained in one of three main operating modes. First, the content can be pre-analyzed at the broadcast affiliate manager 104 or content manager 110 headend and the metadata can be broadcast together. This can be accomplished by putting the tagged data as part of the SI data in the transport stream and sending the tagged data along with the content so that there is no work on the DVR or device 200. Second, content can be analyzed and tagged as it flows into device 200 or when it is written to disk. Third, the content can be dynamically analyzed during playback and / or during trick mode operation, and reference points can be dynamically generated. For example, when a user fast forwards or rewinds, the device actually performs some frame analysis as the content passes in either direction. Each tagging mode will now be further described.

  In the first mode of tagging frames of video content, tagging is performed at the headend before the content is transmitted over the delivery network. Broadcasters are less likely to support content tagging because of the possibility of lost revenue (especially with respect to the possibility of skipping commercials). However, the concept of actually providing this function in the encoder itself presents other opportunities because other possibilities are implied by being able to detect the scene. If scene tagging exists in the stream itself, there are several possibilities. For example, priority commercials may be tagged to indicate that they cannot be skipped. In an exemplary embodiment, the head end may not be important. The device 200 is likely to have a digital terrestrial tuner and, like any other DVR, the device 200 is fed content that the device is processing on the fly. However, in an alternative embodiment, the headend may be used to receive streamed pre-prepared content. In this case, it may be advantageous to have some advanced scene detection in the film using a similar solution. For example, a broadcaster may desire to have content with a very long GOP (group of pictures) with a large maximum I-frame interval. In this case, tagging at the headend may be valuable and may facilitate playback and search through the content.

  In the second mode of tagging frames of video content, tagging is during ingestion by the video processor 210 into the set-top box 200, i.e. content is received and / or disk, hard drive or other Where it is written to the memory device. The point at which content is being ingested into the device and / or processed and written to disk is likely to be the best point to analyze the content and provide tagging. The level of processing varies depending on the requirements and may be as simple as tagging non-regular I-frames and “black” I-frames, or includes more sophisticated scene detection. Also good. There are considerations about how much additional disk space can be used and how much additional information should be stored. In some embodiments, when scenes are detected, thumbnails of frames that start the scene may also be captured to allow graphic-based browsing of content.

  A third mode for tagging frames involves tagging content in real time. If the content is not pre-tagged, video processor 210 can perform scene analysis. Here, scene analysis can be performed on-the-fly during fast forward or rewind events. When the user fast forwards or rewinds, the video processor 210 essentially tags on the fly and maintains a counter as to where the appropriate scene point is. When the user presses play, the algorithm or function described below is applied to jump to the appropriate tag location.

  In all cases, content tagging is implemented as an automated solution that is completely invisible to the user. However, there can be considerable variation in how much information is tagged, what is used to determine such tags, and how those tags are used. In some embodiments, a tag may comprise a very small amount of data that defines a key transition point in the file. For example, for a two-hour program that had six commercial breaks, the beginning and end of those commercial breaks can be defined by analyzing scene changes with black reference frames.

  The process for detecting tag points in video content will now be described. In the process of compressing video, I frames are typically inserted every 0.5 or 1 second, and there are a few sporadic I frames that represent scene changes. In addition to scene changes, I frames are typically spaced at regular intervals, so one difficulty is that scenes can change at regularly spaced I frames, which identifies them as new scenes. It will be difficult. It is relatively easy to calculate the actual maximum I-frame interval of the content. If you look through a short history, at least every N frames will be revealed. For example, if the maximum GOP size of content is 0.5 seconds, there will be at least 100 I frames every 50 seconds. However, because of the additional I frames for scene changes, there may be, for example, 110 I frames per 50 second period. From this, it can be estimated that the interval is approximately X or approximately 0.5 seconds, but there are additional I frames that represent scene changes.

  The actual methodology for detecting the appropriate frame for tagging is relatively well known to those skilled in the art. For example, in one known approach, animated video content data is typically captured, stored, transmitted, processed, and output as a series of still images. When the output is directed to the viewer at sufficiently short time intervals, small changes in the data content from frame to frame are perceived as movement. A large change in data content between two adjacent frames is perceived as a scene change (eg, a change from indoor to outdoor scene, a change in camera angle, a sudden change in illuminance in an image, etc.).

  The encoding and compression process takes advantage of small changes in video content data from frame to frame to reduce the amount of data needed to store, transmit, and process video data content. The amount of data required to describe the change is less than the amount of data required to describe the original still image. For example, under standards developed by the Moving Pictures Experts Group (MPEG), a group of frames begins with an intra-coded frame (I frame). In an I frame, the encoded video content data corresponds to the visual attributes (eg, luminance, chrominance) of the original still image. Subsequent frames in the group of frames, such as predictively encoded frames (P frames) and bi-directionally encoded frames (B frames), are encoded based on changes from earlier frames in the group. The New frame groups, and thus new I frames, are started at regular time intervals to prevent noise from inducing, for example, erroneous video content data changes. A new frame group, and thus a new I-frame, can also be started with a scene change when the video content data change is large. This is because describing a new still image requires less data than describing a large change between adjacent still images. In other words, two images from different scenes have little correlation between them. It is more efficient to compress a new picture into I frames than to use one picture to predict the other picture. Therefore, in content data encoding, it is important to identify scene changes between adjacent video content data frames.

  The disclosed method and apparatus may detect scene changes using a sum of absolute histogram difference (SAHD) and a sum of absolute display frame difference (SADFD). Such a method uses temporal information within the same scene to smooth out variations and accurately detect scene changes. These methods can be used for both real-time (eg, real-time video compression) and non-real-time (eg, movie post-production) applications.

In another embodiment of the present disclosure, there are several levels of tags. That is, tags are assigned weights or priorities. In this embodiment, the search zone within the content has more of an impact. For example, the level may be as follows.
Black reference frame (highest priority)
1) Non-regular reference frames (secondary priority but scene change)
2) Other (optional).

  Typically, when playing stored content, playback begins with a reference frame. However, tagging allows a better estimate of which frame the user is most likely to want to start with. If a priority 1 frame is found in the primary or secondary search zone, playback begins here. If a priority 1 frame is found in the primary zone, no further search is performed. If the priority 1 tagged frame is not in the primary or secondary zone, the second priority tag closest to the center is selected as the starting position. There may be “other” tags that need to be considered, such as a tertiary priority similar to a priority 2 tag. However, if none of these is present, the reference frame closest to the center of the primary search zone is selected as the start position.

  The process of playing video content using tags or tagged frames will now be described. In some embodiments, for video playback with pre-tagged content, a separate content file associated with the content file on the disc or storage device 212 that is tagged or that includes tagging information. Suppose you have a file. The tagging information generally indicates scene points within the video content file, and in particular has tags weighted as to how important those markers are as reference points. There are several possible tag types: defined “look-up points”, regularly spaced I frames (reference frames), off-spaced I frames (representing a new scene), and blank I frames. Blank (black) I frames contain very little data and therefore have a very low data rate, generally indicating, for example, a transition from commercial to beginning of the scene between commercial breaks or between scenes and scenes. Inserted between.

  The flowchart shown in FIG. 3 plays the content in an environment where the content is pre-tagged prior to the content broadcast or when the content is consumed by the DVR device 200 or written to disk. Represents the process flow. If the information is read from a disk, such as a hard drive disk (step 302), normal playback is performed at the listening speed (304), and during normal playback, the user can navigate through the user interface 216. Navigation instructions, such as instructions for fast-forwarding or rewinding content, may be entered (step 306). It should be understood that navigation commands, such as fast forward (FF), rewind (Rew), scene skip, etc., allow users to navigate video content faster than the normal playback speed for auditioning. is there.

  When the user inputs fast forward or rewind, no additional processing is performed until the user presses play again, i.e., until a subsequent navigation command. Once the user presses play after fast forward or rewind (step 308), the controller 214 examines the tagged information to determine what tags have occurred within the appropriate range of locations where the user pressed play. (Step 310). Controller 214 then determines where to jump to start playback based on the tag weight and FF / Rew speed (step 312). Once the playback position is determined, video processor 210 seeks the playback head to that point and starts video playback from the selected tagged frame (step 314).

  In an alternative embodiment shown in FIG. 4, the playback process itself can be used to effectively dynamically tag content. As described above, first, in step 402, content is read from the disc and normal playback is performed (step 404). When the user performs FF / Rew, ie, enters navigation instructions (step 406), video processor 210 applies dynamic or “on-the-fly” frame tagging (step 408). That is, the device detects blank scenes, reference frames, etc. that have passed during the FF / Rew process. These tags may or may not be stored with the content for later use.

  Once the user presses play after fast forward or rewind (step 410), device 200 proceeds as described above. Based on the tag weight and FF / Rew speed, the controller 214 determines where to jump to start playback (step 412). Once the playback position is determined, video processor 210 seeks the playback head to that point and begins video playback from the selected tagged frame (step 414).

  In addition to supporting the fast forward or rewind process through the content, tagging can be skipped by the user at the push of a button “from scene to scene” or (with a predefined basic time period) It can also be used to provide a better or different experience that allows you to skip large amounts of content. Still, playback begins at the scene boundary defined in the tag. This process is illustrated in FIG.

  Referring to FIG. 5, a video is read from the disc (step 502) and normal playback is performed at a pre-listening speed (step 504). When the user requests the “Scene Skip” function at step 506, ie, enters a navigation command, the controller 214 sets the “scene search” position according to the predefined “scene definition” setting (step 508), ie, Jump forward or backward a fixed amount of time to start the scene search. Next, in step 510, the controller 214 examines tag information for frames tagged within the vicinity of the “scene search” starting point. Controller 214 then determines where to jump to start playback based on the tag weights in the selected region (step 512). Once the playback position is determined, video processor 210 seeks the playback head to that point and begins video playback from the selected tagged frame (step 514).

  In addition to being able to perform scene skipping on tagged content, the apparatus 200 can also dynamically perform scene skipping on pre-tagged content, as shown in FIG. As described above, the video is read from the disc (step 602) and normal playback is performed at the speed for listening (step 604). When the user requests the “Scene Skip” function in step 606, the controller 214 sets the “scene search” position according to the predefined “scene definition” settings (step 608), ie, to initiate a scene search. Jump forward or backward for a fixed amount of time. Next, in step 510, the controller 214 examines tag information for frames tagged within the vicinity of the “scene search” starting point. Video processor 210 applies dynamic or “on-the-fly” frame tagging (step 610). That is, the video processor 210 detects blank scenes, reference frames, etc. that have passed during the scene skip process. These detection frames or reference points are tagged. These tags may or may not be stored with the content for later use. Controller 214 then determines where to jump to start playback based on the tag weights in the selected region (step 612). Once the playback position is determined, video processor 210 seeks the playback head to that point and begins video playback from the selected tagged frame (step 614).

  The function of how to determine the appropriate playback position after the user presses play is described here. In order to determine the appropriate position at which playback should begin, the controller 214 sets a starting point based on one of several factors, then specifies a period or zone to search in either direction from that reference point To do. The controller 214 searches to see what tags are within its range and applies an algorithm or function to determine the most appropriate starting point for playback.

  The starting point location is likely to be some form of reference frame, but it is also possible to start with an alternative predefined time stamp as a key. This may be other than the reference frame. In fact, as part of the tagging mechanism, it is easy to say that this is a non-I frame, for example a B frame, but it is the B frame that can be easily constructed from the last four frames. If the starting position for playback is here, the tag will return data that allows the device to go back a few frames to build this non-reference frame and get all the video data needed to handle it. Or a reference to the data). In this case, the tag does not have to calculate the required data from scratch on the fly, but contains the offset information needed to make it faster and easier to get the required data Will.

  In another embodiment, if the video compression results in a very long GOP of, for example, 10 seconds, the present disclosure describes where the apparatus and method can actually support fast forward and rewind with such video. Provides a mechanism to obtain a reference frame from elsewhere. It is by augmenting such video with external data and dynamically acquiring additional frames from the Internet or some other medium and / or source. In this example, the stream has a minimum number of reference frames, and there is a remainder of the I frames and another source of intervening data needed to build a complete frame.

  A DVR typically uses an algorithm or function that determines which reference frame should be displayed or jumps from I frame to I frame during trick mode playback. The present disclosure extends based on this basic idea, and there are several possible points where the DVR can stop rather than simply referencing I-frames. These points are nominally defined as scenes. Tags define the possible points at which playback begins, but determine the time interval within the content where these tags should be searched, and algorithms to determine which tag represents the best starting point within that content Or the function is applied.

  In this implementation, the start and end positions for any playback position search are the position in the content file where the user started fast-forward / rewind, i.e., entered the first navigation instruction, and the user presses play. In other words, the boundary from the input of the second navigation command is the boundary. No search is performed outside of these boundaries. In order to determine the starting position of the tag search, the controller 214 determines the “search position” (in the center of the search area) and the size of the area (or zone) where the tag is to be searched, as shown in FIG. Calculate both.

  When the user presses the play button during FF or Rew execution, the search start position is defined in the file based on the following criteria: 1) the speed at which the user is doing FF / Rew and 2) assigned to the user Nominal reaction time. The user's reaction time may be initially set to 2-5 seconds, and the actual likely reaction time can be modified according to user input and / or device 200 experience. This will be described in detail below.

  For example, the user FFs 30 times real speed and presses play at 43 minutes 10 seconds (43:10) in the file. Suppose a user is assigned a reaction time of 4 seconds. This means that the center position 702 for the search is 4 × 30 seconds (ie 2 minutes) before the position where the user pressed play (ie 41:10). Thus, the search for tagged frames begins at this position and the primary search zone 704 is a fixed percentage of this distance on each side of the center point 702. If this ratio is 50%, the tag search zone is 1 minute on each side of the center point, that is, between 40:10 and 42:10 in the file. If any priority tagged frame is found within this range, a hit is registered and video playback begins with the tagged frame with the highest priority. If two or more matches are found and the tag priority weights are the same, playback begins from the point closest to the center position 702. If any match is made, the user's reaction time may be measured and possibly used to change the expected response time for future searches.

  If no match is found, the secondary zone 706 is also searched. This may be, for example, 100% of the distance from the position where the user pressed play to the center point 702. If a key tag is found in this search, this may indicate that the user's response was abnormal, and if a key frame exists in this area, that frame is still selected as the starting position. Can.

The last learning search zone 708 extends from the center point 702 to the playback position and returns 200% from the center point. This is searched only if no key frame is found in either of the first two zones. If a key tagged frame is found here, a delay can be recorded, and if this is a constant behavior, the user response time may be adjusted. This is to ensure that more key frames enter the primary zone. Note that the percentage of distance from the center point is merely exemplary and should be determined through user profiling. Further, regardless of the ratio, the search is performed within the boundary of the end of the search as described above.
In one embodiment, if there are no tagged frames in the first search area (704) and the second search area (706):
Selecting a third search area (708) larger than the second search area (706);
Adjusting the reaction time assigned to the user when determining the at least one tagged frame in the third search area (708);
Increasing the length of the first search area may be performed.

  In order to determine the user reaction time, the apparatus 200 uses both automated and manual mechanisms. This may include user preferences that allow users to define and / or test their reaction times. A typical reaction time is, for example, 2 seconds, so when the user fast-forwards through the content, it takes some time for the user to press the play button after seeing the point where the user wants to start playback. In an example where the user's reaction time is 2 seconds and fast-forward at 30 times the normal playback, it takes 1 minute between the moment when the user presses playback and the user actually presses playback. The video passes. If the FF rate is only twice that of normal playback, for example, the video passing in this time is only 4 seconds. User response times are highly variable, slow response times are about 5 seconds, and fast reaction times are probably 0.5 seconds.

  The device 200 determines whether the user response time is fast. As a rule of thumb, default values are used to set the average user response based on tests. Furthermore, the apparatus 200 may provide a user interface for the user to configure and / or dynamically calculate his / her reaction time. If the device defines an average user default time, eg 2 seconds, then the device can accumulate a record of how the user actually reacts over time. This is based, for example, on testing for high priority “blank frame” tags that are typically found consistently within a long distance from when the user presses play. The response time may be connected to a user-based system on the device 200 so that separate profiling may be performed for multiple users of the system.

  The manual reaction time may be set using a traditional slider displayed on the display device 114. Another option is, for example, to show a series of images in a random order and ask the user to press a button when viewing a particular image (for example, a picture of a dog). It is a mechanism that determines the user's reaction rate by measuring the time between when playback is pressed. The test may be repeated multiple times to obtain better accuracy, or it may be user specific (i.e., the system will allow the user to individually identify himself, both from a test perspective and for device use). May be allowed to identify).

  While embodiments that incorporate the teachings of this disclosure have been shown and described in detail herein, one of ordinary skill in the art can readily devise many other variations that still incorporate these teachings. Can do. Although preferred embodiments of methods and apparatus for optimal playback positioning in digital content have been described (these are intended to be illustrative rather than limiting), in light of the above teachings It should be noted that those skilled in the art can make modifications and changes. Accordingly, it should be understood that changes may be made in the particular embodiments of the disclosure disclosed within the scope of the disclosure as set forth in the appended claims.

Here are some notes.
[Appendix 1]
A method for determining an optimal playback position in video content that includes multiple frames, comprising:
Displaying video content at a playback speed for audition;
Receiving a first navigation instruction for navigating the video content at a speed faster than the playback speed for the audition;
Receiving a second navigation instruction to resume playback of the video content at a playback speed for the audition;
Determining a playback position of the video content in response to the second navigation instruction based on at least one tagged frame of the video content.
Method.
[Appendix 2]
The method of claim 1, wherein the at least one tagged frame of the video content is tagged prior to the displaying step.
[Appendix 3]
Dynamically tagging at least one frame of the video content as frames are passed within a time period between receiving the first navigation instruction and receiving a second navigation instruction. The method according to appendix 1, further comprising:
[Appendix 4]
The determining step further includes:
Determining a search start position in a frame that is passed within a time period between receiving the first navigation command and receiving a second navigation command;
Selecting a first search area for searching tagged frames that includes a predetermined time of the video content on both sides of the determined search start position.
The method according to appendix 1.
[Appendix 5]
The method according to claim 4, wherein the search start position is based on a speed of the first navigation command.
[Appendix 6]
The method according to claim 5, wherein the search start position is further based on a reaction time assigned to a user.
[Appendix 7]
7. The method of claim 6, further comprising selecting a tagged frame with the highest priority as the playback position if there are at least two tagged frames in the first search area.
[Appendix 8]
8. The method of claim 7, further comprising selecting a second search area that is larger than the first search area if there are no tagged frames in the first search area.
[Appendix 9]
If there are no tagged frames in the first region and the second search region:
Selecting a third search area larger than the second search area;
Adjusting the reaction time assigned to the user when determining the at least one tagged frame in the third search region;
Further increasing the predetermined number of times of the first search region.
The method according to appendix 8.
[Appendix 10]
The method of claim 1, wherein the first navigation instruction is a fast forward function or a rewind function.
[Appendix 11]
The method of claim 10, wherein the second navigation instruction is a playback function.
[Appendix 12]
The method of claim 1, wherein the first navigation instruction is a scene skip function.
[Appendix 13]
The determining step further includes:
Determining a search start position by moving forward or backward a predetermined time from the time of receiving the first navigation command;
Searching for at least one tagged frame within the vicinity of the search start position;
The method according to appendix 12.
[Appendix 14]
14. The method of claim 13, further comprising selecting a tagged frame with the highest priority as the playback position if there are at least two tagged frames in the first search area.
[Appendix 15]
An apparatus for playing back video content that includes multiple frames:
A video processor for providing video content to the playback device at a playback speed for listening;
A second navigation instruction for receiving a first navigation instruction for navigating the video content at a speed faster than a playback speed for the audition and restarting the playback of the video content at the playback speed for the audition; User interface to receive;
Receiving the second navigation instruction, determining a playback position of the video content based on at least one tagged frame of the video content, and providing the determined playback position to the video processor; A controller coupled to the user interface;
apparatus.
[Appendix 16]
The apparatus of claim 15, wherein the video processor tags the at least one tagged frame of the video content prior to storing the video content in a storage device.
[Appendix 17]
The video processor dynamically tags the at least one frame of the video content when a frame is passed within a time period between receipt of the first navigation instruction and the second navigation instruction. The device according to appendix 15, which is attached.
[Appendix 18]
The controller further determines a search start position in a frame that is passed within a time period between receipt of the first navigation instruction and the second navigation instruction, and on both sides of the determined search start position. The apparatus of claim 15 configured to select a first search area for searching tagged frames that includes a predetermined time of video content.
[Appendix 19]
The apparatus according to claim 18, wherein the search start position is based on a speed of the first navigation command.
[Appendix 20]
The apparatus of claim 19, wherein the search start position is further based on a reaction time assigned to a user.
[Appendix 21]
The apparatus of claim 20, wherein if there are at least two tagged frames in the first search area, the controller selects the tagged frame with the highest priority as the playback position.
[Appendix 22]
The apparatus of claim 21, wherein if there is no tagged frame in the first search area, the controller selects a second search area that is larger than the first search area.
[Appendix 23]
If there are no tagged frames in the first and second search areas, the controller selects a third search area that is larger than the second search area;
When determining the at least one tagged frame in the third search area, the controller adjusts the reaction time assigned to the user and the predetermined time of the first search area. 24. The apparatus of appendix 22, wherein the number is increased.
[Appendix 24]
The apparatus of claim 15, wherein the first navigation instruction is a fast forward function or a rewind function.
[Appendix 25]
25. The apparatus according to appendix 24, wherein the second navigation command is a playback function.
[Appendix 26]
The apparatus according to claim 15, wherein the first navigation instruction is a scene skip function.
[Appendix 27]
The controller further determines a search start position by moving forward or backward for a predetermined time from a time when the first navigation command is received, and at least one tagged frame within the vicinity of the search start position. 27. Apparatus according to appendix 26, configured to search.
[Appendix 28]
28. The apparatus of claim 27, wherein if there are at least two tagged frames in the first search area, the controller selects the tagged frame with the highest priority as the playback position.

Claims (22)

A method for determining an optimal playback position in video content that includes multiple frames, comprising:
Displaying video content at a playback speed for audition;
Receiving a first navigation instruction for navigating the video content at a speed faster than the playback speed for the audition;
Receiving a second navigation instruction to resume playback of the video content at a playback speed for the audition;
Thereby determining a playback position of the video content in response to the second navigation command, the step of determining a playback position comprising: receiving the first navigation command; At least one tag for determining a search start position in a frame that is passed in a time period between receiving a navigation command and including a predetermined time of the video content on both sides of the determined search start position Further comprising selecting a first search area for searching for tagged frames, wherein the playback position is associated with a selected one of the at least one tagged frame; and Including
If at least two tagged frames are found in the first search region, the determining step further determines a priority for each tagged frame of the at least two tagged frames. Selecting a tagged frame having the highest priority of the at least two tagged frames to be associated with the playback position;
Method.   The method of claim 1, wherein the at least one tagged frame of the video content is tagged prior to the displaying.   Dynamically tagging at least one frame of the video content as frames are passed within a time period between receiving the first navigation instruction and receiving a second navigation instruction. The method of claim 1 further comprising:   The method of claim 1, wherein the search start position is based on a speed of the first navigation instruction.   The method of claim 4, wherein the search start position is further based on a reaction time assigned to a user.   The method of claim 1, further comprising selecting a second search area that is larger than the first search area if there are no tagged frames in the first search area. If there are no tagged frames in the first region and the second search region:
Selecting a third search area larger than the second search area;
Adjusting the reaction time assigned to the user when determining the at least one tagged frame in the third search region;
Further increasing the predetermined time of the first search area.
The method of claim 6.   The method of claim 1, wherein the first navigation instruction is a fast forward function or a rewind function.   The method of claim 8, wherein the second navigation instruction is a playback function.   The method of claim 1, wherein the first navigation instruction is a scene skip function. The determining step further includes:
Determining a search start position by moving forward or backward a predetermined time from the time of receiving the first navigation command;
Searching for at least one tagged frame within the vicinity of the search start position;
The method of claim 10. An apparatus for playing back video content that includes multiple frames:
A video processor for providing video content to the playback device at a playback speed for listening;
A second navigation instruction for receiving a first navigation instruction for navigating the video content at a speed faster than a playback speed for the audition and restarting the playback of the video content at the playback speed for the audition; User interface to receive;
Receiving the second navigation command, determining a search start position in a frame that is passed in a time period between receiving the first navigation command and receiving the second navigation command; Determining the playback position of the video content by selecting a first search area for searching at least one tagged frame that includes a predetermined time of the video content on both sides of a start position A controller coupled to the user interface, wherein the playback position is associated with a selected one of the at least one tagged frame, and wherein the controller further determines the determined playback position A controller for providing to the video processor;
If at least two tagged frames are found in the first search region, the determining step further determines a priority for each tagged frame of the at least two tagged frames. Selecting a tagged frame having the highest priority of the at least two tagged frames to be associated with the playback position;
apparatus.   13. The apparatus of claim 12, wherein the video processor tags the at least one tagged frame of the video content prior to storing the video content in a storage device.   The video processor dynamically tags the at least one frame of the video content when a frame is passed within a time period between receipt of the first navigation instruction and the second navigation instruction. The apparatus of claim 12, attached.   The apparatus of claim 12, wherein the search start position is based on a speed of the first navigation instruction.   The apparatus of claim 15, wherein the search start position is further based on a reaction time assigned to a user.   13. The apparatus of claim 12, wherein the controller selects a second search area that is larger than the first search area if there are no tagged frames in the first search area. If there are no tagged frames in the first and second search areas, the controller selects a third search area that is larger than the second search area;
When determining the at least one tagged frame in the third search area, the controller adjusts the reaction time assigned to the user and the predetermined time of the first search area. 18. The apparatus of claim 17, wherein the apparatus increases.   The apparatus of claim 12, wherein the first navigation instruction is a fast forward function or a rewind function.   The apparatus of claim 19, wherein the second navigation instruction is a playback function.   The apparatus of claim 12, wherein the first navigation instruction is a scene skip function.   The controller further determines a search start position by moving forward or backward for a predetermined time from a time when the first navigation command is received, and at least one tagged frame within the vicinity of the search start position. The apparatus of claim 21, wherein the apparatus is configured to search.

Images