Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06F3/0482—Interaction with lists of selectable items, e.g. menus
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N5/00—Details of television systems
  • H04N5/76—Television signal recording
  • H04N5/84—Television signal recording using optical recording
  • H04N5/85—Television signal recording using optical recording on discs or drums
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
  • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
  • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
  • H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
  • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
  • H04N21/47—End-user applications
  • H04N21/482—End-user interface for program selection
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
  • H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/79—Processing of colour television signals in connection with recording
  • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
  • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
  • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
  • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal

Definitions

• the present invention relates to video menu creation generally and, more particularly, to video motion menu generation in a low memory environment .
• the menu page 10 includes a background image 12, several thumbnail pictures 14a-14f and one or more navigation buttons 16a-16b.
• the DVD menu page 10 is commonly the first picture to appear when playing a DVD disk on a commercial player/recorder .
• the image 12 is often stored in a nonvolatile memory within the player/recorder .
• the image 12 is used to create a visual background template for the thumbnail pictures 14a-14f.
• 4 to 8 thumbnail pictures 14a-14f are in a single menu page 10, one thumbnail picture 14a-14f for each title of a video program. If the number of titles in the program exceeds the thumbnail capacity of the menu 10, the menu 10 has several pages and thus is called a multi-page menu.
• the buttons 16a-16b control movement between menu pages.
• the buttons 16a-16b are commonly named NEXT and PREVIOUS.
• Menu navigation is triggered by a hand-held remote control unit associated with the player/recorder .
• a central focus on a display can be moved either to any of the thumbnail pictures 14a- 14f or to any of the buttons 16a-16b.
• the player/recorder either plays the selected title or executes the button to change the menu page 10 to either the next page or the previous page, as appropriate.
• the present invention concerns a method of generating a motion menu in a low memory environment.
• the method generally comprises the steps of (A) generating a plurality of encoded streams in a buffer by encoding a fixed duration from each of a plurality of title streams received in a video program, (B) generating a plurality of thumbnails frames in the buffer by decoding each of the encoded streams and (C) generating the motion menu in the buffer by combining one of the thumbnail frames from each respective one of the encoded streams into a respective one of plurality of menu frames such that a sequential display the menu frames appear as a plurality of thumbnails
• the objects, features and advantages of the present invention include providing video motion menu generation in a low memory environment that may (i) generate thumbnails showing moving sequences in a menu, (ii) create the dynamic thumbnails using a small amount of memory and/or (iii) create a motion menu without use of storage external to a player/recorder .
• FIG. 1 is a diagram of a conventional DVD menu page
• FIG. 2 is a block diagram of a device in accordance with a preferred embodiment of the present invention.
• FIG. 3 is a flow diagram of an example method of generating a motion menu
• FIG. 4 is a detailed flow diagram of a portion of the method of FIG. 3 focused on creating thumbnail streams.
• FIG. 5 is a detailed flow diagram of a portion of the method of FIG. 3 focused on completing the motion menu. Detailed Description of the Preferred Embodiments
• Motion menus are dynamic menus where individual title thumbnail images change over time to show a moving sequence.
• the motion menus are generally not available on consumer created DVD disks and usually cannot be created in consumer DVD recorder/players .
• the consumer DVD recorder/players generally lack sufficient internal memory to generate the motion menus .
• the device 100 may be implemented as a DVD recorder/player .
• the device 100 may be operational to create dynamic thumbnail pictures in a motion menu using title video streams received from a video source.
• the device 100 generally comprises a circuit (or module) 102, a circuit (or module) 104, a circuit (or module) 106, a circuit (or module) 108, a circuit (or module) 110, a circuit (or module) 112, a circuit (or module) 114 and an interface (or port) 116.
• the circuit 102 may implement an audio/video encoder.
• the circuit 102 is generally operational to encode video streams to generate encoded bitstreams. Encoding may be compliant with the MPEG-2 standard, the MPEG-4 standard, the MPEG-4 Advance Other video encoding standards may be implemented to meet the criteria of a particular application.
• the circuit 104 may implement an audio/video decoder.
• the circuit 104 may be operational to decode video streams to generate sequences of uncompressed frames and/or fields.
• Decoding may be compliant with MPEG-2 standard, the MPEG-4 standard, the MPEG-4 Advance Video Coding recommendation and/or the H.264 recommendation.
• Other video decoding standards may be implemented to meet the criteria of a particular application.
• the circuit 106 may implement a video sealer.
• the circuit 106 is generally operational to downscale video fields/frames of a video stream in real time. Downscaling may alter a size of a video field/frame from a normal size (e.g., 720 by 480 pixels) to a thumbnail size (e.g., 120 by 80 pixels) .
• the downscaling may also reduce the bitrate of the video stream from approximately 4 megabits per second down to approximately 110 kilobits per second (e.g., in a 3x3 thumbnail array on the motion menu) .
• the circuit 108 may be implemented as a video memory.
• the circuit 108 may be configured as multiple buffers to store one or more encoded bitstreams and/or one or more decoded video sequences.
• the circuit 108 may be implemented as a solid-state memory.
• the circuit 108 has a capacity of circuit 108 may implement a volatile random access memory.
• the circuit 108 may also represent a nonvolatile capability (e.g., a volatile memory and a nonvolatile memory) . Other memory capacities may be implemented to meet the criteria of a particular application.
• the circuit 110 may be implemented as a video processor.
• the circuit 110 is generally operational to manipulate video pictures and information.
• the circuit 110 may be configured to (i) overlay decoded thumbnail frames onto a decoded background picture to form a motion menu and (ii) add navigational features (e.g., button and links) to the motion menu.
• the circuit 112 may be implemented as an optical disk writer (or recorder) .
• the circuit 112 is generally operational to write one or more encoded video programs and one or more encoded motion menus on (in) an optical disk medium.
• the circuit 112 may also implement an optical disk players capable of reading encoded video content and encoded motion menus from an optical disk.
• the circuit 114 may be implemented as an optical disk player.
• the circuit 114 may provide a source of the video program having the title streams used to build the motion menu.
• the circuit 114 may be a non-optical disk be implemented as a video satellite receiver, a cable set-top- box and/or a camcorder.
• Other sources of video programs (content) may be implemented to meet the criteria of a particular application.
• the interface 116 generally implements a video output port.
• the interface 116 may be arranged as one or more of a composite output, a component output, a radio-frequency output, a red-green-blue output and/or the like.
• the interface 116 may be connectable to a display to show the programs and the motion menus to viewers .
• the method 120 may be implemented by the device 100.
• the method 120 generally comprises a step (or block) 122, a step (or block) 124, a step (or block) 126, a step (or block) 128 and a step (or block) 130.
• a video program may be received by the circuit 114 (e.g., in the form of a normal DVD disk inserted into the player) .
• the circuit 114 may extract one or more title streams from the video program in the step 124. Decoding of the title streams during extraction may be performed by the circuit 114 or the circuit 104. Stream segments covering a fixed amount of time (e.g., 20 to 30 second) of each of the title streams may 126, the circuit 102 may encode the captured title stream segments and store the encoded title stream segments in the circuit 108. Buffering of the segments may be done after encoding to make efficient use of the limited capacity of the circuit 108.
• the circuits 102-110 may operate to create a motion menu from the encoded title stream segments.
• Generation of the motion menu generally includes adding intra- menu navigation features (e.g., next page and previous page buttons) and DVD related navigation features (e.g., language selection, aspect ratios and such) .
• the resulting motion menu may be encoded by the circuit 102 and temporarily stored in the circuit 108 for subsequent display and/or recording.
• the circuits 104-112 may operate to store both the motion menu and the video program on (in) a writable medium (e.g., an optical disk) mounted in the circuit 112.
• the method 120 may be repeated for each page of the motion menu.
• the illustrated portion may include the step 122, one or more steps (or blocks) 140a-140n, one or more steps (or blocks) 142a-142n, the step 126 and one or more steps (or blocks) 144a-144n.
• the step 122 (in FIG. 3) generally comprises multiple sub-steps 122a-122n (in FIG. 4) , one sub-step for each of the title streams (e.g., STREAM 1 to STREAM N) received from the circuit 114.
• the title streams may be received from the circuit 114 one at a time and processed one at a time.
• two or more of the title streams may be received and processed in parallel.
• the title streams may be received in an encoded form.
• each of the encoded title streams may be decoded by either the circuit 104 and/or the circuit 114. Similar to the steps 122a-122n, the decoding operations 140a-140n may be performed sequentially, one title stream at a time, or in parallel with two or more streams substantially simultaneously. Decoding may be performed on a frame-by-frame basis and/or a field-by-field basis. The decoded title streams may be temporarily buffered in the circuit 108. In the steps 142a-142n, the decoded title streams may be downscaled to a thumbnail size by the circuit 106. Scaling may be performed on a frame-by-frame and/or field-by-field basis.
• the thumbnail size may be a fixed size or a dynamic size, depending on one or both of (i) the number of titles to be presented on each page of the motion menu and (ii) the size of the motion menu.
• Each of the scaled thumbnail streams may be thumbnail streams may overwrite the original title streams. In other embodiments, the scaled thumbnail streams may be stored separately from the original title streams.
• the step 126 (in FIG. 3) generally comprises multiple sub-steps 126a-126n (in FIG. 4), one sub-step for each of the scaled thumbnail streams.
• a respective scaled thumbnail stream may be encoded.
• the resulting thumbnail streams may be stored on (in) the circuit 108 in the steps 144a-144n.
• the illustrated portion may include one or more steps (or blocks) 146a-146n, one or more steps (or blocks) 148a-148n, a step (or block) 150, a step (or block) 152, a step (or block) 154, a step (or block) 156, a step (or block) 158 and the step 130.
• a single field/frame of each of the encoded and scaled thumbnail streams may be read from the circuit 108. As before, reading may be performed one field/frame at a time, or multiple field/frames in parallel and substantially simultaneously. Each of the fields/frames read from the circuit 108 may be decoded in the respective steps 148a-148n by the circuit 104 and written back into the circuit 108.
• an encoded background picture may be read by the circuit 104 from either the circuit 108 (e.g., nonvolatile portion) or the video source via the circuit 114. The background picture is generally stored in an encoded form to save space.
• the circuit 104 may decode the background picture in the step 152 and buffer the decoded picture in the circuit 108 (e.g., volatile portion).
• the decoded background picture may occupy a full size buffer (e.g., a YUV 4:2:0 buffer) in the circuit 108.
• the circuit 110 may generate a page of the motion menu by combining a thumbnail field/ frame from each of the titles with the background picture.
• the resulting motion menu page may be buffered in the circuit 108 during and after construction.
• the circuit 102 may then encode the motion menu page in the step 156 and store the result back into the circuit 108.
• Additional encoded motion menu pages may be created for each successive page until all of the motion menu pages have been created, encoded and buffered.
• the circuit 110 may add the onscreen navigation information to the encoded motion menu page.
• the circuit 112 may write the completed motion menu into a writable optical disk in the step 130 in a DVD-video compliant stream.
• the navigation information stored in navigation files may instruct a player (e.g., circuit 114) to creating a constantly moving motion menu.
• the navigation files may instruct the player to display the thumbnail sequences in a single pass and then hold the thumbnails at the last fields/frames of the sequences.
• the memory savings generally makes possible the whole motion menu creating process in a local solid-state memory without using a large external storage device, such as a magnetic hard drive.
• Audio may be provided while the motion menu is displayed to the viewers.
• one or more audio clips may be stored in the circuit 108 (nonvolatile portion) and played through the circuit 110 at a low bitrate.
• a user authoring the motion menu may select one or more of the clips to be associated with the motion menu.
• FIGS. 2-5 may be implemented using a conventional general purpose digital computer programmed according to the teachings of the present specification, as will be apparent to those skilled in the relevant art(s).
• Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will also be apparent to those skilled in The present invention may also be implemented by the preparation of ASICs, FPGAs, or by interconnecting an appropriate network of conventional component circuits, as is described herein, modifications of which will be readily apparent to those skilled in the art(s).
• the present invention thus may also include a computer product which may be a storage medium including instructions which can be used to program a computer to perform a process in accordance with the present invention.
• the storage medium can include, but is not limited to, any type of disk including floppy disk, optical disk, CD-ROM, magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, Flash memory, magnetic or optical cards, or any type of media suitable for storing electronic instructions.
• the term "simultaneously” is meant to describe events that share some common time period but the term is not meant to be limited to events that begin at the same point in time, end at the same point in time, or have the same duration.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• General Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Television Signal Processing For Recording (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)
• Management Or Editing Of Information On Record Carriers (AREA)
• Signal Processing For Digital Recording And Reproducing (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=40027588

Family Applications (1)

Country Status (7)

Families Citing this family (7)

Citations (8)

Family Cites Families (7)

• 2007
  • 2007-05-17 US US11/749,809 patent/US8340196B2/en not_active Expired - Fee Related
  • 2007-11-26 TW TW096144726A patent/TWI404415B/zh not_active IP Right Cessation
• 2008
  • 2008-03-03 JP JP2010508357A patent/JP5701597B2/ja not_active Expired - Fee Related
  • 2008-03-03 WO PCT/US2008/002802 patent/WO2008143732A1/en not_active Ceased
  • 2008-03-03 CN CN2008800163798A patent/CN101681193B/zh not_active Expired - Fee Related
  • 2008-03-03 EP EP08726359A patent/EP2171560A4/en not_active Withdrawn
  • 2008-03-03 KR KR1020097025075A patent/KR101266496B1/ko not_active Expired - Fee Related

Patent Citations (8)

Also Published As

Similar Documents

Legal Events