US8374245B2 - Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation - Google Patents

Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation Download PDF

Info

Publication number
US8374245B2
US8374245B2 US11/525,059 US52505906A US8374245B2 US 8374245 B2 US8374245 B2 US 8374245B2 US 52505906 A US52505906 A US 52505906A US 8374245 B2 US8374245 B2 US 8374245B2
Authority
US
United States
Prior art keywords
direct mode
picture
mode macroblock
motion vector
spatial
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/525,059
Other versions
US20070014358A1 (en
Inventor
Alexandros Tourapis
Shipeng Li
Feng Wu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US11/525,059 priority Critical patent/US8374245B2/en
Application filed by Microsoft Corp filed Critical Microsoft Corp
Publication of US20070014358A1 publication Critical patent/US20070014358A1/en
Priority to US13/760,486 priority patent/US8873630B2/en
Application granted granted Critical
Publication of US8374245B2 publication Critical patent/US8374245B2/en
Priority to US14/502,529 priority patent/US9185427B2/en
Assigned to MICROSOFT TECHNOLOGY LICENSING, LLC reassignment MICROSOFT TECHNOLOGY LICENSING, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MICROSOFT CORPORATION
Priority to US14/875,164 priority patent/US9571854B2/en
Priority to US15/391,652 priority patent/US10116959B2/en
Priority to US16/146,133 priority patent/US10694208B2/en
Priority to US16/872,815 priority patent/US11277636B2/en
Priority to US17/669,235 priority patent/US11575934B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/577Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/142Detection of scene cut or scene change
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/56Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/573Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/58Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/87Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving scene cut or scene change detection in combination with video compression

Definitions

  • This invention relates to video coding, and more particularly to methods and apparatuses for providing improved coding and/or prediction techniques associated with different types of video data.
  • JVT Joint Video Team
  • VCEG Video Coding Expert Group
  • the method includes identifying at least a portion of at least one video frame to be a Bidirectionally Predictive (B) picture, and selectively encoding the B picture using at least spatial prediction to encode at least one motion parameter associated with the B picture.
  • the B picture may include a block, a macroblock, a subblock, a slice, or other like portion of the video frame. For example, when a macroblock portion is used, the method produces a Direct Macroblock.
  • the method further includes employing linear or non-linear motion vector prediction for the B picture based on at least one reference picture that is at least another portion of the video frame.
  • the method employs median motion vector prediction to produce at least one motion vector.
  • the method may also process at least one other portion of at least one other video frame to further selectively encode the B picture using temporal prediction to encode at least one temporal-based motion parameter associated with the B picture.
  • the temporal prediction includes bidirectional temporal prediction, for example based on at least a portion of a Predictive (P) frame.
  • the method also selectively determines applicable scaling for a temporal-based motion parameter based at least in part on a temporal distance between the predictor video frame and the frame that includes the B picture.
  • temporal distance information is encoded, for example, within a header or other like data arrangement associated with the encoded B picture.
  • FIG. 1 is a block diagram depicting an exemplary computing environment that is suitable for use with certain implementations of the present invention.
  • FIG. 2 is a block diagram depicting an exemplary representative device that is suitable for use with certain implementations of the present invention.
  • FIG. 3 is an illustrative diagram depicting spatial predication associated with portions of a picture, in accordance with certain exemplary implementations of the present invention.
  • FIG. 4 is an illustrative diagram depicting Direct Prediction in B picture coding, in accordance with certain exemplary implementations of the present invention.
  • FIG. 5 is an illustrative diagram depicting what happens when a scene change happens or even when the collocated block is intra-coded, in accordance with certain exemplary implementations of the present invention.
  • FIG. 6 is an illustrative diagram depicting handling of collocated intra within existing codecs wherein motion is assumed to be zero, in accordance with certain exemplary implementations of the present invention.
  • FIG. 7 is an illustrative diagram depicting how Direct Mode is handled when the reference picture of the collocated block in the subsequent P picture is other than zero, in accordance with certain exemplary implementations of the present invention.
  • FIG. 8 is an illustrative diagram depicting an exemplary scheme wherein MV FW and MV BW are derived from spatial prediction, in accordance with certain exemplary implementations of the present invention.
  • FIG. 9 is an illustrative diagram depicting how spatial prediction solves the problem of scene changes and the like, in accordance with certain exemplary implementations of the present invention.
  • FIG. 10 is an illustrative diagram depicting joint spatio-temporal prediction for Direct Mode in B picture coding, in accordance with certain exemplary implementations of the present invention.
  • FIG. 11 is an illustrative diagram depicting Motion Vector Prediction of a current block considering reference picture information of predictor macroblocks, in accordance with certain exemplary implementations of the present invention.
  • FIG. 12 is an illustrative diagram depicting how to use more candidates for Direct Mode prediction especially if bidirectional prediction is used within the B picture, in accordance with certain exemplary implementations of the present invention.
  • FIG. 13 is an illustrative diagram depicting how B pictures may be restricted in using future and past reference pictures, in accordance with certain exemplary implementations of the present invention.
  • FIG. 14 is an illustrative diagram depicting projection of collocated Motion Vectors to a current reference for temporal direct prediction, in accordance with certain exemplary implementations of the present invention.
  • FIGS. 15 a - c are illustrative diagrams depicting Motion Vector Predictors for one MV in different configurations, in accordance with certain exemplary implementations of the present invention.
  • FIGS. 16 a - c are illustrative diagrams depicting Motion Vector Predictors for one MV with 8 ⁇ 8 partitions in different configurations, in accordance with certain exemplary implementations of the present invention.
  • FIGS. 17 a - c are illustrative diagrams depicting Motion Vector Predictors for one MV with additional predictors for 8 ⁇ 8 partitioning, in accordance with certain exemplary implementations of the present invention.
  • program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types.
  • the invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in both local and remote memory storage devices.
  • FIG. 1 illustrates an example of a suitable computing environment 120 on which the subsequently described systems, apparatuses and methods may be implemented.
  • Exemplary computing environment 120 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the improved methods and systems described herein. Neither should computing environment 120 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in computing environment 120 .
  • the improved methods and systems herein are operational with numerous other general purpose or special purpose computing system environments or configurations.
  • Examples of well known computing systems, environments, and/or configurations that may be suitable include, but are not limited to, personal computers, server computers, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
  • computing environment 120 includes a general-purpose computing device in the form of a computer 130 .
  • the components of computer 130 may include one or more processors or processing units 132 , a system memory 134 , and a bus 136 that couples various system components including system memory 134 to processor 132 .
  • Bus 136 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port and a processor or local bus using any of a variety of bus architectures.
  • bus architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus also known as Mezzanine bus.
  • Computer 130 typically includes a variety of computer readable media. Such media may be any available media that is accessible by computer 130 , and it includes both volatile and non-volatile media, removable and non-removable media.
  • system memory 134 includes computer readable media in the form of volatile memory, such as random access memory (RAM) 140 , and/or non-volatile memory, such as read only memory (ROM) 138 .
  • RAM random access memory
  • ROM read only memory
  • a basic input/output system (BIOS) 142 containing the basic routines that help to transfer information between elements within computer 130 , such as during start-up, is stored in ROM 138 .
  • BIOS basic input/output system
  • RAM 140 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processor 132 .
  • Computer 130 may further include other removable/non-removable, volatile/non-volatile computer storage media.
  • FIG. 1 illustrates a hard disk drive 144 for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a “hard drive”), a magnetic disk drive 146 for reading from and writing to a removable, non-volatile magnetic disk 148 (e.g., a “floppy disk”), and an optical disk drive 150 for reading from or writing to a removable, non-volatile optical disk 152 such as a CD-ROM/R/RW, DVD-ROM/R/RW/+R/RAM or other optical media.
  • Hard disk drive 144 , magnetic disk drive 146 and optical disk drive 150 are each connected to bus 136 by one or more interfaces 154 .
  • the drives and associated computer-readable media provide nonvolatile storage of computer readable instructions, data structures, program modules, and other data for computer 130 .
  • the exemplary environment described herein employs a hard disk, a removable magnetic disk 148 and a removable optical disk 152 , it should be appreciated by those skilled in the art that other types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, random access memories (RAMs), read only memories (ROM), and the like, may also be used in the exemplary operating environment.
  • a number of program modules may be stored on the hard disk, magnetic disk 148 , optical disk 152 , ROM 138 , or RAM 140 , including, e.g., an operating system 158 , one or more application programs 160 , other program modules 162 , and program data 164 .
  • the improved methods and systems described herein may be implemented within operating system 158 , one or more application programs 160 , other program modules 162 , and/or program data 164 .
  • a user may provide commands and information into computer 130 through input devices such as keyboard 166 and pointing device 168 (such as a “mouse”).
  • Other input devices may include a microphone, joystick, game pad, satellite dish, serial port, scanner, camera, etc.
  • a user input interface 170 that is coupled to bus 136 , but may be connected by other interface and bus structures, such as a parallel port, game port, or a universal serial bus (USB).
  • USB universal serial bus
  • a monitor 172 or other type of display device is also connected to bus 136 via an interface, such as a video adapter 174 .
  • personal computers typically include other peripheral output devices (not shown), such as speakers and printers, which may be connected through output peripheral interface 175 .
  • Computer 130 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 182 .
  • Remote computer 182 may include many or all of the elements and features described herein relative to computer 130 .
  • Logical connections shown in FIG. 1 are a local area network (LAN) 177 and a general wide area network (WAN) 179 .
  • LAN local area network
  • WAN wide area network
  • Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.
  • computer 130 When used in a LAN networking environment, computer 130 is connected to LAN 177 via network interface or adapter 186 .
  • the computer When used in a WAN networking environment, the computer typically includes a modem 178 or other means for establishing communications over WAN 179 .
  • Modem 178 which may be internal or external, may be connected to system bus 136 via the user input interface 170 or other appropriate mechanism.
  • FIG. 1 Depicted in FIG. 1 , is a specific implementation of a WAN via the Internet.
  • computer 130 employs modem 178 to establish communications with at least one remote computer 182 via the Internet 180 .
  • program modules depicted relative to computer 130 may be stored in a remote memory storage device.
  • remote application programs 189 may reside on a memory device of remote computer 182 . It will be appreciated that the network connections shown and described are exemplary and other means of establishing a communications link between the computers may be used.
  • FIG. 2 is a block diagram depicting another exemplary device 200 that is also capable of benefiting from the methods and apparatuses disclosed herein.
  • Device 200 is representative of any one or more devices or appliances that are operatively configured to process video and/or any related types of data in accordance with all or part of the methods and apparatuses described herein and their equivalents.
  • device 200 may take the form of a computing device as in FIG.
  • device 200 includes logic 202 configured to process video data, a video data source 204 configured to provide vide data to logic 202 , and at least one display module 206 capable of displaying at least a portion of the video data for a user to view.
  • Logic 202 is representative of hardware, firmware, software and/or any combination thereof.
  • logic 202 includes a compressor/decompressor (codec), or the like.
  • Video data source 204 is representative of any mechanism that can provide, communicate, output, and/or at least momentarily store video data suitable for processing by logic 202 .
  • Video reproduction source is illustratively shown as being within and/or without device 200 .
  • Display module 206 is representative of any mechanism that a user might view directly or indirectly and see the visual results of video data presented thereon.
  • device 200 may also include some form or capability for reproducing or otherwise handling audio data associated with the video data.
  • an audio reproduction module 208 is shown.
  • This section describes several exemplary improvements that can be implemented to encode Bidirectionally Predictive (B) pictures and Motion Vector prediction within a video coding system or the like.
  • the exemplary methods and apparatuses can be applied to predict motion vectors and enhancements in the design of a B picture Direct Mode.
  • Such methods and apparatuses are particularly suitable for multiple picture reference codecs, such as, for example, JVT, and can achieve considerable coding gains especially for panning sequences or scene changes.
  • Bidirectionally Predictive (B) pictures are an important part of most video coding standards and systems since they tend to increase the coding efficiency of such systems, for example, when compared to only using Predictive (P) pictures.
  • This improvement in coding efficiency is mainly achieved by the consideration of bidirectional motion compensation, which can effectively improve motion compensated prediction and thus allow the encoding of significantly reduced residue information.
  • the introduction of the Direct Prediction mode for a Macroblock/block within such pictures can further increase efficiency considerably (e.g., more than 10-20%) since no motion information is encoded. Such may be accomplished, for example, by allowing the prediction of both forward and backward motion information to be derived directly from the motion vectors used in the corresponding macroblock of a subsequent reference picture.
  • FIG. 4 illustrates Direct Prediction in B picture at time t+1 coding based on P frames at times t and t+2, and the applicable motion vectors (MVs).
  • MVs Motion vectors
  • the motion vectors ( ⁇ right arrow over (MV) ⁇ fw , ⁇ right arrow over (MV) ⁇ tw ) of the Direct Mode versus the motion vector ⁇ right arrow over (MW) ⁇ of the collocated MB in the first subsequent P reference picture are basically calculated by:
  • TR B is the temporal distance between the current B picture and the reference picture pointed by the forward MV of the collocated MB
  • TR D is the temporal distance between the future reference picture and the reference picture pointed by the forward MV of the collocated MB.
  • FIG. 5 illustrates what happens when a scene change occurs in the video sequence and/or what happens when the collocated block is intra.
  • FIG. 5 illustrates what happens when a scene change occurs in the video sequence and/or what happens when the collocated block is intra.
  • bidirectional prediction would provide little if any benefit.
  • the Direct Mode could be completely wasted.
  • conventional implementations of the Direct Mode restrict it to always perform a bidirectional prediction of a Macroblock.
  • FIG. 7 is an illustrative diagram depicting how Direct Mode is handled when the reference picture of the collocated block in the subsequent P picture is other than zero, in accordance with certain implementations of the present invention.
  • a new Direct Macroblock type is introduced wherein both temporal prediction and/or spatial prediction is considered.
  • the type(s) of prediction used can depend on the type of reference picture information of the first subsequent P reference picture, for example.
  • Direct Mode is designed as a bidirectional prediction scheme where motion parameters are always predicted in a temporal way from the motion parameters in the subsequent P images.
  • an enhanced Direct Mode technique is provided in which spatial information may also/alternatively be considered for such predictions.
  • One or more of the following exemplary techniques may be implemented as needed, for example, depending on the complexity and/or specifications of the system.
  • One technique is to implement spatial prediction of the motion vector parameters of the Direct Mode without considering temporal prediction.
  • Spatial prediction can be accomplished, for example, using existing Motion Vector prediction techniques used for motion vector encoding (such as, e.g., median prediction). If multiple picture references are used, then the reference picture of the adjacent blocks may also be considered (even though there is no such restriction and the same reference, e.g. 0, could always be used).
  • Motion parameters and reference pictures could be predicted as follows and with reference to FIG. 3 , which illustrates spatial predication associated with portions A-E (e.g., macroblocks, slices, etc.) assumed to be available and part of a picture.
  • A-E e.g., macroblocks, slices, etc.
  • E is predicted in general from A, B, C as Median (A,B,C). If C is actually outside of the picture then D is used instead. If B, C, and D are outside of picture, then only A is used, where as if A does not exist, such is replaced with (0,0).
  • A-E e.g., macroblocks, slices, etc.
  • spatial prediction can be seen as a linear or nonlinear function of all available motion information calculated within a picture or a group of macroblocks/blocks within the same picture.
  • One method may be to select a minimum reference picture among the predictions.
  • a median reference picture may be selected.
  • a selection may be made between a minimum reference picture and median reference picture, e.g., if the minimum is zero.
  • a higher priority could also be given to either vertical or horizontal predictors (A and B) due to their possibly stronger correlation with E.
  • Temporal prediction is used for Macroblocks if the subsequent P reference is non intra as in existing codecs. Attention is now drawn to FIG. 8 , in which MV FW and MV BW are derived from spatial prediction (Median MV of surrounding Macroblocks). If either one is not available (i.e., no predictors) then one-direction is used. If a subsequent P reference is intra, then spatial prediction can be used instead as described above. Assuming that no restrictions exist, if one of the predictions is not available then Direct Mode becomes a single direction prediction mode.
  • spatial prediction may be used to solve the problem of a scene change.
  • temporal prediction will not be as efficient in the direct mode for blocks when the collocated P reference block has a non-zero reference picture.
  • spatial prediction may also be used as above.
  • special handling may be provided for the case of zero motion (or close to zero motion) with a non-zero reference.
  • regardless of temporal distance forward and backward motion vectors could always be taken as zero.
  • the best solution may be to always examine the reference picture information of surrounding macroblocks and based thereon decide on how the direct mode should be handled in such a case.
  • FIG. 10 illustrates a joint spatio-temporal prediction for Direct Mode in B picture coding.
  • Direct Mode can be a 1- to 4-direction mode depending on information available.
  • Bi-directional prediction for Direct Mode macroblocks a multi-hypothesis extension of such mode can be done and multiple predictions used instead.
  • Direct Mode macroblocks can be predicted using from one up to four possible motion vectors depending on the information available. Such can be decided, for example, based on the mode of the collocated P reference image macroblock and on the surrounding macroblocks in the current B picture. In such a case, if the spatial prediction is too different than the temporal one, one of them could be selected as the only prediction in favor of the other. Since spatial prediction as described previously, might favor a different reference picture than the temporal one, the same macroblock might be predicted from more than 2 reference pictures.
  • the JVT standard does not restrict the first future reference to be a P picture.
  • a picture can be a B as illustrated in FIG. 12 , or even a Multi-Hypothesis (MH) picture.
  • MH Multi-Hypothesis
  • the first subsequent reference picture is a B picture (pictures B 8 and B 9 ). This enables one to use more candidates for Direct Mode prediction especially if bidirectional prediction is used within the B picture.
  • B pictures can be restricted in using only one future and past reference pictures.
  • projection of the motion vectors is necessary.
  • a projection of the collocated MVs to the current reference for temporal direct prediction is illustrated in FIG. 14 (note that it is possible that TD D,0 >TD D,1 ).
  • Direct Mode motion parameters are calculated by projecting motion vectors that refer to other reference pictures to the two reference pictures, or by using spatial prediction as in FIG. 13 . Note that such options not only allow for possible reduced encoding complexity of B pictures, but also tend to reduce memory requirements since fewer B pictures (e.g., maximum two) are needed to be stored if B pictures are allowed to reference B pictures.
  • a reference picture of the first future reference picture may no longer be available in the reference buffer. This could immediately generate a problem for the estimate of Direct Mode macroblocks and special handling of such cases is required. Obviously there is no such problem if a single picture reference is used. However, if multiple picture references are desired, then possible solutions include projecting the motion vector(s) to either the first forward reference picture, and/or to the reference picture that was closest to the non available picture. Either solution could be viable, whereas again spatial prediction could be an alternative solution.
  • Motion vector prediction for multi-picture reference motion compensation can significantly affect the performance of both B and P picture coding.
  • Existing standards such as, for example, JVT, do not always consider the reference pictures of the macroblocks used in the prediction. The only consideration such standards do make is when only one of the prediction macroblocks uses the same reference. In such a case, only that predictor is used for the motion prediction. There is no consideration of the reference picture if only one or all predictors are using a different reference.
  • FIG. 11 illustrates Motion Vector prediction of a current block (C) considering the reference picture information of predictor macroblocks (Pr) and performance of proper adjustments (e.g., scaling of the predictors)
  • predictors A, B, and C use reference pictures with temporal distance TR A , TR B , and TR C respectively, and the current reference picture has a temporal distance equal to TR, then the median predictor is calculated as follows:
  • integer computation it may be easier to place the multiplication inside the median, thus increasing accuracy.
  • Motion Vector prediction as discussed previously is basically median biased, meaning that the median value among a set of predictors is selected for the prediction. If one only uses one type of macroblock (e.g., 16 ⁇ 16) with one Motion Vector (MV), then these predictors can be defined, for example, as illustrated in FIG. 15 .
  • MV predictors are shown for one MV.
  • FIG. 15 a the MB is not in the first row or the last column.
  • the MB is in the last column.
  • FIG. 15 c the MB is in the first row.
  • the JVT standard improves on this further by also considering the case that only one of the three predictors exists (i.e. Macroblocks are intra or are using a different reference picture in the case of multi-picture prediction). In such a case, only the existing or same reference predictor is used for the prediction and all others are not examined.
  • Intra coding does not always imply that a new object has appeared or that scene changes. It might instead, for example, be the case that motion estimation and compensation is inadequate to represent the current object (e.g., search range, motion estimation algorithm used, quantization of residue, etc) and that better results could be achieved through Intra Coding instead. The available motion predictors could still be adequate enough to provide a good motion vector predictor solution.
  • MPEG4 and H.263 standards can have up to four such subblocks (e.g., with size 8 ⁇ 8), where as the JVT standard allows up to sixteen subblocks while also being able to handle variable block sizes (e.g., 4 ⁇ 4, 4 ⁇ 8, 8 ⁇ 4, 8 ⁇ 8, 8 ⁇ 16, 16 ⁇ 8, and 16 ⁇ 16).
  • JVT also allows for 8 ⁇ 8 Intra subblocks, thus complicating things even 23 further.
  • FIGS. 16 a - c having a similar arrangement to FIGS. 15 a - c , respectively.
  • Motion Vector predictors are shown for one MV with 8 ⁇ 8 partitions. Even though the described predictors could give reasonable results in some cases, it appears that they may not adequately cover all possible predictions.
  • FIGS. 17 a - c are also in a similar arrangement to FIGS. 15 a - c , respectively.
  • FIGS. 17 a - c there are two additional predictors that could also be considered in the prediction phase (C 1 and A 2 ). If 4 ⁇ 4 blocks are also considered, this increases the possible predictors by four.
  • predictors A 1 , and C 2 are essentially too close with one another and it may be the case that they may not be too representative in the prediction phase. Instead, selecting predictors A 1 , C 1 , and B seems to be a more reliable solution due to their separation.
  • An alternative could also be the selection of A 2 instead of A 1 but that may again be too close to predictor B. Simulations suggest that the first case is usually a better choice.
  • a 2 could be used instead of A 1 .
  • For the first row either one of A 1 and A 2 or even their average value could be used. Gain up to 1% was noted within JVT with this implementation.
  • ⁇ right arrow over (MV) ⁇ pred Median(Ave( ⁇ right arrow over (MV) ⁇ C 1 , ⁇ right arrow over (MV) ⁇ C 2 ), Ave( ⁇ right arrow over (MV) ⁇ A 1 , ⁇ right arrow over (MV) ⁇ A 2 ), ⁇ right arrow over (MV) ⁇ B )
  • ⁇ right arrow over (MV) ⁇ pred Median(Median( ⁇ right arrow over (MV) ⁇ C 1 , ⁇ right arrow over (MV) ⁇ C 2 , ⁇ right arrow over (MV) ⁇ D ), . . . Median( ⁇ right arrow over (MV) ⁇ D , ⁇ right arrow over (MV) ⁇ A 1 , ⁇ right arrow over (MV) ⁇ C 1 ), Median( ⁇ right arrow over (MV) ⁇ B , ⁇ right arrow over (MV) ⁇ A 1 , ⁇ right arrow over (MV) ⁇ A 2 ))
  • ⁇ right arrow over (MV) ⁇ pred Median( ⁇ right arrow over (MV) ⁇ C 1 , ⁇ right arrow over (MV) ⁇ C 2 , ⁇ right arrow over (MV) ⁇ D , ⁇ right arrow over (MV) ⁇ B , ⁇ right arrow over (MV) ⁇ A 1 , ⁇ right arrow over (MV) ⁇ A 2 )
  • JVT allows the existence of Intra subblocks within an Inter Macroblock (e.g., tree macroblock structure), such could also be taken in consideration within the Motion Prediction.
  • a subblock e.g., from Macroblocks above or left only
  • the adjacent subblock may be used instead.
  • a 1 is intra but A 2 is not
  • a 1 can be replaced by A 2 in the prediction.
  • a further possibility is to replace one missing Intra Macroblock with the MV predictor from the upper-left position. In FIG. 17 a , for example, if C 1 is missing then D may be used instead.

Abstract

Several improvements for use with Bidirectionally Predictive (B) pictures within a video sequence are provided. In certain improvements Direct Mode encoding and/or Motion Vector Prediction are enhanced using spatial prediction techniques. In other improvements Motion Vector prediction includes temporal distance and subblock information, for example, for more accurate prediction. Such improvements and other presented herein significantly improve the performance of any applicable video coding system/logic.

Description

RELATED PATENT APPLICATIONS
This application is a continuation of U.S. patent application Ser. No. 10/444,511, filed May 23, 2003, the disclosure of which is hereby incorporated by reference, which claims the benefit of, and hereby incorporates by reference the entire disclosure of, U.S. Provisional Application No. 60/385,965, filed Jun. 3, 2002, and titled “Spatialtemporal Prediction for Bidirectionally Predictive (B) Frames and Motion Vector Prediction for Multi-Frame Reference Motion Compensation.”
TECHNICAL FIELD
This invention relates to video coding, and more particularly to methods and apparatuses for providing improved coding and/or prediction techniques associated with different types of video data.
BACKGROUND
The motivation for increased coding efficiency in video coding has led to the adoption in the Joint Video Team (JVT) (a standards body) of more refined and complicated models and modes describing motion information for a given macroblock. These models and modes tend to make better advantage of the temporal redundancies that may exist within a video sequence. See, for example, IUU-T, Video Coding Expert Group (VCEG), “JVT Coding—(ITU-T H.26L & ISO/IEC JTC1 Standard)—Working Draft Number 2 (WD-2)”, ITU-T JVT-B118, March 2002; and/or Heiko Schwarz and Thomas Wiegand, “Tree-structured macroblock partition”, Doc. VCEG-N17, Dec. 2001.
There is continuing need for further improved methods and apparatuses that can support the latest models and modes and also possibly introduce new models and modes to take advantage of improved coding techniques.
SUMMARY
The above state needs and other are addressed, for example, by a method for use in encoding video data within a sequence of video frames. The method includes identifying at least a portion of at least one video frame to be a Bidirectionally Predictive (B) picture, and selectively encoding the B picture using at least spatial prediction to encode at least one motion parameter associated with the B picture. In certain exemplary implementations the B picture may include a block, a macroblock, a subblock, a slice, or other like portion of the video frame. For example, when a macroblock portion is used, the method produces a Direct Macroblock.
In certain further exemplary implementations, the method further includes employing linear or non-linear motion vector prediction for the B picture based on at least one reference picture that is at least another portion of the video frame. By way of example, in certain implementations, the method employs median motion vector prediction to produce at least one motion vector.
In still other exemplary implementations, in addition to spatial prediction, the method may also process at least one other portion of at least one other video frame to further selectively encode the B picture using temporal prediction to encode at least one temporal-based motion parameter associated with the B picture. In some instances the temporal prediction includes bidirectional temporal prediction, for example based on at least a portion of a Predictive (P) frame.
In certain other implementations, the method also selectively determines applicable scaling for a temporal-based motion parameter based at least in part on a temporal distance between the predictor video frame and the frame that includes the B picture. In certain implementations temporal distance information is encoded, for example, within a header or other like data arrangement associated with the encoded B picture.
BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is illustrated by way of example and not limitation in the figures of the accompanying drawings. The same numbers are used throughout the figures to reference like components and/or features.
FIG. 1 is a block diagram depicting an exemplary computing environment that is suitable for use with certain implementations of the present invention.
FIG. 2 is a block diagram depicting an exemplary representative device that is suitable for use with certain implementations of the present invention.
FIG. 3 is an illustrative diagram depicting spatial predication associated with portions of a picture, in accordance with certain exemplary implementations of the present invention.
FIG. 4 is an illustrative diagram depicting Direct Prediction in B picture coding, in accordance with certain exemplary implementations of the present invention.
FIG. 5 is an illustrative diagram depicting what happens when a scene change happens or even when the collocated block is intra-coded, in accordance with certain exemplary implementations of the present invention.
FIG. 6 is an illustrative diagram depicting handling of collocated intra within existing codecs wherein motion is assumed to be zero, in accordance with certain exemplary implementations of the present invention.
FIG. 7 is an illustrative diagram depicting how Direct Mode is handled when the reference picture of the collocated block in the subsequent P picture is other than zero, in accordance with certain exemplary implementations of the present invention.
FIG. 8 is an illustrative diagram depicting an exemplary scheme wherein MVFW and MVBW are derived from spatial prediction, in accordance with certain exemplary implementations of the present invention.
FIG. 9 is an illustrative diagram depicting how spatial prediction solves the problem of scene changes and the like, in accordance with certain exemplary implementations of the present invention.
FIG. 10 is an illustrative diagram depicting joint spatio-temporal prediction for Direct Mode in B picture coding, in accordance with certain exemplary implementations of the present invention.
FIG. 11 is an illustrative diagram depicting Motion Vector Prediction of a current block considering reference picture information of predictor macroblocks, in accordance with certain exemplary implementations of the present invention.
FIG. 12 is an illustrative diagram depicting how to use more candidates for Direct Mode prediction especially if bidirectional prediction is used within the B picture, in accordance with certain exemplary implementations of the present invention.
FIG. 13 is an illustrative diagram depicting how B pictures may be restricted in using future and past reference pictures, in accordance with certain exemplary implementations of the present invention.
FIG. 14 is an illustrative diagram depicting projection of collocated Motion Vectors to a current reference for temporal direct prediction, in accordance with certain exemplary implementations of the present invention.
FIGS. 15 a-c are illustrative diagrams depicting Motion Vector Predictors for one MV in different configurations, in accordance with certain exemplary implementations of the present invention.
FIGS. 16 a-c are illustrative diagrams depicting Motion Vector Predictors for one MV with 8×8 partitions in different configurations, in accordance with certain exemplary implementations of the present invention.
FIGS. 17 a-c are illustrative diagrams depicting Motion Vector Predictors for one MV with additional predictors for 8×8 partitioning, in accordance with certain exemplary implementations of the present invention.
DETAILED DESCRIPTION
Several improvements for use with Bidirectionally Predictive (B) pictures within a video sequence are described below and illustrated in the accompanying drawings. In certain improvements Direct Mode encoding and/or Motion Vector Prediction are enhanced using spatial prediction techniques. In other improvements Motion Vector prediction includes temporal distance and subblock information, for example, for more accurate prediction. Such improvements and other presented herein significantly improve the performance of any applicable video coding system/logic.
While these and other exemplary methods and apparatuses are described, it should be kept in mind that the techniques of the present invention are not limited to the examples described and shown in the accompanying drawings, but are also clearly adaptable to other similar existing and future video coding schemes, etc.
Before introducing such exemplary methods and apparatuses, an introduction is provided in the following section for suitable exemplary operating environments, for example, in the form of a computing device and other types of devices/appliances.
Exemplary Operational Environments:
Turning to the drawings, wherein like reference numerals refer to like elements, the invention is illustrated as being implemented in a suitable computing environment. Although not required, the invention will be described in the general context of computer-executable instructions, such as program modules, being executed by a personal computer.
Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multi-processor systems, microprocessor based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, portable communication devices, and the like.
The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.
FIG. 1 illustrates an example of a suitable computing environment 120 on which the subsequently described systems, apparatuses and methods may be implemented. Exemplary computing environment 120 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the improved methods and systems described herein. Neither should computing environment 120 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in computing environment 120.
The improved methods and systems herein are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable include, but are not limited to, personal computers, server computers, thin clients, thick clients, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
As shown in FIG. 1, computing environment 120 includes a general-purpose computing device in the form of a computer 130. The components of computer 130 may include one or more processors or processing units 132, a system memory 134, and a bus 136 that couples various system components including system memory 134 to processor 132.
Bus 136 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port and a processor or local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus also known as Mezzanine bus.
Computer 130 typically includes a variety of computer readable media. Such media may be any available media that is accessible by computer 130, and it includes both volatile and non-volatile media, removable and non-removable media.
In FIG. 1, system memory 134 includes computer readable media in the form of volatile memory, such as random access memory (RAM) 140, and/or non-volatile memory, such as read only memory (ROM) 138. A basic input/output system (BIOS) 142, containing the basic routines that help to transfer information between elements within computer 130, such as during start-up, is stored in ROM 138. RAM 140 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processor 132.
Computer 130 may further include other removable/non-removable, volatile/non-volatile computer storage media. For example, FIG. 1 illustrates a hard disk drive 144 for reading from and writing to a non-removable, non-volatile magnetic media (not shown and typically called a “hard drive”), a magnetic disk drive 146 for reading from and writing to a removable, non-volatile magnetic disk 148 (e.g., a “floppy disk”), and an optical disk drive 150 for reading from or writing to a removable, non-volatile optical disk 152 such as a CD-ROM/R/RW, DVD-ROM/R/RW/+R/RAM or other optical media. Hard disk drive 144, magnetic disk drive 146 and optical disk drive 150 are each connected to bus 136 by one or more interfaces 154.
The drives and associated computer-readable media provide nonvolatile storage of computer readable instructions, data structures, program modules, and other data for computer 130. Although the exemplary environment described herein employs a hard disk, a removable magnetic disk 148 and a removable optical disk 152, it should be appreciated by those skilled in the art that other types of computer readable media which can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, random access memories (RAMs), read only memories (ROM), and the like, may also be used in the exemplary operating environment.
A number of program modules may be stored on the hard disk, magnetic disk 148, optical disk 152, ROM 138, or RAM 140, including, e.g., an operating system 158, one or more application programs 160, other program modules 162, and program data 164.
The improved methods and systems described herein may be implemented within operating system 158, one or more application programs 160, other program modules 162, and/or program data 164.
A user may provide commands and information into computer 130 through input devices such as keyboard 166 and pointing device 168 (such as a “mouse”). Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, serial port, scanner, camera, etc. These and other input devices are connected to the processing unit 132 through a user input interface 170 that is coupled to bus 136, but may be connected by other interface and bus structures, such as a parallel port, game port, or a universal serial bus (USB).
A monitor 172 or other type of display device is also connected to bus 136 via an interface, such as a video adapter 174. In addition to monitor 172, personal computers typically include other peripheral output devices (not shown), such as speakers and printers, which may be connected through output peripheral interface 175.
Computer 130 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 182. Remote computer 182 may include many or all of the elements and features described herein relative to computer 130.
Logical connections shown in FIG. 1 are a local area network (LAN) 177 and a general wide area network (WAN) 179. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets, and the Internet.
When used in a LAN networking environment, computer 130 is connected to LAN 177 via network interface or adapter 186. When used in a WAN networking environment, the computer typically includes a modem 178 or other means for establishing communications over WAN 179. Modem 178, which may be internal or external, may be connected to system bus 136 via the user input interface 170 or other appropriate mechanism.
Depicted in FIG. 1, is a specific implementation of a WAN via the Internet. Here, computer 130 employs modem 178 to establish communications with at least one remote computer 182 via the Internet 180.
In a networked environment, program modules depicted relative to computer 130, or portions thereof, may be stored in a remote memory storage device. Thus, e.g., as depicted in FIG. 1, remote application programs 189 may reside on a memory device of remote computer 182. It will be appreciated that the network connections shown and described are exemplary and other means of establishing a communications link between the computers may be used.
Attention is now drawn to FIG. 2, which is a block diagram depicting another exemplary device 200 that is also capable of benefiting from the methods and apparatuses disclosed herein. Device 200 is representative of any one or more devices or appliances that are operatively configured to process video and/or any related types of data in accordance with all or part of the methods and apparatuses described herein and their equivalents. Thus, device 200 may take the form of a computing device as in FIG. 1, or some other form, such as, for example, a wireless device, a portable communication device, a personal digital assistant, a video player, a television, a DVD player, a CD player, a karaoke machine, a kiosk, a digital video projector, a flat panel video display mechanism, a set-top box, a video game machine, etc. In this example, device 200 includes logic 202 configured to process video data, a video data source 204 configured to provide vide data to logic 202, and at least one display module 206 capable of displaying at least a portion of the video data for a user to view. Logic 202 is representative of hardware, firmware, software and/or any combination thereof. In certain implementations, for example, logic 202 includes a compressor/decompressor (codec), or the like. Video data source 204 is representative of any mechanism that can provide, communicate, output, and/or at least momentarily store video data suitable for processing by logic 202. Video reproduction source is illustratively shown as being within and/or without device 200. Display module 206 is representative of any mechanism that a user might view directly or indirectly and see the visual results of video data presented thereon. Additionally, in certain implementations, device 200 may also include some form or capability for reproducing or otherwise handling audio data associated with the video data. Thus, an audio reproduction module 208 is shown.
With the examples of FIGS. 1 and 2 in mind, and others like them, the next sections focus on certain exemplary methods and apparatuses that may be at least partially practiced using with such environments and with such devices.
Encoding Bidirectionally Predictive (B) Pictures And Motion Vector Prediction
This section describes several exemplary improvements that can be implemented to encode Bidirectionally Predictive (B) pictures and Motion Vector prediction within a video coding system or the like. The exemplary methods and apparatuses can be applied to predict motion vectors and enhancements in the design of a B picture Direct Mode. Such methods and apparatuses are particularly suitable for multiple picture reference codecs, such as, for example, JVT, and can achieve considerable coding gains especially for panning sequences or scene changes.
Bidirectionally Predictive (B) pictures are an important part of most video coding standards and systems since they tend to increase the coding efficiency of such systems, for example, when compared to only using Predictive (P) pictures. This improvement in coding efficiency is mainly achieved by the consideration of bidirectional motion compensation, which can effectively improve motion compensated prediction and thus allow the encoding of significantly reduced residue information. Furthermore, the introduction of the Direct Prediction mode for a Macroblock/block within such pictures can further increase efficiency considerably (e.g., more than 10-20%) since no motion information is encoded. Such may be accomplished, for example, by allowing the prediction of both forward and backward motion information to be derived directly from the motion vectors used in the corresponding macroblock of a subsequent reference picture.
By way of example, FIG. 4 illustrates Direct Prediction in B picture at time t+1 coding based on P frames at times t and t+2, and the applicable motion vectors (MVs). Here, an assumption is made that an object in the picture is moving with constant speed. This makes it possible to predict a current position inside a B picture without having to transmit any motion vectors. The motion vectors ({right arrow over (MV)}fw,{right arrow over (MV)}tw) of the Direct Mode versus the motion vector {right arrow over (MW)} of the collocated MB in the first subsequent P reference picture are basically calculated by:
MV fw = TR B · MV TR D and MV bw = ( TR B - TR D ) · MV TR D ,
where TRB is the temporal distance between the current B picture and the reference picture pointed by the forward MV of the collocated MB, and TRD is the temporal distance between the future reference picture and the reference picture pointed by the forward MV of the collocated MB.
Unfortunately there are several cases where the existing Direct Mode does not provide an adequate solution, thus not efficiently exploiting the properties of this mode. In particular, existing designs of this mode usually force the motion parameters of the Direct Macroblock, in the case of the collocated Macroblock in the subsequent P picture being Intra coded, to be zero. For example, see FIG. 6, which illustrates handling of collocated intra within existing codecs wherein motion is assumed to be zero. This essentially means that, for this case, the B picture Macroblock will be coded as the average of the two collocated Macroblocks in the first subsequent and past P references. This immediately raises the following concern; if a Macroblock is Intra-coded, then how does one know how much relationship it has with the collocated Macroblock of its reference picture. In some situations, there may be little if any actual relationship. Hence, it is possible that the coding efficiency of the Direct Mode may be reduced. An extreme case can be seen in the case of a scene change as illustrated in FIG. 5. FIG. 5 illustrates what happens when a scene change occurs in the video sequence and/or what happens when the collocated block is intra. Here, in this example, obviously no relationship exists between the two reference pictures given the scene change. In such a case bidirectional prediction would provide little if any benefit. As such, the Direct Mode could be completely wasted. Unfortunately, conventional implementations of the Direct Mode restrict it to always perform a bidirectional prediction of a Macroblock.
FIG. 7 is an illustrative diagram depicting how Direct Mode is handled when the reference picture of the collocated block in the subsequent P picture is other than zero, in accordance with certain implementations of the present invention.
An additional issue with the Direct Mode Macroblocks exists when multi-picture reference motion compensation is used. Until recently, for example, the JVT standard provided the timing distance information (TRB and TRD), thus allowing for the proper scaling of the parameters. Recently, this was changed in the new revision of the codec (see, e.g., Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, “Joint Committee Draft (CD) of Joint Video Specification (ITU-T Rec. H.264|ISO/IEC 14496-10 AVC)”, ITU-T JVT-C167, May, 2002, which is incorporated herein by reference). In the new revision, the motion vector parameters of the subsequent P picture are to be scaled equally for the Direct Mode prediction, without taking in account the reference picture information. This could lead to significant performance degradation of the Direct Mode, since the constant motion assumption is no longer followed.
Nevertheless, even if the temporal distance parameters were available, it is not always certain that the usage of the Direct Mode as defined previously is the most appropriate solution. In particular for the B pictures which are closer to a first forward reference picture, the correlation might be much stronger with that picture, than the subsequent reference picture. An extreme example which could contain such cases could be a sequence where scene A changes to scene B, and then moves back to scene A (e.g., as may happen in a news bulletin, etc.). All the above could deter the performance of B picture encoding considerably since Direct Mode will not be effectively exploited within the encoding process.
With these and other concerns in mind, unlike the previous definitions of the Direct Mode where only temporal prediction was used, in accordance with certain aspects of the present invention, a new Direct Macroblock type is introduced wherein both temporal prediction and/or spatial prediction is considered. The type(s) of prediction used can depend on the type of reference picture information of the first subsequent P reference picture, for example.
In accordance with certain other aspects of the present invention, one may also further considerably improve motion vector prediction for both P and B pictures when multiple picture references are used, by taking in consideration temporal distances, if such are available.
These enhancements are implemented in certain exemplary methods and apparatuses as described below. The methods and apparatuses can achieve significant bitrate reductions while achieving similar or better quality.
Direct Mode Enhancements:
In most conventional video coding systems, Direct Mode is designed as a bidirectional prediction scheme where motion parameters are always predicted in a temporal way from the motion parameters in the subsequent P images. In this section, an enhanced Direct Mode technique is provided in which spatial information may also/alternatively be considered for such predictions.
One or more of the following exemplary techniques may be implemented as needed, for example, depending on the complexity and/or specifications of the system.
One technique is to implement spatial prediction of the motion vector parameters of the Direct Mode without considering temporal prediction. Spatial prediction can be accomplished, for example, using existing Motion Vector prediction techniques used for motion vector encoding (such as, e.g., median prediction). If multiple picture references are used, then the reference picture of the adjacent blocks may also be considered (even though there is no such restriction and the same reference, e.g. 0, could always be used).
Motion parameters and reference pictures could be predicted as follows and with reference to FIG. 3, which illustrates spatial predication associated with portions A-E (e.g., macroblocks, slices, etc.) assumed to be available and part of a picture. Here, E is predicted in general from A, B, C as Median (A,B,C). If C is actually outside of the picture then D is used instead. If B, C, and D are outside of picture, then only A is used, where as if A does not exist, such is replaced with (0,0). Those skilled in the art will recognize that spatial prediction may be done at a subblock level as well.
In general spatial prediction can be seen as a linear or nonlinear function of all available motion information calculated within a picture or a group of macroblocks/blocks within the same picture.
There are various methods available that may be arranged to predict the reference picture for Direct Mode. For example, one method may be to select a minimum reference picture among the predictions. In another method, a median reference picture may be selected. In certain methods, a selection may be made between a minimum reference picture and median reference picture, e.g., if the minimum is zero. In still other implementations, a higher priority could also be given to either vertical or horizontal predictors (A and B) due to their possibly stronger correlation with E.
If one of the predictions does not exist (e.g., all surrounding macroblocks are predicted with the same direction FW or BW only or are intra), then the existing one is only used (single direction prediction) or such could be predicted from the one available. For example if forward prediction is available then:
MV bw = ( TR B - TR D ) · MV fw TR B
Temporal prediction is used for Macroblocks if the subsequent P reference is non intra as in existing codecs. Attention is now drawn to FIG. 8, in which MVFW and MVBW are derived from spatial prediction (Median MV of surrounding Macroblocks). If either one is not available (i.e., no predictors) then one-direction is used. If a subsequent P reference is intra, then spatial prediction can be used instead as described above. Assuming that no restrictions exist, if one of the predictions is not available then Direct Mode becomes a single direction prediction mode.
This could considerably benefit video coding when the scene changes, for example, as illustrated in FIG. 9, and/or even when fading exists within a video sequence. As illustrated in FIG. 9, spatial prediction may be used to solve the problem of a scene change.
If temporal distance information is not available within a codec, temporal prediction will not be as efficient in the direct mode for blocks when the collocated P reference block has a non-zero reference picture. In such a case, spatial prediction may also be used as above. As an alternative, one may estimate scaling parameters if one of the surrounding macroblocks also uses the same reference picture as the collocated P reference block. Furthermore, special handling may be provided for the case of zero motion (or close to zero motion) with a non-zero reference. Here, regardless of temporal distance forward and backward motion vectors could always be taken as zero. The best solution, however, may be to always examine the reference picture information of surrounding macroblocks and based thereon decide on how the direct mode should be handled in such a case.
More particularly, for example, given a non-zero reference, the following sub cases may be considered:
    • Case A: Temporal prediction is used if the motion vectors of the collocated P block are zero.
    • Case B: If all surrounding macroblocks use different reference pictures than the collocated P reference, then spatial prediction appears to be a better choice and temporal prediction is not used.
    • Case C: If motion flow inside the B picture appears to be quite different than the one in the P reference picture, then spatial prediction is used instead.
    • Case D: Spatial or temporal prediction of Direct Mode macroblocks could be signaled inside the image header. A pre-analysis of the image could be performed to decide which should be used.
    • Case E: Correction of the temporally predicted parameters based on spatial information (or vice versa). Thus, for example, if both appear to have the same or approximately the same phase information then the spatial information could be a very good candidate for the direct mode prediction. A correction could also be done on the phase, thus correcting the sub pixel accuracy of the prediction.
FIG. 10 illustrates a joint spatio-temporal prediction for Direct Mode in B picture coding. Here, in this example, Direct Mode can be a 1- to 4-direction mode depending on information available. Instead of using Bi-directional prediction for Direct Mode macroblocks, a multi-hypothesis extension of such mode can be done and multiple predictions used instead.
Combined with the discussion above, Direct Mode macroblocks can be predicted using from one up to four possible motion vectors depending on the information available. Such can be decided, for example, based on the mode of the collocated P reference image macroblock and on the surrounding macroblocks in the current B picture. In such a case, if the spatial prediction is too different than the temporal one, one of them could be selected as the only prediction in favor of the other. Since spatial prediction as described previously, might favor a different reference picture than the temporal one, the same macroblock might be predicted from more than 2 reference pictures.
The JVT standard does not restrict the first future reference to be a P picture. Hence, in such a standard, a picture can be a B as illustrated in FIG. 12, or even a Multi-Hypothesis (MH) picture. This implies that more motion vectors are assigned per macroblock. This means that one may also use this property to increase the efficiency of the Direct Mode by more effectively exploiting the additional motion information.
In FIG. 12, the first subsequent reference picture is a B picture (pictures B8 and B9). This enables one to use more candidates for Direct Mode prediction especially if bidirectional prediction is used within the B picture.
In particular one may perform the following:
    • a.) If the collocated reference block in the first future reference is using bidirectional prediction, the corresponding motion vectors (forward or backward) are used for calculating the motion vectors of the current block. Since the backward motion vector of the reference corresponds to a future reference picture, special care should be taken in the estimate of the current motion parameters. Attention is drawn, for example to FIG. 12 in which the first subsequent reference picture is a B picture (pictures B8 and B9). This enables one to use more candidates for Direct Mode prediction especially if bidirectional prediction is used within the B picture. Thus, as illustrated, the backward motion vector of B8 {right arrow over (MV)}B8bw can be calculated as 2×{right arrow over (MV)}B7bw due to the temporal distance between B8, B7 and P6. Similarly for B9 the backward motion vector can be taken as {right arrow over (MV)}B7bw, if though these refer to the B7. One may also restrict these to refer to the first subsequent P picture, in which case these motion vectors can be scaled accordingly. A similar conclusion can be deduced about the forward motion vectors. Multiple picture reference or intra macroblocks can be handled similar to the previous discussion.
    • b.) If bidirectional prediction for the collocated block is used, then, in this example, one may estimate four possible predictions for one macroblock for the direct mode case by projecting and inverting the backward and forward motion vectors of the reference.
    • c.) Selective projection and inversion may be used depending on temporal distance. According to this solution, one selects the motion vectors from the reference picture which are more reliable for the prediction. For example, considering the illustration in FIG. 12, one will note that B8 is much closer to P2 than P6. This implies that the backward motion vector of B7 may not be a very reliable prediction. In this case, direct mode motion vectors can therefore be calculated only from the forward prediction of B7. For B9, however, both motion vectors seem to be adequate enough for the prediction and therefore may be used. Such decisions/information may also be decided/supported within the header of the image. Other conditions and rules may also be implemented. For example, additional spatial confidence of a prediction and/or a motion vector phase may be considered. Note, in particular, that if the forward and backward motion vectors have no relationship, then the backward motion vector might be too unreliable to use.
Single Picture Reference for B Pictures:
A special case exists with the usage of only one picture reference for B pictures (although, typically a forward and a backward reference are necessary) regardless of how many reference pictures are used in P pictures. From observations of encoding sequences in the current JVT codec, for example, it was noted that, if one compares the single-picture reference versus the multi-picture reference case using B pictures, even though encoding performance of P pictures for the multi-picture case is almost always superior to that of the single-picture, the some is not always true for B pictures.
One reason for this observation is the overhead of the reference picture used for each macroblock. Considering that B pictures rely more on motion information than P pictures, the reference picture information overhead reduces the number of bits that are transmitted for the residue information at a given bitrate, which thereby reduces efficiency. A rather easy and efficient solution could be the selection of only one picture reference for either backward or forward motion compensation, thus not needing to transmit any reference picture information.
This is considered with reference to FIGS. 13 and 14. As illustrated in FIG. 13, B pictures can be restricted in using only one future and past reference pictures. Thus, for direct mode motion vector calculation, projection of the motion vectors is necessary. A projection of the collocated MVs to the current reference for temporal direct prediction is illustrated in FIG. 14 (note that it is possible that TDD,0>TDD,1). Thus, in this example, Direct Mode motion parameters are calculated by projecting motion vectors that refer to other reference pictures to the two reference pictures, or by using spatial prediction as in FIG. 13. Note that such options not only allow for possible reduced encoding complexity of B pictures, but also tend to reduce memory requirements since fewer B pictures (e.g., maximum two) are needed to be stored if B pictures are allowed to reference B pictures.
In certain cases a reference picture of the first future reference picture may no longer be available in the reference buffer. This could immediately generate a problem for the estimate of Direct Mode macroblocks and special handling of such cases is required. Obviously there is no such problem if a single picture reference is used. However, if multiple picture references are desired, then possible solutions include projecting the motion vector(s) to either the first forward reference picture, and/or to the reference picture that was closest to the non available picture. Either solution could be viable, whereas again spatial prediction could be an alternative solution.
Refinements of the Motion Vector Prediction for Single- and Multi-Picture Reference Motion Compensation
Motion vector prediction for multi-picture reference motion compensation can significantly affect the performance of both B and P picture coding. Existing standards, such as, for example, JVT, do not always consider the reference pictures of the macroblocks used in the prediction. The only consideration such standards do make is when only one of the prediction macroblocks uses the same reference. In such a case, only that predictor is used for the motion prediction. There is no consideration of the reference picture if only one or all predictors are using a different reference.
In such a case, for example, and in accordance with certain further aspects of the present invention, one can scale the predictors according to their temporal distance versus the current reference. Attention is drawn to FIG. 11, which illustrates Motion Vector prediction of a current block (C) considering the reference picture information of predictor macroblocks (Pr) and performance of proper adjustments (e.g., scaling of the predictors)
If predictors A, B, and C use reference pictures with temporal distance TRA, TRB, and TRC respectively, and the current reference picture has a temporal distance equal to TR, then the median predictor is calculated as follows:
MV pred - TR × Median ( MV A TR A , MV B TR B , MV C TR C )
If integer computation is to be used, it may be easier to place the multiplication inside the median, thus increasing accuracy. The division could also be replaced with shifting, but that reduces the performance, whereas it might be necessary to handle signed shifting as well (−1>>N=−1). It is thus very important in such cases to have the temporal distance information available for performing the appropriate scaling. Such could also be available within the header, if not predictable otherwise.
Motion Vector prediction as discussed previously is basically median biased, meaning that the median value among a set of predictors is selected for the prediction. If one only uses one type of macroblock (e.g., 16×16) with one Motion Vector (MV), then these predictors can be defined, for example, as illustrated in FIG. 15. Here, MV predictors are shown for one MV. In FIG. 15 a, the MB is not in the first row or the last column. In FIG. 15 b, the MB is in the last column. In FIG. 15 c, the MB is in the first row.
The JVT standard improves on this further by also considering the case that only one of the three predictors exists (i.e. Macroblocks are intra or are using a different reference picture in the case of multi-picture prediction). In such a case, only the existing or same reference predictor is used for the prediction and all others are not examined.
Intra coding does not always imply that a new object has appeared or that scene changes. It might instead, for example, be the case that motion estimation and compensation is inadequate to represent the current object (e.g., search range, motion estimation algorithm used, quantization of residue, etc) and that better results could be achieved through Intra Coding instead. The available motion predictors could still be adequate enough to provide a good motion vector predictor solution.
What is intriguing is the consideration of subblocks within a Macroblock, with each one being assigned different motion information. MPEG4 and H.263 standards, for example, can have up to four such subblocks (e.g., with size 8×8), where as the JVT standard allows up to sixteen subblocks while also being able to handle variable block sizes (e.g., 4×4, 4×8, 8×4, 8×8, 8×16, 16×8, and 16×16). In addition JVT also allows for 8×8 Intra subblocks, thus complicating things even 23 further.
Considering the common cases of JVT and MPEG-4/H.263 (8×8 and 16×16), the predictor set for a 16×16 macroblock is illustrated in FIGS. 16 a-c having a similar arrangement to FIGS. 15 a-c, respectively. Here, Motion Vector predictors are shown for one MV with 8×8 partitions. Even though the described predictors could give reasonable results in some cases, it appears that they may not adequately cover all possible predictions.
Attention is drawn next to FIGS. 17 a-c, which are also in a similar arrangement to FIGS. 15 a-c, respectively. Here, in FIGS. 17 a-c there are two additional predictors that could also be considered in the prediction phase (C1 and A2). If 4×4 blocks are also considered, this increases the possible predictors by four.
Instead of employing a median of the three predictors A, B, and C (or A1, B, and C2) one may now have some additional, and apparently more reliable, options. Thus, for example, one can observe that predictors A1, and C2 are essentially too close with one another and it may be the case that they may not be too representative in the prediction phase. Instead, selecting predictors A1, C1, and B seems to be a more reliable solution due to their separation. An alternative could also be the selection of A2 instead of A1 but that may again be too close to predictor B. Simulations suggest that the first case is usually a better choice. For the last column A2 could be used instead of A1. For the first row either one of A1 and A2 or even their average value could be used. Gain up to 1% was noted within JVT with this implementation.
The previous case adds some tests for the last column. By examining FIG. 7 b, for example, it is obvious that such tends to provide the best partitioning available. Thus, an optional solution could be the selection of A2, C1, and B (from the upper-left position). This may not always be recommended however, since such an implementation may adversely affect the performance of right predictors.
An alternative solution would be the usage of averages of predictors within a Macroblock. The median may then be performed as follows:
{right arrow over (MV)} pred=Median(Ave({right arrow over (MV)} C 1 , {right arrow over (MV)} C 2 ), Ave({right arrow over (MV)} A 1 , {right arrow over (MV)} A 2 ), {right arrow over (MV)} B)
For median row/column calculation, the median can be calculated as:
{right arrow over (MV)} pred=Median(Median({right arrow over (MV)} C 1 ,{right arrow over (MV)} C 2 , {right arrow over (MV)} D), . . . Median({right arrow over (MV)} D , {right arrow over (MV)} A 1 , {right arrow over (MV)} C 1 ), Median({right arrow over (MV)}B , {right arrow over (MV)} A 1 , {right arrow over (MV)} A 2 ))
Another possible solution is a Median5 solution. This is probably the most complicated solution due to computation (quick-sort or bubble-sort could for example be used), but could potentially yield the best results. If 4×4 blocks are considered, for example, then Median9 could also be used:
{right arrow over (MV)} pred=Median({right arrow over (MV)} C 1 , {right arrow over (MV)} C 2 , {right arrow over (MV)} D , {right arrow over (MV)} B , {right arrow over (MV)} A 1 , {right arrow over (MV)} A 2 )
Considering that JVT allows the existence of Intra subblocks within an Inter Macroblock (e.g., tree macroblock structure), such could also be taken in consideration within the Motion Prediction. If a subblock (e.g., from Macroblocks above or left only) to be used for the MV prediction is Intra, then the adjacent subblock may be used instead. Thus, if A1 is intra but A2 is not, then A1 can be replaced by A2 in the prediction. A further possibility is to replace one missing Intra Macroblock with the MV predictor from the upper-left position. In FIG. 17 a, for example, if C1 is missing then D may be used instead.
In the above sections, several improvements on B picture Direct Mode and on Motion Vector Prediction were presented. It was illustrated that spatial prediction can also be used for Direct Mode macroblocks; where as Motion Vector prediction should consider temporal distance and subblock information for more accurate prediction. Such considerations should significantly improve the performance of any applicable video coding system.
CONCLUSION
Although the description above uses language that is specific to structural features and/or methodological acts, it is to be understood that the invention defined in the appended claims is not limited to the specific features or acts described. Rather, the specific features and acts are disclosed as exemplary forms of implementing the invention.

Claims (39)

1. A method for use in encoding video data in a video encoder, the method comprising:
making a spatial/temporal motion vector prediction decision for at least one direct mode macroblock in a B-picture, wherein the spatial/temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock;
selectively encoding the at least one direct mode macroblock, wherein the encoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock; and
signaling spatial/temporal motion vector prediction decision information for the at least one direct mode macroblock in a header that includes header information for plural macroblocks in the B-picture, wherein the signaling of the spatial/temporal motion vector prediction decision information in the header communicates to a video decoder the spatial/temporal motion vector prediction decision for the at least one direct mode macroblock.
2. The method of claim 1 wherein the plural macroblocks in the B-picture are in a slice of the B-picture.
3. The method of claim 1 wherein the at least one direct mode macroblock comprises plural direct mode macroblocks.
4. The method of claim 3 wherein the plural direct mode macroblocks are 16×16 macroblocks.
5. The method of claim 4 wherein each of the 16×16 macroblocks includes four 8×8 sub-blocks.
6. The method of claim 1 wherein the surrounding portions are surrounding macroblocks.
7. The method of claim 1 wherein the spatial motion vector prediction comprises median motion vector prediction.
8. The method of claim 1 further comprising:
analyzing the B-picture, wherein the spatial/temporal motion vector prediction decision is based at least in part on the analysis.
9. The method of claim 1 further comprising:
analyzing motion flow within the B-picture, wherein the spatial/temporal motion vector prediction decision is based at least in part on the analysis.
10. The method of claim 1 further comprising:
analyzing whether collocated blocks of a subsequent picture have zero motion, the subsequent picture following the B-picture, wherein the spatial/temporal motion vector prediction decision is based at least in part on the analysis.
11. The method of claim 1 further comprising:
analyzing temporal distance between the B-picture and pictures around the B-picture, wherein the spatial/temporal motion vector prediction decision is based at least in part on the analysis.
12. The method of claim 1 further comprising:
identifying a scene change around the B-picture, wherein the spatial/temporal motion vector prediction decision is based at least in part on the identification of the scene change.
13. A method for use in decoding video data in a video decoder, the method comprising:
receiving signaled spatial/temporal motion vector prediction decision information for at least one direct mode macroblock in a header that includes header information for plural macroblocks in a B-picture;
from the signaled spatial/temporal motion vector prediction decision information in the header, determining a spatial/temporal motion vector prediction decision for the at least one direct mode macroblock, wherein the spatial or temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock; and
decoding the at least one direct mode macroblock, wherein the decoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock.
14. The method of claim 13 wherein the plural macroblocks in the B-picture are in a slice of the B-picture.
15. The method of claim 13 wherein the at least one direct mode macroblock comprises plural direct mode macroblocks.
16. The method of claim 15 wherein the plural direct mode macroblocks are 16×16 macroblocks.
17. The method of claim 16 wherein each of the 16×16 macroblocks includes four 8×8 sub-blocks.
18. The method of claim 13 wherein the surrounding portions are surrounding macroblocks.
19. The method of claim 13 further comprising:
displaying visual results of the decoding of the video data; and
reproducing audio data associated with the video data.
20. A video decoder implemented with a computing device, wherein the video decoder is adapted to perform a method comprising:
receiving signaled spatial/temporal motion vector prediction decision information for at least one direct mode macroblock in a header that includes header information for plural macroblocks in a B-picture;
from the signaled spatial/temporal motion vector prediction decision information in the header, determining a spatial/temporal motion vector prediction decision for the at least one direct mode macroblock, wherein the spatial or temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock; and
decoding the at least one direct mode macroblock, wherein the decoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock.
21. The video decoder of claim 20 wherein the plural macroblocks in the B-picture are in a slice of the B-picture.
22. The video decoder of claim 20 wherein the at least one direct mode macroblock comprises plural direct mode macroblocks.
23. The video decoder of claim 20 wherein the surrounding portions are surrounding macroblocks.
24. The video decoder of claim 20 wherein the computing device further includes an audio reproduction module for reproducing audio data.
25. The video decoder of claim 20 wherein the computing device is a hand-held device that includes a display, a network interface, one or more processors and memory.
26. The video decoder of claim 20 wherein the computing device is a portable communication device that includes a display, a network interface, one or more processors and memory.
27. The video decoder of claim 20 wherein the computing device is a set-top box that includes a network interface, one or more processors and memory.
28. One or more memory devices having stored thereon computer-executable instructions for causing a computing device programmed thereby to perform a method of decoding video data, the method comprising:
receiving signaled spatial/temporal motion vector prediction decision information for at least one direct mode macroblock in a header that includes header information for plural macroblocks in a B-picture;
from the signaled spatial/temporal motion vector prediction decision information in the header, determining a spatial/temporal motion vector prediction decision for the at least one direct mode macroblock, wherein the spatial or temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock; and
decoding the at least one direct mode macroblock, wherein the decoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock.
29. The one or more memory devices of claim 28 wherein the surrounding portions are surrounding macroblocks.
30. The one or more memory devices of claim 28 wherein the surrounding portions are surrounding macroblocks.
31. A portable communication device that includes a display, a network interface, one or more processors, memory, an audio reproduction module for reproducing audio, and a video decoder, wherein the video decoder is adapted to perform a method comprising:
receiving signaled spatial/temporal motion vector prediction decision information for at least one direct mode macroblock in a header that includes header information for plural macroblocks in a slice of a B-picture;
from the signaled spatial/temporal motion vector prediction decision information in the header, determining a spatial/temporal motion vector prediction decision for the at least one direct mode macroblock, wherein the spatial or temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock; and
decoding the at least one direct mode macroblock, wherein the decoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock.
32. A video encoder implemented with a computing device, wherein the video encoder is adapted to perform a method comprising:
analyzing one or more pictures of a video sequence;
based at least in part on results of the analyzing, making a spatial/temporal motion vector prediction decision for at least one direct mode macroblock in a B-picture among the one or more pictures of the video sequence, wherein the spatial/temporal motion vector prediction decision indicates use of spatial motion vector prediction for the at least one direct mode macroblock;
selectively encoding the at least one direct mode macroblock, wherein the encoding includes for a given direct mode macroblock of the at least one direct mode macroblock:
selecting a reference picture for the given direct mode macroblock from among reference pictures used for surrounding portions of the B-picture, wherein the selecting the reference picture for the given direct mode macroblock comprises selecting a minimum reference picture index for the given direct mode macroblock from among the reference picture indices used for the surrounding portions of the B-picture;
performing spatial motion vector prediction for the given direct mode macroblock; and
performing motion compensation for the given direct mode macroblock; and
signaling spatial/temporal motion vector prediction decision information for the at least one direct mode macroblock in a header that includes header information for plural macroblocks in the B-picture, wherein the signaling of the spatial/temporal motion vector prediction decision information in the header communicates to a video decoder the spatial/temporal motion vector prediction decision for the at least one direct mode macroblock.
33. The video encoder of claim 32 wherein the plural macroblocks in the B-picture are in a slice of the B-picture.
34. The video encoder of claim 32 wherein the surrounding portions are surrounding macroblocks.
35. The video encoder of claim 32 wherein the analyzing comprises analyzing the B-picture.
36. The video encoder of claim 32 wherein the analyzing comprises analyzing motion flow within the B-picture.
37. The video encoder of claim 32 wherein the analyzing comprises analyzing whether collocated blocks of a subsequent picture have zero motion, the subsequent picture following the B-picture.
38. The video encoder of claim 32 wherein the analyzing comprises analyzing temporal distance between the B-picture and pictures around the B-picture.
39. The video encoder of claim 32 wherein the analyzing comprises identifying a scene change around the B-picture.
US11/525,059 2002-06-03 2006-09-20 Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation Active 2027-07-02 US8374245B2 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
US11/525,059 US8374245B2 (en) 2002-06-03 2006-09-20 Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation
US13/760,486 US8873630B2 (en) 2002-06-03 2013-02-06 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/502,529 US9185427B2 (en) 2002-06-03 2014-09-30 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/875,164 US9571854B2 (en) 2002-06-03 2015-10-05 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US15/391,652 US10116959B2 (en) 2002-06-03 2016-12-27 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/146,133 US10694208B2 (en) 2002-06-03 2018-09-28 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/872,815 US11277636B2 (en) 2002-06-03 2020-05-12 Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US17/669,235 US11575934B2 (en) 2002-06-03 2022-02-10 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US38596502P 2002-06-03 2002-06-03
US10/444,511 US20040001546A1 (en) 2002-06-03 2003-05-23 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US11/525,059 US8374245B2 (en) 2002-06-03 2006-09-20 Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/444,511 Continuation US20040001546A1 (en) 2002-06-03 2003-05-23 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/760,486 Continuation US8873630B2 (en) 2002-06-03 2013-02-06 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Publications (2)

Publication Number Publication Date
US20070014358A1 US20070014358A1 (en) 2007-01-18
US8374245B2 true US8374245B2 (en) 2013-02-12

Family

ID=29550205

Family Applications (9)

Application Number Title Priority Date Filing Date
US10/444,511 Abandoned US20040001546A1 (en) 2002-06-03 2003-05-23 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US11/525,059 Active 2027-07-02 US8374245B2 (en) 2002-06-03 2006-09-20 Spatiotemporal prediction for bidirectionally predictive(B) pictures and motion vector prediction for multi-picture reference motion compensation
US13/760,486 Expired - Lifetime US8873630B2 (en) 2002-06-03 2013-02-06 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/502,529 Expired - Lifetime US9185427B2 (en) 2002-06-03 2014-09-30 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/875,164 Expired - Lifetime US9571854B2 (en) 2002-06-03 2015-10-05 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US15/391,652 Expired - Lifetime US10116959B2 (en) 2002-06-03 2016-12-27 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/146,133 Expired - Lifetime US10694208B2 (en) 2002-06-03 2018-09-28 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/872,815 Expired - Lifetime US11277636B2 (en) 2002-06-03 2020-05-12 Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US17/669,235 Expired - Lifetime US11575934B2 (en) 2002-06-03 2022-02-10 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US10/444,511 Abandoned US20040001546A1 (en) 2002-06-03 2003-05-23 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Family Applications After (7)

Application Number Title Priority Date Filing Date
US13/760,486 Expired - Lifetime US8873630B2 (en) 2002-06-03 2013-02-06 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/502,529 Expired - Lifetime US9185427B2 (en) 2002-06-03 2014-09-30 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US14/875,164 Expired - Lifetime US9571854B2 (en) 2002-06-03 2015-10-05 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US15/391,652 Expired - Lifetime US10116959B2 (en) 2002-06-03 2016-12-27 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/146,133 Expired - Lifetime US10694208B2 (en) 2002-06-03 2018-09-28 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US16/872,815 Expired - Lifetime US11277636B2 (en) 2002-06-03 2020-05-12 Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US17/669,235 Expired - Lifetime US11575934B2 (en) 2002-06-03 2022-02-10 Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Country Status (10)

Country Link
US (9) US20040001546A1 (en)
EP (1) EP1369820A3 (en)
JP (1) JP4733341B2 (en)
KR (1) KR100958499B1 (en)
CN (1) CN100455018C (en)
AU (1) AU2003204477B2 (en)
BR (1) BR0302164A (en)
CA (1) CA2430460C (en)
MX (1) MXPA03004906A (en)
RU (1) RU2310231C2 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130188713A1 (en) * 2007-06-15 2013-07-25 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20140016702A1 (en) * 2012-02-03 2014-01-16 Panasonic Corporation Image decoding method and image decoding apparatus
US20140270555A1 (en) * 2013-03-18 2014-09-18 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding an image by using an adaptive search range decision for motion estimation
US9392293B2 (en) * 2014-05-21 2016-07-12 Alcatel Lucent Accelerated image processing
US9445120B2 (en) 2011-04-12 2016-09-13 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US9456214B2 (en) 2011-08-03 2016-09-27 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9479777B2 (en) 2012-03-06 2016-10-25 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9485518B2 (en) 2011-05-27 2016-11-01 Sun Patent Trust Decoding method and apparatus with candidate motion vectors
US9591328B2 (en) 2012-01-20 2017-03-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US9609356B2 (en) 2011-05-31 2017-03-28 Sun Patent Trust Moving picture coding method and apparatus with candidate motion vectors
US9615107B2 (en) 2011-05-27 2017-04-04 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US9826249B2 (en) 2011-05-24 2017-11-21 Velos Media, Llc Decoding method and apparatuses with candidate motion vectors
US9900613B2 (en) 2011-05-31 2018-02-20 Sun Patent Trust Image coding and decoding system using candidate motion vectors
US10205962B2 (en) 2013-03-15 2019-02-12 Raymond Zenkich System and method for non-uniform video coding
US10887585B2 (en) 2011-06-30 2021-01-05 Sun Patent Trust Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus
US11218708B2 (en) 2011-10-19 2022-01-04 Sun Patent Trust Picture decoding method for decoding using a merging candidate selected from a first merging candidate derived using a first derivation process and a second merging candidate derived using a second derivation process
US20220167006A1 (en) * 2002-06-03 2022-05-26 Microsoft Technology Licensing, Llc Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US20220337816A1 (en) * 2007-06-15 2022-10-20 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium

Families Citing this family (132)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6957350B1 (en) 1996-01-30 2005-10-18 Dolby Laboratories Licensing Corporation Encrypted and watermarked temporal and resolution layering in advanced television
US8374237B2 (en) 2001-03-02 2013-02-12 Dolby Laboratories Licensing Corporation High precision encoding and decoding of video images
US8111754B1 (en) 2001-07-11 2012-02-07 Dolby Laboratories Licensing Corporation Interpolation of video compression frames
US7266150B2 (en) 2001-07-11 2007-09-04 Dolby Laboratories, Inc. Interpolation of video compression frames
US20030112863A1 (en) 2001-07-12 2003-06-19 Demos Gary A. Method and system for improving compressed image chroma information
JP4114859B2 (en) * 2002-01-09 2008-07-09 松下電器産業株式会社 Motion vector encoding method and motion vector decoding method
US7003035B2 (en) 2002-01-25 2006-02-21 Microsoft Corporation Video coding methods and apparatuses
JP2004023458A (en) * 2002-06-17 2004-01-22 Toshiba Corp Moving picture encoding/decoding method and apparatus
US7280700B2 (en) * 2002-07-05 2007-10-09 Microsoft Corporation Optimization techniques for data compression
CN100566420C (en) * 2002-07-15 2009-12-02 株式会社日立制作所 coding method of dynamic image
US7154952B2 (en) 2002-07-19 2006-12-26 Microsoft Corporation Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures
KR100506864B1 (en) * 2002-10-04 2005-08-05 엘지전자 주식회사 Method of determining motion vector
WO2004040915A1 (en) * 2002-11-01 2004-05-13 Matsushita Electric Industrial Co., Ltd. Motion picture encoding method and motion picture decoding method
JP4373702B2 (en) 2003-05-07 2009-11-25 株式会社エヌ・ティ・ティ・ドコモ Moving picture encoding apparatus, moving picture decoding apparatus, moving picture encoding method, moving picture decoding method, moving picture encoding program, and moving picture decoding program
US7609763B2 (en) * 2003-07-18 2009-10-27 Microsoft Corporation Advanced bi-directional predictive coding of video frames
US8064520B2 (en) 2003-09-07 2011-11-22 Microsoft Corporation Advanced bi-directional predictive coding of interlaced video
CN103826133B (en) 2004-05-04 2017-11-24 高通股份有限公司 Motion compensated frame rate up conversion method and apparatus
CA2572605C (en) 2004-07-01 2013-04-02 Qualcomm Incorporated Method and apparatus for using frame rate up conversion techniques in scalable video coding
KR20070044455A (en) 2004-07-20 2007-04-27 콸콤 인코포레이티드 Method and apparatus for encoder assisted-frame rate up conversion (ea-fruc) for video compression
KR20070040397A (en) * 2004-07-20 2007-04-16 퀄컴 인코포레이티드 Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes
US8553776B2 (en) 2004-07-21 2013-10-08 QUALCOMM Inorporated Method and apparatus for motion vector assignment
KR100584603B1 (en) * 2004-08-03 2006-05-30 학교법인 대양학원 Direct mode motion prediction method and apparatus for multi-view video
WO2006016783A1 (en) * 2004-08-13 2006-02-16 Industry Academic Cooperation Foundation Kyunghee University Method and device for motion estimation and compensation for panorama image
KR100694058B1 (en) 2004-09-30 2007-03-12 삼성전자주식회사 Method and apparatus for encoding and decoding in intra mode based on multi time scan
KR100694059B1 (en) * 2004-09-30 2007-03-12 삼성전자주식회사 Method and apparatus for encoding and decoding in inter mode based on multi time scan
US7751478B2 (en) * 2005-01-21 2010-07-06 Seiko Epson Corporation Prediction intra-mode selection in an encoder
KR100723403B1 (en) * 2005-02-28 2007-05-30 삼성전자주식회사 A prediction image generating method and apparatus using using single coding mode among color components, and an image and video encoding/decoding method and apparatus using it
US7830961B2 (en) * 2005-06-21 2010-11-09 Seiko Epson Corporation Motion estimation and inter-mode prediction
CN100473168C (en) * 2005-06-21 2009-03-25 中国科学院计算技术研究所 Motion vector space prediction method for video coding
CN101288315B (en) * 2005-07-25 2012-05-30 汤姆森特许公司 Method and apparatus for the concealment of missing video frames
KR100727969B1 (en) 2005-08-27 2007-06-14 삼성전자주식회사 Apparatus for encoding and decoding image, and method theroff, and a recording medium storing program to implement the method
US20070064809A1 (en) * 2005-09-14 2007-03-22 Tsuyoshi Watanabe Coding method for coding moving images
US7843995B2 (en) * 2005-12-19 2010-11-30 Seiko Epson Corporation Temporal and spatial analysis of a video macroblock
US8170102B2 (en) * 2005-12-19 2012-05-01 Seiko Epson Corporation Macroblock homogeneity analysis and inter mode prediction
US20070171977A1 (en) * 2006-01-25 2007-07-26 Shintaro Kudo Moving picture coding method and moving picture coding device
JP4527677B2 (en) * 2006-03-15 2010-08-18 富士通株式会社 Moving picture coding method, moving picture coding apparatus, moving picture coding program
US8750387B2 (en) 2006-04-04 2014-06-10 Qualcomm Incorporated Adaptive encoder-assisted frame rate up conversion
US8634463B2 (en) 2006-04-04 2014-01-21 Qualcomm Incorporated Apparatus and method of enhanced frame interpolation in video compression
CN101422047B (en) * 2006-04-14 2011-01-12 Nxp股份有限公司 Motion estimation at image borders and display device
US8009732B2 (en) * 2006-09-01 2011-08-30 Seiko Epson Corporation In-loop noise reduction within an encoder framework
KR101365574B1 (en) * 2007-01-29 2014-02-20 삼성전자주식회사 Method and apparatus for video encoding, and Method and apparatus for video decoding
US9031129B2 (en) * 2007-06-15 2015-05-12 Microsoft Technology Licensing, Llc Joint spatio-temporal prediction for video coding
US8254455B2 (en) * 2007-06-30 2012-08-28 Microsoft Corporation Computing collocated macroblock information for direct mode macroblocks
KR101396365B1 (en) 2007-08-28 2014-05-30 삼성전자주식회사 Method and apparatus for spatiotemporal motion estimation and motion compensation of video
FR2923125B1 (en) * 2007-10-29 2010-10-22 Assistance Tech Et Etude De Ma METHOD AND SYSTEM FOR ESTIMATING FUTURE MOVEMENT OF IMAGE ELEMENTS FROM MOVEMENT IN VIDEO ENCODER
US8687693B2 (en) 2007-11-30 2014-04-01 Dolby Laboratories Licensing Corporation Temporal image prediction
KR100939917B1 (en) * 2008-03-07 2010-02-03 에스케이 텔레콤주식회사 Encoding system using motion estimation and encoding method using motion estimation
EP2266318B1 (en) 2008-03-19 2020-04-22 Nokia Technologies Oy Combined motion vector and reference index prediction for video coding
KR101691199B1 (en) * 2008-04-11 2016-12-30 톰슨 라이센싱 Method and apparatus for template matching prediction(tmp) in video encoding and decoding
WO2010017166A2 (en) 2008-08-04 2010-02-11 Dolby Laboratories Licensing Corporation Overlapped block disparity estimation and compensation architecture
US8189666B2 (en) 2009-02-02 2012-05-29 Microsoft Corporation Local picture identifier and computation of co-located information
US9060176B2 (en) * 2009-10-01 2015-06-16 Ntt Docomo, Inc. Motion vector prediction in video coding
JP2011091696A (en) * 2009-10-23 2011-05-06 Victor Co Of Japan Ltd Motion vector predicting method
US9036692B2 (en) 2010-01-18 2015-05-19 Mediatek Inc. Motion prediction method
CN104967857B (en) 2010-01-19 2019-08-23 三星电子株式会社 The method and apparatus that image is encoded/decoded
MY184904A (en) * 2010-01-19 2021-04-30 Samsung Electronics Co Ltd Method and apparatus for encoding/decoding images using a motion vector of a previous block as a motion vector for the current block
JP5649701B2 (en) * 2010-04-08 2015-01-07 株式会社東芝 Image decoding method, apparatus, and program
JP5367161B2 (en) * 2010-04-08 2013-12-11 株式会社東芝 Image encoding method, apparatus, and program
WO2011125211A1 (en) * 2010-04-08 2011-10-13 株式会社 東芝 Image encoding method and image decoding method
CN103227922B (en) * 2010-04-08 2016-06-01 株式会社东芝 Picture decoding method and picture decoding apparatus
EP2375751A1 (en) * 2010-04-12 2011-10-12 Panasonic Corporation Complexity reduction of edge-detection based spatial interpolation
BR112012025407B1 (en) * 2010-04-13 2022-03-22 Samsung Electronics Co, Ltd Video decoding method based on encoding units determined according to a tree structure
WO2011128259A1 (en) * 2010-04-13 2011-10-20 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. A video decoder and a video encoder using motion-compensated prediction
US8837592B2 (en) * 2010-04-14 2014-09-16 Mediatek Inc. Method for performing local motion vector derivation during video coding of a coding unit, and associated apparatus
JP5625512B2 (en) * 2010-06-09 2014-11-19 ソニー株式会社 Encoding device, encoding method, program, and recording medium
TWI426785B (en) * 2010-09-17 2014-02-11 Univ Nat Cheng Kung Method of frame error concealment in scable video decoding
US20120082228A1 (en) * 2010-10-01 2012-04-05 Yeping Su Nested entropy encoding
US10104391B2 (en) 2010-10-01 2018-10-16 Dolby International Ab System for nested entropy encoding
KR102277273B1 (en) * 2010-10-08 2021-07-15 지이 비디오 컴프레션, 엘엘씨 Picture coding supporting block partitioning and block merging
AR083954A1 (en) * 2010-11-24 2013-04-10 Panasonic Corp METHOD FOR CALCULATING MOTION VECTORS, METHOD FOR CODING IMAGES, METHOD FOR DECODING IMAGES AND APPLIANCE AND CALCULATING SYSTEM FOR MOTION VECTOR
PT2938082T (en) * 2011-01-07 2017-04-07 Ntt Docomo Inc Predictive encoding method, predictive encoding device, and predictive encoding program of motion vector, and predictive decoding method, predictive decoding device, and predictive decoding program of motion vector
US9319716B2 (en) * 2011-01-27 2016-04-19 Qualcomm Incorporated Performing motion vector prediction for video coding
CN107197300B (en) 2011-02-09 2020-03-06 Lg 电子株式会社 Method of encoding and decoding image and apparatus using the same
JP5747559B2 (en) * 2011-03-01 2015-07-15 富士通株式会社 Moving picture decoding method, moving picture encoding method, moving picture decoding apparatus, and moving picture decoding program
GB2501835B (en) * 2011-03-09 2014-09-03 Canon Kk Video encoding and decoding
AU2014210569B2 (en) * 2011-06-15 2015-10-01 Fujitsu Limited Video decoding apparatus, video coding apparatus, video decoding method, video coding method, and storage medium
JP5786478B2 (en) 2011-06-15 2015-09-30 富士通株式会社 Moving picture decoding apparatus, moving picture decoding method, and moving picture decoding program
TWI803915B (en) * 2011-06-27 2023-06-01 南韓商三星電子股份有限公司 Method of decoding motion vector, method of encoding motion vector and non-transitory computer-readable medium for recording bitstream
KR20140034292A (en) * 2011-07-01 2014-03-19 모토로라 모빌리티 엘엘씨 Motion vector prediction design simplification
GB2493755B (en) * 2011-08-17 2016-10-19 Canon Kk Method and device for encoding a sequence of images and method and device for decoding a sequence of images
US20130070855A1 (en) * 2011-09-17 2013-03-21 Qualcomm Incorporated Hybrid motion vector coding modes for video coding
US9106927B2 (en) 2011-09-23 2015-08-11 Qualcomm Incorporated Video coding with subsets of a reference picture set
CN107105279B (en) * 2011-09-23 2020-03-06 株式会社Kt Method for guiding merging candidate blocks and apparatus using the same
CN103999468A (en) * 2011-10-21 2014-08-20 诺基亚公司 Method for video coding and an apparatus
US9264717B2 (en) * 2011-10-31 2016-02-16 Qualcomm Incorporated Random access with advanced decoded picture buffer (DPB) management in video coding
CN104041041B (en) 2011-11-04 2017-09-01 谷歌技术控股有限责任公司 Motion vector scaling for the vectorial grid of nonuniform motion
US20130114717A1 (en) * 2011-11-07 2013-05-09 Qualcomm Incorporated Generating additional merge candidates
JP5969041B2 (en) * 2011-11-08 2016-08-10 エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute Candidate list sharing method and apparatus using such method
WO2013109124A1 (en) 2012-01-19 2013-07-25 삼성전자 주식회사 Method and device for encoding video to limit bidirectional prediction and block merging, and method and device for decoding video
HUE062452T2 (en) * 2012-04-12 2023-11-28 Jvckenwood Corp Merge candidate list construction
US11317101B2 (en) 2012-06-12 2022-04-26 Google Inc. Inter frame candidate selection for a video encoder
US9503746B2 (en) 2012-10-08 2016-11-22 Google Inc. Determine reference motion vectors
US9485515B2 (en) 2013-08-23 2016-11-01 Google Inc. Video coding using reference motion vectors
US9942063B2 (en) 2012-10-26 2018-04-10 Altera Corporation Apparatus for improved encoding and associated methods
US9490836B2 (en) * 2012-10-26 2016-11-08 Altera Corporation Apparatus for improved encoding and associated methods
CN104885470B (en) 2013-01-30 2018-08-07 英特尔公司 It is divided for the prediction of next-generation video and the content-adaptive of coding
FR3002716A1 (en) 2013-02-26 2014-08-29 France Telecom DERIVATION OF MOTION VECTOR OF DISPARITY, 3D VIDEO CODING AND DECODING USING SUCH DERIVATION
WO2014166116A1 (en) * 2013-04-12 2014-10-16 Mediatek Inc. Direct simplified depth coding
CN105594214B (en) * 2013-04-12 2019-11-26 联发科技股份有限公司 The inner frame coding method and device of depth block in 3-dimensional encoding system
US10003792B2 (en) 2013-05-27 2018-06-19 Microsoft Technology Licensing, Llc Video encoder for images
JP5571229B2 (en) * 2013-06-03 2014-08-13 株式会社東芝 Image encoding method and image decoding method
JP5444497B2 (en) * 2013-09-11 2014-03-19 株式会社東芝 Image encoding method and image decoding method
JP5479648B1 (en) * 2013-12-10 2014-04-23 株式会社東芝 Image encoding method and image decoding method
KR101789954B1 (en) * 2013-12-27 2017-10-25 인텔 코포레이션 Content adaptive gain compensated prediction for next generation video coding
JP5509398B1 (en) * 2014-01-23 2014-06-04 株式会社東芝 Image encoding method and image decoding method
JP5571262B2 (en) * 2014-01-23 2014-08-13 株式会社東芝 Image encoding method and image decoding method
JP2014131293A (en) * 2014-01-23 2014-07-10 Toshiba Corp Image encoding method and image decoding method
JP2014131295A (en) * 2014-01-23 2014-07-10 Toshiba Corp Image encoding method and image decoding method
CN105359531B (en) * 2014-03-17 2019-08-06 微软技术许可有限责任公司 Method and system for determining for the coder side of screen content coding
JP5659314B1 (en) * 2014-10-01 2015-01-28 株式会社東芝 Image encoding method and image decoding method
JP2015053729A (en) * 2014-11-17 2015-03-19 株式会社東芝 Image encoding method, and image decoding method
CN106416254B (en) 2015-02-06 2019-08-02 微软技术许可有限责任公司 Evaluation stage is skipped during media coding
US10958927B2 (en) 2015-03-27 2021-03-23 Qualcomm Incorporated Motion information derivation mode determination in video coding
US10038917B2 (en) 2015-06-12 2018-07-31 Microsoft Technology Licensing, Llc Search strategies for intra-picture prediction modes
US10136132B2 (en) 2015-07-21 2018-11-20 Microsoft Technology Licensing, Llc Adaptive skip or zero block detection combined with transform size decision
JP6196341B2 (en) * 2016-02-17 2017-09-13 株式会社東芝 Image encoding method and image decoding method
WO2017188566A1 (en) * 2016-04-25 2017-11-02 엘지전자 주식회사 Inter-prediction method and apparatus in image coding system
US10762135B2 (en) * 2016-11-21 2020-09-01 Adobe Inc. Recommending software actions to create an image and recommending images to demonstrate the effects of software actions
JP6271694B2 (en) * 2016-12-16 2018-01-31 株式会社東芝 Image encoding method and image decoding method
JP6370977B2 (en) * 2017-08-31 2018-08-08 株式会社東芝 Image encoding method and image decoding method
JP6608904B2 (en) * 2017-12-05 2019-11-20 株式会社東芝 Video encoding apparatus and method
WO2019152283A1 (en) * 2018-02-02 2019-08-08 Apple Inc. Techniques of multi-hypothesis motion compensation
JP6609004B2 (en) * 2018-07-02 2019-11-20 株式会社東芝 Image encoding method and image decoding method
US11665365B2 (en) * 2018-09-14 2023-05-30 Google Llc Motion prediction coding with coframe motion vectors
CN113056920A (en) 2018-11-22 2021-06-29 北京字节跳动网络技术有限公司 Inter-frame prediction coordination method based on sub-blocks
CN114128292A (en) * 2019-07-01 2022-03-01 三星电子株式会社 Apparatus and method for encoding and decoding motion information using neighboring motion information
CN114208184A (en) 2019-08-13 2022-03-18 北京字节跳动网络技术有限公司 Motion accuracy in sub-block based inter prediction
CN114424553A (en) 2019-09-22 2022-04-29 北京字节跳动网络技术有限公司 Inter-frame prediction scaling method based on sub-blocks
JP6980889B2 (en) * 2019-10-21 2021-12-15 株式会社東芝 Image coding method and image decoding method
JP6961781B2 (en) * 2019-10-21 2021-11-05 株式会社東芝 Image coding method and image decoding method
JP7242811B2 (en) 2019-10-21 2023-03-20 株式会社東芝 Image encoding method and image decoding method
JP6795666B2 (en) * 2019-10-21 2020-12-02 株式会社東芝 Image coding method and image decoding method

Citations (222)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4454546A (en) 1980-03-13 1984-06-12 Fuji Photo Film Co., Ltd. Band compression device for shaded image
US4661853A (en) 1985-11-01 1987-04-28 Rca Corporation Interfield image motion detector for video signals
US4661849A (en) 1985-06-03 1987-04-28 Pictel Corporation Method and apparatus for providing motion estimation signals for communicating image sequences
US4695882A (en) 1984-01-30 1987-09-22 Kokusai Denshin Denwa Co., Ltd. Movement estimation system for video signals using a recursive gradient method
US4796087A (en) 1986-05-29 1989-01-03 Jacques Guichard Process for coding by transformation for the transmission of picture signals
US4849812A (en) 1987-03-10 1989-07-18 U.S. Philips Corporation Television system in which digitized picture signals subjected to a transform coding are transmitted from an encoding station to a decoding station
US4862267A (en) 1987-06-09 1989-08-29 Sony Corp. Motion compensated interpolation of digital television images
US4864393A (en) 1987-06-09 1989-09-05 Sony Corp. Motion vector estimation in television images
EP0279053B1 (en) 1987-02-16 1991-04-10 ANT Nachrichtentechnik GmbH Method for the transmission and reproduction of sequences of television pictures
US5021879A (en) 1987-05-06 1991-06-04 U.S. Philips Corporation System for transmitting video pictures
US5068724A (en) 1990-06-15 1991-11-26 General Instrument Corporation Adaptive motion compensation for digital television
US5089889A (en) 1989-04-28 1992-02-18 Victor Company Of Japan, Ltd. Apparatus for inter-frame predictive encoding of video signal
US5089887A (en) 1988-09-23 1992-02-18 Thomson Consumer Electronics Method and device for the estimation of motion in a sequence of moving images
US5091782A (en) 1990-04-09 1992-02-25 General Instrument Corporation Apparatus and method for adaptively compressing successive blocks of digital video
US5103306A (en) 1990-03-28 1992-04-07 Transitions Research Corporation Digital image compression employing a resolution gradient
US5111292A (en) 1991-02-27 1992-05-05 General Electric Company Priority selection apparatus as for a video signal processor
US5117287A (en) 1990-03-02 1992-05-26 Kokusai Denshin Denwa Co., Ltd. Hybrid coding system for moving image
US5132792A (en) 1989-10-14 1992-07-21 Sony Corporation Video signal transmitting system
US5157490A (en) 1990-03-14 1992-10-20 Kabushiki Kaisha Toshiba Television signal scanning line converting apparatus
US5175618A (en) 1990-10-31 1992-12-29 Victor Company Of Japan, Ltd. Compression method for interlace moving image signals
US5185819A (en) 1991-04-29 1993-02-09 General Electric Company Video signal compression apparatus for independently compressing odd and even fields
US5193004A (en) 1990-12-03 1993-03-09 The Trustees Of Columbia University In The City Of New York Systems and methods for coding even fields of interlaced video sequences
US5223949A (en) 1991-04-18 1993-06-29 Matsushita Electric Industrial Co., Ltd. Coding means for a signal processing system
US5227878A (en) 1991-11-15 1993-07-13 At&T Bell Laboratories Adaptive coding and decoding of frames and fields of video
US5235618A (en) 1989-11-06 1993-08-10 Fujitsu Limited Video signal coding apparatus, coding method used in the video signal coding apparatus and video signal coding transmission system having the video signal coding apparatus
US5260782A (en) 1991-08-30 1993-11-09 Matsushita Electric Industrial Co., Ltd. Adaptive DCT/DPCM video signal coding method
US5287420A (en) 1992-04-08 1994-02-15 Supermac Technology Method for image compression on a personal computer
US5298991A (en) 1991-08-03 1994-03-29 Sony Corporation Variable length coding apparatus and method for motion vector
US5317397A (en) 1991-05-31 1994-05-31 Kabushiki Kaisha Toshiba Predictive coding using spatial-temporal filtering and plural motion vectors
US5343248A (en) 1991-07-26 1994-08-30 Sony Corporation Moving image compressing and recording medium and moving image data encoder and decoder
US5347308A (en) 1991-10-11 1994-09-13 Matsushita Electric Industrial Co., Ltd. Adaptive coding method for interlaced scan digital video sequences
US5400075A (en) 1993-01-13 1995-03-21 Thomson Consumer Electronics, Inc. Adaptive variable length encoder/decoder
US5412435A (en) 1992-07-03 1995-05-02 Kokusai Denshin Denwa Kabushiki Kaisha Interlaced video signal motion compensation prediction system
US5412430A (en) 1991-07-31 1995-05-02 Matsushita Electric Industrial Co. Ltd. Image coding method and image coding apparatus
USRE34965E (en) 1989-01-20 1995-06-13 Victor Company Of Japan Limited Inter-frame predictive encoding system with encoded and transmitted prediction error
US5428396A (en) 1991-08-03 1995-06-27 Sony Corporation Variable length coding/decoding method for motion vectors
US5442400A (en) 1993-04-29 1995-08-15 Rca Thomson Licensing Corporation Error concealment apparatus for MPEG-like video data
US5448297A (en) 1993-06-16 1995-09-05 Intel Corporation Method and system for encoding images using skip blocks
US5453799A (en) 1993-11-05 1995-09-26 Comsat Corporation Unified motion estimation architecture
US5461421A (en) 1992-11-30 1995-10-24 Samsung Electronics Co., Ltd. Encoding and decoding method and apparatus thereof
US5467086A (en) 1992-06-18 1995-11-14 Samsung Electronics Co., Ltd. Apparatus and method of coding/decoding video data
US5467134A (en) 1992-12-22 1995-11-14 Microsoft Corporation Method and system for compressing video data
US5467136A (en) 1991-05-31 1995-11-14 Kabushiki Kaisha Toshiba Video decoder for determining a motion vector from a scaled vector and a difference vector
USRE35093E (en) 1990-12-03 1995-11-21 The Trustees Of Columbia University In The City Of New York Systems and methods for coding even fields of interlaced video sequences
US5477272A (en) 1993-07-22 1995-12-19 Gte Laboratories Incorporated Variable-block size multi-resolution motion estimation scheme for pyramid coding
USRE35158E (en) 1989-04-27 1996-02-20 Victor Company Of Japan Limited Apparatus for adaptive inter-frame predictive encoding of video signal
US5510840A (en) 1991-12-27 1996-04-23 Sony Corporation Methods and devices for encoding and decoding frame signals and recording medium therefor
EP0397402B1 (en) 1989-05-11 1996-07-10 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding- and decoding apparatus
US5539466A (en) 1991-07-30 1996-07-23 Sony Corporation Efficient coding apparatus for picture signal and decoding apparatus therefor
US5565922A (en) 1994-04-11 1996-10-15 General Instrument Corporation Of Delaware Motion compensation for interlaced digital video signals
US5594504A (en) 1994-07-06 1997-01-14 Lucent Technologies Inc. Predictive video coding using a motion vector updating routine
US5598216A (en) 1995-03-20 1997-01-28 Daewoo Electronics Co., Ltd Method and apparatus for encoding/decoding a video signal
US5598215A (en) 1993-05-21 1997-01-28 Nippon Telegraph And Telephone Corporation Moving image encoder and decoder using contour extraction
EP0535746B1 (en) 1991-09-30 1997-01-29 Philips Electronics Uk Limited Motion vector estimation, motion picture encoding and storage
US5617144A (en) 1995-03-20 1997-04-01 Daewoo Electronics Co., Ltd. Image processing system using pixel-by-pixel motion estimation and frame decimation
US5619281A (en) 1994-12-30 1997-04-08 Daewoo Electronics Co., Ltd Method and apparatus for detecting motion vectors in a frame decimating video encoder
US5621481A (en) 1993-04-08 1997-04-15 Sony Corporation Motion vector detecting apparatus for determining interframe, predictive error as a function of interfield predictive errors
US5623311A (en) 1994-10-28 1997-04-22 Matsushita Electric Corporation Of America MPEG video decoder having a high bandwidth memory
EP0771114A2 (en) 1995-10-26 1997-05-02 Hyundai Electronics Industries Co., Ltd. Method of generating object-adaptive code block patterns
US5648819A (en) 1994-03-30 1997-07-15 U.S. Philips Corporation Motion estimation using half-pixel refinement of frame and field vectors
EP0786907A2 (en) 1997-01-24 1997-07-30 Texas Instruments Incorporated Video encoder
US5666461A (en) 1992-06-29 1997-09-09 Sony Corporation High efficiency encoding and decoding of picture signals and recording medium containing same
US5677735A (en) 1992-03-03 1997-10-14 Kabushiki Kaisha Toshiba Motion picture coding apparatus
US5687097A (en) 1995-07-13 1997-11-11 Zapex Technologies, Inc. Method and apparatus for efficiently determining a frame motion vector in a video encoder
US5691771A (en) 1994-12-29 1997-11-25 Sony Corporation Processing of redundant fields in a moving picture to achieve synchronized system operation
US5699476A (en) 1990-02-22 1997-12-16 U.S. Philips Corporation Method and apparatus for transmitting and/or storing a series of hierarchically encoded digital image data blocks
US5701164A (en) 1993-03-24 1997-12-23 Sony Corporation Macroblock coding including difference between motion vectors
US5717441A (en) 1995-05-02 1998-02-10 Matsushita Electric Ind. Picture data memory with high access efficiency in detecting motion vectors, a motion vector detection circuit provided with the picture data memory, and an address conversion circuit
US5731850A (en) 1995-06-07 1998-03-24 Maturi; Gregory V. Hybrid hierarchial/full-search MPEG encoder motion estimation
US5734755A (en) 1994-03-11 1998-03-31 The Trustees Of Columbia University In The City Of New York JPEG/MPEG decoder-compatible optimized thresholding for image and video signal compression
US5748784A (en) 1991-11-08 1998-05-05 Victor Company Of Japan, Ltd. Moving image signal coding apparatus and coded signal decoding apparatus
US5767898A (en) 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
EP0540350B1 (en) 1991-10-31 1998-07-22 Sony Corporation Method and apparatus for variable length coding
US5787203A (en) 1996-01-19 1998-07-28 Microsoft Corporation Method and system for filtering compressed video images
US5786860A (en) 1994-07-30 1998-07-28 Korean Advanced Institute Of Science And Technology High speed block matching for bi-directional motion vector estimation
US5796438A (en) 1994-07-05 1998-08-18 Sony Corporation Methods and apparatus for interpolating picture information
US5798788A (en) 1996-02-01 1998-08-25 David Sarnoff Research Center, Inc. Method and apparatus for evaluating field display functionality of a video decoder
USRE35910E (en) 1989-05-11 1998-09-29 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding apparatus and decoding apparatus
US5822541A (en) 1995-10-09 1998-10-13 Hitachi, Ltd. Compressed video data amount reducing device, compressed video data amount reducing system and compressed video data amount reducing method
US5835144A (en) 1994-10-13 1998-11-10 Oki Electric Industry Co., Ltd. Methods of coding and decoding moving-picture signals, using self-resynchronizing variable-length codes
US5844613A (en) 1997-03-17 1998-12-01 Microsoft Corporation Global motion estimator for motion video signal encoding
US5847776A (en) 1996-06-24 1998-12-08 Vdonet Corporation Ltd. Method for entropy constrained motion estimation and coding of motion vectors with increased search range
GB2328337A (en) 1997-08-12 1999-02-17 Daewoo Electronics Co Ltd Encoding motion vectors
US5874995A (en) 1994-10-28 1999-02-23 Matsuhita Electric Corporation Of America MPEG video decoder having a high bandwidth memory for use in decoding interlaced and progressive signals
US5901248A (en) 1992-02-19 1999-05-04 8X8, Inc. Programmable architecture and methods for motion estimation
US5923375A (en) 1996-02-27 1999-07-13 Sgs-Thomson Microelectronics S.R.L. Memory reduction in the MPEG-2 main profile main level decoder
US5926573A (en) 1996-01-29 1999-07-20 Matsushita Electric Corporation Of America MPEG bit-stream format converter for changing resolution
US5929940A (en) 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US5949489A (en) 1991-10-22 1999-09-07 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US5959673A (en) 1995-10-05 1999-09-28 Microsoft Corporation Transform coding of dense motion vector fields for frame and object based video coding applications
US5963673A (en) 1995-12-20 1999-10-05 Sanyo Electric Co., Ltd. Method and apparatus for adaptively selecting a coding mode for video encoding
US5973743A (en) 1997-12-02 1999-10-26 Daewoo Electronics Co., Ltd. Mode coding method and apparatus for use in an interlaced shape coder
US5973755A (en) 1997-04-04 1999-10-26 Microsoft Corporation Video encoder and decoder using bilinear motion compensation and lapped orthogonal transforms
US5982438A (en) 1996-03-22 1999-11-09 Microsoft Corporation Overlapped motion compensation for object coding
US5991447A (en) 1997-03-07 1999-11-23 General Instrument Corporation Prediction and coding of bi-directionally predicted video object planes for interlaced digital video
EP0614318B1 (en) 1993-03-04 1999-12-01 Kabushiki Kaisha Toshiba Video encoder and decoder
US6005980A (en) 1997-03-07 1999-12-21 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
EP0588653B1 (en) 1992-09-16 1999-12-22 Fujitsu Limited Image data coding and restoring method and apparatus for restoring the same
GB2332115B (en) 1997-12-01 1999-12-29 Samsung Electronics Co Ltd Motion vector prediction method
US6011596A (en) 1991-05-24 2000-01-04 British Broadcasting Video image motion compensation using an algorithm involving at least two fields
USRE36507E (en) 1992-03-27 2000-01-18 Matsushita Electric Corporation Of America Apparatus and method for processing groups of fields in a video data compression system to encode a single frame as an I-field and a P-field
JP3001688B2 (en) 1991-08-05 2000-01-24 株式会社大一商会 Pachinko ball circulation controller
US6055012A (en) 1995-12-29 2000-04-25 Lucent Technologies Inc. Digital multi-view video compression with complexity and compatibility constraints
GB2343579A (en) 1998-11-07 2000-05-10 Ibm Hybrid-linear-bicubic interpolation method and apparatus
US6067322A (en) 1997-06-04 2000-05-23 Microsoft Corporation Half pixel motion estimation in motion video signal encoding
US6081209A (en) 1998-11-12 2000-06-27 Hewlett-Packard Company Search system for use in compression
US6094225A (en) 1997-12-02 2000-07-25 Daewoo Electronics, Co., Ltd. Method and apparatus for encoding mode signals for use in a binary shape coder
US6130963A (en) 1996-11-22 2000-10-10 C-Cube Semiconductor Ii, Inc. Memory efficient decoding of video frame chroma
JP2000308064A (en) 1999-04-22 2000-11-02 Mitsubishi Electric Corp Motion vector detecting device
JP2000307672A (en) 1999-04-26 2000-11-02 Oki Electric Ind Co Ltd Encoded information receiving and decoding device
US6154495A (en) 1995-09-29 2000-11-28 Kabushiki Kaisha Toshiba Video coding and video decoding apparatus for changing a resolution conversion according to a reduction ratio setting information signal
EP0782343A3 (en) 1995-12-27 2000-12-20 Matsushita Electric Industrial Co., Ltd. Video coding method
US6167090A (en) 1996-12-26 2000-12-26 Nippon Steel Corporation Motion vector detecting apparatus
US6175592B1 (en) 1997-03-12 2001-01-16 Matsushita Electric Industrial Co., Ltd. Frequency domain filtering for down conversion of a DCT encoded picture
JP2001025014A (en) 1999-05-24 2001-01-26 Agilent Technol Inc Method and device for decoding compressed multi-media communication and evaluating quality of multi-media communication
US6188725B1 (en) 1997-05-30 2001-02-13 Victor Company Of Japan, Ltd. Interlaced video signal encoding and decoding method, by conversion of selected fields to progressive scan frames which function as reference frames for predictive encoding
US6192081B1 (en) 1995-10-26 2001-02-20 Sarnoff Corporation Apparatus and method for selecting a coding mode in a block-based coding system
US6201927B1 (en) 1997-02-18 2001-03-13 Mary Lafuze Comer Trick play reproduction of MPEG encoded signals
US6205176B1 (en) 1997-07-28 2001-03-20 Victor Company Of Japan, Ltd. Motion-compensated coder with motion vector accuracy controlled, a decoder, a method of motion-compensated coding, and a method of decoding
US6205177B1 (en) 1997-09-12 2001-03-20 Netergu Networks Video coder/decoder
US6243418B1 (en) 1998-03-30 2001-06-05 Daewoo Electronics Co., Ltd. Method and apparatus for encoding a motion vector of a binary shape signal
US6263024B1 (en) 1996-12-12 2001-07-17 Matsushita Electric Industrial Co., Ltd. Picture encoder and picture decoder
US6263065B1 (en) 1997-03-18 2001-07-17 At&T Corp. Method and apparatus for simulating central queue for distributing call in distributed arrangement of automatic call distributors
EP0944245B1 (en) 1998-03-20 2001-07-25 SGS-THOMSON MICROELECTRONICS S.r.l. Hierarchical recursive motion estimator for video images encoder
US6269121B1 (en) 1997-08-13 2001-07-31 Daewoo Electronics Co., Ltd. Adaptive motion estimation method and apparatus
US6271885B2 (en) 1998-06-24 2001-08-07 Victor Company Of Japan, Ltd. Apparatus and method of motion-compensated predictive coding
US6282243B1 (en) 1997-06-11 2001-08-28 Fujitsu Limited Apparatus and method for interframe predictive video coding and decoding with capabilities to avoid rounding error accumulation
US20010019586A1 (en) 2000-02-22 2001-09-06 Kang Hyun Soo Motion estimation method and device
US6295376B1 (en) 1997-06-09 2001-09-25 Hitachi, Ltd. Image sequence coding method and decoding method
US20010040926A1 (en) 2000-05-15 2001-11-15 Miska Hannuksela Video coding
US6320593B1 (en) 1999-04-20 2001-11-20 Agilent Technologies, Inc. Method of fast bi-cubic interpolation of image information
US6324216B1 (en) 1992-06-29 2001-11-27 Sony Corporation Video coding selectable between intra-frame prediction/field-based orthogonal transformation and inter-frame prediction/frame-based orthogonal transformation
JP2002118598A (en) 2001-08-06 2002-04-19 Nippon Telegr & Teleph Corp <Ntt> Congestion detecting method, congestion preventing method, and packet communication system
US6377628B1 (en) 1996-12-18 2002-04-23 Thomson Licensing S.A. System for maintaining datastream continuity in the presence of disrupted source data
JP2002121053A (en) 2000-10-11 2002-04-23 Koyu Sangyo Kk Cement/concrete admixture and its production process
US6381279B1 (en) 1998-01-22 2002-04-30 Hewlett-Packard Company Method for providing motion-compensated multi-field enhancement of still images from video
RU2182727C2 (en) 2000-07-20 2002-05-20 Дворкович Александр Викторович Method for searching motion vectors of parts in amplitude images
JP2002156266A (en) 2000-11-17 2002-05-31 Osaka Gas Co Ltd Fluid flow rate measuring system
US6404813B1 (en) 1997-03-27 2002-06-11 At&T Corp. Bidirectionally predicted pictures or video object planes for efficient and flexible video coding
JP2002177889A (en) 2000-12-12 2002-06-25 Iseki & Co Ltd Rotary grain sorter
JP2002193027A (en) 2000-12-27 2002-07-10 Equos Research Co Ltd Light distribution control device
JP2002204713A (en) 2001-01-11 2002-07-23 Taishou:Kk Hairgrip
US6427027B1 (en) 1996-09-09 2002-07-30 Sony Corporation Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
US20020105596A1 (en) 2000-12-13 2002-08-08 Steve Selby Method and apparatus for detecting motion between odd and even video fields
US20020114388A1 (en) 2000-04-14 2002-08-22 Mamoru Ueda Decoder and decoding method, recorded medium, and program
US20020122488A1 (en) 2000-10-12 2002-09-05 Kuniaki Takahashi Motion vector conversion method and conversion apparatus
US20020154693A1 (en) 2001-03-02 2002-10-24 Demos Gary A. High precision encoding and decoding of video images
US6483874B1 (en) 1999-01-27 2002-11-19 General Instrument Corporation Efficient motion estimation for an arbitrarily-shaped object
EP0863673A3 (en) 1997-03-07 2002-12-11 General Instrument Corporation Intra-macroblock DC and AC coefficient prediction for interlaced digital video
US20020186890A1 (en) 2001-05-03 2002-12-12 Ming-Chieh Lee Dynamic filtering for lossy compression
US6496601B1 (en) 1997-06-23 2002-12-17 Viewpoint Corp. System and method for asynchronous, adaptive moving picture compression, and decompression
US6519287B1 (en) 1998-07-13 2003-02-11 Motorola, Inc. Method and apparatus for encoding and decoding video signals by using storage and retrieval of motion vectors
US20030053537A1 (en) 2001-03-05 2003-03-20 Chang-Su Kim Systems and methods for reducing frame rates in a video data stream
US6539056B1 (en) 1998-07-23 2003-03-25 Sony Corporation Picture decoding method and apparatus
EP0830029A3 (en) 1996-09-13 2003-05-07 Robert Bosch Gmbh Method for video signal data reduction
US6563953B2 (en) 1998-11-30 2003-05-13 Microsoft Corporation Predictive image compression using a single variable length code for both the luminance and chrominance blocks for each macroblock
US20030099294A1 (en) 2001-11-27 2003-05-29 Limin Wang Picture level adaptive frame/field coding for digital video content
US20030099292A1 (en) 2001-11-27 2003-05-29 Limin Wang Macroblock level adaptive frame/field coding for digital video content
US20030113026A1 (en) 2001-12-17 2003-06-19 Microsoft Corporation Skip macroblock coding
US20030112864A1 (en) 2001-09-17 2003-06-19 Marta Karczewicz Method for sub-pixel value interpolation
EP0901289A3 (en) 1997-09-03 2003-07-02 Matsushita Electric Industrial Co., Ltd. Apparatus for layered video coding
US20030142748A1 (en) 2002-01-25 2003-07-31 Alexandros Tourapis Video coding methods and apparatuses
US20030142751A1 (en) 2002-01-23 2003-07-31 Nokia Corporation Coding scene transitions in video coding
US20030156646A1 (en) 2001-12-17 2003-08-21 Microsoft Corporation Multi-resolution motion estimation and compensation
US6614442B1 (en) 2000-06-26 2003-09-02 S3 Graphics Co., Ltd. Macroblock tiling format for motion compensation
US6636565B1 (en) 1999-01-12 2003-10-21 Lg Electronics Inc. Method for concealing error
EP1006732A3 (en) 1998-12-04 2003-10-22 Mitsubishi Denki Kabushiki Kaisha Motion compensated interpolation for digital video signal processing
US20030202590A1 (en) 2002-04-30 2003-10-30 Qunshan Gu Video encoding using direct mode predicted frames
US20030206589A1 (en) 2002-05-03 2003-11-06 Lg Electronics Inc. Method for coding moving picture
US6647061B1 (en) 2000-06-09 2003-11-11 General Instrument Corporation Video size conversion and transcoding from MPEG-2 to MPEG-4
US6654420B1 (en) 1999-10-29 2003-11-25 Koninklijke Philips Electronics N.V. Video encoding-method
US6654419B1 (en) 2000-04-28 2003-11-25 Sun Microsystems, Inc. Block-based, adaptive, lossless video coder
US20040001546A1 (en) 2002-06-03 2004-01-01 Alexandros Tourapis Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US20040008899A1 (en) 2002-07-05 2004-01-15 Alexandros Tourapis Optimization techniques for data compression
US6683987B1 (en) 1999-03-25 2004-01-27 Victor Company Of Japan, Ltd. Method and apparatus for altering the picture updating frequency of a compressed video data stream
US20040047418A1 (en) 2002-07-19 2004-03-11 Alexandros Tourapis Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures
US6728317B1 (en) 1996-01-30 2004-04-27 Dolby Laboratories Licensing Corporation Moving image compression quality enhancement using displacement filters with negative lobes
EP1427216A1 (en) 2002-07-02 2004-06-09 Matsushita Electric Industrial Co., Ltd. Image encoding method and image decoding method
US20040136457A1 (en) 2002-10-23 2004-07-15 John Funnell Method and system for supercompression of compressed digital video
US20040139462A1 (en) 2002-07-15 2004-07-15 Nokia Corporation Method for error concealment in video sequences
JP2004208259A (en) 2002-04-19 2004-07-22 Matsushita Electric Ind Co Ltd Motion vector calculating method
US20040141651A1 (en) 2002-10-25 2004-07-22 Junichi Hara Modifying wavelet division level before transmitting data stream
US20040146109A1 (en) 2002-04-19 2004-07-29 Satoshi Kondo Method for calculation motion vector
EP0874526B1 (en) 1997-04-25 2004-08-25 Victor Company Of Japan, Limited Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
US6785331B1 (en) 1997-02-14 2004-08-31 Nippon Telegraph And Telephone Corporation Predictive encoding and decoding methods of video data
US6798837B1 (en) 1999-02-24 2004-09-28 Matsushita Electric Industrial Co., Ltd. Video coding method and video coding apparatus
US6798364B2 (en) 2002-02-05 2004-09-28 Intel Corporation Method and apparatus for variable length coding
US6807231B1 (en) 1997-09-12 2004-10-19 8×8, Inc. Multi-hypothesis motion-compensated video image predictor
US6816552B2 (en) 2001-07-11 2004-11-09 Dolby Laboratories Licensing Corporation Interpolation of video compression frames
US20040228413A1 (en) 2003-02-18 2004-11-18 Nokia Corporation Picture decoding method
US20050013497A1 (en) 2003-07-18 2005-01-20 Microsoft Corporation Intraframe and interframe interlace coding and decoding
US20050013498A1 (en) 2003-07-18 2005-01-20 Microsoft Corporation Coding of motion vector information
US20050036759A1 (en) 1998-11-30 2005-02-17 Microsoft Corporation Efficient motion vector coding for video compression
US20050053147A1 (en) 2003-09-07 2005-03-10 Microsoft Corporation Motion vector prediction in bi-directionally predicted interlaced field-coded pictures
US20050053137A1 (en) 2003-09-07 2005-03-10 Microsoft Corporation Predicting motion vectors for fields of forward-predicted interlaced video frames
US6873657B2 (en) 2001-12-27 2005-03-29 Koninklijke Philips Electronics, N.V. Method of and system for improving temporal consistency in sharpness enhancement for a video signal
US6876703B2 (en) 2000-05-11 2005-04-05 Ub Video Inc. Method and apparatus for video coding
US20050100093A1 (en) 2003-09-07 2005-05-12 Microsoft Corporation Signaling field type information
US6900846B2 (en) 2000-06-13 2005-05-31 Samsung Electronics Co., Ltd. Format converter using bi-directional motion vector and method thereof
US20050129120A1 (en) 2002-10-04 2005-06-16 Jeon Byeong M. Method of determining a motion vector for deriving motion vectors of a bi-predictive image block
US20050135484A1 (en) 2003-12-18 2005-06-23 Daeyang Foundation (Sejong University) Method of encoding mode determination, method of motion estimation and encoding apparatus
US20050147167A1 (en) 2003-12-24 2005-07-07 Adriana Dumitras Method and system for video encoding using a variable number of B frames
US6920175B2 (en) 2001-01-03 2005-07-19 Nokia Corporation Video coding architecture and methods for using same
US20050185713A1 (en) 2004-02-24 2005-08-25 Lsi Logic Corporation Method and apparatus for determining a second picture for temporal direct-mode block prediction
US20050207490A1 (en) 2004-03-18 2005-09-22 Wang Jason N Stored picture index for AVC coding
US20050249291A1 (en) 2004-05-07 2005-11-10 Stephen Gordon Method and system for generating a transform size syntax element for video decoding
US6975680B2 (en) 2001-07-12 2005-12-13 Dolby Laboratories, Inc. Macroblock mode decision biasing for video compression systems
US20060013307A1 (en) 2004-07-06 2006-01-19 Yannick Olivier Method or device for coding a sequence of source pictures
US6999513B2 (en) 2002-04-20 2006-02-14 Korea Electronics Technology Institute Apparatus for encoding a multi-view moving picture
US7092576B2 (en) 2003-09-07 2006-08-15 Microsoft Corporation Bitplane coding for macroblock field/frame coding type information
JP3129986U (en) 2006-12-26 2007-03-08 ライオン株式会社 Plate cushioning material
US20070177674A1 (en) 2006-01-12 2007-08-02 Lg Electronics Inc. Processing multiview video
US7317839B2 (en) 2003-09-07 2008-01-08 Microsoft Corporation Chroma motion vector derivation for interlaced forward-predicted fields
US20080043845A1 (en) 2006-08-17 2008-02-21 Fujitsu Limited Motion prediction processor with read buffers providing reference motion vectors for direct mode coding
US7346111B2 (en) 2003-12-10 2008-03-18 Lsi Logic Corporation Co-located motion vector storage
US20080069462A1 (en) 2002-08-08 2008-03-20 Kiyofumi Abe Moving picture coding method and moving picture decoding method
US20080075171A1 (en) 2002-07-15 2008-03-27 Yoshinori Suzuki Moving picture encoding method and decoding method
US7362807B2 (en) 2002-01-09 2008-04-22 Matsushita Electric Industrial Co., Ltd. Motion vector coding method and motion vector decoding method
US20080117985A1 (en) 2006-10-16 2008-05-22 Nokia Corporation System and method for implementing efficient decoded buffer management in multi-view video coding
US7388916B2 (en) 2000-07-07 2008-06-17 Electronics And Telecommunications Research Institute Water ring scanning apparatus and method, and apparatus and method for encoding/decoding video sequences using the same
US20090238269A1 (en) 2006-07-06 2009-09-24 Purvin Bibhas Pandit Method and Apparatus for Decoupling Frame Number and/or Picture Order Count (POC) for Multi-View Video Encoding and Decoding
US7733960B2 (en) * 2002-04-19 2010-06-08 Panasonic Corporation Motion vector calculation method

Family Cites Families (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH031688Y2 (en) 1985-02-20 1991-01-18
JPS61205086A (en) 1985-03-08 1986-09-11 Mitsubishi Electric Corp Picture encoding and decoding device
JPS62213494A (en) 1986-03-14 1987-09-19 Kokusai Denshin Denwa Co Ltd <Kdd> Motion compensation system for animation picture signal
DE3717057A1 (en) 1987-05-21 1988-12-01 Bayer Ag METHOD FOR PRODUCING ISOCYANATES
JP2562499B2 (en) 1989-05-29 1996-12-11 日本電信電話株式会社 High-efficiency image encoding device and its decoding device
JP2712645B2 (en) 1989-10-14 1998-02-16 ソニー株式会社 Motion vector transmission method and apparatus, and motion vector decoding method and apparatus
JPH05137131A (en) 1991-11-13 1993-06-01 Sony Corp Inter-frame motion predicting method
JP2524044B2 (en) 1992-01-22 1996-08-14 松下電器産業株式会社 Image coding method and image coding apparatus
JP3201079B2 (en) 1992-07-03 2001-08-20 ケイディーディーアイ株式会社 Motion compensated prediction method, coding method and apparatus for interlaced video signal
JP2510456B2 (en) 1992-08-27 1996-06-26 三菱電機株式会社 Image coding device
JPH06276481A (en) 1993-03-18 1994-09-30 Sony Corp Picture signal coding and decoding method and recording medium
JP3312417B2 (en) 1993-03-18 2002-08-05 ソニー株式会社 Image signal encoding device and image signal decoding device
US5612732A (en) 1993-03-31 1997-03-18 Casio Computer Co., Ltd. Portable compact imaging and displaying apparatus with rotatable camera
JP3589480B2 (en) 1994-03-31 2004-11-17 三菱電機株式会社 Video signal encoding method
US6091460A (en) 1994-03-31 2000-07-18 Mitsubishi Denki Kabushiki Kaisha Video signal encoding method and system
FR2725577B1 (en) 1994-10-10 1996-11-29 Thomson Consumer Electronics CODING OR DECODING METHOD OF MOTION VECTORS AND CODING OR DECODING DEVICE USING THE SAME
JPH08140099A (en) 1994-11-11 1996-05-31 Canon Inc Coding device and method
JP2951861B2 (en) 1994-12-28 1999-09-20 シャープ株式会社 Image encoding device and image decoding device
GB2301970B (en) 1995-06-06 2000-03-01 Sony Uk Ltd Motion compensated video processing
GB2303267B (en) 1995-06-06 2000-03-22 Sony Uk Ltd Video compression
DE69630643T2 (en) 1995-08-29 2004-10-07 Sharp Kk The video coding apparatus
JP3377893B2 (en) 1995-10-25 2003-02-17 沖電気工業株式会社 Video encoding / decoding device
JP3371191B2 (en) 1996-03-22 2003-01-27 ソニー株式会社 Image signal encoding method and decoding method, and encoding apparatus and decoding apparatus
JPH105664A (en) 1996-06-25 1998-01-13 Mitsubishi Chem Corp Die coater
CN1134172C (en) 1997-01-13 2004-01-07 皇家菲利浦电子有限公司 Emboding supplemental data in digital video signal
JPH10224800A (en) 1997-02-07 1998-08-21 Matsushita Electric Ind Co Ltd Motion vector coding method and decoding method
USRE38564E1 (en) 1997-03-07 2004-08-10 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
JP3129986B2 (en) 1997-04-09 2001-01-31 日本車輌製造株式会社 Pile construction machine torque management device
US6633611B2 (en) 1997-04-24 2003-10-14 Mitsubishi Denki Kabushiki Kaisha Method and apparatus for region-based moving image encoding and decoding
JP2828095B2 (en) 1997-06-23 1998-11-25 松下電器産業株式会社 Image signal decoding apparatus and image signal decoding method
JP2914448B2 (en) 1997-06-25 1999-06-28 日本電信電話株式会社 Motion vector prediction encoding method and motion vector decoding method, prediction encoding device and decoding device, and recording medium recording motion vector prediction encoding program and decoding program
JP3570863B2 (en) 1997-08-05 2004-09-29 三菱電機株式会社 Moving picture decoding apparatus and moving picture decoding method
JPH11136683A (en) 1997-10-27 1999-05-21 Matsushita Electric Ind Co Ltd Video signal coder
EP0953253B1 (en) 1997-11-17 2006-06-14 Koninklijke Philips Electronics N.V. Motion-compensated predictive image encoding and decoding
EP0940774A3 (en) * 1998-03-05 2000-07-05 Matsushita Electric Industrial Co., Ltd. Motion vector coding and decoding apparatus and method
CA2265089C (en) * 1998-03-10 2007-07-10 Sony Corporation Transcoding system using encoding history information
US6414992B1 (en) 1999-01-27 2002-07-02 Sun Microsystems, Inc. Optimal encoding of motion compensated video
US6697430B1 (en) 1999-05-19 2004-02-24 Matsushita Electric Industrial Co., Ltd. MPEG encoder
JP2000350212A (en) 1999-06-04 2000-12-15 Matsushita Electric Ind Co Ltd Decoding device and display system for video signal
US6671319B1 (en) 1999-12-28 2003-12-30 Sony Corporation Methods and apparatus for motion estimation using neighboring macroblocks
US7023922B1 (en) 2000-06-21 2006-04-04 Microsoft Corporation Video coding system and method using 3-D discrete wavelet transform and entropy coding with motion information
KR100727910B1 (en) * 2000-10-11 2007-06-13 삼성전자주식회사 Method and apparatus for motion estimation of hybrid type
WO2002037859A2 (en) * 2000-11-03 2002-05-10 Compression Science Video data compression system
CN1401189A (en) * 2000-11-23 2003-03-05 皇家菲利浦电子有限公司 Video decoding method and corresponding decoder
WO2002062074A1 (en) 2001-01-22 2002-08-08 Webcast Technologies, Inc. Video encoding and decoding techniques and apparatus
US6804301B2 (en) * 2001-08-15 2004-10-12 General Instrument Corporation First pass encoding of I and P-frame complexity for compressed digital video
PT2285121E (en) 2001-11-21 2015-10-27 Google Technology Holdings LLC Macroblock level adaptive frame/field coding for digital video content
WO2003063505A1 (en) 2002-01-23 2003-07-31 Nokia Corporation Grouping of image frames in video coding
WO2003098939A1 (en) * 2002-05-22 2003-11-27 Matsushita Electric Industrial Co., Ltd. Moving image encoding method, moving image decoding method, and data recording medium
US7227901B2 (en) 2002-11-21 2007-06-05 Ub Video Inc. Low-complexity deblocking filter
JP2004228259A (en) * 2003-01-22 2004-08-12 Hitachi Ltd Semiconductor device and electronic equipment using the same
JP4968726B2 (en) 2003-06-25 2012-07-04 トムソン ライセンシング Fast mode decision coding for interframes.
US7609763B2 (en) 2003-07-18 2009-10-27 Microsoft Corporation Advanced bi-directional predictive coding of video frames
TW200820791A (en) 2006-08-25 2008-05-01 Lg Electronics Inc A method and apparatus for decoding/encoding a video signal
US8254455B2 (en) 2007-06-30 2012-08-28 Microsoft Corporation Computing collocated macroblock information for direct mode macroblocks
US8265144B2 (en) 2007-06-30 2012-09-11 Microsoft Corporation Innovations in video decoder implementations
US9648325B2 (en) 2007-06-30 2017-05-09 Microsoft Technology Licensing, Llc Video decoding implementations for a graphics processing unit
US8189666B2 (en) 2009-02-02 2012-05-29 Microsoft Corporation Local picture identifier and computation of co-located information
JP6078298B2 (en) 2012-11-01 2017-02-08 武蔵エンジニアリング株式会社 Work device having position correction function and work method

Patent Citations (262)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4454546A (en) 1980-03-13 1984-06-12 Fuji Photo Film Co., Ltd. Band compression device for shaded image
US4695882A (en) 1984-01-30 1987-09-22 Kokusai Denshin Denwa Co., Ltd. Movement estimation system for video signals using a recursive gradient method
US4661849A (en) 1985-06-03 1987-04-28 Pictel Corporation Method and apparatus for providing motion estimation signals for communicating image sequences
US4661853A (en) 1985-11-01 1987-04-28 Rca Corporation Interfield image motion detector for video signals
US4796087A (en) 1986-05-29 1989-01-03 Jacques Guichard Process for coding by transformation for the transmission of picture signals
EP0279053B1 (en) 1987-02-16 1991-04-10 ANT Nachrichtentechnik GmbH Method for the transmission and reproduction of sequences of television pictures
US4849812A (en) 1987-03-10 1989-07-18 U.S. Philips Corporation Television system in which digitized picture signals subjected to a transform coding are transmitted from an encoding station to a decoding station
US5021879A (en) 1987-05-06 1991-06-04 U.S. Philips Corporation System for transmitting video pictures
US4862267A (en) 1987-06-09 1989-08-29 Sony Corp. Motion compensated interpolation of digital television images
US4864393A (en) 1987-06-09 1989-09-05 Sony Corp. Motion vector estimation in television images
US5089887A (en) 1988-09-23 1992-02-18 Thomson Consumer Electronics Method and device for the estimation of motion in a sequence of moving images
USRE34965E (en) 1989-01-20 1995-06-13 Victor Company Of Japan Limited Inter-frame predictive encoding system with encoded and transmitted prediction error
USRE35158E (en) 1989-04-27 1996-02-20 Victor Company Of Japan Limited Apparatus for adaptive inter-frame predictive encoding of video signal
US5089889A (en) 1989-04-28 1992-02-18 Victor Company Of Japan, Ltd. Apparatus for inter-frame predictive encoding of video signal
EP0397402B1 (en) 1989-05-11 1996-07-10 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding- and decoding apparatus
USRE35910E (en) 1989-05-11 1998-09-29 Matsushita Electric Industrial Co., Ltd. Moving image signal encoding apparatus and decoding apparatus
US5132792A (en) 1989-10-14 1992-07-21 Sony Corporation Video signal transmitting system
USRE37222E1 (en) 1989-10-14 2001-06-12 Sony Corporation Video signal transmitting system
US5235618A (en) 1989-11-06 1993-08-10 Fujitsu Limited Video signal coding apparatus, coding method used in the video signal coding apparatus and video signal coding transmission system having the video signal coding apparatus
US5699476A (en) 1990-02-22 1997-12-16 U.S. Philips Corporation Method and apparatus for transmitting and/or storing a series of hierarchically encoded digital image data blocks
US5117287A (en) 1990-03-02 1992-05-26 Kokusai Denshin Denwa Co., Ltd. Hybrid coding system for moving image
US5157490A (en) 1990-03-14 1992-10-20 Kabushiki Kaisha Toshiba Television signal scanning line converting apparatus
US5103306A (en) 1990-03-28 1992-04-07 Transitions Research Corporation Digital image compression employing a resolution gradient
US5091782A (en) 1990-04-09 1992-02-25 General Instrument Corporation Apparatus and method for adaptively compressing successive blocks of digital video
US5068724A (en) 1990-06-15 1991-11-26 General Instrument Corporation Adaptive motion compensation for digital television
US5175618A (en) 1990-10-31 1992-12-29 Victor Company Of Japan, Ltd. Compression method for interlace moving image signals
US5193004A (en) 1990-12-03 1993-03-09 The Trustees Of Columbia University In The City Of New York Systems and methods for coding even fields of interlaced video sequences
USRE35093E (en) 1990-12-03 1995-11-21 The Trustees Of Columbia University In The City Of New York Systems and methods for coding even fields of interlaced video sequences
US5111292A (en) 1991-02-27 1992-05-05 General Electric Company Priority selection apparatus as for a video signal processor
US5223949A (en) 1991-04-18 1993-06-29 Matsushita Electric Industrial Co., Ltd. Coding means for a signal processing system
US5185819A (en) 1991-04-29 1993-02-09 General Electric Company Video signal compression apparatus for independently compressing odd and even fields
US6011596A (en) 1991-05-24 2000-01-04 British Broadcasting Video image motion compensation using an algorithm involving at least two fields
US5467136A (en) 1991-05-31 1995-11-14 Kabushiki Kaisha Toshiba Video decoder for determining a motion vector from a scaled vector and a difference vector
US5317397A (en) 1991-05-31 1994-05-31 Kabushiki Kaisha Toshiba Predictive coding using spatial-temporal filtering and plural motion vectors
US5424779A (en) 1991-05-31 1995-06-13 Kabushiki Kaisha Toshiba Video coding apparatus
US5343248A (en) 1991-07-26 1994-08-30 Sony Corporation Moving image compressing and recording medium and moving image data encoder and decoder
US5539466A (en) 1991-07-30 1996-07-23 Sony Corporation Efficient coding apparatus for picture signal and decoding apparatus therefor
US5412430A (en) 1991-07-31 1995-05-02 Matsushita Electric Industrial Co. Ltd. Image coding method and image coding apparatus
EP0526163B1 (en) 1991-07-31 1998-03-04 Matsushita Electric Industrial Co., Ltd. Image coding method and image coding apparatus
US5428396A (en) 1991-08-03 1995-06-27 Sony Corporation Variable length coding/decoding method for motion vectors
US5298991A (en) 1991-08-03 1994-03-29 Sony Corporation Variable length coding apparatus and method for motion vector
JP3001688B2 (en) 1991-08-05 2000-01-24 株式会社大一商会 Pachinko ball circulation controller
US5260782A (en) 1991-08-30 1993-11-09 Matsushita Electric Industrial Co., Ltd. Adaptive DCT/DPCM video signal coding method
EP0535746B1 (en) 1991-09-30 1997-01-29 Philips Electronics Uk Limited Motion vector estimation, motion picture encoding and storage
US5347308A (en) 1991-10-11 1994-09-13 Matsushita Electric Industrial Co., Ltd. Adaptive coding method for interlaced scan digital video sequences
US6188794B1 (en) 1991-10-22 2001-02-13 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US6097759A (en) 1991-10-22 2000-08-01 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US5949489A (en) 1991-10-22 1999-09-07 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US5963258A (en) 1991-10-22 1999-10-05 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US5970175A (en) 1991-10-22 1999-10-19 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US6002439A (en) 1991-10-22 1999-12-14 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US5990960A (en) 1991-10-22 1999-11-23 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
US6307973B2 (en) 1991-10-22 2001-10-23 Mitsubishi Denki Kabushiki Kaisha Image signal coding system
EP0540350B1 (en) 1991-10-31 1998-07-22 Sony Corporation Method and apparatus for variable length coding
USRE36822E (en) 1991-11-08 2000-08-15 Victor Company Of Japan, Ltd. Moving image signal coding apparatus and coded signal decoding apparatus
US5748784A (en) 1991-11-08 1998-05-05 Victor Company Of Japan, Ltd. Moving image signal coding apparatus and coded signal decoding apparatus
US5227878A (en) 1991-11-15 1993-07-13 At&T Bell Laboratories Adaptive coding and decoding of frames and fields of video
US5510840A (en) 1991-12-27 1996-04-23 Sony Corporation Methods and devices for encoding and decoding frame signals and recording medium therefor
US5901248A (en) 1992-02-19 1999-05-04 8X8, Inc. Programmable architecture and methods for motion estimation
US5677735A (en) 1992-03-03 1997-10-14 Kabushiki Kaisha Toshiba Motion picture coding apparatus
USRE36507E (en) 1992-03-27 2000-01-18 Matsushita Electric Corporation Of America Apparatus and method for processing groups of fields in a video data compression system to encode a single frame as an I-field and a P-field
US5287420A (en) 1992-04-08 1994-02-15 Supermac Technology Method for image compression on a personal computer
US5467086A (en) 1992-06-18 1995-11-14 Samsung Electronics Co., Ltd. Apparatus and method of coding/decoding video data
US5666461A (en) 1992-06-29 1997-09-09 Sony Corporation High efficiency encoding and decoding of picture signals and recording medium containing same
US6324216B1 (en) 1992-06-29 2001-11-27 Sony Corporation Video coding selectable between intra-frame prediction/field-based orthogonal transformation and inter-frame prediction/frame-based orthogonal transformation
US5412435A (en) 1992-07-03 1995-05-02 Kokusai Denshin Denwa Kabushiki Kaisha Interlaced video signal motion compensation prediction system
EP0588653B1 (en) 1992-09-16 1999-12-22 Fujitsu Limited Image data coding and restoring method and apparatus for restoring the same
US5461421A (en) 1992-11-30 1995-10-24 Samsung Electronics Co., Ltd. Encoding and decoding method and apparatus thereof
US5467134A (en) 1992-12-22 1995-11-14 Microsoft Corporation Method and system for compressing video data
US5400075A (en) 1993-01-13 1995-03-21 Thomson Consumer Electronics, Inc. Adaptive variable length encoder/decoder
EP0614318B1 (en) 1993-03-04 1999-12-01 Kabushiki Kaisha Toshiba Video encoder and decoder
US5701164A (en) 1993-03-24 1997-12-23 Sony Corporation Macroblock coding including difference between motion vectors
US6040863A (en) 1993-03-24 2000-03-21 Sony Corporation Method of coding and decoding motion vector and apparatus therefor, and method of coding and decoding picture signal and apparatus therefor
US5946042A (en) 1993-03-24 1999-08-31 Sony Corporation Macroblock coding including difference between motion vectors
US5621481A (en) 1993-04-08 1997-04-15 Sony Corporation Motion vector detecting apparatus for determining interframe, predictive error as a function of interfield predictive errors
US5442400A (en) 1993-04-29 1995-08-15 Rca Thomson Licensing Corporation Error concealment apparatus for MPEG-like video data
EP0625853B1 (en) 1993-05-21 1999-03-03 Nippon Telegraph And Telephone Corporation Moving image encoder and decoder
US5598215A (en) 1993-05-21 1997-01-28 Nippon Telegraph And Telephone Corporation Moving image encoder and decoder using contour extraction
US5448297A (en) 1993-06-16 1995-09-05 Intel Corporation Method and system for encoding images using skip blocks
US5477272A (en) 1993-07-22 1995-12-19 Gte Laboratories Incorporated Variable-block size multi-resolution motion estimation scheme for pyramid coding
US5453799A (en) 1993-11-05 1995-09-26 Comsat Corporation Unified motion estimation architecture
US5734755A (en) 1994-03-11 1998-03-31 The Trustees Of Columbia University In The City Of New York JPEG/MPEG decoder-compatible optimized thresholding for image and video signal compression
US5648819A (en) 1994-03-30 1997-07-15 U.S. Philips Corporation Motion estimation using half-pixel refinement of frame and field vectors
US5565922A (en) 1994-04-11 1996-10-15 General Instrument Corporation Of Delaware Motion compensation for interlaced digital video signals
US5767898A (en) 1994-06-23 1998-06-16 Sanyo Electric Co., Ltd. Three-dimensional image coding by merger of left and right images
US5796438A (en) 1994-07-05 1998-08-18 Sony Corporation Methods and apparatus for interpolating picture information
US5594504A (en) 1994-07-06 1997-01-14 Lucent Technologies Inc. Predictive video coding using a motion vector updating routine
US5786860A (en) 1994-07-30 1998-07-28 Korean Advanced Institute Of Science And Technology High speed block matching for bi-directional motion vector estimation
US5835144A (en) 1994-10-13 1998-11-10 Oki Electric Industry Co., Ltd. Methods of coding and decoding moving-picture signals, using self-resynchronizing variable-length codes
US5874995A (en) 1994-10-28 1999-02-23 Matsuhita Electric Corporation Of America MPEG video decoder having a high bandwidth memory for use in decoding interlaced and progressive signals
US5623311A (en) 1994-10-28 1997-04-22 Matsushita Electric Corporation Of America MPEG video decoder having a high bandwidth memory
US5691771A (en) 1994-12-29 1997-11-25 Sony Corporation Processing of redundant fields in a moving picture to achieve synchronized system operation
US5619281A (en) 1994-12-30 1997-04-08 Daewoo Electronics Co., Ltd Method and apparatus for detecting motion vectors in a frame decimating video encoder
US5617144A (en) 1995-03-20 1997-04-01 Daewoo Electronics Co., Ltd. Image processing system using pixel-by-pixel motion estimation and frame decimation
US5598216A (en) 1995-03-20 1997-01-28 Daewoo Electronics Co., Ltd Method and apparatus for encoding/decoding a video signal
US5717441A (en) 1995-05-02 1998-02-10 Matsushita Electric Ind. Picture data memory with high access efficiency in detecting motion vectors, a motion vector detection circuit provided with the picture data memory, and an address conversion circuit
US5731850A (en) 1995-06-07 1998-03-24 Maturi; Gregory V. Hybrid hierarchial/full-search MPEG encoder motion estimation
US5687097A (en) 1995-07-13 1997-11-11 Zapex Technologies, Inc. Method and apparatus for efficiently determining a frame motion vector in a video encoder
US6154495A (en) 1995-09-29 2000-11-28 Kabushiki Kaisha Toshiba Video coding and video decoding apparatus for changing a resolution conversion according to a reduction ratio setting information signal
US5970173A (en) 1995-10-05 1999-10-19 Microsoft Corporation Image compression and affine transformation for image motion compensation
US5959673A (en) 1995-10-05 1999-09-28 Microsoft Corporation Transform coding of dense motion vector fields for frame and object based video coding applications
US5822541A (en) 1995-10-09 1998-10-13 Hitachi, Ltd. Compressed video data amount reducing device, compressed video data amount reducing system and compressed video data amount reducing method
US5929940A (en) 1995-10-25 1999-07-27 U.S. Philips Corporation Method and device for estimating motion between images, system for encoding segmented images
US6192081B1 (en) 1995-10-26 2001-02-20 Sarnoff Corporation Apparatus and method for selecting a coding mode in a block-based coding system
EP0771114A2 (en) 1995-10-26 1997-05-02 Hyundai Electronics Industries Co., Ltd. Method of generating object-adaptive code block patterns
US5963673A (en) 1995-12-20 1999-10-05 Sanyo Electric Co., Ltd. Method and apparatus for adaptively selecting a coding mode for video encoding
EP0782343A3 (en) 1995-12-27 2000-12-20 Matsushita Electric Industrial Co., Ltd. Video coding method
US6055012A (en) 1995-12-29 2000-04-25 Lucent Technologies Inc. Digital multi-view video compression with complexity and compatibility constraints
US5787203A (en) 1996-01-19 1998-07-28 Microsoft Corporation Method and system for filtering compressed video images
US5926573A (en) 1996-01-29 1999-07-20 Matsushita Electric Corporation Of America MPEG bit-stream format converter for changing resolution
US6728317B1 (en) 1996-01-30 2004-04-27 Dolby Laboratories Licensing Corporation Moving image compression quality enhancement using displacement filters with negative lobes
US5798788A (en) 1996-02-01 1998-08-25 David Sarnoff Research Center, Inc. Method and apparatus for evaluating field display functionality of a video decoder
US5923375A (en) 1996-02-27 1999-07-13 Sgs-Thomson Microelectronics S.R.L. Memory reduction in the MPEG-2 main profile main level decoder
US5982438A (en) 1996-03-22 1999-11-09 Microsoft Corporation Overlapped motion compensation for object coding
US5847776A (en) 1996-06-24 1998-12-08 Vdonet Corporation Ltd. Method for entropy constrained motion estimation and coding of motion vectors with increased search range
US6459812B2 (en) 1996-09-09 2002-10-01 Sony Corporation Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
US6427027B1 (en) 1996-09-09 2002-07-30 Sony Corporation Picture encoding and/or decoding apparatus and method for providing scalability of a video object whose position changes with time and a recording medium having the same recorded thereon
EP0830029A3 (en) 1996-09-13 2003-05-07 Robert Bosch Gmbh Method for video signal data reduction
US6130963A (en) 1996-11-22 2000-10-10 C-Cube Semiconductor Ii, Inc. Memory efficient decoding of video frame chroma
US6263024B1 (en) 1996-12-12 2001-07-17 Matsushita Electric Industrial Co., Ltd. Picture encoder and picture decoder
US6377628B1 (en) 1996-12-18 2002-04-23 Thomson Licensing S.A. System for maintaining datastream continuity in the presence of disrupted source data
US6167090A (en) 1996-12-26 2000-12-26 Nippon Steel Corporation Motion vector detecting apparatus
EP0786907A2 (en) 1997-01-24 1997-07-30 Texas Instruments Incorporated Video encoder
US6785331B1 (en) 1997-02-14 2004-08-31 Nippon Telegraph And Telephone Corporation Predictive encoding and decoding methods of video data
US6201927B1 (en) 1997-02-18 2001-03-13 Mary Lafuze Comer Trick play reproduction of MPEG encoded signals
EP0863674A3 (en) 1997-03-07 2002-12-18 General Instrument Corporation Prediction and coding of bi-directionally predicted video object planes for interlaced digital video
US6026195A (en) 1997-03-07 2000-02-15 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
EP0863675A3 (en) 1997-03-07 2003-04-09 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
US5991447A (en) 1997-03-07 1999-11-23 General Instrument Corporation Prediction and coding of bi-directionally predicted video object planes for interlaced digital video
EP0863673A3 (en) 1997-03-07 2002-12-11 General Instrument Corporation Intra-macroblock DC and AC coefficient prediction for interlaced digital video
USRE38563E1 (en) 1997-03-07 2004-08-10 Gen Instrument Corp Prediction and coding of bi-directionally predicted video object planes for interlaced digital video
US6005980A (en) 1997-03-07 1999-12-21 General Instrument Corporation Motion estimation and compensation of video object planes for interlaced digital video
US6175592B1 (en) 1997-03-12 2001-01-16 Matsushita Electric Industrial Co., Ltd. Frequency domain filtering for down conversion of a DCT encoded picture
US5844613A (en) 1997-03-17 1998-12-01 Microsoft Corporation Global motion estimator for motion video signal encoding
US6263065B1 (en) 1997-03-18 2001-07-17 At&T Corp. Method and apparatus for simulating central queue for distributing call in distributed arrangement of automatic call distributors
US6704360B2 (en) 1997-03-27 2004-03-09 At&T Corp. Bidirectionally predicted pictures or video object planes for efficient and flexible video coding
US6404813B1 (en) 1997-03-27 2002-06-11 At&T Corp. Bidirectionally predicted pictures or video object planes for efficient and flexible video coding
US5973755A (en) 1997-04-04 1999-10-26 Microsoft Corporation Video encoder and decoder using bilinear motion compensation and lapped orthogonal transforms
US6307887B1 (en) 1997-04-04 2001-10-23 Microsoft Corporation Video encoder and decoder using bilinear motion compensation and lapped orthogonal transforms
EP0874526B1 (en) 1997-04-25 2004-08-25 Victor Company Of Japan, Limited Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
US6188725B1 (en) 1997-05-30 2001-02-13 Victor Company Of Japan, Ltd. Interlaced video signal encoding and decoding method, by conversion of selected fields to progressive scan frames which function as reference frames for predictive encoding
US6067322A (en) 1997-06-04 2000-05-23 Microsoft Corporation Half pixel motion estimation in motion video signal encoding
US6295376B1 (en) 1997-06-09 2001-09-25 Hitachi, Ltd. Image sequence coding method and decoding method
US6529632B1 (en) 1997-06-09 2003-03-04 Hitachi, Ltd. Image coding method
EP0884912B1 (en) 1997-06-09 2003-08-27 Hitachi, Ltd. Image sequence decoding method
US6650781B2 (en) 1997-06-09 2003-11-18 Hitachi, Ltd. Image decoder
US6282243B1 (en) 1997-06-11 2001-08-28 Fujitsu Limited Apparatus and method for interframe predictive video coding and decoding with capabilities to avoid rounding error accumulation
US6496601B1 (en) 1997-06-23 2002-12-17 Viewpoint Corp. System and method for asynchronous, adaptive moving picture compression, and decompression
US6205176B1 (en) 1997-07-28 2001-03-20 Victor Company Of Japan, Ltd. Motion-compensated coder with motion vector accuracy controlled, a decoder, a method of motion-compensated coding, and a method of decoding
GB2328337A (en) 1997-08-12 1999-02-17 Daewoo Electronics Co Ltd Encoding motion vectors
US6269121B1 (en) 1997-08-13 2001-07-31 Daewoo Electronics Co., Ltd. Adaptive motion estimation method and apparatus
EP0901289A3 (en) 1997-09-03 2003-07-02 Matsushita Electric Industrial Co., Ltd. Apparatus for layered video coding
US6205177B1 (en) 1997-09-12 2001-03-20 Netergu Networks Video coder/decoder
US6807231B1 (en) 1997-09-12 2004-10-19 8×8, Inc. Multi-hypothesis motion-compensated video image predictor
GB2332115B (en) 1997-12-01 1999-12-29 Samsung Electronics Co Ltd Motion vector prediction method
US6094225A (en) 1997-12-02 2000-07-25 Daewoo Electronics, Co., Ltd. Method and apparatus for encoding mode signals for use in a binary shape coder
US5973743A (en) 1997-12-02 1999-10-26 Daewoo Electronics Co., Ltd. Mode coding method and apparatus for use in an interlaced shape coder
US6381279B1 (en) 1998-01-22 2002-04-30 Hewlett-Packard Company Method for providing motion-compensated multi-field enhancement of still images from video
EP0944245B1 (en) 1998-03-20 2001-07-25 SGS-THOMSON MICROELECTRONICS S.r.l. Hierarchical recursive motion estimator for video images encoder
US6243418B1 (en) 1998-03-30 2001-06-05 Daewoo Electronics Co., Ltd. Method and apparatus for encoding a motion vector of a binary shape signal
US6271885B2 (en) 1998-06-24 2001-08-07 Victor Company Of Japan, Ltd. Apparatus and method of motion-compensated predictive coding
US6519287B1 (en) 1998-07-13 2003-02-11 Motorola, Inc. Method and apparatus for encoding and decoding video signals by using storage and retrieval of motion vectors
US6539056B1 (en) 1998-07-23 2003-03-25 Sony Corporation Picture decoding method and apparatus
GB2343579A (en) 1998-11-07 2000-05-10 Ibm Hybrid-linear-bicubic interpolation method and apparatus
US6081209A (en) 1998-11-12 2000-06-27 Hewlett-Packard Company Search system for use in compression
US6735345B2 (en) 1998-11-30 2004-05-11 Microsoft Corporation Efficient macroblock header coding for video compression
US6563953B2 (en) 1998-11-30 2003-05-13 Microsoft Corporation Predictive image compression using a single variable length code for both the luminance and chrominance blocks for each macroblock
US7054494B2 (en) 1998-11-30 2006-05-30 Microsoft Corporation Coded block pattern decoding with spatial prediction
US20050036759A1 (en) 1998-11-30 2005-02-17 Microsoft Corporation Efficient motion vector coding for video compression
EP1006732A3 (en) 1998-12-04 2003-10-22 Mitsubishi Denki Kabushiki Kaisha Motion compensated interpolation for digital video signal processing
US6636565B1 (en) 1999-01-12 2003-10-21 Lg Electronics Inc. Method for concealing error
US6483874B1 (en) 1999-01-27 2002-11-19 General Instrument Corporation Efficient motion estimation for an arbitrarily-shaped object
US6798837B1 (en) 1999-02-24 2004-09-28 Matsushita Electric Industrial Co., Ltd. Video coding method and video coding apparatus
US6683987B1 (en) 1999-03-25 2004-01-27 Victor Company Of Japan, Ltd. Method and apparatus for altering the picture updating frequency of a compressed video data stream
US6320593B1 (en) 1999-04-20 2001-11-20 Agilent Technologies, Inc. Method of fast bi-cubic interpolation of image information
JP2000308064A (en) 1999-04-22 2000-11-02 Mitsubishi Electric Corp Motion vector detecting device
JP2000307672A (en) 1999-04-26 2000-11-02 Oki Electric Ind Co Ltd Encoded information receiving and decoding device
JP2001025014A (en) 1999-05-24 2001-01-26 Agilent Technol Inc Method and device for decoding compressed multi-media communication and evaluating quality of multi-media communication
US6654420B1 (en) 1999-10-29 2003-11-25 Koninklijke Philips Electronics N.V. Video encoding-method
US20010019586A1 (en) 2000-02-22 2001-09-06 Kang Hyun Soo Motion estimation method and device
US20020114388A1 (en) 2000-04-14 2002-08-22 Mamoru Ueda Decoder and decoding method, recorded medium, and program
US6654419B1 (en) 2000-04-28 2003-11-25 Sun Microsystems, Inc. Block-based, adaptive, lossless video coder
US6876703B2 (en) 2000-05-11 2005-04-05 Ub Video Inc. Method and apparatus for video coding
US20010040926A1 (en) 2000-05-15 2001-11-15 Miska Hannuksela Video coding
US6647061B1 (en) 2000-06-09 2003-11-11 General Instrument Corporation Video size conversion and transcoding from MPEG-2 to MPEG-4
US6900846B2 (en) 2000-06-13 2005-05-31 Samsung Electronics Co., Ltd. Format converter using bi-directional motion vector and method thereof
US6614442B1 (en) 2000-06-26 2003-09-02 S3 Graphics Co., Ltd. Macroblock tiling format for motion compensation
US7388916B2 (en) 2000-07-07 2008-06-17 Electronics And Telecommunications Research Institute Water ring scanning apparatus and method, and apparatus and method for encoding/decoding video sequences using the same
RU2182727C2 (en) 2000-07-20 2002-05-20 Дворкович Александр Викторович Method for searching motion vectors of parts in amplitude images
JP2002121053A (en) 2000-10-11 2002-04-23 Koyu Sangyo Kk Cement/concrete admixture and its production process
US20020122488A1 (en) 2000-10-12 2002-09-05 Kuniaki Takahashi Motion vector conversion method and conversion apparatus
JP2002156266A (en) 2000-11-17 2002-05-31 Osaka Gas Co Ltd Fluid flow rate measuring system
JP2002177889A (en) 2000-12-12 2002-06-25 Iseki & Co Ltd Rotary grain sorter
US20020105596A1 (en) 2000-12-13 2002-08-08 Steve Selby Method and apparatus for detecting motion between odd and even video fields
JP2002193027A (en) 2000-12-27 2002-07-10 Equos Research Co Ltd Light distribution control device
US6920175B2 (en) 2001-01-03 2005-07-19 Nokia Corporation Video coding architecture and methods for using same
JP2002204713A (en) 2001-01-11 2002-07-23 Taishou:Kk Hairgrip
US20020154693A1 (en) 2001-03-02 2002-10-24 Demos Gary A. High precision encoding and decoding of video images
US20050254584A1 (en) 2001-03-05 2005-11-17 Chang-Su Kim Systems and methods for enhanced error concealment in a video decoder
US20030053537A1 (en) 2001-03-05 2003-03-20 Chang-Su Kim Systems and methods for reducing frame rates in a video data stream
US20020186890A1 (en) 2001-05-03 2002-12-12 Ming-Chieh Lee Dynamic filtering for lossy compression
US6816552B2 (en) 2001-07-11 2004-11-09 Dolby Laboratories Licensing Corporation Interpolation of video compression frames
US6975680B2 (en) 2001-07-12 2005-12-13 Dolby Laboratories, Inc. Macroblock mode decision biasing for video compression systems
JP2002118598A (en) 2001-08-06 2002-04-19 Nippon Telegr & Teleph Corp <Ntt> Congestion detecting method, congestion preventing method, and packet communication system
US20030112864A1 (en) 2001-09-17 2003-06-19 Marta Karczewicz Method for sub-pixel value interpolation
US6980596B2 (en) 2001-11-27 2005-12-27 General Instrument Corporation Macroblock level adaptive frame/field coding for digital video content
US20030099294A1 (en) 2001-11-27 2003-05-29 Limin Wang Picture level adaptive frame/field coding for digital video content
US20030099292A1 (en) 2001-11-27 2003-05-29 Limin Wang Macroblock level adaptive frame/field coding for digital video content
US20070064801A1 (en) 2001-11-27 2007-03-22 General Instrument Corporation Picture Level Adaptive Frame/Field Coding for Digital Video Content
US20030156646A1 (en) 2001-12-17 2003-08-21 Microsoft Corporation Multi-resolution motion estimation and compensation
US20030113026A1 (en) 2001-12-17 2003-06-19 Microsoft Corporation Skip macroblock coding
US6873657B2 (en) 2001-12-27 2005-03-29 Koninklijke Philips Electronics, N.V. Method of and system for improving temporal consistency in sharpness enhancement for a video signal
US7362807B2 (en) 2002-01-09 2008-04-22 Matsushita Electric Industrial Co., Ltd. Motion vector coding method and motion vector decoding method
US20030142751A1 (en) 2002-01-23 2003-07-31 Nokia Corporation Coding scene transitions in video coding
US20030142748A1 (en) 2002-01-25 2003-07-31 Alexandros Tourapis Video coding methods and apparatuses
US7003035B2 (en) 2002-01-25 2006-02-21 Microsoft Corporation Video coding methods and apparatuses
US20060072662A1 (en) 2002-01-25 2006-04-06 Microsoft Corporation Improved Video Coding
US7646810B2 (en) 2002-01-25 2010-01-12 Microsoft Corporation Video coding
US6798364B2 (en) 2002-02-05 2004-09-28 Intel Corporation Method and apparatus for variable length coding
US20040146109A1 (en) 2002-04-19 2004-07-29 Satoshi Kondo Method for calculation motion vector
JP2004208259A (en) 2002-04-19 2004-07-22 Matsushita Electric Ind Co Ltd Motion vector calculating method
US7733960B2 (en) * 2002-04-19 2010-06-08 Panasonic Corporation Motion vector calculation method
US6999513B2 (en) 2002-04-20 2006-02-14 Korea Electronics Technology Institute Apparatus for encoding a multi-view moving picture
US20030202590A1 (en) 2002-04-30 2003-10-30 Qunshan Gu Video encoding using direct mode predicted frames
US20030206589A1 (en) 2002-05-03 2003-11-06 Lg Electronics Inc. Method for coding moving picture
US20040001546A1 (en) 2002-06-03 2004-01-01 Alexandros Tourapis Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US20040234143A1 (en) 2002-07-02 2004-11-25 Makoto Hagai Image encoding method and picture decoding method
EP1427216A1 (en) 2002-07-02 2004-06-09 Matsushita Electric Industrial Co., Ltd. Image encoding method and image decoding method
US7280700B2 (en) 2002-07-05 2007-10-09 Microsoft Corporation Optimization techniques for data compression
US20040008899A1 (en) 2002-07-05 2004-01-15 Alexandros Tourapis Optimization techniques for data compression
US20040139462A1 (en) 2002-07-15 2004-07-15 Nokia Corporation Method for error concealment in video sequences
US20080075171A1 (en) 2002-07-15 2008-03-27 Yoshinori Suzuki Moving picture encoding method and decoding method
US20060280253A1 (en) 2002-07-19 2006-12-14 Microsoft Corporation Timestamp-Independent Motion Vector Prediction for Predictive (P) and Bidirectionally Predictive (B) Pictures
US20040047418A1 (en) 2002-07-19 2004-03-11 Alexandros Tourapis Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures
US7154952B2 (en) 2002-07-19 2006-12-26 Microsoft Corporation Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures
US20080069462A1 (en) 2002-08-08 2008-03-20 Kiyofumi Abe Moving picture coding method and moving picture decoding method
US7233621B2 (en) 2002-10-04 2007-06-19 Lg Electronics, Inc. Method of determining a motion vector for deriving motion vectors of bi-predictive block
US20050129120A1 (en) 2002-10-04 2005-06-16 Jeon Byeong M. Method of determining a motion vector for deriving motion vectors of a bi-predictive image block
US20040136457A1 (en) 2002-10-23 2004-07-15 John Funnell Method and system for supercompression of compressed digital video
US20040141651A1 (en) 2002-10-25 2004-07-22 Junichi Hara Modifying wavelet division level before transmitting data stream
US20040228413A1 (en) 2003-02-18 2004-11-18 Nokia Corporation Picture decoding method
US20050013497A1 (en) 2003-07-18 2005-01-20 Microsoft Corporation Intraframe and interframe interlace coding and decoding
US20050013498A1 (en) 2003-07-18 2005-01-20 Microsoft Corporation Coding of motion vector information
US7567617B2 (en) 2003-09-07 2009-07-28 Microsoft Corporation Predicting motion vectors for fields of forward-predicted interlaced video frames
US7092576B2 (en) 2003-09-07 2006-08-15 Microsoft Corporation Bitplane coding for macroblock field/frame coding type information
US20050100093A1 (en) 2003-09-07 2005-05-12 Microsoft Corporation Signaling field type information
US20050053137A1 (en) 2003-09-07 2005-03-10 Microsoft Corporation Predicting motion vectors for fields of forward-predicted interlaced video frames
US20050053147A1 (en) 2003-09-07 2005-03-10 Microsoft Corporation Motion vector prediction in bi-directionally predicted interlaced field-coded pictures
US20050053149A1 (en) 2003-09-07 2005-03-10 Microsoft Corporation Direct mode motion vectors for Bi-directionally predicted interlaced pictures
US7317839B2 (en) 2003-09-07 2008-01-08 Microsoft Corporation Chroma motion vector derivation for interlaced forward-predicted fields
US7346111B2 (en) 2003-12-10 2008-03-18 Lsi Logic Corporation Co-located motion vector storage
US20050135484A1 (en) 2003-12-18 2005-06-23 Daeyang Foundation (Sejong University) Method of encoding mode determination, method of motion estimation and encoding apparatus
US20050147167A1 (en) 2003-12-24 2005-07-07 Adriana Dumitras Method and system for video encoding using a variable number of B frames
US20050185713A1 (en) 2004-02-24 2005-08-25 Lsi Logic Corporation Method and apparatus for determining a second picture for temporal direct-mode block prediction
US20050207490A1 (en) 2004-03-18 2005-09-22 Wang Jason N Stored picture index for AVC coding
US20050249291A1 (en) 2004-05-07 2005-11-10 Stephen Gordon Method and system for generating a transform size syntax element for video decoding
US20060013307A1 (en) 2004-07-06 2006-01-19 Yannick Olivier Method or device for coding a sequence of source pictures
US20070177674A1 (en) 2006-01-12 2007-08-02 Lg Electronics Inc. Processing multiview video
US20090238269A1 (en) 2006-07-06 2009-09-24 Purvin Bibhas Pandit Method and Apparatus for Decoupling Frame Number and/or Picture Order Count (POC) for Multi-View Video Encoding and Decoding
US20080043845A1 (en) 2006-08-17 2008-02-21 Fujitsu Limited Motion prediction processor with read buffers providing reference motion vectors for direct mode coding
US20080117985A1 (en) 2006-10-16 2008-05-22 Nokia Corporation System and method for implementing efficient decoded buffer management in multi-view video coding
JP3129986U (en) 2006-12-26 2007-03-08 ライオン株式会社 Plate cushioning material

Non-Patent Citations (99)

* Cited by examiner, † Cited by third party
Title
"The TML Project Web-Page and Archive," (including pages of code marked "image.cpp for H.26L decoder, Copyright 1999" and "image.c"), 24 pp.
Abe et al., "Clarification and Improvement of Direct Mode," JVT-D033, 9 pp. (document marked Jul. 16, 2002).
Anonymous, "DivX Multi Standard Video Encoder," 2 pp.
Chalidabhongse et al., "Fast motion vector estimation using multiresolution spatio-temporal correlations," IEEE Transactions on Circuits and Systems for Video Technology, pp. 477-488 (Jun. 1997).
Chujoh et al., "Verification result on the combination of spatial and temporal," JVT-E095, 5 pp. (Oct. 2002).
Decision on Grant dated Apr. 2, 2007, from Russian Patent Application No. 2003116281, 5 pp.
Ericsson, "Fixed and Adaptive Predictors for Hybrid Predictive/Transform Coding," IEEE Transactions on Comm., vol. COM-33, No. 12, pp. 1291-1302 (1985).
European Official Communication dated Oct. 28, 2005, from European Patent Application No. 03 011 935.8, 3 pp.
European Search Report dated Dec. 4, 2003, from European Patent Application No. 03 011 935.8, 5 pp.
Examiner's First Report dated Nov. 29, 2007, from Australian Patent Application No. 2003204477, 2 pp.
Examiner's Report No. 2 dated Jun. 24, 2008, from Australian Patent Application No. 2003204477, 2 pp.
Flierl et al., "Multihypothesis Motion Estimation for Video Coding," Proc. DCC, 10 pp. (Mar. 2001).
Fogg, "Survey of Software and Hardware VLC Architectures," SPIE, vol. 2186, pp. 29-37 (1994).
Girod, "Efficiency Analysis of Multihypothesis Motion-Compensated Prediction for Video Coding," IEEE Transactions on Image Processing, vol. 9, No. 2, pp. 173-183 (Feb. 2000).
Girod, "Motion-Compensation: Visual Aspects, Accuracy, and Fundamental Limits," Motion Analysis and Image Sequence Processing, Kluwer Academic Publishers, pp. 125-152 (1993).
Grigoriu, "Spatio-temporal compression of the motion field in video coding," 2001 IEEE Fourth Workshop on Multimedia Signal Processing, pp. 129-134 (Oct. 2001).
Gu et al., "Introducing Direct Mode P-picture (DP) to reduce coding complexity," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Document No. JVT-C044, 10 pp. (Mar. 2002).
Horn et al., "Estimation of Motion Vector Fields for Multiscale Motion Compensation," Proc. Picture Coding Symp. (PCS 97), pp. 141-144 (Sep. 1997).
Hsu et al., "A Low Bit-Rate Video Codec Based on Two-Dimensional Mesh Motion Compensation with Adaptive Interpolation," IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, No. 1, pp. 111-117 (Jan. 2001).
Huang et al., "Hardware architecture design for variable block size motion estimation in MPEG-4 AVC/JVT/ITU-T H.264," Proc. of the 2003 Int'l Symposium on Circuits & Sys. (ISCAS '03), vol. 2, pp. 796-799 (May 2003).
ISO/IEC, "Information Technology-Coding of Audio-Visual Objects: Visual, ISO/IEC 14496-2, Committee Draft," 330 pp. (1998).
ISO/IEC, "ISO/IEC 11172-2: Information Technology-Coding of Moving Pictures and Associated Audio for Storage Mediaat up to About 1.5 Mbit/s," 122 pp. (1993).
ISO/IEC, "MPEG-4 Video Verification Model Version 10.0," ISO/IEC JTC1/SC29/WG11, MPEG98/N1992, 305 pp. (1998).
ISO/IEC, "MPEG-4 Video Verification Model Version 18.0," ISO/IEC JTC1/SC29/WG11 N3908, Pisa, pp. 1-10, 299-311 (Jan. 2001).
ITU-Q15-F-24, "MVC Video Codec-Proposal for H.26L," Study Group 16, Video Coding Experts Group (Question 15), 28 pp. (document marked as generated in 1998).
ITU-T, "ITU-T Recommendation H.261: Video Codec for Audiovisual Services at p x 64 kbits," 28 pp. (1993).
ITU-T, "ITU-T Recommendation H.262: Information Technology-Generic Coding of Moving Pictures and Associated Audio Information: Video," 218 pp. (1995).
ITU-T, "ITU-T Recommendation H.263: Video Coding for Low Bit Rate Communication," 167 pp. (1998).
Jeon et al., "B picture coding for sequence with repeating scene changes," JVT-C120, 9 pp. (document marked May 1, 2002).
Jeon, "Clean up for temporal direct mode," JVT-E097, 13 pp. (Oct. 2002).
Jeon, "Direct mode in B pictures," JVT-D056, 10 pp. (Jul. 2002).
Jeon, "Motion vector prediction and prediction signal in B pictures," JVT-D057, 5 pp. (Jul. 2002).
Ji et al., "New Bi-Prediction Techniques for B Pictures Coding," IEEE Int'l Conf. on Multimedia and Expo, pp. 101-104 (Jun. 2004).
Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, "Joint Model No. 1, Revision 1 (JM-1r1)," JVT-A003r1, Pattaya, Thailand, 80 pp. (Dec. 2001).
Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, "Study of Final Committee Draft of Joint Video Specification," JVT-F100, Awaji Island, 242 pp. (Dec. 2002).
Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Working Draft No. 2, Revision 0 (WD-2), JVT-B118r1, 105 pp. (Jan. 2002).
Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG, Working Draft No. 2, Revision 2 (WD-2), JVT-B118r2, 106 pp. (Jan. 2002).
Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, "Joint Final Committee Draft (JFCD) of Joint Video Specification (ITU-T Recommendation H.264, ISO/IEC 14496-10 AVC," JVT-D157 (Aug. 2002).
Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, "Text of Committee Draft of Joint Video Specification (ITU-T Rec. H.264, ISO/IEC 14496-10 AVC)," Document JVT-C167, 143 pp. (May 2002).
Kadono et al., "Memory reduction for temporal technique of direct mode," JVT-E076, 12 pp. (Oct. 2002).
Ko et al., "Fast Intra-Mode Decision Using Inter-Frame Correlation for H.264/AVC," Proc. IEEE ISCE 2008, 4 pages (Apr. 2008).
Kondo et al., "New Prediction Method to Improve B-picture Coding Efficiency," VCEG-O26, 9 pp. (document marked Nov. 26, 2001).
Kondo et al., "Proposal of Minor Changes to Multi-frame Buffering Syntax for Improving Coding Efficiency of B-pictures," JVT-B057, 10 pp. (document marked Jan. 23, 2002).
Konrad et al., "On Motion Modeling and Estimation for Very Low Bit Rate Video Coding," Visual Comm. & Image Processing (VCIP '95), 12 pp. (May 1995).
Kossentini et al., "Predictive RD Optimized Motion Estimation for Very Low Bit-rate Video Coding," IEEE J. on Selected Areas in Communications, vol. 15, No. 9 pp. 1752-1763 (Dec. 1997).
Lainema et al., "Skip Mode Motion Compensation," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-C027, 8 pp. (May 2002).
Microsoft Corporation, "Microsoft Debuts New Windows Media Players 9 Series, Redefining Digital Media on the PC," 4 pp. (Sep. 4, 2002) [Downloaded from the World Wide Web on May 14, 2004].
Mook, "Next-Gen Windows Media Player Leaks to the Web," BetaNews, 17 pp. (Jul. 19, 2002) [Downloaded from the World Wide Web on Aug. 8, 2003].
Notice of Acceptance dated Feb. 26, 2009, from Australian Patent Application No. 2003204477, 3 pp.
Notice of Allowance dated Apr. 1, 2011, from Japanese Patent Application No. 2003-157240, 6 pp.
Notice of Allowance dated Apr. 12, 2010, from Korean Patent Application No. 10-2003-0035240, 2 pp.
Notice of Preliminary Rejection dated Sep. 24, 2009, from Korean Patent Application No. 10-2003-0035240, 4 pp.
Notice of Rejection dated Dec. 8, 2009, from Japanese Patent Application No. 2003-157240, 5 pp.
Notice of Rejection dated Sep. 17, 2010, from Japanese Patent Application No. 2003-157240, 3 pp.
Notice on Grant of Patent Right for Invention dated Sep. 19, 2008, from Chinese Patent Application No. 03141275.0, 4 pp.
Notice on Office Action dated Sep. 1, 2006, from Chinese Patent Application No. 03141275.0, 9 pp.
Official Action dated Dec. 11, 2006, from Russian Patent Application No. 2003116281, 10 pp.
Official Action dated Mar. 22, 2012, from Canadian Patent Application No. 2,430,460, 3 pp.
Official Action dated Sep. 21, 2011, from Canadian Patent Application No. 2,430,460, 3 pp.
Official Notice of Final Rejection dated Apr. 9, 2010, from Japanese Patent Application No. 2003-157240, 4 pp.
Panusopone et al., "Direct Prediction for Predictive (P) Picture in Field Coding mode," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, Document JVT-D046, 8 pp. (Jul. 2002).
Pourazad et al., "An H.264-based Video Encoding Scheme for 3D TV," EURASIP European Signal Processing Conference-EUSIPCO, Florence, Italy, 5 pages (Sep. 2006).
Printouts of FTP directories from http://ftp3.itu.ch, 8 pp. (downloaded from the World Wide Web on Sep. 20, 2005).
Reader, "History of MPEG Video Compression-Ver. 4.0," 99 pp. (document marked Dec. 16, 2003).
Schwarz et al., "Core Experiment Results on Improved Macroblock Prediction Modes," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-B054, 10 pp. (Jan.-Feb. 2002).
Schwarz et al., "Tree-structured macroblock partition," ITU-T SG16/Q.6 VCEG-O17, 6 pp. (Dec. 2001).
Sullivan et al., "The H.264/AVC Advanced Video Coding Standard: Overview and Introduction to the Fidelity Range Extensions," 21 pp. (Aug. 2004).
Suzuki et al., "Study of direct mode," JVT-E071 rl, 7 pp. (Oct. 2002).
Suzuki, "Handling of reference pictures and MVs for direct mode," JVT-D050, 11 pp. (Jul. 2002).
The Second Office Action dated Nov. 16, 2007, from Chinese Patent Application No. 03141275.0, 8 pp.
Tourapis et al., "B picture and ABP finalization," JVT-E018, 2 pp. (Oct. 2002).
Tourapis et al., "Direct Mode Coding for Bipredictive Slices in the H.264 Standard," IEEE Trans. on Circuits and Systems for Video Technology, vol. 15, No. 1, pp. 119-126 (Jan. 2005).
Tourapis et al., "Direct Prediction for Predictive (P) and Bidirectionally Predictive (B) frames in Video Coding ," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-C128, 11 pp. (May 2002).
Tourapis et al., "Motion Vector Prediction in Bidirectionally Predictive (B) frames with regards to Direct Mode," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-C127, 7 pp. (May 2002).
Tourapis et al., "Performance Comparison of Temporal and Spatial Direct mode," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-E026, 7 pp. (Oct. 2002).
Tourapis et al., "Temporal Interpolation of Video Sequences Using Zonal Based Algorithms," IEEE, pp. 895-898 (Oct. 2001).
Tourapis et al., "Timestamp Independent Motion Vector Prediction for P and B frames with Division Elimination," Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), Document JVT-D040, 18 pp. (Jul. 2002).
U.S. Appl. No. 10/462,085.
U.S. Appl. No. 10/622,378.
U.S. Appl. No. 10/942,524.
U.S. Appl. No. 11/275,103.
U.S. Appl. No. 11/465,938.
U.S. Appl. No. 11/525,059.
U.S. Appl. No. 11/824,550.
U.S. Appl. No. 12/364,325.
U.S. Appl. No. 12/474,821.
U.S. Appl. No. 13/459,809.
U.S. Appl. No. 60/341,674, filed Dec. 17, 2001, Lee et al.
U.S. Appl. No. 60/488,710, filed Jul. 18, 2003, Srinivasan et al.
U.S. Appl. No. 60/501,081, filed Sep. 7, 2003, Srinivasan et al.
Wang et al., "Adaptive frame/field coding for JVT Video Coding," ITU-T SG16 Q.6 JVT-B071, 24 pp. (Jan. 2002).
Wang et al., "Interlace Coding Tools for H.26L Video Coding," ITU-T SG16/Q.6 VCEG-O37, pp. 1-20 (Dec. 2001).
Wiegand et al., "Long-term Memory Motion Compensated Prediction," IEEE Transactions on Circuits & Systems for Video Technology, vol. 9, No. 1, pp. 70-84 (Feb. 1999).
Wiegand et al., "Motion-compensating Long-term Memory Prediction," Proc. Int'l Conf. on Image Processing, 4 pp. (Oct. 1997).
Wiegand, "H.26L Test Model Long-Term No. 9 (TML-9) draft 0," ITU-Telecommunications Standardization Sector, Study Group 16, VCEG-N83, 74 pp. (Dec. 2001).
Wien, "Variable Block-Size Transforms for Hybrid Video Coding," Dissertation, 182 pp. (Feb. 2004).
Winger et al., "HD temporal direct-mode verification & text," JVT-E037, 8 pp. (Oct. 2002).
Wu et al., "Joint estimation of forward and backward motion vectors for interpolative prediction of video," IEEE Transactions on Image Processing, vol. 3, No. 5, pp. 684-687 (Sep. 1994).
Yu et al., "Two-Dimensional Motion Vector Coding for Low Bitrate Videophone Applications," Proc. Int'l Conf on Image Processing, Los Alamitos, US, pp. 414-417, IEEE Comp. Soc. Press (1995).

Cited By (83)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11575934B2 (en) * 2002-06-03 2023-02-07 Microsoft Technology Licensing, Llc Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation
US20220167006A1 (en) * 2002-06-03 2022-05-26 Microsoft Technology Licensing, Llc Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US20190098296A1 (en) * 2007-06-15 2019-03-28 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20220337816A1 (en) * 2007-06-15 2022-10-20 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US10178383B2 (en) * 2007-06-15 2019-01-08 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20190098297A1 (en) * 2007-06-15 2019-03-28 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US11438575B2 (en) * 2007-06-15 2022-09-06 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20190098298A1 (en) * 2007-06-15 2019-03-28 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US11863740B2 (en) * 2007-06-15 2024-01-02 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20190110044A1 (en) * 2007-06-15 2019-04-11 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US20130188713A1 (en) * 2007-06-15 2013-07-25 Sungkyunkwan University Foundation For Corporate Collaboration Bi-prediction coding method and apparatus, bi-prediction decoding method and apparatus, and recording medium
US11917186B2 (en) 2011-04-12 2024-02-27 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US10178404B2 (en) 2011-04-12 2019-01-08 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US11012705B2 (en) 2011-04-12 2021-05-18 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US10382774B2 (en) 2011-04-12 2019-08-13 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US9872036B2 (en) 2011-04-12 2018-01-16 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US11356694B2 (en) 2011-04-12 2022-06-07 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US9445120B2 (en) 2011-04-12 2016-09-13 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US10536712B2 (en) 2011-04-12 2020-01-14 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US10609406B2 (en) 2011-04-12 2020-03-31 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus and moving picture coding and decoding apparatus
US10484708B2 (en) 2011-05-24 2019-11-19 Velos Media, Llc Decoding method and apparatuses with candidate motion vectors
US11228784B2 (en) 2011-05-24 2022-01-18 Velos Media, Llc Decoding method and apparatuses with candidate motion vectors
US9826249B2 (en) 2011-05-24 2017-11-21 Velos Media, Llc Decoding method and apparatuses with candidate motion vectors
US10129564B2 (en) 2011-05-24 2018-11-13 Velos Media, LCC Decoding method and apparatuses with candidate motion vectors
US11076170B2 (en) 2011-05-27 2021-07-27 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US9485518B2 (en) 2011-05-27 2016-11-01 Sun Patent Trust Decoding method and apparatus with candidate motion vectors
US10708598B2 (en) 2011-05-27 2020-07-07 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US11895324B2 (en) 2011-05-27 2024-02-06 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US10034001B2 (en) 2011-05-27 2018-07-24 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US9615107B2 (en) 2011-05-27 2017-04-04 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US10200714B2 (en) 2011-05-27 2019-02-05 Sun Patent Trust Decoding method and apparatus with candidate motion vectors
US11575930B2 (en) 2011-05-27 2023-02-07 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US10212450B2 (en) 2011-05-27 2019-02-19 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US11570444B2 (en) 2011-05-27 2023-01-31 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US9883199B2 (en) 2011-05-27 2018-01-30 Sun Patent Trust Coding method and apparatus with candidate motion vectors
US10595023B2 (en) 2011-05-27 2020-03-17 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US9838695B2 (en) * 2011-05-27 2017-12-05 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US20170163987A1 (en) * 2011-05-27 2017-06-08 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US11115664B2 (en) 2011-05-27 2021-09-07 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US10721474B2 (en) 2011-05-27 2020-07-21 Sun Patent Trust Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus
US9723322B2 (en) 2011-05-27 2017-08-01 Sun Patent Trust Decoding method and apparatus with candidate motion vectors
US10412404B2 (en) 2011-05-31 2019-09-10 Velos Media, Llc Image decoding method and image decoding apparatus using candidate motion vectors
US11368710B2 (en) 2011-05-31 2022-06-21 Velos Media, Llc Image decoding method and image decoding apparatus using candidate motion vectors
US9819961B2 (en) 2011-05-31 2017-11-14 Sun Patent Trust Decoding method and apparatuses with candidate motion vectors
US9609356B2 (en) 2011-05-31 2017-03-28 Sun Patent Trust Moving picture coding method and apparatus with candidate motion vectors
US11057639B2 (en) 2011-05-31 2021-07-06 Sun Patent Trust Derivation method and apparatuses with candidate motion vectors
US11509928B2 (en) 2011-05-31 2022-11-22 Sun Patent Trust Derivation method and apparatuses with candidate motion vectors
US9900613B2 (en) 2011-05-31 2018-02-20 Sun Patent Trust Image coding and decoding system using candidate motion vectors
US10951911B2 (en) 2011-05-31 2021-03-16 Velos Media, Llc Image decoding method and image decoding apparatus using candidate motion vectors
US10645413B2 (en) 2011-05-31 2020-05-05 Sun Patent Trust Derivation method and apparatuses with candidate motion vectors
US10652573B2 (en) 2011-05-31 2020-05-12 Sun Patent Trust Video encoding method, video encoding device, video decoding method, video decoding device, and video encoding/decoding device
US11917192B2 (en) 2011-05-31 2024-02-27 Sun Patent Trust Derivation method and apparatuses with candidate motion vectors
US10887585B2 (en) 2011-06-30 2021-01-05 Sun Patent Trust Image decoding method, image coding method, image decoding apparatus, image coding apparatus, and image coding and decoding apparatus
US10284872B2 (en) 2011-08-03 2019-05-07 Sun Patent Trust Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus
US10129561B2 (en) 2011-08-03 2018-11-13 Sun Patent Trust Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus
US11553202B2 (en) 2011-08-03 2023-01-10 Sun Patent Trust Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus
US9456214B2 (en) 2011-08-03 2016-09-27 Sun Patent Trust Moving picture coding method, moving picture coding apparatus, moving picture decoding method, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10440387B2 (en) 2011-08-03 2019-10-08 Sun Patent Trust Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus
US11218708B2 (en) 2011-10-19 2022-01-04 Sun Patent Trust Picture decoding method for decoding using a merging candidate selected from a first merging candidate derived using a first derivation process and a second merging candidate derived using a second derivation process
US11647208B2 (en) 2011-10-19 2023-05-09 Sun Patent Trust Picture coding method, picture coding apparatus, picture decoding method, and picture decoding apparatus
US10616601B2 (en) 2012-01-20 2020-04-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US10129563B2 (en) 2012-01-20 2018-11-13 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US9591328B2 (en) 2012-01-20 2017-03-07 Sun Patent Trust Methods and apparatuses for encoding and decoding video using temporal motion vector prediction
US9648323B2 (en) 2012-02-03 2017-05-09 Sun Patent Trust Image coding method and image coding apparatus
US10904554B2 (en) 2012-02-03 2021-01-26 Sun Patent Trust Image coding method and image coding apparatus
US10334268B2 (en) 2012-02-03 2019-06-25 Sun Patent Trust Image coding method and image coding apparatus
US20140016702A1 (en) * 2012-02-03 2014-01-16 Panasonic Corporation Image decoding method and image decoding apparatus
US10623762B2 (en) 2012-02-03 2020-04-14 Sun Patent Trust Image coding method and image coding apparatus
US9609320B2 (en) * 2012-02-03 2017-03-28 Sun Patent Trust Image decoding method and image decoding apparatus
US11451815B2 (en) 2012-02-03 2022-09-20 Sun Patent Trust Image coding method and image coding apparatus
US10034015B2 (en) 2012-02-03 2018-07-24 Sun Patent Trust Image coding method and image coding apparatus
US9883201B2 (en) 2012-02-03 2018-01-30 Sun Patent Trust Image coding method and image coding apparatus
US11812048B2 (en) 2012-02-03 2023-11-07 Sun Patent Trust Image coding method and image coding apparatus
US11595682B2 (en) 2012-03-06 2023-02-28 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10880572B2 (en) 2012-03-06 2020-12-29 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10212447B2 (en) 2012-03-06 2019-02-19 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10560716B2 (en) 2012-03-06 2020-02-11 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US9479777B2 (en) 2012-03-06 2016-10-25 Sun Patent Trust Moving picture coding method, moving picture decoding method, moving picture coding apparatus, moving picture decoding apparatus, and moving picture coding and decoding apparatus
US10205962B2 (en) 2013-03-15 2019-02-12 Raymond Zenkich System and method for non-uniform video coding
US10999599B2 (en) 2013-03-15 2021-05-04 Raymond Zenkich System and method for non-uniform video coding
US20140270555A1 (en) * 2013-03-18 2014-09-18 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding an image by using an adaptive search range decision for motion estimation
US9438929B2 (en) * 2013-03-18 2016-09-06 Samsung Electronics Co., Ltd. Method and apparatus for encoding and decoding an image by using an adaptive search range decision for motion estimation
US9392293B2 (en) * 2014-05-21 2016-07-12 Alcatel Lucent Accelerated image processing

Also Published As

Publication number Publication date
US11575934B2 (en) 2023-02-07
US9185427B2 (en) 2015-11-10
US20200275123A1 (en) 2020-08-27
US20070014358A1 (en) 2007-01-18
CN1471320A (en) 2004-01-28
EP1369820A3 (en) 2004-03-03
CN100455018C (en) 2009-01-21
US10694208B2 (en) 2020-06-23
US20150016527A1 (en) 2015-01-15
BR0302164A (en) 2004-09-08
US20190045216A1 (en) 2019-02-07
JP4733341B2 (en) 2011-07-27
US20040001546A1 (en) 2004-01-01
EP1369820A2 (en) 2003-12-10
CA2430460A1 (en) 2003-12-03
US20130148737A1 (en) 2013-06-13
US20170118488A1 (en) 2017-04-27
US9571854B2 (en) 2017-02-14
US20160134890A1 (en) 2016-05-12
AU2003204477A1 (en) 2004-01-08
US20220167006A1 (en) 2022-05-26
US10116959B2 (en) 2018-10-30
AU2003204477B2 (en) 2009-03-12
CA2430460C (en) 2013-05-21
KR20030094086A (en) 2003-12-11
US8873630B2 (en) 2014-10-28
KR100958499B1 (en) 2010-05-17
MXPA03004906A (en) 2004-10-15
JP2004040785A (en) 2004-02-05
RU2310231C2 (en) 2007-11-10
US11277636B2 (en) 2022-03-15

Similar Documents

Publication Publication Date Title
US11277636B2 (en) Spatiotemporal prediction for bidirectionally predictive (b) pictures and motion vector prediction for multi-picture reference motion compensation
US10708582B2 (en) Video coding
US7154952B2 (en) Timestamp-independent motion vector prediction for predictive (P) and bidirectionally predictive (B) pictures

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034542/0001

Effective date: 20141014

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8