EP2232385A4 - System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity - Google Patents

System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Info

Publication number
EP2232385A4
EP2232385A4 EP20080856703 EP08856703A EP2232385A4 EP 2232385 A4 EP2232385 A4 EP 2232385A4 EP 20080856703 EP20080856703 EP 20080856703 EP 08856703 A EP08856703 A EP 08856703A EP 2232385 A4 EP2232385 A4 EP 2232385A4
Authority
EP
European Patent Office
Prior art keywords
system
method
image tiles
compressing video
allocating bits
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP20080856703
Other languages
German (de)
French (fr)
Other versions
EP2232385A1 (en
Inventor
Der Laan Roger Van
Stephen G Perlman
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OL2 Inc
Original Assignee
OnLive Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US99968807A priority Critical
Application filed by OnLive Inc filed Critical OnLive Inc
Priority to PCT/US2008/085598 priority patent/WO2009073823A1/en
Publication of EP2232385A1 publication Critical patent/EP2232385A1/en
Publication of EP2232385A4 publication Critical patent/EP2232385A4/en
Application status is Ceased legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/107Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/335Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/355Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an MPEG-stream for transmitting to a mobile phone or a thin client
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/358Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/164Feedback from the receiver or from the transmission channel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/436Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/65Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
    • H04N19/67Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience involving unequal error protection [UEP], i.e. providing protection according to the importance of the data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/23805Controlling the feeding rate to the network, e.g. by controlling the video pump
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2383Channel coding or modulation of digital bit-stream, e.g. QPSK modulation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27Server based end-user applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6583Acknowledgement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection
EP20080856703 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity Ceased EP2232385A4 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US99968807A true 2007-12-05 2007-12-05
PCT/US2008/085598 WO2009073823A1 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP14186904.0A EP2826531A3 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP14186904.0A Division EP2826531A3 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Publications (2)

Publication Number Publication Date
EP2232385A1 EP2232385A1 (en) 2010-09-29
EP2232385A4 true EP2232385A4 (en) 2011-05-25

Family

ID=40718181

Family Applications (2)

Application Number Title Priority Date Filing Date
EP20080856703 Ceased EP2232385A4 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity
EP14186904.0A Ceased EP2826531A3 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP14186904.0A Ceased EP2826531A3 (en) 2007-12-05 2008-12-04 System and method for compressing video by allocating bits to image tiles based on detected intraframe motion or scene complexity

Country Status (11)

Country Link
EP (2) EP2232385A4 (en)
JP (1) JP2011507345A (en)
KR (1) KR20100103548A (en)
CN (1) CN101918943B (en)
AU (1) AU2008333825A1 (en)
CA (1) CA2707724C (en)
HK (1) HK1149810A1 (en)
NZ (1) NZ585903A (en)
RU (1) RU2010127312A (en)
TW (2) TW200939789A (en)
WO (1) WO2009073823A1 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8926435B2 (en) 2008-12-15 2015-01-06 Sony Computer Entertainment America Llc Dual-mode program execution
US8147339B1 (en) 2007-12-15 2012-04-03 Gaikai Inc. Systems and methods of serving game video
US8613673B2 (en) 2008-12-15 2013-12-24 Sony Computer Entertainment America Llc Intelligent game loading
KR20170129296A (en) 2010-09-13 2017-11-24 소니 인터랙티브 엔터테인먼트 아메리카 엘엘씨 A method and system of providing a computer game at a computer game system including a video server and a game server
US9723319B1 (en) 2009-06-01 2017-08-01 Sony Interactive Entertainment America Llc Differentiation for achieving buffered decoding and bufferless decoding
US8888592B1 (en) 2009-06-01 2014-11-18 Sony Computer Entertainment America Llc Voice overlay
US8968087B1 (en) 2009-06-01 2015-03-03 Sony Computer Entertainment America Llc Video game overlay
US8259808B2 (en) * 2010-03-25 2012-09-04 Mediatek Inc. Low complexity video decoder
US8771064B2 (en) 2010-05-26 2014-07-08 Aristocrat Technologies Australia Pty Limited Gaming system and a method of gaming
TWI405455B (en) * 2010-07-07 2013-08-11 Acer Inc Shutter glasses and method for controlling shutter glasses
US8676591B1 (en) 2010-08-02 2014-03-18 Sony Computer Entertainment America Llc Audio deceleration
US9878240B2 (en) 2010-09-13 2018-01-30 Sony Interactive Entertainment America Llc Add-on management methods
US8385414B2 (en) * 2010-11-30 2013-02-26 International Business Machines Corporation Multimedia size reduction for database optimization
US9325999B2 (en) * 2011-03-10 2016-04-26 Sharp Kabushiki Kaisha Video decoder for slices
US9339726B2 (en) * 2012-06-29 2016-05-17 Nokia Technologies Oy Method and apparatus for modifying the presentation of information based on the visual complexity of environment information
US20160269731A1 (en) * 2013-11-25 2016-09-15 Sony Interactive Entertainment Inc. Image delivery device, image delivery program, and image delivery method
CN106658027B (en) * 2016-11-28 2019-05-24 北京理工大学 The bit rate control method and device of background frames

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6665872B1 (en) * 1999-01-06 2003-12-16 Sarnoff Corporation Latency-based statistical multiplexing
WO2006100664A2 (en) * 2005-03-21 2006-09-28 Yosef Mizrahi Method, system and computer-readable code for providing a computer gaming service

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3069144B2 (en) * 1991-04-30 2000-07-24 オリンパス光学工業株式会社 Moving picture coding apparatus
JPH05111015A (en) * 1991-10-17 1993-04-30 Sony Corp Movement adaptive image encoder
US5558339A (en) 1994-05-05 1996-09-24 Perlman; Stephen G. Network architecture to support recording and playback of real-time video games
US5623424A (en) * 1995-05-08 1997-04-22 Kabushiki Kaisha Toshiba Rate-controlled digital video editing method and system which controls bit allocation of a video encoder by varying quantization levels
FR2821028B1 (en) 2001-02-16 2003-10-17 Faurecia Sieges Automobile Seating apparatus comprising a seat frame
US7023918B2 (en) * 2002-05-30 2006-04-04 Ess Technology, Inc. Color motion artifact detection and processing apparatus compatible with video coding standards
JP4144749B2 (en) * 2003-10-02 2008-09-03 株式会社リコー Image compression decompression system, an image compressing apparatus, an image decompression apparatus, an image compression method and an image decompression method
JP2006304204A (en) * 2005-04-25 2006-11-02 Matsushita Electric Ind Co Ltd Image processor
US8403757B2 (en) * 2006-04-13 2013-03-26 Yosef Mizrachi Method and apparatus for providing gaming services and for handling video content
DE102006029208B4 (en) 2006-06-26 2010-06-10 Franz Josef Summerer Injection molding and injection molding for injection molding of plastic moldings with several Entformrichtungen

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6665872B1 (en) * 1999-01-06 2003-12-16 Sarnoff Corporation Latency-based statistical multiplexing
WO2006100664A2 (en) * 2005-03-21 2006-09-28 Yosef Mizrahi Method, system and computer-readable code for providing a computer gaming service

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
DAPENG WU ET AL: "Transporting Real-Time Video over the Internet: Challenges and Approaches", PROCEEDINGS OF THE IEEE, IEEE. NEW YORK, US, vol. 88, no. 12, 1 December 2000 (2000-12-01), XP011044464, ISSN: 0018-9219 *
HASKELL B G; PURI A; NETRAVALI A N: "DIGITAL VIDEO: AN INTRODUCTION TO MPEG-2, CHAPTER 8: MPEG-2 VIDEO CODING AND COMPRESSION", 1997, CHAPMAN AND HALL, NEW YORK, ISBN: 0-412-08411-2, pages: 156 - 182, XP002633080 *
See also references of WO2009073823A1 *
YAO WANG ET AL: "Error Control and Concealment for Video Communication: A Review", PROCEEDINGS OF THE IEEE, IEEE. NEW YORK, US, vol. 86, no. 5, 1 May 1998 (1998-05-01), XP011044024, ISSN: 0018-9219 *

Also Published As

Publication number Publication date
CN101918943B (en) 2015-02-11
NZ585903A (en) 2013-06-28
WO2009073823A1 (en) 2009-06-11
EP2232385A1 (en) 2010-09-29
EP2826531A2 (en) 2015-01-21
CA2707724C (en) 2017-01-10
CN101918943A (en) 2010-12-15
KR20100103548A (en) 2010-09-27
RU2010127312A (en) 2012-01-10
EP2826531A3 (en) 2015-09-23
AU2008333825A1 (en) 2009-06-11
CA2707724A1 (en) 2009-06-11
TW200939789A (en) 2009-09-16
TW200935920A (en) 2009-08-16
JP2011507345A (en) 2011-03-03
HK1149810A1 (en) 2015-12-18

Similar Documents

Publication Publication Date Title
TWI324014B (en) Image capturing apparatus with zoom function
TWI419567B (en) Video coding with large macroblocks
TWI488506B (en) Video coding with large macroblocks
TWI444048B (en) Fragmented reference in temporal compression for video coding
DK2712200T3 (en) Image decoding method
TWI558109B (en) System and method for compressing video frames or portions thereof based on feedback information from a client device
TWI539230B (en) System for 3d image projections and viewing
TWI396451B (en) System and method for implementing efficient decoded buffer management in multi-view video coding
TWI395143B (en) Human face recognition and user interface system for digital camera and video camera
TWI399097B (en) System and method for encoding video, and computer readable medium
GB2429867B (en) Image stabilization system and method for a video camera
TWI483597B (en) Video conference rate matching
TWI527435B (en) Video camera
TWI437887B (en) Multiview video coding over mpeg-2 systems
IL207018D0 (en) Image coding method and image decoding method
IL187494A (en) Digital tv system
EP2279625A4 (en) Method and apparatus for processing 3d video image
EP2080379A4 (en) System and method for using parallelly decodable slices for multi-view video coding
EP1987674A4 (en) Accelerated video encoding
HK1167463A1 (en) System and method for generating three dimensional images using lidar and video measurements
TWI394433B (en) Image capturing apparatus, light metering method, luminance calculation method, and program
GB0720669D0 (en) Split screen multimedia video conferencing
PT2269371T (en) A method of adapting video images to small screen sizes
MY155173A (en) Method and apparatus for encoding video, and method and apparatus for decoding video
IL215300D0 (en) System and method for compressing video based on latency measurements and other feedback

Legal Events

Date Code Title Description
17P Request for examination filed

Effective date: 20100602

AK Designated contracting states:

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent to

Countries concerned: ALBAMKRS

DAX Request for extension of the european patent (to any country) deleted
A4 Despatch of supplementary search report

Effective date: 20110429

17Q First examination report

Effective date: 20130225

RAP1 Transfer of rights of an ep published application

Owner name: OL2, INC.

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

18R Refused

Effective date: 20141031