SG11202001643TA - System and method for foveated compression of image frames in a system on a chip - Google Patents

System and method for foveated compression of image frames in a system on a chip

Info

Publication number
SG11202001643TA
SG11202001643TA SG11202001643TA SG11202001643TA SG11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA
Authority
SG
Singapore
Prior art keywords
chip
image frames
foveated compression
foveated
compression
Prior art date
Application number
SG11202001643TA
Inventor
Meghal Varia
Serag Gadelrab
Wesley James Holland
Joseph Cheung
Dam Backer
Tom Longo
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11202001643TA publication Critical patent/SG11202001643TA/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162—User input
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0207—Addressing or allocation; Relocation with multidimensional access, e.g. row/column, matrix
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115—Selection of the code volume for a coding unit prior to coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/917—Television signal processing therefor for bandwidth reduction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1041—Resource optimization
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/40—Specific encoding of data in memory or cache
    • G06F2212/401—Compressed data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/50—Control mechanisms for virtual memory, cache or TLB
    • G06F2212/502—Control mechanisms for virtual memory, cache or TLB using adaptive policy
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Discrete Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Studio Devices (AREA)
SG11202001643TA 2017-10-06 2018-09-07 System and method for foveated compression of image frames in a system on a chip SG11202001643TA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/727,517 US10511842B2 (en) 2017-10-06 2017-10-06 System and method for foveated compression of image frames in a system on a chip
PCT/US2018/049948 WO2019070365A1 (en) 2017-10-06 2018-09-07 System and method for foveated compression of image frames in a system on a chip

Publications (1)

Publication Number Publication Date
SG11202001643TA true SG11202001643TA (en) 2020-04-29

Family

ID=63684597

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202001643TA SG11202001643TA (en) 2017-10-06 2018-09-07 System and method for foveated compression of image frames in a system on a chip

Country Status (6)

Country Link
US (2) US10511842B2 (en)
EP (2) EP4242856A3 (en)
CN (2) CN117135356A (en)
SG (1) SG11202001643TA (en)
TW (1) TWI705695B (en)
WO (1) WO2019070365A1 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018223179A1 (en) * 2017-06-05 2018-12-13 Immersive Robotics Pty Ltd Digital content stream compression
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip
US11721307B1 (en) 2018-11-02 2023-08-08 Meta Platforms Technologies, Llc Beam-racing pixel generation in a display engine
JP7182006B2 (en) * 2018-12-20 2022-12-01 テレフオンアクチーボラゲット エルエム エリクソン（パブル） Method and Apparatus for Video Coding Using Uniform Segment Splits in Pictures
CN112215940B (en) 2019-07-11 2024-01-19 台达电子工业股份有限公司 Construction system and construction method of scene model
TWI699661B (en) * 2019-07-11 2020-07-21 台達電子工業股份有限公司 Scene model construction system and scene model constructing method
BR112022001434A2 (en) * 2019-07-28 2022-06-07 Google Llc Methods, systems and media for rendering immersive video content with optimized meshes
EP4035376A1 (en) * 2019-09-24 2022-08-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Multiple stage residual coding in modern hybrid image and video coding solutions
CN113518249B (en) * 2020-04-10 2023-03-10 华为技术有限公司 Far-end image processing method and device
US11871131B2 (en) * 2021-08-06 2024-01-09 Raytheon Company Foveal compressive upsampling

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6252989B1 (en) 1997-01-07 2001-06-26 Board Of The Regents, The University Of Texas System Foveated image coding system and method for image bandwidth reduction
US6879266B1 (en) * 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
WO2000062543A1 (en) 1999-04-08 2000-10-19 New York University Extremely high resolution foveated display
US7167519B2 (en) 2001-12-20 2007-01-23 Siemens Corporate Research, Inc. Real-time video object generation for smart cameras
KR100723505B1 (en) * 2005-10-06 2007-05-30 삼성전자주식회사 System and method for image data processing using hybrid type
US7481533B2 (en) * 2006-10-30 2009-01-27 Johnson & Johnson Vision Care, Inc Method for designing multifocal contact lenses
JP4807284B2 (en) * 2007-03-07 2011-11-02 カシオ計算機株式会社 Camera device, camera device control program, and camera device control method
WO2009119110A1 (en) * 2008-03-27 2009-10-01 パナソニック株式会社 Blind spot display device
US8194736B2 (en) * 2008-04-15 2012-06-05 Sony Corporation Video data compression with integrated lossy and lossless compression
JP5492139B2 (en) * 2011-04-27 2014-05-14 富士フイルム株式会社 Image compression apparatus, image expansion apparatus, method, and program
US20140204107A1 (en) * 2013-01-22 2014-07-24 Vixs Systems, Inc. Video processor with frame buffer compression and methods for use therewith
US20160007026A1 (en) 2013-03-08 2016-01-07 Jie Dong Techniques for image encoding based on region of interest
US9230302B1 (en) 2013-03-13 2016-01-05 Hrl Laboratories, Llc Foveated compressive sensing system
US10242462B2 (en) * 2013-04-02 2019-03-26 Nvidia Corporation Rate control bit allocation for video streaming based on an attention area of a gamer
EP2958074A1 (en) * 2014-06-17 2015-12-23 Thomson Licensing A method and a display device with pixel repartition optimization
TWI571768B (en) * 2015-04-29 2017-02-21 由田新技股份有限公司 A human interface synchronous system, device, method, computer readable media, and computer program product
WO2017025483A1 (en) 2015-08-07 2017-02-16 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method and apparatus for data capture and evaluation of ambient data
US10424097B2 (en) * 2017-04-01 2019-09-24 Intel Corporation Predictive viewport renderer and foveated color compressor
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip

Also Published As

Publication number Publication date
EP3692444A1 (en) 2020-08-12
EP3692444B1 (en) 2023-08-02
US20200092564A1 (en) 2020-03-19
TW201926990A (en) 2019-07-01
CN117135356A (en) 2023-11-28
CN111149095B (en) 2023-08-01
CN111149095A (en) 2020-05-12
EP4242856A2 (en) 2023-09-13
US11006127B2 (en) 2021-05-11
US20190110053A1 (en) 2019-04-11
US10511842B2 (en) 2019-12-17
WO2019070365A1 (en) 2019-04-11
TWI705695B (en) 2020-09-21
EP3692444C0 (en) 2023-08-02
EP4242856A3 (en) 2023-11-01

Similar Documents

Publication Publication Date Title
SG11202001643TA (en) System and method for foveated compression of image frames in a system on a chip
IL268214A (en) Method for image processing and video compression
GB2581907B (en) Image enhancement method and system
EP3541073A4 (en) Method and device for decoding image in image coding system
EP3595302A4 (en) Method and device for performing image decoding on basis of intra prediction in image coding system
HK1247722A1 (en) Method and system for processing image
IL273446B (en) Method and system for image content recognition
EP3367681A4 (en) Modeling-based image decoding method and device in image coding system
EP3472806A4 (en) Image compression method and apparatus
IL246766A0 (en) Polarization imaging for facial recognition enhancement system and method
EP3313079A4 (en) Image filtering method and device in image coding system
EP3687157A4 (en) Method for capturing images and electronic device
GB201713829D0 (en) Image data processing system and method
GB2579911B (en) Image enhancement system and method
EP3613212C0 (en) System and method for intelligent data/frame compression in a system on a chip
EP3474536A4 (en) Photographing method and system for smart television
SG11202008813PA (en) Image recognition system and method
GB2566020B (en) System and method for motion compensation in images
EP3258689A4 (en) Method and device for compressing image on basis of photography information
GB2578629B (en) Device and method for processing rendered frames
SG10201906401VA (en) Object recognition system and method using simulated object images
GB201520023D0 (en) Method and system for processing image data
HK1257704A1 (en) Omnidirectional image capturing method and device for performing method
IL261652B (en) Image comparison system and method
IL280232A (en) System and method for content-layer based video compression