SG11202001643TA - System and method for foveated compression of image frames in a system on a chip - Google Patents

System and method for foveated compression of image frames in a system on a chip

Info

Publication number
SG11202001643TA
SG11202001643TA SG11202001643TA SG11202001643TA SG11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA SG 11202001643T A SG11202001643T A SG 11202001643TA
Authority
SG
Singapore
Prior art keywords
chip
image frames
foveated compression
foveated
compression
Prior art date
Application number
SG11202001643TA
Other languages
English (en)
Inventor
Meghal Varia
Serag Gadelrab
Wesley James Holland
Joseph Cheung
Dam Backer
Tom Longo
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of SG11202001643TA publication Critical patent/SG11202001643TA/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162—User input
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0207—Addressing or allocation; Relocation with multidimensional access, e.g. row/column, matrix
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/115—Selection of the code volume for a coding unit prior to coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/174—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a slice, e.g. a line of blocks or a group of blocks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/917—Television signal processing therefor for bandwidth reduction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1041—Resource optimization
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/40—Specific encoding of data in memory or cache
    • G06F2212/401—Compressed data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/50—Control mechanisms for virtual memory, cache or TLB
    • G06F2212/502—Control mechanisms for virtual memory, cache or TLB using adaptive policy
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Discrete Mathematics (AREA)
  • Mathematical Physics (AREA)
  • General Engineering & Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Studio Devices (AREA)
SG11202001643TA 2017-10-06 2018-09-07 System and method for foveated compression of image frames in a system on a chip SG11202001643TA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/727,517 US10511842B2 (en) 2017-10-06 2017-10-06 System and method for foveated compression of image frames in a system on a chip
PCT/US2018/049948 WO2019070365A1 (fr) 2017-10-06 2018-09-07 Système et procédé de compression fovéale de trames d'image dans un système sur puce

Publications (1)

Publication Number Publication Date
SG11202001643TA true SG11202001643TA (en) 2020-04-29

Family

ID=63684597

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202001643TA SG11202001643TA (en) 2017-10-06 2018-09-07 System and method for foveated compression of image frames in a system on a chip

Country Status (6)

Country Link
US (2) US10511842B2 (fr)
EP (2) EP3692444B1 (fr)
CN (2) CN117135356A (fr)
SG (1) SG11202001643TA (fr)
TW (1) TWI705695B (fr)
WO (1) WO2019070365A1 (fr)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110999287A (zh) * 2017-06-05 2020-04-10 因默希弗机器人私人有限公司 数字内容流压缩
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip
US11315327B1 (en) 2018-11-02 2022-04-26 Facebook Technologies, Llc. Beam-racing fallbacks in a display engine
WO2020130925A1 (fr) * 2018-12-20 2020-06-25 Telefonaktiebolaget Lm Ericsson (Publ) Procédé et appareil de codage vidéo utilisant une séparation uniforme de segment dans des images
TWI699661B (zh) * 2019-07-11 2020-07-21 台達電子工業股份有限公司 場景模型之建構系統及其建構方法
CN112215940B (zh) 2019-07-11 2024-01-19 台达电子工业股份有限公司 场景模型的建构系统及其建构方法
CN114175630A (zh) * 2019-07-28 2022-03-11 谷歌有限责任公司 利用注视点网格渲染沉浸式视频内容的方法、系统和介质
CN114731421A (zh) * 2019-09-24 2022-07-08 弗劳恩霍夫应用研究促进协会 现代混合图像和视频编码方案中的多级残差编码
CN113518249B (zh) * 2020-04-10 2023-03-10 华为技术有限公司 一种远端图像处理方法及装置
US11871131B2 (en) * 2021-08-06 2024-01-09 Raytheon Company Foveal compressive upsampling

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6252989B1 (en) 1997-01-07 2001-06-26 Board Of The Regents, The University Of Texas System Foveated image coding system and method for image bandwidth reduction
US6879266B1 (en) * 1997-08-08 2005-04-12 Quickshift, Inc. Memory module including scalable embedded parallel data compression and decompression engines
WO2000062543A1 (fr) 1999-04-08 2000-10-19 New York University Affichage a tres haute resolution obtenu par foveation
US7167519B2 (en) 2001-12-20 2007-01-23 Siemens Corporate Research, Inc. Real-time video object generation for smart cameras
KR100723505B1 (ko) * 2005-10-06 2007-05-30 삼성전자주식회사 하이브리드 방식의 영상 데이터 처리 시스템 및 영상데이터 처리 방법
US7481533B2 (en) * 2006-10-30 2009-01-27 Johnson & Johnson Vision Care, Inc Method for designing multifocal contact lenses
JP4807284B2 (ja) * 2007-03-07 2011-11-02 カシオ計算機株式会社 カメラ装置、カメラ装置制御プログラム及びカメラ装置制御方法
US8395490B2 (en) * 2008-03-27 2013-03-12 Panasonic Corporation Blind spot display apparatus
US8194736B2 (en) * 2008-04-15 2012-06-05 Sony Corporation Video data compression with integrated lossy and lossless compression
JP5492139B2 (ja) * 2011-04-27 2014-05-14 富士フイルム株式会社 画像圧縮装置、画像伸長装置、方法、及びプログラム
US20140204107A1 (en) * 2013-01-22 2014-07-24 Vixs Systems, Inc. Video processor with frame buffer compression and methods for use therewith
CN104969262A (zh) 2013-03-08 2015-10-07 英特尔公司 用于基于感兴趣的区域的图像编码的技术
US9230302B1 (en) 2013-03-13 2016-01-05 Hrl Laboratories, Llc Foveated compressive sensing system
US10242462B2 (en) * 2013-04-02 2019-03-26 Nvidia Corporation Rate control bit allocation for video streaming based on an attention area of a gamer
EP2958074A1 (fr) * 2014-06-17 2015-12-23 Thomson Licensing Procédé et dispositif d'affichage avec optimisation de répartition de pixel
TWI571768B (zh) * 2015-04-29 2017-02-21 由田新技股份有限公司 使用者介面同步系統、裝置、方法、電腦可讀取記錄媒體、及電腦程式產品
US20200081524A1 (en) 2015-08-07 2020-03-12 Apple Inc. Method and appartus for data capture and evaluation of ambient data
US10424097B2 (en) * 2017-04-01 2019-09-24 Intel Corporation Predictive viewport renderer and foveated color compressor
US10511842B2 (en) 2017-10-06 2019-12-17 Qualcomm Incorporated System and method for foveated compression of image frames in a system on a chip

Also Published As

Publication number Publication date
EP3692444C0 (fr) 2023-08-02
US20200092564A1 (en) 2020-03-19
CN117135356A (zh) 2023-11-28
EP4242856A3 (fr) 2023-11-01
EP3692444A1 (fr) 2020-08-12
TW201926990A (zh) 2019-07-01
US20190110053A1 (en) 2019-04-11
TWI705695B (zh) 2020-09-21
EP3692444B1 (fr) 2023-08-02
US11006127B2 (en) 2021-05-11
WO2019070365A1 (fr) 2019-04-11
US10511842B2 (en) 2019-12-17
CN111149095A (zh) 2020-05-12
EP4242856A2 (fr) 2023-09-13
CN111149095B (zh) 2023-08-01

Similar Documents

Publication Publication Date Title
SG11202001643TA (en) System and method for foveated compression of image frames in a system on a chip
IL268214A (en) A method for image processing and video compression
GB2581907B (en) Image enhancement method and system
ZA201705418B (en) Image recognition system and method
IL273446B (en) Method and system for identifying content in an image
EP3541073A4 (fr) Procédé et dispositif de décodage d'image dans un système de codage d'images
EP3595302A4 (fr) Procédé et dispositif de réalisation de décodage d'image basé sur une intraprédiction dans un système de codage d'image
HK1247722A1 (zh) 圖像處理方法及系統
EP3367681A4 (fr) Procédé et dispositif de décodage d'image à base de modélisation dans un système de codage d'image
EP3472806A4 (fr) Procédé et appareil de compression d'image
IL246766A0 (en) Polarization simulation for a face recognition improvement system and method
EP3313079A4 (fr) Procédé et dispositif de filtrage d'image dans un système de codage d'image
EP3687157A4 (fr) Procédé de capture d'images et dispositif électronique
EP3474536A4 (fr) Procédé et système de photographie destinés à une télévision intelligente
GB201713829D0 (en) Image data processing system and method
GB2579911B (en) Image enhancement system and method
EP3258689A4 (fr) Procédé et dispositif de compression d'image sur la base d'informations de photographie
EP3613212C0 (fr) Système et procédé de compression de données/trames intelligentes dans un système sur puce
GB2566020B (en) System and method for motion compensation in images
GB2578629B (en) Device and method for processing rendered frames
GB201520023D0 (en) Method and system for processing image data
SG10201906401VA (en) Object recognition system and method using simulated object images
HK1257704A1 (zh) 全方位影像成像方法及執行該方法的設備
IL261652B (en) A system and method for comparing images
IL280232A (en) System and method for video compression based on content layers