JP7837926B2 - 二重画像モデルを使用した画像符号化のためのシステムおよび方法 - Google Patents

二重画像モデルを使用した画像符号化のためのシステムおよび方法

Info

Publication number
JP7837926B2
JP7837926B2 JP2023061210A JP2023061210A JP7837926B2 JP 7837926 B2 JP7837926 B2 JP 7837926B2 JP 2023061210 A JP2023061210 A JP 2023061210A JP 2023061210 A JP2023061210 A JP 2023061210A JP 7837926 B2 JP7837926 B2 JP 7837926B2
Authority
JP
Japan
Prior art keywords
image
model
video sequence
image data
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2023061210A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023155898A5 (https=
JP2023155898A (ja
Inventor
アクセル ケスキカンガス，
ヴィクトル エドパルム，
Original Assignee
アクシス アーベー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アクシス アーベー filed Critical アクシス アーベー
Publication of JP2023155898A publication Critical patent/JP2023155898A/ja
Publication of JP2023155898A5 publication Critical patent/JP2023155898A5/ja
Application granted granted Critical
Publication of JP7837926B2 publication Critical patent/JP7837926B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/162—User input
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
JP2023061210A 2022-04-11 2023-04-05 二重画像モデルを使用した画像符号化のためのシステムおよび方法 Active JP7837926B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP22167664.6A EP4262209A1 (en) 2022-04-11 2022-04-11 System and method for image coding using dual image models
EP22167664 2022-04-11

Publications (3)

Publication Number Publication Date
JP2023155898A JP2023155898A (ja) 2023-10-23
JP2023155898A5 JP2023155898A5 (https=) 2026-01-20
JP7837926B2 true JP7837926B2 (ja) 2026-03-31

Family

ID=81306805

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2023061210A Active JP7837926B2 (ja) 2022-04-11 2023-04-05 二重画像モデルを使用した画像符号化のためのシステムおよび方法

Country Status (6)

Country Link
US (1) US12401801B2 (https=)
EP (1) EP4262209A1 (https=)
JP (1) JP7837926B2 (https=)
KR (1) KR102945698B1 (https=)
CN (1) CN116896637A (https=)
TW (1) TW202344056A (https=)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12294640B1 (en) * 2023-12-12 2025-05-06 Atombeam Technologies Inc System and method for distributed edge-cloud homomorphic compression using adaptive neural networks
US20240291993A1 (en) * 2023-02-28 2024-08-29 Ford Global Technologies, Llc Rule-based digitized image compression
US20260050893A1 (en) * 2024-08-16 2026-02-19 Saudi Arabian Oil Company Proactive equipment maintenance and control through remote edge monitoring
CN119583816B (zh) * 2024-12-06 2025-09-09 中国科学技术大学先进技术研究院 基于生成式人工智能的多路径嵌入视频编码方法及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111447449A (zh) 2020-04-01 2020-07-24 北京奥维视讯科技有限责任公司 基于roi的视频编码方法和系统以及视频传输和编码系统
CN113099161A (zh) 2021-04-13 2021-07-09 北京中科深智科技有限公司 一种基于深度神经网络的会议视频重建方法和系统

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
HUP0301368A3 (en) 2003-05-20 2005-09-28 Amt Advanced Multimedia Techno Method and equipment for compressing motion picture data
US9215467B2 (en) 2008-11-17 2015-12-15 Checkvideo Llc Analytics-modulated coding of surveillance video
US20100296583A1 (en) * 2009-05-22 2010-11-25 Aten International Co., Ltd. Image processing and transmission in a kvm switch system with special handling for regions of interest
US10326978B2 (en) * 2010-06-30 2019-06-18 Warner Bros. Entertainment Inc. Method and apparatus for generating virtual or augmented reality presentations with 3D audio positioning
GB201312382D0 (en) 2013-07-10 2013-08-21 Microsoft Corp Region-of-interest aware video coding
US10567771B2 (en) 2014-12-15 2020-02-18 Miovision Technologies Incorporated System and method for compressing video data
KR20230010060A (ko) * 2016-10-04 2023-01-17 주식회사 비원영상기술연구소 영상 데이터 부호화/복호화 방법 및 장치
US10349060B2 (en) 2017-06-30 2019-07-09 Intel Corporation Encoding video frames using generated region of interest maps
US10452923B2 (en) * 2017-11-28 2019-10-22 Visual Semantics, Inc. Method and apparatus for integration of detected object identifiers and semantic scene graph networks for captured visual scene behavior estimation
CN108833925B (zh) 2018-07-19 2020-09-11 哈尔滨工业大学 一种基于深度神经网络的帧间预测方法
US11580395B2 (en) 2018-11-14 2023-02-14 Nvidia Corporation Generative adversarial neural network assisted video reconstruction
US11689726B2 (en) 2018-12-05 2023-06-27 Google Llc Hybrid motion-compensated neural network with side-information based video coding
CN110493596B (zh) 2019-09-02 2021-09-17 西北工业大学 一种基于神经网络的视频编码系统及方法
US12170779B2 (en) * 2020-04-09 2024-12-17 Nokia Technologies Oy Training a data coding system comprising a feature extractor neural network
CN111541900B (zh) 2020-04-28 2022-05-17 山东浪潮科学研究院有限公司 基于gan的安防视频压缩方法、装置、设备及存储介质
US11900662B2 (en) * 2020-12-16 2024-02-13 Here Global B.V. Method, apparatus, and computer program product for training a signature encoding module and a query processing module to identify objects of interest within an image utilizing digital signatures
US12341977B2 (en) * 2020-12-23 2025-06-24 Intel Corporation Technologies for region-of-interest video encoding

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111447449A (zh) 2020-04-01 2020-07-24 北京奥维视讯科技有限责任公司 基于roi的视频编码方法和系统以及视频传输和编码系统
CN113099161A (zh) 2021-04-13 2021-07-09 北京中科深智科技有限公司 一种基于深度神经网络的会议视频重建方法和系统

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Dong Liu, et al.，"Deep Learning-Based Video Coding: A Review and a Case Study"，ACM Computing Surveys，Vol.53, No.1, Article No.: 11，[online], ACM，2020年02月06日，total 35 pages，<DOI: https://doi.org/10.1145/3368405>.
中尾 鷹詔（外２名），「ＡＩ解析向け動画像符号化方式」，情報処理学会研究報告，日本，[online], 情報処理学会，2020年02月20日，Vol.2020-OS-148, No.7，total 6 pages，ISSN: 2188-8795.

Also Published As

Publication number Publication date
US20230328260A1 (en) 2023-10-12
CN116896637A (zh) 2023-10-17
KR20230145920A (ko) 2023-10-18
KR102945698B1 (ko) 2026-03-30
EP4262209A1 (en) 2023-10-18
TW202344056A (zh) 2023-11-01
US12401801B2 (en) 2025-08-26
JP2023155898A (ja) 2023-10-23

Similar Documents

Publication Publication Date Title
JP7837926B2 (ja) 二重画像モデルを使用した画像符号化のためのシステムおよび方法
Habibian et al. Video compression with rate-distortion autoencoders
Liu et al. Adamask: Enabling machine-centric video streaming with adaptive frame masking for dnn inference offloading
CN119031147B (zh) 基于可学习任务感知机制的视频编解码加速方法及系统
Yang et al. Hierarchical autoregressive modeling for neural video compression
US9258519B2 (en) Encoder assisted frame rate up conversion using various motion models
US10373458B2 (en) Automatic threat detection based on video frame delta information in compressed video streams
US9602819B2 (en) Display quality in a variable resolution video coder/decoder system
WO2021205065A1 (en) Training a data coding system comprising a feature extractor neural network
Xia et al. Detecting video frame rate up-conversion based on frame-level analysis of average texture variation
CN117730537A (zh) 经由基于学习神经网络的过滤器对机器视觉任务的性能改进
US20130279598A1 (en) Method and Apparatus For Video Compression of Stationary Scenes
CN101036387B (zh) 检测mpeg视频流中的运动的方法和装置
WO2023073281A1 (en) A method, an apparatus and a computer program product for video coding
WO2024222387A1 (zh) 一种编解码方法及装置
Tian et al. Secure deep learning framework for moving object detection in compressed video
Soyak et al. Low-complexity tracking-aware H. 264 video compression for transportation surveillance
Abou-Elailah et al. Fusion of global and local motion estimation using foreground objects for distributed video coding
WO2023089231A1 (en) A method, an apparatus and a computer program product for video encoding and video decoding
KR20230040286A (ko) 영상정보의 비트스트림정보에 기반하여 물체 유기이벤트를 감지하는 방법 및 시스템
Cossalter et al. Privacy-enabled object tracking in video sequences using compressive sensing
US20050078873A1 (en) Movement detection and estimation in wavelet compressed video
Mital et al. Deep stereo image compression with decoder side information using wyner common information
Veena et al. A machine learning framework for inter-frame prediction for effective motion estimation
US20220124339A1 (en) Image processing device and method of pre-processing images of a video stream before encoding

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20260109

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20260109

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20260109

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20260303

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20260318

R150 Certificate of patent or registration of utility model

Ref document number: 7837926

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150