WO2011163438A1 - Graphical user interface for tone mapping high dynamic range video - Google Patents

Graphical user interface for tone mapping high dynamic range video Download PDF

Info

Publication number
WO2011163438A1
WO2011163438A1 PCT/US2011/041564 US2011041564W WO2011163438A1 WO 2011163438 A1 WO2011163438 A1 WO 2011163438A1 US 2011041564 W US2011041564 W US 2011041564W WO 2011163438 A1 WO2011163438 A1 WO 2011163438A1
Authority
WO
WIPO (PCT)
Prior art keywords
region
video
global
section
regional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2011/041564
Other languages
English (en)
French (fr)
Inventor
Jiefu Zhai
Joan Llach
Zhe Wang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thomson Licensing SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Priority to CN201180031460.5A priority Critical patent/CN102959583B/zh
Priority to KR1020127033668A priority patent/KR101843902B1/ko
Priority to US13/805,185 priority patent/US10108314B2/en
Priority to JP2013516759A priority patent/JP6282863B2/ja
Priority to EP11729347.2A priority patent/EP2586010B1/en
Publication of WO2011163438A1 publication Critical patent/WO2011163438A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/24Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20208High dynamic range [HDR] image processing

Definitions

  • Figure 5 shows a fifth view of the user interface at the third point in time which highlights the ability to add and show additional operators and/or filters in other operator bars;
  • Figure 6 shows a sixth view of the user interface at the first point in time which highlights the ability to change exposure and contrast levels;
  • Exposure is changed for a given region by moving the top slider of the given region.
  • Contrast is changed for a given region by moving the bottom slider of the given region in the all-regions control section 34. Comparing to Figure 1 , only the exposure and contrast for region 10 are changed. Note that the exposure and contrast levels are set for each operator separately in this implementation. This means that the exposure and contrast levels will remain the same for the entire set of frames that is operated on by an operator. Of course, the regions are expected to change from frame to frame, depending on the pixel intensity values, but the exposure and contrast settings remain the same.
  • anchor points it is also possible to add or delete anchor points.
  • the advantages will typically be similar to changing anchor points. For instance, sometimes a user can add more anchor points in order to have finer control over the tone mapped image.
  • the upper bars and lower bars will change the exposure and contrast parameter for each region, defined by the weight images. From the end user's viewpoint, upper bars change brightness and lower bars change contrast.
  • two extra global parameters i.e. all-regions control section 34
  • Moving the global exposure bar will change the exposure parameters for all regions and moving the global contrast bar will change the contrast parameters for all regions.
  • These two global bars can be used in situations, for example, in which the end user would like to change the global brightness or contrast. For instance, if the user finds out that the tone mapped picture is too bright, the user does not need to decrease the exposure parameter for each region separately. Instead, the user can move the global exposure bar to the left, which will result in moving of all upper (exposure) bars to the left for each region simultaneously.
  • a device such as for example, a pre-processor, an encoder, a transmitter, a receiver, a decoder, a post-processor, a set-top box, a cell-phone, a laptop or other personal computer, a PDA, or other consumer communications equipment, containing a processing device of Implementation 8.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Image Processing (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)
  • Picture Signal Circuits (AREA)
PCT/US2011/041564 2010-06-25 2011-06-23 Graphical user interface for tone mapping high dynamic range video Ceased WO2011163438A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201180031460.5A CN102959583B (zh) 2010-06-25 2011-06-23 色调映射高动态范围视频的图形用户界面
KR1020127033668A KR101843902B1 (ko) 2010-06-25 2011-06-23 높은 동적 범위 비디오를 톤 맵핑하기 위한 그래픽 사용자 인터페이스
US13/805,185 US10108314B2 (en) 2010-06-25 2011-06-23 Method and system for displaying and processing high dynamic range video and images
JP2013516759A JP6282863B2 (ja) 2010-06-25 2011-06-23 ハイダイナミックレンジ映像をトーンマッピングするためのグラフィカルユーザインターフェース
EP11729347.2A EP2586010B1 (en) 2010-06-25 2011-06-23 Graphical user interface for tone mapping high dynamic range video

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US35860510P 2010-06-25 2010-06-25
US61/358,605 2010-06-25

Publications (1)

Publication Number Publication Date
WO2011163438A1 true WO2011163438A1 (en) 2011-12-29

Family

ID=44477689

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/041564 Ceased WO2011163438A1 (en) 2010-06-25 2011-06-23 Graphical user interface for tone mapping high dynamic range video

Country Status (6)

Country Link
US (1) US10108314B2 (enExample)
EP (1) EP2586010B1 (enExample)
JP (1) JP6282863B2 (enExample)
KR (1) KR101843902B1 (enExample)
CN (1) CN102959583B (enExample)
WO (1) WO2011163438A1 (enExample)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9064313B2 (en) * 2012-09-28 2015-06-23 Intel Corporation Adaptive tone map to a region of interest to yield a low dynamic range image
US9955084B1 (en) 2013-05-23 2018-04-24 Oliver Markus Haynold HDR video camera
JP6311021B2 (ja) 2013-07-25 2018-04-11 コンヴィーダ ワイヤレス, エルエルシー エンドツーエンドm2mサービス層セッション
US9460499B2 (en) * 2014-05-30 2016-10-04 Shenzhen Mindray Bio-Medical Electronics Co., Ltd. Systems and methods for selective enhancement of a region of interest in an image
KR102244918B1 (ko) 2014-07-11 2021-04-27 삼성전자주식회사 시인성을 향상시키고 전력 소모를 줄일 수 있는 디스플레이 컨트롤러와 이를 포함하는 디스플레이 시스템
USD766976S1 (en) * 2014-08-18 2016-09-20 Rockwell Collins, Inc. Display panel with icon
US10277771B1 (en) 2014-08-21 2019-04-30 Oliver Markus Haynold Floating-point camera
US10225485B1 (en) 2014-10-12 2019-03-05 Oliver Markus Haynold Method and apparatus for accelerated tonemapping
KR102309676B1 (ko) 2015-07-24 2021-10-07 삼성전자주식회사 사용자 적응 이미지 보상기
US10114769B2 (en) * 2015-08-19 2018-10-30 Logitech Europe S.A. Synchronization of computer peripheral effects
JP6451669B2 (ja) 2016-03-04 2019-01-16 ソニー株式会社 評価装置、評価方法およびカメラシステム
KR20220141916A (ko) 2016-05-11 2022-10-20 콘비다 와이어리스, 엘엘씨 새로운 라디오 다운링크 제어 채널
WO2017196670A1 (en) 2016-05-13 2017-11-16 Vid Scale, Inc. Bit depth remapping based on viewing parameters
US11503314B2 (en) 2016-07-08 2022-11-15 Interdigital Madison Patent Holdings, Sas Systems and methods for region-of-interest tone remapping
KR20190039223A (ko) 2016-08-11 2019-04-10 콘비다 와이어리스, 엘엘씨 뉴 라디오를 위한 유연한 프레임 구조에서의 빔포밍 스위핑 및 트레이닝
CN109891772B (zh) 2016-11-03 2022-10-04 康维达无线有限责任公司 Nr中的帧结构
US11765406B2 (en) 2017-02-17 2023-09-19 Interdigital Madison Patent Holdings, Sas Systems and methods for selective object-of-interest zooming in streaming video
CN110383848B (zh) 2017-03-07 2022-05-06 交互数字麦迪逊专利控股公司 用于多设备呈现的定制视频流式传输
US10706512B2 (en) * 2017-03-07 2020-07-07 Adobe Inc. Preserving color in image brightness adjustment for exposure fusion
KR102553764B1 (ko) * 2017-07-13 2023-07-10 삼성전자주식회사 전자 장치, 디스플레이 장치 및 그 제어 방법
CN109104633B (zh) * 2018-08-30 2021-09-28 Oppo广东移动通信有限公司 视频截图方法、装置、存储介质及移动终端
CN112753265B (zh) 2018-09-27 2025-02-11 交互数字专利控股公司 新无线电的未经许可的频谱中的子频带操作
WO2021223205A1 (en) * 2020-05-08 2021-11-11 Huawei Technologies Co., Ltd. Encoder, decoder, system, and method for determining tone mapping curve parameters
JP1692292S (enExample) * 2020-10-05 2021-08-10
CA202359S (en) * 2020-10-05 2023-09-07 Sony Interactive Entertainment Inc Display screen with animated graphical user interface

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6744968B1 (en) * 1998-09-17 2004-06-01 Sony Corporation Method and system for processing clips
US20060153445A1 (en) * 2005-01-07 2006-07-13 Ulead Systems, Inc. Display methods for high dynamic range images and user interfaces for the same
WO2008064349A1 (en) * 2006-11-22 2008-05-29 Nik Software, Inc. Method for dynamic range editing
WO2009078862A1 (en) * 2007-12-17 2009-06-25 Hewlett-Packard Development Company, L.P. Image processing using target values

Family Cites Families (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5682326A (en) * 1992-08-03 1997-10-28 Radius Inc. Desktop digital video processing system
JP4055092B2 (ja) * 1998-04-27 2008-03-05 ソニー株式会社 撮像装置及び撮像方法
US7786999B1 (en) * 2000-10-04 2010-08-31 Apple Inc. Edit display during rendering operations
US6888552B2 (en) * 2001-06-08 2005-05-03 University Of Southern California High dynamic range image editing
US20020198789A1 (en) 2001-06-22 2002-12-26 Sony Corp. And Sony Music Entertainment, Inc. Apparatus and method for identifying and purchasing music
US6968337B2 (en) 2001-07-10 2005-11-22 Audible Magic Corporation Method and apparatus for identifying an unknown work
EP1345172A1 (en) * 2002-02-26 2003-09-17 Sony International (Europe) GmbH Contrast enhancement for digital images
US7073127B2 (en) * 2002-07-01 2006-07-04 Arcsoft, Inc. Video editing GUI with layer view
US7525697B2 (en) * 2002-07-15 2009-04-28 Olympus Corporation White balance processing apparatus and processing method thereof
US6879731B2 (en) 2003-04-29 2005-04-12 Microsoft Corporation System and process for generating high dynamic range video
US7492375B2 (en) * 2003-11-14 2009-02-17 Microsoft Corporation High dynamic range image viewing on low dynamic range displays
US7751805B2 (en) 2004-02-20 2010-07-06 Google Inc. Mobile image-based information retrieval system
US7805678B1 (en) * 2004-04-16 2010-09-28 Apple Inc. Editing within single timeline
US20050243176A1 (en) 2004-04-30 2005-11-03 James Wu Method of HDR image processing and manipulation
US7551776B2 (en) 2004-07-22 2009-06-23 Seiko Epson Corporation Histogram generation apparatus and method for operating the same
US8355030B2 (en) * 2005-01-07 2013-01-15 Corel Corporation Display methods for high dynamic range images and user interfaces for the same
US7873322B2 (en) 2005-06-14 2011-01-18 Acterna Llc Ingress susceptibility on return path
US7660464B1 (en) * 2005-12-22 2010-02-09 Adobe Systems Incorporated User interface for high dynamic range merge image selection
US7715047B2 (en) * 2006-02-17 2010-05-11 Seiko Epson Corporation Image editing device
US7822289B2 (en) 2006-07-25 2010-10-26 Microsoft Corporation Locally adapted hierarchical basis preconditioning
US8213711B2 (en) * 2007-04-03 2012-07-03 Her Majesty The Queen In Right Of Canada As Represented By The Minister Of Industry, Through The Communications Research Centre Canada Method and graphical user interface for modifying depth maps
US20080263450A1 (en) * 2007-04-14 2008-10-23 James Jacob Hodges System and method to conform separately edited sequences
US8444560B2 (en) * 2007-05-14 2013-05-21 Abbott Diabetes Care Inc. Method and apparatus for providing data processing and control in a medical communication system
US8237730B1 (en) * 2008-01-23 2012-08-07 Pixar Animation Studios Tone mapping for motion pictures
ES2602100T3 (es) * 2008-04-16 2017-02-17 Ge Video Compression, Llc Escalabilidad de profundidad de bits
FR2939265A1 (fr) * 2008-12-03 2010-06-04 Thomson Licensing Procede de detection de mode film ou mode camera
US20100153520A1 (en) * 2008-12-16 2010-06-17 Michael Daun Methods, systems, and media for creating, producing, and distributing video templates and video clips
US8339475B2 (en) * 2008-12-19 2012-12-25 Qualcomm Incorporated High dynamic range image combining
US8237743B2 (en) * 2009-02-17 2012-08-07 Xerox Corporation Modification of images from a user's album for spot-the-differences
US8818172B2 (en) * 2009-04-14 2014-08-26 Avid Technology, Inc. Multi-user remote video editing
US9195898B2 (en) 2009-04-14 2015-11-24 Qualcomm Incorporated Systems and methods for image recognition using mobile devices
US8533598B2 (en) * 2009-04-30 2013-09-10 Apple Inc. Media editing with a segmented timeline
US8881013B2 (en) * 2009-04-30 2014-11-04 Apple Inc. Tool for tracking versions of media sections in a composite presentation
US20100281371A1 (en) * 2009-04-30 2010-11-04 Peter Warner Navigation Tool for Video Presentations
TWI378718B (en) * 2009-06-05 2012-12-01 Univ Nat Taiwan Method for scaling video content according to bandwidth rate
US8433150B2 (en) * 2009-09-28 2013-04-30 Peking University Sample based tone mapping method for high dynamic range images
US8831340B2 (en) * 2010-01-27 2014-09-09 Adobe Systems Incorporated Methods and apparatus for tone mapping high dynamic range images
US8525899B2 (en) * 2010-05-27 2013-09-03 Canon Kabushiki Kaisha Image-capturing device, user interface and method for selective color balance adjustment
US8819557B2 (en) * 2010-07-15 2014-08-26 Apple Inc. Media-editing application with a free-form space for organizing or compositing media clips

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6744968B1 (en) * 1998-09-17 2004-06-01 Sony Corporation Method and system for processing clips
US20060153445A1 (en) * 2005-01-07 2006-07-13 Ulead Systems, Inc. Display methods for high dynamic range images and user interfaces for the same
WO2008064349A1 (en) * 2006-11-22 2008-05-29 Nik Software, Inc. Method for dynamic range editing
WO2009078862A1 (en) * 2007-12-17 2009-06-25 Hewlett-Packard Development Company, L.P. Image processing using target values

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"Technical Report: Software for High-Speed RAW Image Processing and Real-Time Editing", CANON, July 2004 (2004-07-01), XP002336076, Retrieved from the Internet <URL:http://www.canon.com/camera-museum/tech/report/200407/200407.html> [retrieved on 20050712] *
ADOBE SYSTEMS INCORPORATED: "Using Adobe Photoshop Lightroom 2 - Chapter 8: Developing photos", 3 September 2009 (2009-09-03), pages I - V, 98 - 123, XP002658382, Retrieved from the Internet <URL:http://help.adobe.com/en_US/Lightroom/2.0/lightroom_2_help.pdf> [retrieved on 20110907] *

Also Published As

Publication number Publication date
US20130091430A1 (en) 2013-04-11
KR20130085371A (ko) 2013-07-29
EP2586010B1 (en) 2018-08-08
JP6282863B2 (ja) 2018-02-21
CN102959583A (zh) 2013-03-06
EP2586010A1 (en) 2013-05-01
JP2013537659A (ja) 2013-10-03
US10108314B2 (en) 2018-10-23
KR101843902B1 (ko) 2018-04-02
CN102959583B (zh) 2016-08-03

Similar Documents

Publication Publication Date Title
US10108314B2 (en) Method and system for displaying and processing high dynamic range video and images
JP5159208B2 (ja) 映像補正方法及び装置
EP3745390B1 (en) Transitioning between video priority and graphics priority
EP3295451B1 (en) Metadata filtering for display mapping for high dynamic range images
US10298857B2 (en) Image processing method and apparatus, integrated circuitry and recording medium for applying gain to a pixel
CN102946513B (zh) 一种启动拍摄装置高动态范围功能的方法、装置及终端
CN101253764B (zh) 成像照相机处理单元和方法
KR20150019985A (ko) 이미지의 동적 범위 향상을 위한 방법 및 장치
CN114092360B (zh) 图像处理方法、设备及可读存储介质
US20110032268A1 (en) Image processing apparatus and method for controlling the same
WO2018231968A1 (en) Efficient end-to-end single layer inverse display management coding
JP2010503056A (ja) 画像の強調の方法及び装置
JP5014274B2 (ja) 画像処理装置、画像処理方法、画像処理システム、プログラム、記録媒体および集積回路
EP3639238A1 (en) Efficient end-to-end single layer inverse display management coding
KR20180000729A (ko) 디스플레이 장치 및 이의 제어 방법
JP5335961B2 (ja) 表示装置およびテレビ受像機
CN101273624A (zh) 对数字图像中的不适当曝光区域的补偿
US20070242898A1 (en) Image processing apparatus, image processing method, and image processing program
CN117935712A (zh) 像素对比度控制系统和方法
JP6190482B1 (ja) 表示制御装置、表示装置、テレビジョン受像機、表示制御装置の制御方法、制御プログラム、及び記録媒体
US20080131021A1 (en) Image processing method and apparatus thereof
JP4758999B2 (ja) 画像処理プログラム、画像処理方法、画像処理装置
CN115699178B (zh) 视频内容编辑方法、系统、介质和计算机程序产品
CN101248455A (zh) 在数字图像处理中设置对比度的方法及装置
CN119831916A (zh) 逆色调映射方法、设备及存储介质

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201180031460.5

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11729347

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13805185

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2011729347

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 20127033668

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2013516759

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE