JP2013235562A - ビデオにおける眼位のためのシステムおよび方法 - Google Patents

ビデオにおける眼位のためのシステムおよび方法 Download PDF

Info

Publication number
JP2013235562A
JP2013235562A JP2013038803A JP2013038803A JP2013235562A JP 2013235562 A JP2013235562 A JP 2013235562A JP 2013038803 A JP2013038803 A JP 2013038803A JP 2013038803 A JP2013038803 A JP 2013038803A JP 2013235562 A JP2013235562 A JP 2013235562A
Authority
JP
Japan
Prior art keywords
camera
image
display screen
face
source image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2013038803A
Other languages
English (en)
Japanese (ja)
Other versions
JP2013235562A5 (https=
Inventor
Simon Lucey
ルーシー サイモン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Commonwealth Scientific and Industrial Research Organization CSIRO
Original Assignee
Commonwealth Scientific and Industrial Research Organization CSIRO
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2012901830A external-priority patent/AU2012901830A0/en
Application filed by Commonwealth Scientific and Industrial Research Organization CSIRO filed Critical Commonwealth Scientific and Industrial Research Organization CSIRO
Publication of JP2013235562A publication Critical patent/JP2013235562A/ja
Publication of JP2013235562A5 publication Critical patent/JP2013235562A5/ja
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—Three-dimensional [3D] animation
    • G06T13/40—Three-dimensional [3D] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20112—Image segmentation details
    • G06T2207/20121—Active appearance model [AAM]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Architecture (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Processing (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Image Analysis (AREA)
JP2013038803A 2012-05-04 2013-02-28 ビデオにおける眼位のためのシステムおよび方法 Pending JP2013235562A (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2012901830A AU2012901830A0 (en) 2012-05-04 System and method for eye alignment in video
AU2012901830 2012-05-04

Publications (2)

Publication Number Publication Date
JP2013235562A true JP2013235562A (ja) 2013-11-21
JP2013235562A5 JP2013235562A5 (https=) 2016-04-14

Family

ID=48576715

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2013038803A Pending JP2013235562A (ja) 2012-05-04 2013-02-28 ビデオにおける眼位のためのシステムおよび方法

Country Status (7)

Country Link
US (2) US20130293669A1 (https=)
EP (1) EP2661077A1 (https=)
JP (1) JP2013235562A (https=)
KR (2) KR20130124188A (https=)
CN (1) CN103384306B (https=)
TW (1) TWI543624B (https=)
WO (1) WO2013163699A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022244146A1 (ja) * 2021-05-19 2022-11-24 日本電信電話株式会社 情報処理装置、身振転写方法およびプログラム

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9270933B1 (en) * 2013-11-23 2016-02-23 Yuan Qing Jiang System and method for face-to-face video communication
US10551913B2 (en) 2015-03-21 2020-02-04 Mine One Gmbh Virtual 3D methods, systems and software
US12169944B2 (en) 2015-03-21 2024-12-17 Mine One Gmbh Image reconstruction for virtual 3D
WO2018164852A1 (en) 2017-02-22 2018-09-13 Mine One Gmbh Image reconstruction for virtual 3d
US10853625B2 (en) 2015-03-21 2020-12-01 Mine One Gmbh Facial signature methods, systems and software
US12560995B2 (en) 2015-03-21 2026-02-24 Mine One Gmbh Asymmetric communication system with viewer position indications
US12322071B2 (en) 2015-03-21 2025-06-03 Mine One Gmbh Temporal de-noising
CN110324553B (zh) * 2018-03-28 2021-02-26 北京富纳特创新科技有限公司 基于视频通信的实景窗系统
CN110324555B (zh) * 2018-03-28 2021-02-26 北京富纳特创新科技有限公司 视频通信装置及方法
CN108965771B (zh) * 2018-09-29 2021-01-26 京东方科技集团股份有限公司 一种视频通话控制装置及方法、视频通话系统
US10893231B1 (en) * 2020-04-14 2021-01-12 International Business Machines Corporation Eye contact across digital mediums
US12244958B2 (en) * 2022-02-07 2025-03-04 Samsung Electronics Co., Ltd. Perspective de-skewing of electronic images
TWI828583B (zh) * 2022-06-15 2024-01-01 仁寶電腦工業股份有限公司 用於遠端視訊會議的操作方法、遠端視訊會議系統及遠端裝置
US12142000B2 (en) * 2022-11-09 2024-11-12 Cbs Interactive Inc. Method and system for optimizing a viewer position with respect to a display device
TWI866802B (zh) * 2024-03-04 2024-12-11 弘真科技股份有限公司 視訊設備的智能化輔助系統

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08237629A (ja) * 1994-10-25 1996-09-13 At & T Corp 視差修正および存在感を提供するビデオ会議システムおよび方法
JP2005092657A (ja) * 2003-09-19 2005-04-07 Hitachi Ltd 画像表示装置および画像表示方法
JP2008140271A (ja) * 2006-12-04 2008-06-19 Toshiba Corp 対話装置及びその方法
JP2010250452A (ja) * 2009-04-14 2010-11-04 Tokyo Univ Of Science 任意視点画像合成装置
JP2010282339A (ja) * 2009-06-03 2010-12-16 Seiko Epson Corp 目における瞳の位置を補正する画像処理装置、画像処理方法、画像処理プログラム、および、印刷装置

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6753900B2 (en) * 2002-05-07 2004-06-22 Avaya Techology Corp. Method and apparatus for overcoming the limitations of camera angle in video conferencing applications
US7515173B2 (en) * 2002-05-23 2009-04-07 Microsoft Corporation Head pose tracking system
KR20050084263A (ko) * 2002-12-11 2005-08-26 코닌클리케 필립스 일렉트로닉스 엔.브이. 비디오 폰 이미지에서 머리 자세를 보정하기 위한 방법 및장치
US8299979B2 (en) * 2003-05-14 2012-10-30 Broadcom Corporation Integral eye-path alignment on telephony and computer video devices using two or more image sensing devices
US7532230B2 (en) * 2004-01-29 2009-05-12 Hewlett-Packard Development Company, L.P. Method and system for communicating gaze in an immersive virtual environment
US20110102553A1 (en) * 2007-02-28 2011-05-05 Tessera Technologies Ireland Limited Enhanced real-time face models from stereo imaging
WO2007048197A1 (en) * 2005-10-26 2007-05-03 The University Of Sydney Systems for providing a 3d image
WO2007092629A2 (en) * 2006-02-09 2007-08-16 Nms Communications Corporation Smooth morphing between personal video calling avatars
WO2008064395A1 (en) * 2006-08-18 2008-06-05 National Ict Australia Limited Facial feature processing
US20080278516A1 (en) * 2007-05-11 2008-11-13 Santon John C System and method for adjusting perceived eye rotation in image of face
BR112012005222A2 (pt) * 2009-09-11 2019-09-24 Koninklijke Philips Electrnics N. V. método para um sistema de processamento de imagem, sistema de processamento de imagem e produto de programa de computador
EP2577963A1 (en) * 2010-05-26 2013-04-10 Ramot at Tel Aviv University, Ltd. Method and system for correcting gaze offset
US8144976B1 (en) * 2010-12-06 2012-03-27 Seiko Epson Corporation Cascaded face model
US8836777B2 (en) * 2011-02-25 2014-09-16 DigitalOptics Corporation Europe Limited Automatic detection of vertical gaze using an embedded imaging device
WO2013079607A1 (en) * 2011-11-30 2013-06-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. View rendering for the provision of virtual eye contact using special geometric constraints in combination with eye-tracking

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08237629A (ja) * 1994-10-25 1996-09-13 At & T Corp 視差修正および存在感を提供するビデオ会議システムおよび方法
JP2005092657A (ja) * 2003-09-19 2005-04-07 Hitachi Ltd 画像表示装置および画像表示方法
JP2008140271A (ja) * 2006-12-04 2008-06-19 Toshiba Corp 対話装置及びその方法
JP2010250452A (ja) * 2009-04-14 2010-11-04 Tokyo Univ Of Science 任意視点画像合成装置
JP2010282339A (ja) * 2009-06-03 2010-12-16 Seiko Epson Corp 目における瞳の位置を補正する画像処理装置、画像処理方法、画像処理プログラム、および、印刷装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022244146A1 (ja) * 2021-05-19 2022-11-24 日本電信電話株式会社 情報処理装置、身振転写方法およびプログラム

Also Published As

Publication number Publication date
US20150220773A1 (en) 2015-08-06
CN103384306B (zh) 2016-09-07
TWI543624B (zh) 2016-07-21
WO2013163699A1 (en) 2013-11-07
US9424463B2 (en) 2016-08-23
KR101598069B1 (ko) 2016-02-26
KR20150030681A (ko) 2015-03-20
CN103384306A (zh) 2013-11-06
US20130293669A1 (en) 2013-11-07
KR20130124188A (ko) 2013-11-13
TW201401880A (zh) 2014-01-01
EP2661077A1 (en) 2013-11-06

Similar Documents

Publication Publication Date Title
JP2013235562A (ja) ビデオにおける眼位のためのシステムおよび方法
Zhang et al. Virtualcube: An immersive 3d video communication system
TWI813098B (zh) 用於新穎視圖合成之神經混合
US8994780B2 (en) Video conferencing enhanced with 3-D perspective control
US9749619B2 (en) Systems and methods for generating stereoscopic images
US8928659B2 (en) Telepresence systems with viewer perspective adjustment
CN114631127A (zh) 说话头的小样本合成
US11290573B2 (en) Method and apparatus for synchronizing viewing angles in virtual reality live streaming
US10453244B2 (en) Multi-layer UV map based texture rendering for free-running FVV applications
CN104782122A (zh) 受控三维通信端点
US12464105B2 (en) System and method for determining directionality of imagery using head tracking
US20250046027A1 (en) Head-tracking based media selection for video communications in virtual environments
CN116095356A (zh) 用于呈现虚拟场景的方法、装置、设备和存储介质
Roberts et al. Estimating the gaze of a virtuality human
US11727645B2 (en) Device and method for sharing an immersion in a virtual environment
KR101816446B1 (ko) 평면 디스플레이에서 표시되는 텔레프레전스 이론을 적용한 3 차원 콘텐츠 영상 처리 시스템 및 그 방법
Fang et al. Immersive video interaction system: a survey
CN116610213A (zh) 虚拟现实中的交互显示方法、装置、电子设备、存储介质
WO2022205001A1 (zh) 信息交互方法、计算机可读存储介质、通信终端
JPWO2020090128A1 (ja) 画像処理装置、方法、コンピュータプログラム
Hsiao et al. Dream Home: a multiview stereoscopic interior design system
CN121887972A (zh) 一种空间影像显示方法、装置及平面显示设备
CN120233864A (zh) 用于显示画面的方法、装置、设备和介质
JP2008067169A (ja) 立体映像合成装置、形状データ生成方法およびそのプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160226

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160226

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170131

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170207

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20170502

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170630

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20171121

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180214

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20180424

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180823

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20181010

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20181122