JP7639004B2 - リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法 - Google Patents

リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法 Download PDF

Info

Publication number
JP7639004B2
JP7639004B2 JP2022540449A JP2022540449A JP7639004B2 JP 7639004 B2 JP7639004 B2 JP 7639004B2 JP 2022540449 A JP2022540449 A JP 2022540449A JP 2022540449 A JP2022540449 A JP 2022540449A JP 7639004 B2 JP7639004 B2 JP 7639004B2
Authority
JP
Japan
Prior art keywords
animated
media
guest
controller
control system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2022540449A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023509640A (ja
JP2023509640A5 (https=
Inventor
アンソニー アレクサンダー メッカ
ティモシー ジェイ エック
Original Assignee
ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー filed Critical ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー
Publication of JP2023509640A publication Critical patent/JP2023509640A/ja
Publication of JP2023509640A5 publication Critical patent/JP2023509640A5/ja
Priority to JP2025024927A priority Critical patent/JP7854083B2/ja
Application granted granted Critical
Publication of JP7639004B2 publication Critical patent/JP7639004B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • G09F27/005—Signs associated with a sensor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
    • B25J11/0015—Face robots, animated artificial faces for imitating human expressions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B25J11/003—Manipulators for entertainment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B25J13/088—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices with position, velocity or acceleration sensors
    • B25J13/089—Determining the position of the robot with reference to its environment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1615—Program controls characterised by special kind of manipulator, e.g. planar, scara, gantry, cantilever, space, closed chain, passive/active joints and tendon driven manipulators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/02—Advertising or display means not otherwise provided for incorporating moving display members
    • G09F19/08—Dolls, faces, or other representations of living forms with moving parts
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35444—Gesture interface, controlled machine observes operator, executes commands
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40411—Robot assists human in non-industrial environment like home or office
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • G09F2027/001—Comprising a presence or proximity detector

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2022540449A 2020-01-02 2020-12-21 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法 Active JP7639004B2 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2025024927A JP7854083B2 (ja) 2020-01-02 2025-02-19 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202062956468P 2020-01-02 2020-01-02
US62/956,468 2020-01-02
US17/122,716 2020-12-15
US17/122,716 US11772276B2 (en) 2020-01-02 2020-12-15 Systems and methods for optical performance captured animated figure with real-time reactive projected media
PCT/US2020/066314 WO2021138100A1 (en) 2020-01-02 2020-12-21 Systems and methods for optical performance captured animated figure with real-time reactive projected media

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2025024927A Division JP7854083B2 (ja) 2020-01-02 2025-02-19 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法

Publications (3)

Publication Number Publication Date
JP2023509640A JP2023509640A (ja) 2023-03-09
JP2023509640A5 JP2023509640A5 (https=) 2023-12-15
JP7639004B2 true JP7639004B2 (ja) 2025-03-04

Family

ID=76654233

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2022540449A Active JP7639004B2 (ja) 2020-01-02 2020-12-21 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法
JP2025024927A Active JP7854083B2 (ja) 2020-01-02 2025-02-19 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2025024927A Active JP7854083B2 (ja) 2020-01-02 2025-02-19 リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法

Country Status (7)

Country Link
US (2) US11772276B2 (https=)
EP (1) EP4085448A1 (https=)
JP (2) JP7639004B2 (https=)
KR (1) KR20220123098A (https=)
CN (2) CN120148373A (https=)
CA (1) CA3161199A1 (https=)
WO (1) WO2021138100A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12112415B2 (en) * 2021-04-09 2024-10-08 Universal City Studios Llc Systems and methods for animated figure display
US12309660B2 (en) * 2021-05-06 2025-05-20 Universal City Studios Llc Systems and methods for layered data reporting in an attraction
RU2767860C1 (ru) * 2021-09-14 2022-03-22 Дмитрий Геннадьевич Хоружик Мобильный сценический комплекс
US12502621B2 (en) 2022-06-30 2025-12-23 Universal City Studios Llc Animated figure walking mechanism
CN119855637A (zh) * 2022-09-06 2025-04-18 环球城市电影有限责任公司 用于游乐园景点设计的有形/虚拟设计系统及方法
US20240119852A1 (en) * 2022-10-09 2024-04-11 Shawn Paul Kelly Singing campfire
KR20240083458A (ko) * 2022-12-05 2024-06-12 삼성전자주식회사 외부 객체의 모션에 대응하는 시각적 객체를 생성하기 위한 전자 장치 및 그 방법
US20240189734A1 (en) * 2022-12-13 2024-06-13 Universal City Studios Llc Reactive show action equipment system
WO2024129742A1 (en) * 2022-12-13 2024-06-20 Universal City Studios Llc Reactive show action equipment system
WO2024148180A1 (en) * 2023-01-06 2024-07-11 Universal City Studios Llc Show effect system for an amusement park
WO2025096833A1 (en) * 2023-10-31 2025-05-08 Universal City Studios Llc Systems and methods for projection mapping onto multiple rigid bodies
US20250278879A1 (en) * 2024-03-01 2025-09-04 Disney Enterprises, Inc. Dynamic augmented projected show elements

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000352761A (ja) 1999-06-10 2000-12-19 Sony Corp 映像投射装置及び方法並びに映像投射制御装置
JP2008033234A (ja) 2006-02-21 2008-02-14 Matsushita Electric Works Ltd 映像表示装置、映像表示装置の映像歪み補正方法
JP2009216958A (ja) 2008-03-11 2009-09-24 Gifu Univ 三次元表示装置
JP2010538755A (ja) 2007-09-12 2010-12-16 ディズニー エンタープライゼズ，インコーポレイテッド 相互作用的なアニマトロニクス・ショーの分散制御システム及び分散制御方法
JP2011254411A (ja) 2010-06-04 2011-12-15 Hokkaido Univ 映像投影システムおよび映像投影プログラム
JP2016145933A (ja) 2015-02-09 2016-08-12 コニカミノルタ株式会社 顔容貌疑似化装置および顔容貌疑似化方法
JP2017522967A (ja) 2014-07-22 2017-08-17 ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー 車両運搬室システム及び方法
US20180071643A1 (en) 2016-09-13 2018-03-15 Universal City Studios Llc Systems and methods for incorporating pneumatic robotic systems into amusement park attractions
US20190302991A1 (en) 2018-03-29 2019-10-03 Universal City Studios Llc Interactive animated character head systems and methods

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6317511Y2 (https=) * 1980-03-27 1988-05-18
JPS56141695A (en) 1980-04-08 1981-11-05 Onkyo Corp Vibration diaphragm for speaker having honey-comb structure
US5325473A (en) 1991-10-11 1994-06-28 The Walt Disney Company Apparatus and method for projection upon a three-dimensional object
US5852672A (en) 1995-07-10 1998-12-22 The Regents Of The University Of California Image system for three dimensional, 360 DEGREE, time sequence surface mapping of moving objects
US8589824B2 (en) 2006-07-13 2013-11-19 Northrop Grumman Systems Corporation Gesture recognition interface system
DE102007055204B4 (de) 2007-11-19 2010-04-08 Deutsches Zentrum für Luft- und Raumfahrt e.V. Roboter, medizinischer Arbeitsplatz und Verfahren zum Projizieren eines Bildes auf die Oberfläche eines Objekts
US8256904B2 (en) * 2008-05-23 2012-09-04 Disney Enterprises, Inc. Rear projected expressive head
US8223196B2 (en) * 2009-06-10 2012-07-17 Disney Enterprises, Inc. Projector systems and methods for producing digitally augmented, interactive cakes and other food products
US8259997B2 (en) 2009-07-13 2012-09-04 Moment Factory Real-time tracking system
US8928735B2 (en) 2011-06-14 2015-01-06 Microsoft Corporation Combined lighting, projection, and image capture without video feedback
US9832352B2 (en) * 2011-11-16 2017-11-28 Autofuss System and method for 3D projection mapping with robotically controlled objects
CN104054023B (zh) 2011-11-16 2017-11-17 欧特法斯公司 用于与机器人控制的物体映射的3d投影的系统和方法
US20140111629A1 (en) * 2012-10-20 2014-04-24 Margaret Morris System for dynamic projection of media
US9300901B2 (en) 2013-12-04 2016-03-29 Disney Enterprises, Inc. Augmenting physical appearance using illumination
KR101710003B1 (ko) 2014-01-07 2017-02-24 한국전자통신연구원 실시간 동적 비평면 프로젝션 장치 및 방법
JP2016152586A (ja) 2015-02-19 2016-08-22 国立大学法人電気通信大学 プロジェクションマッピング装置、映像投影制御装置、映像投影制御方法および映像投影制御プログラム
KR101684270B1 (ko) 2015-03-13 2016-12-20 주식회사 레드로버 표면윤곽 변화를 고려한 동적 프로젝션 매핑 방법
CN108697938B (zh) * 2016-01-06 2020-07-10 埃沃洛夫有限公司 具有可变角色的机器人
JP6374418B2 (ja) 2016-01-27 2018-08-15 キヤノンファインテックニスカ株式会社 転写材、記録物、記録物の製造装置、および記録物の製造方法
US10802665B2 (en) * 2016-10-05 2020-10-13 Motorola Solutions, Inc. System and method for projecting graphical objects
US9958767B1 (en) 2016-11-01 2018-05-01 Disney Enterprises, Inc. Projection mapped augmentation of mechanically animated objects
ES2970599T3 (es) * 2017-03-25 2024-05-29 Universal City Studios Llc Sistema y método de robot suave
US11061304B2 (en) * 2017-04-03 2021-07-13 SmartDeco LLC Rear-projected animated display device
CN108921779A (zh) 2018-07-13 2018-11-30 北京炬力北方微电子有限公司 一种三维投影映射方法及装置
CN109571507A (zh) 2019-01-16 2019-04-05 鲁班嫡系机器人（深圳）有限公司 一种服务机器人系统及服务方法

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000352761A (ja) 1999-06-10 2000-12-19 Sony Corp 映像投射装置及び方法並びに映像投射制御装置
JP2008033234A (ja) 2006-02-21 2008-02-14 Matsushita Electric Works Ltd 映像表示装置、映像表示装置の映像歪み補正方法
JP2010538755A (ja) 2007-09-12 2010-12-16 ディズニー エンタープライゼズ，インコーポレイテッド 相互作用的なアニマトロニクス・ショーの分散制御システム及び分散制御方法
JP2009216958A (ja) 2008-03-11 2009-09-24 Gifu Univ 三次元表示装置
JP2011254411A (ja) 2010-06-04 2011-12-15 Hokkaido Univ 映像投影システムおよび映像投影プログラム
JP2017522967A (ja) 2014-07-22 2017-08-17 ユニバーサル シティ スタジオズ リミテッド ライアビリティ カンパニー 車両運搬室システム及び方法
JP2016145933A (ja) 2015-02-09 2016-08-12 コニカミノルタ株式会社 顔容貌疑似化装置および顔容貌疑似化方法
US20180071643A1 (en) 2016-09-13 2018-03-15 Universal City Studios Llc Systems and methods for incorporating pneumatic robotic systems into amusement park attractions
US20190302991A1 (en) 2018-03-29 2019-10-03 Universal City Studios Llc Interactive animated character head systems and methods

Also Published As

Publication number Publication date
WO2021138100A1 (en) 2021-07-08
JP2023509640A (ja) 2023-03-09
US20210205999A1 (en) 2021-07-08
US12552044B2 (en) 2026-02-17
EP4085448A1 (en) 2022-11-09
CN114868179B (zh) 2025-11-18
CN114868179A (zh) 2022-08-05
CA3161199A1 (en) 2021-07-08
JP7854083B2 (ja) 2026-04-30
KR20220123098A (ko) 2022-09-05
US11772276B2 (en) 2023-10-03
US20240009853A1 (en) 2024-01-11
CN120148373A (zh) 2025-06-13
JP2025081516A (ja) 2025-05-27

Similar Documents

Publication Publication Date Title
JP7639004B2 (ja) リアルタイム反応型投影メディアを用いた光学パフォーマンスキャプチャ式アニメフィギュアのためのシステム及び方法
JP7403452B2 (ja) 双方向ビデオゲームシステム
CN109829976A (zh) 一种基于全息技术实时表演方法及其系统
JP2024514565A (ja) アニメフィギュアの動的プロジェクションマッピングのためのシステム及び方法
WO2022216913A1 (en) Systems and methods for dynamic projection mapping for animated figures
JP2024525357A (ja) アニメーションフィギュアのメディア投影のためのシステム及び方法
US20250142029A1 (en) Systems and methods for projection mapping onto multiple rigid bodies
CN120523328A (zh) 基于数字化技术的虚实结合多维度展示交互方法
US20240226759A1 (en) Show effect system for an amusement park
HK40128191A (zh) 用於具有实时反应投影媒体的光学表现捕获的动画形象的系统和方法
HK40079197A (en) Systems and methods for optical performance captured animated figure with real-time reactive projected media
JP2025522348A (ja) 動的プロジェクションマッピングのための校正システム及び方法
EP4611365A1 (en) Dynamic augmented projected show elements
KR20250129798A (ko) 놀이공원용 쇼 효과 시스템
HK40104563A (zh) 用於动画形象的动态投影映射的系统和方法
KR20240111547A (ko) 3d 실사형 입체 프로젝션 맵핑 형성장치 및 방법
JP2024523410A (ja) アトラクションシステムのプロジェクションマッピングのためのシステム及び方法
KR20240086905A (ko) 특정인을 추적하는 로봇시스템
HK40103696A (zh) 用於动画形象显示的系统和方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20231206

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20231206

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20240920

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20240926

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20241223

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20250120

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20250219

R150 Certificate of patent or registration of utility model

Ref document number: 7639004

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150