CA3161199A1 - Systems and methods for optical performance captured animated figure with real-time reactive projected media - Google Patents

Systems and methods for optical performance captured animated figure with real-time reactive projected media Download PDF

Info

Publication number
CA3161199A1
CA3161199A1 CA3161199A CA3161199A CA3161199A1 CA 3161199 A1 CA3161199 A1 CA 3161199A1 CA 3161199 A CA3161199 A CA 3161199A CA 3161199 A CA3161199 A CA 3161199A CA 3161199 A1 CA3161199 A1 CA 3161199A1
Authority
CA
Canada
Prior art keywords
animated
media
guest
controller
control system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3161199A
Other languages
English (en)
French (fr)
Inventor
Anthony Alexander MECCA
Timothy J. Eck
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universal City Studios LLC
Original Assignee
Universal City Studios LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universal City Studios LLC filed Critical Universal City Studios LLC
Publication of CA3161199A1 publication Critical patent/CA3161199A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • G09F27/005—Signs associated with a sensor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
    • B25J11/0015—Face robots, animated artificial faces for imitating human expressions
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B25J11/003—Manipulators for entertainment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • B25J13/088—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices with position, velocity or acceleration sensors
    • B25J13/089—Determining the position of the robot with reference to its environment
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1615—Program controls characterised by special kind of manipulator, e.g. planar, scara, gantry, cantilever, space, closed chain, passive/active joints and tendon driven manipulators
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/02—Advertising or display means not otherwise provided for incorporating moving display members
    • G09F19/08—Dolls, faces, or other representations of living forms with moving parts
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179—Video signal processing therefor
    • H04N9/3185—Geometric adjustment, e.g. keystone or convergence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/35—Nc in input of data, input till input file format
    • G05B2219/35444—Gesture interface, controlled machine observes operator, executes commands
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40411—Robot assists human in non-industrial environment like home or office
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00—Combined visual and audible advertising or displaying, e.g. for public address
    • G09F2027/001—Comprising a presence or proximity detector

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Robotics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Geometry (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
CA3161199A 2020-01-02 2020-12-21 Systems and methods for optical performance captured animated figure with real-time reactive projected media Pending CA3161199A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US202062956468P 2020-01-02 2020-01-02
US62/956,468 2020-01-02
US17/122,716 2020-12-15
US17/122,716 US11772276B2 (en) 2020-01-02 2020-12-15 Systems and methods for optical performance captured animated figure with real-time reactive projected media
PCT/US2020/066314 WO2021138100A1 (en) 2020-01-02 2020-12-21 Systems and methods for optical performance captured animated figure with real-time reactive projected media

Publications (1)

Publication Number Publication Date
CA3161199A1 true CA3161199A1 (en) 2021-07-08

Family

ID=76654233

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3161199A Pending CA3161199A1 (en) 2020-01-02 2020-12-21 Systems and methods for optical performance captured animated figure with real-time reactive projected media

Country Status (7)

Country Link
US (2) US11772276B2 (https=)
EP (1) EP4085448A1 (https=)
JP (2) JP7639004B2 (https=)
KR (1) KR20220123098A (https=)
CN (2) CN120148373A (https=)
CA (1) CA3161199A1 (https=)
WO (1) WO2021138100A1 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12112415B2 (en) * 2021-04-09 2024-10-08 Universal City Studios Llc Systems and methods for animated figure display
US12309660B2 (en) * 2021-05-06 2025-05-20 Universal City Studios Llc Systems and methods for layered data reporting in an attraction
RU2767860C1 (ru) * 2021-09-14 2022-03-22 Дмитрий Геннадьевич Хоружик Мобильный сценический комплекс
US12502621B2 (en) 2022-06-30 2025-12-23 Universal City Studios Llc Animated figure walking mechanism
CN119855637A (zh) * 2022-09-06 2025-04-18 环球城市电影有限责任公司 用于游乐园景点设计的有形/虚拟设计系统及方法
US20240119852A1 (en) * 2022-10-09 2024-04-11 Shawn Paul Kelly Singing campfire
KR20240083458A (ko) * 2022-12-05 2024-06-12 삼성전자주식회사 외부 객체의 모션에 대응하는 시각적 객체를 생성하기 위한 전자 장치 및 그 방법
US20240189734A1 (en) * 2022-12-13 2024-06-13 Universal City Studios Llc Reactive show action equipment system
WO2024129742A1 (en) * 2022-12-13 2024-06-20 Universal City Studios Llc Reactive show action equipment system
WO2024148180A1 (en) * 2023-01-06 2024-07-11 Universal City Studios Llc Show effect system for an amusement park
WO2025096833A1 (en) * 2023-10-31 2025-05-08 Universal City Studios Llc Systems and methods for projection mapping onto multiple rigid bodies
US20250278879A1 (en) * 2024-03-01 2025-09-04 Disney Enterprises, Inc. Dynamic augmented projected show elements

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6317511Y2 (https=) * 1980-03-27 1988-05-18
JPS56141695A (en) 1980-04-08 1981-11-05 Onkyo Corp Vibration diaphragm for speaker having honey-comb structure
US5325473A (en) 1991-10-11 1994-06-28 The Walt Disney Company Apparatus and method for projection upon a three-dimensional object
US5852672A (en) 1995-07-10 1998-12-22 The Regents Of The University Of California Image system for three dimensional, 360 DEGREE, time sequence surface mapping of moving objects
US6554431B1 (en) * 1999-06-10 2003-04-29 Sony Corporation Method and apparatus for image projection, and apparatus controlling image projection
JP4222420B2 (ja) * 2006-02-21 2009-02-12 パナソニック電工株式会社 映像表示装置、映像表示装置の映像歪み補正方法
US8589824B2 (en) 2006-07-13 2013-11-19 Northrop Grumman Systems Corporation Gesture recognition interface system
US8060255B2 (en) * 2007-09-12 2011-11-15 Disney Enterprises, Inc. System and method of distributed control of an interactive animatronic show
DE102007055204B4 (de) 2007-11-19 2010-04-08 Deutsches Zentrum für Luft- und Raumfahrt e.V. Roboter, medizinischer Arbeitsplatz und Verfahren zum Projizieren eines Bildes auf die Oberfläche eines Objekts
JP5024766B2 (ja) * 2008-03-11 2012-09-12 国立大学法人岐阜大学 三次元表示装置
US8256904B2 (en) * 2008-05-23 2012-09-04 Disney Enterprises, Inc. Rear projected expressive head
US8223196B2 (en) * 2009-06-10 2012-07-17 Disney Enterprises, Inc. Projector systems and methods for producing digitally augmented, interactive cakes and other food products
US8259997B2 (en) 2009-07-13 2012-09-04 Moment Factory Real-time tracking system
JP2011254411A (ja) * 2010-06-04 2011-12-15 Hokkaido Univ 映像投影システムおよび映像投影プログラム
US8928735B2 (en) 2011-06-14 2015-01-06 Microsoft Corporation Combined lighting, projection, and image capture without video feedback
US9832352B2 (en) * 2011-11-16 2017-11-28 Autofuss System and method for 3D projection mapping with robotically controlled objects
CN104054023B (zh) 2011-11-16 2017-11-17 欧特法斯公司 用于与机器人控制的物体映射的3d投影的系统和方法
US20140111629A1 (en) * 2012-10-20 2014-04-24 Margaret Morris System for dynamic projection of media
US9300901B2 (en) 2013-12-04 2016-03-29 Disney Enterprises, Inc. Augmenting physical appearance using illumination
KR101710003B1 (ko) 2014-01-07 2017-02-24 한국전자통신연구원 실시간 동적 비평면 프로젝션 장치 및 방법
US9526997B2 (en) * 2014-07-22 2016-12-27 Universal City Studios Llc Vehicle transportation room system and method
JP6332067B2 (ja) * 2015-02-09 2018-05-30 コニカミノルタ株式会社 顔容貌疑似化装置および顔容貌疑似化方法
JP2016152586A (ja) 2015-02-19 2016-08-22 国立大学法人電気通信大学 プロジェクションマッピング装置、映像投影制御装置、映像投影制御方法および映像投影制御プログラム
KR101684270B1 (ko) 2015-03-13 2016-12-20 주식회사 레드로버 표면윤곽 변화를 고려한 동적 프로젝션 매핑 방법
CN108697938B (zh) * 2016-01-06 2020-07-10 埃沃洛夫有限公司 具有可变角色的机器人
JP6374418B2 (ja) 2016-01-27 2018-08-15 キヤノンファインテックニスカ株式会社 転写材、記録物、記録物の製造装置、および記録物の製造方法
US10350504B2 (en) * 2016-09-13 2019-07-16 Universal City Studios Llc Systems and methods for incorporating pneumatic robotic systems into amusement park attractions
US10802665B2 (en) * 2016-10-05 2020-10-13 Motorola Solutions, Inc. System and method for projecting graphical objects
US9958767B1 (en) 2016-11-01 2018-05-01 Disney Enterprises, Inc. Projection mapped augmentation of mechanically animated objects
ES2970599T3 (es) * 2017-03-25 2024-05-29 Universal City Studios Llc Sistema y método de robot suave
US11061304B2 (en) * 2017-04-03 2021-07-13 SmartDeco LLC Rear-projected animated display device
US10845975B2 (en) 2018-03-29 2020-11-24 Universal City Studios Llc Interactive animated character head systems and methods
CN108921779A (zh) 2018-07-13 2018-11-30 北京炬力北方微电子有限公司 一种三维投影映射方法及装置
CN109571507A (zh) 2019-01-16 2019-04-05 鲁班嫡系机器人（深圳）有限公司 一种服务机器人系统及服务方法

Also Published As

Publication number Publication date
WO2021138100A1 (en) 2021-07-08
JP2023509640A (ja) 2023-03-09
US20210205999A1 (en) 2021-07-08
JP7639004B2 (ja) 2025-03-04
US12552044B2 (en) 2026-02-17
EP4085448A1 (en) 2022-11-09
CN114868179B (zh) 2025-11-18
CN114868179A (zh) 2022-08-05
JP7854083B2 (ja) 2026-04-30
KR20220123098A (ko) 2022-09-05
US11772276B2 (en) 2023-10-03
US20240009853A1 (en) 2024-01-11
CN120148373A (zh) 2025-06-13
JP2025081516A (ja) 2025-05-27

Similar Documents

Publication Publication Date Title
US12552044B2 (en) Systems and methods for optical performance captured animated figure with real-time reactive projected media
KR20230048554A (ko) 3차원 환경들과의 상호작용을 위한 디바이스들, 방법들 및 그래픽 사용자 인터페이스들
CN111417443A (zh) 交互式视频游戏系统
JP2021530292A (ja) ライトフィールドディスプレイシステムベースの遊園地のアトラクション
US20220323874A1 (en) Systems and methods for dynamic projection mapping for animated figures
US12236152B2 (en) Information processing apparatus and information processing method for displaying a feeling parameter associated with an autonomous moving body
WO2022216913A1 (en) Systems and methods for dynamic projection mapping for animated figures
US20250142029A1 (en) Systems and methods for projection mapping onto multiple rigid bodies
WO2022158279A1 (ja) 自律移動体及び情報処理方法
HK40079197A (en) Systems and methods for optical performance captured animated figure with real-time reactive projected media
US20240226759A1 (en) Show effect system for an amusement park
HK40128191A (zh) 用於具有实时反应投影媒体的光学表现捕获的动画形象的系统和方法
US20230403381A1 (en) Calibration systems and methods for dynamic projection mapping
JP2025522348A (ja) 動的プロジェクションマッピングのための校正システム及び方法
HK40104563A (zh) 用於动画形象的动态投影映射的系统和方法
KR20250129798A (ko) 놀이공원용 쇼 효과 시스템
WO2025041587A1 (ja) 情報処理装置及び情報処理方法
HK40033460A (en) Interactive video game system

Legal Events

Date Code Title Description
MFA Maintenance fee for application paid

Free format text: FEE DESCRIPTION TEXT: MF (APPLICATION, 4TH ANNIV.) - STANDARD

Year of fee payment: 4

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20241213

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT DETERMINED COMPLIANT

Effective date: 20241213

Free format text: ST27 STATUS EVENT CODE: A-1-1-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20241213

D11 Substantive examination requested

Free format text: ST27 STATUS EVENT CODE: A-1-1-D10-D11-D117 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: REQUEST FOR EXAMINATION RECEIVED

Effective date: 20241218

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-1-1-P10-P11-P101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT RECEIVED - VOLUNTARY AMENDMENT

Effective date: 20241218

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20241218

D00 Search and/or examination requested or commenced

Free format text: ST27 STATUS EVENT CODE: A-1-1-D10-D00-D118 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: REQUEST FOR EXAMINATION REQUIREMENTS DETERMINED COMPLIANT

Effective date: 20250109

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-1-1-P10-P11-P102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: AMENDMENT DETERMINED COMPLIANT

Effective date: 20250109

P13 Application amended

Free format text: ST27 STATUS EVENT CODE: A-1-1-P10-P13-X000 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: APPLICATION AMENDED

Effective date: 20250109

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W111 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: CORRESPONDENT DETERMINED COMPLIANT

Effective date: 20250109

D11 Substantive examination requested

Free format text: ST27 STATUS EVENT CODE: A-1-2-D10-D11-D155 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: ALL REQUIREMENTS FOR EXAMINATION DETERMINED COMPLIANT

Effective date: 20250501

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-2-2-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20250523