JP7394046B2 - システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム - Google Patents

システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム Download PDF

Info

Publication number
JP7394046B2
JP7394046B2 JP2020195149A JP2020195149A JP7394046B2 JP 7394046 B2 JP7394046 B2 JP 7394046B2 JP 2020195149 A JP2020195149 A JP 2020195149A JP 2020195149 A JP2020195149 A JP 2020195149A JP 7394046 B2 JP7394046 B2 JP 7394046B2
Authority
JP
Japan
Prior art keywords
imaging
user
coordinate information
imaging mode
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2020195149A
Other languages
English (en)
Japanese (ja)
Other versions
JP2022083680A5 (cg-RX-API-DMAC7.html
JP2022083680A (ja
Inventor
直之 宮田
英樹 柳澤
麻美子 石田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Priority to JP2020195149A priority Critical patent/JP7394046B2/ja
Priority to EP21897808.8A priority patent/EP4252871A4/en
Priority to US18/253,070 priority patent/US12401883B2/en
Priority to PCT/JP2021/042137 priority patent/WO2022113834A1/ja
Publication of JP2022083680A publication Critical patent/JP2022083680A/ja
Publication of JP2022083680A5 publication Critical patent/JP2022083680A5/ja
Application granted granted Critical
Publication of JP7394046B2 publication Critical patent/JP7394046B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Position Input By Displaying (AREA)
  • Image Analysis (AREA)
JP2020195149A 2020-11-25 2020-11-25 システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム Active JP7394046B2 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2020195149A JP7394046B2 (ja) 2020-11-25 2020-11-25 システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム
EP21897808.8A EP4252871A4 (en) 2020-11-25 2021-11-16 SYSTEM, IMAGING DEVICE, INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND INFORMATION PROCESSING PROGRAM
US18/253,070 US12401883B2 (en) 2020-11-25 2021-11-16 System, imaging apparatus, information processing apparatus, information processing method, and information processing program
PCT/JP2021/042137 WO2022113834A1 (ja) 2020-11-25 2021-11-16 システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2020195149A JP7394046B2 (ja) 2020-11-25 2020-11-25 システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム

Publications (3)

Publication Number Publication Date
JP2022083680A JP2022083680A (ja) 2022-06-06
JP2022083680A5 JP2022083680A5 (cg-RX-API-DMAC7.html) 2023-03-30
JP7394046B2 true JP7394046B2 (ja) 2023-12-07

Family

ID=81755960

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020195149A Active JP7394046B2 (ja) 2020-11-25 2020-11-25 システム、撮像装置、情報処理装置、情報処理方法および情報処理プログラム

Country Status (4)

Country Link
US (1) US12401883B2 (cg-RX-API-DMAC7.html)
EP (1) EP4252871A4 (cg-RX-API-DMAC7.html)
JP (1) JP7394046B2 (cg-RX-API-DMAC7.html)
WO (1) WO2022113834A1 (cg-RX-API-DMAC7.html)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7434207B2 (ja) * 2021-04-13 2024-02-20 株式会社ソニー・インタラクティブエンタテインメント システム、情報処理方法および情報処理プログラム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014115457A (ja) 2012-12-10 2014-06-26 Sony Corp 情報処理装置および記録媒体
JP2014127987A (ja) 2012-12-27 2014-07-07 Sony Corp 情報処理装置および記録媒体
US20150109528A1 (en) 2013-10-21 2015-04-23 Postech Academy-Industry Foundation Apparatus and method for providing motion haptic effect using video analysis
JP2019213764A (ja) 2018-06-14 2019-12-19 株式会社バンダイナムコスタジオ シミュレーションシステム

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6766036B1 (en) * 1999-07-08 2004-07-20 Timothy R. Pryor Camera based man machine interfaces
KR100840023B1 (ko) * 2007-11-13 2008-06-20 (주)올라웍스 셀프 촬영 시 얼굴의 구도를 잡도록 도와주는 방법 및시스템
JP5100324B2 (ja) 2007-11-16 2012-12-19 株式会社ソニー・コンピュータエンタテインメント ゲームシステムおよびゲームコントローラ
US8538072B2 (en) * 2008-08-27 2013-09-17 Imprivata, Inc. Systems and methods for operator detection
US20100295782A1 (en) * 2009-05-21 2010-11-25 Yehuda Binder System and method for control based on face ore hand gesture detection
CN101827219B (zh) * 2010-01-22 2014-07-16 中兴通讯股份有限公司 无线终端中主从模式双摄像头控制方法及装置
JP5300777B2 (ja) * 2010-03-31 2013-09-25 株式会社バンダイナムコゲームス プログラム及び画像生成システム
US8350919B2 (en) * 2010-09-09 2013-01-08 Vizio, Inc. Configuration of a device based upon orientation
US8643741B2 (en) * 2012-01-17 2014-02-04 Apple Inc. Orientation detection using image processing
US10002297B2 (en) * 2012-06-20 2018-06-19 Imprivata, Inc. Active presence detection with depth sensing
US20140184854A1 (en) * 2012-12-28 2014-07-03 Motorola Mobility Llc Front camera face detection for rear camera zoom function
JP6143469B2 (ja) * 2013-01-17 2017-06-07 キヤノン株式会社 情報処理装置、情報処理方法及びプログラム
KR102020636B1 (ko) * 2013-06-07 2019-09-10 삼성전자주식회사 카메라에 기반한 전자 장치의 제어 방법, 저장 매체 및 전자 장치
US9630105B2 (en) * 2013-09-30 2017-04-25 Sony Interactive Entertainment Inc. Camera based safety mechanisms for users of head mounted displays
US9536351B1 (en) * 2014-02-03 2017-01-03 Bentley Systems, Incorporated Third person view augmented reality
US9363426B2 (en) * 2014-05-29 2016-06-07 International Business Machines Corporation Automatic camera selection based on device orientation
JP6426484B2 (ja) * 2015-01-28 2018-11-21 京セラ株式会社 携帯端末
JP6691351B2 (ja) * 2015-03-31 2020-04-28 株式会社バンダイナムコエンターテインメント プログラム及びゲームシステム
US9860452B2 (en) * 2015-05-13 2018-01-02 Lenovo (Singapore) Pte. Ltd. Usage of first camera to determine parameter for action associated with second camera
WO2017150795A1 (en) 2016-02-29 2017-09-08 Samsung Electronics Co., Ltd. Video display apparatus and method for reducing vr sickness
US9832368B1 (en) * 2016-05-31 2017-11-28 Motorola Mobility Llc Managing unintended camera clicks
US10095461B2 (en) * 2016-09-23 2018-10-09 Intel IP Corporation Outside-facing display for head-mounted displays
US10440261B2 (en) * 2017-04-03 2019-10-08 International Business Machines Corporation Automatic selection of a camera based on facial detection
US10430966B2 (en) * 2017-04-05 2019-10-01 Intel Corporation Estimating multi-person poses using greedy part assignment
US10803616B1 (en) * 2017-04-13 2020-10-13 Facebook Technologies, Llc Hand calibration using single depth camera
US20180356880A1 (en) * 2017-04-14 2018-12-13 Colopl, Inc. Information processing method and apparatus, and program for executing the information processing method on computer
US10688396B2 (en) * 2017-04-28 2020-06-23 Sony Interactive Entertainment Inc. Second screen virtual window into VR environment
US10812731B2 (en) * 2018-08-22 2020-10-20 Qualcomm Incorporated Adjustable receiver exposure times for active depth sensing systems

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014115457A (ja) 2012-12-10 2014-06-26 Sony Corp 情報処理装置および記録媒体
JP2014127987A (ja) 2012-12-27 2014-07-07 Sony Corp 情報処理装置および記録媒体
US20150109528A1 (en) 2013-10-21 2015-04-23 Postech Academy-Industry Foundation Apparatus and method for providing motion haptic effect using video analysis
JP2019213764A (ja) 2018-06-14 2019-12-19 株式会社バンダイナムコスタジオ シミュレーションシステム

Also Published As

Publication number Publication date
EP4252871A4 (en) 2024-09-18
WO2022113834A1 (ja) 2022-06-02
US12401883B2 (en) 2025-08-26
US20230353860A1 (en) 2023-11-02
EP4252871A1 (en) 2023-10-04
JP2022083680A (ja) 2022-06-06

Similar Documents

Publication Publication Date Title
US11086392B1 (en) Devices, systems, and methods for virtual representation of user interface devices
KR20220120649A (ko) 인공 현실 콘텐츠의 가변 초점 디스플레이를 갖는 인공 현실 시스템
US20210042513A1 (en) Information processing apparatus, information processing method, and program
JP2003337963A (ja) 画像処理装置および画像処理方法、ならびに、画像処理プログラムおよびその記録媒体
WO2017077918A1 (ja) 情報処理装置、情報処理システム、および情報処理方法
US10978019B2 (en) Head mounted display system switchable between a first-person perspective mode and a third-person perspective mode, related method and related non-transitory computer readable storage medium
US11137600B2 (en) Display device, display control method, and display system
WO2017130514A1 (ja) 情報処理装置、情報処理方法、およびプログラムを記録したコンピュータ読み取り可能な記録媒体
KR20150040580A (ko) 가상 공간 멀티 터치 인터랙션 장치 및 방법
JP7300436B2 (ja) 情報処理装置、システム、情報処理方法および情報処理プログラム
US20210068674A1 (en) Track user movements and biological responses in generating inputs for computer systems
US12401883B2 (en) System, imaging apparatus, information processing apparatus, information processing method, and information processing program
CN115066668A (zh) 显示控制装置、显示控制方法和记录介质
JP7434207B2 (ja) システム、情報処理方法および情報処理プログラム
JP7513564B2 (ja) システム、情報処理方法および情報処理プログラム
WO2023238678A1 (ja) 情報処理装置、コントローラ表示方法およびコンピュータプログラム
WO2019054037A1 (ja) 情報処理装置、情報処理方法、およびプログラム
TWI867727B (zh) 追蹤系統、追蹤方法及自追蹤追蹤器
US20260069982A1 (en) Information processing device and image generation method
JP2025078532A (ja) 情報処理装置、情報処理装置のシステム、情報処理装置の制御方法、プログラム
US20260105700A1 (en) Information processing apparatus and information processing method
US20250148727A1 (en) Information processing apparatus controlling reproduction of video of virtual object, control method of information processing apparatus, and storage medium
EP4610785A1 (en) Input device, control apparatus, control method, information processing apparatus, and information processing method
JP2025040859A (ja) 情報処理装置、情報処理システム、情報処理方法、プログラム
JP2023120842A (ja) 情報処理装置、デバイス速度推定方法およびデバイス位置推定方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230322

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20230322

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20231107

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20231127

R150 Certificate of patent or registration of utility model

Ref document number: 7394046

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150