WO2020262261A1 - 情報処理装置、情報処理方法及びプログラム - Google Patents

情報処理装置、情報処理方法及びプログラム Download PDF

Info

Publication number
WO2020262261A1
WO2020262261A1 PCT/JP2020/024249 JP2020024249W WO2020262261A1 WO 2020262261 A1 WO2020262261 A1 WO 2020262261A1 JP 2020024249 W JP2020024249 W JP 2020024249W WO 2020262261 A1 WO2020262261 A1 WO 2020262261A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
model
information processing
captured image
control unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/024249
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
尚子 菅野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to JP2021526948A priority Critical patent/JP7582186B2/ja
Priority to EP20830863.5A priority patent/EP3982331A4/en
Priority to US17/618,647 priority patent/US11842453B2/en
Priority to CN202080045553.2A priority patent/CN114008582B/zh
Publication of WO2020262261A1 publication Critical patent/WO2020262261A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/94—Hardware or software architectures specially adapted for image or video understanding
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/64—Three-dimensional [3D] objects
    • G06V20/653—Three-dimensional [3D] objects by matching three-dimensional models, e.g. conformal mapping of Riemann surfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/165—Detection; Localisation; Normalisation using facial parts and geometric relationships
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/176—Dynamic expression
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Definitions

  • the present disclosure relates to information processing devices, information processing methods and programs, and in particular, information processing devices, information processing methods and programs capable of causing 3D objects to perform interactive movements and reactions according to the movements of an observer. Regarding the program.
  • Fourth Embodiment 4-1 Functional configuration of mobile terminals 4-2. Flow of processing performed by mobile terminals 4-3. Effect of the fourth embodiment 5.
  • Fifth Embodiment 5-1 Functional configuration of mobile terminals 5-2. Flow of processing performed by mobile terminals 5-3. Effect of the fifth embodiment 6.
  • Sixth Embodiment 6-1 Functional configuration of mobile terminals 6-2. Flow of processing performed by mobile terminals 6-3. Effect of the sixth embodiment 7.
  • Functional configuration of mobile terminals 7-2 Flow of processing performed by mobile terminals 7-3. Effect of the seventh embodiment 8.
  • Eighth Embodiment 8-1 Outline of information processing device 8-2.
  • Functional configuration of information processing device 8-3 Functional configuration of processing performed by the information processing device 8-4. Effect of the eighth embodiment 9.
  • Ninth Embodiment 9-1 Outline of information processing device 9-2.
  • Functional configuration of information processing device 9-3 Functional configuration of processing performed by the information processing device 9-4. Effect of 9th Embodiment 9-1.
  • FIG. 2 is a diagram illustrating an AR application.
  • FIG. 7A shows an enlarged view of the left eye of the subject 92 detected from the captured image I captured by the camera 84.
  • the distance dp between the center of the pupil P and the inner corner of the eye Q changes according to the line-of-sight direction. Specifically, as shown in FIG. 7A, when the line of sight turns to the left (toward the outer corner S side of the eye), the distance dp increases. On the other hand, when the line of sight turns to the right (toward the inner Q side of the eye), the distance dp becomes smaller. Therefore, when the distance dp is measured, the approximate line-of-sight direction can be calculated.
  • FIG. 7B is an example of capturing the face of the subject 92 with the camera 84 while irradiating the infrared LED 86. It is assumed that the camera 84 has sensitivity to light having a wavelength emitted by the infrared LED 86.
  • the line-of-sight measurement method shown in FIG. 7B detects the region of the eyeball from the captured face image, and based on the position of the reflected image (corneal reflex image) of the infrared LED86 in the detected cornea of the eyeball, the line-of-sight.
  • the direction E is detected. Since the wavelength of the light emitted by the infrared LED 86 is an invisible wavelength, the line-of-sight direction can be detected without disturbing the subject 92.
  • FIG. 7B shows an enlarged view of the left eye of the subject 92 detected from the captured image I captured by the camera 84.
  • the positional relationship between the center of the pupil P and the corneal reflex image R changes according to the line-of-sight direction. Specifically, as shown in FIG. 7B, when the line of sight turns to the left (toward the outer corner S side of the eye), the pupil P is located on the outer corner S side of the corneal reflex image R. On the other hand, when the line of sight is directed to the right (facing the inner corner Q side of the eye), the pupil P is located closer to the inner corner Q side of the corneal reflex image R. Therefore, when the positional relationship between the pupil P and the corneal reflex image R is measured, an approximate line-of-sight direction can be detected.
  • the 3D model frame selection unit 54a selects the 3D model 90M of the differential default determined in advance according to the AR marker 85 from the 3D model M stored in the storage unit 38. .. Then, the 3D model drawing direction control unit 54b superimposes and displays the selected 3D model 90M at a position corresponding to the AR marker 85 of the captured image I (step S13).
  • the line-of-sight direction detection unit 53b determines whether the subject 92 is looking at the camera, that is, whether the line-of-sight direction E of the subject 92 is facing the direction of the camera 84 (step S17).
  • step S17: Yes the process proceeds to step S19.
  • step S17: No the process proceeds to step S18.
  • the subject feature detection unit 53 detects the line-of-sight direction E, which is a feature of the subject 92
  • the display control unit 54 detects it.
  • the line-of-sight direction F (face direction) of the 3D model 90M is changed according to the line-of-sight direction E of the subject 92.
  • the 3D model 90M perform an interactive operation or reaction according to the line-of-sight direction E of the subject 92.
  • the 3D model 90M can be made to perform interactive movements and reactions according to the subject 92.
  • the second embodiment of the present disclosure is an example of a mobile terminal 80 (information processing device) having a function of allowing the subject 92 and the 3D model 90M to look at each other with their eyes aligned.
  • step S37 the 3D model drawing direction control unit 54b directs the drawing position of the 3D model 90M toward the face of the subject 92 (step S39).
  • the smile detection unit 53c detects whether the subject 92 reflected in the captured image I is a smile.
  • the smile detection unit 53c extracts the facial region of the subject 92 detected by the subject detection unit 53a. Then, the smile detection unit 53c collates the extracted facial area with a sample showing a smile among a large number of facial expression samples stored in the facial expression database (not shown in FIG. 12).
  • the smile detection unit 53c determines that the subject 92 is a smile when the extracted facial region shows a high degree of collation with the sample showing a smile.
  • the smile detection unit 53c may determine whether or not the person is smiling by using another image processing algorithm.
  • step S50 to step S55 in FIG. 13 Since the processing flow from step S50 to step S55 in FIG. 13 is the same as the processing flow from step S10 to step S15 in FIG. 9 described in the first embodiment, the description thereof will be omitted.
  • step S55 When it is determined in step S55 that the subject 92 has been detected (step S55: Yes), the line-of-sight direction detection unit 53b detects the line-of-sight direction E of the subject 92. Then, the smile detection unit 53c determines whether the subject 92 is a smile (step S56).
  • step S57 determines whether the line-of-sight direction E of the subject 92 is facing the direction of the camera 84 (step S57).
  • step S57: Yes the process proceeds to step S59.
  • step S58 the process proceeds to step S58.
  • FIG. 14 is a functional block diagram showing an example of the functional configuration of the mobile terminal according to the fourth embodiment.
  • the mobile terminal 80 of the fourth embodiment has a functional configuration in which some functions are exchanged with the mobile terminal 80 of the first embodiment (see FIG. 6).
  • FIG. 6 shows the mobile terminal 80 of the first embodiment.
  • the subject feature detection unit 53 includes a shooting environment evaluation unit 53d instead of the line-of-sight direction detection unit 53b.
  • the 3D model brightness control unit 54c determines that the skin brightness and skin tone of the 3D model 90M are the skin brightness of the subject 92 based on the skin brightness and skin tone of the subject 92 reflected in the captured image I.
  • the texture of the 3D model 90M may be corrected to be comparable to the shade of the pods.
  • FIG. 15 is a flowchart showing an example of the flow of processing performed by the mobile terminal according to the fourth embodiment. Hereinafter, the processing flow will be described step by step.
  • the imaging / recording processing unit 51b performs self-shooting in a state where both the subject 92 and the 3D model 90N are projected (step S79).
  • the drawing position (distance from the camera 84) of the 3D model 90M is corrected according to the position of the subject 92 (distance from the camera 84), and the subject 92 and the 3D model 90M are corrected.
  • This is an example of a mobile terminal 80 (information processing device) having a function of performing self-portrait photography in a state where both are in focus. That is, the mobile terminal 80 of the present embodiment changes the display mode (drawing position) of the 3D model 90M according to the position (distance from the camera 84), which is a feature of the subject 92.
  • the subject detection unit 53a detects the subject 92 from the captured image I (step S85).
  • the depth of field calculation unit 53e calculates the distance between the camera 84 and the subject 92.
  • FIG. 19 is a flowchart showing an example of the flow of processing performed by the mobile terminal according to the sixth embodiment. Hereinafter, the processing flow will be described step by step.
  • step S90 to step S92 in FIG. 19 Since the processing flow from step S90 to step S92 in FIG. 19 is the same as the processing flow from step S10 to step S12 in FIG. 9 described in the first embodiment, the description thereof will be omitted.
  • each of the above-described embodiments may have the functions of a plurality of different embodiments. Then, in that case, the mobile terminal 80 is provided with all the functional configurations of the plurality of embodiments.
  • the camera 84 connected to the information processing device 81a captures the user who is the subject 92 and generates an captured image Ia (virtual image).
  • the generated captured image Ia is wirelessly transmitted and displayed on the head-mounted display 89 (HMD) worn by the subject 92.
  • the captured image Ia displayed on the head-mounted display 89 displays the avatar 92a (first avatar), which is the alter ego of the subject 92, and the 3D model 90M described in each embodiment of the present disclosure is superimposed. Is displayed.
  • the avatar 92a is a full CG movie.
  • the avatar 92a has a function of capturing an image using a virtual camera 84V in a virtual space. That is, when the subject 92 issues an instruction to operate the virtual camera 84V via the controller 88, the avatar 92a takes out the virtual camera 84V and captures an image in the direction instructed by the subject 92 in the virtual space.
  • the 3D model frame selection unit 54a selects a predetermined 3D model 90M from a plurality of 3D model M stored in the storage unit 38. Further, the 3D model frame selection unit 54a selects the 3D model 90M having the line-of-sight direction F corresponding to the line-of-sight direction E of the avatar 92a detected by the line-of-sight direction detection unit 53b. More specifically, the 3D model frame selection unit 54a selects the 3D model 90M in which the line-of-sight direction F of the 3D model 90M faces the virtual camera 84V when the avatar 92a is looking at the virtual camera.
  • the line-of-sight direction detection unit 53b determines whether the avatar 93a is looking at the virtual camera 84V, that is, is looking at the virtual camera (step S136). When it is determined that the avatar 93a is looking at the virtual camera (step S136: Yes), the process proceeds to step S137. On the other hand, if it is not determined that the avatar 93a is looking at the virtual camera (step S136: No), the process returns to step S135.
  • the subject 92 (user) can make another subject 93 perform an interactive operation or reaction in the virtual space.
  • a control unit that controls the 3D model displayed in the captured image The captured image is provided with a detection unit for detecting the characteristics of the subject displayed at the same time as the 3D model.
  • the control unit is an information processing device that changes the display mode of the 3D model according to the characteristics of the subject detected by the detection unit.
  • the detection unit detects the line-of-sight direction, which is a feature of the subject.
  • the control unit changes the orientation of the 3D model according to the detected line-of-sight direction of the subject.
  • the information processing device according to (1) above.
  • the control unit changes the orientation of the 3D model by rotating the 3D model according to the line-of-sight direction of the subject.
  • the control unit changes the orientation of the 3D model by rotating the coordinate system in which the 3D model is placed according to the line-of-sight direction of the subject.
  • the information processing device according to (2) above.
  • the control unit changes the orientation of the 3D model to the direction in which the captured image is captured.
  • the information processing device according to any one of (1) to (4).
  • (6) When the detection unit detects that the line-of-sight direction of the subject is facing the 3D model, The control unit changes the orientation of the 3D model to face the subject.
  • the information processing device according to any one of (1) to (4).
  • the information processing device according to any one of (1) to (8).
  • the detection unit detects the position of the subject in the captured image, which is a feature of the subject. When the position of the subject and the position of the 3D model are predicted to overlap, the control unit changes the display position of the 3D model to a position that does not overlap with the subject.
  • the information processing device according to any one of (1) to (9) above.
  • the detection unit detects the position and size of the subject in the captured image, which is a feature of the subject.
  • the control unit adjusts the display position and size of the 3D model according to the position and size of the subject.
  • the information processing device according to any one of (1) to (10).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Architecture (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Ophthalmology & Optometry (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Image Analysis (AREA)
PCT/JP2020/024249 2019-06-28 2020-06-19 情報処理装置、情報処理方法及びプログラム Ceased WO2020262261A1 (ja)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2021526948A JP7582186B2 (ja) 2019-06-28 2020-06-19 情報処理装置、情報処理方法及びプログラム
EP20830863.5A EP3982331A4 (en) 2019-06-28 2020-06-19 INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING METHOD AND PROGRAM
US17/618,647 US11842453B2 (en) 2019-06-28 2020-06-19 Information processing device, information processing method, and program
CN202080045553.2A CN114008582B (zh) 2019-06-28 2020-06-19 信息处理装置、信息处理方法和程序

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019121554 2019-06-28
JP2019-121554 2019-06-28

Publications (1)

Publication Number Publication Date
WO2020262261A1 true WO2020262261A1 (ja) 2020-12-30

Family

ID=74060879

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/024249 Ceased WO2020262261A1 (ja) 2019-06-28 2020-06-19 情報処理装置、情報処理方法及びプログラム

Country Status (5)

Country Link
US (1) US11842453B2 (https=)
EP (1) EP3982331A4 (https=)
JP (1) JP7582186B2 (https=)
CN (1) CN114008582B (https=)
WO (1) WO2020262261A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024009745A1 (ja) * 2022-07-07 2024-01-11 ソニーグループ株式会社 情報処理装置、情報処理方法、および記録媒体
WO2024202483A1 (ja) * 2023-03-31 2024-10-03 株式会社コロプラ プログラム
WO2024204042A1 (ja) * 2023-03-30 2024-10-03 富士フイルム株式会社 情報処理装置、情報処理方法、プログラム、及び記録媒体

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021132013A1 (ja) * 2019-12-27 2021-07-01 ソニーグループ株式会社 情報処理装置、情報処理方法及び情報処理プログラム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006227838A (ja) * 2005-02-16 2006-08-31 Nec Corp 画像処理装置及び画像処理プログラム
JP2007042055A (ja) * 2005-06-30 2007-02-15 Canon Inc 画像処理方法、画像処理装置
JP2012160039A (ja) * 2011-02-01 2012-08-23 Fujifilm Corp 画像処理装置、立体画像印刷システム、画像処理方法およびプログラム
JP2015503141A (ja) * 2011-10-28 2015-01-29 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
JP2017056114A (ja) * 2015-09-18 2017-03-23 株式会社スクウェア・エニックス ビデオゲーム処理プログラム、ビデオゲーム処理システム及びビデオゲーム処理方法
WO2017082076A1 (ja) 2015-11-11 2017-05-18 ソニー株式会社 符号化装置および符号化方法、復号装置および復号方法
JP2017138914A (ja) * 2016-02-05 2017-08-10 株式会社バンダイナムコエンターテインメント 画像生成システム及びプログラム
JP2017138912A (ja) * 2016-02-05 2017-08-10 株式会社バンダイナムコエンターテインメント 画像生成システム及びプログラム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5646263B2 (ja) * 2010-09-27 2014-12-24 任天堂株式会社 画像処理プログラム、画像処理装置、画像処理システム、および、画像処理方法
US9947139B2 (en) * 2014-06-20 2018-04-17 Sony Interactive Entertainment America Llc Method and apparatus for providing hybrid reality environment
JP6632443B2 (ja) * 2016-03-23 2020-01-22 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置、情報処理システム、および情報処理方法
DK179948B1 (en) * 2017-05-16 2019-10-22 Apple Inc. Recording and sending Emoji
US11335065B2 (en) * 2017-12-05 2022-05-17 Diakse Method of construction of a computer-generated image and a virtual environment
US11600047B2 (en) * 2018-07-17 2023-03-07 Disney Enterprises, Inc. Automated image augmentation using a virtual character
KR102664688B1 (ko) * 2019-02-19 2024-05-10 삼성전자 주식회사 가상 캐릭터 기반 촬영 모드를 제공하는 전자 장치 및 이의 동작 방법
US11450051B2 (en) * 2020-11-18 2022-09-20 Snap Inc. Personalized avatar real-time motion capture

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006227838A (ja) * 2005-02-16 2006-08-31 Nec Corp 画像処理装置及び画像処理プログラム
JP2007042055A (ja) * 2005-06-30 2007-02-15 Canon Inc 画像処理方法、画像処理装置
JP2012160039A (ja) * 2011-02-01 2012-08-23 Fujifilm Corp 画像処理装置、立体画像印刷システム、画像処理方法およびプログラム
JP2015503141A (ja) * 2011-10-28 2015-01-29 マジック リープ， インコーポレイテッド 拡張現実および仮想現実のためのシステムおよび方法
JP2017056114A (ja) * 2015-09-18 2017-03-23 株式会社スクウェア・エニックス ビデオゲーム処理プログラム、ビデオゲーム処理システム及びビデオゲーム処理方法
WO2017082076A1 (ja) 2015-11-11 2017-05-18 ソニー株式会社 符号化装置および符号化方法、復号装置および復号方法
JP2017138914A (ja) * 2016-02-05 2017-08-10 株式会社バンダイナムコエンターテインメント 画像生成システム及びプログラム
JP2017138912A (ja) * 2016-02-05 2017-08-10 株式会社バンダイナムコエンターテインメント 画像生成システム及びプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3982331A4

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024009745A1 (ja) * 2022-07-07 2024-01-11 ソニーグループ株式会社 情報処理装置、情報処理方法、および記録媒体
WO2024204042A1 (ja) * 2023-03-30 2024-10-03 富士フイルム株式会社 情報処理装置、情報処理方法、プログラム、及び記録媒体
WO2024202483A1 (ja) * 2023-03-31 2024-10-03 株式会社コロプラ プログラム
JP2024146121A (ja) * 2023-03-31 2024-10-15 株式会社コロプラ プログラム
JP7728299B2 (ja) 2023-03-31 2025-08-22 株式会社コロプラ プログラム

Also Published As

Publication number Publication date
JP7582186B2 (ja) 2024-11-13
CN114008582B (zh) 2024-11-26
EP3982331A1 (en) 2022-04-13
CN114008582A (zh) 2022-02-01
US20220358724A1 (en) 2022-11-10
US11842453B2 (en) 2023-12-12
JPWO2020262261A1 (https=) 2020-12-30
EP3982331A4 (en) 2022-11-09

Similar Documents

Publication Publication Date Title
US12387442B2 (en) Mixed reality display device and mixed reality display method
JP7523615B2 (ja) 拡張現実表示装置及び拡張現実表示方法
JP7582186B2 (ja) 情報処理装置、情報処理方法及びプログラム
JP6576536B2 (ja) 情報処理装置
JP3749227B2 (ja) 立体画像処理方法および装置
CN113066189B (zh) 一种增强现实设备及虚实物体遮挡显示方法
JP3857988B2 (ja) 立体画像処理方法および装置
JP7148634B2 (ja) ヘッドマウントディスプレイ装置
JP2022183213A (ja) ヘッドマウントディスプレイ
CN117981295A (zh) 信息处理设备和程序
WO2017191703A1 (ja) 画像処理装置
JP2020182109A (ja) 情報処理装置、情報処理方法及びプログラム
WO2021171982A1 (ja) 画像処理装置、３ｄモデルの生成方法、学習方法およびプログラム
JP6649010B2 (ja) 情報処理装置
JP4118146B2 (ja) 立体画像処理装置
CN120529061A (zh) 三维成像效果的测试系统、方法、设备及存储介质
WO2018173206A1 (ja) 情報処理装置
JP2026054720A (ja) 情報処理装置、情報処理装置の制御方法、およびプログラム
JP2022083816A (ja) 画像生成装置、画像生成方法及びプログラム
CN121099022A (zh) 投影控制方法、装置、电子设备以及存储介质
JP2016054417A (ja) 立体画像処理装置、立体撮像装置、立体表示装置および立体画像処理プログラム
JP2019118042A (ja) 画像処理装置、画像処理方法及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20830863

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021526948

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2020830863

Country of ref document: EP

Effective date: 20220110

WWW Wipo information: withdrawn in national office

Ref document number: 2020830863

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 202117054256

Country of ref document: IN