SG11202112531QA - Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction - Google Patents

Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction

Info

Publication number
SG11202112531QA
SG11202112531QA SG11202112531QA SG11202112531QA SG11202112531QA SG 11202112531Q A SG11202112531Q A SG 11202112531QA SG 11202112531Q A SG11202112531Q A SG 11202112531QA SG 11202112531Q A SG11202112531Q A SG 11202112531QA SG 11202112531Q A SG11202112531Q A SG 11202112531QA
Authority
SG
Singapore
Prior art keywords
camera
techniques
mixed
reality environment
hand gesture
Prior art date
Application number
SG11202112531QA
Inventor
Maria Cheng Lei
Vishal Jain
Vikramaditya Dangi
Original Assignee
Microsoft Technology Licensing Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing Llc filed Critical Microsoft Technology Licensing Llc
Publication of SG11202112531QA publication Critical patent/SG11202112531QA/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28—Systems for automatic generation of focusing signals
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
    • G03B13/32—Means for focusing
    • G03B13/34—Power focusing
    • G03B13/36—Autofocus systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H04N23/675—Focus control based on electronic image sensor signals comprising setting of focusing regions
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Studio Devices (AREA)
  • Controls And Circuits For Display Device (AREA)
SG11202112531QA 2019-05-31 2020-04-24 Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction SG11202112531QA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/427,398 US10798292B1 (en) 2019-05-31 2019-05-31 Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction
PCT/US2020/029670 WO2020242680A1 (en) 2019-05-31 2020-04-24 Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction

Publications (1)

Publication Number Publication Date
SG11202112531QA true SG11202112531QA (en) 2021-12-30

Family

ID=70614688

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202112531QA SG11202112531QA (en) 2019-05-31 2020-04-24 Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction

Country Status (13)

Country Link
US (3) US10798292B1 (en)
EP (3) EP4373121A3 (en)
JP (1) JP7492974B2 (en)
KR (1) KR20220013384A (en)
CN (1) CN113826059B (en)
AU (1) AU2020282272A1 (en)
BR (1) BR112021023291A2 (en)
CA (1) CA3138681A1 (en)
IL (1) IL288336B1 (en)
MX (1) MX2021014463A (en)
SG (1) SG11202112531QA (en)
WO (1) WO2020242680A1 (en)
ZA (1) ZA202107562B (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11288733B2 (en) * 2018-11-14 2022-03-29 Mastercard International Incorporated Interactive 3D image projection systems and methods
US11520409B2 (en) * 2019-04-11 2022-12-06 Samsung Electronics Co., Ltd. Head mounted display device and operating method thereof
KR102149732B1 (en) * 2019-04-17 2020-08-31 라쿠텐 인코포레이티드 Display control device, display control method, program, and non-transitory computer-readable information recording medium
US11927756B2 (en) * 2021-04-01 2024-03-12 Samsung Electronics Co., Ltd. Method for providing augmented reality image and head mounted display device supporting the same
BE1029715B1 (en) * 2021-08-25 2023-03-28 Rods&Cones Holding Bv AUTOMATED CALIBRATION OF HEADWEAR HANDS-FREE CAMERA
WO2023080767A1 (en) * 2021-11-02 2023-05-11 삼성전자 주식회사 Wearable electronic device displaying virtual object and method for controlling same
KR102613391B1 (en) * 2021-12-26 2023-12-13 주식회사 피앤씨솔루션 Ar glasses apparatus having an automatic ipd adjustment using gesture and automatic ipd adjustment method using gesture for ar glasses apparatus
WO2023146196A1 (en) * 2022-01-25 2023-08-03 삼성전자 주식회사 Method and electronic device for determining user's hand in video
CN116452655B (en) * 2023-04-18 2023-11-21 深圳市凌壹科技有限公司 Laminating and positioning method, device, equipment and medium applied to MPIS industrial control main board

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4344299B2 (en) 2004-09-16 2009-10-14 富士通マイクロエレクトロニクス株式会社 Imaging apparatus and autofocus focusing time notification method
JP2007065290A (en) 2005-08-31 2007-03-15 Nikon Corp Automatic focusing device
JP5188071B2 (en) 2007-02-08 2013-04-24 キヤノン株式会社 Focus adjustment device, imaging device, and focus adjustment method
US8073198B2 (en) 2007-10-26 2011-12-06 Samsung Electronics Co., Ltd. System and method for selection of an object of interest during physical browsing by finger framing
JP5224955B2 (en) 2008-07-17 2013-07-03 キヤノン株式会社 IMAGING DEVICE, IMAGING DEVICE CONTROL METHOD, PROGRAM, AND RECORDING MEDIUM
JP5789091B2 (en) 2010-08-20 2015-10-07 キヤノン株式会社 IMAGING DEVICE AND IMAGING DEVICE CONTROL METHOD
US8939579B2 (en) 2011-01-28 2015-01-27 Light Prescriptions Innovators, Llc Autofocusing eyewear, especially for presbyopia correction
US9077890B2 (en) 2011-02-24 2015-07-07 Qualcomm Incorporated Auto-focus tracking
US20130088413A1 (en) * 2011-10-05 2013-04-11 Google Inc. Method to Autofocus on Near-Eye Display
WO2013055737A1 (en) 2011-10-14 2013-04-18 Pelco, Inc. Focus control for ptz cameras
US8848094B2 (en) 2011-12-01 2014-09-30 Sony Corporation Optimal blur matching selection for depth estimation
CN104012073B (en) 2011-12-16 2017-06-09 奥林巴斯株式会社 The storage medium of the tracing program that filming apparatus and its image pickup method, storage can be processed by computer
WO2014145166A2 (en) * 2013-03-15 2014-09-18 Eyecam, LLC Autonomous computing and telecommunications head-up displays glasses
US20150003819A1 (en) * 2013-06-28 2015-01-01 Nathan Ackerman Camera auto-focus based on eye gaze
CN105493493B (en) 2013-08-01 2018-08-28 富士胶片株式会社 Photographic device, image capture method and image processing apparatus
US20150268728A1 (en) 2014-03-18 2015-09-24 Fuji Xerox Co., Ltd. Systems and methods for notifying users of mismatches between intended and actual captured content during heads-up recording of video
US10216271B2 (en) * 2014-05-15 2019-02-26 Atheer, Inc. Method and apparatus for independent control of focal vergence and emphasis of displayed and transmitted optical content
JP6281409B2 (en) 2014-05-26 2018-02-21 富士通株式会社 Display control method, information processing program, and information processing apparatus
US10852838B2 (en) * 2014-06-14 2020-12-01 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality
US9858720B2 (en) 2014-07-25 2018-01-02 Microsoft Technology Licensing, Llc Three-dimensional mixed-reality viewport
JP6041016B2 (en) * 2014-07-25 2016-12-07 裕行 池田 Eyeglass type terminal
KR102404790B1 (en) * 2015-06-11 2022-06-02 삼성전자주식회사 Method and apparatus for changing focus of camera
US20160378176A1 (en) * 2015-06-24 2016-12-29 Mediatek Inc. Hand And Body Tracking With Mobile Device-Based Virtual Reality Head-Mounted Display
US10048765B2 (en) 2015-09-25 2018-08-14 Apple Inc. Multi media computing or entertainment system for responding to user presence and activity
US10445860B2 (en) 2015-12-08 2019-10-15 Facebook Technologies, Llc Autofocus virtual reality headset
US9910247B2 (en) 2016-01-21 2018-03-06 Qualcomm Incorporated Focus hunting prevention for phase detection auto focus (AF)
US10257505B2 (en) 2016-02-08 2019-04-09 Microsoft Technology Licensing, Llc Optimized object scanning using sensor fusion
WO2017196928A1 (en) * 2016-05-10 2017-11-16 Google Llc Volumetric virtual reality keyboard methods, user interface, and interactions
CA3029234A1 (en) * 2016-06-30 2018-01-04 Thalmic Labs Inc. Image capture systems, devices, and methods that autofocus based on eye-tracking
US10044925B2 (en) 2016-08-18 2018-08-07 Microsoft Technology Licensing, Llc Techniques for setting focus in mixed reality applications
US20180149826A1 (en) 2016-11-28 2018-05-31 Microsoft Technology Licensing, Llc Temperature-adjusted focus for cameras
CN108886572B (en) * 2016-11-29 2021-08-06 深圳市大疆创新科技有限公司 Method and system for adjusting image focus
US10382699B2 (en) * 2016-12-01 2019-08-13 Varjo Technologies Oy Imaging system and method of producing images for display apparatus
CN212181161U (en) * 2016-12-30 2020-12-18 高途乐公司 Wearable imaging device
WO2018160593A1 (en) 2017-02-28 2018-09-07 Magic Leap, Inc. Virtual and real object recording in mixed reality device
JP6719418B2 (en) 2017-05-08 2020-07-08 株式会社ニコン Electronics
US10366691B2 (en) * 2017-07-11 2019-07-30 Samsung Electronics Co., Ltd. System and method for voice command context
US20190129607A1 (en) 2017-11-02 2019-05-02 Samsung Electronics Co., Ltd. Method and device for performing remote control

Also Published As

Publication number Publication date
EP4373122A2 (en) 2024-05-22
CN113826059B (en) 2024-06-07
EP3959587A1 (en) 2022-03-02
CA3138681A1 (en) 2020-12-03
IL288336A (en) 2022-01-01
IL288336B1 (en) 2024-05-01
BR112021023291A2 (en) 2022-01-04
AU2020282272A1 (en) 2021-11-18
EP4373121A2 (en) 2024-05-22
KR20220013384A (en) 2022-02-04
US11770599B2 (en) 2023-09-26
JP2022534847A (en) 2022-08-04
MX2021014463A (en) 2022-01-06
WO2020242680A1 (en) 2020-12-03
JP7492974B2 (en) 2024-05-30
US20220141379A1 (en) 2022-05-05
CN113826059A (en) 2021-12-21
ZA202107562B (en) 2023-01-25
US11245836B2 (en) 2022-02-08
EP4373122A3 (en) 2024-06-26
EP3959587B1 (en) 2024-03-20
US20200404159A1 (en) 2020-12-24
EP4373121A3 (en) 2024-06-26
US10798292B1 (en) 2020-10-06

Similar Documents

Publication Publication Date Title
IL288336A (en) Techniques to set focus in camera in a mixed-reality environment with hand gesture interaction
EP3408794A4 (en) Initiating fingerprint capture with a touch screen
EP3371690A4 (en) Intelligent digital assistant in a multi-tasking environment
GB2541580B (en) Using a mobile device to restrict focus and perform operations at another mobile device
AU201614913S (en) Display screen with a user interface component
AU201614922S (en) Display screen with a user interface component
AU201614929S (en) Display screen with a user interface component
EP3058512A4 (en) Organizing digital notes on a user interface
GB2539597B (en) Optical touch screen with a lossy dispersive FTIR layer
EP2901372A4 (en) Using digital fingerprints to associate data with a work
AU201614920S (en) Display screen with a user interface component
EP3126990A4 (en) Early rear view camera video display in a multiprocessor architecture
HK1220510A1 (en) A portable folding virtual reality glasses with adjustable focus
AU201614915S (en) Display screen with a user interface component
FR3004455B1 (en) COMPOSITION BASED ON TRANSPARENT AND ANTISTATIC PMMA
EP3006969A4 (en) Optical member provided with anti-reflection film
GB2509833B (en) Moveable led array flaps in IR led camera
ZA201702316B (en) Target-directed movement in a user interface
AU201614924S (en) Display screen with a user interface component
EP3005300A4 (en) Combining a digital image with a virtual entity
AU201614927S (en) Display screen with a user interface component
HK1190249A1 (en) Camera device with a dynamic touch screen shutter
EP3811270A4 (en) Touch interactions with image capture devices
EP3092528A4 (en) Handheld magnifier camera with variable focus distance
HK1204405A1 (en) Image sensor with fast intra-frame focus