KR20160146716A - 모바일 플랫폼에서의 공중 및 표면 다중―터치 검출 - Google Patents

모바일 플랫폼에서의 공중 및 표면 다중―터치 검출 Download PDF

Info

Publication number
KR20160146716A
KR20160146716A KR1020167029188A KR20167029188A KR20160146716A KR 20160146716 A KR20160146716 A KR 20160146716A KR 1020167029188 A KR1020167029188 A KR 1020167029188A KR 20167029188 A KR20167029188 A KR 20167029188A KR 20160146716 A KR20160146716 A KR 20160146716A
Authority
KR
South Korea
Prior art keywords
depth map
reconstructed depth
light
reconstructed
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
KR1020167029188A
Other languages
English (en)
Korean (ko)
Inventor
혜정 서
존 마이클 와이워스
야체크 마이탄
예브게니 페트로비치 고우제브
바백 아리아인
시쿠안 쿠이
Original Assignee
퀄컴 인코포레이티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 퀄컴 인코포레이티드 filed Critical 퀄컴 인코포레이티드
Publication of KR20160146716A publication Critical patent/KR20160146716A/ko
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G06F3/04186—Touch location disambiguation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • G06T7/0051—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04108—Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04109—FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)
KR1020167029188A 2014-04-28 2015-04-01 모바일 플랫폼에서의 공중 및 표면 다중―터치 검출 Withdrawn KR20160146716A (ko)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201461985423P 2014-04-28 2014-04-28
US61/985,423 2014-04-28
US14/546,303 US20150309663A1 (en) 2014-04-28 2014-11-18 Flexible air and surface multi-touch detection in mobile platform
US14/546,303 2014-11-18
PCT/US2015/023920 WO2015167742A1 (en) 2014-04-28 2015-04-01 Air and surface multi-touch detection in mobile platform

Publications (1)

Publication Number Publication Date
KR20160146716A true KR20160146716A (ko) 2016-12-21

Family

ID=54334777

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167029188A Withdrawn KR20160146716A (ko) 2014-04-28 2015-04-01 모바일 플랫폼에서의 공중 및 표면 다중―터치 검출

Country Status (7)

Country Link
US (1) US20150309663A1 (enExample)
EP (1) EP3137979A1 (enExample)
JP (1) JP2017518566A (enExample)
KR (1) KR20160146716A (enExample)
CN (1) CN106255944A (enExample)
BR (1) BR112016025033A2 (enExample)
WO (1) WO2015167742A1 (enExample)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103729096A (zh) * 2013-12-25 2014-04-16 京东方科技集团股份有限公司 交互识别系统以及显示装置
US9424458B1 (en) 2015-02-06 2016-08-23 Hoyos Labs Ip Ltd. Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
US11263432B2 (en) 2015-02-06 2022-03-01 Veridium Ip Limited Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
CN108351713B (zh) * 2015-10-14 2022-03-08 麦克赛尔株式会社 输入终端装置和操作输入方法
US10185400B2 (en) * 2016-01-11 2019-01-22 Antimatter Research, Inc. Gesture control device with fingertip identification
US10096158B2 (en) * 2016-03-24 2018-10-09 Ford Global Technologies, Llc Method and system for virtual sensor data generation with depth ground truth annotation
US10139961B2 (en) * 2016-08-18 2018-11-27 Microsoft Technology Licensing, Llc Touch detection using feature-vector dictionary
US10451714B2 (en) 2016-12-06 2019-10-22 Sony Corporation Optical micromesh for computerized devices
US10536684B2 (en) 2016-12-07 2020-01-14 Sony Corporation Color noise reduction in 3D depth map
US10181089B2 (en) 2016-12-19 2019-01-15 Sony Corporation Using pattern recognition to reduce noise in a 3D map
US10178370B2 (en) 2016-12-19 2019-01-08 Sony Corporation Using multiple cameras to stitch a consolidated 3D depth map
US10444908B2 (en) * 2016-12-31 2019-10-15 Innoventions, Inc. Virtual touchpads for wearable and portable devices
US10495735B2 (en) 2017-02-14 2019-12-03 Sony Corporation Using micro mirrors to improve the field of view of a 3D depth map
US10795022B2 (en) * 2017-03-02 2020-10-06 Sony Corporation 3D depth map
US10979687B2 (en) 2017-04-03 2021-04-13 Sony Corporation Using super imposition to render a 3D depth map
US10484667B2 (en) 2017-10-31 2019-11-19 Sony Corporation Generating 3D depth map using parallax
CN108268134B (zh) * 2017-12-30 2021-06-15 广州正峰电子科技有限公司 拿放商品的手势识别装置及方法
US10740876B1 (en) * 2018-01-23 2020-08-11 Facebook Technologies, Llc Systems and methods for generating defocus blur effects
US10549186B2 (en) 2018-06-26 2020-02-04 Sony Interactive Entertainment Inc. Multipoint SLAM capture
US10345506B1 (en) * 2018-07-16 2019-07-09 Shenzhen Guangjian Technology Co., Ltd. Light projecting method and device
CN109360197B (zh) * 2018-09-30 2021-07-09 北京达佳互联信息技术有限公司 图像的处理方法、装置、电子设备及存储介质
GB201817495D0 (en) * 2018-10-26 2018-12-12 Cirrus Logic Int Semiconductor Ltd A force sensing system and method
CN117940952A (zh) * 2021-08-04 2024-04-26 三星电子株式会社 电子设备及其操作方法
CN120595956A (zh) * 2021-09-17 2025-09-05 联想(北京)有限公司 一种电子设备操纵方法以及电子设备
US12293023B2 (en) * 2021-12-02 2025-05-06 SoftEye, Inc. Systems, apparatus, and methods for gesture-based augmented reality, extended reality

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7983817B2 (en) * 1995-06-07 2011-07-19 Automotive Technologies Internatinoal, Inc. Method and arrangement for obtaining information about vehicle occupants
MXPA03001171A (es) * 2000-08-09 2003-06-30 Dynamic Digital Depth Res Pty Tecnicas de conversion y codificacion de imagenes.
US8013845B2 (en) * 2005-12-30 2011-09-06 Flatfrog Laboratories Ab Optical touch pad with multilayer waveguide
US8488868B2 (en) * 2007-04-03 2013-07-16 Her Majesty The Queen In Right Of Canada, As Represented By The Minister Of Industry, Through The Communications Research Centre Canada Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images
US20090245696A1 (en) * 2008-03-31 2009-10-01 Sharp Laboratories Of America, Inc. Method and apparatus for building compound-eye seeing displays
US8248410B2 (en) * 2008-12-09 2012-08-21 Seiko Epson Corporation Synthesizing detailed depth maps from images
US8730212B2 (en) * 2009-08-21 2014-05-20 Microsoft Corporation Illuminator for touch- and object-sensitive display
CN201654675U (zh) * 2009-11-10 2010-11-24 北京思比科微电子技术有限公司 基于深度检测的身体识别控制装置
US20120056982A1 (en) * 2010-09-08 2012-03-08 Microsoft Corporation Depth camera based on structured light and stereo vision
CN101964111B (zh) * 2010-09-27 2011-11-30 山东大学 基于超分辨率的视线跟踪精度提升方法
US9535537B2 (en) * 2010-11-18 2017-01-03 Microsoft Technology Licensing, Llc Hover detection in an interactive display device
US8878950B2 (en) * 2010-12-14 2014-11-04 Pelican Imaging Corporation Systems and methods for synthesizing high resolution images using super-resolution processes
FR2978855B1 (fr) * 2011-08-04 2013-09-27 Commissariat Energie Atomique Procede et dispositif de calcul d'une carte de profondeur a partir d'une unique image
US9019240B2 (en) * 2011-09-29 2015-04-28 Qualcomm Mems Technologies, Inc. Optical touch device with pixilated light-turning features
US8660306B2 (en) * 2012-03-20 2014-02-25 Microsoft Corporation Estimated pose correction
US9726803B2 (en) * 2012-05-24 2017-08-08 Qualcomm Incorporated Full range gesture system
AU2013305770A1 (en) * 2012-08-21 2015-02-26 Pelican Imaging Corporation Systems and methods for parallax detection and correction in images captured using array cameras
US20140085245A1 (en) * 2012-09-21 2014-03-27 Amazon Technologies, Inc. Display integrated camera array
RU2012145349A (ru) * 2012-10-24 2014-05-10 ЭлЭсАй Корпорейшн Способ и устройство обработки изображений для устранения артефактов глубины
US8891905B2 (en) * 2012-12-19 2014-11-18 Hong Kong Applied Science And Technology Research Institute Co., Ltd. Boundary-based high resolution depth mapping

Also Published As

Publication number Publication date
WO2015167742A1 (en) 2015-11-05
BR112016025033A2 (pt) 2017-08-15
JP2017518566A (ja) 2017-07-06
US20150309663A1 (en) 2015-10-29
CN106255944A (zh) 2016-12-21
EP3137979A1 (en) 2017-03-08

Similar Documents

Publication Publication Date Title
US20150309663A1 (en) Flexible air and surface multi-touch detection in mobile platform
US9582117B2 (en) Pressure, rotation and stylus functionality for interactive display screens
CN106062780B (zh) 3d剪影感测系统
JP6309527B2 (ja) ディスプレイ一体型カメラアレイ
KR101097309B1 (ko) 터치 동작 인식 방법 및 장치
CN102411706B (zh) 识别用户的动态器官姿势的方法和接口以及用电装置
US20130044193A1 (en) Dynamic selection of surfaces in real world for projection of information thereon
US20100225588A1 (en) Methods And Systems For Optical Detection Of Gestures
US9652083B2 (en) Integrated near field sensor for display devices
Sharma et al. Air-swipe gesture recognition using OpenCV in Android devices
US9507433B1 (en) System and method for discerning complex gestures using an array of optical sensors
CN106406684B (zh) 投影处理方法、装置及投影仪
US20150378463A1 (en) Electronic device for sensing 2d and 3d touch and method for controlling the same
US9946917B2 (en) Efficient determination of biometric attribute for fast rejection of enrolled templates and other applications
TWI597487B (zh) 用於觸控點識別之方法及系統與相關聯電腦可讀媒體
CN102799344A (zh) 虚拟触摸屏系统以及方法
US10444894B2 (en) Developing contextual information from an image
Fang et al. P. 133: 3D Multi‐Touch System by Using Coded Optical Barrier on Embedded Photo‐Sensors
Asgarov et al. 3D-CNNs-Based Touchless Human-Machine Interface
Irri et al. A study of ambient light-independent multi-touch acquisition and interaction methods for in-cell optical touchscreens
CN104915065A (zh) 物件检测方法以及用于光学触控系统的校正装置
Ooi et al. Real time touch less home control system with vision-based FPGA hand gesture recognition interface

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20161019

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
PC1203 Withdrawal of no request for examination