WO2015081705A1 - Système de commande sans contact - Google Patents

Système de commande sans contact Download PDF

Info

Publication number
WO2015081705A1
WO2015081705A1 PCT/CN2014/082897 CN2014082897W WO2015081705A1 WO 2015081705 A1 WO2015081705 A1 WO 2015081705A1 CN 2014082897 W CN2014082897 W CN 2014082897W WO 2015081705 A1 WO2015081705 A1 WO 2015081705A1
Authority
WO
WIPO (PCT)
Prior art keywords
processing module
person
display screen
camera
angle
Prior art date
Application number
PCT/CN2014/082897
Other languages
English (en)
Chinese (zh)
Inventor
刘美鸿
高炜
徐万良
Original Assignee
深圳市亿思达科技集团有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市亿思达科技集团有限公司 filed Critical 深圳市亿思达科技集团有限公司
Publication of WO2015081705A1 publication Critical patent/WO2015081705A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Definitions

  • the present invention relates to the field of handwriting input technology, and in particular to an air touch system.
  • the handwriting input device generally comprises: a stylus and a tablet or a touch screen.
  • the stylus and the tablet or the touch screen are close-range input devices, and the remote input cannot be completed.
  • the user is beyond a certain distance from the electronic device or the user's hand is occupied by other things, it is inconvenient to complete the manipulation of the electronic device.
  • the present invention provides an air touch system.
  • the present invention provides an air touch control system that acquires a position image of a person by using a 3D camera provided at a front end of the display screen, and generates a corresponding operation of the finger position and the motion track of the person according to the position image.
  • the instruction adjusts the tilt angle of the dynamic grating of the display screen according to the angle between the human eye and the display screen, and rotates the 3D scene, so that the air touch system provided by the invention can not only input in the air, but also can make the user move during the movement. Still able to get a holographic 3D effect experience.
  • the invention provides an air touch system, comprising:
  • the 3D camera is disposed on a front end surface of the display screen, and is used for real-time acquiring a position image of a person in a visual field;
  • a first processing module electrically connected to the 3D camera, configured to calculate a position of a human finger on the screen and a motion track according to the position image
  • a first execution module electrically connected to the first processing module, configured to generate a corresponding operation instruction according to a position of the finger on the screen and a motion track, and execute the operation instruction;
  • a second processing module electrically connected to the 3D camera, for calculating an angle of the human eye relative to the display screen according to the position image
  • a second execution module electrically connected to the second processing module, configured to adjust an inclination angle of the dynamic grating of the display screen according to the angle to adapt to a position of the human eye;
  • the third execution module is electrically connected to the second processing module, and is configured to rotate the virtual 3D scene according to the angle, so that the human eye can view the scene from different angles to obtain a holographic 3D experience.
  • the present invention provides an air touch system that acquires a position image of a person by using a 3D camera provided at a front end of the display screen, and generates a person according to the position image, which is different from the prior art.
  • the operation command corresponding to the finger position and the motion track adjusts the tilt angle of the dynamic grating of the display screen according to the angle between the human eye and the display screen, and rotates the 3D scene, so that the air touch system provided by the present invention can not only realize
  • the operational commands are entered in the air and can enable the user to obtain a holographic 3D effect experience during exercise.
  • FIG. 1 is a schematic structural view of an embodiment of an air touch system of the present invention.
  • FIG. 1 is a schematic structural diagram of an embodiment of an air touch system according to the present invention.
  • the air touch system provided by the present invention includes a 3D camera 11 , a first processing module 12 , a first execution module 13 , a second processing module 14 , a second execution module 15 , and a third execution module 16 .
  • the 3D camera 11 is disposed on the front end surface of the display screen as an input device for acquiring the position image of the person in the field of view in real time;
  • the first processing module 12 is electrically connected to the 3D camera 11 , and the first processing module is 12 is used to calculate the position of the human finger on the screen according to the position image of the person acquired by the 3D camera 11, and the continuous position coordinates outline the movement track of the human hand;
  • the first execution module 13 and the first processing module 12 are electrically The first execution module 13 is configured to generate a corresponding click or swipe action according to the position of the finger on the screen and the motion track, and execute the operation instruction;
  • the second processing module 14 is electrically connected to the 3D camera 11 , and second The processing module 14 is configured to calculate an angle of the human eye relative to the display screen according to the position image of the person.
  • the second processing module 14 can obtain the connection of the human eye to the center of the display according to the position image of the person acquired by the 3D camera 11 .
  • the tilt angle of the grating is adapted to the position of the human eye; the third execution module 16 is electrically connected to the second processing module 14 for rotating the virtual 3D scene according to the angle, so that the human eye can view the scene from different angles to obtain the holographic 3D experience. .
  • the present invention provides an air touch system that acquires a position image of a person by using a 3D camera disposed at a front end of the display screen, and generates an operation instruction corresponding to a finger position and a motion track of the person according to the position image. Adjusting the tilt angle of the dynamic grating of the display screen and rotating the 3D scene according to the angle between the human eye and the display screen, so that the air touch control system provided by the invention can not only realize the air input operation command, but also enable the user to Get a holographic 3D effect experience during exercise.

Abstract

L'invention a trait à un système de commande sans contact qui comprend : une caméra 3D (11) conçue pour acquérir en temps réel une image de la localisation d'une personne dans l'étendue d'une vue; un premier module de traitement (12) servant à calculer la localisation et la trajectoire de déplacement d'un doigt de la personne au-dessus d'un écran conformément à l'image de la localisation; un premier module d'exécution (13) destiné à générer une instruction de fonctionnement correspondante selon la localisation et la trajectoire de déplacement du doigt au-dessus de l'écran, et exécuter ladite instruction de fonctionnement; un second module de traitement (14) prévu pour calculer un angle inclus à partir d'un œil de la personne par rapport à un afficheur et en fonction de l'image de la localisation; un deuxième module d'exécution (15) permettant d'ajuster un angle d'inclinaison des réseaux dynamiques de l'afficheur suivant l'angle inclus pour s'adapter à la localisation de l'œil de la personne; et un troisième module d'exécution (16) conçu pour faire tourner une scène 3D virtuelle suivant l'angle inclus, afin que l'œil de la personne puisse voir la scène depuis différents angles et bénéficier d'une expérience 3D holographique. Cela permet la saisie sans contact, et l'utilisateur continue à profiter de l'effet 3D holographique pendant qu'il bouge.
PCT/CN2014/082897 2013-12-02 2014-07-24 Système de commande sans contact WO2015081705A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310638317.3 2013-12-02
CN201310638317.3A CN103995620A (zh) 2013-12-02 2013-12-02 一种空中触控系统

Publications (1)

Publication Number Publication Date
WO2015081705A1 true WO2015081705A1 (fr) 2015-06-11

Family

ID=51309806

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/082897 WO2015081705A1 (fr) 2013-12-02 2014-07-24 Système de commande sans contact

Country Status (2)

Country Link
CN (1) CN103995620A (fr)
WO (1) WO2015081705A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105704470A (zh) * 2015-11-26 2016-06-22 中国传媒大学 一种全息视频预览方法
CN105704469A (zh) * 2015-11-26 2016-06-22 中国传媒大学 一种全息视频播放方法
CN106055108B (zh) * 2016-06-10 2020-11-13 北京行云时空科技有限公司 一种虚拟触摸屏的操控方法和系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102981616A (zh) * 2012-11-06 2013-03-20 中兴通讯股份有限公司 增强现实中对象的识别方法及系统和计算机
CN103180893A (zh) * 2011-08-23 2013-06-26 索尼公司 用于提供三维用户界面的方法和系统
CN103176605A (zh) * 2013-03-27 2013-06-26 刘仁俊 一种手势识别控制装置及控制方法
CN103279191A (zh) * 2013-06-18 2013-09-04 北京科技大学 一种基于手势识别技术的3d虚拟交互方法及系统
US20130249786A1 (en) * 2012-03-20 2013-09-26 Robert Wang Gesture-based control system

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8368753B2 (en) * 2008-03-17 2013-02-05 Sony Computer Entertainment America Llc Controller with an integrated depth camera
CN102253713B (zh) * 2011-06-23 2016-10-12 康佳集团股份有限公司 面向三维立体影像显示系统
CN102508546B (zh) * 2011-10-31 2014-04-09 冠捷显示科技（厦门）有限公司 一种3d虚拟投影及虚拟触摸的用户交互界面及实现方法
CN103248905A (zh) * 2013-03-22 2013-08-14 深圳市云立方信息科技有限公司 一种模仿全息3d场景的显示装置和视觉显示方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103180893A (zh) * 2011-08-23 2013-06-26 索尼公司 用于提供三维用户界面的方法和系统
US20130249786A1 (en) * 2012-03-20 2013-09-26 Robert Wang Gesture-based control system
CN102981616A (zh) * 2012-11-06 2013-03-20 中兴通讯股份有限公司 增强现实中对象的识别方法及系统和计算机
CN103176605A (zh) * 2013-03-27 2013-06-26 刘仁俊 一种手势识别控制装置及控制方法
CN103279191A (zh) * 2013-06-18 2013-09-04 北京科技大学 一种基于手势识别技术的3d虚拟交互方法及系统

Also Published As

Publication number Publication date
CN103995620A (zh) 2014-08-20

Similar Documents

Publication Publication Date Title
US11221730B2 (en) Input device for VR/AR applications
TWI546725B (zh) 於手勢和使用者介面元件間之延續虛擬連結技術
US9395821B2 (en) Systems and techniques for user interface control
US9658695B2 (en) Systems and methods for alternative control of touch-based devices
KR101791366B1 (ko) 증강된 가상 터치패드 및 터치스크린
JP2023515525A (ja) ウェアラブルシステムのための手のジェスチャ入力
JP6619003B2 (ja) 調整機構を持つ取外し可能な入力／出力モジュール
US11853527B2 (en) Devices, methods, and graphical user interfaces for providing computer-generated experiences
WO2016123816A1 (fr) Procédé et appareil de visée pour jeu de tir
JP7382994B2 (ja) 仮想現実システム内の仮想コントローラの位置および向きの追跡
Kharlamov et al. TickTockRay: smartwatch-based 3D pointing for smartphone-based virtual reality
Pietroszek et al. Watchcasting: Freehand 3D interaction with off-the-shelf smartwatch
WO2011137226A1 (fr) Systèmes et procédés de projection de curseur basée sur la saisie dans l'espace
KR20170107357A (ko) 하나의 단일 감지 시스템을 이용하는 멀티 모드 제스처 기반의 상호작용 시스템 및 방법
TW202105129A (zh) 具有用於閘控使用者介面元件的個人助理元件之人工實境系統
WO2015081705A1 (fr) Système de commande sans contact
JP2019051297A5 (ja) プログラム及び情報処理装置
Arslan et al. E-Pad: Large display pointing in a continuous interaction space around a mobile device
US20200057501A1 (en) System, devices, and methods for remote projection of haptic effects
WO2012114791A1 (fr) Système à commande gestuelle
Mendes Manipulation of 3d objects in immersive virtual environments
TW201913298A (zh) 可顯示實體輸入裝置即時影像之虛擬實境系統及其控制方法
CN110794958B (zh) 在增强/虚拟现实环境中使用的输入设备
KR20150138659A (ko) 홀로그래피 터치 방법 및 프로젝터 터치 방법
KR20160014091A (ko) 홀로그래피 터치 기술 및 프로젝터 터치 기술

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14868120

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14868120

Country of ref document: EP

Kind code of ref document: A1