WO2017092060A1 - Air mouse implementation method based on smart phone - Google Patents

Air mouse implementation method based on smart phone Download PDF

Info

Publication number
WO2017092060A1
WO2017092060A1 PCT/CN2015/096499 CN2015096499W WO2017092060A1 WO 2017092060 A1 WO2017092060 A1 WO 2017092060A1 CN 2015096499 W CN2015096499 W CN 2015096499W WO 2017092060 A1 WO2017092060 A1 WO 2017092060A1
Authority
WO
WIPO (PCT)
Prior art keywords
mouse
smart phone
software application
click
implementing
Prior art date
Application number
PCT/CN2015/096499
Other languages
French (fr)
Chinese (zh)
Inventor
韩性峰
Original Assignee
深圳瀚飞科技开发有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳瀚飞科技开发有限公司 filed Critical 深圳瀚飞科技开发有限公司
Priority to CN201580076121.7A priority Critical patent/CN107533388B/en
Priority to PCT/CN2015/096499 priority patent/WO2017092060A1/en
Publication of WO2017092060A1 publication Critical patent/WO2017092060A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor

Definitions

  • the invention belongs to the field of computer input control, and in particular relates to a method for implementing a mouse.
  • the mouse is an input device of the computer, which is divided into wired and wireless. It is also an indicator for positioning the vertical and horizontal coordinates of the computer display system. It is named “mouse” because it resembles a mouse.
  • the mouse is divided into a mechanical mouse and an optical mouse according to the working principle of the mouse.
  • the mechanical mouse is mainly composed of a rolling ball, a roller column and a grating signal sensor.
  • the ball is rotated, the roller rotates the roller, and the grating signal sensor installed at the end of the roller collects the grating signal.
  • the photoelectric pulse signal generated by the sensor reflects the displacement of the mouse in the vertical and horizontal directions, and then the movement of the cursor arrow on the screen is controlled by the processing and conversion of the computer program.
  • the present invention provides a method for implementing an air mouse based on a smart phone, and installing an application by using a popular smartphone. APP, you can realize the function of the traditional mouse.
  • a method for implementing an air mouse based on a smart phone installing a software application on the smart phone, extracting image data to the software application by using a camera and an auto focus function on the smart phone, the software application is based on image data
  • the change determines the direction of the up and down, left and right movement and the distance of movement, and clicks or double-clicks; then sends the moving direction, moving distance, click or double-click operation of the mouse to the computer device by wireless communication to control The operation of the computer device.
  • the mobile phone moves, the same part of the image of the two frames before and after is shifted; according to the offset position, the moving direction of the mouse can be measured, and according to the offset, the moving distance of the mouse can be measured.
  • the software application detects After this change, it is determined to be a click action.
  • the click action is captured 2 times within a preset time, indicating a double tap action.
  • the computer device is a PC, a notebook computer or a tablet computer.
  • the wireless communication method is any one of Bluetooth, Wi-Fi, infrared, and ZigBee.
  • the smart phone has become a necessity in our daily life With no additional equipment, only one APP software can be installed to realize the basic functions of the mouse.
  • the method for implementing the air mouse based on the smart phone of the present invention is simple in implementation, convenient in application, and has good application value.
  • FIG. 1 is a schematic diagram showing the principle of a smart phone-based air mouse right shifting according to the present invention
  • FIG. 2 is a schematic diagram of the principle of a smartphone-based air mouse single machine of the present invention.
  • the smart phone-based air mouse implementation method of the invention installs a software application APP on the smart phone, extracts image data by using a camera on the smart phone and an auto focus function, and the software application measures the up, down, left and right movement according to the change of the image data.
  • the moving direction, moving distance, click or double click operation of the illustrated mouse is then transmitted to the computer device by wireless communication to control the operation of the computer device.
  • the computer device can be a PC, a laptop or a tablet.
  • the manner of wireless communication may be Bluetooth, Wi-Fi, infrared, ZigBee, and the like.
  • Air mouse movement measurement As shown in Figure 1, after opening the camera on the mobile phone and automatically focusing, the image information is acquired periodically. When the mobile phone moves up and down (or left and right), the same part of the two frames before and after will be offset. According to the offset position, the mouse can be measured The moving direction, according to the offset, can measure the moving distance of the mouse.
  • Aerial mouse click calculation As shown in Figure 2, when the mobile phone moves vertically downwards, the camera captures the image range and the local content becomes larger. When the mobile phone moves vertically upwards, the camera acquires a larger image range and the local content becomes smaller. After the software application detects this change, it is determined to be a click action.
  • the air mouse double-clicks to calculate: the above-mentioned click action is captured twice in a preset time, indicating a double-click action.
  • the smart phone has become an indispensable tool in our daily life. It does not need extra equipment. It only needs to install an APP software to realize the basic functions of the mouse.
  • the implementation method of the smart mouse-based air mouse of the present invention is simple to implement. It is easy to apply and has good application value.

Abstract

Disclosed is an air mouse implementation method based on a smart phone. The method comprises: installing a software application (APP) on a smart phone; utilizing a camera and an automatic focusing function of the smart phone to extract image data; the software application measuring and determining an up-down or left-right movement direction and a movement distance and a single-click or double-click operation according to a change in the image data; and then sending, to a computer device, the movement direction, the movement distance and the single-click or double-click operation of the illustrated mouse by means of wireless communication, so as to control an operation of the computer device. By means of the method, basic functions of a mouse can be implemented by utilizing a smart phone with a high level of popularity. The method is simple in implementation method, convenient in application and cost-effective.

Description

基于智能手机的空中鼠标实现方法Smartphone-based aerial mouse implementation method 技术领域Technical field
本发明属于计算机输入控制领域,尤其涉及一种鼠标的实现方法。The invention belongs to the field of computer input control, and in particular relates to a method for implementing a mouse.
背景技术Background technique
鼠标是计算机的一种输入设备,分有线和无线两种,也是计算机显示系统纵横坐标定位的指示器,因形似老鼠而得名“鼠标”。The mouse is an input device of the computer, which is divided into wired and wireless. It is also an indicator for positioning the vertical and horizontal coordinates of the computer display system. It is named "mouse" because it resembles a mouse.
鼠标按其工作原理的不同分为机械鼠标和光电鼠标,机械鼠标主要由滚球、辊柱和光栅信号传感器组成。当你拖动鼠标时,带动滚球转动,滚球又带动辊柱转动,装在辊柱端部的光栅信号传感器采集光栅信号。传感器产生的光电脉冲信号反映出鼠标器在垂直和水平方向的位移变化,再通过电脑程序的处理和转换来控制屏幕上光标箭头的移动。The mouse is divided into a mechanical mouse and an optical mouse according to the working principle of the mouse. The mechanical mouse is mainly composed of a rolling ball, a roller column and a grating signal sensor. When you drag the mouse, the ball is rotated, the roller rotates the roller, and the grating signal sensor installed at the end of the roller collects the grating signal. The photoelectric pulse signal generated by the sensor reflects the displacement of the mouse in the vertical and horizontal directions, and then the movement of the cursor arrow on the screen is controlled by the processing and conversion of the computer program.
现在鼠标已经走进了人们的日常工作和生活中,只要使用计算机的人就离不开鼠标,人们越来越习惯使用鼠标来控制计算机的操作。便携式计算机尤其是平板电脑的发展,越来越多的人携带平板电脑外出使用,但是平板电脑通常是不配备鼠标的,万一忘记带鼠标就会很难受。Now that the mouse has entered people's daily work and life, people who use computers can't do without the mouse, and people are getting used to using the mouse to control the operation of the computer. With the development of portable computers, especially tablets, more and more people are using tablet computers to go out, but tablets are usually not equipped with a mouse. If you forget to bring a mouse, it will be very difficult.
发明内容Summary of the invention
为了解决现有技术中问题,本发明提供了一种基于智能手机的空中鼠标实现方法,利用普及率很广的智能手机,安装一个应用程序 APP,即可实现传统鼠标的功能。In order to solve the problems in the prior art, the present invention provides a method for implementing an air mouse based on a smart phone, and installing an application by using a popular smartphone. APP, you can realize the function of the traditional mouse.
本发明通过如下技术方案实现:The invention is achieved by the following technical solutions:
一种基于智能手机的空中鼠标实现方法,在所述智能手机安装一个软件应用,利用所述智能手机上的摄像头及自动聚焦功能,提取图像数据给所述软件应用,所述软件应用根据图像数据的变化测定上下、左右移动的方向和移动距离,以及单击或者双击操作;然后通过无线通信的方式,将所示鼠标的移动方向、移动距离、单击或者双击操作发送给计算机设备,以控制所述计算机设备的操作。A method for implementing an air mouse based on a smart phone, installing a software application on the smart phone, extracting image data to the software application by using a camera and an auto focus function on the smart phone, the software application is based on image data The change determines the direction of the up and down, left and right movement and the distance of movement, and clicks or double-clicks; then sends the moving direction, moving distance, click or double-click operation of the mouse to the computer device by wireless communication to control The operation of the computer device.
作为本发明的进一步改进,当手机移动时,前后2帧图像的相同部分会发生偏移;根据偏移位置,可以测算出鼠标的移动方向,根据偏移量,可以测算出鼠标的移动距离。As a further improvement of the present invention, when the mobile phone moves, the same part of the image of the two frames before and after is shifted; according to the offset position, the moving direction of the mouse can be measured, and according to the offset, the moving distance of the mouse can be measured.
作为本发明的进一步改进,当手机垂直向下运动时,摄像头获取图像范围缩小,局部内容变大;当手机垂直向上运动时,摄像头获取图像范围变大,局部内容变小;所述软件应用检测到这一变化后,判定为一次单击动作。As a further improvement of the present invention, when the mobile phone moves vertically downward, the image range of the camera is reduced, and the local content becomes larger; when the mobile phone moves vertically upward, the image range of the camera is enlarged, and the local content becomes smaller; the software application detects After this change, it is determined to be a click action.
作为本发明的进一步改进,在预设的时间内,所述单击动作捕捉到2次,表示双击动作。As a further improvement of the present invention, the click action is captured 2 times within a preset time, indicating a double tap action.
作为本发明的进一步改进,所述计算机设备是PC机、笔记本电脑或者平板电脑。As a further improvement of the present invention, the computer device is a PC, a notebook computer or a tablet computer.
作为本发明的进一步改进,所述无线通信的方式是蓝牙、Wi-Fi、红外、ZigBee中的任意一种。As a further improvement of the present invention, the wireless communication method is any one of Bluetooth, Wi-Fi, infrared, and ZigBee.
本发明的有益效果是:智能手机已变成我们日常生活中的必备工 具,不需额外配备,只需安装一个APP软件,即可实现鼠标的基本功能,本发明的基于智能手机的空中鼠标实现方法,实现方式简单,应用方便,具有很好的应用价值。The beneficial effects of the invention are: the smart phone has become a necessity in our daily life With no additional equipment, only one APP software can be installed to realize the basic functions of the mouse. The method for implementing the air mouse based on the smart phone of the present invention is simple in implementation, convenient in application, and has good application value.
附图说明DRAWINGS
图1是本发明的基于智能手机的空中鼠标右移的原理示意图;1 is a schematic diagram showing the principle of a smart phone-based air mouse right shifting according to the present invention;
图2是本发明的基于智能手机的空中鼠标单机的原理示意图。2 is a schematic diagram of the principle of a smartphone-based air mouse single machine of the present invention.
具体实施方式detailed description
下面结合附图说明及具体实施方式对本发明进一步说明。The invention will now be further described with reference to the drawings and specific embodiments.
本发明的基于智能手机的空中鼠标实现方法,在智能手机安装一个软件应用APP,利用智能手机上的摄像头及自动聚焦功能,提取图像数据,所述软件应用根据图像数据的变化测定上下、左右移动的方向和移动距离,以及单击或者双击操作。然后通过无线通信的方式,将所示鼠标的移动方向、移动距离、单击或者双击操作发送给计算机设备,以控制所述计算机设备的操作。所述计算机设备可以是PC机、笔记本电脑或者平板电脑。所述无线通信的方式可以是蓝牙、Wi-Fi、红外、ZigBee等。The smart phone-based air mouse implementation method of the invention installs a software application APP on the smart phone, extracts image data by using a camera on the smart phone and an auto focus function, and the software application measures the up, down, left and right movement according to the change of the image data. Direction and movement distance, as well as click or double click operation. The moving direction, moving distance, click or double click operation of the illustrated mouse is then transmitted to the computer device by wireless communication to control the operation of the computer device. The computer device can be a PC, a laptop or a tablet. The manner of wireless communication may be Bluetooth, Wi-Fi, infrared, ZigBee, and the like.
本发明具体的实现原理如下:The specific implementation principle of the present invention is as follows:
空中鼠标移动测算:如附图1所示,打开手机上的摄像头并自动聚焦后,定时获取图像信息,当手机上下(或者左右)移动时,前后2帧图像的相同部分会发生偏移。根据偏移位置,可以测算出鼠标的 移动方向,根据偏移量,可以测算出鼠标的移动距离。Air mouse movement measurement: As shown in Figure 1, after opening the camera on the mobile phone and automatically focusing, the image information is acquired periodically. When the mobile phone moves up and down (or left and right), the same part of the two frames before and after will be offset. According to the offset position, the mouse can be measured The moving direction, according to the offset, can measure the moving distance of the mouse.
空中鼠标单击测算:如附图2所示,当手机垂直向下运动时,摄像头获取图像范围缩小,局部内容变大;当手机垂直向上运动时,摄像头获取图像范围变大,局部内容变小;软件应用检测到这一变化后,判定为一次单击动作。Aerial mouse click calculation: As shown in Figure 2, when the mobile phone moves vertically downwards, the camera captures the image range and the local content becomes larger. When the mobile phone moves vertically upwards, the camera acquires a larger image range and the local content becomes smaller. After the software application detects this change, it is determined to be a click action.
空中鼠标双击测算:在预设的时间内,上述单击动作捕捉到2次,表示双击动作。The air mouse double-clicks to calculate: the above-mentioned click action is captured twice in a preset time, indicating a double-click action.
智能手机已变成我们日常生活中的必备工具,不需额外配备,只需安装一个APP软件,即可实现鼠标的基本功能,本发明的基于智能手机的空中鼠标实现方法,实现方式简单,应用方便,具有很好的应用价值。The smart phone has become an indispensable tool in our daily life. It does not need extra equipment. It only needs to install an APP software to realize the basic functions of the mouse. The implementation method of the smart mouse-based air mouse of the present invention is simple to implement. It is easy to apply and has good application value.
以上内容是结合具体的优选实施方式对本发明所作的进一步详细说明,不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干简单推演或替换,都应当视为属于本发明的保护范围。 The above is a further detailed description of the present invention in connection with the specific preferred embodiments, and the specific embodiments of the present invention are not limited to the description. It will be apparent to those skilled in the art that the present invention may be made without departing from the spirit and scope of the invention.

Claims (6)

  1. 一种基于智能手机的空中鼠标实现方法,其特征在于:在所述智能手机安装一个软件应用,利用所述智能手机上的摄像头及自动聚焦功能,提取图像数据输入到所述软件应用,所述软件应用根据图像数据的变化测定上下、左右移动的方向和移动距离,以及单击或者双击操作;然后通过无线通信的方式,将所示鼠标的移动方向、移动距离、单击或者双击操作发送给计算机设备,以控制所述计算机设备的操作。A method for implementing an air mouse based on a smart phone, comprising: installing a software application on the smart phone, extracting image data into the software application by using a camera and an auto focus function on the smart phone; The software application determines the direction of the up and down, left and right movement and the moving distance according to the change of the image data, and clicks or double clicks; then sends the moving direction, moving distance, click or double click operation of the mouse to the wireless communication method to A computer device to control the operation of the computer device.
  2. 根据权利要求1所述的空中鼠标实现方法,其特征在于:当手机移动时,前后2帧图像的相同部分会发生偏移;根据偏移位置,可以测算出鼠标的移动方向,根据偏移量,可以测算出鼠标的移动距离。The method for implementing an air mouse according to claim 1, wherein when the mobile phone moves, the same part of the image of the two frames before and after is offset; according to the offset position, the moving direction of the mouse can be measured, according to the offset , you can measure the moving distance of the mouse.
  3. 根据权利要求1所述的空中鼠标实现方法,其特征在于:当手机垂直向下运动时,摄像头获取图像范围缩小,局部内容变大;当手机垂直向上运动时,摄像头获取图像范围变大,局部内容变小;所述软件应用检测到这一变化后,判定为一次单击动作。The method for implementing an air mouse according to claim 1, wherein when the mobile phone moves vertically downwards, the image range of the camera is reduced, and the local content is enlarged; when the mobile phone moves vertically upwards, the image range of the camera is increased, and the image is enlarged. The content becomes smaller; after the software application detects the change, it is determined to be a click action.
  4. 根据权利要求3所述的空中鼠标实现方法,其特征在于:所述单击动作捕捉到2次,表示双击动作。The method for implementing an air mouse according to claim 3, wherein the click action is captured twice, indicating a double click action.
  5. 根据权利要求1所述的空中鼠标实现方法,其特征在于:所述计算机设备是PC机、笔记本电脑或者平板电脑。The aerial mouse implementation method according to claim 1, wherein the computer device is a PC, a notebook computer or a tablet computer.
  6. 根据权利要求1所述的空中鼠标实现方法,其特征在于:所述无线通信的方式是蓝牙、Wi-Fi、红外、ZigBee中的任意一种。 The method for implementing an air mouse according to claim 1, wherein the wireless communication mode is any one of Bluetooth, Wi-Fi, infrared, and ZigBee.
PCT/CN2015/096499 2015-12-05 2015-12-05 Air mouse implementation method based on smart phone WO2017092060A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201580076121.7A CN107533388B (en) 2015-12-05 2015-12-05 Air mouse implementation method based on smart phone
PCT/CN2015/096499 WO2017092060A1 (en) 2015-12-05 2015-12-05 Air mouse implementation method based on smart phone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2015/096499 WO2017092060A1 (en) 2015-12-05 2015-12-05 Air mouse implementation method based on smart phone

Publications (1)

Publication Number Publication Date
WO2017092060A1 true WO2017092060A1 (en) 2017-06-08

Family

ID=58796157

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/096499 WO2017092060A1 (en) 2015-12-05 2015-12-05 Air mouse implementation method based on smart phone

Country Status (2)

Country Link
CN (1) CN107533388B (en)
WO (1) WO2017092060A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109491519A (en) * 2018-10-09 2019-03-19 深圳市奥拓电子股份有限公司 Air mouse method for tracing, system and machine readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202177873U (en) * 2011-06-28 2012-03-28 刘笃林 Air mouse
CN202453824U (en) * 2011-12-30 2012-09-26 深圳市迈乐数码科技股份有限公司 Wireless laser pen with air mouse function
CN203250265U (en) * 2013-01-24 2013-10-23 陈宝明 Air mouse
US20140168079A1 (en) * 2012-12-14 2014-06-19 Hsien- Chang Huang Cursor control system
CN104219587A (en) * 2014-08-20 2014-12-17 深圳智意能电子科技有限公司 Method and device used for controlling application

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566744A (en) * 2010-12-22 2012-07-11 康佳集团股份有限公司 Mouse control method, mouse control device and terminal
US20130009875A1 (en) * 2011-07-06 2013-01-10 Fry Walter G Three-dimensional computer interface
CN103425405B (en) * 2012-05-15 2016-12-14 深圳市启望科文技术有限公司 Body-sensing remote control unit mode switching method
CN103513787B (en) * 2012-06-29 2016-12-21 深圳市快播科技有限公司 For operating air mouse achievement method and the system of multi-screen adapter
CN102868925A (en) * 2012-09-10 2013-01-09 四川长虹电器股份有限公司 Intelligent TV (television) control method
CN103838491A (en) * 2012-11-23 2014-06-04 许丰 Intelligent touch recognition system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202177873U (en) * 2011-06-28 2012-03-28 刘笃林 Air mouse
CN202453824U (en) * 2011-12-30 2012-09-26 深圳市迈乐数码科技股份有限公司 Wireless laser pen with air mouse function
US20140168079A1 (en) * 2012-12-14 2014-06-19 Hsien- Chang Huang Cursor control system
CN203250265U (en) * 2013-01-24 2013-10-23 陈宝明 Air mouse
CN104219587A (en) * 2014-08-20 2014-12-17 深圳智意能电子科技有限公司 Method and device used for controlling application

Also Published As

Publication number Publication date
CN107533388A (en) 2018-01-02
CN107533388B (en) 2021-03-19

Similar Documents

Publication Publication Date Title
CN101551723B (en) Electronic device and related control method
EP2770423A2 (en) Method and apparatus for operating object in user device
CN102819398A (en) Method for slidingly controlling camera via touch screen device
WO2015188691A1 (en) Method, device, and system for controlling browser by utilizing motion-sensing remote control device
CN105487689A (en) Ring mouse and method for operating mobile terminal through same
CN104866103B (en) Relative position determining method, wearable electronic device and terminal device
CN104223616B (en) A kind of data inputting method, device, process chip and information input finger ring
WO2018076720A1 (en) One-hand operation method and control system
TW201430627A (en) System and method for identifying operation of stylus
CN104142739A (en) Laser point tracking system and method based on optical mouse sensing array
TWI505135B (en) Control system for display screen, control apparatus and control method
WO2012151914A1 (en) Method using three-dimensional movement trajectory as input and mobile terminal
CN103142248B (en) Measuring method for touch screen ultrasonic diagnosis instrument and touch screen ultrasonic diagnosis instrument
WO2018045688A1 (en) Method and device for controlling cursor
WO2017092060A1 (en) Air mouse implementation method based on smart phone
CN105183190A (en) Laser pen with mouse function
TW201604723A (en) Mobile terminal and touch operation method thereof
CN103616973A (en) Operation method of touch screen and touch screen device
TWI602092B (en) Calibration of an input device to a display using the input device
CN102508581A (en) Optical touch handwriting delay solution method
CN105630136B (en) Input system
KR20110013076A (en) Ring input device for gestural and touch interface use camera system
CN106484142A (en) A kind of remote control thereof realizing display screen
TW201621651A (en) Mouse simulation system and method
TWI476645B (en) Projection system and method for controlling the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15909574

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 9.10.18)

122 Ep: pct application non-entry in european phase

Ref document number: 15909574

Country of ref document: EP

Kind code of ref document: A1