WO2006081761A1 - Contrôleur de souris à point lumineux et méthode de traitement de signal - Google Patents

Contrôleur de souris à point lumineux et méthode de traitement de signal Download PDF

Info

Publication number
WO2006081761A1
WO2006081761A1 PCT/CN2006/000164 CN2006000164W WO2006081761A1 WO 2006081761 A1 WO2006081761 A1 WO 2006081761A1 CN 2006000164 W CN2006000164 W CN 2006000164W WO 2006081761 A1 WO2006081761 A1 WO 2006081761A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
mouse
image
computer
screen
Prior art date
Application number
PCT/CN2006/000164
Other languages
English (en)
Chinese (zh)
Inventor
Zhiming Wu
Shouqian Yan
Original Assignee
Zeng, Qinglin
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zeng, Qinglin filed Critical Zeng, Qinglin
Publication of WO2006081761A1 publication Critical patent/WO2006081761A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen

Definitions

  • the present invention relates to the field of computers, and more particularly to a spot mouse controller for moving and clicking a mouse on a computer using a handheld television remote control.
  • the invention also relates to a signal processing method for a spot mouse controller.
  • the actual mouse position on the screen of the mouse controller is often indirect. It is the indirect use of the movement of the mouse controller.
  • the mouse movement on the mouse does not directly control the mouse according to the position of the screen, that is to say, the mouse cannot be directly manipulated against the items on the display device unless the touch screen is used.
  • the main performance is as follows: The first one is operated by the traditional mouse control mode.
  • the second remote control device is equipped with a mouse control device, but it does not allow the user to directly control the remote control to directly control the coordinates of the mouse, but uses the up, down, left and right buttons to control, so it is extremely inconvenient to use.
  • the present invention takes the following scheme:
  • a light spot mouse controller of the present invention comprises a computer and a screen, and further comprises: a signal transmitting component for transmitting a mouse button signal and a laser spot on the shooting screen and the screen And a light spot emitted by the infrared light emitting diode mounted around the screen; the signal receiving part is configured to receive the mouse button signal sent by the signal transmitting component, and transmit the mouse button signal and the image signal of the captured screen to the signal processing component; The signal processing component is configured to process the mouse button signal and the screen image signal captured by the signal transmitting component, and convert it into a mouse control signal for controlling the computer mouse arrow, and transmit the signal to the computer operating system or the application.
  • the signal transmitting component comprises a casing, an infrared signal transmitter, a camera, a filter, a laser tube, a remote control button, a mouse button and a laser emitting composite switch, a remote control button control chip, a remote control button circuit board, and a battery.
  • the remote control button control chip is mounted on the remote control button circuit board, and the infrared signal transmitter is connected to the laser tube through the mouse button and the laser emitting composite switch, and the filter is installed in front of the camera.
  • the signal receiving component comprises a casing, an infrared light emitting diode, an infrared receiver, a communication interface, and a button signal conversion circuit, wherein the infrared light emitting diode is mounted on four sides and four corners of the outer casing, and the infrared receiver is connected. To the button signal conversion circuit, and then connected to the computer through the communication interface.
  • the signal processing component is a software module including a boundary definition program, an image coordinate processing program, and a signal conversion program.
  • the signal processing component is a chip with a boundary definition program, an image coordinate processing program, and a signal conversion program, and the chip is installed on a computer motherboard or an expansion slot, or is installed in a separate hardware device and connected to the computer through a communication interface. .
  • the software module of the boundary definition program, the image coordinate processing program, and the signal conversion program is placed on a DSP (digital signal processing chip) control chip of the camera.
  • DSP digital signal processing chip
  • the mouse button and the laser emitting composite switch are two-stage linkage switches.
  • the communication interface is a parallel port or a serial port or a USB interface.
  • a signal processing method for a spot mouse controller of the present invention includes:
  • Pixel scan comparison step Scan the captured image one by one pixel and find Each spot coordinates
  • Resolution ratio calculation step Calculate the ratio of the pixel on the image to the actual resolution of the screen
  • Center coordinate calculation step Calculate the position of the center of the image relative to the actual imaged position of the screen in the image
  • Center coordinate conversion step convert the position of the image center position relative to the actual image of the screen in the image into the coordinates of the computer mouse;
  • the invention has the advantages that: compared with the prior art, the operation of the mouse is more intuitive, no dragging, convenient to use, direct operation, wide application range, etc., so that the user does not need to hold the laser pointer, the mouse controller, the television at the same time.
  • the remote control can directly control the mouse of the computer, and at the same time, the laser pointer can be used as a hint to explain, which brings great convenience to the user.
  • Figure 1 is a schematic view showing the overall structure of the present invention
  • FIG. 2 is a schematic structural view of a signal receiving and transmitting component of the present invention
  • Figure 3 is a plan view of Figure 2;
  • FIG. 4 is a schematic structural view of a signal receiving component of the present invention.
  • FIG. 5 is a block diagram showing the signal processing flow of the signal processing unit of the present invention.
  • Figure 6 is a schematic view showing the working state of the present invention.
  • Figure 7 is a schematic diagram of an image taken by a camera with 8 spots
  • Figure 8 is a schematic diagram of an image having no image facing the screen
  • FIG. 9 is a schematic diagram of an image taken by a camera as three light spots; 10 is a schematic diagram of three light spots without an image facing the screen; FIG. 11 is a view of eight light spots emitted by eight infrared light emitting diodes;
  • Figure 12 is a map of light spots
  • Figure 13 is a diagram showing the coordinates of one spot
  • Figure 14 is a diagram showing coordinates of two spots
  • Figure 15 is a diagram showing coordinates of eight spots
  • Figure 16 is a line diagram showing the coordinates of eight spot coordinates.
  • 1 is the signal transmitting part
  • 2 is the signal receiving part
  • 3 is the display device
  • 4 is the computer
  • 5 is the computer mouse cursor
  • 6 is the signal processing part
  • 21 ⁇ 28 is the infrared light emitting diode
  • 29 is the infrared receiver
  • 210 is a signal receiving component housing
  • 211 is a USB communication interface
  • 212 is a key signal conversion circuit
  • 31, 32 are signal transmitting component shells
  • 33 is an infrared signal transmitter
  • 34 is a filter
  • 35 is a camera
  • 36 is a laser tube
  • 37 is the remote control button
  • 310 is the remote control button control chip
  • 311 is the remote control button circuit board
  • 312 is the battery
  • Pl, P2, P3, P4, P5 , P6, P7 P8 is the corner point of the actual image of the camera.
  • a spot mouse controller of the present invention comprises a computer 4, a screen, a signal transmitting unit 1, a signal receiving unit 2, and a signal processing unit 6, wherein:
  • the signal transmitting unit 1 includes a housing 31, 32, a laser tube 36, a camera 35, a mouse button 38, a remote controller button 37, an infrared signal transmitter 33, a remote controller button circuit board 311, and The battery 312, wherein the laser tube 36 is connected to the remote control button circuit board 311, the mouse button and the laser emission composite switch 38, 39 are two-stage linkage switches; wherein the infrared signal transmitter 33 can be used for a single transmission for simultaneous transmission.
  • the signal and mouse signal of the TV remote control can also be divided into two, one for transmitting the signal of the TV remote control and the other for transmitting the mouse signal.
  • the structure of the camera 35 has four components: LENS (lens), SENSOR (image sensor), DSP (digital signal processing chip), power supply.
  • the structure of the DSP has four major components: ISP (image signal processor), JPEG encoder, USB device controller, EEPROM Electrically Erasable & Programmable ROM Read-only memory), which can be used to store encoding programs that control or process JPEG images.
  • the infrared signal transmitter can be implemented by Bluetooth (BlueTooth) or by wireless technology (Radio).
  • the signal receiving component 2 includes a housing 210, an infrared receiver 29, a button signal conversion circuit 212, infrared light emitting diodes eight 21 to 28, and a communication interface 211, wherein the infrared light emitting diodes are disposed at eight to eighteen At four sides and four corners of the outer casing 210, the infrared receiver 2 is connected to the key signal conversion circuit 212, and then connected to the computer 4 through a communication interface, and the infrared receiver 29 can be used as a single one for At the same time, receiving the signal of the TV remote control and the mouse signal can also be divided into two, one for receiving the signal of the TV remote control and the other for receiving the mouse signal.
  • the infrared receiver 29 can be implemented by Bluetooth (BlueTooth) or by wireless technology (Radio).
  • the signal processing unit 6 can be a software module including a boundary definition program, an image coordinate processing program, and a signal conversion program installed in a computer system.
  • the signal processing component can also be a chip with a boundary definition program, an image coordinate processing program, a signal conversion program, or a software module that places a boundary definition program, an image coordinate processing program, and a signal conversion program on the DSP control chip of the camera. in.
  • the communication interface 211 can use the parallel port, serial port or USB interface, and the USB interface is more convenient for connecting different types of devices.
  • the filter 34 can be installed in front of the camera 35, and only the specific wavelengths of the eight infrared light-emitting diodes 21-28 of the signal receiving component are received. Infrared light.
  • the user picks up the signal after the computer 4 starts up.
  • the component 1 is aligned and aligned with the screen, and the first segment of the mouse button 38 of the signal transmitting component 1 is pressed, the laser tube 36 emits a laser beam, and the light emitted by the eight infrared light-emitting diodes 21-28 of the signal receiving component 2 is
  • the camera 35 captures the image and sends the captured image to the signal processing unit 6 to process it into a mouse signal. This step can be processed in two ways. One is that the image captured by the camera 35 passes through the infrared light of the signal transmitting unit 1.
  • the transmitter 33 is transmitted to the signal receiving unit 2, and then the image is sent to the signal processing component software module disposed on the computer 4 through the communication interface 211 of the signal receiving unit 2, and after image processing, the image is converted into mouse coordinates. And the position of the mouse is controlled by the computer 4; the other way is to store the signal processing component software module in the EEPROM in the DSP component in the camera 35, so the image captured by the camera 35 is directly in the DSP component in the camera. After the image is processed, it is converted into mouse coordinates, and then transmitted to the signal receiving unit through the infrared emitter 33 of the signal transmitting unit. 2, then the signal received by the communication interface 2 to control the position of the mouse 211 to a computer mouse coordinates member 4.
  • the signal of the mouse button being pressed is transmitted to the signal receiving component 2 through the infrared emitter 33 of the signal transmitting component 1, and then passes through the signal receiving component.
  • the communication interface 211 of 2 sends a signal that the mouse button is pressed to the computer 4 to control the action of pressing the mouse button.
  • FIG. 7 to FIG. 10 an image taken by the camera 35, as shown in FIG. 11, photographing eight light spots emitted by eight infrared light emitting diodes of the signal receiving part; or as shown in FIG. 13, photographing the signal receiving part
  • Three light spots emitted by eight infrared light-emitting diodes; Pl, P3, P5, and P7 are the four corners of the actual image of the camera, while P1 ⁇ P7 and P3 ⁇ P5 are the resolution of the X-axis of the camera, P1 ⁇ P3, P7 ⁇ P5 are the resolution of the Y-axis of the camera.
  • 21 ⁇ 27 and 23 ⁇ 25 should be equal to 800
  • 21 ⁇ 23 and 27 ⁇ 25 should be equal to 600
  • 21 ⁇ 28, 28-27, 23-24 > 24 ⁇ 25 should be equal to 400
  • 21-22, 22-23 , 27-26 , 25 25 should be equal to 300
  • the actual coordinates of the eight spots on the image must be known from the actual image 21, 22, 23, 24, 25, 26, 27, 28 Since the camera is equipped with an infrared light filter, only eight light spots emitted by the eight infrared light emitting diodes will be photographed, so the image is as shown in FIG.
  • the signal processing method of the present invention converts the captured image into computer mouse coordinates by using a boundary definition program, an image coordinate processing program, and a signal conversion program in the signal processing unit. :
  • the eight spot pixels emitted by the eight infrared LEDs will have a great RGB difference with other pixels that do not emit infrared light. After scanning one pixel by pixel, you can find the coordinates of each spot in the image, as shown in Figure 12 ⁇ 13. Because there are no other pixels that emit infrared light, the RGB values are assumed to be (0 ⁇ N, 0 ⁇ N, 0 ⁇ N), and the eight spot pixels emitted by the eight infrared LEDs are assumed to have RGB values (0).
  • the resolution ratio DX is CX/(21 ⁇ 27+23 ⁇ 25)/2
  • the ratio of y-axis resolution DY is CY/(21 ⁇ 23+27 ⁇ 25)/2, where (21 ⁇ 27+23 ⁇ 25) / 2 is because if the user is not working on the computer or TV screen, it may cause perspective or squint effect, so 21 ⁇ 27 is not necessarily equal to 23 ⁇ 25, so the calculation can reduce the error, in addition (21 ⁇ 23+27 ⁇ 25)/2 is also calculated according to this method.
  • the light spot of the laser pointer and 21 to 28 on the signal receiving part 2 are the infrared light intake emitted by the infrared light emitting diode, and the image signal is sent to the signal processing unit 6, and the pixel scanning contrast processing is performed, and then the coordinate distance calculation is performed.
  • the infrared signal transmitter 33 of the same signal transmitting component 1 is transmitted to the infrared receiver 29 on the signal receiving part 2, and then The computer 5 is connected via the USB communication interface 211 to move the mouse 5 on the screen 3 to the position of the laser pointer light spot.
  • the mouse button signal of the mouse is sent to the computer 4 of the signal processing component 6 to be used.
  • the light point of the laser pointer can be utilized, and the left mouse button 38 or the right mouse button 39 of the signal transmitting unit 1 can be used to control the use of the mouse 5 as with the conventional mouse controller.
  • the infrared signal transmitter 33 and the infrared receiver 29 of the signal receiving unit 2 can also use several different transmission signals: such as Bluetooth (BlueTooth) ), infrared (Infrad) and wireless technology (Radio) to transfer to the computer 4.
  • Bluetooth Bluetooth
  • Infrad infrared
  • Radio wireless technology

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L’’invention concerne un contrôleur de souris à point lumineux et une méthode de traitement de signal. Le contrôleur comprend : un ordinateur (4) ; un écran d’affichage ; un appareil d’émission de signaux (1) pour émettre le signal de clic de bouton de souris et acquérir l’écran et le point lumineux laser à l’écran et les points lumineux émis par les DEL infrarouges (21, 22, 23, 24, 25, 26, 27, 28) disposées autour de l’écran ; un appareil de réception du signal (2) pour récevoir le signal de clic de bouton de souris émis par l’appareil d’émission de signaux et transmettre le signal de clic de bouton de souris à l’appareil de traitement de signaux (6) ; l’appareil de traitement de signaux traite alors le signal de clic de bouton de souris et le signal d’image écran capturés par l’appareil d’émission de signaux et les transforme en signaux de contrôle de souris pilotant le curseur de souris de l’ordinateur (5). La méthode de traitement de signaux du contrôleur de souris comprend : 1) le balayage et la comparaison des pixels ; 2) le calcul des distances de coordonnées ; 3) le calcul de l’échelle de résolution ; 4) le calcul de la position du centre de l’image ; 5) la conversion des coordonnées du centre de l’image ; 6) l’émission des coordonnées de la souris et des signaux de clic de bouton vers l’ordinateur pour contrôler la souris.
PCT/CN2006/000164 2005-02-03 2006-01-26 Contrôleur de souris à point lumineux et méthode de traitement de signal WO2006081761A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN200520002059.0 2005-02-03
CNU2005200020590U CN2807330Y (zh) 2005-02-03 2005-02-03 一种光点鼠标控制器

Publications (1)

Publication Number Publication Date
WO2006081761A1 true WO2006081761A1 (fr) 2006-08-10

Family

ID=36776964

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2006/000164 WO2006081761A1 (fr) 2005-02-03 2006-01-26 Contrôleur de souris à point lumineux et méthode de traitement de signal

Country Status (2)

Country Link
CN (1) CN2807330Y (fr)
WO (1) WO2006081761A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113426100A (zh) * 2021-05-20 2021-09-24 深圳市宏伟华电子有限公司 游戏枪光电感应方法、光电游戏系统及可读存储介质
CN113873307A (zh) * 2021-09-26 2021-12-31 关有光 一种带鼠标功能的智能电视遥控器

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100587747C (zh) * 2006-12-14 2010-02-03 北京视博数字电视科技有限公司 鼠标式遥控装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002052496A2 (fr) * 2000-12-22 2002-07-04 Koninklijke Philips Electronics N.V. Systeme de pointage sans fil utilisant la vision artificielle
WO2003052568A2 (fr) * 2001-12-14 2003-06-26 Koninklijke Philips Electronics N.V. Systeme et procede de telecommande pour un recepteur de television
CN2602419Y (zh) * 2002-11-22 2004-02-04 北京鹰搏蓝天科技有限公司 一种用于计算机输入的激光系统

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002052496A2 (fr) * 2000-12-22 2002-07-04 Koninklijke Philips Electronics N.V. Systeme de pointage sans fil utilisant la vision artificielle
WO2003052568A2 (fr) * 2001-12-14 2003-06-26 Koninklijke Philips Electronics N.V. Systeme et procede de telecommande pour un recepteur de television
CN2602419Y (zh) * 2002-11-22 2004-02-04 北京鹰搏蓝天科技有限公司 一种用于计算机输入的激光系统

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113426100A (zh) * 2021-05-20 2021-09-24 深圳市宏伟华电子有限公司 游戏枪光电感应方法、光电游戏系统及可读存储介质
CN113873307A (zh) * 2021-09-26 2021-12-31 关有光 一种带鼠标功能的智能电视遥控器
CN113873307B (zh) * 2021-09-26 2024-01-26 关有光 一种带鼠标功能的智能电视遥控器

Also Published As

Publication number Publication date
CN2807330Y (zh) 2006-08-16

Similar Documents

Publication Publication Date Title
TWI395603B (zh) 互動式遊戲裝置及其遊戲控制器
US6498860B1 (en) Input position detection device and entertainment system using the same
US8610667B2 (en) Non-contact selection device
CN104777927B (zh) 影像式触控装置及其控制方法
US8188973B2 (en) Apparatus and method for tracking a light pointer
WO2020015627A1 (fr) Capteur d'image, terminal mobile, et procédé de prise d'image photographique
JP2001236181A (ja) ポインティングデバイス
CN108965666B (zh) 一种移动终端及图像拍摄方法
CN102184053A (zh) 一种新型投影仪装置
JP2017072795A (ja) プロジェクター、及び、プロジェクターの制御方法。
US9686522B2 (en) Display apparatus capable of seamlessly displaying a plurality of projection images on screen
US9459695B2 (en) Gesture recognition system and method
KR101087998B1 (ko) 포인팅 제어 장치 및 제어 방법
JP5897158B2 (ja) 表示装置の操作方法、システム及び関連装置
WO2006081761A1 (fr) Contrôleur de souris à point lumineux et méthode de traitement de signal
TWI446218B (zh) A method of switching the range of interactive pointing devices and a handover fetch for interactive pointing devices
US20060250363A1 (en) Mouse with image system and method for using the same
CN111083454B (zh) 位置检测装置、显示装置、显示系统以及位置检测方法
US11243674B2 (en) Display apparatus and image processing method
JP2003208260A (ja) ポインティング装置
US20090046063A1 (en) Coordinate positioning system and method with in-the-air positioning function
KR20040027561A (ko) 카메라 기반의 지시 장치를 갖는 텔레비전 시스템, 및 그동작 방법
CN1533180A (zh) 基于视频画面检测的遥控装置及其方法
KR100980261B1 (ko) 포인팅/인터페이스 시스템
KR101056388B1 (ko) 포인팅/인터페이스 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: COMMUNICATION UNDER RULE 112(1) EPC, EPO FORM 1205A DATED 19/11/08.

122 Ep: pct application non-entry in european phase

Ref document number: 06705585

Country of ref document: EP

Kind code of ref document: A1