WO2017028524A1 - Système et procédé de reconnaissance d'objets physiques sur un tableau interactif - Google Patents

Système et procédé de reconnaissance d'objets physiques sur un tableau interactif Download PDF

Info

Publication number
WO2017028524A1
WO2017028524A1 PCT/CN2016/075705 CN2016075705W WO2017028524A1 WO 2017028524 A1 WO2017028524 A1 WO 2017028524A1 CN 2016075705 W CN2016075705 W CN 2016075705W WO 2017028524 A1 WO2017028524 A1 WO 2017028524A1
Authority
WO
WIPO (PCT)
Prior art keywords
physical object
coupling
sensors
processor
coupling pattern
Prior art date
Application number
PCT/CN2016/075705
Other languages
English (en)
Inventor
Zheng Shi
Yeliao TAO
Original Assignee
Zheng Shi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zheng Shi filed Critical Zheng Shi
Publication of WO2017028524A1 publication Critical patent/WO2017028524A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means

Definitions

  • the present invention relates to the field of interactive surfaces.
  • smart devices with touch screen have become popular communication devices. These smart devices collect input information from the capacitive sensor on the touch screen; specifically, touch and gesture actions performed on the touch screen.
  • the present invention provides a system for recognizing physical objects on an interactive board.
  • the system comprises includes one or more physical objects, an interactive board comprising a sensor array of which each sensor configured to couple with a physical object placed within the sensor’s detection range, and export the value of the coupling, and a processor configured to receive the coupling values.
  • the processor is configured to receive coupling values from the sensors that have coupled with the physical object, and derive a coupling pattern based on the coupling values.
  • the sensor array comprises capacitive sensors, and the coupling values are the capacitance changes caused by capacitive coupling between the physical object and the sensors that have detected the physical object.
  • the sensor array comprises frequency sensitive devices with a fixed frequency
  • the coupling values are the frequency changes of the frequency sensitive devices caused by coupling between the physical object and the sensors.
  • the processor recognizes the identity of physical object in accordance with the shape of the coupling pattern, and derives the location of the physical object from the locations of the sensors related to the coupling pattern.
  • the processor determines that the physical object is moving on the interactive board whenever the shape of the coupling pattern remains unchanged but the position of the coupling pattern changes, and that the moving direction of the physical object on the interactive board is the moving direction of the coupling pattern.
  • the processor determines that a secondary action has been acted upon the physical object when the shape of the coupling pattern changes while the physical object stays stationary.
  • the secondary action of a first physical object comprises placing a second physical object on the first physical object.
  • the secondary action of a first physical object comprises placing a finger on the first physical object.
  • the processor is further configured to determine the position of the finger touch on the first physical object in accordance with the changes in the shape of the coupling pattern.
  • the present invention further provides a method for recognizing physical objects on an interactive board, which comprises:
  • the method further comprises recognizing the identity of the physical object in accordance with the shape of the coupling pattern, and deriving the location of the physical object from the locations of the sensors related to the coupling pattern.
  • the method further comprises determining that the physical object is moving on the interactive board whenever the shape of the coupling pattern remains unchanged but the position of the coupling pattern changes, and that the moving direction of the physical object is the moving direction of the coupling pattern.
  • the method further comprises determining, by the processor, that the secondary action of a first physical object comprises placing a second physical object on the first physical object.
  • the method further comprises determining that the secondary action of a first physical object comprises placing a finger on the first physical object.
  • the method further comprises determining, by the processor, the position of the finger touch on the first physical object in accordance with the changes in the shape of the coupling pattern.
  • FIG. 1 is an exemplary schematic diagram illustrating a toy car being placed upon on an interactive board in accordance with one embodiment of the present invention.
  • FIG. 2 is an exemplary schematic diagram illustrating the effect of placing a toy car on the interactive board upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • FIG. 3 is an exemplary schematic diagram illustrating the effect of moving a toy car across to the right upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • FIG. 4 is an exemplary schematic diagram illustrating the effect of rotating a toy car 90° upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • FIGs. 5A, 5B, 5C, and 5D are exemplary schematic diagrams illustrating the effects of placing a physical object on top of another physical object upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • FIG. 6 is the flow chart illustrating the method for interacting with physical objects placed on an interactive board in accordance with one embodiment of the present invention.
  • FIG. 1 is an exemplary schematic diagram illustrating an embodiment of the present invention in which a toy car is placed upon on an interactive board.
  • the system for interacting with physical objects placed on an interactive board includes an interactive board 101, at least one physical object 102, and a processor 103.
  • the interactive board 101 comprises a sensor array of which each sensor is configured to couple with the physical object 102 placed on top of it and export a coupling value to the processor 103.
  • the processor 103 is connected to the sensor array of the interactive board 101 and is configured to receive the coupling values exported from all of the sensors of the sensor array.
  • the processor 103 receives the coupling values exported from the sensors of the sensor array that have experienced coupling with the physical object 102, it is configured to derive a coupling pattern based on the coupling values.
  • the physical object 102 is designed to be a toy car.
  • the sensors of the sensor array can be designed to have different structures.
  • the sensors of the sensor array are capacitive sensors and the coupling values are the capacitance changes of the capacitive sensors, caused by coupling between the physical object and the sensors.
  • Another potential option is for the sensors of the sensor array to be frequency sensitive devices with a fixed frequency, and then the coupling values are the frequency changes of the frequency sensitive devices caused by coupling between the physical object and the sensors.
  • Other potential options for the sensor design include using single capacitor electrodes, piezoelectric units or magnetic coils.
  • the coupling values between the physical objects and the sensor array will be different.
  • the coupling value will be the change in capacitive value whereas when a single capacitor electrode sensor is used, the coupling value is the coupling value between the physical object and the capacitance electrode.
  • the same sensor design may be used in different ways.
  • the coupling values can be achieved either by measuring the change in capacitance values or by measuring the frequency change after electrifying the capacitance with alternating current of a certain frequency.
  • the processor 103 is configured to derive a coupling pattern based on the coupling values between the physical object and the sensors of the sensor array that have experienced coupling.
  • FIG. 2 is an exemplary schematic diagram illustrating the effect of placing a toy car on the interactive board upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • the coupling pattern is in a three dimensional coordinate system in which the X axis and the Y axis are used to represent the coordinate locations of the physical object (i.e., the toy car) 102 relative to the interactive board 101.
  • each X, Y coordinate represents a particular sensor of the sensor array (illustrated as boxes in FIG. 2) .
  • the Z axis represents the magnitude of the coupling value. Specifically, this is the coupling value exported by the sensors.
  • the physical object 102 couples with the several sensors placed below and near it with the magnitude of the coupling varying depending on the proximity of the coupling sensor to the physical object 102.
  • the coupling pattern of the physical object 102 has been pre-stored in the processor 103. Therefore, the processor 103 identifies the physical object 102 whenever it is placed upon the interactive board by detecting and recognizing its coupling pattern.
  • the coupling pattern is defined as the specific shape, in both relative location of coupling sensors from each other (i.e., number of sensors experiencing coupling and their relative location from each other) and each coupling sensor’s individual coupling magnitude (i.e., Z variable) attributable to a physical object when coupling with the sensor array.
  • the processor 103 is also configured to determine the orientation of the physical object 102 by comparing the difference in the magnitude of the coupling values experienced by coupling sensors.
  • the back of the toy car is designed in such a manner that it creates the strongest coupling value with the sensor placed under it compared with the rest of the toy car.
  • the coordinate (3, 3) in FIG. 2 experiences the strongest coupling value (biggest Z parameter value) as it is the location of the back of the toy car.
  • the processor 103 is configured to receive coupling values and subsequently derive a coupling pattern in real-time. Thus, the processor 103 determines that the physical object 102 is moving on the interactive board 101 whenever the shape of the coupling pattern remains unchanged but the position of the coupling pattern changes, and that the direction of the physical object 102 on the interactive board 101 is the direction from the start position of the coupling pattern to the end position of the coupling pattern.
  • FIG. 3 is an exemplary schematic diagram illustrating the effect of moving the toy car 102 across to the right upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • the back of the toy car 102 is designed to create the strongest coupling value which, as mentioned previously, is the (3, 3) coordinate where the Z axis value is the highest.
  • the user moves the toy car 102 across to the right which causes the sensor array to experience the same coupling pattern (as it is still the same object) but at a different location.
  • the toy car’s 102 coupling pattern has shifted up the x axis by one cell (i.e., each cell being a sensor) .
  • the back of the toy car’s 102 coordinates has changes from the original (3, 3) to the new (4, 4) .
  • FIG. 4 is an exemplary schematic diagram illustrating the effect of rotating a toy car 120 90° upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • the user rotates the toy car 102 from its original position in FIG. 2 by 90° causing the coupling pattern illustrated in FIG. 4.
  • FIGs. 5A, 5B, 5C, and 5D are exemplary schematic diagrams illustrating the effects of placing a physical object on top another physical object upon the sensor array’s coupling pattern in accordance with one embodiment of the present invention.
  • FIG. 5A is an exemplary schematic diagram illustrating the placement of a second physical object 502 on top of a first physical object 501 that is located on the interactive board.
  • FIG. 5B illustrates the coupling pattern of the first physical object 501 whenever it is placed alone upon the interactive board.
  • FIG. 5C is the coupling pattern of the second physical object 502 whenever it is placed alone upon the interactive surface.
  • FIG. 5D illustrates the coupling pattern caused by placing the second physical object 502 on top of the first physical object 501.
  • the coupling patterns of the physical objects 501, 502 are pre-stored in the processor 103.
  • the coupling value between the sensor array and the area on the physical objects’ 501 and 502 designed to cause the strongest coupling value is 100 whereas the coupling value between the sensor array and the other areas of the physical objects’ 501 and 502 is only 50.
  • the coupling value for the coupling pattern is changed to 130 (areas which combine a bold area and non-bolded area) and 70 (only non-bolded area) respectively.
  • the processor 103 since the processor 103 has already identified the first physical object 501, and detects that the coupling pattern has changed to the coupling pattern illustrated in FIG. 5D, the processor is configured to recognize that a secondary action has been made upon the first physical object 501. The processor 103 is then configured to divide the coupling pattern illustrated in FIG. 5D into two coupling patterns, the coupling pattern of the first physical object 501 and a new coupling pattern. Subsequently, the processor 103 matches the new coupling pattern to that of the second physical object (i.e., FIG. 5C) . In such a manner the processor is configured to deduce that the second physical object 502 was superimposed upon the first physical object 501. Other physical objects having unique coupling patterns can be recognized as superimposed upon physical objects in the same manner.
  • a secondary action may further include placing a finger on top of a physical object already located on the interactive surface.
  • the processor will deduce that the object placed on top of the physical object is a finger whenever it fails to attribute the new coupling pattern as a pre-recorded coupling pattern.
  • FIG. 6 is the flow chart illustrating the method for interacting with physical objects placed on an interactive board in accordance with one embodiment of the present invention. As shown in FIG. 6, the method for interacting with physical objects placed on an interactive board comprises:
  • a coupling pattern for the physical object comprising both the location of the sensors having coupled with the physical object and the values of such couplings (604) .
  • the apparatus and method disclosed may be realized by other means.
  • the embodiment of the apparatus described is only schematic.
  • the division of the unit is only a division of logical function; in practice, it can be divided in other ways.
  • multiple units or components can be combined or integrated to another system, or some features can be ignored, or not executed.
  • the mutual coupling or direct coupling or communication connection displayed or discussed can be through indirect coupling or communication connection of a number of interfaces, devices or units, which can be electrical, mechanical or otherwise.
  • the unit described as a separate component can be either physically separated or not, the component as display unit can be either physical unit or not, namely it can be placed in one place, or be distributed to multiple network units. By choosing part or the entire unit according to the actual need, the purpose of this embodiment can be realized.
  • each function unit if each embodiment of the present invention can be integrated to a processing unit or each unit physically exists alone, or two or more units are integrated to one unit.
  • the integrated unit can be realized in the form of hardware or realized in the form of hardware plus software.
  • the integrated unit realized in the form of software unit can be stored in a computer readable storage medium.
  • the software unit is stored in a storage medium, comprising several instructions to make a computer device (e.g., a personal computer, server, or network equipment) or processor execute part of the steps in each embodiment of the present invention.
  • the storage medium may comprise: a U disk, mobile hard disk, read only memory read only memory (ROM) , random access memory (RAM) , disk or CD-ROM and other various program code storage medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

La présente invention concerne un système et un procédé associé de reconnaissance d'objets physiques sur un tableau interactif. Le système comprend un ou plusieurs objets physiques, un tableau interactif comprenant un réseau de capteurs conçus chacun pour le couplage à un objet physique lorsque ledit objet physique est placé à l'intérieur de la plage de détection du capteur et l'exportation de la valeur du couplage, et un processeur conçu pour la réception des valeurs de couplage. Une fois l'objet physique placé sur le tableau interactif, le processeur est conçu pour la réception de valeurs de couplage en provenance des capteurs ayant été couplés avec l'objet physique et la détermination d'un motif de couplage en fonction des valeurs de couplage.
PCT/CN2016/075705 2015-08-14 2016-03-04 Système et procédé de reconnaissance d'objets physiques sur un tableau interactif WO2017028524A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510499236.9A CN105068652A (zh) 2015-08-14 2015-08-14 输入检测方法及装置
CN201510499236.9 2015-08-14

Publications (1)

Publication Number Publication Date
WO2017028524A1 true WO2017028524A1 (fr) 2017-02-23

Family

ID=54498038

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/075705 WO2017028524A1 (fr) 2015-08-14 2016-03-04 Système et procédé de reconnaissance d'objets physiques sur un tableau interactif

Country Status (2)

Country Link
CN (1) CN105068652A (fr)
WO (1) WO2017028524A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105068652A (zh) * 2015-08-14 2015-11-18 施政 输入检测方法及装置

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713756A (zh) * 2012-09-29 2014-04-09 联想(北京)有限公司 一种触摸屏上物体识别方法及应用该方法的电子设备
WO2014209519A1 (fr) * 2013-06-27 2014-12-31 Synaptics Incorporated Classification d'objet d'entrée
US20150029128A1 (en) * 2013-07-24 2015-01-29 Synaptics Incorporated Face detection with transcapacitive sensing
US20150091846A1 (en) * 2013-10-02 2015-04-02 Synaptics Incorporated Modulated back plate for capacitive sensing
CN104750314A (zh) * 2015-04-16 2015-07-01 施政 物体位置探测方法、微处理器及探测系统
CN105068652A (zh) * 2015-08-14 2015-11-18 施政 输入检测方法及装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100383713C (zh) * 2004-12-31 2008-04-23 联想(北京)有限公司 一种便携式电子设备的信息输入装置及控制方法
CN101403954A (zh) * 2008-09-25 2009-04-08 深圳华为通信技术有限公司 触摸检测方法、装置及其系统
US9182860B2 (en) * 2012-02-08 2015-11-10 Sony Corporation Method for detecting a contact

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103713756A (zh) * 2012-09-29 2014-04-09 联想(北京)有限公司 一种触摸屏上物体识别方法及应用该方法的电子设备
WO2014209519A1 (fr) * 2013-06-27 2014-12-31 Synaptics Incorporated Classification d'objet d'entrée
US20150029128A1 (en) * 2013-07-24 2015-01-29 Synaptics Incorporated Face detection with transcapacitive sensing
US20150091846A1 (en) * 2013-10-02 2015-04-02 Synaptics Incorporated Modulated back plate for capacitive sensing
CN104750314A (zh) * 2015-04-16 2015-07-01 施政 物体位置探测方法、微处理器及探测系统
CN105068652A (zh) * 2015-08-14 2015-11-18 施政 输入检测方法及装置

Also Published As

Publication number Publication date
CN105068652A (zh) 2015-11-18

Similar Documents

Publication Publication Date Title
US8566955B2 (en) User indentification with capacitive touchscreen
CN103154866B (zh) 对于触摸和悬停感测的并行信号检测
CN105786239B (zh) 具有电感器的笔
CN103440089B (zh) 一种用户设备的界面调整方法及用户设备
US20110037727A1 (en) Touch sensor device and pointing coordinate determination method thereof
CN105786238B (zh) 利用多个发射器频率感测对象
KR20160096390A (ko) 터치 센서를 구비한 전자 장치 및 그 구동 방법
US9798433B2 (en) Guard accessory device for an electronic and/or computer apparatus, and apparatus equipped with such an accessory device
JP6234462B2 (ja) タッチスクリーン入力処理方法及び装置
US9582127B2 (en) Large feature biometrics using capacitive touchscreens
US20160054831A1 (en) Capacitive touch device and method identifying touch object on the same
CN110162230A (zh) 触摸位置的识别方法、装置及存储介质
EP3640775B1 (fr) Procédé de détection tactile, puce tactile, dispositif électronique et système tactile
US11157714B2 (en) Method for determining a finger motion on a fingerprint sensor
US9811218B2 (en) Location based object classification
CN103324410A (zh) 用于检测触摸的方法和装置
CN106095298B (zh) 用于电容性输入装置的混合检测
US10088922B2 (en) Smart resonating pen
WO2017028524A1 (fr) Système et procédé de reconnaissance d'objets physiques sur un tableau interactif
TWI700624B (zh) 觸控中心計算方法、觸控系統及觸控裝置
TW201546690A (zh) 具有接近感應功能之電容式觸控面板及其掃描方法
US20150309635A1 (en) Method for using a controller on a touch sensitive device
WO2017004998A1 (fr) Système pour diriger l'action d'un objet physique automoteur et procédé associé
TWI490766B (zh) 未共地物件識別方法
US10620727B2 (en) Information processing method and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16836389

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16836389

Country of ref document: EP

Kind code of ref document: A1