WO2013016995A1 - 一种红外触摸屏的多点识别方法及系统 - Google Patents

一种红外触摸屏的多点识别方法及系统 Download PDF

Info

Publication number
WO2013016995A1
WO2013016995A1 PCT/CN2012/077823 CN2012077823W WO2013016995A1 WO 2013016995 A1 WO2013016995 A1 WO 2013016995A1 CN 2012077823 W CN2012077823 W CN 2012077823W WO 2013016995 A1 WO2013016995 A1 WO 2013016995A1
Authority
WO
WIPO (PCT)
Prior art keywords
point
data structure
touch screen
optical path
contour
Prior art date
Application number
PCT/CN2012/077823
Other languages
English (en)
French (fr)
Inventor
王武军
刘新斌
刘建军
叶新林
Original Assignee
北京汇冠新技术股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京汇冠新技术股份有限公司 filed Critical 北京汇冠新技术股份有限公司
Publication of WO2013016995A1 publication Critical patent/WO2013016995A1/zh

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/04166Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving

Definitions

  • the invention relates to a method and a system for recognizing a touch screen touch point, in particular to a multi-point recognition method and system for an infrared touch screen based on image processing.
  • touch screens are widely used as a simple and convenient human-computer interaction device.
  • the types of touch screens mainly include resistive touch screens, capacitive touch screens, surface acoustic wave touch screens, optical touch screens, and infrared touch screens.
  • the infrared touch screen uses an infrared matrix densely arranged in the X and Y directions to detect and locate the user's touch operation.
  • the infrared touch screen is provided with a circuit board outer frame on the front side of the display.
  • the circuit board arranges the infrared transmitting tube and the infrared receiving tube on the four sides of the screen, and one-to-one correspondingly forms an infrared matrix which is horizontally and vertically crossed.
  • the touch object such as a finger blocks the two infrared rays passing through the position, so that the position of the touch point on the screen can be judged. Since the infrared touch screen has the advantages of being free from current, voltage and static interference, and being suitable for harsh environmental conditions, the infrared touch screen has a wide application range.
  • the identification method of touch points on the infrared touch screen has gone through the development process from identifying a point to recognizing two points and then identifying more points.
  • Multi-point (more than two points) recognition will inevitably become the trend of infrared touch screens, because multi-touch can not only display more dazzling display effects, but also achieve more touch functions.
  • the two-point identification method of the infrared touch screen is basically mature at present, and the key step in the recognition process is to remove ghost points, which are non-real touch points recognized on the infrared touch screen.
  • logical judgment methods can be used. For example, according to the distance relationship between each corresponding quasi-touch point set in two (or more) logic screens, the real touch points are directly filtered. The theoretical basis is: The real point has a small deviation in the scan results of each logical screen, and the ghost point deviation is large. This method of removing ghost points is simple and easy to implement, and the calculation amount is small, and the ability to remove ghosts is strong.
  • the applicant submitted a Chinese invention patent application (application number: 201110157053.0, name: a multi-point identification method and system for infrared touch screen), and recorded an image-based infrared touch screen multi-point identification method and system .
  • the method and system first generate an optical path image corresponding to the optical path of the infrared touch screen in one recognition process; and then extract the touch point information by performing operations such as denoising and dividing the optical path image.
  • the method and system can realize the recognition of any multi-point on the infrared touch screen well, and the recognition accuracy is high, no ghost points or few ghost points.
  • the method and system perform processing based on the image as a whole or in part it is time consuming.
  • the technical problem to be solved by the present invention is to provide an efficient multi-point identification method and system for an infrared touch screen.
  • the technical solution adopted by the present invention is as follows:
  • a multi-point identification method for an infrared touch screen includes the following steps:
  • Touch point information is extracted according to the data structure.
  • the multi-point identification method of the infrared touch screen as described above, wherein the method for generating the data structure comprises the following steps: collecting optical path data of the infrared touch screen in one recognition process;
  • each optical path is occluded is determined based on the optical path data, and if the optical path is not occluded, the corresponding element value in the data structure is marked as a first set value.
  • the multi-point identification method of the infrared touch screen as described above, wherein the method of extracting touch point information comprises the following steps:
  • the center coordinates and the contour area of each contour are calculated based on the contour information, and the center coordinates are used as touch point coordinates, and the contour area is used as a touch point area.
  • the multi-point identification method of the infrared touch screen as described above, wherein the denoising process is as follows:
  • the data structure is continuously subjected to N etching operations, the 1 N 5 .
  • the etching operation includes the following steps:
  • step 1 sequentially traversing each element in the data structure, if the current element value is the first set value, continue to traverse, otherwise, proceed to step 2;
  • step 3 determines whether the data structure is traversed, if yes, proceed to step 4, otherwise, go to step 1;
  • the multi-point identification method of the infrared touch screen as described above, wherein the smooth edge processing method is as follows:
  • the data structure is continuously subjected to N expansion operations, the 1 N 5 .
  • the expansion operation includes the following steps:
  • step 1 sequentially traversing each element in the data structure, if the current element value is the first set value, continue to traverse, otherwise, proceed to step 2;
  • step 3 determines whether the data structure is traversed, if yes, proceed to step 4, otherwise, go to step 1;
  • step 3 determines whether the data structure is traversed, if yes, proceed to step 4, otherwise, go to step 1;
  • the multi-point recognition method of the infrared touch screen as described above, wherein the method of extracting the touch point contour information comprises the following steps:
  • step 4 Determine whether the data structure is traversed, and if yes, end, otherwise, go to step 1.
  • the multi-point recognition method of the infrared touch screen in a single recognition process, it is first determined whether there is a touch point on the infrared touch screen according to the optical path data; if there is no touch point, the current recognition is ended.
  • the area where the touch point is located is first determined according to the optical path data; if there is the touch point area, the area corresponding to the touch point is generated corresponding to the optical path in the area
  • the data structure having the two-dimensional matrix arrangement property is subjected to subsequent recognition processing; if there is no touch point region, the current recognition is ended.
  • the multi-point recognition method of the infrared touch screen as described above in the first recognition process, first determining whether there is a touch point on the infrared touch screen according to the optical path data; if there is a touch point, continuing to determine the area where the touch point is located according to the optical path data, A data structure having a two-dimensional matrix arrangement property corresponding to the optical path in the region is generated in the region where the touch point is located, and subsequent recognition processing is performed; if there is no touch point, the current recognition is ended.
  • a multi-point recognition system for an infrared touch screen comprising: a data structure generating device for generating a data structure having a two-dimensional matrix arrangement property corresponding to an optical path of the infrared touch screen in one recognition process;
  • a touch point information extracting apparatus for extracting touch point information in the data structure.
  • the data structure generating means includes a collecting unit for collecting optical path data in a single recognition process of the infrared touch screen;
  • An initial data structure generating unit for generating an initial data structure that is at a preset ratio to the infrared touch screen size, and initializing all element values of the initial data structure to a second set value;
  • the data structure element value determining unit is set to the first set value according to the corresponding element value in the structure.
  • the touch point information extracting means includes a denoising unit for performing denoising processing on the data structure, and the processed data structure is recorded as a data structure.
  • a smooth edge unit for smoothing edge processing of the data structure A, and treating the processed data structure as a data structure
  • a contour refinement unit for performing contour thinning on the data structure, and recording the processed data structure as a data structure C;
  • An extracting unit for segmenting the data structure C and extracting touch point contour information
  • a calculation unit for calculating a center coordinate and a contour area of each contour based on the contour information.
  • the multi-point recognition system of the infrared touch screen as described above, further comprising: touch point area determining means for determining an area where the touch point is located according to the optical path data; wherein the data structure generating means is configured to generate and describe the area where the touch point is located A data structure having a two-dimensional matrix arrangement property corresponding to the optical path in the region.
  • the multi-point recognition system of the infrared touch screen as described above further includes pre-determination means for determining whether or not there is a touch point on the infrared touch screen based on the optical path data.
  • the multi-point recognition system of the infrared touch screen as described above further includes pre-determination means for determining whether there is a touch point on the infrared touch screen according to the optical path data; and a touch point area determining means for determining an area where the touch point is located according to the optical path data;
  • the data structure generating means is configured to generate, in the region where the touch point is located, a data structure having a two-dimensional matrix arrangement property corresponding to the optical path in the region.
  • the multi-point recognition system of the infrared touch screen as described above further includes touch point tracking means for tracking the movement of the touch point in accordance with the distance of the track point of each touch point from the front point.
  • the invention provides a novel infrared touch screen multi-point recognition method and system for simulating images by using a data structure having a two-dimensional matrix arrangement property, which is suitable for identification of any plurality of touch points, has fast touch response speed and high recognition accuracy. No ghosts or ghosts.
  • FIG. 1 is a structural block diagram of a multi-point recognition system of an infrared touch screen in Embodiment 1;
  • Embodiment 2 is a flowchart of a multi-point identification method of the infrared touch screen in Embodiment 1;
  • FIG. 3 is a flow chart showing a method of generating an optical path corresponding array in Embodiment 1;
  • FIG. 4 and FIG. 5 are schematic diagrams showing a process of determining corresponding element values in an array according to an optical path in Embodiment 1;
  • FIG. 6 is a flowchart of an array generating method in Embodiment 1;
  • FIG. 7 is a flowchart of a method of denoising processing in Embodiment 1;
  • Embodiment 8 is a flowchart of a smooth edge processing method in Embodiment 1;
  • Embodiment 9 is a flowchart of a contour thinning processing method in Embodiment 1;
  • Embodiment 10 is a flowchart of a method for extracting touch point contour information in Embodiment 1;
  • FIG. 11 is a structural block diagram of a multi-point identification system of an infrared touch screen in Embodiment 2;
  • Figure 12 is a schematic diagram showing the principle of optical path reverse pushing in Embodiment 2;
  • FIG. 13 and FIG. 14 are block diagrams showing the configuration of a multipoint recognition system for an infrared touch panel in Embodiment 3. detailed description
  • the core idea of the present invention is: in a recognition process, first generating an optical path image corresponding to an optical path in a recognition process, if there is a touch point, it can be reflected in the optical path image; and then performing a series of processing on the optical path image to extract the touch Point information.
  • a data structure having a two-dimensional matrix arrangement property is used to simulate an optical path image, and an element in the data structure is equivalent to a pixel in the optical path image, thereby solving image processing consumption. More problems at the time, thus increasing the speed of the touch response and enhancing the touch experience.
  • the system includes a data structure generating device 11, a touch point information extracting device 12, and a touch point tracking device 13.
  • the data structure generating device 11 includes an acquiring unit 111, an initial data structure generating unit 112, and a data structure element value determining unit 113.
  • the touch point information extracting device 12 includes a denoising unit 121, a smoothing edge unit 122, and a contour refinement unit 123.
  • the extraction unit 124 and the calculation unit 125 is described infrared touch screen.
  • the data structure generating means 11 is for generating a data structure having a two-dimensional matrix arrangement property corresponding to the optical path of the infrared touch screen in one recognition process.
  • the collecting unit 111 is configured to collect optical path data of the infrared touch screen in a single recognition process;
  • the initial data structure generating unit 112 is configured to generate an initial data structure that is preset to a size of the infrared touch screen, and use all elements of the initial data structure.
  • the value is initialized to the second set value;
  • the data structure element value determining unit 113 is configured to determine, according to the optical path data, whether each optical path is occluded, and if the optical path is not occluded, set the corresponding element value in the data structure to the first Set a value.
  • the touch point information extracting means 12 is for extracting touch point information in the data structure.
  • the denoising unit 121 is configured to perform denoising processing on the data structure, and record the processed data structure as a data structure smoothing edge unit 122 for performing smooth edge processing on the data structure A, and processing the processed data structure.
  • the data structure B is used;
  • the contour refinement unit 123 is configured to perform contour thinning processing on the data structure, and the processed data structure is recorded as the data structure C; and the extracting unit 124 is configured to divide the data structure C.
  • the touch point contour information is extracted;
  • the calculating unit 125 is configured to calculate the center coordinate and the contour area of each contour according to the contour information, using the center coordinate as the touch point coordinate, and the contour area as the touch point area.
  • the touch point tracking device 13 is for tracking the touch point motion according to the distance of the track point of each touch point from the previous point.
  • the method for implementing multi-point identification in a recognition process in the system of the present embodiment includes the following steps:
  • the data structure generating means 11 generates a data structure having a two-dimensional matrix arrangement property corresponding to the optical path of the infrared touch screen in one recognition process.
  • the data structure having the two-dimensional matrix arrangement property may be a two-dimensional array, a two-dimensional vector or a two-dimensional matrix, etc., and an array is used in the embodiment.
  • An array corresponding to all the optical paths in one recognition process may be generated, or an array corresponding to a part of the optical paths in one identification process may be generated, which is determined according to a specific application environment. Obviously, the more light paths, the better the recognition effect.
  • the specific generation process includes the following steps:
  • the collecting unit 111 collects the optical path data of the infrared touch screen in one recognition process.
  • the initial data structure generating unit 112 generates an initial array that is at a preset ratio to the size of the infrared touch screen, and All element values of the initial data structure are initialized to a second set value, ie, the elements of the initial data structure are all defaulted to the target point.
  • the size of the touch screen and the size of the array can be any ratio, which is set by the user according to the specific application environment. Preferably, it is 1 : 1, such that the coordinates of the optical path on the touch screen and the corresponding coordinates of the optical path in the array need not be converted.
  • the data structure element value determining unit 113 determines whether an optical path is occluded according to the optical path data. If the optical path is not occluded, the corresponding element value in the array is marked as the first set value, that is, marked as a background point, and proceeds to the next step; Otherwise, go directly to the next step.
  • the first set value is 0, and the second set value is 1.
  • Coordinate transformation is required when determining the elements in the corresponding array of optical paths.
  • the starting point coordinate of the optical path is (c,y)
  • y/y ' m/n
  • a linear rasterization algorithm (such as the Bresenham algorithm) is used to perform the method based on integer increment, which has the advantage of high speed.
  • the combination of the elements in the corresponding array of the two optical paths 41 and 42, as shown in Fig. 4 are 41 ' and 42 ', respectively.
  • the linear rasterization algorithm is an existing algorithm, and can be referred to related image literature, and the description will not be repeated here.
  • the touch point information extracting means 12 extracts the touch point information in the array P. As shown in Fig. 6, the specific extraction process includes the following steps:
  • the denoising unit 121 denoises the array ⁇ and records the processed array as an array A.
  • the process of the corrosion operation includes the following steps:
  • step (a) traverse each element in the array ⁇ in turn, if the current element value is 0, continue the traversal, otherwise, proceed to step (b);
  • step (c) determine whether the array ⁇ is traversed, if yes, proceed to step (d), otherwise, go to step (a);
  • Smooth edge unit 122 performs smooth edge processing on the array ,, and records the processed array as an array ⁇ .
  • the purpose of smooth edge processing is to make the edges of touch points smoother.
  • the process of smoothing edge processing includes the following steps:
  • step (a) traverse each element in array A in turn, if the current element value is 0, continue traversing, otherwise, proceed to step (b);
  • step ( b ) marking all four neighborhood elements of the current element as target points; (c) judging whether the array A has been traversed, if yes, proceeding to step (d), otherwise, proceeding to step (a);
  • the contour refinement unit 123 performs contour thinning on the array ,, and records the processed array as an array C.
  • the purpose of the contour refinement process is to remove the internal points of the touch point area, leaving only the touch point edges.
  • the process of the contour thinning process includes the following steps:
  • step (a) traverse each element in the array in turn, if the current element value is 0, continue the traversal, otherwise, proceed to step (b);
  • step (c) judging whether the array has been traversed, if yes, proceed to step (d), otherwise, go to step (a);
  • the extracting unit 124 divides the array C to extract touch point contour information; if the touch point contour is not obtained, the current recognition is ended.
  • the process of extracting touch point contour information includes the following steps:
  • step (a) traversing array C from bottom to top and from left to right; if the current element is a background point (ie, the element value is 0) or has been traversed, or there are already tracked target points in the eight neighborhoods of the current element , or all the eight neighbors of the current element are background points, then skip the current element and continue traversing; otherwise, the current element is the starting point of the new touch point contour, record the starting contour point information, and proceed to step (b) for single Target contour tracking;
  • step (c) starting from the current contour point, continue to follow the tracking method as described in step (b) until the current boundary point returns to the starting contour point;
  • step (d) Determine if array C has been traversed, and if so, end, otherwise, go to step (a).
  • the calculation unit 125 calculates the center coordinates and the contour area of each contour based on the contour information, and uses the center coordinates as the touch point coordinates, and the contour area as the touch point area.
  • the center coordinates of the contour can be calculated using, but not limited to, the following methods: (a) Calculate the average of the coordinates of all contour points recorded, and use the average as the center coordinate of the contour; (b) Calculate the average of the coordinates of all points in the contour. Value, the average value is taken as the center coordinate of the contour, and the coordinates of all points in the contour can be obtained by the coordinates of the contour edge point. Obviously, the center coordinates calculated using the coordinates of all points in the contour are more accurate.
  • the contour area can be calculated by, but not limited to, the following method: (a) Calculate the area of the circumscribed rectangle of the contour, and use the area as the contour area; (b) Calculate the number of points contained in the contour, and use the number as the contour area. Obviously, the contour area calculated by the second method is more accurate.
  • the coordinates of the touch point acquired at this time are the coordinates in the array, and if necessary, the coordinates can be converted into touch screen coordinates according to the size of the touch screen and the size ratio of the array.
  • the method further includes the step of tracking the touched point.
  • the tracking device 13 tracks the motion of the touch point based on the distance of the track point of each touch point from the previous point. For example, suppose that during the two consecutive recognitions, the first time Five touch points are identified, which are 7 ⁇ , ⁇ 2 , ⁇ 3 , ⁇ 4 , ⁇ 5 , and the second touch point is also identified, which are 7V, ⁇ 2 ', ⁇ 3 ', ⁇ 4 ', respectively. ⁇ 5 '.
  • each step is to process the entire array. Since the approximate position of each touch point area can be quickly obtained by the initial optical path data, the rough area set of the touch point can be obtained first, and subsequent operations are performed only for these areas. This processing speed will be greatly improved, but the basic idea is the same as that of the implementation method 1.
  • the specific process is as follows:
  • an initial array with a preset ratio of ⁇ to the infrared touch screen size is generated, with an element value of 0.
  • a rough area of the candidate touch points is calculated based on the optical path data, which is approximately a rectangular area. Therefore, as shown in Fig. 11, the system according to the present embodiment adds the touch point area determining means 14 to the first embodiment. If the candidate touch point area is not obtained after calculation based on the optical path data, it means that no touch point exists, and the current recognition is ended.
  • each touch point area in the initial array is traversed, and for each touch point area, all the optical paths passing through the area are reversed, the same optical path is merged, and the element value corresponding to the optical path in the array is determined according to the optical path.
  • the rectangular, circular, and diamond-shaped targets represent touch-point regions of different sizes and shapes.
  • the starting and ending optical paths through the object are obtained by back-twisting (the left optical path represents the starting optical path, right
  • the side light path represents the end light path.
  • the array element values corresponding to the light paths in the left and right ranges are determined.
  • part of the optical path passing through the rectangular area also passes through the circular area, and the optical paths of all areas are merged in order to avoid repeated generation.
  • the subsequent processing is basically the same as that of the first embodiment. The only difference is that the first embodiment processes the entire array, and the present embodiment only processes the array corresponding to the touch point area.
  • the present embodiment is based on the first embodiment or the second embodiment, and the pre-determination means 15 is provided for preliminarily determining whether or not the touch point exists based on the optical path data.
  • the specific judgment method may adopt any one of the prior art methods, and details are not described herein again.
  • the pre-judging means determines whether there is a touch point based on the optical path data. If there is no touch point, the current recognition is ended; if there is a touch point, the touch point is identified by the method of Embodiment 1 or Embodiment 2. This can avoid unnecessary recognition processing and improve recognition efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

本发明涉及一种红外触摸屏的多点识别方法及系统。本发明首先生成与红外触摸屏在一次识别过程中光路对应的具有二维矩阵排列性质的数据结构;然后根据所述数据结构提取触摸点信息。优选的,在一次识别过程中先根据光路数据判断红外触摸屏上是否存在触摸点;如果不存在,则结束本次识别。优选的,如果存在触摸点,则继续根据光路数据判断触摸点所在区域,对所述触摸点所在区域生成与所述区域中光路对应的数据结构;然后根据所述数据结构提取触摸点信息。本发明提出了一种全新的红外触摸屏多点识别方法及系统,适合于任意多个触摸点的识别,触摸响应速度快、识别准确率高、无鬼点或鬼点少。

Description

一种红外触摸屏的多点识别方法及系统 技术领域
本发明涉及一种触摸屏触摸点的识别方法及系统, 尤其是涉及一种基于图像处理的 红外触摸屏的多点识别方法及系统。
背景技术
随着触摸技术的发展, 触摸屏作为一种简单方便的人机交互设备得到广泛应用。 目 前, 触摸屏的种类主要包括电阻式触摸屏、 电容式触摸屏、 表面声波触摸屏、 光学触摸 屏和红外触摸屏等。 其中, 红外触摸屏是利用 X、 Y方向上密布的红外线矩阵来检测并 定位用户的触摸操作。 红外触摸屏在显示器的前面安装一个电路板外框, 电路板在屏幕 四边排布红外发射管和红外接收管, 一一对应形成横竖交叉的红外线矩阵。 用户在触摸 屏幕时, 手指等触摸物会挡住经过该位置的横竖两条红外线, 因而可以判断出触摸点在 屏幕上的位置。 由于红外触摸屏具有不受电流、 电压和静电干扰, 适宜恶劣的环境条件 等优点, 因此红外触摸屏的应用范围较广。
红外触摸屏上触摸点的识别方法经历了从识别一点到识别两点, 再到识别更多点的 发展历程。 多点 (超过两点) 识别必然会成为红外触摸屏的发展趋势, 因为多点触摸不 仅可以显示出更炫丽的显示效果, 而且可以实现更多的触摸功能。
红外触摸屏的两点识别方法目前已基本成熟, 识别过程中的关键步骤是去除鬼点, 所述鬼点是指在红外触摸屏上识别出的非真实触摸点。去除鬼点可以采用逻辑判断方法, 例如, 根据两个 (或更多) 逻辑屏中, 各个对应准触摸点集之间的距离关系, 直接筛选 真实的触摸点。 其理论基础是: 真实点在各个逻辑屏的扫描结果中距离偏差小, 而鬼点 偏差较大。 这种去除鬼点方法简单易实现, 计算量小, 去鬼点能力强。 但是, 当触摸点 多于两点时, 不同逻辑屏上特定触摸点的对应关系不易确定, 因为当不同逻辑屏上点数 相同时, 容易排序, 但是点数不同时, 如边角处某一逻辑屏上点丢失, 则较难排序对齐, 而且点数自动判定较难。 在点数增加时, 由于排序不成功而导致的错误识别发生几率也 迅速增加。 因此, 这种方法不适合于红外触摸屏上超过两点的多点识别。
目前市场上已经有部分厂家推出了具有多点 (10点) 识别功能的红外触摸屏, 但是 在效果上存在诸多弊端。 例如, 鬼点多、 精度低, 而且要求触摸点的面积较大。
申请人在之间提交了一件中国发明专利申请 (申请号: 201110157053.0, 名称: 一 种红外触摸屏的多点识别方法及系统) , 记载了一种基于图像的红外触摸屏的多点识别 方法及系统。 该方法及系统首先生成与红外触摸屏在一次识别过程中光路对应的光路图 像; 然后对所述光路图像进行去噪、 分割等操作后提取触摸点信息。 该方法及系统很好 地实现了红外触摸屏上任意多点的识别, 识别准确率高、 无鬼点或鬼点少。 但是, 由于 该方法及系统基于图像整体或局部进行处理, 因此比较费时。
发明内容
针对现有技术中存在的缺陷, 本发明所要解决的技术问题是提供一种高效的红外触 摸屏的多点识别方法及系统。 为解决上述技术问题, 本发明采用的技术方案如下:
一种红外触摸屏的多点识别方法, 包括以下步骤:
生成与红外触摸屏在一次识别过程中光路对应的具有二维矩阵排列性质的数据结 构;
根据所述数据结构提取触摸点信息。
如上所述的红外触摸屏的多点识别方法, 其中, 数据结构的生成方法包括以下步骤: 采集红外触摸屏在一次识别过程中的光路数据;
生成与所述红外触摸屏尺寸成预设比例的初始数据结构, 将所述初始数据结构的所 有元素值初始化为第二设定数值;
根据所述光路数据判断每条光路是否被遮挡, 如果光路未被遮挡, 则将所述数据结 构中相应元素值标记为第一设定数值。
如上所述的红外触摸屏的多点识别方法, 其中, 提取触摸点信息的方法包括以下步 骤:
对所述数据结构进行去噪处理, 将处理后的数据结构记为数据结构
对所述数据结构 A进行平滑边缘处理, 将处理后的数据结构记为数据结构 β;
对所述数据结构 进行轮廓细化处理, 将处理后的数据结构记为数据结构 C;
对所述数据结构 c进行分割, 提取触摸点轮廓信息; 如果未获得触摸点轮廓, 则结 束本次识别;
根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积, 将所述中心坐标作为触摸 点坐标, 轮廓面积作为触摸点面积。
如上所述的红外触摸屏的多点识别方法, 其中, 去噪处理的方法如下: 对所述数据 结构连续进行 N次腐蚀操作, 所述 1 N 5。 所述腐蚀操作包括以下步骤:
①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②;
②判断当前元素的四邻域元素值, 如果全部为第二设定数值, 则标记当前元素为目 标点, 否则, 标记为背景点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为背景点的元素值设置为第一设定数值。
如上所述的红外触摸屏的多点识别方法, 其中, 平滑边缘处理的方法如下: 对所述 数据结构连续进行 N次膨胀操作, 所述 1 N 5。 所述膨胀操作包括以下步骤:
①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②;
②将当前元素的四邻域元素全部标记为目标点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为目标点的元素值设置为第二设定数值。
如上所述的红外触摸屏的多点识别方法, 其中, 轮廓细化处理的方法包括以下步骤: ①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②;
②判断当前元素的八邻域值, 如果全部为第二设定数值, 则将当前元素标记为背景 点; 否则, 标记为目标点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为背景点的元素值设置为第一设定数值。
如上所述的红外触摸屏的多点识别方法, 其中, 提取触摸点轮廓信息的方法包括以 下步骤:
①从下到上、 自左向右遍历所述数据结构; 如果当前元素为背景点或者已被遍历过, 或者当前元素的八邻域内有已被跟踪过的目标点, 或者当前元素的八邻域内全部为背景 点, 则跳过当前元素, 继续寻找; 否则, 当前元素为新触摸点轮廓的起始点, 记录该起 始轮廓点信息, 进入步骤②进行单目标轮廓跟踪;
②从所述起始轮廓点开始, 沿左下方向进行扫描, 如果当前元素为目标点, 则记录 该目标点信息, 同时将扫描方向顺时针旋转 90度; 如果当前元素为背景点, 则将扫描方 向逆时针旋转 45度;
③从当前轮廓点开始, 继续按照步骤②中所述的跟踪方式进行轮廓跟踪, 直到当前 边界点回到起始轮廓点;
④判断所述数据结构是否遍历完毕, 如是, 则结束, 否则, 转至步骤①。
如上所述的红外触摸屏的多点识别方法, 在一次识别过程中, 首先根据光路数据判 断红外触摸屏上是否存在触摸点; 如果不存在触摸点, 则结束本次识别。
如上所述的红外触摸屏的多点识别方法, 在一次识别过程中, 首先根据光路数据判 断触摸点所在区域; 如果存在触摸点区域, 则对所述触摸点所在区域生成与所述区域中 光路对应的具有二维矩阵排列性质的数据结构, 再进行后续识别处理; 如果不存在触摸 点区域, 则结束本次识别。
如上所述的红外触摸屏的多点识别方法, 在一次识别过程中, 首先根据光路数据判 断红外触摸屏上是否存在触摸点; 如果存在触摸点, 则继续根据光路数据判断触摸点所 在区域, 对所述触摸点所在区域生成与所述区域中光路对应的具有二维矩阵排列性质的 数据结构, 再进行后续识别处理; 如果不存在触摸点, 则结束本次识别。
如上所述的红外触摸屏的多点识别方法, 其中, 在获得触摸点信息后, 还包括根据 每个触摸点的轨迹点与前面点的距离, 跟踪触摸点运动的步骤。
一种红外触摸屏的多点识别系统, 包括用于生成与红外触摸屏在一次识别过程中光 路对应的具有二维矩阵排列性质的数据结构的数据结构生成装置;
用于在所述数据结构中提取触摸点信息的触摸点信息提取装置。
如上所述的红外触摸屏的多点识别系统, 其中, 数据结构生成装置包括用于采集红 外触摸屏在一次识别过程中光路数据的采集单元;
用于生成与所述红外触摸屏尺寸成预设比例的初始数据结构, 并将所述初始数据结 构的所有元素值初始化为第二设定数值的初始数据结构生成单元;
用于根据所述光路数据判断每条光路是否被遮挡, 如果光路未被遮挡, 则将所述数 据结构中相应元素值设置为第一设定数值的数据结构元素值确定单元。
如上所述的红外触摸屏的多点识别系统, 其中, 触摸点信息提取装置包括用于对所 述数据结构进行去噪处理的去噪单元, 将处理后的数据结构记为数据结构
用于对所述数据结构 A进行平滑边缘处理的平滑边缘单元, 将处理后的数据结构记 为数据结构
用于对所述数据结构 进行轮廓细化处理的轮廓细化单元, 将处理后的数据结构记 为数据结构 C;
用于对所述数据结构 C进行分割, 提取触摸点轮廓信息的提取单元;
用于根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积的计算单元。 如上所述的红外触摸屏的多点识别系统, 还包括用于根据光路数据确定触摸点所在 区域的触摸点区域确定装置; 所述数据结构生成装置用于对所述触摸点所在区域生成与 所述区域中光路对应的具有二维矩阵排列性质的数据结构。
如上所述的红外触摸屏的多点识别系统, 还包括用于根据光路数据判断红外触摸屏 上是否存在触摸点的预判断装置。
如上所述的红外触摸屏的多点识别系统, 还包括用于根据光路数据判断红外触摸屏 上是否存在触摸点的预判断装置; 用于根据光路数据确定触摸点所在区域的触摸点区域 确定装置; 所述数据结构生成装置用于对所述触摸点所在区域生成与所述区域中光路对 应的具有二维矩阵排列性质的数据结构。
如上所述的红外触摸屏的多点识别系统, 还包括用于根据每个触摸点的轨迹点与前 面点的距离跟踪触摸点运动的触摸点跟踪装置。
本发明提出了一种全新的用具有二维矩阵排列性质的数据结构模拟图像的红外触摸 屏多点识别方法及系统, 适合于任意多个触摸点的识别, 触摸响应速度快、 识别准确率 高、 无鬼点或鬼点少。
附图说明
图 1是实施方式 1中红外触摸屏的多点识别系统的结构框图;
图 2是实施方式 1中红外触摸屏的多点识别方法的流程图;
图 3是实施方式 1中生成光路对应数组的方法流程图;
图 4和图 5是实施方式 1中根据光路确定数组中相应元素值的过程示意图; 图 6是实施方式 1中数组生成方法的流程图;
图 7是实施方式 1中去噪处理方法的流程图;
图 8是实施方式 1中平滑边缘处理方法的流程图;
图 9是实施方式 1中轮廓细化处理方法的流程图;
图 10是实施方式 1中触摸点轮廓信息提取方法的流程图;
图 11是实施方式 2中红外触摸屏的多点识别系统的结构框图;
图 12是实施方式 2中光路反推原理示意图;
图 13和图 14是实施方式 3中红外触摸屏的多点识别系统的结构框图。 具体实施方式
本发明的核心思想是: 在一次识别过程中, 首先生成与一次识别过程中光路对应的 光路图像, 如果存在触摸点, 则能够反映在光路图像中; 然后对光路图像进行一系列处 理后提取触摸点信息。 但是, 在生成光路图像时, 并非真正生成光路图像, 而是用具有 二维矩阵排列性质的数据结构来模拟光路图像, 数据结构中的元素相当于光路图像中的 像素, 以此解决图像处理耗时较多的问题, 从而提高触摸响应的速度, 增强触摸感受。 下面结合实施方式和附图对本发明进行详细描述。
实施方式 1
本实施方式记载了一种红外触摸屏的多点识别系统及方法。 如图 1所示, 该系统包 括数据结构生成装置 11、 触摸点信息提取装置 12和触摸点跟踪装置 13。 其中, 数据结 构生成装置 11包括采集单元 111、 初始数据结构生成单元 112和数据结构元素值确定单 元 113, 触摸点信息提取装置 12包括去噪单元 121、 平滑边缘单元 122、 轮廓细化单元 123、 提取单元 124和计算单元 125。
数据结构生成装置 11用于生成与红外触摸屏在一次识别过程中光路对应的具有二维 矩阵排列性质的数据结构。 其中采集单元 111 用于采集红外触摸屏在一次识别过程中的 光路数据; 初始数据结构生成单元 112用于生成与红外触摸屏尺寸成预设比例的初始数 据结构, 并将所述初始数据结构的所有元素值初始化为第二设定数值; 数据结构元素值 确定单元 113用于根据所述光路数据判断每条光路是否被遮挡, 如果光路未被遮挡, 则 将所述数据结构中相应元素值设置为第一设定数值。
触摸点信息提取装置 12用于在所述数据结构中提取触摸点信息。 其中去噪单元 121 用于对所述数据结构进行去噪处理, 将处理后的数据结构记为数据结构 平滑边缘单 元 122用于对所述数据结构 A进行平滑边缘处理, 将处理后的数据结构记为数据结构 B; 轮廓细化单元 123用于对所述数据结构 Β进行轮廓细化处理, 将处理后的数据结构记为 数据结构 C; 提取单元 124用于对所述数据结构 C进行分割, 提取触摸点轮廓信息; 计 算单元 125用于根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积, 将中心坐标作 为触摸点坐标, 轮廓面积作为触摸点面积。
触摸点跟踪装置 13用于根据每个触摸点的轨迹点与前面点的距离跟踪触摸点运动。 如图 2所示, 本实施方式所述系统在一次识别过程中实现多点识别的方法包括以下 步骤:
( 1 ) 数据结构生成装置 11 生成与红外触摸屏在一次识别过程中光路对应的具有二 维矩阵排列性质的数据结构。 所述具有二维矩阵排列性质的数据结构可以是二维数组、 二维向量或二维矩阵等, 本实施方式中采用数组。
可以生成在一次识别过程中的所有光路对应的数组, 也可以生成在一次识别过程中 的部分光路对应的数组, 根据具体的应用环境确定。 显然, 光路越多, 识别效果越好。
如图 3所示, 具体地生成过程包括以下步骤:
①采集单元 111采集红外触摸屏在一次识别过程中的光路数据。
②初始数据结构生成单元 112 生成与红外触摸屏尺寸成预设比例的初始数组, 并将 所述初始数据结构的所有元素值初始化为第二设定数值, 即将初始数据结构的元素均默 认为目标点。
触摸屏的尺寸与数组的尺寸可以是任意比例, 由用户根据具体应用环境设定。 优选 为 1 : 1, 这样光路在触摸屏上的坐标和该光路在数组中的对应坐标无需转换。
③数据结构元素值确定单元 113 根据光路数据判断一条光路是否被遮挡, 如果该光 路未被遮挡, 则将数组中相应元素值标记为第一设定数值, 即标记为背景点, 进入下一 步; 否则, 直接进入下一步。
本实施方式中, 第一设定数值为 0, 第二设定数值为 1。
在确定光路对应数组中元素时需要进行坐标转换。 设触摸屏的尺寸与数组的尺寸比 例 M=m/n, 光路的起点坐标为 ( c,y), 该光路在数组中对应元素的起点坐标为 则 c/ c'= m/n, y/y'= m/n, 由该公式可以计算出光路在数组中对应元素的起点坐标。 采用 同样的方法可以计算出光路在数组中对应元素的终点坐标。
在确定光路在数组中对应元素的起点与终点之间的元素时,采用直线光栅化算法(如 Bresenham算法), 基于整数递增的方式进行, 具有速度高的优点。 例如, 如图 4所示的 两条光路 41和 42, 对应数组中的元素组合分别为 41 ' 和 42 '。 直线光栅化算法为现有 算法, 可参考相关图像学文献, 此处不再展开说明。
④如果所有光路均被判断完毕, 则结束, 得到数组 Λ 否则, 获取下一个光路数据, 转至步骤③。
( 2) 触摸点信息提取装置 12在数组 P中提取触摸点信息, 如图 6所示, 具体地提 取过程包括以下步骤:
①去噪单元 121对数组 ^进行去噪处理, 将处理后的数组记为数组 A。
去噪处理的目的是去除噪声点, 即非触摸点。 本实施方式中, 去噪处理方法采用对 数组 ^连续进行 N次腐蚀操作, 所述 1 N 5, 优选 N=3。
如图 7所示, 腐蚀操作的过程包括以下步骤:
( a) 依次遍历数组 ^中的每个元素, 如果当前元素值为 0, 则继续遍历, 否则, 进 入步骤 (b ) ;
( b ) 判断当前元素的四邻域元素值, 如果全部为 1, 则标记当前元素为目标点, 否 则, 标记为背景点;
( c ) 判断数组 ^是否遍历完毕, 如是, 则进入步骤 (d), 否则, 转至步骤 (a) ;
( d) 再次遍历数组 Ρ, 将被标记为背景点的元素值设置为 0, 得到数组^。
②平滑边缘单元 122对数组 Α进行平滑边缘处理, 将处理后的数组记为数组 β。 平滑边缘处理的目的是使触摸点的边缘更加平滑。 本实施方式中, 平滑边缘处理采 用对数组 Α连续进行 N次膨胀操作, 所述 1 N 5, 优选 N=3。
如图 8所示, 平滑边缘处理的过程包括以下步骤:
( a) 依次遍历数组 A中的每个元素, 如果当前元素值为 0, 则继续遍历, 否则, 进 入步骤 (b ) ;
( b ) 将当前元素的四邻域元素全部标记为目标点; ( c ) 判断数组 A是否遍历完毕, 如是, 则进入步骤 (d), 否则, 转至步骤 (a) ;
( d) 再次遍历数组 A, 将被标记为目标点的元素值设置为 1, 得到数组 。
③轮廓细化单元 123对数组 Β进行轮廓细化处理, 将处理后的数组记为数组 C。 轮廓细化处理的目的是将触摸点区域的内部点去除, 只保留触摸点边缘。 如图 9所 示, 本实施方式中, 轮廓细化处理的过程包括以下步骤:
( a) 依次遍历数组 中的每个元素, 如果当前元素值为 0, 则继续遍历, 否则, 进 入步骤 (b ) ;
( b ) 判断当前元素的八邻域值, 如果全部为 1, 则表明当前元素表示触摸点轮廓的 内部点, 将当前元素标记为背景点; 否则, 标记为目标点;
( c ) 判断数组 是否遍历完毕, 如是, 则进入步骤 (d), 否则, 转至步骤 (a) ;
( d) 再次遍历数组 β, 将被标记为背景点的元素值设置为 0, 得到数组 ( 。
④提取单元 124对数组 C进行分割, 提取触摸点轮廓信息; 如果未获得触摸点轮廓, 则结束本次识别。
如图 10所示, 本实施方式中, 提取触摸点轮廓信息的过程包括以下步骤:
( a) 从下到上、 自左向右遍历数组 C; 如果当前元素为背景点 (即元素值为 0 ) 或 者已被遍历过, 或者当前元素的八邻域内有已被跟踪过的目标点, 或者当前元素的八邻 域内全部为背景点, 则跳过当前元素, 继续遍历; 否则, 当前元素为新触摸点轮廓的起 始点, 记录该起始轮廓点信息, 进入步骤 (b ) 进行单目标轮廓跟踪;
( b ) 从所述起始轮廓点开始, 沿左下方向进行扫描, 如果当前元素为目标点, 则记 录该目标点信息, 同时将扫描方向顺时针旋转 90度; 如果当前元素为背景点, 则将扫描 方向逆时针旋转 45度;
( c ) 从当前轮廓点开始, 继续按照步骤 (b ) 中所述的跟踪方式进行轮廓跟踪, 直 到当前边界点回到起始轮廓点;
( d) 判断数组 C是否遍历完毕, 如是, 则结束, 否则, 转至步骤 (a)。
⑤计算单元 125根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积, 将所述中 心坐标作为触摸点坐标, 轮廓面积作为触摸点面积。
轮廓的中心坐标可以采用但不限于下述方法计算: (a) 计算记录的所有轮廓点坐标 的平均值, 将该平均值作为轮廓的中心坐标; (b ) 计算轮廓内全部点的坐标的平均值, 将该平均值作为轮廓的中心坐标, 轮廓内全部点的坐标可通过轮廓边缘点的坐标得到。 显然, 利用轮廓内全部点的坐标计算的中心坐标更加精确。
轮廓面积可以采用但不限于下述方法计算: (a) 计算轮廓的外接矩形的面积, 将该 面积作为轮廓面积; (b ) 计算轮廓内包含的点的数量, 将该数量作为轮廓面积。 显然, 采用第二种方式计算的轮廓面积更加精确。
此时获取的触摸点坐标为数组中的坐标, 如需要可以根据触摸屏的尺寸与数组的尺 寸比例 M将该坐标转换为触摸屏坐标。
本实施方式中, 还包括对触摸点进行跟踪的步骤。 跟踪装置 13根据每个触摸点的轨 迹点与前面点的距离, 跟踪触摸点的运动。 例如, 假设在连续两次识别过程中, 第一次 识别出 5个触摸点, 分别为 7^、 Γ2、 Γ3、 Τ4、 Τ5, 第二次也识别 5个触摸点, 分别为 7V、 Τ2 '、 Γ3 '、 Τ4 '、 Τ5 '。 分别计算 TV 与 T 、 Τ2、 Γ3、 Τ4、 Γ5之间的距离, 将与 TV 距离 最近的点与 7V 作为一个运动轨迹上的两个点, 即这两点处在一个运动轨迹上。 采用同 样的方式判断 TV、 Γ3 '、 Γ4 '、 Τ5 Ό
实施方式 2
在实施方式 1 中, 每个步骤都是对整个数组进行处理的。 由于可以通过最初的光路 数据, 快速得到各个触摸点区域的大致位置, 因此可以先求取触摸点的粗略区域集合, 后续操作只针对这些区域进行。 这样处理速度会大大提高, 但基本思想与实施方式 1相 同。 具体过程如下:
首先, 生成与红外触摸屏尺寸成预设比例 Μ的初始数组, 其元素值均为 0。 根据光 路数据计算得到候选触摸点的粗略区域, 近似为一个个矩形区域。 为此, 如图 11所示, 本实施方式所述系统在实施方式 1的基础上增加触摸点区域确定装置 14。 如果根据光路 数据计算后没有得到候选触摸点区域, 则说明没有触摸点存在, 结束本次识别。
然后, 遍历初始数组中每个触摸点区域, 针对每个触摸点区域, 反推经过该区域的 所有光路, 合并相同光路, 根据光路确定数组中与该光路对应的元素值。
光路反推原理如图 12所示。 图 12中矩形、 圆形和菱形目标代表大小和形状不同的 触摸点区域, 以矩形物体为例, 经过反推得到经过此物体的起始光路和终止光路 (左侧 光路代表起始光路, 右侧光路代表终止光路), 生成数组过程中, 只判断和生成左侧和右 侧范围内的光路对应的数组元素值。 从图 12中可以看到, 经过矩形区域的部分光路同时 也经过圆形区域, 为了避免重复生成, 对所有区域的光路进行合并。
得到光路对应数组后, 后续处理与实施方式 1 基本相同, 差别仅仅在于实施方式 1 是对整个数组进行处理, 而本实施方式只对触摸点区域对应的数组进行处理。
实施方式 3
由于在一次识别过程中, 并非一定有触摸操作发生, 因此如果在一次识别过程中没 有发生触摸操作, 仍然按照实施方式 1或 2中所述方式进行一遍处理, 不仅没有必要, 而且会占用系统资源, 导致识别效率降低。
如图 13和 14所示, 本实施方式在实施方式 1或实施方式 2的基础上增加预判断装 置 15, 用于根据光路数据预先判断触摸点是否存在。 具体判断方法可以采用现有技术中 的任何一种方法, 此处不再赘述。
在一次识别过程中, 采集到光路数据后, 首先由预判断装置根据光路数据判断是否 存在触摸点。 如果不存在触摸点, 则结束本次识别; 如果存在触摸点, 再采用实施方式 1或实施方式 2中的方法识别触摸点。 这样能够避免不必要的识别处理, 提高识别效率。
显然, 本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神 和范围。 这样, 倘若本发明的这些修改和变型属于本发明权利要求及其同等技术的范围 之内, 则本发明也意图包含这些改动和变型在内。

Claims

权利要求书
1 . 一种红外触摸屏的多点识别方法, 其特征在于, 包括以下步骤:
生成与红外触摸屏在一次识别过程中光路对应的具有二维矩阵排列性质的数据结 构;
根据所述数据结构提取触摸点信息。
2. 如权利要求 1所述的红外触摸屏的多点识别方法, 其特征在于, 所述数据结构的 生成方法包括以下步骤:
采集红外触摸屏在一次识别过程中的光路数据;
生成与所述红外触摸屏尺寸成预设比例的初始数据结构, 将所述初始数据结构的所 有元素值初始化为第二设定数值;
根据所述光路数据判断每条光路是否被遮挡, 如果光路未被遮挡, 则将所述数据结 构中相应元素值标记为第一设定数值。
3. 如权利要求 1所述的红外触摸屏的多点识别方法, 其特征在于, 所述提取触摸点 信息的方法包括以下步骤:
对所述数据结构进行去噪处理, 将处理后的数据结构记为数据结构
对所述数据结构 A进行平滑边缘处理, 将处理后的数据结构记为数据结构 β;
对所述数据结构 进行轮廓细化处理, 将处理后的数据结构记为数据结构 C;
对所述数据结构 c进行分割, 提取触摸点轮廓信息; 如果未获得触摸点轮廓, 则结 束本次识别;
根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积, 将所述中心坐标作为触摸 点坐标, 轮廓面积作为触摸点面积。
4. 如权利要求 3所述的红外触摸屏的多点识别方法, 其特征在于, 所述去噪处理的 方法如下: 对所述数据结构连续进行 N次腐蚀操作, 所述 1 N 5。
5. 如权利要求 4所述的红外触摸屏的多点识别方法, 其特征在于, 所述腐蚀操作包 括以下步骤:
①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②;
②判断当前元素的四邻域元素值, 如果全部为第二设定数值, 则标记当前元素为目 标点, 否则, 标记为背景点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为背景点的元素值设置为第一设定数值。
6. 如权利要求 3所述的红外触摸屏的多点识别方法, 其特征在于, 所述平滑边缘处 理的方法如下: 对所述数据结构连续进行 N次膨胀操作, 所述 1 N 5。
7. 如权利要求 6所述的红外触摸屏的多点识别方法, 其特征在于, 所述膨胀操作包 括以下步骤:
①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②; ②将当前元素的四邻域元素全部标记为目标点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为目标点的元素值设置为第二设定数值。
8. 如权利要求 3所述的红外触摸屏的多点识别方法, 其特征在于, 所述轮廓细化处 理的方法包括以下步骤:
①依次遍历所述数据结构中的每个元素, 如果当前元素值为第一设定数值, 则继续 遍历, 否则, 进入步骤②;
②判断当前元素的八邻域值, 如果全部为第二设定数值, 则将当前元素标记为背景 点; 否则, 标记为目标点;
③判断所述数据结构是否遍历完毕, 如是, 则进入步骤④, 否则, 转至步骤①;
④再次遍历所述数据结构, 将被标记为背景点的元素值设置为第一设定数值。
9. 如权利要求 3所述的红外触摸屏的多点识别方法, 其特征在于, 所述提取触摸点 轮廓信息的方法包括以下步骤:
①从下到上、 自左向右遍历所述数据结构; 如果当前元素为背景点或者已被遍历过, 或者当前元素的八邻域内有已被跟踪过的目标点, 或者当前元素的八邻域内全部为背景 点, 则跳过当前元素, 继续寻找; 否则, 当前元素为新触摸点轮廓的起始点, 记录该起 始轮廓点信息, 进入步骤②进行单目标轮廓跟踪;
②从所述起始轮廓点开始, 沿左下方向进行扫描, 如果当前元素为目标点, 则记录 该目标点信息, 同时将扫描方向顺时针旋转 90度; 如果当前元素为背景点, 则将扫描方 向逆时针旋转 45度;
③从当前轮廓点开始, 继续按照步骤②中所述的跟踪方式进行轮廓跟踪, 直到当前 边界点回到起始轮廓点;
④判断所述数据结构是否遍历完毕, 如是, 则结束, 否则, 转至步骤①。
10. 如权利要求 1~9中任一项所述的红外触摸屏的多点识别方法, 其特征在于: 在 一次识别过程中, 首先根据光路数据判断红外触摸屏上是否存在触摸点; 如果不存在触 摸点, 则结束本次识别。
11. 如权利要求 1~9 中任一项所述的红外触摸屏的多点识别方法, 其特征在于: 在 一次识别过程中, 首先根据光路数据判断触摸点所在区域; 如果存在触摸点区域, 则对 所述触摸点所在区域生成与所述区域中光路对应的具有二维矩阵排列性质的数据结构, 再进行后续识别处理; 如果不存在触摸点区域, 则结束本次识别。
12. 如权利要求 1~9中任一项所述的红外触摸屏的多点识别方法, 其特征在于: 在 一次识别过程中, 首先根据光路数据判断红外触摸屏上是否存在触摸点; 如果存在触摸 点, 则继续根据光路数据判断触摸点所在区域, 对所述触摸点所在区域生成与所述区域 中光路对应的具有二维矩阵排列性质的数据结构, 再进行后续识别处理; 如果不存在触 摸点, 则结束本次识别。
13. 如权利要求 1~9中任一项所述的红外触摸屏的多点识别方法, 其特征在于: 在 获得触摸点信息后, 还包括根据每个触摸点的轨迹点与前面点的距离, 跟踪触摸点运动 的步骤。
14. 一种红外触摸屏的多点识别系统, 其特征在于: 所述系统包括用于生成与红外 触摸屏在一次识别过程中光路对应的具有二维矩阵排列性质的数据结构的数据结构生成 装置 (11 ) ;
用于在所述数据结构中提取触摸点信息的触摸点信息提取装置 (12)。
15. 如权利要求 14所述的红外触摸屏的多点识别系统, 其特征在于: 所述数据结构 生成装置 (11 ) 包括用于采集红外触摸屏在一次识别过程中光路数据的采集单元 (111 ) ; 用于生成与所述红外触摸屏尺寸成预设比例的初始数据结构, 并将所述初始数据结 构的所有元素值初始化为第二设定数值的初始数据结构生成单元 (112) ;
用于根据所述光路数据判断每条光路是否被遮挡, 如果光路未被遮挡, 则将所述数 据结构中相应元素值设置为第一设定数值的数据结构元素值确定单元 (113 )。
16. 如权利要求 14所述的红外触摸屏的多点识别系统, 其特征在于: 所述触摸点信 息提取装置 (12 ) 包括用于对所述数据结构进行去噪处理的去噪单元 (121 ), 将处理后 的数据结构记为数据结构
用于对所述数据结构 A进行平滑边缘处理的平滑边缘单元 (122), 将处理后的数据 结构记为数据结构 ;
用于对所述数据结构 进行轮廓细化处理的轮廓细化单元 (123 ), 将处理后的数据 结构记为数据结构 C;
用于对所述数据结构 C进行分割, 提取触摸点轮廓信息的提取单元 (124 ) ;
用于根据所述轮廓信息计算各个轮廓的中心坐标和轮廓面积的计算单元 (125 )。
17. 如权利要求 14~16中任一项所述的红外触摸屏的多点识别系统, 其特征在于: 所述系统还包括用于根据光路数据确定触摸点所在区域的触摸点区域确定装置(14) ; 所 述数据结构生成装置 (11 ) 用于对所述触摸点所在区域生成与所述区域中光路对应的具 有二维矩阵排列性质的数据结构。
18. 如权利要求 14~16中任一项所述的红外触摸屏的多点识别系统, 其特征在于: 所述系统还包括用于根据光路数据判断红外触摸屏上是否存在触摸点的预判断装置
( 15 )。
19. 如权利要求 14~16中任一项所述的红外触摸屏的多点识别系统, 其特征在于: 所述系统还包括用于根据光路数据判断红外触摸屏上是否存在触摸点的预判断装置
( 15 ); 用于根据光路数据确定触摸点所在区域的触摸点区域确定装置 (14) ; 所述数据 结构生成装置 (11 ) 用于对所述触摸点所在区域生成与所述区域中光路对应的具有二维 矩阵排列性质的数据结构。
20. 如权利要求 14~16中任一项所述的红外触摸屏的多点识别系统, 其特征在于: 所述系统还包括用于根据每个触摸点的轨迹点与前面点的距离跟踪触摸点运动的触摸点 跟踪装置 (13 )。
PCT/CN2012/077823 2011-08-03 2012-06-29 一种红外触摸屏的多点识别方法及系统 WO2013016995A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110221824.8 2011-08-03
CN201110221824.8A CN102419664B (zh) 2011-08-03 2011-08-03 一种红外触摸屏的多点识别方法及系统

Publications (1)

Publication Number Publication Date
WO2013016995A1 true WO2013016995A1 (zh) 2013-02-07

Family

ID=45944098

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/077823 WO2013016995A1 (zh) 2011-08-03 2012-06-29 一种红外触摸屏的多点识别方法及系统

Country Status (2)

Country Link
CN (1) CN102419664B (zh)
WO (1) WO2013016995A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102419664B (zh) * 2011-08-03 2014-04-02 北京汇冠新技术股份有限公司 一种红外触摸屏的多点识别方法及系统
CN103034440A (zh) * 2012-12-05 2013-04-10 北京小米科技有限责任公司 一种识别手势指令的方法及装置
CN103092439B (zh) * 2013-02-21 2015-06-10 盐城工学院 一种改进的红外交互触点识别方法
CN106502476B (zh) * 2016-11-04 2019-10-01 青岛海信电器股份有限公司 红外触摸屏多点触摸识别方法和装置
CN110942445B (zh) * 2019-10-16 2024-01-12 深圳市天英联合科技股份有限公司 红外触摸屏的触点识别方法、装置、终端设备及存储介质
CN113126795B (zh) * 2019-12-31 2022-08-19 青岛海信商用显示股份有限公司 一种触控显示装置的触控识别方法及相关设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727245A (zh) * 2008-10-15 2010-06-09 北京京东方光电科技有限公司 多点触摸定位方法及多点触摸屏
US20100207909A1 (en) * 2009-02-13 2010-08-19 Ming-Cho Wu Detection module and an optical detection device comprising the same
CN102053757A (zh) * 2009-11-05 2011-05-11 上海精研电子科技有限公司 一种红外触摸屏装置及其多点定位方法
CN102419664A (zh) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 一种红外触摸屏的多点识别方法及系统
CN102419663A (zh) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 一种红外触摸屏多点识别方法及系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101876869A (zh) * 2009-04-30 2010-11-03 鸿富锦精密工业(深圳)有限公司 电子装置及控制电子装置进行输入的方法
CN101995997A (zh) * 2009-08-21 2011-03-30 厦门信烨联动传媒有限公司 一种多点红外线触摸屏及其触摸定位方法
CN101859209A (zh) * 2010-05-28 2010-10-13 程宇航 红外线检测装置和方法、红外线输入装置以及图形用户设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101727245A (zh) * 2008-10-15 2010-06-09 北京京东方光电科技有限公司 多点触摸定位方法及多点触摸屏
US20100207909A1 (en) * 2009-02-13 2010-08-19 Ming-Cho Wu Detection module and an optical detection device comprising the same
CN102053757A (zh) * 2009-11-05 2011-05-11 上海精研电子科技有限公司 一种红外触摸屏装置及其多点定位方法
CN102419664A (zh) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 一种红外触摸屏的多点识别方法及系统
CN102419663A (zh) * 2011-08-03 2012-04-18 北京汇冠新技术股份有限公司 一种红外触摸屏多点识别方法及系统

Also Published As

Publication number Publication date
CN102419664B (zh) 2014-04-02
CN102419664A (zh) 2012-04-18

Similar Documents

Publication Publication Date Title
CN102096530B (zh) 一种多点触摸轨迹跟踪方法
CN106575170B (zh) 在触摸敏感设备中执行触摸动作的方法
WO2013016995A1 (zh) 一种红外触摸屏的多点识别方法及系统
US7916126B2 (en) Bottom-up watershed dataflow method and region-specific segmentation based on historic data to identify patches on a touch sensor panel
WO2013016996A1 (zh) 一种红外触摸屏多点识别方法及系统
US20130050076A1 (en) Method of recognizing a control command based on finger motion and mobile device using the same
WO2012171457A1 (zh) 一种红外触摸屏的多点识别方法及系统
KR20100138602A (ko) 실시간으로 피사체의 손을 검출하기 위한 장치 및 방법
CN106155540B (zh) 电子毛笔笔形处理方法和装置
JP2010218232A (ja) 対象物追跡装置
CN108255352B (zh) 一种投影交互系统中多点触摸实现方法及系统
US9971429B2 (en) Gesture recognition method, apparatus and device, computer program product therefor
CN109933276A (zh) 一种基于触摸大屏电子白板手写笔迹中手袖误触的判定方法
CN105205786A (zh) 一种图像深度恢复方法及电子设备
CN109871178A (zh) 一种基于图像识别的虚拟触摸屏系统
KR101683194B1 (ko) 깊이 영상에서 가장자리 쌍 기반의 손 추적 방법
CN104992161B (zh) 一种基于部件识别的汉字部件分割与结构判定方法
Wong et al. Virtual touchpad: Hand gesture recognition for smartphone with depth camera
KR101683189B1 (ko) 깊이 영상에서 가장자리 쌍 기반의 객체 검출 방법
TWI474234B (zh) 觸控板之多點定位方法
US20170090676A1 (en) Learning method and information processing apparatus
TWI507919B (zh) 追蹤與記錄指尖軌跡的影像處理方法
CN202404557U (zh) 一种基于图像处理技术的虚拟触摸屏系统
JP2001126027A (ja) ナンバープレート認識装置
CN106095183B (zh) 触摸轨迹跟踪方法、装置及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12820341

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12820341

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 09/04/2014)

122 Ep: pct application non-entry in european phase

Ref document number: 12820341

Country of ref document: EP

Kind code of ref document: A1