WO2023179694A1 - 一种基于纹理识别的差异触控方法 - Google Patents

一种基于纹理识别的差异触控方法 Download PDF

Info

Publication number
WO2023179694A1
WO2023179694A1 PCT/CN2023/083220 CN2023083220W WO2023179694A1 WO 2023179694 A1 WO2023179694 A1 WO 2023179694A1 CN 2023083220 W CN2023083220 W CN 2023083220W WO 2023179694 A1 WO2023179694 A1 WO 2023179694A1
Authority
WO
WIPO (PCT)
Prior art keywords
texture
touch
electronic device
information
finger
Prior art date
Application number
PCT/CN2023/083220
Other languages
English (en)
French (fr)
Inventor
申昊
Original Assignee
杭州悉晓信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州悉晓信息技术有限公司 filed Critical 杭州悉晓信息技术有限公司
Publication of WO2023179694A1 publication Critical patent/WO2023179694A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the invention belongs to the field of information interaction technology and relates to a differential touch method based on texture recognition.
  • touch methods include the home button, power button, function keys on the back of the fuselage, part of the touch screen and/or lower sensor, part function keys, touch pad, etc.; the information interaction process between existing touch methods and electronic devices is relatively simple. , generally only generates one user event, and occasionally only has two instructions (for example, Huawei's mobile phone systems in 2020 and later, click the screen quickly and continuously to generate a screenshot function).
  • the mouse serves as an information input medium, and clicking different keys in a specific place will Produce a variety of instructions (for example, clicking "Computer” in the Windows 7 operating system, left-clicking once is to select “Computer”, clicking the left-clicking button twice in succession is to open “Computer”, and clicking the right-clicking button is to expand "Computer” property interface), this design is very in line with the development trend of the times and can adapt to user needs, so almost all mice today have at least three command keys (left-click key, right-click key, and middle key).
  • the purpose of the present invention is to propose a differential touch method based on texture recognition in order to solve the problem of weak functionality caused by the single instruction input form of the existing touch method.
  • the invention includes the following processes:
  • Step (1) Select the transmission component and the electronic device with texture recognition function, and connect the transmission component with the telecommunications signal of the electronic device;
  • Step (2) Select information carriers with different textures, and match the different textures of the information carrier with the texture identification information of the transmission piece, so that when different textures touch or touch the transmission piece, an independent signal will be generated;
  • Step (3) When any one or more information carriers touch or touch the information receiving point of the delivery piece, the delivery piece collects the texture on each information carrier and performs matching:
  • the transfer part When the texture information collected by the transfer part matches the texture identification information in the transfer part/electronic device, the transfer part generates corresponding signals respectively and sends them to the electronic device;
  • the transfer part When the texture information collected by the transfer part does not match the texture identification information in the transfer part/electronic device, the transfer part generates a corresponding signal and sends it to the electronic device;
  • the transmitter When there is no texture input, the transmitter generates a corresponding signal and sends it to the electronic device;
  • Step (4) The electronic device executes the corresponding instruction or instruction sequence according to the signal content, the software and hardware status of the electronic device, the user's transmission input and/or the touch input of the touch screen.
  • the transmission member is a touch screen with a texture recognition function
  • the touch input is input by the transmission member.
  • the signals include empty signals and real signals; the instructions include empty instructions and real instructions with execution functions, and the instruction sequences include empty instruction sequences and real instruction sequences with execution functions.
  • the electronic device includes a multimedia device equipped with one or more of text, sound, image, animation, and video for interactive functions.
  • a multimedia device equipped with one or more of text, sound, image, animation, and video for interactive functions.
  • the information carrier is one or any combination of one or more of the human body's finger prints, a finger cot with textures on its end, and a touch pen with textures on its end.
  • the information carrier is the finger fingerprint of the human body, and the texture recognition function of the transfer member is the finger fingerprint recognition function; different fingerprints are entered and recorded through the transfer member; when the information receiving part of the transfer member is touched or touched, the information is transferred
  • the component collects fingerprints, matches the collected fingerprints with the fingerprints recorded in the transmission component, generates corresponding signals and sends them to the electronic device.
  • the texture recognition function of the transfer part can also be a finger fingerprint part identification/classification function; when the information receiving part of the transfer part is touched or touched, the fingerprint image collected by the transfer part distinguishes the finger part, generates a corresponding signal and sends to electronic devices.
  • the information carrier is a finger cot worn on human fingers.
  • the end of the finger cot has texture.
  • the texture information on the finger cot is entered and recorded through the transmission piece; the information receiving part of the transmission piece is touched or touched.
  • the collected finger cuff texture is matched with the finger cuff texture recorded in the transmission part, and a corresponding signal is generated and sent to the electronic device.
  • the different textures are respectively provided on different finger cots or multiple textures are provided on different parts of the same finger cot.
  • the information carrier is a touch pen, the end of the touch pen has texture, and the texture information of the end of the touch pen is entered and recorded through the transmission piece; when the information receiving part of the transmission piece is touched or touched, the current touch is collected through the transmission piece After detecting the texture of the pen end, the collected texture of the touch pen end is matched with the texture of the touch pen end recorded in the transmission piece, and a corresponding signal is generated and sent to the electronic device.
  • the transfer member is any one or a combination of a home button, a power button, a function key on the back of the fuselage, a partial touch screen and/or a sensor below, a part function key, a touch screen, and a touch pad with a texture recognition function.
  • this method changes the form of traditional transmission parts that can only output a single signal, and combines the original touch operation with texture recognition, so that electronic devices in the same software and hardware state can detect different textures at the same position.
  • the touch will make different responses, increasing the dimension of touch; using multiple information carriers to transmit multiple signal functions enriches the means of interaction between people and electronic devices.
  • Figure 1 is a flow chart of an implementation manner of Embodiment 1.
  • a touch panel is selected, and the touch panel is replaced by one or more of the Home button, the power button, the function keys on the back of the fuselage, part of the touch screen and/or the sensor under the touch screen, the part function keys, and the touch screen. Both combinations achieve the same effect.
  • the information carrier is the finger fingerprint of the human body, and the texture recognition function of the touch panel is the finger fingerprint recognition function; different fingerprints are entered and recorded through the touch panel; when the information receiving part of the touch panel is touched or touched, the The board collects finger fingerprints, matches the collected finger fingerprints with those recorded in the touch pad, generates corresponding signals and sends them to the electronic device.
  • Fingerprint recognition is achieved by building a fingerprint library, and all fingerprints are entered into the touch panel or electronic device through the touch panel.
  • the touch panel collects the currently input fingerprints and matches them:
  • the transfer part When the texture information collected by the transfer part matches the texture identification information in the transfer part/electronic device, the transfer part generates corresponding signals respectively and sends them to the electronic device;
  • the transfer part When the texture information collected by the transfer part does not match the texture identification information in the transfer part/electronic device, the transfer part generates a corresponding signal and sends it to the electronic device;
  • the touch pad when there is no texture input, the touch pad generates corresponding signals and sends them to the electronic device;
  • partial fingerprints mean that fingerprints on different parts of the finger (such as fingertips, fingertips, etc.) are registered as separate textures; full fingerprints mean that fingerprints on the entire finger are registered as the same texture.
  • the electronic device executes corresponding instructions or instruction sequences based on the signal content, the software and hardware status of the electronic device, and/or the touch panel input input by the user.
  • the fingerprint recognition algorithm (such as template matching algorithm) used by the fingerprint recognition function will classify fingerprints according to three basic fingerprint types (kei-shaped, bucket-shaped or arc-shaped) when registering/entering fingerprints, and draw the specific details of tiny patterns. , check the subtle differences in grain directions caused by pores and edge structures, and generate a fingerprint template in the form of a mathematical representation based on the above fingerprint features; when identifying fingerprints, the fingerprint sensor will collect the fingerprint features in the fingerprint image again to create a mathematical representation of the collected fingerprints form, matching the registered fingerprint template.
  • three basic fingerprint types kei-shaped, bucket-shaped or arc-shaped
  • the texture recognition function of the touch panel can also be a finger fingerprint part identification/classification function; when the information receiving point of the touch panel is touched or touched, the touch panel collects the fingerprint image and distinguishes the finger part, and generates corresponding signals respectively. Sent to electronic device. The electronic device executes corresponding instructions or instruction sequences based on the signal content, the software and hardware status of the electronic device, and/or the touch panel input input by the user.
  • the fingerprint image can be abstracted into a set of concentric ellipses with different radii.
  • the ellipse at the fingertip has a larger radius and smaller curvature, and the ellipse at the fingertip has a smaller radius and larger curvature.
  • the conclusion that "the curvature at the fingertip is smaller and the curvature at the fingertip is larger" is also true. Therefore, only by calculating the fingerprint collected by the touch panel
  • the average curvature of the main fingerprint lines in the fingerprint image can distinguish the fingertips and fingertips without the need to record fingerprints in advance, achieving the same human-computer interaction effect.
  • fingerprint recognition algorithms using template matching algorithms often need to collect several feature points and compare them with fingerprint templates containing dozens of them; finger fingerprint part recognition/classification algorithms only need to collect and compare fingerprint images.
  • the curvature feature or a few features reduce the matching time and improve the recognition efficiency.
  • the fingerprint part recognition/classification algorithm only divides fingerprints into two or a few categories, the degree of derivability of its instructions is smaller than that of the fingerprint recognition algorithm, which can derive more instructions.
  • the fingertips and finger pulps of different fingers can also be registered as different textures, thus integrating multiple interactive options on one finger like the finger fingerprint part recognition/classification algorithm without switching fingers. Complete input of multiple interactive options. At the same time, more interaction options can be provided.
  • the information carrier is a finger cot worn on human fingers.
  • the end of the finger cot has texture.
  • the texture information on the finger cot is input and recorded through the touch pad; the information receiving point of the touch pad is touched or touched.
  • the collected finger cuff texture is matched with the finger cuff texture recorded in the touch pad, and a corresponding signal is generated and sent to the electronic device.
  • the electronic device executes corresponding instructions or instruction sequences based on the signal content, the software and hardware status of the electronic device, and/or the touch panel input input by the user.
  • the different textures are respectively provided on different finger cots or multiple textures are provided on different parts of the same finger cot.
  • This finger cot can also have a two-segment/multi-segment structure.
  • the texture of the fingertips on the fingertips is different from the texture of the fingertips on the fingertips, thus achieving the feature of "complete input of multiple interactive options without switching fingers.”
  • the information carrier is a touch pen, the end of the touch pen has texture, and the texture information on the end of the touch pen is input and recorded through the touch pad; when the information receiving point of the touch pad is touched or touched, the current touch is collected through the touch pad. After detecting the texture of the pen end, the collected texture of the touch pen end is matched with the texture of the touch pen end recorded in the touch panel, and a corresponding signal is generated and sent to the electronic device.
  • the electronic device executes corresponding instructions or instruction sequences based on the signal content, the software and hardware status of the electronic device, and/or the touch panel input input by the user.
  • the two ends of the touch pen have two different textures.
  • the two instructions obtained after matching the texture information recorded on the touch pad with the textures on both ends of the touch pen are: open and switch to the next execution command, and go back and switch to. The execution command of the previous step.
  • the textures described below include fingerprints, textures on fingertips, and textures on touch pens.
  • the first instruction/instruction sequence is executed; when the input texture collected by the delivery component is not the specified texture, the second instruction/instruction sequence is executed.
  • n is less than or equal to m.
  • the electronic device executes the m+1th instruction or instruction sequence.
  • the delivery piece is a touchpad that supports texture recognition in all touch areas
  • the first command is expressed as a brush tool
  • the second command is expressed as an eraser tool
  • the third command is expressed as a selection tool.
  • the texture collected through the transmission piece determines the working status of the touch operation; it is usually a two-hand operation, with one hand used as the information carrier and the other hand used as the touch input of the touch screen.
  • the software when the index finger of the left hand touches the transmission part (the transmission part collects the fingerprint of the index finger), the software is in the "erase execution” state; when the middle finger of the left hand touches the transmission part (the transmission part collects the fingerprint of the middle finger), the software is in the “erase execution” state. "Perspective switching execution” state; when the drawing software is not in the “erasure execution” and “perspective switching execution” states, it is in the "drawing execution” state.
  • Form 4 Use form 1, form 2, and form 3 together.
  • Form 5 Based on form 4, combined with other touch methods:
  • texture A The specified texture in form 1 is abbreviated as texture A, and the texture that is not a specified texture is abbreviated as texture non-A.
  • Texture A+click corresponds to command 1
  • texture non-A+click corresponds to command 2
  • texture A+double-click corresponds to command 3
  • texture non-A+double-click corresponds to command 4;
  • Another example is the combination of force sensitivity, texture A/non-A combination with light press and heavy hit, etc.
  • Another example is the form of matching sliding detection:
  • the effect is equivalent to pressing a virtual button.
  • the moving direction of the information carrier on the touchpad is detected and / Or move a distance that is equivalent to pushing a virtual/analog stick a certain amount in a certain direction and / or pressing a linear trigger with varying amounts of force.
  • This enables the touchpad to be implemented as a multi-function button, virtual joystick and/or linear trigger.
  • the sliding detection function can be realized by continuously collecting fingerprint images and comparing the offsets between the images. For example, modern optical mice use the same principle to convert the movement of the mouse on the mouse pad/other textured surfaces. for the movement of the cursor on the screen.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明提供了一种基于纹理识别的差异触控方法，属于信息交互技术领域。本发明选取具有纹理识别功能的传递件和电子设备，具有不同纹理的信息载体；将信息载体的不同纹理与传递件的纹理识别信息对应匹配，使不同的纹理触摸或触碰传递件时均会产生一种独立的信号；任意一个或多个信息载体对传递件的信息接收处进行触摸或触碰时，传递件采集每个信息载体上的纹理，并进行匹配；根据匹配结果，传递件产生对应的信号并发送给电子设备；电子设备根据信号内容、电子设备的软硬件状态和/或用户输入的传递件输入，执行相应的指令或指令序列。本方法解决了现有的触控方式指令输入形式单一导致功能性不强的问题，丰富了人与电子设备的交互手段。

Description

一种基于纹理识别的差异触控方法 技术领域
本发明属于信息交互技术领域，涉及一种基于纹理识别的差异触控方法。
 背景技术
当今年代是信息多元化的年代，大数据、多媒体、人工智能是时代发展的主题趋势，然而它们都离不开一个重要的关键因素，那就是信息交互过程。
何为信息交互过程，例如：人们在使用电子设备(比如手机或平板)电脑的过程中，通过触摸屏将手指按在指令的位置，那么人体就会传递给该设备信息，使其按照人体意愿进行下一步的信息反馈。在这个过程中，人体通过手指按在指令的位置，这就是人体主动发给设备的信息交互；而设备按照人体意愿进行下一步的信息反馈的过程，就是设备主动发送给人体的信息交互。
随着移动平台的逐步发展，智能手环、智能手表等小尺寸便携设备兴起（便携设备小型化），智能手机、平板电脑等便携设备越来越多的承担起个人电脑的功能（便携设备多功能化）。智能手环、智能手表等小尺寸设备更小的屏幕限制了触控的顺利进行，智能手机、平板电脑等便携设备所采用的触控等操作方式也越来越难以满足便携设备日益增长的、实现更多功能的需要。
常用的触控方式有Home键、电源键、机身背部功能键、部分触摸屏和/或下方传感器、部位功能键、触摸板等；现有的触控方式人和电子设备的信息交互过程较为单一，普遍来说只会产生一种用户事件，偶尔也只会具有两种指令（例如华为2020年及其之后的手机系统，快速的连续点一下屏幕，会产生截屏功能）。
这就好比最早的鼠标仅仅只有一个点击键一样，在特定的地方点击后只会产生一种用户事件；但是随着时代发展，如今鼠标却拥有了多个键（例如左击键、右击键、中键，有些高端鼠标的两侧边还会具有回退键、前进键等等），那么在这种情况下，鼠标作为一个信息输入媒介，在特定的地方进行不同键位的点击就会产生多种指令（比如Windows7操作系统中点击“计算机”一样，点一下左击键是选中“计算机”，连续迅速的点两下左击键是打开“计算机”，而点一下右击键是展开“计算机”的属性界面），这样的设计十分符合时代发展潮流并能够顺应用户使用需求，所以当今年代几乎所有的鼠标至少都会具有三个指令键（左击键、右击键、中键）。
因此，提出了一种基于纹理识别的差异触控方法，基于现有的触控方式将人与电子设备信息交互指令进行多元化处理，以此来提高电子设备的功能性。
 发明内容
本发明的目的是针对现有的触控方式指令输入形式单一导致功能性不强的问题，提出一种基于纹理识别的差异触控方法。
本发明包括以下过程：
步骤(1)：选取具有纹理识别功能的传递件和电子设备，并将传递件与电子设备的电信信号连接；
步骤(2)：选取具有不同纹理的信息载体，将信息载体的不同纹理与传递件的纹理识别信息对应匹配，使不同的纹理触摸或触碰传递件时均会产生一种独立的信号；
步骤(3)：任意一个或多个信息载体对传递件的信息接收处进行触摸或触碰时，传递件采集每个信息载体上的纹理，并进行匹配：
在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息匹配的情况下，传递件分别产生对应的信号并发送给电子设备；
在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息均不匹配的情况下，传递件产生对应的信号并发送给电子设备；
当没有纹理输入时，传递件产生对应的信号并发送给电子设备；
步骤(4)：电子设备根据信号内容、电子设备的软硬件状态、用户输入的传递件输入和/或触摸屏的触摸输入，执行相应的指令或指令序列。
特别的，当传递件为具有纹理识别功能的触摸屏时，触摸输入由传递件输入。
所述的信号包括空信号和实信号；所述的指令包括空指令和具有执行功能的实指令，指令序列包括空指令序列和具有执行功能的实指令序列。
所述的电子设备包括搭载了文本、声音、图像、动画、影片中的一种或多种以进行互动功能的多媒体设备。如：智能手环、智能手表、手机、计算机、平板电脑、车载平板。
所述的信息载体为人体的手指指纹、端部具有纹路的指套、端部具有纹路的触摸笔中的一种或多种的任意组合。
所述的信息载体为人体的手指指纹，所述传递件的纹理识别功能为手指指纹识别功能；通过传递件录入并记录不同的指纹；对传递件的信息接收处进行触摸或触碰时，传递件采集手指指纹，将采集的手指指纹与传递件中记录的手指指纹进行匹配，产生相应的信号并发送给电子设备。
所述传递件的纹理识别功能还可以为手指指纹部位识别/分类功能；对传递件的信息接收处进行触摸或触碰时，传递件采集的指纹图像并分辨手指部位，产生相应的信号并发送给电子设备。
所述的信息载体为用于戴在人体手指上的指套，指套的端部具有纹路，通过传递件录入并记录指套上的纹路信息；对传递件的信息接收处进行触摸或触碰时，通过传递件采集当前指套纹路后，将采集的指套纹路与传递件中记录的指套纹路进行匹配，产生相应的信号并发送给电子设备。
所述不同的纹路分别设置在不同的指套上或将多个纹路设置在同一指套的不同部位。
所述的信息载体为触摸笔，触摸笔的端部具有纹路，通过传递件录入并记录触摸笔端部的纹路信息；对传递件的信息接收处进行触摸或触碰时，通过传递件采集当前触摸笔端部的纹路后，将采集的触摸笔端部的纹路与传递件中记录的触摸笔端部的纹路进行匹配，产生相应的信号并发送给电子设备。
所述的传递件为具有纹理识别功能的Home键、电源键、机身背部功能键、部分触摸屏和/或下方传感器、部位功能键、触摸屏、触摸板中的任意一种或几种的组合。
与现有技术相比，本方法改变了传统的传递件只能输出单一信号的形式，将原有触摸操作与纹理识别相结合，使得同一软硬件状态下的电子设备对同一位置下的不同纹理的触摸，会做出不同的相应，增加了触控的维度；以多个信息载体来传递多种信号功能，丰富了人与电子设备的交互手段。
 附图说明
图1为实施例1一种实现方式的流程图。
 具体实施方式
以下对本发明的技术方案作进一步的描述，但本发明并不限于这些实施例。
为便于描述本实施例中传递件选用触摸板，将触摸板替换为Home键、电源键、机身背部功能键、部分触摸屏和/或触摸屏下方传感器、部位功能键、触摸屏中一种或多种组合均可实现相同的效果。
实施例1
所述的信息载体为人体的手指指纹，所述触摸板的纹理识别功能为手指指纹识别功能；通过触摸板录入并记录不同的指纹；对触摸板的信息接收处进行触摸或触碰时，触摸板采集手指指纹，将采集的手指指纹与触摸板中记录的手指指纹进行匹配，产生相应的信号并发送给电子设备。
如图1所示，具体过程如下：
通过构建指纹库实现指纹识别，通过触摸板将所有的指纹录入到触摸板或电子设备中，触摸板采集当前输入的指纹，并对其进行匹配：
①在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息匹配的情况下，传递件分别产生对应的信号并发送给电子设备；
②在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息均不匹配的情况下，传递件产生对应的信号并发送给电子设备；
特别的，当没有纹理输入时，触摸板产生对应的信号并发送给电子设备；
其中，部分指纹，意味着将手指不同部位（如指尖、指腹等）的指纹注册为单独的纹理；全部指纹，意味着将整个手指的指纹注册为同一个纹理。
电子设备根据信号内容、电子设备的软硬件状态和/或用户输入的触摸板输入，执行相应的指令或指令序列。
指纹识别功能采用的指纹识别算法（如模板匹配算法）会在注册/录入指纹时，根据三种基本指纹类型（箕形纹、斗形纹或弧形纹）将指纹分类，绘制微小纹路的具体细节，检查因毛孔和边缘结构造成的纹路方向细微差异，并以上述指纹特征生成数学表示形式的指纹模板；在识别指纹时，指纹传感器将再次采集指纹图像中的指纹特征，创建采集指纹的数学表示形式，与注册的指纹模板匹配。
所述触摸板的纹理识别功能还可以为手指指纹部位识别/分类功能；对触摸板的信息接收处进行触摸或触碰时，触摸板采集的指纹图像并分辨手指部位，分别产生相应的信号并发送给电子设备。电子设备根据信号内容、电子设备的软硬件状态和/或用户输入的触摸板输入，执行相应的指令或指令序列。
例如，对于斗形纹形的指纹，其指纹图像可以抽象为一组半径不同的同心椭圆，指尖处椭圆半径更大，曲率更小，指腹处的椭圆半径更小，曲率更大。对于绝大多数的手指指纹（箕形、斗形、双斗形），“指尖处的曲率更小，指腹处的曲率更大”这一结论同样成立，因此，仅通过计算触摸板采集的指纹图像中指纹主要纹线的平均曲率，即可分辨指尖与指腹，无需提前录入指纹，实现同样的人机交互效果。
在识别效率上，采用模板匹配算法的指纹识别算法往往需要采集数个特征点，并与含有数十个的指纹模板进行比对；手指指纹部位识别/分类算法仅需采集与比对指纹图像的曲率特征这一个或少数几个特征，减少了匹配时间，提高了识别效率。
但由于手指指纹部位识别/分类算法仅把指纹分成了两类或少数几类，其指令的可衍生程度小于指纹识别算法，指纹识别算法能衍生出更多的指令。
采用指纹识别算法时，也可将不同手指的指尖、指腹注册为不同的纹理，从而像手指指纹部位识别/分类算法一样，在一根手指上集成多个交互选项，无需切换手指即可完成多个交互选项的输入。同时，也能提供更多的交互选项。
实施例2
所述的信息载体为用于戴在人体手指上的指套，指套的端部具有纹路，通过触摸板录入并记录指套上的纹路信息；对触摸板的信息接收处进行触摸或触碰时，通过触摸板采集当前指套纹路后，将采集的指套纹路与触摸板中记录的指套纹路进行匹配，产生相应的信号并发送给电子设备。电子设备根据信号内容、电子设备的软硬件状态和/或用户输入的触摸板输入，执行相应的指令或指令序列。
所述不同的纹路分别设置在不同的指套上或将多个纹路设置在同一指套的不同部位。
这种形式，比较切合目前技术的实际，因为指套在出厂后与触摸屏的信息匹配是完全固定的，它们必然会获得一个较好的调试，所以在调试完全后必然就会具备良好的匹配性。并且，由于编制指套的纹理是规则的，所以识别指套会比指纹容易，相对于录入人体指纹的形式，它的识别效率会更好，有较高的实用性。
这种指套也可以具有两段/多段的结构。例如，指尖处指套的纹路与指腹处指套纹路不同，从而实现“无需切换手指即可完成多个交互选项的输入”的特性。
实施例3
所述的信息载体为触摸笔，触摸笔的端部具有纹路，通过触摸板录入并记录触摸笔端部的纹路信息；对触摸板的信息接收处进行触摸或触碰时，通过触摸板采集当前触摸笔端部的纹路后，将采集的触摸笔端部的纹路与触摸板中记录的触摸笔端部的纹路进行匹配，产生相应的信号并发送给电子设备。电子设备根据信号内容、电子设备的软硬件状态和/或用户输入的触摸板输入，执行相应的指令或指令序列。
触摸笔的两端分别具有两种不同的纹路，触摸板记载的纹理信息与触摸笔两端的纹路匹配后得到的2种指令分别为：打开与切换到下一步的执行命令、回退与切换到上一步的执行命令。
实施例4
为实施1~3的任意组合，采用多种信息载体作为输入。
采用上述实施例所述的方法，对于如何具体使用各种命令形式，列举例如以下几种形式的人机交互：
在不同的系统或应用中，具体的指令和指令序列由其开发者/用户指定。
下述纹理包括指纹、指套上的纹路和触摸笔上的纹路。
形式1：
当传递件采集到的输入纹理为指定纹理时，执行第一指令/指令序列；当传递件采集到的输入纹理不为指定纹理时，执行第二指令/指令序列。
形式2：
假设传递件/电子设备中记录着m个纹理。
当传递件采集到的输入纹理为第n个指令或指令序列对应的纹理时，电子设备执行第n指令或指令序列。其中，n小于等于m。
当传递件采集到的输入纹理不为记录的m个纹理时，电子设备执行第m+1指令或指令序列。
例如，传递件为触摸区域均支持纹理识别功能的触摸板；
比如某个画图软件，第1指令表现为画笔工具，第2指令表现为橡皮擦工具，第3指令表现为选择工具，当触摸板采集到的输入纹理为第2指令对应的纹理时，画图软件将擦除触摸区域的绘画痕迹。
形式3：
通过传递件采集到的纹理，确定触摸操作的工作状态；通常为双手操作，一手作为信息载体，另一手作为触摸屏的触摸输入。
比如在某个绘图软件中，当左手食指触摸传递件时（传递件采集食指指纹），软件处于“擦除执行”状态；当左手中指触摸触传递件时（传递件采集中指指纹），软件处于“视角切换执行”状态；当绘图软件不处于“抹除执行”和“视角切换执行”的状态时则处于“绘图执行”状态。
当左手的食指和中指都没有放置在传递件上时，软件处于“绘图执行”状态，此时用右手在绘图区域中的触摸操作就被解释为“绘制”(画笔功能) ；
当左手食指持续放置在传递件上时，软件处于“擦除执行”状态，那么用右手在绘图区域中的触摸操作就被解释为“擦除”(橡皮擦功能) ；
当左手中指持续放置在差异触控控件上时，软件处于“视角切换执行状态，那么用右手在绘图区域中的触摸操作就被解释为“移动画布”；
这种形式能够很好的兼容市场上广泛存在的非全屏指纹、纹理识别设备。如智能手机市场中存在大量将纹理识别模块集成于Home键、电源键、机身背部功能键、部分触摸屏下方、部位功能键的智能手机。
形式4：将形式1、形式2、形式3结合使用。
形式5：在形式4的基础上，结合其他触控方式：
将形式1中的指定纹理简记为纹理A，不为指定纹理的纹理简记为纹理非A。
纹理A+单击对应指令1，纹理非A+单击对应指令2，纹理A+双击对应指令3，纹理非A+双击对应指令4；
又如采用了多点触控的形式：纹理A/非A配合拖拽、纹理A/非A配合缩放
又如配合力度感应，纹理A/非A配合轻按和重击等等形式。
又如配合滑动检测的形式：
使用纹理A触摸触摸板时，其效果等同于按下了某个虚拟按键，当用户使用纹理非A触摸触摸板，并在触摸板上移动时，通过检测信息载体在触摸板上的移动方向和/或移动距离，其效果等同于在特定方向上特定程度地推动某个虚拟/类比摇杆和/或使用不同的力度按下线性扳机。从而将触摸板实现为多功能按钮、虚拟摇杆和/或线性扳机。
滑动检测的功能可由连续采集指纹图像并对比图像间的偏移量实现，例如现代的光学式鼠标，便是通过相同的原理，将鼠标在鼠标垫/其他带有纹理的表面上的移动，转换为光标在屏幕上的移动。
以上方式和形式都是本文献所给出的部分方案，除此之外还有许多拓展性的形式，在未来科技发展后多种多样的信息传递形式或者通讯设备同样适用本发明所提出的概念。
应该理解，在本发明的权利要求书、说明书中，所有“包括……”均应理解为开放式的含义，也就是其含义等同于“至少含有……”，而不应理解为封闭式的含义，即其含义不应该理解为“仅包含……”。
本文中所描述的具体实施例仅仅是对本发明精神作举例说明。本发明所属技术领域的技术人员可以对所描述的具体实施例做各种各样的修改或补充或采用类似的方式替代，但并不会偏离本发明的精神或者超越所附权利要求书所定义的范围。

Claims (10)

  1. 一种基于纹理识别的差异触控方法，其特征在于，包括以下过程：
    步骤(1)：选取具有纹理识别功能的传递件和电子设备，并将传递件与电子设备的电信信号连接；
    步骤(2)：选取具有不同纹理的信息载体，将信息载体的不同纹理与传递件的纹理识别信息对应匹配，使不同的纹理触摸或触碰传递件时均会产生一种独立的信号；
    步骤(3)：任一或任意多个信息载体对传递件的信息接收处进行触摸或触碰时，传递件采集每个信息载体上的纹理，并进行匹配：
    ①在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息匹配的情况下，传递件分别产生对应的信号并发送给电子设备；
    ②在传递件采集的纹理信息与传递件/电子设备中的纹理识别信息均不匹配的情况下，传递件产生对应的信号并发送给电子设备；
    特别的，当没有纹理输入时，传递件产生对应的信号并发送给电子设备；
    步骤(4)：电子设备根据信号内容、电子设备的软硬件状态、用户输入的传递件输入和/或触摸屏的触摸输入，执行相应的指令或指令序列；
    特别的，当传递件为具有纹理识别功能的触摸屏时，触摸输入由传递件输入。
  2. .根据权利要求1所述的基于纹理识别的差异触控方法，其特征在于：所述的信号包括空信号和实信号；所述的指令包括空指令和具有执行功能的实指令，指令序列包括空指令序列和具有执行功能的实指令序列。
  3. .根据权利要求1所述的基于纹理识别的差异触控方法，其特征在于：所述的电子设备包括搭载了文本、声音、图像、动画、影片中的一种或多种以进行互动功能的多媒体设备。
  4. .根据权利要求1所述的基于纹理识别的差异触控方法，其特征在于：所述的信息载体为人体的手指指纹、端部具有纹路的指套、端部具有纹路的触摸笔中的一种或多种的任意组合。
  5.  根据权利要求4所述的基于纹理识别的差异触控方法，其特征在于：所述的信息载体为人体的手指指纹，所述传递件的纹理识别功能为手指指纹识别功能；通过传递件录入并记录不同的指纹；对传递件的信息接收处进行触摸或触碰时，传递件采集手指指纹，将采集的手指指纹与传递件中记录的手指指纹进行匹配，产生相应的信号并发送给电子设备。
  6. 根据权利要求4所述的基于纹理识别的差异触控方法，其特征在于：所述的信息载体为人体的手指指纹，所述传递件的纹理识别功能为手指指纹部位识别/分类功能；对传递件的信息接收处进行触摸或触碰时，传递件采集的指纹图像并分辨手指部位，产生相应的信号并发送给电子设备。
  7. .根据权利要求4所述的基于纹理识别的差异触控方法，其特征在于：所述的信息载体为用于戴在人体手指上的指套，指套的端部具有纹路，通过传递件录入并记录指套上的纹路信息；对传递件的信息接收处进行触摸或触碰时，通过传递件采集当前指套纹路后，将采集的指套纹路与传递件中记录的指套纹路进行匹配，产生相应的信号并发送给电子设备。
  8. .根据权利要求7所述的基于纹理识别的差异触控方法，其特征在于：所述不同的纹路分别设置在不同的指套上或将多个纹路设置在同一指套的不同部位。
  9. 根据权利要求4所述的基于纹理识别的差异触控方法，其特征在于：所述的信息载体为触摸笔，触摸笔的端部具有纹路，通过传递件录入并记录触摸笔端部的纹路信息；对传递件的信息接收处进行触摸或触碰时，通过传递件采集当前触摸笔端部的纹路后，将采集的触摸笔端部的纹路与传递件中记录的触摸笔端部的纹路进行匹配，产生相应的信号并发送给电子设备。
  10. 根据权利要求1至7和9任意一项所述的基于纹理识别的差异触控方法，其特征在于：所述的传递件为具有纹理识别功能的Home键、电源键、机身背部功能键、部分触摸屏和/或下方传感器、部位功能键、触摸屏、触摸板中的任意一种或几种的组合。
PCT/CN2023/083220 2022-03-23 2023-03-22 一种基于纹理识别的差异触控方法 WO2023179694A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210291659.1 2022-03-23
CN202210291659.1A CN114780008A (zh) 2022-03-23 2022-03-23 一种基于纹理识别的差异触控方法

Publications (1)

Publication Number Publication Date
WO2023179694A1 true WO2023179694A1 (zh) 2023-09-28

Family

ID=82426189

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/083220 WO2023179694A1 (zh) 2022-03-23 2023-03-22 一种基于纹理识别的差异触控方法

Country Status (2)

Country Link
CN (1) CN114780008A (zh)
WO (1) WO2023179694A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114780008A (zh) * 2022-03-23 2022-07-22 申昊 一种基于纹理识别的差异触控方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102063254A (zh) * 2010-12-23 2011-05-18 东莞宇龙通信科技有限公司 一种应用于移动终端的指纹操作方法及系统
CN102135830A (zh) * 2010-11-22 2011-07-27 华为终端有限公司 触摸屏触发方法及触摸装置
US20120044156A1 (en) * 2010-08-20 2012-02-23 Avaya Inc. Multi-finger sliding detection using fingerprints to generate different events
CN109598248A (zh) * 2018-12-07 2019-04-09 京东方科技集团股份有限公司 纹路识别装置的操作方法以及纹路识别装置
CN113170012A (zh) * 2018-12-10 2021-07-23 深圳市柔宇科技股份有限公司 基于指纹识别的交互方法、电子设备及相关装置
CN114780008A (zh) * 2022-03-23 2022-07-22 申昊 一种基于纹理识别的差异触控方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9075462B2 (en) * 2012-12-10 2015-07-07 Sap Se Finger-specific input on touchscreen devices

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120044156A1 (en) * 2010-08-20 2012-02-23 Avaya Inc. Multi-finger sliding detection using fingerprints to generate different events
CN102135830A (zh) * 2010-11-22 2011-07-27 华为终端有限公司 触摸屏触发方法及触摸装置
CN102063254A (zh) * 2010-12-23 2011-05-18 东莞宇龙通信科技有限公司 一种应用于移动终端的指纹操作方法及系统
CN109598248A (zh) * 2018-12-07 2019-04-09 京东方科技集团股份有限公司 纹路识别装置的操作方法以及纹路识别装置
CN113170012A (zh) * 2018-12-10 2021-07-23 深圳市柔宇科技股份有限公司 基于指纹识别的交互方法、电子设备及相关装置
CN114780008A (zh) * 2022-03-23 2022-07-22 申昊 一种基于纹理识别的差异触控方法

Also Published As

Publication number Publication date
CN114780008A (zh) 2022-07-22

Similar Documents

Publication Publication Date Title
US5534893A (en) Method and apparatus for using stylus-tablet input in a computer system
US7477233B2 (en) Method and system for providing modifier key behavior through pen gestures
Le et al. Investigating the feasibility of finger identification on capacitive touchscreens using deep learning
CN109933206B (zh) 一种基于Leap Motion的手指无接触绘图方法及系统
CN114115689A (zh) 跨环境共享
CN108616712B (zh) 一种基于摄像头的界面操作方法、装置、设备及存储介质
US20090102604A1 (en) Method and system for controlling computer applications
US8462113B2 (en) Method for executing mouse function of electronic device and electronic device thereof
CN101866226A (zh) 便携式电子设备的移动定位操作装置及操作方法
WO2023179694A1 (zh) 一种基于纹理识别的差异触控方法
WO2022267760A1 (zh) 按键功能执行方法、装置、设备及存储介质
CN106774839A (zh) 一种智能穿戴键盘装置及其输入方法
Sun et al. Thumbtrak: Recognizing micro-finger poses using a ring with proximity sensing
US20100321293A1 (en) Command generation method and computer using the same
Corradini et al. A map-based system using speech and 3D gestures for pervasive computing
US20010033268A1 (en) Handheld ergonomic mouse
CN103472931A (zh) 鼠标仿真触控屏幕操作的方法
Tosas et al. Virtual touch screen for mixed reality
Liu et al. Ultrasonic positioning and IMU data fusion for pen-based 3D hand gesture recognition
CN101598982B (zh) 电子装置的鼠标功能执行方法及其电子装置
KR100509913B1 (ko) 다중 형식 입력 장치 및 방법
Kim et al. Mo-Bi: Contextual mobile interfaces through bimanual posture sensing with Wrist-Worn devices
CN113934323A (zh) 基于智能黑板的多点显示方法、装置和终端设备
Gupta et al. A real time controlling computer through color vision based touchless mouse
Athira Touchless technology

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23773941

Country of ref document: EP

Kind code of ref document: A1