WO2011076057A1 - Input apparatus based on body feeling and input method thereof - Google Patents
Input apparatus based on body feeling and input method thereof Download PDFInfo
- Publication number
- WO2011076057A1 WO2011076057A1 PCT/CN2010/079407 CN2010079407W WO2011076057A1 WO 2011076057 A1 WO2011076057 A1 WO 2011076057A1 CN 2010079407 W CN2010079407 W CN 2010079407W WO 2011076057 A1 WO2011076057 A1 WO 2011076057A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- input
- electronic device
- information
- sensing device
- finger
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
Definitions
- Handheld electronic devices are small electronic devices that can be used by hand, such as tablets, UMPCs, mobile phones, PDAs, and handheld keyboards. Handheld electronic devices are generally small, lightweight, and portable, but at the same time there is a problem of difficulty entering information.
- the input modes of the handheld electronic device include keyboard input, touch input, camera input, voice input, etc., but due to the small size and small display area limitation, it is usually required to use a keyboard or a plurality of different types of information input. Special buttons to switch the input interface.
- the position sensing device can sense the movement information of the handheld electronic device, the moving speed and the gravitational information such as the gravity pointing, and is more and more used in the game machine. However, since the body position sensing device can only distinguish a small number of groups of information, the control command is less. Usually, only simpler functions can be implemented, and complex information input such as text input cannot be performed.
- the operator's hand movement feature is "left-handed”; when the operator holds the electronic device to rotate the wrist to the right, the body position sensing device detects a clockwise basis based on the screen surface of the electronic device.
- the rotational angular velocity force the processor determines the operator's hand motion characteristic as "right-handed” according to the detected angular velocity force direction information.
- the somatosensory input device on the handheld electronic device used in this embodiment includes input software installed in the handheld electronic device and contact sensing device and body position sensing device connected to the input end of the handheld electronic device, the contact sensing device is distributed in the handheld Three touch sensing sheets or buttons on the side of the electronic device, the touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and the touch sensing sheet or the button is distributed in the operator's hand.
- the three fingers can generate eight states together with the touch sensor and no contact, that is, the contact sensing device can generate eight control states: the three control states are all left from the touch sensor for the first control.
- the index finger contacts, the other two fingers leave the touch sensor for the second control state; the middle finger contacts, the other two fingers leave the touch sensor for the third control state; the ring finger contacts, the other two fingers leave the touch sensor for the fourth state Control state; the ring finger leaves, the other two fingers touch the touch sensor for the fifth control state; the index finger leaves, the other two fingers touch the touch sensor for the sixth control state; the middle finger leaves, the other two fingers touch the touch sensor for the first Seven control states; all three fingers touch the touch sensor to the eighth control state;
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An input apparatus based on body feeling and an input method thereof. The apparatus includes an input software installed in a handheld electronic device, a contact sensing apparatus and a body position sensing apparatus, wherein the contact sensing apparatus and the body position sensing apparatus are connected at the input end of the handheld electronic device. An operator holds the handheld electronic device and contacts with the contact sensing apparatus of the handheld electronic device through a finger. The input software receives and analyzes the finger contact information, selects the corresponding control state, determines the corresponding input character according to the hand action of the operator detected by the body position sensing apparatus and finally outputs the input content to other application software. The method can carry out complex text input through actions such as shaking and so on, realize text input without watching screen after being skilled and provide a new information input approach for the blind people to use the electronic device.
Description
明 书 Book
基于体感的输入装置及其输入方法 技术领域 Somatosensory-based input device and input method thereof
本发明涉及一种基于体感的输入装置及其输入方法。 The present invention relates to a body-sensing-based input device and an input method thereof.
背景技术 Background technique
手持电子设备是指平板电脑、 UMPC、 移动电话、 掌上电脑、 掌上 键盘等可以手持使用的小型电子设备。手持电子设备普遍体积小、重 量轻、 便于携带， 但同时也存在输入信息困难的问题。 当前手持电子 设备的输入方式有键盘输入、触摸输入、摄像输入、语音输入等多种， 但由于受到体积小、显示屏面积小的限制， 针对多种不同类型的信息 输入， 通常需要利用键盘或特殊的按键来切换输入界面。体位感应装 置能够感应手持电子设备的运动方向、运动速度以及重力指向等体感 信息， 越来越多地用于游戏机中， 但由于体位感应装置只能辨别少量 的几组信息， 控制指令较少， 通常只能实现较为简单的功能， 无法进 行文本输入等复杂的信息输入。 Handheld electronic devices are small electronic devices that can be used by hand, such as tablets, UMPCs, mobile phones, PDAs, and handheld keyboards. Handheld electronic devices are generally small, lightweight, and portable, but at the same time there is a problem of difficulty entering information. Currently, the input modes of the handheld electronic device include keyboard input, touch input, camera input, voice input, etc., but due to the small size and small display area limitation, it is usually required to use a keyboard or a plurality of different types of information input. Special buttons to switch the input interface. The position sensing device can sense the movement information of the handheld electronic device, the moving speed and the gravitational information such as the gravity pointing, and is more and more used in the game machine. However, since the body position sensing device can only distinguish a small number of groups of information, the control command is less. Usually, only simpler functions can be implemented, and complex information input such as text input cannot be performed.
现在己有的体位感应装置主要有三种类型： 一，采用振动传感器 作为体位感应装置，根据设备的位移状态信息来执行或者实施相对应 的功能； 二， 采用图像传感器作为体位感应装置， 采集周围环境中连 续的图像， 通过对比分析每张图像， 判断设备的位移状态， 并据此来 执行或者实施对应的功能； 三， 采用图像传感器作为体位感应装置， 通过采集的用户手势动作，根据用户的手势动作特征来执行或者实施 预先对应的功能。 At present, there are three main types of body position sensing devices: First, the vibration sensor is used as the body position sensing device, and the corresponding function is performed according to the displacement state information of the device; Second, the image sensor is used as the body position sensing device to collect the surrounding environment. In the continuous image, by comparing and analyzing each image, judging the displacement state of the device, and performing or implementing the corresponding function according to this; Third, using the image sensor as the body position sensing device, by collecting the user gesture action, according to the user's gesture Action features to perform or implement pre-corresponding functions.
发明内容 Summary of the invention
本发明的目的是提供一种效率高、使用方便的基于体感的输入装 置及其输入方法，使手持电子设备的动作输入能够进行文本输入等较 为复杂的信息输入，特别是为盲人等特殊用户使用电子设备提供一种 新的信息输入途径。 The object of the present invention is to provide a high-efficiency, easy-to-use body-sensing input device and an input method thereof, so that the action input of the handheld electronic device can input more complicated information such as text input, especially for special users such as blind people. Electronic devices provide a new way to enter information.
为实现上述目的， 本发明采用以下技术方案：
本发明所述的基于体感的输入装置，包括安装在手持电子设备中 的输入软件以及连接在手持电子设备的输入端的接触感应装置和体 位感应装置， 其特征在于： 所述的接触感应装置是分布在手持电子设 备的侧面或者背面的多个触摸感应片，该触摸感应片为采集压感信息 或者触感信息的感应片，分布在操作者手握手持电子设备时手指与设 备接触的区域； 所述体位感应装置为采集手持电子设备的运动方向、 运动速度、 运动轨迹、 重力指向信息的传感器。 To achieve the above object, the present invention adopts the following technical solutions: The somatosensory input device of the present invention comprises input software installed in the handheld electronic device and contact sensing device and body position sensing device connected to the input end of the handheld electronic device, wherein: the contact sensing device is distributed a plurality of touch sensing sheets on a side or a back side of the handheld electronic device, wherein the touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and is distributed in an area where the finger contacts the device when the operator hands hold the electronic device; The body position sensing device is a sensor that collects the moving direction, the moving speed, the moving track, and the gravity pointing information of the handheld electronic device.
采用上述基于体感的输入装置的输入方法，其特征在于包括如下 步骤： The input method using the above-described body-based input device is characterized by comprising the following steps:
步骤 A: 操作者手握手持电子设备， 操作者的手指与手持电子设 备的接触感应装置接触； 步骤 B: 手持电子设备的接触感应装置采集 操作者手指接触信息； 步骤 C : 输入软件接收并分析手指接触信息； 步骤 D : 输入软件根据手指接触信息选择动作输入控制状态； 步骤 E: 体位感应装置采集手持电子设备的体位信息，所述体位信息为运动方 向、 运动速度、 运动轨迹、 重力指向信息中的一种或多种； 步骤 F: 输入软件根据选定的动作输入控制状态，将体位信息转化为对应的输 入内容； 步骤 G: 输入软件将输入的内容输出到其它应用软件。 Step A: The operator hands hold the electronic device, and the operator's finger contacts the contact sensing device of the handheld electronic device; Step B: The touch sensing device of the handheld electronic device collects the operator's finger contact information; Step C: Input software receives and analyzes Finger touch information; Step D: The input software selects the motion input control state according to the finger contact information; Step E: The body position sensing device collects the body position information of the handheld electronic device, and the body position information is the motion direction, the motion speed, the motion track, and the gravity pointing information. One or more of the steps; Step F: The input software inputs the control state according to the selected action, and converts the body position information into the corresponding input content; Step G: The input software outputs the input content to other application software.
在上述步骤 B， 接触感应装置所采集的操作者手指接触信息多个 接触感应装置所采集的手指接触信息的组合。 In the above step B, the operator's finger contact information collected by the contact sensing device is a combination of the finger contact information collected by the plurality of contact sensing devices.
所述动作输入控制状态至少包含有初始化状态， 在初始化状态 下， 任何体位信息对应的输入内容均为初始化指令， 该初始化指令传 递如下信息给输入软件， 上一体位信息的采集过程己结束， 等待下一 体位信息的采集。 The action input control state includes at least an initialization state. In the initialization state, the input content corresponding to any body position information is an initialization command, and the initialization command delivers the following information to the input software, and the process of collecting the integrated bit information has ended, waiting The collection of the next integrated information.
使用该方法以后， 可以通过摇晃等动作动作进行复杂的文本输 入， 熟练以后， 无需观看屏幕即可实现文本输入， 为盲人使用电子设 备提供一种新的信息输入途径。 After using this method, complex text input can be performed by shaking motions, etc. After proficiency, text input can be realized without watching the screen, and a new information input path is provided for the blind person to use the electronic device.
具体实施方式 detailed description
本发明所述的基于体感的输入装置，包括安装在手持电子设备中 的输入软件以及连接在手持电子设备的输入端的接触感应装置和体 位感应装置。所述的接触感应装置是分布在手持电子设备的侧面或者
背面的多个触摸感应片，该触摸感应片为采集压感信息或者触感信息 的感应片， 分布在操作者手握手持电子设备时手指与设备接触的区 域； 所述体位感应装置为采集手持电子设备的运动方向、 运动速度、 运动轨迹、 重力指向信息的传感器。 The somatosensory input device of the present invention includes input software installed in the handheld electronic device and a touch sensing device and a body position sensing device connected to the input end of the handheld electronic device. The contact sensing device is distributed on the side of the handheld electronic device or a plurality of touch sensing sheets on the back side, the touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and is distributed in an area where the finger contacts the device when the operator hands hold the electronic device; the body position sensing device is for collecting handheld electronic The device's direction of motion, speed of motion, motion trajectory, and sensor for gravity pointing information.
上述接触感应装置可以是机械按键、 轻触开关、 簧片开关、 压 感电容、 压感电阻、 热敏传感器、 光敏传感器、 红外传感器等， 可以 感应到手指的压感信息或触感信息。本发明所述的手指与接触感应装 置的接触信息是手指与接触感应装置接触的压感信息或触感信息，在 同一时间，手指与接触感应装置的接触信息集合为一组手指接触设备 信息， 每组手指接触设备信息可以是一个手指接触设备的信息， 也可 以是多个手指接触设备的组合信息。 每组手指接触设备信息的变换， 可以通过单个手指接触接触感应装置状态的变换实现，也可以通过多 个手指接触感接触感应装置状态的组合变换实现。单个手指与接触感 应装置的接触状态的变换方式有从非施压状态变换到施压状态，或从 施压状态变换到非施压状态， 或从接触状态变换到非接触状态， 或从 非接触状态变换到接触状态。 The contact sensing device may be a mechanical button, a tact switch, a reed switch, a pressure sensitive capacitor, a pressure sensitive resistor, a thermal sensor, a photosensor, an infrared sensor, etc., and may sense pressure sensitive information or tactile information of the finger. The contact information of the finger and the contact sensing device according to the present invention is pressure sensitive information or tactile information of the finger contacting the touch sensing device. At the same time, the contact information of the finger and the contact sensing device is a set of finger contact device information, and each The group finger contact device information may be information of one finger contacting the device, or may be combined information of multiple finger contact devices. The transformation of each group of finger contact device information can be realized by a single finger contact with the change of the state of the touch sensing device, or by a combined transformation of the state of the plurality of finger contact sensor devices. The change of the contact state of the single finger and the contact sensing device may be changed from a non-pressure state to a pressure state, or from a pressure state to a non-pressure state, or from a contact state to a non-contact state, or from a non-contact state. The state changes to the contact state.
接触感应装置的设置方式有如下几种选择： a :根据手持电子设 备操作者的手持习惯，在操作者手持的状态下手指与设备接触的位置 点安置接触感应装置，每一个接触感应装置都是一个独立的手指接触 信息采集点； b :根据手持电子设备操作者的手持习惯， 在操作者手持 的状态下手指易与设备接触的位置区域安置由接触感应装置组成的 接触感应带，操作者实际手持该设备时每一个手指与接触感应带接触 的位置都是一个独立的手指接触信息采集点； c :手持电子设备有外部 部件， 根据操作者手持该设备和外部部件的组合体的手持习惯， 在操 作者手持的状态下手指与外部部件接触的位置点安置接触感应装置， 手持电子设备外部部件上每一个接触感应装置都是一个独立的手指 接触信息采集点； d :手持电子设备有外部部件， 根据操作者手持该设 备和外部部件的组合体的手持习惯，在操作者手持的状态下手指与外 部部件接触的位置区域安置由接触感应装置组成的接触感应带，操作 者实际手持该组合体时每一个手指与接触感应带接触的位置都是一 个独立的手指接触信息采集点。
上述手持电子设备的外部部件可以是设备机套、 可拆卸式键盘 等，外部部件通过安置独立电源系统或使用手持电子设备电源系统的 方式为接触感应装置提供电源，通过有线或无线的信号连接通道将接 触感应装置的接触感应信息传输到手持电子设备。 There are several options for setting the contact sensing device: a: According to the hand-held habit of the operator of the handheld electronic device, the contact sensing device is placed at a position where the finger contacts the device in a state of being held by the operator, and each contact sensing device is An independent finger contact information collection point; b: according to the hand-held habit of the operator of the handheld electronic device, a contact sensing belt composed of a contact sensing device is disposed in a position area where the finger is easily in contact with the device in a state of being held by the operator, and the operator actually The position where each finger contacts the contact sensor belt when holding the device is an independent finger contact information collection point; c: the handheld electronic device has an external component, and according to the handheld habit of the operator holding the combination of the device and the external component, The contact sensing device is disposed at a position where the finger contacts the external component in a state of being held by the operator, and each contact sensing device on the external component of the handheld electronic device is an independent finger contact information collecting point; d: the handheld electronic device has an external component , according to the operator holding the device and the external department The hand-held habit of the assembly, in a position area where the finger contacts the external component in a state of being held by the operator, a contact sensing belt composed of a contact sensing device is disposed, and each finger is in contact with the contact sensing belt when the operator actually holds the assembly. The location is an independent finger contact information collection point. The external components of the handheld electronic device may be a device casing, a detachable keyboard, etc., and the external components provide power to the contact sensing device by installing an independent power supply system or using a handheld electronic device power system, and connecting the channels through wired or wireless signals. The contact sensing information of the touch sensing device is transmitted to the handheld electronic device.
体位感应装置能够检测设备的位移状态，该体位感应装置可以包 括振动传感器或者图像传感器。振动传感器可以是在该领域中己知的 任何类型的振动感应电路， 诸如加速计、 惯性计等加速度传感器， 陀 螺仪等角速度传感器， 电子罗盘等磁阻传感器， 能够实时产生设备位 移的相对方向、 角度、 距离等数据， 处理器根据该振动电路检测的设 备位移数据确定操作者的动作特征。图像传感器可以包括在该领域中 己经的任何类型感光电路，诸如 CM0S、 CCD等，能够连续的采集图像， 处理器对连续捕捉的每张图像进行对比分析，确定操作者手部动作的 位移轨迹特征。 The body position sensing device is capable of detecting a displacement state of the device, and the body position sensing device may include a vibration sensor or an image sensor. The vibration sensor may be any type of vibration sensing circuit known in the art, such as an accelerometer, an inertial meter, etc., an angular velocity sensor such as a gyroscope, a magnetoresistive sensor such as an electronic compass, which can generate a relative direction of the device displacement in real time, The data of the angle, the distance, and the like, the processor determines an action characteristic of the operator according to the device displacement data detected by the vibration circuit. The image sensor may include any type of photosensitive circuit that has been used in the field, such as CMOS, CCD, etc., capable of continuously acquiring images, and the processor compares and analyzes each image continuously captured to determine the displacement track of the operator's hand motion. feature.
采用上述基于体感的输入装置的输入方法包括如下步骤： 步骤 A: 操作者手握手持电子设备， 操作者的手指与手持电子设 备的接触感应装置接触； 步骤 B: 手持电子设备的接触感应装置采集 操作者手指接触信息； 步骤 C : 输入软件接收并分析手指接触信息； 步骤 D : 输入软件根据手指接触信息选择动作输入控制状态； 步骤 E: 体位感应装置采集手持电子设备的体位信息，所述体位信息为运动方 向、 运动速度、 运动轨迹、 重力指向信息中的一种或多种； 步骤 F: 输入软件根据选定的动作输入控制状态，将体位信息转化为对应的输 入内容； 步骤 G: 输入软件将输入的内容输出到其它应用软件。 The input method using the above-described somatosensory-based input device includes the following steps: Step A: The operator hands hold the electronic device, and the operator's finger contacts the contact sensing device of the handheld electronic device; Step B: The touch sensing device of the handheld electronic device collects The operator's finger touches the information; Step C: The input software receives and analyzes the finger contact information; Step D: The input software selects the action input control state according to the finger contact information; Step E: The body position sensing device collects the body position information of the handheld electronic device, the body position The information is one or more of the moving direction, the moving speed, the moving track, and the gravity pointing information; Step F: The input software inputs the control state according to the selected action, and converts the body position information into the corresponding input content; Step G: Input The software outputs the input to other applications.
在上述步骤 B， 接触感应装置所采集的操作者手指接触信息多个 接触感应装置所采集的手指接触信息的组合。 In the above step B, the operator's finger contact information collected by the contact sensing device is a combination of the finger contact information collected by the plurality of contact sensing devices.
所述动作输入控制状态至少包含有初始化状态， 在初始化状态 下， 任何体位信息对应的输入内容均为初始化指令， 该初始化指令传 递如下信息给输入软件， 上一体位信息的采集过程己结束， 等待下一 体位信息的采集。 The action input control state includes at least an initialization state. In the initialization state, the input content corresponding to any body position information is an initialization command, and the initialization command delivers the following information to the input software, and the process of collecting the integrated bit information has ended, waiting The collection of the next integrated information.
支持本发明的基于体感的输入装置的输入方法的输入软件具有 如下的一个或者多个特征： 包含有两个以上的控制状态； 能够接收并
处理接触感应装置采集到的手指接触信息；能够接收并处理体位感应 装置输入的动作特征； 根据手指接触信息切换动作输入控制状态； 在 己选定的动作输入控制状态中，将体位感应装置输入的动作特征转化 为输入的内容； 将输入的内容输出到其它应用软件和显示系统； 在一 套输入软件中，一组手指接触信息只能定义对应一个动作输入控制状 态， 一个动作输入控制状态可以定义对应多组手指接触信息。 The input software supporting the input method of the somatosensory input device of the present invention has one or more of the following features: includes more than two control states; Processing finger contact information collected by the touch sensing device; capable of receiving and processing the action feature input by the body position sensing device; switching the motion input control state according to the finger contact information; inputting the body position sensing device in the selected action input control state The action feature is converted into the input content; the input content is output to other application software and the display system; in a set of input software, a set of finger contact information can only define a corresponding action input control state, and an action input control state can be defined. Corresponding to multiple sets of finger contact information.
根据输入系统的实际需要，输入软件开发人员或操作者可以在输 入软件里定义动作输入控制状态的数量和每个动作输入控制状态中 各动作特征对应的内容，以及定义每个动作输入控制状态与各组手指 接触信息之间的对应关系。通过手指接触信息的变换， 在不同的动作 输入控制状态之间进行切换。 According to the actual needs of the input system, the input software developer or operator can define the number of motion input control states and the content of each action feature in each action input control state in the input software, and define each action input control state and The correspondence between each group of finger contact information. By changing the finger contact information, switching between different motion input control states is performed.
体位感应装置为振动电路的应用案例：本实施例使用的体位感应 装置采用了加速度传感器，可以检测到应用在手持电子设备上的加速 力。 The body position sensing device is an application case of the vibration circuit: the body position sensing device used in this embodiment employs an acceleration sensor, which can detect the acceleration force applied to the handheld electronic device.
本实施例定义了六个体位特征： 向上、 向下、 向左、 向右， 左旋、 右旋。操作者手握持电子设备以腕部向上动作时， 体位感应装置检测 到一个基于电子设备屏幕面为基准面向上的加速力，处理器根据检测 到的加速力方向信息确定操作者的手部动作特征为 "向上"； 操作者 手握持电子设备以腕部向下动作时，体位感应装置检测到一个基于电 子设备屏幕面为基准面向下的加速力，处理器根据检测到的加速力方 向信息确定操作者的手部动作特征为 "向下"； 操作者手握持电子设 备以腕部向左动作时，体位感应装置检测到一个基于电子设备屏幕面 为基准面向左的加速力，处理器根据检测到的加速力方向信息确定操 作者的手部动作特征为 "向左"； 操作者手握持电子设备以腕部向右 动作时，体位感应装置检测到一个基于电子设备屏幕面为基准面向右 的加速力，处理器根据检测到的加速力方向信息确定操作者的手部动 作特征为 "向右"； 操作者手握持电子设备以腕部为中心向左旋转动 作时，体位感应装置检测到一个基于电子设备屏幕面为基准面逆时针 旋转的的角速力，处理器根据检测到的角速力方向信息确定操作者的 手部动作特征为 "左旋"； 操作者手握持电子设备以腕部向右旋转动 作时，体位感应装置检测到一个基于电子设备屏幕面为基准面顺时针
旋转的角速力，处理器根据检测到的角速力方向信息确定操作者的手 部动作特征为 "右旋"。 This embodiment defines six posture characteristics: up, down, left, right, left-handed, right-handed. When the operator holds the electronic device to move the wrist upward, the posture sensing device detects an acceleration force based on the screen surface of the electronic device, and the processor determines the operator's hand motion according to the detected acceleration force direction information. The feature is "upward"; when the operator holds the electronic device to move the wrist downward, the posture sensing device detects an acceleration force based on the screen surface of the electronic device as a reference, and the processor according to the detected acceleration force direction information Determining that the operator's hand motion feature is "downward"; when the operator holds the electronic device to move the wrist to the left, the body position sensing device detects an acceleration force directed to the left based on the screen surface of the electronic device, the processor Determining the operator's hand motion characteristic as "leftward" according to the detected acceleration force direction information; when the operator holds the electronic device to move the wrist to the right, the body position sensing device detects a screen based on the electronic device as a reference The rightward acceleration force, the processor determines the operator's hand motion characteristic as "rightward" according to the detected acceleration force direction information; When the author holds the electronic device and rotates to the left with the wrist as the center, the body position sensing device detects an angular velocity force which is rotated counterclockwise based on the screen surface of the electronic device, and the processor determines the direction information according to the detected angular velocity force. The operator's hand movement feature is "left-handed"; when the operator holds the electronic device to rotate the wrist to the right, the body position sensing device detects a clockwise basis based on the screen surface of the electronic device. The rotational angular velocity force, the processor determines the operator's hand motion characteristic as "right-handed" according to the detected angular velocity force direction information.
本实施例采用的接触感应装置是分布在手持电子设备的侧面的 3 个触摸感应片或按键，该触摸感应片为采集压感信息或者触感信息的 感应片， 触摸感应片或按键分布在操作者手握手持电子设备时食指、 中指和无名指与设备接触的区域。三个手指与触摸感应片和不接触共 可以产生八种状态， 也就是说接触感应装置可以产生八个控制状态， 这八个控制状态分别是：三个手指全部离开触摸感应片为第一控制状 态； 食指接触、 另两个手指离开触摸感应片为第二控制状态； 中指接 触、 另两个手指离开触摸感应片为第三控制状态； 无名指接触、 另两 个手指离开触摸感应片为第四控制状态； 无名指离开、另两个手指接 触触摸感应片为第五控制状态； 食指离开、另两个手指接触触摸感应 片为第六控制状态； 中指离开、另两个手指接触触摸感应片为第七控 制状态； 三个手指全部接触触摸感应片为第八控制状态。 The touch sensing device used in this embodiment is three touch sensing sheets or buttons distributed on the side of the handheld electronic device. The touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and the touch sensing sheet or button is distributed to the operator. The area where the index finger, middle finger, and ring finger are in contact with the device when holding the electronic device. The three fingers can generate eight states together with the touch sensor and no contact, that is, the contact sensing device can generate eight control states: the three control states are all: the three fingers all leave the touch sensor for the first control. State; the index finger contacts, the other two fingers leave the touch sensor for the second control state; the middle finger contacts, the other two fingers leave the touch sensor for the third control state; the ring finger contacts, the other two fingers leave the touch sensor for the fourth state Control state; the ring finger leaves, the other two fingers touch the touch sensor for the fifth control state; the index finger leaves, the other two fingers touch the touch sensor for the sixth control state; the middle finger leaves, the other two fingers touch the touch sensor Seven control states; all three fingers touch the touch sensor to the eighth control state.
本实施例采用的输入软件根据动作输入的体位特征和接触感应 装置输入的控制状态确定输入的内容，不同的体位特征与相应的控制 状态组合时代表不同的输入信息， 产生如下表所示对应关系： The input software used in this embodiment determines the input content according to the body position characteristics of the motion input and the control state input by the touch sensing device. When the different body posture features are combined with the corresponding control states, different input information is generated, and the corresponding relationship is generated as shown in the following table. :
以输入 "胃. 163. com"为例， 首先操作者手握手持电子设备，
操作者的手指与手持电子设备的接触感应装置接触。 1， 食指、 中指、 无名指分别对应在接触感应装置的三个键位上，在电子设备的接触感 应装置处做下按操作， 再将手向左平移， 体位感应装置检测到一个基 于电子设备屏幕面为基准面向左的加速力，处理器根据检测到的加速 力方向信息确定操作者的手部动作特征为 "向左"， 输入软件根据手 指的状态选择第八控制状态， 将手持电子设备"向左"的动作特征转 化为字符 "W"; 2， 食指、 中指、 无名指全部离开接触感应装置， 不 做下按操作， 再将手向右平移回前一动作的初始位置， 体位感应装置 检测到一个基于电子设备屏幕面为基准面向右的加速力，处理器根据 检测到的加速力方向信息确定操作者的手部动作特征为 "向右"， 输 入软件根据手指的状态选择第一控制状态， 该操作为初始化状态， 在 初始化状态下， 任何体位信息对应的输入内容均为初始化指令， 该初 始化指令传递如下信息给输入软件， 上一体位信息的采集过程己结 束，等待下一体位信息的采集； 3，重复上述步骤 1，输入第二个 "W"; 4， 重复上述步骤 2， 再次初始化； 5， 重复上述步骤 1， 输入第三个 "W"; 6， 食指接触、 另外两个手指离开接触感应装置， 再将手持电 子设备向右平移，体位感应装置检测到一个基于电子设备屏幕面为基 准面向右的加速力，处理器根据检测到的加速力方向信息确定操作者 的手部动作特征为 "向右"， 输入软件根据手指的动作选择第二控制 状态， 将手持电子设备 "向右" 的动作特征转化为字符 ". "； 7， 食 指接触、另外两个手指离开接触感应装置， 再将手持电子设备向左旋 转动作时，体位感应装置检测到一个基于电子设备屏幕面为基准面逆 时针旋转的的角速力，处理器根据检测到的角速力方向信息确定操作 者的手部动作特征为 "左旋"， 输入软件根据手指的动作选定第三控 制状态， 将手持电子设备 "左旋" 的动作特征转化为字符 " 1 "; 8， 食指和中指触发接触感应装置， 无名指离开， 再将手持电子设备向右 旋转，体位感应装置检测到一个基于电子设备屏幕面为基准面顺时针 旋转的的角速力，处理器根据检测到的角速力方向信息确定操作者的 手部动作特征为 "右旋"， 输入软件根据手指的动作选定第五控制状 态， 将手持电子设备 "右旋" 的动作特征转化为字符 " 6 "; 9， 无名 指接触、另外两个手指离开接触感应装置， 再将手持电子设备向左旋
转，体位感应装置检测到一个基于电子设备屏幕面为基准面逆时针旋 转的的角速力，处理器根据检测到的角速力方向信息确定操作者的手 部动作特征为 "左旋"， 输入软件根据手指的动作选定第四控制状态， 将手持电子设备"左旋"的动作特征转化为字符 "3"; 10， 食指接触、 另外两个手指离开接触感应装置， 再将手持电子设备向右平移， 体位 感应装置检测到一个基于电子设备屏幕面为基准面向右的加速力，处 理器根据检测器检测到的加速力方向信息确定操作者的手部动作特 征为 "向右"， 输入软件根据手指的动作选择第二控制状态， 将手持 电子设备 "向右"的动作特征转化为字符 ". "； 11， 中指接触、 另外 两个手指离开接触感应装置， 再将手持电子设备向左平移， 体位感应 装置检测到一个基于电子设备屏幕面为基准面向左的加速力，处理器 根据检测器检测到的加速力方向信息确定操作者的手部动作特征为 "向左"， 输入软件根据手指的动作选择第三控制状态， 将手持电子 设备 "向左"的动作特征转化为字符 " 12， 食指、 中指、 无名指 全部离开接触感应装置， 不做下按操作， 再将手持电子设备向右平移 回前一动作的初始位置，体位感应装置检测到一个基于电子设备屏幕 面为基准面向右的加速力，处理器根据检测到的加速力方向信息确定 操作者的手部动作特征为 "向右"， 输入软件根据手指的动作选择第 一控制状态， 该操作为初始化状态， 在初始化状态下， 任何体位信息 对应的输入内容均为初始化指令，该初始化指令传递如下信息给输入 软件， 上一体位信息的采集过程己结束， 等待下一体位信息的采集； 13， 中指、 无名指接触、 食指离开接触感应装置， 再将手持电子设备 向左平移，体位感应装置检测到一个基于电子设备屏幕面为基准面向 左的加速力，处理器根据检测到的加速力方向信息确定操作者的手部 动作特征为 "向左"， 输入软件根据手指的动作选择第六控制状态， 将手持电子设备 "向左"的动作特征转化为字符 " 0"; 14， 食指、 中 指、 无名指全部离开接触感应装置， 不做下按操作， 再将手持电子设 备向右平移回前一动作的初始位置，体位感应装置检测到一个基于电 子设备屏幕面为基准面向右的加速力，处理器根据检测到的加速力方 向信息确定操作者的手部动作特征为 "向右"， 输入软件根据手指的 动作择第一控制状态， 该操作为该操作为初始化状态； 15， 中指、 无
名指接触、 食指离开接触感应装置， 再将手持电子设备向上移动， 体 位感应装置检测到一个基于电子设备屏幕面为基准面向上的加速力， 处理器根据检测到的加速力方向信息确定操作者的手部动作特征为 "向上"， 输入软件根据手指的动作选择第六控制状态， 将操作者手 部 "向上" 的动作特征转化为字符 "M"。 Take the input "stomach. 163. com" as an example. First, the operator handshaking the electronic device. The operator's finger is in contact with the touch sensing device of the handheld electronic device. 1. The index finger, the middle finger and the ring finger respectively correspond to the three key positions of the touch sensing device, perform a push operation at the contact sensing device of the electronic device, and then translate the hand to the left, and the body position sensing device detects a screen based on the electronic device. The surface is the left-facing acceleration force, and the processor determines the operator's hand motion characteristic as "leftward" according to the detected acceleration force direction information, and the input software selects the eighth control state according to the state of the finger, and the handheld electronic device is " The motion feature to the left is converted to the character "W"; 2, the index finger, the middle finger, and the ring finger all leave the contact sensing device, and the user does not press the operation, and then shifts the hand to the right to the initial position of the previous motion, and the body position sensing device detects To a right-facing acceleration force based on the screen surface of the electronic device, the processor determines the operator's hand motion feature as "right" according to the detected acceleration force direction information, and the input software selects the first control state according to the state of the finger. , the operation is an initialization state, in the initialization state, the input content corresponding to any body position information is an initialization finger The initialization instruction passes the following information to the input software, and the acquisition process of the integrated information has been completed, waiting for the acquisition of the integrated information; 3. Repeat step 1 above, input the second "W"; 4. Repeat step 2 above. , re-initialize; 5, repeat step 1 above, enter the third "W"; 6, the index finger contacts, the other two fingers leave the contact sensing device, then the handheld electronic device is translated to the right, the position sensing device detects an electronic based The screen surface of the device is the acceleration force of the reference to the right, and the processor determines the operator's hand motion feature as "right" according to the detected acceleration force direction information, and the input software selects the second control state according to the action of the finger, and the handheld electronic device The action feature of the device "to the right" is converted into the character "."; 7. When the index finger is in contact, the other two fingers leave the touch sensing device, and then the handheld electronic device is rotated to the left, the body position sensing device detects a screen based on the electronic device. The surface is an angular velocity force that rotates counterclockwise on the reference surface, and the processor determines the operator's hand according to the detected angular velocity force direction information. The action feature is "left-handed", the input software selects the third control state according to the action of the finger, and converts the action feature of the "left-handed" of the handheld electronic device into the character "1"; 8, the index finger and the middle finger trigger the contact sensing device, and the ring finger leaves, The handheld electronic device is rotated to the right, and the body position sensing device detects an angular velocity force that is rotated clockwise based on the screen surface of the electronic device. The processor determines the operator's hand motion characteristic according to the detected angular velocity force direction information. "Right rotation", the input software selects the fifth control state according to the action of the finger, and converts the action feature of the "right-handed" of the handheld electronic device into the character "6"; 9, the ring finger contacts, and the other two fingers leave the contact sensing device, Turn the handheld electronic device to the left Turning, the body position sensing device detects an angular velocity force that is rotated counterclockwise based on the screen surface of the electronic device, and the processor determines the operator's hand motion characteristic as "left-handed" according to the detected angular velocity force direction information, and the input software is based on The action of the finger selects the fourth control state, and converts the action feature of the left-handed electronic device into the character "3"; 10, the index finger contacts, the other two fingers leave the contact sensing device, and then the handheld electronic device is translated to the right. The posture sensing device detects an acceleration force directed to the right based on the screen surface of the electronic device, and the processor determines the operator's hand motion characteristic as "rightward" according to the acceleration force direction information detected by the detector, and inputs the software according to the finger The action selects the second control state, converting the action feature of the "rightward" of the handheld electronic device into the character "."; 11, the middle finger contacts, the other two fingers leave the contact sensing device, and then the handheld electronic device is translated to the left, the body position sensing The device detects an acceleration force facing the left based on the screen surface of the electronic device, and the processor is based on the detector The measured acceleration force direction information determines that the operator's hand motion feature is "leftward", and the input software selects the third control state according to the action of the finger, and converts the "leftward" motion feature of the handheld electronic device into a character "12, The index finger, the middle finger and the ring finger all leave the touch sensing device, and the handheld electronic device is translated to the right to the initial position of the previous motion without performing a push operation. The body position sensing device detects an acceleration based on the screen surface of the electronic device. The processor determines that the operator's hand motion characteristic is "rightward" according to the detected acceleration force direction information, and the input software selects the first control state according to the action of the finger, the operation is an initialization state, and in the initialization state, any The input content corresponding to the body position information is an initialization instruction, and the initialization instruction transmits the following information to the input software, the collection process of the integrated unit information has been completed, waiting for the collection of the integrated position information; 13, the middle finger, the ring finger contact, the index finger leaving the contact sensor Device, then shifting the handheld electronic device to the left, the position sensing device A left-facing acceleration force based on the screen surface of the electronic device is detected, and the processor determines the operator's hand motion characteristic as "leftward" according to the detected acceleration force direction information, and the input software selects the sixth control according to the action of the finger. State, the "left" motion feature of the handheld electronic device is converted to the character "0"; 14, the index finger, the middle finger, and the ring finger all leave the touch sensing device, and the handheld electronic device is panned back to the previous one without pressing the operation. The initial position of the motion, the posture sensing device detects an acceleration force based on the screen surface of the electronic device as a reference, and the processor determines the operator's hand motion characteristic as "rightward" according to the detected acceleration force direction information, and inputs the software. Selecting the first control state according to the action of the finger, the operation is the initialization state; 15, the middle finger, no The finger contact and the index finger leave the contact sensing device, and then move the handheld electronic device upwards. The body position sensing device detects an acceleration force based on the screen surface of the electronic device, and the processor determines the operator according to the detected acceleration force direction information. The hand movement feature is "up", the input software selects the sixth control state according to the action of the finger, and converts the action feature of the operator's hand "up" into the character "M".
体位感应装置采用感光电路时的应用案例：本实施例采用的体位 感应装置采用 CMOS感光电路， 可以连续采集图像。 The application case when the position sensing device adopts the photosensitive circuit: the body position sensing device used in this embodiment adopts a CMOS photosensitive circuit, and can continuously collect images.
本实施例采用的手持电子设备上的动作输入的方法定义了六个 手部动作位移特征： 向上、 向下、 向左、 向右， 顺时圈、 逆时圈。 操 作者手握持电子设备以腕部为固定轴心向上动作时，体位感应装置采 集到的连续图片按坐标系向下轨迹进行位移，处理器根据位移轨迹信 息确定操作者的手部动作特征为 "向上"； 操作者手握持电子设备以 腕部为固定轴心向下动作时，体位感应装置采集到的连续图片按坐标 系向上轨迹进行位移，处理器根据位移轨迹信息确定操作者的手部动 作特征为 "向下"； 操作者手握持电子设备以腕部为固定轴心右旋动 作或向右甩动时，体位感应装置采集到的连续图片按坐标系向右轨迹 进行位移， 处理器根据位移轨迹信息确定操作者的手部动作特征为 "向右"； 操作者手握持电子设备以腕部为固定轴心左旋动作或向左 甩动时， 体位感应装置采集到的连续图片按坐标系向左轨迹进行位 移， 处理器根据位移轨迹信息确定操作者的手部动作特征为 "向左"； 操作者手握持电子设备以腕部为固定轴心顺时针画圈运动时，体位感 应装置采集到的连续图片按坐标系顺时圈轨迹进行位移，处理器根据 位移轨迹信息确定操作者的手部动作特征为 "顺时圈"； 操作者手握 持电子设备以腕部为固定轴心逆时针画圈运动时，体位感应装置采集 到的连续图片按坐标系逆时圈轨迹进行位移，处理器根据位移轨迹信 息确定操作者的手部动作特征为 "逆时圈"。 The method of motion input on the handheld electronic device used in this embodiment defines six hand motion displacement characteristics: up, down, left, right, clockwise, and reverse. When the operator holds the electronic device and moves the wrist to the fixed axis, the continuous image collected by the body position sensing device is displaced according to the coordinate system downward trajectory, and the processor determines the operator's hand motion characteristic according to the displacement trajectory information. "Upward"; when the operator holds the electronic device and moves the wrist as a fixed axis downward, the continuous picture collected by the body position sensing device is displaced according to the upward trajectory of the coordinate system, and the processor determines the operator's hand according to the displacement trajectory information. The action characteristic of the part is "downward"; when the operator holds the electronic device with the wrist as the fixed axis and the right hand or the right, the continuous picture collected by the body position sensing device is displaced to the right track by the coordinate system. The processor determines, according to the displacement trajectory information, that the operator's hand motion feature is "to the right"; when the operator holds the electronic device with the wrist as the fixed axis left-handed motion or leftward, the position sensing device collects the continuous The image is displaced to the left trajectory according to the coordinate system, and the processor determines the operator's hand motion characteristic as "leftward" according to the displacement trajectory information; When the hand holds the electronic device and the clock is moved clockwise with the wrist as the fixed axis, the continuous picture collected by the body position sensing device is displaced according to the coordinate system clockwise trajectory, and the processor determines the operator's hand according to the displacement trajectory information. The action feature is "shun-time circle"; when the operator holds the electronic device and moves the circle counterclockwise with the wrist as the fixed axis, the continuous picture collected by the body position sensing device is displaced according to the coordinate system inverse time circle trajectory, the processor The operator's hand motion characteristic is determined as "reverse time circle" based on the displacement trajectory information.
本实施例采用的手持电子设备上基于体感的输入装置包括包括 安装在手持电子设备中的输入软件以及连接在手持电子设备的输入 端的接触感应装置和体位感应装置，该接触感应装置是分布在手持电 子设备的侧面的三个触摸感应片或按键，该触摸感应片为采集压感信 息或者触感信息的感应片，触摸感应片或按键分布在操作者手握手持
电子设备时食指、 中指和无名指与设备接触的区域。三个手指与触摸 感应片和不接触共可以产生八种状态，也就是说接触感应装置可以产 生八个控制状态， 这八个控制状态分别是： 三个手指全部离开触摸感 应片为第一控制状态； 食指接触、另两个手指离开触摸感应片为第二 控制状态； 中指接触、 另两个手指离开触摸感应片为第三控制状态； 无名指接触、另两个手指离开触摸感应片为第四控制状态； 无名指离 开、 另两个手指接触触摸感应片为第五控制状态； 食指离开、 另两个 手指接触触摸感应片为第六控制状态； 中指离开、另两个手指接触触 摸感应片为第七控制状态；三个手指全部接触触摸感应片为第八控制 状态；。 The somatosensory input device on the handheld electronic device used in this embodiment includes input software installed in the handheld electronic device and contact sensing device and body position sensing device connected to the input end of the handheld electronic device, the contact sensing device is distributed in the handheld Three touch sensing sheets or buttons on the side of the electronic device, the touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and the touch sensing sheet or the button is distributed in the operator's hand. The area where the index finger, middle finger and ring finger are in contact with the device when the electronic device is in use. The three fingers can generate eight states together with the touch sensor and no contact, that is, the contact sensing device can generate eight control states: the three control states are all left from the touch sensor for the first control. State; the index finger contacts, the other two fingers leave the touch sensor for the second control state; the middle finger contacts, the other two fingers leave the touch sensor for the third control state; the ring finger contacts, the other two fingers leave the touch sensor for the fourth state Control state; the ring finger leaves, the other two fingers touch the touch sensor for the fifth control state; the index finger leaves, the other two fingers touch the touch sensor for the sixth control state; the middle finger leaves, the other two fingers touch the touch sensor for the first Seven control states; all three fingers touch the touch sensor to the eighth control state;
本实施例采用的输入软件能够根据上述手指的动作的特征和体 位感应装置检测到的位移特征， 动作特征与控制状态对应关系如下 表： The input software used in this embodiment can be based on the characteristics of the action of the finger and the displacement feature detected by the body sensing device. The correspondence between the action feature and the control state is as follows:
以输入 "胃. 163. com"为例， 首先操作者手握手持电子设备， 1， 食指、 中指、 无名指分别对应在接触感应装置的三个键位上， 在 电子设备的接触感应装置处做下按操作， 再将手向左平移或左旋运 动， 体位感应装置采集到一个按坐标系向左位移的连续图片， 处理器 根据体位感应装置检采集到图片位移信息确定操作者的手部动作特
征为 "向左"， 输入软件根据选定的动作输入第八控制状态， 将操作 者手部 "向左" 的动作特征转化为字符 "W"; 2， 按图 4第一控制状 态所示， 食指、 中指、 无名指分别在电子设备的接触感应装置处不做 下按操作， 再将手向右平移或右旋运动回到前一动作的初始位置， 体 位感应装置采集到一个按坐标系向右位移的连续图片，处理器根据体 位感应装置检采集到图片位移信息确定操作者的手部动作特征为"向 右"， 输入软件根据选定的动作输入第一控制状态， 该操作为初始化 状态； 3， 食指、 中指、 无名指分别在电子设备的接触感应装置处做 下按操作， 再将手向左平移或左旋运动， 体位感应装置采集到一个按 坐标系向左位移的连续图片，处理器根据体位感应装置检采集到图片 位移信息确定操作者的手部动作特征为 "向左"， 输入软件根据选定 的动作输入第八控制状态， 将操作者手部"向左"的动作特征转化为 字符 "W"; 4， 食指、 中指、 无名指分别在电子设备的接触感应装置 处不做下按操作，再将手向右平移或右旋运动回到前一动作的初始位 置， 体位感应装置采集到一个按坐标系向右位移的连续图片， 处理器 根据体位感应装置检采集到图片位移信息确定操作者的手部动作特 征为 "向右"， 输入软件根据选定的动作输入第一控制状态， 该操作 为初始化状态； 5， 食指、 中指、 无名指分别在电子设备的接触感应 装置处做下按操作， 再将手向左平移或左旋运动， 体位感应装置采集 到一个按坐标系向左位移的连续图片，处理器根据体位感应装置检采 集到图片位移信息确定操作者的手部动作特征为 "向左"， 输入软件 根据选定的动作输入第八控制状态， 将操作者手部"向左"的动作特 征转化为字符 "W"; 6， 食指在电子设备的接触感应装置处做下按操 作， 再将手向右平移或右旋运动， 体位感应装置采集到一个按坐标系 向右位移的连续图片，处理器根据体位感应装置检采集到图片位移信 息确定操作者的手部动作特征为 "向右"， 输入软件根据选定的动作 输入第二控制状态，将操作者手部"向右"的动作特征转化为字符". "； 7， 中指在电子设备的接触感应装置处做下按操作， 再将手以腕部为 中心做顺时针画圈动作时，体位感应装置采集到一个按坐标系顺时圈 位移的连续图片，处理器根据体位感应装置检采集到图片位移信息确 定操作者的手部动作特征为 "顺时圈"， 输入软件根据选定的动作输
入第三控制状态，将操作者手部 "顺时圈"的动作特征转化为字符" 1 "； 8， 食指和中指在电子设备的接触感应装置处做下按操作， 再将手以 腕部为中心做逆时针画圈动作时，体位感应装置采集到一个按坐标系 逆时圈位移的连续图片，处理器根据体位感应装置检采集到图片位移 信息确定操作者的手部动作特征为 "逆时圈"， 输入软件根据选定的 动作输入第五控制状态， 将操作者手部 "逆时圈"的动作特征转化为 字符 "6 "; 9， 无名指在电子设备的接触感应装置处做下按操作， 再 将手以腕部为中心做顺时针画圈动作时，体位感应装置采集到一个按 坐标系顺时圈位移的连续图片，处理器根据体位感应装置检采集到图 片位移信息确定操作者的手部动作特征为 "顺时圈"， 输入软件根据 选定的动作输入第四控制状态， 将操作者手部 "顺时圈"的动作特征 转化为字符 "3"; 10，食指在电子设备的接触感应装置处做下按操作， 再将手向右平移或右旋运动，体位感应装置采集到一个按坐标系向右 位移的连续图片，处理器根据体位感应装置检采集到图片位移信息确 定操作者的手部动作特征为 "向右"， 输入软件根据选定的动作输入 第二控制状态， 将操作者手部 "向右" 的动作特征转化为字符 ". "； 11， 中指在电子设备的接触感应装置处做下按操作， 再将手向左平移 或左旋运动， 体位感应装置采集到一个按坐标系向左位移的连续图 片，处理器根据体位感应装置检采集到图片位移信息确定操作者的手 部动作特征为 "向左"， 输入软件根据选定的动作输入第三控制状态， 将操作者手部 "向左 "的动作特征转化为字符" 12， 食指、 中指、 无名指分别在电子设备的接触感应装置处不做下按操作，再将手向右 平移或右旋运动回到前一动作的初始位置，体位感应装置采集到一个 按坐标系向右位移的连续图片，处理器根据体位感应装置检采集到图 片位移信息确定操作者的手部动作特征为 "向右"， 输入软件根据选 定的动作输入第一控制状态， 该操作为初始化状态； 13， 中指、 无名 指分别在电子设备的接触感应装置处做下按操作，再将手向左平移或 左旋运动， 体位感应装置采集到一个按坐标系向左位移的连续图片， 处理器根据体位感应装置检采集到图片位移信息确定操作者的手部 动作特征为 "向左"， 输入软件根据选定的动作输入第六控制状态， 将操作者手部 "向左 "的动作特征转化为字符" 0"; 14， 食指、 中指、
无名指分别在电子设备的接触感应装置处不做下按操作，再将手向右 平移或右旋运动回到前一动作的初始位置，体位感应装置采集到一个 按坐标系向右位移的连续图片，处理器根据体位感应装置检采集到图 片位移信息确定操作者的手部动作特征为 "向右"， 输入软件根据选 定的动作输入第一控制状态， 该操作为初始化状态； 15， 中指、 无名 指分别在电子设备的接触感应装置处做下按操作，再将手以腕部为固 定轴心向上移动， 采集到一个按坐标系向下位移的连续图片， 处理器 根据体位感应装置检采集到图片位移信息确定操作者的手部动作特 征为 "向上"， 输入软件根据选定的动作输入第六控制状态， 将操作 者手部 "向上" 的动作特征转化为字符 "M"。 Take the input "stomach. 163. com" as an example. First, the operator hands-hold the electronic device. 1. The index finger, the middle finger and the ring finger correspond to the three key positions of the contact sensing device respectively, and the contact sensing device of the electronic device is made. Pressing the operation, and then shifting the hand to the left or left-handed motion, the body position sensing device collects a continuous picture shifted to the left by the coordinate system, and the processor determines the operator's hand movement according to the position sensing device. The sign is "to the left", the input software inputs the eighth control state according to the selected action, and converts the action feature of the operator's hand "to the left" into the character "W"; 2, as shown in the first control state of FIG. The index finger, the middle finger, and the ring finger are not pressed down at the contact sensing device of the electronic device, and then the hand is translated to the right or right-handed to return to the initial position of the previous motion, and the body position sensing device collects a coordinate system. The continuous image of the right displacement, the processor determines the operator's hand motion characteristic according to the position sensing device to determine the operator's hand motion feature as "rightward", and the input software inputs the first control state according to the selected action, and the operation is an initialization state. 3, the index finger, the middle finger, and the ring finger respectively perform a push operation at the contact sensing device of the electronic device, and then shift the hand to the left or left to rotate, and the body position sensing device collects a continuous picture shifted to the left by the coordinate system, the processor According to the position sensing device, the image displacement information is collected to determine that the operator's hand motion characteristic is "leftward", and the input software inputs according to the selected motion. Eight control states, the operator's hand "left" action characteristics are converted into characters "W"; 4, the index finger, middle finger, ring finger are not pressed down at the contact sensing device of the electronic device, and then the hand is turned to the right The translational or right-handed motion returns to the initial position of the previous motion, and the body position sensing device collects a continuous picture that is displaced to the right by the coordinate system. The processor determines the operator's hand motion characteristics according to the position sensing device. For "right", the input software inputs the first control state according to the selected action, and the operation is the initialization state; 5, the index finger, the middle finger, and the ring finger respectively perform a push operation at the contact sensing device of the electronic device, and then the hand is directed Left or left-handed motion, the body position sensing device collects a continuous picture shifted to the left by the coordinate system, and the processor determines the operator's hand motion characteristic according to the position sensing device to determine the operator's hand motion feature as "leftward", input software Entering the eighth control state according to the selected action, converting the action feature of the operator's hand to the left into the character "W"; 6, the index finger is The sub-device's contact sensing device performs a push-down operation, and then shifts the hand to the right or right-handed motion, and the body position sensing device collects a continuous picture that is displaced to the right by the coordinate system, and the processor collects the image displacement according to the body position sensing device. The information determines that the operator's hand motion feature is "to the right", and the input software inputs the second control state according to the selected action, and converts the operator's "rightward" action feature into the character "."; 7, the middle finger When the operation is performed by the touch sensing device of the electronic device, and the hand is clockwise drawn around the wrist, the body position sensing device collects a continuous picture of the clockwise rotation according to the coordinate system, and the processor is based on the body position. The sensing device detects the image displacement information and determines that the operator's hand motion feature is "shun-time circle", and the input software inputs according to the selected action. Into the third control state, the operator's hand "timely circle" action characteristics are converted into the character "1"; 8, the index finger and the middle finger are pressed at the contact sensing device of the electronic device, and then the hand is the wrist When performing the counterclockwise circle motion for the center, the body position sensing device collects a continuous picture of the reverse rotation of the coordinate system, and the processor determines the operator's hand motion characteristic according to the position sensing device to determine the operator's hand motion feature as "reverse". "Time circle", the input software inputs the fifth control state according to the selected action, and converts the action characteristic of the operator's hand "reverse time circle" into the character "6"; 9, the ring finger is made at the contact sensing device of the electronic device. Pressing the operation, and then making the clockwise motion around the wrist, the body position sensing device collects a continuous picture of the coordinate shift according to the coordinate system, and the processor determines the operation of the image displacement information according to the body position sensing device. The hand movement feature is "timely circle", the input software inputs the fourth control state according to the selected action, and converts the action feature of the operator's hand "timely circle" into the character "3"; The index finger performs a push operation at the contact sensing device of the electronic device, and then shifts the hand to the right or right rotation, and the body position sensing device collects a continuous picture that is displaced to the right by the coordinate system, and the processor collects the image according to the body position sensing device. The image displacement information is determined to be "rightward" to the image displacement information, and the input software inputs the second control state according to the selected motion, and converts the operator's "rightward" motion feature into a character "."; 11. The middle finger performs a push-down operation at the contact sensing device of the electronic device, and then shifts the hand to the left or left-handed motion, and the body position sensing device collects a continuous picture shifted to the left by the coordinate system, and the processor collects the image according to the body position sensing device. The picture displacement information determines that the operator's hand motion feature is "leftward", and the input software inputs the third control state according to the selected action, and converts the operator's "left" motion feature into a character "12, index finger The middle finger and the ring finger are not pressed down at the contact sensing device of the electronic device, and then the hand is turned to the right or the right is rotated to return to the beginning of the previous action. At the starting position, the body position sensing device collects a continuous picture that is displaced to the right by the coordinate system, and the processor determines the operator's hand motion characteristic to be "right" according to the position sensing information of the body position sensing device, and the input software is selected according to the selection. The action is input to the first control state, and the operation is the initialization state; 13, the middle finger and the ring finger respectively perform a push operation at the contact sensing device of the electronic device, and then the hand is shifted to the left or left-handed, and the body position sensing device collects a button. The continuous image of the coordinate system shifting to the left, the processor determines the operator's hand motion feature as "left" according to the position sensing device, and the input software inputs the sixth control state according to the selected action, and the operation is performed. The action feature of the "left" hand is converted to the character "0"; 14, the index finger, the middle finger, The ring finger does not perform a push operation at the contact sensing device of the electronic device, and then shifts the hand to the right or right rotation to return to the initial position of the previous motion, and the body position sensing device collects a continuous picture that is displaced to the right by the coordinate system. The processor determines that the operator's hand motion feature is "rightward" according to the position sensing device, and the input software inputs the first control state according to the selected action, and the operation is an initialization state; 15, the middle finger, The ring finger is pressed down at the contact sensing device of the electronic device, and then the hand is moved upward with the wrist as a fixed axis, and a continuous picture that is displaced downward by the coordinate system is collected, and the processor collects the image according to the body position sensing device. The picture displacement information determines that the operator's hand motion feature is "up", and the input software inputs the sixth control state according to the selected action, and converts the operator's "up" action feature into the character "M".
当然除以上应用案例以外， 还可以定义更多更复杂的动作特征， 以便于输入更多的文字信息。本应用案例所定义的动作特征为手部动 作仅为腕部动作的动作特征， 手部动作幅度小， 动作简单， 容易被体 位感应装置分辨。
Of course, in addition to the above application cases, you can define more and more complex motion features, in order to input more text information. The action feature defined in this application case is that the hand movement is only an action feature of the wrist movement, the hand movement amplitude is small, the movement is simple, and it is easy to be distinguished by the position sensing device.
Claims
1、 基于体感的输入装置， 包括安装在手持电子设备中的输入软 件以及连接在手持电子设备的输入端的接触感应装置和体位感应装 置， 其特征在于： 所述的接触感应装置是分布在手持电子设备的侧面 或者背面的多个触摸感应片，该触摸感应片为采集压感信息或者触感 信息的感应片，分布在操作者手握手持电子设备时手指与设备接触的 区域;所述体位感应装置为采集手持电子设备的运动方向、运动速度、 运动轨迹、 重力指向信息的传感器。 1. A somatosensory input device comprising input software installed in a handheld electronic device and a touch sensing device and a body position sensing device connected to an input end of the handheld electronic device, wherein: the touch sensing device is distributed in a handheld electronic device a plurality of touch sensing sheets on the side or the back of the device, wherein the touch sensing sheet is a sensing sheet for collecting pressure sensitive information or tactile information, and is distributed in an area where the finger contacts the device when the operator hands hold the electronic device; the body position sensing device A sensor for collecting motion direction, motion speed, motion trajectory, and gravity pointing information of a handheld electronic device.
2、 采用如权利要求 1所述的基于体感的输入装置的输入方法， 其特征在于包括如下步骤： 2. An input method using a somatosensory input device according to claim 1, comprising the steps of:
步骤 A: 操作者手握手持电子设备， 操作者的手指与手持电子设 备的接触感应装置接触； 步骤 B: 手持电子设备的接触感应装置采集 操作者手指接触信息； 步骤 C: 输入软件接收并分析手指接触信息； 步骤 D: 输入软件根据手指接触信息选择动作输入控制状态； 步骤 E: 体位感应装置采集手持电子设备的体位信息，所述体位信息为运动方 向、 运动速度、 运动轨迹、 重力指向信息中的一种或多种； 步骤 F: 输入软件根据选定的动作输入控制状态，将体位信息转化为对应的输 入内容； 步骤 G: 输入软件将输入的内容输出到其它应用软件。 Step A: The operator hands hold the electronic device, and the operator's finger contacts the contact sensing device of the handheld electronic device; Step B: The touch sensing device of the handheld electronic device collects the operator's finger contact information; Step C: Input software receives and analyzes Finger touch information; Step D: The input software selects the motion input control state according to the finger contact information; Step E: The body position sensing device collects the body position information of the handheld electronic device, and the body position information is the motion direction, the motion speed, the motion track, and the gravity pointing information. One or more of the steps; Step F: The input software inputs the control state according to the selected action, and converts the body position information into the corresponding input content; Step G: The input software outputs the input content to other application software.
3、 根据权利要求 2所述的基于体感的输入装置的输入方法， 其 特征在于： 在步骤 B， 接触感应装置所采集的操作者手指接触信息多 个接触感应装置所采集的手指接触信息的组合。 3. The input method of the somatosensory input device according to claim 2, wherein: in step B, the touch finger contact information collected by the contact sensing device is combined with the finger contact information collected by the plurality of contact sensing devices. .
4、 根据权利要求 2所述的基于体感的输入装置的输入方法， 其 特征在于： 所述动作输入控制状态至少包含有初始化状态， 在初始化 状态下， 任何体位信息对应的输入内容均为初始化指令， 该初始化指 令传递如下信息给输入软件， 上一体位信息的采集过程己结束， 等待 下一体位信息的采集。 4. The input method of the somatosensory input device according to claim 2, wherein: the motion input control state includes at least an initialization state, and in the initialization state, an input content corresponding to any body position information is an initialization command. The initialization instruction passes the following information to the input software, and the acquisition process of the integrated unit information has ended, waiting for the collection of the integrated information.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910311952A CN101706677A (en) | 2009-12-22 | 2009-12-22 | Input device based on body feeling and input method thereof |
| CN200910311952.4 | 2009-12-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2011076057A1 true WO2011076057A1 (en) | 2011-06-30 |
Family
ID=42376906
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2010/079407 WO2011076057A1 (en) | 2009-12-22 | 2010-12-02 | Input apparatus based on body feeling and input method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN101706677A (en) |
| WO (1) | WO2011076057A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011157247A2 (en) * | 2011-09-02 | 2011-12-22 | 华为终端有限公司 | Motion-sensing input method, motion-sensing device, wireless handheld device, and motion-sensing system |
| CN105138111A (en) * | 2015-07-09 | 2015-12-09 | 中山大学 | Single camera based somatosensory interaction method and system |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101706677A (en) * | 2009-12-22 | 2010-05-12 | 聂清永 | Input device based on body feeling and input method thereof |
| CN101853135A (en) * | 2010-06-20 | 2010-10-06 | 聂清永 | Method for controlling touch screen input interfaces on handheld electronic equipment based on somatosensory device |
| CN102457674A (en) * | 2010-10-27 | 2012-05-16 | 赛龙通信技术（深圳）有限公司 | Method for simulating gravity sensor with camera |
| EP2672372B1 (en) * | 2011-04-11 | 2018-05-30 | Huawei Device (Dongguan) Co., Ltd. | Information processing method and terminal device |
| CN103777769A (en) * | 2012-10-23 | 2014-05-07 | 联想(北京)有限公司 | Input control method and device and electronic equipment |
| CN103873500A (en) * | 2012-12-12 | 2014-06-18 | 腾讯科技（深圳）有限公司 | Application control method, terminal and system based on mobile terminal sensor |
| CN106293044B (en) * | 2015-06-29 | 2023-02-28 | 北京智谷睿拓技术服务有限公司 | Information processing method, information processing device and user equipment |
| CN106502854A (en) * | 2016-12-26 | 2017-03-15 | 北京大华杰康科技有限公司 | A kind of apparatus for evaluating of vivid platform proprioceptive simulation fidelity |
| CN109731324B (en) * | 2018-12-29 | 2022-08-16 | 深圳市掌网科技股份有限公司 | Game system based on augmented reality |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08220988A (en) * | 1995-02-20 | 1996-08-30 | Fujitsu Ltd | Braille data input/output terminal |
| CN1805472A (en) * | 2005-01-10 | 2006-07-19 | 乐金电子(中国)研究开发中心有限公司 | Mobile telephone for blind, mute or deaf man |
| CN1826574A (en) * | 2003-07-22 | 2006-08-30 | 熊泽逸夫 | Data input device, information equipment, information equipment control method, and computer program |
| CN101464779A (en) * | 2009-01-13 | 2009-06-24 | 聂清永 | Method and apparatus for switching input interface on hand-hold electronic equipment |
| CN101706677A (en) * | 2009-12-22 | 2010-05-12 | 聂清永 | Input device based on body feeling and input method thereof |
-
2009
- 2009-12-22 CN CN200910311952A patent/CN101706677A/en active Pending
-
2010
- 2010-12-02 WO PCT/CN2010/079407 patent/WO2011076057A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08220988A (en) * | 1995-02-20 | 1996-08-30 | Fujitsu Ltd | Braille data input/output terminal |
| CN1826574A (en) * | 2003-07-22 | 2006-08-30 | 熊泽逸夫 | Data input device, information equipment, information equipment control method, and computer program |
| CN1805472A (en) * | 2005-01-10 | 2006-07-19 | 乐金电子(中国)研究开发中心有限公司 | Mobile telephone for blind, mute or deaf man |
| CN101464779A (en) * | 2009-01-13 | 2009-06-24 | 聂清永 | Method and apparatus for switching input interface on hand-hold electronic equipment |
| CN101706677A (en) * | 2009-12-22 | 2010-05-12 | 聂清永 | Input device based on body feeling and input method thereof |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011157247A2 (en) * | 2011-09-02 | 2011-12-22 | 华为终端有限公司 | Motion-sensing input method, motion-sensing device, wireless handheld device, and motion-sensing system |
| WO2011157247A3 (en) * | 2011-09-02 | 2012-07-26 | 华为终端有限公司 | Motion-sensing input method, motion-sensing device, wireless handheld device, and motion-sensing system |
| CN105138111A (en) * | 2015-07-09 | 2015-12-09 | 中山大学 | Single camera based somatosensory interaction method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101706677A (en) | 2010-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2011076057A1 (en) | Input apparatus based on body feeling and input method thereof | |
| EP1241616B9 (en) | Portable electronic device with mouse-like capabilities | |
| EP3089018B1 (en) | Method, apparatus, and device for information processing | |
| JP5784003B2 (en) | Multi-telepointer, virtual object display device, and virtual object control method | |
| US20190204929A1 (en) | Devices and methods for dynamic association of user input with mobile device actions | |
| US20050219355A1 (en) | Information input device | |
| TW200822682A (en) | Multi-function key with scrolling | |
| US20110199301A1 (en) | Sensor-based Pointing Device for Natural Input and Interaction | |
| WO2003017244A1 (en) | System and method for selecting actions based on the identification of user's fingers | |
| KR20100075767A (en) | Input apparatus, handheld apparatus, and control method | |
| WO2014183351A1 (en) | Handwriting input method and device | |
| WO2012050537A1 (en) | Pencil input peripheral computer controller | |
| WO2011038626A1 (en) | Display and control method for control menu on touch screen | |
| JP2009258946A (en) | Capacitive touch sensor | |
| CN102414645A (en) | Apparatus including a sensor arrangement and methods of operating the same | |
| RU2275674C2 (en) | Method for controlling cursor and device for its realization | |
| CN100374998C (en) | Touch control type information input device and method | |
| Pandit et al. | A simple wearable hand gesture recognition device using iMEMS | |
| KR101211808B1 (en) | Gesture cognitive device and method for recognizing gesture thereof | |
| WO2009093027A1 (en) | Wrist-mounted computer periferal | |
| EP2756370A1 (en) | Multifunctional pencil input peripheral computer controller | |
| WO2016121034A1 (en) | Wearable device, input method, and program | |
| JP2005339306A (en) | Data input device | |
| CN101408797A (en) | Sensing module | |
| CN106569610A (en) | Method for realizing electronic equipment input function through thumb bending degree testing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10838620 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 10838620 Country of ref document: EP Kind code of ref document: A1 |