WO2014135023A1 - Man-machine interaction method and system of intelligent terminal - Google Patents
Man-machine interaction method and system of intelligent terminal Download PDFInfo
- Publication number
- WO2014135023A1 WO2014135023A1 PCT/CN2014/072586 CN2014072586W WO2014135023A1 WO 2014135023 A1 WO2014135023 A1 WO 2014135023A1 CN 2014072586 W CN2014072586 W CN 2014072586W WO 2014135023 A1 WO2014135023 A1 WO 2014135023A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- control instruction
- smart terminal
- data
- earphone
- user
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
Definitions
- the present invention relates to the field of human-computer interaction technologies, and in particular, to a human-computer interaction method and system for an intelligent terminal.
- Face recognition technology requires the device to turn on the camera and aim at the face to be accurate. Identification. Therefore, in actual use, when the user is unwilling or unable to perform various operations by hand, the above-mentioned human-computer interaction technology often fails to meet the user's operation requirements, accurately achieves the user's desired operational effect, and gives the user A bad operating experience that is not convenient enough.
- the present invention provides a novel human-computer interaction method and system for a smart terminal, so that the user does not enjoy the audio/video even when making detailed menu selections. You need to touch the phone to operate and communicate the relevant control commands.
- a human-computer interaction method for a smart terminal wherein the smart terminal establishes a wired or wireless connection with an inductive headset, and the digital inductive device and the at least one pressure sensing device are disposed on the inductive headset, the steps of the method comprising:
- the digital gyroscope collects motion data during the movement of the earphone and sends it to the intelligent terminal;
- the processor of the smart terminal analyzes the motion data to obtain and executes a control instruction matching the control data, the control instruction including a movement of the focus mark on the user display interface;
- the pressure sensing device acquires the sensing signal caused by the tensioning action of the ear organ of the user, and outputs the sensing data to the intelligent terminal according to the sensing signal;
- control instruction comprising triggering an item pointed by the focus indicator in step b.
- the focus mark includes, but is not limited to, a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic
- the item pointed by the focus mark includes but is not limited to a button, a menu option, a text/symbol with a link function/ Graphics.
- Step b The processor of the smart terminal analyzes the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter.
- the control instruction is judged according to the matching result; or the motion data output by the digital gyro is directly matched with the preset instruction parameter, and the control instruction is judged according to the matching result.
- control instruction of step b may further include up/down/left/right translation and page turning of the page on the user display interface.
- the sensing data of step c includes the collected pressure value and the corresponding time value.
- Step d analyzing the sensing data to obtain a matching control command includes: comparing whether a maximum pressure difference caused by an expansion or tightening action of a user's ear organ reaches a pressure difference threshold in a preset command parameter; comparing the expansion or Whether the frequency of the tightening action matches the preset frequency reference value.
- the invention also discloses a human-computer interaction system for an intelligent terminal, comprising an inductive earphone and a smart terminal for establishing a wired connection or a wireless connection, the induction earphone comprising:
- connection module for transmitting data to the smart terminal by the earphone
- a gyroscope module for collecting motion data during the movement of the earphone
- a pressure detecting module configured to acquire a sensing signal caused by a tensioning action of a user's ear organ, and output sensing data according to the sensing signal
- the smart terminal includes:
- connection module configured to receive data sent by the earphone
- a motion analysis module for analyzing motion data of the gyro module to obtain a matching control command, the control command including movement of the focus mark on the user display interface
- a pressure analysis module for analyzing the sensing data of the pressure detecting module to obtain a matching control command, the control command comprising triggering an item pointed by the focus mark on the user display interface;
- An execution module for executing the control instruction.
- the focus mark includes a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic
- the item pointed by the focus mark includes a button, a menu option, and a text/symbol/graphic with a link function.
- the motion analysis module is used to analyze the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter, and the matching result is judged according to the matching result.
- Control command or directly match the motion data output by the digital gyroscope with the preset command parameters, and judge the control command according to the matching result.
- the sensing data includes the collected pressure value and the corresponding time value
- the pressure analysis module is configured to analyze the sensing data to obtain a matching control instruction, including: comparing the maximum caused by the expansion or tightening action of the user's ear organ Whether the pressure difference reaches the pressure difference threshold in the preset command parameter; whether the frequency for comparing the expansion or tightening action matches the preset frequency reference value.
- the present invention provides a new human-computer interaction mode of the smart terminal, and detects the user's head motion and the ear-pair earphone through the gyroscope and the pressure sensing device in the earphone connected with the smart terminal signal.
- the tensioning action is implemented to perform a user interface operation command that is adapted to the detection signal.
- Users do not need to directly input instructions to the intelligent terminal to operate, and can also avoid the trouble of being disturbed by foreign objects and unable to transmit control signals, especially when the user is listening to audio/video or even making detailed menu selections, without touching the mobile phone for operation. It can convey relevant control commands, and with the support of existing sensing technology, it can meet the accuracy requirements of operation recognition, bringing a new and convenient operation experience to users.
- FIG. 1 is a schematic flowchart of implementing a human-computer interaction method of a smart phone according to an embodiment of the present invention
- FIG. 2 is a schematic block diagram of a human-machine interaction system of an intelligent terminal according to an embodiment of the present invention.
- a human-computer interaction method for an intelligent terminal the smart terminal establishing a wired or wireless connection with an inductive headset, the wireless connection comprising a Bluetooth connection, wherein the inductive headset is provided with a digital gyroscope and at least one pressure sensing device, the method
- the steps include:
- the digital gyroscope collects motion data during the movement of the earphone and sends it to the intelligent terminal;
- the processor of the smart terminal analyzes the motion data to obtain and executes a control instruction matching the control data, the control instruction including a movement of the focus mark on the user display interface;
- the pressure sensing device acquires the sensing signal caused by the tensioning action of the ear organ of the user, and outputs the sensing data to the intelligent terminal according to the sensing signal;
- control instruction includes the item pointed to by the focus identifier in step b (the coordinate position of the focus identifier in step b is stored in the processor) ).
- the focus mark includes a cursor, a mouse pointer (including a visualized mark with directivity), and a highlighting effect of a text/symbol/graphic
- the item pointed by the focus mark includes a button, a menu option, and a link function. Text/symbol/graphic.
- Step b The processor of the intelligent terminal analyzes the motion data to obtain a matching control instruction, which is: the relative motion data (relative to the smart terminal) of the earphone is analyzed by using the smart terminal as a reference object, and the relative motion data is compared with the pre-motion data.
- the command parameters are matched to determine the control command according to the matching result; or the motion data output by the digital gyro is directly matched with the preset command parameters, and the control command is judged according to the matching result.
- the analysis of the relative motion data requires the smart terminal to simultaneously configure the digital gyroscope.
- the matching of the relative motion data or the motion data with the preset command parameters refers to comparing whether the relative motion data or the motion data is within the range of the preset command parameters.
- the step b further includes: setting a correspondence between the preset instruction parameter and the control instruction, where the preset instruction parameter includes a motion speed and an acceleration, and the motion speed and the acceleration are three-dimensional vectors.
- control instructions of step b may further include up/down/left/right panning and page turning of pages on the user display interface. That is, the user's head motion is detected by the digital gyroscope to control the up/down/left/right panning and page turning of the page.
- the sensing data of step c includes the collected pressure value and the corresponding time value.
- Step d analyzing the sensing data to obtain a matching control command includes: comparing whether a maximum pressure difference caused by an expansion or tightening action of a user's ear organ reaches a pressure difference threshold in a preset command parameter; comparing the expansion or Whether the frequency of the tightening action matches the preset frequency reference value.
- comparing whether the frequency of the expansion or tightening action matches the preset frequency reference value comprises: comparing whether the duration of the one-time expansion or tightening action matches a preset duration range, the one-time expansion or The tightening action means that the pressure value collected by the pressure sensing device fluctuates upward or downward, causing the pressure difference to rise from the pressure difference threshold in the preset command parameter to the value of the pressure difference threshold; whether the number of tensioning actions is compared Matches the preset number of tensions; compares whether the two-two interval time of the tensioning action matches the preset interval time.
- the method further includes: setting a correspondence between the preset instruction parameter and the control instruction, where the preset instruction parameter includes a pressure difference threshold, a duration range, a tensioning number, and an interval time.
- the smart terminal has a voice prompt function
- the voice function is used in combination with the gyro module and the pressure detecting module of the earphone, and the earphone outputs prompt information, such as a prompt menu option, thereby making the inventive concept
- prompt information such as a prompt menu option
- the application of the human-computer interaction method of the present invention includes selection of menu options, control of game operations, and the like. Specifically, taking the selection of menu options as an example, when the functions of the digital gyroscope and the pressure detecting device are turned on, the gyroscope detects the user's head. The forward/back/up/down/left/movement controls the position of the focus mark on the screen of the smart terminal on the mouse. When the focus mark falls on the position desired by the user, the user makes an action of expanding or contracting the ear, and the operation is detected by the pressure detecting means, triggering the menu option pointed by the focus mark, such as the trigger button 'next'. The method is applied to the game, and the movement of the game object can be controlled by the head movement, and the preset operation of the game object, such as 'shooting the shell', is controlled by the expansion or contraction action of the ear.
- the present invention further provides an implementation process of a human-computer interaction method of a smart phone according to an embodiment, and the steps thereof include:
- digital gyroscope collects motion data during the movement of the earphone
- the headset sends motion data to the smart terminal via Bluetooth
- the processor of the intelligent terminal analyzes the motion data
- step 005 determining whether the motion data matches the preset instruction parameter of the control instruction, if step 006 is performed, otherwise returning to step 002;
- the intelligent terminal executes a control instruction, and moves the focus indicator on the user display interface to a position desired by the user;
- the pressure sensing device acquires a sensing signal caused by a tensioning action of a user's ear organ
- the earphone outputs the sensing data to the smart terminal according to the sensing signal
- the processor of the smart terminal analyzes the sensing data.
- step 010 determining whether the sensing data matches the preset instruction parameter of the control instruction, if step 011 is performed, otherwise returning to step 007;
- the intelligent terminal executes a control instruction to trigger an item pointed by the focus identifier.
- the present invention also discloses a human-computer interaction system for an intelligent terminal, which includes an inductive headset and a smart terminal for establishing a wired connection or a wireless connection, and the inductive headset includes:
- connection module for transmitting data to the smart terminal by the earphone
- a gyroscope module for collecting motion data during the movement of the earphone
- a pressure detecting module configured to acquire a sensing signal caused by a tensioning action of a user's ear organ, and output sensing data according to the sensing signal
- the smart terminal includes:
- connection module configured to receive data sent by the earphone
- a motion analysis module for analyzing motion data of the gyro module to obtain a matching control command, the control command including movement of the focus mark on the user display interface
- a pressure analysis module for analyzing the sensing data of the pressure detecting module to obtain a matching control command, the control command comprising triggering an item pointed by the focus mark on the user display interface;
- An execution module for executing the control instruction.
- the focus mark includes a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic
- the item pointed by the focus mark includes a button, a menu option, and a text/symbol/graphic with a link function.
- the motion analysis module is used to analyze the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter, and the matching result is judged according to the matching result.
- Control command or directly match the motion data output by the digital gyroscope with the preset command parameters, and judge the control command according to the matching result.
- the sensing data includes the collected pressure value and the corresponding time value
- the pressure analysis module is configured to analyze the sensing data to obtain a matching control instruction, including: comparing the maximum caused by the expansion or tightening action of the user's ear organ Whether the pressure difference reaches the pressure difference threshold in the preset command parameter; whether the frequency for comparing the expansion or tightening action matches the preset frequency reference value.
- the human-machine interaction system of the present invention further includes an instruction parameter preset module in the smart terminal, configured to set a correspondence between the preset instruction parameter and each control instruction.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
A man-machine interaction method and system of an intelligent terminal, the intelligent terminal establishing a wired or wireless connection with an inductive earphone, the method comprising the following steps: a digital gyroscope within the earphone acquires the motion data generated during movement of the earphone and transmits the motion data to the intelligent terminal; the intelligent terminal analyzes the motion data to obtain a matched control instruction and executes the control instruction, the control instruction comprising the movement of a focus identifier on a user display interface; a pressure inductive device within the earphone acquires an inductive signal induced by the tensioning movement of an ear organ of a user, and outputs the inductive data to the intelligent terminal according to the inductive signal; the intelligent terminal analyzes the inductive data to obtain a matched control instruction and executes the control instruction, the control instruction comprising triggering an item pointed by the focus identifier. The inductive earphone detects the head movement of the user and the tensioning movement applied to the earphone by the ear portion of the user, such that when a user is enjoying an audio/video or even choosing from specific menu options, the user can communicate a related operation and control instruction without touching a mobile phone to perform any operation.
Description
技术领域 Technical field
本发明涉及人机交互技术领域，尤其涉及一种智能终端的人机交互方法及系统。 The present invention relates to the field of human-computer interaction technologies, and in particular, to a human-computer interaction method and system for an intelligent terminal.
背景技术 Background technique
随着电子产品技术的发展，智能手机、平板电脑等智能终端已经成为人们日常生活中很常见的产品。由于人们对设备的智能化要求越来越高目前，对人机交互的操作体验的改善往往成为开发者越来越重视的要素。目前广泛应用的触屏技术及日渐成熟的语音控制技术、人脸识别技术等均已应用于智能终端领域，极大地提高了人机交互的便捷性。以触摸屏手机为例，其取代了机械按键这种较为不便的操作方式，但是仍然需要保持与终端的接触才能实现对其操纵。而语音控制技术的应用往往受到硬件条件的限制，要求操作者与控制对象之间保持无阻碍的一定距离以保证语音信号的准确识别，人脸识别技术需要设备开启摄像头而且对准人脸才能准确识别。因而，在实际使用中，当用户不愿或者不能用手部实施各种操作时，以上所提及的人机交互技术常常无法满足用户的操作要求，准确地达到用户期望的操作效果，给用户以不够便利的不良操作体验。
With the development of electronic product technology, smart terminals such as smart phones and tablet computers have become very common products in people's daily lives. Due to the increasing demand for intelligent devices, the improvement of the operational experience of human-computer interaction has often become an increasingly important factor for developers. At present, the widely used touch screen technology and the increasingly mature voice control technology and face recognition technology have been applied to the field of intelligent terminals, which greatly improves the convenience of human-computer interaction. Taking a touch screen mobile phone as an example, it replaces the inconvenient operation mode of the mechanical button, but it is still necessary to maintain contact with the terminal to achieve its manipulation. The application of voice control technology is often limited by hardware conditions, requiring an unobstructed distance between the operator and the control object to ensure accurate recognition of the voice signal. Face recognition technology requires the device to turn on the camera and aim at the face to be accurate. Identification. Therefore, in actual use, when the user is unwilling or unable to perform various operations by hand, the above-mentioned human-computer interaction technology often fails to meet the user's operation requirements, accurately achieves the user's desired operational effect, and gives the user A bad operating experience that is not convenient enough.
发明内容 Summary of the invention
为了克服上述所指的现有技术中的不足之处，本发明提供一种新型的智能终端的人机交互方法及系统，以使用户在欣赏音/视频甚至在进行详细的菜单选择时，不需要接触手机进行操作即可传达相关操控指令。
In order to overcome the deficiencies in the prior art referred to above, the present invention provides a novel human-computer interaction method and system for a smart terminal, so that the user does not enjoy the audio/video even when making detailed menu selections. You need to touch the phone to operate and communicate the relevant control commands.
本发明是通过以下技术方案实现的： The invention is achieved by the following technical solutions:
一种智能终端的人机交互方法，所述智能终端与一感应耳机建立有线或无线连接，该感应耳机上设置数字陀螺仪及至少一压力感应装置，所述方法的步骤包括：
A human-computer interaction method for a smart terminal, wherein the smart terminal establishes a wired or wireless connection with an inductive headset, and the digital inductive device and the at least one pressure sensing device are disposed on the inductive headset, the steps of the method comprising:
a 、数字陀螺仪采集耳机运动过程中的运动数据并发送至智能终端； a, the digital gyroscope collects motion data during the movement of the earphone and sends it to the intelligent terminal;
b
、智能终端的处理器分析运动数据得到与之相匹配的控制指令并执行，所述控制指令包括用户显示界面上的聚焦标识的移动；b
The processor of the smart terminal analyzes the motion data to obtain and executes a control instruction matching the control data, the control instruction including a movement of the focus mark on the user display interface;
c 、压力感应装置获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据至智能终端； c, the pressure sensing device acquires the sensing signal caused by the tensioning action of the ear organ of the user, and outputs the sensing data to the intelligent terminal according to the sensing signal;
d
、分析所述感应数据得到与之相匹配的控制指令并执行，所述控制指令包括触发步骤b中的聚焦标识所指向的项目。 d
And analyzing the sensing data to obtain and execute a control instruction matching the control data, the control instruction comprising triggering an item pointed by the focus indicator in step b.
进一步地，所述聚焦标识包括但不限于光标、鼠标指针及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括但不限于按钮、菜单选项、具链接功能的文字/符号/图形。
Further, the focus mark includes, but is not limited to, a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic, and the item pointed by the focus mark includes but is not limited to a button, a menu option, a text/symbol with a link function/ Graphics.
步骤b所述智能终端的处理器分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据，将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。
Step b: The processor of the smart terminal analyzes the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter. The control instruction is judged according to the matching result; or the motion data output by the digital gyro is directly matched with the preset instruction parameter, and the control instruction is judged according to the matching result.
步骤b所述控制指令还可包括用户显示界面上的页面的上/下/左/右平移及翻页。 The control instruction of step b may further include up/down/left/right translation and page turning of the page on the user display interface.
步骤c所述感应数据包括采集的压力值及相应时间值。 The sensing data of step c includes the collected pressure value and the corresponding time value.
步骤d分析所述感应数据得到与之相匹配的控制指令包括：比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。
Step d analyzing the sensing data to obtain a matching control command includes: comparing whether a maximum pressure difference caused by an expansion or tightening action of a user's ear organ reaches a pressure difference threshold in a preset command parameter; comparing the expansion or Whether the frequency of the tightening action matches the preset frequency reference value.
本发明还公开了一种智能终端的人机交互系统，包括建立有线连接或无线连接的感应耳机与智能终端，所述感应耳机包括：
The invention also discloses a human-computer interaction system for an intelligent terminal, comprising an inductive earphone and a smart terminal for establishing a wired connection or a wireless connection, the induction earphone comprising:
一连接模块，用于耳机将数据发送至智能终端； a connection module for transmitting data to the smart terminal by the earphone;
一陀螺仪模块，用于采集耳机运动过程中的运动数据； a gyroscope module for collecting motion data during the movement of the earphone;
一压力检测模块，用于获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据； a pressure detecting module, configured to acquire a sensing signal caused by a tensioning action of a user's ear organ, and output sensing data according to the sensing signal;
所述智能终端包括： The smart terminal includes:
一连接模块，用于接收耳机发送的数据； a connection module, configured to receive data sent by the earphone;
一运动分析模块，用于分析陀螺仪模块的运动数据得到与之相匹配的控制指令，该控制指令包括用户显示界面上的聚焦标识的移动；
a motion analysis module for analyzing motion data of the gyro module to obtain a matching control command, the control command including movement of the focus mark on the user display interface;
一压力分析模块，用于分析压力检测模块的感应数据得到与之相匹配的控制指令，所述控制指令包括触发用户显示界面上的聚焦标识所指向的项目；
a pressure analysis module for analyzing the sensing data of the pressure detecting module to obtain a matching control command, the control command comprising triggering an item pointed by the focus mark on the user display interface;
一执行模块，用于执行所述控制指令。 An execution module for executing the control instruction.
进一步地，所述聚焦标识包括光标、鼠标指针及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括按钮、菜单选项、具链接功能的文字/符号/图形。
Further, the focus mark includes a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic, and the item pointed by the focus mark includes a button, a menu option, and a text/symbol/graphic with a link function.
运动分析模块用于分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据，将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。
The motion analysis module is used to analyze the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter, and the matching result is judged according to the matching result. Control command; or directly match the motion data output by the digital gyroscope with the preset command parameters, and judge the control command according to the matching result.
所述感应数据包括采集的压力值及相应时间值，所述压力分析模块用于分析感应数据得到与之相匹配的控制指令包括：用于比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；用于比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。
The sensing data includes the collected pressure value and the corresponding time value, and the pressure analysis module is configured to analyze the sensing data to obtain a matching control instruction, including: comparing the maximum caused by the expansion or tightening action of the user's ear organ Whether the pressure difference reaches the pressure difference threshold in the preset command parameter; whether the frequency for comparing the expansion or tightening action matches the preset frequency reference value.
与现有技术相比，本发明提供了一种新的智能终端的人机交互方式，通过与智能终端信号连接的耳机内的陀螺仪及压力感应装置检测用户的头部动作及耳部对耳机实施的张紧动作，从而执行与检测信号相适应的用户界面操作指令。用户无需直接面向智能终端操作来输入指令，也可避免受到外物干扰而无法传递控制信号的困扰，尤其是当用户在欣赏音/视频甚至进行详细的菜单选择时，不需要接触手机进行操作即可传达相关操控指令，而且在现有的传感技术支持下，能达到操作识别的准确度要求，给用户带来全新的便捷的操作体验。
Compared with the prior art, the present invention provides a new human-computer interaction mode of the smart terminal, and detects the user's head motion and the ear-pair earphone through the gyroscope and the pressure sensing device in the earphone connected with the smart terminal signal. The tensioning action is implemented to perform a user interface operation command that is adapted to the detection signal. Users do not need to directly input instructions to the intelligent terminal to operate, and can also avoid the trouble of being disturbed by foreign objects and unable to transmit control signals, especially when the user is listening to audio/video or even making detailed menu selections, without touching the mobile phone for operation. It can convey relevant control commands, and with the support of existing sensing technology, it can meet the accuracy requirements of operation recognition, bringing a new and convenient operation experience to users.
附图说明 DRAWINGS
附图1为本发明一种实施例的智能手机的人机交互方法的实现流程示意图； 1 is a schematic flowchart of implementing a human-computer interaction method of a smart phone according to an embodiment of the present invention;
附图2为本发明一种实施例的智能终端的人机交互系统的构成简图。 2 is a schematic block diagram of a human-machine interaction system of an intelligent terminal according to an embodiment of the present invention.
具体实施方式 detailed description
为了便于本领域技术人员的理解，下面结合附图对本发明作进一步的描述。 In order to facilitate the understanding of those skilled in the art, the present invention will be further described below in conjunction with the accompanying drawings.
一种智能终端的人机交互方法，所述智能终端与一感应耳机建立有线或无线连接，所述无线连接包括蓝牙连接，该感应耳机上设置数字陀螺仪及至少一压力感应装置，所述方法的步骤包括：
A human-computer interaction method for an intelligent terminal, the smart terminal establishing a wired or wireless connection with an inductive headset, the wireless connection comprising a Bluetooth connection, wherein the inductive headset is provided with a digital gyroscope and at least one pressure sensing device, the method The steps include:
a 、数字陀螺仪采集耳机运动过程中的运动数据并发送至智能终端； a, the digital gyroscope collects motion data during the movement of the earphone and sends it to the intelligent terminal;
b
、智能终端的处理器分析运动数据得到与之相匹配的控制指令并执行，所述控制指令包括用户显示界面上的聚焦标识的移动； b
The processor of the smart terminal analyzes the motion data to obtain and executes a control instruction matching the control data, the control instruction including a movement of the focus mark on the user display interface;
c 、压力感应装置获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据至智能终端； c, the pressure sensing device acquires the sensing signal caused by the tensioning action of the ear organ of the user, and outputs the sensing data to the intelligent terminal according to the sensing signal;
d
、分析所述感应数据得到与之相匹配的控制指令并执行，所述控制指令包括触发步骤b中的聚焦标识所指向的项目（所述步骤b中的聚焦标识的坐标位置储存于处理器中）。 d
And analyzing the sensing data to obtain a matching control instruction, where the control instruction includes the item pointed to by the focus identifier in step b (the coordinate position of the focus identifier in step b is stored in the processor) ).
进一步地，所述聚焦标识包括光标、鼠标指针（包括具有指向性的形象化标识）及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括按钮、菜单选项、具链接功能的文字/符号/图形。
Further, the focus mark includes a cursor, a mouse pointer (including a visualized mark with directivity), and a highlighting effect of a text/symbol/graphic, and the item pointed by the focus mark includes a button, a menu option, and a link function. Text/symbol/graphic.
步骤b所述智能终端的处理器分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据（相对于智能终端），将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。该相对运动数据的分析要求智能终端同时配置数字陀螺仪。上述将该相对运动数据或运动数据与预设指令参数进行匹配是指比较判断相对运动数据或运动数据是否在预设指令参数的范围内。
Step b: The processor of the intelligent terminal analyzes the motion data to obtain a matching control instruction, which is: the relative motion data (relative to the smart terminal) of the earphone is analyzed by using the smart terminal as a reference object, and the relative motion data is compared with the pre-motion data. The command parameters are matched to determine the control command according to the matching result; or the motion data output by the digital gyro is directly matched with the preset command parameters, and the control command is judged according to the matching result. The analysis of the relative motion data requires the smart terminal to simultaneously configure the digital gyroscope. The matching of the relative motion data or the motion data with the preset command parameters refers to comparing whether the relative motion data or the motion data is within the range of the preset command parameters.
所述步骤b之前还包括：设置预设指令参数与控制指令的对应关系，所述预设指令参数包括运动速度及加速度，该运动速度及加速度为三维矢量。
The step b further includes: setting a correspondence between the preset instruction parameter and the control instruction, where the preset instruction parameter includes a motion speed and an acceleration, and the motion speed and the acceleration are three-dimensional vectors.
在本发明的其他实施例中，步骤b所述控制指令还可包括用户显示界面上的页面的上/下/左/右平移及翻页。即通过数字陀螺仪检测用户的头部动作从而控制页面的上/下/左/右平移及翻页。
In other embodiments of the invention, the control instructions of step b may further include up/down/left/right panning and page turning of pages on the user display interface. That is, the user's head motion is detected by the digital gyroscope to control the up/down/left/right panning and page turning of the page.
步骤c所述感应数据包括采集的压力值及相应时间值。 The sensing data of step c includes the collected pressure value and the corresponding time value.
步骤d分析所述感应数据得到与之相匹配的控制指令包括：比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。具体地，比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配包括：比较一次扩张或收紧动作的持续时间是否与预设的持续时间范围相匹配，所述一次扩张或收紧动作是指压力感应装置所采集的压力值向上或下波动致使压力差自上升达到预设指令参数中的压力差阀值至下降达到该压力差阀值止；比较张紧动作的次数是否与预设张紧次数相匹配；比较张紧动作的两两相隔时间是否与预设间隔时间相匹配。
Step d analyzing the sensing data to obtain a matching control command includes: comparing whether a maximum pressure difference caused by an expansion or tightening action of a user's ear organ reaches a pressure difference threshold in a preset command parameter; comparing the expansion or Whether the frequency of the tightening action matches the preset frequency reference value. Specifically, comparing whether the frequency of the expansion or tightening action matches the preset frequency reference value comprises: comparing whether the duration of the one-time expansion or tightening action matches a preset duration range, the one-time expansion or The tightening action means that the pressure value collected by the pressure sensing device fluctuates upward or downward, causing the pressure difference to rise from the pressure difference threshold in the preset command parameter to the value of the pressure difference threshold; whether the number of tensioning actions is compared Matches the preset number of tensions; compares whether the two-two interval time of the tensioning action matches the preset interval time.
所述步骤d之前，还包括：设置预设指令参数与控制指令的对应关系，所述预设指令参数包括压力差阀值、持续时间范围、张紧次数、间隔时间。
Before the step d, the method further includes: setting a correspondence between the preset instruction parameter and the control instruction, where the preset instruction parameter includes a pressure difference threshold, a duration range, a tensioning number, and an interval time.
在本发明的较佳实施例中，所述智能终端具有语音提示功能，通过语音功能与耳机的陀螺仪模块和压力检测模块结合使用，耳机输出提示信息，比如提示菜单选项，从而使本发明构思下的人机交互形式更为灵活、多样化。
In a preferred embodiment of the present invention, the smart terminal has a voice prompt function, and the voice function is used in combination with the gyro module and the pressure detecting module of the earphone, and the earphone outputs prompt information, such as a prompt menu option, thereby making the inventive concept The human-computer interaction form is more flexible and diverse.
本发明的人机交互方法的应用包括菜单选项的选取、游戏操作的控制等，具体地，以菜单选项的选取为例，当数字陀螺仪和压力检测装置功能开启后，陀螺仪检测用户头部的向前/后/上/下/左/运动，控制智能终端屏幕上鼠标等聚焦标识的位置。当该聚焦标识落在了用户期望的位置后，用户作出扩张或收缩耳朵的动作，通过压力检测装置检测到此操作，触发聚焦标识所指向的菜单选项，比如触发按钮'下一张'。而本方法应用于游戏中，可通过头部运动来控制游戏对象的走位，以及通过耳朵的扩张或收缩动作控制游戏对象的预设操作，比如'射击炮弹'。
The application of the human-computer interaction method of the present invention includes selection of menu options, control of game operations, and the like. Specifically, taking the selection of menu options as an example, when the functions of the digital gyroscope and the pressure detecting device are turned on, the gyroscope detects the user's head. The forward/back/up/down/left/movement controls the position of the focus mark on the screen of the smart terminal on the mouse. When the focus mark falls on the position desired by the user, the user makes an action of expanding or contracting the ear, and the operation is detected by the pressure detecting means, triggering the menu option pointed by the focus mark, such as the trigger button 'next'. The method is applied to the game, and the movement of the game object can be controlled by the head movement, and the preset operation of the game object, such as 'shooting the shell', is controlled by the expansion or contraction action of the ear.
具体地，如附图1所示，以智能手机为例，本发明还提供了一种实施例的智能手机的人机交互方法的实现流程，其步骤包括：
Specifically, as shown in FIG. 1 , taking a smart phone as an example, the present invention further provides an implementation process of a human-computer interaction method of a smart phone according to an embodiment, and the steps thereof include:
001 、开启耳机的数字陀螺仪及压力感应装置功能； 001, digital gyro and pressure sensing device function for turning on the headset;
002 、数字陀螺仪采集耳机运动过程中的运动数据； 002, digital gyroscope collects motion data during the movement of the earphone;
003 、耳机通过蓝牙发送运动数据至智能终端； 003, the headset sends motion data to the smart terminal via Bluetooth;
004 、智能终端的处理器分析运动数据； 004, the processor of the intelligent terminal analyzes the motion data;
005 、判断运动数据是否与控制指令的预设指令参数相匹配，若是执行步骤006，否则返回步骤002； 005, determining whether the motion data matches the preset instruction parameter of the control instruction, if step 006 is performed, otherwise returning to step 002;
006 、智能终端执行控制指令，移动用户显示界面上的聚焦标识至用户所期望的位置； 006. The intelligent terminal executes a control instruction, and moves the focus indicator on the user display interface to a position desired by the user;
007 、压力感应装置获取由用户耳器官的张紧动作引起的感应信号； 007, the pressure sensing device acquires a sensing signal caused by a tensioning action of a user's ear organ;
008 、耳机根据感应信号输出感应数据至智能终端； 008, the earphone outputs the sensing data to the smart terminal according to the sensing signal;
009 、智能终端的处理器分析所述感应数据； 009. The processor of the smart terminal analyzes the sensing data.
010 、判断感应数据是否与控制指令的预设指令参数相匹配，若是执行步骤011，否则返回步骤007； 010, determining whether the sensing data matches the preset instruction parameter of the control instruction, if step 011 is performed, otherwise returning to step 007;
011 、智能终端执行控制指令，触发聚焦标识所指向的项目。 011. The intelligent terminal executes a control instruction to trigger an item pointed by the focus identifier.
如附图2所示，本发明还公开了本发明还公开了一种智能终端的人机交互系统，包括建立有线连接或无线连接的感应耳机与智能终端，所述感应耳机包括：
As shown in FIG. 2, the present invention also discloses a human-computer interaction system for an intelligent terminal, which includes an inductive headset and a smart terminal for establishing a wired connection or a wireless connection, and the inductive headset includes:
一连接模块，用于耳机将数据发送至智能终端； a connection module for transmitting data to the smart terminal by the earphone;
一陀螺仪模块，用于采集耳机运动过程中的运动数据； a gyroscope module for collecting motion data during the movement of the earphone;
一压力检测模块，用于获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据； a pressure detecting module, configured to acquire a sensing signal caused by a tensioning action of a user's ear organ, and output sensing data according to the sensing signal;
所述智能终端包括： The smart terminal includes:
一连接模块，用于接收耳机发送的数据； a connection module, configured to receive data sent by the earphone;
一运动分析模块，用于分析陀螺仪模块的运动数据得到与之相匹配的控制指令，该控制指令包括用户显示界面上的聚焦标识的移动；
a motion analysis module for analyzing motion data of the gyro module to obtain a matching control command, the control command including movement of the focus mark on the user display interface;
一压力分析模块，用于分析压力检测模块的感应数据得到与之相匹配的控制指令，所述控制指令包括触发用户显示界面上的聚焦标识所指向的项目；
a pressure analysis module for analyzing the sensing data of the pressure detecting module to obtain a matching control command, the control command comprising triggering an item pointed by the focus mark on the user display interface;
一执行模块，用于执行所述控制指令。 An execution module for executing the control instruction.
进一步地，所述聚焦标识包括光标、鼠标指针及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括按钮、菜单选项、具链接功能的文字/符号/图形。
Further, the focus mark includes a highlight effect of a cursor, a mouse pointer, and a text/symbol/graphic, and the item pointed by the focus mark includes a button, a menu option, and a text/symbol/graphic with a link function.
运动分析模块用于分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据，将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。
The motion analysis module is used to analyze the motion data to obtain a matching control instruction, which is: the relative motion data of the earphone is obtained by analyzing the smart terminal as a reference object, and the relative motion data is matched with the preset instruction parameter, and the matching result is judged according to the matching result. Control command; or directly match the motion data output by the digital gyroscope with the preset command parameters, and judge the control command according to the matching result.
所述感应数据包括采集的压力值及相应时间值，所述压力分析模块用于分析感应数据得到与之相匹配的控制指令包括：用于比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；用于比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。
The sensing data includes the collected pressure value and the corresponding time value, and the pressure analysis module is configured to analyze the sensing data to obtain a matching control instruction, including: comparing the maximum caused by the expansion or tightening action of the user's ear organ Whether the pressure difference reaches the pressure difference threshold in the preset command parameter; whether the frequency for comparing the expansion or tightening action matches the preset frequency reference value.
进一步地，本发明的人机交互系统还包括智能终端内的指令参数预设模块，用于设置预设指令参数与各控制指令的对应关系。
Further, the human-machine interaction system of the present invention further includes an instruction parameter preset module in the smart terminal, configured to set a correspondence between the preset instruction parameter and each control instruction.
以上内容是结合具体的优选方式对本发明所作的进一步详细说明，不应认定本发明的具体实施只局限于以上说明。对于本技术领域的技术人员而言，在不脱离本发明构思的前提下，还可以作出若干简单推演或替换，均应视为由本发明所提交的权利要求确定的保护范围之内。
The above is a further detailed description of the present invention in combination with the specific preferred embodiments, and the specific embodiments of the present invention are not limited to the above description. It will be apparent to those skilled in the art that <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt;
Claims (10)
- 一种智能终端的人机交互方法，所述智能终端与一感应耳机建立有线或无线连接，该感应耳机上设置数字陀螺仪及至少一压力感应装置，所述方法的步骤包括：A human-computer interaction method for a smart terminal, wherein the smart terminal establishes a wired or wireless connection with an inductive headset, and the digital inductive device and the at least one pressure sensing device are disposed on the inductive headset, the steps of the method comprising:a 、数字陀螺仪采集耳机运动过程中的运动数据并发送至智能终端；a, the digital gyroscope collects motion data during the movement of the earphone and sends it to the intelligent terminal;b 、智能终端的处理器分析运动数据得到与之相匹配的控制指令并执行，所述控制指令包括用户显示界面上的聚焦标识的移动；b The processor of the smart terminal analyzes the motion data to obtain and executes a control instruction matching the control data, the control instruction including a movement of the focus mark on the user display interface;c 、压力感应装置获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据至智能终端；c The pressure sensing device acquires the sensing signal caused by the tensioning action of the ear organ of the user, and outputs the sensing data to the intelligent terminal according to the sensing signal;d 、分析所述感应数据得到与之相匹配的控制指令并执行，所述控制指令包括触发步骤b中的聚焦标识所指向的项目。d And analyzing the sensing data to obtain and execute a control instruction matching the control data, the control instruction comprising triggering an item pointed by the focus indicator in step b.
- 根据权利要求1所述的智能终端的人机交互方法，其特征在于：所述聚焦标识包括光标、鼠标指针及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括按钮、菜单选项、具链接功能的文字/符号/图形。The human-computer interaction method of the smart terminal according to claim 1, wherein the focus mark comprises a cursor, a mouse pointer and a highlighting effect of a text/symbol/graphic, and the item pointed by the focus mark comprises a button and a menu. Options, text/symbol/graphics with link function.
- 根据权利要求2所述的智能终端的人机交互方法，其特征在于，步骤b所述智能终端的处理器分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据，将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。The human-computer interaction method of the smart terminal according to claim 2, wherein the processor of the intelligent terminal in step b analyzes the motion data to obtain a matching control instruction, which is: the smart terminal is used as a reference object for analysis. The relative motion data of the earphone, the relative motion data is matched with the preset instruction parameter, and the control instruction is judged according to the matching result; or the motion data output by the digital gyro is directly matched with the preset instruction parameter, and the control instruction is judged according to the matching result. .
- 根据权利要求3所述的智能终端的人机交互方法，其特征在于：步骤b所述控制指令还包括用户显示界面上的页面的上/下/左/右平移及翻页。The human-computer interaction method of the smart terminal according to claim 3, wherein the control instruction of step b further comprises: up/down/left/right translation and page turning of the page on the user display interface.
- 根据权利要求3所述的智能终端的人机交互方法，其特征在于：步骤c所述感应数据包括采集的压力值及相应时间值。 The human-computer interaction method of the smart terminal according to claim 3, wherein the sensing data in step c comprises the collected pressure value and the corresponding time value.
- 根据权利要求5所述的智能终端的人机交互方法，其特征在于，步骤d分析所述感应数据得到与之相匹配的控制指令包括：The human-computer interaction method of the smart terminal according to claim 5, wherein the step d analyzing the sensing data to obtain a matching control instruction comprises:比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；Comparing whether the maximum pressure difference caused by the expansion or tightening action of the user's ear organ reaches the pressure difference threshold in the preset command parameter;比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。Compare whether the frequency of the expansion or tightening action matches the preset frequency reference value.
- 一种智能终端的人机交互系统，包括建立有线连接或无线连接的感应耳机与智能终端，其特征在于，所述感应耳机包括：A human-computer interaction system for an intelligent terminal, comprising a sensor headset and a smart terminal for establishing a wired connection or a wireless connection, wherein the induction earphone comprises:一连接模块，用于耳机将数据发送至智能终端；a connection module for transmitting data to the smart terminal by the earphone;一陀螺仪模块，用于采集耳机运动过程中的运动数据；a gyroscope module for collecting motion data during the movement of the earphone;一压力检测模块，用于获取由用户耳器官的张紧动作引起的感应信号，根据该感应信号输出感应数据；a pressure detecting module, configured to acquire a sensing signal caused by a tensioning action of a user's ear organ, and output sensing data according to the sensing signal;所述智能终端包括：The smart terminal includes:一连接模块，用于接收耳机发送的数据；a connection module, configured to receive data sent by the earphone;一运动分析模块，用于分析陀螺仪模块的运动数据得到与之相匹配的控制指令，该控制指令包括用户显示界面上的聚焦标识的移动；a motion analysis module for analyzing motion data of the gyro module to obtain a matching control command, the control command including movement of the focus mark on the user display interface;一压力分析模块，用于分析压力检测模块的感应数据得到与之相匹配的控制指令，所述控制指令包括触发用户显示界面上的聚焦标识所指向的项目；a pressure analysis module for analyzing the sensing data of the pressure detecting module to obtain a matching control command, the control command comprising triggering an item pointed by the focus mark on the user display interface;一执行模块，用于执行所述控制指令。An execution module for executing the control instruction.
- 根据权利要求7所述的智能终端的人机交互系统，其特征在于：所述聚焦标识包括光标、鼠标指针及文字/符号/图形的突出显示效果，该聚焦标识所指向的项目包括按钮、菜单选项、具链接功能的文字/符号/图形。The human-computer interaction system of the smart terminal according to claim 7, wherein the focus mark comprises a highlighting effect of a cursor, a mouse pointer and a text/symbol/graphic, and the item pointed by the focus mark comprises a button and a menu. Options, text/symbol/graphics with link function.
- 根据权利要求8所述的智能终端的人机交互系统，其特征在于，运动分析模块用于分析运动数据得到与之相匹配的控制指令是指：以智能终端为参照物分析得到耳机的相对运动数据，将该相对运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令；或者直接将数字陀螺仪输出的运动数据与预设指令参数进行匹配，根据匹配结果判断控制指令。The human-computer interaction system of the smart terminal according to claim 8, wherein the motion analysis module is configured to analyze the motion data to obtain a matching control instruction, which is: the relative motion of the earphone is analyzed by using the smart terminal as a reference object. Data, the relative motion data is matched with the preset instruction parameter, and the control instruction is judged according to the matching result; or the motion data output by the digital gyro is directly matched with the preset instruction parameter, and the control instruction is judged according to the matching result.
- 根据权利要求9所述的智能终端的人机交互系统，其特征在于，所述感应数据包括采集的压力值及相应时间值，所述压力分析模块用于分析感应数据得到与之相匹配的控制指令包括：The human-computer interaction system of the smart terminal according to claim 9, wherein the sensing data comprises a collected pressure value and a corresponding time value, and the pressure analysis module is configured to analyze the sensing data to obtain a matching control. Instructions include:用于比较由于用户耳器官的扩张或收紧动作引起的最大压力差是否达到预设指令参数中的压力差阀值；For comparing whether the maximum pressure difference caused by the expansion or tightening action of the user's ear organ reaches the pressure difference threshold in the preset command parameter;用于比较该扩张或收紧动作的频次是否与预设的频次参考值相匹配。Whether the frequency for comparing the expansion or tightening action matches the preset frequency reference value.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2013100707944A CN103226436A (en) | 2013-03-06 | 2013-03-06 | Man-machine interaction method and system of intelligent terminal |
| CN201310070794.4 | 2013-03-06 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2014135023A1 true WO2014135023A1 (en) | 2014-09-12 |
Family
ID=48836909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/072586 WO2014135023A1 (en) | 2013-03-06 | 2014-02-26 | Man-machine interaction method and system of intelligent terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103226436A (en) |
| WO (1) | WO2014135023A1 (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325481A (en) * | 2015-06-30 | 2017-01-11 | 展讯通信(天津)有限公司 | A non-contact type control system and method and a mobile terminal |
| CN108269571A (en) * | 2018-03-07 | 2018-07-10 | 佛山市云米电器科技有限公司 | A kind of voice control terminal with camera function |
| CN109426498A (en) * | 2017-08-24 | 2019-03-05 | 北京迪文科技有限公司 | A kind of man-machine interactive system backstage development approach and device |
| CN114554094A (en) * | 2022-02-25 | 2022-05-27 | 深圳市豪恩声学股份有限公司 | Camera shooting control method based on headset and headset |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103226436A (en) * | 2013-03-06 | 2013-07-31 | 广东欧珀移动通信有限公司 | Man-machine interaction method and system of intelligent terminal |
| CN103543843A (en) * | 2013-10-09 | 2014-01-29 | 中国科学院深圳先进技术研究院 | Man-machine interface equipment based on acceleration sensor and man-machine interaction method |
| CN103763440A (en) * | 2014-02-19 | 2014-04-30 | 联想(北京)有限公司 | Information processing method, electronic device accessory and electronic device |
| CN104935721B (en) * | 2014-03-20 | 2018-02-13 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method and device interactive with intelligent terminal |
| CN104080022A (en) * | 2014-07-14 | 2014-10-01 | 深迪半导体(上海)有限公司 | Drive-by-wire earphone with posture control |
| CN105446467B (en) * | 2014-08-21 | 2018-08-31 | 刘小洋 | The method and apparatus that control intelligent terminal uses |
| CN105572870A (en) * | 2014-11-05 | 2016-05-11 | 优利科技有限公司 | Head-mounted display device |
| CN105867600A (en) * | 2015-11-06 | 2016-08-17 | 乐视移动智能信息技术（北京）有限公司 | Interaction method and device |
| CN105472496A (en) * | 2015-11-21 | 2016-04-06 | 惠州Tcl移动通信有限公司 | Bluetooth earphone and automatic on-off method thereof |
| CN106908642B (en) * | 2015-12-23 | 2021-05-28 | 普源精电科技股份有限公司 | Probe, oscilloscope, motion recognition system and method |
| CN105718777B (en) * | 2016-01-19 | 2018-12-25 | 宇龙计算机通信科技(深圳)有限公司 | A kind of terminal solution/screen locking method, earphone, terminal and system |
| CN112969116A (en) * | 2021-02-01 | 2021-06-15 | 深圳市美恩微电子有限公司 | Interactive control system of wireless earphone and intelligent terminal |
| CN112835453B (en) * | 2021-03-04 | 2023-05-09 | 网易（杭州）网络有限公司 | Method, apparatus and storage medium for simulating interface effect when focusing human eyes |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2293598A2 (en) * | 2009-07-31 | 2011-03-09 | Carlos De La Fe Dahlin | Menusystem |
| US20110206215A1 (en) * | 2010-02-21 | 2011-08-25 | Sony Ericsson Mobile Communications Ab | Personal listening device having input applied to the housing to provide a desired function and method |
| US20130055103A1 (en) * | 2011-08-29 | 2013-02-28 | Pantech Co., Ltd. | Apparatus and method for controlling three-dimensional graphical user interface (3d gui) |
| CN103226436A (en) * | 2013-03-06 | 2013-07-31 | 广东欧珀移动通信有限公司 | Man-machine interaction method and system of intelligent terminal |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100656523B1 (en) * | 2005-07-27 | 2006-12-11 | 삼성전자주식회사 | Method and system using human body motion |
| CN101232743A (en) * | 2007-01-24 | 2008-07-30 | 鸿富锦精密工业（深圳）有限公司 | Audio playing device and used earphone, automatic control method |
| US8098838B2 (en) * | 2008-11-24 | 2012-01-17 | Apple Inc. | Detecting the repositioning of an earphone using a microphone and associated action |
| US9000887B2 (en) * | 2009-07-23 | 2015-04-07 | Qualcomm Incorporated | Method and apparatus for communicating control information by a wearable device to control mobile and consumer electronic devices |
-
2013
- 2013-03-06 CN CN2013100707944A patent/CN103226436A/en active Pending
-
2014
- 2014-02-26 WO PCT/CN2014/072586 patent/WO2014135023A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2293598A2 (en) * | 2009-07-31 | 2011-03-09 | Carlos De La Fe Dahlin | Menusystem |
| US20110206215A1 (en) * | 2010-02-21 | 2011-08-25 | Sony Ericsson Mobile Communications Ab | Personal listening device having input applied to the housing to provide a desired function and method |
| US20130055103A1 (en) * | 2011-08-29 | 2013-02-28 | Pantech Co., Ltd. | Apparatus and method for controlling three-dimensional graphical user interface (3d gui) |
| CN103226436A (en) * | 2013-03-06 | 2013-07-31 | 广东欧珀移动通信有限公司 | Man-machine interaction method and system of intelligent terminal |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106325481A (en) * | 2015-06-30 | 2017-01-11 | 展讯通信(天津)有限公司 | A non-contact type control system and method and a mobile terminal |
| CN109426498A (en) * | 2017-08-24 | 2019-03-05 | 北京迪文科技有限公司 | A kind of man-machine interactive system backstage development approach and device |
| CN109426498B (en) * | 2017-08-24 | 2023-11-17 | 北京迪文科技有限公司 | Background development method and device for man-machine interaction system |
| CN108269571A (en) * | 2018-03-07 | 2018-07-10 | 佛山市云米电器科技有限公司 | A kind of voice control terminal with camera function |
| CN108269571B (en) * | 2018-03-07 | 2024-01-09 | 佛山市云米电器科技有限公司 | Voice control terminal with camera function |
| CN114554094A (en) * | 2022-02-25 | 2022-05-27 | 深圳市豪恩声学股份有限公司 | Camera shooting control method based on headset and headset |
| CN114554094B (en) * | 2022-02-25 | 2024-04-26 | 深圳市豪恩声学股份有限公司 | Camera shooting control method based on headset and headset |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103226436A (en) | 2013-07-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2014135023A1 (en) | Man-machine interaction method and system of intelligent terminal | |
| WO2017188801A1 (en) | Optimum control method based on multi-mode command of operation-voice, and electronic device to which same is applied | |
| WO2013048054A1 (en) | Method of operating gesture based communication channel and portable terminal system for supporting the same | |
| WO2014107005A1 (en) | Mouse function provision method and terminal implementing the same | |
| WO2014077460A1 (en) | Display device and controlling method thereof | |
| WO2016052778A1 (en) | Portable device and method for controlling same | |
| WO2014030902A1 (en) | Input method and apparatus of portable device | |
| WO2014003365A1 (en) | Method and apparatus for processing multiple inputs | |
| WO2010110573A2 (en) | Multi-telepointer, virtual object display device, and virtual object control method | |
| WO2017113807A1 (en) | Smart watch-based smart home control method and smart watch | |
| WO2015174597A1 (en) | Voice-controllable image display device and voice control method for image display device | |
| WO2018004140A1 (en) | Electronic device and operating method therefor | |
| WO2015126197A1 (en) | Apparatus and method for remote control using camera-based virtual touch | |
| EP2486663A2 (en) | Method for providing user interface and mobile terminal using the same | |
| CN111083684A (en) | Method for controlling electronic equipment and electronic equipment | |
| WO2014044063A1 (en) | Method and device for controlling touch keys | |
| WO2015137742A1 (en) | Display apparatus and controlling method thereof | |
| KR20220047624A (en) | Object positioning method and electronics | |
| WO2014178693A1 (en) | Method for matching multiple devices, device for enabling matching thereof and server system | |
| WO2021129745A1 (en) | Touch key, control method and electronic device | |
| WO2017065450A1 (en) | Display apparatus and controlling method thereof | |
| WO2014014240A1 (en) | Contact type finger mouse and operating method thereof | |
| WO2016036197A1 (en) | Hand movement recognizing device and method | |
| CN111093133B (en) | Wireless device control method, apparatus and computer readable storage medium | |
| WO2021104285A1 (en) | Application control method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14760989 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14760989 Country of ref document: EP Kind code of ref document: A1 |