WO2017101351A1 - 一种终端交互操作的方法及装置 - Google Patents

一种终端交互操作的方法及装置 Download PDF

Info

Publication number
WO2017101351A1
WO2017101351A1 PCT/CN2016/088718 CN2016088718W WO2017101351A1 WO 2017101351 A1 WO2017101351 A1 WO 2017101351A1 CN 2016088718 W CN2016088718 W CN 2016088718W WO 2017101351 A1 WO2017101351 A1 WO 2017101351A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
operation type
gesture
content
reply
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/088718
Other languages
English (en)
French (fr)
Inventor
王蕊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Original Assignee
Le Holdings Beijing Co Ltd
Leshi Zhixin Electronic Technology Tianjin Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Le Holdings Beijing Co Ltd, Leshi Zhixin Electronic Technology Tianjin Co Ltd filed Critical Le Holdings Beijing Co Ltd
Priority to US15/247,809 priority Critical patent/US20170177206A1/en
Publication of WO2017101351A1 publication Critical patent/WO2017101351A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60L—PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES; SUPPLYING ELECTRIC POWER FOR AUXILIARY EQUIPMENT OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRODYNAMIC BRAKE SYSTEMS FOR VEHICLES IN GENERAL; MAGNETIC SUSPENSION OR LEVITATION FOR VEHICLES; MONITORING OPERATING VARIABLES OF ELECTRICALLY-PROPELLED VEHICLES; ELECTRIC SAFETY DEVICES FOR ELECTRICALLY-PROPELLED VEHICLES
    • B60L2250/00—Driver interactions

Definitions

  • the present application relates to the field of information interaction processing technologies, and in particular, to a method and apparatus for terminal interaction operations.
  • the vehicle voice recognition interactive function has become a key item in vehicle configuration.
  • the vehicle voice recognition interactive function brings convenience to people and reduces the safety in the driving process.
  • Hidden dangers, mobile applications with car voice recognition capabilities are also increasingly rich, such as voice assistants.
  • the products of the traditional intelligent speech recognition products are mainly based on the accumulation of content, and the interaction is mostly in the form of dialogue.
  • this kind of user interface is not suitable for this kind of application scenario in the vehicle product.
  • the user in the driving state has more demanding information acquisition, too much redundant information, and the too complicated interactive interface will improve the user's Operating costs, which affect the normal operation of the driving state.
  • the inventor has found that the manner in which the voice assistant products in the prior art switch between the recording state and the standby state is mostly performed by clicking a trigger button, and the interface is filled with too much text information or semantics. After the content operation performed after the recognition is performed, if the user in the on-vehicle state needs to jump back to the recording state from the voice recognition result page or the semantic execution interface, the operation cost of the user is improved.
  • the purpose of the present application is to provide a method for interacting with a terminal and a device for interacting with a terminal, which are used to solve the problem that the user's operation cost is improved by returning to the destination interface in the complicated interactive interface existing in the prior art.
  • the present application discloses a method for terminal interaction operation, including:
  • the operation gesture is detected, and it is determined whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, wherein the display interface includes: detecting that after the voice input is completed in the voice recognition interface, displaying Content reply and recognition result interface or reply content full screen interface or reply content full screen extension interface;
  • An interaction operation corresponding to the operation type is performed according to the operation type.
  • an apparatus for interactive operation of a terminal including:
  • a detecting module configured to detect an operation gesture in a state of displaying the interface, and determine whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, wherein the display interface comprises: detecting a voice in the voice recognition interface After the entry is completed, the displayed content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface;
  • a determining module configured to determine, according to whether the acceleration of the downward movement according to the operation gesture exceeds a preset threshold, determine an operation type corresponding to the operation gesture
  • an execution module configured to perform an interaction operation corresponding to the operation type according to the operation type.
  • the application also discloses a device for interworking with a terminal, comprising: a memory, a processor, wherein
  • the memory is configured to store one or more instructions, wherein the one or more instructions are for execution by the processor;
  • the processor is configured to detect an operation gesture in a state of displaying the interface, and determine whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, where the display interface includes: detecting a voice recognition interface After the voice input is completed, the displayed content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface;
  • the application solves the problem of jumping from the other interface back to the recording interface in the prior art, and improving the operation cost of the user.
  • the user can directly return to the voice recognition interface through a simple operation in the state of displaying the interface, and the operation steps are simple.
  • the user's interactive operation is more convenient and quick to achieve the purpose of operation, returning to the destination interface from the complicated interactive interface, effectively reducing the user's operating cost, and does not affect the normal driving state.
  • FIG. 2 is a structural diagram of a device according to Embodiment 2 of the present application.
  • FIG. 3 is a schematic diagram of device connection according to Embodiment 3 of the present application.
  • the mode of the voice assistant product in switching between the recording state and the standby state is mostly switched by clicking a trigger button, and the interface is filled with too much text information or content operations performed after semantic recognition, excessive redundancy. The remaining information, the too complicated interactive interface will increase the user's operating cost. If the user in the vehicle state needs to jump back to the recording state from the speech recognition result page or the semantic execution interface, the operation steps are very complicated, and the operation cost of the user is improved. Therefore, the driving state is normally performed, and the user in the driving state is more demanding on the information acquisition. If the operation step of jumping back to the recording state can be simplified, the operation cost of the user is greatly reduced, and the user experience is improved.
  • the present invention will be further described in detail below with reference to the drawings and specific embodiments.
  • FIG. 1 is a flowchart of a terminal interaction operation method according to an embodiment of the present invention, as shown in FIG. 1:
  • the embodiment of the invention provides a method for interactive operation of a terminal, including:
  • Step S101 In the state of displaying the interface, detecting an operation gesture, determining whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, wherein the displaying interface includes: detecting that after the voice input is completed in the voice recognition interface, the displayed Content reply and recognition result interface or reply content full screen interface or reply content full screen extension interface;
  • the user interacts with the client in the mobile terminal.
  • the client displays the interface
  • the voice assistant displays the interface, including: content.
  • Reply and recognition result interface or reply content full screen interface or reply content full screen extension interface content reply and recognition result interface is after the voice input is completed, part of the display boundary displays the reply content generated according to the voice content, and part of the display is recognized according to the voice content.
  • the full-screen interface of the reply content displays the reply content for the display interface, and the recognition result portion is hidden.
  • the full-screen extension interface of the reply content is in the full-screen interface of the reply content, and the user slides the interface upward, and the interface continues to extend downward to display the content of the reply. Content.
  • determining the acceleration of the operation gesture sliding downward Whether the degree exceeds the preset threshold is to determine the type of operation corresponding to the operation gesture, and the preset threshold is a judgment criterion, and the operation type is determined to be a normal operation type or an acceleration operation type.
  • Step S102 determining, according to whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, determining an operation type corresponding to the operation gesture;
  • the operation type corresponding to the operation gesture is determined by the determination result in the step S101.
  • the embodiment of the present invention preferably determines the operation type corresponding to the operation gesture, and further includes: presetting the matching between the operation gesture and the operation type. Relationship; whether the acceleration sliding downward according to the operation gesture exceeds a preset threshold, and the type of operation corresponding to the operation gesture is determined in conjunction with a matching relationship between the preset operation gesture and the operation type.
  • the matching relationship between the operation gesture and the operation type may be the default factory default setting, or may be preset by the user.
  • Step S103 Perform an interaction operation corresponding to the operation type according to the operation type.
  • the interaction operation corresponding to the operation type is performed according to the operation type, and the guy operation includes, but is not limited to, the interface gradually extending from the full content extension interface to the reply content full screen interface, or from the reply content full screen interface to the content reply. And the recognition result interface, or from the content reply and recognition result interface to the speech recognition interface and the like.
  • the embodiment of the present invention preferably determines whether the type of operation corresponding to the operation gesture is determined according to whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, and further includes:
  • the acceleration of the operation gesture sliding downward does not exceed the preset threshold, and the operation type corresponding to the operation gesture is a normal operation type, and the normal operation type includes: a normal sliding operation type and a click operation type; an acceleration of the operation gesture sliding downward When the preset threshold is exceeded, the type of operation corresponding to the operation gesture is the acceleration operation type.
  • the detected acceleration of the operation gesture does not exceed the preset threshold, and the operation type is a normal operation type, that is, the user does not generate an acceleration sliding effect in the interaction operation on the display interface, and the relative displacement of the interface is relatively small, and the operation type is
  • the normal sliding operation type is performed, the interaction operation is performed according to the preset interaction operation policy, and the interface gradually displays the corresponding interface according to the interface connection strategy according to the sliding gesture.
  • the acceleration of the operation gesture sliding downward does not exceed the preset threshold, there is also a case that the operation gesture is a click operation type, and the acceleration of the downward movement of the click operation gesture does not exceed the preset threshold, and is also a normal operation type.
  • the operation type corresponding to the operation gesture is an acceleration operation type, that is, the user generates an acceleration sliding effect in the interaction operation on the display interface, and the relative displacement of the interface is relatively large.
  • the operation type is the acceleration operation type, the interface directly retreats to the speech recognition interface along with the swipe gesture.
  • the embodiment of the present invention preferably performs an interaction operation corresponding to the operation type according to the operation type, and further includes: performing an interaction operation according to the preset interaction operation policy when the operation type is a normal slide type, wherein
  • the preset interaction operation strategy includes: along with the operation gesture, the interface gradually extends from the full content extension interface of the reply content to the full screen interface of the reply content, or from the full screen interface of the reply content to the content reply and recognition result interface, or from the content reply and recognition result interface to The voice recognition interface; in the full-screen extension interface of the reply content or the full-screen interface of the reply content, when the operation type is the click operation type, the trigger button that is retained at the top edge of the interface is triggered, and the current interface directly falls back to the voice recognition interface; When the type is accelerated operation type, it is directly returned to the speech recognition interface from the current interface.
  • the acceleration of the detected operation gesture sliding downward does not exceed the preset threshold, and the operation type is a normal operation type.
  • the operation gesture the user slowly slides from the top to the bottom on the interface, and when the interface is a full screen extension interface for the reply content, the interface
  • the operation gesture gradually moves from the full-screen extension interface of the reply content to the full-screen interface of the reply content, or when the interface is a full-screen interface for replying the content, the gesture is subsequently operated, and the interface is gradually returned from the full-screen interface of the reply content to the content reply and recognition result interface, or
  • the interface is a content reply interface
  • the interface gradually moves from the content reply and recognition result interface to the voice recognition interface along with the operation gesture.
  • the operation gesture is a click operation type, and the button at the top edge of the interface is clicked, and the interface can also directly fall back from the reply content full screen extension interface or the reply content full screen interface to the speech recognition interface.
  • the interface directly retreats to the speech recognition interface along with the swipe gesture.
  • the interface directly falls back to the voice recognition interface from the excessively redundant interface, which is too complicated, which facilitates the user's operation, avoids complicated operation steps, and reduces the operation cost of the user.
  • FIG. 2 is a schematic structural diagram of a terminal interaction operation device according to an embodiment of the present invention, as shown in FIG. 2:
  • the embodiment of the invention further provides an apparatus for interactive operation of a terminal, comprising:
  • the detecting module 1 is configured to detect an operation gesture in a state of displaying the interface, and determine whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, wherein the displaying interface includes: detecting that after the voice input is completed in the voice recognition interface , the displayed content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface;
  • a determining module 2 configured to determine, according to whether the acceleration of the downward sliding according to the operation gesture exceeds a preset threshold, determine an operation type corresponding to the operation gesture
  • the execution module 3 is configured to perform an interaction operation corresponding to the operation type according to the operation type.
  • the determining module 2 is further configured to:
  • the type of operation corresponding to the operation gesture is determined in conjunction with a matching relationship between the preset operation gesture and the operation type.
  • the determining module 2 is further configured to:
  • the acceleration of the operation gesture sliding downward does not exceed the preset threshold, and the operation type corresponding to the operation gesture is a normal operation type, and the normal operation type includes: a normal sliding operation type and a click operation type;
  • the acceleration of the operation gesture sliding downward exceeds the preset threshold, and the operation type corresponding to the operation gesture is the acceleration operation type.
  • the module 3 is executed, further for:
  • the interaction operation is performed according to the preset interaction operation policy, wherein the preset interaction operation strategy includes: the interface gradually moves from the full content extension interface of the reply content to the full screen interface of the reply content, or from the reply Content full screen interface to content reply and recognition result interface, or from content reply and recognition result interface to speech recognition interface;
  • the operation type is the click operation type
  • the trigger button that is retained at the uppermost edge of the interface is triggered, and then the current interface directly falls back to the voice recognition interface
  • the operation type is the acceleration operation type, it is directly returned to the speech recognition interface from the current interface.
  • the apparatus shown in FIG. 2 can perform the method of the embodiment shown in FIG. 1 , and the implementation principle and technical effects refer to the embodiment shown in FIG. 1 and FIG. 2 , and details are not described herein again.
  • the voice assistant in the standby interface of the voice assistant, the user clicks the trigger button or the voice wakes up to enter the voice assistant's recording state, the trigger button state is switched from static to dynamic, and the volume of the input volume is synchronized with the dynamic vibration effect of the button. After the voice input is completed, the voice assistant automatically switches from the recording state to the recognition state, or the user can manually click the trigger button to actively end the voice recording state.
  • the dynamic trigger button is first moved down to the bottom of the interface, and then the white background is returned from the bottom of the interface.
  • the button indicates that the application is recognizing the voice input content of the user by another dynamic effect, and the black background portion above the button displays the recognized voice-to-text content, and the white background portion below the button displays the reply content for the user instruction.
  • the display interface is a content reply and recognition result interface.
  • the trigger button switches back to the static state, and pulls the entire content reply and the recognition result interface to move upward.
  • the text size of the black background portion becomes smaller as the black background portion decreases.
  • the trigger button moves up until it pulls to the height of two-fifths of the interface, that is, the recognition result interface (black part) accounts for two-fifths of the interface height, and the reply content interface (white part) accounts for three-fifths of the interface height.
  • the display interface is a full-screen interface for replying content.
  • the edge recognition on the interface triggers speech recognition.
  • the button the user in the state of the reply content full screen display, dragging up the interface continues to extend the content of the reply downwards, at this time, the display interface is a full screen extension interface for replying content.
  • the user drags the interface downward through the normal sliding operation type, and the interface retreats from the full-screen extension interface of the reply content to the full-screen interface of the reply content, and the top of the interface displays the top of the reply content, and the interface is restored.
  • the user continues to drag down the interface, and the recognition result interface is pulled back to the visible area.
  • the interface is the content reply and recognition result interface, and the upper part of the interface is the recognition result interface, and the lower part of the interface
  • the white part is the content reply interface.
  • the interface is a voice recognition interface.
  • the interface displays the reply content in full screen for the reply content full screen interface or the reply content full screen extension interface, directly click the button for triggering voice recognition remaining at the top edge of the interface, and directly fall back to the voice recognition state.
  • the voice assistant display interface is the content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface
  • the voice assistant display interface is the content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface
  • the user slides down with a certain acceleration on the interface, that is, the user drags the interface downward by the acceleration operation type. Then directly fall back to the speech recognition state and fall back to the speech recognition interface.
  • the method and device for interacting with a terminal solve the problem of the operation of jumping back to the recording interface from other interfaces in the prior art, and improving the operation cost of the user, and using the mobile terminal for
  • the acceleration sliding effect generated when the screen is swiped in the client interaction operation determines the relative displacement distance of the interface, thereby performing different responses.
  • the user can directly return to the voice recognition interface through a simple operation in the state of the display interface, and the operation steps are simple and convenient, and the user interaction operation is more convenient and quick to achieve the operation purpose, and returns to the destination interface from the complicated interaction interface, thereby effectively reducing
  • the user's operating cost does not affect the normal operation of the driving state, which improves the user experience.
  • An apparatus for interworking in a terminal includes: a memory 301, a processor 302, where the memory 301 is configured to store one or more instructions, where the one is Or a plurality of instructions for execution by the processor;
  • the processor 302 is configured to detect an operation gesture in a state of displaying the interface, and determine whether the acceleration of the downward movement of the operation gesture exceeds a preset threshold, where the display interface includes: detecting the voice recognition After the voice input in the interface is completed, the displayed content reply and recognition result interface or the reply content full screen interface or the reply content full screen extension interface;
  • the processor 302 is further configured to preset a matching relationship between the operation gesture and the operation type before determining an operation type corresponding to the operation gesture; Whether the acceleration of the sliding exceeds a preset threshold, and determining a type of operation corresponding to the operation gesture in combination with a matching relationship between the operation gesture and the operation type set in advance.
  • the processor 302 when determining, according to whether the acceleration of the downward movement according to the operation gesture exceeds a preset threshold, determining an operation type corresponding to the operation gesture, the processor 302 is further configured to: slide the operation gesture downward
  • the operation type corresponding to the operation gesture is a normal operation type, and the normal operation type includes: a normal sliding operation type and a click operation type; the operation gesture is downward.
  • the acceleration of the sliding exceeds the preset threshold, and the type of operation corresponding to the operation gesture is an acceleration operation type.
  • the processor 302 is further configured to: according to the preset interaction operation strategy, when the operation type is a normal sliding type Performing an interaction operation, wherein the preset interaction operation policy includes: the interface gradually moves from the reply content full screen extension interface to the reply content full screen interface, or from the reply content full screen interface to the content reply and the recognition result along with the operation gesture The interface, or the content reply and recognition result interface to the voice recognition interface; in the reply content full screen extension interface or the reply content full screen interface, when the operation type is a click operation type, triggering a trigger button remaining at the top edge of the interface, The current interface directly falls back to the voice recognition interface; when the operation type is an accelerated operation type, the current interface directly falls back to the voice recognition interface.
  • the preset interaction operation policy includes: the interface gradually moves from the reply content full screen extension interface to the reply content full screen interface, or from the reply content full screen interface to the content reply and the recognition result along with the operation gesture
  • the operation type is a click operation type, triggering a trigger button remaining at the top edge of
  • a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
  • processors CPUs
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-persistent memory, random access memory (RAM), and/or non-volatile memory in a computer readable medium, such as read only memory (ROM) or flash memory.
  • RAM random access memory
  • ROM read only memory
  • Memory is an example of a computer readable medium.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include non-transitory computer readable media, such as modulated data signals and carrier waves.
  • first device if a first device is coupled to a second device, the first device can be directly electrically coupled to the second device, or electrically coupled indirectly through other devices or coupling means. Connected to the second device.
  • the description of the specification is intended to be illustrative of the preferred embodiments of the invention. The scope of protection of the application is subject to the definition of the appended claims.
  • the method for interacting with the terminal and the device for interacting with the terminal can improve the operation cost of the user in the process of jumping from the other interface to the operation of the recording interface.
  • the user can display the interface state.
  • the simple operation returns directly to the voice recognition interface, the operation steps are simple and convenient, the user interaction operation is more convenient and quick to achieve the operation purpose, and returns to the destination interface from the complicated interaction interface, thereby effectively reducing the operation cost of the user and not affecting the driving.
  • the status is normal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

终端交互操作的方法和装置，包括：在展示界面的状态下，检测到操作手势，判断操作手势向下滑动的加速度是否超过预设阈值，其中，展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面（S101）；根据操作手势向下滑动的加速度是否超过预设阈值，确定与操作手势相对应的操作类型（S102）；根据操作类型，执行与操作类型相对应的交互操作（S103），相应地，还提供一种终端交互操作的装置，根据该技术方案，用户可以在展示界面的状态下，通过简单的操作直接返回至语音识别界面，操作简单快捷方便，有效降低用户的操作成本。

Description

一种终端交互操作的方法及装置
交叉引用
本申请引用于2015年12月18日递交的名称为“一种终端交互操作的方法及装置”的第201510960784.7号中国专利申请，其通过引用被全部并入本申请。
技术领域
本申请涉及信息交互处理技术领域，特别涉及一种终端交互操作的方法及装置。
背景技术
近年来，随着汽车技术的不断发展，车载语音识别交互功能已经成为车辆配置中关键的一项，车载语音识别交互功能在给人们带来方便的同时也减少了在行车过程中的存在的安全隐患，伴随着车载语音识别功能的移动应用产品也日益丰富，例如语音助手。然而，在现有移动应用市场中传统的智能语音识别类的产品首页以内容的堆积为主，交互多采取对话的形式进行。但这种用户界面在车载产品中并不能够很好的适用于这种应用场景，行驶状态的用户对于信息的获取要求更加苛刻，过多的冗余信息，过于复杂的交互界面都会提高用户的操作成本，从而影响驾驶状态的正常进行。
发明人在实现本发明的过程中发现，现有技术中的语音助手类产品在切换录音状态和待机状态时的方式多以点击触发按钮的方式进行，在界面中充斥着过多文字信息或语义识别之后执行的内容操作，对于车载状态的用户如果需要从语音识别结果页面或者语义执行界面跳转回到录音状态，用户的操作成本被提高。
为了使用户的交互操作更加方便快捷地达到操作目的，从繁杂交互界面中回到目的界面，并针对现有技术中的从其他界面跳转回录音界面的操作缺 陷，需要研发一种新的终端交互方法，解决上述问题。
发明内容
本申请的目的在于提供一种终端交互操作的方法及终端交互操作的装置，用以解决现有技术存在的繁杂交互界面中回到目的界面，用户的操作成本被提高的问题。
为了解决上述技术问题，本申请揭示了一种终端交互操作的方法，包括：
在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
根据所述操作类型，执行与所述操作类型相对应的交互操作。
为了解决上述技术问题，本申请还揭示了一种终端交互操作的装置，包括：
检测模块，用于在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
确定模块，用于根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
执行模块，用于根据所述操作类型，执行与所述操作类型相对应的交互操作。
本申请还揭示了一种终端交互操作的设备，包括：存储器、处理器，其中，
所述存储器，用于存储一条或多条指令，其中，所述一条或多条指令以供所述处理器调用执行；
所述处理器，用于在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
用于根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
用于根据所述操作类型，执行与所述操作类型相对应的交互操作。
与现有技术相比，本申请可以获得包括以下技术效果：
本申请解决了现有技术中的从其他界面跳转回录音界面的操作，提高用户操作成本的问题，用户可以在展示界面的状态下，通过简单的操作直接返回至语音识别界面，操作步骤简单快捷方便，用户的交互操作更加方便快捷地达到操作目的，从繁杂交互界面中回到目的界面，有效降低用户的操作成本，不影响驾驶状态的正常进行。
附图说明
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，本发明的示意性实施例及其说明用于解释本发明，并不构成对本发明的不当限定。在附图中：
图1是本申请实施例一的方法流程图；
图2是本申请实施例二的装置结构图；
图3是本申请实施例三的设备连接示意图。
具体实施方式
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述， 显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
现有技术中语音助手类产品在切换录音状态和待机状态时的方式多以点击触发按钮的方式进行切换，在界面中充斥着过多文字信息或语义识别之后执行的内容操作，过多的冗余信息，过于复杂的交互界面都会提高用户的操作成本，对于车载状态的用户如果需要从语音识别结果页面或者语义执行界面跳转回到录音状态，操作步骤非常复杂，用户的操作成本被提高，从而影响驾驶状态的正常进行，行驶状态的用户对于信息的获取要求更加苛刻，如果能将跳转回到录音状态的操作步骤简单化，将大大降低用户的操作成本，提高用户的使用体验。为使本发明的目的、技术方案和优点更加清楚，以下结合附图及具体实施例，对本发明作进一步地详细说明。
实施例一
图1为本发明实施例的终端交互操作方法的流程图，如图1所示：
本发明实施例提供一种终端交互操作的方法，包括：
步骤S101：在展示界面的状态下，检测到操作手势，判断操作手势向下滑动的加速度是否超过预设阈值，其中，展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
用户通过移动终端中的客户端进行交互操作，在客户端展示界面的状态下，例如，用户与车载语音助手进行交互操作，在语音识别界面中语音录入完成后，语音助手展示界面，包括：内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面，内容回复和识别结果界面为在语音录入完成后，显示界一部分显示根据语音内容产生的回复内容，一部分显示根据语音内容得到的识别结果，回复内容全屏界面为显示界面全部显示回复内容，识别结果部分被隐藏起来，回复内容全屏延伸界面为在回复内容全屏界面中，用户向上滑动界面，则界面继续向下延展显示回复的内容延展的内容。
在上述展示界面下，检测到操作手势后，判断操作手势向下滑动的加速 度是否超过预设阈值是为了判断与操作手势相对应的操作类型，以预设阈值为判断基准，判断操作类型是正常操作类型或者加速操作类型。
步骤S102：根据操作手势向下滑动的加速度是否超过预设阈值，确定与操作手势相对应的操作类型；
通过步骤S101中的判断结果，确定与操作手势相对应的操作类型，本发明实施例优选地，确定与操作手势相对应的操作类型，之前还包括：预先设置操作手势与操作类型之间的匹配关系；根据操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的操作手势与操作类型之间的匹配关系，确定与操作手势相对应的操作类型。操作手势与操作类型之间的匹配关系可以是默认的出厂初始设置，也可以是由用户自定义进行预先设置。
步骤S103：根据操作类型，执行与操作类型相对应的交互操作。
通过步骤S102确定操作类型后，根据操作类型执行与操作类型相对应的交互操作，家伙操作包括但不限于界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面等等。
对于步骤S102来说，本发明实施例优选地，根据操作手势向下滑动的加速度是否超过预设阈值，确定与操作手势相对应的操作类型，进一步包括：
操作手势向下滑动的加速度没有超过预设阈值，则与操作手势相对应的操作类型为正常操做类型，正常操作类型，包括：正常滑动操作类型和点击操作类型；操作手势向下滑动的加速度超过预设阈值，则与操作手势相对应的操作类型为加速操作类型。
检测到的操作手势向下滑动的加速度没有超过预设阈值，操作类型为正常操作类型，即用户在展示界面上交互操作中没有产生加速度滑动效果，界面的相对位移相对较小，在操作类型为正常滑动操作类型时，按照预设交互操作策略执行交互操作，界面随着滑动手势按照界面衔接策略逐步显示相应界面。在操作手势向下滑动的加速度没有超过预设阈值时，还存在一种情况，即为操作手势为点击操作类型，点击操作手势的向下滑动的加速度没有超过预设阈值，也属于正常操作类型。
当操作手势向下滑动的加速度超过预设阈值时，则与操作手势相对应的操作类型为加速操作类型，即用户在展示界面上交互操作中产生加速度滑动效果，界面的相对位移相对较大，在操作类型为加速操作类型时，界面随着滑动手势直接回退至语音识别界面。
对于步骤S103来说，本发明实施例优选地，根据操作类型，执行与操作类型相对应的交互操作，进一步包括：当操作类型为正常滑动类型时，按照预设交互操作策略执行交互操作，其中，预设交互操作策略包括：随着操作手势，界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；在回复内容全屏延伸界面或回复内容全屏界面下，当操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；当操作类型为加速操作类型时，则从当前界面直接回退到语音识别界面。
检测到的操作手势向下滑动的加速度没有超过预设阈值，操作类型为正常操作类型，随着操作手势，用户在界面上从上向下缓慢滑动，在界面为回复内容全屏延伸界面时，界面随着操作手势逐步从回复内容全屏延伸界面到回复内容全屏界面，或在界面为回复内容全屏界面时，随之操作手势，界面从回复内容全屏界面逐步回退到内容回复和识别结果界面，或当界面为内容回复界面时，界面随着操作手势逐步从内容回复和识别结果界面到语音识别界面。
当在回复内容全屏延伸界面或回复内容全屏界面下，操作手势为点击操作类型，点击界面最上沿的按钮，界面也可以直接从回复内容全屏延伸界面或回复内容全屏界面回退至语音识别界面。
在操作类型为加速操作类型时，界面随着滑动手势直接回退至语音识别界面。
通过简单的操作，界面从包含过多的冗余信息，过于复杂的交互界面直接回退至语音识别界面，方便了用户的操作，避免了繁杂的操作步骤，降低了用户的操作成本。
实施例二
图2为本发明实施例的终端交互操作装置结构示意图，如图2所示：
本发明实施例还提供一种终端交互操作的装置，包括：
检测模块1，用于在展示界面的状态下，检测到操作手势，判断操作手势向下滑动的加速度是否超过预设阈值，其中，展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
确定模块2，用于根据操作手势向下滑动的加速度是否超过预设阈值，确定与操作手势相对应的操作类型；
执行模块3，用于根据操作类型，执行与操作类型相对应的交互操作。
优选地，确定模块2，还用于：
预先设置操作手势与操作类型之间的匹配关系；
根据操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的操作手势与操作类型之间的匹配关系，确定与操作手势相对应的操作类型。
优选地，确定模块2，进一步用于：
操作手势向下滑动的加速度没有超过预设阈值，则与操作手势相对应的操作类型为正常操做类型，正常操作类型，包括：正常滑动操作类型和点击操作类型；
操作手势向下滑动的加速度超过预设阈值，则与操作手势相对应的操作类型为加速操作类型。
优选地，执行模块3，进一步用于：
当操作类型为正常滑动类型时，按照预设交互操作策略执行交互操作，其中，预设交互操作策略包括：随着操作手势，界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；
在回复内容全屏延伸界面或回复内容全屏界面下，当操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；
当操作类型为加速操作类型时，则从当前界面直接回退到语音识别界面。
图2所示装置可以执行图1所示实施例的方法，实现原理和技术效果参考图1以及图2所示实施例，不再赘述。
下面通过具体应用场景对本发明实施例作进一步介绍，以下应用场景仅为本发明实施例应用场景中的一部分，本非全部应用场景。
应用场景
以语音助手为例，在语音助手的待机界面，用户点击触发按钮或者语音唤醒进入到语音助手的录音状态，触发按钮状态由静态切换为动态，且录入音量的大小和按钮的动态震动效果保持同步；语音录入完成后，语音助手自动从录音状态切换到识别状态，或者用户也可以手动点击触发按钮来主动结束语音录入状态。
录音完成后，动态触发按钮先是向下移动到界面的最下端，之后从界面最下端带起白色为底色的内容回复界面。此时，按钮以另一动态效果表示应用正在识别用户的语音录入内容，按钮以上的黑色底色部分显示所识别出的语音转文字内容，按钮以下的白色底色部分显示对于用户指令的回复内容，此时，展示界面为内容回复和识别结果界面。
语音助手对于用户指令识别完毕后，触发按钮切换回静态状态，且拉动整个内容回复和识别结果界面向上移动，此时，黑色底色部分的文字字号随着黑色底色部分的减少而变小，触发按钮向上移动直至拉动到界面的五分之二高度处，即，识别结果界面(黑色部分)占界面高度的五分之二，回复内容界面(白色部分)占界面高度的五分之三。
此时，用户自下而上拖动界面则全屏显示指令回复内容，此时，展示界面为回复内容全屏界面。回复内容全屏显示后，界面上沿保留触发语音识别 的按钮，用户在回复内容全屏展示的状态下，向上拖动则界面继续向下延展回复的内容，此时，展示界面为回复内容全屏延伸界面。
用户在回复内容全屏延伸界面下，用户通过正常滑动操作类型向下拖动界面，则界面从回复内容全屏延伸界面回退至回复内容全屏界面，界面的顶端显示的是回复内容的顶端，界面恢复至回复内容全屏界面后，用户继续向下拖动界面，则识别结果界面被拉回到可视区域，此时，界面为内容回复和识别结果界面，界面上部黑色部分为识别结果界面，界面下部白色部分为内容回复界面，用户继续向下拖动，则会退到语音识别状态，此时界面为语音识别界面。同时，在界面为回复内容全屏界面或回复内容全屏延伸界面全屏显示回复内容时，直接点击保留在界面最上沿的触发语音识别的按钮，则直接回退到语音识别状态。
当语音助手展示界面为内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面时，用户在界面上以一定加速度向下滑动时，也就是用户通过加速操作类型向下拖动界面，则直接回退到语音识别状态，回退至语音识别界面。
综上所述，本发明实施例提供的一种终端交互操作的方法和装置，解决了现有技术中的从其他界面跳转回录音界面的操作，提高用户操作成本的问题，利用移动终端对于客户端交互操作中滑动屏幕时产生的加速度滑动效果，对界面的相对位移距离进行判断，从而执行不同的响应。用户可以在展示界面的状态下，通过简单的操作直接返回至语音识别界面，操作步骤简单快捷方便，用户的交互操作更加方便快捷地达到操作目的，从繁杂交互界面中回到目的界面，有效降低用户的操作成本，不影响驾驶状态的正常进行，提高了用户的使用体验。
实施例三
本申请实施例还揭示的一种终端交互操作的设备，如图3所示，包括：存储器301、处理器302，其中，所述存储器301用于存储一条或多条指令，其中，所述一条或多条指令以供所述处理器调用执行；
所述处理器302，用于在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
用于根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
用于根据所述操作类型，执行与所述操作类型相对应的交互操作。
具体的，在确定与所述操作手势相对应的操作类型之前，所述处理器302，进一步用于预先设置所述操作手势与所述操作类型之间的匹配关系；根据所述操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的所述操作手势与所述操作类型之间的匹配关系，确定与所述操作手势相对应的操作类型。
具体的，当根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型时，所述处理器302，进一步用于，所述操作手势向下滑动的加速度没有超过所述预设阈值，则与所述操作手势相对应的操作类型为正常操做类型，所述正常操作类型，包括：正常滑动操作类型和点击操作类型；所述操作手势向下滑动的加速度超过所述预设阈值，则与所述操作手势相对应的操作类型为加速操作类型。
具体的，当根据所述操作类型，执行与所述操作类型相对应的交互操作时，所述处理器302，进一步用于，当所述操作类型为正常滑动类型时，按照预设交互操作策略执行交互操作，其中，所述预设交互操作策略包括：随着所述操作手势，所述界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；在回复内容全屏延伸界面或回复内容全屏界面下，当所述操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；当所述操作类型为加速操作类型时，则从当前界面直接回退到所述语音识别界面。
本设备的技术方案和各模块的功能特征、连接方式，与图1～图2对应实 施例所描述的特征和技术方案相对应，不足之处请参见前述图1～图2对应实施例。
在一个典型的配置中，计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。
内存可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。内存是计算机可读介质的示例。
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带，磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括非暂存电脑可读媒体(transitory media)，如调制的数据信号和载波。
如在说明书及权利要求当中使用了某些词汇来指称特定组件。本领域技术人员应可理解，硬件制造商可能会用不同名词来称呼同一个组件。本说明书及权利要求并不以名称的差异来作为区分组件的方式，而是以组件在功能上的差异来作为区分的准则。如在通篇说明书及权利要求当中所提及的“包含”为一开放式用语，故应解释成“包含但不限定于”。“大致”是指在可接收的误差范围内，本领域技术人员能够在一定误差范围内解决所述技术问题，基本达到所述技术效果。此外，“耦接”一词在此包含任何直接及间接的电性耦接手段。因此，若文中描述一第一装置耦接于一第二装置，则代表所述第一装置可直接电性耦接于所述第二装置，或通过其他装置或耦接手段间接地电性耦接至所述第二装置。说明书后续描述为实施本申请的较佳实施方式，然所述描述乃以说明本申请的一般原则为目的，并非用以限定本申请的范围。 本申请的保护范围当视所附权利要求所界定者为准。
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的商品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种商品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的商品或者系统中还存在另外的相同要素。
工业实用性
通过本申请提供的终端交互操作的方法及终端交互操作的装置，从其他界面跳转回录音界面的操作的过程中，提高用户操作成本的问题，具体而言，用户可以在展示界面的状态下，通过简单的操作直接返回至语音识别界面，操作步骤简单快捷方便，用户的交互操作更加方便快捷地达到操作目的，从繁杂交互界面中回到目的界面，有效降低用户的操作成本，不影响驾驶状态的正常进行。

Claims (12)

  1. 一种终端交互操作的方法，其特征在于，包括：
    在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
    根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
    根据所述操作类型，执行与所述操作类型相对应的交互操作。
  2. 如权利要求1所述的终端交互操作的方法，其特征在于，确定与所述操作手势相对应的操作类型，之前还包括：
    预先设置所述操作手势与所述操作类型之间的匹配关系；
    根据所述操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的所述操作手势与所述操作类型之间的匹配关系，确定与所述操作手势相对应的操作类型。
  3. 如权利要求1所述的终端交互操作的方法，其特征在于，根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型，进一步包括：
    所述操作手势向下滑动的加速度没有超过所述预设阈值，则与所述操作手势相对应的操作类型为正常操做类型，所述正常操作类型，包括：正常滑动操作类型和点击操作类型；
    所述操作手势向下滑动的加速度超过所述预设阈值，则与所述操作手势相对应的操作类型为加速操作类型。
  4. 如权利要求3所述的终端交互操作的方法，其特征在于，根据所述操作类型，执行与所述操作类型相对应的交互操作，进一步包括：
    当所述操作类型为正常滑动类型时，按照预设交互操作策略执行交互操 作，其中，所述预设交互操作策略包括：随着所述操作手势，所述界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；
    在回复内容全屏延伸界面或回复内容全屏界面下，当所述操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；
    当所述操作类型为加速操作类型时，则从当前界面直接回退到所述语音识别界面。
  5. 一种终端交互操作的装置，其特征在于，包括：
    检测模块，用于在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
    确定模块，用于根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
    执行模块，用于根据所述操作类型，执行与所述操作类型相对应的交互操作。
  6. 如权利要求5所述的终端交互操作的装置，其特征在于，所述确定模块，还用于：
    预先设置所述操作手势与所述操作类型之间的匹配关系；
    根据所述操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的所述操作手势与所述操作类型之间的匹配关系，确定与所述操作手势相对应的操作类型。
  7. 如权利要求5所述的终端交互操作的装置，其特征在于，所述确定模块，进一步用于：
    所述操作手势向下滑动的加速度没有超过所述预设阈值，则与所述操作手势相对应的操作类型为正常操做类型，所述正常操作类型，包括：正常滑 动操作类型和点击操作类型；
    所述操作手势向下滑动的加速度超过所述预设阈值，则与所述操作手势相对应的操作类型为加速操作类型。
  8. 如权利要求7所述的终端交互操作的装置，其特征在于，所述执行模块，进一步用于：
    当所述操作类型为正常滑动类型时，按照预设交互操作策略执行交互操作，其中，所述预设交互操作策略包括：随着所述操作手势，所述界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；
    在回复内容全屏延伸界面或回复内容全屏界面下，当所述操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；
    当所述操作类型为加速操作类型时，则从当前界面直接回退到所述语音识别界面。
  9. 一种终端交互操作的设备，其特征在于，包括：存储器、处理器，其中，
    所述存储器，用于存储一条或多条指令，其中，所述一条或多条指令以供所述处理器调用执行；
    所述处理器，用于在展示界面的状态下，检测到操作手势，判断所述操作手势向下滑动的加速度是否超过预设阈值，其中，所述展示界面，包括：检测到在语音识别界面中语音录入完成后，显示的内容回复和识别结果界面或回复内容全屏界面或回复内容全屏延伸界面；
    用于根据所述操作手势向下滑动的加速度是否超过预设阈值，确定与所述操作手势相对应的操作类型；
    用于根据所述操作类型，执行与所述操作类型相对应的交互操作。
  10. 如权利要求9所述的设备，其特征在于，所述处理器，还用于：
    预先设置所述操作手势与所述操作类型之间的匹配关系；
    根据所述操作手势向下滑动的加速度是否超过预设阈值，结合预先设置的所述操作手势与所述操作类型之间的匹配关系，确定与所述操作手势相对应的操作类型。
  11. 如权利要求9所述的设备，其特征在于，所述处理器，进一步用于：
    所述操作手势向下滑动的加速度没有超过所述预设阈值，则与所述操作手势相对应的操作类型为正常操做类型，所述正常操作类型，包括：正常滑动操作类型和点击操作类型；
    所述操作手势向下滑动的加速度超过所述预设阈值，则与所述操作手势相对应的操作类型为加速操作类型。
  12. 如权利要求11所述的设备，其特征在于，所述处理器，进一步用于：
    当所述操作类型为正常滑动类型时，按照预设交互操作策略执行交互操作，其中，所述预设交互操作策略包括：随着所述操作手势，所述界面逐步从回复内容全屏延伸界面到回复内容全屏界面，或从回复内容全屏界面到内容回复和识别结果界面，或从内容回复和识别结果界面到语音识别界面；
    在回复内容全屏延伸界面或回复内容全屏界面下，当所述操作类型为点击操作类型时，触发保留在界面最上沿的触发按钮，则从当前界面直接回退到语音识别界面；
    当所述操作类型为加速操作类型时，则从当前界面直接回退到所述语音识别界面。
PCT/CN2016/088718 2015-12-18 2016-07-05 一种终端交互操作的方法及装置 Ceased WO2017101351A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/247,809 US20170177206A1 (en) 2015-12-18 2016-08-25 Method for interaction with terminal and electronic apparatus for the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510960784.7A CN105892799A (zh) 2015-12-18 2015-12-18 一种终端交互操作的方法及装置
CN201510960784.7 2015-12-18

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/247,809 Continuation US20170177206A1 (en) 2015-12-18 2016-08-25 Method for interaction with terminal and electronic apparatus for the same

Publications (1)

Publication Number Publication Date
WO2017101351A1 true WO2017101351A1 (zh) 2017-06-22

Family

ID=57002173

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/088718 Ceased WO2017101351A1 (zh) 2015-12-18 2016-07-05 一种终端交互操作的方法及装置

Country Status (3)

Country Link
US (1) US20170177206A1 (zh)
CN (1) CN105892799A (zh)
WO (1) WO2017101351A1 (zh)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106484232B (zh) * 2016-10-08 2019-09-24 福州市马尾区小微发明信息科技有限公司 一种界面显示系统
CN107870725A (zh) * 2017-11-30 2018-04-03 广东欧珀移动通信有限公司 录屏方法、装置及终端
CN109814964B (zh) * 2019-01-04 2024-07-19 平安科技（深圳）有限公司 一种界面展示方法、终端设备及计算机可读存储介质
CN112346621A (zh) * 2019-08-08 2021-02-09 北京车和家信息技术有限公司 一种虚拟功能按钮显示方法及装置
CN114519928B (zh) * 2020-09-25 2023-08-15 阿波罗智联(北京)科技有限公司 控制车辆的方法、装置、车辆、电子设备和介质
CN114594895A (zh) * 2022-03-08 2022-06-07 深圳创维－Rgb电子有限公司 信息交互确认方法、装置、设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102646016A (zh) * 2012-02-13 2012-08-22 北京百纳信息技术有限公司 显示手势语音交互统一界面的用户终端及其显示方法
CN103871437A (zh) * 2012-12-11 2014-06-18 比亚迪股份有限公司 车载多媒体装置及其语音控制方法
CN104090652A (zh) * 2014-06-13 2014-10-08 北京搜狗科技发展有限公司 一种语音输入方法和装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102646016A (zh) * 2012-02-13 2012-08-22 北京百纳信息技术有限公司 显示手势语音交互统一界面的用户终端及其显示方法
CN103871437A (zh) * 2012-12-11 2014-06-18 比亚迪股份有限公司 车载多媒体装置及其语音控制方法
CN104090652A (zh) * 2014-06-13 2014-10-08 北京搜狗科技发展有限公司 一种语音输入方法和装置

Also Published As

Publication number Publication date
CN105892799A (zh) 2016-08-24
US20170177206A1 (en) 2017-06-22

Similar Documents

Publication Publication Date Title
WO2017101351A1 (zh) 一种终端交互操作的方法及装置
US11955039B2 (en) Method and apparatus for controlling display in a screen projection scenario, device and program product
US20210208776A1 (en) Techniques for image-based search using touch controls
US20210096885A1 (en) User interface adaptations based on inferred content occlusion and user intent
CN106293315B (zh) 浮动窗口显示的方法和装置
JP6037973B2 (ja) ユーザ・インターフェースのための入力モード間の自動切り替え
US9632693B2 (en) Translation of touch input into local input based on a translation profile for an application
TWI587208B (zh) The method and apparatus of the page return operation
US20140372402A1 (en) Enhanced Searching at an Electronic Device
WO2018098912A1 (zh) 屏幕录像的录制、播放方法、录屏终端及播放终端
CN108064371A (zh) 一种柔性显示屏的控制方法及装置
CN109891374B (zh) 用于与数字代理的基于力的交互的方法和计算设备
US20120235933A1 (en) Mobile terminal and recording medium
CN106155524A (zh) 页面控制方法及装置
WO2022007541A1 (zh) 设备控制方法、装置、存储介质及电子设备
WO2023129821A1 (en) Methods and apparatus for related search within a browser
US20160349981A1 (en) Control system for virtual mouse and control method thereof
CN110795015A (zh) 操作提示方法、装置、设备及存储介质
KR20160020531A (ko) 테더링된 선택 핸들
US20140108982A1 (en) Object placement within interface
US20130111333A1 (en) Scaling objects while maintaining object structure
CN106815374A (zh) 一种页面跳转方法及装置
US9323452B2 (en) System and method for processing touch input
CN115390740A (zh) 设备控制方法、装置、存储介质及电子设备
CN106843559B (zh) 用户指令识别及处理方法、装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16874413

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16874413

Country of ref document: EP

Kind code of ref document: A1