WO2016054885A1

WO2016054885A1 - Operation object processing method and apparatus

Info

Publication number: WO2016054885A1
Application number: PCT/CN2015/072702
Authority: WO
Inventors: 朱燕
Original assignee: 中兴通讯股份有限公司
Priority date: 2014-10-09
Filing date: 2015-02-10
Publication date: 2016-04-14
Also published as: CN105573534A

Abstract

Disclosed are an operation object processing method and apparatus. The method comprises: receiving touch information of a terminal and voice information of the terminal; determining, on the basis of the touch information, an operation object selected by the terminal; and processing the selected operation object according to signaling identified by the voice information. The present invention solves the problem in the related art that many functions are limited due to operation performed by touch or voice alone, thereby achieving the effect of improving user experience.

Description

Processing method and device for operating object

Technical field

The present invention relates to the field of communications, and in particular to a method and apparatus for processing an operation object.

Background technique

With the rapid development of mobile communication technologies, the increase of wireless bandwidth and smart terminal screens has caused the explosion of terminal applications, and the functions of smart terminals have become more powerful and diverse. In order to more effectively transfer information between humans and computers, some interactive technologies and devices have gradually matured, such as touch, voice, and sensing devices between humans and computers. When the mobile phone hardware is almost the same, how to improve the user experience of the mobile phone is a problem that all major mobile phone manufacturers must consider.

Using touch and voice interaction, in a variety of application scenarios, the user experience can be improved. For example, in the information age, the sharing of information is everywhere. Users can share the weather with friends; they will share fresh, interesting and meaningful information, whether from Weibo, web pages or other communication platforms, to others. At present, the traditional touch interaction method requires the user to first select the information to be shared, and then select the sharing function in the function menu, and some even need the user to select the platform to be shared in the secondary menu, which is difficult to operate. At the same time, it is easy to misuse. With a single voice interaction method, to complete this function, more voice information needs to be transmitted, which will increase the difficulty of voice recognition and is not easy to identify. At present, because the mobile phone usage scene is very complicated, and the performance of speech recognition is significantly affected by factors such as speaking mode and environmental noise, speech recognition technology cannot be widely used in mobile phones.

In particular, in some scenarios where traditional touch interaction methods cannot be used, such as game mode, many scenes cannot be implemented using function menus, resulting in many functions of the game being limited, and the appeal and user experience are poor.

In view of the problem that many functions are limited by the operation of touch or voice alone in the related art, an effective solution has not been proposed yet.

Summary of the invention

The present invention provides a method and a device for processing an operation object, so as to at least solve the problem that many functions are limited by the touch or voice alone in the related art.

According to an aspect of the present invention, a method for processing an operation object is provided, including: receiving touch information of a terminal and voice information of the terminal; determining an operation object selected by the terminal according to the touch information; The signaling identified by the voice information processes the selected operation object.

Preferably, processing the selected operation object according to the signaling identified by the voice information comprises: determining whether the selected operation object is processed for the first time; and if the determination result is yes Sending prompt information to the terminal, wherein the prompt information is used to prompt the terminal to select a processing manner for processing the selected operation object; and/or, if the determination result is negative, to the The terminal feedbacks the successful processing information.

Preferably, before processing the selected operation object according to the signaling identified by the voice information, the method further includes: receiving setting information that is set by the terminal to the processing mode; The processing method is adjusted.

Preferably, before processing the selected operation object according to the signaling identified by the voice information, the method further includes:

Determining that the voice information is associated with the selected operation object, and processing the operation object associated with the voice information according to the signaling identified by the voice information.

Preferably, determining that the voice information is associated with the selected operation object comprises: determining whether the voice information includes identification information for identifying the operation object; and if the determination result is yes, determining the location The speech information is associated with the selected operational object.

According to another aspect of the present invention, a processing apparatus for operating an object is provided, including: a first receiving module configured to receive touch information of the terminal and voice information of the terminal; and a first determining module configured to The touch information determines an operation object selected by the terminal; and the processing module is configured to process the selected operation object according to the signaling identified by the voice information.

Preferably, the processing module includes: a first determining unit configured to determine whether the selected operation object is processed for the first time; and a sending unit configured to send to the terminal if the determination result is yes a prompt information, wherein the prompt information is used to prompt the terminal to select a processing manner for processing the selected operation object; and/or, the feedback unit is set to be in the case that the determination result is negative, The information that the terminal feedback processing is successful.

Preferably, the device includes: a second receiving module, configured to receive setting information that the terminal sets the processing mode; and an adjusting module configured to adjust the processing mode according to the setting information.

Preferably, the apparatus further includes: a second determining module, configured to determine that the voice information is associated with the selected operation object, and the signaling pair identified according to the voice information is associated with the voice information The operation object is processed.

Preferably, the second determining module includes: a second determining unit, configured to determine whether the voice information includes identification information for identifying the operation object; and the determining unit is configured to: if the determination result is yes Determining that the voice information is associated with the selected one of the operational objects.

According to the present invention, the touch information of the receiving terminal and the voice information of the terminal are used; the operation object selected by the terminal is determined according to the touch information; and the selected information is determined according to the voice information. The operation object is processed to solve the problem that many functions are limited by the touch or voice operation in the related art, thereby achieving the effect of improving the user experience.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flow chart of a method of processing an operation object according to an embodiment of the present invention;

2 is a block diagram of a processing apparatus for operating an object according to an embodiment of the present invention;

3 is a block diagram 1 of a processing apparatus for operating an object in accordance with a preferred embodiment of the present invention;

4 is a block diagram 2 of a processing apparatus for operating an object in accordance with a preferred embodiment of the present invention;

Figure 5 is a block diagram 3 of a processing apparatus for operating an object in accordance with a preferred embodiment of the present invention;

Figure 6 is a block diagram 4 of a processing apparatus for operating an object in accordance with a preferred embodiment of the present invention;

7 is a flow chart of a method of processing an operational object in accordance with a preferred embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In this embodiment, a processing method of an operation object is provided. FIG. 1 is a flowchart of a processing method of an operation object according to an embodiment of the present invention. As shown in FIG. 1, the flow includes the following steps:

Step S102, receiving touch information of the terminal and voice information of the terminal;

Step S104, determining, according to the touch information, an operation object selected by the terminal;

Step S106, processing the selected operation object according to the signaling identified by the voice information.

Through the above steps, the touch information of the terminal and the voice information of the terminal are received, the operation object selected by the terminal is determined according to the touch information, the voice mailbox is identified, and the selected operation object is processed according to the identified signaling. The invention solves the problem that many functions are limited by the touch or voice operation alone in the related art, thereby achieving the effect of improving the user experience.

In this implementation, the selected operation object is processed in the following manner: first, it is determined whether the selected operation object is processed for the first time, and as a result, the prompt information is sent to the terminal, and the terminal is prompted to select the pair by the prompt information. The processing method of the selected operation object is processed; and/or, the result is not the first time, the processing is directly processed by using the previously used processing mode or the default processing mode, and the successful processing information is fed back to the terminal, by the above manner, Make sure that the selected action object is processed successfully.

In a preferred embodiment, the setting information of the processing mode is set by the receiving terminal before the selected operation object is processed according to the signaling identified by the voice information; the processing mode is adjusted according to the setting information, and then adjusted according to the setting information. The subsequent processing method processes the operation object.

In addition, before the selected operation object is processed according to the signaling identified by the voice information, the voice information may be determined in advance to be associated with the selected operation object, and the signaling pair and the voice information identified according to the voice information may be The associated operation object is processed. Of course, in addition to the above method, the determined voice information may be associated with the selected operation object, and the operation object may be preset in the terminal to allow the operation object to be processed in a naming manner of the voice information. Regardless of which of the above methods, it is ensured that the signaling included in the voice information is to process the operation object.

In this embodiment, determining that the voice information is associated with the selected operation object may include: determining whether the voice information includes identification information for identifying the operation object; and if the determination result is yes, determining the The voice information is associated with the selected operational object, and other equivalent embodiments that achieve the same effect are also within the scope of the embodiments of the present invention.

Another aspect of the embodiments of the present invention provides a processing device for operating an object, which is used to implement the above-described embodiments and preferred embodiments, and is not described again. As used below, the term "module" A block" can implement a combination of software and/or hardware for a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

2 is a block diagram of a processing device for operating an object according to an embodiment of the present invention. As shown in FIG. 2, the first receiving module 22, the first determining module 24, and the processing module 26 are described below.

The first receiving module 22 is configured to receive touch information of the terminal and voice information of the terminal;

The first determining module 24 is configured to determine, according to the touch information, an operation object selected by the terminal;

The processing module 26 is configured to process the selected operation object according to the signaling identified by the voice information.

3 is a block diagram of a processing apparatus for operating an object in accordance with a preferred embodiment of the present invention. As shown in FIG. 3, the processing module 26 includes:

The first determining unit 32 is configured to determine whether it is the first time to process the selected operation object;

The sending unit 34 is configured to: when the determination result is yes, send the prompt information to the terminal, wherein the prompt information is used to prompt the terminal to select a processing manner for processing the selected operation object; and/or,

The feedback unit 36 is configured to feed back to the terminal information that the processing is successful if the determination result is negative.

4 is a block diagram 2 of a processing apparatus for operating an object according to a preferred embodiment of the present invention. As shown in FIG. 4, the apparatus includes:

The second receiving module 42 is configured to receive first setting information that is set by the terminal for the processing mode;

The adjustment module 44 is configured to adjust the processing mode according to the setting information.

FIG. 5 is a block diagram 3 of a processing apparatus for operating an object according to a preferred embodiment of the present invention. As shown in FIG. 5, the apparatus further includes:

The second determining module 52 is configured to determine that the voice information is associated with the selected operation object, and the signaling object identified according to the voice information processes the operation object associated with the voice information.

FIG. 6 is a block diagram 4 of a processing apparatus for operating an object according to a preferred embodiment of the present invention. As shown in FIG. 6, the second determining module 52 includes:

The second determining unit 62 is configured to determine whether the voice information includes identifier information for identifying the operation object;

The determining unit 64 is arranged to determine that the voice information is associated with the selected operation object if the determination result is YES.

The embodiment further provides an operation object processing system including at least one of the above devices.

The embodiments of the present invention are further described below in conjunction with the preferred embodiments.

The embodiment of the invention provides a more convenient and friendly touch and voice interaction mode, which has a significant effect on improving the application and even the product image and increasing the selling point, and aims to improve the user experience of multiple application scenarios, specifically adopted in multiple In the application scenario, a touch-and-speech interaction mode is used instead of a single touch interaction mode, and the user selects an operation object through touch, and directly performs a related operation through a voice command. Improve the user experience without increasing hardware costs.

The following is an example of using the user sharing information as a usage scenario, including the following content: the user uses a browser (or other application) to share the current page or part of the page content; the user selects the content to be shared through the touch operation. At the same time, say "share" to determine whether the user uses voice for the first time to perform "sharing." If not, directly perform the sharing function and display the “Share Success...” prompt on the phone screen; otherwise, the phone pops up a dialog box to let the user select the default sharing method. For example, you can choose to share to WeChat circle and Sina Weibo at the same time, or only share to friends circle or Weibo, or other sharing methods; users choose a sharing method, click to confirm, perform sharing function, and the mobile screen displays “Share Success..." prompt.

The above implementation manner is to change the interaction mode of the application scenario on the basis of the original mobile phone software, and the hardware is implemented without modification, and the operation steps are reduced compared with the single touch interaction mode, thereby reducing the error operation rate; Compared with a single voice interaction method, the voice command is simplified, the difficulty of voice recognition is reduced, and the accuracy of voice recognition is improved; especially in some scenes that are not suitable for pop-up function menus (such as game mode), software can be improved. Use sex. Improve user experience in multiple scenarios without increasing hardware costs.

The following describes the embodiment in the "user sharing information" scenario.

After entering the "user sharing information" scene, it is only necessary to add a voice input function to the traditional touch input mode. Since it is pure software implementation, the system hardware does not need to be modified. When the user needs to share information, only need to select the content to be shared, input the "share" character in the voice, and then the voice recognition module can start to recognize; if it is a sharing command, determine whether the user uses the voice to perform "sharing" for the first time. If it is the first time, the phone pops up a dialog box, allowing the user to select the default sharing mode; then perform the sharing function, and the mobile phone screen The screen displays the "Share success..." prompt; if it is not a share command, it waits for the user to re-enter; until the exit application ends. It should be noted that since the voice function is newly added to the original touch system, the user can still change to the touch interaction mode at any time during the entire use process.

7 is a flowchart of a method for processing an operation object according to a preferred embodiment of the present invention. As shown in FIG. 7, the specific implementation process includes the following steps:

Step S702, the user uses a browser (or other application) to share the current page or part of the page content, and the user selects the content to be shared through the touch operation;

Step S704, the user says "share" through the voice device, and then the audio input module acquires the input audio of the user;

Step S706, the voice recognition module acquires audio data from the input module.

Step S708, identifying that the content input by the user is “sharing”;

Step S710, it is determined whether the user uses voice for the first time to perform "sharing", and if so, step S712 is performed, otherwise, step S718 is performed;

Step S712, it is determined whether the voice is used for the first time to perform the sharing, if the determination result is yes, step S714 is performed, otherwise, step S716 is performed;

Step S714, the mobile terminal pops up a dialog box, so that the user selects a default sharing mode;

Step S716, after which the voice recognition module outputs "share" and performs a sharing function;

In step S718, the voice input is awaited, and then the mobile phone screen displays a “Share Successful...” prompt.

During the above steps, the user can also set the switch of the voice function. Of course, the above description is only performed in the scenario where the user shares information. Obviously, the information sharing scenario can also be replaced with any other scenario that uses a single touch interaction mode, such as SMS forwarding, information collection, and the like.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. Perform the steps shown or described, or separate them into individual integrated circuit modules, or Multiple of these modules or steps are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

As described above, the above-mentioned embodiments and the preferred embodiments solve the problem that the functions of the related technologies are limited by the touch or the voice alone, thereby achieving the effect of improving the user experience.

Claims

A method of processing an operation object, comprising:

Receiving touch information of the terminal and voice information of the terminal;

Determining, according to the touch information, an operation object selected by the terminal;

The selected operation object is processed according to the signaling identified by the voice information.
The method of claim 1, wherein processing the selected one of the operational objects based on the signaling identified by the voice information comprises:

Determining whether it is the first time to process the selected operation object;

When the determination result is yes, the prompt information is sent to the terminal, where the prompt information is used to prompt the terminal to select a processing manner for processing the selected operation object; and/or,

If the result of the determination is negative, the information that the processing is successful is fed back to the terminal.
The method according to claim 2, wherein before the processing of the selected operation object according to the signaling identified by the voice information, the method further comprises:

Receiving setting information that the terminal sets the processing mode;

The processing mode is adjusted according to the setting information.
The method according to claim 1, wherein before the processing of the selected operation object according to the signaling identified by the voice information, the method further comprises:

Determining that the voice information is associated with the selected operation object, and processing the operation object associated with the voice information according to the signaling identified by the voice information.
The method of claim 4 wherein determining that the voice information is associated with the selected one of the operational objects comprises:

Determining whether the voice information includes identification information for identifying the operation object;

In the case where the determination result is YES, it is determined that the voice information is associated with the selected operation object.
A processing device for operating an object, comprising:

The first receiving module is configured to receive touch information of the terminal and voice information of the terminal;

The first determining module is configured to determine, according to the touch information, an operation object selected by the terminal;

The processing module is configured to process the selected operation object according to the signaling identified by the voice information.
The apparatus of claim 6 wherein said processing module comprises:

a first determining unit, configured to determine whether it is the first time to process the selected operation object;

a sending unit, configured to send, to the terminal, prompt information when the determination result is yes, wherein the prompt information is used to prompt the terminal to select a processing manner for processing the selected operation object; and/or ,

The feedback unit is configured to feed back information indicating that the processing is successful to the terminal if the determination result is negative.
The apparatus of claim 7 wherein said apparatus comprises:

a second receiving module, configured to receive setting information that is set by the terminal to the processing mode;

The adjustment module is configured to adjust the processing manner according to the setting information.
The apparatus of claim 6 wherein said apparatus further comprises:

And a second determining module, configured to determine that the voice information is associated with the selected operation object, and process the operation object associated with the voice information according to the signaling identified by the voice information.
The apparatus of claim 9, wherein the second determining module comprises:

a second determining unit, configured to determine whether the voice information includes identifier information for identifying the operation object;

The determining unit is configured to determine that the voice information is associated with the selected operation object if the determination result is YES.