WO2016045501A1

WO2016045501A1 - Search method and device

Info

Publication number: WO2016045501A1
Application number: PCT/CN2015/089110
Authority: WO
Inventors: 何柏钢
Original assignee: 阿里巴巴集团控股有限公司; 何柏钢
Priority date: 2014-09-24
Filing date: 2015-09-08
Publication date: 2016-03-31
Also published as: HK1221792A1; CN105512125A

Abstract

A search method and device, the search method comprises: detecting a gesture made with respect to terminal device by a user (101); if the gesture satisfies a preset gesture condition for activating a voice input mode, activating the voice input mode (102); receiving a voice search word input by the user in the voice input mode (103); searching according to the voice search word, and displaying search results to the user (104). The present invention allows a user to input search words quickly when a current page does not have search function, thus facilitating the improvement of search efficiency.

Description

Search method and device

[Technical Field]

The present invention relates to the field of Internet technologies, and in particular, to a search method and apparatus.

【Background technique】

With the development of Internet technology, search is the most extensive operation behavior of a user in a system or application. On the computer, the search bar is usually located at the head of the webpage, so that the user can search for the search words at any time, and the mobile terminal equipment has limited space. There will be trade-offs for functional content, so there will be other function entries in some head navigation bars. Users can't search instantly, and they need to constantly return to the page with search function to search, resulting in low search efficiency.

[Summary of the Invention]

Aspects of the present invention provide a search method and apparatus for improving search efficiency.

In an aspect of the invention, a search method is provided, comprising:

Detecting gestures issued by the user for the terminal device;

If the gesture sent by the user for the terminal device satisfies a preset gesture condition for starting the voice input mode, the voice input mode is activated;

Receiving a voice search word input by the user in the voice input mode;

Searching based on the voice search term and presenting the search result to the user.

In another aspect of the invention, a search device is provided, comprising:

a detecting module, configured to detect a gesture sent by the user for the terminal device;

a startup module, configured to start the voice input mode when a gesture of the user for the terminal device meets a preset gesture condition for starting a voice input mode;

a receiving module, configured to receive a voice search term input by the user in the voice input mode;

a search module for searching according to the voice search term and presenting the search result to the User.

According to the above technical solution, the present invention adopts a gesture initiated by the user for the terminal device to initiate a voice input mode, and in the startup voice input mode, the user inputs a voice search term, and then searches based on the voice search term and displays the search result, so that the user is based on the terminal. When searching for a device, you can input the search word without returning to the page with the search function. Instead, you can quickly input the search word by gesture and voice input, which is beneficial to improve search efficiency.

[Description of the Drawings]

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are the present invention. For some embodiments, other drawings may be obtained from those of ordinary skill in the art in light of the inventive workability.

FIG. 1 is a schematic flowchart of a search method according to an embodiment of the present invention;

2 is a schematic structural diagram of a search apparatus according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a search apparatus according to another embodiment of the present invention.

【detailed description】

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

FIG. 1 is a schematic flowchart diagram of a search method according to an embodiment of the present invention. As shown in Figure 1, the method includes:

101. Detect a gesture sent by the user for the terminal device.

102. If the gesture sent by the user for the terminal device satisfies the preset gesture condition for starting the voice input mode, the voice input mode is started.

103. Receive a voice search term input by a user in a voice input mode.

104. Search based on the above voice search words, and present the search results to the user.

The execution body of this embodiment may be a search device. Preferably, the search device may be implemented in a terminal device.

The user can perform retrieval based on the terminal device, and can be retrieved through a browser on the terminal device. In order to facilitate the user to input the search term, the terminal device of the embodiment allows the user to input the search word in a voice manner, so that the input of the search word can be separated from the search bar, so that the user does not need to return from the current page to the page with the search function to input the search word. The efficiency of inputting the search term is improved to some extent; further, the terminal device of the embodiment allows the user to initiate the voice input mode by using a gesture, without triggering a specific physical key on the terminal device as in the prior art, which makes the user not use It is also advantageous to further improve the efficiency of the user inputting the search term by the limitation of whether the physical key for starting the voice input mode is set on the terminal device.

In order to implement the above functions, the terminal device is preset with a gesture condition required for starting the voice input mode, and the voice input mode can be activated only when the gesture issued by the user satisfies the gesture condition.

Specifically, when the user needs to perform a search based on the terminal device, the searching device may detect a gesture sent by the user for the terminal device; and then determine whether the gesture sent by the user for the terminal device satisfies a preset gesture condition for starting the voice input mode, if When the gesture sent by the user for the terminal device satisfies the gesture condition, the voice input mode is activated; in the voice input mode, the user can input the search word by voice, that is, the voice search word, and the search device receives the voice input by the user in the voice input mode. Searching for a word; thereafter, the search device can recognize the voice search word as text, then search based on the recognized text, and present the search result to the user. The process of the search device identifying the voice search word as a text is actually a voice recognition technology. For the specific process, refer to the prior art, and details are not described herein.

Herein, the present embodiment does not limit the gesture for starting the voice input mode. According to use The preset gesture conditions will also differ depending on the gesture in which the voice input mode is activated. The following is an example of a gesture for triggering a voice input mode and a gesture condition.

For example, the gesture for starting the voice input mode may be a contact gesture gesture input by the user on the touch screen of the terminal device, and preset a trajectory of the gesture gesture used, for example, a linear trajectory, a curved trajectory, a circle Tracks and more. Accordingly, the gesture condition refers to information capable of recognizing a gesture for activating a voice input mode from a gesture input by the user on the touch screen of the terminal device. For example, if the gesture for starting the voice input mode is a gesture motion of a curved trajectory input by the user on the touch screen of the terminal device, the gesture condition may be a trend of the curved trajectory and a radians threshold corresponding to the curved trajectory; if used to start the voice The gesture of the input mode is a gesture motion of a circular trajectory input by the user on the touch screen of the terminal device, and the gesture condition may be the direction of the circular trajectory (for example, clockwise or counterclockwise) and the radians of the circumference, that is, 2π.

For another example, the gesture for starting the voice input mode may also be a non-contact gesture action that is sent by the user on the touch screen of the terminal device, and preset a trajectory of the gesture action used, for example, a linear trajectory or a curved trajectory. , circular tracks, and more. Accordingly, the gesture condition refers to information capable of recognizing a gesture for activating a voice input mode from a gesture issued by the user on the touch screen of the terminal device. For example, if the gesture for initiating the voice input mode is a gesture motion of a curved trajectory issued by the user on the touch screen of the terminal device, the gesture condition may be a trend of the curved trajectory and a radians threshold corresponding to the curved trajectory; if used for starting The gesture of the voice input mode is a gesture motion of a circular trajectory issued by the user on the touch screen of the terminal device, and the gesture condition may be a direction of a circular trajectory (for example, clockwise or counterclockwise) and a radians of the circumference, that is, 2π. .

For another example, the gesture for starting the voice input mode may also be a gesture generated by the user's mobile terminal device, and preset the trajectory of the mobile terminal device, for example, may be a linear trajectory, a curved trajectory, a circular trajectory, or the like. Correspondingly, the gesture condition refers to information capable of recognizing a gesture for activating a voice input mode from a gesture of the user's mobile terminal device. For example, if the gesture for initiating the voice input mode is a gesture of moving the terminal device in a straight track, the gesture condition may be a moving direction (eg top to bottom, bottom to top, left to right or right to left) And the radians of the linear trajectory, ie 0; if the gesture for starting the voice input mode is to move the terminal device with a curved trajectory Gesture, the gesture condition may be the direction of the curve trajectory and the radians threshold corresponding to the curve trajectory.

In an optional implementation manner, the gesture for starting the voice input mode is a gesture generated by the user's mobile terminal device, and the gesture generated by the user moving the terminal device specifically refers to the trajectory gradually approaching the user's mouth, and the trajectory corresponding to the trajectory is greater than A radian threshold, and the gesture that the end point of the gesture is less than the distance threshold from the user's mouth. Correspondingly, the preset gesture condition may specifically include: the trajectory gradually approaches the user's mouth, the radiance is greater than the preset radians threshold, and the distance is less than the preset distance threshold, etc., but is not limited thereto. Based on the above, the detecting the gesture sent by the user to the terminal device is specifically: detecting a gesture used by the user for the mobile terminal device by using a motion sensor (for example, a three-axis sensor) in the terminal device, wherein the motion sensor can simultaneously measure 6 The position of the direction, the movement trajectory and the acceleration, so that the user's gesture can be accurately detected. In this embodiment, the process of detecting a gesture sent by the user for the terminal device specifically refers to detecting a starting point, an ending point, and a curvature corresponding to the trajectory from the starting point to the ending point of the user's gesture for the mobile terminal device.

Based on the above, the process of determining whether the gesture issued by the user for the terminal device conforms to the preset gesture condition for initiating the voice input mode includes: the search device determining whether the trajectory of the gesture used by the user for the mobile terminal device gradually approaches the mouth of the user, and Whether the arc corresponding to the trajectory is greater than the preset radians threshold; if the judgment result is yes, that is, the trajectory gradually approaches the mouth of the user, and the arc corresponding to the trajectory is greater than the preset radians threshold, further determining that the user is used for the mobile terminal device Whether the distance from the end point of the gesture to the user's mouth is less than the preset distance threshold; if the judgment result is yes, that is, the distance from the end point of the gesture of the user for the mobile terminal device to the mouth of the user is less than the preset distance The threshold is determined to determine that the gesture used by the user for the mobile terminal device is consistent with the preset gesture condition for starting the voice input mode, and is equivalent to determining that the gesture sent by the user for the terminal device conforms to the preset gesture condition for starting the voice input mode.

Wherein, before determining whether the distance from the end point of the gesture of the user for the mobile terminal device to the mouth of the user is less than a preset distance threshold, the searching device may use the distance sensor in the terminal device to determine that the user is used for the mobile terminal device. The distance from the end point of the gesture to the user's mouth. Specifically, the search device may detect the physical change amount of the terminal device by the distance sensor, and convert the change amount into a distance to measure the distance displacement from the terminal device to the vicinity of the user's mouth. Mobile phone with iphone As an example, its distance sensor is located on the front of the front of the phone, in the vicinity of the handset and the front camera. As long as any part of the human body is close to this area, the distance sensor will respond.

Further, if the trajectory of the gesture used by the user for the mobile terminal device is not gradually approaching the mouth of the user, or the trajectory corresponding to the trajectory of the gesture used by the user for the mobile terminal device is less than a preset radians threshold, or the gesture used by the user for the mobile terminal device If the distance from the end point of the user to the mouth of the user is greater than the preset distance threshold, it is determined that the gesture issued by the user for the terminal device does not meet the preset gesture condition for starting the voice input mode, that is, the gesture of the user mobile terminal device is not used for Start voice input mode.

In an optional implementation manner, the searching device may detect a gesture sent by the user for the terminal device when the terminal device presents the specified page, and then start the voice input mode to receive the user input when the gesture meets the gesture condition for starting the voice input mode. Voice search terms, search based on voice search terms and display search results.

The specified page may be a page provided by the system software or the application software under the operating system, for example, a page provided by the browser, or a configuration page of the system software.

It should be noted that the method provided by this embodiment is applicable to any time and any scene. That is, at any time and in any scenario, when the user needs to perform a search, the process provided by the above method may be used for searching, and is not limited to the terminal device presenting the specified page.

In summary, the above embodiment adopts a gesture initiated by the user for the terminal device to initiate a voice input mode. In the voice input mode, the user inputs a voice search term, and then searches based on the voice search term and displays the search result, so that the user is based on the terminal device. When searching, you can input the search words without returning to the page with the search function. Instead, you can quickly input the search words by gestures and voice input, which is beneficial to improve the search efficiency. In addition, the page does not need to set the search function. Conducive to saving screen space.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. Secondly, those skilled in the art should also know that the embodiments described in the specification are In the preferred embodiment, the actions and modules involved are not necessarily required by the present invention.

In the above embodiments, the descriptions of the various embodiments are different, and the details that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

FIG. 2 is a schematic structural diagram of a search apparatus according to an embodiment of the present invention. The search device 200 can be implemented in a terminal device. As shown in FIG. 2, the search device 200 includes a detection module 21, a startup module 22, a receiving module 23, and a search module 24.

The detecting module 21 is configured to detect a gesture sent by the user for the terminal device.

The startup module 22 is connected to the detection module 21 for starting the voice input mode when the gesture detected by the detection module 21 for the terminal device meets the preset gesture condition for starting the voice input mode.

The receiving module 23 is connected to the startup module 22 for receiving a voice search term input by the user in the voice input mode initiated by the startup module 22.

The search module 24 is connected to the receiving module 23 for searching according to the voice search words received by the receiving module 23, and presenting the search results to the user.

In an optional implementation manner, as shown in FIG. 3, the terminal device further includes: a motion sensor 300 and a distance sensor 400. The motion sensor 300 can be a three-axis sensor. Based on this, the detection module 21 is connected to the motion sensor 300, and can be specifically used to detect the gesture used by the user for the mobile terminal device by using the motion sensor 300 in the terminal device.

Based on the above, as shown in FIG. 3, the search apparatus 200 further includes a determination module 25.

The determining module 25 is connected to the startup module 22, and is configured to determine whether the trajectory of the gesture used by the user for the mobile terminal device gradually approaches the mouth of the user before the startup module 22 starts the voice input mode, and whether the radiance corresponding to the trajectory is greater than a preset. If the result of the determination is yes, it is determined whether the distance from the end point of the gesture of the user for the mobile terminal device to the mouth of the user is less than a preset distance threshold; if the determination result is yes, the user is determined to be used for the movement. The gesture of the terminal device conforms to the preset gesture condition for starting the voice input mode. The determination module 25 also provides a determination result to the startup module 22.

Further, as shown in FIG. 3, the search device 200 further includes a determination module 26. The determining module 26 is connected to the distance sensor 400 and the determining module 25 for determining the user's use in the determining module 25 Determining, by the distance sensor 400 in the terminal device, the end point of the gesture used by the user for the mobile terminal device to the user before the distance from the end point of the gesture of the mobile terminal device to the mouth of the user is less than a preset distance threshold distance. The determination module 26 also provides the decision module 25 with the distance from the end point of the user's gesture for the mobile terminal device to the user.

In an optional implementation manner, the detecting module 21 is specifically configured to detect, when the terminal device presents the specified page, a gesture that is sent by the user for the terminal device, but is not limited thereto.

The search device provided in this embodiment is disposed in the terminal device, and starts a voice input mode by using a gesture sent by the user for the terminal device, and the user inputs a voice search word in the voice input mode, and then searches and displays the search result based on the voice search word. Therefore, when the user searches based on the terminal device, the user can input the search word without returning to the page with the search function, but directly input the search word by means of gesture and voice input, which is beneficial to improve the search efficiency.

A person skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the system, the device and the unit described above can refer to the corresponding process in the foregoing method embodiment, and details are not described herein again.

In the several embodiments provided by the present invention, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated in one unit. In the unit. The above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

The above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium. The above software functional unit is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor to perform the methods of the various embodiments of the present invention. Part of the steps. The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes. .

It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that The technical solutions described in the foregoing embodiments are modified, or the equivalents of the technical features are replaced. The modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

A search method, comprising:

Detecting gestures issued by the user for the terminal device;

If the gesture sent by the user for the terminal device satisfies a preset gesture condition for starting the voice input mode, the voice input mode is activated;

Receiving a voice search word input by the user in the voice input mode;

Searching based on the voice search term and presenting the search result to the user.
The method according to claim 1, wherein the detecting a gesture issued by the user for the terminal device comprises:

A gesture of the user for moving the terminal device is detected by using a motion sensor in the terminal device.
The method of claim 2, further comprising:

Determining whether a trajectory of the gesture used by the user to move the terminal device gradually approaches a mouth of the user, and whether a radii corresponding to the trajectory is greater than a preset radians threshold;

If the determination result is yes, determining whether the distance from the end point of the gesture for moving the terminal device to the mouth of the user is less than a preset distance threshold;

If the determination result is yes, the gesture for the user to move the terminal device is determined, and the preset gesture condition for starting the voice input mode is satisfied.
The method according to claim 3, wherein the determining whether the distance from the end point of the gesture for moving the terminal device to the mouth of the user is less than a preset distance threshold is further include:

Using a distance sensor within the terminal device, determining a distance from an end point of the gesture of the user for moving the terminal device to a mouth of the user.
The method according to any one of claims 1 to 4, wherein the detecting a gesture issued by the user for the terminal device comprises:

When the terminal device presents the specified page, detecting that the user sends the specified terminal device gesture.
A search device is provided in a terminal device, wherein the device comprises:

a detecting module, configured to detect a gesture sent by the user for the terminal device;

a startup module, configured to start the voice input mode when a gesture of the user for the terminal device meets a preset gesture condition for starting a voice input mode;

a receiving module, configured to receive a voice search term input by the user in the voice input mode;

And a searching module, configured to perform a search according to the voice search term, and present the search result to the user.
The device according to claim 6, wherein the detecting module is specifically configured to detect a gesture used by the user to move the terminal device by using a motion sensor in the terminal device.
The device according to claim 7, further comprising:

a judging module, configured to determine whether a trajectory of the gesture used by the user to move the terminal device gradually approaches a mouth of the user, and whether a radii corresponding to the trajectory is greater than a preset radians threshold, and if the judgment result is yes Determining whether the distance from the end point of the gesture for moving the terminal device to the mouth of the user is less than a preset distance threshold. If the determination result is yes, determining that the user is used to move the location The gesture of the terminal device satisfies a preset gesture condition for starting the voice input mode.
The device according to claim 8, further comprising:

And a determining module, configured to determine, by using a distance sensor in the terminal device, a distance from an end point of the gesture used by the user to move the terminal device to the user.
The device according to any one of claims 6-9, wherein the detecting module is specifically configured to detect a gesture issued by the user for the terminal device when the terminal device presents a specified page.