WO2021244059A1

WO2021244059A1 - Interaction method and device, earphone, and server

Info

Publication number: WO2021244059A1
Application number: PCT/CN2021/074916
Authority: WO
Inventors: 崔文华; 赵楠
Original assignee: 北京搜狗智能科技有限公司
Priority date: 2020-06-05
Filing date: 2021-02-02
Publication date: 2021-12-09
Also published as: CN111739529A

Abstract

Provided in embodiments of the present invention are an interaction method, an interaction device, an earphone, and a server. The earphone is is engaged in a communication connection with a server and has an interaction assistant. The method comprises: the earphone sending voice of a user to the server, and acquiring, from the server, a result of voice recognition performed on the voice of the user; and calling the interaction assistant to perform an interaction operation according to the result of the voice recognition. The method does not require a user to manually operate an earphone to realize multiple interaction functions of the earphone.

Description

Interactive method, device, earphone and server

This application claims all the priority of the invention patent application whose application number is 202010507540.4 and the application date is June 5, 2020 in China. The invention title is "an interactive method, device, headset and server".

Technical field

The present invention relates to the technical field of electronic equipment, in particular to an interactive method, an interactive device, a headset and a server.

Background technique

With the continuous development of science and technology, electronic technology has also developed rapidly, and there are more and more types of electronic devices, and people are becoming more and more accustomed to using a variety of electronic devices in their lives.

However, in some scenarios, there are still some restrictions on the operation of the electronic device, which is not conducive to the operation of the electronic device by the user. For example, in scenes such as driving a car, cycling, or running, it is inconvenient for users to operate handheld electronic devices.

Summary of the invention

The embodiment of the present invention provides an interaction method, an interaction device, a headset, and a server.

The embodiment of the present invention discloses an interaction method, which is applied to a headset, the headset is communicatively connected with a server, the headset has an interactive assistant, and the method includes:

Sending, by the headset, a user voice to the server, and obtaining a voice recognition result of the user voice from the server;

Invoke the interactive assistant to perform an interactive operation according to the voice recognition result.

Optionally, the invoking the interactive assistant to perform an interactive operation according to the voice recognition result includes:

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Invoke the interactive assistant to recommend songs or play songs according to the user status.

Optionally, the headset has a gravity sensor, and the acquiring the user status includes:

Acquire the sensing data detected by the gravity sensor, and determine the user state according to the sensing data.

Optionally, the invoking the interactive assistant to recommend songs according to the user status includes:

Sending the user status to the server;

Receive the recommended song sent by the server and call the interactive assistant to recommend to the user, the recommended song is a song searched by the server that matches the user's status.

Optionally, the invoking the interactive assistant to play the song according to the user status includes:

Sending the user status to the server;

Receive the preset song after adjusting the sound effect sent by the server and call the interactive assistant to play it; the preset song after the sound effect adjustment is the sound effect determined by the server to match the user status, and the preset song Adjusted to the sound effect.

Invoke the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.

Optionally, the invoking the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or to obtain and play the recorded information according to the voice recognition result, includes:

Invoke the interactive assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain and play the pre-device memo information according to the voice recognition result.

The interactive assistant is called to recognize and record a target voice from the user's voice according to the voice recognition result, or obtain and play the recorded target voice according to the voice recognition result.

Optionally, it also includes:

Send the recorded information to the server, and/or obtain and record the recorded information of the server.

Optionally, it also includes:

After the memo information is recorded, a reminder event for the memo information is generated.

Optionally, it also includes:

Obtain a preset reminder event for the memo information from the server.

Optionally, it also includes:

When the trigger condition of the preset reminder event is met, the interactive assistant is called to obtain and play the memo information corresponding to the preset reminder event.

Optionally, the acquiring and playing the pre-device forget information according to the voice recognition result includes:

Searching for information that matches the voice recognition result from the pre-device forget information;

Invoke the interactive assistant to play the information matching the voice recognition result.

Optionally, it also includes:

Obtaining a semantic analysis result obtained by the server performing semantic analysis on the memo information;

According to the semantic analysis result, label information is generated for the memo information.

When the voice recognition result includes the memo information that characterizes the need to find target tag information, the interactive assistant is called to find and play the pre-device forget information that matches the target tag information.

Obtaining a dialogue sentence from the speech recognition result;

Invoke the interactive assistant to generate a reply sentence matching the dialogue sentence and play it.

Optionally, the invoking the interactive assistant to generate and play a reply sentence matching the dialogue sentence includes:

Obtain user location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence.

Optionally, the headset has an orientation sensor, and the acquiring user orientation information includes:

Obtain user position information detected by the position sensor.

Optionally, the invoking the interactive assistant to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence includes:

Obtain user geographic location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information, the dialogue sentence and the user's geographic location information.

Sending navigation query information to the server; the navigation query information includes the user location information and the dialogue sentence;

The reply sentence for voice navigation sent by the server is received and played. The reply sentence for voice navigation is generated by the server according to the user location information and the dialog sentence query.

The embodiment of the present invention discloses an interaction method, which is applied to a server, the server is in communication connection with a headset, the headset has an interactive assistant, and the method includes:

The server receives the user voice sent by the headset, and recognizes the user voice to obtain a voice recognition result;

The voice recognition result is sent to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.

Optionally, it also includes:

Acquiring the user status detected by the headset;

Find a recommended song matching the user's state and send it to the headset; the headset is used to call the interactive assistant to recommend the recommended song to the user.

Optionally, it also includes:

Acquiring the user status detected by the headset;

Determining a sound effect matching the user status;

The preset song is adjusted to the sound effect, and the preset song with the adjusted sound effect is sent to the earphone, and the earphone is used for invoking the interactive assistant to play the preset song with the adjusted sound effect.

Optionally, it also includes:

Recognize and record information from the user's voice according to the voice recognition result, or obtain and send the recorded information to the earphone according to the voice recognition result, and the earphone is used to play the recorded information.

Optionally, the recognizing and recording information from the user's voice according to the voice recognition result, or obtaining the recorded information according to the voice recognition result and sending it to the headset, includes:

Recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.

Optionally, the recognizing and recording information from the user voice according to the voice recognition result, or obtaining the recorded information according to the voice recognition result and sending it to the headset, includes:

According to the voice recognition result, a target voice is recognized and recorded from the user voice, or a recorded target voice is acquired and sent to the headset according to the voice recognition result.

Optionally, it also includes:

Send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.

Optionally, it also includes:

After the memo information is recorded, a reminder event for the memo information is generated;

For the reminder event to the earphone, the earphone is used to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.

Optionally, it also includes:

Perform semantic analysis on the memo information to obtain the semantic analysis result;

Optionally, the acquiring pre-device forget information according to the voice recognition result and sending it to the headset includes:

When the voice recognition result includes memo information that characterizes the need to find target tag information, search for pre-device forget information that matches the target tag information and send it to the headset.

Optionally, it also includes:

Obtaining a dialogue sentence from the speech recognition result;

A reply sentence matching the dialogue sentence is generated and sent to the earphone, and the earphone is used to play the reply sentence matching the dialogue sentence.

Optionally, the generating and sending a reply sentence matching the conversation sentence to the headset includes:

Acquiring user location information detected by the headset;

According to the user location information and the dialogue sentence, a reply sentence for voice navigation is generated and sent to the headset.

The embodiment of the present invention discloses an interactive device, which is applied to a headset, the headset is in communication connection with a server, the headset has an interactive assistant, and the device includes:

A voice recognition result obtaining module, configured to send a user voice to the server, and obtain a voice recognition result of the user voice from the server;

The first interaction module is used to invoke the interaction assistant to perform an interaction operation according to the voice recognition result.

Optionally, the first interaction module includes:

The wake-up module is used to wake up the interactive assistant according to the voice recognition result;

User status acquisition module, used to acquire user status;

The song interaction module is used to call the interactive assistant to recommend songs or play songs according to the user status.

Optionally, the headset has a gravity sensor, and the user status acquisition module is configured to acquire sensor data detected by the gravity sensor, and determine the user status according to the sensor data.

Optionally, the song interaction module is configured to send the user status to the server; receive recommended songs sent by the server and call the interactive assistant to recommend to the user, the recommended songs are searched by the server Of songs that match the user's status.

Optionally, the song interaction module is configured to send the user status to the server; receive a preset song with adjusted sound effects sent by the server and call the interactive assistant to play; It is assumed that the song is a sound effect that is determined by the server to match the user status, and a preset song is adjusted to the sound effect.

Optionally, the first interaction module includes:

The first recording interaction module is configured to call the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.

Optionally, the first recording interaction module is configured to call the interactive assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or to obtain a pre-device memo according to the voice recognition result Message and play.

Optionally, the first recording interaction module is configured to call the interactive assistant to recognize and record a target voice from the user voice according to the voice recognition result, or obtain the recorded target voice according to the voice recognition result And play.

Optionally, it also includes:

The first recorded information transmission module is configured to send recorded information to the server, and/or obtain and record the recorded information of the server.

Optionally, it also includes:

The first reminder event generating module is configured to generate a reminder event for the memo information after the memo information is recorded.

Optionally, it also includes:

The first reminder event obtaining module is configured to obtain preset reminder events for the memo information from the server.

Optionally, it also includes:

The first reminder event triggering module is configured to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.

Optionally, the first recording interaction module is configured to search for information that matches the voice recognition result from pre-device forget information; call the interactive assistant to play the information that matches the voice recognition result.

Optionally, it also includes:

The first semantic analysis module is configured to obtain a semantic analysis result obtained by the server performing semantic analysis on the memo information;

The first label generating module is configured to generate label information for the memo information according to the semantic analysis result.

Optionally, the first recording interaction module is configured to call the interactive assistant to find pre-device forget information that matches the target tag information when the voice recognition result includes a requirement to find memo information with target tag information And play.

Optionally, the first interaction module includes:

The first dialogue sentence obtaining module is used to obtain the dialogue sentence from the speech recognition result;

The first dialogue interaction module is used to call the interactive assistant to generate and play a reply sentence matching the dialogue sentence.

Optionally, the first dialogue interaction module is configured to obtain user location information; call the interactive assistant to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence.

Optionally, the headset has an orientation sensor, and the first dialogue interaction module is configured to acquire user orientation information detected by the orientation sensor.

Optionally, the first dialogue interaction module is configured to obtain user geographic location information; call the interactive assistant to generate a reply statement for voice navigation based on the user location information, the dialogue sentence, and the user geographic location information And play.

Optionally, the first dialog interaction module is configured to send navigation query information to the server; the navigation query information includes the user location information and the dialog sentence; and receives a voice navigation message sent by the server The answer sentence for voice navigation is generated by the server according to the user location information and the dialogue sentence query.

The embodiment of the present invention discloses an interactive device, which is applied to a server, the server is in communication connection with a headset, the headset has an interactive assistant, and the device includes:

The voice recognition module is used to receive the user voice sent by the headset and recognize the user voice to obtain a voice recognition result;

The voice recognition result sending module is configured to send the voice recognition result to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.

Optionally, it also includes:

The first user status acquiring module is configured to acquire the user status detected by the headset;

The first song sending module is used to find a recommended song matching the user's status and send it to the earphone; the earphone is used to call the interactive assistant to recommend the recommended song to the user.

Optionally, it also includes:

The second user status acquiring module is configured to acquire the user status detected by the headset;

A sound effect determining module, configured to determine a sound effect matching the user status;

The second song sending module is configured to adjust a preset song to the sound effect and send the preset song with the adjusted sound effect to the earphone. The earphone is used to call the interactive assistant to play all the adjusted sound effects. Describe the preset songs.

Optionally, it also includes:

The recorded information processing module is used for recognizing and recording information from the user’s voice according to the voice recognition result, or acquiring the recorded information according to the voice recognition result and sending it to the earphone, and the earphone is used for playing The recorded information.

Optionally, the record information processing module includes:

The memo information processing module is configured to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.

Optionally, the record information processing module includes:

The voice processing module is configured to recognize and record a target voice from the user voice according to the voice recognition result, or obtain a recorded target voice according to the voice recognition result and send it to the headset.

Optionally, it also includes:

The second record information transmission module is configured to send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.

Optionally, it also includes:

The second reminder event generating module is used to generate a reminder event for the memo information after the memo information is recorded;

The reminder event sending module is configured to send the reminder event to the earphone, and the earphone is used to call the interactive assistant to obtain the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met, and Play.

Optionally, it also includes:

The second semantic analysis module is used to perform semantic analysis on the memo information to obtain the semantic analysis result;

The second label generating module is used to generate label information for the memo information according to the semantic analysis result.

Optionally, the memo information processing module is configured to, when the voice recognition result includes the memo information that characterizes the need to find target tag information, search for pre-device forget information that matches the target tag information and send it to the headset send.

Optionally, it also includes:

A dialogue sentence obtaining module, which is used to obtain a dialogue sentence from the speech recognition result;

The reply sentence sending module is used for generating a reply sentence matching the dialogue sentence and sending it to the earphone, and the earphone is used for playing the reply sentence matching the dialogue sentence.

Optionally, the reply sentence sending module is configured to obtain the user location information detected by the headset; according to the user location information and the dialogue sentence, generate a reply sentence for voice navigation and send it to the headset.

The embodiment of the present invention discloses a headset, including a memory, and one or more programs. One or more programs are stored in the memory and configured to be executed by one or more processors. The above program contains instructions for the following operations:

Sending a user voice to a server, and obtaining a voice recognition result of the user voice from the server;

The interactive assistant is invoked to perform interactive operations according to the voice recognition result.

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Sending the user status to the server;

Optionally, it also contains instructions for performing the following operations:

Obtain a preset reminder event for the memo information from the server.

Obtaining a dialogue sentence from the speech recognition result;

Obtain user location information;

Obtain user position information detected by the position sensor.

Obtain user geographic location information;

The embodiment of the present invention discloses a server, including a memory, and one or more programs. One or more programs are stored in the memory and configured to be executed by one or more processors. The above program contains instructions for the following operations:

Receive the user's voice sent by the headset, and recognize the user's voice to obtain the voice recognition result;

Acquiring the user status detected by the headset;

Determining a sound effect matching the user status;

Obtaining a dialogue sentence from the speech recognition result;

Acquiring user location information detected by the headset;

The embodiment of the present invention discloses a computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the interaction method as described in any of the above step.

The embodiment of the present invention also discloses a computer program, including computer readable code, which when the computer readable code runs on a computing processing device, causes the computing processing device to execute the interaction method according to any one of the foregoing.

The embodiments of the present invention include the following advantages:

In the embodiment of the present invention, the headset can obtain the voice recognition result of the user's voice from the server, and the interactive assistant of the headset can perform interactive operations according to the voice recognition result of the user's voice. The user does not need to use the hand to operate the headset, and realize the multiple interactive functions of the headset. .

The above description is only an overview of the technical solution of the present invention. In order to understand the technical means of the present invention more clearly, it can be implemented in accordance with the content of the specification, and in order to make the above and other objectives, features and advantages of the present invention more obvious and easy to understand. In the following, specific embodiments of the present invention will be cited.

Description of the drawings

FIG. 1 is a flowchart of the steps of Embodiment 1 of an interactive method of the present invention;

2 is a flowchart of the steps of Embodiment 2 of an interactive method of the present invention;

FIG. 3 is a flowchart of the steps of Embodiment 3 of an interactive method of the present invention;

FIG. 4 is a flowchart of the steps of Embodiment 4 of an interactive method of the present invention;

FIG. 5 is a flowchart of steps in Embodiment 5 of an interactive method of the present invention;

6 is a structural block diagram of Embodiment 1 of an interactive device of the present invention;

FIG. 7 is a structural block diagram of Embodiment 2 of an interactive device of the present invention;

8 is a structural block diagram of Embodiment 3 of an interactive device of the present invention;

9 is a structural block diagram of Embodiment 4 of an interactive device of the present invention;

Fig. 10 is a structural block diagram of a headset for interaction according to an exemplary embodiment;

Fig. 11 is a schematic structural diagram of a server for interaction shown in another exemplary embodiment.

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

detailed description

In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

1, there is shown a step flow chart of Embodiment 1 of an interactive method of the present invention. The method is applied to a headset, the headset is in communication with a server, and the headset has an interactive assistant. The method may specifically include the following step:

Step 101: The headset sends a user voice to the server, and obtains a voice recognition result of the user voice from the server.

Earphones are portable electronic devices that people often use in daily life. The earphones can have playback functions, sound pickup functions, and communication functions. Users can use headphones to listen to songs or communicate on the phone.

The server has a voice recognition function, which can perform voice recognition on the user's voice collected by the headset.

Step 102: Invoke the interactive assistant to perform an interactive operation according to the voice recognition result.

The headset is installed with an interactive assistant. The interactive assistant can be a program installed in the headset to run independently, and can provide a variety of interactive functions. The interactive assistant can perform interactive operations based on the voice recognition results to implement various interactive functions of the headset.

In the embodiment of the present invention, the headset can be communicatively connected with the mobile terminal, and the mobile terminal can follow an application program APP matched with the interactive assistant of the headset, and the user can control the interactive assistant on the interface of the APP.

The interactive assistant can be awakened in a specific way, for example, a specific voice command. Some interactive functions of the interactive assistant can be executed after being awakened, and some interactive functions can be executed without being awakened.

In scenarios such as running and driving, it is inconvenient for the user to take out the mobile phone to search for songs. In order to facilitate the user to search for songs, in one embodiment, the interactive function of the earphone may include a song recommendation function.

2, there is shown a step flow chart of the second embodiment of an interactive method of the present invention. The method is applied to a headset, the headset is in communication with a server, and the headset has an interactive assistant. The method may specifically include the following step:

Step 201: The headset sends a user voice to the server, and obtains a voice recognition result of the user voice from the server.

Step 202: Wake up the interactive assistant according to the voice recognition result.

When the voice recognition result includes information indicating that the user needs to find a suitable song or adjust the sound effect of the song, the interactive assistant is awakened to recommend the song to the user. For example, speech recognition results include: "play a song suitable for running" or "switch to sound effects suitable for running".

Step 203: Obtain the user status.

The user status, that is, the status of the user, can include sitting status, walking status, running status, driving status, riding status, and so on.

In an example, the headset may have a gravity sensor that can detect the state of the user. The step of acquiring the user status may include: acquiring sensor data detected by the gravity sensor, and determining the user status according to the sensor data. Specifically, an algorithm for detecting the user's state can be used to determine the user's state based on the sensing data of the gravity sensor.

Step 204: Invoke the interactive assistant to recommend songs or play songs according to the user status.

In the embodiment of the present invention, the interactive assistant can recommend songs to the user according to the user's status, and the user can determine whether to play the song; it can also directly play the song that adapts to the user's status.

Specifically, you can configure multiple tags or categories for the songs in the preset song list in advance, for example, "rock", "pop", "jazz", "folk", "pure music", "strong rhythm", " Labels such as "passion", "lyric", "serenity", and "dynamic". The interactive assistant can search for songs with tags that match the user's status. For example, when the user's status is "running", songs with the tag "strong rhythm" can be recommended.

In an example, the interactive assistant may be called to find recommended songs that match the user's status and recommend them to the user.

In another example, the server can look up recommended songs. The step of invoking the interactive assistant to recommend songs based on the user status may include: sending the user status to the server; receiving recommended songs sent by the server and invoking the interactive assistant to recommend to the user, the recommendation The song is a song found by the server that matches the state of the user.

In the embodiment of the present invention, the interactive assistant can play the song according to the matched sound effect according to the user's status. Specifically, the interactive assistant can adjust the sound effect of the song through the sound effect algorithm. The sound effect algorithm can adjust the song into multiple types of sound effects, such as "quiet", "far away", "rock" and so on. When the user's state is sitting still, the preset song can be adjusted to a "quiet" sound effect.

In an example, the interactive assistant may adjust the sound effect of the song, and the step of invoking the interactive assistant to recommend a song according to the user state may include: invoking the interactive assistant to determine the sound effect matching the user state, and Adjusting a preset song to the sound effect; playing the preset song after adjusting the sound effect.

In another example, the server may adjust the sound effects of the songs, and the step of invoking the interactive assistant to recommend songs according to the user status may include: sending the user status to the server; receiving the information sent by the server The preset song after the sound effect adjustment is called and played by the interactive assistant; the preset song after the sound effect adjustment is the sound effect determined by the server to match the user status, and the preset song is adjusted to the sound effect to obtain . The preset song may be the currently playing song in the playlist of the headset.

In the embodiment of the present invention, the earphone can obtain the voice recognition result of the user's voice from the server, wake up the interactive assistant according to the voice recognition result and obtain the user status, and call the interactive assistant to recommend or play songs according to the user status. The embodiment of the present invention realizes that the user does not need to use the hand to operate the earphone, and the earphone recommends songs or plays the song, which simplifies the user's operation process.

In scenarios such as running and driving, it is inconvenient for the user to take out the mobile phone to record the memo information or search for the memo information. In order to facilitate the user to use the memo, in one embodiment, the interactive function of the headset may include an information recording interactive function.

3, there is shown a step flow chart of the third embodiment of an interactive method of the present invention. The method is applied to a headset, the headset is in communication with a server, and the headset has an interactive assistant. The method may specifically include the following step:

Step 301: The headset sends a user voice to the server, and obtains a voice recognition result of the user voice from the server.

Step 302: Invoke the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.

In the embodiment of the present invention, the headset can send the recorded information to the server, and can also obtain and record the recorded information of the server.

In the embodiment of the present invention, the invoking the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or to obtain and play the recorded information according to the voice recognition result, includes: invoking The interactive assistant recognizes and records a target voice from the user's voice according to the voice recognition result, or obtains and plays the recorded target voice according to the voice recognition result.

When the voice recognition result includes that the user's voice needs to be recorded, the interactive assistant can recognize the target voice from the user's voice. For example, if the user says "record a sound", the interactive assistant can record the user's voice collected later. The user can set the recording method to filter the sounds that need to be recorded. For example, in a meeting, if the user wants to record the voice of each person participating in the meeting, the headset can record the omnidirectional user voice. In the classroom, if the user wants to record the teacher's speech, the headset can record the user's speech in the specified direction.

When the voice recognition result includes that the recorded target voice needs to be played, the interactive assistant can search for the target voice and play it.

In the embodiment of the present invention, the invoking the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or to obtain and play the recorded information according to the voice recognition result, includes: invoking The interactive assistant recognizes and records memo information from the voice recognition result according to the voice recognition result, or obtains and plays the pre-device memo information according to the voice recognition result.

When the voice recognition result includes information indicating that memo information needs to be recorded, the interactive assistant can extract relevant content from the voice recognition result and record it as memo information. The interactive assistant supports command and talk. For example, the form of the voice command can be "write down + memo content", and the voice recognition result is "write down for me, and have a meeting with the sales tomorrow in the meeting room on the third floor at 10 o'clock in the morning." "Take it down for me" means that you need to record the memo information, and the interactive assistant will record the "meeting with the sales in the meeting room on the third floor at 10 o'clock tomorrow morning" as the memo information. It means that the content of the memo information that needs to be recorded can also be "Help me a few things", "Help me keep an account", "Help my parents keep a record", "Help me keep a parking space" and so on. Voice recognition can be trained in advance Model to identify the need to record memo information.

When the voice recognition result includes information indicating that the memo information needs to be queried, the interactive assistant can obtain the pre-device memo information and play it.

In the embodiment of the present invention, the interactive assistant may obtain the memo information locally from the headset, or obtain the memo information from the server.

In the embodiment of the present invention, the step of acquiring and playing the pre-device forget information according to the voice recognition result may include: searching for information matching the voice recognition result from the pre-device forget information; invoking the interactive assistant to play The information that matches the voice recognition result.

Specifically, the interactive assistant can retrieve specific information from the memo information, for example, retrieve information that matches the keyword, time, location, category, and other information in the user's voice. For example, the voice recognition result is "What time is the meeting with sales tomorrow morning?", and the interactive assistant answers "10 o'clock".

In the embodiment of the present invention, the earphone can perform semantic analysis on the memo information to obtain the semantic analysis result. The headset can also be obtained from the server, and the semantic analysis result obtained by the semantic analysis of the memo information by the server. The headset can generate tag information for the memo information according to the semantic analysis result.

Specifically, the server may use a natural language understanding algorithm to perform semantic analysis on the speech recognition result to obtain the semantic analysis result.

In the embodiment of the present invention, the step of acquiring and playing the pre-device forget information according to the voice recognition result may include: when the voice recognition result includes a requirement to find memo information with target tag information, calling the The interactive assistant finds and plays the pre-device forgetting information that matches the target tag information.

The label information may include information such as classification labels and attribute labels. The interactive assistant can generate corresponding label information according to the semantic analysis result. Based on semantic analysis, the interactive assistant can categorize or add tags to the memo. For example, after the user finishes saying "Take it down for me, I will have a meeting with the sales in the meeting room on the third floor at 10 am tomorrow." Based on semantic analysis, this memo Information belongs to the to-do category. In addition to searching by keywords, users can also search by tag information. For example, the user’s voice is "What do I have to-do tomorrow?", the interactive assistant searches for information with the tag "to-do" Memo information.

In the embodiment of the present invention, the interactive assistant may generate a reminder event for the memo information after recording the memo information. It can also be obtained from the server, and the reminder event generated by the server for the memo information. The reminder event may include reminder content and trigger conditions. The reminder content is memo information, and the trigger condition is a condition for triggering the reminder event, such as reaching a set time.

In the embodiment of the present invention, when the trigger condition of the preset reminder event is met, the interactive assistant may be called to obtain and play the memo information corresponding to the preset reminder event. For example, if the trigger condition of a reminder event is "time reaches 9:45", the headset will play the memo information corresponding to the reminder event, and the headset will remind you by voice "You have arranged a meeting with sales in the third floor meeting room at 10 o'clock, please advance arrange".

In the embodiment of the present invention, the headset can obtain the voice recognition result of the user's voice from the server; call the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result. The embodiment of the present invention realizes that the user does not need to use a hand to operate the earphone, and can record information or play recorded information through the earphone, which simplifies the user's operation process.

In scenarios such as walking, cycling, etc., it is inconvenient for the user to take out the mobile phone to make an inquiry. To facilitate the user's inquiry, in one embodiment, the interactive function of the headset may include a question-and-answer interactive function.

4, there is shown a step flow chart of Embodiment 4 of an interactive method of the present invention. The method is applied to a headset, the headset is in communication with a server, and the headset has an interactive assistant. The method may specifically include the following step:

Step 401: The headset sends a user voice to the server, and obtains a voice recognition result of the user voice from the server.

Step 402: Obtain a dialogue sentence from the speech recognition result.

In the embodiment of the present invention, the interactive assistant of the headset can have a conversation with the user, and can obtain the conversation sentence of the user from the voice recognition result.

Step 403: Invoke the interactive assistant to generate a reply sentence matching the dialogue sentence and play it.

The interactive assistant can generate and play matching reply sentences according to the user's dialogue sentences, so as to conduct voice questions and answers with the user.

In the embodiment of the present invention, the step of invoking the interactive assistant to generate and play a reply sentence matching the dialogue sentence may include: obtaining user location information; invoking the interactive assistant according to the user location information and The dialogue sentence is described, and the reply sentence for voice navigation is generated and played.

The user orientation information refers to the frontal orientation of the user. In the embodiment of the present invention, the headset may have an orientation sensor. When the user wears the headset, the orientation sensor can detect the user's orientation information in real time. The interactive assistant can obtain the user's position information detected by the position sensor.

In an example, the step of invoking the interaction assistant to generate and play a reply sentence for voice navigation based on the user location information and the dialogue sentence may include: obtaining user geographic location information; invoking the interaction The assistant generates and plays a reply sentence for voice navigation according to the user's location information, the dialogue sentence and the user's geographic location information.

The headset can obtain the current user's geographic location information, for example, the headset detects the current user's geographic location information. For another example, the headset can be communicatively connected with the mobile device. The mobile device may have positioning capabilities, for example, by setting a GPS module, or positioning by communicating with a base station, the headset may obtain the current user's geographic location information detected by the mobile device.

In another example, the step of invoking the interactive assistant to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence may include: sending navigation query information to the server; The navigation query information includes the user location information and the dialogue sentence; the reply sentence for voice navigation sent by the server is received and played, and the reply sentence for voice navigation is determined by the server according to the user position. Information and the dialogue sentence query is generated.

The server can generate a reply sentence for voice navigation according to the user's location information, dialogue sentence, and user's geographic location information query, and then send the reply sentence back to the headset.

The interactive assistant of the headset can interact with the user for voice navigation. During the interaction, the navigation voice can be played based on the real-time user location information, real-time user geographic location information, and the voice continuously spoken by the user.

For example, user: What's delicious nearby?

Interactive Assistant: What style would you like to eat?

User: Sichuan style.

Interactive Assistant: There is a "Meizhou Dongpo" house 800 meters away that has a good evaluation. Would you consider going there?

User: Okay.

Interactive Assistant: Now I will help you navigate to "Meizhou Dongpo", do you see a red tall building ahead?

User: I saw it.

Interactive assistant: You walk about 200 meters in the direction of the red tall building.

According to the real-time user location information, it is determined that the user starts to walk toward the red tall building at this time.

Interactive assistant: there is a barber shop under the red tall building. When you see the barber shop, turn right

According to the real-time user location information, it is determined that the user starts to turn right at this time.

Interactive Assistant: There are still 600 meters away from the destination.

Interactive Assistant: Do you see an intersection ahead?

User: I saw it.

Interactive Assistant: After you reach the crossroad, turn left.

According to the real-time user location information and user location information, it is determined that the user walks to the intersection and turns left.

Interactive Assistant: Continue straight ahead, "Meizhou Dongpo" is 100 meters ahead.

According to the real-time user location information, the user is determined to move forward.

Interactive assistant: "Meizhou Dongpo" is on your left, navigation is complete, I wish you a pleasant meal.

In the embodiment of the present invention, the headset can obtain the voice recognition result of the user's voice from the server; obtain the dialogue sentence from the voice recognition result, and then call the interactive assistant to generate and play the reply sentence matching the dialogue sentence. The embodiment of the present invention realizes that the user does not need to use the hand to operate the earphone, and the earphone can conduct question and answer according to the user's voice, which simplifies the user's operation process.

The following describes from the perspective of the server.

5, there is shown a step flow chart of Embodiment 5 of an interactive method of the present invention. The method is applied to a server, and the server communicates with a headset, and the headset has an interactive assistant. The method includes:

Step 501, the server receives the user voice sent by the headset, and recognizes the user voice to obtain a voice recognition result.

In the embodiment of the present invention, the server has a voice recognition function, and can perform voice recognition on the user's voice collected by the headset to obtain a voice recognition result.

Step 502: Send the voice recognition result to the headset, where the headset is used to invoke the interactive assistant to perform an interactive operation according to the voice recognition result.

The headset is equipped with an interactive assistant, which can be a program installed on the headset, and can provide a variety of interactive functions. After the headset receives the voice recognition result sent by the server, the interactive assistant can be called to perform interactive operations according to the voice recognition result, so as to realize various interactive functions of the headset.

In the embodiment of the present invention, the server can send the voice recognition result of the user's voice to the headset, and the interactive assistant of the headset can perform interactive operations according to the voice recognition result of the user's voice. The user does not need to use the hand to operate the headset to realize various interactions of the headset. Features.

In an embodiment, the interactive function of the headset may include a song recommendation function. The headset can call the interactive assistant to obtain the user status according to the voice recognition result. When the voice recognition result includes information indicating that the user needs to find a suitable song or adjust the sound effect of the song, the interactive assistant of the headset may request the server to recommend the song or adjust the sound effect of the song.

In an example, the server may obtain the user status detected by the headset; find a recommended song matching the user status, and send it to the headset, so that the headset calls the interactive assistant to recommend the recommended song to the user. In another example, the server can obtain the user status detected by the headset; determine the sound effect matching the user status; adjust the preset song to the sound effect, and send the preset song with the adjusted sound effect to the headset so that the headset can call The interactive assistant plays the preset songs after adjusting the sound effects.

In another embodiment, the interactive function of the headset may include an information recording interactive function. The server may recognize and record information from the user's voice according to the voice recognition result, or obtain the recorded information according to the voice recognition result and send it to the headset, so that the headset can play the recorded information.

The server can send the recorded information to the headset, or obtain and record the recorded information of the headset.

In an example, the server may recognize and record the target voice from the user's voice according to the voice recognition result, or obtain the recorded target voice according to the voice recognition result and send it to the headset, so that the headset can play the target voice. In another example, the server may recognize and record the memo information from the voice recognition result according to the voice recognition result, or obtain the pre-device forget information according to the voice recognition result and send it to the headset, so that the headset can play the pre-device forget information.

The server may generate a reminder event for the memo information after recording the memo information; the reminder event to the headset, so that when the trigger condition of the preset reminder event is met, the headset can call the interactive assistant to obtain the preset reminder event The corresponding memo information and play.

The server can also perform semantic analysis on the memo information to obtain a semantic analysis result; according to the semantic analysis result, generate label information for the memo information. When the voice recognition result includes the requirement to find memo information with target tag information, the server can search for the pre-device forget information that matches the target tag information and send it to the headset, so that the headset can play the pre-device forget information that matches the target tag information .

In another embodiment, the interactive function of the headset may include a question-and-answer interactive function. The server obtains the dialog sentence from the voice recognition result; generates a reply sentence matching the dialog sentence and sends the headset to make the headset play the reply sentence matching the dialog sentence to realize the question and answer interaction with the user.

In an example, the question and answer interactive function may include voice navigation, and the server may obtain the user's location information detected by the headset; according to the user's location information and the dialogue sentence, a reply sentence for voice navigation is generated and sent to the headset, so that the headset is used for playback. Reply sentence for voice navigation.

It should be noted that, for the sake of simple description, the method embodiments are all expressed as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described sequence of actions, because According to the embodiments of the present invention, some steps may be performed in other order or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

6, there is shown a structural block diagram of Embodiment 1 of an interactive device of the present invention. The interactive device is applied to a headset. The headset is in communication with a server. The headset has an interactive assistant. The device may specifically include the following Module:

The voice recognition result obtaining module 601 is configured to send a user voice to the server, and obtain a voice recognition result of the user voice from the server;

The first interaction module 602 is configured to invoke the interaction assistant to perform an interaction operation according to the voice recognition result.

Referring to FIG. 7, there is shown a structural block diagram of Embodiment 2 of an interactive device of the present invention. The interactive device is applied to a headset. The headset is in communication with a server. The headset has an interactive assistant. The device may specifically include the following Module:

The voice recognition result obtaining module 701 is configured to send a user voice to the server, and obtain a voice recognition result of the user voice from the server;

The first interaction module 702 is configured to call the interaction assistant to perform an interaction operation according to the voice recognition result.

In the embodiment of the present invention, the first interaction module 702 may include:

The wake-up module 7021 is used to wake up the interactive assistant according to the voice recognition result;

The user status acquisition module 7022 is used to acquire the user status;

The song interaction module 7023 is used to call the interactive assistant to recommend songs or play songs according to the user status.

In the embodiment of the present invention, the headset has a gravity sensor, and the user state acquisition module 7022 is configured to acquire sensor data detected by the gravity sensor, and determine the user status according to the sensor data.

In the embodiment of the present invention, the song interaction module 7023 is configured to send the user status to the server; to receive the recommended song sent by the server and call the interactive assistant to recommend to the user, the recommended song is the reason The song found by the server matches the state of the user.

In the embodiment of the present invention, the song interaction module 7023 is configured to send the user status to the server; receive the preset song after the sound effect adjustment sent by the server and call the interactive assistant to play it; after the sound effect adjustment The preset song is a sound effect determined by the server to match the user status, and the preset song is adjusted to the sound effect.

The first recording interaction module 7024 is configured to call the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.

In the embodiment of the present invention, the first recording interaction module 7024 is configured to call the interactive assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or according to the voice recognition result Get the pre-device forgotten information and play it.

In the embodiment of the present invention, the first recording interaction module 7024 is used to call the interactive assistant to recognize and record the target voice from the user voice according to the voice recognition result, or to obtain the recorded voice according to the voice recognition result. Record the target voice and play it.

In the embodiment of the present invention, the interaction device may further include:

The first recorded information transmission module 703 is configured to send recorded information to the server, and/or obtain and record the recorded information of the server.

The first reminder event generating module 704 is configured to generate a reminder event for the memo information after the memo information is recorded.

The first reminder event obtaining module 705 is configured to obtain a preset reminder event for the memo information from the server.

The first reminder event triggering module 706 is configured to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.

In the embodiment of the present invention, the first recording interaction module 7024 is configured to search for information that matches the voice recognition result from the pre-device forget information; call the interactive assistant to play the voice recognition result that matches Information.

The first semantic analysis module 707 is configured to obtain a semantic analysis result obtained by the server performing semantic analysis on the memo information;

The first tag generation module 708 is configured to generate tag information for the memo information according to the semantic analysis result.

In the embodiment of the present invention, the first record interaction module 7024 is configured to call the interactive assistant to find the memo information that matches the target tag information when the voice recognition result includes the memo information that characterizes the need to find target tag information. Pre-device forgets the information and plays it.

The first dialogue sentence obtaining module 7025 is configured to obtain the dialogue sentence from the voice recognition result;

The first dialogue interaction module 7026 is configured to call the interactive assistant to generate and play a reply sentence matching the dialogue sentence.

In the embodiment of the present invention, the first dialogue interaction module 7026 is used to obtain user location information; call the interactive assistant to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence .

In the embodiment of the present invention, the headset has an orientation sensor, and the first dialogue interaction module 7026 is configured to obtain user orientation information detected by the orientation sensor.

In the embodiment of the present invention, the first dialogue interaction module 7026 is configured to obtain user geographic location information; call the interactive assistant to generate voice information based on the user location information, the dialogue sentence, and the user geographic location information Navigate the reply sentence and play it.

In the embodiment of the present invention, the first dialog interaction module 7026 is configured to send navigation query information to the server; the navigation query information includes the user location information and the dialog sentence; and receives the information sent by the server The reply sentence used for voice navigation is played, and the reply sentence used for voice navigation is generated by the server according to the user location information and the dialog sentence query.

Referring to FIG. 8, there is shown a structural block diagram of Embodiment 3 of an interactive device of the present invention. The interactive device is applied to a server, and the server is in communication connection with a headset. The headset has an interactive assistant. The device may specifically include the following Module:

The voice recognition module 801 is configured to receive the user voice sent by the headset, and recognize the user voice to obtain a voice recognition result;

The voice recognition result sending module 802 is configured to send the voice recognition result to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.

9, there is shown a structural block diagram of Embodiment 4 of an interactive device of the present invention. The interactive device is applied to a server, and the server is in communication connection with a headset. The headset has an interactive assistant. The device may specifically include the following Module:

The voice recognition module 901 is configured to receive the user voice sent by the headset, and recognize the user voice to obtain a voice recognition result;

The voice recognition result sending module 902 is configured to send the voice recognition result to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.

The first user status acquiring module 903 is configured to acquire the user status detected by the headset;

The first song sending module 904 is configured to find a recommended song matching the user's status and send it to the earphone; the earphone is used to call the interactive assistant to recommend the recommended song to the user.

The second user status acquiring module 905 is configured to acquire the user status detected by the headset;

The sound effect determining module 906 is configured to determine a sound effect matching the user state;

The second song sending module 907 is configured to adjust a preset song to the sound effect, and send the preset song with the adjusted sound effect to the earphone, and the earphone is used to call the interactive assistant to play the adjusted sound effect The preset song.

The recorded information processing module 908 is configured to recognize and record information from the user's voice according to the voice recognition result, or obtain recorded information according to the voice recognition result and send it to the earphone. The earphone is used for Play the recorded information.

In the embodiment of the present invention, the record information processing module 908 may include:

The memo information processing module 9081 is configured to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.

The voice processing module 9082 is configured to recognize and record a target voice from the user voice according to the voice recognition result, or obtain a recorded target voice according to the voice recognition result and send it to the headset.

The second recorded information transmission module 909 is configured to send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.

The second reminder event generating module 910 is configured to generate a reminder event for the memo information after the memo information is recorded;

The reminder event sending module 911 is configured to send the reminder event to the earphone, and the earphone is used to call the interactive assistant to obtain the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met And play.

The second semantic analysis module 912 is configured to perform semantic analysis on the memo information to obtain a semantic analysis result;

The second label generating module 913 is configured to generate label information for the memo information according to the semantic analysis result.

In the embodiment of the present invention, the memo information processing module 9081 is configured to search for pre-device memo information matching the target tag information when the voice recognition result includes the memo information that characterizes the need to find target tag information. Send to the headset.

The dialogue sentence obtaining module 914 is configured to obtain the dialogue sentence from the speech recognition result;

The reply sentence sending module 915 is configured to generate a reply sentence matching the dialogue sentence and send it to the earphone, and the earphone is used to play the reply sentence matching the dialogue sentence.

In the embodiment of the present invention, the reply sentence sending module 915 is used to obtain the user location information detected by the headset; according to the user location information and the dialogue sentence, generate a reply sentence for voice navigation and send the answer to the The headset is sent.

The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in One place, or it can be distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement without creative work.

Fig. 10 is a structural block diagram showing a headset 1000 for interaction according to an exemplary embodiment. 10, the headset 1000 may include one or more of the following components: a processing component 1002, a memory 1004, a power component 1006, a multimedia component 1008, an audio component 1010, an input/output (I/O) interface 1012, a sensor component 1014, And communication component 1016.

The processing component 1002 generally controls the overall operations of the headset 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1002 may include one or more processors 1020 to execute instructions to complete all or part of the steps of the foregoing method. In addition, the processing component 1002 may include one or more modules to facilitate the interaction between the processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate the interaction between the multimedia component 1008 and the processing component 1002.

The memory 1004 is configured to store various types of data to support operations on the headset 1000. Examples of these data include instructions for any application or method operated on the headset 1000, contact data, phone book data, messages, pictures, videos, etc. The memory 1004 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.

The power component 1006 provides power to various components of the earphone 1000. The power component 1006 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the headset 1000.

The multimedia component 1008 includes a screen that provides an output interface between the headset 1000 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the headset 1000 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a microphone (MIC), and when the headset 1000 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal may be further stored in the memory 1004 or transmitted via the communication component 1016. In some embodiments, the audio component 1010 further includes a speaker for outputting audio signals.

The I/O interface 1012 provides an interface between the processing component 1002 and a peripheral interface module. The above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

The sensor component 1014 includes one or more sensors for providing the earphone 1000 with various aspects of state evaluation. For example, the sensor component 1014 can detect the on/off state of the headset 1000 and the relative positioning of the components. For example, the component is the display and the keypad of the headset 1000. The sensor component 1014 can also detect the position change of the headset 1000 or a component of the headset 1000. , The presence or absence of contact between the user and the headset 1000, the orientation or acceleration/deceleration of the headset 1000, and the temperature change of the headset 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 1014 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

The communication component 1016 is configured to facilitate wired or wireless communication between the headset 1000 and other devices. The headset 1000 can be connected to a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 1014 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1014 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the headset 1000 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic component is used to implement the above method.

In an exemplary embodiment, there is also provided a non-transitory computer-readable storage medium including instructions, such as the memory 1004 including instructions, and the foregoing instructions may be executed by the processor 1020 of the headset 1000 to complete the foregoing method. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

A headset includes a memory and one or more programs, where one or more programs are stored in the memory, and are configured to be executed by one or more processors, including for performing Instructions for the following operations:

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Sending the user status to the server;

Optionally, it also includes instructions for performing the following operations: sending the recorded information to the server, and/or obtaining and recording the recorded information by the server.

Optionally, it further includes an instruction to perform the following operations: after the memo information is recorded, a reminder event for the memo information is generated.

Optionally, it further includes an instruction to perform the following operations: obtaining a preset reminder event for the memo information from the server.

Optionally, it also includes an instruction to perform the following operations: when the trigger condition of the preset reminder event is met, call the interactive assistant to obtain the memo information corresponding to the preset reminder event and play it.

Optionally, it also includes instructions for performing the following operations: obtaining a semantic analysis result obtained by the server performing semantic analysis on the memo information;

Obtaining a dialogue sentence from the speech recognition result;

Obtain user location information;

Obtain user position information detected by the position sensor.

Obtain user geographic location information;

A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of the headset, the headset can execute an interactive method, the method comprising:

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Sending the user status to the server;

Optionally, the invoking the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result, includes:

Optionally, the method further includes: sending the recorded information to the server, and/or obtaining and recording the recorded information of the server.

Optionally, the method further includes: after the memo information is recorded, generating a reminder event for the memo information.

Optionally, the method further includes: obtaining a preset reminder event for the memo information from the server.

Optionally, the method further includes: when the trigger condition of the preset reminder event is met, invoking the interactive assistant to obtain and play the memo information corresponding to the preset reminder event.

Optionally, the method further includes: obtaining a semantic analysis result obtained by the server performing semantic analysis on the memo information;

Obtaining a dialogue sentence from the speech recognition result;

Obtain user location information;

Obtain user position information detected by the position sensor.

Obtain user geographic location information;

Fig. 11 is a schematic structural diagram showing a server 1100 for interaction according to another exemplary embodiment of the present invention. The server may have relatively large differences due to different configurations or performance, and may include one or more central processing units (CPU) 1122 (for example, one or more processors) and memory 1132, one or more A storage medium 1130 (for example, one or a storage device with a large amount of storage) for storing application programs 1142 or data 1144. Among them, the memory 1132 and the storage medium 1130 may be short-term storage or persistent storage. The program stored in the storage medium 1130 may include one or more modules (not shown in the figure), and each module may include a series of command operations on the server. Furthermore, the central processing unit 1122 may be configured to communicate with the storage medium 1130, and execute a series of instruction operations in the storage medium 1130 on the server.

The server may also include one or more power supplies 1126, one or more wired or wireless network interfaces 1150, one or more input and output interfaces 1158, one or more keyboards 1156, and/or one or more operating systems 1141, For example, Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and so on.

A server including a memory and one or more programs, wherein one or more programs are stored in the memory, and are configured to be executed by one or more processors, including for performing Instructions for the following operations:

The voice recognition result is sent to the earphone, and the earphone is used for invoking an interactive assistant to perform an interactive operation according to the voice recognition result.

Optionally, it also includes instructions for performing the following operations: acquiring the user status detected by the headset;

Determining a sound effect matching the user status;

Optionally, it further includes instructions for performing the following operations: recognizing and recording information from the user voice according to the voice recognition result, or obtaining recorded information according to the voice recognition result and sending it to the headset, The earphone is used to play the recorded information.

Optionally, it further includes instructions for performing the following operations: sending information recognized from the user's voice to the headset, and/or acquiring and recording the information recorded by the headset.

Optionally, it also includes instructions for performing the following operations: after recording the memo information, generating a reminder event for the memo information;

Optionally, it also contains instructions for performing the following operations: performing semantic analysis on the memo information to obtain a semantic analysis result;

Optionally, it also includes instructions for performing the following operations: obtaining a dialogue sentence from the voice recognition result;

Acquiring user location information detected by the headset;

A non-transitory computer-readable storage medium. When instructions in the storage medium are executed by a processor of a server, the server can execute an interactive method, the method including:

Optionally, it also includes:

Acquiring the user status detected by the headset;

Optionally, it also includes:

Acquiring the user status detected by the headset;

Determining a sound effect matching the user status;

Optionally, it also includes:

Obtaining a dialogue sentence from the speech recognition result;

Acquiring user location information detected by the headset;

The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same or similar parts between the various embodiments can be referred to each other.

The embodiments of the present invention are described with reference to the flowcharts and/or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processors of general-purpose computers, special-purpose computers, embedded processors, or other programmable data processing terminal equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal equipment A device for realizing the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram is generated.

These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing terminal equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The instruction device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.

These computer program instructions can also be loaded on a computer or other programmable data processing terminal equipment, so that a series of operation steps are executed on the computer or other programmable terminal equipment to produce computer-implemented processing, so that the computer or other programmable terminal equipment The instructions executed above provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Although the preferred embodiments of the embodiments of the present invention have been described, those skilled in the art can make additional changes and modifications to these embodiments once they learn the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present invention.

Finally, it should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities Or there is any such actual relationship or sequence between operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements not only includes those elements, but also includes those elements that are not explicitly listed. Other elements listed, or also include elements inherent to this process, method, article, or terminal device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other same elements in the process, method, article or terminal device that includes the element.

The above describes in detail an interaction method, an interaction device, a headset, and a server provided by the present invention. In this article, specific examples are used to illustrate the principles and implementation modes of the present invention. The above embodiments The description is only used to help understand the method and core idea of the present invention; at the same time, for those of ordinary skill in the art, according to the idea of the present invention, there will be changes in the specific implementation and the scope of application. In summary As mentioned, the content of this specification should not be construed as a limitation of the present invention.

Claims

An interaction method, characterized in that it is applied to a headset, the headset is communicatively connected with a server, the headset has an interactive assistant, and the method includes:

Sending, by the headset, a user voice to the server, and obtaining a voice recognition result of the user voice from the server;

Invoke the interactive assistant to perform an interactive operation according to the voice recognition result.
The method according to claim 1, wherein the invoking the interactive assistant to perform an interactive operation according to the voice recognition result comprises:

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Invoke the interactive assistant to recommend songs or play songs according to the user status.
The method according to claim 2, wherein the headset has a gravity sensor, and the acquiring the user status includes:

Acquire the sensing data detected by the gravity sensor, and determine the user state according to the sensing data.
The method according to claim 2, wherein said invoking said interactive assistant to recommend songs according to said user status comprises:

Sending the user status to the server;

Receive the recommended song sent by the server and call the interactive assistant to recommend to the user, the recommended song is a song searched by the server that matches the user's status.
The method according to claim 2, wherein the invoking the interactive assistant to play a song according to the user status comprises:

Sending the user status to the server;

Receive the preset song after adjusting the sound effect sent by the server and call the interactive assistant to play it; the preset song after the sound effect adjustment is the sound effect determined by the server to match the user status, and the preset song Adjusted to the sound effect.
The method according to claim 1, wherein the invoking the interactive assistant to perform an interactive operation according to the voice recognition result comprises:

Invoke the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.
The method according to claim 6, wherein said invoking said interactive assistant to recognize and record information from said user voice according to said voice recognition result, or obtain recorded information according to said voice recognition result And play, including:

Invoke the interactive assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain and play the pre-device memo information according to the voice recognition result.
The method according to claim 6, wherein said invoking said interactive assistant to recognize and record information from said user voice according to said voice recognition result, or obtain recorded information according to said voice recognition result And play, including:

The interactive assistant is called to recognize and record a target voice from the user's voice according to the voice recognition result, or obtain and play the recorded target voice according to the voice recognition result.
The method according to claim 6, further comprising:

Send the recorded information to the server, and/or obtain and record the recorded information of the server.
The method according to claim 7, further comprising:

After the memo information is recorded, a reminder event for the memo information is generated.
The method according to claim 8, further comprising:

Obtain a preset reminder event for the memo information from the server.
The method according to claim 10 or 11, further comprising:

When the trigger condition of the preset reminder event is met, the interactive assistant is called to obtain and play the memo information corresponding to the preset reminder event.
The method according to claim 7, wherein the obtaining and playing the pre-device forget information according to the voice recognition result comprises:

Searching for information that matches the voice recognition result from the pre-device forget information;

Invoke the interactive assistant to play the information matching the voice recognition result.
The method according to claim 7, further comprising:

Obtaining a semantic analysis result obtained by the server performing semantic analysis on the memo information;

According to the semantic analysis result, label information is generated for the memo information.
The method according to claim 14, wherein the acquiring and playing the pre-device forget information according to the voice recognition result comprises:

When the voice recognition result includes the memo information that characterizes the need to find target tag information, the interactive assistant is called to find and play the pre-device forget information that matches the target tag information.
The method according to claim 1, wherein the invoking the interactive assistant to perform an interactive operation according to the voice recognition result comprises:

Obtaining a dialogue sentence from the speech recognition result;

The interactive assistant is called to generate and play a reply sentence matching the dialogue sentence.
The method according to claim 16, wherein the invoking the interactive assistant to generate and play a reply sentence matching the dialogue sentence comprises:

Obtain user location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence.
The method according to claim 17, wherein the headset has an orientation sensor, and the acquiring user orientation information comprises:

Obtain user position information detected by the position sensor.
The method according to claim 17, wherein said invoking said interactive assistant to generate and play a reply sentence for voice navigation according to said user location information and said dialogue sentence, comprising:

Obtain user geographic location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information, the dialogue sentence and the user's geographic location information.
The method according to claim 17, wherein said invoking said interactive assistant to generate and play a reply sentence for voice navigation according to said user location information and said dialogue sentence, comprising:

Sending navigation query information to the server; the navigation query information includes the user location information and the dialogue sentence;

The reply sentence for voice navigation sent by the server is received and played. The reply sentence for voice navigation is generated by the server according to the user location information and the dialog sentence query.
An interaction method, characterized in that it is applied to a server, the server is communicatively connected with a headset, the headset has an interactive assistant, and the method includes:

The server receives the user voice sent by the headset, and recognizes the user voice to obtain a voice recognition result;

The voice recognition result is sent to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.
The method according to claim 21, further comprising:

Acquiring the user status detected by the headset;

Find a recommended song matching the user's state and send it to the headset; the headset is used to call the interactive assistant to recommend the recommended song to the user.
The method according to claim 21, further comprising:

Acquiring the user status detected by the headset;

Determining a sound effect matching the user status;

The preset song is adjusted to the sound effect, and the preset song with the adjusted sound effect is sent to the earphone, and the earphone is used for invoking the interactive assistant to play the preset song with the adjusted sound effect.
The method according to claim 21, further comprising:

Recognize and record information from the user's voice according to the voice recognition result, or obtain and send the recorded information to the earphone according to the voice recognition result, and the earphone is used to play the recorded information.
The method according to claim 24, wherein the information is recognized and recorded from the user voice according to the voice recognition result, or the recorded information is obtained according to the voice recognition result and sent to the headset Send, including:

Recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.
The method according to claim 24, wherein the information is recognized and recorded from the user voice according to the voice recognition result, or the recorded information is obtained according to the voice recognition result and sent to the headset Send, including:

According to the voice recognition result, a target voice is recognized and recorded from the user voice, or a recorded target voice is acquired and sent to the headset according to the voice recognition result.
The method according to claim 24, further comprising:

Send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.
The method according to claim 25, further comprising:

After the memo information is recorded, a reminder event for the memo information is generated;

For the reminder event to the earphone, the earphone is used to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.
The method according to claim 25, further comprising:

Perform semantic analysis on the memo information to obtain the semantic analysis result;

According to the semantic analysis result, label information is generated for the memo information.
The method according to claim 29, wherein the acquiring pre-device forget information according to the voice recognition result and sending it to the headset comprises:

When the voice recognition result includes memo information that characterizes the need to find target tag information, search for pre-device forget information that matches the target tag information and send it to the headset.
The method according to claim 21, further comprising:

Obtaining a dialogue sentence from the speech recognition result;

A reply sentence matching the dialogue sentence is generated and sent to the earphone, and the earphone is used to play the reply sentence matching the dialogue sentence.
The method according to claim 31, wherein the generating and sending a reply sentence matching the conversation sentence to the headset comprises:

Acquiring user location information detected by the headset;

According to the user location information and the dialogue sentence, a reply sentence for voice navigation is generated and sent to the headset.
An interactive device, characterized in that it is applied to a headset, the headset is in communication connection with a server, the headset has an interactive assistant, and the device includes:

A voice recognition result obtaining module, configured to send a user voice to the server, and obtain a voice recognition result of the user voice from the server;

The first interaction module is used to invoke the interaction assistant to perform an interaction operation according to the voice recognition result.
The interaction device according to claim 33, wherein the first interaction module comprises:

The wake-up module is used to wake up the interactive assistant according to the voice recognition result;

User status acquisition module, used to acquire user status;

The song interaction module is used to call the interactive assistant to recommend songs or play songs according to the user status.
The interaction device according to claim 34, wherein the headset has a gravity sensor, and the user status acquisition module is configured to acquire sensor data detected by the gravity sensor, and determine the user status according to the sensor data .
The interaction device according to claim 34, wherein the song interaction module is configured to send the user status to the server; receive recommended songs sent by the server and call the interactive assistant to recommend to the user, The recommended song is a song found by the server that matches the status of the user.
The interaction device according to claim 34, wherein the song interaction module is configured to send the user status to the server; receive a preset song with adjusted sound effects sent by the server and call the interaction Assistant playing; the preset song after the sound effect adjustment is a sound effect determined by the server to match the user status, and the preset song is adjusted to the sound effect.
The interaction device according to claim 33, wherein the first interaction module comprises:

The first recording interaction module is configured to call the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.
The interaction device according to claim 38, wherein the first recording interaction module is configured to call the interaction assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or Obtain and play the pre-device forget information according to the voice recognition result.
The interaction device of claim 38, wherein the first recording interaction module is configured to call the interaction assistant to recognize and record the target voice from the user voice according to the voice recognition result, or according to the voice recognition result. According to the voice recognition result, the recorded target voice is obtained and played.
The interaction device according to claim 38, further comprising:

The first recorded information transmission module is configured to send recorded information to the server, and/or obtain and record the recorded information of the server.
The interaction device of claim 39, further comprising:

The first reminder event generating module is configured to generate a reminder event for the memo information after the memo information is recorded.
The interaction device of claim 40, further comprising:

The first reminder event obtaining module is configured to obtain preset reminder events for the memo information from the server.
The interaction device according to claim 42 or 43, further comprising:

The first reminder event triggering module is configured to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.
The interaction device according to claim 39, wherein the first recording interaction module is configured to search for information that matches the voice recognition result from pre-device forget information; call the interactive assistant to play the and Information that the voice recognition result matches.
The interaction device of claim 39, further comprising:

The first semantic analysis module is configured to obtain a semantic analysis result obtained by the server performing semantic analysis on the memo information;

The first label generating module is configured to generate label information for the memo information according to the semantic analysis result.
The interaction device according to claim 46, wherein the first recording interaction module is configured to call the interaction assistant to find memo information that characterizes the need to find target tag information when the voice recognition result The pre-device that matches the target tag information forgets the information and plays it.
The interaction device according to claim 33, wherein the first interaction module comprises:

The first dialogue sentence obtaining module is used to obtain the dialogue sentence from the speech recognition result;

The first dialogue interaction module is used to call the interactive assistant to generate and play a reply sentence matching the dialogue sentence.
The interaction device according to claim 48, wherein the first dialog interaction module is configured to obtain user location information; call the interactive assistant to generate a voice message according to the user location information and the dialog sentence Navigate the reply sentence and play it.
The interaction device according to claim 49, wherein the headset has an orientation sensor, and the first dialogue interaction module is configured to obtain user orientation information detected by the orientation sensor.
The interaction device according to claim 49, wherein the first dialog interaction module is configured to obtain user geographic location information; call the interactive assistant according to the user location information, the dialogue sentence, and the user geographic location Information, generate and play the reply sentence for voice navigation.
The interaction device of claim 49, wherein the first dialog interaction module is configured to send navigation query information to the server; the navigation query information includes the user location information and the dialog sentence; The reply sentence for voice navigation sent by the server is received and played. The reply sentence for voice navigation is generated by the server according to the user location information and the dialog sentence query.
An interactive device, characterized in that it is applied to a server, the server is in communication connection with a headset, the headset has an interactive assistant, and the device includes:

The voice recognition module is used to receive the user voice sent by the headset and recognize the user voice to obtain a voice recognition result;

The voice recognition result sending module is configured to send the voice recognition result to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.
The interactive device of claim 53, further comprising:

The first user status acquiring module is configured to acquire the user status detected by the headset;

The first song sending module is used to find a recommended song matching the user's status and send it to the earphone; the earphone is used to call the interactive assistant to recommend the recommended song to the user.
The interactive device of claim 53, further comprising:

The second user status acquiring module is configured to acquire the user status detected by the headset;

A sound effect determining module, configured to determine a sound effect matching the user status;

The second song sending module is configured to adjust a preset song to the sound effect and send the preset song with the adjusted sound effect to the earphone. The earphone is used to call the interactive assistant to play all the adjusted sound effects. Describe the preset songs.
The interactive device of claim 53, further comprising:

The recorded information processing module is used for recognizing and recording information from the user’s voice according to the voice recognition result, or acquiring the recorded information according to the voice recognition result and sending it to the earphone, and the earphone is used for playing The recorded information.
The interactive device according to claim 56, wherein the record information processing module comprises:

The memo information processing module is configured to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.
The interactive device according to claim 56, wherein the record information processing module comprises:

The voice processing module is configured to recognize and record a target voice from the user voice according to the voice recognition result, or obtain a recorded target voice according to the voice recognition result and send it to the headset.
The interactive device of claim 56, further comprising:

The second record information transmission module is configured to send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.
The interaction device of claim 57, further comprising:

The second reminder event generating module is used to generate a reminder event for the memo information after the memo information is recorded;

The reminder event sending module is configured to send the reminder event to the earphone, and the earphone is used to call the interactive assistant to obtain the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met, and Play.
The interaction device of claim 57, further comprising:

The second semantic analysis module is used to perform semantic analysis on the memo information to obtain the semantic analysis result;

The second label generating module is used to generate label information for the memo information according to the semantic analysis result.
The interaction device according to claim 61, wherein the memo information processing module is configured to find the memo information that matches the target tag information when the voice recognition result includes a requirement to find memo information with target tag information The pre-device forgot the information and sent it to the headset.
The interactive device of claim 53, further comprising:

A dialogue sentence obtaining module, which is used to obtain a dialogue sentence from the speech recognition result;

The reply sentence sending module is used for generating a reply sentence matching the dialogue sentence and sending it to the earphone, and the earphone is used for playing the reply sentence matching the dialogue sentence.
The interaction device according to claim 63, wherein the reply sentence sending module is configured to obtain user location information detected by the headset; and generate a voice navigation system based on the user location information and the dialogue sentence. The reply sentence is sent to the headset.
A headset, characterized by comprising a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors Contains instructions for the following operations:

Sending a user voice to a server, and obtaining a voice recognition result of the user voice from the server;

The interactive assistant is invoked to perform an interactive operation according to the voice recognition result.
The headset according to claim 65, wherein said invoking said interactive assistant to perform an interactive operation according to said voice recognition result comprises:

Wake up the interactive assistant according to the voice recognition result;

Get user status;

Invoke the interactive assistant to recommend songs or play songs according to the user status.
The earphone according to claim 66, wherein the earphone has a gravity sensor, and said acquiring the user status comprises:

Acquire the sensing data detected by the gravity sensor, and determine the user state according to the sensing data.
The headset according to claim 66, wherein said invoking said interactive assistant to recommend songs according to said user status comprises:

Sending the user status to the server;

Receive the recommended song sent by the server and call the interactive assistant to recommend to the user, the recommended song is a song searched by the server that matches the user's status.
The headset according to claim 66, wherein said invoking said interactive assistant to play a song according to said user status comprises:

Sending the user status to the server;

Receive the preset song after adjusting the sound effect sent by the server and call the interactive assistant to play it; the preset song after the sound effect adjustment is the sound effect determined by the server to match the user status, and the preset song Adjusted to the sound effect.
The headset according to claim 65, wherein said invoking said interactive assistant to perform an interactive operation according to said voice recognition result comprises:

Invoke the interactive assistant to recognize and record information from the user's voice according to the voice recognition result, or obtain and play the recorded information according to the voice recognition result.
The headset according to claim 70, wherein the invoking the interactive assistant recognizes and records information from the user voice according to the voice recognition result, or obtains recorded information according to the voice recognition result And play, including:

Invoke the interactive assistant to recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain and play the pre-device memo information according to the voice recognition result.
The headset according to claim 70, wherein the invoking the interactive assistant recognizes and records information from the user voice according to the voice recognition result, or obtains recorded information according to the voice recognition result And play, including:

Invoke the interactive assistant to recognize and record a target voice from the user's voice according to the voice recognition result, or obtain and play the recorded target voice according to the voice recognition result.
The headset according to claim 70, further comprising instructions for performing the following operations:

Send the recorded information to the server, and/or obtain and record the recorded information of the server.
The headset according to claim 71, further comprising instructions for performing the following operations:

After the memo information is recorded, a reminder event for the memo information is generated.
The headset according to claim 72, further comprising instructions for performing the following operations:

Obtain a preset reminder event for the memo information from the server.
The headset according to claim 74 or 75, further comprising instructions for performing the following operations:

When the trigger condition of the preset reminder event is met, the interactive assistant is called to obtain and play the memo information corresponding to the preset reminder event.
The headset according to claim 71, wherein the acquiring and playing the pre-device forget information according to the voice recognition result comprises:

Searching for information that matches the voice recognition result from the pre-device forget information;

Invoke the interactive assistant to play the information matching the voice recognition result.
The headset according to claim 71, further comprising instructions for performing the following operations:

Obtaining a semantic analysis result obtained by the server performing semantic analysis on the memo information;

According to the semantic analysis result, label information is generated for the memo information.
The headset according to claim 78, wherein the acquiring and playing the pre-device forget information according to the voice recognition result comprises:

When the voice recognition result includes the memo information that characterizes the need to find target tag information, the interactive assistant is called to find and play the pre-device forget information that matches the target tag information.
The headset according to claim 65, wherein said invoking said interactive assistant to perform an interactive operation according to said voice recognition result comprises:

Obtaining a dialogue sentence from the speech recognition result;

Invoke the interactive assistant to generate a reply sentence matching the dialogue sentence and play it.
The headset according to claim 80, wherein the invoking the interactive assistant to generate and play a reply sentence matching the dialogue sentence comprises:

Obtain user location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information and the dialogue sentence.
The headset according to claim 81, wherein the headset has an orientation sensor, and said acquiring user orientation information comprises:

Obtain user position information detected by the position sensor.
The headset according to claim 81, wherein said invoking said interactive assistant to generate and play a reply sentence for voice navigation according to said user location information and said dialogue sentence, comprising:

Obtain user geographic location information;

The interactive assistant is called to generate and play a reply sentence for voice navigation according to the user location information, the dialogue sentence and the user's geographic location information.
The headset according to claim 81, wherein said invoking said interactive assistant to generate and play a reply sentence for voice navigation according to said user location information and said dialogue sentence, comprising:

Sending navigation query information to the server; the navigation query information includes the user location information and the dialogue sentence;

The reply sentence for voice navigation sent by the server is received and played. The reply sentence for voice navigation is generated by the server according to the user location information and the dialog sentence query.
A server, characterized by comprising a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors Contains instructions for the following operations:

Receive the user's voice sent by the headset, and recognize the user's voice to obtain the voice recognition result;

The voice recognition result is sent to the earphone, and the earphone is used to call the interactive assistant to perform an interactive operation according to the voice recognition result.
The server of claim 85, further comprising instructions for performing the following operations:

Acquiring the user status detected by the headset;

Find a recommended song matching the user's state and send it to the headset; the headset is used to call the interactive assistant to recommend the recommended song to the user.
The server of claim 85, further comprising instructions for performing the following operations:

Acquiring the user status detected by the headset;

Determine a sound effect matching the user status;

The preset song is adjusted to the sound effect, and the preset song with the adjusted sound effect is sent to the earphone, and the earphone is used for invoking the interactive assistant to play the preset song with the adjusted sound effect.
The server of claim 85, further comprising instructions for performing the following operations:

Recognize and record information from the user's voice according to the voice recognition result, or obtain and send the recorded information to the earphone according to the voice recognition result, and the earphone is used to play the recorded information.
The server according to claim 88, wherein the information is recognized and recorded from the user's voice according to the voice recognition result, or the recorded information is obtained according to the voice recognition result and sent to the headset Send, including:

Recognize and record memo information from the voice recognition result according to the voice recognition result, or obtain pre-device memo information according to the voice recognition result and send it to the headset.
The server according to claim 88, wherein the information is recognized and recorded from the user's voice according to the voice recognition result, or the recorded information is obtained according to the voice recognition result and sent to the headset Send, including:

According to the voice recognition result, a target voice is recognized and recorded from the user voice, or a recorded target voice is acquired and sent to the headset according to the voice recognition result.
The server according to claim 88, further comprising instructions for performing the following operations:

Send the information recognized from the user's voice to the earphone, and/or obtain and record the information recorded by the earphone.
The server according to claim 89, further comprising instructions for performing the following operations:

After the memo information is recorded, a reminder event for the memo information is generated;

For the reminder event to the earphone, the earphone is used to call the interactive assistant to obtain and play the memo information corresponding to the preset reminder event when the trigger condition of the preset reminder event is met.
The server according to claim 89, further comprising instructions for performing the following operations:

Perform semantic analysis on the memo information to obtain the semantic analysis result;

According to the semantic analysis result, label information is generated for the memo information.
The server according to claim 93, wherein the acquiring pre-device forget information according to the voice recognition result and sending it to the headset comprises:

When the voice recognition result includes memo information that characterizes the need to find target tag information, search for pre-device forget information that matches the target tag information and send it to the headset.
The server of claim 85, further comprising instructions for performing the following operations:

Obtaining a dialogue sentence from the speech recognition result;

A reply sentence matching the dialogue sentence is generated and sent to the earphone, and the earphone is used to play the reply sentence matching the dialogue sentence.
The server according to claim 95, wherein the generating and sending a reply sentence matching the conversation sentence to the headset comprises:

Acquiring user location information detected by the headset;

According to the user location information and the dialogue sentence, a reply sentence for voice navigation is generated and sent to the headset.
A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the interactive method according to any one of claims 1 to 20 is implemented step.
A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the interactive method according to any one of claims 21 to 32 is implemented. step.
A computer program comprising computer readable code, which when the computer readable code runs on a computing processing device, causes the computing processing device to execute the interaction method according to any one of claims 1-20.
A computer program comprising computer readable code, which when the computer readable code runs on a computing processing device, causes the computing processing device to execute the interaction method according to any one of claims 21-32.