WO2016019695A1

WO2016019695A1 - Voice interaction method and terminal

Info

Publication number: WO2016019695A1
Application number: PCT/CN2014/096015
Authority: WO
Inventors: 刘豫军
Original assignee: 广州华多网络科技有限公司
Priority date: 2014-08-04
Filing date: 2014-12-31
Publication date: 2016-02-11
Also published as: CN104166899A; CN104166899B

Abstract

A voice interaction method and a terminal. The method comprises: detecting the state of a voice interaction window of each second terminal in an interaction group, and determining the second terminals that are valid and online according to the state of the voice interaction window of each second terminal (101); detecting the second terminals having the voice interaction capability in all the second terminals that are valid and online, and using all the second terminals that are valid and online and have the voice interaction capability as the second terminals satisfying the voice interaction condition (102); and implementing voice interaction with the second terminals satisfying the voice interaction condition (103).

Description

Voice interaction method and terminal

The present application claims priority to Chinese Patent Application No. 2014-1037976, filed on Aug. 4, 2014, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present application relates to the field of information technology, and in particular, to a method and terminal for voice interaction.

Background technique

With the continuous development of information technology, more and more application scenarios of voice interaction. Taking the application scenario taught by the teacher as an example, the teacher can understand the learning state of the student and strengthen the knowledge point by performing voice interaction with the student. Therefore, how to carry out voice interaction has become a concern of people.

There are currently two ways of voice interaction. The first mode: the first terminal selects at least one second terminal and performs voice interaction with the selected second terminal. The second mode: the first terminal receives the voice interaction request sent by the at least one second terminal; the first terminal selects at least one second terminal according to all the received voice interaction requests, and performs voice interaction with the selected second terminal.

In the process of implementing the present application, the inventors found that the above method has at least the following problems:

In the first mode, the first terminal directly selects the second terminal and performs voice interaction. Because the selected second terminal's microphone cannot be used or the second terminal is selected by the unmanned operation, the first terminal cannot be selected with the first terminal. The second terminal performs voice interaction, which makes the voice interaction less efficient. In the second mode, the first terminal selects the second terminal according to the received voice interaction request sent by the at least one second terminal, and performs voice interaction, but the microphone of the second terminal is still unavailable, and the first terminal cannot be used. The selected second terminal performs voice interaction, resulting in low efficiency of voice interaction.

Summary of the invention

In order to solve the problem of the prior art, the embodiment of the present application provides a method and terminal for voice interaction. The technical solution is as follows:

In a first aspect, a method for voice interaction is provided, the method comprising:

Detecting the status of the voice interaction window of each second terminal in the interaction group, according to each second terminal The state of the voice interaction window determines the second terminal that is effectively online, and the interaction group includes the first terminal and the at least one second terminal;

Detecting a second terminal having voice interaction capability in all the second terminals that are effectively online, and using all the second terminals that are effectively online and having voice interaction capability as the second terminal having voice interaction conditions;

The voice interaction is performed according to the second terminal having the voice interaction condition.

As an optional embodiment, the determining, according to the state of the voice interaction window of each second terminal, the second terminal that is effectively online, includes:

Determining whether the voice interaction window of each second terminal is displayed at the forefront and without occlusion;

The voice interaction window is displayed at the forefront and the second terminal is occluded as the second terminal that is effectively online.

As an optional embodiment, after determining whether the voice interaction window of each second terminal is displayed at the forefront and without occlusion, the method further includes:

Detecting, in a preset time, an operation of the voice interaction window of the second terminal that is displayed at the forefront and without occlusion;

Displaying the voice interaction window at the forefront and unobstructing the second terminal as the second terminal of the effective online, including:

The second terminal that displays the voice interaction window at the forefront and has no occlusion and detects the operation of the voice interaction window within a preset time is used as the second terminal of the effective online.

As an optional embodiment, detecting the second terminal having voice interaction capability in all the second terminals that are effectively online includes:

Testing the microphone of each second terminal that is effectively online;

If the microphone test of any of the second terminals passes, any second terminal is used as the detected second terminal with voice interaction capability.

As an optional embodiment, the voice interaction is performed according to the displayed interactive identifier and the second terminal having the voice interaction condition, including:

Selecting at least one second terminal from all second terminals having voice interaction conditions according to the displayed interactive identifier, and performing voice interaction with the selected second terminal.

As an optional embodiment, after all the second terminals that are effectively online and have voice interaction capabilities are used as the second terminal with voice interaction conditions, the method further includes:

The first terminal displays an inability to interact with the second terminal that is not active online and/or has no voice interaction capability.

As an optional embodiment, after the first terminal displays the inaccessible identifier of the second terminal that is not valid online and/or does not have the voice interaction capability, the method further includes:

Periodically detecting a second terminal that is not active online and/or has no voice interaction capability;

When it is detected that the second terminal that is not valid online and/or has no voice interaction capability is valid online and has voice interaction capability, the detected non-interactive identifier of the second terminal is updated to an interactive identifier.

In a second aspect, a terminal for voice interaction is provided, and the terminal includes:

a first detecting module, configured to detect a state of a voice interaction window of each second terminal in the interaction group, where the interaction group includes a first terminal and at least one second terminal;

a determining module, configured to determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online;

a second detecting module, configured to detect a second terminal having voice interaction capability in all second terminals that are effectively online;

a processing module, configured to use all second terminals that are effectively online and have voice interaction capability as the second terminal with voice interaction conditions;

A voice interaction module for performing voice interaction according to a second terminal having a voice interaction condition.

As an optional embodiment, the determining module includes:

a judging unit, configured to determine whether the voice interaction window of each second terminal is displayed at the forefront and has no occlusion;

The first processing unit is configured to display the voice interaction window at the forefront and the non-occlusion second terminal as the second terminal that is effectively online.

As an optional embodiment, the determining module further includes:

a detecting unit, configured to detect, during a preset time, an operation of displaying a voice interaction window of the second terminal in the forefront and without occlusion;

The first processing unit is configured to display the voice interaction window at the forefront and without occlusion and the second terminal that detects the operation of the voice interaction window within the preset time as the second terminal that is effectively online.

As an optional embodiment, the second detecting module includes:

a testing unit, configured to test a microphone of each second terminal that is effectively online;

And a second processing unit, configured to use any of the second terminals as the detected second terminal having voice interaction capability when the microphone test of any second terminal passes.

As an optional embodiment, the voice interaction module includes:

a selection unit for displaying an interactive logo of all second terminals having voice interaction conditions, and rooting The interactive identifier is selected to select at least one second terminal from all second terminals having voice interaction conditions;

A voice interaction unit for performing voice interaction with the selected second terminal.

As an optional embodiment, the terminal further includes:

The identifier display module is configured to display, by the first terminal, an inability to interact with the second terminal that is not valid online and/or has no voice interaction capability.

As an optional embodiment, the terminal further includes:

a third detecting module, configured to periodically detect a second terminal that is not valid online and/or has no voice interaction capability;

The update module is configured to update the detected non-interactive identifier of the second terminal to the interactive identifier when detecting that the second terminal that is not valid online and/or has no voice interaction capability is valid online and has voice interaction capability.

A third aspect provides a terminal, where the terminal includes: a processor, a transceiver;

The processor is configured to detect a state of a voice interaction window of each second terminal in the interaction group, and determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online, where the interaction group includes a terminal and at least one second terminal; detecting a second terminal having voice interaction capability in all second terminals that are effectively online, and using all second terminals that are effective online and having voice interaction capability as the second terminal having voice interaction conditions ;

The transceiver is configured to perform voice interaction according to a second terminal having a voice interaction condition.

As an optional embodiment, the processor is further configured to determine whether the voice interaction window of each second terminal is displayed at the front end and is not occluded; displaying the voice interaction window at the forefront and the occlusion of the second terminal is effective. The second terminal on the line.

In an optional embodiment, the processor is further configured to: detect, during a preset time, an operation of displaying a voice interaction window of the second terminal in the front end and the occlusion;

The processor is further configured to display the voice interaction window at the forefront and without occlusion and the second terminal that detects the operation of the voice interaction window within a preset time as the second terminal that is effectively online.

As an optional embodiment, the processor is further configured to test a microphone of each second terminal that is effectively online; if any of the second terminals pass the microphone test, the second terminal is used. As the detected second terminal with voice interaction capability.

As an optional embodiment, the terminal further includes a display.

a display for displaying an interactive logo of all second terminals having voice interaction conditions;

The processor is further configured to select at least one second terminal from all second terminals having voice interaction conditions according to the displayed interactive identifier;

The transceiver is further configured to perform voice interaction with the selected second terminal.

As an optional embodiment, the display is further configured to display, by the first terminal, an inability to interact with the second terminal that is not valid online and/or has no voice interaction capability.

As an optional embodiment, the processor is further configured to periodically detect a second terminal that is not valid online and/or has no voice interaction capability; when detecting that the network is not valid online and/or has no voice When the second terminal of the interactive capability is valid online and has the voice interaction capability, the detected non-interactive identifier of the second terminal is updated to the interactive identifier.

The beneficial effects brought by the technical solutions provided by the embodiments of the present application are:

The second terminal with the voice interaction condition is used as the second terminal with the voice interaction condition, and the second terminal with the voice interaction condition performs the voice interaction, thereby implementing the second terminal with the voice interaction condition. Voice interaction increases the efficiency of voice interaction.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present application. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

1 is a schematic diagram of an implementation environment involved in a method for voice interaction provided by an embodiment of the present application;

2 is a flowchart of a method for voice interaction provided by an embodiment of the present application;

3 is a flowchart of a method for voice interaction provided by another embodiment of the present application;

4 is a schematic diagram of an interaction interface according to another embodiment of the present application;

FIG. 5 is a flowchart of voice interaction provided by another embodiment of the present application; FIG.

6 is a schematic structural diagram of a voice interactive terminal according to another embodiment of the present application;

FIG. 7 is a schematic structural diagram of a first detecting module according to another embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of a first detecting module according to another embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of a second detecting module according to another embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of a voice interaction module according to another embodiment of the present application;

11 is a schematic structural diagram of a voice interactive terminal according to another embodiment of the present application;

FIG. 12 is a schematic structural diagram of a terminal according to another embodiment of the present application.

detailed description

In order to make the objects, technical solutions and advantages of the present application more clear, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings.

Please refer to FIG. 1 , which is a schematic structural diagram of an implementation environment involved in a method for voice interaction provided by an embodiment of the present application. As shown in FIG. 1 , the implementation environment includes a first terminal 101 and a second terminal 102. The first terminal 101 and the second terminal 102 can communicate through a wired network or a wireless network. The first terminal 101 and the second terminal 102 may be a smartphone, a tablet, a laptop portable computer, or the like. FIG. 1 shows only one first terminal 101 and two second terminals 102. In the specific implementation, the first terminal 101 and the second terminal 102 may also have multiple. The first embodiment and the subsequent embodiments do not have the first terminal 101 and The number of second terminals 102 is limited.

In addition, the first terminal 101 and the second terminal 102 mentioned in this embodiment and subsequent embodiments may perform voice interaction on the same topic or the same content, thereby forming an interaction group. In this embodiment, the number of the first terminal 101 and the second terminal in the interaction group is not limited, and the manner in which the first terminal 101 and the second terminal 102 join the interaction group is also not limited. In a specific implementation, the first terminal 101 and the second terminal 102 may apply for the same interaction group to perform voice interaction for the same topic or the same content, and the terminal in the same interaction group may perform voice interaction through the microphone of the terminal. For the case that the first terminal 101 is in the voice interaction with the second terminal 102, the microphone of the second terminal 102 cannot be used or the second terminal 102 is not operated. The embodiment of the present application provides a method for voice interaction. Figure 2. The method flow includes:

101: Detecting a state of a voice interaction window of each second terminal in the interaction group, and determining, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online, where the interaction group includes the first terminal and at least one Second terminal;

As an optional embodiment, determining the second terminal that is effectively online according to the state of the voice interaction window of each second terminal includes:

102: Detecting a second terminal having voice interaction capability in all the second terminals that are effectively online, and using all the second terminals that are effectively online and having voice interaction capability as the second terminal having voice interaction conditions;

Testing the microphone of each second terminal that is effectively online;

103: Perform voice interaction according to the second terminal that has a voice interaction condition.

Displaying an interaction identifier of all second terminals having voice interaction conditions, and selecting at least one second terminal from all second terminals having voice interaction conditions according to the displayed interaction identifier, and performing voice interaction with the selected second terminal.

The method provided by the embodiment of the present application implements voice interaction by using all second terminals that are effectively online and have voice interaction capability as the second terminal with voice interaction conditions, and performing voice interaction according to the second terminal having voice interaction conditions. The second terminal of the voice interaction condition performs voice interaction, which improves the efficiency of voice interaction.

The embodiment of the present application provides a method for voice interaction. In combination with the contents of the embodiment shown in FIG. 1 and FIG. 2, a voice interaction method is applied to a scene in which a teacher conducts classroom teaching to a student, wherein a teacher operates. The first terminal, the student operates the second terminal, each student can operate the second terminal to apply to join the interactive group where the teacher is located, so that the first terminal and all the second terminals form an interactive group, and the first terminal can control the second terminal Make voice interactions. The interaction group includes a first terminal and at least one second terminal. Referring to Figure 3, the method flow includes:

201: The first terminal determines whether the voice interaction window of each second terminal in the interaction group is displayed at the front end and is not occluded;

The first terminal may determine the second terminal in the interaction group before determining whether the voice interaction window of each second terminal in the interaction group is displayed at the front end and is not occluded. The manner of determining the second terminal in the interaction group is not specifically limited in this embodiment. In a specific implementation, the non-interactive identifier of the second terminal may be displayed, and the second terminal in the interaction group is determined according to the non-interactive identifier of the second terminal.

The voice interaction window is a voice interactive interface displayed when the second terminal runs the voice interactive application, and the student operating the second terminal can perform voice interaction with the teacher operating the first terminal through the voice interaction window.

Since multiple applications may be running in the second terminal at the same time, the student operating the second terminal may be using any of the multiple applications running; if the student operating the second terminal is using the application is not a voice Interactive applications can cause voice interactions to fail. When the voice interaction window is displayed at the front end and is unoccluded, it indicates that the student operating the second terminal is using the voice interactive application. Therefore, in order to ensure that the student who operates the second terminal is using the voice interactive application, the method provided by the embodiment of the present application determines whether the voice interaction window of each second terminal in the interaction group is displayed at the front end and is not blocked, thereby eliminating A second terminal that is being operated by a student who is using an application other than the voice interactive application, thereby improving the efficiency of voice interaction. The method for determining whether the voice interaction window of each second terminal in the interaction group is displayed at the forefront and without occlusion is not specifically limited in this embodiment. For example, the first terminal sends a detection instruction of the voice interaction window to each second terminal, and each second terminal in the interaction group detects the voice interaction window through an API (Application Programming Interface) according to the detection instruction. Whether it is in the active state, the state detection result is obtained; if the voice window is in the active state, it indicates that the voice interaction window is at the front end and is not occluded; the second terminal returns the state detection result to the first terminal, and the first terminal receives the interaction group a state detection result of the voice interaction window sent by each second terminal; if the state detection result of the voice interaction window sent by any second terminal received is that the voice interaction window is in an active state, the first terminal determines the second The terminal's voice interaction window is displayed at the front end and is unobstructed.

202: The first terminal detects, in a preset time, an operation of displaying a voice interaction window of the voice terminal that is displayed at the front end and is not occluded;

When the voice interaction window of the second terminal is displayed at the forefront and is not occluded, although the student operating the second terminal is using the voice interactive application, the voice interaction window still exists because the student operating the second terminal is not seated or the like. The second terminal that is displayed at the forefront and is unobstructed is unmanned.

In order to prevent the voice interaction window from being displayed at the forefront and the unblocked second terminal is not operated, the embodiment further provides a method for detecting the operation of the voice interaction window of the second terminal, which is preset by the first terminal. The operation of detecting the voice interaction window in the time is displayed at the front end and the operation of the voice interaction window of the second terminal without occlusion, so as to ensure that the voice interaction window is displayed at the forefront and the second terminal without occlusion is operated in a preset time. Regarding the manner of detection, the present embodiment is not specifically limited. For example, the first terminal sends an operation detection instruction to the second terminal that is displayed at the forefront and is not occluded to each voice interaction window, and the second terminal that is displayed at the forefront by the voice interaction window and is unoccluded is preset according to the operation detection instruction. The operation of detecting the voice interaction window is performed in time, and the operation detection result is obtained; the second interaction terminal displayed in the front end and the occlusion is returned to the first terminal, and the first terminal receives the voice interaction window displayed at the forefront. And the operation detection result sent by the second terminal without occlusion; if the operation detection result sent by any second terminal received is an operation of detecting the voice interaction window within a preset time, the first terminal is within the preset time The operation of the voice interaction window of the second terminal that is displayed at the forefront and without occlusion is detected.

The embodiment does not limit the length of the preset time. In the specific implementation, if the preset time set is too short, the student who operates the second terminal within the preset time may still have the operation in the future; if the set preset time is too long, the preset may appear in the preset. The situation in which the second terminal is not operated during the time. Therefore, the preset time that can be set according to the actual situation, for example, the preset time can be set to 30 seconds or the like.

203: The first terminal displays the voice interaction window at the forefront and is occluded, and the second terminal that detects the operation of the voice interaction window within the preset time is used as the detected second terminal of the effective online;

In the method provided by the embodiment, when the voice interaction window of the second terminal is displayed at the front end and is not occluded, the voice interaction window of the second terminal that is displayed at the front end and is not occluded is displayed in the preset time. The second terminal, which operates to ensure that the tone interactive window is displayed at the forefront and is unoccluded and that detects the operation of the voice interactive window within a preset time, is operated, and the student operating the second terminal is using the voice interactive application. Therefore, the voice interaction window can be displayed at the forefront and without occlusion and the second terminal detecting the operation of the voice interaction window within the preset time as the second terminal of the detected valid online.

Further, the foregoing step 201 to step 203 is performed to detect the second terminal that is effectively online in the interaction group. To complete the voice interaction, the method provided in this embodiment further includes a subsequent step.

204: The first terminal detects a second terminal having voice interaction capability in all second terminals that are effectively online, and uses all the second terminals that are effectively online and have voice interaction capability as the voice interaction bar. Second terminal of the piece;

Since the second terminal that is effectively online may not have the microphone installed or the installed microphone is damaged, the second terminal that is effectively online cannot obtain the voice information input by the student operating the second terminal, and thus the first terminal is in the effective online When the second terminal performs voice interaction, the voice information sent by the second terminal that is effectively online cannot be received, and the voice interaction fails. Therefore, the method provided by the embodiment of the present application detects the second terminal having the voice interaction capability in all the second terminals that are effectively online, and uses all the second terminals that are effectively online and have the voice interaction capability as the second voice with the voice interaction condition. terminal. The second terminal having the voice interaction capability can normally obtain the voice information input by the student operating the second terminal, and the method for detecting the second terminal having the voice interaction capability in the second terminal that is effectively online is used in this embodiment. No specific limitation.

As an optional embodiment, the second terminal having voice interaction capability is detected in all the second terminals that are effectively online, including but not limited to:

Testing the microphone of each second terminal that is effectively online;

The embodiment does not limit the manner of testing the microphone of each second terminal that is effectively online. In a specific implementation, the first terminal may send a microphone test instruction to each second terminal that is effectively online, and the second terminal that is effectively online tests whether the microphone can collect the voice information according to the test instruction, and returns the test result to the first a terminal; the first terminal receives the detection result sent by each second terminal that is effectively online; if the test result of any of the received second terminals is that the microphone can collect the voice information, the microphone test of the second terminal passes.

It should be noted that, in addition to the first terminal and the second terminal directly interacting to perform corresponding operations, the first terminal may also interact with the server, and the server interacts with the second terminal again, and The result is fed back to the first terminal, so that the first terminal performs the operations of the foregoing steps, and the specific manner is not specifically limited in this embodiment.

205: The first terminal performs voice interaction according to the displayed interaction identifier according to the second terminal that has a voice interaction condition.

Since the second terminal having the voice interaction condition can perform the voice interaction normally, the first terminal detects the second terminal having the voice interaction capability, and uses all the second terminals that are effectively online and have the voice interaction capability as the voice interaction condition. After the second terminal, the interactive identifier of all the second terminals having the voice interaction condition may be displayed, and then according to the displayed interactive identifier and the voice interactive condition The second terminal performs voice interaction.

The interactive identifier includes, but is not limited to, an icon for identifying a valid online and having a voice interaction capability, and the interactive identifier may be in any form. This embodiment does not limit the specific form and specific display manner of the interactive identifier. In a specific implementation, the interaction identifier may be displayed on the interaction interface of the first terminal, and the interaction interface of the second terminal may display the user corresponding to the first terminal in addition to the interaction identifier of the second terminal having the voice interaction condition. The avatar, the user avatar corresponding to all the second terminals belonging to the same interaction group, and the voice interaction content of the interaction group, the embodiment does not limit the content displayed on the interaction interface of the first terminal. Taking the interaction interface shown in FIG. 4 as an example, the interaction interface of the first terminal displays the user avatar corresponding to the first terminal (the upper right corner of the interface) and the user avatar corresponding to each second terminal in the same interaction group (first In addition to the user avatar corresponding to the terminal, the microphone icon is displayed in front of the user avatar corresponding to each second terminal, and the second terminal having the voice interaction condition may display the interactive identifier before the corresponding user avatar and the microphone icon. ★”, used to indicate that the second terminal is valid online and has voice interaction capability. Similarly, for the second terminal that does not have the voice interaction condition, the non-interactive identifier "☆" can be displayed before the corresponding user avatar and the microphone icon, indicating that the second terminal is not valid online and/or has no voice interaction capability. .

Correspondingly, the following steps may be included in the embodiment of the present application:

An inability to interactively identify a second terminal that is not active online and/or that does not have voice interaction capabilities.

In addition, it should be noted that, regardless of the manner in which the interactive identifier of the second terminal having the voice interaction condition is displayed, the state of the second terminal may change in real time due to whether the state of the voice interaction condition is changed, and the first terminal may / or a second terminal that does not have voice interaction capability for detection. The detecting process may periodically detect the second terminal that is not valid online and/or has no voice interaction capability according to a preset time, and after detecting that the second terminal is valid online and has voice interaction capability, In the interaction interface, the non-interactive identifier “☆” corresponding to the second terminal is updated to the interactive identifier “★”. Therefore, the interactive identifiers of all the second terminals with voice interaction conditions displayed by the first terminal can be updated in real time.

For example, the second terminal A does not have a voice interaction condition because the microphone is unusable 5 minutes ago, and the first terminal does not display the interaction identifier of the second terminal, such as the user avatar and the wheat corresponding to the second terminal A. “☆” is displayed before the icon. After that, the user corresponding to the second terminal A performs maintenance on the microphone of the second terminal, so that the microphone of the second terminal A returns to normal after 5 minutes, and after the detection of the above steps, the second terminal A has a voice interaction condition. Therefore, after the interactive interface of the first terminal is updated, the interactive identifier of the second terminal A is displayed, that is, the user avatar corresponding to the second terminal A and the microphone icon are displayed with "★".

Further, when the interaction between the displayed interactive identifier and the second terminal having the voice interaction condition is performed, the interactive identifier of all the second terminal having the voice interaction condition may be displayed, and all the voice interaction conditions are displayed according to the displayed interactive identifier. At least one second terminal is selected in the second terminal, and performs voice interaction with the selected second terminal. The manner of selecting the second terminal is not limited in this embodiment. For example, the user corresponding to the first terminal selects a user avatar corresponding to the second terminal having the voice interaction condition from all the second terminals having the voice interaction condition. The first terminal will double-click the second terminal of the user's avatar as the selected second terminal and perform voice interaction with it.

Regardless of the manner in which the second terminal is selected, when the first terminal performs voice interaction with the selected second terminal, the embodiment does not limit the manner in which the specific voice interaction is performed. In a specific implementation, the voice information of the user corresponding to the first terminal is recorded by the microphone device of the first terminal, and the voice information is sent to each selected second terminal. Certainly, each selected second terminal can record the corresponding user's voice information through its microphone device, and send the recorded voice information to the first terminal, thereby implementing the user corresponding to the first terminal and the selected second terminal. Corresponding user interaction between voices.

For example, for an application scenario in which a teacher and a student perform voice interaction through a first terminal and a second terminal respectively, by displaying an interactive identifier of all second terminals having a voice interaction condition at a first terminal operated by the teacher, the operation of the first terminal is performed. The teacher can learn all the second terminals having the voice interaction condition, and then the first terminal can detect the second terminal selected by the teacher and perform voice interaction with the second terminal selected by the teacher.

In addition, referring to the flow chart of the voice interaction shown in FIG. 5, step 201 corresponds to the start and the classroom window is pre-positioned and has no occlusion and does not have an interactive condition, and does not display an interactive icon. Step 202 corresponds to the last 30 seconds of having an operation in the classroom window and does not have an interactive condition, and does not display an interactive icon. Step 203 is correspondingly marked as valid online. Step 204 corresponds to the mic test and is marked as online and has voice interaction capability and does not have an interactive condition. The interactive icon is not displayed, and step 205 corresponds to an interactive condition, and an interactive icon is displayed.

The method provided by the embodiment of the present application is to use all the second terminals that are effectively online and have voice interaction capability as the second terminal with voice interaction conditions, and according to the second terminal with voice interaction conditions. The voice interaction is performed to realize the voice interaction with the second terminal having the voice interaction condition, thereby improving the efficiency of the voice interaction.

Referring to FIG. 6, the embodiment of the present application provides a voice interactive terminal, which is used to execute the method provided by the embodiment shown in FIG. 2 or FIG. 3 above. The terminal includes:

The first detecting module 401 is configured to detect a state of a voice interaction window of each second terminal in the interaction group, where the interaction group includes a first terminal and at least one second terminal;

a determining module 402, configured to determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online;

a second detecting module 403, configured to detect a second terminal having voice interaction capability in all second terminals that are effectively online;

The processing module 404 is configured to use all second terminals that are effectively online and have voice interaction capabilities as the second terminal with voice interaction conditions;

The voice interaction module 406 is configured to perform voice interaction with the selected second terminal.

As an optional embodiment, referring to FIG. 7, the determining module 402 includes:

The determining unit 4021 is configured to determine whether the voice interaction window of each second terminal is displayed at the forefront and is occluded;

The first processing unit 4022 is configured to display the voice interaction window at the forefront and the non-occlusion second terminal as the second terminal that is effectively online.

As an optional embodiment, referring to FIG. 8, the determining module 402 further includes:

The detecting unit 4023 is configured to detect, during a preset time, an operation of displaying a voice interaction window of the second terminal of the second terminal without the occlusion;

The first processing unit 4022 is configured to display the voice interaction window at the forefront and without occlusion and the second terminal that detects the operation of the voice interaction window within a preset time as the second terminal that is effectively online.

As an optional embodiment, referring to FIG. 9, the second detecting module 403 includes:

a testing unit 4031, configured to test a microphone of each second terminal that is effectively online;

The second processing unit 4032 is configured to use any second terminal as the detected second terminal with voice interaction capability when the microphone test of any second terminal passes.

As an alternative embodiment, referring to FIG. 10, the voice interaction module 406 includes:

The selecting unit 4061 is configured to display an interaction identifier of all second terminals having voice interaction conditions, and select at least one of all second terminals having voice interaction conditions according to the displayed interaction identifier. Second terminal;

The voice interaction unit 4062 is configured to perform voice interaction with the selected second terminal.

As an optional embodiment, the terminal further includes:

The terminal provided by the embodiment of the present application implements voice interaction by using all second terminals that are effectively online and have voice interaction capability as the second terminal with voice interaction conditions, and performing voice interaction according to the second terminal having voice interaction conditions. The second terminal of the voice interaction condition performs voice interaction, which improves the efficiency of voice interaction.

Please refer to FIG. 11 , which is a schematic structural diagram of a terminal involved in the embodiment of the present application. The terminal may be used to implement the voice interaction method provided in the foregoing embodiment. Specifically:

The terminal 1100 may include an RF (Radio Frequency) circuit 110, a memory 120 including one or more computer readable storage media, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, and a WiFi (Wireless Fidelity, wireless). The fidelity module 170 includes a processor 180 having one or more processing cores, and a power supply 190 and the like. It will be understood by those skilled in the art that the terminal structure shown in FIG. 11 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements. among them:

The RF circuit 110 can be used for transmitting and receiving information or during a call, and receiving and transmitting signals. Specifically, after receiving downlink information of the base station, the downlink information is processed by one or more processors 180. In addition, the data related to the uplink is sent to the base station. . Generally, the RF circuit 110 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier). , duplexer, etc. In addition, RF circuitry 110 can also communicate with the network and other devices via wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile) Communication, Global System for Mobile Communications, GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), e-mail, SMS (Short Messaging Service), etc.

The memory 120 can be used to store software programs and modules, and the processor 180 executes various functional applications and data processing by running software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may be stored according to The data created by the use of the terminal 1100 (such as audio data, phone book, etc.) and the like. Moreover, memory 120 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, memory 120 may also include a memory controller to provide access to memory 120 by processor 180 and input unit 130.

The input unit 130 can be configured to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls. In particular, input unit 130 can include touch-sensitive surface 131 as well as other input devices 132. Touch-sensitive surface 131, also referred to as a touch display or trackpad, can collect touch operations on or near the user (such as a user using a finger, stylus, etc., on any suitable object or accessory on touch-sensitive surface 131 or The operation near the touch-sensitive surface 131) and driving the corresponding connecting device according to a preset program. Alternatively, the touch-sensitive surface 131 can include two portions of a touch detection device and a touch controller. Wherein, the touch detection device detects the touch orientation of the user, and detects a signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts the touch information into contact coordinates, and sends the touch information. The processor 180 is provided and can receive commands from the processor 180 and execute them. In addition, the touch-sensitive surface 131 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch-sensitive surface 131, the input unit 130 can also include other input devices 132. Specifically, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, and the like.

The display unit 140 can be used to display information entered by the user or information provided to the user and various graphical user interfaces of the terminal 1100, which can be composed of graphics, text, icons, video, and any combination thereof. The display unit 140 can include a display panel 141, optionally, can be employed The display panel 141 is configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Further, the touch-sensitive surface 131 may cover the display panel 141, and when the touch-sensitive surface 131 detects a touch operation thereon or nearby, it is transmitted to the processor 180 to determine the type of the touch event, and then the processor 180 according to the touch event The type provides a corresponding visual output on display panel 141. Although in FIG. 11, touch-sensitive surface 131 and display panel 141 are implemented as two separate components to implement input and input functions, in some embodiments, touch-sensitive surface 131 can be integrated with display panel 141 for input. And output function.

Terminal 1100 can also include at least one type of sensor 150, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 141 according to the brightness of the ambient light, and the proximity sensor may close the display panel 141 when the terminal 1100 moves to the ear. / or backlight. As a kind of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (usually three axes). When it is stationary, it can detect the magnitude and direction of gravity. It can be used to identify the attitude of the terminal (such as horizontal and vertical screen switching, related Game, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for the terminal 1,100 can also be configured with gyroscopes, barometers, hygrometers, thermometers, infrared sensors and other sensors, here Let me repeat.

The audio circuit 160, the speaker 161, and the microphone 162 can provide an audio interface between the user and the terminal 1100. The audio circuit 160 can transmit the converted electrical data of the received audio data to the speaker 161 for conversion to the sound signal output by the speaker 161; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal by the audio circuit 160. After receiving, it is converted into audio data, and then processed by the audio data output processor 180, transmitted to the terminal, for example, via the RF circuit 110, or outputted to the memory 120 for further processing. The audio circuit 160 may also include an earbud jack to provide communication of the peripheral earphones with the terminal 1100.

WiFi is a short-range wireless transmission technology, and the terminal 1100 can help users to send and receive emails, browse web pages, and access streaming media through the WiFi module 170, which provides wireless broadband Internet access for users. Although FIG. 11 shows the WiFi module 170, it can be understood that it does not belong to the essential configuration of the terminal 1100, and may be omitted as needed within the scope of not changing the essence of the invention.

The processor 180 is a control center of the terminal 1100 that connects various portions of the entire terminal using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 120, and recalling data stored in the memory 120, Perform various functions and processing data of the terminal 1100, from The terminal is monitored as a whole. Optionally, the processor 180 may include one or more processing cores; preferably, the processor 180 may integrate an application processor and a modem processor, where the application processor mainly processes an operating system, a user interface, an application, and the like. The modem processor primarily handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 180.

The terminal 1100 also includes a power supply 190 (such as a battery) for powering various components. Preferably, the power supply can be logically coupled to the processor 180 through a power management system to manage functions such as charging, discharging, and power management through the power management system. Power supply 190 may also include any one or more of a DC or AC power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.

Although not shown, the terminal 1100 may further include a camera, a Bluetooth module, and the like, and details are not described herein again. Specifically, in this embodiment, the display unit of the terminal is a touch screen display, the terminal further includes a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be processed by one or more Execution. The one or more programs include operational instructions corresponding to methods for performing the voice interactions described in the above embodiments.

Please refer to FIG. 12, which is a schematic structural diagram of a terminal involved in the embodiment of the present application. The terminal includes: a processor 1201, a transceiver 1202;

The processor 1201 is configured to detect a state of a voice interaction window of each second terminal in the interaction group, and determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online, where the interaction group includes the first The terminal and the at least one second terminal; detecting the second terminal having the voice interaction capability in all the second terminals that are effectively online, and using all the second terminals that are effectively online and having the voice interaction capability as the second terminal having the voice interaction condition;

The transceiver 1202 is configured to perform voice interaction with the second terminal having the voice interaction condition according to the displayed interactive identifier.

As an optional embodiment, the processor 1201 is further configured to determine whether the voice interaction window of each second terminal is displayed at the front end and is not occluded; the voice interaction window is displayed at the forefront and the second terminal is not occluded as an effective online The second terminal.

As an optional embodiment, the processor 1201 is further configured to detect, during a preset time, an operation of displaying a voice interaction window of the second terminal that is displayed at the forefront and without the occlusion;

The processor 1201 is further configured to display the voice interaction window at the forefront and without the occlusion and the second terminal that detects the operation of the voice interaction window within the preset time as the second terminal that is effectively online.

As an optional embodiment, the processor 1201 is further configured to test the microphone of each second terminal that is effectively online; if the microphone test of any second terminal passes, any second terminal is detected as A second terminal with voice interaction capabilities.

As an optional embodiment, the terminal further includes a display 1203,

a display 1203, configured to display an interactive identifier of all second terminals having voice interaction conditions;

The processor 1201 is further configured to select at least one second terminal from all second terminals having voice interaction conditions according to the displayed interactive identifier;

The transceiver 1202 is further configured to perform voice interaction with the selected second terminal.

As an optional embodiment, the display 1202 is further configured to display, by the first terminal, an inability to interact with the second terminal that is not valid online and/or has no voice interaction capability.

As an optional embodiment, the processor 1201 is further configured to periodically detect a second terminal that is not valid online and/or has no voice interaction capability; when detecting that the data is not valid online and/or has no voice interaction When the second terminal of the capability is valid online and has voice interaction capability, the detected non-interactive identifier of the second terminal is updated to an interactive identifier.

It should be noted that, when the voice interactive terminal provided by the foregoing embodiment performs voice interaction, only the division of each functional module is used as an example. In an actual application, the function distribution may be completed by different functional modules according to requirements. The internal structure of the terminal is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the voice interactive terminal and the voice interaction provided by the foregoing embodiment is the same concept, and the specific implementation process is described in the method embodiment, and details are not described herein again.

The serial numbers of the embodiments of the present application are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

A person skilled in the art may understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be instructed by a program to execute related hardware, and the program may be stored in a computer readable storage medium. The storage medium mentioned may be a read only memory, a magnetic disk or an optical disk or the like.

The above is only the preferred embodiment of the present application, and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application are included in the protection of the present application. Within the scope.

Claims

A method for voice interaction, characterized in that the method comprises:

Detecting a state of a voice interaction window of each second terminal in the interaction group, and determining, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online, where the interaction group includes the first terminal and at least one second terminal;

Detecting a second terminal having voice interaction capability in all the second terminals that are effectively online, and using all the second terminals that are effectively online and having voice interaction capability as the second terminal having voice interaction conditions;

Performing voice interaction according to the second terminal having the voice interaction condition.
The method according to claim 1, wherein the determining the second terminal that is valid online according to the state of the voice interaction window of each second terminal comprises:

Determining whether the voice interaction window of each second terminal is displayed at the forefront and without occlusion;

The voice interaction window is displayed at the forefront and the second terminal is occluded as the second terminal that is effectively online.
The method according to any one of claims 1 to 2, wherein the determining whether the voice interaction window of each second terminal is displayed at the forefront and without occlusion further comprises:

Detecting, in a preset time, an operation of the voice interaction window of the second terminal that is displayed at the forefront and without occlusion;

The displaying the voice interaction window at the forefront and the non-occlusion second terminal as the second terminal that is effectively online includes:

The second terminal that displays the voice interaction window at the forefront and has no occlusion and detects the operation of the voice interaction window within a preset time is used as the second terminal of the effective online.
The method according to any one of claims 1-3, wherein the detecting the second terminal having the voice interaction capability in the second terminal that is effectively online, comprises:

Testing the microphone of each second terminal that is effectively online;

If the microphone test of any of the second terminals passes, the any second terminal is used as the detected second terminal with voice interaction capability.
The method according to any one of claims 1 to 4, wherein the performing the voice interaction according to the second terminal having the voice interaction condition comprises:

Displaying an interaction identifier of all second terminals having voice interaction conditions, and selecting at least one second terminal from all second terminals having voice interaction conditions according to the displayed interaction identifier, and performing voice interaction with the selected second terminal.
The method according to any one of claims 1-5, wherein the method further comprises: after the second terminal that is effective in online and has voice interaction capability, the method further comprises:

An inability to interactively identify a second terminal that is not active online and/or that does not have voice interaction capabilities.
The method according to claim 6, wherein the method further comprises: after the first terminal displays the inability to interact with the second terminal that is not valid online and/or has no voice interaction capability, the method further includes:

Periodically detecting a second terminal that is not active online and/or has no voice interaction capability;

When it is detected that the second terminal that is not valid online and/or has no voice interaction capability is valid online and has voice interaction capability, the detected non-interactive identifier of the second terminal is updated to an interactive identifier.
A voice interactive terminal, wherein the terminal includes:

a first detecting module, configured to detect a state of a voice interaction window of each second terminal in the interaction group, where the interaction group includes a first terminal and at least one second terminal;

a determining module, configured to determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online;

a second detecting module, configured to detect a second terminal having voice interaction capability in all second terminals that are effectively online;

a processing module, configured to use all second terminals that are effectively online and have voice interaction capability as the second terminal with voice interaction conditions;

The voice interaction module is configured to perform voice interaction according to the second terminal having the voice interaction condition.
The terminal according to claim 8, wherein the determining module comprises:

a judging unit, configured to determine whether the voice interaction window of each second terminal is displayed at the forefront and has no occlusion;

The first processing unit is configured to display the voice interaction window at the forefront and the non-occlusion second terminal as the second terminal that is effectively online.
The terminal according to any one of claims 8 to 9, wherein the determining module further comprises:

a detecting unit, configured to detect, during a preset time, an operation of displaying a voice interaction window of the second terminal in the forefront and without occlusion;

The first processing unit is configured to display the voice interaction window at the forefront and without occlusion and the second terminal that detects the operation of the voice interaction window within the preset time as the second terminal that is effectively online.
The terminal according to any one of claims 8 to 10, wherein the second detecting module comprises:

a testing unit, configured to test a microphone of each second terminal that is effectively online;

And a second processing unit, configured to use any of the second terminals as the detected second terminal having voice interaction capability when the microphone test of any second terminal passes.
The terminal according to any one of claims 8-11, wherein the voice interaction module comprises:

a selection unit, configured to display an interaction identifier of all second terminals having voice interaction conditions, and select at least one second terminal from all second terminals having voice interaction conditions according to the displayed interaction identifier;

A voice interaction unit for performing voice interaction with the selected second terminal.
The terminal according to any one of claims 8 to 12, wherein the terminal further comprises:

The identifier display module is configured to display, by the first terminal, an inability to interact with the second terminal that is not valid online and/or has no voice interaction capability.
The terminal according to claim 13, wherein the terminal further comprises:

a third detecting module, configured to periodically detect a second terminal that is not valid online and/or has no voice interaction capability;

An update module, configured to update the detected non-interactive identifier of the second terminal to an interactive identifier when detecting that the second terminal that is not valid online and/or has no voice interaction capability is valid online and has voice interaction capability .
A terminal, comprising: a processor, a transceiver;

The processor is configured to detect a state of a voice interaction window of each second terminal in the interaction group, and determine, according to a state of the voice interaction window of each second terminal, a second terminal that is effectively online, where the interaction group includes a terminal and at least one second terminal; detecting a second terminal having voice interaction capability in all second terminals that are effectively online, and using all second terminals that are effective online and having voice interaction capability as the second terminal having voice interaction conditions ;

The transceiver is configured to perform voice interaction according to the second terminal that has a voice interaction condition.
The terminal of claim 15 wherein:

The processor is further configured to determine whether the voice interaction window of each second terminal is displayed at the front end and is not occluded; the voice interaction window is displayed at the forefront and the second terminal is not occluded as the second terminal that is effectively online.
A terminal according to any of claims 15 or 16, wherein

The processor is further configured to detect, during a preset time, an operation of displaying a voice interaction window of the second terminal that is displayed at the front end and is not occluded;

The processor is further configured to display the voice interaction window at the forefront and without occlusion and the second terminal that detects the operation of the voice interaction window within a preset time as the second terminal that is effectively online.
A terminal according to any of claims 15-17, characterized in that

The processor is further configured to test the microphone of each second terminal that is effectively online; if any of the second terminals pass the microphone test, the second terminal is used as the detected voice interaction capability. The second terminal.
The terminal according to any of claims 15-18, wherein the terminal further comprises a display.

The display is configured to display an interactive identifier of all second terminals having voice interaction conditions;

The processor is further configured to select at least one second terminal from all second terminals having voice interaction conditions according to the displayed interactive identifier;

The transceiver is further configured to perform voice interaction with the selected second terminal.
A terminal according to any of claims 15-19, characterized in that

The display is further configured to display, by the first terminal, an inability to interact with the second terminal that is not valid online and/or has no voice interaction capability.
The terminal according to claim 20, characterized in that

The processor is further configured to periodically detect a second terminal that is not valid online and/or has no voice interaction capability; and when the second terminal that is not valid online and/or has no voice interaction capability is detected, the terminal is valid online. And having the voice interaction capability, updating the detected non-interactive identifier of the second terminal to an interactive identifier.