CN111343410A - Mute prompt method and device, electronic equipment and storage medium - Google Patents
Mute prompt method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111343410A CN111343410A CN202010092245.7A CN202010092245A CN111343410A CN 111343410 A CN111343410 A CN 111343410A CN 202010092245 A CN202010092245 A CN 202010092245A CN 111343410 A CN111343410 A CN 111343410A
- Authority
- CN
- China
- Prior art keywords
- terminal
- sound signal
- voice signal
- sound
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/16—Speech classification or search using artificial neural networks
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M3/00—Automatic or semi-automatic exchanges
- H04M3/42—Systems providing special services or facilities to subscribers
- H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
- H04M3/568—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
- G10L21/0216—Noise filtering characterised by the method used for estimating noise
- G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
- G10L2021/02166—Microphone arrays; Beamforming
Abstract
The embodiment of the disclosure discloses a mute prompt method, a device, an electronic device and a storage medium, wherein the method comprises the following steps: acquiring a sound signal acquired by a terminal; under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state; and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call. The technical scheme of the embodiment of the disclosure realizes the purpose of carrying out mute prompt in the call conference.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of computers, and in particular relates to a mute prompt method, a mute prompt device, an electronic device and a storage medium.
Background
The video conference system is a multimedia communication system supporting remote bidirectional transmission of voice and video, and is used for helping participants at different places to complete real-time bidirectional face-to-face visual communication.
In the process of a video conference or a voice conference, particularly in a multi-person conference scene, most participants can set their terminals to be in a mute state actively so as to prevent a voice signal stealing private language from entering a conference system and affecting the conference atmosphere. However, as the conference progresses, sometimes a certain participant or multiple participants need to speak, and in many cases, the participants forget that their terminals have set a mute state and always speak actively, which not only causes a blank time for the conference, but also causes the participants to repeat the spoken content again, thereby seriously affecting the meeting experience of all participants.
Disclosure of Invention
The embodiment of the disclosure provides a mute prompt method, a mute prompt device, an electronic device and a storage medium, which achieve the purpose of performing mute prompt in a call conference.
In a first aspect, an embodiment of the present disclosure provides a silent alert method, where the method includes:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
In a second aspect, an embodiment of the present disclosure further provides a silent alert device, where the silent alert device includes:
the acquisition module is used for acquiring the sound signal acquired by the terminal;
the prompting module is used for sending a mute prompt if the sound signal is matched with a set voice signal under the condition that the terminal is in a microphone mute state in a call conference, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a silent alerting method as in any of the embodiments of the present disclosure.
In a fourth aspect, the disclosed embodiments also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a silent alert method as described in any one of the disclosed embodiments.
According to the technical scheme of the embodiment of the disclosure, the sound signal collected by the terminal is obtained; under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state; in the mute state of the microphone, the sound signal collected by the terminal is forbidden to be sent to the technical means in the call conference, so that the aim of carrying out mute prompt in the call conference in time is fulfilled.
Drawings
The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.
Fig. 1 is a schematic flow chart of a mute prompt method according to a first embodiment of the present disclosure;
fig. 2 is a schematic flow chart of another mute prompt method according to a first embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a silent alert device according to a second embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to a third embodiment of the disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.
The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
Example one
Fig. 1 is a flowchart illustrating a mute prompt method according to a first embodiment of the disclosure. The method can be applied to a call conference (such as a video conference or a voice conference) and can be used for prompting the current user that the terminal is in the microphone mute state when the current user starts to actively speak to participate in conference discussion at a certain moment after the current user sets the terminal of the current user to be in the microphone mute state, so that the situation that the call conference is blank for a period of time is avoided, the spoken content needs to be repeated by the current user, and the purpose of improving the conference experience of all participants is achieved. The silent alert method may be performed by a silent alert device, which may be implemented in software and/or hardware.
As shown in fig. 1, the method for prompting silence provided by this embodiment includes the following steps:
and step 110, acquiring the sound signal collected by the terminal.
The terminal may refer to an intelligent terminal, such as a mobile phone and a computer, for a user to connect to a conference call. The user communicates with the participants in different places through the terminal. It can be understood that the terminal can receive the voices of other participants and play the voices through a loudspeaker of the terminal, and can also receive the voice of the current user and transmit the voice of the current user to the terminal sides of the other participants. However, if the current user sets the terminal thereof to a microphone mute state in the conference call, the voice of the current user is not transmitted to the terminal sides of the other participants, that is, in the microphone mute state, the sound signal collected by the terminal is prohibited from being transmitted to the conference call.
Illustratively, the terminal collects sound signals around the terminal through a sound pickup or microphone configured in the terminal. The sound signal may include a sound signal of the current user actively speaking for the conference call, or may include sound signals of other persons, such as voices of other participants who are in different places and played through a speaker of the terminal, or may include noise in the surrounding environment, such as a sound of striking a keyboard, a sound of a bird, a sound of whistling, and the like.
It should be noted that the application scenarios of this embodiment are as follows: in a call conference, especially a multi-person call conference, in order to avoid introducing undesired sound into the call conference, thereby affecting conference atmosphere, a terminal of the user is usually set to be in a microphone mute state before the conference, the terminal set to be in the microphone mute state can only receive and play the voice introduced into the call conference by terminals of other participants, and a sound signal collected by a terminal of a current user cannot be introduced into a conference system, that is, the other participants cannot hear the sound of the current user. However, as the conference progresses, the current user is often required to speak to communicate with other participants, and at this time, if the current user forgets that the terminal of the current user is set to be in the microphone mute state, the current user can speak actively, and at this time, the other participants cannot hear the speech of the current user. When the current terminal is in a microphone mute state, if the current user starts to speak actively is detected, a mute prompt is timely performed on the current user to inform the current user that the terminal is in the microphone mute state, and the current user is requested to be set to a non-microphone mute state and then speak. Therefore, the specific implementation manner can be realized by the following steps, which are more critical processing steps for accurately identifying whether the sound signal collected by the terminal includes the conference speaking sound of the current user.
Illustratively, after acquiring the sound signal collected by the terminal, the method further includes:
inputting the sound signal to a pre-trained neural network model;
and judging whether the sound signal is matched with the set voice signal or not according to the output result of the neural network model.
Wherein the neural network model comprises a Convolutional Neural Network (CNN) model.
Further, the method further comprises:
acquiring a sound sample data set;
training a set neural network structure based on the sound sample data set to obtain the neural network model;
the sound sample data set includes the set voice signal labeled with a first classification tag and a non-set voice signal labeled with a second classification tag.
Correspondingly, the determining whether the sound signal matches the set speech signal according to the output result of the neural network model includes:
and if the output result is that the frequency of the first classification label reaches a set threshold value continuously, judging that the sound signal is matched with the set voice signal, otherwise, judging that the sound signal is not matched with the set voice signal.
Optionally, the counting of the output result of the neural network model is performed by a counter, specifically:
if the output result is the first classification label, the count value of the counter is increased by one, and the initial value of the counter is 0;
if the output result is the second classification label, the count value of the counter is set to zero;
and if the count value of the counter reaches a set threshold value, judging that the sound signal is matched with the set voice signal.
The setting voice signal may be a voice signal of a terminal owner, for example, a terminal of zhang san, the corresponding setting voice signal is a voice signal of zhang san, and the corresponding setting voice signal is a voice signal of liqi. The setting voice signal can also be broadly referred to as a near-field voice signal, that is, voice signals within a certain range around the terminal all belong to the category of the setting voice signal. The near-field voice signal refers to a voice signal of which the distance between a sound source and the center point of the microphone array is smaller than a threshold value, and the voice signal of which the distance between the sound source and the center point of the microphone array is larger than the threshold value is a far-field voice signal. The threshold value is related to the array aperture of the microphone array, the speed of sound and the highest frequency of the sound signal.
Illustratively, the setting the voice signal includes: a near-field speech signal;
the non-setting voice signal comprises at least one of the following: stationary noise signals (e.g., white noise, pink noise, brown noise, etc.), non-stationary noise signals (e.g., keyboard sounds, door closing sounds, car sounds, music sounds, etc.), and far-field speech signals.
Further, the acquiring the sound sample data set includes:
recognizing the set voice signal from an existing voice signal library through a voice recognition technology;
and obtaining the non-setting voice signal by performing attenuation processing and/or reverberation processing on the setting voice signal.
Taking the set voice signal as a near-field voice signal as an example to explain the above process of acquiring the sound sample data set: a large number of near-field voice signals with high signal-to-noise ratio can be identified from an existing voice signal library through a voice identification technology. A large number of far-field speech signals can be simulated by attenuating, or attenuating and reverberation, the identified near-field speech signals with high signal-to-noise ratios. A large number of different types of pure music are available from the data set retrieved by the music information, and a large number of stationary noise signals can be generated by audio editing software, such as audio and audio. All these near-field speech signals, far-field speech signals, stationary noise signals and non-stationary noise signals constitute a huge set of sound sample data.
In order to improve the robustness of the neural network model, the complex diversity of the sound sample data set can be enhanced. For example, different noise may be mixed in a certain ratio in the near-field speech of the sound sample data set, and near-field speech may be mixed in a certain ratio in other various noises. And finally, training a set neural network structure based on the obtained sound sample data set, and performing supervised learning and training by using the cross entropy as a cost function to obtain the neural network model.
It can be understood that, in a conference call scenario, it is necessary to receive and play the voice signals of other participants in different places through the terminal, so that the current user can hear the speech of the other participants. Therefore, the voice signals of the other participants are collected by the terminal, and the voice signals belong to near-field voice signals. However, when the terminal collects such near-field voice signals, the actual requirement of microphone mute prompt for the current user is not met. Therefore, when the set voice signal is a near-field voice signal, the mute prompt scheme cannot identify the voice signals of other participants played by the terminal as the near-field voice signals.
In view of the above problem, for example, before the sound signal is input to the pre-trained neural network model, the method further includes:
and carrying out echo cancellation processing on the sound signals, wherein near-field voice signals collected by a terminal microphone and played by a terminal loudspeaker can be cancelled through the echo cancellation processing, so that interference caused by the voice signals played by the terminal loudspeaker is avoided.
Correspondingly, referring to a flow diagram of another silent alert method shown in fig. 2, the silent alert method specifically includes: collecting sound signals through a microphone, carrying out AEC (automatic echo cancellation) processing on the collected sound signals, judging whether the current terminal is in a microphone mute state, if so, inputting the sound signals processed by the AEC to a trained neural network model CNN VAD, judging whether the sound signals processed by the AEC are near-field sound signals according to an output result of the neural network model, and if so, carrying out mute prompt. The mute prompt mode can be that a target prompt voice is played through the current terminal; or displaying the mute prompt animation through a display interface of the current terminal.
According to the technical scheme of the embodiment of the disclosure, the sound signal collected by the terminal is obtained; under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state; in the microphone mute state, the sound signal that the terminal was gathered is forbidden to be sent technical means in the conversation meeting has realized when the user actively speaks, if its terminal is in microphone mute state, in time carries out the purpose of silence suggestion to the user, has improved the suggestion precision, and then has promoted user's meeting experience.
Example two
Fig. 3 is a mute prompt apparatus provided in the second embodiment of the present disclosure, and the apparatus includes: an acquisition module 310 and a prompt module 320.
The acquiring module 310 is configured to acquire a sound signal acquired by a terminal; a prompt module 320, configured to send a mute prompt if the sound signal matches a set voice signal when the terminal is in a microphone mute state in a call conference, where the mute prompt is used to prompt that the terminal is in the microphone mute state; and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
On the basis of the above technical solution, the apparatus further includes:
the input module is used for inputting the sound signals to a pre-trained neural network model;
and the judging module is used for judging whether the sound signal is matched with the set voice signal according to the output result of the neural network model.
On the basis of the above technical solutions, the apparatus further includes:
the collection module is used for acquiring a sound sample data set;
the training module is used for training a set neural network structure based on the sound sample data set to obtain the neural network model;
the sound sample data set includes the set voice signal labeled with a first classification tag and a non-set voice signal labeled with a second classification tag.
On the basis of the above technical solutions, the setting the voice signal includes: a near-field speech signal;
the non-setting voice signal comprises at least one of the following: stationary noise signals, non-stationary noise signals, and far-field speech signals.
On the basis of the above technical solutions, the collecting module includes:
the recognition unit is used for recognizing the set voice signal from an existing voice signal library through a voice recognition technology;
and the processing unit is used for carrying out attenuation processing and/or reverberation processing on the set voice signal to obtain the non-set voice signal.
On the basis of the above technical solutions, the determination module is specifically configured to:
and if the output result is that the frequency of the set result reaches a set threshold value, judging that the sound signal is matched with the set voice signal, otherwise, judging that the sound signal is not matched with the set voice signal.
On the basis of the above technical solutions, the apparatus further includes:
and the echo cancellation module is used for performing echo cancellation processing on the sound signal before the sound signal is input to a pre-trained neural network model so as to cancel echo in the sound signal.
According to the technical scheme of the embodiment of the disclosure, the sound signal collected by the terminal is obtained; under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state; in the mute state of the microphone, the sound signal collected by the terminal is forbidden to be sent to the technical means in the call conference, so that the aim of carrying out mute prompt in the call conference in time is fulfilled.
The mute prompt device provided by the embodiment of the disclosure can execute the mute prompt method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.
EXAMPLE III
Referring now to fig. 4, a schematic diagram of an electronic device (e.g., the terminal device or the server of fig. 4) 400 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 4 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 4, the electronic device 400 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 401 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)402 or a program loaded from a storage device 406 into a Random Access Memory (RAM) 403. In the RAM 403, various programs and data necessary for the operation of the electronic apparatus 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input/output (I/O) interface 405 is also connected to bus 404.
Generally, the following devices may be connected to the I/O interface 405: input devices 406 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 407 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 406 including, for example, magnetic tape, hard disk, etc.; and a communication device 409. The communication means 409 may allow the electronic device 400 to communicate wirelessly or by wire with other devices to exchange data. While fig. 4 illustrates an electronic device 400 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.
In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 409, or from the storage means 406, or from the ROM 402. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing device 401.
The terminal provided by the embodiment of the present disclosure and the mute prompting method provided by the embodiment belong to the same inventive concept, and technical details that are not described in detail in the embodiment of the present disclosure may be referred to the embodiment, and the embodiment of the present disclosure have the same beneficial effects.
Example four
The disclosed embodiments provide a computer storage medium on which a computer program is stored, which when executed by a processor implements the silent alert method provided by the above embodiments.
It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network protocol, such as HTTP (HyperText transfer protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.
The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a cell does not in some cases constitute a limitation on the cell itself, for example, an editable content display cell may also be described as an "editing cell".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
According to one or more embodiments of the present disclosure, [ example one ] there is provided a silent alerting method, the method comprising:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
According to one or more embodiments of the present disclosure, in example two, a silent alert method is provided, and optionally after acquiring a sound signal collected by a terminal, the method further includes:
inputting the sound signal to a pre-trained neural network model;
and judging whether the sound signal is matched with the set voice signal or not according to the output result of the neural network model.
According to one or more embodiments of the present disclosure, [ example three ] there is provided a silent alerting method, optionally, the method further comprising:
acquiring a sound sample data set;
training a set neural network structure based on the sound sample data set to obtain the neural network model;
the sound sample data set includes the set voice signal labeled with a first classification tag and a non-set voice signal labeled with a second classification tag.
According to one or more embodiments of the present disclosure, [ example four ] there is provided a silent alerting method, optionally, the setting a voice signal includes: a near-field speech signal;
the non-setting voice signal comprises at least one of the following: stationary noise signals, non-stationary noise signals, and far-field speech signals.
According to one or more embodiments of the present disclosure, [ example five ] there is provided a silent alerting method, optionally, the acquiring a sound sample data set includes:
recognizing the set voice signal from an existing voice signal library through a voice recognition technology;
and obtaining the non-setting voice signal by performing attenuation processing and/or reverberation processing on the setting voice signal.
According to one or more embodiments of the present disclosure, [ example six ] there is provided a silent alerting method, optionally, the determining whether the sound signal matches the set speech signal according to an output result of the neural network model, including:
and if the output result is that the frequency of the set result reaches a set threshold value, judging that the sound signal is matched with the set voice signal, otherwise, judging that the sound signal is not matched with the set voice signal.
According to one or more embodiments of the present disclosure, [ example seven ] there is provided a silent alerting method, optionally, before inputting the sound signal to a pre-trained neural network model, the method further comprises:
and carrying out echo cancellation processing on the sound signal so as to cancel echo in the sound signal.
According to one or more embodiments of the present disclosure, [ example eight ] there is provided a silent alert device, the device comprising:
the acquisition module is used for acquiring the sound signal acquired by the terminal;
the prompting module is used for sending a mute prompt if the sound signal is matched with a set voice signal under the condition that the terminal is in a microphone mute state in a call conference, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
According to one or more embodiments of the present disclosure, [ example nine ] there is provided an electronic device comprising:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement a silent alerting method as follows:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
According to one or more embodiments of the present disclosure, [ example ten ] there is provided a storage medium containing computer-executable instructions which, when executed by a computer processor, are operable to perform the following silent alerting method:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.
Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (10)
1. A silent alert method, comprising:
acquiring a sound signal acquired by a terminal;
under the condition that the terminal is in a microphone mute state in a call conference, if the sound signal is matched with a set voice signal, sending a mute prompt, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
2. The method of claim 1, wherein after the sound signal collected by the terminal is obtained, the method further comprises:
inputting the sound signal to a pre-trained neural network model;
and judging whether the sound signal is matched with the set voice signal or not according to the output result of the neural network model.
3. The method of claim 2, further comprising:
acquiring a sound sample data set;
training a set neural network structure based on the sound sample data set to obtain the neural network model;
the sound sample data set includes the set voice signal labeled with a first classification tag and a non-set voice signal labeled with a second classification tag.
4. The method of claim 3, wherein the setting the voice signal comprises: a near-field speech signal;
the non-setting voice signal comprises at least one of the following: stationary noise signals, non-stationary noise signals, and far-field speech signals.
5. The method of claim 3, wherein said obtaining a set of sound sample data comprises:
recognizing the set voice signal from an existing voice signal library through a voice recognition technology;
and obtaining the non-setting voice signal by performing attenuation processing and/or reverberation processing on the setting voice signal.
6. The method according to claim 2, wherein the determining whether the sound signal matches the set speech signal according to the output result of the neural network model includes:
and if the output result is that the frequency of the set result reaches a set threshold value, judging that the sound signal is matched with the set voice signal, otherwise, judging that the sound signal is not matched with the set voice signal.
7. The method of any one of claims 2-6, wherein prior to inputting the sound signal into a pre-trained neural network model, the method further comprises:
and carrying out echo cancellation processing on the sound signal so as to cancel echo in the sound signal.
8. A silent alert device, comprising:
the acquisition module is used for acquiring the sound signal acquired by the terminal;
the prompting module is used for sending a mute prompt if the sound signal is matched with a set voice signal under the condition that the terminal is in a microphone mute state in a call conference, wherein the mute prompt is used for prompting that the terminal is in the microphone mute state;
and in the mute state of the microphone, the sound signal collected by the terminal is prohibited from being sent to the conference call.
9. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a storage device for storing one or more programs,
when executed by the one or more processors, cause the one or more processors to implement the silent alerting method of any one of claims 1-7.
10. A storage medium containing computer-executable instructions for performing the silent alerting method of any one of claims 1-7 when executed by a computer processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092245.7A CN111343410A (en) | 2020-02-14 | 2020-02-14 | Mute prompt method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092245.7A CN111343410A (en) | 2020-02-14 | 2020-02-14 | Mute prompt method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111343410A true CN111343410A (en) | 2020-06-26 |
Family
ID=71185237
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010092245.7A Pending CN111343410A (en) | 2020-02-14 | 2020-02-14 | Mute prompt method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111343410A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203039A (en) * | 2020-10-12 | 2021-01-08 | 北京字节跳动网络技术有限公司 | Processing method and device for online conference, electronic equipment and computer storage medium |
| CN112650650A (en) * | 2020-12-31 | 2021-04-13 | 联想(北京)有限公司 | Control method and device |
| CN112885350A (en) * | 2021-02-25 | 2021-06-01 | 北京百度网讯科技有限公司 | Control method and device of network conference, electronic equipment and storage medium |
| CN112969000A (en) * | 2021-02-25 | 2021-06-15 | 北京百度网讯科技有限公司 | Control method and device of network conference, electronic equipment and storage medium |
| CN113038063A (en) * | 2021-03-24 | 2021-06-25 | 百度在线网络技术（北京）有限公司 | Method, apparatus, device, medium and product for outputting a prompt |
| WO2023040523A1 (en) * | 2021-09-16 | 2023-03-23 | 腾讯科技（深圳）有限公司 | Audio signal processing method and apparatus, electronic device, and storage medium |
| CN112650650B (en) * | 2020-12-31 | 2024-04-23 | 联想(北京)有限公司 | Control method and device |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025972A (en) * | 2010-12-16 | 2011-04-20 | 中兴通讯股份有限公司 | Mute indication method and device applied for video conference |
| US20130002800A1 (en) * | 2011-06-28 | 2013-01-03 | Mock Wayne E | Muting a Videoconference Using Touch-Based Gestures |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN103473864A (en) * | 2013-06-17 | 2013-12-25 | 西北工业大学 | Voice identification and fingerprint settlement method of intelligent canteen card reader |
| CN105096946A (en) * | 2014-05-08 | 2015-11-25 | 钰太芯微电子科技（上海）有限公司 | Voice activation detection based awakening device and method |
| CN107015481A (en) * | 2017-05-31 | 2017-08-04 | 苏州远唯景电子科技有限公司 | A kind of intelligent voice control blind system with voice identification authentication |
| CN107426413A (en) * | 2017-06-14 | 2017-12-01 | 深圳天珑无线科技有限公司 | Method that volume automatically adjusts, the device and electronic equipment with store function |
| CN108111701A (en) * | 2016-11-24 | 2018-06-01 | 北京中创视讯科技有限公司 | Silence processing method and device |
| CN109065036A (en) * | 2018-08-30 | 2018-12-21 | 出门问问信息科技有限公司 | Method, apparatus, electronic equipment and the computer readable storage medium of speech recognition |
| CN109841206A (en) * | 2018-08-31 | 2019-06-04 | 大象声科（深圳）科技有限公司 | A kind of echo cancel method based on deep learning |
| CN110097875A (en) * | 2019-06-03 | 2019-08-06 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
| CN110223711A (en) * | 2019-06-03 | 2019-09-10 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
| CN110473547A (en) * | 2019-07-12 | 2019-11-19 | 云知声智能科技股份有限公司 | A kind of audio recognition method |
| CN110706694A (en) * | 2019-09-26 | 2020-01-17 | 成都数之联科技有限公司 | Voice endpoint detection method and system based on deep learning |
-
2020
- 2020-02-14 CN CN202010092245.7A patent/CN111343410A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102025972A (en) * | 2010-12-16 | 2011-04-20 | 中兴通讯股份有限公司 | Mute indication method and device applied for video conference |
| US20130002800A1 (en) * | 2011-06-28 | 2013-01-03 | Mock Wayne E | Muting a Videoconference Using Touch-Based Gestures |
| CN103473864A (en) * | 2013-06-17 | 2013-12-25 | 西北工业大学 | Voice identification and fingerprint settlement method of intelligent canteen card reader |
| CN103287362A (en) * | 2013-06-25 | 2013-09-11 | 安科智慧城市技术（中国）有限公司 | Vehicle-mounted voice control system and method and electric automobile |
| CN105096946A (en) * | 2014-05-08 | 2015-11-25 | 钰太芯微电子科技（上海）有限公司 | Voice activation detection based awakening device and method |
| CN108111701A (en) * | 2016-11-24 | 2018-06-01 | 北京中创视讯科技有限公司 | Silence processing method and device |
| CN107015481A (en) * | 2017-05-31 | 2017-08-04 | 苏州远唯景电子科技有限公司 | A kind of intelligent voice control blind system with voice identification authentication |
| CN107426413A (en) * | 2017-06-14 | 2017-12-01 | 深圳天珑无线科技有限公司 | Method that volume automatically adjusts, the device and electronic equipment with store function |
| CN109065036A (en) * | 2018-08-30 | 2018-12-21 | 出门问问信息科技有限公司 | Method, apparatus, electronic equipment and the computer readable storage medium of speech recognition |
| CN109841206A (en) * | 2018-08-31 | 2019-06-04 | 大象声科（深圳）科技有限公司 | A kind of echo cancel method based on deep learning |
| CN110097875A (en) * | 2019-06-03 | 2019-08-06 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
| CN110223711A (en) * | 2019-06-03 | 2019-09-10 | 清华大学 | Interactive voice based on microphone signal wakes up electronic equipment, method and medium |
| CN110473547A (en) * | 2019-07-12 | 2019-11-19 | 云知声智能科技股份有限公司 | A kind of audio recognition method |
| CN110706694A (en) * | 2019-09-26 | 2020-01-17 | 成都数之联科技有限公司 | Voice endpoint detection method and system based on deep learning |
Non-Patent Citations (1)
| Title |
|---|
| 中国铁路总公司: "《高速铁路通信技术 业务网》", 30 April 2016, 北京：中国铁道出版社 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112203039A (en) * | 2020-10-12 | 2021-01-08 | 北京字节跳动网络技术有限公司 | Processing method and device for online conference, electronic equipment and computer storage medium |
| CN112650650A (en) * | 2020-12-31 | 2021-04-13 | 联想(北京)有限公司 | Control method and device |
| CN112650650B (en) * | 2020-12-31 | 2024-04-23 | 联想(北京)有限公司 | Control method and device |
| CN112885350A (en) * | 2021-02-25 | 2021-06-01 | 北京百度网讯科技有限公司 | Control method and device of network conference, electronic equipment and storage medium |
| CN112969000A (en) * | 2021-02-25 | 2021-06-15 | 北京百度网讯科技有限公司 | Control method and device of network conference, electronic equipment and storage medium |
| CN113038063A (en) * | 2021-03-24 | 2021-06-25 | 百度在线网络技术（北京）有限公司 | Method, apparatus, device, medium and product for outputting a prompt |
| WO2023040523A1 (en) * | 2021-09-16 | 2023-03-23 | 腾讯科技（深圳）有限公司 | Audio signal processing method and apparatus, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111343410A (en) | Mute prompt method and device, electronic equipment and storage medium | |
| US9293133B2 (en) | Improving voice communication over a network | |
| CN103190139B (en) | For providing the system and method for conferencing information | |
| CN109361995B (en) | Volume adjusting method and device for electrical equipment, electrical equipment and medium | |
| CN103685783A (en) | Information processing system and storage medium | |
| CN112364144B (en) | Interaction method, device, equipment and computer readable medium | |
| CN113257283B (en) | Audio signal processing method and device, electronic equipment and storage medium | |
| CN112634872A (en) | Voice equipment awakening method and device | |
| CN111883135A (en) | Voice transcription method and device and electronic equipment | |
| CN115831155A (en) | Audio signal processing method and device, electronic equipment and storage medium | |
| CN113257218B (en) | Speech synthesis method, device, electronic equipment and storage medium | |
| CN112863545B (en) | Performance test method, device, electronic equipment and computer readable storage medium | |
| US20200286475A1 (en) | Two-person Automatic Speech Recognition Training To Interpret Unknown Voice Inputs | |
| CN113674752B (en) | Noise reduction method and device for audio signal, readable medium and electronic equipment | |
| CN112837672B (en) | Method and device for determining conversation attribution, electronic equipment and storage medium | |
| CN112259076A (en) | Voice interaction method and device, electronic equipment and computer readable storage medium | |
| CN114550728B (en) | Method, device and electronic equipment for marking speaker | |
| CN113113038A (en) | Echo cancellation method and device and electronic equipment | |
| CN113299309A (en) | Voice translation method and device, computer readable medium and electronic equipment | |
| CN111582708A (en) | Medical information detection method, system, electronic device and computer-readable storage medium | |
| CN112382268A (en) | Method, apparatus, device and medium for generating audio | |
| CN112382273A (en) | Method, apparatus, device and medium for generating audio | |
| CN113763976A (en) | Method and device for reducing noise of audio signal, readable medium and electronic equipment | |
| CN114449341B (en) | Audio processing method and device, readable medium and electronic equipment | |
| CN112671966B (en) | Ear-return time delay detection device, method, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200626 |