WO2023138632A1

WO2023138632A1 - Voice recording method and apparatus, and electronic device

Info

Publication number: WO2023138632A1
Application number: PCT/CN2023/072987
Authority: WO
Inventors: 高志稳
Original assignee: 维沃移动通信有限公司
Priority date: 2022-01-24
Filing date: 2023-01-18
Publication date: 2023-07-27
Also published as: CN114390133A

Abstract

The present application belongs to the field of electronic devices. Disclosed are a voice recording method and apparatus, and an electronic device. The method comprises: a terminal determining the position of a target sound source by means of a microphone array, wherein the target sound source is a sound source for which the sound intensity of a generated voice signal meets a first condition, and the microphone array comprises at least three microphones which are not arranged on one straight line; and according to the position of the target sound source, collecting voice signals in a directional collection mode, so as to obtain a voice file.

Description

Recording method, device and electronic equipment

cross reference

The present invention claims the priority of the Chinese patent application submitted to the China Patent Office on January 24, 2022, with the application number 202210082304.1 and the title of the invention "Recording method, device and electronic equipment". The entire content of this application is incorporated by reference in the present invention.

technical field

The present application belongs to the field of electronic equipment, and in particular relates to a recording method, device and electronic equipment.

Background technique

With the continuous progress and development of science and technology, the functions of smart phones are becoming more and more diverse. People have higher and higher requirements for recording technology and quality. Good recording technology can bring people a good experience, and the same wonderful and rich sound can also bring people more sincere hearing.

Smartphone recordings are not very capable of suppressing environmental noise, especially in scenarios such as multi-person conferences, where slightly louder surrounding sounds will be recorded, resulting in low sound recognition and loud noise.

Contents of the invention

The purpose of the embodiment of the present application is to provide a recording method, device and electronic equipment, which can solve the problem of poor suppression of environmental noise, especially in scenarios such as multi-person conferences, where slightly louder surrounding sounds will be recorded, resulting in low sound recognition and high noise.

In the first aspect, the embodiment of the present application provides a recording method, the method comprising:

The terminal determines the position of the target sound source through the microphone array; wherein, the target sound source is the The sound intensity of the voice signal that is born satisfies the sound source of the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line;

According to the position of the target sound source, the voice signal is collected in a directional collection mode to obtain a voice file.

In a second aspect, an embodiment of the present application provides a recording device, the device comprising:

The sound source localization module is used to determine the position of the target sound source through the microphone array; wherein the target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line;

The voice collection module is used to collect voice signals in a directional collection mode according to the position of the target sound source to obtain a voice file.

In a third aspect, an embodiment of the present application provides an electronic device, the electronic device includes a processor and a memory, the memory stores programs or instructions that can run on the processor, and when the programs or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

In a fifth aspect, the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run programs or instructions to implement the method described in the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product, the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the method described in the first aspect.

In the embodiment of the present application, the terminal determines the position of the target sound source through the microphone array; wherein, The target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition, and the microphone array includes at least three microphones not arranged in a straight line; according to the position of the target sound source, the speech signal is collected in a directional collection mode. Through the embodiment of the present invention, the determined target sound source is firstly positioned and directional collected, so that the speech signal of the target sound source can be effectively separated from the noise environment and collected to obtain clearer sound clips.

Description of drawings

Fig. 1 is a schematic flow chart of a recording method provided by the embodiment of the present application;

FIG. 2 is a schematic structural diagram of a microphone array provided by an embodiment of the present application;

Fig. 3 is a schematic flow chart of another recording method provided by the embodiment of the present application;

Fig. 4 is a schematic flow chart of another recording method provided by the embodiment of the present application;

Fig. 5 is a schematic flow chart of another recording method provided by the embodiment of the present application;

Fig. 6 is a schematic flow chart of a sound clip identification method provided by an embodiment of the present application;

FIG. 7 is a schematic display diagram of a display interface provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a terminal group provided by an embodiment of the present application;

Fig. 9 is a schematic display diagram of another display interface provided by the embodiment of the present application;

Fig. 10 is a schematic display diagram of another display interface provided by the embodiment of the present application;

FIG. 11 is a schematic structural diagram of a recording device provided in an embodiment of the present application;

FIG. 12 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 13 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.

Detailed ways

The technical scheme in the embodiment of the application will be carried out below in conjunction with the accompanying drawings in the embodiment of the application Clearly described, it is obvious that the described embodiments are some of the embodiments of the present application, but not all of the embodiments. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in this application belong to the protection scope of this application.

The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second" and so on are generally of one type, and the number of objects is not limited. For example, there can be one or more first objects. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.

The recording method provided by the embodiment of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.

As shown in FIG. 1 , the embodiment of the present application provides a recording method. The execution body of the method is a terminal, and a microphone array is arranged on the terminal. The microphone array includes at least three microphones, and it is required that the at least three microphones are not arranged on the same straight line. As shown in FIG. 2 , three microphones 101 that are not on the same straight line are respectively installed on the top, middle and bottom of the terminal 100 to form a microphone array. The recording method may include the following steps.

Step 110, the terminal determines the position of the target sound source through the microphone array; wherein the target sound source is a sound source whose sound intensity of the generated voice signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line.

The target sound source is a sound source corresponding to a speech signal satisfying a first condition among the speech signals collected by the microphone array.

The first condition can be set according to actual needs, and can be based on the sound of the voice signal The intensity can be set, or it can be set based on the duration of the voice signal.

In one embodiment, the first condition is that the sound intensity of the voice signal exceeds a first threshold. The microphone array monitors the sound intensity of the voice signal collected in the environment, and when the sound intensity of the voice signal exceeds the first threshold, the sound source that generates the voice seat number is determined as the target sound source.

The first condition may also be that the duration of the sound intensity exceeding the first threshold exceeds the first duration; or, the sound intensity of the voice signals whose sound intensity exceeds the first threshold in the current environment is the highest. For the sake of simplicity, in the following embodiments, the first condition is that the sound intensity of the voice signal exceeds the first threshold A as an example for illustration.

The terminal can locate the target sound source by using the microphone array, so as to acquire the position of the target sound source. Wherein, the manner of using multiple microphones to locate the sound source can be varied, and the position in three-dimensional space of the target sound source that generates the speech signal can be calculated by using the differences in the sound intensity and phase of the speech signals collected by different microphones in the microphone array.

Step 120, according to the position of the target sound source, collect the voice signal in a directional collection mode to obtain a voice file.

After determining the position of the target sound source, the terminal may control the microphone array to adopt a directional collection mode, and collect voice signals in a direction in which the target sound source is located, until the sound intensity of the collected voice signals is less than a second threshold, or when the sound intensity of the collected voice signals is less than the second threshold for a duration exceeding a second duration, exit the directional collection mode, and the collected voice information will be saved as a voice file. Return to the normal acquisition mode, and monitor whether the voice signal meeting the first condition reappears in the current environment. At this time, if the collected voice signal does not satisfy the first condition, it will be overlaid as the noise floor and saved in the voice file. Wherein, the second threshold may be equal to the first threshold, or smaller than the first threshold.

Further, the directional acquisition modes in step 120 can be various, and can include:

Setting an acquisition area centered on the target sound source;

From within the collection area, the voice signal is collected to obtain a sound segment.

Further, the acquisition area can be determined in a variety of ways. It can be within a radius range centered on the target sound source, or it can be a fan-shaped area with the microphone array as the apex and a line connecting the microphone array to the target sound source as the centerline. The opening angle of the fan-shaped area can be set to a first angle X. As shown in FIG. 3 , the fan-shaped area formed with the target sound source 200 as the center is used as the collection area to collect voice information. For the sake of simplicity, in the following embodiments, the fan-shaped area is taken as an example for illustration.

In one embodiment, in order to ensure the clarity of the speech signal collected in the collection area, the method further includes:

The voice signals outside the collection area are shielded or suppressed. As shown in FIG. 3 , the voice signals generated by other sound sources 201 outside the fan-shaped area are shielded or suppressed.

The manner of shielding or suppressing the voice signal can be set according to actual needs, for example, different gains in different directions can be formed by adjusting the parameters of each microphone in the microphone array. The gain in the direction of the collection area is increased, while the gain outside the collection area is decreased; the voice signal outside the collection area can also be filtered or suppressed by software algorithm.

FIG. 4 shows an example of the recording method of the embodiment of the present application.

recording starts;

Whether the sound intensity of the voice signals produced by different sound sources in the monitoring current environment exceeds the first threshold value A; sequentially determine whether the sound intensity of the voice signals of each sound source including sound source 1, sound source 2 and sound source 3 exceeds the first threshold value A;

If the sound intensity of the voice information of any sound source exceeds the first threshold A, then the sound source is determined as Target the sound source and locate it, so that the voice signal of the sound source is directional collected in an X-angle sector, and at the same time shield or suppress the voice signals generated by other sound sources;

If the first threshold A is not exceeded, continue to monitor the voice signal of the next sound source, and so on until the end of the recording.

After the recording ends, the terminal can obtain the complete voice file of this recording.

It can be seen from the technical solutions provided by the above embodiments of the present invention that the embodiments of the present invention determine the position of the target sound source through the microphone array; wherein, the target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line; according to the position of the target sound source, the speech signal is collected in a directional collection mode. Through the embodiment of the present invention, the determined target sound source is firstly positioned and directional collected, so that the speech signal of the target sound source can be effectively separated from the noise environment and collected to obtain clearer sound clips.

Based on the foregoing embodiments, further, as shown in FIG. 5 , during the process of collecting the voice signal in step 120 or after the collection is completed, the method further includes:

Step 130: Determine a sound source corresponding to the voice signal according to the voiceprint feature of the voice signal.

While collecting the voice signal, identification of the sound source that generates the voice signal may also be enabled. There may be various ways of identifying the identity, and this embodiment of the present application only uses the way of matching based on voiceprint features as an example for illustration.

As shown in Figure 6, through feature extraction, the voiceprint feature of the speech signal to be recognized is extracted, and matched with the existing voiceprint feature of the existing sound source of the terminal, if the matching is successful, then it is determined that the sound source generating the speech signal is an existing sound source, and then the sound segment containing the speech signal is extracted and recorded in the corresponding directory; and if the matching fails, then it is determined that the sound source generating the speech signal is a new sound source, press Name the identity of the new sound source according to the naming rules, and store the new sound source and voiceprint features into a new existing sound source and existing voiceprint features, and then extract the sound segment containing the voice signal and record it in the corresponding directory.

Further, after the step S130, the method further includes:

Extracting a sound segment including the speech signal according to the sound intensity;

Wherein, there may be various ways to extract the sound segment, and the embodiment of the present application only gives an example of one of them. The sound segment can be extracted based on the first condition, and according to the variation of the sound intensity of the voice signal, the start mark of each sound segment can be when the sound intensity meets the first condition or meets the first condition for a first duration, and the end mark is when the sound intensity does not meet the first condition or does not meet the first condition for a second duration.

On the display interface, the sound segment is recorded into a first directory corresponding to the sound source, and the first directory is located under a second directory corresponding to the voice file.

The arrangement rules and display rules of the directories in the display interface can be set according to actual needs, and this embodiment of the present application only gives an example for illustration. As shown in Figure 7, set up two-level directory in display interface, with the second directory corresponding to described audio file as first-level directory, the directory name of described second directory can be the mark of described audio file, under described second directory, set up the first directory corresponding to each sound source as second-level directory, the directory name of described first directory can be the identification mark of corresponding sound source: sound source A, sound source B and sound source C, and record the sound segment corresponding to each sound source under each first directory, A-1, A-2 and A-3, the title of each sound segment can include corresponding sound Source ID and sequence number.

In the process of identifying the sound clip, if the existing sound source corresponding to the sound clip is matched, the sound clip is recorded in the first directory corresponding to the existing sound source; The first directory corresponding to the source, and record the sound clip into the newly created first directory.

Further, the method also includes:

Receive a first input to the display interface; wherein, the first input can be generated by a touch operation, for example, a click operation, a long press operation, or a slide operation, etc., or can also be generated by a voice operation or a gesture operation, which is not specifically limited here.

In response to the first input, the sound clip or voice file is played.

Through the first input to the display interface, the user chooses to play the voice file or sound segment displayed on the display interface. For example, as shown in Figure 7, the user can play or pause the audio file that contains each sound clip by performing a first operation on the second directory corresponding to the audio file; the user can also expand or collapse the list of the first directory under the second directory by performing a second operation on the second directory; the user can also expand or collapse the list of sound clips under the first directory by performing a third operation on the expanded first directory;

It can be seen from the above technical solutions provided by the embodiments of the present invention that the embodiments of the present invention determine the sound source that generates the speech signal according to the voiceprint feature of the speech signal. Through the embodiment of the present invention, the sound source of the voice signal is identified, and the corresponding sound clips are extracted, and then recorded in the corresponding directory, so that the sound clips can be efficiently managed, reasonably displayed and played.

Based on the above embodiment, further, if the terminal is a main terminal of a terminal group, and the terminal group includes at least one main terminal and N auxiliary terminals, where N is greater than or equal to 1, the method further includes:

receiving and summarizing the voice signals collected by the attached terminal to obtain a voice file.

As shown in FIG. 8 , according to actual needs, a terminal group composed of multiple terminals can be formed. For example, when a multi-terminal conference is required, multiple terminals joining the conference can be formed into a terminal group. In a In this embodiment, at least one of the terminals can be set as the main terminal, and the other terminals can be set as auxiliary terminals, and the main terminal can record and record the whole process of the multi-terminal conference.

Each terminal can determine and locate the target sound source in the surrounding environment according to the method of the above-mentioned embodiment, and then, according to the position of the target sound source, collect voice signals in a directional collection mode, and then send the voice signals to the main terminal, and the main terminal summarizes them in chronological order to form a total voice file.

Further, in the process of receiving the voice signal collected by the attached terminal, the method further includes:

A sound source corresponding to the speech signal is determined.

It should be understood that the identification process of the sound source corresponding to each voice signal can be completed by each terminal itself, and then the identification result together with the voice signal is sent to the main terminal; the identification process can also be performed by the main terminal.

A sound segment including the voice signal is extracted from the voice file.

The sound segment can be extracted based on the first condition, and according to the variation of the sound intensity of the voice signal, the start mark of each sound segment can be when the sound intensity meets the first condition or meets the first condition for a first duration, and the end mark is when the sound intensity does not meet the first condition or does not meet the first condition for a second duration.

On the display interface, record the sound segment into a first directory corresponding to the sound source; wherein, the first directory is located under a third directory corresponding to the terminal, and the third directory is located under a second directory corresponding to the voice file.

The main terminal records the sound clip into a corresponding directory on the display interface according to the sound source corresponding to the sound clip in the identification result of the sound clip and the terminal that collects the sound clip.

Arrangement rules and display rules of directories in the display interface can be implemented according to actual needs It is assumed that the embodiment of the present application only provides an example for illustration. As shown in Figure 9, set up a secondary directory on the display interface, with the second directory corresponding to the voice file as the first-level directory, the directory name of the second directory can be the identification of the voice file: terminal 1, terminal 2 and terminal 3, the third directory corresponding to each terminal is established under the second directory as the second-level directory, the directory name of the third directory can be the identification of the terminal, and the corresponding sound clips are recorded in the third directory. 1-B-1 etc.

In another embodiment, a three-level directory can also be established on the display interface, and the second directory corresponding to the voice file is used as the first-level directory. The directory name of the second directory can be the identification of the voice file. Under the second directory, a third directory corresponding to each terminal is established as the second-level directory. The directory name of the third directory can be the identification of the terminal: Terminal 1, Terminal 2, and Terminal 3. The first directory corresponding to each sound source is established under the third directory as the third-level directory, and the directory name of the first directory can be the identity of the corresponding sound source: sound source A, Sound source B and sound source C, and record sound clips corresponding to each sound source in each first directory: 1-A-1, 1-A-2, 1-B-1, etc.

In another embodiment, the hierarchical relationship between the first directory and the second directory in the above-mentioned three-level directory can also be reversed, the first directory is used as the second-level directory, the third directory is established under the second directory as the third-level directory, and the corresponding sound source is recorded in the third directory.

For the sake of simplicity, in the following embodiments, the establishment of the secondary directory as shown in FIG. 9 is taken as an example for illustration.

In one embodiment, the main terminal extracts and identifies each sound segment in the total voice file, and in the process of identifying the sound segment, through the matching process of voiceprint features, determine the identity of the sound source corresponding to the sound segment, record it in the corresponding third directory and name it.

Further, the method also includes:

In response to the first input, the sound clip or voice file is played.

Through the first input to the display interface, the user chooses to play the voice file or sound segment displayed on the display interface. For example, as shown in Figure 9, the user can play or pause the audio file containing each sound clip by performing a first operation on the second directory corresponding to the audio file; the user can also expand or collapse the list of the third directory under the second directory by performing a second operation on the second directory; the user can also expand or collapse the list of sound clips under the third directory by performing a third operation on the expanded third directory;

It can be seen from the above technical solutions provided by the embodiments of the present invention that in the embodiments of the present invention, if the terminal is the main terminal of a terminal group, and the terminal group includes at least one main terminal and N auxiliary terminals, where N is greater than or equal to 1, the main terminal receives the sound clips collected by the auxiliary terminals, and saves them together as a voice file. Through the embodiment of the present invention, the sound source of the sound clip is identified and recorded in a corresponding directory, so that the sound clip can be efficiently managed, displayed and played reasonably.

The recording method provided in the embodiment of the present application may be executed by a recording device. In the embodiment of the present application, the recording method performed by the recording device is taken as an example to describe the recording device provided in the embodiment of the present application.

As shown in Figure 11, described recording device comprises: sound source localization module 111 and voice acquisition module 112; Wherein, described sound source localization module 111 is used for passing the microphone array, determines the position of target sound source; Wherein, described target sound source is the sound source that the sound intensity of the speech signal that produces meets the first condition, and described microphone array comprises at least three microphones that are not arranged on a straight line; Said voice acquisition module Block 112 is used to collect voice signals in a directional collection mode according to the position of the target sound source to obtain a voice file.

Further, the first condition includes:

The sound intensity of the speech signal exceeds a first threshold.

Further, the voice collection module is used for:

Setting an acquisition area centered on the target sound source;

From within the collection area, voice signals are collected.

Further, the collection area is a fan-shaped area with the microphone array as an apex and a line connecting the microphone array to the target sound source as a centerline.

Further, the voice collection module is also used for:

Shield or suppress voice signals outside the collection area.

It can be seen from the technical solutions provided by the embodiments of the present invention above that the position of the target sound source is determined through the microphone array in the embodiment of the present invention; wherein, the target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line; according to the position of the target sound source, the speech signal is collected in a directional collection mode. Through the embodiment of the present invention, the determined target sound source is firstly positioned and directional collected, so that the speech signal of the target sound source can be effectively separated from the noise environment and collected to obtain clearer sound clips.

Based on the above embodiments, further, in the process of collecting voice signals in a directional collection mode, the voice collection module is also used for:

A sound source corresponding to the voice signal is determined according to the voiceprint feature of the voice signal.

Further, after determining the sound source corresponding to the voice signal, the voice collection module is also used for:

Further, after recording the sound clip into the first directory corresponding to the corresponding identification information, the voice collection module is also used for:

receiving a first input to a display interface;

In response to the first input, the sound clip or voice file is played.

It can be seen from the above technical solutions provided by the embodiments of the present invention that the embodiments of the present invention determine the sound source that generates the speech signal according to the voiceprint feature of the speech signal. Through the embodiment of the present invention, the identity of the sound source corresponding to the voice signal is identified, and the corresponding sound segment is extracted, and then recorded in the corresponding directory, so that the sound segment can be efficiently managed, reasonably displayed and played.

Based on the above embodiment, further, when the recording device is a main terminal of a terminal group, and the terminal group includes at least one main terminal and N auxiliary terminals, where N is greater than or equal to 1, the voice collection module is further configured to:

Further, in the process of receiving the voice signal collected by the attached terminal, the voice collection module is also used for:

determining a sound source corresponding to the speech signal;

extracting a sound segment including the voice signal from the voice file;

Recording the sound clip on the display interface in a third directory corresponding to the terminal that collected the sound clip; wherein the third directory is located in the second directory corresponding to the voice file.

receiving a first input to a display interface;

In response to the first input, the sound clip or voice file is played.

It can be seen from the technical solutions provided by the above embodiments of the present invention that if the device in the embodiments of the present invention is the main terminal of a terminal group, the terminal group includes at least one main terminal and N auxiliary terminals, where N is greater than or equal to 1, and the main terminal receives the sound clips collected by the auxiliary terminals, and saves them together as a voice file. Through the embodiment of the present invention, the sound source of the sound clip is identified and recorded in a corresponding directory, so that the sound clip can be efficiently managed, displayed and played reasonably.

The recording device in the embodiment of the present application may be an electronic device, or may be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or other devices other than the terminal. Exemplarily, the electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (Augmented Reality, AR)/virtual reality (Virtual Reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-Mobile Personal Computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc., It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which are not specifically limited in this embodiment of the present application.

The recording device in this embodiment of the present application may be a device with an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.

The recording device provided in the embodiment of the present application can realize various processes realized by the method embodiments in FIG. 1 to FIG. 10 , and details are not repeated here to avoid repetition.

Optionally, as shown in FIG. 12 , the embodiment of the present application further provides an electronic device 1200, including The processor 1201 and the memory 1202. The memory 1202 stores programs or instructions that can run on the processor 1201. When the programs or instructions are executed by the processor 1201, each step of the above-mentioned recording method embodiment can be achieved, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.

The electronic device 1300 includes, but is not limited to: a radio frequency unit 1301, a network module 1302, an audio output unit 1303, an input unit 1304, a sensor 1305, a display unit 1306, a user input unit 1307, an interface unit 1308, a memory 1309, and a processor 1310.

Those skilled in the art can understand that the electronic device 1300 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 1310 through the power management system, so that functions such as management of charging, discharging, and power consumption management can be realized through the power management system. The structure of the electronic device shown in FIG. 13 does not constitute a limitation to the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, which will not be repeated here.

Wherein, the processor 1310 is configured to determine the position of the target sound source through the input unit 1304; wherein, the target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition; the input unit 1304 includes at least three microphones that are not arranged in a straight line;

The input unit 1304 is configured to collect voice signals in a directional collection mode according to the position of the target sound source to obtain a voice file.

Further, the first condition includes:

The sound intensity of the speech signal exceeds a first threshold.

Further, the input unit 1304 is used for:

Setting an acquisition area centered on the target sound source;

From within the collection area, voice signals are collected.

Further, the input unit 1304 is also used for:

Shield or suppress voice signals outside the collection area.

Through the embodiment of the present invention, the determined target sound source is firstly positioned and directional collected, so that the speech signal of the target sound source can be effectively separated from the noise environment and collected to obtain clearer sound clips.

Based on the above embodiment, further, during the process of collecting the voice signal in the directional collection mode, the processor 1310 is further configured to: determine the sound source corresponding to the voice signal according to the voiceprint feature of the voice signal.

Further, after determining the sound source corresponding to the speech signal, the processor 1310 is further configured to:

Further, the user input unit 1307 is configured to receive a first input to the display interface;

The audio output unit 1303 is configured to play the sound clip or voice file in response to the first input.

Through the embodiment of the present invention, the identity of the sound source corresponding to the voice signal is identified, and the corresponding sound segment is extracted, and then recorded in the corresponding directory, so that the sound segment can be efficiently managed, reasonably displayed and played.

Further, when the recording device is the main terminal of the terminal group, the terminal group includes at least one main terminals and N auxiliary terminals, where N is greater than or equal to 1, the radio frequency unit 1301 is further configured to: receive and summarize voice signals collected by the auxiliary terminals to obtain a voice file.

Further, in the process of receiving the voice signal collected by the attached terminal, the processor 1310 is further configured to:

determining a sound source corresponding to the speech signal;

extracting a sound segment including the voice signal from the voice file;

Through the embodiment of the present invention, the sound source of the sound clip is identified and recorded in a corresponding directory, so that the sound clip can be efficiently managed, displayed and played reasonably.

It should be understood that, in the embodiment of the present application, the input unit 1304 may include a graphics processor (Graphics Processing Unit, GPU) 13041 and a microphone 13042, and the graphics processor 13041 processes image data of still pictures or videos obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1306 may include a display panel 13061, and the display panel 13061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1307 includes at least one of a touch panel 13071 and other input devices 13072 . Touch panel 13071, also called touch screen. The touch panel 13071 may include two parts, a touch detection device and a touch controller. Other input devices 13072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.

The memory 1309 can be used to store software programs as well as various data. The memory 1309 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required by at least one function (such as a sound playing function) function, image playback function, etc.), etc. Furthermore, memory 1309 can include volatile memory or nonvolatile memory, or, memory 1309 can include both volatile and nonvolatile memory. Wherein, the non-volatile memory may be a read-only memory (Read-Only Memory, ROM), a programmable read-only memory (Programmable ROM, PROM), an erasable programmable read-only memory (Erasable PROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or a flash memory. Volatile memory can be Random Access Memory (Random Access Memory, RAM), Static Random Access Memory (Static RAM, SRAM), Dynamic Random Access Memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (Double Data Rate SDRAM, DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESD RAM), synchronous connection dynamic random access memory (Synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DRRAM). The memory 1309 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 1310 may include one or more processing units; optionally, the processor 1310 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It can be understood that the foregoing modem processor may not be integrated into the processor 1310 .

The embodiment of the present application also provides a readable storage medium. The readable storage medium stores a program or an instruction. When the program or instruction is executed by a processor, each process of the above-mentioned recording method embodiment can be achieved, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.

Wherein, the processor is the processor in the electronic device described in the above embodiments. Described readable storage medium includes computer readable storage medium, such as computer read-only memory ROM, random memory Take the memory RAM, magnetic disk or optical disk, etc.

The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned recording method embodiment, and can achieve the same technical effect. To avoid repetition, details are not repeated here.

It should be understood that the chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.

The embodiment of the present application provides a computer program product, the program product is stored in a storage medium, and the program product is executed by at least one processor to implement the various processes in the above-mentioned recording method embodiment, and can achieve the same technical effect. To avoid repetition, details are not repeated here.

It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such a process, method, article or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Additionally, features described with reference to certain examples may be combined in other examples.

Through the description of the above embodiments, those skilled in the art can clearly understand that the methods in the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course they can also over hardware, but in many cases the former is a better implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of a computer software product in essence or the part that contributes to the prior art. The computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), and includes several instructions to make a terminal (which can be a mobile phone, computer, server, or network device, etc.) execute the method described in each embodiment of the application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Under the inspiration of this application, those skilled in the art can also make many forms without departing from the purpose of the application and the scope of protection of the claims, all of which belong to the protection of the present application.

Claims

A recording method, comprising:

The terminal determines the position of the target sound source through the microphone array; wherein the target sound source is a sound source whose sound intensity of the generated voice signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line;

According to the position of the target sound source, the voice signal is collected in a directional collection mode to obtain a voice file.
The method according to claim 1, wherein said collecting the voice signal in a directional collection mode according to the position of the target sound source comprises:

Setting an acquisition area centered on the target sound source;

From within the collection area, voice signals are collected.
The method according to claim 2, wherein the collection area is a fan-shaped area with the microphone array as a vertex and a line connecting the microphone array to the target sound source as a center line.
The method according to claim 2, wherein the method further comprises:

Shield or suppress voice signals outside the collection area.
The method according to claim 1, wherein, in the process of collecting voice signals in a directional collection mode, the method further comprises:

A sound source corresponding to the voice signal is determined according to the voiceprint feature of the voice signal.
The method according to claim 5, wherein, after determining the sound source corresponding to the speech signal, the method further comprises:

Extracting a sound segment including the speech signal according to the sound intensity;

On the display interface, the sound segment is recorded into a first directory corresponding to the sound source, and the first directory is located under a second directory corresponding to the voice file.
The method according to claim 2, wherein, when the terminal is a main terminal of a terminal group, and the terminal group includes at least one main terminal and N auxiliary terminals, where N is greater than or equal to 1, the method further comprises:

receiving and summarizing the voice signals collected by the attached terminal to obtain a voice file.
The method according to claim 7, wherein, in the process of receiving the voice signal collected by the attached terminal, the method further comprises:

determining a sound source corresponding to the speech signal;

extracting a sound segment including the voice signal from the voice file;

Recording the sound clip on the display interface in a third directory corresponding to the terminal that collected the sound clip; wherein the third directory is located in the second directory corresponding to the voice file.
The method according to claim 6 or 8, wherein, after recording the sound clip into the first directory corresponding to the corresponding identification information, the method further comprises:

receiving a first input to a display interface;

In response to the first input, the sound clip or voice file is played.
The method of claim 1, wherein the first condition comprises:

The sound intensity of the speech signal exceeds a first threshold.
A recording device comprising:

The sound source localization module is used to determine the position of the target sound source through the microphone array; wherein the target sound source is a sound source whose sound intensity of the generated speech signal meets the first condition, and the microphone array includes at least three microphones that are not arranged in a straight line;

The voice collection module is used to collect voice signals in a directional collection mode according to the position of the target sound source to obtain a voice file.
An electronic device, comprising a processor and a memory, the memory stores programs or instructions that can run on the processor, and when the programs or instructions are executed by the processor, the steps of the recording method according to any one of claims 1-10 are realized.
A readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the recording method according to any one of claims 1-10 are realized.