CN115396723A - Screen recording method, device, equipment and storage medium - Google Patents

Screen recording method, device, equipment and storage medium Download PDF

Info

Publication number
CN115396723A
CN115396723A CN202211013897.2A CN202211013897A CN115396723A CN 115396723 A CN115396723 A CN 115396723A CN 202211013897 A CN202211013897 A CN 202211013897A CN 115396723 A CN115396723 A CN 115396723A
Authority
CN
China
Prior art keywords
audio
audio data
data
target
screen recording
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211013897.2A
Other languages
Chinese (zh)
Inventor
张丽娜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN202211013897.2A priority Critical patent/CN115396723A/en
Publication of CN115396723A publication Critical patent/CN115396723A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G11B2020/10537—Audio or video recording
    • G11B2020/10546—Audio or video recording specifically adapted for audio data

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

The disclosure relates to a screen recording method, device, equipment and storage medium. The screen recording method is applied to electronic equipment and comprises the following steps: under the condition that a screen recording instruction for a display interface of the electronic equipment is detected, acquiring picture data of the display interface; obtaining first audio data of a target application program from the target application program which is currently played in an audio mode through an internal interface of the electronic equipment; acquiring second audio data in the space where the electronic equipment is located currently through an audio acquisition module of the electronic equipment; synthesizing the first audio data and the second audio data to obtain target audio data; and generating a screen recording file based on the picture data and the target audio data. The screen recording method can improve the screen recording performance of the electronic equipment, so that the screen recording requirements under various scenes are met; in addition, the screen recording effect of the electronic equipment can be enhanced.

Description

Screen recording method, device, equipment and storage medium
Technical Field
The present disclosure relates to the field of communications technologies, and in particular, to a screen recording method, apparatus, device, and storage medium.
Background
With the development of science and technology, the technology of the terminal device is more mature, for example, the functions of the electronic device are more complete, such as a small window function, a voice assistant function, a screen recording function, and the like. The screen recording function may record internal audio of the electronic device (i.e., audio being played by the electronic device) or external sound collected by a microphone while recording a display screen of the electronic device.
However, the screen recording function in the related art cannot record the internal audio of the electronic device and the external sound collected by the microphone at the same time, so that the screen recording performance of the electronic device is poor, and the screen recording function cannot be applied to an application scenario in which the internal audio and the external sound of the electronic device need to be recorded at the same time.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides a screen recording method, device, equipment and storage medium, which can improve the screen recording performance of electronic equipment, thereby satisfying the screen recording requirements in various scenes and enhancing the screen recording effect of electronic equipment.
According to a first aspect of the embodiments of the present disclosure, there is provided a screen recording method applied to an electronic device, the method including:
under the condition that a screen recording instruction aiming at a display interface of the electronic equipment is detected, acquiring picture data of the display interface;
obtaining first audio data of a target application program from the target application program which is currently played in an audio mode through an internal interface of the electronic equipment;
acquiring second audio data in the space where the electronic equipment is located currently through an audio acquisition module of the electronic equipment;
synthesizing the first audio data and the second audio data to obtain target audio data;
and generating a screen recording file based on the picture data and the target audio data.
In some embodiments, the obtaining, through the internal interface of the electronic device, the first audio data of the target application from the target application currently performing audio playing includes:
executing an audio output thread of the target application program, and transmitting the first audio data to a hardware abstraction layer through the internal interface;
the synthesizing the first audio data and the second audio data to obtain target audio data includes:
transmitting second audio data acquired by the audio acquisition module to the hardware abstraction layer;
and synthesizing the first audio data and the second audio data through an audio processing module of the hardware abstraction layer to obtain the target audio data.
In some embodiments, the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
performing format conversion on the first audio data through the audio processing module to obtain first audio data in a target format;
carrying out format conversion on the second audio data to obtain second audio data in the target format;
determining a first time stamp of each first audio unit in the first audio data in the target format and a second time stamp of each second audio unit in the second audio data in the target format;
and combining the first audio unit and the second audio unit according to the first time stamp and the second time stamp to obtain the target audio data.
In some embodiments, the executing the audio output thread of the target application to transfer the first audio data to a hardware abstraction layer through the internal interface includes:
executing an audio output thread of the target application program, and transmitting the first audio data to an audio manager of the electronic equipment through the internal interface;
the audio manager carries out noise reduction processing on the first audio data and transmits the first audio data subjected to the noise reduction processing to the hardware abstraction layer;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the second audio data and the first audio data subjected to noise reduction processing through the audio processing module to obtain the target audio data.
In some embodiments, the method further comprises:
after receiving the first audio data, a data receiving module of the hardware abstraction layer copies the first audio data to obtain a first audio copy;
the data receiving module copies the received second audio data to obtain a second audio copy;
the data receiving module transmits the first audio copy and the second audio copy to the audio processing module;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the first audio copy and the second audio copy through the audio processing module to obtain the target audio data.
In some embodiments, the method further comprises:
the data receiving module transmits the first audio data to an audio output module of the electronic equipment and outputs the first audio data through the audio output module;
the data receiving module transmits the second audio data to the target application program.
In some embodiments, the generating a screen recording file based on the picture data and the target audio data includes:
executing a data acquisition thread in an audio manager, and acquiring the target audio data from an audio processing module of the hardware abstraction layer;
transmitting the target audio data to a screen recording application program through a preset channel;
and the screen recording application program generates the screen recording file based on the picture data and the target audio data.
According to a second aspect of the embodiments of the present disclosure, there is provided a screen recording apparatus applied to an electronic device, the apparatus including:
the acquisition module is configured to acquire picture data of a display interface of the electronic equipment under the condition that a screen recording instruction for the display interface is detected;
the first processing module is configured to obtain first audio data of a target application program from the target application program currently performing audio playing through an internal interface of the electronic device;
the acquisition module is configured to acquire second audio data in the space where the electronic equipment is located through an audio acquisition module of the electronic equipment;
the synthesis module is configured to synthesize the first audio data and the second audio data to obtain target audio data;
and the second processing module is configured to generate a screen recording file based on the picture data and the target audio data.
In some embodiments, the first processing module is configured to execute an audio output thread of the target application program, and transmit the first audio data to a hardware abstraction layer through the internal interface;
the synthesis module is configured to:
transmitting second audio data acquired by the audio acquisition module to the hardware abstraction layer;
and synthesizing the first audio data and the second audio data through an audio processing module of the hardware abstraction layer to obtain the target audio data.
In some embodiments, the synthesis module is configured to:
performing format conversion on the first audio data through the audio processing module to obtain first audio data in a target format;
carrying out format conversion on the second audio data to obtain second audio data in the target format;
determining a first time stamp of each first audio unit in the first audio data in the target format and a second time stamp of each second audio unit in the second audio data in the target format;
and combining the first audio unit and the second audio unit according to the first time stamp and the second time stamp to obtain the target audio data.
In some embodiments, the first processing module is configured to:
executing an audio output thread of the target application program, and transmitting the first audio data to an audio manager of the electronic equipment through the internal interface;
performing noise reduction processing on the first audio data through the audio manager, and transmitting the first audio data subjected to the noise reduction processing to the hardware abstraction layer;
the synthesis module is configured to: and synthesizing the second audio data and the first audio data subjected to noise reduction processing through the audio processing module to obtain the target audio data.
In some embodiments, the apparatus further comprises a replication module configured to:
copying the first audio data after the first audio data is received through a data receiving module of the hardware abstraction layer to obtain a first audio copy;
copying the received second audio data through the data receiving module to obtain a second audio copy;
transmitting, by the data receiving module, the first audio copy and the second audio copy to the audio processing module;
the synthesis module is configured to perform synthesis processing on the first audio copy and the second audio copy through the audio processing module to obtain the target audio data.
In some embodiments, the apparatus further comprises a third processing module configured to:
the first audio data are transmitted to an audio output module of the electronic equipment through the data receiving module and are output through the audio output module;
and transmitting the second audio data to the target application program through the data receiving module.
In some embodiments, the second processing module is configured to:
executing a data acquisition thread in an audio manager, and acquiring the target audio data from an audio processing module of the hardware abstraction layer;
and transmitting the target audio data to a screen recording application program through a preset channel.
According to a third aspect of the embodiments of the present disclosure, there is provided an electronic apparatus including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: when executed, the method realizes the steps of any screen recording method of the first aspect.
According to a fourth aspect of embodiments of the present disclosure, there is provided a non-transitory computer-readable storage medium, wherein instructions of the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the steps of any one of the screen recording methods of the first aspect.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
in the embodiment of the disclosure, when a screen recording instruction for a display interface of an electronic device is detected, first audio data can be obtained from a target application program currently performing audio playing through an internal interface of the electronic device while picture data of the display interface is obtained, and second audio data in a space where the electronic device is currently located is collected through an audio collection module of the electronic device. That is to say, in the first aspect, in the process of recording the display interface of the electronic device, the present disclosure may record the internal audio (i.e., the first audio data in the target application) and the external sound (i.e., the second audio data in the space where the electronic device is currently located) of the electronic device at the same time, and therefore, the screen recording performance of the electronic device may be improved, so as to meet the screen recording requirements in various scenes. In a second aspect, the sound quality of the first audio data obtained from the target program through the internal interface of the electronic device is better, and the noise is smaller; therefore, the target audio data synthesized by the first audio data and the second audio data can have better sound quality and lower noise; and further, the screen recording effect of the electronic equipment can be enhanced.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a first flowchart illustrating a screen recording method according to an exemplary embodiment of the present disclosure;
FIG. 2 is a flowchart illustrating a screen recording method according to an exemplary embodiment of the present disclosure;
FIG. 3 is a schematic diagram illustrating a screen recording method according to an exemplary embodiment of the present disclosure;
FIG. 4 is a schematic diagram illustrating a screen recording method according to an exemplary embodiment of the present disclosure;
fig. 5 is a block diagram illustrating a structure of a screen recording apparatus according to an exemplary embodiment of the present disclosure;
fig. 6 is a block diagram illustrating a hardware configuration of an electronic device according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
Fig. 1 is a flowchart of a screen recording method according to an exemplary embodiment of the present disclosure, as shown in fig. 1, the method mainly includes the following steps:
step 110, acquiring picture data of a display interface of the electronic equipment under the condition that a screen recording instruction for the display interface is detected;
step 120, obtaining first audio data of a target application program from the target application program currently performing audio playing through an internal interface of the electronic device;
step 130, acquiring second audio data in the current space of the electronic equipment through an audio acquisition module of the electronic equipment;
step 140, synthesizing the first audio data and the second audio data to obtain target audio data;
and 150, generating a screen recording file based on the picture data and the target audio data.
It should be noted that the screen recording method provided by the present disclosure may be applied to an electronic device, where the electronic device may include: a terminal device, such as a mobile terminal or a fixed terminal. Wherein, the mobile terminal can include: mobile phones, tablet computers, notebook computers and the like. The fixed terminal may include: desktop computers or smart televisions, etc.
In some embodiments, the screen recording instruction may include an instruction triggered by an input operation of a user to instruct recording of a display interface of the electronic device. The input operation here may include: voice input operations, gesture operations, and the like. For example, text, symbols, etc. may be entered by gestures. Wherein the input operation may further include: key operation, click operation, etc. After receiving an input operation input by a user, the electronic equipment triggers a screen recording instruction, and records a display interface of the electronic equipment according to the screen recording instruction.
In the case that a screen recording instruction for a display interface of the electronic device is detected, the display interface of the electronic device may be recorded. In the process of recording the display interface of the electronic equipment, the picture data of the display interface can be acquired. Here, the display interface may be an interface currently displayed by the electronic device, for example, the display interface may be an interface where a desktop of the electronic device is located, or may be an interface inside an application running in the electronic device.
In some embodiments, in the process of recording the display interface of the electronic device, the audio being played by the electronic device may also be recorded, or the external sound collected by the audio collection module of the electronic device may be recorded.
In some embodiments, in the process of recording the display interface of the electronic device, the audio being played by the electronic device and the external sound collected by the audio collection module of the electronic device can be recorded at the same time. For example, first audio data of a target application program can be obtained from the target application program currently performing audio playing through an internal interface of the electronic device, and second audio data in a space where the electronic device is currently located is acquired through an audio acquisition module of the electronic device.
Here, the target application may be an application that is playing audio in the electronic device, and the internal interface may be an interface through which the target application outputs audio to other functional modules of the electronic device. The first audio data of the target application program is obtained from the target application program currently performing audio playing, and may be obtained from the target application program currently performing audio playing when it is detected that the target application program currently performing audio playing is playing audio.
It can be understood that, when the running application is not detected or the running application does not currently play audio, the first audio data may not be acquired, and the second audio data in the space where the electronic device is currently located is acquired through the audio acquisition module of the electronic device while the picture data of the display interface is acquired.
The electronic device often plays music and video or performs voice communication through an application installed in the electronic device, so that the first audio data of the target application can be obtained from the target application currently performing audio playing. The first audio data may be data of audio being played by a target application currently performing audio playing, for example, data of music being played by a music player, data of background music of video being played by a video player, data of voice being played by a communication application, or data of voice received by the communication application while performing voice call.
It should be noted that, the first audio data is obtained from a target application program currently performing audio playing through an internal interface of the electronic device; instead of outputting the audio through an audio playing module (e.g., a speaker) of the electronic device and capturing the audio through an audio capturing module (e.g., a microphone) of the electronic device.
It can be understood that after the audio is output through the speaker of the electronic device, the audio collected through the microphone may be mixed with external noise; moreover, in the process of outputting and collecting audio, multiple encoding and decoding needs to be performed on the audio, and the multiple encoding and decoding can affect the tone quality of the audio. Therefore, compared with the method that the audio data is collected through the microphone after the audio is output through the loudspeaker of the electronic equipment; the first audio data obtained from the target application program currently playing the audio through the internal interface of the electronic equipment has better tone quality and smaller noise.
In this disclosure, the audio collection module of the electronic device may be a module capable of collecting sound in a space where the electronic device is currently located, for example, the audio collection module may include a microphone, and the microphone may collect data of sound input by a user to the electronic device through the microphone, or may collect data of environmental sound in the space where the electronic device is currently located.
In the embodiment of the disclosure, under the condition that a screen recording instruction for a display interface of an electronic device is detected, if a target application program currently performing audio playing is playing audio, while picture data of the display interface is acquired, first audio data of the target application program is acquired from the target application program currently performing audio playing through an internal interface of the electronic device, and second audio data in a space where the electronic device is currently located is acquired through an audio acquisition module of the electronic device; if the running application program does not exist or the audio is not played by the running application program, acquiring the picture data of the display interface and acquiring second audio data in the space where the electronic equipment is currently located through an audio acquisition module of the electronic equipment.
After the first audio data and the second audio data are obtained, the first audio data and the second audio data may be subjected to synthesis processing to obtain target audio data. Here, the first audio data and the second audio data may be synthesized in accordance with time stamps of the first audio data and the second audio data.
After the target audio data is obtained, a screen recording file may be generated based on the picture data and the target audio data.
Here, the screen data and the target Audio data may be subjected to Audio/Video synchronization processing to obtain a screen recording file, and a file format of the screen recording file may be a Moving Picture Experts Group (MP 4) format, an Audio Video Interleaved format (AVI), a streaming media format (Flash Video, FLV) format, or the like.
In the embodiment of the disclosure, when a screen recording instruction for a display interface of an electronic device is detected, first audio data can be obtained from a target application program currently performing audio playing through an internal interface of the electronic device while picture data of the display interface is obtained, and second audio data in a space where the electronic device is currently located is collected through an audio collection module of the electronic device. That is to say, in the first aspect, in the process of recording the display interface of the electronic device, the internal audio (i.e., the first audio data in the target application) and the external sound (i.e., the second audio data in the space where the electronic device is currently located) of the electronic device may be recorded simultaneously, so that the screen recording performance of the electronic device may be improved, thereby meeting the screen recording requirements in various scenes. In a second aspect, the sound quality of the first audio data obtained from the target program through the internal interface of the electronic device is better, and the noise is smaller; therefore, the target audio data synthesized by the first audio data and the second audio data can have better sound quality and lower noise; thereby enhancing the screen recording effect of the electronic equipment
In some embodiments, in step 120, obtaining, through the internal interface of the electronic device, first audio data of a target application from a target application currently performing audio playing includes:
executing an audio output thread of the target application program, and transmitting the first audio data to a hardware abstraction layer through the internal interface;
in step 140, the synthesizing the first audio data and the second audio data to obtain target audio data includes:
transmitting second audio data acquired by the audio acquisition module to the hardware abstraction layer;
and synthesizing the first audio data and the second audio data through an audio processing module of the hardware abstraction layer to obtain the target audio data.
In some embodiments, the screen recording method provided by the present disclosure may be applied to an Android system, and when the screen recording method is applied to the Android system, an Audio output thread of a target application may be executed, and the first Audio data is transmitted to the hardware abstraction layer through an internal interface of the electronic device and an Audio Track.
Here, the Audio Track may be used for transmission of Audio data. It can be understood that the Android system architecture includes an application layer, an application framework layer, a system runtime layer, a hardware abstraction layer, and a Linux kernel layer, where the hardware abstraction layer is located between the system runtime layer and the Linux kernel layer, and is intended to abstract hardware, and hide hardware interface details of a specific platform, so as to provide a virtual hardware platform for an operating system, so that the operating system has hardware independence and can be transplanted on various platforms.
It is understood that the hardware abstraction layer may be located between the application program and the hardware functional module in the electronic device, for example, the hardware abstraction layer may be located between the target application program and the audio output module, so that after the first audio data is transmitted to the hardware abstraction layer, the first audio data may be transmitted to the audio output module of the electronic device through the hardware abstraction layer for audio output.
For example, the hardware abstraction layer may be located between the target application and the audio capture module, such that the audio capture module may be transmitted to the hardware abstraction layer and through the hardware abstraction layer to the target application.
In the embodiment of the disclosure, after the first audio data and the second audio data are transmitted to the hardware abstraction layer, the first audio data and the second audio data may be synthesized by the audio processing module of the hardware abstraction layer to obtain the target audio data.
It should be noted that, in the embodiment of the present disclosure, in a case where the first audio data is transmitted to the hardware abstraction layer through the internal interface of the electronic device, the first audio data and the second audio data may be synthesized in the hardware abstraction layer, that is, the first audio data is audio data that is not output to the outside of the electronic device through the audio output module (e.g., a speaker).
Here, the audio processing module of the hardware abstraction layer may be configured to perform audio processing on the received audio data, for example, audio synthesis processing, audio parameter extraction processing, and the like.
As described in the above embodiments, in comparison with the method, after the audio is output through the speaker of the electronic device, the audio data is collected through the microphone; the first audio data obtained from the target application program currently playing the audio through the internal interface of the electronic equipment has better tone quality and smaller noise. That is, the first audio data transmitted by the target application program to the hardware abstraction layer through the internal interface has better sound quality and less noise. Therefore, the audio manager in the hardware abstraction layer synthesizes the first audio data and the second audio data, and the obtained target audio data has better tone quality and smaller noise.
In some embodiments, the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
performing format conversion on the first audio data through the audio processing module to obtain first audio data in a target format;
carrying out format conversion on the second audio data to obtain second audio data in the target format;
determining a first time stamp of each first audio unit in the first audio data in the target format and a second time stamp of each second audio unit in the second audio data in the target format;
and combining the first audio unit and the second audio unit according to the first time stamp and the second time stamp to obtain the target audio data.
It can be understood that, because the requirements of each functional module or each component in the functional module in the electronic device on the data format are different, the data format of the audio data may be changed during the transmission of the audio data in the electronic device, and the data formats of the audio data in different functional modules or different components of the same functional module may be different. For example, the data format of the first audio data transmitted by the target application program to the hardware abstraction layer through the internal interface may be different from the data format of the second audio data transmitted by the audio acquisition module to the hardware abstraction layer.
Therefore, in order to facilitate the synthesis processing of the first audio data and the second audio data, the formats of the first audio data and the second audio data may be unified, the first audio data and the second audio data are both converted into the target format, and then the first audio data in the target format and the second audio data in the target format are synthesized.
Here, the target format may include a text format or a binary value format, etc. For example, the first audio data transmitted to the hardware abstraction layer through the internal interface of the electronic device is in a text format, and the second audio data transmitted to the hardware abstraction layer through the audio acquisition module is in a binary numerical format; the audio processing module of the hardware abstraction layer may convert both the received first audio data and the second audio data into a binary numerical format.
It is to be understood that the audio data may include at least one audio unit and a time stamp of each audio unit, and in the process of synthesizing the first audio data in the standard format and the second audio data in the standard format, each first audio unit and each second audio unit in the second audio data may be combined according to the first time stamp of each first audio unit in the first audio data and the second time stamp of each second audio unit in the second audio data to obtain the target audio data.
Here, the respective audio units may be arranged and combined in chronological order of the respective time stamps, the audio unit with an earlier time stamp may be arranged at a position earlier, and the audio unit with a later time stamp may be arranged at a position later.
In this way, by converting the first audio data and the second audio data into the target format, the efficiency of the synthesis processing of the first audio data and the second audio data can be made higher, and the error is smaller. The first audio unit and the second audio unit are combined according to the first time stamp and the second time stamp, so that the audio sequence of the target audio data obtained by combination corresponds to the audio sequence in the first audio data and the second audio data, and the first audio data and the second audio data can be fused together.
In some embodiments, the executing the audio output thread of the target application to transmit the first audio data to a hardware abstraction layer through the internal interface includes:
executing an audio output thread of the target application program, and transmitting the first audio data to an audio manager of the electronic equipment through the internal interface;
the audio manager carries out noise reduction processing on the first audio data and transmits the first audio data subjected to the noise reduction processing to the hardware abstraction layer;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the second audio data and the first audio data subjected to noise reduction processing through the audio processing module to obtain the target audio data.
The audio manager can be located between the target application program and the hardware abstraction layer, first audio data of the target application program can be transmitted to the audio manager firstly, the first audio data is subjected to noise reduction, sound mixing and other processing through the audio manager, then the first audio data subjected to noise reduction, sound mixing and other processing is transmitted to the hardware abstraction layer, and then the first audio data and second audio data from the audio acquisition module are subjected to synthesis processing through an audio processing module of the hardware abstraction layer.
It can be understood that the sound quality of the audio data can be better by performing the noise reduction processing on the audio data; the audio data is subjected to sound mixing processing, so that the music effect of the audio data is better.
Under the condition that the screen recording method provided by the embodiment of the disclosure is applied to an Android system, the Audio manager can be an Audio flag.
Therefore, after the noise reduction processing is carried out on the first audio data through the audio manager, the tone quality of the first audio data can be improved, and the tone quality of target audio data obtained by synthesizing the second audio data and the first audio data after the noise reduction processing through the audio processing module is better.
In some embodiments, the method further comprises:
after receiving the first audio data, a data receiving module of the hardware abstraction layer copies the first audio data to obtain a first audio copy;
the data receiving module copies the received second audio data to obtain a second audio copy;
the data receiving module transmits the first audio copy and the second audio copy to the audio processing module;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the first audio copy and the second audio copy through the audio processing module to obtain the target audio data.
The hardware abstraction layer can include a data receiving module and an audio processing module, the data receiving module can be used for receiving first audio data from a target application program and second audio data from an audio acquisition module, the data receiving module can transmit the received first audio data and the received second audio data to the audio processing module after receiving the first audio data and the received second audio data, and the audio processing module can synthesize the received first audio data and the received second audio data to obtain the target audio data.
In some embodiments, after receiving the first audio data and the second audio data, the data receiving module may copy the first audio data and the second audio data to obtain a first audio copy of the first audio data and a second audio copy of the second audio data, and the audio processing module may perform synthesis processing on the first audio copy and the second audio copy to obtain the target audio data.
Here, the first audio copy may be identical to the first audio data, and the second audio copy may be identical to the second audio data.
It is understood that, after being transmitted to the hardware abstraction layer, the first audio data and the second audio data may be transmitted to other functional modules through the hardware abstraction layer to be processed accordingly; for example, the first audio data may be transmitted to the audio output module for audio output, and for example, the second audio data may be transmitted to the communication module for communication with other electronic devices.
Therefore, the data receiving module is used for copying the first audio data and the second audio data to obtain a first audio copy and a second audio copy, and then the audio processing module is used for synthesizing the first audio copy and the second audio copy, so that the target audio data can be obtained under the condition that the hardware abstraction layer is not influenced to transmit the first audio data and the second audio data to other functional modules. That is to say, the screen recording function of the electronic equipment can be realized, and other functions of the electronic equipment are not influenced.
In some embodiments, the method further comprises:
the data receiving module transmits the first audio data to an audio output module of the electronic equipment, and the first audio data is output through the audio output module;
the data receiving module transmits the second audio data to the target application program.
In this embodiment, after the data receiving module transmits the first audio data to the audio output module, the audio output module may output the first audio data, for example, output the first audio data through an earphone or output the first audio data through a speaker, so as to implement a music playing function of the target application program. Meanwhile, after the data receiving module transmits the second audio data to the target application program, the second audio data can be processed through a preset function in the target application program, for example, the second audio data is clipped; the second audio data can also be stored in a storage space corresponding to the target application program.
Therefore, the screen recording function of the electronic equipment can be realized, the music playing function of the target application program can be realized, and the second audio data can be transmitted to the target application program for subsequent processing.
In some embodiments, in step 150, generating a screen recording file based on the picture data and the target audio data includes:
executing a data acquisition thread in an audio manager, and acquiring the target audio data from an audio processing module of the hardware abstraction layer;
transmitting the target audio data to a screen recording application program through a preset channel;
and the screen recording application program generates the screen recording file based on the picture data and the target audio data.
As described in the foregoing embodiment, the audio manager may be located between the application program and the hardware abstraction layer, and therefore, after the audio processing module of the hardware abstraction layer performs synthesis processing on the first audio data and the second audio data to obtain the target audio data, the data obtaining thread in the audio manager may be executed to obtain the target audio data from the audio processing module of the hardware abstraction layer, and transmit the obtained target audio data to the screen recording application program through the preset channel. Here, the data acquisition thread may be created when a screen recording instruction is detected, and the preset channel may be located after the audio manager and the screen recording application for data transmission.
The screen recording application program can perform audio and video synchronization processing on the acquired picture data and the target audio data so as to generate a screen recording file.
Therefore, the target audio data in the hardware abstraction layer can be transmitted to the screen recording application program through the audio manager and the preset channel, so that the screen recording application program can generate a screen recording file based on the target audio data and the picture data, and a data transmission channel between the screen recording application program and the hardware abstraction layer does not need to be additionally established.
Fig. 2 is a flowchart ii illustrating a screen recording method according to an exemplary embodiment of the present disclosure, and fig. 3 is a schematic view illustrating a principle of the screen recording method according to an exemplary embodiment of the present disclosure. As shown in fig. 2 to 3, the screen recording method provided by the embodiment of the present disclosure includes the following steps:
step 201, in the case that a screen recording instruction for a display interface of an electronic device is detected, acquiring picture data of the display interface.
It should be noted that the screen recording method provided by the present disclosure may be applied to an electronic device, where the electronic device may include: a terminal device, for example a mobile terminal or a fixed terminal. Wherein, the mobile terminal can include: mobile phones, tablet computers, notebook computers and the like. The fixed terminal may include: desktop computers or smart televisions, etc.
The user can trigger a screen recording instruction of the electronic equipment by selecting the function option of 'inner recording + outer recording' in the electronic equipment.
Here, the display interface may be an interface currently displayed by the electronic device, for example, the display interface may be an interface where a desktop of the electronic device is located, or may be an interface inside an application running in the electronic device.
Step 202, executing the audio output thread of the target application program, and transmitting the first audio data to the audio manager of the electronic device through the internal interface.
Here, the target application may be an application that is playing audio in the electronic device, and the internal interface may be an interface through which the target application outputs audio to other functional modules of the electronic device.
As shown in fig. 3, the screen recording method provided by the present disclosure may be applied to an Android system, and when the screen recording method is applied to the Android system, an Audio output thread of a target application may be executed, and the first Audio data is transmitted to the Audio manager 330 through an internal interface of the electronic device and an Audio Track (Audio Track) 311.
In step 203, the audio manager performs noise reduction processing on the first audio data, and transmits the first audio data subjected to noise reduction processing to the data receiving module of the hardware abstraction layer.
As shown in fig. 3, in some embodiments, the audio receiving module may include an audio write interface (voip _ write) 341 and an audio read interface (voip _ read) 342, where the audio manager 330 may transfer the first audio data to the audio write interface (voip _ write) 341 of the hardware abstraction layer 340 after denoising the first audio data.
And step 204, transmitting the second audio data acquired by the audio acquisition module to a data receiving module of the hardware abstraction layer.
In some embodiments, the audio capture module 380 may transmit the captured second audio data to the codec 360 for encoding, and then transmit the encoded second audio data to the audio digital signal processor 350 for data processing, where the analog signal type second audio data may be converted into digital signal type second audio data through the codec 360 and the audio digital signal processor 350, and then the digital signal type second audio data may be transmitted to the audio read interface (voip _ read) 342 of the hardware abstraction layer 340.
Step 205, the data receiving module copies the received first audio data to obtain a first audio copy, copies the received second audio data to obtain a second audio copy, transmits the first audio data to an audio output module of the electronic device, and transmits the second audio data to the target application program.
In some embodiments, the audio write interface (voip _ write) 341 may copy the received first audio data to obtain a first audio copy, transmit the first audio data to the audio digital signal processor 350, then transmit the first audio data to the codec 360 via the audio digital signal processor 350, and transmit the first audio data to the audio output module 370 of the electronic device via the codec 360; the Audio read interface (voip _ read) 342 may copy the received second Audio data to obtain a second Audio copy, and transmit the second Audio data to the Audio manager 330, and to the Audio recording instance 1 (Audio Record 1) 312 of the target application 310 via the Audio manager 330.
And step 206, synthesizing the first audio copy and the second audio copy through an audio processing module of the hardware abstraction layer to obtain target audio data.
In some embodiments, the audio processing module may be a buffer space for audio synthesis, such as the buffer space (buffer) 343, the audio write interface (voip _ write) 341 and the audio read interface (voip _ read) 342 in fig. 3, and may store the audio units in the first audio copy and the second audio copy into the buffer space (buffer) 343 according to a time sequence, so that the target audio data may be obtained, that is, the data stored in the buffer space (buffer) 343 is the target audio data.
And step 207, executing a data acquisition thread in the audio manager, acquiring target audio data from the audio processing module, and transmitting the target audio data to the screen recording application program through a preset channel.
In some embodiments, the data acquisition Thread may be the data acquisition Thread (Record Thread) 331 shown in fig. 3, the data acquisition Thread (Record Thread) 331 may be created in case of detecting a screen recording instruction, and the preset channel may be a mono channel (monapipe) 332. In this embodiment, the data obtaining Thread (Record Thread) 331 may obtain the target Audio data from the buffer space (buffer) 343 and transmit the target Audio data to the Audio recording instance 2 (Audio Record 2) 321 of the screen recording application 320 through a mono channel (monapipe) 332.
In step 208, the screen recording application generates a screen recording file based on the picture data and the target audio data.
Fig. 4 is a schematic diagram illustrating a screen recording method according to an exemplary embodiment of the present disclosure. In fig. 4, the user 410 may be an action or instruction for the user to trigger a function of the electronic device, for example, the user plays the first audio data through the target application; for example, the user records the second audio data of the space where the electronic device is located through the screen recording application. In the case that a user plays first audio data through a target application and records second audio data through a screen recording application, the first audio data transmitted to the hardware abstraction layer 420 by the target application and the second audio data transmitted to the hardware abstraction layer 420 by the audio acquisition module (e.g., a microphone) 450 and the audio digital signal processor 430 may be copied to obtain a first audio copy and a second audio copy, and then the first audio copy and the second audio copy are synthesized to obtain target audio data (i.e., audio data corresponding to in-recording and out-recording), and at the same time, the first audio data is output through the audio digital signal processor 430 and the audio output module (e.g., a speaker) 440, and the second audio data is transmitted to the screen recording application.
The embodiment of the disclosure can simultaneously realize the internal recording of the internal audio (namely, the first audio data) of the electronic equipment and the external recording of the external sound (namely, the second audio data) of the electronic equipment. Under the condition that a user performs a behavior A (namely, playing first audio data) and a behavior B (namely, recording second audio data), the first audio data and the second audio data of the hardware abstraction layer are synthesized through the hardware abstraction layer to obtain target audio data, the target audio data are output to the audio manager 460, and the target audio data are transmitted to the screen recording application program through the audio manager 460, so that the screen recording function of internal recording and external recording is realized.
Fig. 5 is a block diagram illustrating a structure of a screen recording apparatus according to an exemplary embodiment of the present disclosure. The disclosure provides a screen recording device applied to electronic equipment. As shown in fig. 5, the screen recording apparatus 500 mainly includes:
the acquiring module 501 is configured to acquire picture data of a display interface of the electronic device when a screen recording instruction for the display interface is detected;
a first processing module 502, configured to obtain first audio data of a target application program from a target application program currently performing audio playing through an internal interface of the electronic device;
the acquisition module 503 is configured to acquire, through an audio acquisition module of the electronic device, second audio data in a space where the electronic device is currently located;
a synthesizing module 504 configured to synthesize the first audio data and the second audio data to obtain target audio data;
and a second processing module 505 configured to generate a screen recording file based on the picture data and the target audio data.
In some embodiments, the first processing module 502 is configured to execute an audio output thread of the target application to transmit the first audio data to a hardware abstraction layer through the internal interface;
the synthesis module 504 is configured to:
transmitting second audio data acquired by the audio acquisition module to the hardware abstraction layer;
and synthesizing the first audio data and the second audio data through an audio processing module of the hardware abstraction layer to obtain the target audio data.
In some embodiments, the synthesis module 504 is configured to:
performing format conversion on the first audio data through the audio processing module to obtain first audio data in a target format;
carrying out format conversion on the second audio data to obtain second audio data in the target format;
determining a first time stamp of each first audio unit in the first audio data in the target format and a second time stamp of each second audio unit in the second audio data in the target format;
and combining the first audio unit and the second audio unit according to the first time stamp and the second time stamp to obtain the target audio data.
In some embodiments, the first processing module 502 is configured to:
executing an audio output thread of the target application program, and transmitting the first audio data to an audio manager of the electronic equipment through the internal interface;
performing noise reduction processing on the first audio data through the audio manager, and transmitting the first audio data subjected to the noise reduction processing to the hardware abstraction layer;
the synthesis module 504 is configured to: and synthesizing the second audio data and the first audio data subjected to noise reduction processing through the audio processing module to obtain the target audio data.
In some embodiments, the apparatus further comprises a replication module configured to:
copying the first audio data after the first audio data is received through a data receiving module of the hardware abstraction layer to obtain a first audio copy;
copying the received second audio data through the data receiving module to obtain a second audio copy;
transmitting, by the data receiving module, the first audio copy and the second audio copy to the audio processing module;
the synthesizing module 504 is configured to perform synthesizing processing on the first audio copy and the second audio copy through the audio processing module to obtain the target audio data.
In some embodiments, the apparatus further comprises a third processing module configured to:
the first audio data are transmitted to an audio output module of the electronic equipment through the data receiving module and are output through the audio output module;
and transmitting the second audio data to the target application program through the data receiving module.
In some embodiments, the second processing module 505 is configured to:
executing a data acquisition thread in an audio manager, and acquiring the target audio data from an audio processing module of the hardware abstraction layer;
and transmitting the target audio data to a screen recording application program through a preset channel.
Fig. 6 is a first block diagram illustrating a hardware structure of an electronic device according to an exemplary embodiment of the present disclosure. For example, the electronic device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 6, electronic device 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.
The processing component 702 generally controls overall operation of the electronic device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operations at the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 706 provides power to the various components of the electronic device 700. The power components 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 700.
The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the electronic device 700 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.
The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 may detect an open/closed state of the electronic device 700, the relative positioning of components, such as a display and keypad of the electronic device 700, the sensor assembly 714 may also detect a change in the position of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, orientation or acceleration/deceleration of the electronic device 700, and a change in the temperature of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate communications between the electronic device 700 and other devices in a wired or wireless manner. The electronic device 700 may access a wireless network based on a communication standard, such as WI-FI,4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the electronic device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform a screen recording method, comprising:
under the condition that a screen recording instruction for a display interface of the electronic equipment is detected, acquiring picture data of the display interface;
obtaining first audio data of a target application program from the target application program which is currently played in an audio mode through an internal interface of the electronic equipment;
acquiring second audio data in the space where the electronic equipment is located currently through an audio acquisition module of the electronic equipment;
synthesizing the first audio data and the second audio data to obtain target audio data;
and generating a screen recording file based on the picture data and the target audio data.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

1. A screen recording method is applied to electronic equipment, and the method comprises the following steps:
under the condition that a screen recording instruction for a display interface of the electronic equipment is detected, acquiring picture data of the display interface;
obtaining first audio data of a target application program from the target application program which is currently played in an audio mode through an internal interface of the electronic equipment;
acquiring second audio data in the space where the electronic equipment is located currently through an audio acquisition module of the electronic equipment;
synthesizing the first audio data and the second audio data to obtain target audio data;
and generating a screen recording file based on the picture data and the target audio data.
2. The method according to claim 1, wherein obtaining the first audio data of the target application from a target application currently performing audio playing through an internal interface of the electronic device comprises:
executing an audio output thread of the target application program, and transmitting the first audio data to a hardware abstraction layer through the internal interface;
the synthesizing the first audio data and the second audio data to obtain target audio data includes:
transmitting second audio data acquired by the audio acquisition module to the hardware abstraction layer;
and synthesizing the first audio data and the second audio data through an audio processing module of the hardware abstraction layer to obtain the target audio data.
3. The method according to claim 2, wherein the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data comprises:
carrying out format conversion on the first audio data through the audio processing module to obtain first audio data in a target format;
carrying out format conversion on the second audio data to obtain second audio data in the target format;
determining a first time stamp of each first audio unit in the first audio data in the target format and a second time stamp of each second audio unit in the second audio data in the target format;
and combining the first audio unit and the second audio unit according to the first time stamp and the second time stamp to obtain the target audio data.
4. The method of claim 2, wherein the executing the audio output thread of the target application to transfer the first audio data to a hardware abstraction layer through the internal interface comprises:
executing an audio output thread of the target application program, and transmitting the first audio data to an audio manager of the electronic equipment through the internal interface;
the audio manager carries out noise reduction processing on the first audio data and transmits the first audio data subjected to the noise reduction processing to the hardware abstraction layer;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the second audio data and the first audio data subjected to noise reduction processing through the audio processing module to obtain the target audio data.
5. The method of claim 2, further comprising:
after receiving the first audio data, a data receiving module of the hardware abstraction layer copies the first audio data to obtain a first audio copy;
the data receiving module copies the received second audio data to obtain a second audio copy;
the data receiving module transmits the first audio copy and the second audio copy to the audio processing module;
the synthesizing, by the audio processing module of the hardware abstraction layer, the first audio data and the second audio data to obtain the target audio data includes:
and synthesizing the first audio copy and the second audio copy through the audio processing module to obtain the target audio data.
6. The method of claim 5, further comprising:
the data receiving module transmits the first audio data to an audio output module of the electronic equipment, and the first audio data is output through the audio output module;
the data receiving module transmits the second audio data to the target application program.
7. The method of claim 2, wherein generating a screen recording file based on the picture data and the target audio data comprises:
executing a data acquisition thread in an audio manager, and acquiring the target audio data from an audio processing module of the hardware abstraction layer;
transmitting the target audio data to a screen recording application program through a preset channel;
and the screen recording application program generates the screen recording file based on the picture data and the target audio data.
8. A screen recording device, applied to an electronic device, the device comprising:
the acquisition module is configured to acquire picture data of a display interface of the electronic equipment under the condition that a screen recording instruction for the display interface is detected;
the first processing module is configured to obtain first audio data of a target application program from the target application program currently performing audio playing through an internal interface of the electronic device;
the acquisition module is configured to acquire second audio data in the space where the electronic equipment is located through an audio acquisition module of the electronic equipment;
the synthesis module is configured to synthesize the first audio data and the second audio data to obtain target audio data;
and the second processing module is configured to generate a screen recording file based on the picture data and the target audio data.
9. An electronic device, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to: when executed, implement the steps in the screen recording method of any of the preceding claims 1 to 7.
10. A non-transitory computer readable storage medium having instructions thereon, which when executed by a processor of an electronic device, enable the electronic device to perform the steps of the screen recording method of any one of the above claims 1 to 7.
CN202211013897.2A 2022-08-23 2022-08-23 Screen recording method, device, equipment and storage medium Pending CN115396723A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211013897.2A CN115396723A (en) 2022-08-23 2022-08-23 Screen recording method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211013897.2A CN115396723A (en) 2022-08-23 2022-08-23 Screen recording method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115396723A true CN115396723A (en) 2022-11-25

Family

ID=84120735

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211013897.2A Pending CN115396723A (en) 2022-08-23 2022-08-23 Screen recording method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115396723A (en)

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102348097A (en) * 2010-08-02 2012-02-08 杭州华三通信技术有限公司 Session method and multi-point control unit for video conference
CN106101767A (en) * 2016-07-28 2016-11-09 维沃移动通信有限公司 A kind of screen recording method and mobile terminal
CN206117996U (en) * 2016-09-23 2017-04-19 深圳市冠旭电子股份有限公司 Noise -reduction controling circuit based on binary channels microphone
CN106843683A (en) * 2017-01-03 2017-06-13 奇酷互联网络科技（深圳）有限公司 Record screen method, device and terminal device
CN107864263A (en) * 2017-10-30 2018-03-30 青岛海信移动通信技术股份有限公司 The method for recording and device of application layer voice data
CN110166723A (en) * 2019-04-02 2019-08-23 广州虎牙信息科技有限公司 It is a kind of to record the audio and video synchronization method in shielding, electronic equipment, storage medium
CN110277102A (en) * 2019-04-30 2019-09-24 晶晨半导体(上海)股份有限公司 A kind of the echo cancellation system and echo removing method of multichannel audio mixing
CN111381954A (en) * 2018-12-27 2020-07-07 深圳市优必选科技有限公司 Audio data recording method, system and terminal equipment
CN111625214A (en) * 2020-05-22 2020-09-04 广州视源电子科技股份有限公司 Audio control method, device, equipment and storage medium
CN111833892A (en) * 2019-04-22 2020-10-27 浙江宇视科技有限公司 Audio and video data processing method and device
CN111901654A (en) * 2020-08-04 2020-11-06 海信视像科技股份有限公司 Display device and screen recording method
CN112383860A (en) * 2020-12-03 2021-02-19 无锡中感微电子股份有限公司 Active noise reduction system, self-adaptive calibration analog filter circuit and earphone
CN113079332A (en) * 2021-03-16 2021-07-06 青岛海信移动通信技术股份有限公司 Mobile terminal and screen recording method thereof
CN113259762A (en) * 2021-04-07 2021-08-13 广州虎牙科技有限公司 Audio processing method and device, electronic equipment and computer readable storage medium
CN113286161A (en) * 2021-05-19 2021-08-20 广州虎牙科技有限公司 Live broadcast method, device, equipment and storage medium
WO2021163879A1 (en) * 2020-02-18 2021-08-26 深圳市欢太科技有限公司 Screen recording method and apparatus, and computer-readable storage medium

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102348097A (en) * 2010-08-02 2012-02-08 杭州华三通信技术有限公司 Session method and multi-point control unit for video conference
CN106101767A (en) * 2016-07-28 2016-11-09 维沃移动通信有限公司 A kind of screen recording method and mobile terminal
CN206117996U (en) * 2016-09-23 2017-04-19 深圳市冠旭电子股份有限公司 Noise -reduction controling circuit based on binary channels microphone
CN106843683A (en) * 2017-01-03 2017-06-13 奇酷互联网络科技（深圳）有限公司 Record screen method, device and terminal device
CN107864263A (en) * 2017-10-30 2018-03-30 青岛海信移动通信技术股份有限公司 The method for recording and device of application layer voice data
CN111381954A (en) * 2018-12-27 2020-07-07 深圳市优必选科技有限公司 Audio data recording method, system and terminal equipment
CN110166723A (en) * 2019-04-02 2019-08-23 广州虎牙信息科技有限公司 It is a kind of to record the audio and video synchronization method in shielding, electronic equipment, storage medium
CN111833892A (en) * 2019-04-22 2020-10-27 浙江宇视科技有限公司 Audio and video data processing method and device
CN110277102A (en) * 2019-04-30 2019-09-24 晶晨半导体(上海)股份有限公司 A kind of the echo cancellation system and echo removing method of multichannel audio mixing
WO2021163879A1 (en) * 2020-02-18 2021-08-26 深圳市欢太科技有限公司 Screen recording method and apparatus, and computer-readable storage medium
CN111625214A (en) * 2020-05-22 2020-09-04 广州视源电子科技股份有限公司 Audio control method, device, equipment and storage medium
CN111901654A (en) * 2020-08-04 2020-11-06 海信视像科技股份有限公司 Display device and screen recording method
CN112383860A (en) * 2020-12-03 2021-02-19 无锡中感微电子股份有限公司 Active noise reduction system, self-adaptive calibration analog filter circuit and earphone
CN113079332A (en) * 2021-03-16 2021-07-06 青岛海信移动通信技术股份有限公司 Mobile terminal and screen recording method thereof
CN113259762A (en) * 2021-04-07 2021-08-13 广州虎牙科技有限公司 Audio processing method and device, electronic equipment and computer readable storage medium
CN113286161A (en) * 2021-05-19 2021-08-20 广州虎牙科技有限公司 Live broadcast method, device, equipment and storage medium

Similar Documents

Publication Publication Date Title
US20170304735A1 (en) Method and Apparatus for Performing Live Broadcast on Game
CN106911961B (en) Multimedia data playing method and device
JP6121621B2 (en) Voice call method, apparatus, program, and recording medium
CN105845124B (en) Audio processing method and device
CN110602394A (en) Video shooting method and device and electronic equipment
CN106911967B (en) Live broadcast playback method and device
CN104391711B (en) A kind of method and device that screen protection is set
US20160373801A1 (en) Method and device for playing multimedia file
EP3163887A1 (en) Method and apparatus for performing media synchronization
CN111583952B (en) Audio processing method, device, electronic equipment and storage medium
US20220248083A1 (en) Method and apparatus for video playing
CN105120337A (en) Video special effect processing method, video special effect processing device and terminal equipment
CN109413478A (en) Video editing method, device, electronic equipment and storage medium
CN115273831A (en) Voice conversion model training method, voice conversion method and device
CN106375846B (en) The processing method and processing device of live audio
CN106060707B (en) Reverberation processing method and device
JP2023544561A (en) Message display method and electronic device
US11561278B2 (en) Method and device for processing information based on radar waves, terminal, and storage medium
CN105245898B (en) Image data recording method and device
CN112087653A (en) Data processing method and device and electronic equipment
CN110267096A (en) Video broadcasting method, device, electronic equipment and storage medium
CN115396723A (en) Screen recording method, device, equipment and storage medium
CN117873367A (en) Split screen display method and related device
CN117813652A (en) Audio signal encoding method, device, electronic equipment and storage medium
CN107395724A (en) Network request method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination