CN114173150A - Live video recording method, device and system and terminal equipment - Google Patents
Live video recording method, device and system and terminal equipment Download PDFInfo
- Publication number
- CN114173150A CN114173150A CN202111583166.7A CN202111583166A CN114173150A CN 114173150 A CN114173150 A CN 114173150A CN 202111583166 A CN202111583166 A CN 202111583166A CN 114173150 A CN114173150 A CN 114173150A
- Authority
- CN
- China
- Prior art keywords
- video
- data
- audio
- compressed data
- live
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 8
- 238000012545 processing Methods 0.000 claims abstract description 7
- 230000015654 memory Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 14
- 230000001360 synchronised effect Effects 0.000 claims description 7
- 238000000926 separation method Methods 0.000 claims description 5
- 238000004806 packaging method and process Methods 0.000 claims 1
- 230000006835 compression Effects 0.000 description 18
- 238000007906 compression Methods 0.000 description 18
- 238000005538 encapsulation Methods 0.000 description 9
- 230000000694 effects Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 230000011664 signaling Effects 0.000 description 3
- 239000000835 fiber Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000012856 packing Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
- H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4334—Recording operations
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
A live video recording method, device, system and terminal equipment are provided, the method comprises: copying original video compressed data and decoded audio data obtained by processing live streaming data, and encoding the copied decoded audio data into audio compressed data in a specified format capable of being synthesized with the video compressed data; and synthesizing the copied original video compressed data and the audio compressed data in the specified format into a video file. The embodiment of the disclosure also provides a device, a system and a terminal device for realizing the method, which can realize high-definition recording and storage of the live video and have universality.
Description
Technical Field
The present disclosure relates to, but not limited to, video technologies, and in particular, to a live video recording method, apparatus, system, and terminal device.
Background
The video integrates rich elements such as images, characters, sounds and the like, and gradually becomes a mainstream expression mode of the internet. The video live broadcast utilizes the internet and streaming media technology, when the user equipment sends a live broadcast request, the server sends the broadcast address of the requested live broadcast channel to the user equipment, and the user equipment joins the corresponding multicast group according to the broadcast address, namely, the live broadcast stream data can be received and played.
When watching a live broadcast, a user sometimes wants to record an interesting video to be watched at any time. Many live broadcasts are realized by a built-in player of a browser, and online recording can be realized by a screen recording function of the browser or special screen recording software. However, the video file obtained by screen recording has loss of definition, and cannot meet the requirement of the user on the video quality.
Disclosure of Invention
The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.
The embodiment of the disclosure provides a live video recording method, which comprises the following recording processes:
copying original video compressed data and decoded audio data obtained by processing live streaming data, and encoding the copied decoded audio data into audio compressed data with a specified format;
and synthesizing the copied original video compressed data and the audio compressed data in the specified format into a video file.
The embodiment of the present disclosure further provides a live video recording system, including a live stream player and a video recorder, wherein:
the live stream player is set to extract original video compressed data and original audio compressed data from live stream data, and the original video compressed data and the original audio compressed data are respectively decoded to obtain decoded video data and decoded audio data and then are synchronously played;
the video recorder is configured to copy the original video compressed data and decoded audio data and encode the decoded audio data into audio compressed data of a specified format; and synthesizing the original video compressed data and the audio compressed data in the specified format into a video file.
The embodiment of the disclosure further provides a live video recording device, which includes a memory and a processor, where the memory stores a computer program, and the processor can implement the live video recording method according to any embodiment of the disclosure when executing the computer program.
The embodiment of the disclosure further provides a terminal device, which includes a processor, and a memory, a display device, an audio device, an input device and a network interface, which are connected to the processor through a bus, wherein a live stream receiving program, a live stream playing program and a live video recording program are stored in the memory, and when the processor executes the live stream receiving program, the processor can receive live stream data through the network interface; when the live stream playing program is executed, the live stream data can be processed and played through the display equipment and the audio equipment; when the live video recording program is executed, the live video recording method according to any embodiment of the disclosure can be realized according to the instruction of the input device.
An embodiment of the present disclosure further provides a non-transitory computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the live video recording method according to any embodiment of the present disclosure is implemented.
According to the embodiment of the disclosure, high-definition recording and storage can be performed on live videos, the loss of definition is avoided, and the video effect of far-beyond screen recording is achieved. Furthermore, the above embodiments of the present disclosure have universality, and can be applied to live streaming data in various formats.
Other aspects will be apparent upon reading and understanding the attached drawings and detailed description.
Drawings
The accompanying drawings are included to provide an understanding of the embodiments of the disclosure, and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the embodiments of the disclosure serve to explain the principles of the disclosure and not to limit the disclosure.
Fig. 1 is a flowchart of a live video recording method according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a live video recording system according to an embodiment of the present disclosure;
fig. 3 is a block diagram of a live video recording system according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of a live video recording apparatus according to an embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a terminal device according to an embodiment of the present disclosure.
Detailed Description
The present disclosure describes embodiments, but the description is illustrative rather than limiting and it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the embodiments described in the present disclosure.
Throughout the description of the present disclosure, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or illustrations. Any embodiment described in this disclosure as "exemplary" or "e.g.," should not be construed as preferred or advantageous over other embodiments. "and/or" herein is a description of an association relationship for an associated object, meaning that there may be three relationships, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone. "plurality" means two or more than two. In addition, for the convenience of clearly describing the technical solutions of the embodiments of the present disclosure, the words "first", "second", and the like are used to distinguish the same items or similar items having substantially the same functions and actions. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
In describing representative exemplary embodiments, the specification may have presented the method and/or process as a particular sequence of steps. However, to the extent that the method or process does not rely on the particular order of steps set forth herein, the method or process should not be limited to the particular sequence of steps described. Other orders of steps are possible as will be understood by those of ordinary skill in the art. Therefore, the particular order of the steps set forth in the specification should not be construed as limitations on the claims. Further, the claims directed to the method and/or process should not be limited to the performance of their steps in the order written, and one skilled in the art can readily appreciate that the sequences may be varied and still remain within the spirit and scope of the embodiments of the present disclosure.
Therefore, an embodiment of the present disclosure provides a live video recording method, including:
and step 120, synthesizing the copied original video compressed data and the audio compressed data in the specified format into a video file.
In the video file recorded by the live video recording method of the embodiment of the disclosure, the video compression data is the original video compression data (called original video compression data) in the live stream data, and the audio compression data is obtained by transcoding the original audio compression data (called original audio compression data) in the live stream data, so that high-definition recording of live video can be realized, loss of definition is avoided, and a video effect of far-super-screen recording can be obtained.
According to the live video recording method, original audio compressed data in live data is decoded first to obtain decoded audio data and then is encoded into audio compressed data in a specified format, and the audio compressed data in the specified format and the video compressed data can be synthesized into a video file. Therefore, the embodiment of the disclosure has universality and can be suitable for recording live videos in various formats.
In an exemplary embodiment of the present disclosure, the original video compression data is obtained by decapsulating the received live streaming data. The decoded audio data is obtained by: and decapsulating the received live streaming data to obtain original audio compressed data, and then decoding the original audio compressed data to obtain the decoded audio data.
Decapsulation is the separation of input data in encapsulated format into audio stream compression encoded data (referred to simply as audio compressed data) and video stream compression encoded data (referred to simply as video compressed data). The type of the packing format may be mp4, MKV, RMVB, TS, FLV, AVI, etc., for example, and the packing is to put the compressed and encoded video data and audio data together according to a certain format.
Decoding is decoding of video compressed data into uncompressed video data, i.e., decoded video data), and decoding of audio compressed data into uncompressed audio data, i.e., decoded audio data. The compression coding standards for audio include g711, g726, aac, MP3, AC-3, etc., and the compression coding standards for video include H.264, H.265, H.266, MPEG, VC-1, etc. By decoding, the compression-encoded video data is output as uncompressed color data, such as YUV420P, RGB, and the like; the compression-encoded audio data is output as uncompressed audio sample data, such as pcm data.
In an exemplary embodiment of the present disclosure, the live streaming data is propagated through a network, and before the live streaming data is decapsulated, the live streaming data is deprototed. The solution protocol is to resolve the data of the streaming media protocol into standard encapsulation format data. When the audios and videos are transmitted on the network, various streaming media protocols are often adopted, such as HTTP, RTMP, MMS, or the like. These protocols transmit some signaling data as well as audio-video data. These signaling data include control of play (play, pause, stop), or description of network status, etc. In the protocol solving process, the signaling data can be removed and only the audio and video data can be reserved.
In an exemplary embodiment of the present disclosure, the format of the original video compressed data is h.264, h.265, or h.266, the specified format is aac format, and the video file is mp4 format. It is assumed that, in an example, the format of the original audio compressed data is g711, and the audio compressed data in the g711 format cannot be directly synthesized into a video and cannot be directly recorded. By the embodiment, the g711 format audio compression data can be decoded into pcm format audio data, and then the pcm format audio data can be encoded into aac format audio compression data, so that the data can be synthesized into video, for example, a video file in mp4 format with h.264, h.265 or h.266 format video compression data. The mp4 format is a common format that can be played using a variety of players. Therefore, the method of the embodiment of the disclosure can be applied to video recording when live streaming data in various formats is live broadcast.
In an exemplary embodiment of the present disclosure, the live video recording method further includes:
starting a recording process after receiving a recording starting instruction input by a user or when a pre-configured recording starting condition is met;
and stopping the recording process after receiving a recording stopping instruction input by a user or when a pre-configured recording stopping condition is met.
Some live video recording methods automatically acquire the video of the time segment from a server by detecting the starting time and the ending time of an object entering a projection area, and the recording time of the method is limited, so that the live video recording method cannot effectively record in the scenes where people exist such as some anchor tape or singing meetings and the like. The embodiment of the disclosure can start and stop recording based on the user instruction, the user can initiatively record a certain video segment, and the start time and the end time are defined by the user, so that free recording is realized. In some situations where the user is inconvenient to input, for example, when the user is not in front of the playing device, the recording can be started and stopped by the pre-configured conditions for starting and/or stopping the recording. The condition may be, for example, that the recording is automatically started when a preset first time is reached, and the recording is stopped when the recording time reaches a preset time. For another example, in the set anti-theft mode, recording is started when a face is detected in the video image, and recording is stopped if the face is not detected after a set time period, and the like.
An embodiment of the present disclosure further provides a live video recording system, as shown in fig. 2, including a live stream player 1 and a video recorder 2, where:
the live stream player 1 is configured to extract original video compressed data and original audio compressed data from live stream data, decode the original video compressed data and the original audio compressed data respectively to obtain decoded video data and decoded audio data, and then perform synchronous playing;
the video recorder 2 is arranged to copy the original video compressed data and decoded audio data and to encode the decoded audio data into audio compressed data of a specified format which can be synthesized with the video compressed data; and synthesizing the original video compressed data and the audio compressed data in the specified format into a video file.
The video file synthesized by the embodiment can be stored in a memory for the user to play at any time.
In an exemplary embodiment of the present disclosure, as shown in fig. 3, the live video recording system further includes: the recording control module 3 is configured to control the video recorder to start a recording process after receiving a recording starting instruction input by a user or when a pre-configured recording starting condition is met; and controlling the video recorder to stop the recording process after receiving a recording stopping instruction input by a user or when a preset recording stopping condition is met. The embodiment can realize free recording of users, and can also realize automatic recording through preset conditions, thereby being convenient and flexible.
In an exemplary embodiment of the present disclosure, as shown in fig. 3:
the live stream player 1 includes:
a media separation module (demuxer)11 configured to decapsulate the live stream data to obtain the original video compressed data and the original audio compressed data. The original audio compressed data obtained by decapsulation is transmitted to the audio decoding module 13 through a first audio link, and the original video compressed data obtained by decapsulation is transmitted to the video decoding module 15 through a first video link. In addition, for the live streaming data encapsulated by the streaming media protocol, the media separation module firstly de-protocols the live streaming data and then de-encapsulates the live streaming data.
An audio decoding module 13 configured to decode the original audio compressed data to obtain decoded audio data. The decoded audio data may be transmitted to the synchronized playback module 17 over a second audio link.
The video decoding module 15 is configured to decode the original video compressed data to obtain decoded video data. The decoded video data may be transmitted to the synchronized playback module 17 over the second video link.
And a synchronous playing module 17 configured to perform synchronous playing on the decoded video data and the decoded audio data. For example, after the decoded video data and the decoded audio data are synchronized, the video data is sent to a display device for rendering, and the audio data is sent to an audio device such as a speaker for playing.
The video recorder 2 includes:
a video copy module 21 configured to copy the original video compression data. The video copy module 21 may be integrated with the media separation module 11 or may be separately provided on the first video link. The video copy module 21 may buffer the original video compression data and copy a video track that is sent to the audio/video encapsulation module 27.
An audio reproduction module 23 configured to reproduce the decoded audio data and send the reproduced audio data to an audio encoding module 25; the audio copy module 23 may be integrated with the audio decoding module 13 or may be separately provided on the second audio link. The audio copy module 21 may buffer the decoded audio data and copy a copy into the audio encoding module 25.
And the audio coding module 25 is configured to code the copied decoded audio data into audio coded data in a specified format. The audio encoding data in the specified format can be sent to the audio track of the audio/video encapsulation module 27.
And an audio/video encapsulation module (media multiplexer) 27 configured to synthesize the copied original video compressed data and the audio compressed data in the specified format into a video file.
An embodiment of the present disclosure further provides a live video recording apparatus, as shown in fig. 4, including a memory 50 and a processor 60, where a computer program is stored in the memory 50, and when the processor 60 executes the computer program, the live video recording method according to any embodiment of the present disclosure can be implemented.
An embodiment of the present disclosure further provides a terminal device, as shown in fig. 5, including a processor 50, and a memory 60, a display device 20, an audio device 30, an input device 40, and a network interface 10 connected to the processor through a bus, where the memory 60 stores a live stream playing program 61 and a live video recording program 62, and the memory 60 also stores other software such as an operating system, which is not described herein again. The processor 50, when executing the live stream playing program 61, can process live stream data received by the network interface 10 or other interfaces and play the live stream data through the display device 20 and the audio device 30; the live video recording program 62 executed by the processor 50 can implement a live video recording method according to any embodiment of the present disclosure according to an instruction of the input device 40.
The live video recording system, the live video recording device and the terminal equipment can execute the live video recording method of the embodiment, high-definition recording of live videos is achieved, loss of definition is avoided, and a video effect of far-beyond screen recording can be achieved. Moreover, the live video recording system of the embodiment of the disclosure has universality and can be suitable for recording live videos of various formats.
An embodiment of the present disclosure further provides a non-transitory computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the live video recording method according to any embodiment of the present disclosure is implemented.
The embodiment of the disclosure provides a live video recording method, which is characterized in that in a live scene built by a google open-source media player exolayer, audio data is re-encoded and then re-packaged with video data to generate a file with mp4 format of live video content, so that local viewing is facilitated. For example, a live broadcast camera is installed in a user home, and when the user remotely checks a live broadcast video shot by the camera by using app at a terminal, the user finds that someone breaks into the home, and can click to start recording to be stored as evidence; or when the child is found playing games, the child wants to record the good memories, and can remotely start high-definition recording to store the current live video.
Referring to fig. 3, the live video recording method according to the embodiment of the present disclosure re-encodes sound based on processing and playing of direct stream data by an exoplayer, and synthesizes original video compressed data and re-encoded audio compressed data into an mp4 file. When the sound is recoded, in this embodiment, the audio compressed data (which may be data in various formats such as g 711) obtained by decapsulating the direct stream is decoded, then the pcm data obtained by decoding is recoded into the aac format, and then the mp4 format video (video) is synthesized with the video compressed data (such as formats such as h.264 and h.265).
According to the embodiment of the live broadcast platform of the exoplayer based on the google open source, the exoplayer obtains live stream (http live source) data and then carries out protocol de-encoding and de-encapsulation to obtain original audio compression data and original video compression data, and yuv video data and pcm audio data are respectively decoded through an audio decoder and a video decoder of the platform and then rendered after audio and video synchronization.
In order to record a direct video, the embodiment of the present disclosure performs video link interception and audio link interception, that is: before the original video compressed data (video packet) is sent to the video decoder (video decoder), a copy of the original video data is sent to the video track (video track) of the audio video packer (media player). After the original audio compressed data (audio packet) is decoded into pcm data by an audio decoder, the pcm data is re-encoded into aac-formatted audio compressed data, and the aac-formatted audio compressed data is sent to an audio track (audio track) of an audio/video encapsulation module (media multiplexer, also called a media compositor).
Since the video must be recorded from the I frame, the audio/video encapsulation module waits for the first I frame of the video to be sent and then starts to synthesize the audio data (audio compressed data in aac format) of the audio track and the video data (i.e. original video compressed data) of the video track, and the audio data and the video data sent from the audio track and the video track are respectively sent to the audio/video encapsulation module (media multiplexer) to be synthesized, and waits for the user to input the stop key and then stops synthesizing.
In the embodiment of the present disclosure, a live stream player module (i.e., an exoplayer module) is mainly responsible for decapsulating, decoding, rendering, and the like of live data; the audio coding module can use an open source algorithm to code the pcm file into an aac file; the audio and video encapsulation module encapsulates and synthesizes the audio and video by using a media synthesizer (media multiplexer).
According to the embodiment of the invention, the live broadcast is carried out and the original video is recorded and stored in a high-definition mode aiming at the user with the live broadcast recording requirement, so that the loss of definition is avoided, and the video effect and the most original video recorded by a far-beyond screen are obtained. And the recording time can be freely selected, and the recording time can be recorded aiming at some special segments. After the live video is recorded, some editing processing can be performed on the recorded video, for example, some specific pictures in the video are saved as pictures, different video segments are clipped and spliced into the same video, some special effects are added to the recorded video, and the like.
In any one or more of the exemplary embodiments described above, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium and executed by a hardware-based processing unit. Computer-readable media may comprise computer-readable storage media corresponding to tangible media, such as data storage media, or communication media including any medium that facilitates transfer of a computer program from one place to another, such as according to a communication protocol. In this manner, the computer-readable medium may generally correspond to a non-transitory tangible computer-readable storage medium or a communication medium such as a signal or carrier wave. A data storage medium may be any available medium that can be accessed by one or more computers or one or more processors to retrieve instructions, code and/or data structures for implementing the techniques described in this disclosure. The computer program product may include a computer-readable medium.
By way of example, and not limitation, such computer-readable storage media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, flash memory, or any other medium that can be used to store desired program code in the form of instructions or data structures and that can be accessed by a computer. Also, any connection may be termed a computer-readable medium, and if instructions are transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, for example, the coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. It should be understood, however, that computer-readable storage media and data storage media do not include connections, carrier waves, signals, or other transitory (transitory) media, but are instead directed to non-transitory tangible storage media. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk or blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
By way of example, and not limitation, instructions may be executed by one or more processors, such as one or more Digital Signal Processors (DSPs), general purpose microprocessors, Application Specific Integrated Circuits (ASICs), field programmable logic arrays (FPGAs), or other equivalent integrated or discrete logic circuitry. Thus, the term "processor," as used herein may refer to any of the foregoing structure or any other structure suitable for implementation of the techniques described herein. In addition, in some aspects, the functionality described herein may be provided within dedicated hardware and/or software modules configured for encoding and decoding, or incorporated in a combined codec. Also, the techniques may be fully implemented in one or more circuits or logic elements.
The techniques of the embodiments of the present disclosure may be implemented in a wide variety of devices or apparatuses, including a wireless handset, an Integrated Circuit (IC), or a set of ICs (e.g., a chipset). Various components, modules, or units are described in embodiments of the disclosure to emphasize functional aspects of devices configured to perform the described techniques, but do not necessarily require realization by different hardware units. Rather, as noted above, the various units may be combined in a codec hardware unit or provided by a collection of interoperating hardware units (including one or more processors as noted above) in conjunction with suitable software and/or firmware.
Claims (12)
1. A live video recording method comprises the following recording processes:
copying original video compressed data and decoded audio data obtained by processing live streaming data, and encoding the copied decoded audio data into audio compressed data in a specified format capable of being synthesized with the video compressed data;
and synthesizing the copied original video compressed data and the audio compressed data in the specified format into a video file.
2. The live video recording method of claim 1, wherein:
and the original video compressed data is obtained by de-encapsulating the received live streaming data.
3. A live video recording method according to claim 1 or 2, characterized by:
the decoded audio data is obtained by: and decapsulating the received live streaming data to obtain original audio compressed data, and then decoding the original audio compressed data to obtain the decoded audio data.
4. A live video recording method according to claim 3, characterized in that:
the format of the original video compressed data is H.264, H.265 or H.266, the specified format is aac format, and the video file is mp4 format.
5. The live video recording method of claim 1, further comprising:
starting a recording process after receiving a recording starting instruction input by a user or when a pre-configured recording starting condition is met;
and stopping the recording process after receiving a recording stopping instruction input by a user or when a pre-configured recording stopping condition is met.
6. A live video recording system, comprising a live stream player and a video recorder, wherein:
the live stream player is set to extract original video compressed data and original audio compressed data from live stream data, and the original video compressed data and the original audio compressed data are respectively decoded to obtain decoded video data and decoded audio data and then are synchronously played;
the video recorder is configured to copy the original video compressed data and decoded audio data and encode the decoded audio data into audio compressed data of a specified format that can be synthesized with the video compressed data; and synthesizing the original video compressed data and the audio compressed data in the specified format into a video file.
7. A live video recording system as claimed in claim 6 wherein:
the live stream player includes:
the media separation module is used for de-encapsulating live streaming data to obtain the original video compressed data and the original audio compressed data;
a video decoding module configured to decode the original video compressed data to obtain decoded video data;
an audio decoding module configured to decode the original audio compressed data to obtain decoded audio data;
and the synchronous playing module is used for synchronously playing the decoded video data and the decoded audio data.
8. A live video recording system as claimed in claim 7 wherein:
the video recorder includes:
the video copying module is integrated with the media separating module or independently arranged and is used for copying the original video compressed data;
an audio reproduction module, integrated with or separately provided from the video decoding module, configured to reproduce the decoded audio data;
an audio encoding module configured to encode the copied decoded audio data into audio encoded data of a specified format;
and the audio and video packaging module is configured to synthesize the copied original video compressed data and the audio compressed data in the specified format into a video file.
9. A live video recording system as claimed in claim 6 wherein:
the live video recording system further comprises: the recording control module is arranged for controlling the video recorder to start a recording process after receiving a recording starting instruction input by a user or when a pre-configured recording starting condition is met; and controlling the video recorder to stop the recording process after receiving a recording stopping instruction input by a user or when a preset recording stopping condition is met.
10. A live video recording apparatus comprising a memory and a processor, wherein the memory stores a computer program, and the processor is capable of implementing a live video recording method as claimed in any one of claims 1 to 5 when executing the computer program.
11. A terminal device comprises a processor, a memory, a display device, an audio device, an input device and a network interface, wherein the memory, the display device, the audio device, the input device and the network interface are connected with the processor through a bus; the live video recording method of any one of claims 1 to 5 can be implemented according to an instruction of the input device when the live video recording program is executed.
12. A non-transitory computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements a live video recording method as claimed in any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583166.7A CN114173150A (en) | 2021-12-22 | 2021-12-22 | Live video recording method, device and system and terminal equipment |
| PCT/CN2022/131510 WO2023116254A1 (en) | 2021-12-22 | 2022-11-11 | Live video recording method, apparatus and system, and terminal device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111583166.7A CN114173150A (en) | 2021-12-22 | 2021-12-22 | Live video recording method, device and system and terminal equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114173150A true CN114173150A (en) | 2022-03-11 |
Family
ID=80487841
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111583166.7A Pending CN114173150A (en) | 2021-12-22 | 2021-12-22 | Live video recording method, device and system and terminal equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114173150A (en) |
| WO (1) | WO2023116254A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115086730A (en) * | 2022-06-16 | 2022-09-20 | 平安国际融资租赁有限公司 | Subscription video generation method, system, computer device and medium |
| WO2023116254A1 (en) * | 2021-12-22 | 2023-06-29 | Oppo广东移动通信有限公司 | Live video recording method, apparatus and system, and terminal device |
| CN116668763A (en) * | 2022-11-10 | 2023-08-29 | 荣耀终端有限公司 | Screen recording method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101603976B1 (en) * | 2014-10-22 | 2016-03-16 | 주식회사 솔박스 | Method and apparatus for concatenating video files |
| CN108235107A (en) * | 2016-12-15 | 2018-06-29 | 广州市动景计算机科技有限公司 | Video recording method, device and electric terminal |
| CN108737884A (en) * | 2018-05-31 | 2018-11-02 | 腾讯科技（深圳）有限公司 | A kind of content recordal method and its equipment, storage medium, electronic equipment |
| CN110708564A (en) * | 2019-10-21 | 2020-01-17 | 上海网达软件股份有限公司 | Live transcoding method and system for dynamically switching video streams |
| CN112565923A (en) * | 2020-11-30 | 2021-03-26 | 北京达佳互联信息技术有限公司 | Audio and video stream processing method and device, electronic equipment and storage medium |
| CN113645485A (en) * | 2021-07-29 | 2021-11-12 | 长沙千视电子科技有限公司 | Method and device for realizing conversion from any streaming media protocol to NDI (network data interface) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8055116B2 (en) * | 2005-07-27 | 2011-11-08 | Streaming Networks (Pvt.) Ltd. | Method and system for providing audio-only recording of an audio/video signal |
| CN102055966B (en) * | 2009-11-04 | 2013-03-20 | 腾讯科技（深圳）有限公司 | Compression method and system for media file |
| CN102447893B (en) * | 2010-09-30 | 2015-08-26 | 北京沃安科技有限公司 | The method and system of mobile video Real-time Collection and issue |
| CN108600816A (en) * | 2018-05-17 | 2018-09-28 | 上海七牛信息技术有限公司 | A kind of detecting method of media, device and media play system |
| CN114173150A (en) * | 2021-12-22 | 2022-03-11 | Oppo广东移动通信有限公司 | Live video recording method, device and system and terminal equipment |
-
2021
- 2021-12-22 CN CN202111583166.7A patent/CN114173150A/en active Pending
-
2022
- 2022-11-11 WO PCT/CN2022/131510 patent/WO2023116254A1/en unknown
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101603976B1 (en) * | 2014-10-22 | 2016-03-16 | 주식회사 솔박스 | Method and apparatus for concatenating video files |
| CN108235107A (en) * | 2016-12-15 | 2018-06-29 | 广州市动景计算机科技有限公司 | Video recording method, device and electric terminal |
| CN108737884A (en) * | 2018-05-31 | 2018-11-02 | 腾讯科技（深圳）有限公司 | A kind of content recordal method and its equipment, storage medium, electronic equipment |
| CN110708564A (en) * | 2019-10-21 | 2020-01-17 | 上海网达软件股份有限公司 | Live transcoding method and system for dynamically switching video streams |
| CN112565923A (en) * | 2020-11-30 | 2021-03-26 | 北京达佳互联信息技术有限公司 | Audio and video stream processing method and device, electronic equipment and storage medium |
| CN113645485A (en) * | 2021-07-29 | 2021-11-12 | 长沙千视电子科技有限公司 | Method and device for realizing conversion from any streaming media protocol to NDI (network data interface) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023116254A1 (en) * | 2021-12-22 | 2023-06-29 | Oppo广东移动通信有限公司 | Live video recording method, apparatus and system, and terminal device |
| CN115086730A (en) * | 2022-06-16 | 2022-09-20 | 平安国际融资租赁有限公司 | Subscription video generation method, system, computer device and medium |
| CN115086730B (en) * | 2022-06-16 | 2024-04-02 | 平安国际融资租赁有限公司 | Subscription video generation method, subscription video generation system, computer equipment and subscription video generation medium |
| CN116668763A (en) * | 2022-11-10 | 2023-08-29 | 荣耀终端有限公司 | Screen recording method and device |
| CN116668763B (en) * | 2022-11-10 | 2024-04-19 | 荣耀终端有限公司 | Screen recording method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023116254A1 (en) | 2023-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114173150A (en) | Live video recording method, device and system and terminal equipment | |
| KR20180010392A (en) | Method and apparatus for streaming media data using java script | |
| KR20070119549A (en) | Image recording apparatus, image reproducing apparatus, image recording method, and image reproducing method | |
| WO2020151398A1 (en) | Method，device and storage medium for seamlessly switching hardware decoding dynamic resolution, | |
| US8260124B2 (en) | Method and apparatus for reproducing digital broadcast and method of recording digital broadcast | |
| CN103647906A (en) | Multipath audio and video synthetic method for embedded hard-disk video recorder | |
| JP5161549B2 (en) | VIDEO RECORDING DEVICE, VIDEO REPRODUCTION DEVICE, AND ITS CONTROL METHOD | |
| KR20140117889A (en) | Client apparatus, server apparatus, multimedia redirection system and the method thereof | |
| KR20060032191A (en) | A method and system for digitally recording broadcast content | |
| JP2005303336A (en) | Video signal recording apparatus and video signal reproducing apparatus | |
| JP7153143B2 (en) | Video providing system and program | |
| JP3566216B2 (en) | Digital audio / video information recording device | |
| RU2690163C2 (en) | Information processing device and information processing method | |
| JP2002290901A (en) | Viewer video recording and reproducing device | |
| KR100681647B1 (en) | Method and apparatus for controlling of personal video recorder | |
| KR20090014858A (en) | Digital set-top box | |
| CN1331343C (en) | Conversion device and method for public interfacing digital television CI to IEEE-1394 interface | |
| CN113490047A (en) | Android audio and video playing method | |
| KR200268775Y1 (en) | campact disk player | |
| US20050089093A1 (en) | Network-based system and related method for processing multi-format video signals | |
| CN117834982A (en) | Video playing processing method and device, electronic equipment and storage medium | |
| KR20100087501A (en) | Av data service and play method, and apparatus thereof | |
| JP2007035200A (en) | Reproducing apparatus, content recording medium, control method of reproducing apparatus, control program, and recording medium | |
| JP2008047972A (en) | Video processing system | |
| KR20030020174A (en) | campact disk player |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |