CN108769738A - Method for processing video frequency, device, computer equipment and storage medium - Google Patents
Method for processing video frequency, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN108769738A CN108769738A CN201810622141.5A CN201810622141A CN108769738A CN 108769738 A CN108769738 A CN 108769738A CN 201810622141 A CN201810622141 A CN 201810622141A CN 108769738 A CN108769738 A CN 108769738A
- Authority
- CN
- China
- Prior art keywords
- file
- hard coded
- video
- impeller
- terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of method for processing video frequency, device, computer equipment and storage mediums, belong to internet arena.The method includes：Based on default hard coded parameter, decoding parametric is obtained, the decoding parametric is to presetting parameter required when the video that hard coded parameter coding is handled is decoded using this；Impeller is obtained, the impeller is written into the decoding parametric, the impeller is used for pending video push to the terminal of multiple users；Pending video is obtained, by target processor and the default hard coded parameter, the carry out hard coded processing to the pending video, the target processor is other processors other than CPU；The hard video compiled after transaction code and the decoding parametric are sent to the terminal of multiple users by impeller.The present invention has got around the limitation of soft addressable port, and is suitable for any type of terminal, has higher compatibility.
Description
Technical field
The present invention relates to Internet technical field more particularly to a kind of method for processing video frequency, device, computer equipment and deposit
Storage media.
Background technology
In transmission of video, since video to be transmitted is larger, it will usually first encode, then transmit to video.Currently,
In various video coding techniques, hard coded is by GPU (Graphics Processing Unit, graphics processor), specially
Non- CPU (the Central Processing such as DSP (Digital Signal Processing, i.e. digital signal processor)
Unit, central processing unit) technology that is encoded, hard coded is because saving cpu load, the advantages such as code efficiency height, to gradually
It is widely used.
In the prior art, usually have using some and carry out video encoding capability using the non-CPU such as GPU, dedicated DSP
Video Toolbox hard encoders are encoded, the video after exports coding, to transmit the video after the coding.However, mesh
Before, the Video Toolbox hard encoders are only compatible with the terminal of certain specified types, for example, software systems be iOS8.0 and
The terminal of above system；The Video Toolbox hard encoders can not be then used on the other-end other than specified type
It is encoded, therefore, there is an urgent need for a kind of methods that hard coded can be used to carry out video processing at present.
Invention content
An embodiment of the present invention provides a kind of method for processing video frequency, device, computer equipment and storage mediums, can solve
In the related technology the problem of poor compatibility.The technical solution is as follows：
In a first aspect, a kind of method for processing video frequency is provided, the method includes：
Based on default hard coded parameter, decoding parametric is obtained, the decoding parametric is to joining using the default hard coded
The video of number encoder processing parameter required when being decoded；
Impeller is obtained, the impeller is written into the decoding parametric, the impeller is used for pending video
Push to the terminal of multiple users；
The pending video is obtained, by target processor and the default hard coded parameter, to described pending
Video carry out hard coded processing, the target processor be central processor CPU other than other processors；
Hard coded treated video and the decoding parametric are sent to the terminal of multiple users by the impeller.
In a kind of possible realization method, described based on default hard coded parameter, obtaining decoding parametric includes：
Under preview state, preview image is acquired, by the target processor and the default hard coded parameter, to institute
It states preview image and carries out hard coded processing, obtain the first file of target envelope format；
The configuration parameter that the preview image is extracted from first file, the configuration parameter of the preview image is true
It is set to follow-up hard coded treated the decoding parametric of pending video.
In a kind of possible realization method, the default hard coded parameter includes code check, frame per second and/or key frame interval；
The decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
In a kind of possible realization method, the acquisition impeller, the impeller, which is written, in the decoding parametric includes：
When receiving sign on, the impeller is created, extradata parameters in the impeller are revised as institute
Decoding parametric is stated, and starts the impeller, the sign on, which is used to indicate, to be started the pending video push at most
The terminal of a user, the extradata parameters are used to carry decoding parametric when carrying out coded treatment to video.
It is described to obtain the pending video in a kind of possible realization method, by target processor and described pre-
If hard coded parameter, the carry out hard coded processing to the pending video includes：
When receiving sign on, the video data of the pending video is acquired, the target processor is passed through
With the default hard coded parameter, hard coded processing, the sign on are carried out to the corresponding multiple image of the video data
It is used to indicate and starts the terminal of the pending video push to the multiple user；
By the target processor, the second file is created, and treated that institute is written in multiple image by the hard coded
The second file is stated, the encapsulation format of second file is target envelope format.
In a kind of possible realization method, the method further includes：
It is written in the second file processes by the hard coded treated multiple image, monitors the text of second file
Part size creates third file, and the hard coded is handled when the file size of second file is more than predetermined threshold value
The third file, the encapsulation lattice of the third file are written in the image that second file is had not been written in multiple image afterwards
Formula is target envelope format.
In a kind of possible realization method, it is described by the impeller by hard coded treated video and the decoding
The terminal that parameter is sent to multiple users includes：
When monitoring in second file there are when hard coded treated multiple image, according to second file
Encapsulation format reads the hard coded from second file treated multiple image；
By the hard coded, treated that multiple image is sent to the impeller, by the impeller, according to default
The hard coded treated multiple image and the decoding parametric are encapsulated as the 4th file, by institute by video flow host-host protocol
State the terminal that the 4th file is sent to the multiple user, the target of the encapsulation format and second file of the 4th file
Encapsulation format differs.
Second aspect, provides a kind of video process apparatus, and described device includes：
Acquisition module, for based on default hard coded parameter, obtaining decoding parametric, the decoding parametric is to described in use
The video of default hard coded parameter coding processing parameter required when being decoded；
For obtaining impeller the impeller is written, the impeller is used for will in the decoding parametric by writing module
Pending video push to multiple users terminal；
Coding module, for obtaining the pending video, by target processor and the default hard coded parameter,
Carry out hard coded processing to the pending video, the target processor are its elsewhere other than central processor CPU
Manage device；
Sending module is sent to for passing through the impeller by hard coded treated video and the decoding parametric more
The terminal of a user.
In a kind of possible realization method, the acquisition module, under preview state, acquiring preview image, passing through
The target processor and the default hard coded parameter carry out hard coded processing to the preview image, obtain target envelope
First file of format；The configuration parameter that the preview image is extracted from first file, by matching for the preview image
Set the decoding parametric that parameter is determined as follow-up hard coded treated pending video.
In a kind of possible realization method, the default hard coded parameter includes code check, frame per second and/or key frame interval；
The decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
In a kind of possible realization method, said write module, for when receiving sign on, creating the plug-flow
Extradata parameters in the impeller are revised as the decoding parametric, and start the impeller by device, described to start to refer to
Order, which is used to indicate, to be started the terminal of the pending video push to the multiple user, and the extradata parameters are used for
Carry decoding parametric when carrying out coded treatment to video.
In a kind of possible realization method, the coding module, for waiting locating when receiving sign on, described in acquisition
The video data of the video of reason corresponds to the video data by the target processor and the default hard coded parameter
Multiple image carry out hard coded processing, the sign on, which is used to indicate, to be started the pending video push to multiple use
The terminal at family；By the target processor, the second file is created, and treated that institute is written in multiple image by the hard coded
The second file is stated, the encapsulation format of second file is target envelope format.
In a kind of possible realization method, described device further includes：
Monitoring modular, for being written in second file processes by the hard coded treated multiple image, prison
The file size for surveying second file creates third file when the file size of second file is more than predetermined threshold value,
And the third file, institute is written into the image that second file is had not been written in the hard coded treated multiple image
The encapsulation format for stating third file is target envelope format.
In a kind of possible realization method, the sending module includes：
Reading unit, for when monitoring in second file there are when hard coded treated multiple image, according to
The encapsulation format of second file reads the hard coded from second file treated multiple image；
Transmission unit is pushed away by described for by the hard coded, treated that multiple image is sent to the impeller
Device is flowed, according to default video flow host-host protocol, the hard coded treated multiple image and the decoding parametric are encapsulated as
4th file, is sent to the terminal of the multiple user by the 4th file, the encapsulation format of the 4th file with it is described
The target envelope format of second file differs.
The third aspect provides a kind of computer equipment, including processor and memory；The memory, for storing
Computer program；The processor realizes that first aspect is any for executing the computer program stored on the memory
Method and step described in.
Fourth aspect provides a kind of computer readable storage medium, is stored in the computer readable storage medium
Computer program realizes first aspect any one of them method and step when the computer program is executed by processor.
The advantageous effect that technical solution provided in an embodiment of the present invention is brought is：
In the embodiment of the present invention, terminal can first obtain decoding parametric, and the impeller is written in the decoding parametric, this is pushed away
Device is flowed to be used for pending video push to the terminal of multiple users.Terminal obtains pending video again, at target
Manage device and default hard coded parameter, the carry out hard coded processing to the pending video, to be encoded by the impeller
Video and the decoding parametric afterwards is sent to the terminal of multiple users, so that the terminal of multiple user is based on the decoding parametric solution
The code video；Due to being encoded without the addressable port of soft coding, the limitation of soft addressable port, also, this have been got around
Method is applicable to any type of terminal, to improve the compatibility of video processing.
Description of the drawings
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, other are can also be obtained according to these attached drawings
Attached drawing.
Fig. 1 is a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention；
Fig. 3 is that data store schematic diagram in a kind of FLV files provided in an embodiment of the present invention；
Fig. 4 is that data store schematic diagram in a kind of FLV files provided in an embodiment of the present invention；
Fig. 5 is that data store schematic diagram in a kind of FLV files provided in an embodiment of the present invention；
Fig. 6 is that data store schematic diagram in a kind of FLV files provided in an embodiment of the present invention；
Fig. 7 is a kind of structural schematic diagram of video process apparatus provided in an embodiment of the present invention；
Fig. 8 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention；
Fig. 9 is a kind of structural schematic diagram of server provided in an embodiment of the present invention.
Specific implementation mode
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention
Formula is described in further detail.
Fig. 1 is a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention.Referring to Fig. 1, this method includes：
101, it is based on default hard coded parameter, obtains decoding parametric, which is to using the default hard coded ginseng
The video of number encoder processing parameter required when being decoded.
102, impeller is obtained, which is written into the impeller, the impeller is for pushing away pending video
It send to the terminal of multiple users；
103, the pending video is obtained, it is pending to this by target processor and the default hard coded parameter
The carry out hard coded processing of video, the target processor are other processors other than central processor CPU；
104, the hard coded treated video and the decoding parametric are sent to the end of multiple users by the impeller
End.
, should be based on default hard coded parameter in a kind of possible realization method, obtaining decoding parametric includes：
Under preview state, preview image is acquired, by the target processor and the default hard coded parameter, to the preview
Image carries out hard coded processing, obtains the first file of target envelope format；
The configuration parameter that the preview image is extracted from first file, after the configuration parameter of the preview image is determined as
The decoding parametric of continuous hard coded treated pending video.
In a kind of possible realization method, which includes code check, frame per second and/or key frame interval；It should
Decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
In a kind of possible realization method, the acquisition impeller, which, which is written the impeller, includes：
When receiving sign on, the impeller is created, extra data parameters in the impeller are revised as the solution
Code parameter, and start the impeller, which, which is used to indicate, started the end of the pending video push to multiple users
End, the extra data parameters are used to carry decoding parametric when carrying out coded treatment to video.
In a kind of possible realization method, the acquisition pending video passes through target processor and the default hard volume
Code parameter, the carry out hard coded processing to the pending video include：
When receiving sign on, the video data of the pending video is acquired, by the target processor and is somebody's turn to do
Default hard coded parameter carries out hard coded processing to the corresponding multiple image of the video data, which is used to indicate out
Begin the terminal of the pending video push to multiple users；
By the target processor, create the second file, and by the hard coded treated multiple image is written this second
The encapsulation format of file, second file is target envelope format.
In a kind of possible realization method, this method further includes：
It is written in the second file processes by the hard coded treated multiple image, the file for monitoring second file is big
It is small, when the file size of second file is more than predetermined threshold value, create third file, and by the hard coded treated multiframe
The third file is written in the image that second file is had not been written in image, and the encapsulation format of the third file is target envelope lattice
Formula.
In a kind of possible realization method, hard coded treated video and the decoding parametric should be sent out by the impeller
The terminal to multiple users is sent to include：
When monitoring in second file there are when hard coded treated multiple image, according to the encapsulation of second file
Format reads the hard coded from second file treated multiple image；
By the hard coded, treated that multiple image is sent to the impeller, by the impeller, according to default video flowing
The hard coded treated multiple image and the decoding parametric are encapsulated as the 4th file, the 4th file are sent out by transport protocol
It send to the terminal of multiple user, the encapsulation format of the 4th file is differed with the target envelope format of second file.
In the embodiment of the present invention, terminal can first obtain decoding parametric, and the impeller is written in the decoding parametric, this is pushed away
Device is flowed to be used for pending video push to the terminal of multiple users.Terminal obtains pending video again, at target
Manage device and default hard coded parameter, the carry out hard coded processing to the pending video, to be encoded by the impeller
Video and the decoding parametric afterwards is sent to the terminal of multiple users, so that the terminal of multiple user is based on the decoding parametric solution
The code video；Due to being encoded without the addressable port of soft coding, the limitation of soft addressable port, also, this have been got around
Method is applicable to any type of terminal, to improve the compatibility of video processing.
The alternative embodiment that any combination forms the present invention may be used, herein no longer in above-mentioned all optional technical solutions
It repeats one by one.
Fig. 2 is a kind of flow chart of method for processing video frequency provided in an embodiment of the present invention.The executive agent of this method can be with
For terminal or server, the embodiment of the present invention is only illustrated by taking terminal as an example, and referring to Fig. 2, this method includes：
201, under preview state, terminal acquires preview image, by target processor and default hard coded parameter, to pre-
Image of looking at carries out hard coded processing, obtains the first file of target envelope format.
In the embodiment of the present invention, the mode that hard coded may be used in terminal carries out coded treatment to video, wherein hard coded
For the technology encoded by non-CPU such as GPU, dedicated DSP, relative to the soft cataloged procedure for using CPU to be encoded, firmly
Coding is without consuming CPU, better performances, and code efficiency is also higher.When terminal-pair video carries out coded treatment, usually it is also required to
Parameter required when decoding the video is obtained, in order to which subsequently the video can be decoded based on the parameter.
In the embodiment of the present invention, terminal can obtain hard coded treated video first with a frame image of video
Decoding parametric, by taking live scene as an example, in live scene, terminal is before entering live state, it will usually first be carried for user
For a preview interface, user can pass through the preview interface preview camera institute recorded video.In this step, when terminal needs
When being broadcast live, terminal can be introduced into preview state, under the preview state, call the camera of terminal, one frame of acquisition pre-
Look at the initial data of image, and by target processor, according to default hard coded parameter, to the initial data of the preview image into
The processing of row hard coded, the coded data of the preview image after coding is written in first file, and by first Document encapsulation
For target envelope format.Wherein, which is the parameter used when being encoded to pending video, namely
It is the parameter subsequently encoded to live video to be transmitted.
Wherein, which can include but is not limited to：Code check, frame per second and/or key frame interval etc..This is pre-
Look at image initial data can be RGB (Red, Green, Blue, reddish yellow blue color) format data, the coded number after coding
According to can be H.264, the data of the formats such as H.265, which can be MP4 (Moving Picture
Experts Group 4, dynamic image expert group) format, which can be a MP4 file.
202, terminal extracts the configuration parameter of the preview image from the first file, and the configuration parameter of the preview image is true
It is set to the follow-up hard coded treated the decoding parametric of pending video.
Terminal parses first file according to the target envelope format of first file, from first file
The configuration parameter is extracted in designated position, which is to be solved to the video for having used default hard coded parameter to be encoded
Required decoding parametric when code, therefore, which can be determined as decoding required when the subsequent decoding video by terminal
Parameter.
Wherein, which includes the SPS (Sequence Parameter Set, sequence parameter set) of first file
And/or picture parameter set PPS (Picture Parameter Set, picture parameter set).
It should be noted that above-mentioned steps 201-202 is that " terminal is based on default hard coded parameter to step, obtains decoding ginseng
The specific implementation of number ", above-mentioned realization method are actually that a frame image of the terminal based on recording carries out at real-time hard coded
Reason, however, terminal can also carry out hard coded processing to the image in advance, is extracted and is stored to obtain the process of decoding parametric
The decoding parametric improves the effect for obtaining decoding parametric to subsequently can directly obtain the decoding parametric from designated space
Rate；Alternatively, the multiple image that terminal is also based on recording carries out hard coded processing, the decoding parametric of multiple image is extracted, it is comprehensive
The configuration parameter acquiring decoding parametric for closing multiple image improves to improve the accuracy for obtaining decoding parametric at video
Manage efficiency.
203, terminal obtains impeller, which is written the impeller.
Wherein, which is used for pending video push to multiple users.In this step, when terminal receives out
When instruction, the impeller is created, extra data parameters in the impeller are revised as the decoding parametric, and start the plug-flow
Device, the extra data parameters are used to carry configuration parameter when carrying out soft coded treatment to video, and the sign on is for referring to
Show and starts the terminal of the pending video push to multiple users.
Wherein, which can be to be triggered by user, and when terminal detects that user triggers start button, receiving should
Enabled instruction, and create impeller, wherein the impeller can be the format context of ff mpeg, in the impeller
In, which is used to store the configuration parameter of the video after coding, and terminal can be that the decoding parametric is written
Byte where the extra data parameters of the impeller.
It should be noted that the impeller can be the impeller that soft coding uses, in general, in soft coding, create
Configuration parameter when carrying out soft coded treatment to video is generated when impeller, and is stored in extra data parameters, this
In inventive embodiments, plug-flow is only carried out using format context by the soft coding, does not actually use pushing away for soft coding
The parameter of device is flowed, but using the configuration parameter obtained when being handled based on hard coded as decoding parametric, it is written in impeller, to
So that can subsequently execute the process of hard coded and plug-flow based on the processor of the non-CPU such as GPU, DSP, the limit of soft coding is relieved
System, without by dedicated hard encoders such as VideoToolbox, hard coded also may make to become feasible.
The decoding parametric can be that PPS, SPS etc. configure parameter, which is used to carry the resolution of image in video
Rate, sublayer number, initial pictures control information, such as initial QP, and terminal is by by the configuration parameter read-in impeller, and by pushing away
The configuration parameter and the video are pushed to each user by stream device together so that the terminal of each user can be directly based upon this and match
It sets parameter to be decoded, to improve decoding efficiency.
204, terminal obtains pending video, pending to this by target processor and the default hard coded parameter
Video carry out hard coded processing.
In this step, user can be by triggering start button, and triggering terminal starts recorded video, then, terminal-pair record
The video original data of system carries out hard coded processing, that is to say and generates video flowing to be transmitted.The process can be：When terminal connects
When receiving sign on, terminal calls camera, acquires the video data of pending video, by the target processor and is somebody's turn to do
Default hard coded parameter carries out hard coded processing to the corresponding multiple image of the video data；Terminal by the target processor,
Create the second file, and treated that second file is written in multiple image by hard coded, the encapsulation format of second file is
Target envelope format.
Wherein, terminal, which can synchronize, executes the step of video record, video hard coded and video encapsulation are the second file,
It that is to say, terminal can be encoded the image data, and second file is written with the image data of one frame image of every acquisition
In.When the second file is written in the image data of every frame image after coding by terminal, terminal can be added before the image data
Blank character, such as 00000001 accord at equal intervals, by the blank character, the image separation of different frame is opened, so that when subsequent decoding
The image data that each frame image can accurately be obtained, improves decoded accuracy.
It should be noted that the timestamp of every frame image can also be extracted and be recorded to terminal when coding is per frame image.It is right
In every frame image, when terminal-pair, the frame image is encoded, and when obtaining the corresponding coded data of the frame image, terminal can be from note
The corresponding timestamp of frame image is extracted in multiple timestamps of record；Thus subsequently can be based on the timestamp of multiple image, it will
Multiple image is sent successively according to chronological order.
It should be noted that further including audio data in the video data of terminal acquisition, terminal can record every frame audio
The timestamp of data, the timestamp based on audio data and the timestamp per frame image, timestamp is identical per frame audio number
It is corresponded according to image data, in order to subsequently by frame audio data transmission synchronous with the frame image data.Certainly, it is recording
System starts, since the beginning acquisition time of the camera of the camera and acquisition audio data of acquisition image data may differ
It causes, the timestamp in the image data and audio data of recording former frame images when starting is caused possibly can not to be completely superposed,
In general, the time of acquisition image can be earlier than audio data, therefore, for timestamp in multiple image earlier than first frame audio number
According to timestamp the first number image, terminal can adjust the timestamp of the image of first number to the first frame sound
The timestamp of frequency evidence.For example, if the timestamp of first frame image, the second frame image is respectively 1050ms, 1060ms, first
When the timestamp of frame audio data is 1060ms, terminal can adjust separately the timestamp of first frame image, the second frame image
To 1060ms, 1062ms, so that audio data and image can correspond, ensure that audio is synchronous with image.
In a kind of possible design, terminal can also monitor the big of file in real time during generating the second file
It is small, to be adjusted into Mobile state.The process can be：The second file mistake is being written in hard coded treated multiple image by terminal
Cheng Zhong monitors the file size of second file, when the file size of second file is more than predetermined threshold value, creates third text
Part, and the third file is written into the image that second file is had not been written in the hard coded treated multiple image, this
The encapsulation format of three files is target envelope format.Wherein, which can be based on needing to be configured, and the present invention is implemented
Example is not specifically limited this.For example, the predetermined threshold value can be 1M, 23M etc..It should be noted that terminal is by picture number
When according to the second file of write-in, terminal can monitor the file size of second file in real time, when this with another thread of synchronous averaging
When the file size of second file is more than predetermined threshold value, terminal can directly be switched to the file being written by second file
Third file, and second file is sent, to after sending delete the second file, and then it ensure that local interim text
Part is not too large, and space resources caused by avoiding temporary file accumulation wastes.
It should be noted that in this step, the hard coded parameter that terminal uses is identical with parameter when coding preview image,
To the configuration parameter obtained based on preview image, it is applied equally to the video data recorded, terminal can directly match this
Decoding parametric and video are sent to each user by the decoding parametric for setting the parameter video pending as this.
Also, terminal by the multiple image in video by being written file, using the processor of the non-CPU such as GPU, DSP, with
The form of written document realizes Video coding；Without calling the addressable port of soft coding, the limit of soft addressable port has been got around
System so that hard coded becomes feasible.Meanwhile without the dedicated hard encoder such as Video Toolbox is used, so that originally
Method can be adapted for any kind of terminal.Due to being not necessarily to call video toolbox encoders, allocating time is saved,
To improve code efficiency.
205, hard coded treated video and the decoding parametric are sent to multiple users' by terminal by the impeller
Terminal.
In this step, terminal the decoding parametric can be written in second file, and pass through the plug-flow by impeller
The second file that decoding parametric is written is sent to the terminal of multiple users by device.Wherein, decoding parametric can will be written in terminal
Second file is added in the avpacket of ffmpeg, to which the second file is sent to server by the avpacket, by
Second file is sent to the terminal for each user for watching the live streaming by server.When the terminal of each user receive this second
When file, the decoding parametric of second file can be first extracted, the decoding parametric is based on, decodes the video counts in second file
According to.Wherein, terminal the decoding parametric can be written in the header of second file, in general, terminal can be by the decoding
The end byte of the parameter read-in header.
In the embodiment of the present invention, which can be in generating the second file processes, and synchronization will firmly compile in second file
Treated that multiple image pushes to multiple users for code.Also, when actually sending, the format of the video file transmitted by terminal
It may be differed with the format of second file, this step can also be：Whether had been written in terminal monitoring second file
Hard coded treated multiple image, when monitoring in second file there are when hard coded treated multiple image, according to
The encapsulation format of second file reads the hard coded from second file treated multiple image；Terminal is by the hard volume
Treated that multiple image is sent to the impeller for code, by the impeller, according to default video flow host-host protocol, by the hard volume
Code treated multiple image and the decoding parametric are encapsulated as the 4th file, and the 4th file is sent to the end of multiple user
End, the encapsulation format of the 4th file are differed with the target envelope format of second file.
Wherein, the encapsulation format of the 4th file can be FLV (Flash Video, Streaming Media) format.4th file
It that is to say a FLV file.The default video flow host-host protocol can be RMTP (Real Time Messaging
Protocol, real-time messages transmission) agreement.Terminal is in the process that hard coded treated multiple image is written to the second file
In, terminal can start another thread, by another thread, execute and monitor in second file whether be written into hard volume
The step of code treated multiple image.
By taking FLV files as an example, as shown in figure 3, Fig. 3 is the video file of FLV encapsulation format, wherein 00 00 00 00 generations
Table timestamp；12 be the script data data of the video file, which is generally stored in video text
Some self-defined informations in part for displaying；For example, the width of image is high in video, makes the Business Name of the video file
Deng；00 01 08 representatives are not added with timestamp and the file of the video file of 00 01 08,0,000 01 13 equal length information is long
Degree, 00 00 01 13 represent the video file after addition timestamp and 00 01 08,00 00 01 13 equal length information
Complete length.
As shown in figure 4, in audio data, 08 data type for representing storage represents sound as audio data, 00 00 07
The length of frequency data packet, subsequent data are the fields such as timestamp, and then equally having 00 00 00 12, to represent packets of audio data long
The trailer field of degree.
As shown in figure 5, in video data, 09 represents the data type of storage as video data, and 00 00 2B representatives regard
The length of frequency data packet, subsequent data are 00 00 00 00 timestamps etc., represent key frame for 17 00,17,00 represents
Video config information that is to say extradata, and 00 17 represent length, and 67 show to be followed by SPS, and 00 04 represent length,
68 show to be followed by PPS, then have 00 00 00 36 to represent entire video data packet size with all below.
The data type of storage is represented as shown in fig. 6, in the video of actual storage when picture frame, 09 as video data,
The length of video data packet is 0,0A5 87, and timestamp represents key frame (27 be non-key frame), 01 generation for 00 00 00 00,17
Table is the picture frame in video, and in general the data volume of picture frame is very big in video, trailer field is not shown in Fig. 6, still
The trailer field of same mark whole length is also had below.
In the embodiment of the present invention, terminal can first obtain decoding parametric, and the impeller is written in the decoding parametric, this is pushed away
Device is flowed to be used for pending video push to the terminal of multiple users.Terminal obtains pending video again, at target
Manage device and default hard coded parameter, the carry out hard coded processing to the pending video, to be encoded by the impeller
Video and the decoding parametric afterwards is sent to the terminal of multiple users, so that the terminal of multiple user is based on the decoding parametric solution
The code video；Due to being encoded without the addressable port of soft coding, the limitation of soft addressable port, also, this have been got around
Method relieves the limitation of terminal type without using the dedicated hard encoder such as Video Toolbox, is suitable for any type
Terminal, to improve video processing compatibility.
Fig. 7 is a kind of structural schematic diagram of video process apparatus provided in an embodiment of the present invention.With reference to Fig. 7, the device packet
It includes：
Acquisition module 701 is used to be based on default hard coded parameter, obtains decoding parametric, which is to be somebody's turn to do to using
The video of default hard coded parameter coding processing parameter required when being decoded；
For obtaining impeller the impeller is written in the decoding parametric by writing module 702, and the impeller will be for that will wait for
The video push of processing to multiple users terminal；
Coding module 703 presets hard coded parameter for obtaining the pending video by target processor and this,
Carry out hard coded processing to the pending video, the target processor are other processors other than central processor CPU；
The hard coded treated video and the decoding parametric are sent to by sending module 704 for passing through the impeller
The terminal of multiple users.
In a kind of possible realization method, the acquisition module 701, under preview state, acquiring preview image, passing through
The target processor and the default hard coded parameter, carry out hard coded processing to the preview image, obtain target envelope format
First file；The configuration parameter of the preview image is determined as by the configuration parameter that the preview image is extracted from first file
The decoding parametric of follow-up hard coded treated pending video.
In a kind of possible realization method, which includes code check, frame per second and/or key frame interval；It should
Decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
In a kind of possible realization method, the writing module 702, for when receiving sign on, creating the plug-flow
Extra data parameters in the impeller are revised as the decoding parametric, and start the impeller by device, and the sign on is for referring to
Show and start the terminal of the pending video push to multiple users, which compiles video for carrying
Decoding parametric when code processing.
In a kind of possible realization method, which waits locating for when receiving sign on, acquiring this
The video data of the video of reason passes through the target processor and the default hard coded parameter, multiframe corresponding to the video data
Image carries out hard coded processing, which, which is used to indicate, starts the terminal of the pending video push to multiple users；
By the target processor, the second file is created, and treated that second file is written in multiple image by the hard coded, this
The encapsulation format of two files is target envelope format.
In a kind of possible realization method, which further includes：
Monitoring modular, for being written in the second file processes by the hard coded treated multiple image, monitor this
The file size of two files creates third file, and by the hard volume when the file size of second file is more than predetermined threshold value
The third file, the encapsulation lattice of the third file are written in the image that second file is had not been written in code treated multiple image
Formula is target envelope format.
In a kind of possible realization method, which includes：
Reading unit, for when monitoring in second file there are when hard coded treated multiple image, according to this
The encapsulation format of second file reads the hard coded from second file treated multiple image；
Transmission unit by the impeller, is pressed for by the hard coded, treated that multiple image is sent to the impeller
According to default video flow host-host protocol, the hard coded treated multiple image and the decoding parametric are encapsulated as the 4th file, it will
4th file is sent to the terminal of multiple user, the encapsulation format of the 4th file and the target envelope lattice of second file
Formula differs.
In the embodiment of the present invention, terminal can first obtain decoding parametric, and the impeller is written in the decoding parametric, this is pushed away
Device is flowed to be used for pending video push to the terminal of multiple users.Terminal obtains pending video again, at target
Manage device and default hard coded parameter, the carry out hard coded processing to the pending video, to be encoded by the impeller
Video and the decoding parametric afterwards is sent to the terminal of multiple users, so that the terminal of multiple user is based on the decoding parametric solution
The code video；Due to being encoded without the addressable port of soft coding, the limitation of soft addressable port, also, this have been got around
Method is applicable to any type of terminal, to improve the compatibility of video processing.
It should be noted that：The video process apparatus that above-described embodiment provides is when video is handled, only with above-mentioned each function
The division progress of module, can be as needed and by above-mentioned function distribution by different function moulds for example, in practical application
Block is completed, i.e., the internal structure of equipment is divided into different function modules, to complete all or part of work(described above
Energy.In addition, the video process apparatus that above-described embodiment provides belongs to same design with method for processing video frequency embodiment, it is specific real
Existing process refers to embodiment of the method, and which is not described herein again.
Fig. 8 is a kind of structural schematic diagram of terminal provided in an embodiment of the present invention.The terminal 800 can be：Smart mobile phone,
Tablet computer, MP3 player (Moving Picture Experts Group Audio Layer III, dynamic image expert
Compression standard audio level 3), (Moving Picture Experts Group Audio Layer IV, dynamic image are special by MP4
Family's compression standard audio level 4) player, laptop or desktop computer.Terminal 800 be also possible to be referred to as user equipment,
Other titles such as portable terminal, laptop terminal, terminal console.
In general, terminal 800 includes：Processor 801 and memory 802.
Processor 801 may include one or more processing cores, such as 4 core processors, 8 core processors etc..Place
DSP (Digital Signal Processing, Digital Signal Processing), FPGA (Field- may be used in reason device 801
Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, may be programmed
Logic array) at least one of example, in hardware realize.Processor 801 can also include primary processor and coprocessor, master
Processor is the processor for being handled data in the awake state, also referred to as CPU (Central Processing
Unit, central processing unit)；Coprocessor is the low power processor for being handled data in the standby state.?
In some embodiments, processor 801 can be integrated with GPU (Graphics Processing Unit, image processor),
GPU is used to be responsible for the rendering and drafting of content to be shown needed for display screen.In some embodiments, processor 801 can also wrap
AI (Artificial Intelligence, artificial intelligence) processor is included, the AI processors are for handling related machine learning
Calculating operation.
Memory 802 may include one or more computer readable storage mediums, which can
To be non-transient.Memory 802 may also include high-speed random access memory and nonvolatile memory, such as one
Or multiple disk storage equipments, flash memory device.In some embodiments, the non-transient computer in memory 802 can
Storage medium is read for storing at least one instruction, at least one instruction is for performed to realize this Shen by processor 801
Please in embodiment of the method provide method for processing video frequency.
In some embodiments, terminal 800 is also optional includes：Peripheral device interface 803 and at least one peripheral equipment.
It can be connected by bus or signal wire between processor 801, memory 802 and peripheral device interface 803.Each peripheral equipment
It can be connected with peripheral device interface 803 by bus, signal wire or circuit board.Specifically, peripheral equipment includes：Radio circuit
804, at least one of touch display screen 805, camera 806, voicefrequency circuit 807, positioning component 808 and power supply 809.
Peripheral device interface 803 can be used for I/O (Input/Output, input/output) is relevant at least one outer
Peripheral equipment is connected to processor 801 and memory 802.In some embodiments, processor 801, memory 802 and peripheral equipment
Interface 803 is integrated on same chip or circuit board；In some other embodiments, processor 801, memory 802 and outer
Any one or two in peripheral equipment interface 803 can realize on individual chip or circuit board, the present embodiment to this not
It is limited.
Radio circuit 804 is for receiving and emitting RF (Radio Frequency, radio frequency) signal, also referred to as electromagnetic signal.It penetrates
Frequency circuit 804 is communicated by electromagnetic signal with communication network and other communication equipments.Radio circuit 804 turns electric signal
It is changed to electromagnetic signal to be sent, alternatively, the electromagnetic signal received is converted to electric signal.Optionally, radio circuit 804 wraps
It includes：Antenna system, RF transceivers, one or more amplifiers, tuner, oscillator, digital signal processor, codec chip
Group, user identity module card etc..Radio circuit 804 can be carried out by least one wireless communication protocol with other terminals
Communication.The wireless communication protocol includes but not limited to：Metropolitan Area Network (MAN), each third generation mobile communication network (2G, 3G, 4G and 5G), wireless office
Domain net and/or WiFi (Wireless Fidelity, Wireless Fidelity) network.In some embodiments, radio circuit 804 may be used also
To include the related circuits of NFC (Near Field Communication, wireless near field communication), the application is not subject to this
It limits.
Display screen 805 is for showing UI (User Interface, user interface).The UI may include figure, text, figure
Mark, video and its their arbitrary combination.When display screen 805 is touch display screen, display screen 805 also there is acquisition to show
The ability of the surface of screen 805 or the touch signal of surface.The touch signal can be used as control signal to be input to processor
801 are handled.At this point, display screen 805 can be also used for providing virtual push button and/or dummy keyboard, also referred to as soft button and/or
Soft keyboard.In some embodiments, display screen 805 can be one, and the front panel of terminal 800 is arranged；In other embodiments
In, display screen 805 can be at least two, be separately positioned on the different surfaces of terminal 800 or in foldover design；In still other reality
Apply in example, display screen 805 can be flexible display screen, be arranged on the curved surface of terminal 800 or fold plane on.Even, it shows
Display screen 805 can also be arranged to non-rectangle irregular figure, namely abnormity screen.LCD (Liquid may be used in display screen 805
Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode)
Etc. materials prepare.
CCD camera assembly 806 is for acquiring image or video.Optionally, CCD camera assembly 806 include front camera and
Rear camera.In general, the front panel in terminal is arranged in front camera, rear camera is arranged at the back side of terminal.One
In a little embodiments, rear camera at least two is main camera, depth of field camera, wide-angle camera, focal length camera shooting respectively
Any one in head, to realize that main camera and the fusion of depth of field camera realize background blurring function, main camera and wide-angle
Camera fusion realizes that pan-shot and VR (Virtual Reality, virtual reality) shooting functions or other fusions are clapped
Camera shooting function.In some embodiments, CCD camera assembly 806 can also include flash lamp.Flash lamp can be monochromatic warm flash lamp,
It can also be double-colored temperature flash lamp.Double-colored temperature flash lamp refers to the combination of warm light flash lamp and cold light flash lamp, be can be used for not
With the light compensation under colour temperature.
Voicefrequency circuit 807 may include microphone and loud speaker.Microphone is used to acquire the sound wave of user and environment, and will
Sound wave, which is converted to electric signal and is input to processor 801, to be handled, or is input to radio circuit 804 to realize voice communication.
For stereo acquisition or the purpose of noise reduction, microphone can be multiple, be separately positioned on the different parts of terminal 800.Mike
Wind can also be array microphone or omnidirectional's acquisition type microphone.Loud speaker is then used to that processor 801 or radio circuit will to be come from
804 electric signal is converted to sound wave.Loud speaker can be traditional wafer speaker, can also be piezoelectric ceramic loudspeaker.When
When loud speaker is piezoelectric ceramic loudspeaker, the audible sound wave of the mankind can be not only converted electrical signals to, it can also be by telecommunications
Number the sound wave that the mankind do not hear is converted to carry out the purposes such as ranging.In some embodiments, voicefrequency circuit 807 can also include
Earphone jack.
Positioning component 808 is used for the current geographic position of positioning terminal 800, to realize navigation or LBS (Location
Based Service, location based service).Positioning component 808 can be the GPS (Global based on the U.S.
Positioning System, global positioning system), the dipper system of China, Russia Gray receive this system or European Union
The positioning component of Galileo system.
Power supply 809 is used to be powered for the various components in terminal 800.Power supply 809 can be alternating current, direct current,
Disposable battery or rechargeable battery.When power supply 809 includes rechargeable battery, which can support wired charging
Or wireless charging.The rechargeable battery can be also used for supporting fast charge technology.
In some embodiments, terminal 800 further include there are one or multiple sensors 810.The one or more sensors
810 include but not limited to：Acceleration transducer 811, gyro sensor 812, pressure sensor 813, fingerprint sensor 814,
Optical sensor 815 and proximity sensor 816.
The acceleration that acceleration transducer 811 can detect in three reference axis of the coordinate system established with terminal 800 is big
It is small.For example, acceleration transducer 811 can be used for detecting component of the acceleration of gravity in three reference axis.Processor 801 can
With the acceleration of gravity signal acquired according to acceleration transducer 811, control touch display screen 805 is regarded with transverse views or longitudinal direction
Figure carries out the display of user interface.Acceleration transducer 811 can be also used for game or the acquisition of the exercise data of user.
Gyro sensor 812 can be with the body direction of detection terminal 800 and rotational angle, and gyro sensor 812 can
To cooperate with acquisition user to act the 3D of terminal 800 with acceleration transducer 811.Processor 801 is according to gyro sensor 812
Following function may be implemented in the data of acquisition：When action induction (for example changing UI according to the tilt operation of user), shooting
Image stabilization, game control and inertial navigation.
The lower layer of side frame and/or touch display screen 805 in terminal 800 can be arranged in pressure sensor 813.Work as pressure
The gripping signal that user can be detected in the side frame of terminal 800 to terminal 800 is arranged in sensor 813, by processor 801
Right-hand man's identification or prompt operation are carried out according to the gripping signal that pressure sensor 813 acquires.When the setting of pressure sensor 813 exists
When the lower layer of touch display screen 805, the pressure operation of touch display screen 805 is realized to UI circle according to user by processor 801
Operability control on face is controlled.Operability control includes button control, scroll bar control, icon control, menu
At least one of control.
Fingerprint sensor 814 is used to acquire the fingerprint of user, collected according to fingerprint sensor 814 by processor 801
The identity of fingerprint recognition user, alternatively, by fingerprint sensor 814 according to the identity of collected fingerprint recognition user.It is identifying
When the identity for going out user is trusted identity, the user is authorized to execute relevant sensitive operation, the sensitive operation packet by processor 801
Include solution lock screen, check encryption information, download software, payment and change setting etc..Terminal can be set in fingerprint sensor 814
800 front, the back side or side.When being provided with physical button or manufacturer Logo in terminal 800, fingerprint sensor 814 can be with
It is integrated with physical button or manufacturer Logo.
Optical sensor 815 is for acquiring ambient light intensity.In one embodiment, processor 801 can be according to optics
The ambient light intensity that sensor 815 acquires controls the display brightness of touch display screen 805.Specifically, when ambient light intensity is higher
When, the display brightness of touch display screen 805 is turned up；When ambient light intensity is relatively low, the display for turning down touch display screen 805 is bright
Degree.In another embodiment, the ambient light intensity that processor 801 can also be acquired according to optical sensor 815, dynamic adjust
The acquisition parameters of CCD camera assembly 806.
Proximity sensor 816, also referred to as range sensor are generally arranged at the front panel of terminal 800.Proximity sensor 816
The distance between front for acquiring user and terminal 800.In one embodiment, when proximity sensor 816 detects use
When family and the distance between the front of terminal 800 taper into, touch display screen 805 is controlled from bright screen state by processor 801
It is switched to breath screen state；When proximity sensor 816 detects user and the distance between the front of terminal 800 becomes larger,
Touch display screen 805 is controlled by processor 801 and is switched to bright screen state from breath screen state.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal 800 of structure shown in Fig. 8, can wrap
It includes than illustrating more or fewer components, either combine certain components or is arranged using different components.
Fig. 9 is a kind of structural schematic diagram of server provided in an embodiment of the present invention, which can be because of configuration or property
Energy is different and generates bigger difference, may include one or more processors (central processing
Units, CPU) 901 and one or more memory 902, wherein at least one finger is stored in the memory 902
It enables, at least one instruction is loaded by the processor 901 and executed to realize regarding for above-mentioned each embodiment of the method offer
Frequency processing method.Certainly, which can also have the portions such as wired or wireless network interface, keyboard and input/output interface
Part, to carry out input and output, which can not also do superfluous herein including other for realizing the component of functions of the equipments
It states.
In the exemplary embodiment, a kind of computer readable storage medium, such as the memory including instruction are additionally provided,
Above-metioned instruction can be executed by the processor in terminal to complete the method for processing video frequency in above-described embodiment.For example, the calculating
Machine readable storage medium storing program for executing can be ROM, random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices
Deng.
One of ordinary skill in the art will appreciate that realizing that all or part of step of above-described embodiment can pass through hardware
It completes, relevant hardware can also be instructed to complete by program, the program being somebody's turn to do can be stored in a kind of computer-readable deposit
In storage media, storage medium mentioned above can be read-only memory, disk or CD etc..
It should be only above presently preferred embodiments of the present invention, be not intended to limit the invention, all spirit and original in the present invention
Within then, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.
Claims (16)
1. a kind of method for processing video frequency, which is characterized in that the method includes：
Based on default hard coded parameter, decoding parametric is obtained, the decoding parametric is to being compiled using the default hard coded parameter
The video of code processing parameter required when being decoded；
Impeller is obtained, the impeller is written into the decoding parametric, the impeller is used for pending video push
To the terminal of multiple users；
The pending video is obtained, by target processor and the default hard coded parameter, described pending is regarded
The carry out hard coded processing of frequency, the target processor are other processors other than central processor CPU；
Hard coded treated video and the decoding parametric are sent to the terminal of multiple users by the impeller.
2. according to the method described in claim 1, it is characterized in that, described based on default hard coded parameter, acquisition decoding parametric
Including：
Under preview state, preview image is acquired, by the target processor and the default hard coded parameter, to described pre-
Image of looking at carries out hard coded processing, obtains the first file of target envelope format；
The configuration parameter of the preview image is determined as by the configuration parameter that the preview image is extracted from first file
The decoding parametric of follow-up hard coded treated pending video.
3. according to the method described in claim 2, it is characterized in that, the default hard coded parameter include code check, frame per second and/or
Key frame interval；The decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
4. according to the method described in claim 1, it is characterized in that, the acquisition impeller, institute is written by the decoding parametric
Stating impeller includes：
When receiving sign on, the impeller is created, extradata parameters in the impeller are revised as the solution
Code parameter, and starts the impeller, and the sign on, which is used to indicate, to be started the pending video push to described more
The terminal of a user, the extradata parameters are used to carry decoding parametric when carrying out coded treatment to video.
5. according to the method described in claim 1, it is characterized in that, described obtain the pending video, at target
Device and the default hard coded parameter are managed, the carry out hard coded processing to the pending video includes：
When receiving sign on, the video data of the pending video is acquired, the target processor and institute are passed through
Default hard coded parameter is stated, hard coded processing is carried out to the corresponding multiple image of the video data, the sign on is used for
Instruction starts the terminal of the pending video push to the multiple user；
By the target processor, the second file is created, and by hard coded treated multiple image write-in second text
The encapsulation format of part, second file is target envelope format.
6. according to the method described in claim 5, it is characterized in that, the method further includes：
It is written in second file processes by the hard coded treated multiple image, monitors the text of second file
Part size creates third file, and the hard coded is handled when the file size of second file is more than predetermined threshold value
The third file, the encapsulation lattice of the third file are written in the image that second file is had not been written in multiple image afterwards
Formula is target envelope format.
7. according to the method described in claim 5, it is characterized in that, described by the impeller, by hard coded, treated regards
Frequency and the decoding parametric are sent to the terminal of multiple users：
When monitoring in second file there are when hard coded treated multiple image, according to the encapsulation of second file
Format reads the hard coded from second file treated multiple image；
By the hard coded, treated that multiple image is sent to the impeller, by the impeller, according to pre- setting video
The hard coded treated multiple image and the decoding parametric are encapsulated as the 4th file, by described by flow host-host protocol
Four files are sent to the terminal of the multiple user, the target envelope of the encapsulation format and second file of the 4th file
Format differs.
8. a kind of video process apparatus, which is characterized in that described device includes：
Acquisition module, for based on default hard coded parameter, obtaining decoding parametric, the decoding parametric is to using described default
The video of hard coded parameter coding processing parameter required when being decoded；
For obtaining impeller the impeller is written, the impeller will be for that will wait locating in the decoding parametric by writing module
The video push of reason to multiple users terminal；
Coding module, for obtaining the pending video, by target processor and the default hard coded parameter, to institute
The carry out hard coded processing of pending video is stated, the target processor is other processors other than central processor CPU；
Sending module, for hard coded treated video and the decoding parametric to be sent to multiple use by the impeller
The terminal at family.
9. device according to claim 8, which is characterized in that
The acquisition module acquires preview image under preview state, by the target processor and described default hard
Coding parameter carries out hard coded processing to the preview image, obtains the first file of target envelope format；From first text
The configuration parameter that the preview image is extracted in part, after the configuration parameter of the preview image is determined as follow-up hard coded processing
Pending video decoding parametric.
10. device according to claim 9, which is characterized in that the default hard coded parameter include code check, frame per second and/
Or key frame interval；The decoding parametric includes the sequence parameter set SPS and/or picture parameter set PPS of first file.
11. device according to claim 8, which is characterized in that
Said write module will be in the impeller for when receiving sign on, creating the impeller
Extradata parameters are revised as the decoding parametric, and start the impeller, and the sign on, which is used to indicate, to be started institute
Pending video push is stated to the terminal of multiple users, the extradata parameters carry out coded treatment for carrying to video
When decoding parametric.
12. device according to claim 8, which is characterized in that
The coding module, for when receiving sign on, acquiring the video data of the pending video, passing through institute
Target processor and the default hard coded parameter are stated, hard coded processing is carried out to the corresponding multiple image of the video data,
The sign on, which is used to indicate, to be started the terminal of the pending video push to the multiple user；Pass through the target
Processor creates the second file, and second file, second text is written in the hard coded treated multiple image
The encapsulation format of part is target envelope format.
13. device according to claim 12, which is characterized in that described device further includes：
Monitoring modular monitors institute for being written in second file processes by the hard coded treated multiple image
The file size for stating the second file creates third file, and will when the file size of second file is more than predetermined threshold value
The image that second file is had not been written in the hard coded treated multiple image is written the third file, and described the
The encapsulation format of three files is target envelope format.
14. device according to claim 12, which is characterized in that the sending module includes：
Reading unit, for when monitoring in second file there are when hard coded treated multiple image, according to described
The encapsulation format of second file reads the hard coded from second file treated multiple image；
Transmission unit, for by the hard coded, treated that multiple image is sent to the impeller, by the impeller,
According to default video flow host-host protocol, the hard coded treated multiple image and the decoding parametric are encapsulated as the 4th text
4th file is sent to the terminal of the multiple user, the encapsulation format of the 4th file and second text by part
The target envelope format of part differs.
15. a kind of computer equipment, which is characterized in that including processor and memory；The memory, for storing computer
Program；The processor realizes any one of claim 1-7 for executing the computer program stored on the memory
The method and step.
16. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium
Program realizes claim 1-7 any one of them method and steps when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810622141.5A CN108769738B (en) | 2018-06-15 | 2018-06-15 | Video processing method, video processing device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810622141.5A CN108769738B (en) | 2018-06-15 | 2018-06-15 | Video processing method, video processing device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769738A true CN108769738A (en) | 2018-11-06 |
| CN108769738B CN108769738B (en) | 2021-01-08 |
Family
ID=63978251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810622141.5A Active CN108769738B (en) | 2018-06-15 | 2018-06-15 | Video processing method, video processing device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769738B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110636337A (en) * | 2019-08-20 | 2019-12-31 | 腾讯科技（深圳）有限公司 | Video image intercepting method, device and system |
| WO2020118601A1 (en) * | 2018-12-13 | 2020-06-18 | 深圳市欢太科技有限公司 | Method, apparatus, electronic device, and storage medium for video encoding |
| CN111343499A (en) * | 2018-12-18 | 2020-06-26 | 北京奇虎科技有限公司 | Video synthesis method and device |
| CN111435995A (en) * | 2019-01-15 | 2020-07-21 | 北京字节跳动网络技术有限公司 | Method, device and system for generating dynamic picture |
| CN114401437A (en) * | 2022-01-10 | 2022-04-26 | 广东省翼瞰集成电路设计有限公司 | Method, system and related equipment for realizing function configuration through image data |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895743A (en) * | 2010-03-11 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for transmitting encoded and decoded data among processors, and visual telephone |
| US20140149828A1 (en) * | 2012-11-27 | 2014-05-29 | Lite-On It Corporation | Solid state drive and joint encoding/decoding method thereof |
| CN104604236A (en) * | 2012-07-02 | 2015-05-06 | 诺基亚公司 | Method and apparatus for video coding |
| CN106034257A (en) * | 2015-03-11 | 2016-10-19 | 北京昌东科技有限公司 | Multimedia application system based on radio and television |
| CN106804003A (en) * | 2017-03-09 | 2017-06-06 | 广州四三九九信息科技有限公司 | Video editing method and device based on ffmpeg |
| CN106911939A (en) * | 2017-01-06 | 2017-06-30 | 武汉烽火众智数字技术有限责任公司 | A kind of video transcoding method, apparatus and system |
-
2018
- 2018-06-15 CN CN201810622141.5A patent/CN108769738B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101895743A (en) * | 2010-03-11 | 2010-11-24 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for transmitting encoded and decoded data among processors, and visual telephone |
| CN104604236A (en) * | 2012-07-02 | 2015-05-06 | 诺基亚公司 | Method and apparatus for video coding |
| US20140149828A1 (en) * | 2012-11-27 | 2014-05-29 | Lite-On It Corporation | Solid state drive and joint encoding/decoding method thereof |
| CN106034257A (en) * | 2015-03-11 | 2016-10-19 | 北京昌东科技有限公司 | Multimedia application system based on radio and television |
| CN106911939A (en) * | 2017-01-06 | 2017-06-30 | 武汉烽火众智数字技术有限责任公司 | A kind of video transcoding method, apparatus and system |
| CN106804003A (en) * | 2017-03-09 | 2017-06-06 | 广州四三九九信息科技有限公司 | Video editing method and device based on ffmpeg |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020118601A1 (en) * | 2018-12-13 | 2020-06-18 | 深圳市欢太科技有限公司 | Method, apparatus, electronic device, and storage medium for video encoding |
| CN111343499A (en) * | 2018-12-18 | 2020-06-26 | 北京奇虎科技有限公司 | Video synthesis method and device |
| CN111435995A (en) * | 2019-01-15 | 2020-07-21 | 北京字节跳动网络技术有限公司 | Method, device and system for generating dynamic picture |
| CN111435995B (en) * | 2019-01-15 | 2022-05-17 | 北京字节跳动网络技术有限公司 | Method, device and system for generating dynamic picture |
| CN110636337A (en) * | 2019-08-20 | 2019-12-31 | 腾讯科技（深圳）有限公司 | Video image intercepting method, device and system |
| CN110636337B (en) * | 2019-08-20 | 2021-08-17 | 腾讯科技（深圳）有限公司 | Video image intercepting method, device and system |
| CN114401437A (en) * | 2022-01-10 | 2022-04-26 | 广东省翼瞰集成电路设计有限公司 | Method, system and related equipment for realizing function configuration through image data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769738B (en) | 2021-01-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108769738A (en) | Method for processing video frequency, device, computer equipment and storage medium | |
| US9836267B2 (en) | Image/audio playback device of mobile communication terminal | |
| CN108093268B (en) | Live broadcast method and device | |
| CN108900859A (en) | Live broadcasting method and system | |
| CN109874043B (en) | Video stream sending method, video stream playing method and video stream playing device | |
| CN109191549A (en) | Show the method and device of animation | |
| CN117063461A (en) | Image processing method and electronic equipment | |
| CN110121084A (en) | The methods, devices and systems of port switching | |
| CN113835649A (en) | Screen projection method and terminal | |
| CN108616776A (en) | Live streaming analysis data capture method and device | |
| CN114040242A (en) | Screen projection method and electronic equipment | |
| CN108965711B (en) | Video processing method and device | |
| CN115237359A (en) | Projection screen display parameter adjusting method | |
| US20240064346A1 (en) | Video Switching Method and Apparatus, Storage Medium, and Device | |
| CN113593567B (en) | Method for converting video and sound into text and related equipment | |
| EP3893529A1 (en) | Communication method based on bluetooth low energy, and related apparatus | |
| CN111478915B (en) | Live broadcast data stream pushing method and device, terminal and storage medium | |
| CN109819314A (en) | Audio/video processing method, device, terminal and storage medium | |
| WO2019033880A1 (en) | Method and system for performing data customization on basic service data | |
| US20230335081A1 (en) | Display Synchronization Method, Electronic Device, and Readable Storage Medium | |
| CN114827581A (en) | Synchronization delay measuring method, content synchronization method, terminal device, and storage medium | |
| CN109714628A (en) | Method, apparatus, equipment, storage medium and the system of playing audio-video | |
| CN110913213B (en) | Method, device and system for evaluating and processing video quality | |
| CN111478914B (en) | Timestamp processing method, device, terminal and storage medium | |
| CN116797767A (en) | Augmented reality scene sharing method and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220330 Address after: 4119, 41st floor, building 1, No.500, middle section of Tianfu Avenue, Chengdu hi tech Zone, China (Sichuan) pilot Free Trade Zone, Chengdu, Sichuan 610000 Patentee after: Chengdu kugou business incubator management Co.,Ltd. Address before: No. 315, Huangpu Avenue middle, Tianhe District, Guangzhou City, Guangdong Province Patentee before: GUANGZHOU KUGOU COMPUTER TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |