CN108377400A - A kind of image transmitting optimization method, system and its apparatus - Google Patents
A kind of image transmitting optimization method, system and its apparatus Download PDFInfo
- Publication number
- CN108377400A CN108377400A CN201810186385.3A CN201810186385A CN108377400A CN 108377400 A CN108377400 A CN 108377400A CN 201810186385 A CN201810186385 A CN 201810186385A CN 108377400 A CN108377400 A CN 108377400A
- Authority
- CN
- China
- Prior art keywords
- low
- video flowing
- frame
- buffer memory
- receiving terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 62
- 238000005457 optimization Methods 0.000 title claims abstract description 41
- 230000005540 biological transmission Effects 0.000 claims abstract description 35
- 230000009467 reduction Effects 0.000 claims abstract description 24
- 238000012545 processing Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000006854 communication Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000033001 locomotion Effects 0.000 description 2
- 230000002441 reversible effect Effects 0.000 description 2
- 206010049669 Dyscalculia Diseases 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000008485 antagonism Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000005243 fluidization Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010025 steaming Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000010415 tropism Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention provides a kind of image transmitting optimization method, system and its apparatus, wherein the method includes：The transmitting terminal reduction pre-reads frame number to the video flowing, generates drop frame video data and by the drop frame video data encoding at low frame video flowing according to the frame number that pre-reads, is sent to the receiving terminal；The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to which the low frame video flowing is cached and decoded according to the low preset buffer memory amount.Method provided by the present invention is when being transmitted the larger video flowing of data volume, the optimization of frame rate reduction processing and buffer memory is carried out to video streaming image, to substantially reduce delay situation of the video streaming image in transmission process, realize non-delay in video stream transmission procedure and interim card situation, lip synchronization can play video flowing in real time, and great convenience is brought for the work of image viewing personnel.
Description
Technical field
The present invention relates to image transmission technology field, more specifically to a kind of image transmitting optimization method, system and
Its device.
Background technology
Image transmitting is to carry out information source and Channel Processing with certain requirement, transmits or store in real time or in time image letter
The process of breath.Image, which is the media such as the scenery reproduction on certain medium, such as picture, film, fax, TV, to be made
Obtain image information.Image information is transmitted to a distant place or stores the process of image information, is referred to as image transmitting.Image passes
It is defeated, may include wire transmission and wireless transmission.
During carrying out image transmitting, such as in the technology of recognition of face, by acquiring real-time face characteristic
It forms video flowing and is simultaneously transmitted storage, larger because of video in transmission process, the case where being susceptible to interim card makes video pass
The case where postponing during defeated.
In short, in existing image transmission technology, since transmission image data amount is big, transmission of video is caused to occur serious
The phenomenon that interim card, delay, causes acoustic image is asynchronous, plays image temporal to lag serious, poor in timeliness, Wu Fagen to a certain extent
Accurately judged according to the image of reception, great inconvenience is brought for the work of image viewing personnel.
Invention content
In view of this, the present invention provides a kind of image transmitting optimization method, system and its apparatus to solve the prior art
It is insufficient.
To solve the above problems, the present invention provides a kind of image transmitting optimization method, be applied to transmitting terminal and receiving terminal it
Between, including：
The transmitting terminal reduction pre-reads frame number to the video flowing, and drop frame video data is generated according to the frame number that pre-reads
And the drop frame video data encoding is sent to the receiving terminal at low frame video flowing；
The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory amount
The low frame video flowing is cached and decoded.
It is preferably, described that " the transmitting terminal reduction pre-reads frame number to the video flowing, is generated according to the frame number that pre-reads
Drop frame video data and by the drop frame video data encoding at low frame video flowing, be sent to the receiving terminal " include：
The transmitting terminal pre-reads frame number described in reducing, and frame number is pre-read after being reduced；
The transmitting terminal picks up the video flowing according to the frame number that pre-reads after the reduction at equal intervals, obtains target
Frame data；
Based on coding protocol, the transmitting terminal becomes low frame video flowing to the target frame data encoding；
The transmitting terminal is by the low frame video stream to the receiving terminal.
Preferably, the frame number that pre-reads after the reduction is 2 frames.
Preferably, the low preset buffer memory amount is 32 bytes.
It is preferably, described that " receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to
Low preset buffer memory amount is cached and is decoded to the low frame video flowing " before, further include：
The receiving terminal increases in each frame in the low frame video flowing after receiving the low frame video flowing between pixel
Pixel difference.
Preferably, described " to be based on coding protocol, the transmitting terminal becomes low frame video to the target frame data encoding
After stream ", including：
Based on elliptic curve encryption algorithm, the low frame video flowing is encrypted in the transmitting terminal；
It is described that " receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to described low default
Buffer memory is cached and is decoded to the low frame video flowing " before, further include：
Based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal.
Preferably, described " being based on elliptic curve encryption algorithm, the low frame video flowing is encrypted in the transmitting terminal " includes：
Based on elliptic curve encryption algorithm, the transmitting terminal generates public key corresponding with the low frame video flowing and private key；
The transmitting terminal, to the low frame video stream encryption, is generated by the public key and encrypts low frame video flowing；
Private key frame video low with the encryption is flowed to the receiving terminal transmission by the transmitting terminal；
" based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal " includes：
The receiving terminal receives the private key and encrypts low frame video flowing with described；
The receiving terminal decrypts the low frame video flowing of the encryption according to the private key, and the low frame after being decrypted regards
Frequency flows, and obtains low preset buffer memory amount in order to reduce preset buffer memory frame number and carries out the decoding to the low frame video flowing.
In addition, to solve the above problems, the present invention also provides a kind of image transmitting optimization system, including transmitting terminal with receive
End, which is characterized in that
The transmitting terminal reduction pre-reads frame number to the video flowing, and drop frame video data is generated according to the frame number that pre-reads
And the drop frame video data encoding is sent to the receiving terminal at low frame video flowing；
The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory amount
The low frame video flowing is cached and decoded.
In addition, to solve the above problems, the present invention also provides a kind of image transmittings to optimize device, including transmitting terminal and reception
End, wherein the transmitting terminal includes first memory and first processor, the receiving terminal includes at second memory and second
Device is managed, the first memory and the second memory are used to storage image transmitting optimization program, the first processor
Described image transmission optimization program is run with the second processor so that described image transmission optimization device is executed as above-mentioned
Described image transmission optimization method.
In addition, to solve the above problems, the present invention also provides a kind of computer readable storage medium, it is described computer-readable
It is stored with image transmitting optimization program on storage medium, is realized as above-mentioned when described image transmission optimization program is executed by processor
Described image transmission optimization method.
A kind of image transmitting optimization method provided by the invention, system and its apparatus.Wherein, method provided by the present invention
By the way that normal video flowing by frame rate reduction processing and is encoded to low frame video flowing, it is then pushed to receiving terminal, receiving terminal is into one
Step carries out preset buffer memory frame number to be reduced to low preset buffer memory amount, in order to further be conciliate to the caching of low frame video flowing
Code carries out video streaming image the optimization of frame rate reduction processing and buffer memory that is, when being transmitted to the larger video flowing of data volume,
To substantially reduce delay situation of the video streaming image in transmission process, non-delay and interim card in video stream transmission procedure is realized
Situation, lip synchronization can play video flowing in real time, and great convenience is brought for the work of image viewing personnel.
Description of the drawings
Fig. 1 is the structural schematic diagram for the hardware running environment that image transmitting optimization method example scheme of the present invention is related to；
Fig. 2 is the flow diagram of image transmitting optimization method first embodiment of the present invention；
Fig. 3 is the flow diagram of image transmitting optimization method second embodiment of the present invention；
Fig. 4 is the flow diagram of image transmitting optimization method 3rd embodiment of the present invention；
Fig. 5 is the flow diagram of image transmitting optimization method fourth embodiment of the present invention；
The refinement flow signal that Fig. 6 is the step S15 and step S16 of image transmitting optimization method fourth embodiment of the present invention
Figure.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, in which the same or similar labels are throughly indicated same or like
Element or element with the same or similar functions.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more this feature.In the description of the present invention, the meaning of " plurality " is two or more,
Unless otherwise specifically defined.
In the present invention unless specifically defined or limited otherwise, term " installation ", " connected ", " connection ", " fixation " etc.
Term shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integral；Can be that machinery connects
It connects, can also be electrical connection；It can be directly connected, can also can be indirectly connected through an intermediary in two elements
The interaction relationship of the connection in portion or two elements.It for the ordinary skill in the art, can be according to specific feelings
Condition understands the concrete meaning of above-mentioned term in the present invention.
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
As shown in Figure 1, the structural schematic diagram of the hardware running environment for the terminal that Fig. 1, which is the embodiment of the present invention, to be related to.
System of the embodiment of the present invention can be PC, can also be that smart mobile phone, tablet computer, E-book reader, MP3 are broadcast
Putting device, MP4 players, pocket computer etc. has the packaged type terminal device of display function.
As shown in Figure 1, the system may include transmitting terminal and receiving terminal, either end or multiterminal may each comprise：Place
Manage device 1001, such as CPU, network interface 1004, user interface 1003, memory 1005, communication bus 1002.Wherein, it communicates
Bus 1002 is for realizing the connection communication between these components.User interface 1003 may include display screen, input unit ratio
Such as keyboard, remote controler, optional user interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004
Optional may include standard wireline interface and wireless interface (such as WI-FI interfaces).Memory 1005 can be that high-speed RAM is deposited
Reservoir can also be stable memory, such as magnetic disk storage.Memory 1005 optionally can also be independently of aforementioned place
Manage the storage device of device 1001.
Optionally, in the system any one end can also include camera, RF (Radio Frequency, radio frequency) circuit,
Sensor, voicefrequency circuit, WiFi module etc..In addition, any one end can also configure gyroscope, barometer, humidity in the system
The other sensors such as meter, thermometer, infrared sensor, details are not described herein.
It will be understood by those skilled in the art that system shown in Fig. 1 does not constitute the restriction to the system, can wrap
It includes than illustrating more or fewer components, either combines certain components or different components arrangement.
As shown in Figure 1, as may include operating system, number in a kind of memory 1005 of computer readable storage medium
Optimize program according to interface control program, network attachment procedure and image transmitting.
A kind of image transmitting optimization method provided by the invention, system and its apparatus.Wherein, the method is to video flow graph
Optimization as carrying out frame rate reduction processing and buffer memory, it is real to substantially reduce delay situation of the video streaming image in transmission process
Non-delay and interim card situation in existing video stream transmission procedure, lip synchronization can play video flowing in real time, be image viewing personnel's
Work brings great convenience.
Embodiment 1：
With reference to Fig. 2, first embodiment of the invention provides a kind of image transmitting optimization method, including：
Step S10, the transmitting terminal reduction pre-read frame number to the video flowing, and drop frame is generated according to the frame number that pre-reads
Video data and by the drop frame video data encoding at low frame video flowing, be sent to the receiving terminal；
It is above-mentioned, it is to be understood that frame number (Frames) is the abbreviation of frame generation quantity.Due to spoken customary original
Cause, we usually obscure frame number and frame per second.Each frame is all static image, in extremely rapid succession shows that frame just forms movement
Illusion, therefore high frame per second can obtain animation more smooth, more true to nature.For example, rate (Speed)=distance
(Distance)/time (Time), unit are metre per second (m/s) (m/s, meterspersecond, mps)；Similarly, frame per second (Frame
Rate)=frame number (Frames)/time (Time), unit are that frame is (f/s, frames per second, fps) per second.As,
If the constant frame per second of an animation is that 60 frames are (fps) per second, its frame number in one second is 60 frames, in two seconds
Frame number is 120 frames.
It is above-mentioned, it is to be understood that so-called Video coding mode refers to just by specific compress technique, by some video
The file of format is converted into the mode of another video format file.Mostly important encoding and decoding standard has state in video steaming transfer
Border Electricity Federation H.261, H.263, H.264, the M-JPEG and International Organization for standardization's moving image of motor rest motion picture expert group version
The MPEG series standards of expert group, the also RealVideo of Real-Networks being widely used on the internet in addition,
The QuickTime etc. of the WMV and Apple companies of Microsoft.
Above-mentioned, transmitting terminal pre-reads the further calculating code check of frame number progress by reducing, and it is outer to ensure that video stream bit rate meets
Portion is set, and to generate drop frame video data, is then encoded and generated low frame video flowing, and by the low frame video stream
To receiving terminal.
Step S20, the receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to described low pre-
If buffer memory is cached and is decoded to the low frame video flowing.
It is above-mentioned, it is to be understood that caching is exactly the buffering area (being referred to as Cache) of data exchange, when a certain hardware will be read
Access according to when, the data of needs can be searched from caching first, are directly executed if having found, can not find if if from memory
In look for.Since the speed of service of caching is more faster than memory, therefore the effect cached is just to aid in hardware and quickly runs.Because slow
It deposits and often uses RAM (the impermanent storage that power-off is fallen), deposited so after being finished still file can be sent to hard disk etc.
It is permanently stored in reservoir.
It is above-mentioned, it is to be understood that decoding be it is a kind of using ad hoc approach, number is reduced into representated by it and perhaps will
Electric impulse signal, optical signal, radio wave etc. are converted into the process of information, data representated by it etc..Decoding is will by biography person
The symbol or code reverse received is the process of information, corresponding with cataloged procedure.It refers to by biography person to decode (Decoding)
It is corresponding with cataloged procedure by the process that the symbol received or code reverse are information.Decoding activities will be by the society of audient
The influence of meeting status and culture background, embodies the diversity of society, and the decoding of audient also has same tropism, antagonism, tendency towards compromise
Three kinds of forms.The handshaking procedures of coding and decoding are substantially exactly simple communication process.If the table of symbol tool or symbol
Existing level is determined by coding person, then the content level of Signifier or symbol is then determined by decoding person.
In a computer network, network is interconnected computer by communication network to realize resource-sharing and data transmission.
When the signal form of the communication network signal form and transmission device that use is different, the conversion of signal form must be just carried out.
Generally the signal form carried out in sender conversion is known as encoding, the signal form that recipient carries out is converted into decoding.
Above-mentioned, in the present embodiment, after getting video flowing, encoding tool needs to cache regarding for a certain size receiving terminal
Frequency frame could be decoded or be played, usually 32 frames, need waiting to be lot more time to low bit-rate video stream (1 second 2 frame)
Gather together enough caching.By manual control preset buffer memory frame number size mode, can start to decode sectional drawing at the first time.In the present embodiment
In, it is to cause the inadaptable adjustment done of general utility tool algorithm for high turn of low algorithm to reduce preset buffer memory frame number.
The method that the present embodiment is provided by the way that normal video flowing by frame rate reduction processing and is encoded to low frame video flowing,
Then it is pushed to receiving terminal, receiving terminal further carries out preset buffer memory frame number to be reduced to low preset buffer memory amount, in order into one
The caching to low frame video flowing of step and decoding, i.e., when being transmitted to the larger video flowing of data volume, to video streaming image
The optimization for carrying out frame rate reduction processing and buffer memory is realized to substantially reduce delay situation of the video streaming image in transmission process
Non-delay and interim card situation, lip synchronization can play video flowing in real time in video stream transmission procedure, be the work of image viewing personnel
Bring great convenience.
Embodiment 2：
With reference to Fig. 3, second embodiment of the invention provides a kind of image transmitting optimization method, based on above-mentioned shown in Fig. 2 the
One embodiment, " the transmitting terminal reduction pre-reads frame number to the step S10 to the video flowing, and frame number life is pre-read according to described
At drop frame video data and by the drop frame video data encoding at low frame video flowing, it is sent to the receiving terminal " include：
Step S11, the transmitting terminal reduce described in pre-read frame number, pre-read frame number after being reduced；
Preferably, the frame number that pre-reads after the reduction is 2 frames.
It is above-mentioned, in the present embodiment, on mini PC of the transmitting terminal using the acceleration of intel qsv hardware videos, due to code check
Demand for control, encryption algorithm can calculate required code check by way of look ahead multitude of video frames, lead to low bit- rate
In the case of the huge delay situation of appearance to a certain extent.
It is above-mentioned, it is to be understood that look ahead are to pre-read video frame algorithm parameter, default setting be read 32 frames into
Row calculates code check, ensures that video stream bit rate meets external setting-up, which goes receiving terminal, receiving terminal that can just open
Beginning is handled.16 seconds are needed for 2 frames/second low bit-rate video, by using 2 parameters of-look_ahead_depth in ffmpeg
Control pre-reads frame number, will pre-read frame number and is reduced to 2, such very short time can start plug-flow, significantly optimizing delay.
It is above-mentioned, it is to be understood that FFmpeg be it is a set of can be used for recording, converted digital audio, video, and can be by it
It is converted into the computer program of increasing income of stream.Using LGPL or GPL licensings.It provides recording, conversion and fluidisation audio and video
Total solution.It contains very advanced audio/video encoding and decoding library libavcodec, in order to ensure high portable
Property and encoding and decoding quality, from the beginning many code are developed in libavcodec.
Step S12, the transmitting terminal pick up the video flowing according to the frame number that pre-reads after the reduction at equal intervals,
Obtain target frame data.
It is above-mentioned, in the present embodiment, accessed video flowing is picked up at equal intervals by the frame number that pre-reads after reduction
It takes, as extracts wherein target frame at equal intervals, to realize to the frame rate reduction processing of wherein target frame, obtain target frame data.
Step S13, is based on coding protocol, and the transmitting terminal becomes low frame video flowing to the target frame data encoding.
Step S14, the transmitting terminal is by the low frame video stream to the receiving terminal.
It is above-mentioned, it is based on coding protocol, target frame data are carried out to be encoded to low frame video flowing, become playable video, into
And by the video stream to receiving terminal, to reduce receiving terminal in the delay generated when acquisition plays in real time.
Embodiment 3：
With reference to Fig. 4, third embodiment of the invention provides a kind of image transmitting optimization method, based on above-mentioned shown in Fig. 2 the
One embodiment.
" receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount the step S20, in order to according to
Low preset buffer memory amount is cached and is decoded to the low frame video flowing " before, further include：
Step S30, the receiving terminal increase each frame in the low frame video flowing after receiving the low frame video flowing
Pixel difference between interior pixel.
It is above-mentioned, in the present embodiment, pass through-the q in ffmpeg:The quality of 0.1 state modulators of v also original image, and then control
Drawing image sharpness, reduces distortion.Ensure that image still can be into traveling one after carrying out drop frame optimization or after other compression methods
Step identification.Wherein, difference is little between the pixel of the blurred picture of each frame, is configured by parameter, makes to obscure in each frame
Difference increases between the pixel of picture, contrast is improved, to make picture be more clear.
Embodiment 4：
With reference to Fig. 5, fourth embodiment of the invention provides a kind of image transmitting optimization method, based on above-mentioned shown in Fig. 3 the
Two embodiments, the step S13 " are based on coding protocol, the transmitting terminal becomes low frame video to the target frame data encoding
After stream ", including：
Step S15, is based on elliptic curve encryption algorithm, and the low frame video flowing is encrypted in the transmitting terminal；
It is described that " receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to described low default
Buffer memory is cached and is decoded to the low frame video flowing " before, further include：
Step S16, based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal.
It is above-mentioned, it is to be understood that elliptic curve encryption algorithm (ECC) is a kind of public encryption system, initially by Koblitz and
Two people of Miller proposed that Fundamentals of Mathematics are to constitute ellipse in Abel modules using the rational point on elliptic curve in 1985
The dyscalculia of discrete logarithm.Public-key cryptosystem is generally divided into three classes according to problem based on it：Factoring problem is asked
Inscribe class, discrete logarithm problem class, elliptic curve class.Sometimes elliptic curve class is also classified as discrete logarithm class.
By elliptic curve encryption algorithm, the interaction data of transmitting terminal and receiving terminal is encrypted and decrypted, to improve number
According to the safety in transmission process, the specified encrypted video stream that transmitting terminal is sent out can only be decrypted and be received by receiving terminal, into
And make that data are with strong points in interactive process, directive property is strong, high safety, prevent loss of data during interacting
And leakage.
Preferably, the step S15 " is based on elliptic curve encryption algorithm, the transmitting terminal adds the low frame video flowing
It is close " include：
Step S151, is based on elliptic curve encryption algorithm, and the transmitting terminal generates public key corresponding with the low frame video flowing
And private key；
Step S152, the transmitting terminal, to the low frame video stream encryption, are generated by the public key and encrypt low frame video
Stream；
Private key frame video low with the encryption is flowed to the receiving terminal transmission by step S153, the transmitting terminal；
" based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal " includes：
Step S161, the receiving terminal receive the private key and encrypt low frame video flowing with described；
Step S162, the receiving terminal decrypts the low frame video flowing of the encryption according to the private key, after being decrypted
The low frame video flowing obtains low preset buffer memory amount and carries out to the low frame video flowing in order to reduce preset buffer memory frame number
Decoding.
It is above-mentioned, according to oval confidentiality algorithm, one is firstly generated with receiving terminal to corresponding public key and private key, wherein public
Key is for being encrypted the low frame video flowing that transmitting terminal generates, to obtain encrypted low frame video flowing, further
The encrypted video flowing is integrated with private key, becomes many data packets, is sent to receiving terminal, the real-time logarithm of receiving terminal
It received, decrypted, cached and is decoded according to packet and played.
Wherein, receiving terminal is decrypted the encrypted low frame video flowing, by the private key in data packet to obtain
Low frame video flowing, and then cached and decoded.
It is above-mentioned, ECC encryptions are carried out in the data transmission procedure of transmitting terminal and receiving terminal to video flowing, to realize number
According to the safe transmission in interactive process, makes video flowing that can only be received and be decrypted by specified receiving terminal, substantially increase number
According to interactive safety.
In addition, the present invention also provides a kind of image transmitting optimization system, including transmitting terminal and receiving terminal, which is characterized in that
The transmitting terminal reduction pre-reads frame number to the video flowing, and drop frame video data is generated according to the frame number that pre-reads
And the drop frame video data encoding is sent to the receiving terminal at low frame video flowing；
The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory amount
The low frame video flowing is cached and decoded.
In addition, the present invention also provides a kind of image transmittings to optimize device, including transmitting terminal and receiving terminal, wherein the transmission
End includes first memory and first processor, and the receiving terminal includes second memory and second processor, and described first deposits
Reservoir and the second memory are used to storage image transmitting optimization program, the first processor and the second processor
Described image transmission optimization program is run so that described image transmission optimization device executes image transmitting optimization as described above
Method.
In addition, the present invention also provides a kind of computer readable storage medium, stored on the computer readable storage medium
There is image transmitting to optimize program, described image transmission optimization program realizes that image transmitting as described above is excellent when being executed by processor
Change method.
It should be noted that herein, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that process, method, article or system including a series of elements include not only those elements, and
And further include other elements that are not explicitly listed, or further include for this process, method, article or system institute it is intrinsic
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
There is also other identical elements in the process of element, method, article or system.
The embodiments of the present invention are for illustration only, can not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be expressed in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions use so that a station terminal equipment (can be mobile phone,
Computer, server or network equipment etc.) execute method described in each embodiment of the present invention.
It these are only the preferred embodiment of the present invention, be not intended to limit the scope of the invention, it is every to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of image transmitting optimization method is applied between transmitting terminal and receiving terminal, which is characterized in that including：
The transmitting terminal reduction pre-reads frame number to the video flowing, and drop frame video data and general are generated according to the frame number that pre-reads
The drop frame video data encoding sends low frame video and flow to the receiving terminal at low frame video flowing；
The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory amount to institute
Low frame video flowing is stated to be cached and decoded.
2. image transmitting optimization method as described in claim 1, which is characterized in that described " the transmitting terminal reduction is regarded to described
Frequency stream pre-reads frame number, and drop frame video data is generated and by the drop frame video data encoding at low frame according to the frame number that pre-reads
Video flowing is sent to the receiving terminal " include：
The transmitting terminal pre-reads frame number described in reducing, and frame number is pre-read after being reduced；
The transmitting terminal picks up the video flowing according to the frame number that pre-reads after the reduction at equal intervals, obtains target frame number
According to；
Based on coding protocol, the transmitting terminal becomes low frame video flowing to the target frame data encoding；
The transmitting terminal is by the low frame video stream to the receiving terminal.
3. image transmitting optimization method as claimed in claim 2, which is characterized in that the frame number that pre-reads after the reduction is 2 frames.
4. image transmitting optimization method as described in claim 1, which is characterized in that the low preset buffer memory amount is 32 bytes.
5. image transmitting optimization method as described in claim 1, which is characterized in that described " receiving terminal reduces preset buffer memory
Frame number obtains low preset buffer memory amount, in order to which the low frame video flowing is cached and solved according to the low preset buffer memory amount
Before code ", further include：
The receiving terminal increases the picture between pixel in each frame in the low frame video flowing after receiving the low frame video flowing
Plain difference.
6. image transmitting optimization method as claimed in claim 2, which is characterized in that described " to be based on coding protocol, the transmitting terminal
Low frame video flowing is become to the target frame data encoding " after, including：
Based on elliptic curve encryption algorithm, the low frame video flowing is encrypted in the transmitting terminal；
It is described that " receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory
Amount is cached and is decoded to the low frame video flowing " before, further include：
Based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal.
7. image transmitting optimization method as claimed in claim 6, which is characterized in that
" being based on elliptic curve encryption algorithm, the low frame video flowing is encrypted in the transmitting terminal " includes：
Based on elliptic curve encryption algorithm, the transmitting terminal generates public key corresponding with the low frame video flowing and private key；
The transmitting terminal, to the low frame video stream encryption, is generated by the public key and encrypts low frame video flowing；
Private key frame video low with the encryption is flowed to the receiving terminal transmission by the transmitting terminal；
" based on oval algorithm, the low preset buffer memory amount is decrypted in the receiving terminal " includes：
The receiving terminal receives the private key and encrypts low frame video flowing with described；
The receiving terminal decrypts the low frame video flowing of the encryption according to the private key, the low frame video after being decrypted
Stream obtains low preset buffer memory amount and carries out the decoding to the low frame video flowing in order to reduce preset buffer memory frame number.
8. a kind of image transmitting optimization system, which is characterized in that including transmitting terminal and receiving terminal, which is characterized in that
The transmitting terminal reduction pre-reads frame number to the video flowing, and drop frame video data and general are generated according to the frame number that pre-reads
The drop frame video data encoding is sent to the receiving terminal at low frame video flowing；
The receiving terminal reduces preset buffer memory frame number and obtains low preset buffer memory amount, in order to according to the low preset buffer memory amount to institute
Low frame video flowing is stated to be cached and decoded.
9. a kind of image transmitting optimizes device, which is characterized in that including transmitting terminal and receiving terminal, wherein the transmitting terminal includes the
One memory and first processor, the receiving terminal include second memory and second processor, the first memory and institute
It states second memory and is used to storage image transmitting optimization program, the first processor and the second processor run institute
Image transmitting optimization program is stated so that described image transmission optimization device executes any one of claim 1-7 described image such as and passes
Defeated optimization method.
10. a kind of computer readable storage medium, which is characterized in that be stored with image biography on the computer readable storage medium
Defeated optimization program is realized when described image transmission optimization program is executed by processor and is schemed as described in any one of claim 1-7
As transmission optimization method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810186385.3A CN108377400A (en) | 2018-03-07 | 2018-03-07 | A kind of image transmitting optimization method, system and its apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810186385.3A CN108377400A (en) | 2018-03-07 | 2018-03-07 | A kind of image transmitting optimization method, system and its apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108377400A true CN108377400A (en) | 2018-08-07 |
Family
ID=63018562
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810186385.3A Pending CN108377400A (en) | 2018-03-07 | 2018-03-07 | A kind of image transmitting optimization method, system and its apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108377400A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112333537A (en) * | 2020-07-27 | 2021-02-05 | 深圳Tcl新技术有限公司 | Video integration method and device and computer readable storage medium |
| CN114786036A (en) * | 2022-03-02 | 2022-07-22 | 上海仙途智能科技有限公司 | Monitoring method and device for automatic driving vehicle, storage medium and computer equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103475902A (en) * | 2013-09-06 | 2013-12-25 | 同观科技（深圳）有限公司 | Video coding and network transmission method and video forwarding server |
| CN104796702A (en) * | 2015-04-22 | 2015-07-22 | 无锡天脉聚源传媒科技有限公司 | H264 video frame rate conversion method and device |
| CN105100675A (en) * | 2015-09-11 | 2015-11-25 | Tcl集团股份有限公司 | Terminal video communication quality adjusting method and system |
| WO2016109201A1 (en) * | 2014-12-31 | 2016-07-07 | Thomson Licensing | High frame rate-low frame rate transmission technique |
| CN106028139A (en) * | 2016-05-16 | 2016-10-12 | 乐视控股（北京）有限公司 | Real-time transcoding method and device for use in frame rate reducing process |
-
2018
- 2018-03-07 CN CN201810186385.3A patent/CN108377400A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103475902A (en) * | 2013-09-06 | 2013-12-25 | 同观科技（深圳）有限公司 | Video coding and network transmission method and video forwarding server |
| WO2016109201A1 (en) * | 2014-12-31 | 2016-07-07 | Thomson Licensing | High frame rate-low frame rate transmission technique |
| CN104796702A (en) * | 2015-04-22 | 2015-07-22 | 无锡天脉聚源传媒科技有限公司 | H264 video frame rate conversion method and device |
| CN105100675A (en) * | 2015-09-11 | 2015-11-25 | Tcl集团股份有限公司 | Terminal video communication quality adjusting method and system |
| CN106028139A (en) * | 2016-05-16 | 2016-10-12 | 乐视控股（北京）有限公司 | Real-time transcoding method and device for use in frame rate reducing process |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112333537A (en) * | 2020-07-27 | 2021-02-05 | 深圳Tcl新技术有限公司 | Video integration method and device and computer readable storage medium |
| CN112333537B (en) * | 2020-07-27 | 2023-12-05 | 深圳Tcl新技术有限公司 | Video integration method, device and computer readable storage medium |
| CN114786036A (en) * | 2022-03-02 | 2022-07-22 | 上海仙途智能科技有限公司 | Monitoring method and device for automatic driving vehicle, storage medium and computer equipment |
| CN114786036B (en) * | 2022-03-02 | 2024-03-22 | 上海仙途智能科技有限公司 | Method and device for monitoring automatic driving vehicle, storage medium and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10979663B2 (en) | Methods and apparatuses for image processing to optimize image resolution and for optimizing video streaming bandwidth for VR videos | |
| JP7284906B2 (en) | Delivery and playback of media content | |
| CN105230024B (en) | A kind of media representation adaptive approach, device and computer storage medium | |
| CN108271048B (en) | Code rate self-adaptive adjusting device and method considering both throughput and video buffering | |
| JP5746392B2 (en) | System and method for transmitting content from a mobile device to a wireless display | |
| Sun et al. | A two-tier system for on-demand streaming of 360 degree video over dynamic networks | |
| US10484446B1 (en) | VBR encoding of live content | |
| CN112312229A (en) | Video transmission method and device, electronic equipment and storage medium | |
| CN112312137A (en) | Video transmission method and device, electronic equipment and storage medium | |
| CN101917613A (en) | Acquiring and coding service system of streaming media | |
| CN109845260A (en) | Decoding method and device | |
| CN108881931A (en) | A kind of data buffering method and the network equipment | |
| CN108401190B (en) | Method and equipment for real-time labeling of video frames | |
| JP2017520940A5 (en) | Method and apparatus for multiplexing layered coded content | |
| WO2021057697A1 (en) | Video encoding and decoding methods and apparatuses, storage medium, and electronic device | |
| WO2024037137A1 (en) | Data processing method and apparatus for immersive media, and device, medium and product | |
| CN105681817A (en) | Intelligent terminal video and audio collection, transmission and playing system and method | |
| CN108377400A (en) | A kind of image transmitting optimization method, system and its apparatus | |
| CN103686077A (en) | Double buffering method applied to realtime audio-video data transmission of 3G wireless network | |
| CN108200470A (en) | A kind of video code rate method of adjustment and equipment | |
| US20230082784A1 (en) | Point cloud encoding and decoding method and apparatus, computer-readable medium, and electronic device | |
| KR101827427B1 (en) | Video signal transmitting apparatus and method thereof | |
| US11336902B1 (en) | Systems and methods for optimizing video encoding | |
| KR20120012089A (en) | System and method for proving video using scalable video coding | |
| JP2013150147A (en) | Encryption device, decryption device, encryption program, and decryption program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180807 |