CN107172376A - A kind of method for video coding and device based on Screen sharing - Google Patents
A kind of method for video coding and device based on Screen sharing Download PDFInfo
- Publication number
- CN107172376A CN107172376A CN201710496439.1A CN201710496439A CN107172376A CN 107172376 A CN107172376 A CN 107172376A CN 201710496439 A CN201710496439 A CN 201710496439A CN 107172376 A CN107172376 A CN 107172376A
- Authority
- CN
- China
- Prior art keywords
- frame
- screenshot capture
- processing unit
- changing
- changing frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of method for video coding and device based on Screen sharing, it is related to field of computer technology.Methods described, including：Screenshot capture is obtained from original pattern with predeterminated frequency；Using the screenshot capture in a preset time unit as a processing unit, the quantity of changing frame in the processing unit is counted respectively；According to the quantity of changing frame in the processing unit and preset time unit setting coding frame per second；The changing frame is encoded according to the coding frame per second.When solving existing video calling cataloged procedure for Screen sharing, anticipation will not be done to a large amount of repeating frames in advance, cause the waste computed repeatedly with Internet resources of a large amount of repeating frames, under same code rate, part code check quota is wasted to above repeating frame, causes the inadequate clearly technical problem of changing frame picture.The calculating and the waste of Internet resources reduced to repeating frame is achieved, the beneficial effect of changing frame definition is improved.
Description
Technical field
The present invention relates to field of computer technology, and in particular to a kind of method for video coding and dress based on Screen sharing
Put.
Background technology
Now with the popularization of immediate communication tool, it is mainly used in the Screen sharing technology of document display into video conference
Standard configuration, realize the main implementation of Screen sharing：1) VNC (Virtual Network Computing) technology, is used
RFB (Remote Frame Buffer) agreement, such as VNC realization, server receives the action of client, produces corresponding table
Face picture, transmits full picture to client, the incremental data of screen change part is sent afterwards when just starting.2) video is used
Talking mode, screenshot capture/coding/transmission/reception/decoding/display mode, passes through point-to-point or transfer service transmission number
According to.
In immediate communication tool, in order to simplify design, screen stream is generally acknowledged to be not different with camera video stream,
Both share a set of video communication framework to transmit data, without individually going to develop the visitor of VNC agreements for Screen sharing function
Family end and server.Although Screen sharing is consistent with video calling principle, Screen sharing application scenarios have it unique：Screen
Buffer contents will not typically change when no user is intervened, i.e., continuous adjacent content frame recurrence probability is very high, and frame is static
Scene than change scene more than several times；Image is substantially lasting change in the scene of ordinary video video recording, even if shooting pair
As transfixion, but trickle shooting angle change, the change of environment light source, the reason such as collecting device picture noise causes very
Few picture for occurring repeating completely.And the requirement of Screen sharing image quality requires high than ordinary video call, in the case of equal code check,
When video image image quality can receive, often details distortion level is unacceptable in Screen sharing picture.In addition, screen is common
Enjoy picture delay more slightly lower than video calling requirement, a little frame bufferings can be done before encoding and are pre-processed.
And existing video calling cataloged procedure be used for Screen sharing when, anticipation will not be done to a large amount of repeating frames in advance, still
Encoded frame by frame using " encoded/encrypted/transmission/decryption/decoding " flow of standard, this can cause：The weight of a large amount of repeating frames
Under the multiple waste calculated with Internet resources, same code rate, part code check quota is wasted to above repeating frame, causes changing frame picture
It is not clear enough.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State a kind of method for video coding based on Screen sharing and a kind of corresponding video coding apparatus based on Screen sharing of problem.
According to one aspect of the present invention there is provided a kind of method for video coding based on Screen sharing, including：
Screenshot capture is obtained from original pattern with predeterminated frequency；
Using the screenshot capture in a preset time unit as a processing unit, count in the processing unit and become respectively
Change the quantity of frame；
According to the quantity of changing frame in the processing unit and preset time unit setting coding frame per second；
The changing frame is encoded according to the coding frame per second.
Alternatively, the screenshot capture using in a preset time unit counts described as a processing unit, respectively
In processing unit the step of the quantity of changing frame, including：
Using the screenshot capture in a preset time unit as a processing unit, first in the processing unit is set
Frame screenshot capture is changing frame；
For the processing unit the second frame screenshot capture to last frame screenshot capture, according to each screenshot capture
Luminance component determine whether the screenshot capture is changing frame；
Count the quantity of changing frame described in the processing unit.
Alternatively, the second frame screenshot capture for the processing unit is to last frame screenshot capture, according to each
The luminance component of the screenshot capture determines the step of whether screenshot capture is changing frame, including：
For the processing unit the second frame screenshot capture to last frame screenshot capture, obtain each screenshot capture
Luminance component；
The luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture is compared, the current screen of statistics
Curtain sectional drawing and the pixel number that gray value is consistent at same pixel point in former frame screenshot capture；
Judge whether the pixel number is equal to the image resolution ratio of the screenshot capture；
If the pixel number is not equal to the image resolution ratio of the screenshot capture, confirm that the current screen is cut
Figure is changing frame.
Alternatively, the step of whether the pixel number is equal to the image resolution ratio of the screenshot capture judged described
Afterwards, in addition to：
If the pixel number is equal to the image resolution ratio of the screenshot capture, the current screen sectional drawing is confirmed
For frozen frozen mass, and the frozen frozen mass is filtered.
Alternatively, it is described according to it is described coding frame per second the changing frame is encoded the step of, including：
First interval changing frame of each pre-arranged code is set to decode refresh frame immediately.
According to another aspect of the present invention there is provided a kind of video coding apparatus based on Screen sharing, including：
Screenshot capture acquisition module, for obtaining screenshot capture from original pattern with predeterminated frequency；
Changing frame statistical module, for using the screenshot capture in a preset time unit as a processing unit, distinguishing
Count the quantity of changing frame in the processing unit；
Frame per second setting module is encoded, for being set according to the quantity of changing frame in the processing unit and preset time unit
Delimit the organizational structure a yard frame per second；
Coding module, for being encoded according to the coding frame per second to the changing frame.
Alternatively, the changing frame statistical module, including：
First changing frame sets submodule, for single using the screenshot capture in a preset time unit as a processing
Member, sets the first frame screenshot capture in the processing unit as changing frame；
Second changing frame sets submodule, for the second frame screenshot capture for the processing unit to last frame screen
Curtain sectional drawing, determines whether the screenshot capture is changing frame according to the luminance component of each screenshot capture
Changing frame statistic submodule, the quantity for counting changing frame described in the processing unit.
Alternatively, the second changing frame setting submodule, including：
Luminance component acquiring unit, cuts for the second frame screenshot capture for the processing unit to last frame screen
Figure, obtains the luminance component of each screenshot capture；
Pixel statistic unit, for by the luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture
It is compared, statistics current screen sectional drawing and the pixel that gray value is consistent at same pixel point in former frame screenshot capture
Number；
Pixel judging unit, for judging whether the pixel number is equal to the image resolution of the screenshot capture
Rate；
Changing frame determining unit, if being not equal to the image resolution ratio of the screenshot capture for the pixel number,
It is changing frame then to confirm the current screen sectional drawing.
Alternatively, after the pixel judging unit, in addition to：
Frozen frozen mass determines filter element, if being equal to the image resolution of the screenshot capture for the pixel number
Rate, then it is frozen frozen mass to confirm the current screen sectional drawing, and the frozen frozen mass is filtered.
Alternatively, the coding module is additionally operable to set first interval changing frame of each pre-arranged code and brushed immediately to decode
New frame.
, can be with predeterminated frequency from original according to a kind of method for video coding and device based on Screen sharing of the present invention
Screen obtains screenshot capture；Using the screenshot capture in a preset time unit as a processing unit, the place is counted respectively
Manage the quantity of changing frame in unit；According to the quantity of changing frame in the processing unit and preset time unit setting coded frame
Rate；The changing frame is encoded according to the coding frame per second.Thus solving existing video calling cataloged procedure is used for
During Screen sharing, anticipation will not be done to a large amount of repeating frames in advance, cause the wave computed repeatedly with Internet resources of a large amount of repeating frames
Take, under same code rate, part code check quota is wasted to above repeating frame, cause the inadequate clearly technical problem of changing frame picture.
The calculating and the waste of Internet resources reduced to repeating frame is achieved, the beneficial effect of changing frame definition is improved.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, various other advantages and benefit is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
The step of Fig. 1 shows a kind of method for video coding based on Screen sharing according to an embodiment of the invention is flowed
Cheng Tu；
Figure 1A shows a kind of system architecture diagram of Screen sharing according to an embodiment of the invention.
The step of Fig. 2 shows a kind of method for video coding based on Screen sharing according to an embodiment of the invention is flowed
Cheng Tu；And
Fig. 3 shows that a kind of structure of video coding apparatus based on Screen sharing according to an embodiment of the invention is shown
It is intended to；And
Fig. 4 shows that a kind of structure of video coding apparatus based on Screen sharing according to an embodiment of the invention is shown
It is intended to.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although showing the disclosure in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Complete conveys to those skilled in the art.
Embodiment one
A kind of method for video coding based on Screen sharing provided in an embodiment of the present invention is discussed in detail.
Reference picture 1, shows a kind of step flow of the method for video coding based on Screen sharing in the embodiment of the present invention
Figure.
Step 110, screenshot capture is obtained from original pattern with predeterminated frequency.
It has been observed that with the popularization of immediate communication tool, being mainly used in the Screen sharing technology of document display into video
The standard configuration of meeting, realizes the main implementation of Screen sharing：1) VNC (Virtual Network Computing) technology, makes
With RFB (Remote Frame Buffer) agreement, such as VNC realization, server receives the action of client, produces corresponding
Desktop picture, transmits full picture to client, the incremental data of screen change part is sent afterwards when just starting.2) use and regard
Frequency talking mode, screenshot capture/coding/transmission/reception/decoding/display mode, passes through point-to-point or transfer service transmission number
According to.And in immediate communication tool, in order to simplify design, screen stream is generally acknowledged to be not different with camera video stream,
Both share a set of video communication framework to transmit data, without individually going to develop the visitor of VNC agreements for Screen sharing function
Family end and server.Screen sharing is carried out using the above-mentioned second way mostly so in the mobile terminals such as mobile phone, computer.
And the application is, relative to second above-mentioned of implementation, there is further optimization.
In embodiments of the present invention, in order to carry out Screen sharing, the original pattern to carrying out Screen sharing is also required to first
Sectional drawing is carried out, that is, obtains the screenshot capture of original pattern, specifically screenshot capture can be obtained from original pattern with predeterminated frequency.Its
In predeterminated frequency can be set according to demand before this step, or before either step before this step,
This embodiment of the present invention is not limited.Original pattern therein can be with the screen of the mobile terminals such as computer, notebook, mobile phone
Curtain, or projecting apparatus screen etc. is any can to show the screen of the digital video either content such as digital picture.
If Figure 1A is a kind of system architecture diagram of Screen sharing.Wherein, middle computer is the original for carrying out Screen sharing
Beginning equipment, its screen is original pattern, and four equipment of surrounding are to receive the data sent from original device to be shown
Shared equipment, then the screen of four equipment is shared screen.
Moreover, in embodiments of the present invention, it is possible to use any methods availalbe or equipment obtain screen from original pattern and cut
Figure, is not limited to this embodiment of the present invention.
For example, being currently needed for the content shown in screen 1 sharing to other screens 2, screen 3, then now screen 1
As original pattern, and screen 2 and screen 3 are then shared screen.So then screen 1 can be obtained with predeterminated frequency in this step
Screenshot capture.
Step 120, using the screenshot capture in a preset time unit as a processing unit, the processing is counted respectively
The quantity of changing frame in unit.
It has been observed that in actual applications, existing Screen sharing technology can be complete to the screenshot capture that is obtained from original pattern
Portion carries out the processing such as encoding sending to each shared screen, but during Screen sharing, when being likely to appear in one section
Between within the content that shows of original pattern do not occur the situation of any change, then the screen obtained within this time is cut
Figure is consistent, namely in the screenshot capture that currently obtains and the preceding screenshot capture once obtained is consistent, then in this hair
In bright embodiment, it is frozen frozen mass that can define the screenshot capture currently obtained；And if the screenshot capture currently obtained with it is previous
The screenshot capture of secondary acquisition is inconsistent, then in embodiments of the present invention, and it is change that can define the screenshot capture currently obtained
Frame.
For frozen frozen mass, if sending it to each shared screen, then each shared screen receive the frozen frozen mass it
Displaying content afterwards can't change with the displaying content before receiving the frozen frozen mass, therefore in the embodiment of the present invention
In, only changing frame can be sent to each shared screen.
So, in embodiments of the present invention, after the screenshot capture of original pattern is obtained, enter to advance to screenshot capture
After the processing of one step, each can be counted respectively using the screenshot capture in a preset time unit as a processing unit first
The quantity of changing frame in processing unit.Preset time unit therein can be according to demand before this step, or this step
Set before either step before rapid, this embodiment of the present invention is not limited.
For example, preset time unit can be set as 1 second (s), predeterminated frequency is 10 times per second, then can be from starting screen
Curtain is shared to be started, with the screenshot capture of the frequency acquisition original pattern of 10 times per second, furthermore, it is possible to periodically by every 1 second
Screenshot capture counts the changing frame in each processing unit as a processing unit, respectively, specifically in order to ensure Screen sharing
Time sequencing, it is necessary to be counted successively in each processing unit according to the acquisition time sequencing of the screenshot capture in each processing unit
Changing frame.For example, from Screen sharing start time to the 1st second, the screenshot capture of acquisition be followed successively by a1, a2, a3, a4, a5, a6,
A7, a8, a9, a10, from the 1st second to the 2nd second, the screenshot capture of acquisition be followed successively by b1, b2, b3, b4, b5, b6, b7, b8, b9,
B10, then can using a1, a2, a3, a4, a5, a6, a7, a8, a9, a10 as first processing unit, with b1, b2, b3, b4,
B5, b6, b7, b8, b9, b10 determine the processing list as second processing unit, and after the determination of each processing unit
Changing frame in member.So then can be after screenshot capture a10 be obtained, you can determine the change in first processing unit
Frame, after screenshot capture B10 is obtained, you can determine the changing frame in second processing unit.
Step 130, according to the quantity of changing frame in the processing unit and preset time unit setting coding frame per second.
In actual applications, screenshot capture is being sent to before shared screen, in addition it is also necessary to which each screenshot capture is compiled
Code, for each processing unit, the quantity of the changing frame finally determined is not fixed, then right for different processing units
The coding frame per second that changing frame therein is encoded is also required to adjust accordingly.In embodiments of the present invention, can be according to place
Manage the quantity of changing frame and preset time unit setting coding frame per second in unit.Specifically can be by the change in processing unit
The ratio of number of frames and preset time unit is used as the coding frame per second for the processing unit.
For example, for the processing unit of foregoing a1, a2, a3, a4, a5, a6, a7, a8, a9, a10 composition, it is assumed that it is determined that
Changing frame be a1, a3, a7, a10, preset time unit be 1s, then can be directed to the processing unit in changing frame carry out
The coding frame per second of coding is 4 changing frames/second, i.e., the coding per second completed to four changing frames.
Step 140, the changing frame is encoded according to the coding frame per second.
, then can be according to the coding frame per second to currently processed after the coding frame per second for current processing unit is determined
Changing frame in unit is encoded.
Coding therein includes Video coding, and so-called Video coding mode just refers to by specific compress technique, by certain
The file of individual video format is converted into the mode of another video format file.Mostly important encoding and decoding mark in video streaming
H.261, H.262, H.263, H.263+, H.263++, H.264 the H.26X series of Zhun You International Telecommunication Association, can specifically include, fortune
Sound stops the M-JPEG of motion picture expert group version and MPEG (the Moving Picture of Motion Picture Experts Group of International Organization for standardization
Experts Group) series standard, the also RealVideo being widely used on the internet in addition be (a kind of high compression ratio
Video format), WMV (Windows Media Video) and QuickTime (a kind of Voice ＆ Video file format) etc..
Changing frame can be encoded using any available code mode in embodiments of the present invention, specifically can be
Coded system is set according to demand before this step, or before either step before this step, and this present invention is implemented
Example is not limited.
During being encoded to changing frame, in order to ensure Screen sharing order will not entanglement, need also exist for by
Each changing frame is encoded successively according to the sequencing of the acquisition time of each changing frame.For example, for above-mentioned same processing
Changing frame a1, a3, a7, a10 in unit, it is assumed that the acquisition sequencing of each changing frame is a1, a3, a7, a10, then then may be used
To be encoded respectively to changing frame a1, a3, a7, a10 successively according to the sequencing of acquisition.
In embodiments of the present invention, screenshot capture can be obtained from original pattern with predeterminated frequency；With a preset time
Screenshot capture in unit is a processing unit, and the quantity of changing frame in the processing unit is counted respectively；According to the place
Manage the quantity of changing frame and preset time unit setting coding frame per second in unit；According to the coding frame per second to the changing frame
Encoded., will not be in advance to a large amount of repeating frames when thus solving existing video calling cataloged procedure for Screen sharing
Anticipation is done, is caused under the waste computed repeatedly with Internet resources of a large amount of repeating frames, same code rate, part code check quota is wasted and arrived
Above repeating frame, cause the inadequate clearly technical problem of changing frame picture.Achieve calculating and the network reduced to repeating frame
The waste of resource, improves the beneficial effect of changing frame definition.
Embodiment two
A kind of method for video coding based on Screen sharing provided in an embodiment of the present invention is discussed in detail.
Reference picture 1, shows a kind of step flow of the method for video coding based on Screen sharing in the embodiment of the present invention
Figure.
Step 210, screenshot capture is obtained from original pattern with predeterminated frequency.
Step 220, using the screenshot capture in a preset time unit as a processing unit, the processing unit is set
In the first frame screenshot capture be changing frame.
In embodiments of the present invention, if in order to avoid the screenshot capture in continuous multiple processing units is all completely the same,
Cause each shared screen not receive new changing frame for a long time, be easily caused each Sharing computer erroneous judgement Screen sharing and occur event
Barrier causes to restart or situations such as blank screen.Therefore, in embodiments of the present invention, it is determined that each processing unit changing frame when, can be with
The the first frame screenshot capture for setting each processing unit is forced as changing frame.
For example, for above-mentioned first processing unit, wherein each screenshot capture included is according to acquisition time order and function order
For a1, a2, a3, a4, a5, a6, a7, a8, a9, a10, then can then set wherein the first frame screenshot capture, namely obtain at first
The frame screenshot capture a1 taken is changing frame.
Step 230, for the processing unit the second frame screenshot capture to last frame screenshot capture, according to each described
The luminance component of screenshot capture determines whether the screenshot capture is changing frame.
Other screenshot captures in addition to the first frame screenshot capture in processing unit, i.e. the second frame screen is so directed to cut
Scheme last frame screenshot capture, namely the second screenshot capture obtained is cut to the screen that last time is obtained in processing unit
Whether figure, it is changing frame that each screenshot capture can be determined respectively.
In actual applications, it is possible to use YUV (also known as YCrCb) video signal transmission carries out video and shared.YUV therein
Carry out the transmission for being mainly used in optimizing colour-video signal.With R (Red, red) G (Green, green) B (Blue, blueness) video
Signal transmission is compared, and its biggest advantage is need to only to take few frequency range that (RGB requires three independent vision signals simultaneously
Transmission).Wherein Y is luminance component, represents lightness (Luminance or Luma), that is, grey decision-making；And U and V are represented then
It is colourity (Chrominance or Chroma), effect is description colors of image and saturation degree, the color for specified pixel.It is bright
Degree is set up through RGB input signals, and method is that the specific part of rgb signal is superimposed together." colourity " is then defined
Two aspects of color, i.e. tone and saturation degree, are represented with Cr and Cb respectively.Wherein, to reflect RGB input signals red by Cr
Difference between color part and rgb signal brightness value.And Cb reflections is RGB input signals blue portion and rgb signal brightness
Difference between value.It is separation using the luminance signal Y and carrier chrominance signal U, V that the importance of YUV color spaces is it.If
Only Y-component is without U, V component, then the image so represented is exactly black and white gray level image.
In embodiments of the present invention, it can determine whether screenshot capture is changing frame according to the Y-component in each screenshot capture.
If so now for the second frame screenshot capture in same processing unit to last frame screenshot capture, if current screen
The Y-component of sectional drawing and the Y-component of its former frame screenshot capture are completely the same, then it is static for then can confirm that current screen sectional drawing
Frame；And if the Y-component of current screen sectional drawing and the Y-component of its former frame screenshot capture are not quite identical, then then can be true
Current screen sectional drawing is recognized for changing frame.
In the embodiment of the present application, the second frame screen of the processing unit can also be directed to using other any methods availalbes
Curtain sectional drawing is to last frame screenshot capture, and whether determine each screenshot capture is changing frame.This embodiment of the present application is not limited
It is fixed.
For example, can compare respectively to last frame screenshot capture for the second frame screenshot capture in same processing unit
It is whether whether completely the same with previous screenshot capture, namely the preceding screenshot capture once obtained compared with current screen sectional drawing, if worked as
Forth screen sectional drawing and previous screenshot capture are completely the same, then it is frozen frozen mass that can then determine current screen sectional drawing；And if worked as
Forth screen sectional drawing and previous screenshot capture are not quite identical, then it is changing frame that can then determine current screen sectional drawing.In this hair
In bright embodiment, it is possible to use any methods availalbe judges whether two screenshot captures are completely the same, to this embodiment of the present invention
It is not limited.In actual applications, the original pattern during a Screen sharing is fixed, then in a secondary screen mistake
The size of the screenshot capture in each processing unit in journey is all consistent, then can then be compared successively in current screen sectional drawing
Each pixel and the pixel of corresponding position in previous screenshot capture it is whether corresponding consistent, if in current screen sectional drawing
The pixel of each pixel and corresponding position in previous screenshot capture is corresponding consistent, then show current screen sectional drawing with it is previous
Screenshot capture is completely the same；And if each pixel in current screen sectional drawing and the picture of corresponding position in previous screenshot capture
Vegetarian refreshments is consistent without corresponding to completely, then show that current screen sectional drawing and previous screenshot capture are not quite identical.
In embodiments of the present invention, the second frame screenshot capture of each processing unit can also be directed to using any methods availalbe
Whether to last frame screenshot capture, it is changing frame to determine each screenshot capture, and this embodiment of the present invention is not also limited.
Alternatively, in embodiments of the present invention, the step 230 can further include：
Sub-step 231, for the processing unit the second frame screenshot capture to last frame screenshot capture, obtain each institute
State the luminance component of screenshot capture.
In embodiments of the present invention, in order to determine whether screenshot capture is changing frame according to the luminance component of screenshot capture.
So firstly the need of the second frame screenshot capture for each processing unit to last frame screenshot capture, each screenshot capture is obtained
Luminance component.In embodiments of the present invention, it is possible to use any methods availalbe or equipment obtain the luminance component of screenshot capture, right
This embodiment of the present invention is not limited.
Sub-step 232, the luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture is compared,
Statistics current screen sectional drawing and the pixel number that gray value is consistent at same pixel point in former frame screenshot capture.
It has been observed that the screenshot capture size of original pattern is all consistent during a Screen sharing, then each screen
The Y-component size of curtain sectional drawing is also necessarily consistent, and consistent with the size of screenshot capture.
When so the luminance component of the brightness of current screen sectional drawing and former frame screenshot capture is compared, specifically may be used
To be compared according to pixel, namely the corresponding luminance component of each pixel in current screen sectional drawing is respectively compared successively with before
The luminance component of the pixel of corresponding position is compared in one frame screenshot capture.For example, by the 1*1 in current screen sectional drawing
The luminance component of the luminance component of the pixel at place and the pixel in former frame screenshot capture at 1*1 is compared, will be current
The luminance component of the luminance component of the pixel at 1*2 in screenshot capture and the pixel at 1*2 in former frame screenshot capture
It is compared, luminance component and the pixel at 2*1 in former frame screenshot capture of the pixel at 2*1 in current screen sectional drawing
The luminance component of point is compared, by that analogy.Count in current screen sectional drawing and former frame screenshot capture at same pixel point
The consistent pixel number of luminance component.
In addition, in embodiments of the present invention, the luminance component of each pixel is it can be appreciated that gray value, then now
The luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture can also be compared, can specifically divided
Do not compare the corresponding gray value of each pixel in current screen sectional drawing and the pixel of corresponding position in former frame screenshot capture
Gray value.It is individual with the pixel that gray value is consistent at same pixel point in former frame screenshot capture to count current screen sectional drawing
Number.
Sub-step 233, judges whether the pixel number is equal to the image resolution ratio of the screenshot capture.
In actual applications, the image resolution ratio in screenshot capture is the number of pixel for representing to include in the screenshot capture
Amount, for example, it is assumed that the image resolution ratio of a certain screenshot capture is 100p (pixel, pixel) * 50p, then in the screenshot capture
Comprising pixel number be 100*50, i.e., 5000.
So, in embodiments of the present invention, current screen sectional drawing picture identical with former frame screenshot capture is obtained in statistics
The consistent pixel number of gray value at vegetarian refreshments, or to obtain current screen sectional drawing identical with former frame screenshot capture for statistics
At pixel after the consistent pixel number of luminance component, then it may determine that whether the pixel number that statistics is obtained is equal to screen
The image resolution ratio of curtain sectional drawing.
Sub-step 234, if the pixel number is not equal to the image resolution ratio of the screenshot capture, confirms described
Current screen sectional drawing is changing frame.
If it is obvious that counting obtained pixel number for current screen sectional drawing is not equal to correspondence current screen sectional drawing
Image resolution ratio, then then illustrate to exist in current screen sectional drawing the luminance component either gray value of pixel with before it
The luminance component of the pixel of corresponding position either gray value is inconsistent in the screenshot capture of one frame, then and can confirm that
Current screen sectional drawing is changing frame.
Alternatively, in embodiments of the present invention, after the sub-step 233, it can also include：
If the pixel number is equal to the image resolution ratio of the screenshot capture, the current screen sectional drawing is confirmed
For frozen frozen mass, and the frozen frozen mass is filtered.
And if counting the image that obtained pixel number is equal to correspondence current screen sectional drawing for current screen sectional drawing
Resolution ratio, then then can confirm that current screen sectional drawing is frozen frozen mass, and each shared screen need not be transmitted it to for frozen frozen mass
Curtain, then in embodiments of the present invention, in order to avoid frozen frozen mass takes memory space, can filter out frozen frozen mass.Certainly may be used
Not perform any operation to frozen frozen mass, this embodiment of the present invention is not limited.
It should be noted that, in embodiments of the present invention, can also be by the luminance component of current screen sectional drawing and former frame screen
The luminance component of curtain sectional drawing is compared, statistics current screen sectional drawing and gray value at same pixel point in former frame screenshot capture
Inconsistent pixel number, or statistics current screen sectional drawing and brightness minute at same pixel point in former frame screenshot capture
The inconsistent pixel number of amount.Whether then judge the pixel number is zero.If that the pixel number is
Zero, then it is changing frame to confirm the current screen sectional drawing；And if the pixel number is not zero, then can confirm that described work as
Forth screen sectional drawing is frozen frozen mass.This embodiment of the present invention is not also limited.
Step 240, the quantity of changing frame described in the processing unit is counted.
Step 250, according to the quantity of changing frame in the processing unit and preset time unit setting coding frame per second.
Step 260, the changing frame is encoded according to the coding frame per second.
Alternatively, in embodiments of the present invention, the step 260 can further include：
Sub-step 261, sets first interval changing frame of each pre-arranged code to decode refresh frame immediately.
I (intracoded frame) frame is a kind of independent frame for carrying full detail, just can independently be entered without reference to other images
First frame in row decoding, video sequence is all I frames all the time.
IDR (Instantaneous Decoding Refresh decode refresh frame immediately) frame belongs to I (intracoded frame)
Frame, I and every IDR frame are all to use infra-frame prediction.The effect of every IDR frame is to refresh at once, mistake is propagated, is opened from every IDR frame
Begin, a new sequence is calculated again and starts coding.And I frames do not have the ability of random access, this function is undertaken by IDR.
IDR can cause DPB ((Decoded Picture Buffer, decoded picture buffering) reference frame lists --- this is key point)
Empty, and I will not.IDR images must be I images, but I images are not necessarily IDR images.Can have many in one sequence
The image that image after I images, I images can be quoted between I images is taken exercises reference.Can have many in one sequence
The image that image after I images, I images can be quoted between I images is taken exercises reference.
For every IDR frame, the content of the frame before all frames after every IDR frame all can not quote any every IDR frame, with
This is on the contrary, for common I frames, B (the bi-directional predicted interpolation coding frame/two-way difference frame) frames and P after it are (preceding
To encoded predicted frame) frame can quote the I frames before common I frames.From random-access video flowing, player forever may be used
To be played from an every IDR frame, because the frame before being quoted after it without any frame.It can however not at one without every IDR frame
Video in commenced play out from arbitrfary point because frame below can always quote frame above.
When receiving every IDR frame, decoder additionally needs the work done and is exactly：All PPS (Picture Parameter
Set, picture parameter set) and SPS (Sequence Parameter Set, sequence parameter set) parameter be updated.
Processing to every IDR frame (processing with I frames is identical)：(1) infra-frame prediction is carried out, used infra-frame prediction mould is determined
Formula.(2) pixel value subtracts predicted value, obtains residual error.(3) transform and quantization is carried out to residual error.(4) variable-length encoding and arithmetic are compiled
Code.(5) reconstructed image and filter, obtained image as other frames reference frame.
Therefore, in embodiments of the present invention, in order to prevent decoding end occur frame losing etc. it is wrong when, cause decoding error to pass
Next interval is delivered to, and then causes the long-term mistake of video, the first interval frame of each pre-arranged code IDR can be forced to
Frame.The interval time span of pre-arranged code therein can be equal to the time span of foregoing processing unit, naturally it is also possible to no
Equal to the time span of foregoing processing unit, this embodiment of the present invention is not limited.It can specifically exist according to demand
Before this step, or the interval time span of setting pre-arranged code before either step before this step, to this this hair
Bright embodiment is not limited.
Moreover, in embodiments of the present invention, in order to ensure that the time sequencing of Screen sharing will not be chaotic, it is any can be according to
The acquisition sequencing of each changing frame is encoded to each changing frame.Namely the first coding first obtained.
Alternatively, in embodiments of the present invention, it can also include after step 260：
Step 270, processing is compressed to the changing frame after coding.
In embodiments of the present invention, each changing frame is sent to the shared screen of each shared mobile terminal for convenience,
Also need to be compressed processing to each changing frame after coding before transmitting.In embodiments of the present invention, it is possible to use any
Available devices or method are compressed processing to changing frame, and this embodiment of the present invention is not limited.Moreover, of the invention real
Apply in example, in order to ensure that the time sequencing of Screen sharing will not be chaotic, it is any can according to each changing frame acquisition sequencing
Each changing frame is compressed.Namely the first compression first obtained.
Alternatively, in embodiments of the present invention, the step 270 can further include：
Sub-step 271, processing is compressed using H.264 compressed format to the changing frame after coding.
H.264 it is the coding standard of a new generation, it is famous with high-quality and support multiple network the streaming media of high compression,
In encoding context, his theoretical foundation that I understands is：Show with reference to the statistical result of image in a period of time, in adjacent several width
In image frame, general differentiated pixel only has the point within 10%, and luminance difference change is no more than 2%, and chroma difference
Change only have within 1%.So for one section of little image frame of change, we can first encode out a complete image
Frame A, subsequent B frames just do not encode all images, only write-in and the difference of A frames, and the size of such B frames just only has the 1/ of whole frame
10 or smaller.If the C frames change after B frames is little, we can continue to encode C frames in the way of B, under so circulating
Go.We are referred to as a sequence (sequence is exactly the one piece of data of same characteristics) this section of image, when some image with before
Image change is very big, it is impossible to generated with reference to frame above, and we just terminate a upper sequence, starts next section of sequence,
It is exactly that a whole frame A1 is generated to this image, subsequent image is just generated with reference to A1, only write-in and A1 difference content.
Three kinds of frames are defined in H.264 agreement, the frame completely encoded is I frames, and what the I frames with reference to before were generated only includes
The frame of difference section coding is P frames, and also a kind of frame encoded with reference to front and rear frame is B frames.In addition, same for the weight of decoding
H.264, step, introduces every IDR frame again.It can be seen that H.264 every IDR frame with matching.So in embodiments of the present invention,
If setting first interval changing frame of each pre-arranged code in abovementioned steps 250 to decode refresh frame immediately, then at this
Then need to be compressed processing to the changing frame after coding using H.264 compressed format in step.
H.264 the core algorithm used is frame data compression and interframe compression, and frame data compression is the algorithm for generating I frames, interframe
Compression is the algorithm for generating B frames and P frames.
H.264 compression method process is as follows：
1st, it is grouped：A few frame changing frames are divided into one group of GOP (Group of Pictures, picture group), to prevent motion from becoming
Change, every group of frame number should not take many；
2nd, frame is defined：Each changing frame in every group is defined as three types, i.e. I frames, B frames and P frames, wherein can be by every group
In first changing frame be defined as every IDR frame；
3rd, frame is predicted：With I frames as basic frame, P frames are predicted with I frames, then B frames are predicted by I frames and P frames；
4th, data transfer：Finally I frame data and the difference information of prediction are stored and transmitted.
Frame in (Intra frame) compression is also referred to as space compression (Spatial compression).When one frame figure of compression
During picture, the data of this frame are only considered without the redundancy between consideration consecutive frame, this is actually similar with Static Picture Compression.
Frame in typically uses Lossy Compression Algorithm, because frame data compression is one complete image of coding, it is possible to independent decoding,
Display.Frame data compression is similar with coding jpeg typically up to less than very high compression.
Interframe (Inter frame) compression principle be：The data of adjacent a few frames have very big correlation, front and rear in other words
The characteristics of two frame informations are varied less.Namely continuously between its consecutive frame of video with redundancy, according to this characteristic, pressure
Amount of redundancy between contracting consecutive frame just can further improve decrement, reduce compression ratio.Interframe compression is also referred to as time compression
(Temporal compression), it is compressed by comparing the data on time shaft between different frame.Interframe compression one
As be lossless.Frame difference (Frame differencing) algorithm is a kind of typical time compression method, and it is by comparing this
The difference of difference between frame and consecutive frame, only minute book frame frame adjacent thereto, can so greatly reduce data volume.
Step 280, the changing frame after compression is handled is sent to each shared screen.
It is that can send to each shared screen so that each shared screen is carried out by the changing frame after encoding compression processing
Displaying.In embodiments of the present invention, it is possible to use any methods availalbe or equipment send the changing frame after encoding compression processing
To each shared screen, this embodiment of the present invention is not limited.
In embodiments of the present invention, screenshot capture can be obtained from original pattern with predeterminated frequency；With a preset time
Screenshot capture in unit is a processing unit, and the quantity of changing frame in the processing unit is counted respectively；According to the place
Manage the quantity of changing frame and preset time unit setting coding frame per second in unit；According to the coding frame per second to the changing frame
Encoded., will not be in advance to a large amount of repeating frames when thus solving existing video calling cataloged procedure for Screen sharing
Anticipation is done, is caused under the waste computed repeatedly with Internet resources of a large amount of repeating frames, same code rate, part code check quota is wasted and arrived
Above repeating frame, cause the inadequate clearly technical problem of changing frame picture.Achieve calculating and the network reduced to repeating frame
The waste of resource, improves the beneficial effect of changing frame definition.
Moreover, in embodiments of the present invention, can be single using the screenshot capture in a preset time unit as a processing
Member, sets the first frame screenshot capture in the processing unit as changing frame；Cut for the second frame screen of the processing unit
Scheme last frame screenshot capture, whether determine the screenshot capture is changing frame.And it is further, single for the processing
Second frame screenshot capture of member obtains the luminance component of each screenshot capture to last frame screenshot capture；By current screen
The luminance component of the luminance component of sectional drawing and former frame screenshot capture is compared, statistics current screen sectional drawing and former frame screen
The consistent pixel number of gray value at same pixel point in sectional drawing；Judge whether the pixel number is equal to the screen and cuts
The image resolution ratio of figure；If the pixel number is not equal to the image resolution ratio of the screenshot capture, described work as is confirmed
Forth screen sectional drawing is changing frame.So as to improve the accuracy of changing frame.
In addition, in embodiments of the present invention, first interval changing frame of each pre-arranged code can also be set vertical as decoding
That is refresh frame.Then processing is compressed to the changing frame after coding using H.264 compressed format.So as to prevent in decoding
When frame losing occurs in end, decoding error is delivered to next interval, causes the long-term mistake of video.
For embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of combination of actions, but this area
Technical staff should know that the embodiment of the present invention is not limited by described sequence of movement, because according to present invention implementation
Example, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art should also know, specification
Described in embodiment belong to necessary to preferred embodiment, the involved action not necessarily embodiment of the present invention.
Embodiment three
A kind of video coding apparatus based on Screen sharing provided in an embodiment of the present invention is discussed in detail.
Reference picture 3, shows a kind of structural representation of the video coding apparatus based on Screen sharing in the embodiment of the present invention
Figure.
Screenshot capture acquisition module 310, for obtaining screenshot capture from original pattern with predeterminated frequency.
Changing frame statistical module 320, for using the screenshot capture in a preset time unit as a processing unit, dividing
The quantity of changing frame in the processing unit is not counted.
Frame per second setting module 330 is encoded, for according to the quantity of changing frame in the processing unit and preset time list
Position setting coding frame per second.
Coding module 340, for being encoded according to the coding frame per second to the changing frame.
In embodiments of the present invention, screenshot capture can be obtained from original pattern with predeterminated frequency；With a preset time
Screenshot capture in unit is a processing unit, and the quantity of changing frame in the processing unit is counted respectively；According to the place
Manage the quantity of changing frame and preset time unit setting coding frame per second in unit；According to the coding frame per second to the changing frame
Encoded., will not be in advance to a large amount of repeating frames when thus solving existing video calling cataloged procedure for Screen sharing
Anticipation is done, is caused under the waste computed repeatedly with Internet resources of a large amount of repeating frames, same code rate, part code check quota is wasted and arrived
Above repeating frame, cause the inadequate clearly technical problem of changing frame picture.Achieve calculating and the network reduced to repeating frame
The waste of resource, improves the beneficial effect of changing frame definition.
Example IV
A kind of video coding apparatus based on Screen sharing provided in an embodiment of the present invention is discussed in detail.
Reference picture 4, shows a kind of structural representation of the video coding apparatus based on Screen sharing in the embodiment of the present invention
Figure.
Screenshot capture acquisition module 410, for obtaining screenshot capture from original pattern with predeterminated frequency.
Changing frame statistical module 420, for using the screenshot capture in a preset time unit as a processing unit, dividing
The quantity of changing frame in the processing unit is not counted.
Alternatively, in embodiments of the present invention, the changing frame statistical module 420, can further include：
First changing frame sets submodule 421, for using the screenshot capture in a preset time unit as a processing
Unit, sets the first frame screenshot capture in the processing unit as changing frame.
Second changing frame sets submodule 422, and last is arrived for the second frame screenshot capture for the processing unit
Frame screenshot capture, determines whether the screenshot capture is changing frame according to the luminance component of each screenshot capture.
Changing frame statistic submodule 423, the quantity for counting changing frame described in the processing unit.
Alternatively, in embodiments of the present invention, the second changing frame setting submodule 422, can further include：
Luminance component acquiring unit, cuts for the second frame screenshot capture for the processing unit to last frame screen
Figure, obtains the luminance component of each screenshot capture.
Pixel statistic unit, for by the luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture
It is compared, statistics current screen sectional drawing and the pixel that gray value is consistent at same pixel point in former frame screenshot capture
Number.
Pixel judging unit, for judging whether the pixel number is equal to the image resolution of the screenshot capture
Rate.
Changing frame determining unit, if being not equal to the image resolution ratio of the screenshot capture for the pixel number,
It is changing frame then to confirm the current screen sectional drawing.
Alternatively, in embodiments of the present invention, after the pixel judging unit, in addition to：
Frozen frozen mass determines filter element, if being equal to the image resolution of the screenshot capture for the pixel number
Rate, then it is frozen frozen mass to confirm the current screen sectional drawing, and the frozen frozen mass is filtered.
Frame per second setting module 430 is encoded, for according to the quantity of changing frame in the processing unit and preset time list
Position setting coding frame per second.
Coding module 440, for being encoded according to the coding frame per second to the changing frame.
Alternatively, in embodiments of the present invention, the coding module 440, be additionally operable to set each pre-arranged code it is interval the
One changing frame is decoding refresh frame immediately.
Alternatively, in embodiments of the present invention, after the coding module 440, it can also include：
Compressing processing module, for being compressed processing to the changing frame after coding.
Alternatively, in embodiments of the present invention, the compressing processing module, is additionally operable to using H.264 compressed format to compiling
Changing frame after code is compressed processing.
Sending module, for compression to be handled after changing frame send to each shared screen.
In embodiments of the present invention, screenshot capture can be obtained from original pattern with predeterminated frequency；With a preset time
Screenshot capture in unit is a processing unit, and the quantity of changing frame in the processing unit is counted respectively；According to the place
Manage the quantity of changing frame and preset time unit setting coding frame per second in unit；According to the coding frame per second to the changing frame
Encoded., will not be in advance to a large amount of repeating frames when thus solving existing video calling cataloged procedure for Screen sharing
Anticipation is done, is caused under the waste computed repeatedly with Internet resources of a large amount of repeating frames, same code rate, part code check quota is wasted and arrived
Above repeating frame, cause the inadequate clearly technical problem of changing frame picture.Achieve calculating and the network reduced to repeating frame
The waste of resource, improves the beneficial effect of changing frame definition.
Moreover, in embodiments of the present invention, can be single using the screenshot capture in a preset time unit as a processing
Member, sets the first frame screenshot capture in the processing unit as changing frame；Cut for the second frame screen of the processing unit
Scheme last frame screenshot capture, whether determine the screenshot capture is changing frame.And it is further, single for the processing
Second frame screenshot capture of member obtains the luminance component of each screenshot capture to last frame screenshot capture；By current screen
The luminance component of the luminance component of sectional drawing and former frame screenshot capture is compared, statistics current screen sectional drawing and former frame screen
The consistent pixel number of gray value at same pixel point in sectional drawing；Judge whether the pixel number is equal to the screen and cuts
The image resolution ratio of figure；If the pixel number is not equal to the image resolution ratio of the screenshot capture, described work as is confirmed
Forth screen sectional drawing is changing frame.So as to improve the accuracy of changing frame.
In addition, in embodiments of the present invention, first interval changing frame of each pre-arranged code can also be set vertical as decoding
That is refresh frame.Then processing is compressed to the changing frame after coding using H.264 compressed format.So as to prevent in decoding
When frame losing occurs in end, decoding error is delivered to next interval, causes the long-term mistake of video.
For device embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with based on teaching in this.As described above, construct required by this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It is understood that, it is possible to use it is various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place is provided, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect, exist
Above in the description of the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：It is i.e. required to protect
The application claims of shield features more more than the feature being expressly recited in each claim.More precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
All as the separate embodiments of the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit is required, summary and accompanying drawing) disclosed in each feature can or similar purpose identical, equivalent by offer alternative features come generation
Replace.
Although in addition, it will be appreciated by those of skill in the art that some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of be the same as Example does not mean in of the invention
Within the scope of and form different embodiments.For example, in the following claims, times of embodiment claimed
One of meaning mode can be used in any combination.
The present invention all parts embodiment can be realized with hardware, or with one or more processor run
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that can use in practice
Microprocessor or digital signal processor (DSP) come realize in Screen sharing equipment according to embodiments of the present invention some or
The some or all functions of person's whole part.The present invention is also implemented as perform method as described herein one
Divide or whole equipment or program of device (for example, computer program and computer program product).It is such to realize this hair
Bright program can be stored on a computer-readable medium, or can have the form of one or more signal.It is such
Signal can be downloaded from internet website and obtained, and either provided or provided in any other form on carrier signal.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" is not excluded the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and coming real by means of properly programmed computer
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
Claims (10)
1. a kind of method for video coding based on Screen sharing, it is characterised in that methods described includes：
Screenshot capture is obtained from original pattern with predeterminated frequency；
Using the screenshot capture in a preset time unit as a processing unit, changing frame in the processing unit is counted respectively
Quantity；
According to the quantity of changing frame in the processing unit and preset time unit setting coding frame per second；
The changing frame is encoded according to the coding frame per second.
2. according to the method described in claim 1, it is characterised in that the screenshot capture using in a preset time unit as
One processing unit, the step of quantity of changing frame in the processing unit is counted respectively, including：
Using the screenshot capture in a preset time unit as a processing unit, the first frame screen in the processing unit is set
Curtain sectional drawing is changing frame；
For the processing unit the second frame screenshot capture to last frame screenshot capture, according to the bright of each screenshot capture
Degree component determines whether the screenshot capture is changing frame；
Count the quantity of changing frame described in the processing unit.
3. method according to claim 2, it is characterised in that the second frame screenshot capture for the processing unit
To last frame screenshot capture, determine whether the screenshot capture is changing frame according to the luminance component of each screenshot capture
Step, including：
For the processing unit the second frame screenshot capture to last frame screenshot capture, obtain the bright of each screenshot capture
Spend component；
The luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture is compared, statistics current screen is cut
Figure and the pixel number that gray value is consistent at same pixel point in former frame screenshot capture；
Judge whether the pixel number is equal to the image resolution ratio of the screenshot capture；
If the pixel number is not equal to the image resolution ratio of the screenshot capture, confirm that the current screen sectional drawing is
Changing frame.
4. method according to claim 3, it is characterised in that judge the pixel number whether equal to described described
After the step of image resolution ratio of screenshot capture, in addition to：
If the pixel number is equal to the image resolution ratio of the screenshot capture, it is quiet to confirm the current screen sectional drawing
Only frame, and being filtered to the frozen frozen mass.
5. according to the method described in claim 1, it is characterised in that described that the changing frame is carried out according to the coding frame per second
The step of coding, including：
First interval changing frame of each pre-arranged code is set to decode refresh frame immediately.
6. a kind of video coding apparatus based on Screen sharing, it is characterised in that described device includes：
Screenshot capture acquisition module, for obtaining screenshot capture from original pattern with predeterminated frequency；
Changing frame statistical module, for using the screenshot capture in a preset time unit as a processing unit, counting respectively
The quantity of changing frame in the processing unit；
Frame per second setting module is encoded, for being compiled according to the quantity of changing frame in the processing unit and the setting of preset time unit
Code frame per second；
Coding module, for being encoded according to the coding frame per second to the changing frame.
7. device according to claim 6, it is characterised in that the changing frame statistical module, including：
First changing frame sets submodule, for using the screenshot capture in a preset time unit as a processing unit, if
The first frame screenshot capture in the fixed processing unit is changing frame；
Second changing frame sets submodule, is cut for the second frame screenshot capture for the processing unit to last frame screen
Figure, determines whether the screenshot capture is changing frame according to the luminance component of each screenshot capture；
Changing frame statistic submodule, the quantity for counting changing frame described in the processing unit.
8. device according to claim 7, it is characterised in that second changing frame sets submodule, including：
Luminance component acquiring unit, for the second frame screenshot capture for the processing unit to last frame screenshot capture,
Obtain the luminance component of each screenshot capture；
Pixel statistic unit, for the luminance component of the luminance component of current screen sectional drawing and former frame screenshot capture to be carried out
Compare, statistics current screen sectional drawing and the pixel number that gray value is consistent at same pixel point in former frame screenshot capture；
Pixel judging unit, for judging whether the pixel number is equal to the image resolution ratio of the screenshot capture；
Changing frame determining unit, if being not equal to the image resolution ratio of the screenshot capture for the pixel number, really
The current screen sectional drawing is recognized for changing frame.
9. device according to claim 8, it is characterised in that after the pixel judging unit, in addition to：
Frozen frozen mass determines filter element, if being equal to the image resolution ratio of the screenshot capture for the pixel number,
It is frozen frozen mass to confirm the current screen sectional drawing, and the frozen frozen mass is filtered.
10. device according to claim 6, it is characterised in that the coding module is additionally operable to set each pre-arranged code area
Between first changing frame be decoding refresh frame immediately.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710496439.1A CN107172376B (en) | 2017-06-26 | 2017-06-26 | Video coding method and device based on screen sharing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710496439.1A CN107172376B (en) | 2017-06-26 | 2017-06-26 | Video coding method and device based on screen sharing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107172376A true CN107172376A (en) | 2017-09-15 |
| CN107172376B CN107172376B (en) | 2020-04-21 |
Family
ID=59828004
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710496439.1A Active CN107172376B (en) | 2017-06-26 | 2017-06-26 | Video coding method and device based on screen sharing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107172376B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613370A (en) * | 2017-10-27 | 2018-01-19 | 烟台北方星空自控科技有限公司 | A kind of Screen sharing frame losing optimized algorithm |
| CN107888583A (en) * | 2017-11-07 | 2018-04-06 | 郑州轻工业学院 | Hydrographic information monitoring method, apparatus and system |
| CN111708505A (en) * | 2020-07-21 | 2020-09-25 | 全时云商务服务股份有限公司 | Desktop sharing method and device and electronic equipment |
| WO2021047177A1 (en) * | 2019-09-09 | 2021-03-18 | 西安万像电子科技有限公司 | Data encoding method and apparatus |
| CN116828242A (en) * | 2023-08-30 | 2023-09-29 | 亿咖通(湖北)技术有限公司 | Method, system and storage medium for long link screen projection |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020005909A1 (en) * | 2000-06-28 | 2002-01-17 | Junichi Sato | Image processing apparatus, image processing method, digital camera, and program |
| CN1622618A (en) * | 2004-12-24 | 2005-06-01 | 北京中星微电子有限公司 | A screen broadcasting method |
| CN1859571A (en) * | 2006-06-01 | 2006-11-08 | 上海交通大学 | Screen coding method under low code rate |
| CN102143360A (en) * | 2010-06-30 | 2011-08-03 | 华为技术有限公司 | Image coding method and device |
| CN102625106A (en) * | 2012-03-28 | 2012-08-01 | 上海交通大学 | Scene self-adaptive screen encoding rate control method and system |
| CN103533358A (en) * | 2013-10-14 | 2014-01-22 | 上海纬而视科技股份有限公司 | Self adaption image collection transmission and display device |
-
2017
- 2017-06-26 CN CN201710496439.1A patent/CN107172376B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020005909A1 (en) * | 2000-06-28 | 2002-01-17 | Junichi Sato | Image processing apparatus, image processing method, digital camera, and program |
| CN1622618A (en) * | 2004-12-24 | 2005-06-01 | 北京中星微电子有限公司 | A screen broadcasting method |
| CN1859571A (en) * | 2006-06-01 | 2006-11-08 | 上海交通大学 | Screen coding method under low code rate |
| CN102143360A (en) * | 2010-06-30 | 2011-08-03 | 华为技术有限公司 | Image coding method and device |
| CN102625106A (en) * | 2012-03-28 | 2012-08-01 | 上海交通大学 | Scene self-adaptive screen encoding rate control method and system |
| CN103533358A (en) * | 2013-10-14 | 2014-01-22 | 上海纬而视科技股份有限公司 | Self adaption image collection transmission and display device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613370A (en) * | 2017-10-27 | 2018-01-19 | 烟台北方星空自控科技有限公司 | A kind of Screen sharing frame losing optimized algorithm |
| CN107888583A (en) * | 2017-11-07 | 2018-04-06 | 郑州轻工业学院 | Hydrographic information monitoring method, apparatus and system |
| WO2021047177A1 (en) * | 2019-09-09 | 2021-03-18 | 西安万像电子科技有限公司 | Data encoding method and apparatus |
| CN111708505A (en) * | 2020-07-21 | 2020-09-25 | 全时云商务服务股份有限公司 | Desktop sharing method and device and electronic equipment |
| CN116828242A (en) * | 2023-08-30 | 2023-09-29 | 亿咖通(湖北)技术有限公司 | Method, system and storage medium for long link screen projection |
| CN116828242B (en) * | 2023-08-30 | 2023-12-05 | 亿咖通(湖北)技术有限公司 | Method, system and storage medium for long link screen projection |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107172376B (en) | 2020-04-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107172376A (en) | A kind of method for video coding and device based on Screen sharing | |
| CN105900425B (en) | Indicate the motion vector in encoded bit stream | |
| US5861922A (en) | Image data coding and restoring method and apparatus for coding and restoring the same | |
| US11647182B2 (en) | Method and apparatus for intra prediction in video coding | |
| AU2023202684B2 (en) | Method and apparatus for intra prediction | |
| CN112351285B (en) | Video encoding method, video decoding method, video encoding device, video decoding device, electronic equipment and storage medium | |
| GB2509563A (en) | Encoding or decoding a scalable video sequence using inferred SAO parameters | |
| US11503335B2 (en) | Method and apparatus for intra prediction | |
| CN115118964A (en) | Video encoding method, video encoding device, electronic equipment and computer-readable storage medium | |
| CN115866297A (en) | Video processing method, device, equipment and storage medium | |
| US11445181B2 (en) | Method and apparatus for predicting most probable intra-modes | |
| WO2023287315A1 (en) | Video coding with dynamic groups of pictures | |
| CN107222743A (en) | A kind of image processing method, device and system | |
| CN110012307A (en) | Video transmission method, device and main terminal equipment | |
| EP3989566A1 (en) | Motion information list construction method in video encoding and decoding, device, and apparatus | |
| Chen et al. | 263 (including H. 263+) and other ITU-T video coding standards | |
| CN115150370A (en) | Image processing method | |
| GB2509706A (en) | Encoding or decoding a scalable video sequence using inferred SAO parameters | |
| CN117979015A (en) | Video encoding and decoding method, video encoder and video decoder | |
| JPH11252570A (en) | Moving image communication system | |
| JPH0440118A (en) | Quantizer | |
| Puri | Tsuhan Chen Carnegie Mellon University, Pittsburgh, Pennsylvania Gary J. Sullivan Picture Tel Corporation, Andover, Massachusetts |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |