CN105916052A - Video frame drawing method and device - Google Patents
Video frame drawing method and device Download PDFInfo
- Publication number
- CN105916052A CN105916052A CN201510934280.8A CN201510934280A CN105916052A CN 105916052 A CN105916052 A CN 105916052A CN 201510934280 A CN201510934280 A CN 201510934280A CN 105916052 A CN105916052 A CN 105916052A
- Authority
- CN
- China
- Prior art keywords
- picture
- video
- renderer
- rendering parameter
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000009877 rendering Methods 0.000 claims abstract description 83
- 239000003999 initiator Substances 0.000 claims abstract description 32
- 238000012544 monitoring process Methods 0.000 claims description 11
- 230000001143 conditioned effect Effects 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 3
- 230000004044 response Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 18
- 230000005540 biological transmission Effects 0.000 description 4
- 241000208340 Araliaceae Species 0.000 description 3
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 3
- 235000003140 Panax quinquefolius Nutrition 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 235000008434 ginseng Nutrition 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000010422 painting Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the invention provides a video frame drawing method and device. The method comprises the steps that GLSurface View and a first renderer and a second renderer corresponding to GLSurface View are created; first rendering parameters are configured for the first renderer, wherein the first rendering parameters at least include the frame position and the frame size of a video initiator; second rendering parameters are configured for the second renderer, wherein the second rendering parameters at least include the frame position and the frame size of a video receiver; and when a video conversation is established, the first renderer and the second renderer draw each frame of received image according to the first rendering parameters and the second rendering parameters respectively. According to the video frame drawing method and device, occupation of mobile phone resources can be reduced so as to guarantee the quality of the video conversation.
Description
Technical field
The present embodiments relate to technical field of image processing, particularly relate to painting of a kind of video pictures
Method and device processed.
Background technology
That day being born from computer, the true simulation to real world is exactly graphics field
The final goal pursued.Rendering, in computer graphics, refers to software from model generation figure
The process of picture.In graphical display manipulation, rendering is last important step, is obtained by it
Model and the final display effect of animation.Rendering is widely used in computer and video-game, mould
Plan, film or the actual application scenarios such as TV specially good effect and the visual design.For rendering display
Mode different, can be roughly divided into two classes: pre-rendered (pre-rendering or
And real-time rendering (real-timerendering or onlinerendering) offlinerendering).Wherein,
Content to be rendered is previously positioned on server by developer exactly and renders, in advance by pre-rendered
The calculating intensity rendered is very big, is generally used for complex scene and processes, the 3D film making the most extremely dazzled
Deng.Real-time rendering requirements real-time experience, is frequently used for the scenes such as all kinds of 3D game, it usually needs depend on
This process is completed by hardware accelerator.
This locality generally can be used to render at present or high in the clouds Rendering realizes the drafting to picture.
Local Rendering is exactly the hardware device of subscriber equipment (UserEquipment, UE), such as: central authorities
Processor (CentralProcessingUnit, CPU), graphic process unit (GraphicProcessingUnit,
GPU) rendering model, after rendering end, display device is transferred rendering result and is shown.
High in the clouds Rendering is exactly the operation of subscriber equipment to move on to high in the clouds run, then final result,
Send subscriber equipment to by pictorial manner to show.
Along with the development of communication technology, people the most increasingly get used to utilizing mobile phone to carry out
Video calling.Also above-mentioned graphics rendering techniques can be related to during video calling.Video
Call often relates to the initiator of video calling and the recipient of video calling.The most in the art
Can be as described below for the drafting of picture in video calling:
It is possible, firstly, to initiator and recipient for video calling set up different respectively
GLSurfaceView, is then sent out video calling respectively by the two GLSurfaceView
The image playing side and recipient is drawn, such that it is able to realize the process of video calling.
But above-mentioned prior art can there is a disadvantage in that establishment two
GLSurfaceView can consume more internal memory undoubtedly and can take more cpu utilization rate,
Thus cause the waste of mobile phone resources, it addition, carry out picture based on two GLSurfaceView
The drafting in face, the picture position obtained the most all is inconvenient to be adjusted.
Summary of the invention
The embodiment of the present invention provides method for drafting and the device of a kind of video pictures, it is possible to reduce opponent
Taking of machine resource, to ensure the quality of video calling.
The embodiment of the present invention provides the method for drafting of a kind of video pictures, including: create
GLSurfaceView and first renderer corresponding with described GLSurfaceView and the second wash with watercolours
Dye device；Configuring the first rendering parameter for described first renderer, described first rendering parameter at least wraps
Include picture position and the picture dimension of video initiator；Render for described second renderer configuration second
Parameter, described second rendering parameter at least includes picture position and the picture dimension of video recipient；
When video calling is set up, described first renderer and described second renderer are respectively according to described
One rendering parameter and described second rendering parameter, draw each frame picture received.
The drawing apparatus of a kind of video pictures that the embodiment of the present invention provides, including: renderer creates
Unit, for creating GLSurfaceView and corresponding with described GLSurfaceView the
One renderer and the second renderer；First rendering parameter dispensing unit, for rendering for described first
Device configures the first rendering parameter, and described first rendering parameter at least includes the picture position of video initiator
Put and picture dimension；Second rendering parameter dispensing unit, for for described second renderer configuration the
Two rendering parameter, described second rendering parameter at least includes picture position and the picture of video recipient
Size；Drawing unit, is used for when video calling is set up, described first renderer and described second
Renderer is respectively according to described first rendering parameter and described second rendering parameter, each to receive
Frame picture is drawn.
The method for drafting of the video pictures that the embodiment of the present invention provides and device, only arrange one
GLSurfaceView, generates two renderers of correspondence under this GLSurfaceView simultaneously.Its
In renderer be used for the picture of render video call initiator, another renderer is then used for wash with watercolours
The picture of dye video calling recipient.The picture position of the video calling initiator by pre-setting
With picture dimension and the picture position of video recipient and picture dimension, render such that it is able to limit
The positions and dimensions of the picture obtained.So, just can be realized by a GLSurfaceView
The drawing process of video calling both sides' picture, saves the resource of mobile phone.Further, by right
Network state in video call process is monitored, such that it is able to according to actual network state,
Resolution or frame per second are adjusted, to ensure the smooth and easy of video calling.Additionally, by monitoring
Touch command on handset touch panel, such that it is able to according to the touch command picture to video calling both sides
Position, face is adjusted, it is ensured that the convenience of video call process.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will
The accompanying drawing used required in embodiment or description of the prior art is introduced the most simply, aobvious and easy
Insight, the accompanying drawing in describing below is some embodiments of the present invention, for ordinary skill
From the point of view of personnel, on the premise of not paying creative work, it is also possible to obtain it according to these accompanying drawings
His accompanying drawing.
The method for drafting flow chart of a kind of video pictures that Fig. 1 provides for the embodiment of the present application；
The drawing apparatus functional block diagram of a kind of video pictures that Fig. 2 provides for the embodiment of the present application.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with
Accompanying drawing in the embodiment of the present invention, carries out clear, complete to the technical scheme in the embodiment of the present invention
Ground describes, it is clear that described embodiment is a part of embodiment of the present invention rather than whole
Embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creation
The every other embodiment obtained under property work premise, broadly falls into the scope of protection of the invention.
The method for drafting flow chart of a kind of video pictures that Fig. 1 provides for the embodiment of the present application.Although
Multiple operations that flow process include with particular order occur are described below, but it should be clearly understood that this
A little processes can include more or less of operation, and these operations can sequentially perform or executed in parallel
(such as using parallel processor or multi-thread environment).As it is shown in figure 1, described method may include that
S1: create GLSurfaceView and corresponding with described GLSurfaceView first
Renderer and the second renderer.
Described GLSurfaceView is a view, and its embedded surface can be responsible for
OpenGL renders.Described GLSurfaceView often can provide following characteristic:
1) management one surface, this surface can be one piece of internal memory, it is possible to directly typesetting is arrived
On the view of Android；
2) content can be rendered into above-mentioned by management one EGL display, this EGL display
On surface；
3) User Defined renderer is supported；
4) renderer is allowed to operate in independent thread, the thread operated by renderer and UI thread
Separate；
5) support on-demand render (on-demand) and render (continuous) continuously.
After creating described GLSurfaceView, described GLSurfaceView can be entered
Row initializes.Specifically, often possess some acquiescences when creating due to GLSurfaceView
Configuration, these acquiescence configurations often can not modify.Therefore during initialized,
The renderer of predetermined number is mainly set in described GLSurfaceView, with respectively to video
Initiator and the recipient of call carry out picture and render.Specifically, the embodiment of the present application can be passed through
SetRenderer (Renderer) instruction arranges a renderer.
It addition, described GLSurfaceView can give tacit consent to establishment pixel format it is
The surface of PixelFormat.RGB_565.Certainly, user can be according to the actual requirements to this pixel
Form is modified, such as can be by calling getHolder () .setFormat (PixelFormat.
TRANSLUCENT) transparent effect is changed in instruction.The pixel format of transparent surface is all
32, each color elements is 8 bit depth, and this just illustrates that this pixel format is probably ARGB
Or RGBA.
In Android device, often support that multiple EGL configures, the most permissible
Use different number of passage (channel), it is also possible to specify each passage to have different number of position
(bits) degree of depth.Therefore, before renderer works, just should specify the configuration of EGL.Described
The pixel format of GLSurfaceView acquiescence EGL configuration is RGB_656, the depth buffer of 16
(depth buffer), acquiescence is not turned on shade caching (stencil buffer).Certainly, if needing to select
Different EGL configurations, then can call setEGLConfigChooser instruction and be replaced.
Configuration parameter in described GLSurfaceView is being modified and predetermined number is being set
Renderer after, just can specify the render mode of renderer, in the embodiment of the present application owing to needing
The picture of video calling carried out real-time rendering, therefore the render mode of renderer all can be set
It is set to render continuously.
When using GLSurfaceView that the picture of video calling is drawn, can be by handing over
Formula or noninteractive method are drawn mutually.Specifically, described noninteractive method for drafting
The video calling picture obtained can not carry out interaction with user, such as can not touching in response to user
Control instruction is adjusted correspondingly.In the application one preferred embodiment, in order to according to user
Touch command the position of video pictures is adjusted, interactively method for drafting pair can be used
The picture of video calling is drawn.Specifically, due to render to as if in independent process,
When needing the object rendered is interacted, then need the mechanism using cross-thread to carry out event
Process.Specifically, queueEvent (Runnable) can be used in the embodiment of the present application to refer to
Order is configured.So, described GLSurfaceView the video pictures drawn just can ring
Should interact with user in the touch command of user.
In the embodiment of the present application, the first renderer and can be set in GLSurfaceView
Two renderers, wherein, described first renderer can be local renderer, is used for rendering this locality and adopts
The video information of collection；Described second renderer can be remote rendering device, converses for render video
The video information remotely sent of recipient.
S2: configuring the first rendering parameter for described first renderer, described first rendering parameter is at least
Picture position and picture dimension including video initiator.
After being provided with the first renderer, can be that described first renderer configuration first renders ginseng
Number.Described first rendering parameter is the rule rendering video information, such as the picture after rendering
Picture size after where face is positioned at and renders is how many.In described first rendering parameter extremely
Picture position and the picture dimension of video initiator can be included less.The video of described video initiator
Information can be sent in described first renderer by after local camera collection, and by described first
Renderer renders, and becomes local video pictures.The position of the video pictures of described this locality with
And size then can be defined by described first rendering parameter.Such as, local video pictures can
To be positioned at the lower left corner of overall picture, size is the 1/8 of overall picture.
Local photographic head, can be by the video information that collects according to one after collecting video information
Fixed frame per second sends to described first renderer.The each frame received is regarded by described first renderer
Frequently information all carries out being rendered to picture, and the picture after rendering shows user according to same frame per second,
Thus provide the user with the picture of video calling.
S3: configuring the second rendering parameter for described second renderer, described second rendering parameter is at least
Picture position and picture dimension including video recipient.
Same, after being provided with the second renderer, can be that described second renderer configures the
Two rendering parameter.Described second rendering parameter is the rule rendering video information equally, example
Picture size after where being positioned at such as the picture after rendering and render is how many.Described second
Rendering parameter at least can include picture position and the picture dimension of video recipient.Described video
After the video information of recipient can be by local camera collection, sent out to video by network transmission
Play the address at place, side.So, send out when the video information of described video recipient arrives video
When playing side, can be rendered it by described second renderer, the picture after rendering just can be in
Watch now to the initiator of video calling.The picture position of described video calling recipient and
Size then can be defined by described second rendering parameter.Such as, the regarding of video calling recipient
Frequently picture can be in the middle of overall picture, and size is for being paved with overall picture.
The video information of the recipient of described video calling equally sends extremely according to certain frame per second
The initiator of video calling, after rendering through described second renderer, just can be according to same
The frame per second of sample presents to the initiator of video calling, thus forms the picture of video calling.
S4: when video calling is set up, described first renderer and described second renderer are respectively
According to described first rendering parameter and described second rendering parameter, each frame picture received is entered
Row is drawn.
After the recipient of video calling have received video calling request, video calling initiator
And between video calling recipient, just establish video calling, and now, first can be according to video
Each frame picture that described second renderer is received by the picture position of recipient and picture dimension enters
Row is drawn, and obtains second picture stream.Picture in this second picture stream is to enter according to preset frame rate
Row transmission, this preset frame rate can be such as 24 frames/second or 30 frames/second.Obtaining described
After two picture stream, can be according to the picture position of video initiator and picture dimension to described
Each frame picture that one renderer receives is drawn, and obtains the first picture stream.Same, should
Picture in first picture stream is also to be transmitted according to preset frame rate, and this preset frame rate such as may be used
Think 24 frames/second or 30 frames/second.During carrying out video calling, described second picture
Flowing to toward the window that can be paved with video calling as background, described first picture stream is the most permissible
Being suspended on described second picture stream, the most described second picture stream just will not shelter from described
One picture stream.It is to say, after obtaining second picture stream and the first picture stream, can be by institute
State the first picture stream and load on described second picture stream, constitute video pictures.As it has been described above,
The described window that can be paved with video calling as background, described first picture stream then can position
In the lower left corner of video calling window, and account for 1/8 size of whole window.
During carrying out video calling, between resolution and adjacent two frames of each frame picture
The frame per second of transmission often determines the quality of video pictures.The resolution of each frame picture is the highest,
So video pictures is the most clear, but also can take more Internet resources, to network-like simultaneously
The requirement of state is higher.Similarly, between adjacent two frames, the frame per second of transmission is the highest, and video pictures is just
Can be the most smooth, but simultaneously can take more Internet resources equally, to the requirement of network state relatively
High.Therefore, in the application one preferred embodiment, in order to ensure the smooth and easy of video calling, can
With the difference according to network state, the picture of described video recipient is adjusted correspondingly.
Specifically, the embodiment of the present application can monitor the network state of video initiator, when described network
When state meets pre-conditioned, it is adjusted to the screen resolution of described video recipient preset and divides
Resolution.Such as, when described network state is preferable, and its network delay is less than predetermined threshold value, can
So that the resolution of current picture is heightened, to increase the definition of picture.Contrary, when described
Network state is poor, when its network delay is higher than predetermined threshold value, and can be by the resolution of current picture
Rate is turned down, to ensure the fluency of picture.
Same, the embodiment of the present application can also monitor the network state of video initiator, works as institute
State network state when meeting pre-conditioned, the picture of described video recipient is rendered frame per second according to
Preset rules is adjusted.Such as, when described network state is preferable, its network delay is less than pre-
If during threshold value, the frame per second of current picture can be heightened, to increase the fluency of picture.On the contrary
, when described network state is poor, when its network delay is higher than predetermined threshold value, can be by current
The frame per second of picture is turned down, to ensure that picture is unlikely to interrupt.It practice, in order to ensure Dynamic Graph
The picture of picture renders quality in controlled range, it is also possible to limits picture and renders at frame per second used
Between minimum frame per second and maximum frame per second, wherein maximum frame per second is can ideally operation state figure
As required maximum frame rate value, the minimum that minimum frame per second can be tolerated when being operation state image
Frame rate value.That is, picture renders frame per second used compare with this minimum frame per second and maximum frame per second
Relatively, if above-mentioned picture renders frame per second used and is less than this minimum frame per second, then by above-mentioned picture wash with watercolours
Frame per second used by dye is set to this minimum frame per second；It is more than if above-mentioned picture renders frame per second used
This maximum frame per second, then render above-mentioned picture frame per second used and be set to this maximum frame per second.Described
Minimum frame per second can be such as 20 frames/second, described maximum frame per second can be such as 60 frames/
Second.
In the application one is preferable to carry out, can picture to described video recipient according to the following equation
Face renders frame per second and is adjusted:
Wherein, INT is bracket function, and δ is that the picture after regulation renders frame per second, and N is for render every time
Time picture frame number, T is to render the time needed for N frame picture, and k is adjustment factor.Described regulation
Coefficient can be adjusted according to network state, between 0.1 to 1.The embodiment of the present application
Can set up the relation between network delay and described adjustment factor, this relation can use inverse proportion letter
Number represents, when network delay is the highest, the adjustment factor of its correspondence is the least；Work as network delay
Time the lowest, the adjustment factor of its correspondence is the biggest.
Therefore, the method for drafting of the video pictures that the embodiment of the present invention provides, only arrange one
Individual GLSurfaceView, generates corresponding two simultaneously under this GLSurfaceView and renders
Device.One of them renderer is used for the picture of render video call initiator, another renderer
Then it is used for the picture of render video call recipient.By the video calling initiator pre-set
Picture position and picture dimension and the picture position of video recipient and picture dimension, thus
The positions and dimensions rendering the picture obtained can be limited.So, by one
GLSurfaceView just can realize the drawing process of video calling both sides' picture, saves hands
The resource of machine.Further, by the network state in video call process is monitored,
Such that it is able to according to actual network state, resolution or frame per second are adjusted, to ensure
Video calling smooth and easy.Additionally, be by the touch command on monitoring handset touch panel, thus can
The picture position of video calling both sides is adjusted according to touch command, it is ensured that video leads to
The convenience of words process.
The embodiment of the present application also provides for the drawing apparatus of a kind of video pictures.Fig. 2 is that the application is real
Execute the drawing apparatus functional block diagram of a kind of video pictures that example provides.As in figure 2 it is shown, it is described
Device may include that
Renderer creating unit 100, is used for creating GLSurfaceView and with described
The first corresponding for GLSurfaceView renderer and the second renderer；
First rendering parameter dispensing unit 200, for rendering ginseng for described first renderer configuration first
Number, described first rendering parameter at least includes picture position and the picture dimension of video initiator；
Second rendering parameter dispensing unit 300, for rendering ginseng for described second renderer configuration second
Number, described second rendering parameter at least includes picture position and the picture dimension of video recipient；
Drawing unit 400, is used for when video calling is set up, described first renderer and described second
Renderer is respectively according to described first rendering parameter and described second rendering parameter, each to receive
Frame picture is drawn.
In the application one preferred embodiment, described drawing unit 400 specifically includes:
Second picture stream acquisition module, for when video calling is set up, according to video recipient
Each frame picture that described second renderer is received by picture position and picture dimension is drawn,
To second picture stream；
First picture stream acquisition module, for the picture position according to video initiator and picture dimension
The each frame picture receiving described first renderer is drawn, and obtains the first picture stream；
Load-on module, for described first picture stream is loaded on described second picture stream, structure
Become video pictures.
Wherein, after described load-on module, described device also includes:
Touch command monitoring modular, for monitoring the touch command on described video pictures, and rings
The touch command that Ying Yu monitors, enters the position of described first picture stream or second picture stream
Row is mobile.
In another preferred embodiment of the application, described device can also include:
Resolution adjustment unit, for monitoring the network state of video initiator, when described network
When state meets pre-conditioned, it is adjusted to the screen resolution of described video recipient preset and divides
Resolution.
In another preferred embodiment of the application, described device can also include:
Frame rate adjustment unit, for monitoring the network state of video initiator, when described network state
When meeting pre-conditioned, the picture of described video recipient is rendered frame per second and carries out according to preset rules
Regulation.
Specifically, in the embodiment of the present application can be according to the following equation to described video recipient
Picture renders frame per second and is adjusted:
Wherein, INT is bracket function, and δ is that the picture after regulation renders frame per second, and N is each wash with watercolours
Picture frame number during dye, T is to render the time needed for N frame picture, and k is adjustment factor.
It should be noted that the specific implementation of the embodiment of the present application each functional module above-mentioned
Consistent with step S1 to S4, the most just repeat no more.
Therefore, the drawing apparatus of the video pictures that the embodiment of the present invention provides, only arrange one
Individual GLSurfaceView, generates corresponding two simultaneously under this GLSurfaceView and renders
Device.One of them renderer is used for the picture of render video call initiator, another renderer
Then it is used for the picture of render video call recipient.By the video calling initiator pre-set
Picture position and picture dimension and the picture position of video recipient and picture dimension, thus
The positions and dimensions rendering the picture obtained can be limited.So, by one
GLSurfaceView just can realize the drawing process of video calling both sides' picture, saves hands
The resource of machine.Further, by the network state in video call process is monitored,
Such that it is able to according to actual network state, resolution or frame per second are adjusted, to ensure
Video calling smooth and easy.Additionally, be by the touch command on monitoring handset touch panel, thus can
The picture position of video calling both sides is adjusted according to touch command, it is ensured that video leads to
The convenience of words process.
In this manual, such as first and second such adjectives can be only used for a unit
Element or action make a distinction with another element or action, without requiring or imply this of any reality
The relation of kind or order.In the case of environment allows, reference element or parts or step (s) are no
Should be interpreted that be confined in only element, parts or step, and can be element, parts,
Or one or more etc. in step.
Each embodiment in this specification all uses the mode gone forward one by one to describe, between each embodiment
Identical similar part sees mutually, and what each embodiment stressed is to implement with other
The difference of example.For system embodiment, owing to it is substantially similar to method in fact
Executing example, so describe is fairly simple, relevant part sees the part of embodiment of the method and illustrates.
The application can be used in numerous general or special purpose computing system environments or configuration.Such as:
Personal computer, server computer, handheld device or portable set, laptop device, many
Processor system, system based on microprocessor, set top box, programmable consumer-elcetronics devices,
Network PC, minicomputer, mainframe computer, include the distributed of any of the above system or equipment
Computing environment etc..
It is last it is noted that the description of the above various embodiments to the application is with the mesh described
Be supplied to those skilled in the art.It is not intended to exhaustive or is not intended to limit the present invention
It is formed on single disclosed embodiment.As it has been described above, the various replacements of the application and change are for upper
Will be apparent from for stating technology one of ordinary skill in the art.Therefore, although the most specifically beg for
Discuss the embodiment of some alternatives, but other embodiment will be apparent from, or this
Skilled person relatively easily draws.The application is intended to be included in this present invention discussed
All replacements, amendment and change, and fall in the spirit and scope of above-mentioned application other
Embodiment.
Claims (10)
1. the method for drafting of a video pictures, it is characterised in that including:
Create GLSurfaceView and corresponding with described GLSurfaceView first to render
Device and the second renderer；
Configuring the first rendering parameter for described first renderer, described first rendering parameter at least includes
The picture position of video initiator and picture dimension；
Configuring the second rendering parameter for described second renderer, described second rendering parameter at least includes
The picture position of video recipient and picture dimension；
When video calling is set up, described first renderer and described second renderer are respectively according to institute
State the first rendering parameter and described second rendering parameter, each frame picture received is drawn.
The method for drafting of video pictures the most according to claim 1, it is characterised in that described
First renderer is local renderer, and described second renderer is remote rendering device.
The method for drafting of video pictures the most according to claim 1, it is characterised in that when regarding
When frequency call is set up, described first renderer and described second renderer are respectively according to described first wash with watercolours
Dye parameter and described second rendering parameter, carry out drafting to each frame picture received and specifically include:
When video calling is set up, picture position and picture dimension according to video recipient are to described
Each frame picture that second renderer receives is drawn, and obtains second picture stream；
It is every that described first renderer is received by picture position according to video initiator and picture dimension
One frame picture is drawn, and obtains the first picture stream；
Described first picture stream is loaded on described second picture stream, constitute video pictures.
The method for drafting of video pictures the most according to claim 3, it is characterised in that
After second picture stream, described method also includes:
The network state of monitoring video initiator, when described network state meets pre-conditioned, will
The screen resolution of described video recipient is adjusted to preset resolution.
The method for drafting of video pictures the most according to claim 3, it is characterised in that
After second picture stream, described method also includes:
The network state of monitoring video initiator, when described network state meets pre-conditioned, will
The picture of described video recipient renders frame per second and is adjusted according to preset rules.
The method for drafting of video pictures the most according to claim 5, it is characterised in that according to
Following formula renders frame per second to the picture of described video recipient and is adjusted:
Wherein, INT is bracket function, and δ is that the picture after regulation renders frame per second, and N is for render every time
Time picture frame number, T is to render the time needed for N frame picture, and k is adjustment factor.
The method for drafting of video pictures the most according to claim 3, it is characterised in that inciting somebody to action
Described first picture stream loads on described second picture stream, after constituting video pictures, described
Method also includes:
Monitor the touch command on described video pictures, and in response to the touch command monitored, will
The position of described first picture stream or second picture stream moves.
8. the drawing apparatus of a video pictures, it is characterised in that including:
Renderer creating unit, is used for creating GLSurfaceView and with described
The first corresponding for GLSurfaceView renderer and the second renderer；
First rendering parameter dispensing unit, for configuring the first rendering parameter for described first renderer,
Described first rendering parameter at least includes picture position and the picture dimension of video initiator；
Second rendering parameter dispensing unit, for configuring the second rendering parameter for described second renderer,
Described second rendering parameter at least includes picture position and the picture dimension of video recipient；
Drawing unit, is used for when video calling is set up, described first renderer and described second wash with watercolours
Dye device is respectively according to described first rendering parameter and described second rendering parameter, to each frame received
Picture is drawn.
The drawing apparatus of video pictures the most according to claim 8, it is characterised in that described
Drawing unit specifically includes:
Second picture stream acquisition module, for when video calling is set up, according to video recipient
Each frame picture that described second renderer is received by picture position and picture dimension is drawn,
To second picture stream；
First picture stream acquisition module, for the picture position according to video initiator and picture dimension
The each frame picture receiving described first renderer is drawn, and obtains the first picture stream；
Load-on module, for described first picture stream is loaded on described second picture stream, structure
Become video pictures.
The drawing apparatus of video pictures the most according to claim 9, it is characterised in that
After described load-on module, described device also includes:
Touch command monitoring modular, for monitoring the touch command on described video pictures, and responds
In the touch command monitored, the position of described first picture stream or second picture stream is moved
Dynamic.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510934280.8A CN105916052A (en) | 2015-12-15 | 2015-12-15 | Video frame drawing method and device |
| PCT/CN2016/088195 WO2017101303A1 (en) | 2015-12-15 | 2016-07-01 | Video image drawing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510934280.8A CN105916052A (en) | 2015-12-15 | 2015-12-15 | Video frame drawing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105916052A true CN105916052A (en) | 2016-08-31 |
Family
ID=56744080
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510934280.8A Pending CN105916052A (en) | 2015-12-15 | 2015-12-15 | Video frame drawing method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105916052A (en) |
| WO (1) | WO2017101303A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124637A (en) * | 2017-05-18 | 2017-09-01 | 北京视博云科技有限公司 | Method and device, computer-readable storage medium in the enterprising row information notice of light terminal |
| CN107888970A (en) * | 2017-11-29 | 2018-04-06 | 天津聚飞创新科技有限公司 | Method for processing video frequency, device, embedded device and storage medium |
| CN108184054A (en) * | 2017-12-28 | 2018-06-19 | 上海传英信息技术有限公司 | A kind of preprocess method and pretreatment unit for intelligent terminal shooting image |
| CN114071229A (en) * | 2021-12-08 | 2022-02-18 | 四川启睿克科技有限公司 | Method for solving recovery delay when surface View renderer reloads video for decoding |
| CN115619911A (en) * | 2022-10-26 | 2023-01-17 | 润芯微科技(江苏)有限公司 | Virtual image generation method based on non-real Engine |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109285211B (en) * | 2018-10-29 | 2023-03-31 | Oppo广东移动通信有限公司 | Picture rendering method and device, terminal and storage medium |
| CN111626915B (en) * | 2020-05-29 | 2024-03-26 | 大陆汽车车身电子系统（芜湖）有限公司 | Image display method |
| CN115942131B (en) * | 2023-02-09 | 2023-09-01 | 蔚来汽车科技(安徽)有限公司 | Method for guaranteeing vehicle looking-around function, cabin system, vehicle and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901668A (en) * | 2005-07-19 | 2007-01-24 | 腾讯科技（深圳）有限公司 | Multiple person video frequency data display processing method and system |
| US20140173507A1 (en) * | 2012-12-19 | 2014-06-19 | Barco N.V. | Display wall layout optimization |
| CN103916621A (en) * | 2013-01-06 | 2014-07-09 | 腾讯科技（深圳）有限公司 | Method and device for video communication |
| US20140237405A1 (en) * | 2011-10-26 | 2014-08-21 | Huawei Device Co., Ltd | Method and Apparatus for Taking Screenshot of Screen of Application in Mobile Terminal |
| CN104811785A (en) * | 2015-04-01 | 2015-07-29 | 乐视致新电子科技（天津）有限公司 | Control method and device for displaying graphical user interface of intelligent terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014184956A1 (en) * | 2013-05-17 | 2014-11-20 | 三菱電機株式会社 | Image synthesis device and method |
| US9901822B2 (en) * | 2014-01-09 | 2018-02-27 | Square Enix Holding Co., Ltd. | Video gaming device with remote rendering capability |
-
2015
- 2015-12-15 CN CN201510934280.8A patent/CN105916052A/en active Pending
-
2016
- 2016-07-01 WO PCT/CN2016/088195 patent/WO2017101303A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1901668A (en) * | 2005-07-19 | 2007-01-24 | 腾讯科技（深圳）有限公司 | Multiple person video frequency data display processing method and system |
| US20140237405A1 (en) * | 2011-10-26 | 2014-08-21 | Huawei Device Co., Ltd | Method and Apparatus for Taking Screenshot of Screen of Application in Mobile Terminal |
| US20140173507A1 (en) * | 2012-12-19 | 2014-06-19 | Barco N.V. | Display wall layout optimization |
| CN103916621A (en) * | 2013-01-06 | 2014-07-09 | 腾讯科技（深圳）有限公司 | Method and device for video communication |
| CN104811785A (en) * | 2015-04-01 | 2015-07-29 | 乐视致新电子科技（天津）有限公司 | Control method and device for displaying graphical user interface of intelligent terminal |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107124637A (en) * | 2017-05-18 | 2017-09-01 | 北京视博云科技有限公司 | Method and device, computer-readable storage medium in the enterprising row information notice of light terminal |
| CN107888970A (en) * | 2017-11-29 | 2018-04-06 | 天津聚飞创新科技有限公司 | Method for processing video frequency, device, embedded device and storage medium |
| CN108184054A (en) * | 2017-12-28 | 2018-06-19 | 上海传英信息技术有限公司 | A kind of preprocess method and pretreatment unit for intelligent terminal shooting image |
| CN108184054B (en) * | 2017-12-28 | 2020-12-08 | 上海传英信息技术有限公司 | Preprocessing method and preprocessing device for images shot by intelligent terminal |
| CN114071229A (en) * | 2021-12-08 | 2022-02-18 | 四川启睿克科技有限公司 | Method for solving recovery delay when surface View renderer reloads video for decoding |
| CN115619911A (en) * | 2022-10-26 | 2023-01-17 | 润芯微科技(江苏)有限公司 | Virtual image generation method based on non-real Engine |
| CN115619911B (en) * | 2022-10-26 | 2023-08-08 | 润芯微科技(江苏)有限公司 | Virtual image generation method based on Unreal Engine |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017101303A1 (en) | 2017-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105916052A (en) | Video frame drawing method and device | |
| CN113099298B (en) | Method and device for changing virtual image and terminal equipment | |
| TWI668577B (en) | Rendering apparatus, rendering method thereof, program and recording medium | |
| CN105825801A (en) | Display control method and electronic device | |
| CN104540012B (en) | Content shared method, apparatus and terminal | |
| CN105005426A (en) | Screenshot method and system for touch screen terminal, and data sharing method and system for touch screen terminal | |
| CN106023904A (en) | Display control method and device based on electronic ink screen | |
| WO2022262618A1 (en) | Screen saver interaction method and apparatus, electronic device, and storage medium | |
| WO2016034031A1 (en) | Method and device for adjusting colour of webpage content | |
| CN103533240A (en) | Method and device for calibrating parameters in real time during photographing and photo post-processing | |
| WO2021169583A1 (en) | Virtual reality display device and control method therefor | |
| CN113282212A (en) | Interface display method, interface display device and electronic equipment | |
| CN103685963B (en) | image display processing method and device | |
| CN112686939A (en) | Depth image rendering method, device and equipment and computer readable storage medium | |
| CN113645476A (en) | Picture processing method and device, electronic equipment and storage medium | |
| CN106792093B (en) | Video split-screen playing method and device and playing terminal | |
| CN104516696B (en) | A kind of information processing method and electronic equipment | |
| CN106325657A (en) | Screen projection display control method and device and mobile terminal | |
| CN108093245B (en) | Multi-screen fusion method, system, device and computer readable storage medium | |
| CN106909263A (en) | The interactive display method and system of 3-D view | |
| CN114428573B (en) | Special effect image processing method and device, electronic equipment and storage medium | |
| US11095956B2 (en) | Method and system for delivering an interactive video | |
| CN112256220B (en) | Screen control method, device, terminal and storage medium | |
| CN104917968B (en) | The method of adjustment and device of image boundary of taking pictures intensity | |
| CN114419238A (en) | Special effect image processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160831 |