CN107566853A - Realize the video data real-time processing method and device, computing device of scene rendering - Google Patents
Realize the video data real-time processing method and device, computing device of scene rendering Download PDFInfo
- Publication number
- CN107566853A CN107566853A CN201710860138.2A CN201710860138A CN107566853A CN 107566853 A CN107566853 A CN 107566853A CN 201710860138 A CN201710860138 A CN 201710860138A CN 107566853 A CN107566853 A CN 107566853A
- Authority
- CN
- China
- Prior art keywords
- image
- processing
- current frame
- video data
- special object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a kind of video data real-time processing method and device, computing device for realizing scene rendering, its method includes：Real-time image acquisition collecting device is captured and/or the video recorded in include special object current frame image；Or the current frame image that special object is included in currently played video is obtained in real time, scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to special object；Drawing three-dimensional scene background figure；Three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the image after present frame processing；Image after present frame is handled covers the video data after former current frame image is handled；Video data after display processing.The present invention uses deep learning method, completes scene cut processing with realizing the high accuracy of high efficiency.And user's technical merit is not limited, it is not necessary to which user carries out extra process to image, saves user time.
Description
Technical field
The present invention relates to image processing field, and in particular to a kind of video data real-time processing method for realizing scene rendering
And device, computing device.
Background technology
With the development of science and technology, the technology of image capture device also increasingly improves.Regarded using what image capture device was recorded
Frequency also becomes apparent from, resolution ratio, display effect also greatly improve.But the video of existing recording is only dull recorded material sheet
Body, the increasing individual requirement that user proposes can not be met.Prior art can be manual by user after recorded video
It is further again to video to be handled, to meet the individual requirement of user.But so processing needs user to have higher figure
As treatment technology, and the cost user more time is needed in processing, handle cumbersome, technical sophistication.
Therefore, it is necessary to a kind of video data real-time processing method for realizing scene rendering, to meet of user in real time
Propertyization requirement.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State the video data real-time processing method and device, computing device of realizing scene rendering of problem.
According to an aspect of the invention, there is provided a kind of video data real-time processing method for realizing scene rendering, its
Including：
Real-time image acquisition collecting device is captured and/or the video recorded in include special object present frame figure
Picture；Or the current frame image that special object is included in currently played video is obtained in real time；
Scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to special object；
Drawing three-dimensional scene background figure；
Three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the image after present frame processing；
Image after present frame is handled covers the video data after former current frame image is handled；
Video data after display processing.
Alternatively, drawing three-dimensional scene background figure further comprises：
According to the terrain information of height map drawing three-dimensional scene background figure.
Alternatively, drawing three-dimensional scene background figure further comprises：
According to the terrain information of three-dimensional scenic Background, texture mapping processing is carried out to three-dimensional scenic Background.
Alternatively, drawing three-dimensional scene background figure further comprises：
In the default statically and/or dynamically effect textures of part designated area addition of three-dimensional scenic Background.
Alternatively, three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the figure after present frame processing
Before picture, method also includes：
Extract the key point information of special object；According to the key point information of special object, calculate with symmetric relation
The distance between at least two key points；
Three-dimensional scenic Background and foreground image are subjected to fusion treatment, the image after present frame processing is obtained and further wraps
Include：
According to the display pattern of distance adjustment foreground image.
Alternatively, captured by real-time image acquisition collecting device and/or in the video recorded comprising special object
Current frame image；Or obtain in real time in currently played video after the current frame image comprising special object, method is also
Including：
Obtain positional information of the special object in current frame image；
Three-dimensional scenic Background and foreground image are subjected to fusion treatment, the image after present frame processing is obtained and further wraps
Include：
According to positional information of the special object in current frame image and the foreground image specified in three-dimensional scenic Background
Depth information, three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the image after present frame processing.
Alternatively, after the image after obtaining present frame processing, method also includes：
Either statically or dynamically effect textures are added in the part designated area of image after present frame processing.
Alternatively, after the image after obtaining present frame processing, method also includes：
Tone processing, photo-irradiation treatment and/or brightness processed are carried out to the image after present frame processing.
Alternatively, the video data after display processing further comprises：By the video data real-time display after processing；
Method also includes：Video data after processing is uploaded to Cloud Server.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud video platform server, so that cloud video platform server is in cloud video
Platform is shown video data.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud direct broadcast server, so that cloud direct broadcast server pushes away video data in real time
Give viewing subscription client.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud public number server, so that cloud public number server pushes away video data
Give public number concern client.
According to another aspect of the present invention, there is provided a kind of video data real-time processing device for realizing scene rendering, its
Including：
Acquisition module, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising specific right
The current frame image of elephant；Or the current frame image that special object is included in currently played video is obtained in real time；
Split module, suitable for current frame image carry out scene cut processing, obtain current frame image be directed to it is specific right
The foreground image of elephant；
Drafting module, suitable for drawing three-dimensional scene background figure；
Fusion Module, suitable for three-dimensional scenic Background and foreground image are carried out into fusion treatment, after obtaining present frame processing
Image；
Overlay module, the video data after former two field picture is handled is covered suitable for the image after present frame is handled；
Display module, suitable for the video data after display processing.
Alternatively, drafting module is further adapted for：
According to the terrain information of height map drawing three-dimensional scene background figure.
Alternatively, drafting module is further adapted for：
According to the terrain information of three-dimensional scenic Background, texture mapping processing is carried out to three-dimensional scenic Background.
Alternatively, drafting module is further adapted for：
In the default statically and/or dynamically effect textures of part designated area addition of three-dimensional scenic Background.
Alternatively, device also includes：
Extraction module, suitable for extracting the key point information of special object；
Computing module, suitable for the key point information according to special object, it is crucial to calculate at least two with symmetric relation
The distance between point；
Fusion Module is further adapted for：According to the display pattern of distance adjustment foreground image.
Alternatively, device also includes：
Position acquisition module, suitable for obtaining positional information of the special object in current frame image；
Fusion Module is further adapted for：
According to positional information of the special object in current frame image and the foreground image specified in three-dimensional scenic Background
Depth information, three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the image after present frame processing.
Alternatively, device also includes：
Textures module, suitable for adding either statically or dynamically effect patch in the part designated area of the image after present frame is handled
Figure.
Alternatively, device also includes：
Image processing module, carried out suitable for the image after handling present frame at tone processing, photo-irradiation treatment and/or brightness
Reason.
Alternatively, display module, it is further adapted for the video data real-time display after processing；
Device also includes：
Uploading module, suitable for the video data after processing is uploaded into Cloud Server.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud video platform server, so that cloud video platform server is in cloud video
Platform is shown video data.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud direct broadcast server, so that cloud direct broadcast server pushes away video data in real time
Give viewing subscription client.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud public number server, so that cloud public number server pushes away video data
Give public number concern client.
According to another aspect of the invention, there is provided a kind of computing device, including：Processor, memory, communication interface and
Communication bus, the processor, the memory and the communication interface complete mutual communication by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device above-mentioned
Realize and operated corresponding to the video data real-time processing method of scene rendering.
In accordance with a further aspect of the present invention, there is provided a kind of computer-readable storage medium, be stored with the storage medium to
A few executable instruction, the executable instruction make computing device realize that the video data of scene rendering is handled in real time as described above
Operated corresponding to method.
It is real according to the video data real-time processing method and device, computing device provided by the invention for realizing scene rendering
When obtain that image capture device is captured and/or the video recorded in include special object current frame image；Or in real time
The current frame image that special object is included in currently played video is obtained, scene cut processing is carried out to current frame image,
Obtain the foreground image that current frame image is directed to special object；Drawing three-dimensional scene background figure；By three-dimensional scenic Background and
Foreground image carries out fusion treatment, obtains the image after present frame processing；Image after present frame is handled covers former present frame
Image handled after video data；Video data after display processing.The present invention is got comprising special object in real time
Current frame image after, the foreground image of special object is partitioned into from current frame image.By foreground image and the three-dimensional drawn
Scene background figure is merged, and the video after obtained processing shows the effect that special object is located in three-dimensional scenic Background
Fruit.Simultaneously by the video real-time display after processing to user, the video display effect after facilitating user to see in real time and handle,
Present invention employs deep learning method, completes scene cut processing with realizing the high accuracy of high efficiency.And user is not needed
Extra process is carried out to the video of recording, saves user time.User's technical merit is not limited simultaneously, facilitates masses to make
With.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows the stream of the video data real-time processing method according to an embodiment of the invention for realizing scene rendering
Cheng Tu；
Fig. 2 shows the video data real-time processing method in accordance with another embodiment of the present invention for realizing scene rendering
Flow chart；
Fig. 3 shows the work(of the video data real-time processing device according to an embodiment of the invention for realizing scene rendering
Can block diagram；
Fig. 4 shows the video data real-time processing device in accordance with another embodiment of the present invention for realizing scene rendering
Functional block diagram；
Fig. 5 shows a kind of structural representation of computing device according to an embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Special object can be any objects such as human body in image, plant, animal in the present invention, with people in embodiment
Illustrated exemplified by body, but be not limited only to human body.
Fig. 1 shows the stream of the video data real-time processing method according to an embodiment of the invention for realizing scene rendering
Cheng Tu.As shown in figure 1, realize that the video data real-time processing method of scene rendering specifically comprises the following steps：
Step S101, real-time image acquisition collecting device is captured and/or the video recorded in comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time.
Image capture device illustrates by taking mobile terminal as an example in the present embodiment.Get mobile terminal camera in real time
Current frame image when current frame image in recorded video or shooting video.Due to the present invention to special object at
Reason, therefore only obtain the current frame image comprising special object during acquisition current frame image.Except real-time image acquisition collecting device
Outside the captured and/or video recorded, it can also obtain in real time current comprising special object in currently played video
Two field picture.
Step S102, scene cut processing is carried out to current frame image, current frame image is obtained and is directed to special object
Foreground image.
Special object, such as human body are contained in current frame image.Scene cut processing is carried out to current frame image, mainly
Special object is split from current frame image, obtains the foreground image that current frame image is directed to special object, before this
Scape image can only include special object.
When carrying out scene cut processing to current frame image, deep learning method can be utilized.Deep learning is machine
It is a kind of based on the method that data are carried out with representative learning in study.Observation (such as piece image) can use various ways
Represent, such as the vector of each pixel intensity value, or be more abstractively expressed as a series of sides, the region etc. of given shape.And make
It is easier with some specific method for expressing from example learning task (for example, recognition of face or human facial expression recognition).Such as profit
Scene cut can be carried out to current frame image, obtain including the foreground image of human body with human body segmentation's method of deep learning.
Step S103, drawing three-dimensional scene background figure.
During drawing three-dimensional scene background figure, the picture of two dimension can be plotted as to the scene background figure of three-dimensional.Can during drafting
The picture of two dimension is plotted as to the scene graph of three-dimensional in a manner of using such as to the picture modeling of two dimension.Specific method for drafting can be with
Using any method that two-dimension picture is plotted as to tri-dimensional picture, do not limit herein.Three-dimensional scenic Background can use such as
Three-dimensional seabed scene background figure, three-dimensional volcano scene background figure etc..
Step S104, three-dimensional scenic Background and foreground image are subjected to fusion treatment, obtain the figure after present frame processing
Picture.
The foreground image for being directed to special object that three-dimensional scenic Background and dividing processing are obtained carries out fusion treatment,
So that three-dimensional scenic Background is more really merged with foreground image, the image after present frame processing is obtained.To make three
Dimension scene background figure and foreground image can be merged preferably, and when carrying out dividing processing to current frame image, segmentation is obtained
The edge of perspective process carry out translucent processing, the edge of special object is obscured, preferably to merge.
Step S105, the image after present frame is handled cover the video data after former current frame image is handled.
Image after being handled using present frame directly overrides former current frame image, the video after directly can be processed
Data.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
In the image after obtaining present frame processing, the image after can present frame be handled directly covers former present frame figure
Picture.Speed during covering, typically completed within 1/24 second.For a user, because the time of covering treatment is relative
Short, human eye is not discovered significantly, i.e., human eye does not perceive the process that the former current frame image in video data is capped.This
During video data of the sample after follow-up display processing, shoot and/or record equivalent to one side and/or during playing video data, one
Side real-time display does not feel as the display effect that two field picture in video data covers for the video data after processing, user
Fruit.
Step S106, the video data after display processing.
After video data after being handled, it can be shown in real time, after user can directly be seen that processing
Video data display effect.
According to the video data real-time processing method provided by the invention for realizing scene rendering, real-time image acquisition collection is set
For the current frame image for including special object in video that is captured and/or being recorded；Or obtain in real time currently played
The current frame image of special object is included in video, scene cut processing is carried out to current frame image, obtains current frame image pin
For the foreground image of special object；Drawing three-dimensional scene background figure；Three-dimensional scenic Background and foreground image are merged
Processing, obtain the image after present frame processing；After the former current frame image of image covering after present frame is handled is handled
Video data；Video data after display processing.The present invention after getting in real time comprising the current frame image of special object, from
The foreground image of special object is partitioned into current frame image.Foreground image and the three-dimensional scenic Background drawn are melted
Close, the video after obtained processing shows the effect that special object is located in three-dimensional scenic Background.Simultaneously by after processing
Video real-time display is to user, and the video display effect after facilitating user to see in real time and handle, present invention employs depth
Learning method, complete scene cut processing with realizing the high accuracy of high efficiency.And user is not needed to carry out the video of recording
Extra process, save user time.User's technical merit is not limited simultaneously, facilitates public use.
Fig. 2 shows the video data real-time processing method in accordance with another embodiment of the present invention for realizing scene rendering
Flow chart.As shown in Fig. 2 realize that the video data real-time processing method of scene rendering specifically comprises the following steps：
Step S201, real-time image acquisition collecting device is captured and/or the video recorded in comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time.
Step S202, to current frame image carry out scene cut processing, obtain current frame image be directed to it is described specific right
The foreground image of elephant.
Above step will not be repeated here with reference to the description of the step S101-S102 in the embodiment of figure 1.
Step S203, extract the key point information of special object.
The key message of special object is extracted from current frame image, the key message can be specially key point letter
Breath, key area information, and/or key lines information etc..Embodiments of the invention illustrate by taking key point information as an example, but this
The key message of invention is not limited to key point information.It can be improved using key point information and be carried out subsequently according to key point information
Processing such as distance calculate, obtain position processing processing speed and efficiency, can directly according to key point information progress such as away from
From calculating, obtain the processing such as position, it is not necessary to carry out the complex operations such as subsequently calculating, analysis to key message again.It is meanwhile crucial
Point information is easy to extract, and extracts accurately, and the effect of progress three dimensional stress processing is more accurate.
Key point information can include the key point information at special object edge, can also include some spies of special object
Determine the key point information in region.According to the key point information extracted, it may be determined that each key point position of special object.With human body
Exemplified by, the key point information of extraction can include the key point information positioned at face edge, the letter of the key point positioned at human body edge
The mouth region key point information etc. of breath, face.
Step S204, according to the key point information of special object, calculate at least two key points with symmetric relation it
Between distance.
Because special object is different from the distance of image capture device, cause size of the special object in current frame image
Also it is inconsistent.As human body and image capture device it is distant when, smaller, human body and figure is presented in human body in current frame image
As collecting device it is closer to the distance when, human body presents larger in current frame image., can according to the key point information of special object
To calculate the distance between at least two key points with symmetric relation.Such as calculating face edge Liang Ge canthus place is
The distance between key point only.
Step S205, obtain positional information of the special object in current frame image.
Positional information obtains after being calculated by the key point information of the special object of extraction, obtains special object
Specific position in current frame image.
Step S206, according to the terrain information of height map drawing three-dimensional scene background figure.
Height map is the picture of two dimension, typically by black, white and between 254 kinds of gradual change gray scales generated.According to height
Degree is desired to make money or profit with such as gray scale value-based algorithm, fractal interpolation algorithm, Diamond-Square algorithm scheduling algorithm drawing three-dimensional scene background figures
Terrain information.When drawing terrain information, color is got over for the Terrain Elevation of the three-dimensional scenic Background of the position correspondence of white
Height, conversely, color is lower for the Terrain Elevation of the three-dimensional scenic Background of the position correspondence of black.
Step S207, according to the terrain information of three-dimensional scenic Background, three-dimensional scenic Background is carried out at texture mapping
Reason.
According to the terrain information of the three-dimensional scenic Background of drafting, texture mapping processing is carried out to three-dimensional conclusion of the business Background.
Such as sand ground landform, the texture mapping processing that corresponding can carry out sand ground.Carried out during texture mapping processing according to different landform
The processing of corresponding texture mapping, during processing, to make three-dimensional scenic Background truer, multitexture stick picture disposing can be carried out.
Such as carry out the texture mapping processing of the sandy sand ground of multiple difference.
After the processing of texture spy figure is carried out, OpenGL mapping technologies can be utilized, so as to generate the three of vivid effect
Tie up scene background figure.
Step S208, in the default statically and/or dynamically effect textures of part designated area addition of three-dimensional scenic Background.
, can also be in three-dimensional scenic Background to make three-dimensional scenic Background not only include simple background display effect
The default statically and/or dynamically effect textures of part designated area addition.As referred in three-dimensional seabed scene background figure in its part
Such as dynamic pasture and water effect textures, bubble effect textures, seabed coral reef statically and/or dynamically effect can be set by determining region
Textures, so that the display effect of whole three-dimensional scenic Background is more true to nature.
Step S209, according to positional information of the special object in current frame image and the foreground image specified in three dimensional field
The depth information of scape Background, three-dimensional scenic Background and foreground image are subjected to fusion treatment, after obtaining present frame processing
Image.
Positional information of the special object of acquisition in current frame image, specifically includes special object in current frame image
Position where upper and lower and left and right.Three-dimensional scenic Background reflects the three-dimensional relationship of top to bottom, left and right, front and rear in figure.By three
Tie up scene background figure and foreground image carries out fusion treatment, particular location of the foreground image in three-dimensional scenic Background includes upper
Under, left and right, front and rear position.According to positional information of the special object in current frame image foreground image can be determined in three-dimensional
Upper and lower in scene background figure, left and right particular location.According to specified foreground image three-dimensional scenic Background depth information,
Foreground image particular location front and rear in three-dimensional scenic Background can be determined, and then determines foreground image in three-dimensional scenic
Particular location in Background, three-dimensional scenic Background and foreground image can be subjected to fusion treatment, obtain present frame processing
Image afterwards.Positional information of the special object in current frame image according to the distance of special object and image capture device not
Together, positional information of the special object got in current frame image also can be different.But foreground image is in three-dimensional scenic background
The depth information of figure is the front and back position information specified, and does not change with positional information of the special object in current frame image and becomes
Change.
Step S210, the display pattern of foreground image is adjusted according to distance.
According to the distance between at least two key points with symmetric relation being calculated, the face of foreground image is adjusted
The display patterns such as color, tone, lighting effect, brightness.Specifically, according to distance, it can be realized that foreground image is in three-dimensional scenic
When position in Background such as three-dimensional scenic Background is seabed scene background figure, color is general more based on blueness but different
The blueness of position is also slightly different.According to the color of the corresponding adjustment foreground image of distance, to reach seemingly specific in display
Object is really in seabed.
Step S211, either statically or dynamically effect textures are added in the part designated area of the image after present frame is handled.
The part designated area of image after present frame processing, can also add either statically or dynamically effect textures.The effect
Fruit textures mutually echo with three-dimensional scenic Background, so that the display effect of three-dimensional scenic Background is more true to nature.As three-dimensional scenic is carried on the back
When scape figure is seabed scene background figure, travelling seabed can be added in the part designated area of the image after present frame processing
The either statically or dynamically effect textures of biology.
Step S212, tone processing, photo-irradiation treatment and/or brightness processed are carried out to the image after present frame processing.
To make the effect of the image after present frame processing more natural true, figure can be carried out to the image after present frame processing
As processing.Image procossing can include carrying out tone processing, photo-irradiation treatment, brightness processed etc. to the image after present frame processing.
When such as three-dimensional scenic background being seabed scene background figure, it can be adjusted according to the different depth position information of seabed scene background figure
Its whole colouring information so that the color intensity of sea water in seabed is closer as seabed depth change produces to be become with the color of nature seawater
Change, it is more blue in the color of deeper position seawater.The photo-irradiation treatment of grating can also be increased in the image after present frame processing
Effect, simulate sunlight seawater, the visual experience of seabed refracted light.
Step S213, the image after present frame is handled cover the video data after former current frame image is handled.
Image after being handled using present frame directly overrides former current frame image, the video after directly can be processed
Data.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
Step S214, the video data after display processing.
After video data after being handled, it can be shown in real time, after user can directly be seen that processing
Video data display effect.
Step S215, the video data after processing is uploaded to Cloud Server.
Video data after processing can be directly uploaded to Cloud Server, specifically, can be by the video counts after processing
According to be uploaded to one or more cloud video platform server, such as iqiyi.com, youku.com, fast video cloud video platform server,
So that cloud video platform server is shown video data in cloud video platform.Or can also be by the video data after processing
Cloud direct broadcast server is uploaded to, can be straight by cloud when the user for having live viewing end is watched into cloud direct broadcast server
Broadcast server and give video data real time propelling movement to viewing subscription client.Or the video data after processing can also be uploaded to
Cloud public number server, when there is user to pay close attention to the public number, video data is pushed to public number by cloud public number server
Pay close attention to client；Further, cloud public number server can also be accustomed to according to the viewing of the user of concern public number, and push meets
The video data of user's custom pays close attention to client to public number.
According to the video data real-time processing method provided by the invention for realizing scene rendering, height map drawing three-dimensional is utilized
The terrain information of scene background figure, and texture mapping processing is further carried out, make three-dimensional scenic Background truer.It is whole to make
The display effect of three-dimensional scenic Background is more true to nature, can also be preset in the part designated area addition of three-dimensional scenic Background quiet
State and/or dynamic effect textures.After positional information of the special object in current frame image is obtained, according to positional information and refer to
The fixed depth information being located in three-dimensional scenic Background, three-dimensional scenic Background and foreground image are subjected to fusion treatment.And
There are the distance between at least two key points of symmetric relation according to special object, adjust the color of foreground picture, make processing
The overall display effect of video afterwards is more true to nature.The present invention can directly obtain the video after processing, can also be by after processing
Video is directly uploaded to Cloud Server, it is not necessary to which user carries out extra process to the video of recording, saves user time, can be with
Real-time display facilitates user to check display effect to the video data after user's processing.User's technical merit is not limited simultaneously
System, facilitates public use.
Fig. 3 shows the work(of the video data real-time processing device according to an embodiment of the invention for realizing scene rendering
Can block diagram.As shown in figure 3, realizing the video data real-time processing device of scene rendering includes following module：
Acquisition module 301, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising specific
The current frame image of object；Or the current frame image that special object is included in currently played video is obtained in real time.
Image capture device illustrates by taking mobile terminal as an example in the present embodiment.Acquisition module 301 gets shifting in real time
Move current frame image when current frame image or shooting video of the terminal camera in recorded video.Because the present invention is to spy
Determine object to be handled, therefore the current frame image comprising special object is only obtained during the acquisition current frame image of acquisition module 301.
For acquisition module 301 except captured by real-time image acquisition collecting device and/or in addition to the video recorded, acquisition module 301 can be with
The current frame image that special object is included in currently played video is obtained in real time.
Split module 302, scene cut processing is carried out to current frame image, current frame image is obtained and is directed to special object
Foreground image.
Current frame image contains special object, such as human body.Split module 302 to carry out at scene cut current frame image
Reason, special object is mainly split, obtain the prospect that current frame image is directed to special object from current frame image
Image, the foreground image can only include special object.
Split module 302 when carrying out scene cut processing to current frame image, deep learning method can be utilized.Depth
Study is a kind of based on the method that data are carried out with representative learning in machine learning.Observation (such as piece image) can use
Various ways represent, a series of such as vector of each pixel intensity value, or be more abstractively expressed as sides, the area of given shape
Domain etc..And some specific method for expressing are used to be easier from example learning task (for example, recognition of face or facial expression are known
Not).Scene cut can be carried out using human body segmentation's method of deep learning to current frame image by such as splitting module 302, be obtained
Foreground image comprising human body.
Drafting module 303, suitable for drawing three-dimensional scene background figure.
During 303 drawing three-dimensional scene background figure of drafting module, the picture of two dimension can be plotted as to the scene background of three-dimensional
Figure.Drafting module 303 can be using as being plotted as three-dimensional when drawing by the way of the picture modeling to two dimension by the picture of two dimension
Scene graph.Specific method for drafting can use any method that two-dimension picture is plotted as to tri-dimensional picture, not limit herein.Three
Such as three-dimensional seabed scene background figure, three-dimensional volcano scene background figure can be used by tieing up scene background figure.
Height map is the picture of two dimension, typically by black, white and between 254 kinds of gradual change gray scales generated.According to height
Spending figure drafting module 303 can utilize such as gray scale value-based algorithm, fractal interpolation algorithm, Diamond-Square algorithms scheduling algorithm to draw
The terrain information of three-dimensional scenic Background.For drafting module 303 when drawing terrain information, color is the three of the position correspondence of white
The Terrain Elevation of dimension scene background figure is higher, conversely, color is high for the landform of the three-dimensional scenic Background of the position correspondence of black
Degree is lower.
Drafting module 303 carries out line according to the terrain information of the three-dimensional scenic Background of drafting to three-dimensional scenic Background
Manage stick picture disposing.The texture mapping processing that corresponding can carry out sand ground such as sand ground landform, drafting module 303.Drafting module 303
The texture mapping processing according to corresponding to being carried out different landform when texture mapping is handled, during processing, to make three-dimensional scenic background
Figure is truer, and drafting module 303 can carry out multitexture stick picture disposing.As drafting module 303 carry out multiple difference it is sandy
The texture mapping processing of sand ground.
Drafting module 303 can utilize OpenGL mapping technologies, be forced so as to generate after the processing of texture spy figure is carried out
The three-dimensional scenic Background of true effect.
To make three-dimensional scenic Background not only include simple background display effect, drafting module 303 can also be three
Tie up the default statically and/or dynamically effect textures of part designated area addition of scene background figure.Such as three-dimensional seabed scene background figure
Middle drafting module 303 can be set such as dynamic pasture and water effect textures, bubble effect textures, seabed coral in its part designated area
The statically and/or dynamically effect textures such as coral reef, so that the display effect of whole three-dimensional scenic Background is more true to nature.
Fusion Module 304, suitable for three-dimensional scenic Background and foreground image are carried out into fusion treatment, obtain present frame processing
Image afterwards.
Fusion Module 304 enters the foreground image for being directed to special object that three-dimensional scenic Background obtains with dividing processing
Row fusion treatment so that three-dimensional scenic Background is more really merged with foreground image, after obtaining present frame processing
Image.To allow three-dimensional scenic Background and foreground image preferably to merge, segmentation module 302 is carried out to current frame image
During dividing processing, the edge of the perspective process obtained to segmentation carries out translucent processing, the edge of special object is obscured, to melt
Matched moulds block 304 preferably merges.
Overlay module 305, the video data after former two field picture is handled is covered suitable for the image after present frame is handled.
Image after overlay module 305 is handled using present frame directly overrides former current frame image, can directly obtain
Video data after processing.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
When Fusion Module 304 obtains the image after present frame processing, overlay module 305 understands the figure after present frame be handled
As directly covering former current frame image.Speed when overlay module 305 covers, was typically completed within 1/24 second.For
For user, because the time of the covering treatment of overlay module 305 is relatively short, human eye is not discovered significantly, i.e., human eye is not examined
Feel the process that the former current frame image in video data is capped.So regarding after the follow-up display processing of display module 306
Frequency according to when, shoot and/or record equivalent to one side and/or during playing video data, the real-time display of one side display module 306
For the video data after processing, user does not feel as the display effect that two field picture in video data covers.
Display module 306, suitable for the video data after display processing.
Display module 306 handled after video data after, it can be shown in real time, user can be direct
See the display effect of the video data after processing.
According to the video data real-time processing device provided by the invention for realizing scene rendering, real-time image acquisition collection is set
For the current frame image for including special object in video that is captured and/or being recorded；Or obtain in real time currently played
The current frame image of special object is included in video, scene cut processing is carried out to current frame image, obtains current frame image pin
For the foreground image of special object；Drawing three-dimensional scene background figure；Three-dimensional scenic Background and foreground image are merged
Processing, obtain the image after present frame processing；After the former current frame image of image covering after present frame is handled is handled
Video data；Video data after display processing.The present invention after getting in real time comprising the current frame image of special object, from
The foreground image of special object is partitioned into current frame image.Foreground image and the three-dimensional scenic Background drawn are melted
Close, the video after obtained processing shows the effect that special object is located in three-dimensional scenic Background.Simultaneously by after processing
Video real-time display is to user, and the video display effect after facilitating user to see in real time and handle, present invention employs depth
Learning method, complete scene cut processing with realizing the high accuracy of high efficiency.And user is not needed to carry out the video of recording
Extra process, save user time.User's technical merit is not limited simultaneously, facilitates public use.
Fig. 4 shows the video data real-time processing device in accordance with another embodiment of the present invention for realizing scene rendering
Functional block diagram.As shown in figure 4, being with Fig. 3 differences, realize that the video data real-time processing device of scene rendering also wraps
Include：
Extraction module 307, suitable for extracting the key point information of special object.
Computing module 308, suitable for the key point information according to special object, calculate at least two passes with symmetric relation
The distance between key point.
Extraction module 307 extracts the key message of special object from current frame image, and the key message can be specific
For key point information, key area information, and/or key lines information etc..Embodiments of the invention enter by taking key point information as an example
Row explanation, but the key message of the present invention is not limited to key point information.It can be improved according to key point using key point information
Information carries out the processing speed and efficiency that subsequent treatment such as distance calculated, obtained position processing, can be directly according to key point
Information is carried out such as apart from calculating, the processing of acquisition position, it is not necessary to is carried out the complexity such as subsequently calculating, analysis to key message again and is grasped
Make.Meanwhile key point information is easy to extract, and extract accurately, the effect of progress three dimensional stress processing is more accurate.
Key point information can include the key point information at special object edge, can also include some spies of special object
Determine the key point information in region.Extraction module 307 is according to the key point information extracted, it may be determined that each key point of special object
Position.By taking human body as an example, extraction module 307 extract key point information can include positioned at face edge key point information,
Mouth region key point information of key point information, face positioned at human body edge etc..
Because special object is different from the distance of image capture device, cause size of the special object in current frame image
Also it is inconsistent.As human body and image capture device it is distant when, smaller, human body and figure is presented in human body in current frame image
As collecting device it is closer to the distance when, human body presents larger in current frame image.Computing module 308 is according to the pass of special object
Key point information, can calculate the distance between at least two key points with symmetric relation.As computing module 308 calculates
The distance between key point untill where face edge Liang Ge canthus.
Fusion Module 304 is according to the distance between at least two key points with symmetric relation being calculated, adjustment
The display patterns such as the color of foreground image, tone, lighting effect, brightness.Specifically, according to distance, it can be realized that foreground picture
As position in three-dimensional scenic Background, when such as three-dimensional scenic Background be seabed scene background figure, with indigo plant more than color is general
Based on color, but the blueness of diverse location is also slightly different.Fusion Module 304 is according to the corresponding face for adjusting foreground image of distance
Color, to reach, in display, seemingly special object is really in seabed.
Position acquisition module 309, suitable for obtaining positional information of the special object in current frame image.
It is specific right that position acquisition module 309 obtains after being calculated by the key point information of the special object of extraction
As the positional information in current frame image.Position of the special object that position acquisition module 309 obtains in current frame image
Information, special object is specifically included in the position where the upper and lower and left and right of current frame image.
Three-dimensional scenic Background reflects the three-dimensional relationship of top to bottom, left and right, front and rear in figure.Fusion Module 304 is by three-dimensional
Scene background figure and foreground image carry out fusion treatment, and particular location of the foreground image in three-dimensional scenic Background includes upper
Under, left and right, front and rear position.The special object that Fusion Module 304 obtains according to position acquisition module 309 is in current frame image
Positional information can determine foreground image in three-dimensional scenic Background up and down, left and right particular location.Fusion Module 304
According to specified foreground image three-dimensional scenic Background depth information, it may be determined that foreground image is in three-dimensional scenic Background
Front and rear particular location, and then particular location of the foreground image in three-dimensional scenic Background is determined, can be by three-dimensional scenic
Background and foreground image carry out fusion treatment, obtain the image after present frame processing.Special object is in current frame image
Positional information is different from the distance of image capture device according to special object, the special object that position acquisition module 309 is got
Positional information in current frame image also can be different.But foreground image is specified in the depth information of three-dimensional scenic Background
Front and back position information, do not change with positional information of the special object in current frame image and change.
Textures module 310, either statically or dynamically imitated suitable for being added in the part designated area of the image after present frame is handled
Fruit textures.
The part designated area of image after present frame processing, textures module 310 can also be added and either statically or dynamically imitated
Fruit textures.The effect textures mutually echo with three-dimensional scenic Background, so that the display effect of three-dimensional scenic Background is more true to nature.Such as
When three-dimensional scenic Background is seabed scene background figure, area is specified in the part of image of the textures module 310 after present frame processing
The either statically or dynamically effect textures of travelling benthon can be added in domain.
Image processing module 311, tone processing, photo-irradiation treatment and/or bright are carried out suitable for the image after handling present frame
Degree processing.
Effect for the image after handling present frame is more natural true, image processing module 311 can be to present frame at
Image after reason carries out image procossing.Image procossing can include carrying out tone processing, illumination to the image after present frame processing
Processing, brightness processed etc..When such as three-dimensional scenic background being seabed scene background figure, image processing module 311 can be according to seabed
The different depth position information of scene background figure, adjusts its colouring information so that the color intensity of sea water in seabed becomes with seabed depth
Change and produce the closer color change with nature seawater, it is more blue in the color of deeper position seawater.Image processing module 311 is also
The photo-irradiation treatment effect of grating can be increased in the image after present frame processing, simulate sunlight seawater, seabed refraction light
The visual experience of line.
Uploading module 312, suitable for the video data after processing is uploaded into Cloud Server.
Video data after processing can be directly uploaded to Cloud Server by uploading module 312, specifically, uploading module
312 can be uploaded to the video data after processing the cloud video platform server of one or more, such as iqiyi.com, youku.com, fast
The cloud video platform server such as video, so that cloud video platform server is shown video data in cloud video platform.Or
Video data after processing can also be uploaded to cloud direct broadcast server by uploading module 312, when the user for having live viewing end enters
When entering cloud direct broadcast server and being watched, can by cloud direct broadcast server by video data real time propelling movement to viewing user client
End.Or the video data after processing can also be uploaded to cloud public number server by uploading module 312, it is somebody's turn to do when there is user's concern
During public number, video data is pushed to public number concern client by cloud public number server；Further, cloud public number service
Device can also be accustomed to according to the viewing of the user of concern public number, and the video data that push meets user's custom is paid close attention to public number
Client.
According to the video data real-time processing device provided by the invention for realizing scene rendering, height map drawing three-dimensional is utilized
The terrain information of scene background figure, and texture mapping processing is further carried out, make three-dimensional scenic Background truer.It is whole to make
The display effect of three-dimensional scenic Background is more true to nature, can also be preset in the part designated area addition of three-dimensional scenic Background quiet
State and/or dynamic effect textures.After positional information of the special object in current frame image is obtained, according to positional information and refer to
The fixed depth information being located in three-dimensional scenic Background, three-dimensional scenic Background and foreground image are subjected to fusion treatment.And
There are the distance between at least two key points of symmetric relation according to special object, adjust the color of foreground picture, make processing
The overall display effect of video afterwards is more true to nature.The present invention can directly obtain the video after processing, can also be by after processing
Video is directly uploaded to Cloud Server, it is not necessary to which user carries out extra process to the video of recording, saves user time, can be with
Real-time display facilitates user to check display effect to the video data after user's processing.User's technical merit is not limited simultaneously
System, facilitates public use.
Present invention also provides a kind of nonvolatile computer storage media, the computer-readable storage medium is stored with least
One executable instruction, the computer executable instructions can perform the video for realizing scene rendering in above-mentioned any means embodiment
Real-time Data Processing Method.
Fig. 5 shows a kind of structural representation of computing device according to an embodiment of the invention, of the invention specific real
Specific implementation of the example not to computing device is applied to limit.
As shown in figure 5, the computing device can include：Processor (processor) 502, communication interface
(Communications Interface) 504, memory (memory) 506 and communication bus 508.
Wherein：
Processor 502, communication interface 504 and memory 506 complete mutual communication by communication bus 508.
Communication interface 504, for being communicated with the network element of miscellaneous equipment such as client or other servers etc..
Processor 502, for configuration processor 510, it is real-time can specifically to perform the above-mentioned video data for realizing scene rendering
Correlation step in processing method embodiment.
Specifically, program 510 can include program code, and the program code includes computer-managed instruction.
Processor 502 is probably central processor CPU, or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or it is arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road.The one or more processors that computing device includes, can be same type of processor, such as one or more CPU；Also may be used
To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 506, for depositing program 510.Memory 506 may include high-speed RAM memory, it is also possible to also include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 510 specifically can be used for so that processor 502, which is performed in above-mentioned any means embodiment, realizes scene wash with watercolours
The video data real-time processing method of dye.The specific implementation of each step may refer to above-mentioned scene rendering of realizing in program 510
Corresponding description in corresponding steps and unit in the real-time Processing Example of video data, will not be described here.The skill of art
Art personnel can be understood that, for convenience and simplicity of description, the equipment of foregoing description and the specific work process of module,
The corresponding process description in preceding method embodiment is may be referred to, will not be repeated here.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with teaching based on this.As described above, required by constructing this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that it can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place provides, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description to the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor
The application claims of shield features more more than the feature being expressly recited in each claim.It is more precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
Separate embodiments all as the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, summary and accompanying drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
Replace.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be realized with hardware, or to be run on one or more processor
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that it can use in practice
Microprocessor or digital signal processor (DSP) realize the video data for realizing scene rendering according to embodiments of the present invention
The some or all functions of some or all parts in the device handled in real time.The present invention is also implemented as being used to hold
The some or all equipment or program of device of row method as described herein are (for example, computer program and computer
Program product).It is such realize the present invention program can store on a computer-readable medium, or can have one or
The form of the multiple signals of person.Such signal can be downloaded from internet website and obtained, or be provided on carrier signal, or
Person is provided in the form of any other.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and being come by means of properly programmed computer real
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
Claims (10)
1. a kind of video data real-time processing method for realizing scene rendering, it includes：
Real-time image acquisition collecting device is captured and/or the video recorded in include special object current frame image；Or
Person, the current frame image that special object is included in currently played video is obtained in real time；
Scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to the special object；
Drawing three-dimensional scene background figure；
The three-dimensional scenic Background and the foreground image are subjected to fusion treatment, obtain the image after present frame processing；
Image after present frame is handled covers the video data after former current frame image is handled；
Show the video data after the processing.
2. according to the method for claim 1, wherein, the drawing three-dimensional scene background figure further comprises：
According to the terrain information of height map drawing three-dimensional scene background figure.
3. according to the method for claim 2, wherein, the drawing three-dimensional scene background figure further comprises：
According to the terrain information of the three-dimensional scenic Background, texture mapping processing is carried out to the three-dimensional scenic Background.
4. according to the method any one of claim 1-3, wherein, the drawing three-dimensional scene background figure further wraps
Include：
In the default statically and/or dynamically effect textures of part designated area addition of the three-dimensional real-time scene Background.
5. according to the method any one of claim 1-4, wherein, described by the three-dimensional scenic Background and described
Foreground image carries out fusion treatment, and before obtaining the image after present frame processing, methods described also includes：
Extract the key point information of the special object；According to the key point information of the special object, calculating has symmetrical close
The distance between at least two key points of system；
It is described that the three-dimensional scenic Background and the foreground image are subjected to fusion treatment, obtain the image after present frame processing
Further comprise：
The display pattern of the foreground image is adjusted according to the distance.
6. according to the method described in claim any one of 1-5, wherein, captured by the real-time image acquisition collecting device
And/or the current frame image of special object is included in the video recorded；Or obtain wrapped in currently played video in real time
After current frame image containing special object, methods described also includes：
Obtain positional information of the special object in current frame image；
It is described that the three-dimensional scenic Background and the foreground image are subjected to fusion treatment, obtain the image after present frame processing
Further comprise：
According to positional information of the special object in current frame image and the foreground image specified in the three dimensional field
The depth information of scape Background, the three-dimensional scenic Background and the foreground image are subjected to fusion treatment, obtain present frame
Image after processing.
7. according to the method any one of claim 1-6, wherein, the image obtained after present frame processing it
Afterwards, methods described also includes：
Either statically or dynamically effect textures are added in the part designated area of image after present frame processing.
8. a kind of video data real-time processing device for realizing scene rendering, it includes：
Acquisition module, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time；
Split module, be suitable to, to current frame image carry out scene cut processing, obtain current frame image be directed to it is described specific right
The foreground image of elephant；
Drafting module, suitable for drawing three-dimensional scene background figure；
Fusion Module, suitable for the three-dimensional scenic Background and the foreground image are carried out into fusion treatment, obtain at present frame
Image after reason；
Overlay module, the video data after former two field picture is handled is covered suitable for the image after present frame is handled；
Display module, suitable for the video data after the display processing.
9. a kind of computing device, including：Processor, memory, communication interface and communication bus, the processor, the storage
Device and the communication interface complete mutual communication by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device such as right will
Ask and operated corresponding to the video data real-time processing method for realizing scene rendering any one of 1-7.
10. a kind of computer-readable storage medium, an at least executable instruction, the executable instruction are stored with the storage medium
Make the video data real-time processing method of realizing scene rendering of the computing device as any one of claim 1-7
Corresponding operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710860138.2A CN107566853A (en) | 2017-09-21 | 2017-09-21 | Realize the video data real-time processing method and device, computing device of scene rendering |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710860138.2A CN107566853A (en) | 2017-09-21 | 2017-09-21 | Realize the video data real-time processing method and device, computing device of scene rendering |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107566853A true CN107566853A (en) | 2018-01-09 |
Family
ID=60982424
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710860138.2A Pending CN107566853A (en) | 2017-09-21 | 2017-09-21 | Realize the video data real-time processing method and device, computing device of scene rendering |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107566853A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112460743A (en) * | 2020-11-30 | 2021-03-09 | 珠海格力电器股份有限公司 | Scene rendering method, scene rendering device and environment regulator |
| CN112560556A (en) * | 2019-09-25 | 2021-03-26 | 杭州海康威视数字技术股份有限公司 | Action behavior image generation method, device, equipment and storage medium |
| WO2023207354A1 (en) * | 2022-04-29 | 2023-11-02 | 北京字跳网络技术有限公司 | Special effect video determination method and apparatus, electronic device, and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7230653B1 (en) * | 1999-11-08 | 2007-06-12 | Vistas Unlimited | Method and apparatus for real time insertion of images into video |
| CN102821323A (en) * | 2012-08-01 | 2012-12-12 | 成都理想境界科技有限公司 | Video playing method, video playing system and mobile terminal based on augmented reality technique |
| CN106204426A (en) * | 2016-06-30 | 2016-12-07 | 广州华多网络科技有限公司 | A kind of method of video image processing and device |
| CN106231411A (en) * | 2015-12-30 | 2016-12-14 | 深圳超多维科技有限公司 | The switching of main broadcaster's class interaction platform client scene, loading method and device, client |
| CN106530309A (en) * | 2016-10-24 | 2017-03-22 | 成都品果科技有限公司 | Video matting method and system based on mobile platform |
-
2017
- 2017-09-21 CN CN201710860138.2A patent/CN107566853A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7230653B1 (en) * | 1999-11-08 | 2007-06-12 | Vistas Unlimited | Method and apparatus for real time insertion of images into video |
| CN102821323A (en) * | 2012-08-01 | 2012-12-12 | 成都理想境界科技有限公司 | Video playing method, video playing system and mobile terminal based on augmented reality technique |
| CN106231411A (en) * | 2015-12-30 | 2016-12-14 | 深圳超多维科技有限公司 | The switching of main broadcaster's class interaction platform client scene, loading method and device, client |
| CN106204426A (en) * | 2016-06-30 | 2016-12-07 | 广州华多网络科技有限公司 | A kind of method of video image processing and device |
| CN106530309A (en) * | 2016-10-24 | 2017-03-22 | 成都品果科技有限公司 | Video matting method and system based on mobile platform |
Non-Patent Citations (1)
| Title |
|---|
| 段永良，宋燕燕，周洪萍，董丽花: "《全媒体制播技术》", 30 September 2016 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112560556A (en) * | 2019-09-25 | 2021-03-26 | 杭州海康威视数字技术股份有限公司 | Action behavior image generation method, device, equipment and storage medium |
| CN112460743A (en) * | 2020-11-30 | 2021-03-09 | 珠海格力电器股份有限公司 | Scene rendering method, scene rendering device and environment regulator |
| WO2023207354A1 (en) * | 2022-04-29 | 2023-11-02 | 北京字跳网络技术有限公司 | Special effect video determination method and apparatus, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107547804A (en) | Realize the video data handling procedure and device, computing device of scene rendering | |
| Rudnev et al. | Nerf for outdoor scene relighting | |
| CN107507155A (en) | Video segmentation result edge optimization real-time processing method, device and computing device | |
| CN107820027A (en) | Video personage dresss up method, apparatus, computing device and computer-readable storage medium | |
| CN107613360A (en) | Video data real-time processing method and device, computing device | |
| CN107483892A (en) | Video data real-time processing method and device, computing device | |
| CN106165387A (en) | Light field processing method | |
| CN108109161A (en) | Video data real-time processing method and device based on adaptive threshold fuzziness | |
| Zamuda et al. | Vectorized procedural models for animated trees reconstruction using differential evolution | |
| Argudo et al. | Single-picture reconstruction and rendering of trees for plausible vegetation synthesis | |
| CN107566853A (en) | Realize the video data real-time processing method and device, computing device of scene rendering | |
| CN107613161A (en) | Video data handling procedure and device, computing device based on virtual world | |
| CN108111911A (en) | Video data real-time processing method and device based on the segmentation of adaptive tracing frame | |
| CN107945188A (en) | Personage based on scene cut dresss up method and device, computing device | |
| CN107633228A (en) | Video data handling procedure and device, computing device | |
| CN107766803B (en) | Video character decorating method and device based on scene segmentation and computing equipment | |
| CN107682731A (en) | Video data distortion processing method, device, computing device and storage medium | |
| CN107680105B (en) | Video data real-time processing method and device based on virtual world and computing equipment | |
| CN107743263B (en) | Video data real-time processing method and device and computing equipment | |
| CN107770606A (en) | Video data distortion processing method, device, computing device and storage medium | |
| CN107563962A (en) | Video data real-time processing method and device, computing device | |
| CN108171716A (en) | Video personage based on the segmentation of adaptive tracing frame dresss up method and device | |
| CN107633547A (en) | Realize the view data real-time processing method and device, computing device of scene rendering | |
| CN107578369A (en) | Video data handling procedure and device, computing device | |
| CN110533740A (en) | A kind of image rendering methods, device, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180109 |
|
| RJ01 | Rejection of invention patent application after publication |