CN107665482A - Realize the video data real-time processing method and device, computing device of double exposure - Google Patents
Realize the video data real-time processing method and device, computing device of double exposure Download PDFInfo
- Publication number
- CN107665482A CN107665482A CN201710864259.4A CN201710864259A CN107665482A CN 107665482 A CN107665482 A CN 107665482A CN 201710864259 A CN201710864259 A CN 201710864259A CN 107665482 A CN107665482 A CN 107665482A
- Authority
- CN
- China
- Prior art keywords
- image
- current frame
- video data
- processing
- special object
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 138
- 238000001514 detection method Methods 0.000 claims abstract description 60
- 238000000034 method Methods 0.000 claims abstract description 42
- 230000001815 facial effect Effects 0.000 claims description 28
- 238000004891 communication Methods 0.000 claims description 17
- 238000004040 coloring Methods 0.000 claims description 7
- 238000010030 laminating Methods 0.000 claims description 5
- 241000406668 Loxodonta cyclotis Species 0.000 claims description 4
- 238000000227 grinding Methods 0.000 claims description 3
- 238000013135 deep learning Methods 0.000 abstract description 7
- 230000000694 effects Effects 0.000 description 15
- 238000005516 engineering process Methods 0.000 description 5
- 210000004209 hair Anatomy 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 210000004709 eyebrow Anatomy 0.000 description 4
- 230000000717 retained effect Effects 0.000 description 4
- 238000013515 script Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 235000013399 edible fruits Nutrition 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000008921 facial expression Effects 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G06T5/94—Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/162—Detection; Localisation; Normalisation using pixel segmentation or colour matching
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
- G06T2207/30201—Face
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
- Studio Circuits (AREA)
Abstract
The invention discloses a kind of video data real-time processing method and device, computing device for realizing double exposure, its method includes：Real-time image acquisition collecting device is captured and/or the video recorded in include special object current frame image；Or the current frame image that special object is included in currently played video is obtained in real time, scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to special object；Key message detection is carried out to current frame image, it is determined that belonging to the specific region of special object；Default background image is loaded for foreground image, is not belonging to be superimposed default foreground image on the subregion of specific region in foreground image, obtains the image after present frame processing；Image after present frame is handled covers the video data after former current frame image is handled；Video data after display processing.Present invention employs deep learning method, completes scene cut processing with realizing the high accuracy of high efficiency.
Description
Technical field
The present invention relates to image processing field, and in particular to a kind of video data real-time processing method for realizing double exposure
And device, computing device.
Background technology
With the development of science and technology, the technology of image capture device also increasingly improves.Regarded using what image capture device was recorded
Frequency also becomes apparent from, resolution ratio, display effect also greatly improve.But the video of existing recording is only dull recorded material sheet
Body, the increasing individual requirement that user proposes can not be met.Prior art can be manual by user after recorded video
It is further again to video to be handled, to meet the individual requirement of user.But so processing needs user to have higher figure
As treatment technology, and the cost user more time is needed in processing, handle cumbersome, technical sophistication.
Therefore, it is necessary to a kind of video data real-time processing method, to meet the individual requirement of user in real time.
The content of the invention
In view of the above problems, it is proposed that the present invention so as to provide one kind overcome above mentioned problem or at least in part solve on
State the video data real-time processing method and device, computing device of realizing double exposure of problem.
According to an aspect of the invention, there is provided a kind of video data real-time processing method for realizing double exposure, its
Including：
Real-time image acquisition collecting device is captured and/or the video recorded in include special object present frame figure
Picture；Or the current frame image that special object is included in currently played video is obtained in real time；
Scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to special object；
Key message detection is carried out to current frame image, it is determined that belonging to the specific region of special object；
Default background image is loaded for foreground image, is not belonging to be superimposed on the subregion of specific region in foreground image
Default foreground image, obtain the image after present frame processing；
Image after present frame is handled covers the video data after former current frame image is handled；
Video data after display processing.
Alternatively, key message detection is carried out to current frame image, it is determined that the specific region for belonging to special object is further
Including：Key point information detection is carried out to current frame image, it is determined that belonging to the specific region of special object.
Alternatively, key message detection is carried out to current frame image, it is determined that the specific region for belonging to special object is further
Including：Key point information and colouring information detection are carried out to current frame image, it is determined that belonging to the specific region of special object.
Alternatively, before the image after obtaining present frame processing, method also includes：According to default background image and/or
The display styles pattern of default foreground image, respective handling is carried out to the specific region of foreground image.
Alternatively, the specific region progress respective handling of foreground image is further comprised：To the given zone of foreground image
Domain carries out grinding skin and/or toning processing.
Alternatively, special object is personage；The specific region of special object is facial zone；
Key message detection is carried out to current frame image, it is determined that the specific region for belonging to special object further comprises：
Critical point detection is carried out to current frame image, determines the face region of personage；
Face Detection is carried out to current frame image, determines the area of skin color of personage；
According to the face region of personage and area of skin color, the facial zone of personage is determined.
Alternatively, it is the first default picture to preset foreground image；Default background image is the second default picture.
Alternatively, method also includes：
3rd default picture is carried out into different tonings to handle, respectively obtains default foreground image and default background image.
Alternatively, it is the two field picture in the first pre- setting video to preset foreground image；Default background image is preset for second to be regarded
Two field picture in frequency.
Alternatively, method also includes：
Two field picture in 3rd pre- setting video is carried out into different tonings to handle, default foreground image is respectively obtained and presets
Background image.
Alternatively, the video data after display processing further comprises：By the video data real-time display after processing；
Method also includes：Video data after processing is uploaded to Cloud Server.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud video platform server, so that cloud video platform server is in cloud video
Platform is shown video data.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud direct broadcast server, so that cloud direct broadcast server pushes away video data in real time
Give viewing subscription client.
Alternatively, the video data after processing is uploaded into Cloud Server to further comprise：
Video data after processing is uploaded to cloud public number server, so that cloud public number server pushes away video data
Give public number concern client.
According to another aspect of the present invention, there is provided a kind of video data real-time processing device for realizing double exposure, its
Including：
Acquisition module, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising specific right
The current frame image of elephant；Or the current frame image that special object is included in currently played video is obtained in real time；
Split module, suitable for current frame image carry out scene cut processing, obtain current frame image be directed to it is specific right
The foreground image of elephant；
Detection module, suitable for carrying out key message detection to current frame image, it is determined that belonging to the specific region of special object；
Laminating module, the default background image of foreground image loading is suitable for, specific region is not belonging in foreground image
Default foreground image is superimposed on subregion, obtains the image after present frame processing；
Overlay module, the video data after former two field picture is handled is covered suitable for the image after present frame is handled；
Display module, suitable for the video data after display processing.
Alternatively, detection module is further adapted for：
Key point information detection is carried out to current frame image, it is determined that belonging to the specific region of special object.
Alternatively, detection module is further adapted for：
Key point information and colouring information detection are carried out to current frame image, it is determined that belonging to the specific region of special object.
Alternatively, device also includes：
Processing module, suitable for the display styles pattern according to default background image and/or default foreground image, to foreground picture
The specific region of picture carries out respective handling.
Alternatively, processing module is further adapted for：
The specific region of foreground image is carried out grinding skin and/or toning processing.
Alternatively, special object is personage；The specific region of special object is facial zone；
Detection module is further adapted for：Critical point detection is carried out to current frame image, determines the face region of personage；To working as
Prior image frame carries out Face Detection, determines the area of skin color of personage；According to the face region of personage and area of skin color, personage is determined
Facial zone.
Alternatively, it is the first default picture to preset foreground image；Default background image is the second default picture.
Alternatively, device also includes：
First toning processing module, handle, respectively obtained before presetting suitable for the 3rd default picture is carried out into different tonings
Scape image and default background image.
Alternatively, it is the two field picture in the first pre- setting video to preset foreground image；Default background image is preset for second to be regarded
Two field picture in frequency.
Alternatively, device also includes：
Second toning processing module, is handled, respectively suitable for the two field picture in the 3rd pre- setting video is carried out into different tonings
Obtain default foreground image and default background image.
Alternatively, display module, it is further adapted for the video data real-time display after processing；
Device also includes：
Uploading module, suitable for the video data after processing is uploaded into Cloud Server.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud video platform server, so that cloud video platform server is in cloud video
Platform is shown video data.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud direct broadcast server, so that cloud direct broadcast server pushes away video data in real time
Give viewing subscription client.
Alternatively, uploading module is further adapted for：
Video data after processing is uploaded to cloud public number server, so that cloud public number server pushes away video data
Give public number concern client.
According to another aspect of the invention, there is provided a kind of computing device, including：Processor, memory, communication interface and
Communication bus, the processor, the memory and the communication interface complete mutual communication by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device above-mentioned
Realize and operated corresponding to the video data real-time processing method of double exposure.
In accordance with a further aspect of the present invention, there is provided a kind of computer-readable storage medium, be stored with the storage medium to
A few executable instruction, the executable instruction make computing device realize that the video data of double exposure is handled in real time as described above
Operated corresponding to method.
It is real according to the video data real-time processing method and device, computing device provided by the invention for realizing double exposure
When obtain that image capture device is captured and/or the video recorded in include special object current frame image；Or in real time
The current frame image that special object is included in currently played video is obtained, scene cut processing is carried out to current frame image,
Obtain the foreground image that current frame image is directed to special object；Key message detection is carried out to current frame image, it is determined that belonging to
The specific region of special object；Default background image is loaded for foreground image, the portion of specific region is not belonging in foreground image
Default foreground image is superimposed on subregion, obtains the image after present frame processing；Image covering original after present frame is handled is worked as
Prior image frame handled after video data；Video data after display processing.The present invention gets present frame figure in real time
As after, the foreground image of special object is partitioned into from current frame image, according to the key message carried out to current frame image
Detection, determine the specific region of special object.On the premise of specific region is retained, specific region will be not belonging in foreground image
The default foreground image of subregion superposition, and load default background image, realize the double exposure special efficacy in video data.
Present invention employs deep learning method, realizes the completion scene cut processing of the high accuracy of high efficiency.And user is not needed
Extra process is carried out to the video of recording, saves user time, the video data after being handled with real-time display to user, side
Just user checks display effect.User's technical merit is not limited simultaneously, facilitates public use.
Described above is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention,
And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can
Become apparent, below especially exemplified by the embodiment of the present invention.
Brief description of the drawings
By reading the detailed description of hereafter preferred embodiment, it is various other the advantages of and benefit it is common for this area
Technical staff will be clear understanding.Accompanying drawing is only used for showing the purpose of preferred embodiment, and is not considered as to the present invention
Limitation.And in whole accompanying drawing, identical part is denoted by the same reference numerals.In the accompanying drawings：
Fig. 1 shows the stream of the video data real-time processing method according to an embodiment of the invention for realizing double exposure
Cheng Tu；
Fig. 2 shows the video data real-time processing method in accordance with another embodiment of the present invention for realizing double exposure
Flow chart；
Fig. 3 shows the work(of the video data real-time processing device according to an embodiment of the invention for realizing double exposure
Can block diagram；
Fig. 4 shows the video data real-time processing device in accordance with another embodiment of the present invention for realizing double exposure
Functional block diagram；
Fig. 5 shows a kind of structural representation of computing device according to an embodiment of the invention.
Embodiment
The exemplary embodiment of the disclosure is more fully described below with reference to accompanying drawings.Although the disclosure is shown in accompanying drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
Limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
Completely it is communicated to those skilled in the art.
Special object can be any objects such as personage in image, plant, animal in the present invention, with people in embodiment
Illustrated exemplified by thing, specific region illustrates by taking the facial zone of personage as an example, but is not limited only to personage and facial zone.
Fig. 1 shows the stream of the video data real-time processing method according to an embodiment of the invention for realizing double exposure
Cheng Tu.As shown in figure 1, realize that the video data real-time processing method of double exposure specifically comprises the following steps：
Step S101, real-time image acquisition collecting device is captured and/or the video recorded in comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time.
Image capture device illustrates by taking mobile terminal as an example in the present embodiment.Get mobile terminal camera in real time
Current frame image when current frame image in recorded video or shooting video.Due to the present invention to special object at
Reason, therefore only obtain the current frame image comprising special object during acquisition current frame image.Except real-time image acquisition collecting device
Outside the captured and/or video recorded, it can also obtain in real time current comprising special object in currently played video
Two field picture.
Step S102, scene cut processing is carried out to current frame image, current frame image is obtained and is directed to special object
Foreground image.
Current frame image contains special object, such as personage.Scene cut processing is carried out to current frame image, mainly will
Special object is split from current frame image, obtains being directed to the foreground image of special object, and the foreground image can be only
Include special object.
When carrying out scene cut processing to current frame image, deep learning method can be utilized.Deep learning is machine
It is a kind of based on the method that data are carried out with representative learning in study.Observation (such as piece image) can use various ways
Represent, such as the vector of each pixel intensity value, or be more abstractively expressed as a series of sides, the region etc. of given shape.And make
It is easier with some specific method for expressing from example learning task (for example, recognition of face or human facial expression recognition).Such as profit
Scene cut can be carried out to current frame image, obtain including the foreground image of personage with personage's dividing method of deep learning.
Step S103, key message detection is carried out to current frame image, it is determined that belonging to the specific region of special object.
To determine specific region, it is necessary to carry out key message detection to current frame image.Specifically, can be from present frame figure
The key message of specific region is extracted as in, is detected according to key message.The key message can be specially key point
Information, key area information, and/or key lines information etc..Embodiments of the invention illustrate by taking key point information as an example, but
The key message of the present invention is not limited to key point information.It can be improved using key point information and spy is determined according to key point information
Determine the processing speed and efficiency in region, specific region directly can be determined according to key point information, it is not necessary to again to key message
Carry out the complex operations such as subsequently calculating, analysis.Meanwhile key point information is easy to extract, and extract accurately, determine specific region
Effect is more accurate.According to the detection that key point information is carried out to current frame image, to determine the specific region for belonging to special object.
Determination such as specific region can be determined according to the edge contour of specific region, therefore, extracted from current frame image
During key point information, the key point information positioned at specific region edge can be extracted.When special object is personage, specific region
For personage facial zone when, the key point information of extraction includes being located at facial zone edge key point information.
Step S104, background image is preset for foreground image loading, the part of specific region is not belonging in foreground image
Default foreground image is superimposed on region, obtains the image after present frame processing.
Default background image is loaded into foreground image, and is not belonging in the obtained foreground image of segmentation the spy having determined
Determine to be superimposed default foreground image on the subregion in region, retaining given zone in the image after the present frame processing obtained from
While the feature display in domain, the subregion that specific region is not belonging in foreground image is reached into default foreground image and part
The display effect of region double exposure.
Wherein, it can be two different pictures to preset background image and default foreground image, and default foreground image can be with
For the first default picture, it is the second default picture to preset background image, avoids the image after present frame processing in display, prospect
The subregion and default background image that specific region is not belonging in image cannot be distinguished by.Or default background image and it is default before
Scape image is a pictures of identical display styles, the such as the 3rd default picture.When default background image and default foreground image are
Handle, respectively obtain, it is necessary to which the 3rd default picture is carried out into different tonings when the 3rd of identical display styles presets picture
The default foreground image of bright tone and the default background image of dim tone.
Step S105, the image after present frame is handled cover the video data after former current frame image is handled.
Image after being handled using present frame directly overrides former current frame image, the video after directly can be processed
Data.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
In the image after obtaining present frame processing, the image after can present frame be handled directly covers former present frame figure
Picture.Speed during covering, typically completed within 1/24 second.For a user, because the time of covering treatment is relative
Short, human eye is not discovered significantly, i.e., human eye does not perceive the process that the former current frame image in video data is capped.This
During video data of the sample after follow-up display processing, shoot and/or record equivalent to one side and/or during playing video data, one
Side real-time display does not feel as the display effect that two field picture in video data covers for the video data after processing, user
Fruit.
Step S106, the video data after display processing.
After video data after being handled, it can be shown in real time, after user can directly be seen that processing
Video data display effect.
According to the video data real-time processing method provided by the invention for realizing double exposure, real-time image acquisition collection is set
For the current frame image for including special object in video that is captured and/or being recorded；Or obtain in real time currently played
The current frame image of special object is included in video, scene cut processing is carried out to current frame image, obtains current frame image pin
For the foreground image of special object；Key message detection is carried out to current frame image, it is determined that belonging to the given zone of special object
Domain；Default background image is loaded for foreground image, is not belonging to be superimposed on the subregion of specific region in foreground image and presets
Foreground image, obtain the image after present frame processing；Image after present frame is handled covers former current frame image and handled
Video data afterwards；Video data after display processing.The present invention after current frame image is got in real time, from current frame image
In be partitioned into the foreground image of special object, according to the detection of the key message carried out to current frame image, determine special object
Specific region.On the premise of specific region is retained, the subregion that specific region is not belonging in foreground image is superimposed pre-
If foreground image, and default background image is loaded, realize the double exposure special efficacy in video data.Present invention employs depth
Learning method, realize the completion scene cut processing of the high accuracy of high efficiency.And user is not needed to carry out the video of recording
Extra process, user time is saved, the video data after being handled with real-time display to user, facilitate user to check display effect
Fruit.User's technical merit is not limited simultaneously, facilitates public use.
Fig. 2 shows the video data real-time processing method in accordance with another embodiment of the present invention for realizing double exposure
Flow chart.As shown in Fig. 2 realize that the video data real-time processing method of double exposure specifically comprises the following steps：
Step S201, real-time image acquisition collecting device is captured and/or the video recorded in comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time.
Step S202, to current frame image carry out scene cut processing, obtain current frame image be directed to it is described specific right
The foreground image of elephant.
Above step will not be repeated here with reference to the description of the step S101-S102 in the embodiment of figure 1.
Step S203, key point information is carried out to current frame image and colouring information detects, it is determined that belonging to special object
Specific region.
Using special object as personage in the present embodiment, the specific region of special object is to illustrate exemplified by facial zone.
To current frame image carry out key point information detection, can by from current frame image extract eyes, eyebrow, face, nose,
The key point informations such as ear are detected, and determine the face region of personage.At the same time it can also carry out color letter to current frame image
(colour of skin) detection is ceased, determines the area of skin color of personage.When carrying out Face Detection, the colour of skin (can be based on by parameterized model
The hypothesis of gaussian probability distributed model can be obeyed), non-parametric model (estimation the colour of skin histogram), colour of skin cluster definition
Skin color detection methods such as (color space such as YCbCr, HSV, RGB, CIELAB Threshold segmentations) is realized, is not limited herein.According to
The face region of personage and area of skin color, it may be determined that belong to the specific region of special object, that is, determine the facial zone of personage.
Step S204, according to the display styles pattern of default background image and/or default foreground image, to foreground image
Specific region carries out respective handling.
, can be to the specific of foreground image according to the display styles pattern of default background image and/or default foreground image
Region carries out the respective handlings such as mill skin, toning.Such as default background image is bright day background image, can be by foreground image
Specific region such as facial zone carry out grind skin processing, to eliminate the flaw such as the spot of parts of skin, flaw, variegated in facial zone
Defect so that facial zone is finer and smoother, and profile becomes apparent from.And adjusted according to the color of default background image, tone etc. special
Determine color, the tone in region etc. so that specific region and default background image divide display styles pattern to be close or unanimously.
It should be noted that, it is necessary to retain the feature of specific region when being handled in the specific region to foreground image
Information, only to being adjusted in display styles pattern.When such as specific region being facial zone, retain eyes, the eyebrow of facial zone
The display characteristic information of the specific region such as hair, face, nose, ear, shape of face script, only adjust pale, the removal face of the colour of skin
Spot, lighten colour of skin etc. processing.
If the display styles pattern of default background image and default foreground image is inconsistent, it is possible to specify according to any figure
The display styles pattern of picture carries out respective handling to the specific region of foreground image.
Step S205, background image is preset for foreground image loading, the part of specific region is not belonging in foreground image
Default foreground image is superimposed on region, obtains the image after present frame processing.
Default background image is loaded into foreground image, and is not belonging in the obtained foreground image of segmentation the spy having determined
Determine the subregion in region, if special object is personage, when specific region is the facial zone of personage, do not belong in foreground image
In the subregion of specific region be the regions such as hair in addition to character face region, clothes.Folded on these subregions
Add default foreground image, so as to obtain the image after present frame processing.
Default background image and default foreground image can use default picture, or any frame figure in video
Picture.Such as default foreground image is any two field picture in the first pre- setting video.Randomly select any frame in the first pre- setting video
Image is as default foreground image.Further, default foreground image can also be real-time change, different with the time, before presetting
Scape image change is another two field picture in the first pre- setting video.Default background image can be any in the second pre- setting video
Two field picture.Any two field picture in the second pre- setting video is randomly selected as default background image.Further, background image is preset
Real-time change is can also be, different with the time, default background image becomes another two field picture turned in the second pre- setting video.The
One pre- setting video and the second pre- setting video are the different videos of two display styles patterns, i.e., default foreground image and default background
The display styles pattern of image is different.Or default foreground image and default background image are appointing in the 3rd pre- setting video
One two field picture, it can be any two field picture of identical in the 3rd pre- setting video to preset foreground image and default background image, in advance
If foreground image and Bu Tong any two field picture that default background image can also be in the 3rd pre- setting video.But due to presetting prospect
Image and default background image are the two field picture in the 3rd pre- setting video, and both display styles patterns are identical.By by
Two field picture in three pre- setting videos carries out different toning processing, as by same two field picture or different frame Image Adjusting into bright
Color, tone as default foreground image, using same two field picture or different frame Image Adjusting into dim color, tone as in advance
If background image, so as to which default background image and default foreground image be made a distinction.
Step S206, the image after present frame is handled cover the video data after former current frame image is handled.
Image after being handled using present frame directly overrides former current frame image, the video after directly can be processed
Data.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
Step S207, the video data after display processing.
After video data after being handled, it can be shown in real time, after user can directly be seen that processing
Video data display effect.
Step S208, the video data after processing is uploaded to Cloud Server.
Video data after processing can be directly uploaded to Cloud Server, specifically, can be by the video counts after processing
According to be uploaded to one or more cloud video platform server, such as iqiyi.com, youku.com, fast video cloud video platform server,
So that cloud video platform server is shown video data in cloud video platform.Or can also be by the video data after processing
Cloud direct broadcast server is uploaded to, can be straight by cloud when the user for having live viewing end is watched into cloud direct broadcast server
Broadcast server and give video data real time propelling movement to viewing subscription client.Or the video data after processing can also be uploaded to
Cloud public number server, when there is user to pay close attention to the public number, video data is pushed to public number by cloud public number server
Pay close attention to client；Further, cloud public number server can also be accustomed to according to the viewing of the user of concern public number, and push meets
The video data of user's custom pays close attention to client to public number.
According to the video data real-time processing method provided by the invention for realizing double exposure, current frame image is closed
Key point information and colouring information detection, it is determined that belonging to the specific region of special object.According to default background image and/or it is default before
The display styles pattern of scape image, respective handling is carried out to the specific region of foreground image, so that specific region and default prospect
The display styles pattern of image and/or default background image is consistent or similar, the video entirety display styles after obtained processing
Pattern is unified.And when being handled in the specific region to foreground image, retain the display characteristic information of specific region script, only
To being adjusted in display styles pattern, the video after obtained processing will not distortion.Default foreground image and default Background
As except using in addition to picture, can also being the two field picture in pre- setting video, and real-time change so that the video after obtained processing is more
Vividly, flexibly.The present invention can directly obtain the video after processing, the video after processing can also be directly uploaded into cloud service
Device, it is not necessary to which user carries out extra process to the video of recording, saves user time, after being handled with real-time display to user
Video data, facilitate user to check display effect.User's technical merit is not limited simultaneously, facilitates public use.
Fig. 3 shows the work(of the video data real-time processing device according to an embodiment of the invention for realizing double exposure
Can block diagram.As shown in figure 3, realizing the video data real-time processing device of double exposure includes following module：
Acquisition module 301, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising specific
The current frame image of object；Or the current frame image that special object is included in currently played video is obtained in real time.
Image capture device illustrates by taking mobile terminal as an example in the present embodiment.Acquisition module 301 gets shifting in real time
Move current frame image when current frame image or shooting video of the terminal camera in recorded video.Because the present invention is to spy
Determine object to be handled, therefore the current frame image comprising special object is only obtained during the acquisition current frame image of acquisition module 301.
For acquisition module 301 except captured by real-time image acquisition collecting device and/or in addition to the video recorded, acquisition module 301 can be with
The current frame image that special object is included in currently played video is obtained in real time.Special object can be image in the present invention
In human body, plant, any object such as animal, illustrated in embodiment by taking human body as an example, but be not limited only to human body.
Split module 302, suitable for current frame image carry out scene cut processing, obtain current frame image be directed to it is specific
The foreground image of object.
Current frame image contains special object, such as personage.Split module 302 to carry out at scene cut current frame image
Reason, special object is mainly split, obtain being directed to the foreground image of special object from current frame image, the prospect
Image can only include special object.
Split module 302 when carrying out scene cut processing to current frame image, deep learning method can be utilized.Depth
Study is a kind of based on the method that data are carried out with representative learning in machine learning.Observation (such as piece image) can use
Various ways represent, a series of such as vector of each pixel intensity value, or be more abstractively expressed as sides, the area of given shape
Domain etc..And some specific method for expressing are used to be easier from example learning task (for example, recognition of face or facial expression are known
Not).Scene cut can be carried out using personage's dividing method of deep learning to current frame image by such as splitting module 302, be obtained
Foreground image comprising personage.
Detection module 303, suitable for carrying out key message detection to current frame image, it is determined that belonging to the given zone of special object
Domain.
Detection module 303 is for determination specific region, it is necessary to carry out key message detection to current frame image.Specifically, inspection
The key message of specific region can be extracted from current frame image by surveying module 303, be detected according to key message.The pass
Key information can be specially key point information, key area information, and/or key lines information etc..Embodiments of the invention are to close
Illustrated exemplified by key point information, but the key message of the present invention is not limited to key point information.Can be with using key point information
The processing speed and efficiency that specific region is determined according to key point information are improved, directly can be determined according to key point information specific
Region, it is not necessary to carry out the complex operations such as subsequently calculating, analysis to key message again.Meanwhile key point information is easy to extract, and
Extraction is accurate, determines that the effect of specific region is more accurate.Detection module 303 carries out key point information according to current frame image
Detection, to determine the specific region for belonging to special object.Determination such as specific region can be according to the edge contour of specific region
It is determined, therefore, detection module 303 can be extracted positioned at specific when extracting key point information from current frame image
The key point information of edges of regions.When special object is personage, and specific region is the facial zone of personage, detection module 303
The key point information of extraction includes being located at facial zone edge key point information.
Using special object as personage in the present embodiment, the specific region of special object is to illustrate exemplified by facial zone.
Detection module 303 carries out key point information detection to current frame image, can be by extracting eyes, eyebrow from current frame image
The key point informations such as hair, face, nose, ear are detected, and determine the face region of personage.Meanwhile detection module 303 may be used also
To carry out colouring information (colour of skin) detection to current frame image, the area of skin color of personage is determined.Detection module 303 is carrying out the colour of skin
During detection, parameterized model (hypothesis that gaussian probability distributed model can be obeyed based on the colour of skin), imparametrization mould can be passed through
Type (estimation colour of skin histogram), colour of skin cluster define the colours of skin such as (color space such as YCbCr, HSV, RGB, CIELAB Threshold segmentations)
Detection method is realized, is not limited herein.Detection module 303 is according to the face region of personage and area of skin color, it may be determined that category
In the specific region of special object, i.e. detection module 303 determines the facial zone of personage.
Laminating module 304, the default background image of foreground image loading is suitable for, specific region is not belonging in foreground image
Subregion on the default foreground image of superposition, obtain the image after present frame processing.
Default background image is loaded foreground image by laminating module 304, and is not belonging in the foreground image that segmentation obtains
The subregion for the specific region having determined, if special object is personage, when specific region is the facial zone of personage, preceding
The regions such as hair of the subregion of specific region i.e. in addition to character face region, clothes are not belonging in scape image.Superposition mould
Block 304 is superimposed default foreground image on these subregions, so as to obtain the image after present frame processing.After present frame processing
Image while the feature display of specific region is retained, the subregion that specific region is not belonging in foreground image reaches pre-
If the display effect of foreground image and subregion double exposure.
Overlay module 305, the video data after former two field picture is handled is covered suitable for the image after present frame is handled.
Image after overlay module 305 is handled using present frame directly overrides former current frame image, can directly obtain
Video data after processing.Meanwhile the user of recording can also be immediately seen the image after present frame processing.
When laminating module 304 obtains the image after present frame processing, overlay module 305 understands the figure after present frame be handled
As directly covering former current frame image.Speed when overlay module 305 covers, was typically completed within 1/24 second.For
For user, because the time of the covering treatment of overlay module 305 is relatively short, human eye is not discovered significantly, i.e., human eye is not examined
Feel the process that the former current frame image in video data is capped.So regarding after the follow-up display processing of display module 306
Frequency according to when, shoot and/or record equivalent to one side and/or during playing video data, the real-time display of one side display module 306
For the video data after processing, user does not feel as the display effect that two field picture in video data covers.
Display module 306, suitable for the video data after display processing.
Display module 306 handled after video data after, it can be shown in real time, user can be direct
See the display effect of the video data after processing.
According to the video data real-time processing device provided by the invention for realizing double exposure, real-time image acquisition collection is set
For the current frame image for including special object in video that is captured and/or being recorded；Or obtain in real time currently played
The current frame image of special object is included in video, scene cut processing is carried out to current frame image, obtains current frame image pin
For the foreground image of special object；Key message detection is carried out to current frame image, it is determined that belonging to the given zone of special object
Domain；Default background image is loaded for foreground image, is not belonging to be superimposed on the subregion of specific region in foreground image and presets
Foreground image, obtain the image after present frame processing；Image after present frame is handled covers former current frame image and handled
Video data afterwards；Video data after display processing.The present invention after current frame image is got in real time, from current frame image
In be partitioned into the foreground image of special object, according to the detection of the key message carried out to current frame image, determine special object
Specific region.On the premise of specific region is retained, the subregion that specific region is not belonging in foreground image is superimposed pre-
If foreground image, and default background image is loaded, realize the double exposure special efficacy in video data.Present invention employs depth
Learning method, realize the completion scene cut processing of the high accuracy of high efficiency.And user is not needed to carry out the video of recording
Extra process, user time is saved, the video data after being handled with real-time display to user, facilitate user to check display effect
Fruit.User's technical merit is not limited simultaneously, facilitates public use.
Fig. 4 shows the video data real-time processing device in accordance with another embodiment of the present invention for realizing double exposure
Functional block diagram.As shown in figure 4, being with Fig. 3 differences, realize that the video data real-time processing device of double exposure also wraps
Include：
Processing module 307, suitable for the display styles pattern according to default background image and/or default foreground image, to preceding
The specific region of scape image carries out respective handling.
Processing module 307, can be to prospect according to the display styles pattern of default background image and/or default foreground image
The specific region of image carries out the respective handlings such as mill skin, toning.Such as default background image is bright day background image, processing
Module 307 can carry out the specific region of foreground image such as facial zone to grind skin processing, to eliminate skin portion in facial zone
Point spot, flaw, the flaw such as variegated so that facial zone is finer and smoother, and profile becomes apparent from.And processing module 307
According to the color of the adjustment such as the color of default background image, tone specific region, tone etc. so that specific region and default Background
As dividing display styles pattern to be close or unanimously.
It should be noted that, it is necessary to retain specific when processing module 307 is handled in the specific region to foreground image
The characteristic information in region, only to being adjusted in display styles pattern.When such as specific region being facial zone, processing module 307
Retain the display characteristic information of the specific region scripts such as the eyes of facial zone, eyebrow, face, nose, ear, shape of face, only adjust
The spot that is pale, removing face of the whole colour of skin, lighten the processing such as colour of skin.
If the display styles pattern of default background image and default foreground image is inconsistent, processing module 307 can refer to
The fixed display styles pattern according to any image carries out respective handling to the specific region of foreground image.
First toning processing module 308, handle, respectively obtain default suitable for the 3rd default picture is carried out into different tonings
Foreground image and default background image.
Default background image and default foreground image can be two different pictures, and default foreground image can be first
Default picture, it is the second default picture to preset background image, the image after present frame processing is avoided in display, in foreground image
The subregion and default background image for being not belonging to specific region cannot be distinguished by.Or default background image and default foreground image
For a pictures of identical display styles, the such as the 3rd default picture.When default background image and default foreground image are identical aobvious
When showing the 3rd default picture of style, the 3rd default picture is carried out different tonings and handled by the first toning processing module 308,
Respectively obtain the default foreground image of bright tone and the default background image of dim tone.
Second toning processing module 309, is handled suitable for the two field picture in the 3rd pre- setting video is carried out into different tonings, point
Default foreground image and default background image are not obtained.
Default background image and default foreground image are in addition to for picture, or any two field picture in video.As in advance
If foreground image is any two field picture in the first pre- setting video.Randomly select any two field picture conduct in the first pre- setting video
Default foreground image.Further, default foreground image can also be real-time change, different with the time, presets foreground image and becomes
Turn to another two field picture in the first pre- setting video.Default background image can be any two field picture in the second pre- setting video.
Any two field picture in the second pre- setting video is randomly selected as default background image.Further, default background image can be with
It is real-time change, different with the time, default background image becomes another two field picture turned in the second pre- setting video.First is default
Video and the second pre- setting video are the different videos of two display styles patterns, i.e., default foreground image and default background image
Display styles pattern is different.Or default foreground image and default background image are any frame figure in the 3rd pre- setting video
Picture, it can be any two field picture of identical in the 3rd pre- setting video to preset foreground image and default background image, preset prospect
Image and Bu Tong any two field picture that default background image can also be in the 3rd pre- setting video.But due to default foreground image and
Default background image is the two field picture in the 3rd pre- setting video, and both display styles patterns are identical.Second toning processing mould
Block 309 is handled by the way that the two field picture in the 3rd pre- setting video is carried out into different tonings, and such as the second toning processing module 309 will be same
One two field picture or different frame Image Adjusting are used as default foreground image, the second toning processing module 309 into bright color, tone
Using same two field picture or different frame Image Adjusting into dim color, tone as default background image, so as to by default prospect
Image and default background image make a distinction.
Wherein, the first toning toning processing module of processing module 308 and/or second is performed according to specific implementation situation selection
309。
Uploading module 310, suitable for the video data after processing is uploaded into Cloud Server.
Video data after processing can be directly uploaded to Cloud Server by uploading module 310, specifically, uploading module
310 can be uploaded to the video data after processing the cloud video platform server of one or more, such as iqiyi.com, youku.com, fast
The cloud video platform server such as video, so that cloud video platform server is shown video data in cloud video platform.Or
Video data after processing can also be uploaded to cloud direct broadcast server by uploading module 310, when the user for having live viewing end enters
When entering cloud direct broadcast server and being watched, can by cloud direct broadcast server by video data real time propelling movement to viewing user client
End.Or the video data after processing can also be uploaded to cloud public number server by uploading module 310, it is somebody's turn to do when there is user's concern
During public number, video data is pushed to public number concern client by cloud public number server；Further, cloud public number service
Device can also be accustomed to according to the viewing of the user of concern public number, and the video data that push meets user's custom is paid close attention to public number
Client.
According to the video data real-time processing device provided by the invention for realizing double exposure, current frame image is closed
Key point information and colouring information detection, it is determined that belonging to the specific region of special object.According to default background image and/or it is default before
The display styles pattern of scape image, respective handling is carried out to the specific region of foreground image, so that specific region and default prospect
The display styles pattern of image and/or default background image is consistent or similar, the video entirety display styles after obtained processing
Pattern is unified.And when being handled in the specific region to foreground image, retain the display characteristic information of specific region script, only
To being adjusted in display styles pattern, the video after obtained processing will not distortion.Default foreground image and default Background
As except using in addition to picture, can also being the two field picture in pre- setting video, and real-time change so that the video after obtained processing is more
Vividly, flexibly.The present invention can directly obtain the video after processing, the video after processing can also be directly uploaded into cloud service
Device, it is not necessary to which user carries out extra process to the video of recording, saves user time, after being handled with real-time display to user
Video data, facilitate user to check display effect.User's technical merit is not limited simultaneously, facilitates public use.
Present invention also provides a kind of nonvolatile computer storage media, the computer-readable storage medium is stored with least
One executable instruction, the computer executable instructions can perform the video for realizing double exposure in above-mentioned any means embodiment
Real-time Data Processing Method.
Fig. 5 shows a kind of structural representation of computing device according to an embodiment of the invention, of the invention specific real
Specific implementation of the example not to computing device is applied to limit.
As shown in figure 5, the computing device can include：Processor (processor) 502, communication interface
(Communications Interface) 504, memory (memory) 506 and communication bus 508.
Wherein：
Processor 502, communication interface 504 and memory 506 complete mutual communication by communication bus 508.
Communication interface 504, for being communicated with the network element of miscellaneous equipment such as client or other servers etc..
Processor 502, for configuration processor 510, it is real-time can specifically to perform the above-mentioned video data for realizing double exposure
Correlation step in processing method embodiment.
Specifically, program 510 can include program code, and the program code includes computer-managed instruction.
Processor 502 is probably central processor CPU, or specific integrated circuit ASIC (Application
Specific Integrated Circuit), or it is arranged to implement the integrated electricity of one or more of the embodiment of the present invention
Road.The one or more processors that computing device includes, can be same type of processor, such as one or more CPU；Also may be used
To be different types of processor, such as one or more CPU and one or more ASIC.
Memory 506, for depositing program 510.Memory 506 may include high-speed RAM memory, it is also possible to also include
Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.
Program 510 specifically can be used for so that processor 502, which is performed in above-mentioned any means embodiment, realizes dual exposure
The video data real-time processing method of light.The specific implementation of each step may refer to above-mentioned double exposure of realizing in program 510
Corresponding description in corresponding steps and unit in the real-time Processing Example of video data, will not be described here.The skill of art
Art personnel can be understood that, for convenience and simplicity of description, the equipment of foregoing description and the specific work process of module,
The corresponding process description in preceding method embodiment is may be referred to, will not be repeated here.
Algorithm and display be not inherently related to any certain computer, virtual system or miscellaneous equipment provided herein.
Various general-purpose systems can also be used together with teaching based on this.As described above, required by constructing this kind of system
Structure be obvious.In addition, the present invention is not also directed to any certain programmed language.It should be understood that it can utilize various
Programming language realizes the content of invention described herein, and the description done above to language-specific is to disclose this hair
Bright preferred forms.
In the specification that this place provides, numerous specific details are set forth.It is to be appreciated, however, that the implementation of the present invention
Example can be put into practice in the case of these no details.In some instances, known method, structure is not been shown in detail
And technology, so as not to obscure the understanding of this description.
Similarly, it will be appreciated that in order to simplify the disclosure and help to understand one or more of each inventive aspect,
Above in the description to the exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes
In example, figure or descriptions thereof.However, the method for the disclosure should be construed to reflect following intention：I.e. required guarantor
The application claims of shield features more more than the feature being expressly recited in each claim.It is more precisely, such as following
Claims reflect as, inventive aspect is all features less than single embodiment disclosed above.Therefore,
Thus the claims for following embodiment are expressly incorporated in the embodiment, wherein each claim is in itself
Separate embodiments all as the present invention.
Those skilled in the art, which are appreciated that, to be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more equipment different from the embodiment.Can be the module or list in embodiment
Member or component be combined into a module or unit or component, and can be divided into addition multiple submodule or subelement or
Sub-component.In addition at least some in such feature and/or process or unit exclude each other, it can use any
Combination is disclosed to all features disclosed in this specification (including adjoint claim, summary and accompanying drawing) and so to appoint
Where all processes or unit of method or equipment are combined.Unless expressly stated otherwise, this specification (including adjoint power
Profit requires, summary and accompanying drawing) disclosed in each feature can be by providing the alternative features of identical, equivalent or similar purpose come generation
Replace.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included some features rather than further feature, but the combination of the feature of different embodiments means in of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
One of meaning mode can use in any combination.
The all parts embodiment of the present invention can be realized with hardware, or to be run on one or more processor
Software module realize, or realized with combinations thereof.It will be understood by those of skill in the art that it can use in practice
Microprocessor or digital signal processor (DSP) realize the video data for realizing double exposure according to embodiments of the present invention
The some or all functions of some or all parts in the device handled in real time.The present invention is also implemented as being used to hold
The some or all equipment or program of device of row method as described herein are (for example, computer program and computer
Program product).It is such realize the present invention program can store on a computer-readable medium, or can have one or
The form of the multiple signals of person.Such signal can be downloaded from internet website and obtained, or be provided on carrier signal, or
Person is provided in the form of any other.
It should be noted that the present invention will be described rather than limits the invention for above-described embodiment, and ability
Field technique personnel can design alternative embodiment without departing from the scope of the appended claims.In the claims,
Any reference symbol between bracket should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not
Element or step listed in the claims.Word "a" or "an" before element does not exclude the presence of multiple such
Element.The present invention can be by means of including the hardware of some different elements and being come by means of properly programmed computer real
It is existing.In if the unit claim of equipment for drying is listed, several in these devices can be by same hardware branch
To embody.The use of word first, second, and third does not indicate that any order.These words can be explained and run after fame
Claim.
Claims (10)
1. a kind of video data real-time processing method for realizing double exposure, it includes：
Real-time image acquisition collecting device is captured and/or the video recorded in include special object current frame image；Or
Person, the current frame image that special object is included in currently played video is obtained in real time；
Scene cut processing is carried out to current frame image, obtains the foreground image that current frame image is directed to the special object；
Key message detection is carried out to the current frame image, it is determined that belonging to the specific region of special object；
Default background image is loaded for the foreground image, is not belonging in the foreground image on the subregion of specific region
The default foreground image of superposition, obtains the image after present frame processing；
Image after present frame is handled covers the video data after former current frame image is handled；
Show the video data after the processing.
2. the method according to claim 11, wherein, it is described that key message detection is carried out to current frame image, it is determined that belonging to
The specific region of special object further comprises：Key point information detection is carried out to current frame image, it is determined that belonging to special object
Specific region.
3. the method according to claim 11, wherein, it is described that key message detection is carried out to current frame image, it is determined that belonging to
The specific region of special object further comprises：Key point information and colouring information detection are carried out to current frame image, it is determined that category
In the specific region of special object.
4. according to the method any one of claim 1-3, wherein, the image obtained after present frame processing it
Before, methods described also includes：According to the display styles pattern of default background image and/or default foreground image, to the prospect
The specific region of image carries out respective handling.
5. according to the method for claim 4, wherein, the specific region to the foreground image carries out respective handling and entered
One step includes：The specific region of the foreground image is carried out grinding skin and/or toning processing.
6. according to the method any one of claim 1-5, wherein, the special object is personage；The special object
Specific region be facial zone；
It is described that key message detection is carried out to current frame image, it is determined that the specific region for belonging to special object further comprises：
Critical point detection is carried out to current frame image, determines the face region of personage；
Face Detection is carried out to current frame image, determines the area of skin color of personage；
According to the face region of the personage and the area of skin color, the facial zone of personage is determined.
7. according to the method any one of claim 1-6, wherein, the default foreground image is the first default picture；
The default background image is the second default picture.
8. a kind of video data real-time processing device for realizing double exposure, it includes：
Acquisition module, suitable for captured by real-time image acquisition collecting device and/or in the video recorded comprising special object
Current frame image；Or the current frame image that special object is included in currently played video is obtained in real time；
Split module, be suitable to, to current frame image carry out scene cut processing, obtain current frame image be directed to it is described specific right
The foreground image of elephant；
Detection module, suitable for carrying out key message detection to the current frame image, it is determined that belonging to the specific region of special object；
Laminating module, the default background image of foreground image loading is suitable for, given zone is not belonging in the foreground image
Default foreground image is superimposed on the subregion in domain, obtains the image after present frame processing；
Overlay module, the video data after former two field picture is handled is covered suitable for the image after present frame is handled；
Display module, suitable for the video data after the display processing.
9. a kind of computing device, including：Processor, memory, communication interface and communication bus, the processor, the storage
Device and the communication interface complete mutual communication by the communication bus；
The memory is used to deposit an at least executable instruction, and the executable instruction makes the computing device such as right will
Ask and operated corresponding to the video data real-time processing method for realizing double exposure any one of 1-7.
10. a kind of computer-readable storage medium, an at least executable instruction, the executable instruction are stored with the storage medium
Make the video data real-time processing method of realizing double exposure of the computing device as any one of claim 1-7
Corresponding operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710864259.4A CN107665482B (en) | 2017-09-22 | 2017-09-22 | Video data real-time processing method and device for realizing double exposure and computing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710864259.4A CN107665482B (en) | 2017-09-22 | 2017-09-22 | Video data real-time processing method and device for realizing double exposure and computing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107665482A true CN107665482A (en) | 2018-02-06 |
| CN107665482B CN107665482B (en) | 2021-07-23 |
Family
ID=61098126
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710864259.4A Active CN107665482B (en) | 2017-09-22 | 2017-09-22 | Video data real-time processing method and device for realizing double exposure and computing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107665482B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108491818A (en) * | 2018-03-30 | 2018-09-04 | 北京三快在线科技有限公司 | Detection method, device and the electronic equipment of target object |
| CN109816663A (en) * | 2018-10-15 | 2019-05-28 | 华为技术有限公司 | A kind of image processing method, device and equipment |
| CN109961453A (en) * | 2018-10-15 | 2019-07-02 | 华为技术有限公司 | A kind of image processing method, device and equipment |
| CN110084154A (en) * | 2019-04-12 | 2019-08-02 | 北京字节跳动网络技术有限公司 | Render method, apparatus, electronic equipment and the computer readable storage medium of image |
| CN110266970A (en) * | 2019-05-31 | 2019-09-20 | 上海萌鱼网络科技有限公司 | A kind of short video creating method and system |
| CN110363172A (en) * | 2019-07-22 | 2019-10-22 | 曲靖正则软件开发有限公司 | A kind of method for processing video frequency, device, electronic equipment and readable storage medium storing program for executing |
| CN112700422A (en) * | 2021-01-06 | 2021-04-23 | 百果园技术(新加坡)有限公司 | Overexposure point detection method and device, electronic equipment and storage medium |
| WO2021135864A1 (en) * | 2019-12-30 | 2021-07-08 | 北京字节跳动网络技术有限公司 | Image processing method and apparatus |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101052100A (en) * | 2007-03-29 | 2007-10-10 | 上海交通大学 | Multiple exposure image intensifying method |
| CN101443791A (en) * | 2006-05-03 | 2009-05-27 | 快图影像有限公司 | Improved foreground/background separation in digitl images |
| CN101493930A (en) * | 2008-01-21 | 2009-07-29 | 保定市天河电子技术有限公司 | Loading exchanging method and transmission exchanging method |
| CN102075688A (en) * | 2010-12-28 | 2011-05-25 | 青岛海信网络科技股份有限公司 | Wide dynamic processing method for single-frame double-exposure image |
| CN103293825A (en) * | 2013-06-26 | 2013-09-11 | 深圳市中兴移动通信有限公司 | Multiple exposure method and device |
| CN104732506A (en) * | 2015-03-27 | 2015-06-24 | 浙江大学 | Character picture color style converting method based on face semantic analysis |
| CN106447642A (en) * | 2016-08-31 | 2017-02-22 | 北京云图微动科技有限公司 | Double exposure fusion method and device for image |
| US9602735B2 (en) * | 2012-12-19 | 2017-03-21 | International Business Machines Corporation | Digital imaging exposure metering system |
| CN107146204A (en) * | 2017-03-20 | 2017-09-08 | 深圳市金立通信设备有限公司 | A kind of U.S. face method of image and terminal |
-
2017
- 2017-09-22 CN CN201710864259.4A patent/CN107665482B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101443791A (en) * | 2006-05-03 | 2009-05-27 | 快图影像有限公司 | Improved foreground/background separation in digitl images |
| CN101052100A (en) * | 2007-03-29 | 2007-10-10 | 上海交通大学 | Multiple exposure image intensifying method |
| CN101493930A (en) * | 2008-01-21 | 2009-07-29 | 保定市天河电子技术有限公司 | Loading exchanging method and transmission exchanging method |
| CN102075688A (en) * | 2010-12-28 | 2011-05-25 | 青岛海信网络科技股份有限公司 | Wide dynamic processing method for single-frame double-exposure image |
| US9602735B2 (en) * | 2012-12-19 | 2017-03-21 | International Business Machines Corporation | Digital imaging exposure metering system |
| CN103293825A (en) * | 2013-06-26 | 2013-09-11 | 深圳市中兴移动通信有限公司 | Multiple exposure method and device |
| CN104732506A (en) * | 2015-03-27 | 2015-06-24 | 浙江大学 | Character picture color style converting method based on face semantic analysis |
| CN106447642A (en) * | 2016-08-31 | 2017-02-22 | 北京云图微动科技有限公司 | Double exposure fusion method and device for image |
| CN107146204A (en) * | 2017-03-20 | 2017-09-08 | 深圳市金立通信设备有限公司 | A kind of U.S. face method of image and terminal |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108491818B (en) * | 2018-03-30 | 2019-07-05 | 北京三快在线科技有限公司 | Detection method, device and the electronic equipment of target object |
| CN108491818A (en) * | 2018-03-30 | 2018-09-04 | 北京三快在线科技有限公司 | Detection method, device and the electronic equipment of target object |
| CN113112505A (en) * | 2018-10-15 | 2021-07-13 | 华为技术有限公司 | Image processing method, device and equipment |
| CN109816663A (en) * | 2018-10-15 | 2019-05-28 | 华为技术有限公司 | A kind of image processing method, device and equipment |
| CN109961453A (en) * | 2018-10-15 | 2019-07-02 | 华为技术有限公司 | A kind of image processing method, device and equipment |
| CN109961453B (en) * | 2018-10-15 | 2021-03-12 | 华为技术有限公司 | Image processing method, device and equipment |
| CN113112505B (en) * | 2018-10-15 | 2022-04-29 | 华为技术有限公司 | Image processing method, device and equipment |
| CN110084154A (en) * | 2019-04-12 | 2019-08-02 | 北京字节跳动网络技术有限公司 | Render method, apparatus, electronic equipment and the computer readable storage medium of image |
| CN110266970A (en) * | 2019-05-31 | 2019-09-20 | 上海萌鱼网络科技有限公司 | A kind of short video creating method and system |
| CN110363172A (en) * | 2019-07-22 | 2019-10-22 | 曲靖正则软件开发有限公司 | A kind of method for processing video frequency, device, electronic equipment and readable storage medium storing program for executing |
| WO2021135864A1 (en) * | 2019-12-30 | 2021-07-08 | 北京字节跳动网络技术有限公司 | Image processing method and apparatus |
| CN113132795A (en) * | 2019-12-30 | 2021-07-16 | 北京字节跳动网络技术有限公司 | Image processing method and device |
| US11798596B2 (en) | 2019-12-30 | 2023-10-24 | Beijing Bytedance Network Technology Co., Ltd. | Image processing method and apparatus |
| CN112700422A (en) * | 2021-01-06 | 2021-04-23 | 百果园技术(新加坡)有限公司 | Overexposure point detection method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107665482B (en) | 2021-07-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107665482A (en) | Realize the video data real-time processing method and device, computing device of double exposure | |
| Moran et al. | Deeplpf: Deep local parametric filters for image enhancement | |
| CN107507155A (en) | Video segmentation result edge optimization real-time processing method, device and computing device | |
| WO2018049084A1 (en) | Methods and systems for human imperceptible computerized color transfer | |
| CN107977927A (en) | Stature method of adjustment and device, computing device based on view data | |
| CN107820027A (en) | Video personage dresss up method, apparatus, computing device and computer-readable storage medium | |
| CN109816612A (en) | Image enchancing method and device, computer readable storage medium | |
| CN109903291B (en) | Image processing method and related device | |
| CN110691226B (en) | Image processing method, device, terminal and computer readable storage medium | |
| CN107705279A (en) | Realize the view data real-time processing method and device, computing device of double exposure | |
| CN107862277A (en) | Live dress ornament, which is dressed up, recommends method, apparatus, computing device and storage medium | |
| CN107483892A (en) | Video data real-time processing method and device, computing device | |
| CN107547803A (en) | Video segmentation result edge optimization processing method, device and computing device | |
| CN107613360A (en) | Video data real-time processing method and device, computing device | |
| Abiko et al. | Single image reflection removal based on GAN with gradient constraint | |
| CN107682731A (en) | Video data distortion processing method, device, computing device and storage medium | |
| CN108111911A (en) | Video data real-time processing method and device based on the segmentation of adaptive tracing frame | |
| CN107610149A (en) | Image segmentation result edge optimization processing method, device and computing device | |
| CN107256543A (en) | Image processing method, device, electronic equipment and storage medium | |
| CN107770606A (en) | Video data distortion processing method, device, computing device and storage medium | |
| CN114913338A (en) | Segmentation model training method and device, and image recognition method and device | |
| CN107566853A (en) | Realize the video data real-time processing method and device, computing device of scene rendering | |
| CN109241930B (en) | Method and apparatus for processing eyebrow image | |
| CN107578369A (en) | Video data handling procedure and device, computing device | |
| CN107743263B (en) | Video data real-time processing method and device and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |