CN107454336A - Image processing method and device, electronic installation and computer-readable recording medium - Google Patents

Image processing method and device, electronic installation and computer-readable recording medium Download PDF

Info

Publication number
CN107454336A
CN107454336A CN201710813698.2A CN201710813698A CN107454336A CN 107454336 A CN107454336 A CN 107454336A CN 201710813698 A CN201710813698 A CN 201710813698A CN 107454336 A CN107454336 A CN 107454336A
Authority
CN
China
Prior art keywords
image
predetermined
frame
depth
active user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710813698.2A
Other languages
Chinese (zh)
Other versions
CN107454336B (en
Inventor
张学勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201710813698.2A priority Critical patent/CN107454336B/en
Publication of CN107454336A publication Critical patent/CN107454336A/en
Application granted granted Critical
Publication of CN107454336B publication Critical patent/CN107454336B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6811Motion detection based on the image signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention discloses a kind of image processing method for merging image.Merge image to be formed with the predetermined foreground image of current user action can be followed to merge by predetermined two-dimensional background image.The action message of personage area image of the predetermined foreground image according to active user in scene image renders to obtain.Image processing method includes judging whether the change in location of two frame personage's area images corresponding to two continuous frames merging image is more than predetermined threshold, and is used as present frame to merge image using former frame merging image or predetermined two-dimensional background image when change in location is more than predetermined threshold.Invention additionally discloses a kind of image processing apparatus, electronic installation and computer-readable recording medium.Image processing method and device, the electronic installation and computer-readable recording medium of embodiment of the present invention are substituted when the two continuous frames character image region associated with the predetermined foreground image of two continuous frames is unstable with stable merging image, make to merge image holding stabilization in all processes, lift Consumer's Experience.

Description

Image processing method and device, electronic installation and computer-readable recording medium
Technical field
The present invention relates to technical field of image processing, more particularly to a kind of image processing method, image processing apparatus, electronics Device and computer-readable recording medium.
Background technology
When carrying out video using electronic installation, electronic equipment may result in active user in the case where the state such as inadvertently falling off The instantaneous shooting visual field for leaving camera, so as to which the action of active user can not be got with to merging the predetermined prospect in image Image is rendered, so as to cause the foreground image merged in image of display to disappear, poor user experience.
The content of the invention
Can the embodiment provides a kind of image processing method, image processing apparatus, electronic installation and computer Read storage medium.
The image processing method of embodiment of the present invention, which is used to handle, merges image.The merging image is carried on the back by predetermined two dimension Scape image forms with the predetermined foreground image of current user action can be followed to merge.The predetermined foreground image is according to described current The action message of personage area image of the user in scene image renders to obtain.Described image processing method includes:
Whether the change in location for judging to merge personage's area image described in two frames corresponding to image described in two continuous frames is more than Predetermined threshold, merging image described in the two continuous frames include former frame and merge image and present frame merging image;With
When the change in location is more than predetermined threshold, image or the predetermined two-dimensional background figure are merged with the former frame As merging image as the present frame.
The image processing apparatus of embodiment of the present invention, which is used to handle, merges image, and the merging image is carried on the back by predetermined two dimension Scape image forms with the predetermined foreground image of current user action can be followed to merge.The predetermined foreground image is according to described current The action message of personage area image of the user in scene image renders to obtain.Described image processing unit includes processor, The processor is used to judge that the change in location of personage's area image described in two frames corresponding to merging image described in two continuous frames to be No to be more than predetermined threshold, image is merged described in the two continuous frames includes former frame merging image and present frame merging image, with And when the change in location is more than predetermined threshold, using the former frame merge image or the predetermined two-dimensional background image as The present frame merges image.
The electronic installation of embodiment of the present invention includes one or more processors, memory and one or more programs. Wherein one or more of programs are stored in the memory, and are configured to by one or more of processors Perform, described program includes being used for the instruction for performing above-mentioned image processing method.
The computer-readable recording medium of embodiment of the present invention includes what is be used in combination with the electronic installation that can be imaged Computer program, the computer program can be executed by processor to complete above-mentioned image processing method.
Image processing method, image processing apparatus, electronic installation and the computer-readable storage medium of embodiment of the present invention Matter, the predetermined foreground image after rendering is being handled with predetermined two-dimensional background image when merging image, by pre- with two continuous frames The change in location for determining the associated corresponding two continuous frames character image region of foreground image judges the degree of stability of portrait, and Substituted when unstable with stable merging image so that merge image in all processes and remain stable, so as to improve The usage experience of user.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments Substantially and it is readily appreciated that, wherein:
Fig. 1 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Fig. 2 is the schematic diagram of the image processing apparatus of some embodiments of the present invention.
Fig. 3 is the structural representation of the electronic installation of some embodiments of the present invention.
Fig. 4 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Fig. 5 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Fig. 6 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Fig. 7 (a) to Fig. 7 (e) is the schematic diagram of a scenario of structural light measurement according to an embodiment of the invention.
Fig. 8 (a) and Fig. 8 (b) is the schematic diagram of a scenario of structural light measurement according to an embodiment of the invention.
Fig. 9 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Figure 10 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Figure 11 is the schematic flow sheet of the image processing method of some embodiments of the present invention.
Figure 12 is the schematic diagram of the image processing apparatus of some embodiments of the present invention.
Figure 13 is the schematic diagram of the electronic installation of some embodiments of the present invention.
Embodiment
Embodiments of the invention are described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
Referring to Fig. 1, the image processing method of embodiment of the present invention, which is used to handle, merges image.Merge image by making a reservation for Two-dimensional background image forms with the predetermined foreground image of current user action can be followed to merge.Predetermined foreground image is worked as according to described The action message of personage area image of the preceding user in scene image renders to obtain.Image processing method includes:
02:Judge whether the change in location of two frame personage's area images corresponding to two continuous frames merging image is more than predetermined threshold Value, two continuous frames, which merge image, includes former frame merging image and present frame merging image;With
04:When change in location is more than predetermined threshold, image or predetermined two-dimensional background image are merged as ought using former frame Previous frame merges image.
Also referring to Fig. 2 to 3, the image processing method of embodiment of the present invention can be by the figure of embodiment of the present invention As processing unit 100 is realized.The image processing apparatus 100 of embodiment of the present invention, which is used to handle, merges image.Merge image by Predetermined two-dimensional background image forms with the predetermined foreground image of current user action can be followed to merge.Predetermined foreground image is according to institute The action message for stating personage area image of the active user in scene image renders to obtain.Image processing apparatus 100 includes place Manage device 20.Step 02 and step 04 can be realized by processor 20.
In other words, processor 20 can be used for the position for judging that two continuous frames merge two frame personage's area images corresponding to image Put whether change is more than predetermined threshold, two continuous frames, which merge image, includes former frame merging image and present frame merging image, with And when change in location is more than predetermined threshold, image or predetermined two-dimensional background image are merged using former frame and merge figure as present frame Picture.
In some embodiments, predetermined foreground image includes two dimension and/or three-dimensional predetermined foreground image.Predetermined prospect Image includes at least one of virtual portrait, real person, animals and plants, and real person eliminates active user itself.Wherein, Virtual portrait can be animated character, such as Mario, Conan, major part son, RNB etc.;Real person can be famous Personage, such as Hepburn Audery, handou sir, Harry Potter etc., animals and plants can be the animal or plants of animation, such as rice is old Mouse, Donald duck, pea shooter etc..
Predetermined foreground image can follow the action message for imitating active user.Wherein, action message includes active user's At least one of expression and limb action.In other words, current action information can only include the expression or limb of active user Body acts, and can also include both expression and limb action of active user simultaneously.
In some embodiments, predetermined two-dimensional background image can be randomly selected or selected by active user.
The image processing apparatus 100 of embodiment of the present invention can apply to the electronic installation of embodiment of the present invention 1000.In other words, the electronic installation 1000 of embodiment of the present invention includes the image processing apparatus of embodiment of the present invention 100。
In some embodiments, electronic installation 1000 includes mobile phone, tablet personal computer, notebook computer, Intelligent bracelet, intelligence Energy wrist-watch, intelligent helmet, intelligent glasses etc..
Image processing method, image processing apparatus 100 and the electronic installation 1000 of embodiment of the present invention render in processing Predetermined foreground image afterwards is with predetermined two-dimensional background image when merging image, by related to the predetermined foreground image of two continuous frames The change in location in the corresponding two continuous frames character image region of connection judges the degree of stability of portrait, and with stably when unstable Merging image substituted so that merge image in all processes and remain stable, so as to improve the usage experience of user.
Referring to Fig. 4, in some embodiments, the image processing method of embodiment of the present invention also includes:
011:With the scene image of predeterminated frequency collection multiframe active user;
012:With the depth image of predeterminated frequency collection multiframe active user;
013:Every frame scene image and every frame depth image are handled to extract the action message of active user;
014:Predetermined foreground image is rendered according to action message so as to follow moving for active user per the predetermined foreground image of frame Make;With
015:Predetermined foreground image and predetermined two-dimensional background image co-registration after every frame is rendered obtain multiframe and merge image With output video image.
Referring again to Fig. 3, image processing apparatus 100 also includes visible image capturing first 11 and depth image acquisition component 12. Step 011 can realize that step 012 can be realized by depth image acquisition component 12 by visible image capturing first 11, step 013, Step 014 and step 015 can be realized by processor 20.
In other words, it is seen that light video camera head 11 can be used for the scene image that multiframe active user is gathered with predeterminated frequency;It is deep Spend the depth image that image collection assembly 12 can be used for gathering multiframe active user with predeterminated frequency;Processor 20 can be used for handling Per frame scene image and per frame depth image to extract the action message of active user, predetermined foreground picture is rendered according to action message As so as to follow the action of active user per the predetermined foreground image of frame, and predetermined foreground image after every frame is rendered and predetermined Two-dimensional background image co-registration obtains multiframe and merges image with output video image.
Wherein, predeterminated frequency refers to that visible image capturing first 11 and depth image acquisition component 12 gather image each second Frame per second, the value of frame per second can be each second 30 frame, frame each second 60, frame each second 120 etc..Frame per second is higher, and video image is got over It is smooth.The scene image of first 11 collection of visible image capturing is gray level image or coloured image, and depth image acquisition component 12 gathers Depth image characterize each personal or object depth information in the scene comprising active user.In the specific embodiment of the present invention In, it is seen that light video camera head 11 and depth image acquisition component 12 should use same predeterminated frequency to carry out IMAQ, in this way, multiframe Scene image corresponds with multiframe depth image, then processor 20 obtains after handling every frame scene image and corresponding depth image To action message can render predetermined foreground image corresponding to a frame, consequently facilitating to the predetermined foreground image of every frame in step 015 With the fusion treatment of predetermined two-dimensional background image.In addition, the scene domain of scene image is consistent with the scene domain of depth image, And each pixel in scene image can be found in depth image to should pixel depth information.
The predetermined foreground image of every frame and corresponding predetermined two-dimensional background after it will be rendered by the action message of active user During image co-registration, if acutely rocking so that failing to extract user's in a certain frame scene image due to electronic installation 1000 Portrait, the then predetermined foreground image that processor 20 can not be according to the action message of the active user of the frame scene image to corresponding frame Rendered, so as to influence the fusion of the predetermined two-dimensional background image of the predetermined foreground image of the frame and corresponding frame.And former frame scene Image can extract the action message of active user, therefore the predetermined foreground image of former frame can be rendered, and be closed And image.Shown in this way, the merging image of former frame can be used to merge image as present frame.Certainly, also can be direct Predetermined two-dimensional background image is shown, so as to avoid picture from acutely shaking and become the poor usage experience given user and brought.
Referring to Fig. 5, in some embodiments, step 012 gathers the depth map of multiframe active user with predeterminated frequency As including:
0121:To active user's projective structure light;
0122:The structure light image modulated with predeterminated frequency shooting multiframe through active user;With
0123:Demodulate per phase information corresponding to each pixel of frame structure light image to obtain multiframe depth image.
Referring again to Fig. 2, in some embodiments, depth image acquisition component 12 includes the He of structured light projector 121 Structure light video camera head 122.Step 0121 can be realized by structured light projector 121.Step 0122 and step 0123 can be by Structure light video camera head 122 is realized.
In other words, structured light projector 121 can be used for active user's projective structure light;Structure light video camera head 122 can For the structure light image modulated with predeterminated frequency shooting multiframe through active user, and demodulation is per each of frame structure light image Phase information corresponding to pixel is to obtain multiframe depth image.
Specifically, structured light projector 121 is by the face and body of the project structured light of certain pattern to active user Afterwards, the structure light image after being modulated by active user can be formed in the face of active user and the surface of body.Structure light images First 122 structure light image with preset frame rate shooting multiframe after modulated, then each frame structure light image is demodulated to obtain To depth image corresponding with the frame structure light image, in this way, can obtain multiframe after being demodulated to multiframe structure light image Depth image.Wherein, the pattern of structure light can be laser stripe, Gray code, sine streak, non-homogeneous speckle etc..
Referring to Fig. 6, in some embodiments, step 0123 is demodulated corresponding to each pixel of every frame structure light image Phase information is included with obtaining multiframe depth image:
01231:Phase information corresponding to each pixel in the every frame structure light image of demodulation;
01232:Phase information is converted into depth information;With
01233:Depth image is generated according to depth information.
Referring again to Fig. 3, in some embodiments, step 01231, step 01232 and step 01233 can be by tying Structure light video camera head 122 is realized.
In other words, it is corresponding can be further used for demodulating each pixel in every frame structure light image for structure light video camera head 122 Phase information, phase information is converted into depth information, and depth image is generated according to depth information.
Specifically, compared with non-modulated structure light, the phase information of the structure light after modulation is changed, and is being tied The structure light showed in structure light image is to generate the structure light after distortion, wherein, the phase information of change can characterize The depth information of object.Therefore, structure light video camera head 122 demodulates phase corresponding to each pixel in every frame structure light image first Position information, calculates depth information, so as to obtain depth image corresponding with the frame structure light image further according to phase information.
In order that those skilled in the art be more apparent from according to structure light come gather active user face and The process of the depth image of body, illustrated below by taking a kind of widely used optical grating projection technology (fringe projection technology) as an example Its concrete principle.Wherein, optical grating projection technology belongs to sensu lato area-structure light.
As shown in Fig. 7 (a), when being projected using area-structure light, sine streak is produced by computer programming first, And sine streak is projected to measured object by structured light projector 121, recycle structure light video camera head 122 to shoot striped by thing Degree of crook after body modulation, then demodulates the curved stripes and obtains phase, then phase is converted into depth information to obtain Depth image.The problem of to avoid producing error or error coupler, needed before carrying out depth information collection using structure light to depth Image collection assembly 12 carries out parameter calibration, and demarcation includes geometric parameter (for example, structure light video camera head 122 and project structured light Relative position parameter between device 121 etc.) demarcation, the inner parameter and structured light projector 121 of structure light video camera head 122 The demarcation of inner parameter etc..
Specifically, the first step, computer programming produce sine streak.Need to obtain using the striped of distortion due to follow-up Phase, for example phase is obtained using four step phase-shifting methods, therefore the striped that four width phase differences are pi/2, then structure light are produced here The projector 121 projects the four spokes line timesharing on measured object (mask shown in Fig. 7 (a)), and structure light video camera head 122 gathers To the figure on such as Fig. 7 (b) left sides, while to read the striped of the plane of reference shown on the right of Fig. 7 (b).
Second step, carry out phase recovery.The bar graph that structure light video camera head 122 is modulated according to four width collected is (i.e. Structure light image) to calculate the phase diagram by phase modulation, now obtained be to block phase diagram.Because four step Phase-shifting algorithms obtain Result be that gained is calculated by arctan function, therefore the phase after structure light modulation is limited between [- π, π], that is, Say, the phase after modulation exceedes [- π, π], and it can restart again.Shown in the phase main value such as Fig. 7 (c) finally given.
Wherein, it is necessary to carry out the saltus step processing that disappears, it is continuous phase that will block phase recovery during phase recovery is carried out Position.As shown in Fig. 7 (d), the left side is the continuous phase bitmap modulated, and the right is to refer to continuous phase bitmap.
3rd step, subtract each other to obtain phase difference (i.e. phase information) by the continuous phase modulated and with reference to continuous phase, should Phase difference characterizes depth information of the measured object with respect to the plane of reference, then phase difference is substituted into the conversion formula (public affairs of phase and depth The parameter being related in formula is by demarcation), you can obtain the threedimensional model of the object under test as shown in Fig. 7 (e).
It should be appreciated that in actual applications, according to the difference of concrete application scene, employed in the embodiment of the present invention Structure light in addition to above-mentioned grating, can also be other arbitrary graphic patterns.
As a kind of possible implementation, the depth information of pattern light progress active user also can be used in the present invention Collection.
Specifically, the method that pattern light obtains depth information is that this spreads out using a diffraction element for being essentially flat board The relief diffraction structure that there are element particular phases to be distributed is penetrated, cross section is with two or more concavo-convex step embossment knots Structure.Substantially 1 micron of the thickness of substrate in diffraction element, each step it is highly non-uniform, the span of height can be 0.7 Micron~0.9 micron.Structure shown in Fig. 8 (a) is the local diffraction structure of the collimation beam splitting element of the present embodiment.Fig. 8 (b) is edge The unit of the cross sectional side view of section A-A, abscissa and ordinate is micron.The speckle pattern of pattern photogenerated has The randomness of height, and can with the difference of distance changing patterns.Therefore, depth information is being obtained using pattern light Before, it is necessary first to the speckle pattern in space is calibrated, for example, in the range of 0~4 meter of distance structure light video camera head 122, A reference planes are taken every 1 centimetre, then just save 400 width speckle images after demarcating, the spacing of demarcation is smaller, obtains Depth information precision it is higher.Then, structured light projector 121 is by pattern light projection to measured object (i.e. active user) On, the speckle pattern that the difference in height on measured object surface to project the pattern light on measured object changes.Structure light Camera 122 is shot project speckle pattern (i.e. structure light image) on measured object after, then by speckle pattern and demarcation early stage The 400 width speckle images preserved afterwards carry out computing cross-correlation one by one, and then obtain 400 width correlation chart pictures.Measured object in space Position where body can show peak value on correlation chart picture, above-mentioned peak value is superimposed and after interpolation arithmetic i.e. It can obtain the depth information of measured object.
Multi beam diffraction light is obtained after diffraction is carried out to light beam due to common diffraction element, but per beam diffraction light light intensity difference Greatly, it is also big to the risk of human eye injury.Re-diffraction even is carried out to diffraction light, the uniformity of obtained light beam is relatively low. Therefore, the effect projected using the light beam of common diffraction element diffraction to measured object is poor.Using collimation in the present embodiment Beam splitting element, the element not only have the function that to collimate uncollimated rays, also have the function that light splitting, i.e., through speculum The non-collimated light of reflection is emitted multi-beam collimation light beam, and the multi-beam collimation being emitted after collimating beam splitting element toward different angles The area of section approximately equal of light beam, flux of energy approximately equal, and then to carry out using the scatterplot light after the beam diffraction The effect of projection is more preferable.Meanwhile laser emitting light is dispersed to every light beam, the risk of injury human eye is reduce further, and dissipate Spot structure light is for other uniform structure lights of arrangement, when reaching same collection effect, the consumption of pattern light Electricity is lower.
Referring to Fig. 9, in some embodiments, step 013 handles every frame scene image and every frame depth image to carry Taking the action message of active user includes:
0131:Identification is per the human face region in frame scene image;
0132:Depth information corresponding with human face region is obtained from depth image corresponding with scene image;
0133:The depth bounds of people's object area is determined according to the depth information of human face region;
0134:The personage area for determining to be connected and fallen into depth bounds with human face region according to the depth bounds of people's object area Domain is to obtain personage's area image;With
0137:Personage's area image is handled to obtain the action message of active user.
Referring again to Fig. 3, in some embodiments, step 0131, step 0132, step 0133, step 0134 and step Rapid 0137 can be realized by processor 20.
In other words, processor 20 can be further used for identifying the human face region in every frame scene image, from scene graph Depth information corresponding with human face region is obtained in the depth image as corresponding to, personage is determined according to the depth information of human face region The depth bounds in region, the personage for determining to be connected and fallen into depth bounds with human face region according to the depth bounds of people's object area Region is to obtain personage's area image, and processing personage's area image is to obtain the action message of active user.
Specifically, the face area that the deep learning Model Identification trained can be used to go out in every frame scene image first Domain, face in each frame scene image then can determine that according to each frame scene image and each one-to-one relation of frame depth image The depth information in region.It is therefore, each in human face region because human face region includes the features such as nose, eyes, ear, lip Individual feature depth data corresponding in depth image is different, for example, in face face depth image acquisition component 12 When, in the depth image that depth image acquisition component 12 is shot, depth data corresponding to nose may be smaller, and ear is corresponding Depth data may be larger.Therefore, the depth information of above-mentioned human face region may be a numerical value or a numerical value model Enclose.Wherein, when the depth information of human face region is a numerical value, the numerical value can be by making even to the depth data of human face region It is worth to;Or can be by being worth in being taken to the depth data of human face region.
Because people's object area includes human face region, in other words, people's object area is in some depth together with human face region In the range of, therefore, after processor 20 determines the depth information of human face region, it can be set according to the depth information of human face region The depth bounds of people's object area, the depth bounds extraction further according to people's object area fall into the depth bounds and with human face region phase People's object area of connection, so as to obtain personage's area image.
After processor 20 calculates personage's area image, personage's area image can be handled.Specifically, processor 20 The human face region in personage's area image can be identified first, so as to carry out Expression Recognition to human face region again;Or processor The human face region obtained in 20 direct processing steps 0131 is to identify the expression of active user.Then, processor 20 is to every frame Personage's area image in scene image is handled to obtain the information of active user's limb action.Wherein, active user's limb The information of body action can be obtained by way of template matches.Processor 20 by people's object area in personage's area image with Multiple personage's templates are matched.The head of people's object area is matched first;After the completion of being matched on head, then to fit heads Remaining multiple personage's templates carry out the matching of the matching, i.e. upper part of the body trunk of next limbs;Match and complete in upper part of the body trunk Afterwards, then to head and upper part of the body trunk the remaining multiple personage's templates to match carry out the matching of next limbs, i.e. upper limbs The matching of body and lower limb body, so as to determine the information of active user's limb action according to the method for template matches.Then, processor The expression and limb action of 20 active users that will identify that again renders to predetermined foreground image, makes in predetermined foreground image Personage or animals and plants can follow imitate active user expression and limb action.Finally, it is pre- after processor 20 will render Foreground image is determined with predetermined two-dimensional background image co-registration to obtain merging image.
In this way, the predetermined foreground image that can follow the expression for imitating active user and limb action can be obtained.Due to Personage's area image is split according to depth information from every frame scene image, and the acquisition of depth information is not by environment The image of the factors such as middle illumination, colour temperature rings, and therefore, the personage's area image extracted is more accurate, then processor 20 handles people The expression and limb action for the active user that object area image obtains are also more accurate, so as to which it is more accurate that processor 20 can be used Action message predetermined foreground image is rendered preferably to be followed imitation effect.
Referring to Fig. 10, in some embodiments, step 013 handles every frame scene image and every frame depth image to carry Taking the action message of active user also includes:
0135:Handle per frame scene image to obtain the whole audience edge image of every frame scene image;With
0136:According to every frame whole audience edge image amendment personage's area image corresponding with the frame whole audience edge image.
Step 0137 processing personage's area image is included with obtaining the action message of active user:
01371:Revised personage's area image is handled to obtain the action message of active user.
Referring again to Fig. 2, in some embodiments, step 0135, step 0136 and step 01371 can be by handling Device 20 is realized.
In other words, processor 20 can also be used to handle every frame scene image to obtain the whole audience edge of every frame scene image Image, repaiied according to every frame whole audience edge image amendment personage's area image corresponding with the frame whole audience edge image, and processing Personage's area image after just is to obtain the action message of active user.
Processor 20 carries out edge extracting to obtain multiframe whole audience edge image to every frame scene image first, wherein, entirely Edge lines in field edge image include the edge lines of background object in scene residing for active user and active user.Tool Body, edge extracting can be carried out to every frame scene image by Canny operators.Canny operators carry out the algorithm of edge extracting Core mainly includes the following steps:First, convolution is carried out to scene image to eliminate noise with 2D gaussian filterings template;Then, The Grad of the gray scale of each pixel, and the gradient side of the gray scale according to each pixel of Grad calculating are obtained using differential operator To adjacent pixels of the respective pixel along gradient direction can be found by gradient direction;Then, each pixel is traveled through, if certain The gray value of individual pixel is not maximum compared with the gray value of former and later two adjacent pixels on its gradient direction, then thinks this Individual pixel is not marginal point.In this way, the pixel that marginal position is in scene image is can determine that, so as to obtain edge extracting Whole audience edge image afterwards.
The corresponding frame whole audience edge image of each frame scene image, similarly, the corresponding frame personage of each frame scene image Area image, therefore, whole audience edge image and personage's area image are one-to-one.Processor 20 obtains whole audience edge image Afterwards, it is modified according to whole audience edge image pair personage's area image corresponding with whole audience edge image.It is appreciated that personage area Domain be by be connected in scene image with human face region and fall into the depth bounds of setting all pixels carry out merger after obtain, In some scenarios, it is understood that there may be some objects for being connected and being fallen into depth bounds with human face region.Therefore, the whole audience can be used Edge graph is modified to personage's area image to obtain more accurate people's object area.
Further, processor 20 can also carry out second-order correction to revised people's object area, for example, can be to revised People's object area carries out expansion process, expands people's object area to retain the edge details of people's object area.In this way, processor 20 is handled The personage's area image arrived is more accurate.
After processor 20 obtains multiframe merging image, multiframe merges image sequence and arranges and store, and multiframe merges image can Video format is stored as by processor 20 and forms video image, when video image with certain frame per second electronic installation 1000 display When being shown on device 50 (shown in Figure 12), user is the video pictures that can watch smoothness.
Figure 11 is referred to, in some embodiments, the image processing method of embodiment of the present invention also includes:
05:When change in location is more than predetermined threshold, judge whether the duration of change in location is more than the scheduled time;With
06:When the duration being less than the scheduled time, within the duration, with the merging image of former frame or predetermined two dimension Background image merges image as present frame.
Referring again to Fig. 3, in some embodiments, step 05 and step 06 can be realized by processor 20.It that is to say Say, when processor 20 can be additionally used in change in location and be more than predetermined threshold, judge change in location duration whether be more than it is predetermined Time, and when the duration being less than the scheduled time, within the duration, with the merging image of former frame or the predetermined two dimension back of the body Scape image merges image as present frame.
In particular, it will be appreciated that when the change of personage's regional location in scene image is due to electronic installation 1000 It is unexpected that usual user can be adjusted to electronic installation 1000 in time when being produced such as shaking or fall, therefore when continuing Between generally it is shorter, set the scheduled time, can effectively judge whether the change of shooting angle is produced by user's true intention, when continue When time is less than the scheduled time, it is believed that this change is by surprisingly producing, and therefore, can use the stable merging figure of former frame The merging image of picture or predetermined two-dimensional background image within the duration as present frame, so as to keep the stabilization of picture.Clapping After taking the photograph angle adjustment time normal condition, it can be closed again through the predetermined foreground image of present frame with the generation of predetermined two-dimensional background image And image.
Referring again to Figure 11, in some embodiments, the image processing method of embodiment of the present invention also includes:
07:When the duration being more than the scheduled time, in the given time, image or the predetermined two dimension back of the body are merged with former frame Scape image merges image as present frame, after the scheduled time, with predetermined the two of the predetermined foreground image and present frame of present frame Dimension background image fusion merges image to form present frame.
Referring again to Fig. 3, in some embodiments, step 07 can be realized by processor 20.In other words, processor 20 can be additionally used in when the duration being more than the scheduled time, in the given time, merge image or the predetermined two dimension back of the body with former frame Scape image merges image as present frame, after the scheduled time, with predetermined the two of the predetermined foreground image and present frame of present frame Dimension background image fusion merges image to form present frame.
When the duration being more than the scheduled time, it is believed that the change of shooting angle is the true intention of user, pre- Image is merged as present frame using stable merging image or predetermined two-dimensional background image in fixing time, ensured to a certain extent Merge the continuity of image, after the scheduled time, then carried on the back with the predetermined two dimension of the predetermined foreground image and present frame of present frame Scape image co-registration merges image to form present frame, now, in the scene image for rendering the predetermined foreground image of the present frame Personage's area image may be included, it is also possible to not comprising someone's object area image.For rendering the predetermined prospect of the present frame When personage's area image is included in the scene image of image, the predetermined foreground picture of corresponding frame is rendered with frame personage's area image Picture, and the predetermined foreground image after rendering merges image with corresponding predetermined two-dimensional background image co-registration to form present frame. It is pre- directly with what is do not rendered when personage's area image is included in the scene image for rendering the predetermined foreground image of the present frame Determine foreground image and merge image with corresponding predetermined two-dimensional background image co-registration to form present frame, in this way, adding predetermined prospect The picture of the merging image of image is more abundant.
Also referring to Fig. 3 and 12, embodiment of the present invention also proposes a kind of electronic installation 1000.Electronic installation 1000 wraps Include image processing apparatus 100.Image processing apparatus 100 can utilize hardware and/or software to realize.Image processing apparatus 100 wraps Include imaging device 10 and processor 20.
Imaging device 10 includes visible image capturing first 11 and depth image acquisition component 12.
Specifically, it is seen that light video camera head 11 includes imaging sensor 111 and lens 112, it is seen that light video camera head 11 can be used for The colour information of active user is caught to obtain multiframe scene image, wherein, imaging sensor 111 includes color filter lens array (such as Bayer filter arrays), the number of lens 112 can be one or more.Visible image capturing first 11 is being obtained per frame scene graph As during, each imaging pixel in imaging sensor 111 senses luminous intensity and wavelength information in photographed scene, Generate one group of raw image data;Imaging sensor 111 sends this group of raw image data into processor 20, processor 20 The scene image of colour is obtained after the computings such as denoising, interpolation are carried out to raw image data.Processor 20 can be in various formats Each image pixel in raw image data is handled one by one, for example, each image pixel there can be 8,10,12 or 14 bits Bit depth, processor 20 can be handled each image pixel by identical or different bit depth.
Depth image acquisition component 12 includes structured light projector 121 and structure light video camera head 122, depth image collection group The depth information that part 12 can be used for catching active user is to obtain depth image.Structured light projector 121 is used to throw structure light Active user is incident upon, wherein, structured light patterns can be the speckle of laser stripe, Gray code, sine streak or random alignment Pattern etc..Structure light video camera head 122 includes imaging sensor 1221 and lens 1222, and the number of lens 1222 can be one or more It is individual.Imaging sensor 1221 is used for the multiframe structure light image that capturing structure light projector 121 is projected on active user.Per frame Structure light image can be sent by depth acquisition component 12 to processor 20 be demodulated, phase recovery, phase information calculate etc. Handle to obtain the depth information of active user.
In some embodiments, it is seen that the function of light video camera head 11 and structure light video camera head 122 can be by a camera Realize, in other words, imaging device 10 only includes a camera and a structured light projector 121, and above-mentioned camera is not only Structure light image can also be shot with photographed scene image.
Except using structure light obtain depth image in addition to, can also by binocular vision method, based on differential time of flight (Time Of Flight, TOF) even depth obtains the depth image of active user as acquisition methods.
In addition, image processing apparatus 100 also includes memory 30.Memory 30 can be embedded in electronic installation 1000, The memory that can be independently of outside electronic installation 1000, and may include direct memory access (DMA) (Direct Memory Access, DMA) feature.The knot that the raw image data or depth image acquisition component 12 of first 11 collection of visible image capturing gather Structure light image related data, which can transmit, to be stored or is cached into memory 30.Processor 20 can be read from memory 30 Raw image data also can read structure light image related data to enter to be handled to obtain scene image from memory 30 Row processing obtains depth image.In addition, scene image and depth image are also storable in memory 30, device 20 for processing with When calling handle, for example, processor 20 calls multiframe scene image and multiframe depth image to carry out the action message of active user Extraction, and the predetermined foreground image after being rendered via action message and corresponding predetermined two-dimensional background image progress fusion treatment Merge image to obtain multiframe, multiframe merges image sequence arrangement or storage forms video image.Wherein, predetermined foreground image, Predetermined two-dimensional background image, merging image, video image may be alternatively stored in memory 30.
Image processing apparatus 100 may also include display 50.Display 50 can obtain video figure directly from processor 20 Picture, also it can obtain video image from memory 30.Display 50 shows that video image is watched for user, or is drawn by figure Hold up or graphics processor (Graphics Processing Unit, GPU) is further processed.Image processing apparatus 100 Also include encoder/decoder 60, encoder/decoder 60 can encoding and decoding scene image, depth image, predetermined foreground image, Predetermined two-dimensional background image, the view data for merging image, video image etc., the view data of coding can be stored in memory In 30, and it can be shown before image is shown on display 50 by decoder decompresses.Encoder/decoder 60 It can be realized by central processing unit (Central Processing Unit, CPU), GPU or coprocessor.In other words, encoder/ Decoder 60 can be any in central processing unit (Central Processing Unit, CPU), GPU and coprocessor It is one or more.
Image processing apparatus 100 also includes control logic device 40.Imaging device 10 imaging when, processor 20 can according into As the data that equipment obtains are analyzed to determine one or more control parameters of imaging device 10 (for example, time for exposure etc.) Image statistics.Processor 20 sends image statistics to control logic device 40, the control imaging of control logic device 40 Equipment 10 is imaged with the control parameter determined.Control logic device 40 may include to perform one or more routines (such as firmware) Processor and/or microcontroller.One or more routines can determine imaging device 10 according to the image statistics of reception Control parameter.
Figure 13 is referred to, the electronic installation 1000 of embodiment of the present invention includes one or more processors 20, memory 30 and one or more programs 31.Wherein one or more programs 31 are stored in memory 30, and are configured to by one Individual or multiple processors 20 perform.Program 31 includes being used to perform the finger of the image processing method of above-mentioned any one embodiment Order.
For example, program 31 includes being used for the instruction for performing the image processing method described in following steps:
02:Judge whether the change in location of two frame personage's area images corresponding to two continuous frames merging image is more than predetermined threshold Value, two continuous frames, which merge image, includes former frame merging image and present frame merging image;With
04:When change in location is more than predetermined threshold, image or predetermined two-dimensional background image are merged as ought using former frame Previous frame merges image.
For another example program 31 also includes being used for the instruction for performing the image processing method described in following steps:
0131:Identification is per the human face region in frame scene image;
0132:Depth information corresponding with human face region is obtained from depth image corresponding with scene image;
0133:The depth bounds of people's object area is determined according to the depth information of human face region;
0134:The personage area for determining to be connected and fallen into depth bounds with human face region according to the depth bounds of people's object area Domain is to obtain personage's area image;With
0137:Personage's area image is handled to obtain the action message of active user.
The computer-readable recording medium of embodiment of the present invention includes being combined with the electronic installation 1000 that can be imaged making Computer program.Computer program can be performed by processor 20 to complete the image procossing of above-mentioned any one embodiment Method.
02:Judge whether the change in location of two frame personage's area images corresponding to two continuous frames merging image is more than predetermined threshold Value, two continuous frames, which merge image, includes former frame merging image and present frame merging image;With
04:When change in location is more than predetermined threshold, image or predetermined two-dimensional background image are merged as ought using former frame Previous frame merges image.
For another example computer program can be also performed by processor 20 to complete the image processing method described in following steps:
0131:Identification is per the human face region in frame scene image;
0132:Depth information corresponding with human face region is obtained from depth image corresponding with scene image;
0133:The depth bounds of people's object area is determined according to the depth information of human face region;
0134:The personage area for determining to be connected and fallen into depth bounds with human face region according to the depth bounds of people's object area Domain is to obtain personage's area image;With
0137:Personage's area image is handled to obtain the action message of active user.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description Point is contained at least one embodiment or example of the present invention.In this manual, to the schematic representation of above-mentioned term not Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the invention, " multiple " are meant that at least two, such as two, three It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following:Electricity with one or more wiring Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage (ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware Any one of row technology or their combination are realized:With the logic gates for realizing logic function to data-signal Discrete logic, have suitable combinational logic gate circuit application specific integrated circuit, programmable gate array (PGA), scene Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above Embodiments of the invention are stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the present invention System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of the invention Type.

Claims (18)

1. a kind of image processing method, merge image for handling, the merging image by predetermined two-dimensional background image with can be with Formed with the predetermined foreground image fusion of current user action, the predetermined foreground image is according to the active user in scene graph The action message of personage's area image as in renders to obtain, it is characterised in that described image processing method includes:
It is predetermined to judge whether the change in location for merging personage's area image described in two frames corresponding to image described in two continuous frames is more than Threshold value, merging image described in the two continuous frames include former frame and merge image and present frame merging image;With
When the change in location is more than predetermined threshold, image is merged with the former frame or the predetermined two-dimensional background image is made Merge image for the present frame.
2. image processing method according to claim 1, it is characterised in that described image processing method also includes:
With the scene image of predeterminated frequency collection multiframe active user;
With the depth image of active user described in predeterminated frequency collection multiframe;
Scene image described in per frame and depth image described in per frame are handled to extract the action message of the active user;
The predetermined foreground image is rendered according to the action message so as to be followed per predetermined foreground image described in frame described current The action of user;With
The predetermined foreground image after every frame is rendered obtains multiframe with the predetermined two-dimensional background image co-registration and merges image With output video image.
3. image processing method according to claim 1, it is characterised in that described image processing method includes step:
When the change in location is more than predetermined threshold, judge whether the duration of the change in location is more than the scheduled time; With
When the duration being less than the scheduled time, within the duration, with the merging image of the former frame Or the predetermined two-dimensional background image merges image as present frame.
4. image processing method according to claim 3, it is characterised in that described image processing method also includes:
When the duration being more than the scheduled time, within the scheduled time, with the former frame merge image or The predetermined two-dimensional background image merges image as the present frame, after the scheduled time, with present frame it is predetermined before Scape image merges image with the predetermined two-dimensional background image co-registration of present frame to form the present frame.
5. image processing method according to claim 2, it is characterised in that described with predeterminated frequency collection multiframe institute The step of depth image for stating active user, includes:
To active user's projective structure light;
The structure light image modulated with predeterminated frequency shooting multiframe through the active user;With
Phase information corresponding to each pixel of structure light image described in per frame is demodulated to obtain depth image described in multiframe.
6. image processing method according to claim 5, it is characterised in that demodulation structure light image described in per frame The step of phase information corresponding to each pixel is to obtain depth image described in multiframe includes:
Phase information corresponding to each pixel in demodulation structure light image described in per frame;
The phase information is converted into depth information;With
The depth image is generated according to the depth information.
7. image processing method according to claim 1, it is characterised in that the predetermined foreground image include two peacekeepings/ Or three-dimensional predetermined foreground image, the predetermined foreground image include at least one in virtual portrait, real person, animals and plants Kind, the real person eliminates the active user itself;
The predetermined two-dimensional background image can be randomly selected or selected by the active user.
8. image processing method according to claim 1, it is characterised in that the action message includes the active user Expression and at least one of limb action.
9. a kind of image processing apparatus, merge image for handling, the merging image by predetermined two-dimensional background image with can be with Formed with the predetermined foreground image fusion of current user action, the predetermined foreground image is according to the active user in scene graph The action message of personage's area image as in renders to obtain, it is characterised in that described image processing unit includes processor, institute Processor is stated to be used for:
It is predetermined to judge whether the change in location for merging personage's area image described in two frames corresponding to image described in two continuous frames is more than Threshold value, merging image described in the two continuous frames include former frame and merge image and present frame merging image;With
When the change in location is more than predetermined threshold, image is merged with the former frame or the predetermined two-dimensional background image is made Merge image for the present frame.
10. image processing apparatus according to claim 9, it is characterised in that described image processing unit also includes:
Visible image capturing head, the visible image capturing head are used for the scene image that multiframe active user is gathered with predeterminated frequency;
Depth image acquisition component, the depth image acquisition component are used for currently to be used described in predeterminated frequency collection multiframe The depth image at family;
The processor is additionally operable to:
Scene image described in per frame and depth image described in per frame are handled to extract the action message of the active user;
The predetermined foreground image is rendered according to the action message so as to be followed per predetermined foreground image described in frame described current The action of user;With
The predetermined foreground image after every frame is rendered obtains multiframe with the predetermined two-dimensional background image co-registration and merges image With output video image.
11. image processing apparatus according to claim 9, it is characterised in that the processor is additionally operable to:
When the change in location is more than predetermined threshold, judge whether the duration of the change in location is more than the scheduled time; With
When the duration being less than the scheduled time, within the duration, with the merging image of the former frame Or the predetermined two-dimensional background image merges image as present frame.
12. image processing apparatus according to claim 11, it is characterised in that the processor is additionally operable to:
When the duration being more than the scheduled time, within the scheduled time, with the former frame merge image or The predetermined two-dimensional background image merges image as the present frame, after the scheduled time, with present frame it is predetermined before Scape image merges image with the predetermined two-dimensional background image co-registration of present frame to form the present frame.
13. image processing apparatus according to claim 10, it is characterised in that the depth image acquisition component includes knot Structure light projector and structure light video camera head, the structured light projector are used for active user's projective structure light;
The structure light video camera head is used for:
The structure light image modulated with predeterminated frequency shooting multiframe through the active user;With
Phase information corresponding to each pixel of structure light image described in per frame is demodulated to obtain depth image described in multiframe.
14. image processing apparatus according to claim 13, it is characterised in that institute's structure light video camera head is additionally operable to:
Phase information corresponding to each pixel in demodulation structure light image described in per frame;
The phase information is converted into depth information;With
The depth image is generated according to the depth information.
15. image processing apparatus according to claim 9, it is characterised in that the predetermined foreground image include two peacekeepings/ Or three-dimensional predetermined foreground image, the predetermined foreground image include at least one in virtual portrait, real person, animals and plants Kind, the real person eliminates the active user itself;
The predetermined two-dimensional background image can be randomly selected or selected by the active user.
16. image processing apparatus according to claim 9, it is characterised in that the action message includes the current use At least one of the expression at family and limb action.
17. a kind of electronic installation, it is characterised in that the electronic installation includes:
One or more processors;
Memory;With
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by One or more of computing devices, described program include being used at the image that perform claim is required described in 1 to 8 any one The instruction of reason method.
A kind of 18. computer-readable recording medium, it is characterised in that the meter being used in combination including the electronic installation with that can image Calculation machine program, the computer program can be executed by processor to complete the image procossing described in claim 1 to 8 any one Method.
CN201710813698.2A 2017-09-11 2017-09-11 Image processing method and apparatus, electronic apparatus, and computer-readable storage medium Active CN107454336B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710813698.2A CN107454336B (en) 2017-09-11 2017-09-11 Image processing method and apparatus, electronic apparatus, and computer-readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710813698.2A CN107454336B (en) 2017-09-11 2017-09-11 Image processing method and apparatus, electronic apparatus, and computer-readable storage medium

Publications (2)

Publication Number Publication Date
CN107454336A true CN107454336A (en) 2017-12-08
CN107454336B CN107454336B (en) 2021-04-30

Family

ID=60495298

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710813698.2A Active CN107454336B (en) 2017-09-11 2017-09-11 Image processing method and apparatus, electronic apparatus, and computer-readable storage medium

Country Status (1)

Country Link
CN (1) CN107454336B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108765531A (en) * 2018-03-27 2018-11-06 广东欧珀移动通信有限公司 Image rendering method, device, storage medium and intelligent terminal
CN109118507A (en) * 2018-08-27 2019-01-01 明超 Shell bears air pressure real-time alarm system
CN111902859A (en) * 2018-03-29 2020-11-06 索尼公司 Information processing apparatus, information processing method, and program
CN114722230A (en) * 2022-03-30 2022-07-08 蔡戴朋 Auxiliary judgment system using angle big data matching

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101309389A (en) * 2008-06-19 2008-11-19 深圳华为通信技术有限公司 Method, apparatus and terminal synthesizing visual images
CN101452582A (en) * 2008-12-18 2009-06-10 北京中星微电子有限公司 Method and device for implementing three-dimensional video specific action
US7564476B1 (en) * 2005-05-13 2009-07-21 Avaya Inc. Prevent video calls based on appearance
CN102656542A (en) * 2009-12-17 2012-09-05 微软公司 Camera navigation for presentations

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7564476B1 (en) * 2005-05-13 2009-07-21 Avaya Inc. Prevent video calls based on appearance
CN101309389A (en) * 2008-06-19 2008-11-19 深圳华为通信技术有限公司 Method, apparatus and terminal synthesizing visual images
CN101452582A (en) * 2008-12-18 2009-06-10 北京中星微电子有限公司 Method and device for implementing three-dimensional video specific action
CN102656542A (en) * 2009-12-17 2012-09-05 微软公司 Camera navigation for presentations

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108765531A (en) * 2018-03-27 2018-11-06 广东欧珀移动通信有限公司 Image rendering method, device, storage medium and intelligent terminal
CN111902859A (en) * 2018-03-29 2020-11-06 索尼公司 Information processing apparatus, information processing method, and program
CN111902859B (en) * 2018-03-29 2024-01-12 索尼公司 Information processing device, information processing method, and program
CN109118507A (en) * 2018-08-27 2019-01-01 明超 Shell bears air pressure real-time alarm system
CN109118507B (en) * 2018-08-27 2019-09-13 嵊州市万睿科技有限公司 Shell bears air pressure real-time alarm system
CN114722230A (en) * 2022-03-30 2022-07-08 蔡戴朋 Auxiliary judgment system using angle big data matching
CN114722230B (en) * 2022-03-30 2022-10-18 西安西科软件技术有限公司 Auxiliary judgment system using angle big data matching

Also Published As

Publication number Publication date
CN107454336B (en) 2021-04-30

Similar Documents

Publication Publication Date Title
CN107610077A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107707835A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107509045A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107734267A (en) Image processing method and device
CN107797664A (en) Content display method, device and electronic installation
CN107707831A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107734264A (en) Image processing method and device
CN107707838A (en) Image processing method and device
CN107590793A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107610078A (en) Image processing method and device
CN107454336A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107527335A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107644440A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107705278A (en) The adding method and terminal device of dynamic effect
CN107509043A (en) Image processing method and device
CN107705277A (en) Image processing method and device
CN107705243A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107613223A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107730509A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107613228A (en) The adding method and terminal device of virtual dress ornament
CN107610076A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107592491A (en) Video communication background display methods and device
CN107682656A (en) Background image processing method, electronic equipment and computer-readable recording medium
CN107734265A (en) Image processing method and device, electronic installation and computer-readable recording medium
CN107622495A (en) Image processing method and device, electronic installation and computer-readable recording medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant after: OPPO Guangdong Mobile Communications Co., Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Applicant before: Guangdong OPPO Mobile Communications Co., Ltd.

GR01 Patent grant
GR01 Patent grant