CN108629296A - Image processing method and device - Google Patents
Image processing method and device Download PDFInfo
- Publication number
- CN108629296A CN108629296A CN201810341632.2A CN201810341632A CN108629296A CN 108629296 A CN108629296 A CN 108629296A CN 201810341632 A CN201810341632 A CN 201810341632A CN 108629296 A CN108629296 A CN 108629296A
- Authority
- CN
- China
- Prior art keywords
- image frame
- video image
- human face
- rendering
- image rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 18
- 238000009877 rendering Methods 0.000 claims abstract description 149
- 238000012545 processing Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 14
- 230000005540 biological transmission Effects 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 3
- 230000010354 integration Effects 0.000 claims 2
- 238000012423 maintenance Methods 0.000 abstract description 7
- 230000000694 effects Effects 0.000 description 24
- 230000018109 developmental process Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 7
- 230000009471 action Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 210000004709 eyebrow Anatomy 0.000 description 3
- 238000004040 coloring Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000000686 essence Substances 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Processing (AREA)
Abstract
A kind of image processing method of the application offer and device are applied to Web client, including：In the image rendering request for receiving user, the video image frame that camera takes is obtained；Described image render request includes image rendering scheme；The video image frame includes human face region；The video image frame and described image rendering scheme are sent to server-side, so that the server-side is obtained in the video image frame based on preset Face datection algorithm after the human face characteristic point of human face region, image rendering is carried out to the video image frame based on the human face characteristic point and described image rendering scheme, and the video image frame after image rendering is returned into the Web client；In the video image frame after receiving the image rendering that the server-side returns, the video image frame after described image is rendered shows user.Technical scheme can promote user experience, and reduce the cost of software development and maintenance.
Description
Technical field
This application involves technical field of image processing more particularly to a kind of image processing methods and device.
Background technology
In present daily life, user can utilize certain image processing softwares, to oneself or other people face's photograph
Piece carries out virtual makeups and shows makeups effect, or can also select the virtual makeups effect of real-time exhibition.In this way, user is not necessarily to
Actual makeups operation is carried out, can also check certain makeups effect, reference is provided for the makeups selection of user.But in general, this
A little image processing softwares are required for user first voluntarily to download and on the terminal devices such as mobile phone, PC, can just be set in terminal
Standby upper using these softwares, user's operation is complex, influences user experience.On the other hand, since the terminal of different model is set
Standby used system may be different, therefore technical staff needs to carry out software development for different systems, technical staff's
Workload is larger, and the cost of software development and maintenance is higher.
Invention content
In view of this, the application provides a kind of image processing method and device, with solve user experience in relevant technologies compared with
Difference, software development and the higher problem of maintenance cost.
Specifically, the application is achieved by the following technical solution：
In a first aspect, the application provides a kind of image processing method, the method is applied to Web client, including：
In the image rendering request for receiving user, the video image frame that camera takes is obtained；Described image wash with watercolours
Dye request includes image rendering scheme；The video image frame includes human face region；
The video image frame and described image rendering scheme are sent to server-side, so that the server-side is based on pre-
If Face datection algorithm obtain in the video image frame after the human face characteristic point of human face region, be based on the human face characteristic point
And described image rendering scheme carries out image rendering to the video image frame, and the video image frame after image rendering is returned
Back to the Web client；
In the video image frame after receiving the image rendering that the server-side returns, regarding after described image is rendered
Frequency picture frame shows user.
Second aspect, the application provide a kind of image processing method, and the method is applied to server-side, including：
When receiving the video image frame and image rendering scheme of Web client transmission, it is based on preset Face datection
Algorithm carries out Face datection to the video image frame, to obtain the human face characteristic point of human face region in the video image frame；
Image rendering is carried out to the video image frame based on the human face characteristic point and described image rendering scheme；
Video image frame after image rendering is returned into the Web client, so that the Web client is by the figure
As the video image frame after rendering shows user.
The third aspect, the application provide a kind of image processing apparatus, and described device is applied to Web client, including：
Acquiring unit, in the image rendering request for receiving user, obtaining the video image that camera takes
Frame；Described image render request includes image rendering scheme；The video image frame includes human face region；
Transmission unit, for the video image frame and described image rendering scheme to be sent to server-side, so that described
Server-side is obtained in the video image frame based on preset Face datection algorithm after the human face characteristic point of human face region, is based on
The human face characteristic point and described image rendering scheme carry out image rendering to the video image frame, and will be after image rendering
Video image frame return to the Web client；
Display unit will be described in the video image frame after receiving the image rendering that the server-side returns
Video image frame after image rendering shows user.
Fourth aspect, the application provide a kind of image processing apparatus, and described device is applied to server-side, including：
Detection unit, for when receiving the video image frame and image rendering scheme of Web client transmission, being based on pre-
If Face datection algorithm to the video image frame carry out Face datection, to obtain human face region in the video image frame
Human face characteristic point；
Rendering unit, for based on the human face characteristic point and described image rendering scheme to the video image frame into
Row image rendering；
Returning unit, for the video image frame after image rendering to be returned to the Web client, so that the Web
Video image frame after client renders described image shows user.
Above-mentioned technical proposal is analyzed it is found that in technical scheme, user can directly be realized by Web client
Rendering to photo or video, such as：Virtual makeups are carried out to photo and show makeups effect or the virtual makeups of real-time exhibition
Effect etc..In this manner, user is without voluntarily downloading installation image processing software, it is only necessary to input Web by browser
The network address of client simplifies user's operation, the user experience is improved to enter Web client.On the other hand, due to
Web client can be adapted to a variety of different systems, you can with the terminal device applied to a variety of different models, technical staff exists
When carrying out software development, without carrying out software development for different systems, reduces the workload of technical staff, reduce soft
The cost of part development and maintenance.
Description of the drawings
Fig. 1 is a kind of flow chart of image processing method shown in one exemplary embodiment of the application；
Fig. 2 is the flow chart of another image processing method shown in one exemplary embodiment of the application；
Fig. 3 is the position view of a kind of human face region and its human face characteristic point；
Fig. 4 is a kind of hardware structure diagram of image processing apparatus place equipment shown in one exemplary embodiment of the application；
Fig. 5 is the hardware configuration of another image processing apparatus place equipment shown in one exemplary embodiment of the application
Figure；
Fig. 6 is a kind of block diagram of image processing apparatus shown in one exemplary embodiment of the application；
Fig. 7 is the block diagram of another image processing apparatus shown in one exemplary embodiment of the application.
Specific implementation mode
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to
When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with the application.On the contrary, they be only with it is such as appended
The example of consistent device and method of some aspects be described in detail in claims, the application.
It is the purpose only merely for description specific embodiment in term used in this application, is not intended to be limiting the application.
It is also intended to including majority in the application and "an" of singulative used in the attached claims, " described " and "the"
Form, unless context clearly shows that other meanings.It is also understood that term "and/or" used herein refers to and wraps
Containing one or more associated list items purposes, any or all may be combined.
It will be appreciated that though various information, but this may be described using term first, second, third, etc. in the application
A little information should not necessarily be limited by these terms.These terms are only used for same type of information being distinguished from each other out.For example, not departing from
In the case of the application range, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as
One information.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When " or " in response to determination ".
In the related technology, user can utilize certain image processing softwares, to oneself or other people facial photo progress void
Quasi- makeups simultaneously show makeups effect, or can also select the virtual makeups effect of real-time exhibition.In this way, user is practical without carrying out
Makeups operation, can also check certain makeups effect, for user makeups select reference is provided.But in general, at these images
Reason software is required for user first voluntarily to download and on the terminal devices such as mobile phone, PC, can just use on the terminal device
These softwares, user's operation is complex, influences user experience.
On the other hand, system used in the terminal device due to different model may be different, such as：Windows、
Linux, Android, iOS etc., therefore technical staff needs to carry out software development, the work of technical staff for different systems
Measure larger, the cost of software development and maintenance is higher.
To solve the above-mentioned problems, a kind of image processing method of the application offer and device, to promote user experience, and drop
The cost of low software development and maintenance.
Referring to FIG. 1, for a kind of flow chart of image processing method shown in one exemplary embodiment of the application.The image
Processing method can be applied in Web client, and Web client can be located in the terminal devices such as mobile phone, PC.The image procossing
Method may include steps of：
Step 101：In the image rendering request for receiving user, the video image frame that camera takes is obtained；Institute
It includes image rendering scheme to state image rendering request；The video image frame includes human face region.
Step 102：The video image frame and described image rendering scheme are sent to server-side, so that the server-side
It is obtained in the video image frame after the human face characteristic point of human face region based on preset Face datection algorithm, is based on the people
Face characteristic point and described image rendering scheme carry out image rendering to the video image frame, and by the video after image rendering
Picture frame returns to the Web client.
Step 103：In the video image frame after receiving the image rendering that the server-side returns, by described image wash with watercolours
Video image frame after dye shows user.
Correspondingly with embodiment shown in FIG. 1, referring to FIG. 2, for the another kind shown in one exemplary embodiment of the application
The flow chart of image processing method.The image processing method can be applied in server-side, and server-side can be located at server etc.
In equipment.The image processing method may include steps of：
Step 201：When receiving the video image frame and image rendering scheme of Web client transmission, based on preset
Face datection algorithm carries out Face datection to the video image frame, to obtain the face of human face region in the video image frame
Characteristic point.
Step 202：Figure is carried out to the video image frame based on the human face characteristic point and described image rendering scheme
As rendering.
Step 203：Video image frame after image rendering is returned into the Web client, so that the Web client
Video image frame after described image is rendered shows user.
In the present embodiment, user directly can enter Web client by terminal devices such as mobile phone, PCs.Tool
Body, user can open browser in terminal device, and then can input the network address of Web client and true in a browser
Recognize, to enter Web client.Due to having included usually browser in system used in terminal device, user is not necessarily to
It voluntarily downloads on the terminal device and browser is installed.
User can select to think image rendering scheme to be used, and click and be illustrated in Web after entering Web client
Image rendering button in the webpage of client.Web client, can after detecting the action that user clicks image rendering button
To be considered as the image rendering request for receiving user, and determine the image rendering scheme of user's selection.Subsequently, Web client can
To call camera in the terminal device where it to carry out video capture, and obtain that camera takes when shooting between on
Several continuous video image frames.In practical applications, Web client can be based on WebRTC (Web Real-Time
Communication, webpage real-time Communication for Power) technology, obtain that camera takes when shooting between several upper continuous videos
Picture frame.
It should be noted that the shooting direction of camera can be adjusted by user, or according to camera in terminal device
In position selection for shooting camera (such as：Front camera, rear camera etc.), so that camera is taken
Video image frame including human face region, even if Web client can get the regarding including human face region of camera shooting
Frequency picture frame.
Web client after getting the video image frame that camera takes, can by these video image frames and
The image rendering scheme of above-mentioned user's selection is sent to server-side, and the image rendering scheme is based on to these video figures by server-side
As frame carries out further image rendering.
In another example, user can first click the webpage for being illustrated in Web client after entering Web client
In shooting button.Web client can be considered as the bat for receiving user after detecting the action that user clicks shooting button
Request is taken the photograph, so as to call the camera in the terminal device where it to carry out video capture, and camera is obtained and takes
When shooting between several upper continuous video image frames.At this point, since user not yet selects to think image rendering side to be used
Case, therefore Web client is not necessarily to these video image frames being sent to server-side, and can be by these video image frames according to bat
It takes the photograph time sequencing and is integrated into video display to user, the video real-time exhibition that camera is taken is to user.
Subsequently, user can click the image rendering button being illustrated in the webpage of Web client.Web client is being examined
After measuring the action that user clicks image rendering button, the image rendering request for receiving user can be considered as, and determine user
The image rendering scheme of selection.At this point, Web client can be regarded what the camera got since current time took
Frequency picture frame and the image rendering scheme of user's selection are sent to server-side, and the image rendering scheme pair is based on by server-side
These video image frames carry out further image rendering.
In the present embodiment, server-side can be based on pre- first when receiving the video image frame of Web client transmission
If Face datection algorithm, to every width video image frame carry out Face datection, to obtain human face region in the video image frame
Human face characteristic point.Wherein, Face datection algorithm can be 68 Face datection algorithms that the libraries Dlib provide.
Specifically, server-side can first obtain the face boundary of human face region in above-mentioned video image frame, then based on advance
The position (coordinate representation can be used) of 68 human face characteristic points in trained faceform and the faceform, to the video
Picture frame is detected, and may thereby determine that the position of 68 human face characteristic points in the video image frame, you can is regarded with obtaining this
68 human face characteristic points in frequency picture frame.
Referring to FIG. 3, for a kind of human face region and its position view of human face characteristic point.Server-side is receiving Web
When the video image frame that client is sent, above-mentioned Face datection algorithm can be based on, Face datection is carried out to the video image frame,
So as to obtain 68 human face characteristic points of human face region in the video image frame, this 68 human face characteristic points are in human face region
In position, that is, it is as shown in Figure 3.
In the present embodiment, server-side, can in getting above-mentioned video image frame after the human face characteristic point of human face region
With based on these human face characteristic points and the above-mentioned rendering scheme (i.e. user select rendering scheme) sent by Web client,
Image rendering is carried out to the video image frame.
Specifically, server-side is in getting above-mentioned video image frame after the human face characteristic point of human face region, first can be with
Face segmentation is carried out to the video image frame based on these human face characteristic points, to be partitioned into the face area from the video image frame
Domain, then trigonometric ratio processing is carried out to the human face region.
By taking human face region shown in Fig. 3 and its human face characteristic point as an example, server-side can be with feature based point 1 to characteristic point 17
And other features, it will be split in video image frame of the human face region where it, convenient for subsequently to the human face region
Carry out image rendering.Subsequently, server-side can carry out trigonometric ratio processing to the human face region, i.e., be more by the face region division
The size of the triangle subarea that a size is identical and position is misaligned, triangle subarea can voluntarily be set by technical staff
It sets.Server-side can be determined based on this 68 characteristic points in the human face region after carrying out trigonometric ratio processing to the human face region
Each one face part position.For example, the triangle subarea where characteristic point 18 to the difference of characteristic point 27 constitutes eyebrow
Part, wherein constitute right eyebrow part to the triangle subarea where the difference of characteristic point 22, characteristic point 22 to characteristic point 27 is divided
Triangle subarea where not constitutes left eyebrow part；Triangle subarea structure where characteristic point 49 to the difference of characteristic point 68
At lip portion, wherein the triangle subarea where characteristic point 49 to the difference of characteristic point 61 constitutes upper lip part, characteristic point
Triangle subarea where 62 to the difference of characteristic point 68 constitutes lower lip part.
Server-side, can be based on the above-mentioned figure sent by Web client after carrying out region segmentation to above-mentioned human face region
As rendering scheme carries out image rendering to the human face region after region segmentation.Wherein, image rendering scheme may include to face
Region is sharpened, obscures, colouring, bloom etc..
Continue by taking human face region shown in Fig. 3 and its human face characteristic point as an example, it is assumed that the image rendering of above-mentioned user's selection
Scheme includes that lip portion is dyed red, then server-side can be to triangle where characteristic point 49 to the difference of characteristic point 68
Region carries out coloring treatment, is colored as red.
In practical applications, server-side can include using a width human face region image as template image, and obtaining should
The human face characteristic point of human face region in template image.Subsequently, server-side can be based on these human face characteristic points, and by technology people
The pre-set a variety of different image rendering schemes of member carry out image rendering, so as to obtain several to the template image
For template image after image rendering as effect image, these effect images have different image rendering effects each other.
These effect images can be supplied to user, user can be according to these effects by server-side by Web client
The image rendering effect selection that image is presented thinks image rendering scheme to be used.Specifically, user can select a width
Effect image simultaneously clicks image rendering button, and Web client, can be with after detecting the action that user clicks image rendering button
The video image frame that camera takes is obtained, and these video image frames and the effect image are sent to server-side.Clothes
End be engaged in when receiving the effect image, it may be determined that image wash with watercolours used in the effect image is obtained by above-mentioned template image
Dye scheme, and the image rendering scheme that the image rendering scheme is selected as user.Subsequently, server-side can be based on the image
Rendering scheme carries out further image rendering to the video image frame that Web client is sent.
Server-side, can be by the video image frame after image rendering after completing to the image rendering of above-mentioned video image frame
Send back Web client.Web client can be incited somebody to action in the video image frame after receiving the image rendering that server-side returns
Video image frame after these image renderings shows user.
Specifically, Web client can be by the video image frame after several above-mentioned image renderings according to shooting time sequence
Video display is integrated into user.In practical applications, usual server-side carries out figure to the video image frame that Web client is sent
The time expended as required for rendering is shorter, therefore can be considered as user can be by Web client, the bat of real time inspection camera
Effect of the video taken the photograph after image rendering.When technical scheme is applied to virtual makeups, i.e., user can lead to
Web client is crossed, the effect of virtual makeups and the virtual makeups of real time inspection is carried out.
In another example, user can also select the photo taken as the figure for wanting progress image rendering
Picture, and the image rendering scheme that the image and user select is sent to server-side by Web client.Server-side can be based on should
Image rendering scheme carries out further image rendering to the image, and the image after image rendering is back to Web client.
It, can be by the image shows after the image rendering after image of the Web client after the image rendering for receiving server-side return
To user, effect of the selected photo after image rendering can be checked thereby using family.
From the point of view of based on the above embodiments, in technical scheme, user can directly pass through Web client realization pair
The rendering of photo or video, such as：Virtual makeups are carried out to photo and show makeups effect or the virtual makeups effect of real-time exhibition
Fruit etc..In this manner, user is without voluntarily downloading installation image processing software, it is only necessary to input Web visitors by browser
The network address at family end simplifies user's operation, the user experience is improved to enter Web client.On the other hand, due to Web
Client can be adapted to a variety of different systems, you can with the terminal device applied to a variety of different models, technical staff into
When row software development, without carrying out software development for different systems, reduces the workload of technical staff, reduce software
The cost of development and maintenance.
Corresponding with the embodiment of aforementioned image processing method, present invention also provides the embodiments of image processing apparatus.
The embodiment of the application image processing apparatus can be applied in Web client and server-side respectively.Device is implemented
Example can also be realized by software realization by way of hardware or software and hardware combining.For implemented in software, as
Device on one logical meaning, being will be in nonvolatile memory by the processor of Web client where it or server-side
Corresponding computer program instructions read what operation in memory was formed.For hardware view, as shown in figure 4, being the application
A kind of hardware structure diagram of Web client where image processing apparatus；As shown in figure 5, for where the application image processing apparatus
A kind of hardware structure diagram of server-side in addition to Fig. 4 and processor shown in fig. 5, memory, network interface and non-volatile is deposited
Except reservoir, Web client and server-side in embodiment where device may be used also generally according to the actual functional capability of the image procossing
To include other hardware, this is repeated no more.
Referring to FIG. 6, for a kind of block diagram of image processing apparatus shown in one exemplary embodiment of the application.At the image
Managing device 600 can apply in Web client shown in Fig. 4, including：
Acquiring unit 601, in the image rendering request for receiving user, obtaining the video figure that camera takes
As frame；Described image render request includes image rendering scheme；The video image frame includes human face region；
Transmission unit 602, for the video image frame and described image rendering scheme to be sent to server-side, so that institute
It states server-side to obtain in the video image frame after the human face characteristic point of human face region based on preset Face datection algorithm, base
Image rendering carried out to the video image frame in the human face characteristic point and described image rendering scheme, and by image rendering
Video image frame afterwards returns to the Web client；
Display unit 603, in the video image frame after receiving the image rendering that the server-side returns, by institute
It states the video image frame after image rendering and shows user.
In an alternative embodiment, the display unit 603 may include：
Show subelement 6031, it is whole according to shooting time sequence for the video image frame after rendering several described images
Video display is combined into user.
Referring to FIG. 7, for a kind of block diagram of image processing apparatus shown in one exemplary embodiment of the application.At the image
Managing device 700 can apply in server-side shown in Fig. 5, including：
Detection unit 701, for receiving the video image frame of Web client transmission and when image rendering scheme, base
Face datection is carried out to the video image frame in preset Face datection algorithm, to obtain face area in the video image frame
The human face characteristic point in domain；
Rendering unit 702, for being based on the human face characteristic point and described image rendering scheme to the video image
Frame carries out image rendering；
Returning unit 703, for the video image frame after image rendering to be returned to the Web client, so that described
Video image frame after Web client renders described image shows user.
In an alternative embodiment, the rendering unit 702 may include：
Segmentation subelement 7021, for carrying out face segmentation to the video image frame to divide based on the human face characteristic point
The human face region is cut out, and trigonometric ratio processing is carried out to the human face region；
Subelement 7022 is rendered, treated that human face region carries out figure to trigonometric ratio for being based on described image rendering scheme
As rendering.
In another optional embodiment, described image rendering scheme may include：
Human face region is sharpened, is obscured, is coloured, bloom.
The function of each unit and the realization process of effect specifically refer to and correspond to step in the above method in above-mentioned apparatus
Realization process, details are not described herein.
For device embodiments, since it corresponds essentially to embodiment of the method, so related place is referring to method reality
Apply the part explanation of example.The apparatus embodiments described above are merely exemplary, wherein described be used as separating component
The unit of explanation may or may not be physically separated, and the component shown as unit can be or can also
It is not physical unit, you can be located at a place, or may be distributed over multiple network units.It can be according to actual
It needs that some or all of module therein is selected to realize the purpose of application scheme.Those of ordinary skill in the art are not paying
In the case of going out creative work, you can to understand and implement.
The foregoing is merely the preferred embodiments of the application, not limiting the application, all essences in the application
With within principle, any modification, equivalent substitution, improvement and etc. done should be included within the scope of the application protection god.
Claims (10)
1. a kind of image processing method, which is characterized in that the method is applied to Web client, including：
In the image rendering request for receiving user, the video image frame that camera takes is obtained；Described image rendering is asked
It includes image rendering scheme to ask；The video image frame includes human face region；
The video image frame and described image rendering scheme are sent to server-side, so that the server-side is based on preset
Face datection algorithm obtains in the video image frame after the human face characteristic point of human face region, based on the human face characteristic point and
Described image rendering scheme carries out image rendering to the video image frame, and the video image frame after image rendering is returned to
The Web client；
In the video image frame after receiving the image rendering that the server-side returns, the video figure after described image is rendered
As frame display is to user.
2. according to the method described in claim 1, it is characterized in that, it is described described image is rendered after video image frame display
To user, including：
By several described images render after video image frame according to shooting time sequence integration be video display to user.
3. a kind of image processing method, which is characterized in that the method is applied to server-side, including：
When receiving the video image frame and image rendering scheme of Web client transmission, it is based on preset Face datection algorithm
Face datection is carried out to the video image frame, to obtain the human face characteristic point of human face region in the video image frame；
Image rendering is carried out to the video image frame based on the human face characteristic point and described image rendering scheme；
Video image frame after image rendering is returned into the Web client, so that the Web client is by described image wash with watercolours
Video image frame after dye shows user.
4. according to the method described in claim 3, it is characterized in that, described be based on the human face characteristic point and described image wash with watercolours
Dye scheme carries out image rendering to the video image frame, including：
Face segmentation is carried out to be partitioned into the human face region, and to institute to the video image frame based on the human face characteristic point
It states human face region and carries out trigonometric ratio processing；
Image rendering is carried out to trigonometric ratio treated human face region based on described image rendering scheme.
5. according to the method described in claim 3, it is characterized in that, described image rendering scheme includes：
Human face region is sharpened, is obscured, is coloured, bloom.
6. a kind of image processing apparatus, which is characterized in that described device is applied to Web client, including：
Acquiring unit, in the image rendering request for receiving user, obtaining the video image frame that camera takes；Institute
It includes image rendering scheme to state image rendering request；The video image frame includes human face region；
Transmission unit, for the video image frame and described image rendering scheme to be sent to server-side, so that the service
End is obtained based on preset Face datection algorithm in the video image frame after the human face characteristic point of human face region, based on described
Human face characteristic point carries out region segmentation to the human face region, and based on described image rendering scheme to the face after region segmentation
Region carries out image rendering, then the video image frame after image rendering is returned to the Web client；
Display unit, in the video image frame after receiving the image rendering that the server-side returns, by described image
Video image frame after rendering shows user.
7. device according to claim 6, which is characterized in that the display unit includes：
Show subelement, the video image frame after being used to render several described images is video according to shooting time sequence integration
Show user.
8. a kind of image processing apparatus, which is characterized in that described device is applied to server-side, including：
Detection unit, for when receiving the video image frame and image rendering scheme of Web client transmission, being based on preset
Face datection algorithm carries out Face datection to the video image frame, to obtain the face of human face region in the video image frame
Characteristic point；
Rendering unit carries out figure for being based on the human face characteristic point and described image rendering scheme to the video image frame
As rendering；
Returning unit, for the video image frame after image rendering to be returned to the Web client, so that the web client
Video image frame after end renders described image shows user.
9. device according to claim 8, which is characterized in that the rendering unit includes：
Divide subelement, it is described to be partitioned into video image frame progress face segmentation for being based on the human face characteristic point
Human face region, and trigonometric ratio processing is carried out to the human face region；
Subelement is rendered, for carrying out image rendering to trigonometric ratio treated human face region based on described image rendering scheme.
10. device according to claim 8, which is characterized in that described image rendering scheme includes：
Human face region is sharpened, is obscured, is coloured, bloom.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810341632.2A CN108629296A (en) | 2018-04-17 | 2018-04-17 | Image processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810341632.2A CN108629296A (en) | 2018-04-17 | 2018-04-17 | Image processing method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108629296A true CN108629296A (en) | 2018-10-09 |
Family
ID=63705462
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810341632.2A Pending CN108629296A (en) | 2018-04-17 | 2018-04-17 | Image processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108629296A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110688948A (en) * | 2019-09-26 | 2020-01-14 | 北京百度网讯科技有限公司 | Method and device for transforming gender of human face in video, electronic equipment and storage medium |
| CN110941332A (en) * | 2019-11-06 | 2020-03-31 | 北京百度网讯科技有限公司 | Expression driving method and device, electronic equipment and storage medium |
| CN111340921A (en) * | 2018-12-18 | 2020-06-26 | 北京京东尚科信息技术有限公司 | Dyeing method, dyeing apparatus, computer system and medium |
| CN113986087A (en) * | 2021-12-27 | 2022-01-28 | 深圳市大头兄弟科技有限公司 | Video rendering method based on subscription |
| CN115379257A (en) * | 2021-05-20 | 2022-11-22 | 阿里巴巴新加坡控股有限公司 | Rendering method, device, system, storage medium and program product |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101547308A (en) * | 2008-03-25 | 2009-09-30 | 索尼株式会社 | Image processing apparatus, image processing method, and program |
| CN101557468A (en) * | 2008-04-07 | 2009-10-14 | 索尼株式会社 | Image processing apparatus, image processing method, and program |
| CN102402782A (en) * | 2011-11-09 | 2012-04-04 | 广东欧珀移动通信有限公司 | Method for realizing special effect mode of mobile phone photographing |
| CN104270577A (en) * | 2014-08-22 | 2015-01-07 | 北京德馨同创科技发展有限责任公司 | Image processing method and device for mobile intelligent terminal |
| CN107247548A (en) * | 2017-05-31 | 2017-10-13 | 腾讯科技（深圳）有限公司 | Method for displaying image, image processing method and device |
| CN107392110A (en) * | 2017-06-27 | 2017-11-24 | 五邑大学 | Beautifying faces system based on internet |
-
2018
- 2018-04-17 CN CN201810341632.2A patent/CN108629296A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101547308A (en) * | 2008-03-25 | 2009-09-30 | 索尼株式会社 | Image processing apparatus, image processing method, and program |
| CN101557468A (en) * | 2008-04-07 | 2009-10-14 | 索尼株式会社 | Image processing apparatus, image processing method, and program |
| CN102402782A (en) * | 2011-11-09 | 2012-04-04 | 广东欧珀移动通信有限公司 | Method for realizing special effect mode of mobile phone photographing |
| CN104270577A (en) * | 2014-08-22 | 2015-01-07 | 北京德馨同创科技发展有限责任公司 | Image processing method and device for mobile intelligent terminal |
| CN107247548A (en) * | 2017-05-31 | 2017-10-13 | 腾讯科技（深圳）有限公司 | Method for displaying image, image processing method and device |
| CN107392110A (en) * | 2017-06-27 | 2017-11-24 | 五邑大学 | Beautifying faces system based on internet |
Non-Patent Citations (1)
| Title |
|---|
| 北方工业大学教务处: "《梦想启程 大学生科学研究与创业行动计划研究报告论文集 2013》", 31 December 2014 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111340921A (en) * | 2018-12-18 | 2020-06-26 | 北京京东尚科信息技术有限公司 | Dyeing method, dyeing apparatus, computer system and medium |
| CN110688948A (en) * | 2019-09-26 | 2020-01-14 | 北京百度网讯科技有限公司 | Method and device for transforming gender of human face in video, electronic equipment and storage medium |
| CN110941332A (en) * | 2019-11-06 | 2020-03-31 | 北京百度网讯科技有限公司 | Expression driving method and device, electronic equipment and storage medium |
| CN115379257A (en) * | 2021-05-20 | 2022-11-22 | 阿里巴巴新加坡控股有限公司 | Rendering method, device, system, storage medium and program product |
| CN115379257B (en) * | 2021-05-20 | 2024-05-14 | 阿里巴巴创新公司 | Rendering method, device, system, storage medium and program product |
| CN113986087A (en) * | 2021-12-27 | 2022-01-28 | 深圳市大头兄弟科技有限公司 | Video rendering method based on subscription |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108629296A (en) | Image processing method and device | |
| US10885713B2 (en) | Method, apparatus, and system for generating an AR application and rendering an AR instance | |
| EP2122546B1 (en) | Remote workspace sharing | |
| CN111787242B (en) | Method and apparatus for virtual fitting | |
| CN105824875B (en) | A kind of photo be shared method and mobile terminal | |
| US11068969B2 (en) | Method and system for configuring a virtual reality environment | |
| US10043317B2 (en) | Virtual trial of products and appearance guidance in display device | |
| CN109117760A (en) | Image processing method, device, electronic equipment and computer-readable medium | |
| CN107045508A (en) | The treating method and apparatus of application program | |
| CN108074278A (en) | Video presentation method, device and equipment | |
| CN108090422A (en) | Hair style recommends method, Intelligent mirror and storage medium | |
| JP2020110572A (en) | Printing method and system of nail printing apparatus, and medium thereof | |
| CN109472655A (en) | Data object trial method, apparatus and system | |
| CN108470377A (en) | AR sees room device | |
| CN106530377B (en) | Method and apparatus for manipulating three-dimensional animated characters | |
| CN116249953A (en) | Mixed reality teleconferencing across multiple locations | |
| CN109660508A (en) | Data visualization method, electronic device, computer equipment and storage medium | |
| CN110889057A (en) | Business data visualization method and business object visualization device | |
| CN104754010B (en) | The method and business platform of information processing | |
| CN109523360B (en) | Information recommendation method and system | |
| US10972656B2 (en) | Cognitively coaching a subject of a photograph | |
| CN115379269A (en) | Live broadcast interaction method of virtual image, computing equipment and storage medium | |
| CN110968379A (en) | Page control method and device of electronic equipment and electronic equipment | |
| CN114285944B (en) | Video color ring generation method and device and electronic equipment | |
| CN105844615A (en) | Method of identifying regular rectangular area and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181009 |
|
| RJ01 | Rejection of invention patent application after publication |