CN107507272A - Establish the method, apparatus and terminal device of human 3d model - Google Patents

Establish the method, apparatus and terminal device of human 3d model Download PDF

Info

Publication number
CN107507272A
CN107507272A CN201710676293.9A CN201710676293A CN107507272A CN 107507272 A CN107507272 A CN 107507272A CN 201710676293 A CN201710676293 A CN 201710676293A CN 107507272 A CN107507272 A CN 107507272A
Authority
CN
China
Prior art keywords
user
light
image
overall
terminal device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710676293.9A
Other languages
Chinese (zh)
Inventor
张学勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201710676293.9A priority Critical patent/CN107507272A/en
Publication of CN107507272A publication Critical patent/CN107507272A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/08Indexing scheme for image data processing or generation, in general involving all processing steps from image acquisition to 3D model generation

Abstract

The application proposes a kind of method, apparatus and terminal device for establishing human 3d model, wherein, the above-mentioned method for establishing human 3d model includes:Receive the configured information that user opens self scanning;According to the configured information, encoded heterogeneous texture light is projected using the Space Rotating residing for the black light light source to the user in terminal device;Using the black light camera in the terminal device according to heterogeneous texture light identical direction of rotation described in the black light light source projects, the image of the user is acquired, obtain with heterogeneous texture light pattern structure light image;The structure light image progress panoramic mosaic obtained will be gathered, obtain the overall structure light image of the user;The overall threedimensional model of the user is established according to the overall structure light image of the user.The application can realize that user oneself by hand-held terminal device, integrally carries out 3D modeling to user, improves user experience.

Description

Establish the method, apparatus and terminal device of human 3d model
Technical field
The application is related to technical field of image processing, more particularly to a kind of method, apparatus for establishing human 3d model and Terminal device.
Background technology
With social development, oneself can not meet the needs of Human Modeling to traditional two-dimensional data, and there is an urgent need to more comprehensively Three-dimensional (Three Dimensions;Hereinafter referred to as:3D) data carry out human body three-dimensional modeling.Three-dimensional data, which visualizes oneself, to be turned into The important step of current Human Modeling.
In existing correlation technique, mobile terminal is more and more scanned using 3D and modeling technique, but existing related skill In art, user oneself can be only done the 3D scannings and modeling of face by hand-held mobile terminal, for leg or pin, or to For the overall 3D modeling that carries out at family with regard to relatively difficult, Consumer's Experience is poor.
The content of the invention
The application is intended to one of technical problem at least solving in correlation technique to a certain extent.
Therefore, first purpose of the application is to propose a kind of method for establishing human 3d model, utilized with realizing Black light light source in terminal device projects heterogeneous texture light to the Space Rotating residing for user, and is set using above-mentioned terminal Black light camera in standby according to above-mentioned black light light source projects heterogeneous texture light identical direction of rotation, to above-mentioned The image of user is acquired, and the structure light image for gathering acquisition is carried out into panoramic mosaic, obtains the overall structure of above-mentioned user Light image, and then the overall 3D models of above-mentioned user are established according to the overall structure light image of above-mentioned user, so as to realize User oneself integrally carries out 3D modeling to user, improves user experience by hand-held terminal device.
Second purpose of the application is to propose a kind of device for establishing human 3d model.
The 3rd purpose of the application is to propose a kind of terminal device.
The 4th purpose of the application is to propose a kind of non-transitorycomputer readable storage medium.
The 5th purpose of the application is to propose a kind of computer program product.
For the above-mentioned purpose, the application first aspect embodiment proposes a kind of method for establishing human 3d model, bag Include:Receive the configured information that user opens self scanning;According to the configured information, the black light light in terminal device is utilized Space Rotating residing for from source to the user projects encoded heterogeneous texture light;Using invisible in the terminal device Light camera according to heterogeneous texture light identical direction of rotation described in the black light light source projects, to the figure of the user As being acquired, the structure light image with heterogeneous texture light pattern is obtained;The structure light image for gathering acquisition is carried out complete Scape splices, and obtains the overall structure light image of the user;The user is established according to the structure light image that the user is overall Overall threedimensional model.
In the method for establishing human 3d model of the embodiment of the present application, the configured information that user opens self scanning is received Afterwards, according to above-mentioned configured information, thrown using the Space Rotating residing for the black light light source to above-mentioned user in terminal device Penetrate encoded heterogeneous texture light, using the black light camera in above-mentioned terminal device according to above-mentioned black light light source Above-mentioned heterogeneous texture light identical direction of rotation is projected, the image of above-mentioned user is acquired, acquisition carries non-homogeneous knot The structure light image of structure light pattern, then the structure light image progress panoramic mosaic obtained will be gathered, it is overall to obtain above-mentioned user Structure light image, the overall 3D models of above-mentioned user are finally established according to the overall structure light image of above-mentioned user, so as to To realize that user oneself by hand-held terminal device, integrally carries out 3D modeling to user, improves user experience.
For the above-mentioned purpose, the application second aspect embodiment proposes a kind of device for establishing human 3d model, if Put in terminal device, the device for establishing human 3d model includes:Receiving module, self is opened for receiving user and is swept The configured information retouched;Projection module, for the configured information received according to the receiving module, using in terminal device can not See that the Space Rotating residing for radiant to the user projects encoded heterogeneous texture light;Acquisition module, for utilizing institute The black light camera stated in terminal device revolves according to heterogeneous texture light identical described in the black light light source projects Turn direction, the image of the user is acquired, obtain the structure light image with heterogeneous texture light pattern;Splice mould Block, panoramic mosaic is carried out for the acquisition module to be gathered to the structure light image obtained, obtains the overall structure of the user Light image;Module is established, the overall structure light image of the user for being obtained according to the concatenation module establishes the use The overall threedimensional model in family.
In the device for establishing human 3d model of the embodiment of the present application, receiving module receives user and opens self scanning After configured information, projection module is according to above-mentioned configured information, using the black light light source in terminal device to above-mentioned user Residing Space Rotating projects encoded heterogeneous texture light, and acquisition module utilizes the black light phase in above-mentioned terminal device Machine according to the above-mentioned heterogeneous texture light identical direction of rotation of above-mentioned black light light source projects, the image of above-mentioned user is entered Row collection, obtains the structure light image with heterogeneous texture light pattern, and then concatenation module will gather the structure light figure obtained As carrying out panoramic mosaic, the overall structure light image of above-mentioned user is obtained, finally establishes module according to the overall knot of above-mentioned user The overall 3D models of above-mentioned user are established in structure light image, so as to realize user oneself by hand-held terminal device, to user It is overall to carry out 3D modeling, improve user experience.
For the above-mentioned purpose, the application third aspect embodiment proposes a kind of terminal device, including:Receiver, can not See radiant, black light camera, memory, processor and be stored on the memory and can run on the processor Computer program;The receiver, the configured information of self scanning is opened for receiving user;The black light light source, For the configured information received according to the receiver, using residing for the black light light source to the user in terminal device Space Rotating projects encoded heterogeneous texture light;The black light camera, for according to the black light light source The heterogeneous texture light identical direction of rotation is projected, the image of the user is acquired, acquisition carries non-homogeneous knot The structure light image of structure light pattern;The processor, for performing the computer program, realize method as described above.
To achieve these goals, the application fourth aspect embodiment proposes a kind of computer-readable storage of non-transitory Medium, is stored thereon with computer program, and the computer program realizes method as described above when being executed by processor.
To achieve these goals, the aspect embodiment of the application the 5th proposes a kind of computer program product, when described When instruction in computer program product is executed by processor, method as described above is realized.
The aspect and advantage that the application adds will be set forth in part in the description, and will partly become from the following description Obtain substantially, or recognized by the practice of the application.
Brief description of the drawings
The above-mentioned and/or additional aspect of the application and advantage will become from the following description of the accompanying drawings of embodiments Substantially and it is readily appreciated that, wherein:
Fig. 1 is the flow chart of method one embodiment that the application establishes human 3d model;
Fig. 2 is the flow chart that the application establishes another embodiment of the method for human 3d model;
Fig. 3 is the flow chart for the method further embodiment that the application establishes human 3d model;
Fig. 4 is the flow chart for the method further embodiment that the application establishes human 3d model;
Fig. 5 is the structural representation of device one embodiment that the application establishes human 3d model;
Fig. 6 is the structural representation that the application establishes another embodiment of the device of human 3d model;
Fig. 7 is the schematic diagram of the application image processing circuit one embodiment.
Embodiment
Embodiments herein is described below in detail, the example of the embodiment is shown in the drawings, wherein from beginning to end Same or similar label represents same or similar element or the element with same or like function.Below with reference to attached The embodiment of figure description is exemplary, it is intended to for explaining the application, and it is not intended that limitation to the application.
Fig. 1 is the flow chart of method one embodiment that the application establishes human 3d model, as shown in figure 1, above-mentioned build The method of vertical human 3d model can include:
Step 101, the configured information that user opens self scanning is received.
In the present embodiment, user can be by clicking on the icon self scanned on terminal device display interface, to terminal Equipment sends the configured information for opening self scanning;Or user can also by specifically operating, such as:Overturn camera, The configured information for opening self scanning is sent to terminal device, the present embodiment sends the configured information for opening self scanning to user Mode be not construed as limiting.
Step 102, according to above-mentioned configured information, using residing for the black light light source to above-mentioned user in terminal device Space Rotating projects encoded heterogeneous texture light.
Step 103, using the black light camera in above-mentioned terminal device according to in above-mentioned black light light source projects Heterogeneous texture light identical direction of rotation is stated, the image of above-mentioned user is acquired, acquisition carries heterogeneous texture light figure The structure light image of case.
Wherein, structure light (structured light) is the set of the projection in known spatial direction, generating structure light Equipment can be certain projector equipment or the instrument for projecting to luminous point, line, grating, grid or speckle on testee, such as: Optical projection device or the laser for generating laser beam.
In the present embodiment, the pattern of said structure light can be laser stripe, Gray code, sine streak or, random alignment Speckle pattern etc..
Wherein, above-mentioned black light light source is typically made up of light source and diffraction optical element, and light source can be that edge emitting swashs Light can also be vertical cavity surface-emitting laser, and above-mentioned black light light source, which can be sent, to be identified not by black light camera Visible ray.For example, black light is infrared light, black light camera is infrared camera, and at this moment, said structure light image is as red Outer image;Or black light is ultraviolet light, black light camera is ultraviolet-cameras, and at this moment said structure light image is ultraviolet figure Picture.
Diffraction optical element needs to be configured to have collimation, beam splitting, diffusion etc. according to different structured light patterns Function.
The pattern of above-mentioned heterogeneous texture light can be to be distributed irregular speckle pattern.The dense degree of the speckle pattern The speed and precision of depth value calculating are have impact on, speckle particle is more, and calculating speed is slower, but precision is higher.Therefore, this is not Visible light source can select suitable speckle particle density according to the approximate depth of the target area of shooting image, ensure to count While calculating speed, still there is higher computational accuracy.Certainly, the speckle particle density also can be according to systematic function and/or reality Existing demand etc. determines.
In the present embodiment, the space projection speckle particle figure residing for the angular user of diffusion that black light light source can be necessarily Case.
It should be noted that above-mentioned black light light source may be provided in black light camera.
Step 104, the structure light image progress panoramic mosaic obtained will be gathered, obtains the overall structure light figure of above-mentioned user Picture.
Step 105, the overall 3D models of above-mentioned user are established according to the overall structure light image of above-mentioned user.
It is above-mentioned to establish in the method for human 3d model, after receiving the configured information that user opens self scanning, according to Above-mentioned configured information, it is encoded using the Space Rotating projection residing for the black light light source to above-mentioned user in terminal device Heterogeneous texture light, using the black light camera in above-mentioned terminal device according to above-mentioned non-with above-mentioned black light light source projects Homogeneous texture light identical direction of rotation, is acquired to the image of above-mentioned user, obtains with heterogeneous texture light pattern Structure light image, then the structure light image progress panoramic mosaic obtained will be gathered, obtain the overall structure light figure of above-mentioned user Picture, the overall 3D models of above-mentioned user are finally established according to the overall structure light image of above-mentioned user, so as to realize user Oneself integrally carries out 3D modeling to user, improves user experience by hand-held terminal device.
Fig. 2 is the flow chart that the application establishes another embodiment of the method for human 3d model, as shown in Fig. 2 this Shen Please be in embodiment illustrated in fig. 1, step 102 can be:
Step 201, according to above-mentioned configured information, using the black light light source in terminal device according to from bottom to up or Order from top to bottom, encoded heterogeneous texture light is projected to the Space Rotating residing for above-mentioned user.
In the present embodiment, after receiving user and opening the configured information self scanned, it can utilize in terminal device Black light light source according to from bottom to up (such as:From the pin of user to head) or from top to bottom (such as:From the head of user Portion is to pin) order, encoded heterogeneous texture light is projected to the Space Rotating residing for above-mentioned user.
Fig. 3 is the flow chart for the method further embodiment that the application establishes human 3d model, as shown in figure 3, this Shen Please be in embodiment illustrated in fig. 1, step 105 can include:
Step 301, the overall structure light image of above-mentioned user is carried out calculating processing acquisition depth image.
Specifically, by taking pattern light as an example, calculating processing is carried out to structure light image, specifically included, from the structure light The speckle image of user is gathered in image, by the speckle image of user with carrying out picture number according to pre-defined algorithm with reference to speckle image According to calculating, obtain each speckle point of the upper speckle image of user relative to the movement with reference to the reference speckle point in speckle image away from From.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and depth is worth to according to the depth Image.
It is, of course, also possible to by the method for binocular vision or based on jet lag (Time of Flight;Hereinafter referred to as: TOF method) obtains the depth image etc., is not limited thereto, as long as can obtain or by the way that depth image is calculated Method belong to the scope that present embodiment includes.
Step 302, according to above-mentioned depth image, above-mentioned user's entirety is established with reference to the overall color information of above-mentioned user 3D models.
Specifically, according to above-mentioned depth image, above-mentioned user's entirety is established with reference to the overall color information of above-mentioned user 3D models can be:By the feature extracted respectively from above-mentioned depth image and the spy extracted from above-mentioned color information Sign carries out registration and Fusion Features processing;According to the feature after fusion, the overall 3D models of above-mentioned user are established.
Wherein, the color information of above-mentioned user can be obtained by image capture sensor, and above-mentioned imaging sensor may include Colour filter array, such as Bayer (Bayer) filter, imaging sensor can obtain to be caught with each imaging pixel of imaging sensor Luminous intensity and wavelength information, so as to obtain the color information of above-mentioned user.
After the color information for the above-mentioned user that image capture sensor arrives is received, the color of above-mentioned user can be believed View data is handled corresponding to breath.
Specifically, raw image data can be handled pixel by pixel in various formats.For example, each image pixel can have Have the bit depth of 8,10,12 or 14 bits, raw image data can be carried out one or more image processing operations, collect on The image statistics of view data.Wherein, image processing operations can be carried out by identical or different bit depth precision.
After the color information of above-mentioned user and depth image is got, it can be merged, obtain 3D models.Its In, the feature of corresponding user can be extracted by least one of appearance profile extracting method or contour feature extracting method, Such as pass through active shape model method (Active Shape Model;Hereinafter referred to as:ASM), active appearance models method (Active Appearance Model;Hereinafter referred to as:AAM), PCA (Principal Component Analysis;Below Referred to as:) or discrete cosine transform method (Discrete Cosine Transform PCA;Hereinafter referred to as:DCT) the methods of, carry The feature of above-mentioned user is taken, is not limited herein.Again by the feature extracted respectively from deep image information and from color The feature extracted in information carries out registration and Fusion Features processing.The Fusion Features processing herein referred to can be by from depth map Weighed as the feature directly combination extracted in information and color information or by identical feature in different images Reset and combined after determining, it is possibility to have other amalgamation modes, finally according to the feature after fusion, generate 3D models.
Fig. 4 is the flow chart for the method further embodiment that the application establishes human 3d model, as shown in figure 4, this Shen After step 105, it please can also include in embodiment illustrated in fig. 1:
Step 401, according to the overall 3D models of above-mentioned user, the human body information of above-mentioned user is obtained.
Specifically, according to the overall 3D models of above-mentioned user, can obtain the height of above-mentioned user, sex, body weight and/or The human body information of waistline etc., and then can be worn the clothes according to the human body information of acquisition to above-mentioned user offer, health And/or the suggestion of sport and body-building etc..
Certainly, establish after the overall 3D models of above-mentioned user, can also be according to the overall 3D model realizations of above-mentioned user Other purposes, it is numerous to list herein.
Fig. 5 is the structural representation of device one embodiment that the application establishes human 3d model, above-mentioned to establish human body The device of threedimensional model is arranged in terminal device, it is possible to achieve the side for establishing human 3d model that the embodiment of the present application provides Method.
Wherein, above-mentioned terminal device can be the intelligent terminals such as smart mobile phone, tablet personal computer or notebook computer, The present embodiment is not construed as limiting to the form of above-mentioned terminal device.
As shown in figure 5, the above-mentioned device for establishing human 3d model can include:Receiving module 51, projection module 52, adopt Collect module 53, concatenation module 54 and establish module 55;
Wherein, receiving module 51, the configured information of self scanning is opened for receiving user;In the present embodiment, Yong Huke With the icon by clicking on self scanning on terminal device display interface, the instruction for opening self scanning is sent to terminal device Information;Or user can also by specifically operating, such as:Camera is overturn, sending unlatching to terminal device self scans Configured information, the present embodiment is sent to user to be opened the mode of configured information of self scanning and is not construed as limiting.
Projection module 52, for the configured information received according to receiving module 51, utilize the black light in terminal device Space Rotating residing for from light source to above-mentioned user projects encoded heterogeneous texture light;
Acquisition module 53, for using the black light camera in above-mentioned terminal device according to above-mentioned black light light source Above-mentioned heterogeneous texture light identical direction of rotation is projected, the image of above-mentioned user is acquired, acquisition carries non-homogeneous knot The structure light image of structure light pattern;
Wherein, structure light (structured light) is the set of the projection in known spatial direction, generating structure light Equipment can be certain projector equipment or the instrument for projecting to luminous point, line, grating, grid or speckle on testee, such as: Optical projection device or the laser for generating laser beam.
In the present embodiment, the pattern of said structure light can be laser stripe, Gray code, sine streak or, random alignment Speckle pattern etc..
Wherein, above-mentioned black light light source is typically made up of light source and diffraction optical element, and light source can be that edge emitting swashs Light can also be vertical cavity surface-emitting laser, and above-mentioned black light light source, which can be sent, to be identified not by black light camera Visible ray.For example, black light is infrared light, black light camera is infrared camera, and at this moment, said structure light image is as red Outer image;Or black light is ultraviolet light, black light camera is ultraviolet-cameras, and at this moment said structure light image is ultraviolet figure Picture.
Diffraction optical element needs to be configured to have collimation, beam splitting, diffusion etc. according to different structured light patterns Function.
The pattern of above-mentioned heterogeneous texture light can be to be distributed irregular speckle pattern.The dense degree of the speckle pattern The speed and precision of depth value calculating are have impact on, speckle particle is more, and calculating speed is slower, but precision is higher.Therefore, this is not Visible light source can select suitable speckle particle density according to the approximate depth of the target area of shooting image, ensure to count While calculating speed, still there is higher computational accuracy.Certainly, the speckle particle density also can be according to systematic function and/or reality Existing demand etc. determines.
In the present embodiment, the space projection speckle particle figure residing for the angular user of diffusion that black light light source can be necessarily Case.
It should be noted that above-mentioned black light light source may be provided in black light camera.
Concatenation module 54, the structure light image for acquisition module 53 to be gathered to acquisition carry out panoramic mosaic, obtained above-mentioned The overall structure light image of user;
Module 55 is established, the overall structure light image of the above-mentioned user for being obtained according to concatenation module 54 establishes above-mentioned use The overall 3D models in family.
Above-mentioned to establish in the device of human 3d model, receiving module 51 receives the configured information that user opens self scanning Afterwards, projection module 52 is according to above-mentioned configured information, using residing for the black light light source to above-mentioned user in terminal device Space Rotating projects encoded heterogeneous texture light, and acquisition module 53 is pressed using the black light camera in above-mentioned terminal device According to the above-mentioned heterogeneous texture light identical direction of rotation of above-mentioned black light light source projects, the image of above-mentioned user is adopted Collection, the structure light image with heterogeneous texture light pattern is obtained, then concatenation module 54 will gather the structure light image obtained Panoramic mosaic is carried out, obtains the overall structure light image of above-mentioned user, finally establishes module 55 according to the overall knot of above-mentioned user The overall 3D models of above-mentioned user are established in structure light image, so as to realize user oneself by hand-held terminal device, to user It is overall to carry out 3D modeling, improve user experience.
Fig. 6 is the structural representation that the application establishes another embodiment of the device of human 3d model.
In the present embodiment, projection module 52, specifically for using the black light light source in terminal device according to from it is lower to Upper or order from top to bottom, encoded heterogeneous texture light is projected to the Space Rotating residing for above-mentioned user.This implementation In example, after the configured information that receiving module 51 receives that user opens self scanning, projection module 52 can utilize terminal Black light light source in equipment according to from bottom to up (such as:From the pin of user to head) or from top to bottom (such as:From with The head at family is to pin) order, encoded heterogeneous texture light is projected to the Space Rotating residing for above-mentioned user.
In the present embodiment, establishing module 55 can include:Image obtains submodule 551 and model setting up submodule 552;
Wherein, image obtains submodule 551, for carrying out calculating processing acquisition to the overall structure light image of above-mentioned user Depth image;Specifically, by taking pattern light as an example, image obtains submodule 551 and calculating processing is carried out to structure light image, has Body includes, from the structure light image gather user speckle image, by the speckle image of user with reference to speckle image according to Pre-defined algorithm carries out view data calculating, obtains each speckle point of the upper speckle image of user relative to reference in speckle image With reference to the displacement of speckle point.The depth value of each speckle point of speckle image, and root are calculated using trigonometry conversion Depth image is worth to according to the depth.
It is, of course, also possible to the method by binocular vision or the method based on TOF obtain the depth image etc., herein not It is construed as limiting, as long as the scope that can be obtained or belong to present embodiment by the way that the method for depth image is calculated and include.
Model setting up submodule 552, for obtaining the depth image of the acquisition of submodule 551 according to image, with reference to above-mentioned use The overall color information in family establishes the overall 3D models of above-mentioned user.
In the present embodiment, model setting up submodule 552, specifically for the spy that will be extracted respectively from above-mentioned depth image Sign and the feature extracted from above-mentioned color information carry out registration and Fusion Features processing;According to the feature after fusion, build The overall 3D models of vertical above-mentioned user.
Wherein, the color information of above-mentioned user can be obtained by image capture sensor, and above-mentioned imaging sensor may include Colour filter array, such as Bayer (Bayer) filter, imaging sensor can obtain to be caught with each imaging pixel of imaging sensor Luminous intensity and wavelength information, so as to obtain the color information of above-mentioned user.
After the color information for the above-mentioned user that image capture sensor arrives is received, the color of above-mentioned user can be believed View data is handled corresponding to breath.
Specifically, raw image data can be handled pixel by pixel in various formats.For example, each image pixel can have Have the bit depth of 8,10,12 or 14 bits, raw image data can be carried out one or more image processing operations, collect on The image statistics of view data.Wherein, image processing operations can be carried out by identical or different bit depth precision.
After the color information of above-mentioned user and depth image is got, it can be merged, obtain 3D models.Its In, the feature of corresponding user can be extracted by least one of appearance profile extracting method or contour feature extracting method, Such as the methods of by ASM, AAM, PCA or DCT, the feature of above-mentioned user is extracted, is not limited herein.Model establishes submodule The feature extracted respectively from deep image information and the feature extracted from color information are carried out registration by block 552 again With Fusion Features processing.The Fusion Features processing herein referred to can will be extracted from deep image information and color information Feature directly combination or will in different images identical feature carry out weight setting after combine, it is possibility to have other Amalgamation mode, finally according to the feature after fusion, generate 3D models.
Further, the above-mentioned device for establishing human 3d model can also include:
Acquisition module 56, for establish module 55 according to the overall structure light image of above-mentioned user and establish above-mentioned user it is whole After the 3D models of body, according to the 3D models that above-mentioned user is overall, the human body information of above-mentioned user is obtained.
Specifically, acquisition module 56 according to the overall 3D models of above-mentioned user, can obtain height, the property of above-mentioned user Not, the human body information of body weight and/or waistline etc., and then can provide and wear to above-mentioned user according to the human body information of acquisition The suggestion of clothing, health and/or sport and body-building etc..
Certainly, establish after the overall 3D models of above-mentioned user, can also be according to the overall 3D model realizations of above-mentioned user Other purposes, it is numerous to list herein.
The embodiment of the present application also provides a kind of terminal device, and above-mentioned terminal device includes:Receiver, black light light source, Black light camera, memory, processor and it is stored in the computer that can be run on above-mentioned memory and on above-mentioned processor Program;Receiver, the configured information of self scanning is opened for receiving user;Black light light source, for according to above-mentioned reception The configured information that device receives, warp knit is projected using the Space Rotating residing for the black light light source to above-mentioned user in terminal device The heterogeneous texture light of code;Black light camera, for according to identical with above-mentioned black light light source projects heterogeneous texture light Direction of rotation, the image of above-mentioned user is acquired, obtain with heterogeneous texture light pattern structure light image;Processing Device, for performing above computer program, realize the method for establishing human 3d model that the embodiment of the present application provides.
Image processing circuit can also be included in above-mentioned terminal device, image processing circuit can utilize hardware and/or soft Part component is realized, it may include defines ISP (Image Signal Processing;Hereinafter referred to as:Picture signal processing) pipeline Various processing units.
Wherein, above-mentioned terminal device can be that the intelligence such as smart mobile phone, tablet personal computer, notebook computer or intelligent watch is whole End equipment, the present embodiment are not construed as limiting to the concrete form of above-mentioned terminal device, but the present embodiment is using above-mentioned terminal device as intelligence It can be illustrated exemplified by mobile phone.
Fig. 7 is the schematic diagram of the application image processing circuit one embodiment.As shown in fig. 7, for purposes of illustration only, only show The various aspects of the image processing techniques related to the embodiment of the present application.
As shown in fig. 7, image processing circuit 700 includes imaging device 710, ISP processors 730 and control logic device 740. Imaging device 710 may include the camera and structured light projector with one or more lens 712, imaging sensor 714 716.Structured light projector 716 is by structured light projection to user.Wherein, the structured light patterns can be laser stripe, Gray code, just String striped or, speckle pattern of random alignment etc..Imaging sensor 714 catches the structure light image that projection is formed to user, And send structure light image to ISP processors 730, structure light image is carried out by ISP processors 730 to calculate processing acquisition use The depth image at family.Meanwhile imaging sensor 714 can also catch the color information of user.It is of course also possible to by two images Sensor 714 catches the structure light image and color information of user respectively.
Wherein, by taking pattern light as an example, ISP processors 730 are demodulated to structure light image, are specifically included, from this The speckle image of user is gathered in structure light image, by the speckle image of user with being carried out with reference to speckle image according to pre-defined algorithm View data calculates, and obtains each speckle point of the upper speckle image of user relative to reference to the reference speckle point in speckle image Displacement.The depth value of each speckle point of speckle image is calculated using trigonometry conversion, and is obtained according to the depth value To the depth image of user.
It is, of course, also possible to the method by binocular vision or the method based on TOF obtain the deep image information etc., This is not construed as limiting, as long as can obtain or belong to present embodiment by the method for the deep image information that user is calculated Comprising scope.
, can be to user after the color information that ISP processors 730 receive the user that imaging sensor 714 captures Color information corresponding to view data handled.ISP processors 730 view data is analyzed with obtain can be used for into As the image statistics of one or more control parameters of equipment 710.Imaging sensor 714 may include colour filter array, Such as Bayer filters, imaging sensor 714 can obtain the luminous intensity caught with each imaging pixel of imaging sensor 714 and ripple Long message, and the one group of raw image data that can be handled by ISP processors 730 is provided.
ISP processors 730 handle raw image data pixel by pixel in various formats.For example, each image pixel can Bit depth with 8,10,12 or 14 bits, ISP processors 730 can be carried out at one or more images to raw image data Reason operation, image statistics of the collection on view data.Wherein, image processing operations can be by identical or different bit depth Precision is carried out.
ISP processors 730 can also receive pixel data from video memory 720.Video memory 720 can be memory device The independent private memory in a part, storage device or electronic equipment put, and may include DMA (Direct Memory Access;Hereinafter referred to as:Direct memory access (DMA)) feature.
When receiving raw image data, ISP processors 730 can carry out one or more image processing operations.
After ISP processors 730 get color information and the depth information of user, it can be merged, obtain three Tie up image.Wherein, corresponding use can be extracted by least one of appearance profile extracting method or contour feature extracting method The feature at family, such as the methods of by ASM, AAM, PCA or DCT, extract the feature of user, do not limit herein.Again will be respectively The feature extracted from depth image and the feature extracted from color information carry out registration and Fusion Features processing.This In refer to Fusion Features processing can directly combine the feature extracted from depth information and color information, can also It is to be combined after identical feature in different images is carried out into weight setting, it is possibility to have other amalgamation modes, finally according to fusion Feature afterwards, generate 3D models.
The view data of 3D models can be transmitted to video memory 720, to carry out other processing before shown. ISP processors 730 are carried out in original domain and red green from the reception processing data of video memory 720 to the processing data Indigo plant (Red Green Blue;Hereinafter referred to as:) and the image real time transfer in YCbCr color spaces RGB.The picture number of 3D models According to may be output to display 760, so that user watches and/or by graphics engine or graphics processor (Graphics Processing Unit;Hereinafter referred to as:GPU) further processing.In addition, the output of ISP processors 730 also can be transmitted to image Memory 720, and display 760 can read view data from video memory 720.In one embodiment, video memory 720 can be configured as realizing one or more frame buffers.In addition, the output of ISP processors 730 can be transmitted to encoder/solution Code device 750, so as to encoding/decoding image data.The view data of coding can be saved, and before display 760 is shown in Decompression.Encoder/decoder 750 can be realized by CPU or GPU or coprocessor.
The image statistics that ISP processors 730 determine, which can be transmitted, gives the unit of control logic device 740.Control logic device 740 It may include the processor and/or microcontroller for performing one or more routines (such as firmware), one or more routines can be according to connecing The image statistics of receipts, determine the control parameter of imaging device 710.
Below be with the image processing circuit shown in Fig. 7 realize the embodiment of the present application provide establish human body three-dimensional mould The step of method of type:
Step 1, the configured information that user opens self scanning is received.
Step 2, according to above-mentioned configured information, using the black light light source in terminal device according to from bottom to up or from Order under up to, encoded heterogeneous texture light is projected to the Space Rotating residing for above-mentioned user.
Step 3, using the black light camera in above-mentioned terminal device according to above-mentioned with above-mentioned black light light source projects Heterogeneous texture light identical direction of rotation, is acquired to the image of above-mentioned user, and acquisition carries heterogeneous texture light pattern Structure light image.
Step 4, the structure light image progress panoramic mosaic obtained will be gathered, obtains the overall structure light figure of above-mentioned user Picture.
Step 5, the overall structure light image of above-mentioned user is carried out calculating processing acquisition depth image.
Step 6, according to above-mentioned depth image, the overall 3D of above-mentioned user is established with reference to the overall color information of above-mentioned user Model.
Step 7, according to the overall 3D models of above-mentioned user, the human body information of above-mentioned user is obtained.
The embodiment of the present application also provides a kind of non-transitorycomputer readable storage medium, is stored thereon with computer journey Sequence, the side for establishing human 3d model that the embodiment of the present application provides can be realized when above computer program is executed by processor Method.
Above-mentioned non-transitorycomputer readable storage medium can use appointing for one or more computer-readable media Meaning combination.Computer-readable medium can be computer-readable signal media or computer-readable recording medium.Computer can Read storage medium and for example may be-but not limited to-the system of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, device Or device, or any combination above.The more specifically example (non exhaustive list) of computer-readable recording medium includes: Electrical connection, portable computer diskette, hard disk, random access memory (RAM), read-only storage with one or more wires Device (Read Only Memory;Hereinafter referred to as:ROM), erasable programmable read only memory (Erasable Programmable Read Only Memory;Hereinafter referred to as:EPROM) or flash memory, optical fiber, portable compact disc are read-only deposits Reservoir (CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer Readable storage medium storing program for executing can be any includes or the tangible medium of storage program, the program can be commanded execution system, device Either device use or in connection.
Computer-readable signal media can include in a base band or as carrier wave a part propagation data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including --- but It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be Any computer-readable medium beyond computer-readable recording medium, the computer-readable medium can send, propagate or Transmit for by instruction execution system, device either device use or program in connection.
The program code included on computer-readable medium can be transmitted with any appropriate medium, including --- but it is unlimited In --- wireless, electric wire, optical cable, RF etc., or above-mentioned any appropriate combination.
Can with one or more programming languages or its combination come write for perform the application operation computer Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, Also include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with Fully perform, partly perform on the user computer on the user computer, the software kit independent as one performs, portion Divide and partly perform or performed completely on remote computer or server on the remote computer on the user computer. It is related in the situation of remote computer, remote computer can pass through the network of any kind --- including LAN (Local Area Network;Hereinafter referred to as:) or wide area network (Wide Area Network LAN;Hereinafter referred to as:WAN) it is connected to user Computer, or, it may be connected to outer computer (such as passing through Internet connection using ISP).
The embodiment of the present application also proposes a kind of computer program product, when the instruction in above computer program product is located When managing device execution, the method for establishing human 3d model of the embodiment of the present application offer can be performed.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show The description of example " or " some examples " etc. means specific features, structure, material or the spy for combining the embodiment or example description Point is contained at least one embodiment or example of the application.In this manual, to the schematic representation of above-mentioned term not Identical embodiment or example must be directed to.Moreover, specific features, structure, material or the feature of description can be with office Combined in an appropriate manner in one or more embodiments or example.In addition, in the case of not conflicting, the skill of this area Art personnel can be tied the different embodiments or example and the feature of different embodiments or example described in this specification Close and combine.
In addition, term " first ", " second " are only used for describing purpose, and it is not intended that instruction or hint relative importance Or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ", the feature of " second " can be expressed or Implicitly include at least one this feature.In the description of the present application, " multiple " are meant that at least two, such as two, three It is individual etc., unless otherwise specifically defined.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize custom logic function or process Point, and the scope of the preferred embodiment of the application includes other realization, wherein can not press shown or discuss suitable Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be by the application Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following:Electricity with one or more wiring Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (Random Access Memory;Hereinafter referred to as:RAM), read-only storage (Read Only Memory;Hereinafter referred to as:ROM), erasable editable Read memory (Erasable Programmable Read Only Memory;Hereinafter referred to as:EPROM) or flash memory, Fiber device, and portable optic disk read-only storage (Compact Disc Read Only Memory;Hereinafter referred to as:CD- ROM).In addition, computer-readable medium, which can even is that, to print the paper or other suitable media of described program thereon, because Can then to enter edlin, interpretation or suitable with other if necessary for example by carrying out optical scanner to paper or other media Mode is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the application can be realized with hardware, software, firmware or combinations thereof.Above-mentioned In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage Or firmware is realized.Such as, if realized with hardware with another embodiment, following skill well known in the art can be used Any one of art or their combination are realized:With the logic gates for realizing logic function to data-signal from Logic circuit is dissipated, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (Programmable Gate Array;Hereinafter referred to as:PGA), field programmable gate array (Field Programmable Gate Array;Below Referred to as:FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the application can be integrated in a processing module, can also That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..Although have been shown and retouch above Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, it is impossible to be interpreted as the limit to the application System, one of ordinary skill in the art can be changed to above-described embodiment, change, replace and become within the scope of application Type.

Claims (12)

  1. A kind of 1. method for establishing human 3d model, it is characterised in that including:
    Receive the configured information that user opens self scanning;
    According to the configured information, projected using the Space Rotating residing for the black light light source to the user in terminal device Encoded heterogeneous texture light;
    Using the black light camera in the terminal device according to heterogeneous texture described in the black light light source projects Light identical direction of rotation, is acquired to the image of the user, obtains the structure light figure with heterogeneous texture light pattern Picture;
    The structure light image progress panoramic mosaic obtained will be gathered, obtain the overall structure light image of the user;
    The overall threedimensional model of the user is established according to the overall structure light image of the user.
  2. 2. according to the method for claim 1, it is characterised in that the black light light source using in terminal device is to institute Stating the encoded heterogeneous texture light of the projection of the Space Rotating residing for user includes:
    Using the black light light source in terminal device according to order from bottom to up or from top to bottom, to residing for the user Space Rotating project encoded heterogeneous texture light.
  3. 3. according to the method for claim 1, it is characterised in that the structure light image overall according to the user is established The overall threedimensional model of the user includes:
    The overall structure light image of the user is carried out to calculate processing acquisition depth image;
    According to the depth image, the overall threedimensional model of the user is established with reference to the overall color information of the user.
  4. 4. according to the method for claim 3, it is characterised in that it is described according to the depth image, it is whole with reference to the user The color information of body, which establishes the overall threedimensional model of the user, to be included:
    The feature extracted respectively from the depth image and the feature extracted from the color information are matched somebody with somebody The processing of accurate and Fusion Features;
    According to the feature after fusion, the overall threedimensional model of the user is established.
  5. 5. according to the method described in claim 1-4 any one, it is characterised in that the structure overall according to the user Light image is established after the overall threedimensional model of the user, in addition to:
    According to the threedimensional model that the user is overall, the human body information of the user is obtained.
  6. 6. a kind of device for establishing human 3d model, is arranged in terminal device, it is characterised in that described to establish human body three-dimensional The device of model includes:
    Receiving module, the configured information of self scanning is opened for receiving user;
    Projection module, for the configured information received according to the receiving module, utilize the black light light source in terminal device Encoded heterogeneous texture light is projected to the Space Rotating residing for the user;
    Acquisition module, for using the black light camera in the terminal device according to the black light light source projects institute Heterogeneous texture light identical direction of rotation is stated, the image of the user is acquired, acquisition carries heterogeneous texture light figure The structure light image of case;
    Concatenation module, panoramic mosaic is carried out for the acquisition module to be gathered to the structure light image obtained, obtains the user Overall structure light image;
    Module is established, it is whole that the overall structure light image of the user for being obtained according to the concatenation module establishes the user The threedimensional model of body.
  7. 7. device according to claim 6, it is characterised in that
    The projection module, specifically for utilizing the black light light source in terminal device according to from bottom to up or from top to bottom Order, project encoded heterogeneous texture light to the Space Rotating residing for the user.
  8. 8. device according to claim 6, it is characterised in that the module of establishing includes:
    Image obtains submodule, for carrying out calculating processing acquisition depth image to the overall structure light image of the user;
    Model setting up submodule, it is overall with reference to the user for obtaining the depth image of submodule acquisition according to described image Color information establish the overall threedimensional model of the user.
  9. 9. device according to claim 8, it is characterised in that
    The model setting up submodule, specifically for the feature that will be extracted respectively from the depth image and from the color The feature extracted in multimedia message carries out registration and Fusion Features processing, and according to the feature after fusion, it is overall to establish the user Threedimensional model.
  10. 10. according to the device described in claim 6-9 any one, it is characterised in that also include:
    Acquisition module, for establishing user's entirety according to the overall structure light image of the user in the module of establishing After threedimensional model, according to the threedimensional model that the user is overall, the human body information of the user is obtained.
  11. A kind of 11. terminal device, it is characterised in that including:Receiver, black light light source, black light camera, memory, Processor and it is stored in the computer program that can be run on the memory and on the processor;
    The receiver, the configured information of self scanning is opened for receiving user;
    The black light light source, for the configured information received according to the receiver, using invisible in terminal device Space Rotating residing for from radiant to the user projects encoded heterogeneous texture light;
    The black light camera, for being rotated according to heterogeneous texture light identical described in the black light light source projects Direction, the image of the user is acquired, obtains the structure light image with heterogeneous texture light pattern;
    The processor, for performing the computer program, realize the method as described in any in claim 1-5.
  12. 12. a kind of non-transitorycomputer readable storage medium, is stored thereon with computer program, it is characterised in that the meter The method as described in any in claim 1-5 is realized when calculation machine program is executed by processor.
CN201710676293.9A 2017-08-09 2017-08-09 Establish the method, apparatus and terminal device of human 3d model Pending CN107507272A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710676293.9A CN107507272A (en) 2017-08-09 2017-08-09 Establish the method, apparatus and terminal device of human 3d model

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710676293.9A CN107507272A (en) 2017-08-09 2017-08-09 Establish the method, apparatus and terminal device of human 3d model

Publications (1)

Publication Number Publication Date
CN107507272A true CN107507272A (en) 2017-12-22

Family

ID=60689578

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710676293.9A Pending CN107507272A (en) 2017-08-09 2017-08-09 Establish the method, apparatus and terminal device of human 3d model

Country Status (1)

Country Link
CN (1) CN107507272A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109499010A (en) * 2018-12-21 2019-03-22 苏州雷泰医疗科技有限公司 Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction
CN110276831A (en) * 2019-06-28 2019-09-24 Oppo广东移动通信有限公司 Constructing method and device, equipment, the computer readable storage medium of threedimensional model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110074932A1 (en) * 2009-08-27 2011-03-31 California Institute Of Technology Accurate 3D Object Reconstruction Using a Handheld Device with a Projected Light Pattern
CN205448962U (en) * 2015-12-31 2016-08-10 深圳先进技术研究院 Mobile terminal with three -dimensional scanning function
CN106355610A (en) * 2016-08-31 2017-01-25 杭州远舟医疗科技有限公司 Three-dimensional human body surface reconstruction method and device
CN106572340A (en) * 2016-10-27 2017-04-19 深圳奥比中光科技有限公司 Camera shooting system, mobile terminal and image processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110074932A1 (en) * 2009-08-27 2011-03-31 California Institute Of Technology Accurate 3D Object Reconstruction Using a Handheld Device with a Projected Light Pattern
CN205448962U (en) * 2015-12-31 2016-08-10 深圳先进技术研究院 Mobile terminal with three -dimensional scanning function
CN106355610A (en) * 2016-08-31 2017-01-25 杭州远舟医疗科技有限公司 Three-dimensional human body surface reconstruction method and device
CN106572340A (en) * 2016-10-27 2017-04-19 深圳奥比中光科技有限公司 Camera shooting system, mobile terminal and image processing method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109499010A (en) * 2018-12-21 2019-03-22 苏州雷泰医疗科技有限公司 Based on infrared and radiotherapy auxiliary system and its method of visible light three-dimensional reconstruction
CN109499010B (en) * 2018-12-21 2021-06-08 苏州雷泰医疗科技有限公司 Radiotherapy auxiliary system based on infrared and visible light three-dimensional reconstruction and method thereof
CN110276831A (en) * 2019-06-28 2019-09-24 Oppo广东移动通信有限公司 Constructing method and device, equipment, the computer readable storage medium of threedimensional model
CN110276831B (en) * 2019-06-28 2022-03-18 Oppo广东移动通信有限公司 Method and device for constructing three-dimensional model, equipment and computer-readable storage medium

Similar Documents

Publication Publication Date Title
CN108154550B (en) RGBD camera-based real-time three-dimensional face reconstruction method
US9317970B2 (en) Coupled reconstruction of hair and skin
CN107481304A (en) The method and its device of virtual image are built in scene of game
CN108765273A (en) The virtual lift face method and apparatus that face is taken pictures
CN107479801A (en) Displaying method of terminal, device and terminal based on user's expression
CN107682607A (en) Image acquiring method, device, mobile terminal and storage medium
CN107480612A (en) Recognition methods, device and the terminal device of figure action
JP6573907B2 (en) System, method, apparatus, and computer readable storage medium for collecting color information about 3D scanned objects
CN107481318A (en) Replacement method, device and the terminal device of user's head portrait
CN107507269A (en) Personalized three-dimensional model generating method, device and terminal device
CN107563304A (en) Unlocking terminal equipment method and device, terminal device
CN107481317A (en) The facial method of adjustment and its device of face 3D models
CN110998669A (en) Image processing apparatus and method
CN107452034A (en) Image processing method and its device
CN107551549A (en) Video game image method of adjustment and its device
CN107517346A (en) Photographic method, device and mobile device based on structure light
CN106165387A (en) Light field processing method
CN107480615A (en) U.S. face processing method, device and mobile device
CN107592449A (en) Three-dimension modeling method, apparatus and mobile terminal
CN107481101A (en) Wear the clothes recommendation method and its device
CN107491744A (en) Human body personal identification method, device, mobile terminal and storage medium
CN107483845A (en) Photographic method and its device
CN108876709A (en) Method for beautifying faces, device, electronic equipment and readable storage medium storing program for executing
CN107370950A (en) Focusing process method, apparatus and mobile terminal
CN107392874A (en) U.S. face processing method, device and mobile device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20171222

RJ01 Rejection of invention patent application after publication