CN102156810A - Augmented reality real-time virtual fitting system and method thereof - Google Patents
Augmented reality real-time virtual fitting system and method thereof Download PDFInfo
- Publication number
- CN102156810A CN102156810A CN2011100812034A CN201110081203A CN102156810A CN 102156810 A CN102156810 A CN 102156810A CN 2011100812034 A CN2011100812034 A CN 2011100812034A CN 201110081203 A CN201110081203 A CN 201110081203A CN 102156810 A CN102156810 A CN 102156810A
- Authority
- CN
- China
- Prior art keywords
- model
- dimensional model
- clothes
- human
- fitting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides an augmented reality real-time virtual fitting system and a method thereof. The augmented reality real-time virtual fitting system comprises an optical camera, a depth camera, a human three-dimensional model module, a garment three-dimensional model module, a three-dimensional model fusion module and a live-action fusion module. The optical camera is used for obtaining live-action video information in real time; the depth camera is used for obtaining human identifying information in real time; the human three-dimensional model module is used for generating a human three-dimensional model according to the human identifying information; the garment three-dimensional model module is used for generating a garment three-dimensional model according to the human identifying information; the three-dimensional model fusion module is used for fusing the human three-dimensional model with the garment three-dimensional model to generate a fitting three-dimensional model; and the live-action fusion module is used for fusing the fitting three-dimensional model with the live-action video information to generate fitting video information. The augmented reality real-time virtual fitting system and the method thereof provided by the invention can realistically display the fitting effect of the experiencer and improve the effect of virtual fitting.
Description
Technical field
The present invention relates to the augmented reality technology, relate in particular to a kind of augmented reality real-time virtual dressing system and method.
Background technology
The augmented reality technology, it is a kind of technology that combines computing machine subjects such as image recognition is followed the trail of, motion-captured, virtual reality, the stack in real time of virtual three-dimensional model animation, video, literal, picture digital information is shown in the real scene, and realizes the human-computer interaction technology of the innovation of nature interaction with real object or user.
The virtual fitting system of prior art is a supporting technology with virtual reality (Virtual Reality) generally, allows the virtual 3D body model that designs show the wearing and the arranging effect of clothes in conjunction with the virtual 3D clothes of different styles, size.But since try on a dress be the 3D manikin that designs, can not be with the human figure of not trying truly the person on, the colour of skin is real-time combines, and can not truly show the satisfied experience of trying on.
Summary of the invention
The invention provides a kind of augmented reality real-time virtual dressing system and method, to improve the effect of virtual fitting.
The invention provides a kind of augmented reality real-time virtual dressing system, comprising:
Optical camera is used for obtaining in real time the outdoor scene video information;
Depth camera is used for obtaining in real time fitting person's human body identification information;
The human 3d model module is connected with described depth camera, is used for generating human 3d model according to described human body identification information;
Clothes three-dimensional model module links to each other with described depth camera, is used for generating the clothes three-dimensional model according to described human body identification information;
The three-dimensional model Fusion Module links to each other with described clothes three-dimensional model module with described human 3d model module respectively, is used for described human 3d model is merged mutually with described clothes three-dimensional model, generates the fitting three-dimensional model;
The outdoor scene Fusion Module links to each other with described three-dimensional model Fusion Module with described optical camera respectively, is used for described fitting three-dimensional model is merged mutually with described outdoor scene video information, generates the fitting video information.
Aforesaid augmented reality real-time virtual dressing system also comprises:
First correction module links to each other with described optical camera, is used for according to default focus information described optical camera being demarcated;
Second correction module links to each other with described depth camera with described optical camera respectively, is used for described optical camera and described depth camera are adjusted into synchronous same visual angle.
Aforesaid augmented reality real-time virtual dressing system, wherein,
Described human body identification information comprises appearance information and action message; Correspondingly,
Described depth camera comprises appearance information capture unit and action message capture unit;
Described appearance information capture unit is used for catching in real time described fitting person's depth information of each pixel and described fitting person's profile information, to form described appearance information;
Described action message capture unit links to each other with described appearance information capture unit, is used for generating the bone nodal information according to described profile information, and generates described action message according to described bone nodal information.
Aforesaid augmented reality real-time virtual dressing system, described human 3d model comprises:
The manikin adjustment unit is used for the shape according to described appearance information adjustment human body basic model, generates the human body static model;
The human movement model unit is used for adjusting according to described action message the action of described human body static model, generates described human 3d model, so that described fitting person is simulated.
Aforesaid augmented reality real-time virtual dressing system, described clothes three-dimensional model comprises:
The garment form adjustment unit is used for the shape according to described appearance information adjustment clothes basic model, generates the clothes static model;
The garment form moving cell is used for adjusting according to described action message the position and the movement posture of described clothes static model, generates the clothes dynamic model;
The d engine unit is used for generating described clothes three-dimensional model according to described action message and described clothes dynamic model.
Aforesaid augmented reality real-time virtual dressing system, described three-dimensional model Fusion Module comprises:
Assembled unit is used for described human 3d model and the combination of described clothes three-dimensional model are generated and block three-dimensional model;
Rendering unit is used for the described three-dimensional model that blocks is played up;
The transparence unit is used for the human 3d model transparence of blocking three-dimensional model after playing up is handled, and generates described fitting three-dimensional model.
The invention provides a kind of augmented reality real-time virtual fitting method, comprising:
Optical camera is obtained the outdoor scene video information in real time;
Depth camera is obtained fitting person's human body identification information in real time;
The human body identification information that the human 3d model module is obtained according to described depth camera generates human 3d model;
The human body identification information that clothes three-dimensional model module is obtained according to described depth camera generates the clothes three-dimensional model;
The described human 3d model that the three-dimensional model Fusion Module generates described human 3d model module respectively merges mutually with the described clothes three-dimensional model that described clothes three-dimensional model module generates, and generates the fitting three-dimensional model;
The outdoor scene Fusion Module merges the described fitting three-dimensional model that described clothes three-dimensional model module generates with the described outdoor scene video information that described optical camera is obtained respectively mutually, generates the fitting video information.
Aforesaid augmented reality real-time virtual fitting method, described optical camera is obtained before the outdoor scene video information in real time, also comprises:
First correction module is demarcated described optical camera according to default focus information;
Second correction module is adjusted into synchronous same visual angle with described optical camera and described depth camera.
Aforesaid augmented reality real-time virtual fitting method, described human body identification information comprises appearance information and action message; Correspondingly, described depth camera is obtained fitting person's human body identification information in real time, comprising:
The depth information of each pixel of the described fitting person of the real-time seizure of described depth camera and described fitting person's profile information are to form described appearance information;
Described depth camera generates the bone nodal information according to described profile information, and generates described action message according to described bone nodal information.
Aforesaid augmented reality real-time virtual fitting method, the human body identification information that described human 3d model module is obtained according to described depth camera generates human 3d model, comprising:
Described human 3d model module generates the human body static model according to the shape of described appearance information adjustment human body basic model;
Described human 3d model module is adjusted the action of described human body static model according to described action message, generates described human 3d model, so that described fitting person is simulated.
Aforesaid augmented reality real-time virtual fitting method, the human body identification information that described clothes three-dimensional model module is obtained according to described depth camera generates the clothes three-dimensional model, comprising:
Described clothes three-dimensional model module generates the clothes static model according to the shape of described appearance information adjustment clothes basic model;
Described clothes three-dimensional model module is adjusted the position and the movement posture of described clothes static model according to described action message, generates the clothes dynamic model;
Described clothes three-dimensional model module generates described clothes three-dimensional model according to described action message and described clothes dynamic model.
Aforesaid augmented reality real-time virtual fitting method, the described human 3d model that described three-dimensional model Fusion Module generates described human 3d model module respectively merges mutually with the described clothes three-dimensional model that described clothes three-dimensional model module generates, generate the fitting three-dimensional model, comprising:
Described three-dimensional model Fusion Module generates described human 3d model and the combination of described clothes three-dimensional model to block three-dimensional model;
Described three-dimensional model Fusion Module is played up the described three-dimensional model that blocks;
The human 3d model transparence of blocking in the three-dimensional model after described three-dimensional model Fusion Module will be played up is handled, and generates described fitting three-dimensional model.
As shown from the above technical solution, augmented reality real-time virtual dressing system provided by the invention and method, obtain the human body identification information in real time by depth camera, and according to this human body identification information generation human 3d model and clothes three-dimensional model, the clothes three-dimensional model can conform to fitting person's build, and can show fitting person when putting on clothes, clothes showed and fitting person's health curve corresponding effect.And the fusion treatment by human 3d model and clothes three-dimensional model generates the fitting three-dimensional model, when making the fitting three-dimensional model merge with the outdoor scene video information, the effect that shows is not only the stack of the two, but can combine with fitting person's human figure, improved the effect of virtual fitting.
Description of drawings
A kind of augmented reality real-time virtual dressing system structural representation that Fig. 1 provides for the embodiment of the invention;
The another kind of augmented reality real-time virtual dressing system structural representation that Fig. 2 provides for the embodiment of the invention;
The augmented reality real-time virtual fitting method process flow diagram that Fig. 3 provides for the embodiment of the invention.
Reference numeral:
The 12-optical camera; The 11-depth camera;
13-human 3d model module; 14-clothes three-dimensional model module;
15-three-dimensional model Fusion Module; 16-outdoor scene Fusion Module;
17-first correction module; 18-second correction module;
111-appearance information capture unit; 112-action message capture unit;
131-manikin adjustment unit; 132-human movement model unit;
141-garment form adjustment unit; 142-garment form moving cell;
143-d engine unit; The 151-assembled unit;
The 152-rendering unit; 153-transparence unit.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention is clearer,, the technical scheme in the embodiment of the invention is clearly and completely described below in conjunction with the embodiment of the invention.Need to prove that in accompanying drawing or instructions, similar or components identical is all used identical Reference numeral.
A kind of augmented reality real-time virtual dressing system structural representation that Fig. 1 provides for the embodiment of the invention, as shown in Figure 1, this augmented reality real-time virtual dressing system comprises optical camera 12, depth camera 11, human 3d model module 13, clothes three-dimensional model module 14, three-dimensional model Fusion Module 15 and outdoor scene Fusion Module 16.Optical camera 12 is used for obtaining in real time the outdoor scene video information.Depth camera 11 is used for obtaining in real time fitting person's human body identification information.Human 3d model module 13 is connected with depth camera 11, is used for generating human 3d model according to the human body identification information.Clothes three-dimensional model module 14 links to each other with depth camera 11, is used for generating the clothes three-dimensional model according to the human body identification information.Three-dimensional model Fusion Module 15 links to each other with clothes three-dimensional model module 14 with human 3d model module 13 respectively, is used for human 3d model is merged mutually with the clothes three-dimensional model, generates the fitting three-dimensional model.Outdoor scene Fusion Module 16 links to each other with three-dimensional model Fusion Module 15 with optical camera 12 respectively, is used for the fitting three-dimensional model is merged mutually with the outdoor scene video information, generates the fitting video information.
This augmented reality real-time virtual dressing system course of work in actual applications is specifically as follows: before fitting person stands in optical camera 12 and depth camera 11, optical camera 12 is obtained the outdoor scene video information in real time, promptly catches fitting person's video information and the residing ambient video information of fitting person in real time.Depth camera 11 is obtained fitting person's human body identification information in real time, and fitting person's human body identification information specifically can identify fitting person's appearance profile and action.Human 3d model module 13 generates human 3d model according to the human body identification information.Human 3d model module 13 specifically can generate human 3d model by the 3 D human body modeling algorithm according to the human body identification information that depth camera 11 is obtained.Specifically can store a plurality of clothes three-dimensional model samples in the clothes three-dimensional model module 14, the clothes that fitting person can select to like is tried on.The clothes three-dimensional model sample that clothes three-dimensional model module 14 is picked out fitting person, according to the human body identification information that depth camera 11 is obtained size and this clothes of clothes are adjusted processing at issuable gauffer of fitting person and distortion on one's body, generate the clothes three-dimensional model.Three-dimensional model Fusion Module 15 merges human 3d model and clothes three-dimensional model, generates the fitting three-dimensional model, and for example, when fitting person wore the clothes, the neck position can be blocked the back collar of clothes, then can show this effect in the fitting three-dimensional model of generation.Outdoor scene Fusion Module 16 is fused in the outdoor scene video of optical camera 12 seizure at the three-dimensional model of will fitting, generate the fitting video information, realized that the fitting three-dimensional model is in fitting person's effect on one's body, this fitting video information is shown to fitting person by display module, gives fitting person's impression just the same with the effect of fitting in the face of fitting mirror.
The augmented reality real-time virtual dressing system that present embodiment provides, obtain the human body identification information in real time by depth camera 11, and according to this human body identification information generation human 3d model and clothes three-dimensional model, the clothes three-dimensional model can conform to fitting person's build, and can show fitting person when putting on clothes, clothes showed and fitting person's health curve corresponding effect.And the fusion treatment by human 3d model and clothes three-dimensional model generates the fitting three-dimensional model, when making the fitting three-dimensional model merge with the outdoor scene video information, the effect that shows is not only the stack of the two, but can combine with fitting person's human figure, the fitting effect that has shown the person of trying has realistically improved the effect of virtual fitting.
The another kind of augmented reality real-time virtual dressing system structural representation that Fig. 2 provides for the embodiment of the invention, as shown in Figure 2, in the present embodiment, this augmented reality real-time virtual dressing system can also comprise first correction module 17 and second correction module 18.First correction module 17 links to each other with optical camera 12, is used for according to default focus information optical camera 12 being demarcated.Second correction module 18 links to each other with depth camera 11 with optical camera 12 respectively, is used for optical camera 12 and depth camera 11 are adjusted into synchronous same visual angle.
Before carrying out virtual fitting, can demarcate correction to optical camera 12 earlier, the default focus information of first correction module, 17 concrete bases carried out the demarcation of inside and outside parameter, make optical camera 12 obtain the outdoor scene video information based on calibrating parameters, and remove the lens distortion influence, the accurately size and the position coordinates of the screen display of specific range, position stack and the clothes three-dimensional model that calculating need be in outdoor scene.Second correction module 18 makes optical camera 12 and the synchronous same visual angle of virtual video camera, is embodied in to have identical angle, focal length and the visual field.Concrete also can passing through adjusted hardware parameter to realize the synchronous same visual angle to optical camera 12 and depth camera 11.By correction, can improve the effect that virtual three-dimensional model and outdoor scene video merge to optical camera 12 and depth camera 11.
In the present embodiment, the human body identification information comprises appearance information and action message.Correspondingly, depth camera 11 comprises appearance information capture unit 111 and action message capture unit 112.Appearance information capture unit 111 is used for catching in real time fitting person's depth information of each pixel and fitting person's profile information, to form appearance information.Appearance information is specifically as follows the fitting person's that crucial shape parameters such as fitting person's shoulder breadth, chest measurement, abdominal circumference, waistline, brachium, leg be long form profile information, and the depth information of each point on fitting person's health of each the pixel correspondence in the fitting person's that obtains of depth camera 11 the image, depth information be specially fitting person on one's body each point apart from the absolute distance of depth camera 11.Action message capture unit 112 links to each other with appearance information capture unit 111, is used for generating the bone nodal information according to profile information, and generates action message according to the bone nodal information.Action message capture unit 112 at first can identify the shape of front face human body by profile information, according to the front face human body shape human skeleton node is positioned, to obtain the bone nodal information.Concrete, the bone node is the crucial bone node of human motion for default motion bone node, by the tracking to those bone nodes, can realize the real-time seizure to human action.
In the present embodiment, human 3d model specifically can comprise manikin adjustment unit 131 and human movement model unit 132.Manikin adjustment unit 131 is used for adjusting according to appearance information the shape of human body basic model, generates the human body static model.Manikin adjustment unit 131 is adjusted the human body basic model according to appearance information on the basis of human body basic model, to generate the human body static model that are complementary with fitting person, can simplify the generating algorithm of human 3d model.Human movement model unit 132 is used for adjusting according to action message the action of human body static model, generates human 3d model, so that fitting person is simulated.Concrete, human body static model and the bone nodal information of pouncing in the action message of grasping can be bound, to realize human 3d model accurately duplicating human figure in the outdoor scene and action.
In the present embodiment, the clothes three-dimensional model specifically can comprise garment form adjustment unit 141, garment form moving cell 142 and d engine unit 143.Garment form adjustment unit 141 is used for adjusting according to appearance information the shape of clothes basic model, generates the clothes static model.Garment form adjustment unit 141 is adjusted the size and the wearing position of clothes basic model according to fitting person's appearance information on the basis of clothes basic model, reminds the clothes static model that are complementary to generate with fitting person.Garment form moving cell 142 is used for adjusting according to action message the position and the movement posture of clothes static model, generates the clothes dynamic model.The bone nodal information that garment form moving cell 142 specifically can be caught the binding of clothes static model in conjunction with the human action that identifies, calculates the locus and the athletic posture of clothes, to generate the clothes dynamic model.D engine unit 143 is used for according to action message and clothes dynamic model, generates the clothes three-dimensional model.Concrete, d engine unit 143 is according to action message, with the clothes dynamic model be out of shape, physics special efficacy such as fold.
In the present embodiment, three-dimensional model Fusion Module 15 specifically can comprise assembled unit 151, rendering unit 152 and transparence unit 153.Assembled unit 151 is used for human 3d model and the combination of clothes three-dimensional model are generated and block three-dimensional model.Rendering unit 152 is used for playing up blocking three-dimensional model.Transparence unit 153 is used for the human 3d model transparence of blocking three-dimensional model after playing up is handled, and generates the fitting three-dimensional model.Concrete, with assembled unit 151 human 3d models and the combination of clothes three-dimensional model, rendering unit 152 is specifically as follows d engine, by depth z-depth computing, do not play up blocking the position, to show occlusion effect, transparence unit 153 is handled the human 3d model transparence again, guaranteeing that the real human body video image that overlaps with the fitting three-dimensional model when the video superimpose is correctly shown, and be implemented under the ad-hoc location attitude correctly blocking of virtual costume after one's death.
In actual application, fitting person's fitting video information shows by display module, function button can be set so that video is amplified, dwindles and moves, can also be to the video image preservation of taking pictures.This augmented reality real-time virtual dressing system can also be connected with online shopping mall, when fitting person pleases oneself to the fitting result, can directly buy operation accordingly by buying button, has opened up brand-new clothes industry digital marketing means.
The augmented reality real-time virtual fitting method process flow diagram that Fig. 3 provides for the embodiment of the invention, as shown in Figure 3, the augmented reality real-time virtual fitting method that present embodiment provides can realize by the augmented reality real-time virtual dressing system that any embodiment of the present invention provides, but not as limit.This augmented reality real-time virtual fitting method comprises:
Step 20, depth camera are obtained fitting person's human body identification information in real time;
The human body identification information that step 30, human 3d model module are obtained according to depth camera generates human 3d model;
The human body identification information that step 40, clothes three-dimensional model module are obtained according to depth camera generates the clothes three-dimensional model;
The human 3d model that step 50, three-dimensional model Fusion Module generate the human 3d model module respectively merges mutually with the clothes three-dimensional model that clothes three-dimensional model module generates, and generates the fitting three-dimensional model;
The augmented reality real-time virtual fitting method that present embodiment provides, step 10 and step 20 can be carried out simultaneously, and step 30 and step 40 also can be carried out simultaneously, do not have inevitable sequential relationship.Obtain the human body identification information in real time by depth camera, and according to this human body identification information generation human 3d model and clothes three-dimensional model, the clothes three-dimensional model can conform to fitting person's build, and can show fitting person when putting on clothes, clothes showed and fitting person's health curve corresponding effect.And the fusion treatment by human 3d model and clothes three-dimensional model generates the fitting three-dimensional model, when making the fitting three-dimensional model merge with the outdoor scene video information, the effect that shows is not only the stack of the two, but can combine with fitting person's human figure, the fitting effect that has shown the person of trying has realistically improved the effect of virtual fitting.
In the present embodiment, step 10, optical camera are obtained before the outdoor scene video information in real time, can also may further comprise the steps:
Step 20, first correction module are demarcated optical camera according to default focus information;
By optical camera and depth camera are demarcated and proofreaied and correct, can improve the effect that virtual three-dimensional model and outdoor scene video merge.
In the present embodiment, concrete, the human body identification information comprises appearance information and action message.Correspondingly, step 20, depth camera are obtained fitting person's human body identification information in real time, specifically can may further comprise the steps:
Step 201, depth camera are caught fitting person's depth information of each pixel and fitting person's profile information in real time, to form appearance information;
Step 202, depth camera generate the bone nodal information according to profile information, and generate action message according to the bone nodal information.
In the present embodiment, the human body identification information that step 30, human 3d model module are obtained according to depth camera generates human 3d model, specifically can may further comprise the steps:
Step 301, human 3d model module are adjusted the shape of human body basic model according to appearance information, generate the human body static model;
Step 302, human 3d model module are adjusted the action of human body static model according to action message, generate human 3d model, so that fitting person is simulated.
Generate the human body static model that are complementary with fitting person by adjusting the human body basic model, can simplify the human 3d model generating algorithm according to appearance information.
In the present embodiment, the human body identification information that step 40, clothes three-dimensional model module are obtained according to depth camera generates the clothes three-dimensional model, specifically can may further comprise the steps:
Step 401, clothes three-dimensional model module are adjusted the shape of clothes basic model according to appearance information, generate the clothes static model;
Step 402, clothes three-dimensional model module are adjusted the position and the movement posture of clothes static model according to action message, generate the clothes dynamic model;
Step 403, clothes three-dimensional model module generate the clothes three-dimensional model according to action message and clothes dynamic model.
Adjust the shape of clothes basic model by appearance information, the clothes static model that generate, can be complementary with fitting person's build, and according to the position of action message adjustment clothes static model and the clothes dynamic model of movement posture province, make the clothes dynamic model can be in corresponding position, the performance corresponding effects according to fitting person's action.
In the present embodiment, the human 3d model that step 50, three-dimensional model Fusion Module generate the human 3d model module respectively merges mutually with the clothes three-dimensional model that clothes three-dimensional model module generates, and generates the fitting three-dimensional model, specifically can may further comprise the steps:
Step 501, three-dimensional model Fusion Module generate human 3d model and the combination of clothes three-dimensional model to block three-dimensional model;
Step 502, three-dimensional model Fusion Module are played up blocking three-dimensional model;
The human 3d model transparence of blocking in the three-dimensional model after step 503, three-dimensional model Fusion Module will be played up is handled, and generates the fitting three-dimensional model.
By garment form being blocked the processing at place, make the fitting three-dimensional model can really show the fitting effect.
Augmented reality real-time virtual dressing system and method that the embodiment of the invention provides, obtain the human body identification information in real time by depth camera, and according to this human body identification information generation human 3d model and clothes three-dimensional model, the clothes three-dimensional model can conform to fitting person's build, and can show fitting person when putting on clothes, clothes showed and fitting person's health curve corresponding effect.And the fusion treatment by human 3d model and clothes three-dimensional model generates the fitting three-dimensional model, when making the fitting three-dimensional model merge with the outdoor scene video information, the effect that shows is not only the stack of the two, but can combine with fitting person's human figure, shown the person's of trying fitting effect realistically.Virtual costume can change the fitting effect automatically according to fitting person's action, and the virtual costume that has solved under different human body rotational angle and the attitude shows in fitting person's correct stack on one's body, has improved the effect of virtual fitting.
It should be noted that at last: above embodiment only in order to technical scheme of the present invention to be described, is not intended to limit; Although with reference to previous embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that previous embodiment is put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of various embodiments of the present invention technical scheme.
Claims (12)
1. an augmented reality real-time virtual dressing system is characterized in that, comprising:
Optical camera is used for obtaining in real time the outdoor scene video information;
Depth camera is used for obtaining in real time fitting person's human body identification information;
The human 3d model module is connected with described depth camera, is used for generating human 3d model according to described human body identification information;
Clothes three-dimensional model module links to each other with described depth camera, is used for generating the clothes three-dimensional model according to described human body identification information;
The three-dimensional model Fusion Module links to each other with described clothes three-dimensional model module with described human 3d model module respectively, is used for described human 3d model is merged mutually with described clothes three-dimensional model, generates the fitting three-dimensional model;
The outdoor scene Fusion Module links to each other with described three-dimensional model Fusion Module with described optical camera respectively, is used for described fitting three-dimensional model is merged mutually with described outdoor scene video information, generates the fitting video information.
2. augmented reality real-time virtual dressing system according to claim 1 is characterized in that, also comprises:
First correction module links to each other with described optical camera, is used for according to default focus information described optical camera being demarcated;
Second correction module links to each other with described depth camera with described optical camera respectively, is used for described optical camera and described depth camera are adjusted into synchronous same visual angle.
3. augmented reality real-time virtual dressing system according to claim 1 and 2 is characterized in that:
Described human body identification information comprises appearance information and action message; Correspondingly,
Described depth camera comprises appearance information capture unit and action message capture unit;
Described appearance information capture unit is used for catching in real time described fitting person's depth information of each pixel and described fitting person's profile information, to form described appearance information;
Described action message capture unit links to each other with described appearance information capture unit, is used for generating the bone nodal information according to described profile information, and generates described action message according to described bone nodal information.
4. augmented reality real-time virtual dressing system according to claim 3 is characterized in that described human 3d model comprises:
The manikin adjustment unit is used for the shape according to described appearance information adjustment human body basic model, generates the human body static model;
The human movement model unit is used for adjusting according to described action message the action of described human body static model, generates described human 3d model, so that described fitting person is simulated.
5. augmented reality real-time virtual dressing system according to claim 3 is characterized in that, described clothes three-dimensional model comprises:
The garment form adjustment unit is used for the shape according to described appearance information adjustment clothes basic model, generates the clothes static model;
The garment form moving cell is used for adjusting according to described action message the position and the movement posture of described clothes static model, generates the clothes dynamic model;
The d engine unit is used for generating described clothes three-dimensional model according to described action message and described clothes dynamic model.
6. augmented reality real-time virtual dressing system according to claim 3 is characterized in that, described three-dimensional model Fusion Module comprises:
Assembled unit is used for described human 3d model and the combination of described clothes three-dimensional model are generated and block three-dimensional model;
Rendering unit is used for the described three-dimensional model that blocks is played up;
The transparence unit is used for the human 3d model transparence of blocking three-dimensional model after playing up is handled, and generates described fitting three-dimensional model.
7. an augmented reality real-time virtual fitting method is characterized in that, comprising:
Optical camera is obtained the outdoor scene video information in real time;
Depth camera is obtained fitting person's human body identification information in real time;
The human body identification information that the human 3d model module is obtained according to described depth camera generates human 3d model;
The human body identification information that clothes three-dimensional model module is obtained according to described depth camera generates the clothes three-dimensional model;
The described human 3d model that the three-dimensional model Fusion Module generates described human 3d model module respectively merges mutually with the described clothes three-dimensional model that described clothes three-dimensional model module generates, and generates the fitting three-dimensional model;
The outdoor scene Fusion Module merges the described fitting three-dimensional model that described clothes three-dimensional model module generates with the described outdoor scene video information that described optical camera is obtained respectively mutually, generates the fitting video information.
8. augmented reality real-time virtual fitting method according to claim 7 is characterized in that described optical camera is obtained before the outdoor scene video information in real time, also comprises:
First correction module is demarcated described optical camera according to default focus information;
Second correction module is adjusted into synchronous same visual angle with described optical camera and described depth camera.
9. according to claim 7 or 8 described augmented reality real-time virtual fitting methods, it is characterized in that described human body identification information comprises appearance information and action message; Correspondingly, described depth camera is obtained fitting person's human body identification information in real time, comprising:
The depth information of each pixel of the described fitting person of the real-time seizure of described depth camera and described fitting person's profile information are to form described appearance information;
Described depth camera generates the bone nodal information according to described profile information, and generates described action message according to described bone nodal information.
10. augmented reality real-time virtual fitting method according to claim 9 is characterized in that, the human body identification information that described human 3d model module is obtained according to described depth camera generates human 3d model, comprising:
Described human 3d model module generates the human body static model according to the shape of described appearance information adjustment human body basic model;
Described human 3d model module is adjusted the action of described human body static model according to described action message, generates described human 3d model, so that described fitting person is simulated.
11. augmented reality real-time virtual fitting method according to claim 9 is characterized in that, the human body identification information that described clothes three-dimensional model module is obtained according to described depth camera generates the clothes three-dimensional model, comprising:
Described clothes three-dimensional model module generates the clothes static model according to the shape of described appearance information adjustment clothes basic model;
Described clothes three-dimensional model module is adjusted the position and the movement posture of described clothes static model according to described action message, generates the clothes dynamic model;
Described clothes three-dimensional model module generates described clothes three-dimensional model according to described action message and described clothes dynamic model.
12. augmented reality real-time virtual fitting method according to claim 9, it is characterized in that, the described human 3d model that described three-dimensional model Fusion Module generates described human 3d model module respectively merges mutually with the described clothes three-dimensional model that described clothes three-dimensional model module generates, generate the fitting three-dimensional model, comprising:
Described three-dimensional model Fusion Module generates described human 3d model and the combination of described clothes three-dimensional model to block three-dimensional model;
Described three-dimensional model Fusion Module is played up the described three-dimensional model that blocks;
The human 3d model transparence of blocking in the three-dimensional model after described three-dimensional model Fusion Module will be played up is handled, and generates described fitting three-dimensional model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100812034A CN102156810A (en) | 2011-03-30 | 2011-03-30 | Augmented reality real-time virtual fitting system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011100812034A CN102156810A (en) | 2011-03-30 | 2011-03-30 | Augmented reality real-time virtual fitting system and method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102156810A true CN102156810A (en) | 2011-08-17 |
Family
ID=44438304
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011100812034A Pending CN102156810A (en) | 2011-03-30 | 2011-03-30 | Augmented reality real-time virtual fitting system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102156810A (en) |
Cited By (81)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102298797A (en) * | 2011-08-31 | 2011-12-28 | 深圳市美丽同盟科技有限公司 | Three-dimensional virtual fitting method, device and system |
| CN102314661A (en) * | 2011-09-07 | 2012-01-11 | 深圳市酷开网络科技有限公司 | Cloud computing-based virtual fitting system and method |
| CN102509224A (en) * | 2011-10-21 | 2012-06-20 | 佛山伊贝尔科技有限公司 | Range-image-acquisition-technology-based human body fitting method |
| CN102509349A (en) * | 2011-09-27 | 2012-06-20 | 深圳市朵唯志远科技有限公司 | Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal |
| CN102682211A (en) * | 2012-05-09 | 2012-09-19 | 晨星软件研发(深圳)有限公司 | Three-dimensional fitting method and device |
| CN102842089A (en) * | 2012-07-18 | 2012-12-26 | 上海交通大学 | Network virtual fit system based on 3D actual human body model and clothes model |
| CN102945530A (en) * | 2012-10-18 | 2013-02-27 | 贵州宝森科技有限公司 | 3D intelligent apparel fitting system and method |
| CN102982581A (en) * | 2011-09-05 | 2013-03-20 | 北京三星通信技术研究有限公司 | Virtual try-on system and method based on images |
| CN103106604A (en) * | 2013-01-23 | 2013-05-15 | 东华大学 | Three dimensional (3D) virtual fitting method based on somatosensory technology |
| CN103198461A (en) * | 2011-11-08 | 2013-07-10 | 索尼公司 | Image processing apparatus, image processing method, and program |
| CN103310342A (en) * | 2012-03-15 | 2013-09-18 | 凹凸电子（武汉）有限公司 | Electronic fitting method and electronic fitting device |
| CN103366402A (en) * | 2013-08-05 | 2013-10-23 | 上海趣搭网络科技有限公司 | Fast attitude synchronization method of three-dimensional virtual clothing |
| CN103533449A (en) * | 2012-12-20 | 2014-01-22 | Tcl集团股份有限公司 | Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television |
| US20140063056A1 (en) * | 2012-08-29 | 2014-03-06 | Koskar Inc. | Apparatus, system and method for virtually fitting wearable items |
| CN103678836A (en) * | 2012-08-30 | 2014-03-26 | 北京三星通信技术研究有限公司 | Virtual fit system and method |
| CN103799769A (en) * | 2012-11-07 | 2014-05-21 | 程抒一 | Digital virtual storage rack |
| CN103871106A (en) * | 2012-12-14 | 2014-06-18 | 韩国电子通信研究院 | Method of fitting virtual item using human body model and system for providing fitting service of virtual item |
| CN103871099A (en) * | 2014-03-24 | 2014-06-18 | 惠州Tcl移动通信有限公司 | 3D simulation matching processing method and system based on mobile terminal |
| CN103907138A (en) * | 2011-11-09 | 2014-07-02 | 索尼公司 | Information processing device, display control method, and program |
| CN104021590A (en) * | 2013-02-28 | 2014-09-03 | 北京三星通信技术研究有限公司 | Virtual try-on system and virtual try-on method |
| CN104081379A (en) * | 2011-10-27 | 2014-10-01 | 电子湾股份有限公司 | Visualization of items using augmented reality |
| CN104133942A (en) * | 2014-07-08 | 2014-11-05 | 上海置森数码技术有限公司 | Intelligent 3D life data cloud service system |
| CN104182886A (en) * | 2013-05-24 | 2014-12-03 | 比亚迪股份有限公司 | Virtual fitting method and mobile terminal for virtual fitting |
| CN104952113A (en) * | 2015-07-08 | 2015-09-30 | 北京理工大学 | Dress fitting experience method, system and equipment |
| CN105096246A (en) * | 2014-05-08 | 2015-11-25 | 腾讯科技（深圳）有限公司 | Image synthesis method and system |
| CN105184584A (en) * | 2015-09-17 | 2015-12-23 | 北京京东方多媒体科技有限公司 | Virtual fitting system and method |
| WO2016000304A1 (en) * | 2014-06-30 | 2016-01-07 | 京东方科技集团股份有限公司 | Virtual fitting method and virtual fitting system |
| CN105279795A (en) * | 2014-07-09 | 2016-01-27 | 先科媒体有限公司 | Augmented reality system based on 3D marker |
| CN105404392A (en) * | 2015-11-03 | 2016-03-16 | 北京英梅吉科技有限公司 | Monocular camera based virtual wearing method and system |
| WO2016045111A1 (en) * | 2014-09-28 | 2016-03-31 | 广州新节奏智能科技有限公司 | Intelligent shopping experience apparatus and experience method |
| CN105787751A (en) * | 2016-01-06 | 2016-07-20 | 湖南拓视觉信息技术有限公司 | 3D human body virtual fitting method and system |
| CN105788002A (en) * | 2016-01-06 | 2016-07-20 | 湖南拓视觉信息技术有限公司 | 3D virtual shoe fitting method and system |
| WO2016123769A1 (en) * | 2015-02-05 | 2016-08-11 | 周谆 | Human interaction method and system for trying on virtual accessory |
| CN105957139A (en) * | 2016-05-23 | 2016-09-21 | 矽照光电（厦门）有限公司 | AR (Augmented Reality) 3D model generation method |
| CN105989618A (en) * | 2014-08-08 | 2016-10-05 | 株式会社东芝 | Virtual try-on apparatus and virtual try-on method |
| CN106057067A (en) * | 2016-06-01 | 2016-10-26 | 浙江工业大学 | Translucent mark making method for augmented reality |
| CN106097442A (en) * | 2016-08-24 | 2016-11-09 | 广东华邦云计算股份有限公司 | A kind of intelligent simulation dressing system and application process thereof |
| CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
| CN106127846A (en) * | 2016-06-28 | 2016-11-16 | 乐视控股（北京）有限公司 | Virtual reality terminal and vision virtual method thereof and device |
| CN106157374A (en) * | 2016-07-12 | 2016-11-23 | 广州凡拓数字创意科技股份有限公司 | Numbers show system and method based on virtual reality |
| CN106157358A (en) * | 2015-03-26 | 2016-11-23 | 成都理想境界科技有限公司 | Object fusion method based on video image and terminal |
| CN106327290A (en) * | 2016-08-11 | 2017-01-11 | 安徽健搏信息科技有限公司 | Virtual fitting system based on augmented reality |
| CN106327562A (en) * | 2016-09-09 | 2017-01-11 | 武汉布偶猫科技有限公司 | Method of solving penetration problem in case of clothing collocation in three-dimensional simulation |
| CN106340064A (en) * | 2016-08-25 | 2017-01-18 | 北京大视景科技有限公司 | Mixed-reality sandbox device and method |
| CN106503286A (en) * | 2016-09-18 | 2017-03-15 | 福建网龙计算机网络信息技术有限公司 | The service of cutting the garment according to the figure and its system |
| CN106600638A (en) * | 2016-11-09 | 2017-04-26 | 深圳奥比中光科技有限公司 | Realization method of augmented reality |
| CN106650643A (en) * | 2016-12-06 | 2017-05-10 | 北京心有灵犀科技有限公司 | Method enabling jewelry to have enhanced reality function |
| CN107174826A (en) * | 2017-05-25 | 2017-09-19 | 合肥泽诺信息科技有限公司 | A kind of game role based on augmented reality is played the part of with the dressing system that changes the outfit |
| WO2017197951A1 (en) * | 2016-05-19 | 2017-11-23 | 京东方科技集团股份有限公司 | Rendering method in augmented reality scene, processing module, and augmented reality glasses |
| CN107481099A (en) * | 2017-07-28 | 2017-12-15 | 厦门大学 | Can 360 degree turn round real-time virtual fitting implementation method |
| CN107507269A (en) * | 2017-07-31 | 2017-12-22 | 广东欧珀移动通信有限公司 | Personalized three-dimensional model generating method, device and terminal device |
| CN107609946A (en) * | 2017-09-19 | 2018-01-19 | 北京优时尚科技有限责任公司 | A kind of display control method and computing device |
| CN107773254A (en) * | 2017-12-05 | 2018-03-09 | 苏州创捷传媒展览股份有限公司 | A kind of method and device for testing Consumer's Experience |
| CN107851323A (en) * | 2015-05-13 | 2018-03-27 | 无装饰实验室奥地利股份有限公司 | 3D body scan data instrument flow chart of data processing |
| CN107919066A (en) * | 2016-10-10 | 2018-04-17 | 北京七展国际数字科技有限公司 | The immersion display systems and method of a kind of arc curtain hyperbolic |
| CN108096836A (en) * | 2017-12-20 | 2018-06-01 | 深圳市百恩互动娱乐有限公司 | A kind of method that true man's real scene shooting makes game |
| CN108564612A (en) * | 2018-03-26 | 2018-09-21 | 广东欧珀移动通信有限公司 | Model display methods, device, storage medium and electronic equipment |
| CN108615261A (en) * | 2018-04-20 | 2018-10-02 | 深圳市天轨年华文化科技有限公司 | The processing method, processing unit and storage medium of image in augmented reality |
| CN108846885A (en) * | 2018-06-06 | 2018-11-20 | 广东您好科技有限公司 | A kind of model activating technology based on 3-D scanning |
| CN109003398A (en) * | 2012-06-14 | 2018-12-14 | 百利游戏技术有限公司 | System and method for augmented reality game |
| WO2019000464A1 (en) * | 2017-06-30 | 2019-01-03 | 广东欧珀移动通信有限公司 | Image display method and device, storage medium, and terminal |
| CN109200586A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Game implementation method and device based on augmented reality |
| CN109285212A (en) * | 2017-07-21 | 2019-01-29 | 中兴通讯股份有限公司 | A kind of augmented reality modeling method, computer readable storage medium and augmented reality model building device |
| US10210659B2 (en) | 2009-12-22 | 2019-02-19 | Ebay Inc. | Augmented reality system, method, and apparatus for displaying an item image in a contextual environment |
| CN109493161A (en) * | 2018-09-29 | 2019-03-19 | 北京小米移动软件有限公司 | The method and apparatus for carrying out virtual shopping using virtual reality |
| CN109685911A (en) * | 2018-12-13 | 2019-04-26 | 谷东科技有限公司 | A kind of the AR glasses and its implementation of achievable virtual fitting |
| US10423220B2 (en) | 2014-08-08 | 2019-09-24 | Kabushiki Kaisha Toshiba | Virtual try-on apparatus, virtual try-on method, and computer program product |
| CN110348370A (en) * | 2019-07-09 | 2019-10-18 | 北京猫眼视觉科技有限公司 | A kind of augmented reality system and method for human action identification |
| US10614602B2 (en) | 2011-12-29 | 2020-04-07 | Ebay Inc. | Personal augmented reality |
| CN111709814A (en) * | 2020-06-22 | 2020-09-25 | 辽宁轻工职业学院 | 3D virtual fitting method for clothing sales |
| CN112200717A (en) * | 2020-10-26 | 2021-01-08 | 广州紫为云科技有限公司 | Complex garment virtual fitting method and device based on neural network and storage medium |
| US10936650B2 (en) | 2008-03-05 | 2021-03-02 | Ebay Inc. | Method and apparatus for image recognition services |
| CN112508639A (en) * | 2020-11-30 | 2021-03-16 | 上海联影智能医疗科技有限公司 | Interaction method of virtualized human body system, electronic device and computer readable medium |
| US10956775B2 (en) | 2008-03-05 | 2021-03-23 | Ebay Inc. | Identification of items depicted in images |
| CN113240819A (en) * | 2021-05-24 | 2021-08-10 | 中国农业银行股份有限公司 | Wearing effect determination method and device and electronic equipment |
| CN113255025A (en) * | 2014-12-23 | 2021-08-13 | 电子湾有限公司 | System and method for generating virtual content from three-dimensional models |
| WO2021179919A1 (en) * | 2020-03-10 | 2021-09-16 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | System and method for virtual fitting during live streaming |
| CN114063860A (en) * | 2021-11-10 | 2022-02-18 | 西安维沃软件技术有限公司 | Image display method and device |
| CN114299264A (en) * | 2020-09-23 | 2022-04-08 | 秀铺菲公司 | System and method for generating augmented reality content based on warped three-dimensional model |
| US11651398B2 (en) | 2012-06-29 | 2023-05-16 | Ebay Inc. | Contextual menus based on image recognition |
| WO2023134269A1 (en) * | 2022-01-17 | 2023-07-20 | 海信视像科技股份有限公司 | Display device, and virtual fitting system and method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1975775A (en) * | 2005-12-01 | 2007-06-06 | 国际商业机器公司 | Consumer representation rendering method and system with selected merchandise |
| CN101145238A (en) * | 2007-02-08 | 2008-03-19 | 罗中根 | Super realistic three-dimensional holographic intelligent dummy human system and method |
| CN201111142Y (en) * | 2007-08-24 | 2008-09-03 | 北京和炫科技有限公司 | Three-dimensional virtual fitting platform system based on network |
| CN101256655A (en) * | 2007-02-28 | 2008-09-03 | 尹红伟 | Real human body three-dimensional tridimensional virtual fitting system |
| CN101398942A (en) * | 2008-04-24 | 2009-04-01 | 中山大学 | Three-dimensional fitting emulation system |
| CN101937546A (en) * | 2010-08-31 | 2011-01-05 | 中山大学 | On-line shopping system and method thereof |
-
2011
- 2011-03-30 CN CN2011100812034A patent/CN102156810A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1975775A (en) * | 2005-12-01 | 2007-06-06 | 国际商业机器公司 | Consumer representation rendering method and system with selected merchandise |
| CN101145238A (en) * | 2007-02-08 | 2008-03-19 | 罗中根 | Super realistic three-dimensional holographic intelligent dummy human system and method |
| CN101256655A (en) * | 2007-02-28 | 2008-09-03 | 尹红伟 | Real human body three-dimensional tridimensional virtual fitting system |
| CN201111142Y (en) * | 2007-08-24 | 2008-09-03 | 北京和炫科技有限公司 | Three-dimensional virtual fitting platform system based on network |
| CN101398942A (en) * | 2008-04-24 | 2009-04-01 | 中山大学 | Three-dimensional fitting emulation system |
| CN101937546A (en) * | 2010-08-31 | 2011-01-05 | 中山大学 | On-line shopping system and method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 曹惠龙: "三维虚拟与实景视频的融合平台研究及设计", 《电脑知识与技术》 * |
Cited By (115)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11727054B2 (en) | 2008-03-05 | 2023-08-15 | Ebay Inc. | Method and apparatus for image recognition services |
| US10936650B2 (en) | 2008-03-05 | 2021-03-02 | Ebay Inc. | Method and apparatus for image recognition services |
| US11694427B2 (en) | 2008-03-05 | 2023-07-04 | Ebay Inc. | Identification of items depicted in images |
| US10956775B2 (en) | 2008-03-05 | 2021-03-23 | Ebay Inc. | Identification of items depicted in images |
| US10210659B2 (en) | 2009-12-22 | 2019-02-19 | Ebay Inc. | Augmented reality system, method, and apparatus for displaying an item image in a contextual environment |
| CN102298797A (en) * | 2011-08-31 | 2011-12-28 | 深圳市美丽同盟科技有限公司 | Three-dimensional virtual fitting method, device and system |
| CN102982581A (en) * | 2011-09-05 | 2013-03-20 | 北京三星通信技术研究有限公司 | Virtual try-on system and method based on images |
| CN102982581B (en) * | 2011-09-05 | 2017-04-05 | 北京三星通信技术研究有限公司 | System for virtually trying and method based on image |
| CN102314661A (en) * | 2011-09-07 | 2012-01-11 | 深圳市酷开网络科技有限公司 | Cloud computing-based virtual fitting system and method |
| CN102509349A (en) * | 2011-09-27 | 2012-06-20 | 深圳市朵唯志远科技有限公司 | Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal |
| CN102509349B (en) * | 2011-09-27 | 2015-07-15 | 深圳市朵唯志远科技有限公司 | Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal |
| CN102509224A (en) * | 2011-10-21 | 2012-06-20 | 佛山伊贝尔科技有限公司 | Range-image-acquisition-technology-based human body fitting method |
| US11475509B2 (en) | 2011-10-27 | 2022-10-18 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
| US10147134B2 (en) | 2011-10-27 | 2018-12-04 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
| US9449342B2 (en) | 2011-10-27 | 2016-09-20 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
| US10628877B2 (en) | 2011-10-27 | 2020-04-21 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
| CN104081379A (en) * | 2011-10-27 | 2014-10-01 | 电子湾股份有限公司 | Visualization of items using augmented reality |
| US11113755B2 (en) | 2011-10-27 | 2021-09-07 | Ebay Inc. | System and method for visualization of items in an environment using augmented reality |
| CN109934635A (en) * | 2011-10-27 | 2019-06-25 | 电子湾股份有限公司 | Use the visualization of the article of augmented reality |
| JP2019029026A (en) * | 2011-10-27 | 2019-02-21 | イーベイ インク．Ｅｂａｙ Ｉｎｃ． | Visualization of items using augmented reality |
| US10163419B2 (en) | 2011-11-08 | 2018-12-25 | Sony Corporation | Image processing to combine virtual object with captured image |
| CN103198461B (en) * | 2011-11-08 | 2017-12-19 | 索尼公司 | Image processing equipment, image processing method and program |
| US11024251B2 (en) | 2011-11-08 | 2021-06-01 | Sony Corporation | Image processing apparatus and image processing method |
| US10720122B2 (en) | 2011-11-08 | 2020-07-21 | Sony Corporation | Image processing apparatus and image processing method |
| CN103198461A (en) * | 2011-11-08 | 2013-07-10 | 索尼公司 | Image processing apparatus, image processing method, and program |
| CN103907138A (en) * | 2011-11-09 | 2014-07-02 | 索尼公司 | Information processing device, display control method, and program |
| CN103907138B (en) * | 2011-11-09 | 2017-11-24 | 索尼公司 | Message processing device and display control method |
| US9865094B2 (en) | 2011-11-09 | 2018-01-09 | Sony Corporation | Information processing apparatus, display control method, and program |
| US10614602B2 (en) | 2011-12-29 | 2020-04-07 | Ebay Inc. | Personal augmented reality |
| CN103310342A (en) * | 2012-03-15 | 2013-09-18 | 凹凸电子（武汉）有限公司 | Electronic fitting method and electronic fitting device |
| CN102682211A (en) * | 2012-05-09 | 2012-09-19 | 晨星软件研发(深圳)有限公司 | Three-dimensional fitting method and device |
| CN109003398A (en) * | 2012-06-14 | 2018-12-14 | 百利游戏技术有限公司 | System and method for augmented reality game |
| US11651398B2 (en) | 2012-06-29 | 2023-05-16 | Ebay Inc. | Contextual menus based on image recognition |
| CN102842089A (en) * | 2012-07-18 | 2012-12-26 | 上海交通大学 | Network virtual fit system based on 3D actual human body model and clothes model |
| US20140063056A1 (en) * | 2012-08-29 | 2014-03-06 | Koskar Inc. | Apparatus, system and method for virtually fitting wearable items |
| CN103678836A (en) * | 2012-08-30 | 2014-03-26 | 北京三星通信技术研究有限公司 | Virtual fit system and method |
| CN102945530A (en) * | 2012-10-18 | 2013-02-27 | 贵州宝森科技有限公司 | 3D intelligent apparel fitting system and method |
| CN103799769A (en) * | 2012-11-07 | 2014-05-21 | 程抒一 | Digital virtual storage rack |
| CN109598798A (en) * | 2012-12-14 | 2019-04-09 | 韩国电子通信研究院 | Virtual object approximating method and virtual object are fitted service system |
| US9607419B2 (en) | 2012-12-14 | 2017-03-28 | Electronics And Telecommunications Research Institute | Method of fitting virtual item using human body model and system for providing fitting service of virtual item |
| CN109598798B (en) * | 2012-12-14 | 2023-11-28 | 韩国电子通信研究院 | Virtual object fitting method and virtual object fitting service system |
| CN103871106A (en) * | 2012-12-14 | 2014-06-18 | 韩国电子通信研究院 | Method of fitting virtual item using human body model and system for providing fitting service of virtual item |
| CN103533449A (en) * | 2012-12-20 | 2014-01-22 | Tcl集团股份有限公司 | Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television |
| CN103106604B (en) * | 2013-01-23 | 2016-04-06 | 东华大学 | Based on the 3D virtual fit method of body sense technology |
| CN103106604A (en) * | 2013-01-23 | 2013-05-15 | 东华大学 | Three dimensional (3D) virtual fitting method based on somatosensory technology |
| CN104021590A (en) * | 2013-02-28 | 2014-09-03 | 北京三星通信技术研究有限公司 | Virtual try-on system and virtual try-on method |
| CN104182886A (en) * | 2013-05-24 | 2014-12-03 | 比亚迪股份有限公司 | Virtual fitting method and mobile terminal for virtual fitting |
| CN103366402B (en) * | 2013-08-05 | 2015-12-09 | 上海趣搭网络科技有限公司 | The rapid posture-synchronizing method of three-dimensional dress ornament |
| CN103366402A (en) * | 2013-08-05 | 2013-10-23 | 上海趣搭网络科技有限公司 | Fast attitude synchronization method of three-dimensional virtual clothing |
| CN103871099A (en) * | 2014-03-24 | 2014-06-18 | 惠州Tcl移动通信有限公司 | 3D simulation matching processing method and system based on mobile terminal |
| CN105096246A (en) * | 2014-05-08 | 2015-11-25 | 腾讯科技（深圳）有限公司 | Image synthesis method and system |
| WO2016000304A1 (en) * | 2014-06-30 | 2016-01-07 | 京东方科技集团股份有限公司 | Virtual fitting method and virtual fitting system |
| CN104133942A (en) * | 2014-07-08 | 2014-11-05 | 上海置森数码技术有限公司 | Intelligent 3D life data cloud service system |
| CN105279795A (en) * | 2014-07-09 | 2016-01-27 | 先科媒体有限公司 | Augmented reality system based on 3D marker |
| CN105279795B (en) * | 2014-07-09 | 2018-07-24 | 先科媒体有限公司 | Augmented reality system based on 3D marker |
| CN105989618A (en) * | 2014-08-08 | 2016-10-05 | 株式会社东芝 | Virtual try-on apparatus and virtual try-on method |
| US10423220B2 (en) | 2014-08-08 | 2019-09-24 | Kabushiki Kaisha Toshiba | Virtual try-on apparatus, virtual try-on method, and computer program product |
| WO2016045111A1 (en) * | 2014-09-28 | 2016-03-31 | 广州新节奏智能科技有限公司 | Intelligent shopping experience apparatus and experience method |
| CN113255025A (en) * | 2014-12-23 | 2021-08-13 | 电子湾有限公司 | System and method for generating virtual content from three-dimensional models |
| WO2016123769A1 (en) * | 2015-02-05 | 2016-08-11 | 周谆 | Human interaction method and system for trying on virtual accessory |
| CN106157358A (en) * | 2015-03-26 | 2016-11-23 | 成都理想境界科技有限公司 | Object fusion method based on video image and terminal |
| CN107851323B (en) * | 2015-05-13 | 2022-08-05 | 无装饰实验室奥地利股份有限公司 | 3D body scanner data processing flow |
| CN107851323A (en) * | 2015-05-13 | 2018-03-27 | 无装饰实验室奥地利股份有限公司 | 3D body scan data instrument flow chart of data processing |
| CN104952113A (en) * | 2015-07-08 | 2015-09-30 | 北京理工大学 | Dress fitting experience method, system and equipment |
| CN104952113B (en) * | 2015-07-08 | 2018-04-27 | 北京理工大学 | Dress ornament tries experiential method, system and equipment on |
| CN105184584A (en) * | 2015-09-17 | 2015-12-23 | 北京京东方多媒体科技有限公司 | Virtual fitting system and method |
| CN105404392B (en) * | 2015-11-03 | 2018-04-20 | 北京英梅吉科技有限公司 | Virtual method of wearing and system based on monocular cam |
| CN105404392A (en) * | 2015-11-03 | 2016-03-16 | 北京英梅吉科技有限公司 | Monocular camera based virtual wearing method and system |
| CN105787751A (en) * | 2016-01-06 | 2016-07-20 | 湖南拓视觉信息技术有限公司 | 3D human body virtual fitting method and system |
| CN105788002A (en) * | 2016-01-06 | 2016-07-20 | 湖南拓视觉信息技术有限公司 | 3D virtual shoe fitting method and system |
| WO2017197951A1 (en) * | 2016-05-19 | 2017-11-23 | 京东方科技集团股份有限公司 | Rendering method in augmented reality scene, processing module, and augmented reality glasses |
| US10573075B2 (en) | 2016-05-19 | 2020-02-25 | Boe Technology Group Co., Ltd. | Rendering method in AR scene, processor and AR glasses |
| CN105957139A (en) * | 2016-05-23 | 2016-09-21 | 矽照光电（厦门）有限公司 | AR (Augmented Reality) 3D model generation method |
| CN106057067A (en) * | 2016-06-01 | 2016-10-26 | 浙江工业大学 | Translucent mark making method for augmented reality |
| CN106097435A (en) * | 2016-06-07 | 2016-11-09 | 北京圣威特科技有限公司 | A kind of augmented reality camera system and method |
| CN106127846A (en) * | 2016-06-28 | 2016-11-16 | 乐视控股（北京）有限公司 | Virtual reality terminal and vision virtual method thereof and device |
| CN106157374A (en) * | 2016-07-12 | 2016-11-23 | 广州凡拓数字创意科技股份有限公司 | Numbers show system and method based on virtual reality |
| CN106327290A (en) * | 2016-08-11 | 2017-01-11 | 安徽健搏信息科技有限公司 | Virtual fitting system based on augmented reality |
| CN106097442A (en) * | 2016-08-24 | 2016-11-09 | 广东华邦云计算股份有限公司 | A kind of intelligent simulation dressing system and application process thereof |
| CN106340064B (en) * | 2016-08-25 | 2019-02-01 | 北京大视景科技有限公司 | A kind of mixed reality sand table device and method |
| CN106340064A (en) * | 2016-08-25 | 2017-01-18 | 北京大视景科技有限公司 | Mixed-reality sandbox device and method |
| CN106327562A (en) * | 2016-09-09 | 2017-01-11 | 武汉布偶猫科技有限公司 | Method of solving penetration problem in case of clothing collocation in three-dimensional simulation |
| CN106503286A (en) * | 2016-09-18 | 2017-03-15 | 福建网龙计算机网络信息技术有限公司 | The service of cutting the garment according to the figure and its system |
| CN107919066A (en) * | 2016-10-10 | 2018-04-17 | 北京七展国际数字科技有限公司 | The immersion display systems and method of a kind of arc curtain hyperbolic |
| CN106600638A (en) * | 2016-11-09 | 2017-04-26 | 深圳奥比中光科技有限公司 | Realization method of augmented reality |
| CN106650643B (en) * | 2016-12-06 | 2020-04-14 | 北京心有灵犀科技有限公司 | Method for making jewelry have augmented reality function |
| CN106650643A (en) * | 2016-12-06 | 2017-05-10 | 北京心有灵犀科技有限公司 | Method enabling jewelry to have enhanced reality function |
| CN107174826A (en) * | 2017-05-25 | 2017-09-19 | 合肥泽诺信息科技有限公司 | A kind of game role based on augmented reality is played the part of with the dressing system that changes the outfit |
| CN109200586A (en) * | 2017-06-29 | 2019-01-15 | 深圳市掌网科技股份有限公司 | Game implementation method and device based on augmented reality |
| CN110622218A (en) * | 2017-06-30 | 2019-12-27 | Oppo广东移动通信有限公司 | Image display method, device, storage medium and terminal |
| WO2019000464A1 (en) * | 2017-06-30 | 2019-01-03 | 广东欧珀移动通信有限公司 | Image display method and device, storage medium, and terminal |
| CN109285212A (en) * | 2017-07-21 | 2019-01-29 | 中兴通讯股份有限公司 | A kind of augmented reality modeling method, computer readable storage medium and augmented reality model building device |
| CN107481099A (en) * | 2017-07-28 | 2017-12-15 | 厦门大学 | Can 360 degree turn round real-time virtual fitting implementation method |
| CN107507269A (en) * | 2017-07-31 | 2017-12-22 | 广东欧珀移动通信有限公司 | Personalized three-dimensional model generating method, device and terminal device |
| CN107609946B (en) * | 2017-09-19 | 2020-11-06 | 北京优时尚科技有限责任公司 | Display control method and computing device |
| CN107609946A (en) * | 2017-09-19 | 2018-01-19 | 北京优时尚科技有限责任公司 | A kind of display control method and computing device |
| CN107773254A (en) * | 2017-12-05 | 2018-03-09 | 苏州创捷传媒展览股份有限公司 | A kind of method and device for testing Consumer's Experience |
| CN108096836B (en) * | 2017-12-20 | 2021-05-04 | 深圳市百恩互动娱乐有限公司 | Method for making game by real-person real shooting |
| CN108096836A (en) * | 2017-12-20 | 2018-06-01 | 深圳市百恩互动娱乐有限公司 | A kind of method that true man's real scene shooting makes game |
| CN108564612A (en) * | 2018-03-26 | 2018-09-21 | 广东欧珀移动通信有限公司 | Model display methods, device, storage medium and electronic equipment |
| CN108615261B (en) * | 2018-04-20 | 2022-09-09 | 深圳市天轨年华文化科技有限公司 | Method and device for processing image in augmented reality and storage medium |
| CN108615261A (en) * | 2018-04-20 | 2018-10-02 | 深圳市天轨年华文化科技有限公司 | The processing method, processing unit and storage medium of image in augmented reality |
| CN108846885A (en) * | 2018-06-06 | 2018-11-20 | 广东您好科技有限公司 | A kind of model activating technology based on 3-D scanning |
| CN109493161A (en) * | 2018-09-29 | 2019-03-19 | 北京小米移动软件有限公司 | The method and apparatus for carrying out virtual shopping using virtual reality |
| CN109685911A (en) * | 2018-12-13 | 2019-04-26 | 谷东科技有限公司 | A kind of the AR glasses and its implementation of achievable virtual fitting |
| CN109685911B (en) * | 2018-12-13 | 2023-10-24 | 谷东科技有限公司 | AR glasses capable of realizing virtual fitting and realization method thereof |
| CN110348370A (en) * | 2019-07-09 | 2019-10-18 | 北京猫眼视觉科技有限公司 | A kind of augmented reality system and method for human action identification |
| WO2021179919A1 (en) * | 2020-03-10 | 2021-09-16 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | System and method for virtual fitting during live streaming |
| CN111709814A (en) * | 2020-06-22 | 2020-09-25 | 辽宁轻工职业学院 | 3D virtual fitting method for clothing sales |
| CN114299264A (en) * | 2020-09-23 | 2022-04-08 | 秀铺菲公司 | System and method for generating augmented reality content based on warped three-dimensional model |
| CN112200717A (en) * | 2020-10-26 | 2021-01-08 | 广州紫为云科技有限公司 | Complex garment virtual fitting method and device based on neural network and storage medium |
| CN112508639A (en) * | 2020-11-30 | 2021-03-16 | 上海联影智能医疗科技有限公司 | Interaction method of virtualized human body system, electronic device and computer readable medium |
| CN113240819A (en) * | 2021-05-24 | 2021-08-10 | 中国农业银行股份有限公司 | Wearing effect determination method and device and electronic equipment |
| CN114063860A (en) * | 2021-11-10 | 2022-02-18 | 西安维沃软件技术有限公司 | Image display method and device |
| WO2023134269A1 (en) * | 2022-01-17 | 2023-07-20 | 海信视像科技股份有限公司 | Display device, and virtual fitting system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102156810A (en) | Augmented reality real-time virtual fitting system and method thereof | |
| CN103106604B (en) | Based on the 3D virtual fit method of body sense technology | |
| US20200175655A1 (en) | Method and system for reconstructing obstructed face portions for virtual reality environment | |
| CN107333121B (en) | The immersion solid rendering optical projection system and its method of moving view point on curve screens | |
| JP6813501B2 (en) | Privacy-sensitive consumer cameras coupled to augmented reality systems | |
| CN102156808A (en) | System and method for improving try-on effect of reality real-time virtual ornament | |
| JP6419116B2 (en) | Method and apparatus for generating artificial pictures | |
| CN109671141B (en) | Image rendering method and device, storage medium and electronic device | |
| CN106095094B (en) | The method and apparatus that augmented reality projection is interacted with reality | |
| CN106843456A (en) | A kind of display methods, device and virtual reality device followed the trail of based on attitude | |
| CN105955456A (en) | Virtual reality and augmented reality fusion method, device and intelligent wearable equipment | |
| KR20140108128A (en) | Method and apparatus for providing augmented reality | |
| US20130127827A1 (en) | Multiview Face Content Creation | |
| CN104881526B (en) | Article wearing method based on 3D and glasses try-on method | |
| CN108351522A (en) | Direction of gaze maps | |
| CN104461006A (en) | Internet intelligent mirror based on natural user interface | |
| CN204576413U (en) | A kind of internet intelligent mirror based on natural user interface | |
| US10863210B2 (en) | Client-server communication for live filtering in a camera view | |
| CN109663343A (en) | A kind of augmented reality AR game device and implementation method | |
| CN107862718B (en) | 4D holographic video capture method | |
| CN104750933A (en) | Eyeglass trying on method and system based on Internet | |
| CN107071388A (en) | A kind of three-dimensional augmented reality display methods and device | |
| CN108491072A (en) | A kind of virtual reality exchange method and device | |
| US20190208124A1 (en) | Methods and apparatus for overcapture storytelling | |
| CN206350095U (en) | A kind of three-dimensional filming system dynamically tracked based on human body |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20110817 |