CN102156810A - Augmented reality real-time virtual fitting system and method thereof - Google Patents

Augmented reality real-time virtual fitting system and method thereof Download PDF

Info

Publication number
CN102156810A
CN102156810A CN2011100812034A CN201110081203A CN102156810A CN 102156810 A CN102156810 A CN 102156810A CN 2011100812034 A CN2011100812034 A CN 2011100812034A CN 201110081203 A CN201110081203 A CN 201110081203A CN 102156810 A CN102156810 A CN 102156810A
Authority
CN
China
Prior art keywords
dimensional model
model
information
module
fitting
Prior art date
Application number
CN2011100812034A
Other languages
Chinese (zh)
Inventor
刘勇
张亮
梁征
苏中谦
Original Assignee
北京触角科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京触角科技有限公司 filed Critical 北京触角科技有限公司
Priority to CN2011100812034A priority Critical patent/CN102156810A/en
Publication of CN102156810A publication Critical patent/CN102156810A/en

Links

Abstract

The invention provides an augmented reality real-time virtual fitting system and a method thereof. The augmented reality real-time virtual fitting system comprises an optical camera, a depth camera, a human three-dimensional model module, a garment three-dimensional model module, a three-dimensional model fusion module and a live-action fusion module. The optical camera is used for obtaining live-action video information in real time; the depth camera is used for obtaining human identifying information in real time; the human three-dimensional model module is used for generating a human three-dimensional model according to the human identifying information; the garment three-dimensional model module is used for generating a garment three-dimensional model according to the human identifying information; the three-dimensional model fusion module is used for fusing the human three-dimensional model with the garment three-dimensional model to generate a fitting three-dimensional model; and the live-action fusion module is used for fusing the fitting three-dimensional model with the live-action video information to generate fitting video information. The augmented reality real-time virtual fitting system and the method thereof provided by the invention can realistically display the fitting effect of the experiencer and improve the effect of virtual fitting.

Description

增强现实实时虚拟试衣系统及方法 Enhanced real-time virtual reality system and method for dressing

技术领域 FIELD

[0001] 本发明涉及增强现实技术,尤其涉及一种增强现实实时虚拟试衣系统及方法。 [0001] The present invention relates to an augmented reality technology, in particular to a real-time augmented reality system and method for virtual try. 背景技术 Background technique

[0002] 增强现实技术,是一种综合了图像识别追踪、运动捕捉、虚拟现实等计算机学科的技术,将虚拟三维模型动画、视频、文字、图片等数字信息实时叠加显示到真实场景中,并与现实物体或者使用者实现自然互动的创新的人机交互技术。 [0002] Augmented Reality technology, is a comprehensive image recognition tracking, motion capture technology computer science, virtual reality, virtual three-dimensional model animation, video, text, images and other digital information superimposed in real time to show the real scene, and for natural interaction with real objects or users innovative human-computer interaction technology.

[0003] 现有技术的虚拟试衣系统一般以虚拟现实(Virtual Reality)为支持技术,让设计好的虚拟3D人体模特结合不同款式、尺寸的虚拟3D服装表现出服装的穿戴以及搭配效果。 [0003] prior art virtual fitting system generally VR (Virtual Reality) to support technology, designed to make 3D virtual mannequins to combine different styles, sizes show a virtual 3D garment and wear clothing with the effect. 但由于试穿衣服的为设计好的3D人体模型,不能与真实地试穿者的人体形态、肤色实时结合,并不能真实表现出满意的试穿体验。 However, due to trying on clothes 3D human model is designed, not, real-time color combined with the truly human form who tried and true can not try to show satisfactory experience.

发明内容 SUMMARY

[0004] 本发明提供一种增强现实实时虚拟试衣系统及方法,以提高虚拟试衣的效果。 [0004] The present invention provides a realistic effect of real-time virtual dressing systems and methods enhanced to improve the virtual fitting.

[0005] 本发明提供一种增强现实实时虚拟试衣系统,包括: [0005] The present invention provides a real-time virtual dressing augmented reality system, including:

[0006] 光学摄像机,用于实时获取实景视频信息; [0006] an optical camera, real time access to video information;

[0007] 深度摄像机,用于实时获取试衣者的人体标识信息; [0007] depth cameras, for real-time access fitting body's identification information;

[0008] 人体三维模型模块,与所述深度摄像机连接,用于根据所述人体标识信息生成人体三维模型; [0008] The three-dimensional human body model module, connected with the depth camera, the three-dimensional model for the human body in accordance with identification information generation;

[0009] 衣服三维模型模块,与所述深度摄像机相连,用于根据所述人体标识信息生成衣服三维模型; [0009] The three-dimensional model clothes module, coupled with the depth camera, for generating a three-dimensional model based on the clothing of human identification information;

[0010] 三维模型融合模块,分别与所述人体三维模型模块和所述衣服三维模型模块相连,用于将所述人体三维模型和所述衣服三维模型相融合,生成试衣三维模型; [0010] The three-dimensional model of the fusion module, each connected to the three-dimensional human body model and the garment three-dimensional model module means for the integration of the three-dimensional human body model and the garment three-dimensional model, generated three-dimensional model fitting;

[0011] 实景融合模块,分别与所述光学摄像机和所述三维模型融合模块相连,用于将所述试衣三维模型和所述实景视频信息相融合,生成试衣视频信息。 [0011] Virtual fusion module, respectively, and the optical camera module is connected to the three-dimensional model fusion, fitting for the three-dimensional model and the real integration of video information, video information generating fitting.

[0012] 如上所述的增强现实实时虚拟试衣系统,还包括: [0012] As noted above augmented reality real-time virtual dressing system further comprising:

[0013] 第一校正模块,与所述光学摄像机相连,用于根据预设焦距信息,对所述光学摄像机进行标定; [0013] The first correction module, the optical camera is connected, according to a preset focal length information, the optical camera calibration;

[0014] 第二校正模块,分别与所述光学摄像机和所述深度摄像机相连,用于将所述光学摄像机和所述深度摄像机调整为同步同视角。 [0014] The second correction module, respectively, the optical camera and the depth camera is connected, for the optical camera and the depth camera is synchronized with the angle of view adjustment.

[0015] 如上所述的增强现实实时虚拟试衣系统,其中, [0015] As noted above, real-time augmented reality virtual fitting system, which,

[0016] 所述人体标识信息包括外形信息和动作信息;相应地, [0016] The human identification information comprises action information and shape information; accordingly,

[0017] 所述深度摄像机包括外形信息捕捉单元和动作信息捕捉单元; [0017] The depth camera capturing unit includes shape information and motion information capturing means;

[0018] 所述外形信息捕捉单元用于实时捕捉所述试衣者的各像素点的深度信息以及所述试衣者的轮廓信息,以形成所述外形信息; [0018] The contour shape information capture depth information for real-time capture unit information of each pixel of the pilot's clothing and clothing by the test, to form the outer shape information;

[0019] 所述动作信息捕捉单元与所述外形信息捕捉单元相连,用于根据所述轮廓信息生成骨骼节点信息,并根据所述骨骼节点信息生成所述动作信息。 [0019] The motion information of the shape information capturing unit capturing unit is connected, according to the profile information generation skeleton node information, and generates the motion information based on the skeleton information node.

[0020] 如上所述的增强现实实时虚拟试衣系统,所述人体三维模型包括: [0020] real-time virtual dressing augmented reality systems, three-dimensional model of the human body as described above include:

[0021] 人体模型调整单元,用于根据所述外形信息调整人体基础模型的形状,生成人体静态模型; [0021] mannequin adjusting means for adjusting the body shape information according to the shape of the base model, the human body generates a static model;

[0022] 人体模型运动单元,用于根据所述动作信息调整所述人体静态模型的动作,生成所述人体三维模型,以对所述试衣者进行模拟。 [0022] The mannequin movement unit for adjusting the operation information of the operation body static model, the human body generates a three-dimensional model to simulate the fitting person.

[0023] 如上所述的增强现实实时虚拟试衣系统,所述衣服三维模型包括: [0023] real-time virtual dressing augmented reality system, the three-dimensional model of clothes as described above include:

[0024] 衣服模型调整单元,用于根据所述外形信息调整衣服基础模型的形状,生成衣服静态模型; [0024] dress model adjustment means for adjusting the shape of the garment according to the basis of the model shape information, generating static model clothes;

[0025] 衣服模型运动单元,用于根据所述动作信息调整所述衣服静态模型的位置和动作姿态,生成衣服动态模型; [0025] Clothes motion model unit for the position and attitude of the operation of the static model garment adjusted according to the operation information, generates a dynamic model clothes;

[0026] 三维引擎单元,用于根据所述动作信息和所述衣服动态模型,生成所述衣服三维模型。 [0026] The engine unit D, according to the action information and the dynamic model of the garment, the garment generating three-dimensional model.

[0027] 如上所述的增强现实实时虚拟试衣系统,所述三维模型融合模块包括: [0027] Real-time augmented reality system of virtual try the three-dimensional model as described above fusion module comprises:

[0028] 组合单元,用于将所述人体三维模型和所述衣服三维模型组合,生成遮挡三维模型; [0028] The combining unit for the three-dimensional human body model and the garment three-dimensional model in combination, to generate a three-dimensional model of occlusion;

[0029] 渲染单元,用于对所述遮挡三维模型进行渲染; [0029] The rendering unit configured to render three-dimensional model of the shield;

[0030] 透明化单元,用于将渲染后的遮挡三维模型中的人体三维模型透明化处理,生成所述试衣三维模型。 [0030] The transparency unit, shielding for the three-dimensional model of human three-dimensional model in a rendered transparent processing to generate a three-dimensional model fitting.

[0031] 本发明提供一种增强现实实时虚拟试衣方法,包括: [0031] The present invention provides a real-time virtual reality enhanced dressing method, comprising:

[0032] 光学摄像机实时获取实景视频信息; [0032] optical camera video in real time to obtain real information;

[0033] 深度摄像机实时获取试衣者的人体标识信息; [0033] depth camera's real-time access fitting body identification information;

[0034] 人体三维模型模块根据所述深度摄像机获取的人体标识信息生成人体三维模型; [0034] The three-dimensional model of human obtaining module according to the depth camera body identification information generation dimensional body model;

[0035] 衣服三维模型模块根据所述深度摄像机获取的人体标识信息生成衣服三维模型; [0035] Clothes module generates three-dimensional model a three-dimensional model of the human body garment identification information acquired by the depth camera;

[0036] 三维模型融合模块分别将所述人体三维模型模块生成的所述人体三维模型和所述衣服三维模型模块生成的所述衣服三维模型相融合,生成试衣三维模型; [0036] The three-dimensional model of the integration module are three-dimensional model of said garment body module generates three-dimensional model of the three-dimensional human body model and the garment three-dimensional model generation module integration, generating three-dimensional model fitting;

[0037] 实景融合模块分别将所述衣服三维模型模块生成的所述试衣三维模型和所述光学摄像机获取的所述实景视频信息相融合,生成试衣视频信息。 [0037] Virtual fusion module respectively the three-dimensional model fitting clothes module generates three-dimensional model of the camera and the optical information acquired by the real video integration, video information generating fitting.

[0038] 如上所述的增强现实实时虚拟试衣方法,所述光学摄像机实时获取实景视频信息之前,还包括: Before [0038] Real-time augmented reality virtual try method, real time access to the optical camera video information as described above, further comprising:

[0039] 第一校正模块根据预设焦距信息,对所述光学摄像机进行标定; [0039] The first correction module preset focal length information, the optical camera calibration;

[0040] 第二校正模块将所述光学摄像机和所述深度摄像机调整为同步同视角。 [0040] The second module correcting the optical camera and the depth camera is synchronized with the angle of view adjustment.

[0041] 如上所述的增强现实实时虚拟试衣方法,所述人体标识信息包括外形信息和动作信息;相应地,所述深度摄像机实时获取试衣者的人体标识信息,包括: [0041] Real-time augmented reality virtual try method, the body shape information includes identification information and operation information as described above; accordingly, the depth of the fitting acquired in real time by the camera body identification information, comprising:

[0042] 所述深度摄像机实时捕捉所述试衣者的各像素点的深度信息以及所述试衣者的轮廓信息,以形成所述外形信息; [0042] The real-time capture of the camera depth test of each pixel's clothing depth information and contour information of the person fitting, to form the outer shape information;

[0043] 所述深度摄像机根据所述轮廓信息生成骨骼节点信息,并根据所述骨骼节点信息生成所述动作信息。 [0043] The video camera according to the depth information generating contour skeletal node information, and generates the motion information based on the skeleton information node.

[0044] 如上所述的增强现实实时虚拟试衣方法,所述人体三维模型模块根据所述深度摄像机获取的人体标识信息生成人体三维模型,包括: [0044] As described above in real-time augmented reality virtual try method, the three-dimensional model of human depth camera module acquires the identification information of the virtual human body three-dimensional model, comprising the:

[0045] 所述人体三维模型模块根据所述外形信息调整人体基础模型的形状,生成人体静态模型; [0045] The module of the three-dimensional model of the human body shape information to adjust the body shape of the base model, the human body generates a static model;

[0046] 所述人体三维模型模块根据所述动作信息调整所述人体静态模型的动作,生成所述人体三维模型,以对所述试衣者进行模拟。 [0046] The three-dimensional model of the human body based on the operation module adjusting the operation information of the static model of the human body, the human body generates a three-dimensional model to simulate the fitting person.

[0047] 如上所述的增强现实实时虚拟试衣方法,所述衣服三维模型模块根据所述深度摄像机获取的人体标识信息生成衣服三维模型,包括: [0047] Real-time augmented reality virtual fitting method, the module generates a three-dimensional model clothes clothes three-dimensional model based on the depth of the camera body identification information acquired as described above, including:

[0048] 所述衣服三维模型模块根据所述外形信息调整衣服基础模型的形状,生成衣服静态模型; [0048] The three-dimensional model of the garment to adjust the shape of the garment module according to the basis of the model shape information, generating static model clothes;

[0049] 所述衣服三维模型模块根据所述动作信息调整所述衣服静态模型的位置和动作姿态,生成衣服动态模型; [0049] The three-dimensional model of the garment of the module position and posture of the operation of the static model clothes adjusted according to the operation information, generates a dynamic model clothes;

[0050] 所述衣服三维模型模块根据所述动作信息和所述衣服动态模型,生成所述衣服三维模型。 [0050] The three-dimensional model of the garment module according to the movement information and the dynamic model of the garment, the garment generating three-dimensional model.

[0051] 如上所述的增强现实实时虚拟试衣方法,所述三维模型融合模块分别将所述人体三维模型模块生成的所述人体三维模型和所述衣服三维模型模块生成的所述衣服三维模型相融合,生成试衣三维模型,包括: Enhanced real-time virtual reality fitting method, the three-dimensional model fusion [0051] above module, respectively, the three-dimensional model of human clothes module generates three-dimensional model of three-dimensional model of the human body and the clothes of the three-dimensional model generation module integration, generating three-dimensional model fitting, comprising:

[0052] 所述三维模型融合模块将所述人体三维模型和所述衣服三维模型组合,生成遮挡三维模型; [0052] The three-dimensional model of the human body fusion module 3D models and three-dimensional model of the combination clothing occlusion generating three-dimensional model;

[0053] 所述三维模型融合模块对所述遮挡三维模型进行渲染; [0053] The three-dimensional model of the fusion module for rendering three-dimensional model occlusion;

[0054] 所述三维模型融合模块将渲染后的遮挡三维模型中的人体三维模型透明化处理, 生成所述试衣三维模型。 [0054] The three-dimensional model of the three-dimensional model of human fusion module occlusion model of a three-dimensional rendering of transparent processing to generate a three-dimensional model fitting.

[0055] 由上述技术方案可知,本发明提供的增强现实实时虚拟试衣系统及方法,通过深度摄像机实时获取人体标识信息,并根据该人体标识信息生成人体三维模型和衣服三维模型,衣服三维模型可以与试衣者的体型相符,而且可以表现出试衣者穿上衣服时,衣服所表现出的与试衣者身体曲线相对应的效果。 [0055] From the above technical solutions, augmented reality real-time virtual dressing systems and methods of the present invention, thus providing a body identification information in real time through a depth camera, and dimensional body model and the garment three-dimensional model, clothes dimensional model of human identification information is generated according to It is consistent with the body's fitting, but also can show when wearing clothes, clothes exhibited by the fitting's body curve fitting corresponding to those effects. 并且通过人体三维模型和衣服三维模型的融合处理生成试衣三维模型,使试衣三维模型融合与实景视频信息时,表现出的效果不仅仅是二者的叠加,而是可以与试衣者的人体形态相结合,提高了虚拟试衣的效果。 And fusion three-dimensional model of three-dimensional model of the human body and clothes fitting three-dimensional model generated by the three-dimensional model fitting integration of information and real time video, showing the effect of not only the superposition of the two, but may be those with the fitting of human form combine to improve the virtual fitting effect.

附图说明 BRIEF DESCRIPTION

[0056] [0056]

[0057] [0057]

[0058] [0058]

图1为本发明实施例提供的一种增强现实实时虚拟试衣系统结构示意图; 图2为本发明实施例提供的另一种增强现实实时虚拟试衣系统结构示意图图3为本发明实施例提供的增强现实实时虚拟试衣方法流程图。 3 embodiment of the present invention are provided in Figure 2 of another real-time augmented reality system virtual try schematic structural diagram according to an embodiment of the present invention; FIG. 1 is a schematic diagram of a virtual real-time augmented reality system configuration fitting to an embodiment of the invention enhanced real-time virtual reality fitting method flow chart.

[0059] 附图标记: [0059] The reference numerals:

[0060] 12-光学摄像机; 11-深度摄像机; [0060] 12- optical camera; 11- depth cameras;

[0061] 13-人体三维模型模块; 14-衣服三维模型模块 [0061] 13- three-dimensional human body model module; 14- dress three-dimensional model module

[0062] 15-三维模型融合模块; 16-实景融合模块; [0062] 15 three-dimensional model fusion module; 16- real fusion module;

[0063] 17-第一校正模块; 18-第二校正模块;[0064] 111-外形信息捕捉单元 [0063] 17- first correction module; second correction module 18; [0064] Shape information capturing unit 111-

[0065] 131-人体模型调整单元 [0065] 131- mannequin adjusting unit

[0066] 141-衣服模型调整单元 [0066] 141- dress model adjustment means

[0067] 143-三维引擎单元; [0067] D 143- engine unit;

112-动作信息捕捉单元132-人体模型运动单元142-衣服模型运动单元151-组合单元; Motion information capturing unit 112- 132- 142- mannequin moving unit moving unit 151- dress model combining unit;

[0068] 152-渲染单元; [0068] 152- rendering unit;

153-透明化单元。 153- transparency unit.

具体实施方式 Detailed ways

[0069] 为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例, 对本发明实施例中的技术方案进行清楚、完整地描述。 [0069] The object of the present invention embodiment, technical solutions and advantages clearer, the following examples in conjunction with the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described. 需要说明的是,在附图或说明书中, 相似或相同的元件皆使用相同的附图标记。 Incidentally, in the specification or the drawings, similar or identical elements are the same reference numerals.

[0070] 图1为本发明实施例提供的一种增强现实实时虚拟试衣系统结构示意图,如图1 所示,该增强现实实时虚拟试衣系统包括光学摄像机12、深度摄像机11、人体三维模型模块13、衣服三维模型模块14、三维模型融合模块15和实景融合模块16。 12 comprises an optical camera, a depth camera 11, the three-dimensional model of the human body in real-time augmented reality system virtual fitting schematic structural diagram of the embodiment [0070] FIG. 1 of the present invention, shown in Figure 1, the real-time augmented reality system virtual try module 13, module 14 clothes three-dimensional model, the three-dimensional model of the fusion module 15 and real integration module 16. 光学摄像机12用于实时获取实景视频信息。 12 optical camera for real time access video information. 深度摄像机11用于实时获取试衣者的人体标识信息。 Depth camera 11 for real-time access fitting body's identification information. 人体三维模型模块13与深度摄像机11连接,用于根据人体标识信息生成人体三维模型。 Dimensional body model module 13 is connected to the depth camera 11, three-dimensional model for the human body in accordance with identification information generation. 衣服三维模型模块14与深度摄像机11相连,用于根据人体标识信息生成衣服三维模型。 Clothes dimensional model module 14 is connected to the depth camera 11, for generating a three dimensional model of the human body garment identification information. 三维模型融合模块15分别与人体三维模型模块13和衣服三维模型模块14相连,用于将人体三维模型和衣服三维模型相融合,生成试衣三维模型。 Three-dimensional model integration module is connected with the body 15 are three-dimensional model module 13 and a garment-dimensional model module 14, for the integration of the human body and clothes dimensional model three-dimensional model, generated three-dimensional model fitting. 实景融合模块16,分别与光学摄像机12 和三维模型融合模块15相连,用于将试衣三维模型和实景视频信息相融合,生成试衣视频fn息ο Virtual fusion module 16, respectively, and the optical camera 12 and 3D model integration module 15 is connected, for the three-dimensional model fitting and real integration of video information, generating information fn fitting video ο

[0071] 该增强现实实时虚拟试衣系统在实际应用中的工作过程具体可以为:试衣者站在光学摄像机12和深度摄像机11前,光学摄像机12实时获取实景视频信息,即实时捕捉试衣者的视频信息以及试衣者所处的环境视频信息。 [0071] The real-time augmented reality virtual fitting system works in practical application may be: optical camera stand dressing in 12 and 11 before the depth camera, optical camera 12 video real-time access real information, that is, real-time capture fitting the video's information and fitting by the environment in which video information. 深度摄像机11实时获取试衣者的人体标识信息,试衣者的人体标识信息具体可以对试衣者的外形轮廓以及动作进行标识。 11 depth camera body identification information acquired in real time fitting person, the body's identification information specific fitting fitting for those who can contour and actions are identified. 人体三维模型模块13根据人体标识信息生成人体三维模型。 Dimensional body model identification module 13 of human body to generate a three-dimensional model according to the information. 人体三维模型模块13具体可以根据深度摄像机11获取的人体标识信息通过三维人体建模算法生成人体三维模型。 DETAILED dimensional body model module 13 may generate a three-dimensional model of the human body by the three-dimensional modeling algorithm according to the camera body 11 acquires the identification information of depth. 衣服三维模型模块14中具体可以存储多个衣服三维模型样本,试衣者可以选择喜欢的衣服进行试穿。 Clothes dimensional model module 14 may store a plurality of three-dimensional models particularly clothes samples, fitting can be selected to try like clothes. 衣服三维模型模块14将试衣者挑选出的衣服三维模型样本,根据深度摄像机11获取的人体标识信息对衣服的大小以及该衣服在试衣者身上可能产生的皱褶和变形进行调整处理,生成衣服三维模型。 Clothes dimensional model module 14 by fitting clothing selected three-dimensional model samples, the size of the adjustment process and clothes wrinkles and deformation of the garment may be generated in accordance with the human body by fitting the identification information acquired by the depth camera 11, generating clothes three-dimensional model. 三维模型融合模块15将人体三维模型和衣服三维模型进行融合,生成试衣三维模型,例如,试衣者穿衣服时,脖子部位会对衣服的后衣领遮挡,生成的试衣三维模型中则会表现这个效果。 The fusion module 15 three-dimensional model of human three-dimensional model and three-dimensional model fusion clothes, to generate three-dimensional model fitting, for example, when the person fitting clothes, the clothes will collar neck portion occlusion, fitting three-dimensional model is generated We will show this effect. 实景融合模块16在将该试衣三维模型融合到光学摄像机12捕捉的实景视频中,生成试衣视频信息,实现了试衣三维模型在试衣者身上的效果, 该试衣视频信息通过显示模块显示给试衣者,给试衣者的感受就和面对试衣镜进行试衣的效果一样。 The real fusion module 16 integrated into the three-dimensional model fitting real video captured by the optical camera 12, the fitting generates video information, an effect is achieved in the three-dimensional model fitting body by fitting the fitting video information through the display module displayed to the person fitting, fitting to those who feel the effects of it and be the face of the dressing mirror dressing the same.

[0072] 本实施例提供的增强现实实时虚拟试衣系统,通过深度摄像机11实时获取人体标识信息,并根据该人体标识信息生成人体三维模型和衣服三维模型,衣服三维模型可以与试衣者的体型相符,而且可以表现出试衣者穿上衣服时,衣服所表现出的与试衣者身体曲线相对应的效果。 [0072] This augmented reality real-time virtual dressing system according to an embodiment, acquiring human identification information in real time via a depth camera 11, and the body identification information to generate human 3D models and clothes three-dimensional model based on clothes three-dimensional model can be persons with fitting consistent size, and they can show when wearing clothes, clothes exhibited by the fitting's body curve fitting corresponding to those effects. 并且通过人体三维模型和衣服三维模型的融合处理生成试衣三维模型,使试衣三维模型融合与实景视频信息时,表现出的效果不仅仅是二者的叠加,而是可以与试衣者的人体形态相结合,逼真地显示了试着者的试衣效果,提高了虚拟试衣的效果。 And fusion three-dimensional model of three-dimensional model of the human body and clothes fitting three-dimensional model generated by the three-dimensional model fitting integration of information and real time video, showing the effect of not only the superposition of the two, but may be those with the fitting of human form combine vividly shows the effect of fitting person to try and improve the effect of the virtual fitting.

[0073] 图2为本发明实施例提供的另一种增强现实实时虚拟试衣系统结构示意图,如图2所示,在本实施例中,该增强现实实时虚拟试衣系统还可以包括第一校正模块17和第二校正模块18。 [0073] FIG. 2 embodiment of the present invention provides real-time virtual reality another schematic structural reinforcement fitting system shown in Figure 2, in the present embodiment, the virtual real-time augmented reality system may further comprise fitting a first a second correction module 17 and a correction module 18. 第一校正模块17与光学摄像机12相连,用于根据预设焦距信息,对光学摄像机12进行标定。 A first correction optical module 17 is connected to the camera 12, according to a preset focal length information, the optical calibration camera 12. 第二校正模块18分别与光学摄像机12和深度摄像机11相连,用于将光学摄像机12和深度摄像机11调整为同步同视角。 The second correction module 18 respectively connected with the optical camera 12 and the depth camera 11, for the optical camera 12 and the depth camera 11 is synchronized with the angle of view adjustment.

[0074] 在进行虚拟试衣之前,可以先对光学摄像机12进行标定校正,第一校正模块17具体根据预设的焦距信息进行过内外参数的标定,使光学摄像机12基于标定参数获取实景视频信息,并去除镜头畸变影响,准确计算需要在实景中的特定距离、位置叠加和衣服三维模型的屏幕显示的大小和位置坐标。 [0074] Before the virtual try, for the optical camera 12 can first calibration correction, the first correction module 17 external parameters specific been calibrated according to a preset focal length information of the calibration parameters based on the optical camera 12 acquires video information Virtual , and remove lens distortion effects need to accurately calculate the real distance of a certain, size and position of the position coordinates and superimposed three-dimensional model of the garment screen display. 第二校正模块18使光学摄像机12和虚拟摄像机同步同视角,具体表现为具有相同的角度、焦距和视野。 The second correction module 18 of the optical camera 12 and the virtual camera synchronized with the angle of view, in particular appear to have the same angle, focal distance and field of view. 具体也可以通过调整硬件参数以实现对光学摄像机12和深度摄像机11的同步同视角。 Specific hardware parameters may be adjusted to achieve synchronization with the angle of view of the camera 12 and the optical depth of the camera 11. 通过对光学摄像机12和深度摄像机11的校正,可以提高虚拟三维模型与实景视频融合的效果。 By correcting the camera 12 and the depth 11 of the optical camera, a virtual three-dimensional model can be improved and the effect of real video integration.

[0075] 在本实施例中,人体标识信息包括外形信息和动作信息。 [0075] In the present embodiment, the body shape information including the identification information and operation information. 相应地,深度摄像机11 包括外形信息捕捉单元111和动作信息捕捉单元112。 Accordingly, a depth camera 11 capturing unit 111 includes a shape information capturing unit 112 and the motion information. 外形信息捕捉单元111用于实时捕捉试衣者的各像素点的深度信息以及试衣者的轮廓信息,以形成外形信息。 Shape information capturing unit 111 to the depth contour information of each pixel in the real-time capture fitting and fitting those persons, to form the shape information. 外形信息具体可以为试衣者的肩宽、胸围、腹围、腰围、臂长、腿长等关键体型参数组成的试衣者的轮廓信息,以及深度摄像机11获取的试衣者的图像中的各像素点对应的试衣者身体上各点的深度信息,深度信息具体为试衣者身上各点距离深度摄像机11的绝对距离。 Specific information may be a shape fitting's shoulder, the image information of contour fitting's bust, waist circumference, waist circumference, arm length, legs and other body parameters consisting of the key, and by fitting the camera 11 acquires a depth in depth information on each point on the body of each pixel corresponding fitting person, depth information specific to the fitting body by absolute distance of each point from the depth camera 11. 动作信息捕捉单元112与外形信息捕捉单元111相连,用于根据轮廓信息生成骨骼节点信息,并根据骨骼节点信息生成动作信息。 Motion information capturing unit 112 is connected to the outer shape information capturing unit 111, for generating bone outline information according to the node information, and skeleton information based on the node information generation operation. 动作信息捕捉单元112首先可以通过轮廓信息识别出正面人体的形状,根据正面人体形状对人体的骨骼节点进行定位,以获得骨骼节点信息。 Motion information capturing unit 112 may first be identified by the body contour shape information of the front side, the skeleton body for positioning node according to the shape of the front body, to obtain information about the node skeleton. 具体的,骨骼节点为预设的运动骨骼节点,为人体运动的关键骨骼节点,通过对该些骨骼节点的追踪,可以实现对人体动作的实时捕捉。 Specifically, bone node to a preset movement bone node, the node is a key bone of human motion, by tracking the bones of these nodes, can achieve real-time capture of human action.

[0076] 在本实施例中,人体三维模型具体可以包括人体模型调整单元131和人体模型运动单元132。 [0076] In the present embodiment, the three-dimensional model of the human body model may specifically include adjusting unit 131 and the moving unit 132 mannequin. 人体模型调整单元131用于根据外形信息调整人体基础模型的形状,生成人体静态模型。 Mannequin adjusting unit 131 for adjusting the body shape information according to the shape of the base model, the human body generates a static model. 人体模型调整单元131在人体基础模型的基础上,根据外形信息对人体基础模型进行调整,以生成与试衣者相匹配的人体静态模型,可以简化人体三维模型的生成算法。 Mannequin adjusting unit 131 based on the human body model based on the shape information according to the adjusted based on the human body model, the human body in order to generate static model match fitting persons, the human body can be simplified three-dimensional model generation algorithm. 人体模型运动单元132用于根据动作信息调整人体静态模型的动作,生成人体三维模型, 以对试衣者进行模拟。 Mannequin moving unit 132 for adjusting the human body based on the operation information of the operation of the static model, the human body generates a three-dimensional model to be simulated by fitting. 具体的,可以将人体静态模型和扑捉到的动作信息中的骨骼节点信息绑定,以实现人体三维模型对实景中人体形态和动作的准确复制。 Specifically, can the human body static model to capture the action and skeletal node information in the binding information to enable accurate replication of the human body three-dimensional model in real human form and movement.

[0077] 在本实施例中,衣服三维模型具体可以包括衣服模型调整单元141、衣服模型运动单元142和三维引擎单元143。 [0077] In the present embodiment, the garment may include a three-dimensional model specifically garment model adaptation unit 141, the moving unit 142 dress model engine unit 143 and three-dimensional. 衣服模型调整单元141用于根据外形信息调整衣服基础模型的形状,生成衣服静态模型。 Dress model adjustment unit 141 for adjusting a garment in accordance with the model shape information base shape, clothes generating static model. 衣服模型调整单元141在衣服基础模型的基础上,根据试衣者的外形信息对衣服基础模型的尺寸和穿戴位置进行调整,以生成与试衣者提醒相匹配的衣服静态模型。 Dress model adjustment unit 141 on the basis of the clothes on the basis of the model, adjusted according to the shape information fitting the wearer's size and position of the base model of the garment, to generate a reminder by fitting the model to match the static clothes. 衣服模型运动单元142用于根据动作信息调整衣服静态模型的位置和动作姿态,生成衣服动态模型。 Clothes motion model unit 142 for adjusting the static model garment according to the position and operation of the operation posture, generates dynamic model clothes. 衣服模型运动单元142具体可以将衣服静态模型绑定捕捉的骨骼节点信息,结合识别出的人体动作,计算出衣服的空间位置与运动姿态,以生成衣服动态模型。 Clothes motion model unit 142 may be specifically bound to capture the static model clothes skeleton node information, in conjunction with the operation of the identified human body, and calculates the spatial position of the motion attitude clothes, clothes to generate a dynamic model. 三维引擎单元143用于根据动作信息和衣服动态模型,生成衣服三维模型。 The engine unit 143 according to the three-dimensional motion information and the dynamic model clothes, clothes generated three-dimensional model. 具体的, 三维引擎单元143根据动作信息,将衣服动态模型进行变形、褶皱等物理特效。 Specifically, the engine unit 143 according to the operation of the three-dimensional information, the dynamic model clothes physical modification effects, such as wrinkles.

[0078] 在本实施例中,三维模型融合模块15具体可以包括组合单元151、渲染单元152和透明化单元153。 [0078] In the present embodiment, the three-dimensional model of the integration module 15 may specifically include a combination unit 151, rendering unit 152 and the unit 153 transparent. 组合单元151用于将人体三维模型和衣服三维模型组合,生成遮挡三维模型。 Combining unit 151 for the three-dimensional model and the three-dimensional model of human combination clothes, three-dimensional model generated occlusion. 渲染单元152用于对遮挡三维模型进行渲染。 Rendering unit 152 for rendering three-dimensional model of occlusion. 透明化单元153用于将渲染后的遮挡三维模型中的人体三维模型透明化处理,生成试衣三维模型。 Transparency unit 153 three-dimensional model for the human body shielding transparent three-dimensional model after the rendering process to generate three-dimensional model fitting. 具体的,将组合单元151人体三维模型和衣服三维模型组合,渲染单元152具体可以为三维引擎,通过深度z-cbpth运算, 对遮挡部位不进行渲染,以显示遮挡效果,透明化单元153再将人体三维模型透明化处理, 以保证在视频叠加时与试衣三维模型重合的真实人体视频图像被正确显示,并实现在特定位置姿态下对身后虚拟服装的正确遮挡。 Specifically, the combining unit and the three-dimensional model of human three-dimensional model 151 in combination clothes, the rendering unit 152 may be a three-dimensional engine specifically, by calculating the depth z-cbpth, occlusion site is not rendered to show the blocking effect, transparency unit 153 then three-dimensional model of the human body transparent process to ensure that when the video overlay and fitting three-dimensional model of the human body coincide with the real video image is displayed correctly, and to achieve the correct posture at a specific location on the virtual clothing obscured behind.

[0079] 在实际应用过程中,试衣者的试衣视频信息通过显示模块进行显示,可以设置功能按钮以对视频进行放大、缩小和移动,还可以对视频图像拍照保存。 [0079] In practical applications, the fitting of the fitting's video information displayed by the display module, the function buttons may be provided to the video enlargement, reduction, and movement, you can also save the video image photographing. 该增强现实实时虚拟试衣系统还可以与网上商城连接,当试衣者对试衣结果感到满意时,可以直接通过购买按钮进行相应的购买操作,开拓了全新的服装产业数字营销手段。 The real-time augmented reality virtual fitting system can also be connected to the online store, when the fitting were satisfied with the fitting result, you can buy the corresponding operation directly through the purchase of a button, to open up a new garment industry of digital marketing.

[0080] 图3为本发明实施例提供的增强现实实时虚拟试衣方法流程图,如图3所示,本实施例提供的增强现实实时虚拟试衣方法可以通过本发明任意实施例提供的增强现实实时虚拟试衣系统来实现,但并不以此为限。 Enhanced flowchart real virtual try method provided in Embodiment AR [0080] FIG. 3 of the present invention, shown in Figure 3, the present embodiment provides enhanced real-time virtual reality fitting method can be provided by any embodiment of the present invention. real-time virtual reality fitting system, but is not limited thereto. 该增强现实实时虚拟试衣方法包括: The real-time augmented reality virtual fitting method comprising:

[0081] 步骤10、光学摄像机实时获取实景视频信息; [0081] Step 10, the optical video camcorder real time access information;

[0082] 步骤20、深度摄像机实时获取试衣者的人体标识信息; [0082] Step 20, the depth of the camera body identification information acquired in real time fitting person;

[0083] 步骤30、人体三维模型模块根据深度摄像机获取的人体标识信息生成人体三维模型; [0083] Step 30, the three-dimensional human body model module three-dimensional model obtained by a depth camera body in accordance with identification information generation;

[0084] 步骤40、衣服三维模型模块根据深度摄像机获取的人体标识信息生成衣服三维模型; [0084] Step 40, the clothes module generates three-dimensional model a three-dimensional model of the human body garment identification information acquired by the depth camera;

[0085] 步骤50、三维模型融合模块分别将人体三维模型模块生成的人体三维模型和衣服三维模型模块生成的衣服三维模型相融合,生成试衣三维模型; [0085] Step 50, the three-dimensional model of a three-dimensional garment fusion model module respectively module generates three-dimensional model of human body and clothes dimensional model generated by the three-dimensional model integration module, to generate a three-dimensional model fitting;

[0086] 步骤60、实景融合模块分别将衣服三维模型模块生成的试衣三维模型和光学摄像机获取的实景视频信息相融合,生成试衣视频信息。 [0086] Step 60, the clothes are real fusion module generated three-dimensional model fitting module and an optical camera three-dimensional model of the real video information acquired fusion, fitting generates video information.

[0087] 本实施例提供的增强现实实时虚拟试衣方法,步骤10和步骤20可以同时进行,步骤30和步骤40也可以同时进行,并不具有必然的时序关系。 [0087] The present embodiment is provided real-time virtual reality enhanced fitting method, steps 10 and 20 may be performed simultaneously, steps 30 and step 40 may be performed simultaneously, does not necessarily have a timing relationship. 通过深度摄像机实时获取人体标识信息,并根据该人体标识信息生成人体三维模型和衣服三维模型,衣服三维模型可以与试衣者的体型相符,而且可以表现出试衣者穿上衣服时,衣服所表现出的与试衣者身体曲线相对应的效果。 By getting real-time depth camera body identification information, and the body identification information to generate a three-dimensional model of the human body and clothes based on a three-dimensional model, three-dimensional model can be consistent with the clothes fitting's body, but who can show fitting clothes to wear, the clothes show the fitting's body curve corresponding effect. 并且通过人体三维模型和衣服三维模型的融合处理生成试衣三维模型,使试衣三维模型融合与实景视频信息时,表现出的效果不仅仅是二者的叠加,而是可以与试衣者的人体形态相结合,逼真地显示了试着者的试衣效果,提高了虚拟试衣的效果。 And fusion three-dimensional model of three-dimensional model of the human body and clothes fitting three-dimensional model generated by the three-dimensional model fitting integration of information and real time video, showing the effect of not only the superposition of the two, but may be those with the fitting of human form combine vividly shows the effect of fitting person to try and improve the effect of the virtual fitting.

[0088] 在本实施例中,步骤10、光学摄像机实时获取实景视频信息之前,还可以包括以下步骤: Before [0088] In the present embodiment, step 10, the optical video camcorder real time access information may further comprise the step of:

[0089] 步骤20、第一校正模块根据预设焦距信息,对光学摄像机进行标定; [0089] Step 20, the correction module in accordance with a first predetermined focal length information, the optical camera calibration;

[0090] 步骤30、第二校正模块将光学摄像机和深度摄像机调整为同步同视角。 [0090] Step 30, the second correction optical module is adjusted and depth video cameras synchronized with the angle of view.

[0091] 通过对光学摄像机和深度摄像机进行标定和校正,可以提高虚拟三维模型与实景视频融合的效果。 [0091] By an optical camera and the depth camera calibration and correction, virtual three-dimensional model can be improved and the effect of real video integration.

[0092] 在本实施例中,具体的,人体标识信息包括外形信息和动作信息。 [0092] In the present embodiment, specifically, the body shape information including the identification information and operation information. 相应地,步骤20、 深度摄像机实时获取试衣者的人体标识信息,具体可以包括以下步骤: Accordingly, step 20, the depth of the camera's real-time access fitting body identification information, may specifically include the following steps:

[0093] 步骤201、深度摄像机实时捕捉试衣者的各像素点的深度信息以及试衣者的轮廓信息,以形成外形信息; [0093] Step 201, a depth camera captures real depth information of each pixel by fitting the contour information and the person fitting to form a shape information;

[0094] 步骤202、深度摄像机根据轮廓信息生成骨骼节点信息,并根据骨骼节点信息生成动作信息。 [0094] Step 202, the camera depth contour skeletal node information generation information, and generates motion information according to the node information according to the skeleton.

[0095] 在本实施例中,步骤30、人体三维模型模块根据深度摄像机获取的人体标识信息生成人体三维模型,具体可以包括以下步骤: [0095] In the present embodiment, step 30, the three-dimensional human body model identification information generation module according to the three-dimensional human body model obtained by a depth camera may specifically include the following steps:

[0096] 步骤301、人体三维模型模块根据外形信息调整人体基础模型的形状,生成人体静态模型; [0096] Step 301, the three-dimensional human body model information adjustment module according to the outline shape of the model base body, the human body generates a static model;

[0097] 步骤302、人体三维模型模块根据动作信息调整人体静态模型的动作,生成人体三维模型,以对试衣者进行模拟。 [0097] Step 302, the three-dimensional human body model module based on the operation information of the operation to adjust the body static model, the human body generates a three-dimensional model to be simulated by fitting.

[0098] 通过根据外形信息调整人体基础模型来生成与试衣者相匹配的人体静态模型,可以简化人体三维模型生成算法。 [0098] generating a static model of the human body by fitting to match the shape information according to adjust the body by the base model, the human body can be simplified three-dimensional model generation algorithm.

[0099] 在本实施例中,步骤40、衣服三维模型模块根据深度摄像机获取的人体标识信息生成衣服三维模型,具体可以包括以下步骤: [0099] In the present embodiment, step 40, module generates a three-dimensional model of clothing garment three-dimensional model of the human body identification information acquired by the depth camera may specifically include the following steps:

[0100] 步骤401、衣服三维模型模块根据外形信息调整衣服基础模型的形状,生成衣服静态模型; [0100] Step 401, adjustment module garment three-dimensional model based on the shape of clothes based model shape information, generating static model clothes;

[0101] 步骤402、衣服三维模型模块根据动作信息调整衣服静态模型的位置和动作姿态, 生成衣服动态模型; [0101] Step 402, the three-dimensional model module clothes adjust the position and attitude of the operation of the clothes based on the operation information static model, generated clothes dynamic model;

[0102] 步骤403、衣服三维模型模块根据动作信息和衣服动态模型,生成衣服三维模型。 [0102] Step 403, the three-dimensional model module clothes based on the operation information and the dynamic model clothes, clothes generated three-dimensional model.

[0103] 通过外形信息调整衣服基础模型的形状,生成的衣服静态模型,可以与试衣者的体型相匹配,并根据动作信息调整衣服静态模型的位置和动作姿态省的衣服动态模型,使衣服动态模型可以根据试衣者的动作而处于相应的位置,表现相应的效果。 [0103] adjust the clothes basis of the model by the shape information on the shape, the resulting clothes static model can be matched with the body fitting's, and with the garment dynamic model position and operation of the posture province operation information adjustment clothes static model, the garment dynamic models may be in accordance with the operation position corresponding to the fitting by, the corresponding performance results.

[0104] 在本实施例中,步骤50、三维模型融合模块分别将人体三维模型模块生成的人体三维模型和衣服三维模型模块生成的衣服三维模型相融合,生成试衣三维模型,具体可以包括以下步骤: [0104] In the present embodiment, step 50, the three-dimensional model merging garment three-dimensional model module respectively dimensional body model module to generate a dimensional body model and the garment three-dimensional model module generates is fused, generating fitting three-dimensional model, it may specifically include the following step:

[0105] 步骤501、三维模型融合模块将人体三维模型和衣服三维模型组合,生成遮挡三维模型; [0105] Step 501, the three-dimensional model of human fusion module 3D models and three-dimensional model combination clothes, three-dimensional model generated occlusion;

[0106] 步骤502、三维模型融合模块对遮挡三维模型进行渲染; [0106] Step 502, the three-dimensional model of the fusion module for rendering three-dimensional model of occlusion;

[0107] 步骤503、三维模型融合模块将渲染后的遮挡三维模型中的人体三维模型透明化处理,生成试衣三维模型。 [0107] Step 503, the three-dimensional model of human fusion module shielding transparent three-dimensional model a three-dimensional model of the rendering process to generate three-dimensional model fitting.

[0108] 通过对衣服模型遮挡处的处理,使试衣三维模型可以真是地表现试衣效果。 [0108] By the process of the clothes occlusion model the three-dimensional model fitting can be really effect the performance of the fitting.

[0109] 本发明实施例提供的增强现实实时虚拟试衣系统及方法,通过深度摄像机实时获取人体标识信息,并根据该人体标识信息生成人体三维模型和衣服三维模型,衣服三维模型可以与试衣者的体型相符,而且可以表现出试衣者穿上衣服时,衣服所表现出的与试衣者身体曲线相对应的效果。 [0109] Augmented reality real-time virtual dressing system and method according to an embodiment of the present invention, obtaining the human identification information in real time through a depth camera, and the body identification information generation dimensional body model and the garment three-dimensional model according garment three-dimensional model may be a fitting match the body shape, and can show when wearing clothes, clothes exhibited by the fitting's body curve fitting corresponding to those effects. 并且通过人体三维模型和衣服三维模型的融合处理生成试衣三维模型,使试衣三维模型融合与实景视频信息时,表现出的效果不仅仅是二者的叠加,而是可以与试衣者的人体形态相结合,逼真地显示了试着者的试衣效果。 And fusion three-dimensional model of three-dimensional model of the human body and clothes fitting three-dimensional model generated by the three-dimensional model fitting integration of information and real time video, showing the effect of not only the superposition of the two, but may be those with the fitting of human form combined realistically shows the effect of trying to persons fitting. 虚拟服装可以根据试衣者的动作自动改变试衣效果,解决了不同人体转动角度和姿态下的虚拟服装在试衣者身上的正确叠加显示,提高了虚拟试衣的效果。 Virtual apparel try-on result can be automatically changed according to the operation's fitting to solve the virtual clothing for different body posture correct rotation angle and superimpose fitting's body shows that increasing the virtual fitting effect.

[0110] 最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换; 而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。 [0110] Finally, it should be noted that: the above embodiments are intended to illustrate the present invention, rather than limiting;. Although the present invention has been described in detail embodiments, those of ordinary skill in the art should be understood: It may still be made to the embodiments described in the foregoing embodiments modifications, or to some technical features equivalents; as such modifications or replacements do not cause the essence of corresponding technical solutions to depart from the technical solutions of the embodiments of the present invention, and range.

Claims (12)

1. 一种增强现实实时虚拟试衣系统,其特征在于,包括:光学摄像机,用于实时获取实景视频信息;深度摄像机,用于实时获取试衣者的人体标识信息;人体三维模型模块,与所述深度摄像机连接,用于根据所述人体标识信息生成人体三维模型;衣服三维模型模块,与所述深度摄像机相连,用于根据所述人体标识信息生成衣服三维模型;三维模型融合模块,分别与所述人体三维模型模块和所述衣服三维模型模块相连,用于将所述人体三维模型和所述衣服三维模型相融合,生成试衣三维模型;实景融合模块,分别与所述光学摄像机和所述三维模型融合模块相连,用于将所述试衣三维模型和所述实景视频信息相融合,生成试衣视频信息。 An augmented reality system, real-time virtual fitting, characterized by comprising: an optical camera, real-time access to real video information; depth cameras, real-time access for fitting the body's identification information; dimensional body model module, and the depth camera is connected, the identification information according to the human body generates a three-dimensional model; garment-dimensional model module, connected to the depth camera, for the identification information generating body garment in accordance with the three-dimensional model; three-dimensional model integration module, respectively, three-dimensional model of the human body and the garment three-dimensional model module module is connected, for the integration of the three-dimensional human body model and the garment three-dimensional model, generated three dimensional model fitting; real integration module, respectively, and the optical camera fusion module coupled to the three-dimensional model, for fitting said three-dimensional model and the real integration of video information, video information generating fitting.
2.根据权利要求1所述的增强现实实时虚拟试衣系统,其特征在于,还包括:第一校正模块,与所述光学摄像机相连,用于根据预设焦距信息,对所述光学摄像机进行标定;第二校正模块,分别与所述光学摄像机和所述深度摄像机相连,用于将所述光学摄像机和所述深度摄像机调整为同步同视角。 The augmented reality system of real-time virtual fitting according to claim 1, characterized in that, further comprising: a first correction module connected to the optical camera, according to a preset focal length information, the optical camera calibration; second correction module, respectively, the optical camera and the depth camera is connected, for the optical camera and the depth camera is synchronized with the angle of view adjustment.
3.根据权利要求1或2所述的增强现实实时虚拟试衣系统,其特征在于:所述人体标识信息包括外形信息和动作信息;相应地,所述深度摄像机包括外形信息捕捉单元和动作信息捕捉单元;所述外形信息捕捉单元用于实时捕捉所述试衣者的各像素点的深度信息以及所述试衣者的轮廓信息,以形成所述外形信息;所述动作信息捕捉单元与所述外形信息捕捉单元相连,用于根据所述轮廓信息生成骨骼节点信息,并根据所述骨骼节点信息生成所述动作信息。 The AR 12 or the real-time virtual dressing system as claimed in claim, wherein: the body includes the shape information and the identification information of the operation information; accordingly, the depth camera capturing unit includes shape information and motion information capturing unit; means for capturing the shape information of depth information and contour information of the fitting of each pixel's real-time capture of the person fitting, to form the outer shape information; the motion information and the capturing unit capturing unit is connected to said shape information, according to the profile information generation skeleton node information, and generates the motion information based on the skeleton information node.
4.根据权利要求3所述的增强现实实时虚拟试衣系统,其特征在于,所述人体三维模型包括:人体模型调整单元,用于根据所述外形信息调整人体基础模型的形状,生成人体静态模型;人体模型运动单元,用于根据所述动作信息调整所述人体静态模型的动作,生成所述人体三维模型,以对所述试衣者进行模拟。 4. The augmented reality system of real-time virtual dressing of claim 3, wherein the three-dimensional model of the human body comprising: a human body model adjustment means for adjusting the human body model based on the basis of the shape of shape information, generates a static body model; mannequin movement unit for adjusting the operation information of the operation body static model, the human body generates a three-dimensional model to simulate the fitting person.
5.根据权利要求3所述的增强现实实时虚拟试衣系统,其特征在于,所述衣服三维模型包括:衣服模型调整单元,用于根据所述外形信息调整衣服基础模型的形状,生成衣服静态模型;衣服模型运动单元,用于根据所述动作信息调整所述衣服静态模型的位置和动作姿态,生成衣服动态模型;三维引擎单元,用于根据所述动作信息和所述衣服动态模型,生成所述衣服三维模型。 The augmented reality system of real-time virtual fitting according to claim 3, wherein the three-dimensional model of said garment comprising: a garment model adjustment means for adjusting a basis of the model based on the clothing outline shape information, generating static clothes model; dress model motion means for adjusting the position information of the article of clothing and operation of the static model operation posture, generates dynamic model clothes; 3-D ​​engine unit, according to the action information and the dynamic model of the garment, generated three-dimensional model of the garment.
6.根据权利要求3所述的增强现实实时虚拟试衣系统,其特征在于,所述三维模型融合模块包括:组合单元,用于将所述人体三维模型和所述衣服三维模型组合,生成遮挡三维模型;渲染单元,用于对所述遮挡三维模型进行渲染;透明化单元,用于将渲染后的遮挡三维模型中的人体三维模型透明化处理,生成所述试衣三维模型。 The enhancement of the real-time virtual reality 3 dressing system as claimed in claim wherein said three dimensional model fusion module comprising: a combining unit for combining the three-dimensional human body model and the garment three-dimensional model, generated occlusion three-dimensional model; rendering unit configured to render three-dimensional model of the occlusion; transparency unit, shielding for the three-dimensional model of human three-dimensional model in a rendered transparent processing to generate a three-dimensional model fitting.
7. 一种增强现实实时虚拟试衣方法,其特征在于,包括: 光学摄像机实时获取实景视频信息;深度摄像机实时获取试衣者的人体标识信息;人体三维模型模块根据所述深度摄像机获取的人体标识信息生成人体三维模型; 衣服三维模型模块根据所述深度摄像机获取的人体标识信息生成衣服三维模型; 三维模型融合模块分别将所述人体三维模型模块生成的所述人体三维模型和所述衣服三维模型模块生成的所述衣服三维模型相融合,生成试衣三维模型;实景融合模块分别将所述衣服三维模型模块生成的所述试衣三维模型和所述光学摄像机获取的所述实景视频信息相融合,生成试衣视频信息。 A real-time augmented reality virtual try method, comprising: an optical camera real time access video information; depth camera identification information acquired in real time the body's fitting; body module acquires three-dimensional model according to the depth camera body generating a three dimensional model of human identification information; clothing garment three-dimensional model generation module according to a three-dimensional model of human depth of the identification information acquired by the camera; three-dimensional model of the fusion module respectively dimensional body model clothes dimensional body and three-dimensional model generated by the module the garment model module to generate three-dimensional model is fused, generating three-dimensional model fitting; real three-dimensional model of the fitting, respectively, the fusion module garment module generates three-dimensional model of the camera and the optical information acquired with the real video fusion, generates a fitting video information.
8.根据权利要求7所述的增强现实实时虚拟试衣方法,其特征在于,所述光学摄像机实时获取实景视频信息之前,还包括:第一校正模块根据预设焦距信息,对所述光学摄像机进行标定; 第二校正模块将所述光学摄像机和所述深度摄像机调整为同步同视角。 8. The real-time augmented reality virtual try method according to claim 7, characterized in that, before the video information of real time access to the optical camera, further comprising: a correction module in accordance with a first predetermined focal length information, the optical camera calibration; second correction module the optical camera and the depth camera is synchronized with the angle of view adjustment.
9.根据权利要求7或8所述的增强现实实时虚拟试衣方法,其特征在于,所述人体标识信息包括外形信息和动作信息;相应地,所述深度摄像机实时获取试衣者的人体标识信息, 包括:所述深度摄像机实时捕捉所述试衣者的各像素点的深度信息以及所述试衣者的轮廓信息,以形成所述外形信息;所述深度摄像机根据所述轮廓信息生成骨骼节点信息,并根据所述骨骼节点信息生成所述动作信息。 9. A real-time augmented reality virtual try The method of claim 7 or claim 8, wherein said human identification information comprises action information and shape information; accordingly, the depth of the fitting acquired in real time by the camera body identification information, comprising: a real-time capture of the camera depth information of each pixel of the depth of the fitting and the test person's clothing contour information, to form the outer shape information; depth camera generating the skeleton information based on the contour node information, and generates the motion information based on the bone node.
10.根据权利要求9所述的增强现实实时虚拟试衣方法,其特征在于,所述人体三维模型模块根据所述深度摄像机获取的人体标识信息生成人体三维模型,包括:所述人体三维模型模块根据所述外形信息调整人体基础模型的形状,生成人体静态模型;所述人体三维模型模块根据所述动作信息调整所述人体静态模型的动作,生成所述人体三维模型,以对所述试衣者进行模拟。 10. The AR according to real-time virtual try-9 A method according to claim, wherein the three-dimensional model of human depth camera module according to the acquired identification information of the human body to generate a three-dimensional model, comprising: a three-dimensional human body model module the basis of the shape information to adjust the body shape of the model, the human body generates a static model; three-dimensional model of the human body based on the operation module adjusting the operation information of the static model of the human body, the human body generates a three-dimensional model to the fitting by simulation.
11.根据权利要求9所述的增强现实实时虚拟试衣方法,其特征在于,所述衣服三维模型模块根据所述深度摄像机获取的人体标识信息生成衣服三维模型,包括:所述衣服三维模型模块根据所述外形信息调整衣服基础模型的形状,生成衣服静态模型;所述衣服三维模型模块根据所述动作信息调整所述衣服静态模型的位置和动作姿态, 生成衣服动态模型;所述衣服三维模型模块根据所述动作信息和所述衣服动态模型,生成所述衣服三维模型。 11. The AR according to real-time virtual try-9 A method according to claim, wherein the garment of clothing three-dimensional model generation module according to a three-dimensional model of human identification information of the acquired depth camera, comprising: a three-dimensional model of the garment module the shape of the garment to adjust the shape information of the base model, generating a static model clothes; three-dimensional model of the garment module according to the movement of the garment static model information adjustment position and attitude of the operation, to generate a dynamic model of clothes; three-dimensional model of said garment module according to the movement information and the dynamic model of the garment, the garment generating three-dimensional model.
12.根据权利要求9所述的增强现实实时虚拟试衣方法,其特征在于,所述三维模型融合模块分别将所述人体三维模型模块生成的所述人体三维模型和所述衣服三维模型模块生成的所述衣服三维模型相融合,生成试衣三维模型,包括:所述三维模型融合模块将所述人体三维模型和所述衣服三维模型组合,生成遮挡三维模型;所述三维模型融合模块对所述遮挡三维模型进行渲染;所述三维模型融合模块将渲染后的遮挡三维模型中的人体三维模型透明化处理,生成所述试衣三维模型。 12. The enhanced real-time virtual reality 9 dressing method according to claim, wherein the three-dimensional model, respectively, the fusion module three-dimensional human body model and the garment three-dimensional human body model module to generate three-dimensional model generation module three-dimensional model of the garment fused, generating three-dimensional model fitting, comprising: a three-dimensional model of the human body fusion module combination of three-dimensional model and three-dimensional model of the garment, to generate a three-dimensional model of occlusion; the three-dimensional model of the fusion module rendering three-dimensional model of said shutter; three-dimensional model of the three-dimensional model of human fusion module occlusion model of a three-dimensional rendering of transparent processing to generate a three-dimensional model fitting.
CN2011100812034A 2011-03-30 2011-03-30 Augmented reality real-time virtual fitting system and method thereof CN102156810A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100812034A CN102156810A (en) 2011-03-30 2011-03-30 Augmented reality real-time virtual fitting system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100812034A CN102156810A (en) 2011-03-30 2011-03-30 Augmented reality real-time virtual fitting system and method thereof

Publications (1)

Publication Number Publication Date
CN102156810A true CN102156810A (en) 2011-08-17

Family

ID=44438304

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100812034A CN102156810A (en) 2011-03-30 2011-03-30 Augmented reality real-time virtual fitting system and method thereof

Country Status (1)

Country Link
CN (1) CN102156810A (en)

Cited By (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102298797A (en) * 2011-08-31 2011-12-28 深圳市美丽同盟科技有限公司 Fitting the three-dimensional virtual method, apparatus and system for
CN102314661A (en) * 2011-09-07 2012-01-11 深圳市酷开网络科技有限公司 Cloud computing-based virtual fitting system and method
CN102509224A (en) * 2011-10-21 2012-06-20 佛山伊贝尔科技有限公司 Range-image-acquisition-technology-based human body fitting method
CN102509349A (en) * 2011-09-27 2012-06-20 深圳市朵唯志远科技有限公司 Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal
CN102682211A (en) * 2012-05-09 2012-09-19 晨星半导体股份有限公司 Three-dimensional fitting method and device
CN102842089A (en) * 2012-07-18 2012-12-26 上海交通大学 Network virtual fit system based on 3D actual human body model and clothes model
CN102945530A (en) * 2012-10-18 2013-02-27 贵州宝森科技有限公司 3D intelligent apparel fitting system and method
CN102982581A (en) * 2011-09-05 2013-03-20 北京三星通信技术研究有限公司 Virtual try-on system and method based on images
CN103106604A (en) * 2013-01-23 2013-05-15 东华大学 Three dimensional (3D) virtual fitting method based on somatosensory technology
CN103198461A (en) * 2011-11-08 2013-07-10 索尼公司 Image processing apparatus, image processing method, and program
CN103310342A (en) * 2012-03-15 2013-09-18 凹凸电子(武汉)有限公司 Electronic fitting method and electronic fitting device
CN103366402A (en) * 2013-08-05 2013-10-23 上海趣搭网络科技有限公司 Fast attitude synchronization method of three-dimensional virtual clothing
CN103533449A (en) * 2012-12-20 2014-01-22 Tcl集团股份有限公司 Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television
US20140063056A1 (en) * 2012-08-29 2014-03-06 Koskar Inc. Apparatus, system and method for virtually fitting wearable items
CN103678836A (en) * 2012-08-30 2014-03-26 北京三星通信技术研究有限公司 Virtual fit system and method
CN103799769A (en) * 2012-11-07 2014-05-21 程抒一 Digital virtual storage rack
CN103871099A (en) * 2014-03-24 2014-06-18 惠州Tcl移动通信有限公司 3D simulation matching processing method and system based on mobile terminal
CN103871106A (en) * 2012-12-14 2014-06-18 韩国电子通信研究院 Method of fitting virtual item using human body model and system for providing fitting service of virtual item
CN103907138A (en) * 2011-11-09 2014-07-02 索尼公司 Information processing device, display control method, and program
CN104021590A (en) * 2013-02-28 2014-09-03 北京三星通信技术研究有限公司 Virtual try-on system and virtual try-on method
CN104081379A (en) * 2011-10-27 2014-10-01 电子湾股份有限公司 Visualization of items using augmented reality
CN104133942A (en) * 2014-07-08 2014-11-05 上海置森数码技术有限公司 Intelligent 3D life data cloud service system
CN104182886A (en) * 2013-05-24 2014-12-03 比亚迪股份有限公司 Virtual fitting method and mobile terminal for virtual fitting
CN104952113A (en) * 2015-07-08 2015-09-30 北京理工大学 Dress fitting experience method, system and equipment
CN105096246A (en) * 2014-05-08 2015-11-25 腾讯科技(深圳)有限公司 Image synthesis method and system
CN105184584A (en) * 2015-09-17 2015-12-23 北京京东方多媒体科技有限公司 Virtual fitting system and method
WO2016000304A1 (en) * 2014-06-30 2016-01-07 京东方科技集团股份有限公司 Virtual fitting method and virtual fitting system
CN105279795A (en) * 2014-07-09 2016-01-27 先科媒体有限公司 3D-marker-based augmented reality system
CN105404392A (en) * 2015-11-03 2016-03-16 北京英梅吉科技有限公司 Monocular camera based virtual wearing method and system
WO2016045111A1 (en) * 2014-09-28 2016-03-31 广州新节奏智能科技有限公司 Intelligent shopping experience apparatus and experience method
CN105788002A (en) * 2016-01-06 2016-07-20 湖南拓视觉信息技术有限公司 3D virtual shoe fitting method and system
CN105787751A (en) * 2016-01-06 2016-07-20 湖南拓视觉信息技术有限公司 3D human body virtual fitting method and system
WO2016123769A1 (en) * 2015-02-05 2016-08-11 周谆 Human interaction method and system for trying on virtual accessory
CN105957139A (en) * 2016-05-23 2016-09-21 矽照光电(厦门)有限公司 AR (Augmented Reality) 3D model generation method
CN105989618A (en) * 2014-08-08 2016-10-05 株式会社东芝 Virtual try-on apparatus and virtual try-on method
CN106057067A (en) * 2016-06-01 2016-10-26 浙江工业大学 Translucent mark making method for augmented reality
CN106097442A (en) * 2016-08-24 2016-11-09 广东华邦云计算股份有限公司 A kind of intelligent simulation dressing system and application process thereof
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method
CN106127846A (en) * 2016-06-28 2016-11-16 乐视控股(北京)有限公司 Virtual reality terminal and vision virtual method thereof and device
CN106157358A (en) * 2015-03-26 2016-11-23 成都理想境界科技有限公司 Object fusion method based on video image and terminal
CN106157374A (en) * 2016-07-12 2016-11-23 广州凡拓数字创意科技股份有限公司 Numbers show system and method based on virtual reality
CN106327290A (en) * 2016-08-11 2017-01-11 安徽健搏信息科技有限公司 Virtual fitting system based on augmented reality
CN106327562A (en) * 2016-09-09 2017-01-11 武汉布偶猫科技有限公司 Method of solving penetration problem in case of clothing collocation in three-dimensional simulation
CN106340064A (en) * 2016-08-25 2017-01-18 北京大视景科技有限公司 Mixed-reality sandbox device and method
CN106503286A (en) * 2016-09-18 2017-03-15 福建网龙计算机网络信息技术有限公司 The service of cutting the garment according to the figure and its system
CN106600638A (en) * 2016-11-09 2017-04-26 深圳奥比中光科技有限公司 Realization method of augmented reality
CN106650643A (en) * 2016-12-06 2017-05-10 北京心有灵犀科技有限公司 Method enabling jewelry to have enhanced reality function
WO2017197951A1 (en) * 2016-05-19 2017-11-23 京东方科技集团股份有限公司 Rendering method in augmented reality scene, processing module, and augmented reality glasses
CN107609946A (en) * 2017-09-19 2018-01-19 北京优时尚科技有限责任公司 A kind of display control method and computing device
CN107919066A (en) * 2016-10-10 2018-04-17 北京七展国际数字科技有限公司 The immersion display systems and method of a kind of arc curtain hyperbolic
CN108564612A (en) * 2018-03-26 2018-09-21 广东欧珀移动通信有限公司 Model display methods, device, storage medium and electronic equipment
WO2019000464A1 (en) * 2017-06-30 2019-01-03 广东欧珀移动通信有限公司 Image display method and device, storage medium, and terminal
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US10423220B2 (en) 2014-08-08 2019-09-24 Kabushiki Kaisha Toshiba Virtual try-on apparatus, virtual try-on method, and computer program product

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1975775A (en) * 2005-12-01 2007-06-06 国际商业机器公司 Consumer representation rendering method and system with selected merchandise
CN101145238A (en) * 2007-02-08 2008-03-19 罗中根 Super realistic three-dimensional holographic intelligent dummy human system and method
CN201111142Y (en) * 2007-08-24 2008-09-03 北京和炫科技有限公司 Three-dimensional virtual fitting platform system based on network
CN101256655A (en) * 2007-02-28 2008-09-03 尹红伟 Real human body three-dimensional tridimensional virtual fitting system
CN101398942A (en) * 2008-04-24 2009-04-01 中山大学 Three-dimensional fitting emulation system
CN101937546A (en) * 2010-08-31 2011-01-05 中山大学 On-line shopping system and method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1975775A (en) * 2005-12-01 2007-06-06 国际商业机器公司 Consumer representation rendering method and system with selected merchandise
CN101145238A (en) * 2007-02-08 2008-03-19 罗中根 Super realistic three-dimensional holographic intelligent dummy human system and method
CN101256655A (en) * 2007-02-28 2008-09-03 尹红伟 Real human body three-dimensional tridimensional virtual fitting system
CN201111142Y (en) * 2007-08-24 2008-09-03 北京和炫科技有限公司 Three-dimensional virtual fitting platform system based on network
CN101398942A (en) * 2008-04-24 2009-04-01 中山大学 Three-dimensional fitting emulation system
CN101937546A (en) * 2010-08-31 2011-01-05 中山大学 On-line shopping system and method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
曹惠龙: "三维虚拟与实景视频的融合平台研究及设计", 《电脑知识与技术》 *

Cited By (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
CN102298797A (en) * 2011-08-31 2011-12-28 深圳市美丽同盟科技有限公司 Fitting the three-dimensional virtual method, apparatus and system for
CN102982581A (en) * 2011-09-05 2013-03-20 北京三星通信技术研究有限公司 Virtual try-on system and method based on images
CN102982581B (en) * 2011-09-05 2017-04-05 北京三星通信技术研究有限公司 System for virtually trying and method based on image
CN102314661A (en) * 2011-09-07 2012-01-11 深圳市酷开网络科技有限公司 Cloud computing-based virtual fitting system and method
CN102509349A (en) * 2011-09-27 2012-06-20 深圳市朵唯志远科技有限公司 Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal
CN102509349B (en) * 2011-09-27 2015-07-15 深圳市朵唯志远科技有限公司 Fitting method based on mobile terminal, fitting device based on mobile terminal and mobile terminal
CN102509224A (en) * 2011-10-21 2012-06-20 佛山伊贝尔科技有限公司 Range-image-acquisition-technology-based human body fitting method
US10147134B2 (en) 2011-10-27 2018-12-04 Ebay Inc. System and method for visualization of items in an environment using augmented reality
CN104081379A (en) * 2011-10-27 2014-10-01 电子湾股份有限公司 Visualization of items using augmented reality
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
CN103198461A (en) * 2011-11-08 2013-07-10 索尼公司 Image processing apparatus, image processing method, and program
CN103198461B (en) * 2011-11-08 2017-12-19 索尼公司 Image processing equipment, image processing method and program
US10163419B2 (en) 2011-11-08 2018-12-25 Sony Corporation Image processing to combine virtual object with captured image
US9865094B2 (en) 2011-11-09 2018-01-09 Sony Corporation Information processing apparatus, display control method, and program
CN103907138B (en) * 2011-11-09 2017-11-24 索尼公司 Message processing device and display control method
CN103907138A (en) * 2011-11-09 2014-07-02 索尼公司 Information processing device, display control method, and program
CN103310342A (en) * 2012-03-15 2013-09-18 凹凸电子(武汉)有限公司 Electronic fitting method and electronic fitting device
CN102682211A (en) * 2012-05-09 2012-09-19 晨星半导体股份有限公司 Three-dimensional fitting method and device
CN102842089A (en) * 2012-07-18 2012-12-26 上海交通大学 Network virtual fit system based on 3D actual human body model and clothes model
US20140063056A1 (en) * 2012-08-29 2014-03-06 Koskar Inc. Apparatus, system and method for virtually fitting wearable items
CN103678836A (en) * 2012-08-30 2014-03-26 北京三星通信技术研究有限公司 Virtual fit system and method
CN102945530A (en) * 2012-10-18 2013-02-27 贵州宝森科技有限公司 3D intelligent apparel fitting system and method
CN103799769A (en) * 2012-11-07 2014-05-21 程抒一 Digital virtual storage rack
US9607419B2 (en) 2012-12-14 2017-03-28 Electronics And Telecommunications Research Institute Method of fitting virtual item using human body model and system for providing fitting service of virtual item
CN103871106A (en) * 2012-12-14 2014-06-18 韩国电子通信研究院 Method of fitting virtual item using human body model and system for providing fitting service of virtual item
CN103533449A (en) * 2012-12-20 2014-01-22 Tcl集团股份有限公司 Method and system for realizing three-dimensional fitting based on intelligent three-dimensional television
CN103106604B (en) * 2013-01-23 2016-04-06 东华大学 Based on the 3D virtual fit method of body sense technology
CN103106604A (en) * 2013-01-23 2013-05-15 东华大学 Three dimensional (3D) virtual fitting method based on somatosensory technology
CN104021590A (en) * 2013-02-28 2014-09-03 北京三星通信技术研究有限公司 Virtual try-on system and virtual try-on method
CN104182886A (en) * 2013-05-24 2014-12-03 比亚迪股份有限公司 Virtual fitting method and mobile terminal for virtual fitting
CN103366402A (en) * 2013-08-05 2013-10-23 上海趣搭网络科技有限公司 Fast attitude synchronization method of three-dimensional virtual clothing
CN103366402B (en) * 2013-08-05 2015-12-09 上海趣搭网络科技有限公司 The rapid posture-synchronizing method of three-dimensional dress ornament
CN103871099A (en) * 2014-03-24 2014-06-18 惠州Tcl移动通信有限公司 3D simulation matching processing method and system based on mobile terminal
CN105096246A (en) * 2014-05-08 2015-11-25 腾讯科技(深圳)有限公司 Image synthesis method and system
WO2016000304A1 (en) * 2014-06-30 2016-01-07 京东方科技集团股份有限公司 Virtual fitting method and virtual fitting system
CN104133942A (en) * 2014-07-08 2014-11-05 上海置森数码技术有限公司 Intelligent 3D life data cloud service system
CN105279795A (en) * 2014-07-09 2016-01-27 先科媒体有限公司 3D-marker-based augmented reality system
CN105279795B (en) * 2014-07-09 2018-07-24 先科媒体有限公司 Augmented reality system based on 3D labels
CN105989618A (en) * 2014-08-08 2016-10-05 株式会社东芝 Virtual try-on apparatus and virtual try-on method
US10423220B2 (en) 2014-08-08 2019-09-24 Kabushiki Kaisha Toshiba Virtual try-on apparatus, virtual try-on method, and computer program product
WO2016045111A1 (en) * 2014-09-28 2016-03-31 广州新节奏智能科技有限公司 Intelligent shopping experience apparatus and experience method
WO2016123769A1 (en) * 2015-02-05 2016-08-11 周谆 Human interaction method and system for trying on virtual accessory
CN106157358A (en) * 2015-03-26 2016-11-23 成都理想境界科技有限公司 Object fusion method based on video image and terminal
CN104952113A (en) * 2015-07-08 2015-09-30 北京理工大学 Dress fitting experience method, system and equipment
CN104952113B (en) * 2015-07-08 2018-04-27 北京理工大学 Dress ornament tries experiential method, system and equipment on
CN105184584A (en) * 2015-09-17 2015-12-23 北京京东方多媒体科技有限公司 Virtual fitting system and method
CN105404392A (en) * 2015-11-03 2016-03-16 北京英梅吉科技有限公司 Monocular camera based virtual wearing method and system
CN105404392B (en) * 2015-11-03 2018-04-20 北京英梅吉科技有限公司 Virtual method of wearing and system based on monocular cam
CN105788002A (en) * 2016-01-06 2016-07-20 湖南拓视觉信息技术有限公司 3D virtual shoe fitting method and system
CN105787751A (en) * 2016-01-06 2016-07-20 湖南拓视觉信息技术有限公司 3D human body virtual fitting method and system
WO2017197951A1 (en) * 2016-05-19 2017-11-23 京东方科技集团股份有限公司 Rendering method in augmented reality scene, processing module, and augmented reality glasses
CN105957139A (en) * 2016-05-23 2016-09-21 矽照光电(厦门)有限公司 AR (Augmented Reality) 3D model generation method
CN106057067A (en) * 2016-06-01 2016-10-26 浙江工业大学 Translucent mark making method for augmented reality
CN106097435A (en) * 2016-06-07 2016-11-09 北京圣威特科技有限公司 A kind of augmented reality camera system and method
CN106127846A (en) * 2016-06-28 2016-11-16 乐视控股(北京)有限公司 Virtual reality terminal and vision virtual method thereof and device
CN106157374A (en) * 2016-07-12 2016-11-23 广州凡拓数字创意科技股份有限公司 Numbers show system and method based on virtual reality
CN106327290A (en) * 2016-08-11 2017-01-11 安徽健搏信息科技有限公司 Virtual fitting system based on augmented reality
CN106097442A (en) * 2016-08-24 2016-11-09 广东华邦云计算股份有限公司 A kind of intelligent simulation dressing system and application process thereof
CN106340064B (en) * 2016-08-25 2019-02-01 北京大视景科技有限公司 A kind of mixed reality sand table device and method
CN106340064A (en) * 2016-08-25 2017-01-18 北京大视景科技有限公司 Mixed-reality sandbox device and method
CN106327562A (en) * 2016-09-09 2017-01-11 武汉布偶猫科技有限公司 Method of solving penetration problem in case of clothing collocation in three-dimensional simulation
CN106503286A (en) * 2016-09-18 2017-03-15 福建网龙计算机网络信息技术有限公司 The service of cutting the garment according to the figure and its system
CN107919066A (en) * 2016-10-10 2018-04-17 北京七展国际数字科技有限公司 The immersion display systems and method of a kind of arc curtain hyperbolic
CN106600638A (en) * 2016-11-09 2017-04-26 深圳奥比中光科技有限公司 Realization method of augmented reality
CN106650643A (en) * 2016-12-06 2017-05-10 北京心有灵犀科技有限公司 Method enabling jewelry to have enhanced reality function
WO2019000464A1 (en) * 2017-06-30 2019-01-03 广东欧珀移动通信有限公司 Image display method and device, storage medium, and terminal
CN107609946A (en) * 2017-09-19 2018-01-19 北京优时尚科技有限责任公司 A kind of display control method and computing device
CN108564612A (en) * 2018-03-26 2018-09-21 广东欧珀移动通信有限公司 Model display methods, device, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
DE69922898T2 (en) Method for three-dimensional facial model production from facial images
KR101821284B1 (en) Method and system to create custom products
JP4401727B2 (en) Image display apparatus and method
KR101323966B1 (en) A system and method for 3D space-dimension based image processing
US20050234782A1 (en) Clothing and model image generation, combination, display, and selection
JP4804256B2 (en) Information processing method
RU2638776C1 (en) Image generating device and method
Hilton et al. Whole-body modelling of people from multiview images to populate virtual worlds
JP2011521357A (en) System, method and apparatus for motion capture using video images
JP6074494B2 (en) Shape recognition device, shape recognition program, and shape recognition method
KR101455403B1 (en) Capturing and processing facial motion data
CN105264478B (en) Holography anchoring and dynamic positioning
JP5028389B2 (en) Method and apparatus for extending the functionality of a mirror using information related to the content and operation on the mirror
US9607419B2 (en) Method of fitting virtual item using human body model and system for providing fitting service of virtual item
CN102981616B (en) The recognition methods of object and system and computer in augmented reality
KR20150079585A (en) System and method for deriving accurate body size measures from a sequence of 2d images
KR20130028878A (en) Combined stereo camera and stereo display interaction
US20110298897A1 (en) System and method for 3d virtual try-on of apparel on an avatar
US20160148427A1 (en) Techniques for processing reconstructed three-dimensional image data
CN102959616B (en) Interactive reality augmentation for natural interaction
US20110210970A1 (en) Digital mirror apparatus
JP2006249618A (en) Virtual try-on device
US9811854B2 (en) 3-D immersion technology in a virtual store
CN1404016A (en) Establishing method of human face 3D model by fusing multiple-visual angle and multiple-thread 2D information
EA200970864A1 (en) Method and system for individual sewing and retail sale clothes

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C12 Rejection of a patent application after its publication