CN103529943A - Human body projection interactive method based on fluid physical simulation system - Google Patents

Human body projection interactive method based on fluid physical simulation system Download PDF

Info

Publication number
CN103529943A
CN103529943A CN 201310486753 CN201310486753A CN103529943A CN 103529943 A CN103529943 A CN 103529943A CN 201310486753 CN201310486753 CN 201310486753 CN 201310486753 A CN201310486753 A CN 201310486753A CN 103529943 A CN103529943 A CN 103529943A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
projection
human body
body
human
body projection
Prior art date
Application number
CN 201310486753
Other languages
Chinese (zh)
Other versions
CN103529943B (en )
Inventor
田地
Original Assignee
合肥金诺数码科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The invention provides a human body projection interactive method based on a fluid physical simulation system. The human body projection interactive method includes the following steps: obtaining a human body projection binary image, extracting a human body projection outline vector set, conducting triangular gridding on the human body projection outline vector set to generate a human body projection three-dimensional model, conducting position corrections on the human body projection three-dimensional model to enable the human body projection three-dimensional model to be matched with the human body projection binary image in direction and size in a corresponding mode, inputting the corrected human body projection three-dimensional model into the fluid physical simulation system to enable the corrected human body projection three-dimensional model to be interacted with a virtual object, and displaying the interactive results and the human body projection binary image in a combined mode. By means of the human body projection interactive method, human body projection image data are captured and processed to obtain the three-dimensional model capable of being applied to the fluid physical simulation system, and collision and stiction effects of human body projection in the fluid physical simulation system are realistically displayed.

Description

一种基于流体物理模拟系统的人体投影交互方法 A personal interaction method based on the projection of fluid physical simulation system

技术领域 FIELD

[0001] 本发明涉及一种基于流体物理模拟系统的人体投影交互方法。 [0001] The present invention relates to a projector body fluid interaction method based on a physical simulation system.

[0002] [0002]

背景技术 Background technique

[0003] 现有的使用人体投影的互动游戏系统主要采用投影包围盒触发器的方法进行互动,该方法获得的人体投影与其实际外形轮廓差距较大,无法逼真地模拟出人体投影外形轮廓与流体物理模拟环境的碰撞与粘滞效果;此外,由于该方法在显示端上采用的是人体的真实投影,导致无法对投影图像进行后期特效处理,削弱了游戏画面的表现力。 [0003] human body using a conventional projection system mainly uses an interactive game projected bounding box interactive trigger, the method of obtaining the projection of the body and its actual contour larger gap can not be realistically simulated body fluid with the outline of the projection viscous effects of simulated collision with the physical environment; in addition, since the method employed in the projection on the display ends of the body is true, can not lead to post-process the projection image effects, weakens the game screen expression.

[0004] [0004]

发明内容 SUMMARY

[0005] 本发明的目的在于提供一种基于流体物理模拟系统的人体投影交互方法,以提高人体投影在流体物理模拟系统中与虚拟物体之间进行交互的逼真性。 [0005] The object of the present invention is to provide a projector body fluid interaction method based on a physical simulation system, to improve the fidelity of the projections are human interaction between a virtual object and physical simulation in fluid systems.

[0006] 本发明的技术方案为: [0006] aspect of the present invention is:

一种基于流体物理模拟系统的人体投影交互方法,包括以下步骤: A personal interaction method based on the projection of fluid physical simulation system, comprising the steps of:

(1)获取人体投影ニ值图像; (1) Get value ni image projected body;

(2)对所述人体投影ニ值图像进行轮廓提取处理,得到人体投影轮廓矢量集合; (2) the value Ni human projected image outline extraction process to obtain a set of vectors of human projection profile;

(3)对所述人体投影轮廓矢量集合进行三角网格化处理,生成人体投影三维模型; (3) the set of human projection profile meshing vector processing to generate a three-dimensional projection model of the human body;

(4)对所述人体投影三维模型进行位置校正,使其与人体投影ニ值图像在方位、尺寸上匹配对应; (4) the three-dimensional model of human projection position correction, so that with the body in the projected image azimuth value ni, corresponding to the size of the matching;

(5)将校正后的人体投影三维模型输入流体物理模拟系统,使其与所述流体物理模拟系统中的虚拟物体发生交互,并将交互结果与人体投影ニ值图像结合显示。 (5) The projected three-dimensional model of human post-correction input fluid physical simulation system, so as to interact with the fluid physical simulation system virtual object occurs, and the result of the interaction with the binding value of the image display body projection ni.

[0007] 所述的基于流体物理模拟系统的人体投影交互方法,所述步骤(I)中,人体投影ニ值图像的获取包括以下步骤: [0007] The projection of the body fluid interaction method based on a physical simulation system, said step (I), the body comprising the steps of obtaining projection ni value of an image:

(11)采用深度传感器捕获包含人体在内的整个环境的深度图像; (11) the depth image using a depth sensor captures the whole of the environment containing the inner body;

(12)利用VFC主动轮廓模型从所述深度图像中提取出人体投影对应区域的数据,构成人体投影深度图像; (12) extracted from the data of the depth image corresponding to the projected area of ​​the body, constituting the body using an image projected depth VFC active contour model;

(13)对所述人体投影深度图像进行ニ值化处理,得到人体投影ニ值图像。 (13) of said body projected depth image processing value ni, ni values ​​to obtain the projected body image.

[0008] 所述的基于流体物理模拟系统的人体投影交互方法,所述步骤(I)还包括:对所述人体投影ニ值图像进行特效处理,所述特效处理包括增加轮廓光芒。 [0008] Projection body fluid interaction method based on a physical simulation of the system, said step (I) further comprises: the values ​​ni human projected image effect processing, effect processing comprises increasing the profile of the light.

[0009] 所述的基于流体物理模拟系统的人体投影交互方法,所述步骤(2)还包括:利用Douglas-Peucker近似算法对所述人体投影轮廓矢量集合进行简化,保留其中的关键点。 [0009] The human interaction projection method, the step (2) physical simulation based fluid system further comprises: using a Douglas-Peucker algorithm approximation to the human body is simplified projected outline vector set, wherein the retaining critical point.

[0010] 所述的基于流体物理模拟系统的人体投影交互方法,所述步骤(3)中,利用Delaunay三角剖分算法对所述人体投影轮廓矢量集合进行三角网格化处理。 [0010] Based on the physical simulation system, the body fluid interaction projection method, the step (3), the Delaunay triangulation algorithm using the set of human projection profile vector meshing process.

[0011] 由上述技术方案可知,本发明通过捕获人体投影图像数据,再对其进行处理得到可以应用于流体物理模拟系统中的三维模型,逼真地表现出人体投影在流体物理模拟系统中的碰撞与粘滞效果。 [0011] From the above technical solution of the present invention, it is processed further by capturing the human body may be applied to the projection image data to obtain a three-dimensional physical model of a fluid simulation system, realistic demonstration of projected body fluid collision physical simulation system and viscous effects. 本发明采用的人体投影并非真实光线造成的,而是人体投影对应区域的图像,对该图像进行特效处理,在显示端可以呈现出更好的视觉效果。 Projection body is not used in the present invention, the true cause of light, but the image corresponding to the projected area of ​​the human body, the image effects processing, the display side may exhibit a better visual effect.

附图说明 BRIEF DESCRIPTION

[0012] 图1是本发明具体实施例的方法流程图; [0012] FIG. 1 is a specific embodiment of the method of the present invention, a flow chart;

图2是实现本发明的一种硬件结构示意图。 FIG 2 is a schematic structural diagram of a hardware implementation of the invention.

[0013]具体实施方式 [0013] DETAILED DESCRIPTION

[0014] 如图1所示,一种基于流体物理模拟系统的人体投影交互方法,包括以下步骤: [0014] 1 An interaction method based on the projection body fluid physical simulation system, comprising the steps of:

(1)采用深度传感器捕获包含人体在内的整个环境的深度图像; (1) The depth of the depth image sensor to capture the entire body, including the environment contains;

(2)利用VFC (vector field convolution矢量场卷积)主动轮廓模型从步骤(I)获取的深度图像中提取出人体投影对应区域的数据,构成人体投影深度图像,对人体投影深度图像进行二值化处理,得到人体投影二值图像;根据表现需求,可以对人体投影二值图像进行诸如增加轮廓光芒等特效处理,以增强视觉效果; (2) using the VFC (vector field convolution convolution of the vector field) active contour model extracted from the depth image in step (I) the acquired projection data corresponding to the body region, the body constituting the projection depth image, the depth of the projected image on human binary treatment, to obtain a binary image projected body; according to the performance requirements, such as increasing the profile may be other light effects processing binary image projected on the human body, in order to enhance the visual effect;

(3 )对步骤(2 )中的人体投影二值图像进行轮廓线提取处理,得到人体投影轮廓矢量集合;利用Douglas-Peucker近似算法对提取出的人体投影轮廓矢量集合进行简化,保留其中的关键点; (3) a step of human projection binary image (2) in contour line extraction processing, to obtain human projection profile vector set; using Douglas-Peucker approximation algorithm to the extracted human projection profile vector set be simplified key which reservations point;

(4)利用Delaunay三角剖分算法对简化后的人体投影轮廓矢量集合进行三角网格化处理,生成可以在流体物理模拟系统中与虚拟物体进行交互的人体投影三维模型; (4) using the Delaunay triangulation algorithm to the projector body outline vector simplified set of meshing process to generate three-dimensional model of human projection in the fluid can interact with the physical simulation system virtual object;

(5)对人体投影三维模型进行位置校正,使其与人体投影二值图像在方位、尺寸上匹配对应; (5) the projected three-dimensional model of the human body position correction, so that with the body in the binary image projection position, matches the corresponding size;

(6)将校正后的人体投影三维模型输入流体物理模拟系统,使其与所述流体物理模拟系统中的虚拟物体发生交互,并将交互结果与人体投影二值图像结合显示。 (6) The projected three-dimensional model of human post-correction input fluid physical simulation system, so as to interact with the fluid physical simulation system virtual object occurs, and human interaction result combined with the binary image projection display.

[0015] 如图2所示,是将本发明应用于游戏系统中的一种硬件结构示意图,深度传感器4捕获包含用户I的人体在内的整个环境的深度图像数据(深度图像为二维位图),传输给计算机主机6,计算机主机6先对深度传感器4获取的深度图像进行处理,得到人体投影二值图像,再对人体投影二值图像进行轮廓线提取处理得到人体投影轮廓矢量集合,最后将其三角化生成人体投影三维模型,经过位置校正,输入流体物理模拟系统中进行互动,并将互动结果传输给投影机3,同时,也将经过后期特效处理的人体投影二值图像传输给投影机3,投影机3将游戏交互结果投影到投影屏幕5上。 [0015] FIG. 2 is a schematic diagram of the hardware configuration of the present invention is applied to a game system, comprising a depth sensor 4 captures the user's body, including the depth I of image data of the entire environment (two-dimensional depth image bits FIG.), transmitted to the host computer 6, the host computer 6 to the depth image depth sensor (4) acquisition, to give the body a projection binary image, and then the body projection binary image contour line extracting process to give the body the projected outline vector set, finally the human body to generate a projection of a triangular three-dimensional model, after position correction, the incoming fluid to interact physical simulation system, and the interaction result to the projector 3, but also to the binary image projected through the body transmission processing to the late effects 3 projector, the projector will interact with the game 3 result projected on the screen 5.

[0016] 由于呈现在投影屏幕5上的是游戏交互场景画面与人体投影画面的结合,所以从外观上看是用户I的人体投影2与游戏中的虚拟物体发生交互碰撞,实际上是人体投影三维模型与虚拟物体发生交互碰撞。 [0016] Since the presentation on the projection screen 5 is a combination of interactive game scene screen projection screen with the human body, so it is the human impact projected interactive user I 2 with virtual objects in the game take place in appearance, is actually a human projection three-dimensional model of interaction with the virtual object collision occurred.

[0017] 以上所述实施方式仅仅是对本发明的优选实施方式进行描述,并非对本发明的范围进行限定,在不脱离本发明设计精神的前提下,本领域普通技术人员对本发明的技术方案作出的各种变形和改进,均应落入本发明的权利要求书确定的保护范围内。 [0017] The above embodiments are merely preferred embodiments of the present invention will be described, not the scope of the present invention are defined, those of ordinary skill in the art to make technical solution of the present invention without departing from the spirit of the design according to the present invention various variations and modifications can be made within the scope of protection of the present invention is defined to fall within the claims.

Claims (5)

  1. 1.一种基于流体物理模拟系统的人体投影交互方法,其特征在于,包括以下步骤: (1)获取人体投影二值图像; (2)对所述人体投影二值图像进行轮廓提取处理,得到人体投影轮廓矢量集合; (3)对所述人体投影轮廓矢量集合进行三角网格化处理,生成人体投影三维模型; (4)对所述人体投影三维模型进行位置校正,使其与人体投影二值图像在方位、尺寸上匹配对应; (5)将校正后的人体投影三维模型输入流体物理模拟系统,使其与所述流体物理模拟系统中的虚拟物体发生交互,并将交互结果与人体投影二值图像结合显示。 A projector body fluid interaction method based on a physical simulation system, characterized by comprising the steps of: (1) obtaining a binary image projected body; (2) the human binary image projected outline extraction process, to obtain human projection profile vector set; (3) the set of human projection profile meshing vector processing to generate a three-dimensional model of the human body projection; (4) three-dimensional model of the human body position correcting projection, the projection reacted with two human in azimuth value of the image, matches the corresponding dimension; (5) the corrected three-dimensional model input projection body fluid physical simulation system, so as to interact with the fluid physical simulation system virtual object occurs, and the result of the interaction with the projection body binary image displayed binding.
  2. 2.根据权利要求1所述的基于流体物理模拟系统的人体投影交互方法,其特征在于,所述步骤(I)中,人体投影二值图像的获取包括以下步骤: (11)采用深度传感器捕获包含人体在内的整个环境的深度图像; (12)利用VFC主动轮廓模型从所述深度图像中提取出人体投影对应区域的数据,构成人体投影深度图像; (13)对所述人体投影深度图像进行二值化处理,得到人体投影二值图像。 The projector body fluid interaction method based on a physical simulation system according to claim 1, wherein said step (I), the body comprising the steps of obtaining a projection of the binary image: (11) The depth sensor captures a depth image including the whole body, including the environment; (12) using the VFC active contour model is extracted from the data of the depth image corresponding to the projected area of ​​the body, the body constituting a depth image projection; (13) the depth image projected human binarization processing, to obtain a binary image projected body.
  3. 3.根据权利要求1所述的基于流体物理模拟系统的人体投影交互方法,其特征在于,所述步骤(I)还包括:对所述人体投影二值图像进行特效处理,所述特效处理包括增加轮廓光芒。 The projector body fluid interaction method based on a physical simulation system according to claim 1, wherein said step (I) further comprises: the human binary image projection processing effects, the effects processing comprises increase the profile of light.
  4. 4.根据权利要求1所述的基于流体物理模拟系统的人体投影交互方法,其特征在于,所述步骤(2)还包括:利用Douglas-Peucker近似算法对所述人体投影轮廓矢量集合进行简化,保留其中的关键点。 The projector body fluid interaction method based on a physical simulation system according to claim 1, wherein said step (2) further comprises: using a Douglas-Peucker algorithm approximation to the human body is simplified projected outline vector set, the key points to retain them.
  5. 5.根据权利要求1所述的基于流体物理模拟系统的人体投影交互方法,其特征在于,所述步骤(3)中,利用Delaunay三角剖分算法对所述人体投影轮廓矢量集合进行三角网格化处理。 The projector body fluid interaction method based on a physical simulation system according to claim 1, wherein said step (3), the Delaunay triangulation algorithm using the set of human projection profile vector triangular mesh treatment.
CN 201310486753 2013-10-17 2013-10-17 A personal interaction method based on the projection of fluid physical simulation system CN103529943B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201310486753 CN103529943B (en) 2013-10-17 2013-10-17 A personal interaction method based on the projection of fluid physical simulation system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201310486753 CN103529943B (en) 2013-10-17 2013-10-17 A personal interaction method based on the projection of fluid physical simulation system

Publications (2)

Publication Number Publication Date
CN103529943A true true CN103529943A (en) 2014-01-22
CN103529943B CN103529943B (en) 2016-05-04

Family

ID=49932016

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201310486753 CN103529943B (en) 2013-10-17 2013-10-17 A personal interaction method based on the projection of fluid physical simulation system

Country Status (1)

Country Link
CN (1) CN103529943B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080122839A1 (en) * 2006-11-28 2008-05-29 Microsoft Corporation Interacting with 2D content on 3D surfaces
CN101271591A (en) * 2008-04-28 2008-09-24 清华大学 Interactive multi-vision point three-dimensional model reconstruction method
GB2499694A (en) * 2012-11-09 2013-08-28 Sony Comp Entertainment Europe System And Method Of Image Reconstruction

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080122839A1 (en) * 2006-11-28 2008-05-29 Microsoft Corporation Interacting with 2D content on 3D surfaces
CN101271591A (en) * 2008-04-28 2008-09-24 清华大学 Interactive multi-vision point three-dimensional model reconstruction method
GB2499694A (en) * 2012-11-09 2013-08-28 Sony Comp Entertainment Europe System And Method Of Image Reconstruction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李超 等: "面向投影环境的计算机视觉交互信息获取", 《电视技术》 *

Also Published As

Publication number Publication date Type
CN103529943B (en) 2016-05-04 grant

Similar Documents

Publication Publication Date Title
US20070291035A1 (en) Horizontal Perspective Representation
Cao et al. Real-time high-fidelity facial performance capture
US20120212509A1 (en) Providing an Interactive Experience Using a 3D Depth Camera and a 3D Projector
US20150187108A1 (en) Augmented reality content adapted to changes in real world space geometry
CN102749990A (en) Systems and methods for providing feedback by tracking user gaze and gestures
US20120306874A1 (en) Method and system for single view image 3 d face synthesis
US20130155106A1 (en) Method and system for coordinating collisions between augmented reality and real reality
US20110122130A1 (en) Modifying Perspective of Stereoscopic Images Based on Changes in User Viewpoint
CN102110379A (en) Multimedia reading matter giving readers enhanced feeling of reality
Luciano et al. Design of the immersivetouch: a high-performance haptic augmented virtual reality system
Francone et al. Using the user's point of view for interaction on mobile devices
CN103810353A (en) Real scene mapping system and method in virtual reality
CN104035760A (en) System capable of realizing immersive virtual reality over mobile platforms
CN104915979A (en) System capable of realizing immersive virtual reality across mobile platforms
WO2011041466A1 (en) Systems and methods for interaction with a virtual environment
CN103337079A (en) Virtual augmented reality teaching method and device
US20130222647A1 (en) Image processing device, control method for an image processing device, program, and information storage medium
US20140267412A1 (en) Optical illumination mapping
US20140267270A1 (en) Shadow rendering in a 3d scene based on physical light sources
Aigerman et al. Seamless surface mappings
CN104102412A (en) Augmented reality technology-based handheld reading equipment and reading method thereof
CN102831631A (en) Rendering method and rendering device for large-scale three-dimensional animations
CN101727182A (en) Method and system for visualizing real hand of participant in helmet-type virtual reality environment
CN105491365A (en) Image processing method, device and system based on mobile terminal
US9619105B1 (en) Systems and methods for gesture based interaction with viewpoint dependent user interfaces

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model