WO2024020937A1 - 基于混合现实技术的手工艺路径引导学习系统 - Google Patents
基于混合现实技术的手工艺路径引导学习系统 Download PDFInfo
- Publication number
- WO2024020937A1 WO2024020937A1 PCT/CN2022/108639 CN2022108639W WO2024020937A1 WO 2024020937 A1 WO2024020937 A1 WO 2024020937A1 CN 2022108639 W CN2022108639 W CN 2022108639W WO 2024020937 A1 WO2024020937 A1 WO 2024020937A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- path
- model
- guidance
- handicraft
- mixed reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2012—Colour editing, changing, or manipulating; Use of colour codes
Definitions
- the present invention relates to the field of mixed reality. Specifically, it relates to a craft path guidance learning system and method based on mixed reality technology.
- the system and method can be used on mobile terminals such as mobile phones and tablet computers, using existing screens, cameras, etc. Components to complete the guidance and auxiliary learning functions of related handicrafts by reducing costs.
- Handicraft refers to arts and crafts with a unique artistic style made by manual labor. Arts and crafts are different from the mass production of standardized daily handicrafts through large-scale industrial mechanization.
- the purpose of the present invention is to provide a handicraft path guidance learning system based on mixed reality technology in view of the shortcomings of the existing technology, which can be used for spatial path planning guidance in handicraft learning and practice.
- a handicraft path guidance learning system based on mixed reality technology.
- the system provides users with a line drawing guidance path on the MR display interface based on mixed reality technology, so that the user can use 3D printing tools to draw according to the description.
- Line guide path for line drawing and printing.
- the system has the following functional modules:
- a model import selection module which is used for users to import required models into the system or select required models from the sample model library
- the parameter control module adjusts the outline and size parameters of single components according to the required target handicraft structure, combined with the selected or imported model, to determine a design model that meets the requirements of the target handicraft structure;
- the path planning display module is used to layer the design model and plan the printing paths of each layer to form a line drawing path guide map of each layer, and present the line drawing path guide maps of each layer on the MR in sequence according to the printing order.
- the user performs line drawing printing with the 3D printing tool according to the line drawing path guide map presented in the MR display interface to obtain the target handicraft structure.
- model is a solid model or a vector path.
- the system builds an interactive interface based on the Grasshopper tool, performs calculations and modeling based on user selection and input; previews the model based on the three-dimensional modeling software Rhinoceros; and implements the interface and model in the mobile terminal virtual world based on the plug-in Fologram. Synchronize to achieve mixed reality effects.
- the path planning method is as follows: according to the user's selection of the desired effect, parameters such as the width, spacing, and angle between the actual drawn lines and the edge of the model are obtained, and then a series of points are taken on the edge of the model, and based on the path parameters Connect the corresponding points to obtain several line segments, and connect these line segments end to end in order to obtain the final path.
- the line drawing and printing guide map is a simulation of the path.
- the Time Trigger in Grasshopper based on the settings of parameters such as speed, it is set to perform a cumulative calculation of the distance that the line should move every 10 ms. Calculate Find the length of the path expected to be drawn at the current moment, mark the current drawing line position in the path, and color the corresponding path to achieve the animation guidance effect.
- the handicraft path-guided learning and production method based on mixed reality technology is implemented based on the above system, including the following steps:
- Step 1 Obtain the model: Select a sample model in the system interface or import the model yourself;
- Step 2 Design model parameters: According to the required goals, combined with the selected or imported model in the MR system, adjust its outline, size and other parameters to determine the basic shape of the model;
- the final design model is determined by mirroring, rotating, array and other transformations on the model
- Step 3 Layering and path planning
- the system plans the line drawing path of the model according to the user's selection.
- the user's selection includes setting the speed parameters of the path simulation, Set the order of model path simulation when there are multiple complex models;
- the system obtains real-time images through the camera of the mobile terminal, and displays the simulated animation guidance interface of the planned path through the display screen of the mobile terminal.
- the animation guidance interface can be unified with the real-time scene images to achieve a mixed reality effect;
- Step 4 Manual operation guided by MR
- the present invention is a handicraft path guidance learning system based on mixed reality technology.
- Mixed reality technology improves the spatial three-dimensionality of the handicraft process display and the user's sense of participation, provides users with real model previews and guidance effects, helps users complete learning and design more efficiently, and lowers the learning threshold.
- Figure 1 is a schematic flow chart of a specific method of the present invention
- Figure 2 is a schematic diagram of actual operation in a specific example of the present invention.
- Figure 3 is a schematic diagram of actual operation in a specific example of the present invention.
- Figure 4 is a schematic interface diagram of the system of the present invention.
- Figure 5 is a schematic interface diagram of the system of the present invention.
- Figure 6 is a test chart of line drawing speed and layering performance of the present invention.
- FIGS 7-10 are diagrams of application examples of the present invention respectively.
- the handicraft path guidance learning system based on mixed reality technology of the present invention can provide the user with a line drawing guidance path on the MR display interface based on the mixed reality technology, so that the user can use the 3D printing tool to follow the line drawing guidance path. Perform line drawing printing.
- the system has the following functional modules:
- a model import selection module which is used for users to import required models into the system or select required models from the sample model library
- the parameter control module can select an example model or import the model by yourself in the system interface.
- the model is generally an entity model (stl, obj, step, etc. format) or a vector path ( ai, dwg, dwf, svg and other formats). Adjust the outline and size parameters of the single component, and transform the input model through a series of methods provided by the system, such as mirroring, rotation, array, etc., to ultimately determine the design model that meets the requirements of the target handicraft structure;
- the path planning module is used to layer the design model and plan the printing paths of each layer to form a line drawing path guide map of each layer, and present the line drawing path guide maps of each layer on the MR display in sequence according to the printing order.
- the user uses the 3D printing tool to trace and print according to the line drawing path guide map presented on the MR display interface to obtain the target handicraft structure.
- the path planning method in this module is as follows: according to the user's selection of desired effects, such as metal wire winding patterns, deformation effects of printed objects, etc., parameters such as the width, spacing, and angle between the actual drawn lines and the edge of the model are obtained, and then A series of points are taken on the edge of the model and the corresponding points are connected according to the path parameters to obtain several line segments.
- the line drawing and printing guide map is a simulation of the path.
- the length of the path expected to be drawn at any time, and the current drawing line position is marked in the path, and the corresponding path is colored to achieve the animation guidance effect.
- the final design model can be determined in the system first; then according to the demand goals, multiple models with different functional requirements can be set in layers, such as hand-painted line cases Complete filling parts and spacer filling parts can be set in it, deformable parts and non-deformable parts can be set in hand-painted 4D printing, and different winding patterns can be set in metal wire winding.
- the system plans the line drawing path of the model according to the user's choice. For example, the speed parameters of path simulation can be set in hand-drawn line drawing and hand-drawn 4D printing. When there are multiple complex models, you can also set the order of model path simulation to simplify the handicraft production process.
- the system obtains real-time images through the camera of the mobile terminal, and displays the simulated animation guidance interface of the planned path through the display screen of the mobile terminal.
- the animation guidance interface can be unified with the real-time scene images to achieve a mixed reality effect.
- users can watch directly on tablets and other terminals without wearing additional mixed reality accessories (such as helmets and glasses), and at the same time use relevant tools (such as 3D printing pens) to complete handicrafts along the guidance path. . Users can pause, continue, loop and end animations at any time when using the guidance system to achieve a more humane learning effect.
- the MR system of the present invention can simulate corresponding effects in real time based on model design and parameter adjustment, display them in the virtual world, provide design previews, and be applied to mobile terminals such as mobile phones and tablet computers. It uses cameras to collect the real environment and capture what the user sees.
- the design model is integrated with reality through the terminal screen.
- the MR system of the present invention can use the Grasshopper tool to build an interactive interface, and perform calculations and modeling based on user selection and input; use the three-dimensional modeling software Rhinoceros to preview the model; use the plug-in Fologram to realize the interface and model on the mobile terminal Synchronization in the virtual world can achieve mixed reality effects through the Sync component in Fologram to complete model synchronization; filtering operations can be performed through the Filter and Gate components to complete model layering and parameter setting functions with multiple choices.
- Figures 2 and 3 are printing examples of a self-twisting model in the present invention. The specific process includes the following:
- Model acquisition According to the required goals and the model library, select a model in the MR system interface or import the model yourself.
- the corresponding model appears in the virtual world, is integrated with the real world captured by the mobile terminal camera, and is displayed on the screen. Import a self-twisting (twist) model into the system, and the model is an stl file.
- twist self-twisting
- parameters such as its outline, size, degree of deformation, and outer contour curve shape are adjusted to determine the basic shape of the single component. Adjust to wide width: 2cm, length 10cm, deformation degree: level 3.
- the model is transformed through a series of methods provided by the system, such as mirroring, rotation, array, etc., to determine the final design model.
- Each parameter adjustment operation in this step will be transmitted to the program in Grasshopper in real time through the Fologram plug-in, and the adjusted model effect will be calculated and updated in the mixed reality system interface.
- the models are layered and combined so that the selected models are arranged in a certain order.
- the order of angles between the filling lines and edges of the selected self-twisting model is: 45° for the first layer, -45° for the second layer, and the filling lines of the upper and lower layers intersect at right angles.
- the system draws two sets of line segments arranged in parallel in the input model, and connects them end to end in order to obtain the final path.
- Set the speed parameter of the path simulation to "simple and easy-to-operate mode", and the path is planned for the user into a continuous and easy-to-operate trajectory.
- the "line drawing position" guided in the system is moved along the planned path.
- the completed parts are colored to achieve animation effects and carried out in mixed reality. simulation.
- FIG. 1 The user uses a 3D printing pen to complete the line drawing and printing of the design model in the real world according to the trajectory and speed guidance in the MR system interface.
- Figures 2 and 3 show the use of a tablet computer for path-guided 4D printing in the MR system. schematic diagram.
- the printing material is a thermoplastic material PLA (Polymaker Polymax) with a diameter of 1.75 mm, and the printing temperature of the printing pen is 170°C.
- PLA Polymaker Polymax
- the printed model is placed in 80°C hot water for heating. After a few seconds, the model can deform, thereby obtaining the deformation effect set in the system.
- thermoplastic materials When printing multiple models, users can use the high-temperature adhesion of thermoplastic materials to assemble multiple models to obtain a complete model.
- system and method of the present invention can be combined with post-processing to enrich the structure of personalized handicrafts and produce complex products.
- Figures 7-10 show some application examples of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
一种基于混合现实技术的手工艺路径引导学习系统，所述系统是在手工艺制作过程中，基于混合现实技术在MR显示界面为用户提供画线引导路径，以供用户利用3D打印工具按照所述画线引导路径进行画线打印。包括：模型导入选择模块、参数调控模块、路径规划模块，该系统可以应用于生活中常见的移动终端上，例如手机、平板电脑等，不需要额外的混合现实终端。可以适用于以画线为基本实现方式的手工艺制作中，例如手绘画线、以金属丝绕线实现的首饰制作、利用3D打印笔的手绘打印等，不需要额外的辅助塑形的模具，降低手工操作的门槛，同时，也可以通过视觉引导系统帮助初学者进行设计预览，辅助手工艺的设计创作。
Description
本发明涉及混合现实领域，具体地说，涉及一种基于混合现实技术的手工艺路径引导学习系统和方法，该系统和方法可用于手机、平板电脑等移动终端上，利用已有的屏幕、摄像头等部件，通过减少成本完成相关手工艺的引导和辅助学习功能。
手工艺是指以手工劳动进行制作的具有独特艺术风格的工艺美术。有别于以大工业机械化方式批量生产规格化日用工艺品的工艺美术。
然而，对于初学者而言，手工艺的学习往往具有较高的门槛。通过图片、视频等方法进行学习具有较高的直观性，可以较快地理解手工艺的流程和制作方法，但空间立体感和体验感较弱，对于空间想象力和动手能力不强的初学者来说，亲自动手完成实践有一定困难。因此，借助于混合现实技术，可有效地帮助初学者身临其境地对制作流程进行感受和体验，从而提高学习效率和创作质量。而传统的虚拟现实眼镜等装置，只能为用户呈现屏幕中的画面，无法提供周围环境等信息。
发明内容
本发明的目的在于针对现有技术的不足，提供一种基于混合现实技术的手工艺路径引导学习系统，可用于手工艺学习及练习中的空间路径规划引导。
本发明采用的技术方案如下：
一种基于混合现实技术的手工艺路径引导学习系统，所述系统是在手工艺制作过程中，基于混合现实技术在MR显示界面为用户提供画线引导路径，以供用户利用3D打印工具按照所述画线引导路径进行画线打印。
上述技术方案中，进一步的，所述系统具有如下功能模块：
模型导入选择模块，所述模块用于供用户向系统中导入所需模型或从示例模型库中选择所需模型；
参数调控模块，根据需求的目标手工艺结构，结合已选择或导入的模型，对单元件的轮廓、尺寸参数进行调整，确定符合目标手工艺结构要求的设计模 型；
路径规划显示模块，用于将所述设计模型进行分层并对各层的打印路径进行规划从而形成各层的画线路径引导图，按照打印顺序将各层画线路径引导图依次呈现在MR显示界面中，用户根据MR显示界面所呈现的画线路径引导图进行3D打印工具描线打印，得到目标手工艺结构。
进一步的，所述的模型为实体模型或矢量路径。
进一步的，所述系统基于Grasshopper工具构建交互界面，基于用户的选择和输入进行计算和建模；基于三维建模软件Rhinoceros进行模型的预览；基于插件Fologram实现界面和模型在移动终端虚拟世界中的同步，达到混合现实效果。
进一步的，所述路径规划的方法如下：根据用户对期望效果的选择，得到实际画线的宽度、间隔、与模型边缘的夹角等参数，之后在模型边缘取一系列点，并根据路径参数将对应点进行连接，获得若干条线段，将这些线段按照顺序首尾相接，得到最终路径。
进一步的，所述的画线打印引导图是对路径的仿真模拟，利用Grasshopper中的Time Trigger，基于速度等参数的设置，设定每10ms对画线所应移动的距离进行一次累加计算，计算出当前时刻所期望绘制的路径长度，并将当前画线位置在路径中进行标记，同时将对应路径着色，从而实现动画引导效果。
基于混合现实技术的手工艺路径引导学习制作方法，基于上述的系统实现，包括如下步骤：
步骤1：获取模型：在系统界面中选择示例模型或自行导入模型；
步骤2:设计模型参数：根据需求的目标结合MR系统中已选择或导入的模型，对其轮廓、尺寸等参数进行调整，确定模型的基本形状；
根据需求的目标，通过对模型进行镜像、旋转、阵列等变换，确定最终的设计模型；
步骤3:分层与路径规划
根据需求目标，可将多个功能需求不同的模型进行分层设定，在此基础上，系统根据用户选择对模型的画线路径进行规划，所述用户选择包括设定路径模拟的速度参数、在有多个复杂模型时设定模型路径模拟的顺序排列；
按照上述路径规划参数，该系统通过移动终端的摄像头获取实时画面，通过移动终端的显示屏显示所规划路径的模拟动画引导界面，动画引导界面可与实时场景画面相统一，达到混合现实效果；
步骤4:MR引导下的手工操作
使用者在混合现实学习引导实践中，不用佩戴额外的混合现实配件，直接在显示终端观看，并同时使用3D打印工具沿引导路径完成手工艺制作，使用者在使用引导系统时可随时暂停、继续、循环播放以及结束动画，达到更为人性化的学习效果。
获得打印完成的模型后还可以结合外界作用如热、水等外因诱导模型材料发生形变，达到所需效果。
本发明的有益效果是：
本发明的一种基于混合现实技术的手工艺路径引导学习系统，借助手机、平板电脑等移动终端的硬件传感器，使得用户无需购买整套虚拟现实设备，可以通过较少的成本投入使用MR系统完成相关手工艺的学习。混合现实技术提高了手工艺流程展示的空间立体感和用户的参与感，为用户提供了真实的模型预览和引导效果，更高效地帮助用户完成学习和设计，降低了学习门槛。
图1是本发明一种具体方法流程示意图；
图2是本发明一种具体实例中的实际操作示意图。
图3是本发明具体实例中实际操作示意图。
图4是本发明系统的一种界面示意图。
图5是本发明系统的一种界面示意图。
图6是本发明对画线速度及分层性能的测试图。
图7-10分别为本发明的应用实例图。
为了更好的理解本发明，下面将结合具体实施例和附图进一步阐述本发明的方案，但本发明的内容不仅仅局限于下面的实施例。
在手工艺制作过程中，本发明的基于混合现实技术的手工艺路径引导学习系统能够基于混合现实技术在MR显示界面为用户提供画线引导路径，以供用 户利用3D打印工具按照所述画线引导路径进行画线打印。系统具有如下功能模块：
模型导入选择模块，所述模块用于供用户向系统中导入所需模型或从示例模型库中选择所需模型；
参数调控模块，根据需求的目标手工艺结构，结合已选择或导入的模型，在系统界面中可选择示例模型或自行导入模型，模型一般为实体模型(stl，obj，step等格式)或矢量路径(ai，dwg，dwf，svg等格式)。对单元件的轮廓、尺寸参数进行调整，可通过一系列系统提供的方式对输入模型进行变换，如镜像、旋转、阵列等，最终确定符合目标手工艺结构要求的设计模型；
路径规划模块，用于将所述设计模型进行分层并对各层的打印路径进行规划从而形成各层的画线路径引导图，按照打印顺序将各层画线路径引导图依次呈现在MR显示界面中，用户根据MR显示界面所呈现的画线路径引导图进行3D打印工具描线打印，得到目标手工艺结构。该模块中路径规划的方法如下：根据用户对期望效果的选择，如金属丝绕线花样、打印物件变形效果等，得到实际画线的宽度、间隔、与模型边缘的夹角等参数，之后在模型边缘取一系列点，并根据路径参数将对应点进行连接，获得若干条线段，将这些线段按照顺序首尾相接，得到最终路径。画线打印引导图是对路径的仿真模拟，可以利用Grasshopper中的Time Trigger，基于速度等参数的设置，设定每一段时间如10ms对画线所应移动的距离进行一次累加计算，计算出当前时刻所期望绘制的路径长度，并将当前画线位置在路径中进行标记，同时将对应路径着色，从而实现动画引导效果。
在基于上述系统进行手工艺路径引导学习制作过程中，可先在系统中确定最终的设计模型；然后根据需求目标，可将多个功能需求不同的模型的进行分层设定，例如手绘画线案例中可设置完全填充件和间隔线填充件等，在手绘4D打印中可设置可变形件和不可变形件等，在金属丝绕线中可设置不同的绕线花样。在此基础上，系统根据用户选择对模型的画线路径进行规划，例如在手绘画线和手绘4D打印中可设定路径模拟的速度参数。在有多个复杂模型时还可以设定模型路径模拟的顺序排列，简化手工艺制作过程。
按照上述路径规划参数，该系统通过移动终端的摄像头获取实时画面，通 过移动终端的显示屏显示所规划路径的模拟动画引导界面，动画引导界面可与实时场景画面相统一，达到混合现实效果。使用者在混合现实学习引导实践中，可不用佩戴额外的混合现实配件(例如头盔、眼镜)，直接在平板电脑等终端观看，并同时使用相关工具(如3D打印笔)沿引导路径完成手工艺制作。使用者在使用引导系统时可随时暂停、继续、循环播放以及结束动画，达到更为人性化的学习效果。进一步地，本发明MR系统可实时根据模型设计、参数调整模拟出对应效果，显示在虚拟世界中，提供设计预览，并应用于手机、平板电脑等移动终端，应用摄像头采集现实环境，将用户所设计模型通过终端屏幕与现实进行融合。
进一步地，本发明MR系统可使用Grasshopper工具构建交互界面，基于用户的选择和输入进行计算和建模；使用三维建模软件Rhinoceros进行模型的预览；使用其中的插件Fologram实现界面和模型在移动终端虚拟世界中的同步，达到混合现实效果可通过Fologram中的Sync组件，完成模型同步；通过Filter和Gate组件进行筛选操作，完成含有多种选择的模型分层和参数设定功能。图2、3是本发明中一个自扭(twist)模型的打印实例，具体过程包括如下：
1、模型获取。根据需求的目标结合模型库在MR系统界面中选择模型或自行导入模型，相应的模型出现在虚拟世界中，与所用移动终端摄像头获取到的真实世界融合，显示在屏幕上。在系统中导入一个自扭(twist)模型，模型为stl文件。
2、模型参数设计
根据需求的目标结合MR系统中模型，对其轮廓、尺寸、变形程度和外轮廓曲线形状等参数进行调整，确定单元件的基本形状。调整为宽带：2cm，长度10cm，形变程度：3级。
根据需求的目标，通过一系列系统提供的方式对模型进行变换，如镜像、旋转、阵列等，确定最终的设计模型。该步骤中的每一次参数调整操作都会实时通过Fologram插件传输给Grasshopper中的程序，计算得到调整后的模型效果并更新在混合现实系统界面中。
3、分层与路径规划
对于多个模型的选择，将模型进行分层和组合，使得所选模型按照一定顺 序进行排列。所选自扭模型的填充线与边缘的夹角顺序为：第一层45°，第二层-45°，上下两层填充线成正相交。系统据此在输入模型中绘制出分别平行排列的两组线段，并按顺序首尾相接，得到最终路径。设定路径模拟的速度参数为“简单易操作模式”，路径为用户规划成连续、易操作的轨迹。
按照分层顺序，根据选定模型的参数，将系统中引导的“画线位置”沿规划好的路径进行移动，同时将已经完成的部分进行上色，实现动画效果，并在混合现实中进行模拟。
4、MR引导下的手工操作
使用者使用3D打印笔，按照MR系统界面中的轨迹和速度引导，在现实世界中完成设计模型的画线打印，如图2、3所示为使用平板电脑在MR系统中进行路径引导4D打印的示意图。
其中，打印材料是直径为1.75毫米的热塑性材料PLA(Polymaker Polymax)，打印笔的打印温度为170℃。
使用者在使用引导系统中可随时暂停、继续、循环播放以及结束4D打印引导动画。当用户根据系统引导完成手动4D打印画线后，将打印完成的模型放入80℃热水中进行加热，数秒后模型可发生形变，从而得到系统中设定的形变效果。
在完成多个模型打印时，用户可利用热塑性材料高温时的黏着性将多个模型进行组装，得到完整模型。
此外，采用本发明的系统及方法可以结合后处理能够丰富个性化手工艺的结构，可制作出复杂产品，如图7-10所示为本发明的一些应用实例。
Claims (7)
- 一种基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述系统是在手工艺制作过程中，基于混合现实技术在MR显示界面为用户提供画线引导路径，以供用户利用3D打印工具按照所述画线引导路径进行画线打印。
- 根据权利要求1所述的基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述系统具有如下功能模块：模型导入选择模块，所述模块用于供用户向系统中导入所需模型或从示例模型库中选择所需模型；参数调控模块，根据需求的目标手工艺结构，结合已选择或导入的模型，对单元件的轮廓、尺寸参数进行调整，确定符合目标手工艺结构要求的设计模型；路径规划显示模块，用于将所述设计模型进行分层并对各层的打印路径进行规划从而形成各层的画线路径引导图，按照打印顺序将各层画线路径引导图依次呈现在MR显示界面中，用户根据MR显示界面所呈现的画线路径引导图进行3D打印工具描线打印，得到目标手工艺结构。
- 根据权利要求2所述的基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述的模型为实体模型或矢量路径。
- 根据权利要求2所述的基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述系统基于Grasshopper工具构建交互界面，基于用户的选择和输入进行计算和建模；基于三维建模软件Rhinoceros进行模型的预览；基于插件Fologram实现界面和模型在移动终端虚拟世界中的同步，达到混合现实效果。
- 根据权利要求2所述的基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述路径规划的方法如下：根据用户对期望效果的选择，得到实际画线的宽度、间隔、与模型边缘的夹角等参数，之后在模型边缘取一系列点，并根据路径参数将对应点进行连接，获得若干条线段，将这些线段按照顺序首尾相接，得到最终路径。
- 根据权利要求2所述的基于混合现实技术的手工艺路径引导学习系统，其特征在于，所述的画线打印引导图是对路径的仿真模拟，利用Grasshopper中的Time Trigger，基于速度等参数的设置，设定每一段时间对画线所应移动的距 离进行一次累加计算，计算出当前时刻所期望绘制的路径长度，并将当前画线位置在路径中进行标记，同时将对应路径着色，从而实现动画引导效果。
- 基于混合现实技术的手工艺路径引导学习制作方法，其特征在于，基于如权利要求1-6任一项所述的系统实现，包括如下步骤：步骤1：获取模型：在系统界面中选择示例模型或自行导入模型；步骤2:设计模型参数：根据需求的目标结合MR系统中已选择或导入的模型，对其轮廓、尺寸等参数进行调整，确定模型的基本形状；根据需求的目标，通过对模型进行镜像、旋转、阵列等变换，确定最终的设计模型；步骤3:分层与路径规划根据需求目标，可将多个功能需求不同的模型进行分层设定，在此基础上，系统根据用户选择对模型的画线路径进行规划，所述用户选择包括设定路径模拟的速度参数、在有多个复杂模型时设定模型路径模拟的顺序排列；按照上述路径规划参数，该系统通过移动终端的摄像头获取实时画面，通过移动终端的显示屏显示所规划路径的模拟动画引导界面，动画引导界面可与实时场景画面相统一，达到混合现实效果；步骤4:MR引导下的手工操作使用者在混合现实学习引导实践中，不用佩戴额外的混合现实配件，直接在显示终端观看，并同时使用3D打印工具沿引导路径完成手工艺制作，使用者在使用引导系统时可随时暂停、继续、循环播放以及结束动画，达到更为人性化的学习效果。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210892601.2 | 2022-07-27 | ||
| CN202210892601.2A CN115170776A (zh) | 2022-07-27 | 2022-07-27 | 基于混合现实技术的手工艺路径引导学习系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024020937A1 true WO2024020937A1 (zh) | 2024-02-01 |
Family
ID=83496620
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/108639 Ceased WO2024020937A1 (zh) | 2022-07-27 | 2022-07-28 | 基于混合现实技术的手工艺路径引导学习系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115170776A (zh) |
| WO (1) | WO2024020937A1 (zh) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180165877A1 (en) * | 2016-12-08 | 2018-06-14 | Nathaniel Winckler | Method and apparatus for virtual reality animation |
| CN109878090A (zh) * | 2017-12-06 | 2019-06-14 | 三纬国际立体列印科技股份有限公司 | 切层方法、切层数据的更新方法及打印系统 |
| CN112734945A (zh) * | 2021-03-30 | 2021-04-30 | 上海交大智邦科技有限公司 | 一种基于增强现实的装配引导方法、系统及应用 |
| WO2021102422A1 (en) * | 2019-11-22 | 2021-05-27 | The Brigham And Women's Hospital, Inc. | Systems and methods for ventricle procedures |
| CN113878879A (zh) * | 2021-09-29 | 2022-01-04 | 陈付辉 | 一种面向多种3d打印工艺的切片方法 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106340064B (zh) * | 2016-08-25 | 2019-02-01 | 北京大视景科技有限公司 | 一种混合现实沙盘装置和方法 |
| CN112140552B (zh) * | 2020-07-23 | 2021-12-28 | 西安交通大学 | 一种原位3d打印曲面分层和路径规划方法 |
| CN114701039B (zh) * | 2022-03-24 | 2022-12-02 | 华中科技大学 | 一种增强现实辅助下的画笔式3d打印方法和系统 |
-
2022
- 2022-07-27 CN CN202210892601.2A patent/CN115170776A/zh active Pending
- 2022-07-28 WO PCT/CN2022/108639 patent/WO2024020937A1/zh not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180165877A1 (en) * | 2016-12-08 | 2018-06-14 | Nathaniel Winckler | Method and apparatus for virtual reality animation |
| CN109878090A (zh) * | 2017-12-06 | 2019-06-14 | 三纬国际立体列印科技股份有限公司 | 切层方法、切层数据的更新方法及打印系统 |
| WO2021102422A1 (en) * | 2019-11-22 | 2021-05-27 | The Brigham And Women's Hospital, Inc. | Systems and methods for ventricle procedures |
| CN112734945A (zh) * | 2021-03-30 | 2021-04-30 | 上海交大智邦科技有限公司 | 一种基于增强现实的装配引导方法、系统及应用 |
| CN113878879A (zh) * | 2021-09-29 | 2022-01-04 | 陈付辉 | 一种面向多种3d打印工艺的切片方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115170776A (zh) | 2022-10-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106843150A (zh) | 一种工业现场仿真模拟方法和装置 | |
| CN111161422A (zh) | 一种用于增强虚拟场景实现的模型展示方法 | |
| CN105069827B (zh) | 一种采用三维模型处理视频转场的方法 | |
| CN112669671B (zh) | 一种基于实物交互的混合现实飞行仿真系统 | |
| CN103258338A (zh) | 利用真实数据来驱动仿真的虚拟环境的方法和系统 | |
| CN107368314B (zh) | 基于移动ar的机械制造工艺课程设计教学辅助系统及开发方法 | |
| CN109901713B (zh) | 一种多人协同装配系统及方法 | |
| WO2020177318A1 (zh) | 一种基于虚拟现实的精酿啤酒糖化操作系统及方法 | |
| CN107895515A (zh) | 一种增强现实的cad教学方法及教学系统 | |
| Tang et al. | Learning to create 3D models via an augmented reality smartphone interface | |
| CN105389005A (zh) | 一种二十四式太极拳三维互动展示方法 | |
| Zhang et al. | The Application of Folk Art with Virtual Reality Technology in Visual Communication. | |
| CN105989623B (zh) | 基于手持移动设备的增强现实应用的实现方法 | |
| CN102930083A (zh) | 一种楼盘实时展示系统及方法 | |
| CN115981457A (zh) | 一种沉浸式动作vr学习系统中基于体感交互的设计方法 | |
| CN119888024B (zh) | 一种基于仿真环境的人体姿态多目视觉识别ai训练数据集自动生成和标识方法 | |
| CN110134247A (zh) | 一种基于vr的船舶运动姿态增强现实互动系统及方法 | |
| CN103942384A (zh) | 基于头盔显示器的动态飞机装配场景实时立体可视化方法 | |
| WO2018188088A1 (zh) | 基于增强现实及数字图像处理的泥胶玩具系统及其方法 | |
| CN118656886A (zh) | 一种基于虚拟现实与增强现实技术的地形分析与设计工具 | |
| CN111612917A (zh) | 一种基于真实场景反馈和可触道具的增强现实交互方法 | |
| WO2024077518A1 (zh) | 基于增强现实的界面显示方法、装置、设备、介质和产品 | |
| CN115170776A (zh) | 基于混合现实技术的手工艺路径引导学习系统 | |
| CN110070777B (zh) | 一种赫哲族鱼皮画仿真培训系统及实现方法 | |
| Yu et al. | Parametric design algorithm guided by machine vision in animation scene design |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22952395 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22952395 Country of ref document: EP Kind code of ref document: A1 |