TW201019265A - Auxiliary design system and method for drawing and real-time displaying 3D objects - Google Patents

Abstract

The invention provides an auxiliary design system for drawing and real-time displaying 3D objects, which includes: an image capture module, a signal characteristic module, a signal processing module, and a display module. The invention also provides an auxiliary design method for drawing and real-time displaying 3D objects, which includes: (A) reshaping the space coordinate of the characteristic signal; (B) establishing the physical model data of 3D objects; and (C) performing space mapping. In addition to the aforementioned steps A, B and C, the invention also includes: (D) performing a method of reality expanding. Based on the aforementioned system and method, designers can proceed design and operation in the real scene and directly view the drawn 3D objects presented in realistic scene in real time from the display module.

Description

201019265 VI. Description of the Invention: [Technical Field] The present invention relates to an auxiliary design system and method for drawing and displaying an object in real time, in particular, a signal feature module is formed in an image capturing module. The image capture space sends a feature signal to draw a 3D object for the image capture module (4) its image and (4) 3D object. φ [Prior Art] According to the principle of modern product design, the concept of recording and development design needs to draw the sketch in a two-dimensional plane. However, for the designer, if the designed item is three-dimensional, enter In the subsequent design process, the information of the two-dimensional plane has to be converted into a three-dimensional three-dimensional model, which not only increases the process of information conversion, but also increases the time and cost. Therefore, the computerized design (c〇mputer Aided Design, CAD) software for the visualization process has been a trend. From the beginning of the concept sketching, detailed design, and finally the appearance of the simulation display, provide convenient and fast assistance. Design features. However, even though the power of computer-aided design is still to present 3D graphics on the 2D plane, the mastery of the entity still requires the designer to use the model to achieve the final shape. In the current design process, 'from the extension of concept, the discussion of hand-drawn sketches, the color map, the computer 3D simulation, the design correction, etc., 3 201019265 saw nothing more than 2D simulation or 3D simulation Figure. For the decision makers and the company's decision-makers, it will cause blind spots in manufacturing and production. After the model is completed, the detailed review and revision work can be done, resulting in unnecessary cost and time. SUMMARY OF THE INVENTION Accordingly, the present invention provides an auxiliary design system and method for drawing and 3D objects, which is operated by a more humanized operation by optical three-dimensional = replacing the planar mouse used by the computer-aided design software. Auxiliary design process. The invention provides an auxiliary design system for drawing and displaying a 3D object in real time, comprising: an image capturing module, comprising at least two image capturing units for capturing images and generating image capturing signals, each image撷The distance between the units is larger than the parallax, and an image manipulation space is formed between the image manipulation roads of each image removal unit. The signal feature module is configured to move the image capture space and emit a feature signal for the image capture module to capture the image. The signal processing module is electrically coupled to the image capture module for receiving the image. The signal number is converted into a Solid Model System (SMS) parameter after calculation. The display module is electrically connected to the signal processing module for receiving the physical model system parameters and presenting them as 3 £) objects. The above-mentioned auxiliary design system for drawing and displaying the object in real time, wherein the image capturing module is a high-capture color camera. 201019265 The above-mentioned auxiliary system for displaying and displaying 3D objects in real time, wherein the signal feature module is a light source transmitter. The light source emitter is a light pen. The above-mentioned auxiliary system capable of displaying a 3D object in a green state, wherein the characteristic signal refers to any one or a combination of a signal coordinate, a signal: a signal time series, a signal strength or a signal point wavelength. ',' ❹ Ο The present invention also provides an auxiliary design method for drawing and displaying a 3D object in real time, wherein the signal feature module emits a characteristic signal edge buckle object in an image capturing space formed by the image capturing module. The image capture module captures the image, and performs the following steps: The space coordinate of the silly feature signal: reconstructs the feature signal according to the feature signal and the module parameter of the module. B. Constructs the 3D object Entity model capital # : :;:. The movement trajectory of the object, according to the entity of an object Ϊ C. Space mapping · Combine the movement trajectory and the space coordinates of the space and the 3D object to perform the mapping and mapping to instantly display the 3D object. The invention also provides a method for forming and suppressing the object formation by the signal feature module, and the feature signal drawing (10) object is generated in the image capturing module image capturing space, and the image capturing module captures the image. The image, and the following steps are performed: A. Reconstruct the feature signal "coordinates · According to the feature signal and shadow 201019265 image capture: the module parameters of the group, reconstruct the feature signal space. β. Construct the physical model data of the 3D object. ^, the movement trajectory of the 3D object, according to this construction: type data. Cut the physical model of 1 thousand C. Spatial mapping: combined with the above-mentioned mobile rail material, and model the characteristic signal and the solid model to map 3D in real time Objects. The coordinates are defined and D. Augmented reality · According to the feature signal, the object is drawn and the scale of the 3D object is set to make the three-dimensional space of the body. Instant display 3D object auxiliary design: 2:: Number refers to signal coordinates, signal color, signal 2 time series, signal (four) degrees or signal point wavelength - or its group can be drawn and displayed instantly The auxiliary setting method of the object, wherein the step A includes the following steps: the parameter of the couch: the image is set up (4) the module is taken, the image is in the parallax' and the image of each image manipulation unit is 2:::=::image_ After the correction, the image operation group is obtained = the image coordinate of the characteristic signal is obtained: the signal pattern is used to move the image capturing space, and the characteristic signal is sent, and then the image is captured by the operation module, and the image is processed. The image of the characteristic signal 201019265 is like a coordinate. The number H is set to set the money line three (four) construction: the module parameters and image coordinates are input into the database, and the =module: formula is set and based on the module parameters and characteristic signals. The three-dimensional reconstruction 'obtains the spatial coordinates of the characteristic signal. The construction (four) is determined according to the color of the characteristic signal, the red t-proliferation mode is preset, the yellow is the sculpture mode, and the blue is the extracted object mode.

The invention has the following advantages: 1. The method for drawing a 3D object according to the invention is relatively close to the human intuition and experience, and can reduce the inaccuracy in the design and development process, and can be made by the designer and the customer. Instant communication paradoxes enhance interactivity and make the design development process smoother, enabling the industry to save more development time and cost. 2. Unlike the traditional CAD or CAM software, which can only be presented on the computer screen, the present invention allows the designer to set the s··· operation in the real scene and directly see the edge through the display module. The virtual object is presented in a realistic scene, so it is easier to understand the actual size of the object and cross-reference with the real environment, so that the designer can more accurately feel the realism of the object. 3. The system of the present invention retains the characteristics of the CAD processing digital data, and elastically changes the design content and attributes of the created virtual object, such as changing the size, modifying the shape, color, and object flipping, so that the visual display design work is performed. In the process, the designer can clearly communicate his ideas in 201019265 and quickly communicate with other participants. 4. For the designer, through the system and method of the invention, the designer's creativity can be swayed away from the plane, and the 3D object can be directly sculptured in the three-dimensional space, and combined with the real environment, the design object will be improved. Authenticity, the boundaries between design drawings and models will no longer be clear, changing the modern design development process.实施 [Embodiment] The first embodiment provides an auxiliary design system for drawing and displaying 3D objects in real time. Please refer to the system block diagram of the first figure and the system architecture diagram of the second figure, including: image capture The module (1) includes at least two image capturing units U1) for capturing images and generating image capturing signals. In this embodiment, two high-speed color cameras are used, and each image capturing unit (u) is connected. The distance is larger than the parallax, and an image capturing space (12) is formed between the image capturing units. The signal feature module (2) moves and emits in the image capturing space (丨2). The characteristic signal, the signal feature module (2) is a light source emitter, and the embodiments of the present invention use an optical brush to emit a characteristic signal as a light spot, which is referred to as a feature point in the embodiments of the present invention. The characteristic signal emitted is called a feature point, which is extracted by the image capturing module (1), and is characterized by any one or a combination of coordinates, colors, time series, intensity or wavelength of the feature points. The processor (3) is electrically connected to the image capturing module (1), and includes a signal processing module (31) and a display module (32). In this embodiment, the signal processing module ( 31) The image capturing interface card and the processing program are used to receive the image of the feature point, and then converted into a Solid Model System (SMS) parameter by the operation, and the display module (32) is connected to the signal processing module. The group (31) is electrically connected, and is a liquid crystal screen 'for rendering a 3D object. e

In use, as shown in the third figure, the user pre-sets the function of the signal feature module (2), for example, which modeling mode is used to draw and draw the 3D object zoom amount, and the image capture space (丨2 ) The internal mobile signal feature module (2) 'signal feature module (2) sends a feature point for the image capture module (丨) to capture its image and transmit it to the signal processing module (31) of the processor (3) After the processing, the 3D object image is outputted in the display module (32) and presented to the user's eyes. The second embodiment is an auxiliary design method for drawing and displaying the 3D object in real time, please refer to the fourth figure. And with the first picture = system architecture diagram, with the signal feature module (2) in the image capture module (1) formed by the image removal space (12) towel issued feature signal edge 3D object 'for image operation Taking the module (1) to capture the image, in this embodiment, the 3D object is drawn by the optical brush in the image capturing space (12), and the method steps are as follows: (4) coordinates of the reconstructed feature signal: according to the feature point and Image 9 201019265 Operation module (l) Module parameters' space coordinates of the feature point reconstruction. Since the image capturing module (the high-speed color camera is used in the embodiments of the present invention, the following module parameters are referred to as camera parameters, which are described in advance herein. This step further includes the fifth figure as shown in FIG. Sub-steps: A1. Obtaining module parameters: Please refer to the image capturing module (1) of the first embodiment to set up a high-speed color camera to perform parameter correction 'obtaining camera parameters for three-dimensional coordinate reconstruction ❹ . 2. Obtaining characteristic signals Image coordinates: moving with an optical brush, moving in the image removal space U2), emitting feature points, capturing images by the image capture module, and performing image processing on the captured images to obtain feature point parallax images. : Feature point Parallax image refers to the feature point emitted by the optical brush, and the image coordinate in the image capturing space (12) formed by the image capturing unit (ιι) having parallax, and the characteristic of the optical brush is determined by the pixel RGB value. Point color. Reduce A3. Modeling and perform 3D reconstruction: input camera parameters, image coordinates, coordinates of feature points, time series, color, etc. into a program database, and set the modeling mode. In this embodiment, the feature signal is The color is distinguished, the preset red is for the accretion mode, the color is the sculptural mode, and the blue is the extracted object mode. At the same time, the root transit point parallax image and camera parameters are reconstructed in three dimensions to obtain the spatial coordinates of the signal. ' Β. Constructing the physical model data of the 3D object: the recording signal The module is drawing the movement of the 3D object in space, and based on this, construct the physical model data of 201019265 pieces. c. Spatial mapping ········································································································ The model relationship combines the relative geometrical transformation of the 3D object with the relative geometry of the aforementioned movement and the 3D object. Ding Yiyi and the mapping 'to instant 显 tiT:: The third embodiment is also a kind of available system and "the auxiliary design method of the object, please take steps A, B, r, bite δ ^ 'Ding and whistle · Match 4 is described with reference to the second embodiment: The first embodiment differs in that: ^ Human Augmented Reality: Augmented Reality has three essential characteristics. (a 5 '丨面, , '° σ virtual 3D objects and real objects; (b) Detecting = interacting with virtual 3D objects; (c) Simulating 3j objects can be presented in real three-dimensional space. Among them, (4) and & In step C and C towel construction is completed, so in this step, in order to increase the geometric property and operation of the f-object, the zooming amount of the 3D object is set according to the movement feature of the signal feature module to draw the 3D object in the work room, so that it is presented in the The three-dimensional space of the real object. As shown in the seventh figure, it is a program algorithm flow, and the method of the third embodiment is designed as an execution program. The program functions: (a) feature points by writing software Space coordinates are reconstructed and the movement trajectory is recorded. 201019265 (b ) Identify feature point colors to construct or sculpture a solid model in U). “Function setting. Dalai. Material and fine object space mapping association, please refer to the operation of the solid model data in the seventh to tenth parts, the modeling setting and the feature point operation: As shown in the eighth figure, If the magnetized Λ & ^ 疋 疋 ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ ^ In the formula, the selected pattern is used as the sweeping brush. The second is the sweeping path, the space coordinate sequence is the sweeping path, the ninth image is the ellipse for the riding (four) plane, and the second is the rectangular sweeping section. For example, if the riding mode is set in the tenth-®^ _, the sweep path is selected as the moving path of the object according to the spatial coordinate sequence. ❹ X modeling is set to the enumeration mode (not shown), and the space coordinate sequence and distance are used. The set of listed graphic parameters and related computer-aided design functions can be assisted by optical brush design, so it is more intimate, human intuition and experience can reduce the uncertainty in the design and development process, and make the design development process more smoothly, The industry can save more development time and cost. As shown in the twelfth figure, the design operation is performed by using the system of the first embodiment of the present invention and the method of the second embodiment, and the optical brush is used in the image capturing space ( 12) emit a feature point to draw a virtual 3D object 12 201019265 pieces (A) and (b), and through the display module (the 3D object (4) and (B) are connected to see the object so that it is easier to understand the object The actual size and the cross-referencing in the real environment of the environment, such as:: the person can more accurately feel the realism of the object. ❹ As shown in the thirteenth figure, for the other - using the first embodiment of the present invention The system and the method of the second embodiment are designed (4) to: send two feature points in the image capturing space (12), and create a virtual 3D object in the actual flower pot (c) scene. And through the display module (32), the actual existing flowerpot and the virtual 3D object (D) can be seen in the real scene, and the creativity can be set to be no longer good, but constructed directly in the three-dimensional space. 3D objects, combined with the real environment, design Will enhance the real

Sex, design and model (4) boundaries will no longer be clear, changing the modern design development process. °X Please refer to the fourteenth to eighteenth aspects. The present invention also applies the concept of Object-〇riented, constructing attributes such as geometry and shape for individual virtual objects, and adding inheritance (Inheritance). The concept, for the physical modeling data can be reused (Reuse), and easy for designers to quickly use existing objects for design and modification. Each virtual object inherits from the same class and has the same operation (0perati〇ns) method, such as changing size, degree of freedom, and light and shadow changes, so that the system can operate and manage the overall design object. The 'fourth and fifteenth drawings are the design operations of the augmented reality system by using the system of the first embodiment of the present invention 201019265 and the method of the third embodiment, and the user and the virtual one are 3) Objects can interact. 'The system performs matrix operations on solid modeling data of 3D objects, such as translation matrix, scaling matrix, and rotation matrix to change the size and degree of freedom of 3D objects, as shown in Figure 14 in 'degree of freedom. The amount of displacement is also determined by the displacement vector of the optical brush, while the rotation property uses the Magnetic Motion Capture System to capture the amount of rotation, and the commercially available motion capture system is set up on the optical brush. On the top, it is convenient for the user to rotate after selecting the object, as shown in the fifteenth figure. In the sixteenth to eighteenth embodiments, the system of the first embodiment of the present invention and the method of the third embodiment are used to modify and create a virtual 3D object. For the modification function, the virtual object grid can be Shape, and then eliminate the calibration by feature coordinate points, and define the attributes of the grid points, so that the program can perform the lattice point masking operation in the object-oriented mode. The preset attributes and function definitions are as shown in Annex 1. The constructed program function determines the masking surface and surface reconstruction operations. The system of the invention retains the characteristics of the CAD processing digital data, and flexibly changes the design content and attributes of the created virtual object, such as changing the size, modifying the shape, color, and flipping the object, such as the second embodiment of the present invention. The 3D objects are designed to allow the designer to clearly communicate his ideas and quickly communicate with other participants during the visual display design process. 201019265 [Simplified description of the drawings] The first figure is a system architecture diagram of the first embodiment of the present invention. The second drawing is an appearance view of the system of the first embodiment of the present invention. The second figure is a flowchart of the operation of the system of the first embodiment of the present invention. The fourth figure is a flow chart of the method of the second embodiment of the present invention. The figure is the flow of the second step in the step A of the second embodiment of the present invention.

Figure 6 is a flow chart of the method of the third embodiment of the present invention. The seventh figure is a flow chart of the execution program algorithm designed by the method of the third embodiment of the present invention. The eighth figure is the operation of constructing the physical model data of the 3D object—at this time, the modeling is set to the proliferative mode. The ninth figure is the operation 2 of constructing the physical model data of the 3D object. At this time, the modeling 3 is again in the sweep mode, and the ellipse is used as the sweeping surface. The tenth figure is the operation three of constructing the physical model data of the 3D object. At this time, the modeling is set to the sweep mode, and the rectangle is used as the third section of the sweeping section to operate the physical model data of the 3D object. Modeling is set to Modeling as the extraction mode. 'Twelfth figure is the system of the first embodiment of the present invention, and the method design operation of the method is to create two images of the image points of the image B. Virtual 3D object. The thirteenth picture is based on the fourth embodiment of the present invention and the second embodiment. 201019265 === Method design operation diagram 2, an optical 3D object is drawn by an optical pen in an actual scene of the basin. Figure 14 is a system and a third embodiment of the first embodiment of the present invention

Sch-design operation diagram - the displacement of the displacement vector of the optical pen and the degree of freedom of the 3D object. The fifteenth figure is the system and the third embodiment of the first embodiment of the present invention

The schematic design operation of the method 1 'determines the rotation angle of the 3D object by taking the rotation of the optical stylus 1 . - Figure 10 is a schematic diagram of modifying and sculpting a virtual 3D object by the system of the first embodiment of the present invention and the method of the third embodiment. The seventeenth embodiment is a first embodiment of the present invention. The system and the method of the third embodiment 'modify and sculpture the virtual 3D object diagram 2. The eighteenth figure is a schematic diagram 3 of modifying and sculpting a virtual 3D object by the method of the first embodiment <system and the third embodiment of the present invention. Attachment 1 is the grid point attribute and function definition. Annex 2 is a photograph of a 3D object designed by the system and method of the present invention. [Main component symbol description] (1) (12) (2) Image capture module image capture spatial signal feature module (11) Image capture unit (3) Processor (31) Signal processing module 201019265 (32 ) Display Module (A) 3D Object (B) 3D Object (C) Flower Pot (D) 3D Object

17

Claims (1)

201019265 VII. Patent application scope · Auxiliary design of 3D object 1 · A system for drawing and instant display, comprising: an image capture module, comprising at least two image captures for extracting images and generating images (4) taking signals, Each ί distance is larger than the parallax ′ and an image browning space is formed between the shadow paths of the image capturing units; the signal feature module is moved in the space of the material (4) and the characteristic signal is extracted for the image capturing module to capture The image processing module is electrically connected to the image capturing module for receiving the image uncovering signal, and is converted into a solid model system (SMS) parameter after the operation; the display module is The signal processing module is electrically connected to receive the physical model system parameters and present as a 3D object. 2. An auxiliary design system for drawing and displaying a >3D object as described in claim 1 of the patent application, wherein the image capture module is a fast color camera. 3. An auxiliary design system for drawing and displaying a 3D object as described in claim 1 of the patent application, wherein the signal feature module is a light source emitter. 4. An auxiliary design system for drawing 3D objects as described in item 3 of the patent application scope, the light source emitter is a light pen. 5. Auxiliary design system for drawing, ie, 201019265: object, as described in the first paragraph of the patent application, which makes the characteristic signal ==, signal color, signal time series, signal strength or signal point wavelength One or a combination thereof. An auxiliary design method for displaying and displaying 3D objects in real time, the signal feature module sends a pull in the image capture module capture space %^^ m M . . Temple sign painted 3D objects for The image capture group captures the image, and performs the following steps: · Ο; the spatial coordinates of the feature signal: reconstruct the coordinate of the feature signal according to the feature signal and the module parameters of the image capture module; η: 3D The physical model data of the object: record feature signal ^ 3D object moving track 'According to this to construct the physical model data of the 3D object; Λ c. Spatial mapping: combined with the aforementioned moving trajectory and entity modeling capital = and the space and 3D of the image The space coordinates of the object are defined and mapped to display the 3D object in real time. ❹ 7.-Available for drawing and instant display # 3D * The auxiliary design of the image is taken by the image feature module in the image forming module. The feature signal green 3D object is sent out for image manipulation 4, the group captures its image, and the following steps are performed: Talk about him A. Reconstruct the spatial coordinates of the feature signal: according to the feature signal and the image capture module Module parameters, reconstruction of the spatial coordinates of the feature signal; cold system 6^ construction of the physical model data of the 3D object: record feature signal, 'movement of the object, and construct the physical model data of the 3D object; '201019265 c. Mapping: Combine the aforementioned moving trajectory and solid modeling data' and define and map the spatial coordinates of the feature signal and the solid model to instantly display the 3D object; D. Amplify the real world: according to the characteristic signal, the moving track of the 3D object The trace sets the amount of zooming of the 3D object to be presented in a three-dimensional space with a real object. The auxiliary design method described in claim 6 or 7 of the patent scope can be used to draw and display the 3D object in real time, wherein The characteristic signal is the signal coordinate, the signal color, the signal time series, the signal strength or the signal point. The type or the group of the skin length. 9. As described in item 6 or item 7 of the patent application scope. Auxiliary design method for providing 3D objects in a timely manner, wherein step A includes the following steps: obtaining module parameters, erecting an image capturing module, and capturing the image The module includes at least two image capturing units, and the distance between each image capturing unit is larger than the parallax, and is formed between the image capturing paths of the image capturing units. The image processing space is corrected to obtain the image capturing mode. The module parameters of the group; A2. The image coordinates of the feature signal are obtained: the signal feature module is moved in the image capturing space, the feature signal is sent, and the image capturing module is used to manipulate the shadow image and the virtual image. Coordinates; 6 images processed after the feature signal A3. Modeling and 3D reconstruction · Input the module parameters, feature signals and image coordinates into a database, and set the modeling mode 'and module Parameter H (4) is used to perform 3D weight 20 201019265 to obtain the space coordinates of the feature signal. ^0. The auxiliary design method for drawing and capturing the π 3D object as described in claim 9 of the patent scope, wherein the modeling setting the color of the signal is made in the area A 'preset red is the shooting mode, The dragon color is the sculpture mode and the blue color is the extraction object mode. $ ❹ twenty one