KR20210116100A - Method and apparatus for 3d sketching - Google Patents

Abstract

According to the present invention, interaction of each function is designed, so functions necessary to move the sketch in the 3D sketching process can be used naturally. Designers can move the sketch by dividing the sketch drawn with a pen into several parts and connecting the parts through joints, as if holding and moving objects with their hands. Disclosed are a method and a device for three-dimensional sketching. The method for three-dimensional sketching creates a reference object based on points selected by a user in a three-dimensional virtual space including an object represented by sketch lines, determines a trajectory of a first part to move in the object based on the reference object, determines the range of motion of the first part and a second part of the object against which the first part moves along the trajectory, and creates a joint connecting the first part and the second part based on a position of the first part, a position of the second part, the trajectory of the first part, and the range of motion.

Description

3D sketching method and apparatus {METHOD AND APPARATUS FOR 3D SKETCHING}

The following description relates to a three-dimensional sketching method and apparatus.

Many products have moving parts, and as the parts move, the product can change into several poses. As such, products with multiple poses have different shapes for each pose. Due to the characteristic that the shape changes according to the movement, the designer must consider the shape and the movement together when designing a product. However, it is difficult to consider shape and movement together in the process of exploring ideas through sketches in the early stages of design. It is difficult to imagine the shape that changes according to the movement, and it takes a lot of time to sketch the various shapes of the product one by one. If ideas are not explored sufficiently during the sketching process, a product can be designed that does not move as intended or takes on unexpected shapes.

In the present invention, the interaction of each function is designed so that functions necessary for moving the sketch can be used naturally in the 3D sketching process. Designers can move a sketch drawn with a pen by dividing it into parts and connecting the parts through joints. In addition, designers can move sketches as if holding objects with their hands and moving them. In this way, designers can focus on sketching ideas through interaction using the pen and hand.

The present invention can provide a three-dimensional sketching system capable of considering both shape and movement by moving a sketched object.

A 3D sketching method according to an embodiment may include: generating a reference object based on points selected by a user in a 3D virtual space including an object represented by sketch lines; determining a trajectory of a first part to be moved in the object based on the reference object; determining a movement range of the first part and a second part of the object as a reference when the first part moves along the trajectory; and generating a joint connecting the first part and the second part based on the position of the first part, the position of the second part, and the trajectory and movement range of the first part.

The step of creating the reference object in the three-dimensional sketching method according to an embodiment refers to a sphere including one of the points selected by the user as the center point of the sphere and the other on the surface of the reference object. object can be determined.

In the three-dimensional sketching method according to an embodiment, the points selected by the user include a first point tapped first and a second point lifted last in a tap-and-drag input from the user, and the second point is the It may be located on a sketch line representing the first part.

In the three-dimensional sketching method according to an embodiment, the determining of the trajectory of the first part may include determining the trajectory on the reference object based on a third point first tapped in the tap and drag input from the user and a drag direction. and the third point may be located on a sketch line representing the first part.

In the three-dimensional sketching method according to an embodiment, the determining of the trajectory of the first part includes generating a plurality of first vectors connecting two reference points from among a plurality of reference points determined by dragging the tap app input from the user. and determining a plurality of second vectors by calculating a cross product between two vectors among the plurality of first vectors, determining a rotation axis vector of the trajectory based on the plurality of second vectors, and the rotation axis vector and the trajectory may be determined based on a drag direction of the tap and drag.

The step of determining the motion range of the first part and the second part of the object in the three-dimensional sketching method according to an embodiment includes selecting a part selected by a tap and hold input from the user from among the parts included in the object. The second part may be determined, and the movement range of the first part may be determined by tapping and dragging inputted from the user while the tap and hold is maintained.

In the 3D sketching method according to an embodiment, the predicted movement of the first part may be visualized by the tap and drag input from the user and provided to the user.

In the 3D sketching method according to an embodiment, the second part may be set as a parent part of the first part, and the first part may be set as a child part of the second part.

In the three-dimensional sketching method according to an embodiment, the step of creating the joint may include moving the first part in the trajectory and the range of motion when considering the position of the second part, which is the basis for the movement of the first part. You can create joints that allow

A three-dimensional sketching method according to an embodiment may include: determining a reference part, which is a reference for movement, from among a plurality of parts of the object; and activating a joint connecting the reference part and a child part of the reference part to move the child part by a tap and drag input from the user.

A three-dimensional sketching method according to an embodiment may include: determining a reference part, which is a reference for movement, from among a plurality of parts of the object; determining any one moving part between the reference part and the distal part of the plurality of parts; and activating one or more joints between the reference part and the moving part to move the moving part with a mid-air pinch gesture input by the user.

The 3D sketching method according to an embodiment may further include setting some sketch lines selected by the user from among the sketch lines expressing the object as one part.

In the 3D sketching method according to an embodiment, the setting of the partial sketch lines as one part may include selecting sketch lines overlapping with the user's drag inputted to a display on which the sketch lines are displayed, and selecting the selected sketch lines. You can remove any one sketch line or a part of the sketch line and set the part with the remaining sketch lines.

A three-dimensional sketching method according to an embodiment generates a reference plane including one or more points input by the user in the three-dimensional virtual space, or a reference sphere including two points input by the user step; and generating a sketch line for expressing the object by projecting the drag input from the user on the reference plane or the reference sphere.

A three-dimensional sketching apparatus according to an embodiment includes a processor; and a memory including at least one instruction executable by the processor, wherein when the at least one instruction is executed by the processor, the processor is executed by a user in a three-dimensional virtual space including an object represented by sketch lines. A reference object is generated based on the selected points, a trajectory of a first part to be moved in the object is determined based on the reference object, and a movement range of the first part and the first part follow the trajectory. determine a second part of the object as a reference when moving, and based on a position of the first part, a position of the second part, a trajectory of the first part, and a movement range, the first part and the second part You can create joints that connect parts.

In the 3D sketching apparatus according to an embodiment, the processor may use any one of the points selected by the user as a center point of the sphere and determine a sphere including the other one on the surface as the reference object.

In the 3D sketching apparatus according to an embodiment, the points selected by the user include a first tapped first point and a last lifted second point in a tap and drag input from the user, and the second point is the It may be located on a sketch line representing the first part.

In the 3D sketching apparatus according to an embodiment, the processor determines the trajectory on the reference object based on a third point first tapped in the tap and drag input from the user and a drag direction, and the third point is the It may be located on a sketch line representing the first part.

In the 3D sketching apparatus according to an embodiment, the processor determines a part selected by the tap and hold input from the user from among the parts included in the object as the second part, and while the tap and hold is maintained, the The movement range of the first part may be determined by a tap and drag input from the user.

In the 3D sketching apparatus according to an embodiment, the predicted movement of the first part may be visualized by the tap and drag input from the user and provided to the user.

According to one embodiment, it is possible to provide a 3D sketching system that makes it possible to explore an idea of a product having multiple poses in the early stages of design. Instead of sketching various shapes of products that change with movement, designers can directly move the drawn sketch and check the shape of the sketch that changes with movement. Designers can easily verify various ideas about movement and shape in the early stages of design through the process of directly moving the drawn sketch, observing the sketch that has changed according to the movement, and revising the sketch that has changed according to the movement. When an idea needs to be revised, the designer can immediately modify the changed sketch according to the movement, and can move the modified sketch again. Through this system, designers can quickly explore ideas for movement and shape by moving and revising and revising ideas directly from the early stage of design.

According to an embodiment, a user can easily learn and intuitively use a 3D sketching method and apparatus. Animated sketches promote new ideas and make it easy to see if ideas make sense in a variety of poses. Each function can be intuitively and simply controlled with a pen or hand movement at any time during sketching.

1 is a view for explaining a process of performing 3D sketching according to an embodiment.
2 and 3 are diagrams for explaining a sketching operation according to an exemplary embodiment.
4 is a view for explaining a parting operation according to an embodiment.
5 to 9 are diagrams for explaining a rigging operation according to an embodiment.
10 to 12 are diagrams for explaining a posing operation according to an embodiment.
13 is a diagram illustrating a three-dimensional sketching method according to an exemplary embodiment.
14 is a diagram illustrating a three-dimensional sketching apparatus according to an exemplary embodiment.

Specific structural or functional descriptions of the embodiments are disclosed for purposes of illustration only, and may be changed and implemented in various forms. Accordingly, the embodiments are not limited to a specific disclosure form, and the scope of the present specification includes changes, equivalents, or substitutes included in the technical spirit.

Although terms such as first or second may be used to describe various components, these terms should be interpreted only for the purpose of distinguishing one component from another. For example, a first component may be termed a second component, and similarly, a second component may also be termed a first component.

When a component is referred to as being “connected to” another component, it may be directly connected or connected to the other component, but it should be understood that another component may exist in between.

The singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, terms such as "comprise" or "have" are intended to designate that the described feature, number, step, operation, component, part, or combination thereof exists, and includes one or more other features or numbers, It should be understood that the possibility of the presence or addition of steps, operations, components, parts or combinations thereof is not precluded in advance.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present specification. does not

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The specific structural or functional descriptions below are only exemplified for the purpose of describing the embodiments, and the scope of the embodiments should not be construed as being limited to the content described in the text. Various modifications and variations are possible from these descriptions by those skilled in the art. In addition, the same reference numerals shown in each drawing indicate the same members, and well-known functions and structures will be omitted.

1 is a view for explaining a process of performing 3D sketching according to an embodiment.

According to an embodiment, the 3D sketching apparatus may sketch an object in a 3D virtual space based on a user's body movement (eg, hand movement, etc.) and/or pen drawing. For example, a 3D sketching device may be implemented in the form of a tablet, but in addition, an AR (Augmented Reality) device capable of displaying objects in a 3D virtual space, VR (Virtual Reality), and a head mounted display ), smart glasses, smartphones, smart TVs, etc. may include various devices without limitation.

Through the 3D sketching device, the user observes the changed shape by moving the sketched object in the 3D virtual space, corrects the object by sketching again on the changed shape, and moves the modified object again to change the shape of the object according to the movement can be checked easily. The object is divided into a plurality of parts, and the parts are connected by a joint, so that the object may include, without limitation, various products that can move with respect to another part to which one part is connected. Through this, the idea of movement of the product, which was difficult to express with only a static sketch, can be easily expressed.

A user may sketch an object in a 3D virtual space through a 3D sketching device, and use a pen and both hands to move the sketched object. For example, the user's hand may be used to select or move a part and/or sketch line of an object, and the pen may be used to draw a sketch line or make a precise selection.

Referring to FIG. 1 , a process of dividing an object into several parts and defining a relationship between the parts is illustrated in order to move the object according to an exemplary embodiment.

In the sketching process 110 , the 3D sketching apparatus may create an object by drawing several sketch lines in a 3D virtual space according to user control. In the parting process 120 , the 3D sketching apparatus may divide the object into several parts by grouping some of the sketch lines drawn in the 3D virtual space and defining them as one part. In the rigging process 130 , the 3D sketching apparatus may create a part and a joint connecting the parts to define a relative position or a vertical relationship between the parts. In the posing process 140 , the 3D sketching apparatus may change the relative position or angle between parts by controlling the joint to change the object to a different pose. In this way, the user can see that the shape of the object is changed by moving the sketched object in the three-dimensional virtual space, and the sketching process 110, the part process 120, and the rigging process 130 are performed while the object is changed to a different pose. can be done again.

The 3D sketching device can modify the sketch even after moving the object. The 3D sketching device can erase the existing sketch line from the moving object and create a new sketch line. If the newly created sketch line is included in the previously created part, the newly created sketch line can move along with the corresponding part. According to an embodiment, if the user does not like the movement, it may be changed to another movement by modifying the joint that makes the corresponding movement. Several poses of an object appearing through various movements can be saved, and modifications made to a sketch in one pose can be reflected in other poses as it is.

The user can reproduce the movement of the object created by the joint by using several types of joints. Furthermore, by using multiple joints, it is possible to enable movement that is impossible with one joint, and by connecting another moving part on top of a moving part, it is possible to create a movement of a product whose shape changes due to the movement of other parts. Through this, the user can express all the movements of the object and observe the shape of the object that changes according to the movement.

The present invention provides a state through the color, thickness, and type (eg, solid line, dotted line, etc.) of the sketch line displayed on the screen, without separating a separate space for the user to check the state of the sketch line expressing the object in the three-dimensional virtual space. can be displayed. Through this, the user can easily check the status without turning his/her eyes away from the object he is working on during the work process.

For example, in the present invention, colors may be divided into black, gray, chromatic colors, and the like. A sketch line expressed in black may indicate an object that can be utilized in the current state. Selecting the black sketch line can cause certain functions to work or changes to the system. The grayed out sketch line may indicate an object to which the function is not applied when a specific function is activated. A sketch line expressed in chromatic color can indicate an object to which a specific function is applied when a specific function is activated. The colors described herein are exemplary, and sketch lines may be distinguished in various ways.

2 and 3 are diagrams for explaining a sketching operation according to an exemplary embodiment.

Referring to FIG. 2 , a sketching process based on a reference plane 220 is illustrated according to an exemplary embodiment.

When the user designates a desired position using a pen, the reference plane 220 including the point of the corresponding position may be generated. The location designated by the user may include at least one point and at most three points. For example, when two points 210 are selected on a grid line and/or a sketch line, the center is at the midpoint of the two points, and the reference plane including the two points 210 ( 220) can be created. In one embodiment, the reference plane 220 may be rotated at a desired angle and moved to a desired position by the user.

The user may freely create the sketch line 230 on the reference plane 220 using a pen. Points belonging to the sketch line 230 drawn by the user on the display may be projected on the reference plane 220 defined on the system to define positions in the stereoscopic space. The user may check the three-dimensional sketch line 230 connecting points defined in the three-dimensional space from various viewpoints. The user may also erase the drawn sketch line 230 or a portion thereof.

Referring to FIG. 3 , a sketching process based on a reference sphere 320 is illustrated according to an exemplary embodiment.

The reference sphere 320 may be generated by a user selecting a desired position using a pen and dragging 310 . For example, the reference sphere 320 may be created with the center point selected by the user as the center point and the distance between the center point and the point intersecting the existing sketch line in the process of dragging 310 as the radius. Alternatively, the radius of the reference sphere 320 may be determined by the distance between the center point selected by the user and the drag end point. The user may freely create the sketch line 330 on the reference sphere 320 using a pen. Points belonging to the sketch line 330 drawn by the user on the display may be projected onto the reference sphere 320 defined on the system to define positions in the three-dimensional space. Similarly, the user may check the three-dimensional sketch line 330 connecting points defined in the three-dimensional space from various viewpoints. The user may also erase the drawn sketch line 330 or a part thereof.

4 is a view for explaining a parting operation according to an embodiment.

Referring to FIG. 4 , an example of determining a part by some of sketch lines of an object according to an exemplary embodiment is illustrated.

In one embodiment, all sketching work may be performed on a single original sketch so that the initial sketch of the design can be focused on. A part may be some set of sketch lines existing in the original sketch. Sketch lines drawn by the user may be divided into several parts. A part may be generated by grouping some sketch lines selected by a user from among the sketch lines. Sketch lines may belong to several parts, and in this case, the sketch lines may be duplicated and belong to each part.

In step 410, the 3D sketch apparatus may receive a drag input from the user for a parting operation. In operation 420 , the 3D sketch apparatus selects sketch lines overlapping the first drag input from the user, and the selected sketch lines may be displayed in green (a thick line in FIG. 4 ). As such, any sketch line partially overlapping with the drag input from the user can be selected, and through this, the user's intended sketch lines can be quickly selected for the shape of the part. In operation 430 , the 3D sketch apparatus may remove one or more sketch lines or a portion of the sketch lines from among the pre-selected sketch lines based on the second drag input from the user. As such, if an unintentional sketch line is selected due to a drag from the user, the unintentional sketch line or only a portion thereof may be removed through a subsequent drag input from the user. In operation 440 , the 3D sketch apparatus may set one part using the remaining sketch lines.

Although the process of setting one part is illustrated in FIG. 4 by way of example, a more detailed description will be omitted since the corresponding description may be applied to the process of setting other parts included in the object as well.

In an embodiment, since the sketch in the initial design stage mainly expresses the overall shape rather than the detailed parts in detail, the designer may not perform the sketch while dividing the parts in the process of expressing the overall shape. So, the sketch lines selected to make a part can belong to multiple parts. Such sketch lines should be included in the corresponding part by separating only a part included in the corresponding part, and can be easily implemented through the above-described parting operation.

As such, in the present invention, in order to easily perform a desired operation without interfering with the sketching operation, it is possible to quickly select sketch lines using a pen, and to refine the selected sketch lines.

5 to 9 are diagrams for explaining a rigging operation according to an embodiment.

Referring to FIG. 5 , a rigging operation for generating a joint between parts included in an object according to an exemplary embodiment is illustrated. For convenience of description, in FIG. 5 , a part to be moved is referred to as a first part, and a part that is a reference for the movement of the first part is referred to as a second part.

In one embodiment, a joint may define a relationship between parts. Through this, it may be determined how one part moves with respect to the other part. The part can have movement along the joint.

In the present invention, the operation of making the joint and the operation of connecting the parts to the joint may be integrated into one operation. The user can connect the joint to the part by creating a joint and naturally moving the sketch, and through this, the user can easily implement the intended movement with only one operation. In the present invention, the position and angle of the joint may be determined in consideration of the movement according to the trajectory desired by the user, rather than making the movement in consideration of the position and angle of the joint. When a user draws a trajectory, the 3D sketching device automatically creates a joint that satisfies the trajectory, so the user does not have to worry about complicated joints.

In order to automatically generate a joint according to an exemplary embodiment, the 3D sketching apparatus may collect information for generating a joint while receiving a control for expressing a movement of a part from a user. For example, information required for joint creation may include information on at least one of a moving part, a part to be moved, a joint type, a joint position and direction, and a movement radius (or range) of the joint. and the required information may vary depending on the type of joint. In the case of a slide joint, more information on the path of the slide is required, and in the case of a ball joint, information on the direction and movement radius of the joint is not required. Hereinafter, the operation of the three-dimensional sketching apparatus based on the rotation joint will be described.

First, the 3D sketching apparatus may generate a reference object based on points selected by a user in a 3D virtual space. The reference object is an object that serves as a reference for determining a trajectory for joint creation, and may have, for example, a spherical shape. For example, the user may input tap and drag to create a reference object, and the 3D sketching device will refer based on a first point tapped first in the tap and drag and a second point lifted last after dragging. You can create a sphere. In this case, the first point may be a center point of the reference sphere, and the second point may be a point located on the surface of the reference sphere. In other words, a reference sphere may be generated with the first point as the center point and the distance between the first point and the second point as the radius. The second point may be located on a sketch line indicating the first part to be moved.

In operation 510, the 3D sketching apparatus may determine the trajectory of the first part based on the reference object. For example, the user may input tap and drag to determine the trajectory, and the 3D sketching apparatus may determine the trajectory on the reference object based on the third point first tapped in the corresponding tap and drag and the drag direction. The determination of the trajectory will be described in detail with reference to FIGS. 6 to 9 .

In operation 520, the 3D sketching apparatus may display an afterimage of the movement of the first part according to the previously determined trajectory, through which the user can easily check the expected movement of the first part according to the trajectory. The afterimage may be expressed in a different color to be easily distinguished from other lines.

In operation 530 , the 3D sketching apparatus may determine a motion range of the first part and a second part of the object as a reference when the first part moves along the trajectory. For example, the user can tap and hold the second part to be fixed with one hand, and enter tap and drag to determine the range of motion of the first part with the other hand while the tap and hold is held. have. The 3D sketching apparatus may determine the part selected by the tap and hold as the second part, and determine the movement range of the first part by tapping and dragging input from the other hand while the tap and hold is maintained. In this case, the movement of the first part for determining the movement range of the first part may be attributed to a predetermined trajectory. In this case, the second part fixed by tap and hold and the first part whose movement range is determined by tap and drag may be displayed in different colors.

Information for creating a joint may be collected through the above-described processes, and a joint may be created between the first part and the second part based on the information.

A relationship between a parent part and a child part may be established through a rigging operation according to an embodiment. The 3D sketching device can create a joint through the determined trajectory, and through this, the 3D sketching device can know which part moves and how. However, the 3D sketching device does not yet know which part is the parent part of the moving part and what the motion radius of the joint is. This is because a joint without parent part information is simply an object floating in space, not connecting the parts. In order for the various parts of an object to change into various shapes according to the movement of the joint, each part must be connected by setting the parent part of the moving part. Since a jointed product without movement radius information does not move like a real product, it is necessary to limit the movement radius to observe the shape in a realistic product pose.

The user can set the motion radius of the joint and the parent part of the part to be moved by directly moving and demonstrating the part through the 3D sketching device. The user can move the part using both hands interaction. First, the user may select and move a part to be moved with the other hand while selecting a part to be fixed near the joint with one hand. The selected moving part can move in the direction the hand moves. Such an interaction method may be the same as an interaction that moves an object in a 3D sketching apparatus.

While the user moves the part, the 3D sketching apparatus may determine the parent part of the corresponding object. In the process of moving the part, the fixed part selected by the user may be the parent part, and the moving part may be set as the child part. The user can set the movement radius of the joint by moving the part. For example, the afterimage according to the movement is displayed in green so that the user can easily check the movement radius.

Referring to FIG. 6 , a process in which a rotation joint is determined based on a trajectory determined on the reference sphere 610 according to an embodiment will be described. The rotation joint may be a hinge joint that rotates the connected parts based on the rotation shaft 620 . A user may draw a trajectory on the reference sphere 610 through tap and drag on the reference object. Rotational joints can rotate connected parts by moving the parts along a trajectory.

Referring to FIG. 7 , a process of determining a rotation axis of a rotation joint based on a trajectory according to an exemplary embodiment is illustrated. The rotation axis vector of the rotation joint can be calculated based on the drawn trajectory. The 3D sketching apparatus generates a plurality of points (P1, P2, P3, P4, P5, ..., PN) located on the trajectory, and several vectors (V1, V1, V2, ...) and finding the cross product between the two vectors among the generated vectors, the rotation axis vector (m) of the two vectors can be obtained. By applying this process to a plurality of vectors connecting points on the trajectory and obtaining the average of several obtained cross product vectors, the rotation axis vector according to the trajectory can be determined. Here, it corresponds to an embodiment that the rotation axis vector is determined based on the average of the cross product vectors, and in addition, various embodiments in which the rotation axis vector is determined by applying other statistical techniques or optimization techniques to the cross product vectors may be included without limitation.

Referring to FIG. 8 , according to an exemplary embodiment, the user may repeatedly draw the trajectory until a desired movement is found while looking at the trajectory of the joint generated by the 3D sketching apparatus and the resulting motion afterimage. If the trajectory is repeatedly drawn, the previously drawn trajectory disappears and a joint is determined based on the recently drawn trajectory, and an afterimage may appear accordingly.

Referring to FIG. 9 , a moving part 910 , a trajectory, an afterimage of the moving part 910 moving according to the trajectory, and a rotation axis according to an exemplary embodiment are illustrated.

10 to 12 are diagrams for explaining a posing operation according to an embodiment.

Referring to FIG. 10 , a posing operation of moving a part of an object according to an embodiment is illustrated by way of example.

The three-dimensional sketching apparatus moves the sketched object in a three-dimensional virtual space for each part, and enables the process of checking and sketching the object in various poses to be performed naturally. In this case, the 3D sketching apparatus may use an interaction method of moving parts of an object using both hands by reflecting a method of holding and moving an actual product. A user can easily designate a part to be fixed among parts of an object by tapping and holding a specific part with a finger at any time during the sketching process. In addition, the user may control the movement of the part to be moved by moving on the screen or in the air with the other hand.

In operation 1010, the user may tap and hold the part to be fixed with one hand, and the 3D sketching apparatus may determine the part selected by the tap and hold as the fixed part. In step 1020, the user may tap and drag the part to be moved with the other hand while holding the tap and hold with one hand, and the 3D sketch device may move the first tapped part in the tap and drag input with the other hand. It is determined as a part, and the corresponding part can be moved corresponding to the drag. In this case, some or all of the joints connecting the fixed part and the child parts of the corresponding part are activated to move the part.

The 3D sketching apparatus may express the state of the part through the color of the sketch line. For example, sketch lines belonging to a part to be moved may be displayed in green, and sketch lines belonging to a part to be fixed may be displayed in blue. For convenience of explanation, green may be represented by a thick line and blue by a thin line in FIG. 10 .

Referring to FIG. 11 , an example of controlling a movement of a part through an aerial pinch gesture according to an embodiment is illustrated.

Because movement on the plane can express the position (x, y) on the surface but not the depth (z), the user can express the movement with more than 2 degrees of freedom through the touch input to the plane of the touch display as intended. I may not be able to express myself accurately. Since the object for which the movement is to be controlled exists in the 3D space, if the hand gesture to control the motion is also made in the 3D space, the desired movement can be controlled more accurately and quickly.

The 3D sketching device combines hand movements and inverse kinematics in space to more accurately and quickly control complex movements of products. The user can fix some parts of the object by inputting tap and hold with one hand, and move other parts through an aerial pinch gesture with the other hand. For example, the aerial pinch gesture is a gesture of contacting the thumb and index finger in the air, and may be detected through a motion sensor or the like. In addition, various aerial gestures such as a fist clenching gesture in the air may be applied without limitation.

When using the movement of the hand in the air, the 3D sketching apparatus may adjust the value of each joint so that it approaches a target located in space using inverse kinematics. Due to this, the user can create complex movements in which several joints are rotated with one hand movement.

A motion sensor can detect hand movements in the air. The 3D sketching apparatus may detect a hand in the air as a target through a motion sensor, and may correspond the target to a specific part of an object. Through this, as the position of the user's hand in the air is changed, a specific part of the corresponding object may also exhibit a corresponding movement. This operation is based on inverse kinematics, and several joints included in an object may be rotated simultaneously or consecutively so that a specific part of the object exhibits a corresponding movement.

The user may first tap and hold the part 1120 to be fixed, and the user may select a specific part 1110 of the object to be moved along the target by tapping or the like. And, when the user makes the aerial pinch gesture, the 3D sketching apparatus may recognize the hand that has made the aerial pinch gesture as a target through the motion sensor, and map the location of the target to the specific part 1110 . When the user moves the hand that has taken the aerial pinch gesture, the specific part 1110 may be moved to correspond to the movement of the corresponding hand based on the inverse kinematics, and in this case, between the specific part 1110 and the fixed part 1120 . One or more joints between the distal parts in a particular part 1110 are stationary, while one or more joints of Accordingly, the movement of the object may vary depending on which part of the parts of the object corresponds to the target.

Referring to FIG. 12 , an example for explaining a clutching operation using an aerial pinch gesture according to an embodiment is shown.

Because the 3D sketching device moves the target using the relative movement of the hand, it can reproduce large movements using clutching. The user can move the target by making a pinch gesture by attaching the thumb and index finger in the air. When the user makes the pinch gesture and moves the hand, the preselected part of the object can be moved correspondingly accordingly. When two fingers are released, the target is released and the part does not move due to the movement of the hand, so the user can control the movement of the preselected part by repositioning the hand to a comfortable position and then taking a pinch gesture again. By repeating this, it is possible to make the target move significantly even if the hand does not move much.

13 is a diagram illustrating a three-dimensional sketching method according to an exemplary embodiment.

Referring to FIG. 13 , a 3D sketching method performed by a processor included in a 3D sketching apparatus according to an exemplary embodiment is illustrated.

In operation 1310, the 3D sketching apparatus generates a reference object based on points selected by a user in a 3D virtual space including an object represented by sketch lines. The 3D sketching apparatus may use any one of the points selected by the user as the center point of the sphere, and determine a sphere including the other on the surface as the reference object. A first point tapped first and a second point lifted last in a tap-and-drag input from a user may be included, and the second point may be located on a sketch line representing the first part.

In operation 1320, the 3D sketching apparatus determines the trajectory of the first part to be moved in the object based on the reference object. The 3D sketching apparatus determines a trajectory on the reference object based on the first tapped third point and the drag direction in the tap and drag input from the user, and the third point may be located on the sketch line representing the first part. have. The 3D sketching apparatus generates a plurality of first vectors connecting two reference points from among a plurality of reference points determined by dragging a tap app input from a user, and calculates a cross product between two vectors among the plurality of first vectors Accordingly, a plurality of second vectors may be determined, a rotation axis vector of the trajectory may be determined based on an average of the plurality of second vectors, and a trajectory may be determined based on the rotation axis vector and a drag direction of the tap and drag. Using the average of the plurality of second vectors corresponds to an embodiment, and in addition, optimization methods using other statistical techniques may be applied to the plurality of second vectors without limitation.

In operation 1330, the 3D sketching apparatus determines a motion range of the first part and a second part of the object as a reference when the first part moves along the trajectory. The 3D sketching apparatus determines a part selected by the tap and hold input from the user from among the parts included in the object as the second part, and selects a part selected by the user by tapping and holding the first part through the tap and drag input by the user while the tap and hold is maintained. The range of motion can be determined. The expected movement of the first part may be visualized and provided to the user by the tap and drag input from the user. The second part may be set as a parent part of the first part, and the first part may be set as a child part of the second part.

In operation 1340 , the 3D sketching apparatus generates a joint connecting the first part and the second part based on the position of the first part, the position of the second part, the trajectory of the first part, and the range of motion. . The 3D sketching apparatus may generate a joint that enables the first part to move along a trajectory and a range of motion when the position of the second part, which is a basis for movement of the first part, is considered.

In one embodiment, the 3D sketching apparatus determines a reference part as a reference for movement from among a plurality of parts of an object, activates a joint connecting the reference part and child parts of the reference part, You can move child parts by tapping and dragging.

In an embodiment, the 3D sketching apparatus may set some sketch lines selected by a user from among sketch lines expressing an object as one part.

In one embodiment, the 3D sketching apparatus generates a reference plane including one or more points inputted from a user in a 3D virtual space, or a reference sphere including two points inputted from a user, and A sketch line for expressing an object can be created by projecting the input drag onto a reference plane or reference sphere.

In addition, the user can save the pose created by moving the object and return to the pose at any time. The saved poses can be viewed from the camera point of view. In addition, as the sketch lines of the object are modified, the appearance in the pose may be synchronized in real time. In other words, modifications applied to one pose can be applied equally to other saved poses. This allows the user to significantly improve work efficiency by checking the modifications made to one pose in several other poses.

14 is a diagram illustrating a three-dimensional sketching apparatus according to an exemplary embodiment.

Referring to FIG. 14 , a 3D sketching apparatus 1400 according to an embodiment includes a memory 1410 and a processor 1420 . The memory 1410 and the processor 1420 may communicate with each other through a bus 1330 .

The memory 1410 may include computer-readable instructions. The processor 1420 may perform the aforementioned operations as an instruction stored in the memory 1410 is executed in the processor 1420 . The memory 1410 may be a volatile memory or a non-volatile memory.

The processor 1420 is a device that executes instructions or programs, or controls the 3D sketching device 1400, and may include, for example, a central processing unit (CPU), a graphic processing unit (GPU), and the like. have. The 3D sketching apparatus 1400 may perform at least one of the aforementioned sketching operation, parting operation, rigging operation, and posing operation.

The sensor 1430 is a device capable of detecting the movement of the user's body, and may include, for example, an infrared sensor, a depth sensor, an image sensor, a tracking sensor, a body tracking sensor, and the like. For example, the sensor 1430 may detect the position and shape of the hand.

The display 1440 may display a process performed by the processor 1420 . For example, the display 1440 may include a tablet-type display, a head-mounted display, a display applied to smart glasses, a display of a smartphone, and the like.

In addition, the above-described operation may be processed with respect to the 3D sketching apparatus 1400 .

The embodiments described above may be implemented by a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the apparatus, methods and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate (FPGA). array), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

The components described in the embodiments are one or more of a digital signal processor (DSP), a processor, a controller, an application specific integrated circuit (ASIC), a programmable logic device such as a field programmable gate array (FPGA). Logic Element), other electronic devices, and hardware components including one or more of combinations thereof. At least some of the functions or processes described in the embodiments may be implemented by software, and the software may be recorded on a recording medium. Components, functions and processes described in the embodiments may be implemented by a combination of hardware and software.

As described above, although the embodiments have been described with reference to the limited drawings, those skilled in the art may apply various technical modifications and variations based on the above. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Claims (20)

generating a reference object based on points selected by a user in a three-dimensional virtual space including an object represented by sketch lines;
determining a trajectory of a first part to be moved in the object based on the reference object;
determining a movement range of the first part and a second part of the object as a reference when the first part moves along the trajectory;
generating a joint connecting the first part and the second part based on the position of the first part, the position of the second part, and the trajectory and movement range of the first part
containing
3D sketching method.
According to claim 1,
The step of creating the reference object is
Using any one of the points selected by the user as the center point of the sphere, and determining a sphere including the other on the surface as the reference object,
3D sketching method.
According to claim 1,
The points selected by the user are
a first point tapped first and a second point lifted last in the tap-and-drag input from the user;
the second point is located on a sketch line representing the first part,
3D sketching method.
According to claim 1,
The step of determining the trajectory of the first part
determining the trajectory on the reference object based on a third point first tapped in the tap and drag input from the user and a drag direction,
The third point is located on a sketch line representing the first part,
3D sketching method.
According to claim 1,
The step of determining the trajectory of the first part
A plurality of first vectors linking two reference points are generated among a plurality of reference points determined by the tap app drag input from the user, and a cross product between two vectors among the plurality of first vectors is calculated to obtain a plurality of second vectors. determining two vectors, determining a rotation axis vector of the trajectory based on the plurality of second vectors, and determining the trajectory based on the rotation axis vector and a drag direction of the tap and drag,
3D sketching method.
According to claim 1,
The step of determining the motion range of the first part and the second part of the object comprises:
A part selected by the tap and hold input from the user from among the parts included in the object is determined as a second part, and the first part is selected by the tap and drag input from the user while the tap and hold is maintained. to determine the range of motion,
3D sketching method.
7. The method of claim 6,
The expected movement of the first part is visualized by the tap and drag input from the user and provided to the user.
3D sketching method.
According to claim 1,
The second part is set as a parent part of the first part,
The first part is set as a child part of the second part,
3D sketching method.
According to claim 1,
The step of creating the joint is
creating a joint that allows the first part to move in the trajectory and range of motion given the position of the second part on which the movement of the first part is based.
3D sketching method.
According to claim 1,
determining a reference part as a reference for movement from among a plurality of parts of the object; and
activating a joint connecting the reference part and a child part of the reference part, and moving the child part by a tap and drag input from the user;
further comprising,
3D sketching method.
According to claim 1,
determining a reference part as a reference for movement from among a plurality of parts of the object;
determining any one moving part between the reference part and the distal part of the plurality of parts; and
activating one or more joints between the reference part and the moving part to move the moving part with a mid-air pinch gesture input from the user;
further comprising,
3D sketching method.
According to claim 1,
setting some sketch lines selected by the user from among the sketch lines expressing the object as one part
further comprising
3D sketching method.
13. The method of claim 12,
The step of setting some of the sketch lines as one part is
Selecting sketch lines overlapping with the user's drag input to a display on which the sketch lines are displayed, removing any one sketch line or a part of the sketch line from among the selected sketch lines, and setting a part with the remaining sketch lines,
3D sketching method.
According to claim 1,
generating a reference plane including one or more points input by the user in the three-dimensional virtual space, or a reference sphere including two points input by the user; and
generating a sketch line for expressing the object by projecting the drag input from the user on the reference plane or the reference sphere
further comprising
3D sketching method.
processor; and
a memory including at least one instruction executable by the processor
including,
When the at least one instruction is executed by the processor, the processor generates a reference object based on points selected by a user in a three-dimensional virtual space including an object represented by sketch lines, and generates a reference object to move in the object. determining a trajectory of one part based on the reference object, determining a movement range of the first part and determining a second part of the object as a reference when the first part moves along the trajectory, wherein the first part generating a joint connecting the first part and the second part based on the position of the second part, the trajectory and the movement range of the first part,
3D sketching device.
16. The method of claim 15,
the processor
Using any one of the points selected by the user as the center point of the sphere, and determining a sphere including the other on the surface as the reference object,
3D sketching device.
16. The method of claim 15,
The points selected by the user are
a first point tapped first and a second point lifted last in the tap-and-drag input from the user;
the second point is located on a sketch line representing the first part,
3D sketching device.
16. The method of claim 15,
the processor
determining the trajectory on the reference object based on a third point first tapped in the tap and drag input from the user and a drag direction,
The third point is located on a sketch line representing the first part,
3D sketching device.
16. The method of claim 15,
the processor
A part selected by the tap and hold input from the user from among the parts included in the object is determined as a second part, and the first part is selected by the tap and drag input from the user while the tap and hold is maintained. to determine the range of motion,
3D sketching device.
20. The method of claim 19,
The expected movement of the first part is visualized by the tap and drag input from the user and provided to the user.
3D sketching device.

Images