KR20110011362A - System and method for extracting grasping pattern of virtual object - Google Patents

Abstract

PURPOSE: A system and a method for extracting a grasping pattern of a virtual object are provided to supply a grasping pattern about all virtual objects without setting a grasping pattern. CONSTITUTION: A database(110) stores a plurality of demonstration objects and a grasping pattern. An object distinguishing unit(120) receives a virtual object. The object distinguishing unit distinguishes a demonstration object corresponding to the virtual object. A grasping pattern extracting unit(130) extracts a grasping pattern of a demonstration object corresponding to the virtual object from the database.

Description

System and method for gripping pattern extraction of virtual objects {SYSTEM AND METHOD FOR EXTRACTING GRASPING PATTERN OF VIRTUAL OBJECT}

One embodiment of the present invention relates to a technique for extracting a gripping pattern for a virtual object in the virtual reality, to extract the gripping pattern to apply to the virtual object using a few demo objects and the gripping pattern for the demo object System and method.

Recently, various technologies using virtual reality have emerged. In particular, when a user grabs and manipulates or moves various virtual object manipulation devices capable of detecting contact and movement in reality, the virtual objects existing in the virtual reality are manipulated or moved together with the virtual object manipulation device to give the user a sense of reality. Technology has been developed to allow more precise and precise manipulation.

In this case, the technology sets a grasping pattern, which is information about shapes in which a user's hand can touch the virtual object, and sets a virtual object manipulation device according to the grasping pattern. The virtual object may be manipulated in response to an operation of the operation device.

However, since the types of virtual objects created in the virtual world vary more than the types of objects existing in the real life, it is difficult to set a grip pattern for every virtual object used in the virtual world.

In addition, when there are a plurality of virtual objects having similar shapes and manipulations as a whole but different parts of detailed shapes, the same holding pattern is duplicated and stored, which causes waste of storage resources.

Therefore, there is a need for a method for more efficiently setting and storing a grip pattern of a virtual object.

According to an embodiment of the present invention, a gripping pattern extraction system of a virtual object includes a database storing a plurality of demonstration objects and grasping patterns; An object determining unit configured to receive a virtual object and determine a demo object corresponding to the virtual object among the demo objects; And a gripping pattern extracting unit extracting a gripping pattern of a demo object corresponding to the virtual object in the database.

According to an aspect of the present invention, the database may classify and store the gripping pattern based on a feature of the demo object and a gripping method set according to the operation of the virtual object.

According to an aspect of the present disclosure, the feature of the demo object may include a shape of the demo object, a size of the demo object, and physical characteristics of the virtual object corresponding to the demo object.

According to an aspect of the present disclosure, the object determining unit may search for at least one demo object having a form similar to the virtual object among the demo objects, and convert the demo object having a size similar to the virtual object among the found demo objects to the virtual object. This can be determined by the demo object corresponding to the object.

According to an aspect of the present invention, the gripping pattern extractor may extract a gripping pattern of a demo object corresponding to the virtual object from the database by using a gripping area and a location of the gripping method virtual object.

According to an aspect of the present invention, the gripping pattern extractor may extract a gripping pattern of a demo object corresponding to the virtual object from the database using the physical characteristics of the virtual object.

According to an embodiment of the present invention, a method of extracting a phage pattern of a virtual object includes maintaining a database including a plurality of demo objects and a phage pattern; Receiving a virtual object; Determining a demo object corresponding to the virtual object among the demo objects; And extracting a gripping pattern of a demo object corresponding to the virtual object from the database.

According to an embodiment of the present invention, a few demo objects and a phage pattern for a demo object are stored in a database, and when a virtual object is selected, a phage pattern for the similar demo object is extracted by determining a demo object similar to the virtual object. By applying to a virtual object, it is possible to provide a grip pattern for all virtual objects without setting a grip pattern for all virtual objects.

According to an embodiment of the present invention, by holding and holding the gripping pattern for the demo object according to the physical characteristics or gripping method and the external characteristics of the virtual object, the gripping pattern of the virtual object having a similar shape and other uses or characteristics only Can provide differentiation.

Hereinafter, with reference to the contents described in the accompanying drawings will be described in detail an embodiment according to the present invention. However, the present invention is not limited to or limited by the embodiments. Like reference numerals in the drawings denote like elements.

1 is a block diagram showing the overall configuration of a gripping pattern extraction system of a virtual object according to an embodiment of the present invention.

Referring to FIG. 1, the gripping pattern extraction system of a virtual object may include a database 110, an object determining unit 120, and a gripping pattern extraction unit 130.

The gripping pattern extraction system of the virtual object replaces the virtual object with a demo object whose overall shape and operation method is similar to the virtual object, and sets a grasping pattern for each demo object to prevent the same phage pattern from being duplicated. With a few phage patterns set, you can use phage patterns for multiple virtual objects.

For example, the gripping pattern extraction system of the virtual object may set the gripping pattern by replacing the cup 210 with the handle with a demonstration object 220 formed by a combination of a cylinder and a cuboid as shown in FIG. 2. At this time, the cup 210 with the handle is a demo object if the approximate shape is similar to the demo object 220 even when the decoration is added to the handle or the cup or the area or shape of the cup and the shape of the handle are partially modified. Can be replaced. Therefore, the gripping pattern of one demo object 220 may be used as the gripping pattern for the cups 210 having different handles.

The database 110 may store a plurality of demo objects and gripping patterns.

At this time, the demo object stored in the database 110 is a basic primitive model 310 and a primitive primitive composed of a cube 311, a cylinder 312, a cone 313, and a sphere 314 as shown in FIG. It may include at least one of the combination model 330 formed of a combination of the deformation model 320 and the basic primitive model 310, the shape of the model 310 is modified. The primitive primitive model is a model that can represent most models only by some transformation or combination with other primitive primitive models. By using the symmetry of the primitive primitive model, the problem of rotational alignment of objects can be reduced.

In one example, the deformed model 320 includes a rectangular parallelepiped 321 having one side length of the cube 311, a pyramidal pillar 322 having an increased width of one side of the cylinder 312, and rugby having both sides of the sphere 314. The ball shape 324 may be included, and the combination model 330 may include a drill shape 331 that combines a cylinder 312 and a cone 313, and a cup shape 332 that combines a pyramidal column 322 and a cuboid 321. ) May be included.

There are two main factors that influence the phage pattern.

First, the gripping pattern may vary according to the characteristics of the demo object.

Demo object features include shape and size, which determine the appearance of the demo object, and weight, texture, and temperature that determine the physical characteristics of the demo object. Can be.

For example, a sphere with a small radius is often caught using thumb and cognition, but a sphere with a radius of more than a certain size can be caught with both hands. You can hold all your fingers wide. In addition, depending on the physical characteristics, heavy objects can be gripped in many ways in a stable and possible contact with hands to avoid dropping, and hot objects can be gripped lightly to feel less hot.

The gripping pattern may vary according to the intention to operate the virtual object. For example, there may be a grasp pattern based on power for holding safely and stably, and a grasp pattern based on precision for manipulating the demo object with sophistication and sensitivity. Also, depending on the intention, the grip position may also vary.

Therefore, the database 110 may classify and store the gripping pattern based on the gripping method setting set according to the characteristics of the demo object and the operation of the virtual object. In this case, the gripping method setting may include a setting for an area or a location for gripping the virtual object. The demo object may include the shape and size of the demo object and the physical characteristics of the virtual object corresponding to the demo object.

The classification of the phage pattern stored in the database 110 will be described with reference to the example of FIG. 4.

The shape 410 is a form of a demo object to which a grip pattern corresponds, and a model obtained by modifying or combining the basic primitive model and the basic primitive model may be set. Shape 410, for example, has a basic primitive model, Shape (a), Cube (b), Cone (c), Cylinder (d), and a combination model (a + b ), (a + c) and (a + b + d) can be set.

The size 420 is a size of a demo object to which a grip pattern corresponds, and may be set to 'large', 'medium', or 'small'. In this case, the 'middle' may be set to 20 mm to 80 mm, the size of the agent in the virtual world to hold with one hand.

In addition, the range of sizes may change depending on the virtual world. For example, when dealing with a large object, such as a city model, 'middle' can be set to 5m to 20m, 'large' can be set to more than 20m, 'small' is less than 5m.

The physical fact 430 is a physical characteristic of the virtual object to which the gripping pattern corresponds, and may include at least one of temperature, texture, weight, and humidity. .

At this time, the temperature (temperature) can be set to one of 'hot' is more than 30'C, 'normal' is 10'C to 30'C, and 'cold' is less than 10'C, the texture (texture) is soft, hard It can be set to a sensation that can be felt when actually contacting a virtual object such as, roughness, and sharpness. In addition, the weight can be set to one of 'heavy' of 1000g or more, 'normal' of 100g to 1000g, and 'light' of 100g or less, and the humidity (humidity) of relative humidity of 70% or more, relative It can be set to one of 'normal' with a humidity of 30% to 70%, and 'dry' with a relative humidity of 30% or less.

The physical feature 430 may simplify the configuration of the database by omitting it not to be stored in the database 110 when the physical feature of the virtual object is not special. In addition, when the physical feature 430 is special, the setting of detailed items such as temperature, texture, weight, and humidity may be further subdivided.

For example, in the case of temperature, it is 'very hot' which is 50'C or more, 'slightly hot' which is 30'C to 50'C, 'normal' which is 10'C to 30'C, and -10'C to 10'C. You can add more classifications of settings, such as 'Slightly Cool' and 'Very Cool' which is below -10'C, 'Hot' above 30'C, 'Normal' between 10'C and 30'C, and 10 'Cold' which is less than or equal to 'C' can be further divided into three stages and set in detail.

The gripping method setting 440 may include a force-precision setting and a location setting as an area, or location, for holding the virtual object.

In this case, the force-precision setting is a setting for which the virtual object uses either a power based grip pattern or a precision based grip pattern according to the intention to operate the virtual object. The gripping area can be divided.

Specifically, the force-based grip pattern is a method of palm contact, and the precision-based grip pattern is a method of fingertip contact. Therefore, if the area holding the virtual object is large, it may be a force-based holding pattern. If the area holding the virtual object is narrow, it may be a precision-based compassion pattern.

For example, the force-precision setting can be set to one of force, neutral, and precision, or one of two forces and precision.

In addition, positioning is performed by the upper surface (1), the lower surface (2), the side surface (3a), the side surface (3b), the side surface (3c), the side surface (3d), and the composite surface ((1) + ( 2), (3a) + (3c), ...).

The gripping pattern 450 may be replaced with a demo object having a shape 310 and a size 320 and may store a gripping pattern of a virtual object having a physical feature 330 and a gripping method setting 440. .

The object determining unit 120 may receive a virtual object from a user and determine a demo object corresponding to the input virtual object from among the demo objects stored in the database 110.

In detail, the object determining unit 120 searches for at least one demo object similar to the virtual object received from the demo object in the database 110, and detects the demo object having a size similar to the received virtual object among the searched demo objects. Can be determined by the demo object corresponding to.

In this case, the object discrimination unit 120 uses a normalization process for translation, scale, and rotation, and a shape-invariant property according to transformation to form a relationship between the virtual object and the demo object. You can check the similarity of the form,

For example, the object discrimination unit 120 is similar to the virtual object input from the demo object in the database 110 using the 'Rotation Invariant Spherical Harmonic Representation' method by M. Kazhdan or the 'Superquadrics Representation' method by A. Jaklic. At least one demo object may be retrieved.

In addition, the object determination unit 120 configures a mapping between the retrieved demo object and the vertex set on the surface of the virtual object, checks the reference point using an optimization algorithm, and detects the reference object based on the reference point. You can adjust the size parameter of to determine the similarity between the size of the retrieved demo object and the size of the virtual object.

The grip pattern extractor 130 may extract a grip pattern of a demo object corresponding to the virtual object input to the object determiner 120 from the database 120.

In detail, the grip pattern extractor 130 receives a detection signal indicating how the user grasps the virtual object manipulation device from the virtual object manipulation device, checks the area and position of the gripped object for the virtual object in the detection signal, The physical characteristics of the virtual object input to the determination unit 120 are checked, the area and the position held by the virtual object, the demo object determined by the object determination unit 120, and input to the object determination unit 120. A gripping pattern that matches all physical characteristics of the virtual object may be searched for and extracted from the database 110.

In this case, the sensing signal may include information about a location and an area where the user contacts the virtual object manipulation apparatus.

In addition, since the property of the virtual object that is easy to obtain in the virtual world includes physical properties such as weight, grain, temperature, and humidity, the gripping pattern extractor 130 uses the property information of the virtual object to obtain physical properties of the virtual object. can confirm.

5 is a flowchart illustrating an entire process of a gripping pattern extraction method according to an embodiment of the present invention.

In operation S510, the object determining unit 120 may receive a virtual object selected by the user from the virtual object manipulation apparatus.

In operation S520, the object determining unit 120 may determine a similarity between the virtual object input in operation S510 and the demo object stored in the database 110, thereby resembling the virtual object input in operation S510. You can search for demo objects of this type.

In operation S530, the object determining unit 120 may determine a size similarity between the demo object retrieved in operation S520 and the virtual object input in operation S510.

For example, the object determining unit 120 configures a mapping between vertex sets on the surface of the virtual object input in step S520 and the virtual object input in step S510 and uses an optimization algorithm. The reference point is checked, and the size of the demo object retrieved in step S520 may be determined by adjusting the size parameter of the demo object retrieved in step S520 based on the reference point.

In operation S540, the object determination unit 120 may determine a demo object having a high size similarity to the virtual object input in operation S510 in operation S520 as a demonstration object corresponding to the virtual object.

In operation S550, the gripping pattern extractor 130 may acquire attribute information of the virtual object input in operation S510 and identify physical properties of the virtual object input in operation S510 from the attribute information. .

In operation S560, the gripping pattern extractor 130 may receive a detection signal including information about a location and an area where the user contacts the virtual object manipulation apparatus from the virtual object manipulation apparatus.

In operation S570, the gripping pattern extractor 130 may input the information input in operation S510 using information about an area of the user's contact with the virtual object manipulation apparatus included in the detection signal received in operation S560. You can see where the virtual object corresponds in the force-precision setting.

In detail, the gripping pattern extractor 130 determines that the virtual object input in step S510 is set to force in the force-precision setting when the area where the user contacts the virtual object manipulation apparatus is equal to or greater than a predetermined value, and the user determines the virtual object. If the area in contact with the operation device is less than a certain level, it is determined that the virtual object input in step S510 is set to precision in the force-precision setting. If the area in contact with the virtual object operation device is a predetermined value, step S510. It can be determined that the virtual object input in is set to neutral in the force-precision setting.

In operation S580, the grip pattern extractor 130 may extract a grip pattern of a demo object corresponding to the virtual object input to the object determiner 120 from the database 120.

In more detail, the gripping pattern extractor 130 may include a shape and a size of the demo object determined in operation S540, physical characteristics of the virtual object identified in operation S550, and a user included in the detection signal received in operation S560. May search for and extract from the database 110 a gripping pattern in which both the contact point with the virtual object manipulation device and the force-precision setting identified in step S570 match.

When the gripping pattern is extracted through the steps S510 to S580, the virtual manipulation apparatus may naturally operate by reflecting the user's manipulation to the virtual object using the extracted gripping pattern.

Parts not described in FIG. 5 may refer to descriptions of FIGS. 1 to 4.

According to an embodiment of the present invention, the phage pattern extraction system of a virtual object stores a few demo objects and a phage pattern for the demo object in a database, and if a virtual object is selected, a demo object similar to the virtual object is determined to determine the similarity. By extracting a phage pattern for a demo object and applying it to a virtual object, a phage pattern for all virtual objects can be provided without setting a phage pattern for all virtual objects.

In addition, the gripping pattern extraction system of the virtual object classifies and stores the gripping pattern for the demo object according to the physical characteristics, the gripping method, and the external characteristics of the virtual object, so that the gripping of the virtual object having similar shapes and other uses or characteristics is possible. Different patterns can be provided.

In addition, the gripping pattern extraction method according to an embodiment of the present invention includes a computer readable medium including program instructions for performing operations implemented by various computers. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The media may be program instructions that are specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware systems specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. The medium may be a transmission medium for transmitting a signal specifying a program command, a data structure, or the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

Although one embodiment of the present invention as described above has been described by a limited embodiment and drawings, one embodiment of the present invention is not limited to the above-described embodiment, which is a general knowledge in the field of the present invention Those having a variety of modifications and variations are possible from these descriptions. Accordingly, one embodiment of the invention should be understood only by the claims set forth below, all equivalent or equivalent modifications will be within the scope of the invention idea.

1 is a block diagram showing the overall configuration of a gripping pattern extraction system of a virtual object according to an embodiment of the present invention.

2 is an example of a process of replacing a virtual object with a demo object according to an embodiment of the present invention.

3 is an example of a demo object stored in a database according to an embodiment of the present invention.

4 is an example of a phage pattern classified according to an embodiment of the present invention and stored in a database.

5 is a flowchart illustrating an entire process of a gripping pattern extraction method according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

110: database

120: object discrimination unit

130: grip pattern extraction unit

Claims (10)

A database for storing a plurality of demo objects and grasping patterns; An object determining unit configured to receive a virtual object and determine a demo object corresponding to the virtual object among the demo objects; And A grip pattern extracting unit configured to extract a grip pattern of a demo object corresponding to the virtual object from the database Phage pattern extraction system of a virtual object comprising a. The method of claim 1, The database, And classifying and storing the gripping pattern based on a feature of the demo object and a gripping method setting set according to an operation of the virtual object. The method of claim 2, The gripping method setting, Gripping pattern extraction system of the virtual object including a setting for the area, or location for holding the virtual object. The method of claim 2, Features of the demo object, And a shape of the demo object, a size of the demo object, and a physical characteristic of the virtual object corresponding to the demo object. The method of claim 1, Demo object stored in the database, And a combination model formed of a combination of a basic primitive model, a deformation model modified from a shape of the basic primitive model, and the basic primitive model. The method of claim 5, The basic primitive model, A grasping pattern extraction system of a virtual object, characterized in that it comprises a cube, a cylinder, a cone, or a sphere. The method of claim 1, The object determination unit, Search for at least one demo object similar to the virtual object among the demo objects, And a phage pattern extraction system of the virtual object, which determines a demo object having a size similar to the virtual object among the searched demo objects as a demo object corresponding to the virtual object. The method of claim 2, The gripping pattern extraction unit, And a gripping pattern of a demo object corresponding to the virtual object from the database using the gripping method setting. The method of claim 4, wherein The gripping pattern extraction unit, And a gripping pattern extraction system of a virtual object using the physical characteristics of the virtual object to extract a gripping pattern of a demo object corresponding to the virtual object from the database. Maintaining a database including a plurality of demo objects and gripping patterns; Receiving a virtual object; Determining a demo object corresponding to the virtual object among the demo objects; And Extracting a gripping pattern of a demo object corresponding to the virtual object from the database; Gripping pattern extraction method of a virtual object comprising a.

Images