KR102087842B1 - System for a run-time field item changing using a real-time scanning - Google Patents

Abstract

The present invention relates to a system and method for replacing field items at runtime based on real-time scanning.
The real-time scanning-based runtime field item change system according to an embodiment of the present invention uses a scanning information received from a scanning performing unit to acquire an image of a real object to store a memory and a program in which a program for changing a field item at runtime is stored. Including a processor to be executed, the processor is characterized in that to define the object information and object functions of the virtual object corresponding to the real object, and to change the field item by mapping the object information and object functions to resource and action related information.

Description

Real-time scanning-based runtime field item change system {SYSTEM FOR A RUN-TIME FIELD ITEM CHANGING USING A REAL-TIME SCANNING}

The present invention relates to a system for replacing field items at runtime based on real-time scanning.

Due to the development of 3D scanning technology, a user can easily generate a 3D model in real time, and the generated 3D model can be applied to an application program.

However, according to the prior art, in order to apply the generated 3D model to an application program, reprogramming and compilation are required, and thus there is a problem that it is difficult to apply it while the game is running.

The present invention has been proposed to solve the above-mentioned problems, by replacing field items used in an application service such as a game or VR in real time at runtime, scanning an object using an external device during execution of the application service, and The aim is to provide a system that can be inserted into the user's application service at runtime or replace existing content.

The real-time scanning-based runtime field item change system according to an embodiment of the present invention uses a scanning information received from a scanning performing unit to acquire an image of a real object, and stores a memory and a program storing a program that changes a field item at runtime. Including a processor to execute, the processor is characterized in that the object information and object function of the virtual object corresponding to the real object is defined, and the object information and object function are mapped to resource and operation related information to change the field item.

The real-time scanning-based runtime field item change system according to an embodiment of the present invention scans a user in all applications using 3D objects such as AR (virtual reality), VR (augmented reality), and MR (mixed reality), which are recent issues. By providing a service that inserts an object at runtime, it is possible to support a personalized service that allows a user to use a model of his or her own preferences, and to secure a differentiated application service.

The effects of the present invention are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a diagram showing an application example of a 3D model according to the prior art.
2 and 3 are views showing a real-time scanning-based runtime field item change system according to an embodiment of the present invention.
4 is a diagram illustrating a template-based data structure for changing a runtime field item according to an embodiment of the present invention.

The above-mentioned objects and other objects, advantages and features of the present invention and methods for achieving them will be clarified with reference to the embodiments described below in detail together with the accompanying drawings.

However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the following embodiments are intended for those skilled in the art to which the present invention pertains. It is merely provided to easily inform the configuration and effect, the scope of the present invention is defined by the description of the claims.

Meanwhile, the terms used in the present specification are for explaining the embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein, "comprises" and / or "comprising" refers to the components, steps, operations and / or elements in which one or more other components, steps, operations and / or elements are present. Or added.

Hereinafter, in order to help those skilled in the art to understand, the background proposed by the present invention will be described first, and embodiments of the present invention will be described.

1 is a diagram showing an application example of a 3D model according to the prior art.

Referring to FIG. 1, in a game of breaking a brick using the user's own smartphone 10, the user wants to change the ball 11 for breaking a brick to an apple 30 located around him.

To this end, the user should be able to scan the physical object, the apple 30, using the scanner 20 to generate a 3D model and insert it into his brick breaking game at runtime.

However, according to the prior art, it is necessary to link the 3D model generated by scanning the apple 30 to the brick breaking game, and then reprogramming and compiling to make the game.

Therefore, there is a problem in that the field item cannot be changed by a runtime method that supports other tasks while the game is running without terminating the game.

The present invention is proposed to solve the above-mentioned problems, proposes a structured structure of game content for changing field items (graphic resources used in games such as apples) at runtime, and converting the size of the scanned data, We propose a system capable of inserting 3D objectified real objects into real-time games, VR, and other application services at runtime through post-processing such as color matching.

According to the present invention, while a user performs an application service such as a game or VR, an object is scanned using an external device (for example, a 3D scanner) and inserted into the application service at runtime, or existing content is Since it is possible to replace, the user can get more fun by incorporating the objects around him into the world in the application service.

In addition, operators can provide differentiated services in games such as Daejeon.

For example, in a fighting game such as a car racing, the banana peel scanned by the user is reflected in the game in real time, and the throwing of the opponent to the opponent can induce the opponent's slippage, and this fun factor stimulates the user's interest. have.

Hereinafter, embodiments of the present invention will be described with reference to FIGS. 2 to 4.

2 is a view showing a real-time scanning-based runtime field item change system according to an embodiment of the present invention.

In the real-time scanning-based runtime field item change system according to an embodiment of the present invention, a program for changing a field item at runtime is stored using scanning information received from the scanning performing unit 200 that acquires an image of a real object. It includes a memory 350 and a processor 340 for executing a program, the processor 340 defines object information and object functions of a virtual object corresponding to a real object, and resource and operation related information of object information and object functions. To map to change the field item.

The scanning execution unit 200 according to an embodiment of the present invention is a tango phone or any device having a 3D capture function, and performs 3D capture on a real object that a user intends to use as an item.

The processor 340 according to an embodiment of the present invention parameterizes lighting information when the image is acquired by the scanning execution unit 200 and changes the color texture of the virtual object model using the extracted parameters. When scanning by the scanning performing unit 200 according to an embodiment of the present invention, that is, when obtaining a 3D object, the lighting environment and the lighting environment of the actual application service do not match, so that the color of the virtual object model is changed.

The processor 340 according to an embodiment of the present invention performs post-processing on an image acquired by the scanning execution unit 200 to change the number of mesh faces and optimize the game environment.

The processor 340 according to an embodiment of the present invention stores the information of the virtual object model in the database 310 in association with the information of the member who executed the scanning, and requests the scanning of a real object by a user, when, and by which user Information about whether it was done is managed.

The processor 340 according to an embodiment of the present invention inputs the information of the virtual object to the database 310 through CNN-based supervised learning by using the image acquired for the virtual object or the real object.

The post-processed virtual object model is input to the content DB of the database 310, and information and object functions of the virtual object are input to the metadata DB.

The processor 340 according to an embodiment of the present invention maps an object function to motion-related information by referring to a preset effect applicable in an application for a virtual object scanned and uploaded in real time. This will be described later in detail with reference to FIG. 4.

When using a field item to which a virtual object is applied, the processor 340 according to an embodiment of the present invention applies mapped action-related information to the object where the item is used.

3 is a view showing a real-time scanning-based runtime field item change system according to an embodiment of the present invention. Hereinafter, it will be described on the assumption that the application service to which the embodiment of the present invention is applied is a game between a plurality of users.

Users 400a and 400b sign up as members through the member management unit 330 of the content management server 300 and start application services (games).

Users 400a and 400b may be users at remote locations, or users at the same location.

For example, User 1 (400a) may be in Daejeon, User 2 (400b) may be in Seoul, and the same runtime field item change service is provided through the content management server (300).

It is assumed that the user 1 400a is playing a game of competition (eg, a car race) with the user 2 400b.

User 1 400a scans the real banana peel 110 around him before or during the game.

At this time, the devices used as the scanning performing unit 200 are various, for example, a tango phone that is recently popularized or any device having a 3D capture function may be used.

The captured 3D object 120 is edited through a post-processor, and the number of mesh faces of the 3D object 120 can be changed to optimize the game environment, and color matching is performed.

According to an embodiment of the present invention, since the lighting environment when acquiring a 3D object by the scanning performing unit 200 is different from the lighting environment of a real game, the color of the 3D object is changed.

At this time, color temperature matching and brightness matching can be performed, and the lighting information used when creating a 3D object is parameterized, and the color texture of the 3D model is changed using the extracted parameters.

The post-processed 3D model is input to the content DB among the databases 310 of the content management server 300.

At this time, information of the 3D object generated through the artificial intelligence engine 320 (eg, object information = banana, object function = sliding) is generated and input to the metadata DB in the database 310.

In this case, the artificial intelligence engine 320 may use existing CNN (Convolutional Neural Networks) based supervised learning.

According to an embodiment of the present invention, the generated 3D model 120 may also be performed, a real 2D photograph taken with the real 110 may be used, and the depth of the layer is appropriately adjusted for real-time processing.

When a banana is input as described above as a real object, the sliding property of the banana is defined. In addition, if the input model is a balloon, a popping characteristic is defined. That is, defining object information and functions of the generated 3D object, and defining a game operation by the object are appropriately performed for each application service.

VR or game users scan their surrounding objects 110 before or during the game, and the scanned 3D objects 120 and original 2D images are inserted into the content DB and metadata DB.

The user presses any button on the user terminal during the game to load the model scanned by the user himself.

 At this time, the virtual object model is linked with member management information, and information about who, when, and what was scanned is managed.

As described above, when the user 1 400a scans and uploads the banana 110 during the car racing game, the content management server 300 uses the artificial intelligence engine 320 in the scanned model to “banana”. The information is extracted, and the banana is registered in the metadata DB of the database 310 that it has the capability of "sliding."

By the above-described process, user 1 (400a) loads a virtual object (120) related to a banana at any point he wants, throws it to a character of user (400b), and the application service of user (400b) is Knowing that the thrown object is a banana and has a sliding function, it causes the character (car) of user 2 (400b) to slide.

4 is a diagram illustrating a template-based data structure for changing a runtime field item according to an embodiment of the present invention, and proposes a template transformation configuration for changing a virtual object model (3D model) scanned by a user at runtime.

4, the game application service is composed of a game program 500 and other resources 510.

The game developer initially creates a game with the structure shown in FIG. 4 according to his scenario.

4, there are n basic game resources (511a to 511n, a.obj to n.obj), and m game resources that can be added in real time by a user (512a to 512m, a_rep.obj to m_rep.obj).

That is, according to the template-based data structure, the user secures m spaces to be scanned and uploaded in real time.

If the object is additionally scanned even though all the reserved space is used up, it is possible to delete the previous resource in consideration of the frequency of use and the like.

Each game resource 511, 512 holds game operation related information 513, 514 that defines the operation of each resource, which may be a code level, a shader, or graphic data.

In the case of the resources 512a to 512m changeable by the user, since it does not know what kind of operation, a plurality of special effects that can be supported in the corresponding game are specified in advance.

The game operation related information 514a to 514x and 515a to 515x in FIG. 4 are mapping of x operation information to a game resource a_rep.obj changeable by a user.

For example, a1_rep.fun can be defined as sliding, a2_rep.fun disappearing, and ax_rep.fun exploding.

This information is predefined differently according to the application service, and information provided by extracting information related to the AI engine 320 of FIG. 3 is activated.

In some cases, a plurality of game motion related information may be mapped to one item, and two game motion related information such as slip and explosion may be mapped to, for example, a banana.

The program compiled with a predetermined name will always perform the corresponding function, and the initial game resources 512a to 512m, game operation related information 514 and 515 are set to a null value.

When a user scans a banana, the scanned banana is renamed and saved as game resource a_reo.obj (512a), and information of slip is inserted into a1_rep.fun (514a), so that the character of the opponent attacked by the banana (car ) Is slipped.

In addition, when the user scans and registers the apple for the second time, the scanned apple is renamed as b.obj and stored, and may be stored as information about the game action as explosion.

Through the above-described structure, it is possible to change the runtime field item to the user, and the virtual object model (3D model) that the user scans and registers is mapped to pre-stored motion-related information.

If the AI engine 320 of FIG. 3 fails to extract accurate information about the scanned object, the initial value is set to null, and at this time, the initial value is determined by the game creator.

When the game resource 512 is determined as the initial value, the game operation related resource catalogs 514 and 515 are also set as the initial value.

So far, we have focused on the embodiments of the present invention. Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered in terms of explanation, not limitation. The scope of the present invention is shown in the appended claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

10: smartphone 11: ball
12: Button 20: Scanner
30: apple 110: real object
120: virtual object 200: scanning execution unit
300: content management server 310: database
320: AI engine 330: member management department
340: processor 350: memory
400: user 500: game program
510: Resources 511, 512: Game Resources
513, 514: Information about game movement

Claims (8)

A memory in which a program for changing a field item at runtime is stored using scanning information received from a scanning performing unit that acquires an image of a real object; And
It includes a processor for executing the program,
The processor defines object information and object function of the virtual object corresponding to the real object, and changes the field item by mapping the object information and object function to resource and operation related information,
The resource includes a basic resource and a resource that can be added in real time. For the resource that can be added in real time, the characteristics of the virtual object are defined by an artificial intelligence engine to map the motion-related information or to support special effects. Designated as motion-related information,
The processor parameterizes lighting environment information when acquiring an image of the scanning unit and changes color temperature and brightness by changing the color texture of the virtual object using the extracted parameters.
Real-time scanning based runtime field item change system, characterized by.
According to claim 1,
The scanning unit performs 3D capture of the real object
Real-time scanning based runtime field item change system.
delete According to claim 1,
The processor performs post-processing on the image obtained by the scanning execution unit to change the number of mesh faces
Real-time scanning based runtime field item change system.
According to claim 1,
The processor stores information in the virtual object in a DB in association with information of the member who executed the scanning.
Real-time scanning based runtime field item change system.
According to claim 1,
The processor inputs the information of the virtual object into the DB through CNN-based supervised learning by using the virtual object or the image acquired for the real object.
Real-time scanning based runtime field item change system.
According to claim 1,
The processor maps the object function to the motion-related information with reference to a preset effect applicable in an application to the virtual object scanned and uploaded in real time.
Real-time scanning based runtime field item change system.
The method of claim 7,
When using the field item to which the virtual object is applied, the processor applies the action-related information to the object where the item is used.
Real-time scanning based runtime field item change system.

Images