KR20210152828A - A method of creating realistic contents - Google Patents

Abstract

The present invention discloses a method of creating realistic content as realistic content using 2D live to allow characters to tell a story as if they were actually making a video call according to lines and situations. The method includes the steps of: extracting background data; extracting object data; and providing role play. An object of the present invention is to maximize the educational and learning effect for users (especially children).

Description

How to create immersive content {A METHOD OF CREATING REALISTIC CONTENTS}

The present invention relates to a method for producing immersive content, and more specifically, mixed reality (MR) combining augmented reality (AR) and virtual reality (VR) and real objects (real dolls, character models, 2D images, etc.) It relates to a method for producing role-play content using

Virtual reality technology, called VR, which is emerging recently, creates a human-computer interface that makes a specific environment or situation into a computer and makes it as if the person using it is interacting with the actual surrounding environment. say

This virtual reality technology makes people feel like they belong to the environment without directly experiencing the difficult environment they need to experience in their daily life, and can be essential, especially in the fields of education and childcare.

Another emerging technology along with virtual reality technology is augmented reality technology, also called AR, which superimposes virtual objects on the real world the user sees with their eyes.

Mixed Reality (MR) that takes advantage of the advantages of augmented reality in that it can interact with reality by mixing this virtual reality technology and augmented reality technology and the characteristics of virtual reality that it can give a sense of immersion in front of people ) based on avatarization of real objects and interaction with virtual characters to develop skills to maximize various educational and learning effects such as understanding fairy tale contents, acquiring educational contents, acquiring knowledge, and improving social skills by performing role play is presenting

As a prior art related to role play, there is Patent Registration No. 10-1314121 (September 26, 2013) [Role play performance system and role play method using the same] (hereinafter referred to as prior art). , it relates to technology that provides social enhancement through musical activity.

However, the present invention is to increase the educational efficiency of the user by generating a role play having a specific event using mixed reality and real objects and outputting it to the user, which is somewhat far from the present invention.

The present invention provides role-play content using mixed reality (MR) combining augmented reality (AR) and virtual reality (VR) and real objects (real dolls, character models, 2D images, etc.), so that users (especially children ) for the purpose of maximizing the effect of education and learning.

In addition, by recording and reproducing various events that make up role-play content, it is possible to share the production content, that is, the event, with other users, and through this, the provision of role-play content is made into a portal service. The purpose is to enable the formation of

The present system according to the present invention having the above object has a background recognition module for recognizing the real background and extracting background data, a real object recognition module for recognizing real objects and extracting object data, and a real background using the background data Outputs the same virtual background as that of the user device on the screen of the user device, uses the object data to output a virtual object (avatar) identical to the real object on the screen of the user device, and creates a virtual character on the screen of the user device and a role-play content output module that provides a role-play that allows the user to interact with the character by manipulating the avatar by outputting it.

In addition, this method using the system includes (S1) the background recognition module recognizing the real background and extracting the background data, (S2) the real object recognition module recognizing the real object placed on the real background, extracting object data, (S3) the role play content output module outputs a virtual background identical to the real background using the background data on the screen of the user device, and uses the object data to display the avatar Providing the role play that allows the user to interact with the character by manipulating the avatar by outputting it to the screen of the user device, generating the virtual character and outputting it to the screen of the user device, is done

The present invention consisting of the above configuration, steps and features is a role play content using mixed reality (MR) combining augmented reality (AR) and virtual reality (VR) and real objects (real dolls, character models, 2D images, etc.) to maximize the effect of education and learning for users (especially children), as well as record and reproduce various events that make up role play content, so that other users can share the production, that is, the event, This has the effect of forming a shared community among multiple users, such as making the provision of role-play content a portal service.

1 is a block diagram of the present system.
2 is a flow chart of the method.
3 is a first embodiment of the present invention.
4 and 5 are a second embodiment of the present invention.
5 is an example of immersive content produced by using the method for producing immersive content according to an embodiment of the present invention.

1 is a block diagram showing the configuration of the present system S. As shown in FIG.

As shown in Fig. 1, the present system (S) comprises a background recognition module (1), a real object recognition module (2), and a role play content output module (3).

For each configuration, the background recognition module 1 recognizes the real background and extracts background data. In order to convert a real object placed on the real background into an avatar, which is a virtual object, the shape of the real background, the degree of curvature, Background data, which is various information about the real background, such as brightness, illuminance, and color, is extracted.

Next, the real object recognition module 2 is configured to recognize a real object and extract object data. In order to convert a real object disposed on the real background into an avatar, which is a virtual object, the shape, color, and real Object data, which is various information about real objects, such as location in the background, is extracted.

Although the background recognition module 1 and the object recognition module 2 are divided into two according to the functions to be performed, they may be configured as one configuration. Also, the background recognition module 1 and the object recognition module 2 may be implemented by computer vision technology in particular.

Next, the role play content output module 3 outputs the same virtual background as the real background on the screen of the user device by using the background data, and uses the object data to display the same virtual object (avatar) as the real object to the user. By outputting to the screen of the device, creating a virtual character and outputting it to the screen of the user device, the user manipulates the avatar to provide a role play that allows the user to interact with the character.

Here, the avatar is a virtual object representing the user, and is a kind of role-playing character in which the user can directly manipulate and move the real object in the virtual background space.

For the effective implementation of such an avatar, it is desirable that the real object be produced as a model with a high recognition rate, and the background recognition module 1 and the object recognition module 2 require 2D image object recognition technology such as template matching. However, the content related to the improvement of the recognition rate of real objects may be applied and implemented by other known technologies.

Next, the virtual character generated by the role-play content output module 3 is a character that interacts with the avatar, and plays a role similar to a kind of NPC (Non-Player Character) in the game.

In addition, the interaction between the avatar and the character corresponds to a series of actions that the role-play content intends to provide, and the concept of the role-play content is determined by how the interaction between the avatar and the character is structured.

In addition, the manipulation of the avatar may be performed through various input means of the user device, such as a controller, a touch screen, and a button.

Additionally, in the present invention, the user equipment may include an MR background board, an augmented reality device (glasses-type device), a smartphone, and the like, and specifically, the MR background board displays the screen output by the role play content output module 3 in real life. It is a component that is placed all over the real background so that it can be output in the background, and augmented reality devices, especially glasses-type devices, are components that provide a realistically output screen through the MR background board. It is a configuration that allows operation.

For example, in the embodiment of the present invention having the above configuration and characteristics, the real background may be a doll's house, and the real object may be a specific doll disposed in the doll's house, in which case the background recognition module 1 is a doll. Extracts background data related to the color, shape, curve, bend, etc. of the house, and the real object recognition module 2 extracts object data related to the shape, color, and location of a specific doll in the doll's house.

In addition, the same virtual background (doll house) as the doll's house is output on the screen of the user device by the role play content output module 3, and the specific doll is converted into an avatar and output on the screen of the user device. It is manipulated by the device, and a virtual character (eg, a parent of a specific doll, a character in a role play story, etc.) is output on the screen of the user device, and the user manipulates the avatar through the user device to create a virtual role-play content through interaction with the characters of

More specifically, for example, assuming that the role play content is the story of 'Snow White', the real background may be a model of a dwarf's house, the real object may be a Snow White doll, and the virtual character may be seven dwarfs. there will be

As another example, parents place MR background boards all over the dwarf's house model, and children wear glasses to watch the interaction of Snow White and the seven dwarfs (a series of event actions based on the story of Snow White's fairy tale). Parents can manipulate Snow White's behavior while watching the screen on which role-play content is output through a smartphone.

The present invention having such a configuration and characteristics can provide role-play content that maximizes the educational and learning effects for users (especially children).

2 is a process diagram illustrating each step of the method for providing role play content using the present system (S) described above.

As shown in FIG. 2 , the method M includes a background data extraction step S1 , an object data extraction step S2 , and a role play providing step S3 .

For each step, the background data extraction step S1 is a step in which the background recognition module 1 recognizes the real background and extracts the background data.

In addition, the object data extraction step (S2) is a step in which the real object recognition module 2 recognizes the real object disposed on the real background and extracts the object data.

In the next role play providing step (S3), the role play content output module 3 uses the background data to output a virtual background identical to the real background on the screen of the user device, and uses the object data to display the avatar of the user device. It is a step of providing a role play in which the user can interact with the character by manipulating the avatar by outputting the output to the screen, generating a virtual character and outputting it to the screen of the user device.

The present invention consisting of the above steps provides role play content that maximizes the educational and learning effects for users (especially children), and the characteristics and individual effects are the same as those of the system (S) mentioned above.

3 relates to a first embodiment of the present invention.

According to the first embodiment, as shown in Fig. 3, the present system (S) further includes a management server (4) communicating with the role-play content output module (3), wherein the method (M) is to reproduce the event Step (S4) may be further included.

Specifically, the management server 4 receives the recorded data that the role play content output module 3 records, collects, and processes the interaction between the avatar and the character, and stores it in the database, and stores the recorded data in the pre-stored query processing ( It extracts events according to Query Processing) and reproduces the extracted events in a form that can be shared.

In addition, the event reproduction step (S4) is a step in which the role play content output module 3 records the interaction between the object and the character and reproduces the event as an event. The step of collecting recorded data by recording the interaction between the character and the character (S41), the role play content output module 3 chronologically arranging, rendering and modeling the recorded data (S42), chronological arrangement, rendering and modeling A step of receiving the recorded data from the management server 4 and storing it in a database (S43), the step of extracting an event from the stored recorded data by the management server 4 according to pre-stored query processing (S44) and , and the management server 4 reproduces the extracted event in a shareable form (S45).

The present invention according to the first embodiment having the above configuration and features provides a role play (role play) according to the situation through interlocking with various virtual objects (characters), interworking with real objects (avatars), and interworking with background objects (background). When performing, important events during the various interactions that make up role play can be recorded and recreated based on those events.

Through this event reproduction function, the present invention can share the production content, that is, the event with other users, and thus has the effect of forming a shared community among multiple users, such as converting the method (M) into a portal service. have

4 and 5 are views showing a second embodiment of the present invention.

First, as shown in Fig. 4, the present system (S) and the present method (M) control the background recognition module 1, the real object recognition module 2, and the role play content output module 3 through control signals. It is characterized in that it may further include a control module (5) and a signal generation module (100) for generating the control signal from a power source for a DC signal.

There is a possibility that noise may be introduced into the control signal of the control module 5 by various external factors, such as the influence of high frequency, the interference by the strong electric field of the power supply, the influence of the external environment (temperature, humidity, dust, etc.) .

The noise introduced into the control signal may cause an unstable operation of each component (including each module) by rapidly or rapidly decreasing the voltage level of the control signal, which may further cause malfunctions and failures.

In order to solve this problem, the present invention includes a signal generating module 100 that generates a control signal in a clean state excluding the possibility of introducing noise, and detects and removes noise to be introduced into the control signal in advance, and through this, a stable motion control is possible.

The signal generating module 100 of the present invention detects and removes noise through several steps, and finally re-detects whether the control signal contains noise before outputting the control signal.

Hereinafter, the signal generating module 100 according to an embodiment of the present invention will be described in more detail with reference to FIG. 5 attached thereto.

(For convenience of explanation, the names of the device units are not divided below. Therefore, it is preferable to infer through the corresponding circuit in which each device is included or to analyze it separately through reference numerals.)

As shown in FIG. 5 , the signal generating module 100 includes a noise amplifier 110 for amplifying the power for a DC signal, a noise detector 120 for detecting noise included in the power for the amplified signal, and removing the detected noise. a filter unit 130 that drives the filter unit only when noise is detected; A signal output unit 160 is included.

The signal generating module 100 amplifies the power for the DC signal in the noise amplifier 110 to amplify the noise included therein to facilitate detection, and detects the noise included in the power for the signal amplified by the noise detector 120 . In addition, the noise detected by the filter unit 130 is removed, but the noise removal process is performed only when the noise is detected through the filter driving unit 140 to prevent unnecessary power consumption and operation overload, and the signal generation unit 150 A clean control signal is generated from the signal power source from which the noise has been removed, and the signal output unit 160 checks whether the signal is clean and outputs it.

Hereinafter, with reference to FIG. 5, a more detailed description of each component of the signal generating module 100, a description of an operation process, and a description of the effects thereof will be described.

The noise amplifier 110 includes a first amplifier circuit 111 for firstly amplifying the signal power source, and a second amplifier circuit 112 for secondarily amplifying the signal.

The first amplifier circuit 111 and the second amplifier circuit 112 have the same structure, and a distribution resistor R101 connected to the positive terminals of the amplifiers A101 and A102 and the amplifiers A101 and A102, respectively. (R102) (R103) (R104) and capacitors (C101) (C102), feedback resistors (R105) (R106) and capacitors (C105) connected in parallel between the output terminal and the negative terminal of the amplifier (A101) (A102) ) (C106).

When the operation and effects of the first amplifier circuit 111 and the second amplifier circuit 112 are described using the first amplifier circuit 111 as an example, the amplifier A101 includes the distribution resistors R101 (R102) and the feedback resistor ( R106), and operates as a non-inverting amplifier by means of a grounding resistor to amplify the voltage level of the signal power supply, thereby amplifying the noise as well to facilitate the detection of the noise. At this time, the feedback capacitor C105 prevents oscillation of the amplifier A101.

In the second amplifier circuit 112, the signal power is amplified through the same process.

In addition, the noise amplifier 110 is characterized in that the amplifier output terminal of the first amplifier circuit 111 and the amplifier (+) terminal of the second amplifier circuit 112 are connected to each other, and through this, the signal power is supplied to the first amplifier circuit. (111), the output is transmitted to the second amplifying circuit 112 and secondarily amplified, so that the signal power supply is more significantly amplified in a doubly manner to facilitate noise detection.

Next, the noise detection unit 120 includes a comparator 121, an application circuit 122 connected to the (-) terminal of the comparator 121, and a reference circuit 123 connected to the (+) terminal of the comparator 121. is done by

More specifically, the application circuit 122 includes a resistor R201 and a capacitor C201 for removing a DC component, and a resistor R202 for checking noise, which are arranged in series with each other.

In addition, the reference circuit 123 includes bias resistors R203, R204, and R205 arranged in parallel to provide a reference voltage for noise determination.

When explaining the operation and effects of the noise detection unit 120 having the above configuration and characteristics, the applying circuit 122 applies the power for the signal amplified by the noise amplifying unit 110 to a direct current through the resistor R201 and the capacitor C201. Removes the component and leaves only the noise component. After that, a noise component is applied to the resistor R202.

After that, the reference circuit generates a reference voltage by the bias resistors R203, R204, and R205, and the comparator 121 compares the reference voltage with the noise voltage applied to the resistor R202 to detect whether noise is generated. When noise is detected, a driving signal is transmitted to the filter driving unit 140 to drive the filter unit 130 to remove noise included in the signal power source, and when noise is not detected, a non-driving signal is transmitted to the filter driving unit 140 or Alternatively, since the signal is not transmitted, the filter unit 130 is not driven, and the signal power is directly transferred to the signal generator. may vary depending on

(The specific circuit configuration of the filter driving unit 140 is already well known, so even if a detailed description thereof is omitted, it will not be difficult for a person skilled in the art to practice.)

Additionally, as shown in FIG. 5 , the noise detecting unit 120 preferably further includes a delay circuit 124 for delaying a signal transmitted to a relay.

The delay circuit 124 includes a reverse diode D201 and a resistor R206 arranged in parallel with each other, and a capacitor C202 connected in parallel thereto.

Through the provision of the delay circuit 124, the lifespan of the filter driving unit 140 can be extended. In general, since noise is generated intermittently rather than continuously or periodically, the filter driving unit 140 performs driving and non-driving. Since the lifespan decreases while repeating, it is preferable to provide a delay circuit 124 to continuously drive the filter driving unit 140 until a predetermined time has elapsed after the operation of the filter driving unit 140 to extend the lifespan.

[0080] Next, the filter unit 130 includes first to third filtering circuits 131, 132, 133 to which the respective output terminals and input terminals are sequentially connected.

The first filtering circuit 131 includes npn-type first and second transistors Q301 and Q302 in which emitters and collectors are connected to each other, and the bases of the first and second transistors Q301 and Q302 Switching diodes D301 and D302 and capacitors C301 and C302 are respectively connected in parallel to each other, and between the base of the first transistor Q301 and the base of the second transistor Q302 are two mutually arranged in parallel It is characterized in that two capacitors (C303) (C304) and two resistors (R303) (R304) in series with the capacitor (C304) are connected.

Also, the second filtering circuit 132 has the same structure as the first filtering circuit 131 .

In addition, the third filtering circuit 133 includes two capacitors C305 and C306 disposed in parallel with each other, and two resistors R305 and R306 connected in series with the capacitor C306, but the second filtering circuit 132 ) and the third filtering circuit 133, characterized in that the reverse flow prevention diode (D303) is provided.

Through the filter unit 130 having the above configuration and features, it is possible to remove noise over three stages, so the noise removal effect is excellent compared to the conventional noise filter, and after the noise is removed, a signal power source having a constant waveform close to direct current It has the advantage of not having to go through an additional rectification or direct current process because it can output

5 is an example of immersive content produced by using the method for producing immersive content according to an embodiment of the present invention.

Referring to FIG. 5 , it is an immersive content using 2D live, and it is implemented so that the character talks as if he were actually making a video call according to the dialogue and the situation.

In addition, realistic character content implemented with live 2D technology is output on the screen.

In addition, the space other than the character corresponding to the background is reflected with the rear camera image to combine it with the real space.

In addition, by using GPS, information or characters that tell a story are printed out for the country and region where you are currently located.

Although the description of the additional elements constituting each circuit is omitted in the above description, it is possible to change the design according to the practice of those skilled in the art.

S: this system M: this method
1: Background recognition module 2: Real object recognition module
3: Role play content output module 4: Management server
5: control module 100: signal generation module

Claims (1)

It is an immersive content using 2D live, and it is a method of creating immersive content that is implemented so that the characters tell a story as if they were actually making a video call according to the lines and situations.

Images