KR102099135B1 - Production system and production method for virtual reality contents - Google Patents

Abstract

The present invention is a virtual reality content production system including a server that provides a virtual reality to a user connected through a network, wherein the server implements the virtual environment of the virtual reality, the process of producing virtual reality content on the virtual environment module; A storage module in which the virtual reality content and the user data are stored; And a communication module communicating with the user's terminal through a network. And the communication module receives the user's selection data and operation data, the process module reflects the user's selection data and operation data in the virtual environment, and the user's selection data includes character selection data and Including the background selection data, the process module discloses a virtual reality content production system and method for producing virtual reality content related to the behavior of the user's character in the virtual environment when the user's virtual reality content production signal is received do.

Description

Virtual reality content production system and production method {PRODUCTION SYSTEM AND PRODUCTION METHOD FOR VIRTUAL REALITY CONTENTS}

The present invention relates to a virtual reality content production system and production method.

With the development of computer technology, Virtual Reality (VR) technology has also been rapidly developed and applied to various fields. In recent years, it is gradually expanding its application areas, such as education and shopping, beyond the game and entertainment areas. Therefore, the demand for virtual reality content is also increasing.

The present invention aims to produce a virtual reality content production system and a production method that facilitates content production, since video motion is produced by recording operations in virtual reality.

On the other hand, the technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned are clearly understood by those skilled in the art from the following description. Will be understandable.

In the virtual reality content production system according to an embodiment of the present invention, in a virtual reality content production system including a server providing virtual reality to a user connected through a network, the server implements a virtual environment of virtual reality, A process module for producing virtual reality content in the virtual environment; A storage module in which the virtual reality content and the user data are stored; And a communication module communicating with the user's terminal through a network. And the communication module receives the user's selection data and operation data, the process module reflects the user's selection data and operation data in the virtual environment, and the user's selection data includes character selection data and Contains background selection data, and the process module produces virtual reality content related to the operation of the user's character in the virtual environment when the user's virtual reality content production signal is received.

The motion data of the user may include at least one of the head tracking data of the user, movement data of objects in the virtual environment, and motion data of the user.

The process module may provide a character selection list and a background selection list to the user in the virtual environment.

The character selection list may include a character creation item, a character selection item stored in the storage module, and a character selection item stored in the storage module and available for purchase.

When the user selects a character creation item, the process module may implement a character creation space on the virtual environment and provide the character creation space to the user.

The process module may implement a virtual mirror object on the character creation space, and the virtual mirror object may be implemented to represent a background and an object reflected from the user's character's field of view.

The process module may play the virtual reality content on the virtual environment when the user's virtual reality content reproduction signal is received.

The process module reproduces the virtual reality content in the virtual environment in the first person field of view, which is the user character's field of view, or when the user's field of view change signal is received, looking at the periphery of the user character at a specific point in the virtual environment It can be reproduced by changing to the inching view.

The server can be accessed by a plurality of users through their respective terminals, the plurality of users includes a first user and a second user, and the process module is based on character data and background data selected by the first user. The created first virtual environment can be provided to the second user.

When the second user accesses the server through his terminal, and the second user accepts the invitation event of the friend of the first user in his virtual environment, the process module provides the first virtual environment Can receive

On the other hand, a method for producing virtual reality content according to an embodiment of the present invention comprises: a method for producing virtual reality content using a virtual reality content production system, comprising: a step of authorizing a user logged in at a terminal to access the server; Providing a character selection list to the user in the virtual environment through the process module; Providing a background selection list to the user in the virtual environment through the process module; Reflecting the received operation data of the user to the virtual environment through the process module; Processing an invitation request signal inviting at least one friend from the list of friends stored in the user in the virtual environment to the user's virtual environment through the process module; And producing or playing virtual reality content related to the motion of the user's character in the virtual environment through the process module. It includes.

In the step of providing a character selection list to the user, the character selection list includes a character creation item, a character selection item stored in the storage module, and a character selection item stored in the storage module and available for purchase, wherein the user generates a character selection item. If is selected, the process module may implement a character creation space on the virtual environment and provide the character creation space to the user.

In the step of providing a character selection list to the user, the process module implements a virtual mirror object on the character creation space, and the virtual mirror object is implemented so that a background and an object reflected from the user character's field of view are represented. Then, the user can identify his character reflected in the virtual mirror object in the first person view in the character creation space.

In the step of producing or playing the virtual reality content, the process module plays the virtual reality content on the virtual environment in the first person field of view, which is the user character's field of view, or when the user's field of view change signal is received, the virtual environment It can be reproduced by changing to the third person view of the user character's periphery from a specific point on the screen.

According to an embodiment of the present invention, since video motion is produced by recording an operation in virtual reality, content production may be facilitated.

On the other hand, the effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those skilled in the art from the following description. Will be able to.

Figure 1a is a schematic view showing the configuration of a virtual reality content production system according to an embodiment of the present invention,
Figure 1b is a schematic view showing the configuration of the server in Figure 1a,
2 is an exemplary flowchart of a method for producing virtual reality content according to an embodiment of the present invention,
3 to 20 are exemplary UI screens and virtual environment screens that are performed according to the steps of the flowchart of FIG. 2.

The embodiments of the present invention are manufactured to more fully describe the present invention to those skilled in the art, and the following examples may be modified in various other forms, and the scope of the present invention is as follows. It is not limited to the Examples. Rather, these examples are made to make the present disclosure more faithful and complete, and to fully convey the spirit of the present invention to those skilled in the art.

In addition, in the following drawings, each configuration is exaggerated for convenience and clarity of description, and the same reference numerals in the drawings refer to the same elements. As used herein, the term “and / or” includes any and all combinations of one or more of the listed items.

The terminology used herein is used to describe a specific embodiment and is not intended to limit the present invention.

As used herein, singular forms may include plural forms unless the context clearly indicates otherwise. Also, as used herein, “comprise” and / or “comprising” specifies the shapes, numbers, steps, actions, elements, elements and / or the presence of these groups. And does not exclude the presence or addition of one or more other shapes, numbers, actions, elements, elements and / or groups.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1A is a configuration diagram schematically showing a configuration of a virtual reality content production system according to an embodiment of the present invention, and FIG. 1B is a configuration diagram schematically showing a configuration of a server in FIG. 1A.

First, referring to FIGS. 1A and 1B, a virtual reality content production system includes a server 100 and a user environment 10, 10a, 10b.

The user environment 10 includes a terminal 200, an output unit 300, an input unit 400, and a sensing unit 500.

The server 100 is a central system that manages the connected terminal 200 and the virtual reality image, and the main functions are user management through the network 150, user access status, and the user terminal 200. The virtual environment screen of the virtual reality may be generated through the base data and provided to the user's output unit 300.

In addition, the server 100 may provide a market for purchasing character, background data, and object data.

On the other hand, the server 100 basically provides a virtual environment in which a user can experience a virtual environment in a first person view seen from a user's character in virtual reality, and also changes a viewpoint to a third person view at a specific point. It is possible to provide an environment for changing the point of view in which one's character and the invited opponent's character can be viewed together.

The server 100 may include a process module 110, a storage module 120 and a communication module 130.

The process module 110 may include, for example, a processor or a microcontroller unit (MCU).

The process module 110 may implement a virtual environment of virtual reality and generate virtual reality content on the virtual environment.

The virtual reality content may include an object type in a selected background, an object position on each frame, clothes information of a selected character, a position value of a character on each frame, and motion data information.

In the present invention, the virtual reality content is video content that contains other motion changes in the position, movement, and movement and placement of a user character in virtual reality, and can be output or edited to the outside as a 360-degree photo, 360-degree picture. In addition to the video in the direction, it may include a fixed type of photo or video.

In addition, the virtual reality content may include various types of data such as a program or a picture or a video that views and experiences a virtual space implemented in 3D in a 360 degree direction through a first person view or a third person view.

In addition, the virtual reality content may include other motion changes in the position, movement, and movement and placement of objects in a situation in which a plurality of users face each other and converse in one virtual space.

Meanwhile, the virtual reality content may be photographed based on a user's specific character's field of view, and when played, may be played based on a user's first person or third person view.

The process module 110 may provide a list screen to the user U in the virtual reality content. Here, the list screen may include a character list, a background list, an object list, a friend list, and a content list.

The character list may display at least one character stored together with a thumbnail.

The background list may display at least one background stored together with a thumbnail.

The object list displays at least one stored object together with a thumbnail, and can be classified into upper and lower categories and displayed.

The friend list may display at least one stored friend along with a character thumbnail, and display online or offline information of the friend.

The list screen may be displayed as a user interface (UI) to a user in a virtual environment.

When the user selects a character creation item in the virtual environment, the process module 110 may implement a character creation space on the virtual environment and provide a character creation space to the user.

Meanwhile, the process module 110 may capture, store, and play virtual reality content according to a user input signal. In particular, the process module 110 may photograph virtual reality content based on a user's specific character's field of view, and when playing the virtual reality content, may be played based on a user's first person view or third person view.

The storage module 120 may store user data based on the login information of the user U. User data may include character data, background data, friend data, and content data.

The character data may include a character name, a thumbnail image of the character, and information on clothes of the set character.

Background data may include a background name, a thumbnail image of the background, the number of objects arranged in the background, the type of objects arranged in the background, and location information of the objects arranged in the background.

The friend data may include a friend's name, a representative character image of the friend, login information of the friend, and the like.

The content data may include video and audio information related to a character, a background and an object's position movement, shape change according to a user's character's motion change in virtual reality.

The terminal 200 is a computing device including a processor and a memory, and may be, for example, a mobile terminal such as a tablet PC.

Meanwhile, the terminal 200 is not limited to a mobile terminal, and may be any computer (eg, a personal computer) as long as it includes a processor and memory.

In addition, although not shown, the terminal 200 may include an input unit for inputting information, an output unit for outputting information, a storage unit for storing information, and a communication unit for transmitting information to the outside.

The input unit is an input device that receives data, and may include, for example, a touch pad, a keyboard, a mouse, and a touch pen.

The output unit is a display device that displays data on a screen, and may include, for example, an LCD.

On the other hand, if the input unit is a touch pad and the touch pad is combined with an output unit, the input unit and the output unit may constitute a touch screen.

The storage unit is a storage device that stores data such as a file or a data processing program, and may include, for example, HDD, SSD, RAM, ROM, cache, register, and the like.

Here, the terminal 200 may store the base data related to the virtual reality and the virtual reality content recorded in the virtual environment of the virtual reality.

A program for editing or converting the format of virtual reality content may be built in the terminal 200, and the user may edit the virtual reality content or convert the format by executing the corresponding program.

Meanwhile, the terminal 200 may provide a login screen for authentication of the server 100 connection on the output unit.

The output unit 300 may reproduce the virtual environment screen of the virtual reality provided by the server 100 and provide it to the user who wears it.

The output unit 300 may output a digital signal of a virtual environment screen of a virtual reality transmitted from the server 200 as video and audio.

On the other hand, the output unit 300 is preferably implemented as a head-mounted device (HMD), and may include a headset for display and voice output for image output.

The input unit 400 is a controller used in a normal virtual reality device, for example, an operation for instructing a specific action of an avatar displayed in virtual reality, such as a game pad, HTC Vive Controller, TacticalHaptics controller, etc. It may be a wired or wireless device that generates a signal.

For example, the input unit 400 may include a gripping portion that is gripped by a user's hand, and a hollow may be formed on an upper side of the gripping portion. In addition, the input unit 400 may include a built-in battery for power supply.

The input unit 400 may include a first input unit 410 and a second input unit 420, the first input unit 410 may receive an operation signal by the user's left hand, the second input unit 420 Can receive the operation signal by the user's right hand.

Here, the operation signal may include a home movement signal, a virtual reality video recording signal, a list screen call signal, a selection signal, and a point movement signal.

For example, a home movement signal, a virtual reality video recording signal, a list screen call signal or a selection signal may be input from the first input unit 410, and a point movement signal may be input from the second input unit 420. However, in the present invention, the signal information received from each of the first input unit 410 and the second input unit 420 is not limited.

The sensing unit 500 may include a plurality of motion sensors 510 and 520 (eg, a camera) and a plurality of sensors (not shown) mounted on the input unit 400.

The sensing unit 500 may detect user sensing data according to a user's movement through a plurality of motion sensors 510 and 520 and a plurality of sensors (not shown) mounted on the input unit 400.

The user sensing data may include a user's head trekking data, object movement data in a virtual environment, and user motion data.

The head trekking data is data related to a user's head movement and may be used to determine a field of view.

The movement data of an object in the virtual environment may be obtained by movement by a user's walking or manipulation of an input device.

Further, the user's motion data may be obtained by a camera or a gesture sensor.

Hereinafter, a method of manufacturing virtual reality content using a virtual reality content production system will be described with reference to FIGS. 2 to 20.

2 is an exemplary flow chart of a method for producing virtual reality content according to an embodiment of the present invention, and FIGS. 3 to 20 are exemplary UI screens and virtual environment screens performed according to the steps of the flow chart of FIG. 2.

First, referring to FIG. 2, in the virtual reality content production method according to an embodiment of the present invention, at least one friend user may be invited to his virtual environment to produce virtual reality content through cooperation.

Accordingly, the first user is logged in step (S11), character selection or creation step (S21), background selection step (S31), friend invitation (S41), object selection and placement step (S51), video recording or video playback step (S61) and the log-out step (S71) can be produced virtual reality content by a method, the second user login step (S12), character selection or creation step (S22), friend invitation acceptance step (S42) and Through the logout step S72, it is possible to cooperate with the production of virtual reality content.

1A to 3, in the login steps S11 and S21, each of a plurality of users may access the server 100 through their respective terminals 200.

As shown in FIG. 3, the terminal 200 may provide a login screen including an ID input window and a PASSWORD input window to a user through an output unit.

The login screen provides a friend add window, through which the first user can add a friend.

Referring to FIG. 4, after logging in, the first user may be provided with a virtual environment in which the main screen is displayed by mounting the output unit 300.

On the main screen, a character selection window 1, a background selection window 2, and a gallery selection window 3 may be displayed.

When the first user selects the character selection window 1 on the main screen, the character selection screen shown in FIG. 5 is provided, and the character selection or creation step (S21) is performed through the selection of the first user on the character selection screen. You can.

On the character selection screen, the character creation (C1) and stored character (C2) items are displayed, and the first user can select one of them.

Meanwhile, when the first user selects the character creation (C1) item on the character selection screen, the screen may be switched to the character creation space 11 as shown in FIGS. 6 and 7.

The character creation space 11 may be provided by the process module 110, the user's input unit 400-1 may be projected to the character creation space 11, and the first user may be provided with the input unit 400-1. The point P may be positioned at a desired position through the point movement signal, and a desired clothes or hairstyle may be selected from the clothes list and reflected in the character through the selection signal of the input unit 400-1.

Meanwhile, a virtual mirror object M-1 may be disposed in the character creation space 11.

In the character creation space 11, the first user can browse the clothing list in the first person view, and the virtual mirror object (M-1) reflects the situation in which the character is changed because the selected clothing or hairstyle is reflected in the character. You can check immediately in the light of.

That is, the selected costume or hairstyle is reflected in the character, and the reflected image can be immediately confirmed through the character C1-1 reflected on the virtual mirror object M-1.

Through this, although the virtual space, the first user can decorate the character with a first person view, such as his / her own view, so that a sense of reality can be reflected.

The virtual mirror object M-1 reflects a change in the user's motion and state, such as a mirror in reality, so that the user can immediately check it in the first person view point.

The virtual mirror object (M-1) is implemented by placing a dark plate object behind the plate object to which the plane reflection is applied, and adjusting the reflection value so that the size of the object remains as it is to implement the virtual mirror object (M-1). You can.

On the other hand, the character selection screen may provide the character stored in the market to the first user, and the first user may purchase the character by paying an amount and reflect it in his virtual environment.

Here, the user can create his or her character through the terminal 200, additionally create a character and upload it to the market, and obtain profits from selling the character.

Referring to FIG. 9, after selecting or creating a character, the first user is provided with a background selection screen, and may perform a background selection or generation step S31 through selection of the first user on the background selection screen.

The background selection screen displays the background creation (S1) and the stored background selection (S2) items, and the first user can select one of them by controlling the point P position.

On the other hand, the background selection screen may provide a background stored in the market to a user, and the first user may purchase the background by paying an amount and reflect it in his virtual environment.

Here, the user can create a background of his / her virtual environment through the terminal 200, additionally create a background and upload it to the market, and obtain profits from selling the background.

After selecting or creating a background, the first user can be provided with a virtual environment defined by himself.

Subsequently, referring to FIG. 9, the first user can control the input unit 400 in a virtual environment to bring up the list screen M.

The list screen M may be displayed as a UI in front of the first person's first person view.

The list screen M may include a character list CM, an object list OM, a friend list FM, and a content list RM.

Referring to FIG. 9, the stored character item (C2) is displayed in the character list (CM) as a thumbnail image and a character name, and the first user controls the location of the point (P) and selects one of them to change his character again. You can.

10 to 12, in the object list OM, the stored object item O1 is displayed as a thumbnail image and an object name, and the first user controls a point P location to select one of them and selects a virtual environment. By placing at least one object on the object, it is possible to perform an object selection and placement step (S51).

Meanwhile, the first user on the virtual environment may control the location of the point P to control the location of the selected object O1.

In addition, the first user may perform a size adjustment or direction adjustment function of the object O1 through a separate operation signal.

Here, the object may be implemented as a 3D graphic file, 3D animation file, or 2D image file.

Meanwhile, the first user can check the login information of the friend user F1 (hereinafter, the second user) in the friend list FM, and the friend list (regardless of before, after, or during the object selection and placement step S51) FM) may invite the second user F1.

The first user may invite the second user to his virtual environment by controlling the location of the point P and selecting the friend invitation (F-I) UI in the friend list FM.

Thus, as shown in FIG. 14, the second user's second character (C-U2) is invited to his virtual environment, whereby the first user and the second user can create virtual reality content through cooperation in one virtual environment. .

Meanwhile, in one virtual environment, the first character C-U1 and the second character C-U2 may be able to communicate with each other through voice or text.

Here, each of the first user and the second user can individually produce virtual reality content in one virtual environment and play stored virtual reality content.

On the other hand, the second user can log in and access the server 100 to maintain the online status to receive a friend invitation event, and perform the invitation acceptance step (S42) for the friend invitation event, the virtual environment of the first user It is possible to receive.

Thereafter, referring to FIGS. 15 to 20, the first user browses the content list RM and controls the location of the point P to play the video content R1 stored in the content list RM in the virtual environment or By selecting a recording UI (RS) to generate new image content, an image recording or image reproduction step (S61) may be performed.

Also, during playback of the video content, a start UI, a stop UI, a play bar UI (R-P), etc. may be displayed on the virtual environment to control the video content played on the virtual environment.

Meanwhile, referring to FIGS. 19 and 20, the first user or the second user may create additional virtual reality content while confirming the virtual reality content played within the virtual environment, and move objects or perform a separate operation. can do.

Here, the playback window in which the virtual reality content is played is implemented as one object, so that the user can move the position of the playback window.

In addition, the first user or the second user may change the playing time point of the virtual reality content played in the virtual environment.

For example, the first user or the second user plays a virtual reality content in a virtual environment and then inputs a viewpoint change signal during the process of playing the virtual reality content as a first person view point of the character RC in the virtual reality content. The character (RC) can be changed to the viewed content from the third person point of view in the virtual reality content.

Thereafter, the first user and the second user may log out from the virtual environment by performing logout steps S71 and S72, respectively.

What has been described above is only one embodiment for implementing the virtual reality content production system and production method according to the present invention, and the present invention is not limited to one embodiment, and as claimed in the following claims Anyone who has ordinary knowledge in the field to which the present invention belongs, without departing from the gist of the invention, will have the technical spirit of the present invention to the extent that various changes can be made.

100: server
200: terminal
300: output
400: input
500: sensing unit

Claims (14)

In the virtual reality content production system including a server that provides a virtual reality to users connected through the network,
The server
A process module for implementing a virtual environment of virtual reality and producing virtual reality content on the virtual environment;
A storage module in which the virtual reality content and user data are stored; And
A communication module communicating with the user's terminal through a network; Including,
The communication module receives the user's selection data and operation data,
The process module reflects the user's selection data and operation data in the virtual environment,
The user's selection data includes character selection data and background selection data,
The process module produces virtual reality content related to the behavior of the user's character in the virtual environment when the user's virtual reality content production signal is received,
The process module
Provide a character selection list and a background selection list to the user in the virtual environment,
The above character selection list
Character creation items, character selection items stored in the storage module and character selection items stored in the storage module and available for purchase,
When the user selects a character creation item,
The process module
A character creation space is implemented on the virtual environment, and the character creation space is provided to the user.
The process module
Implementing at least one virtual mirror object on the character creation space,
The virtual mirror object is implemented such that a background and an object reflected from the user's character's field of view are represented,
In the character creation space, the user can browse the list of costumes with a first person view, and create virtual reality contents that can be immediately checked by illuminating the situation where the character is changed by reflecting the selected costume or hairstyle on his character on a virtual mirror object. system.
delete delete delete delete delete According to claim 1,
The process module
A virtual reality content production system that reproduces the virtual reality content in the virtual environment when the user's virtual reality content reproduction signal is received.
The method of claim 7,
The process module
In the virtual environment, the virtual reality content is reproduced in a first person view, which is a standard of view of the user character, or
When a signal for changing a user's field of view is received, a virtual reality content production system that changes and plays a third person's field of view around the user character at a specific point on the virtual environment.
The method of claim 8,
The server can be accessed by a plurality of users through their respective terminals,
The plurality of users includes a first user and a second user,
The process module
A virtual reality content production system that provides a first virtual environment generated based on character data and background data selected by the first user to the second user.
The method of claim 9,
The second user accesses the server through his terminal,
When the second user approves the friend invitation event of the first user in his virtual environment, the virtual reality content production system receives the first virtual environment in the process module.
In the method for producing virtual reality content using the virtual reality content production system according to claim 1,
Approving a user logged in at the terminal and accessing the server;
Providing a character selection list to the user in the virtual environment through the process module;
Providing a background selection list to the user in the virtual environment through the process module;
Reflecting the received operation data of the user to the virtual environment through the process module;
Processing an invitation request signal inviting at least one friend from the list of friends stored in the user in the virtual environment to the user's virtual environment through the process module; And
Producing or playing virtual reality content related to the motion of the user's character in the virtual environment through the process module; Virtual reality content production method comprising a.
The method of claim 11,
In the step of providing a character selection list to the user
The character selection list includes a character creation item, a character selection item stored in the storage module, and a character selection item stored in the storage module and available for purchase,
When the user selects a character creation item,
The process module
A method for producing virtual reality content that implements a character creation space on the virtual environment and provides the character creation space to the user.
The method of claim 12,
In the step of providing a character selection list to the user
The process module
A virtual mirror object on the character creation space,
The virtual mirror object is implemented to represent a background and an object reflected from the user's character's field of view,
The user in the character creation space in a first-person field of view virtual reality content production method that can identify their character reflected in the virtual mirror object.
The method of claim 12,
In the step of producing or playing the virtual reality content,
The process module
In the virtual environment, the virtual reality content is reproduced in a first person view, which is a standard of view of the user character, or
A method for producing virtual reality content when a signal for changing a user's field of view is received and changed to a third person's field of view surrounding the user's character at a specific point on the virtual environment and reproduced.

Images