JP7104210B1 - How to provide interactive virtual reality content and equipment - Google Patents

Abstract

Kind Code: A1 A method and apparatus for providing interactive virtual reality content that enhances a user's immersion by smoothly connecting an idle image and a branch image are provided. Kind Code: A1 A method for providing interactive virtual reality content performed by a computing device provides an idle video including options, wherein a performer in the idle video performs a standby action, and the performer performs a standby action. During the process, receiving a selection input corresponding to a choice from a user, providing a connected image after receiving the selection input, and providing a branch image corresponding to the user's selection after providing the connected image. and providing At least a part of the actor is subjected to computer graphics processing in the connecting video, and the actor's first posture at the time of receiving the selection input by the actor performing the connecting motion to the actor's first posture at the start of the branch video. It should be smoothly connected in two postures. [Selection drawing] Fig. 10

Description

The present invention relates to a method and an apparatus for providing interactive virtual reality content.

Virtual reality contents create a specific environment / situation on a computer that is similar to reality but not reality, as if the user interacts with the real situation / environment.

Interactive content also allows users to actively participate in the story progression of content (eg, movies, games, books, etc.). Therefore, even if one interactive content is experienced, many users can have several different endings.

Virtual reality content and interactive content are similar in that users play actively rather than passively experience the content. Therefore, the production of virtual reality content (hereinafter referred to as "interactive virtual reality content") to which an interactive function is added is being discussed.

On the other hand, it is possible to stop the progress of the content in the middle of providing the interactive virtual reality content (for example, in the middle of showing the video), provide the user with many choices, and provide the branched video corresponding to the user's choice. can. However, when the connectivity between the video that provides a large number of options (hereinafter referred to as "idol video") and the branch video that follows the idle video is lost, the user (that is, the audience) is immersed in the interactive virtual reality content. The degree drops.

An object to be solved by the present invention is to provide a method and an apparatus for providing interactive virtual reality content that can increase the immersiveness of a user by smoothly connecting an idle video and a branched video.

In order to solve the above problems, one aspect (aspect) of the method for providing interactive virtual reality content of the present invention provides an idle image including options in the method for providing interactive virtual reality content performed by a computing device. However, the performer in the idle video performs a standby operation, a stage in which the performer receives an input of a selection corresponding to the option from the user while the performer performs the standby operation, and an input of the selection. Including the step of providing the linked video after receiving the video and the step of providing the corresponding branched video according to the user's selection after providing the linked video, at least one of the performers in the linked video. The unit is computer-graphically processed, and the performer smoothly shifts from the first posture of the performer at the time of receiving the input of the selection to the second posture of the performer at the start of the branched image by performing the connection operation. Make it connected.

The performer in the idle image can move from the first standby posture to the second standby posture.

Further including a step of storing a large number of connected images, the large number of the connected images include a first connected image including the performer moving from the first standby posture to the second posture, and the performer performing the second. A second connected image including moving from the standby posture to the second posture may be included.

Further including a step of checking the first posture of the performer at the time of receiving the input of the selection, the step of providing the connected video is the first connected video or the above, depending on the checked first posture. It may include selectively providing the second concatenated video.

The step of checking the first posture of the performer is between the first time stamp corresponding to the time when the performer in the idle image is in the first standby posture, and between the first standby posture and the second standby posture. Time interval and the use of a second time stamp at the time of receiving the input of the selection may be included.

Further, the performer in the idle video moves from the first standby posture to the second standby posture, then returns from the second standby posture to the first standby posture, and at the time when the input of the selection is received, the performer in the idle video Even if the performer is closer to the second standby posture than the first standby posture, the performer in the idle image returns to the first standby posture, returns to the first standby posture, and then connects. Can provide footage.

The connected video may include dissolving the garment of the performer in the first standby posture to the garment of the performer in the second posture.

Further including a step of checking the motion characteristics of the performer in the start section of the branch image, the dissolve of the clothes in the first standby posture of the performer is applied first according to the motion characteristics. The area can be changed.

In order to solve the above problems, one aspect of the interactive virtual reality content providing device of the present invention includes a memory and a processor, and the memory provides an idle image in which the processor includes options, but the idle. The performer in the video performs a standby operation, and while the performer performs the standby operation, receives an input of a selection corresponding to the option from the user, and after receiving the input of the selection, provides a linked video. After providing the linked video, a corresponding branched video is provided according to the user's selection, and at least a part of the performers is computer-graphically processed in the linked video, and the performer performs the linking operation. By doing so, the instruction is included so that the first posture of the performer at the time of receiving the input of the selection is smoothly connected to the second posture of the performer at the start of the branched image.

Further, the performer in the idle image moves from the first standby posture to the second standby posture, and the memory stores a large number of connected images, but the performer is in the first standby posture for a large number of the connected images. The memory includes the first connected video including moving from the second posture to the second posture and the second connected video including the performer moving from the second standby posture to the second posture, and the memory is selected by the processor. An instruction that checks the first posture of the performer at the time of receiving the input of, and selectively provides the first connected video or the second connected video according to the checked first posture. including.

The performer in the idle image moves from the first standby posture to the second standby posture, then returns from the second standby posture to the first standby posture, and the memory is stored at the time when the processor receives the input of the selection. Even if the performer in the idle image is closer to the second standby posture than the first standby posture, the performer in the idle image returns to the first standby posture and returns to the first standby posture. Later, the linked video will be provided, which may include dissolving the performer's clothing in the first standby posture into the performer's clothing in the second posture.

It is a conceptual diagram for demonstrating the interactive virtual reality content provision system by some embodiments of this invention. It is an exemplary block diagram for explaining the structure of the content providing apparatus. It is a figure for demonstrating the method of providing the interactive virtual reality content by some embodiments of this invention. It is a figure for demonstrating the idle image in the method of providing the interactive virtual reality content by some embodiments of this invention. It is a figure for demonstrating the idle image in the method of providing the interactive virtual reality content by some Embodiments of this invention. It is a figure for demonstrating the connected image which connects the idle image and the branched image in the method of providing the interactive virtual reality content by some Embodiments of this invention. It is a figure for demonstrating the connected image which connects the idle image and the branched image in the method of providing the interactive virtual reality content by some Embodiments of this invention. It is a figure for demonstrating the connected image which connects the idle image and the branched image in the method of providing the interactive virtual reality content by some Embodiments of this invention. It is a figure for demonstrating the connected image which connects the idle image and the branched image in the method of providing the interactive virtual reality content by some Embodiments of this invention. It is a flowchart for demonstrating the method of providing the interactive virtual reality content by one Embodiment of this invention. It is a flowchart for demonstrating the method of providing the interactive virtual reality content by another Embodiment of this invention. It is a flowchart for demonstrating the method of providing the interactive virtual reality content by another embodiment of this invention. It is a figure for demonstrating the method of providing the virtual reality content by another embodiment of this invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The advantages and features of the present invention, as well as the methods for achieving them, will become clear with reference to embodiments described in detail with the accompanying drawings. However, the present invention is not limited to the embodiments posted below, and can be realized in various forms different from each other. Simply, the present embodiment completes the posting of the present invention, and the technique to which the present invention belongs. It is provided to fully inform a person having ordinary knowledge in the field of the scope of the invention, and the present invention is defined only by the scope of the claims.

The first, second, etc. are used to describe a variety of elements, components and / or sections, but of course these elements, components and / or sections are not limited by these terms. These terms are used solely to distinguish one element, component or section from another element, component or section. Therefore, it goes without saying that the first element, the first component or the first section referred to below can be the second element, the second component or the second section within the technical idea of the present invention.

The terms used herein are for purposes of describing embodiments and are not intended to limit the invention. In the present specification, the singular form also includes the plural form unless otherwise specified in the text. As used herein, "comprises" and / or "comprising" are the referred components, stages, actions and / or elements are one or more other components, steps, actions and /. Or do not rule out the presence or addition of elements.

Unless otherwise defined, all terms used herein (including technical and scientific terms) are used in a sense that is commonly understood by those with ordinary knowledge in the art to which the invention belongs. Will be done. Also, terms defined in commonly used dictionaries are not ideally or over-interpreted unless explicitly defined otherwise.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and in the description with reference to the attached drawings, the same or corresponding components are assigned the same reference numbers regardless of the drawing reference numerals. Duplicate explanations relating to this will be omitted.

As used herein, "configured to" means, for example, "suitable" or "capable of" in terms of hardware or software, depending on the circumstances. Can be used interchangeably with "have", "modified to", "made to", "can" or "designed to" can. In some situations, the expression "a device configured to" means that the device "can" with other devices or components. For example, the text "processor configured (or set) to perform A, B, and C" is a dedicated processor (eg, embedded processor) for performing the corresponding operation, or one stored in a memory device. It means a general-purpose processor (eg, CPU or application processor) that can perform the corresponding operation by executing one or more software programs. As used herein, the term user (or spectator) refers to a person who uses an electronic device or a device that uses an electronic device (eg, an artificial intelligence electronic device).

FIG. 1 is a conceptual diagram for explaining an interactive virtual reality content providing system according to some embodiments of the present invention. FIG. 2 is an exemplary block diagram for explaining the configuration of the content providing device shown in FIG.

Referring to FIG. 1, in the interactive virtual reality content providing system according to some embodiments of the present invention, the user (that is, the spectator) is connected to the user device 100, the content providing device 200, and the like through the network 250.

The network 250 includes, for example, all wired and wireless systems. In particular, wireless communication includes, for example, LTE, LTE-A (LTE Advance), CDMA (code division multiple access), WCDMA (wideband CDMA), UMTS (universal mobile telecommunication It may include cellular communication using at least one of System for Mobile Communications) and the like. Alternatively, wireless communication includes WiFi (wireless fidelity), LiFi (light fidelity), Bluetooth (registered trademark), Bluetooth low energy (BLE), ZIGBEE (registered trademark), NFC (near field communication), and magnetic secure. It may include at least one of transmission (Magnetic Security Transition), radio frequency (RF), or body area network (BAN). Wired communication includes, for example, USB (universal serial bus), HDMI (registered trademark) (high definition multi-media interface), RS-232 (recommended standard 232), power line communication, or POTS (plane old network). It may include at least one of LAN or WAN) and the like.

The content providing device 200 is a device for providing interactive virtual reality content described later. For example, the content providing device 200 can be realized by one or more servers, but is not limited thereto. For example, it can be a combination of various servers such as a database server, a file server, a mail server, and a web server. The content providing device 200 can be in the form of a centralized server, and can also be realized in the form of a distributed server.

The user device 100 may be, for example, a wearable device as a device used by the user (viewer) to view the virtual reality content. Examples of wearable devices include head-mounted displays (HMDs), accessory types (eg watches, rings, bangles, ankles, necklaces, glasses, contact lenses, etc.), textiles or clothing-integrated types (eg electronic clothing). ), Body-attached (eg, skin pad or tattoo), or at least one of the bioimplantable circuits. The user device 100 can also be realized in other forms, and may include, for example, at least one of a smartphone, a tablet PC, a PDA, a PMP (portable multimedia player), a medical device, a camera, or a wearable device.

The user (that is, the spectator) can also individually view the virtual reality content at a personal place (for example, a house, a company, etc.) using the user device 100. Alternatively, a large number of users can get together to view virtual reality content in a communal place such as a screening hall. When viewing virtual reality content in a communal location, the user device 100 may be fixed / attached to the seat. Alternatively, if the user device 100 is not provided in the seat, the user (viewer) uses the user device 100 provided by the screening hall, or the user (viewer) uses a separate personal electronic device. You can also bring it in and use it.

Here, referring to FIG. 2, in the content providing device 200, various components such as a communication module 230, a processor 260, a memory 270, and an input / output interface (not shown) are connected and communicated with each other (that is, not shown) by a bus 280. Control message transmission and data transmission) can be performed.

The communication module 230 is a module for communicating with another user device 100, a content providing device 200, and the like through the various wired / wireless networks 250 described with reference to FIG.

As used herein, the term "module" includes a unit composed of hardware, software or firmware and is used interchangeably with terms such as logic, logic blocks, components, or circuits. Can be done. A "module" can be an integral part or the smallest unit or part thereof that performs one or more functions. The "module" can be realized mechanically or electronically.

Processor 260 may include one or more of a central processing unit, application processor, or communication processor. Processor 260 may, for example, perform arithmetic and data processing relating to control and / or communication of at least one other component of the content providing device 200.

The memory 270 includes a volatile memory (eg, DRAM, SRAM, or SDRAM) and / or a non-volatile memory (eg, OTPROM (one time program ROM), PROM, EPROM, EEPROM, mask ROM, flash ROM, flash memory, PRAM. , RRAM, MRAM, hard drive, or solid state drive (SSD)). Memory 270 may include internal memory and / or external memory. The memory 270 may store, for example, instructions or data related to at least one other component of the content providing device 200. The memory 270 may also store software and / or programs. The program may include, for example, a kernel, middleware, an application programming interface (API), and / or an application program (or "application"). At least part of the kernel, middleware, or API can be referred to as the operating system.

The memory 270 stores instructions for performing the next method of showing the interactive virtual reality content.

Specifically, the memory 270 provides an idle image in which the processor 260 includes options, but the performer in the idle image performs a standby operation, and the user is in the middle of performing the standby operation. After receiving the input of the selection corresponding to the option from the above, and after receiving the input of the selection, the linked video is provided, and after the linked video is provided, the corresponding branched video is provided according to the user's selection. In the connected video, at least a part of the performer is computer-graphically processed, and the branch video is started from the first posture of the performer at the time when the performer performs the connection operation to receive the input of the selection. Includes instructions to ensure a smooth connection to the performer's second posture at the time.

Further, the performer in the idle image moves from the first standby posture to the second standby posture, and although the memory 270 stores a large number of connected images, the performer performs the first standby for the large number of connected images. The memory 270 includes the first connected video including moving from the posture to the second posture and the second connected video including the performer moving from the second standby posture to the second posture, and the memory 270 is the processor 260. Checks the first posture of the performer at the time when the input of the selection is received, and selectively provides the first connected video or the second connected video according to the checked first posture. Including instructions.

The performer in the idle image moves from the first standby posture to the second standby posture, then returns from the second standby posture to the first standby posture, and the memory 270 is the time when the processor 260 receives the input of the selection. In addition, even if the performer in the idle image is closer to the second standby posture than the first standby posture, the performer in the idle image returns to the first standby posture and is in the first standby posture. After returning, the linked video is provided, which may include dissolving the performer's clothing in the first standby posture into the performer's clothing in the second posture.

A method for providing such interactive virtual reality content will be specifically described later with reference to FIGS. 3 to 13.

In this specification, what is expressed as "video" such as previous video, idle video, linked video, branch video, etc. refers to video used in various virtual reality contents such as movies, games, and videos. means.

FIG. 3 is a diagram for explaining a method of providing virtual reality content according to some embodiments of the present invention. FIG. 4 is a diagram for explaining that options appear at a turning point of virtual reality content.

First, referring to FIG. 3, in the method of providing virtual reality content according to some embodiments of the present invention, the previous video A0 is provided from time t0 to time t1. The user views the previous video A0 via the user device 100.

After the previous video A0 is provided, at least one option is provided at the first branch point Q1 (eg, at time t1).

The user then receives input of a selection corresponding to the option (ie, via the user device 100).

From time t1 to time t2, the corresponding branched video (A1 or A2) is provided according to the user's selection. The user views the branched video (A1 or A2) via the user device 100.

Specifically, taking the example of FIG. 4, in the previous video A0, the performer (“Yonghee”, 3710) wanders around the isolated island and finds an old bridge after the crash landing. At this time, option 370a appears. The first option OP1 is "cross the bridge", and the second option OP2 is "return without crossing the bridge". When the user selects the first option OP1, the branch image crossing the bridge is displayed (that is, the branch image A1 is provided). When the user selects the second option OP2, the branch video that returns without crossing the bridge is displayed (that is, the branch video A2 is provided).

Referring to FIG. 3 again, then at least one option is provided again at the second branch point Q2 (eg, at time t2) after the branch video A1 is provided.

The user then receives input of a selection corresponding to the option (ie, via the user device 100). Then, from time t2 to time t3, the corresponding branched video (A11 or A12) is provided according to the user's selection. The user views the branched video (A11 or A12) via the user device 100.

Alternatively, after the branch video A2 is provided, at least one option is provided at the third branch point Q3 (eg, at time t2).

The user then receives input of a selection corresponding to the option (ie, via the user device 100). Then, from time t2 to time t3, the corresponding branched video (A21 or A22) is provided according to the user's selection. The user views the branched video (A21 or A22) via the user device 100.

The conclusions (R1, R2, R3, R4) of the interactive virtual reality content can be changed by the user's selection at least once described above.

In FIG. 3, it is illustrated that the second branch point Q2 and the third branch point Q3 are arranged at the same time t2, but the present invention is not limited to this. That is, the positions of the second branch point Q2 and the third branch point Q3 may change depending on the lengths of the branch video A1 and the branch video A2.

Here, an idle image including options provided at a branch point (for example, Q1) will be specifically described with reference to FIG.

FIG. 5 is a diagram for explaining an idle image in a method of providing interactive virtual reality content according to some embodiments of the present invention. No options (see 370a in FIG. 4) are shown to explain the performer's movements in detail in the idle video.

As shown in FIG. 5, the performer in the idle image has movement. In interactive virtual reality content, the user's immersiveness can be reduced if the performer is stationary and fixed while the user makes a selection (ie, in the idle video). For example, while the performer asks the user a question and the performer waits for the user's reply (ie, selection), the performer can only increase the user's immersiveness if he or she is performing a natural action.

For example, the performer in the idle image can move from the first standby posture 371 to the second standby posture 372. Further, the performer in the idle image can move from the first standby posture 371 to the second standby posture 372, and then return from the second standby posture 372 to the first standby posture 371. That is, the performer in the idle video can repeat the already set action while waiting for the user's reply (ie, selection).

On the other hand, in FIG. 5, the performer in the idle image moves and / or returns from the first standby posture 371 to the second standby posture 372 as an example, but the present invention is not limited to this.

Although not shown in the drawing, for example, the performer moves from the first standby posture 371 to the left to the second standby posture 372, moves from the second standby posture 372 to the right, passes through the first standby posture 371, and then waits for another. It can move to the posture, move to the left from the other standby posture, and return to the first standby posture 371.

On the other hand, while the idle video is being provided, the user receives input of the selection corresponding to the option (for example, 370a). In a method of providing interactive virtual reality content according to some embodiments of the present invention, a linked video is provided after receiving a selection input. After providing the linked video, the corresponding branched video is provided according to the user's selection.

Specifically, a connected video that connects the idle video and the branched video will be described with reference to FIGS. 6 to 9.

It is assumed that the performer in the idle video performs a standby motion, but the standby motion moves between the first standby posture (371 in FIG. 5) and the second standby posture (372 in FIG. 5). Further, the posture of the performer is set to the first posture (3911 in FIG. 6 or 3912 in FIG. 8) at the time of receiving the input of the user's selection, and the second posture 381 of the performer at the start of the branch video A1.

First, referring to FIGS. 6 and 7, the previous video A0 is provided before time t1.

Idle video I0 is provided from time t1. The performer in the idle video I0 performs a standby operation. That is, it is assumed that the performer in the idle image moves between the first standby posture 371 and the second standby posture 372.

At time t11, while the idle video I0 is being provided (that is, while the performer is performing the standby operation), the user inputs the selection S1 corresponding to the option. At the time of receiving the input of the user's selection, the performer may be in a position corresponding to the first standby posture 371 or closer to the first standby posture 371 (from the second standby posture 372). That is, the performer's first posture 3911 may be in a position corresponding to the first standby posture 371 at the time of receiving the input of the user's selection.

From time t11 to time t12, the first connected video C11 is provided. Specifically, the connected video may change depending on the time when the selection S1 is input (or the posture of the performer at the time when the selection S1 is input). In FIGS. 6 and 7, since the performer's first posture 3911 is in a position corresponding to the first standby posture 371, the first connected video C11 is provided.

The first connected video C11 smoothly connects the idle video I0 and the branched video A1 (provided from the time t12). Here, in the first connected video C11, the performer (of the idle video I0) moves from the first standby posture 371 to the second posture 381 at the start (of the branch video A1) (see drawing reference numeral 391).

With reference to FIGS. 8 and 9, the previous video A0 is provided before time t1.

Idle video I0 is provided from time t1. The performer in the idle video I0 performs a standby operation. That is, it is assumed that the performer in the idle image moves between the first standby posture 371 and the second standby posture 372.

At time t21, while the idle video I0 is being provided (that is, while the performer is performing the standby operation), the user inputs the selection S1 corresponding to the option. At the time of receiving the input of the user's selection, the performer may be in a position corresponding to the second standby posture 372 or closer to the second standby posture 372 (from the first standby posture 371). That is, the performer's first posture 3912 may be in a position corresponding to the second standby posture 372 at the time of receiving the input of the user's selection.

From time t21 to time t22, the second connected video C12 is provided. Specifically, the connected video may change depending on the time when the selection S1 is input (or the posture of the performer at the time when the selection S1 is input). In FIGS. 8 and 9, since the performer's first posture 3912 is in a position corresponding to the second standby posture 372, the second connected video C12 is provided.

The second connected video C12 smoothly connects the idle video I0 and the branched video A1 (provided from the time t22). Here, in the second connected video C12, the performer (of the idle video) moves from the second standby posture 372 to the second posture 381 at the start (of the branch video A1) (see drawing reference numeral 392).

Referring to FIGS. 5 to 9, at least a part of the performer is computer-graphically processed in the connected video (C11 or C12), and the performer performs the connecting operation (see 391, 392). The first posture (3911 or 3912) of the performer at the time of receiving the input of the selection S1 is smoothly connected to the second posture 381 of the performer at the start of the branch image A1.

On the other hand, a large number of linked images (C11 or C12) are prepared in advance (for example, they are stored in the memory 270 of FIG. 2). That is, since it is not known when the user's selection S1 is input during the process of providing the standby video, a large number of linked videos (eg, C11 or C12) are stored for smooth coupling to the branched video A1. ing.

5 to 9 have been described based on only two connected images (C11 or C12), but the present invention is not limited to this. That is, three or more connected images may be prepared. For example, there may be a third standby posture between the first standby posture 371 and the second standby posture 372. That is, in the idle image, the performer moves from the first standby posture 371 to the second standby posture 372 through the third standby posture, and conversely moves from the second standby posture 372 to the first standby posture 371 through the third standby posture. obtain. When the input from the user is received, it is checked which of the first standby posture 371, the second standby posture 372, and the third standby posture is the closest to the performer's posture at the time of receiving the input. The first connected video C11 moves from the first standby posture 371 to the second posture 381, the second connected video C12 moves from the second standby posture 372 to the second posture 381, and the third connected video moves from the third standby posture to the second. It can move to posture 381. As a result of the check, if the posture of the performer is most similar to the third standby posture at the time of receiving the input from the user, the third connected video may be provided after the idle video I0.

If the user's selection S1 is input while the idle video I0 is being provided and immediately jumps to the branch video A1 without the connected video (C11 or C12), the last scene of the idle video I0 (that is, selection). The difference between the posture of the performer at the time of receiving the input of (that is, the posture at the start of the branch video A1) and the scene at the start of the branch video A1 (that is, the posture at the start of the performer) may be large. In such cases, the user (ie, spectator) immersiveness in the interactive virtual reality content is reduced.

On the other hand, when the user's selection S1 is input while the idle video I0 is being provided, but the user moves to the branch video A1 after showing the idle video I0 to the end, the user immediately selects his / her selection S1. It is considered that the reaction of the performer is too slow. Even in such a case, the user (that is, the audience) is less immersive in the interactive virtual reality content.

Therefore, in the method of providing the interactive virtual reality content according to some embodiments of the present invention, when the user's selection S1 is input while the idle video I0 is being provided, the screen is immediately changed (that is, the connected video). (C11 or C12) can be provided) to allow the user to feel that his or her selection S1 is reflected immediately. Further, the connected video (C11 or C12) is the last scene of the idle video I0 (that is, the posture of the performer at the time of receiving the input of selection) and the scene at the start of the branched video A1 (that is, the performer's posture). By smoothly connecting the postures at the start point), the unnaturalness that occurs when the image jumps can be removed (see 391 in FIG. 6 and 392 in FIG. 8).

Further, the method of creating the connected video (C11 or C12) can be variously performed by using computer graphic processing.

Against the background of a monochromatic screen (for example, a green screen or a blue screen), the performer performs in advance from the first standby posture 371 to the second posture 381 or from the second standby posture 372 to the second posture 381. A large number of connected images (C11 or C12) are produced using such performance.

Further, since the virtual reality content has a sense of depth (depth) unlike a normal 2D image, if the branch image A1 is immediately connected to the idle image I0, a sense of incongruity (unnaturalness) occurs. For example, the clothes of the performer of the idol image I0 (creases, flow, etc.) and the clothes of the performer of the branch image A1 (creases, flow, etc.) do not match, which causes a sense of discomfort (unnaturalness). Therefore, the performer is computer-graphically processed by the linked video (C11 or C12) to smoothly connect the idle video I0 and the linked video (C11 or C12) or the linked video (C11 or C12) and the branched video A1. do. In particular, the clothes (creases, flows, etc.) of the performer in the connected video (C11 or C12) are made to smoothly match the clothes in the other video (I0 or A1). In addition, the performer's clothes (creases, flows, etc.) in the connected image (C11 or C12) can be dissolved in the clothes in another image (for example, A1).

Hereinafter, a method for determining which of the large number of connected images to be provided will be provided with reference to FIGS. 10 to 12 will be specifically described.

FIG. 10 is a flowchart for explaining a method of providing interactive virtual reality content according to an embodiment of the present invention. For convenience of explanation, substantially the same contents as those described with reference to FIGS. 4 to 9 will be omitted. In FIG. 10, it is assumed that when the performer in the idle image performs the standby motion, the standby motion moves between the first standby posture (see 371 in FIG. 5) and the second standby posture (see 372 in FIG. 5). do.

Referring to FIG. 10, an idle image is provided after the previous image is provided. While the idle video is being provided, the user inputs the selection S1 corresponding to the option. The posture of the performer at the time of receiving the input of the selection S1 (that is, the first posture (3911 or 3912)) is checked (S410). It is determined whether or not the posture of the performer at the time of receiving the input of the selection S1 is similar to the first standby posture 371 (S420).

Specifically, there are various methods for checking the posture of the performer (that is, the first posture) at the time when the input of the selection S1 is received.

For example, by calculating the similarity between the first posture and the first standby posture 371 and the similarity between the first posture and the second standby posture 372 by image analysis, which standby posture (371) is the first posture. Or it can be determined whether it is similar to 372).

Alternatively, when the performer in the idle video is in the first standby posture 371, the corresponding first time stamp, the time interval between the first standby posture 371 and the second standby posture 372, and the time when the input of the selection S1 is received. Judgment is made by comparing the second time stamps of. For example, the first time stamp is 1:10:10, and the time interval between the first standby posture 371 and the second standby posture 372 is 10 seconds. That is, the time for the performer to enter the second standby posture 372 is expected to be 1:10:20. Here, when the second time stamp is 1:10:16, the first posture is changed from the first standby posture 371 to the second standby posture 372 because it is closer to 1:10:20 than 1:10:10. It can be judged that they are more similar.

When the posture of the performer at the time of receiving the input of the selection S1 is similar to the first standby posture 371, the first connected video C11 is provided (S451).

If the posture of the performer at the time of receiving the input of the selection S1 is not similar to the first standby posture 371 (that is, if it is similar to the second standby posture 372), the second connected video C12 is provided (that is, if it is similar to the second standby posture 372). S452).

FIG. 11 is a flowchart for explaining a method of providing interactive virtual reality content according to another embodiment of the present invention. For convenience of explanation, substantially the same contents as those described with reference to FIGS. 4 to 10 will be omitted. In FIG. 11, there may be a third standby posture between the first standby posture 371 and the second standby posture 372. That is, in the idle image, the performer moves from the first standby posture (see 371 in FIG. 5) to the second standby posture (see 372 in FIG. 5) through the third standby posture, and conversely, from the second standby posture 372 to the second. It moves to the first standby posture 371 through the three standby postures.

Referring to FIG. 11, an idle image is provided after the previous image is provided. While the idle video is being provided, the user inputs the selection S1 corresponding to the option. The posture of the performer at the time of receiving the input of selection S1 is checked (S410).

It is determined whether or not the posture of the performer at the time of receiving the input of the selection S1 is similar to the first standby posture 371 (S420).

When the posture of the performer at the time of receiving the input of the selection S1 is similar to the first standby posture 371, the first connected video C11 is provided (S451).

If the posture of the performer at the time of receiving the input of the selection S1 is not similar to the first standby posture 371, it is determined whether the posture of the performer at the time of receiving the input of the selection S1 is similar to the second standby posture 372. Judgment (S430).

When the posture of the performer at the time of receiving the input of the selection S1 is similar to the second standby posture 372, the second connected video C12 is provided (S452).

If the posture of the performer at the time of receiving the input of the selection S1 is not similar to the second standby posture 372 (that is, if it is similar to the third standby posture), the third connected video is provided (S453). ..

FIG. 12 is a flowchart for explaining a method of providing interactive virtual reality content according to another embodiment of the present invention. For convenience of explanation, substantially the same contents as those described with reference to FIGS. 4 to 11 will be omitted. In FIG. 12, in the idle image, the performer moves from the first standby posture (see 371 in FIG. 5) to the second standby posture (see 372 in FIG. 5) through the third standby posture, and conversely, the second standby posture 372. It moves to the first standby posture 371 through the third standby posture.

Referring to FIG. 12, an idle image is provided after the previous image is provided. While the idle video is being provided, the user inputs the selection S1 corresponding to the option. The posture of the performer at the time of receiving the input of selection S1 is checked (S410).

It is determined whether or not the posture of the performer at the time of receiving the input of the selection S1 moves from the first standby posture 371 (S421). YES means moving from the first standby posture 371 to the third standby posture and / or the second standby posture 372, and NO means moving from the third standby posture and / or the second standby posture 372 to the first standby posture 371. Means to move in the direction of.

Next, if YES in the S421 step, it is examined whether or not to move from the third standby posture to the second standby posture 372 (S423).

If YES in the S423 stage (that is, when moving from the third standby posture to the second standby posture 372), the second connected video C12 is provided (S452). That is, the second connected video C12 including the movement from the second standby posture 372 to the second posture 381 is provided.

If NO in the S423 stage (that is, when moving from the first standby posture 371 to the third standby posture), the third connected video is provided (S453). That is, a third connected image including moving from the third standby posture to the second posture 381 is provided.

On the other hand, if NO in the S421 stage, it is examined whether or not to move from the second standby posture 372 to the third standby posture (S422).

If YES in the S422 step (that is, when moving from the second standby posture 372 to the third standby posture), the third connected video is provided (S453). That is, a third connected image including moving from the third standby posture to the second posture 381 is provided.

If NO in the S422 stage (that is, when moving from the third standby posture to the first standby posture 371), the first connected video is provided (S451). That is, the first connected video C11 including the movement from the first standby posture 371 to the second posture 381 is provided.

The reason for doing this is as follows. For example, the selection S1 is input while the performer is moving from the first standby posture 371 to the third standby posture. Even if the posture of the performer at the time when the selection S1 is input is closer to the first standby posture 371, the first connected image C11 (that is, the movement from the first standby posture 371 to the second posture 381) is not provided. The third connected image (that is, the movement from the third standby posture to the second posture 381) is provided. In this way, the connected video (that is, the movement from the third standby posture to the second posture 381) is provided according to the movement direction of the performer (that is, the movement from the first standby posture 371 to the third standby posture). Therefore, the user feels the reaction of the performer naturally.

FIG. 13 is a diagram for explaining a method of providing virtual reality content according to another embodiment of the present invention.

Referring to FIG. 13, the performer in the idle image repeatedly moves from the first standby posture 371 to the second standby posture 372, and then returns from the second standby posture 372 to the first standby posture 371.

Unlike the above-mentioned contents, even if the performer in the idle video is closer to the second standby posture 372 than the first standby posture 371 at the time of receiving the input of the selection S1, the performer in the idle video is in the first standby. Return to posture 371. After returning to the first standby posture 371, the first connected image (that is, the movement from the first standby posture 371 to the second posture 381) is provided.

Here, the first connected image C11 may further include computer graphic processing for dissolving the clothes of the performer in the first standby posture 371 to the clothes of the performer in the second posture 381. As described above, even if the clothes in the first standby posture 371 and the clothes in the second posture 381 are the same type of clothes, the folds, the flow, and the like may be different. Therefore, by making the folds, the flow, and the like the same, the connection to the branch image A1 can be made smoother.

In addition, the operating characteristics of the performer in the start section of the branched video can be further checked. Depending on the operating characteristics, the area of the garment in the performer's first standby posture 371 to which the dissolve is first applied can be changed.

Specifically, for example, the performer can move to the right in the start section of the branched video. In such a case, the dissolve can be applied first from the right side portion of the clothes in the first standby posture 371. In FIG. 13, the dissolve is applied in the order of the right side portion 399a, the central portion 399b, and the left side portion 399c. Generally, the user (audience) pays more attention to the direction in which the performer moves. Therefore, when the dissolve is applied from the direction in which the performer moves, the user (audience) can feel the connection to the branch video A1 more smoothly.

An embodiment of the present invention has been described with reference to the above and the accompanying drawings, but a person having ordinary knowledge in the technical field to which the present invention belongs does not change the technical idea or essential features of the present invention. It is possible to understand that it can be carried out in a concrete form of. Therefore, it should be understood that the above embodiment is exemplary in all respects and is not limiting.

100 User device 200 Content provider 230 Communication module 260 Processor 270 Memory 250 Network

Claims (8)

In the method of providing interactive virtual reality content performed by computing devices
An idle image including options is provided, and the performer in the idle image performs a standby operation of moving from the first standby posture to the second standby posture.
A stage in which the performer receives an input of a selection corresponding to the option from the user while the performer performs the standby operation.
After receiving the input of the selection, the stage of providing the linked video and
Including the step of providing the corresponding branched video according to the user's selection after providing the linked video.
In the connected video, at least a part of the performer is computer-graphically processed, and the branch video is started from the first posture of the performer at the time when the performer performs the connection operation to receive the input of the selection. To be smoothly connected to the second posture of the performer at the time,
It further includes the step of storing a large number of the linked images.
Many of the linked images
A first connected image including the performer moving from the first standby posture to the second posture, and
A method of providing interactive virtual reality content, which includes a second connected video including the performer moving from the second standby posture to the second posture. It further includes the step of checking the first posture of the performer at the time of receiving the input of the selection.
The interactive virtual reality according to claim 1, wherein the step of providing the connected video includes selectively providing the first connected video or the second connected video according to the checked first posture. How to provide content. The step of checking the first posture of the performer is between the first time stamp corresponding to the time when the performer in the idle image is in the first standby posture, and between the first standby posture and the second standby posture. 2. The method of providing interactive virtual reality content according to claim 2, wherein the time interval of the above and a second time stamp at the time of receiving the input of the selection are used. In the method of providing interactive virtual reality content performed by computing devices
An idol image including options is provided, but the performer in the idol image is in the stage of performing a standby operation.
A stage in which the performer receives an input of a selection corresponding to the option from the user while the performer performs the standby operation.
After receiving the input of the selection, the stage of providing the linked video and
Including the step of providing the corresponding branched video according to the user's selection after providing the linked video.
In the connected video, at least a part of the performer is computer-graphically processed, and the branch video is started from the first posture of the performer at the time when the performer performs the connection operation to receive the input of the selection. To be smoothly connected to the second posture of the performer at the time,
The performer in the idle image moves from the first standby posture to the second standby posture, and then returns from the second standby posture to the first standby posture.
Even if the performer in the idle video is closer to the second standby posture than the first standby posture at the time of receiving the input of the selection, the performer in the idle video returns to the first standby posture. ,
A method of providing interactive virtual reality content that provides the connected video after returning to the first standby posture. The interactive virtual reality content according to claim 4, wherein the connected video includes dissolving the clothes of the performer in the first standby posture to the clothes of the performer in the second posture. Providing method. Further including a step of checking the motion characteristics of the performer in the start section of the branch video.
The method for providing interactive virtual reality content according to claim 5, wherein the area of the clothes of the performer in the first standby posture to which the dissolve is first applied is changed according to the operating characteristics. Including memory and processor
The memory provides an idle image in which the processor includes choices, but the performer in the idle image performs a standby operation of moving from a first standby position to a second standby position.
While the performer is performing the standby operation, the user receives an input of a selection corresponding to the option, and the performer receives an input of a selection corresponding to the option.
After receiving the input of the selection, the concatenated video is provided.
After providing the linked video, the corresponding branched video is provided according to the user's selection.
In the connected video, at least a part of the performer is computer-graphically processed, and the branch video is started from the first posture of the performer at the time when the performer performs the connection operation to receive the input of the selection. Includes instructions to ensure a smooth connection to the performer's second posture at the time.
The memory stores a large number of the connected images and
A large number of the connected images include a first connected image including the performer moving from the first standby posture to the second posture, and the performer moving from the second standby posture to the second posture. Including the second connected video including
The memory checks the performer's first posture at the time the processor receives the input of the selection.
Including an instruction to selectively provide the first connected image or the second connected image according to the checked first posture.
A device that provides interactive virtual reality content. Including memory and processor
The memory provides an idle image in which the processor includes choices, while the performer in the idle image performs a standby operation.
While the performer is performing the standby operation, the user receives an input of a selection corresponding to the option, and the performer receives an input of a selection corresponding to the option.
After receiving the input of the selection, the concatenated video is provided.
After providing the linked video, the corresponding branched video is provided according to the user's selection.
In the connected video, at least a part of the performer is computer-graphically processed, and the branch video is started from the first posture of the performer at the time when the performer performs the connection operation to receive the input of the selection. Includes instructions to ensure a smooth connection to the performer's second posture at the time.
The performer in the idle image moves from the first standby posture to the second standby posture, and then returns from the second standby posture to the first standby posture.
In the memory, even if the performer in the idle video is closer to the second standby posture than the first standby posture at the time when the processor receives the input of the selection, the performer in the idle video is said to be said. Return to the 1st standby position,
After returning to the first standby posture, the connected video is provided, and the connected video dissolves the clothes of the performer in the first standby posture into the clothes of the performer in the second posture. Including instructions including dissolve),
A device that provides interactive virtual reality content.

Images