KR20230133624A - Method for interaction between vr device and object in virtual reality - Google Patents

Abstract

The present invention relates to a method by which a VR device can interact with objects provided in a virtual space synchronized with the real space. A method of interaction between a VR device and an object in a virtual space according to an embodiment of the present invention includes outputting a virtual space synchronized with a real space and a plurality of objects in the virtual space to a VR device, based on location information of the VR device. It includes determining a target object among the plurality of objects and, when a request signal is received from the VR device, outputting an interaction event corresponding to the target object to the VR device.

Description

How VR devices and objects interact in virtual space {METHOD FOR INTERACTION BETWEEN VR DEVICE AND OBJECT IN VIRTUAL REALITY}

The present invention relates to a method for a VR device to interact with objects provided in a virtual space synchronized with the real space.

Virtual Reality is a technology that allows people to have a realistic experience in a virtual world created by a computer.

Technology that combines virtual reality (VR) and augmented reality (AR), a technology that adds virtual information to the real world, is called mixed reality (MR). VR, AR, and MR all have something in common in that they are technologies that create a reality that does not actually exist and allow people to perceive it. However, AR is a method of adding virtual information to actual reality, and VR is different in that both present fictional situations.

Recently, technology has been developed that allows users to virtually experience industrial sites, preliminary training, and exhibition halls using VR.

For example, a virtual reality-based training simulator that creates a virtual environment identical to the actual work environment at an industrial site, minimizes safety accidents that occur due to problems arising in the created virtual environment, and allows workers to perform training. are being developed.

However, existing VR technology in industrial sites only allows users to simply experience VR content in a single, predetermined scenario, and has limitations in reflecting various situations and characteristics in industrial sites. At the same time, multiple users cooperate to experience virtual situations. There is a problem that it cannot be done.

Republic of Korea Patent Publication No. 10-2020-0114856

The purpose of the present invention is to enable a user wearing a VR device to interact with various objects provided in a virtual space.

Additionally, the purpose of the present invention is to allow multiple users to interact with one object simultaneously.

The objects of the present invention are not limited to the objects mentioned above, and other objects and advantages of the present invention that are not mentioned can be understood by the following description and will be more clearly understood by the examples of the present invention. Additionally, it will be readily apparent that the objects and advantages of the present invention can be realized by the means and combinations thereof indicated in the patent claims.

An interaction method between a VR device and an object in a virtual space according to an embodiment of the present invention for achieving the above-described object includes outputting a virtual space synchronized with a real space and a plurality of objects in the virtual space to the VR device, It includes determining a target object among the plurality of objects based on the location information of the VR device, and outputting an interaction event corresponding to the target object to the VR device when a request signal is received from the VR device. Do it as

A method of interaction between a VR device and an object in a virtual space according to another embodiment of the present invention includes a virtual space synchronized with a real space and a plurality of objects within the virtual space in a virtual space streaming system including a first and a second VR device. Outputting an object to the first and second VR devices, determining a target object among the plurality of objects based on the location information of the first and second VR devices, receiving a request signal from the first VR device When received, outputting an interaction event corresponding to the target object to the first and second VR devices, granting control authority to at least one of the first and second VR devices, and the VR device to which the control authority has been granted. When a control signal is received from, controlling the interaction event according to the control signal.

According to the present invention, by allowing a user wearing a VR device to interact with various objects provided in a virtual space, there is an effect of arousing interest by providing a variety of experiences to the user.

According to the present invention, there is an effect of fostering cooperation between users by allowing multiple users to interact with one object at the same time.

In addition to the above-described effects, specific effects of the present invention are described below while explaining specific details for carrying out the invention.

1 is a diagram illustrating an interaction system according to an embodiment of the present invention.
Figure 2 is a flowchart showing an interaction method between a VR device and an object in a virtual space according to an embodiment of the present invention.
Figure 3 is a diagram illustrating an example of a virtual space synchronized with a real space.
Figure 4 is a diagram illustrating an example of a virtual space output from a VR device.
Figure 5 is a flowchart showing an interaction method between a VR device and an object in a virtual space according to another embodiment of the present invention.
Figure 6 is a diagram showing each user interacting with a target object through a plurality of VR devices.

The above-mentioned objects, features, and advantages will be described in detail later with reference to the attached drawings, so that those skilled in the art will be able to easily implement the technical idea of the present invention. In describing the present invention, if it is determined that a detailed description of known technologies related to the present invention may unnecessarily obscure the gist of the present invention, the detailed description will be omitted. Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the attached drawings. In the drawings, identical reference numerals are used to indicate identical or similar components.

In this specification, first, second, etc. are used to describe various components, but of course, these components are not limited by these terms. These terms are only used to distinguish one component from another component, and unless specifically stated to the contrary, the first component may also be a second component.

Additionally, in this specification, when a component is described as being “connected,” “coupled,” or “connected” to another component, the components may be directly connected or connected to each other, but there are other components between each component. It should be understood that elements may be “interposed,” or each component may be “connected,” “combined,” or “connected” through other components.

Additionally, as used herein, singular expressions include plural expressions, unless the context clearly dictates otherwise. In the present application, terms such as “consists of” or “comprises” should not be construed as necessarily including all of the various components or steps described in the specification, and some of the components or steps may include It may not be included, or it should be interpreted as including additional components or steps.

In addition, in this specification, when referring to "A and/or B", this means A, B or A and B, unless otherwise specified, and when referring to "C to D", this means unless specifically stated to the contrary. Unless otherwise stated, it means C or higher and D or lower.

The present invention relates to a system and method that allows a VR device to interact with objects provided in a virtual space synchronized with the real space.

Hereinafter, a method of interacting between a VR device and an object in a virtual space according to an embodiment will be described in detail with reference to FIGS. 1 to 4.

FIG. 1 is a diagram showing an interaction system according to an embodiment of the present invention, and FIG. 2 is a flowchart showing an interaction method between a VR device and an object in a virtual space according to an embodiment of the present invention.

FIG. 3 is a diagram illustrating a virtual space synchronized with a real space, and FIG. 4 is a diagram illustrating an exemplary virtual space output from a VR device.

Referring to FIG. 1, the interaction system 10 according to an embodiment of the present invention may include a server 100 and a VR device 200. The server 100 may receive location information and a request signal from the VR device 200 and output an interaction event back to the VR device 200 based on this. Meanwhile, the VR device 200 can be worn on the user's face and allow the user to view the virtual space and objects output from the server 100.

Referring to FIG. 2, the interaction method between the VR device 200 and objects in a virtual space according to an embodiment of the present invention outputs a virtual space synchronized with the real space and a plurality of objects in the virtual space to the VR device 200. A step (S100), a step of determining a target object among the plurality of objects based on the location information of the VR device 200 (S200), and when a request signal is received from the VR device 200, an interaction event corresponding to the target object It may include a step (S300) of outputting to the VR device 200.

Each step shown in FIG. 2 can be performed by the server shown in FIG. 1, and the server 100 uses application specific integrated circuits (ASICs), digital signal processors (DSPs), and DSPDs (ASICs) to perform operations described later. At least one physical device among digital signal processing devices (PLDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, processors, microprocessors, and micro-controllers. May contain elements.

However, the method of interaction between the VR device 200 and objects in the virtual space shown in FIG. 2 is according to one embodiment, and the steps forming the invention are not limited to the embodiment shown in FIG. 2, and some may be used as necessary. Steps may be added, changed, or deleted.

Referring to FIG. 3, the server 100 can output a virtual space synchronized with the real space and a plurality of objects within the virtual space to the VR device 200 (S100). Assuming that (a) in FIG. 3 is a real space and (b) in FIG. 3 is a virtual space synchronized with the real space, the server 100 configures the structure of the real space as shown in FIG. 3 (a) in FIG. 3 ( As shown in b), it can be synchronized to the virtual space and output to the VR device 200 worn by the user. In other words, real space and virtual space can have the same area and structure.

Next, the server 100 can set a plurality of interactive objects in the virtual space. Objects can be provided in various ways depending on the virtual space concept set by the user. For example, in FIG. 4 , when the user sets the virtual space as a museum, the server 100 may set objects as exhibits such as statues and relics. In addition, as the virtual space is set up like an exhibition or educational environment, the server 100 can set various objects appropriate for it.

The server 100 may determine a target object among a plurality of objects based on the location information of the VR device 200 (S200).

The server 100 can determine the user's location information by receiving the user's current location, movement direction, and movement speed from a location sensor (not shown) provided in the VR device 200. Next, the server 100 may identify an object located within a preset distance from the VR device 200 among the plurality of objects based on the location information, and determine the identified object as the target object. For example, the server 100 may identify an object located within a preset radius (eg, 1 m) around the VR device 200 and determine it as the target object.

As another example of a method for the server 100 to determine a target object that can interact with the VR device 200 among a plurality of objects, the server 100 may first set a designated range corresponding to each of the plurality of objects in the virtual space. there is. Afterwards, if the location information of the VR device 200 is within the designated range, the object corresponding to the designated range can be determined as the target object.

4 as an example, the server 100 may preset a designated range (eg, 1 m nearby or a designated location) for each of the plurality of objects. Thereafter, when the location information of the VR device 200 is recognized in the designated range (Ar) corresponding to the object (A), the server 100 may determine the object (A) as the target object.

Next, when a request signal is received from the VR device 200, the server 100 may output an interaction event corresponding to the target object to the VR device 200 (S300).

As an example, a request signal may be generated when a target object is output to the VR device 200 for more than a preset time. For example, in a virtual space set as a museum, when a user wears the VR device 200 and gazes at the object A for more than a preset time (e.g., 10 seconds), a request signal for the object A may be generated. there is.

As another example, a request signal may be generated when a user wearing the VR device 200 selects a target object with a controller. For example, when a user wears the VR device 200 in a virtual space set as a museum and selects a target object with a controller linked to the VR device 200, a request signal for the object (A) may be generated. . At this time, the controller may be in the form of a joystick, and may be output as selection symbols such as a cursor or point in the field of view of the user wearing the VR device 200.

As another example, the request signal may be generated when the location of the VR device 200 and the location of the target object are within a preset distance for a preset time. For example, in a virtual space set as a museum, when the user wears the VR device 200 and stays within a preset distance (e.g., 1 m) of the object (A) for a preset time (e.g., 5 seconds), the object (A) ) A request signal can be generated.

When a request signal is generated in the VR device 200 according to the above-described method, the server can receive the request signal from the VR device 200 and output an interaction event corresponding to the target object to the VR device 200. there is.

When outputting an interaction event corresponding to a target object to the VR device 200, the server 100 may output pre-stored information about the target object as at least one of sound and video.

Specifically, interaction events corresponding to each object may be previously stored in the server in the form of at least one of sound and video. For example, an interaction event for the object A may be a description of the object A, and the description may be previously stored on the server in the form of sound or video. Accordingly, when a request signal is received from the VR device 200, the server can output a description of the target object in audio or video to the VR device 200.

Next, with reference to FIGS. 4 to 6, an interaction method between a VR device and an object in a virtual space according to another embodiment of the present invention will be described in detail.

Figure 5 is a flowchart showing an interaction method between a VR device and an object in a virtual space according to another embodiment of the present invention. Additionally, FIG. 6 is a diagram showing each user interacting with a target object through a plurality of VR devices 200.

Referring to FIG. 5, the method of interaction between a VR device and an object in a virtual space includes a virtual space synchronized with the real space and a plurality of objects within the virtual space in the virtual space streaming system 10 including the first and second VR devices. Outputting an object to the first and second VR devices (S400), determining a target object among a plurality of objects based on the location information of the first and second VR devices (S500), request from the first VR device When a signal is received, outputting an interaction event corresponding to the target object to the first and second VR devices, granting control authority to at least one of the first and second VR devices (S600), and VR to which control authority has been granted When a control signal is received from the device, it may include controlling the interaction event according to the control signal (S700).

However, the method of interaction between a VR device and an object in the virtual space shown in FIG. 5 is according to one embodiment, and the steps forming the invention are not limited to the embodiment shown in FIG. 5, and some steps are added as needed. It may be changed or deleted.

Elements that perform the same functions as in the previously shown drawings are denoted by the same reference numerals, and operations of components not described below should be understood as the same as the operations described above in one embodiment. Meanwhile, each step shown in FIG. 5 can be performed by the server 100 like the steps shown in FIG. 1.

Hereinafter, each step shown in FIG. 5 will be described. In the virtual space streaming system 10 including the first and second VR devices, a virtual space synchronized with the real space and a plurality of objects in the virtual space can be output to the first and second VR devices ( S400). In other words, multiple users, each wearing a VR device, can exist simultaneously within the virtual space.

The server 100 can synchronize the structure of the real space and the virtual space and set a plurality of interactive objects in the virtual space.

The server 100 may determine a target object among a plurality of objects based on the location information of the first and second VR devices (S500). To be more specific, the server 100 may receive each location information from the location sensors provided in the first and second VR devices. Thereafter, the server 100 may identify objects located within a preset distance from both the first and second VR devices based on the location information, and determine the identified objects as target objects.

Meanwhile, two designated ranges corresponding to a plurality of objects may be set in advance in the virtual space. At this time, if the location information of the first VR device is within one of the two designated ranges and the location information of the second VR device is within the other one of the two designated ranges, the server 100 creates objects corresponding to the two designated ranges. It can be determined by the target object.

Referring again to FIG. 4, the two designated ranges corresponding to the object B may be Br1 and Br2, respectively. At this time, the location information of the first VR device may be within Br1, and the location information of the second VR device may be within Br2. In this case, the server 100 may determine object B as the target object.

When a request signal is received from the first VR device, the server 100 outputs an interaction event corresponding to the target object to the first and second VR devices, and grants control authority to at least one of the first and second VR devices. You can do it (S600).

For example, in the first and second VR devices, a request signal may be generated when the target object is output for more than a preset time. For example, in a virtual space set as a practice site, when two users wear the first and second VR devices respectively and gaze at the target object simultaneously for more than a preset time (e.g. 5 seconds), a request signal for the object may be generated. there is.

As another example, in the first and second VR devices, a request signal may be generated when the first user and/or the second user wearing the first and second VR devices select the target object with a controller. For example, when one or more of the two users wearing the first and second VR devices in a virtual space set as a practice site selects a target object with a controller linked to the first and second VR devices, respectively, the object A request signal may be generated.

As another example, a request signal may be generated in the first and second VR devices when the positions of the first and second VR devices and the position of the target object are within a preset distance for a preset time. For example, in a virtual space set as a practice site, when two users wear the first and second VR devices respectively and stay within a preset distance (e.g., 1 m) from the target object for a preset time (e.g., 5 seconds) A request signal for an object may be generated.

When a request signal is generated from the first and/or second VR device according to the above-described method, the server 100 may receive the request signal from the first and/or second VR device and create an interaction corresponding to the target object. Events can be output to both the first and second VR devices.

When outputting an interaction event corresponding to a target object to a VR device, the server 100 may output pre-stored information about the target object as at least one of sound and video.

Additionally, the server 100 may grant request signal control authority to at least one of the first and second VR devices, and when a control signal is received from a VR device to which control authority has been granted, the server 100 may control the interaction event according to the control signal. (S700). Hereinafter, for convenience of explanation, it is assumed that there are multiple second VR devices.

Referring to FIG. 6, the server 100 may grant control rights to the first VR device (T) and non-control rights to the second VR devices (S1 to S4). Let us assume that the first VR device (T) is an educator and the second to fifth VR devices (S1 to S4) are students. When the server 100 grants control rights to the object O to the first VR device T, only the first VR device T, which is an educator, can control the interaction event, and the second to third VR devices, which are students, can control the interaction event. 5 VR devices (S1~S4) may not be able to control interaction events.

In a specific example, in a virtual environment for frog dissection practice, only an educator can transmit a control signal to the server 100 through the first VR device (T), and the server 100 controls the interaction event according to the control signal. Thus, the image of the frog being dissected can be output to the first and second VR devices (T, S1 to S4). At this time, a signal indicating that control is currently being performed in the first VR device (T) may be output to the second VR devices (S1 to S4).

Meanwhile, the server 100 can grant control authority to the second VR devices (S1 to S4) when a permission request signal for the second VR devices (S1 to S4) is received from the first VR device (T). there is. For example, when the educator transmits an authority request signal for the second VR device (S1 to S4) of the student to the server 100 through the first VR device (T), the server 100 sends the second VR device ( Control authority can also be granted to S1 to S4), and then the second VR device (S1 to S4) can also transmit a control signal to the server 100.

In a specific example, after the educator transmits a control signal to the server 100 through the first VR device (T), the process of dissecting the frog is output to the first and second VR devices (T, S1 to S4), For students' practice, the educator may transmit an authority request signal for the second VR devices (S1 to S4) to the server 100. Accordingly, the server 100 can also grant control authority to the second VR devices (S1 to S4), and finally the student can control the interaction event through the second VR devices (S1 to S4).

As another example, when a first control signal is received from the first VR device (S1) and a second control signal is received from the second VR devices (S1 to S4), the interaction event is performed according to the first and second control signals. You can control it. At this time, assuming that the first VR device (S1) is the first student and the second VR device (S2) is the second student, both the first VR device (S1) and the second VR device (S2) are involved in the same interaction event. The server 100 can control the interaction event only when the first and second control signals are transmitted.

For example, in a task where frog skin must be pulled from both sides to dissect a frog, the first student may transmit a first control signal to pull the skin to the left through the first VR device (S1), and the second student may transmit the first control signal to pull the skin to the left through the first VR device (S1). Can transmit a second control signal to pull the skin to the right through the second VR device (S2). The server 100 controls the interaction event when the first and second control signals are received from the first and second VR devices (S1, S2), respectively, to display the frog being dissected through the first and second VR devices (S1, S2). It can be output to S1, S2).

As another example, if a second control signal is received from the second VR device (S2) while the first control signal is being received from the first VR device (S1), the interaction event is controlled according to the first and second control signals. can do.

Specifically, the first control signal and the second control signal may be signals transmitted over a continuous period of time, and the server 100 controls the interaction event only when one control signal is received while the other control signal is received. can do. In the above example, while the first student is transmitting a first control signal for pulling the skin to the left through the first VR device (S1) for a continuous period of time, the second student uses the second VR device (S2) When a second signal for pulling the skin to the right is transmitted, the server 100 can output an image of a frog being dissected to the first and second VR devices (S1 and S2) by controlling the interaction event.

As described above, the present invention has been described with reference to the illustrative drawings, but the present invention is not limited to the embodiments and drawings disclosed herein, and various modifications may be made by those skilled in the art within the scope of the technical idea of the present invention. It is obvious that transformation can occur. In addition, although the operational effects according to the configuration of the present invention were not explicitly described and explained while explaining the embodiments of the present invention above, it is natural that the predictable effects due to the configuration should also be recognized.

Claims (19)

Outputting a virtual space synchronized with the real space and a plurality of objects within the virtual space to a VR device;
determining a target object among the plurality of objects based on location information of the VR device; and
When a request signal is received from the VR device, outputting an interaction event corresponding to the target object to the VR device.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The step of outputting the plurality of objects to the VR device is
synchronizing the structure of the real space and the virtual space; and
Including setting a plurality of interactive objects in the virtual space.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The step of determining the target object is
Receiving the location information from a location sensor provided in the VR device; and
Identifying an object located within a preset distance from the VR device based on the location information, and determining the identified object as a target object.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
In the virtual space, a designated range corresponding to each of the plurality of objects is set,
The step of determining the target object is
If the location information is within the designated range, determining an object corresponding to the designated range as the target object.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The request signal is generated when the target object is output to the VR device for more than a preset time.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The request signal is generated when a user wearing the VR device selects the target object with a controller.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The request signal is generated when the location of the VR device and the location of the target object are within a preset distance for a preset time.
Method of interaction between VR devices and objects in virtual space.
According to paragraph 1,
The step of outputting the interaction event to the VR device is
Outputting pre-stored information about the target object in at least one of audio and video
Method of interaction between VR devices and objects in virtual space.
In a virtual space streaming system including a first and a second VR device,
outputting a virtual space synchronized with the real space and a plurality of objects within the virtual space to the first and second VR devices;
determining a target object among the plurality of objects based on the location information of the first and second VR devices;
When a request signal is received from the first VR device, outputting an interaction event corresponding to the target object to the first and second VR devices and granting control authority to at least one of the first and second VR devices. ; and
When a control signal is received from the VR device to which the control authority has been granted, controlling the interaction event according to the control signal.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The step of outputting the plurality of objects to the first and second VR devices
synchronizing the structure of the real space and the virtual space; and
Including setting a plurality of interactive objects in the virtual space.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The step of determining the target object is
Receiving location information from location sensors provided in the first and second VR devices; and
Identifying an object located within a preset distance from the first and second VR devices based on the location information, and determining the identified object as a target object.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
In the virtual space, two designated ranges corresponding to each of the plurality of objects are set,
The step of determining the target object is
If the location information of the first VR device is within one of the two designated ranges and the location information of the second VR device is within the other one of the two designated ranges, the object corresponding to the two designated ranges is determined as the target object. containing the steps of
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The request signal is generated when the target object is output to the first and second VR devices for more than a preset time.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The request signal is generated when each user wearing the first and second VR devices selects the target object with a controller.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The request signal is generated when the positions of the first and second VR devices and the position of the target object are within a preset distance for a preset time.
Method of interaction between VR devices and objects in virtual space.
According to clause 9,
The step of granting control authority to at least one of the first and second VR devices is
Comprising the step of granting control rights to the first VR device and granting non-control rights to the second VR device.
Method of interaction between VR devices and objects in virtual space.
According to clause 16,
Further comprising granting control authority to the second VR device when a permission request signal for the second VR device is received from the first VR device.
Method of interaction between VR devices and objects in virtual space.
According to clause 17,
When a first control signal is received from the first VR device and a second control signal is received from the second VR device, the interaction event is controlled according to the first and second control signals.
Method of interaction between VR devices and objects in virtual space.
According to clause 17,
If a second control signal is received from the second VR device while the first control signal is being received from the first VR device, the interaction event is controlled according to the first and second control signals.
Method of interaction between VR devices and objects in virtual space.