WO2018016928A1

WO2018016928A1 - Virtual reality implementation system and virtual reality implementation method thereof

Info

Publication number: WO2018016928A1
Application number: PCT/KR2017/007944
Authority: WO
Inventors: 김계현
Original assignee: 김계현
Priority date: 2016-07-22
Filing date: 2017-07-24
Publication date: 2018-01-25
Also published as: KR101696243B1

Abstract

The present invention relates to a virtual reality implementation system and a virtual reality implementation method thereof. In a virtual reality implementation system of the present invention, an actual object existing in a particular space and a virtual object virtually implemented and expressed in the particular space are displayed on a display panel of a wearable device. The particular space is defined by a plurality of location information transceiving sensors. A server stores, as three-dimensional images, image data of the actual object and image data of the virtual object and provides the image data to a user computer in the particular space. The server determines location information of a wearable device and location information of the actual object within the particular space. Then, when the actual object and the virtual object partially overlap, the server processes images such that the overlapping portion appears hidden or displayed to be seen on the display panel of the wearable device according to the visual field depth between image data of the actual object and image data of the virtual object. According to the present invention, a wearable device can be used in various spaces to express an actual object and a virtual object with a sense of reality, so as to implement a virtual reality and an augmented reality in a combined manner.

Description

Virtual Reality Implementation System and its Virtual Reality Implementation Method

The present invention relates to a virtual reality realization system, and more specifically to realizing a high-resolution virtual space of a work of art through optical images, at the same time to implement a number of galleries and works using location-based information, The present invention relates to a virtual reality realization system and a virtual reality realization method for providing an additional service and enabling virtual advertisements, so that a plurality of galleries and works can be viewed in a specific real space.

In recent years, wearable glasses that can see digital information anytime, anywhere has become lighter, by using it to digital information of virtual space (for example, local information, photos, tweets, maps, advertisements, accommodation, restaurants, Wikipedia, etc.) Attempts to provide users immediately in the field have received much attention.

This can serve as a new media that can replace the portable Internet terminal that is being used as a media of information acquisition.

In other words, it is possible to immediately provide information of interest to users in the field, and can instantly perform life logging services such as Facebook, Twitter, and YouTube anytime, anywhere, and obtain various information easily.

In particular, there is a great need for the development of technologies that provide users with an immersive virtual experience.

To this end, in Republic of Korea Patent No. 10-1106857, as shown in Figure 9, in the gallery system of the virtual space including the gallery providing unit 60, the gallery providing unit 60, the system control program 3D virtual reality program 90 for providing a three-dimensional virtual space gallery in accordance with the control signal of the unit 80; An article selection unit 100 for displaying the selected article in the management server 10 in the gallery of the virtual space according to the control signal of the system control program unit 80; An east-west north-south / up-down key providing unit 110 for adjusting a spatial distance of the gallery of the virtual space; A gallery lending unit 120 of the virtual space that lends the gallery of the virtual space if a request is made to rent the gallery of the virtual space from the affiliated terminal 40; An item seat moving unit 130 for moving the goods displayed in the gallery of the virtual space when there is a request for a seat movement of the displayed goods from the member terminal 30; A cyber money payment unit 140 for charging the cyber money when there is a gallery rental request for the virtual space from the affiliated store terminal 40; When the background music from the member terminal 30 is selected, a 'gallery gallery of virtual space using 3D' has been proposed, which is composed of a background music selection unit 150 for transmitting music.

However, despite the prior art as described above, it was not possible to implement a plurality of galleries and works using location-based information, provide additional services for individual works, and implement virtual advertisements.

SUMMARY OF THE INVENTION An object of the present invention is to provide a virtual reality realization system and a method for implementing virtual reality such that overlapping portions between real objects and virtually implemented virtual objects in a specific space displayed on a wearable device of a user are displayed according to the depth of view of the user. To provide.

Another object of the present invention is to implement a virtual reality system and a method for implementing a virtual reality for realizing a virtual space for an object, such as a work of art, a work of art through an optical image, and at the same time using a location-based information To provide.

It is still another object of the present invention to provide a virtual reality implementation system and a virtual reality implementation method for implementing a virtual military training system using a military drone.

It is still another object of the present invention to provide a virtual reality realization system in which virtual reality and augmented reality are integrated in various fields such as viewing a work, advertising, shopping, sports, military, etc. using a wearable device, and a method of implementing the virtual reality.

In order to achieve the above objects, the virtual reality implementation system of the present invention allows an overlapping portion between a real object and a virtually implemented virtual object in a specific space displayed on the wearable device of the user to be displayed according to the depth of view of the user. There is one characteristic. Such a virtual reality implementation system of the present invention can realistically display the overlapping portions between real objects and virtual objects in a specific space on the display panel of the wearable device.

According to an aspect of the present invention, there is provided a virtual reality implementation system comprising: a display panel including a real object existing in a specific space defined through a plurality of location information transceiving sensors and a virtual object virtually implemented within the specific space. A wearable device wearable by a user; Collecting location information of the real object and location information of the wearable device from the location information transceiving sensor and a plurality of optical motion sensors that detect movement of the user and the real object in the specific space, and transmit the location information to the wearable device; A user computer for transmitting the image data of the virtual object and the image data of the virtual object; The wearable is stored when the image data of the real object and the image data of the virtual object are stored and the location information of the real object and the location information of the wearable device are determined by partially overlapping the real object and the virtual object. The display panel of the device may be configured to display an overlapping portion of the real object and the virtual object located at a short distance with the wearable device according to a depth of view between the image data of the real object and the image data of the virtual object. And a server transmitting image data of the real object and image data of the virtual object to the user computer.

In one embodiment of this aspect, the virtual reality implementation system; At least one three-dimensional optical scanning device scanning the real object to generate three-dimensional image data and outputting three-dimensional image data; The apparatus may further include a rendering computer configured to receive the 3D image data from the 3D optical scanning device and to perform a rendering operation to transmit image data of the real object to the server.

In another embodiment, the virtual reality implementation system; Further comprising a wide-angle IP camera for driving to change the shooting direction in response to the movement of the wearable device under the control of the server; The wearable device displays an image captured by the wide-angle IP camera on the display panel.

In another embodiment, the virtual reality implementation system; The apparatus may further include a plurality of pressure sensors provided on a bottom surface of the specific space to further detect location information of the real object and the wearable device.

In another embodiment, the wearable device; The display apparatus further displays additional information about the real object and the virtual object, and when the additional information is selected, it is connected to an additional service corresponding to the additional information.

In another embodiment, the server; The image data of the real object and the image data of the virtual object are further displayed on the display panel of the wearable device in order to further display the real object and the virtual object in response to a three-dimensional angle of the user's gaze. to provide.

In another embodiment, the position information transmission and reception sensor; It is provided with any one of a GPS device, a communication network base station, a wireless communication repeater and a drone to recognize the location information of the real thing and the wearable device.

According to another feature of the present invention, a virtual reality implementation method of a virtual reality implementation system is provided.

According to an aspect of the present invention, there is provided a virtual reality implementation method of a virtual reality implementation system, comprising: defining a specific space using a plurality of location information transceiving sensors; The location information transmitting and receiving sensor senses the location information of the real thing existing in the specific space and the location information of the wearable device worn by the user having a display panel displaying a virtual object virtually implemented in the specific space. and; The position information of the real object and the position information of the wearable device may be obtained from the position information transceiving sensor and a plurality of optical motion sensors that detect movement of the user and the real object in the specific space through a user computer provided in the specific space. Collect and transmit image data of the real object and image data of the virtual object to the wearable device; When the server determines the positional information of the real object and the positional information of the wearable device in the specific space and the real object and the virtual object partially overlap, the image data of the real object and the image are displayed on the display panel of the wearable device. The overlapping portion of the real object and the virtual object located near the wearable device among the virtual objects is displayed according to the depth of view between the image data of the virtual object, and the image data of the real object and the virtual are displayed to the user computer. Transfer the image data of the object.

In one embodiment of this aspect, the method comprises; Scan the real object through at least one three-dimensional optical scanning device to generate three-dimensional image data and output three-dimensional image data; A rendering computer receives the three-dimensional image data from the three-dimensional optical scanning device and performs a rendering operation to transmit the image data of the real object to the server; The server may further include storing image data of the real object.

As described above, the virtual reality implementation system of the present invention determines the location information of the real object and the location information of the wearable device in a specific space, and when the real object and the virtual object partially overlap, the image of the real object on the display panel of the wearable device. By overlapping or overlapping parts depending on the depth of field of view between the data and the image data of the virtual object, the wearable device can be realistically represented using a wearable device in various spaces. Convergent implementation of augmented reality is possible.

In addition, according to the virtual reality implementation system of the present invention, in particular, as applied to the virtual gallery system, the virtual curator may tell the history of the artist, auction information, the history of the work, the intention of the creation of the work in a narrative manner, wearable device By selecting a menu displayed together on the display panel, the item may be purchased directly, or a virtual advertisement or an actual product advertisement displayed on the display panel may be selected to purchase the corresponding product.

In addition, according to the present invention, by being applied to the guard post, linked to the wearable device, the wide-angle IP camera is activated, the service soldier of the guard post, while not actually going to the outer duty patrol, stays in the guard post, etc. As intended, there is a characteristic effect that the boundary work is possible through the images captured by each wide-angle IP camera.

In addition, according to the present invention, as applied to military drones, it is possible to easily grasp the current position of the enemy and the enemy tank, as well as the direction of attack on the enemy, the future movement path of our allies, or the retreat of the allies. There is another effect that enables rapid and safe unit movement.

1 is an overall schematic diagram showing the configuration of a virtual reality implementation system according to the present invention,

2 is a view showing a user viewing a work by using a wearable device for a real object and a virtual object in a real gallery according to an embodiment of the present invention;

3 is a schematic diagram illustrating that a user utilizes a wearable device with respect to the virtual object illustrated in FIG. 2;

FIG. 4 is a schematic diagram illustrating that depths of view are differently set for real objects and virtual objects in the real gallery shown in FIG. 2;

5 is a schematic view showing that the lens direction of the wide-angle IP camera is driven in the vertical direction in conjunction with the wearable device worn by the user according to another embodiment of the present invention;

6 is a schematic diagram showing the configuration of a virtual reality implementation system using a military drone according to another embodiment of the present invention,

7 is a schematic diagram showing that a close clip plane and a spaced clip plane from a camera are set based on a viewpoint according to the present invention;

8 is a view showing a wearable device in the form of a Google glass according to an embodiment of the present invention, and

9 is a view showing a schematic configuration of a gallery system of a virtual space using 3D according to an embodiment of the prior art.

The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be interpreted as being limited by the embodiments described below. This embodiment is provided to more completely explain the present invention to those skilled in the art. Therefore, the shape of the components in the drawings, etc. have been exaggerated to emphasize a more clear description.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to FIGS. 1 to 8.

1 is an overall schematic diagram showing the configuration of a virtual reality implementation system according to the present invention.

Referring to FIG. 1, in the virtual reality implementation system of the present invention, an optical scan and a three-dimensional image of a subject to represent a virtual object constructed with a real object in order to implement a realistic virtual reality using the wearable device 100 is performed. Process to display the overlapping part of the real object and the virtual object according to the direction of viewing the real object and the virtual object.

To this end, the virtual reality implementation system of the present invention includes a wearable device 100, a user computer 200, a server 300, a rendering computer 400, and a plurality of 3D optical scanning devices 500: 500a and 500b. And an optical IP camera 600. Such a virtual reality implementation system is connected to the Internet using, for example, a wired or wireless communication network, and is connected to enable mutual data communication. Here, the wearable device 100 and the user computer 200 are located in a specific space S1.

The wearable device 100 includes a display panel worn by the user M, a display panel for outputting an image, a microphone for recording voice (for example, a holographic microphone, etc.), a speaker for outputting voice in stereo, headphones, and the like. It is provided. In addition, the wearable device 100 includes various sensors, for example, a wide angle camera, an optical motion sensor, a gyroscope sensor, a position information transceiver, a pupil position tracking device, a pupil contraction / relaxation tracking device, and an illuminance sensor. The wearable device 100 displays an image including a real object and a virtual object according to a virtual reality implemented using a display panel.

The user computer 200 is provided in a specific space S1 (eg, an actual gallery) and is connected to the wearable device 100 through a wireless communication network.

The user computer 200 includes a reader that reads optically readable optical recognition codes (or tags), and an optical motion sensor (eg, a laser motion tracking sensor) within a specific space defined by a plurality of location information transmission and reception sensors. The location information of the wearable device 100 including the position, the direction, and the three-dimensional angle of the wearable device 100 is collected by using.

Here, the reader reads an optical recognition code (or tag) that includes three-dimensional information about all subjects (eg, real objects including objects, creatures, etc.) existing in the defined space.

A plurality of location information transmission / reception sensors are installed in a specific space to define a space, and sense information about the position, direction, and three-dimensional angle of the wearable device 100 existing in the defined space. In addition, the position information transmission and reception sensor detects a straight line distance to the wearable device 100. The optical motion sensor detects information including position, shape, size, volume, etc. in real time for all subjects existing within a defined space. Also, the information detected by the reader and the optical motion sensor is used to correct an error of the subject.

In addition, a specific space is provided with a plurality of pressure sensors on the bottom surface, through which the position of the wearable device and the position of the existing subject are identified and corrected. In addition, a specific space further includes a voice output device capable of independent left and right recording and output, through which outputs all sounds generated from a subject (for example, a real object or a virtual object) existing in the space, thereby positioning the sound source. Information can be measured to convey realistic and three-dimensional voice information.

In addition, the user computer 200 transmits image data and voice data to the wearable device 100 through a wireless communication network. In addition, the user computer 200 receives image data of an actual object and image data of a virtual object from the server 300 through the Internet and provides the image data to the wearable device 100.

The server 300 stores image data of all subjects, that is, real objects and virtual objects, and voice data including sound effects of the real objects and virtual objects for various specific spaces S1 and S2. The server 300 receives and stores image data about an optically scanned real object from a plurality of 3D optical scanning devices 500: 500a and 500b through the Internet. The server 300 transmits image data and voice data to the user computer 200 through the Internet. The server 300 computes a control signal to control the user computer 200, the rendering computer 400, and the wide-angle IP camera 600.

In addition, when the gaze direction of the user is changed from the wearable device 100 through the Internet, the server 300 remotely controls the photographing direction of the wide-angle IP camera 600 to be remotely changed in response thereto, and the image obtained through this is obtained. The data is provided to the wearable device 100.

In addition, the server 300 is connected to the virtual wearable device 100, a mobile terminal, a computer, and the like located in the personal direct viewing space (S2) directly viewed by an individual to provide image data and voice data.

The server 300 receives a variety of information from the user computer 200 through the Internet, information about the position, direction, three-dimensional angle and shape, size of the user and all subjects of the wearable device 100 in a specific space It stores and analyzes in real time to provide an image in which the real and virtual reality is reproduced in real time through the display panel on the wearable device 100 is fused. In addition, the server 300 processes a realistic representation of a real object and a virtual object virtually realized according to the location information, the viewing range, and the depth of each of the waveable device 100 and the subject. In addition, the server 300 processes masking so that a part of a relatively long subject overlaps with a subject in a relatively short distance so as not to be displayed according to a distance of each subject in the field of view to be implemented, or first displays a subject located in a short distance first. do. In addition, the server 300 is a three-dimensional processing of the position and the moving path of the virtually implemented subject in the field of view to be implemented, it is possible to realistically implement the position, three-dimensional angle, perspective effect.

The rendering computer 400 receives the image data of the real object scanned from the 3D optical scanning device 500 through the Internet and converts the 3D image data into 2D image data displayed on the display panel of the wearable device 100. The 3D rendering operation generates a 3D image data value, and transmits the 3D image data to the server 300 through the Internet.

3D optical scanning device 500 is provided with a plurality of scanning the actual object to obtain the three-dimensional image data, and transmits it to the server 300 through the Internet.

The wide-angle IP camera 600 operates according to a driving signal received from the wearable device 100 or the like. The wide-angle IP camera 600 is provided in various spaces and is remotely controlled to change the photographing direction according to the eyeline direction of the wearable device 100 through the server 300 to obtain image data of the corresponding space, and the server 300 To send.

Therefore, the virtual reality realization system of the present invention may implement virtual reality and augmented reality by using the wearable device 100 in various spaces to realistically express real objects and virtual objects.

2 is a view showing a user viewing a work by using a wearable device for a real object and a virtual object in a real gallery according to an embodiment of the present invention, and FIG. 3 is a view of the virtual object shown in FIG. FIG. 4 is a schematic diagram illustrating a user using a wearable device, FIG. 4 is a schematic diagram illustrating that depths of view are differently set for real objects and virtual objects in the actual gallery shown in FIG. 2, and FIG. It is a schematic diagram which shows that the proximity clip surface and the spaced clip surface from the camera are set based on the viewpoint according to the invention.

First, referring to FIGS. 2 to 4, in this embodiment, the specific space S1 is an actual gallery, and defines the space by the plurality of location information transceiving sensors L1 to L8. In addition, the user M wearing the wearable device 100 in the specific space S1 is disposed in the specific space S1 with a plurality of optical motion sensors I1 to I15 spaced apart at regular intervals along the edge of the prescribed space. And position information on the actual object (R). In addition, the bottom surface of the specific space (S1) is provided with a pressure sensor (P1) to detect the user's position, movement, and the like. In this embodiment, the location information transceiving sensors L1 to L8 are provided with, for example, a Bluetooth becon.

Specifically, the actual gallery S1 is defined as a predetermined space, and location information transceiving sensors L1 to L8 are installed to cover the entire area, and at least two adjacent location information transceiving sensors L1 to L8 are provided. Optical motion sensors (I1 to I15) are installed between) so that a user (M), a real object (R), and a virtual object (V) moving in the real gallery (S1) are sensed or position data is detected as valid data. To be installed.

In addition, a plurality of pressure sensors P are mounted on the floor constituting the actual gallery S1 to sense actual position data of a user M or a real object R moving while applying pressure on the floor. It is provided.

At this time, the data value for the real object (R) can be secured by scanning by using a high-resolution 3D optical scanning device (500: 500a, 500b). The secured data value is transmitted to the server 300 through the Internet and stored.

In addition, as the user M reads three-dimensional coordinate values of each of the real object R and the virtual object V using the wearable device 100, the user M may read the display screen of the wearable device 100. Is displayed.

The application principle of the virtual reality realization system in this embodiment is to cause the virtual object V, which is illustrated in a subject, for example, fish shape, to be realistically reproduced in reality, based on the positional information in a specific space S1. In addition, all coordinates, sizes, etc. of all objects in the specific space S1 are recognized, and three-dimensional coordinates are assigned and displayed in the specific space S1. That is, the virtual reality realization system analyzes the location information of the object and the information of the field of view, thereby enabling the fusion of the virtual object V and the real object R to be realistic.

For example, as shown in the user's eye B of FIG. 3, a real object R and a fish-like virtual object V are placed on a display panel of the wearable device 100 in a specific space S1. Displayed in front of the real object (R), the fish-like virtual object (V) is swimming in a specific space (S1), as shown in the user's eye (A) of Figure 3, behind the real object (R) When the virtual object V returns to the back of the real object R, an overlapping region Hi overlaps the real object R and the virtual object V, and thus the user's eyes may have a depth of view. Accordingly, the image of the virtual object V of the overlapping portion is displayed as partly covered by the real object R, so that a virtual 3D image as if the virtual object exists is realized.

In addition, when the user M wears the wearable device 100 and moves to the rear of the real object R, the virtual object V is the real object as shown in the user's eye A of FIG. 3. The portion which is not visible overlapping with (R) is shown as in the user's line of sight B of FIG. 3.

In addition, the present invention is a technology in which virtual reality and augmented reality are fused, the fish-like virtual object (V) that was outside the user M's field of view as if the real thing is coming closer to the front of the user (M) Can be implemented virtually.

Furthermore, when the fish-like virtual object V and the real object R are viewed through the wearable device 100, these data values are synthesized and displayed, and various additions to the virtual object V and the real object R are performed. The information is displayed and various additional services can be received by selecting these additional information.

The data value for the real object R may be obtained by scanning in real time by the 3D optical scanning device 500 (500a, 500b), the optical motion sensors I1 to I15 installed in the real gallery S1, The data value may be obtained by being sensed by the location information transmission / reception sensors L1 to L8 or may be obtained through the pressure sensor P located on the floor. In addition, it is possible to reduce the error by comparing the data values obtained by using the above-described methods in combination.

Here, the wearable device 100 measures coordinates, directions, and angle information on the three-dimensional space of the wearable device 100 using various sensors, and through this, the real objects R and the virtual objects V are measured. The relative position between the users M, the real object R or the virtual object V, and the wearable devices 100 may be sensed, that is, three-dimensional spatial coordinates. In this case, the sensor for detecting the 3D location information may include, for example, an IR sensor, an optical sensor, and the like. Therefore, the user's field of view is determined by the position of the wearable device 100 and the three-dimensional angle information.

At the same time, through this, as shown in FIG. 7, a viewing frustum in which the user M is represented on the display through spatial position coordinates and angles is defined, and the subjects entering the viewing frustum at this time are defined. The information about is realized realistically through the depth information process of the field of view. Since the user can see the real object and the background through the camera of the wearable device 100, the viewing frustum is a viewpoint, that is, which part of the entire screen is visible on the final screen in terms of the camera. This means that the visible area, that is, the determined display area. That is, the screen displayed on the display panel of the wearable device 100 becomes one screen between a near clip plane and a far clip plane in the viewing frustum according to the depth of the view.

And although the object located in the space but not in the field of view is not displayed, the voice information generated by the object or the person who does not enter the field of view is implemented to be outputable, and the real space implemented by the virtual reality realization system of the present invention is virtual. It is implemented to match the space and its shape, width and height.

In addition, when the present invention is applied to the virtual gallery, when a plurality of users (M) wearing the wearable device 100 is viewed with the virtual curator in the actual gallery (S1), the various existing in the space of the actual gallery (S1) It is considered not to collide with each other users M, virtual curators and real objects R. At this time, the virtual curator may tell the history of the artist, the auction information, the history of the work, the intention of the creation of the work in a narration manner. In addition, the virtual curator, like the curator of a real gallery, follows the audience and gives a detailed explanation of the work.

In addition, by selecting a menu displayed together on the display panel of the wearable device 100, the item may be purchased directly. In addition, a corresponding advertisement may be purchased by selecting a virtual advertisement displayed on the display panel of the wearable device 100 or an actual product advertisement, for example, a banner advertisement or a product advertisement such as a vehicle. In addition, by selecting a menu displayed together with the work on the display panel of the wearable device 100, it is possible to participate in the auction of the item.

In addition, the camera outputs images and sounds from the display panel of the wearable device 100 and has a device and a data communication device capable of informing a position to various spatial coordinate recognition sensors, and photographs the front of the device and transmits them in real time. At the same time, it may be further provided with a device having a laser scanning equipment for measuring and recording the position of the pupil inside.

In addition, in terms of sound, for each user M wearing the wearable device 100, the sound is different from the sound coming from the right direction and the sound coming from the left direction. The sound heard from left and right is set differently with respect to. Therefore, according to the relative positions of the user M wearing the wearable device 100 and the virtual object V in the space of the actual gallery S1, the sounds heard from the left and right sides of the wearable device 100 are mutually level of sound ( level) is set differently.

In addition, while viewing a work as a virtual object V on a real gallery S1, a user may selectively view all sides of the work at the front, back, side, and top and bottom. At this time, while viewing the virtual object (V), the user's pupils placed inside the wearable device 100, such as the time the user stays, may be checked to determine the preference for the virtual object (V) as an object. have.

In addition, as shown in FIG. 4, in the virtual reality implementation system of this embodiment, when the depth of view of the real object and the virtual object is different from each other, perspective processing may be performed according to the depth of view to improve the realism.

Here, the depth of view is processed three-dimensionally according to the positions where the plurality of real objects (R) and the virtual object (V) are placed in a specific space, so that the user's gaze feels a different distance depending on the direction of the arrow, It is determined by the user M how the image data of the virtual object V is obtained differently. For example, the actual real objects R are displayed by the depth of view, and the virtual object V is positioned behind the real object R such that a part of the virtual object V is placed on the real object R. If it is covered by, the part is processed invisible to the user M's field of view.

Such a virtual reality implementation system may be implemented as a virtual gallery system in which a specific space is defined, and also in various forms, for example, as shown in FIG. 2, a virtual gallery may also be implemented as a real gallery S1 in which a specific space is defined.

FIG. 5 is a schematic diagram illustrating driving of a lens direction of a wide-angle IP camera through a step motor in an up-down-left-left direction in conjunction with a wearable device worn by a user according to another exemplary embodiment of the present invention.

Referring to FIG. 5, the wide-angle IP camera 600 of this embodiment is linked with the wearable device 100 worn by a user to remotely control the lens direction, that is, the photographing direction, of the wide-angle IP camera 600 through the step motor. That is, as the line of sight of the user wearing the wearable device 100 is changed up, down, left, and right, the photographing direction of the wide-angle IP camera 600 is driven up, down, left, and right. This is because when the wearable device 100 moves in the gaze direction, the server 300 recognizes this through the Internet, and rotates the wide-angle IP camera 600 up, down, left, and right according to the movement of the wearable device 100 to change the shooting direction. do. In this case, the wearable device 100 and the wide-angle IP camera 600 worn by the user M are connected to the server 300 through the Internet, respectively.

The situation in which the wide-angle IP camera 600 is linked to the wearable device 100 worn by the user M may be applied to various places, such as a stadium and a guard post.

For example, when applied to the stadium, when the user (M) wearing the wearable device 100 moves his head in accordance with the game situation in the stadium, the movement of the wearable device 100 worn on the head is As detected, the server 300 may be connected to the server 300 to drive the step motor of the wide-angle IP camera 600 to change the shooting direction according to the game situation. That is, as the user M wearing the wearable device 100 moves his or her head in up, down, left, and right directions, the lens direction of the wide-angle IP camera 600 is also driven up, down, left, and right through the step motor.

In addition, a plurality of wide-angle IP cameras 600 may be installed in the stadium. In this case, the specific wide-angle IP camera 600 may allow a user M wearing the wearable device 100 among the plurality of wide-angle IP cameras 600 to output an image signal that is closer to or more vibrant. Can be selected. Therefore, in the field of view of the user M wearing the wearable device 100, a closer or more thrilling video signal transmitted from the specific wide-angle IP camera 600 can be viewed.

As another example, when applied to the guard post, the wide-angle IP camera 600 is driven through the stepper motor in conjunction with the wearable device 100, through each of the wide-angle IP camera 600 installed in various places in the front, Even without actually going to the outside duty patrol, soldiers of guard posts can be on duty duty through the images taken by each wide-angle IP camera 600, as he intended, even while staying in the guard post.

6 is a schematic diagram showing the configuration of a virtual reality implementation system using a military drone according to another embodiment of the present invention.

Referring to FIG. 6, the virtual reality implementation system of this embodiment detects the location information of soldiers using military drones D1 to D4, and thereby implements the situation of soldiers in virtual reality. Military drones (D1 ~ D4) are equipped with a position sensor and a heat sensor to detect the presence and location of each of the soldiers. In addition, military drones (D1 ~ D4) can collect personal information, such as belonging, rank, class, etc. of allies (m1 ~ m4) wearing the wearable device 100 and biometric information of each of the allies (m1 ~ m4), In addition, biomedical information may be monitored to provide unit status for unit units.

For example, during a war, a plurality of military drones (D1-D4) are used to detect the location of the enemy (e1-e3), weapons (t) or military equipment, and fight against the enemy (e1-e3). Many allies (m1 ~ m4) soldiers collect information on various war situations from a plurality of military drones (D1 ~ D4) flying over the battlefield to use terrain information, location information of the enemy (e1 ~ e3) It can be recommended to determine the war situation and determine where to gather, targets to strike, effective defensive routes, attack routes and travel routes.

That is, military drones D1 to D4 fly over a battlefield and receive current location information using a GPS receiver that receives its location information from a GPS satellite. In addition, military drones (D1 to D4) transmit location information with other military drones (D1 to D4) adjacent to each other or exchange distance information calculated by using triangulation, etc. You can also determine the exact location for e1 ~ e3).

In addition, the military drones (D1 ~ D4) can be sent to the friendly forces (m1 ~ m4) wearing the wearable device 100, so as to transmit the location information about the enemy, various war situations, various sensors, for example, location And an information transmitting and receiving device, a thermal image sensor, an optical sensor, and the like. Using the military drones (D1 ~ D4) to determine the current position of the enemy (e1 ~ e3) and enemy tank (t), as well as the direction of attack on the enemy (e1 ~ e3), friendly (m1 ~ m4) Easily identify future paths or retreats of allies (m1 to m4) to enable rapid and safe unit movement.

Accordingly, each of the allies m1 to m4 does not expose its position to a number of enemy soldiers e1 to e3 or enemy tank t through the wearable device 100 that they wear. Can perform rapid and safe unit movements or operations.

As another example, when using a network base station instead of a military drone, in order to detect the location information in a specific space using the network base station, Wi-Fi (WiFi) repeater, Bluetooth beacon, etc. to determine the location information and triangle between each device Distance information between specific locations may be calculated through a survey method. In this case, it is obvious that the example of the communication network base station may be a certain space, not necessarily any room or office, for example, Seoul.

As another example, if a specific space is a building, the location of the buildings is three-dimensionally scanned using a laser scanner, an IR scanner, a thermal scanner, and at the same time, the user is located at a communication base station, a Wi-Fi repeater, a Bluetooth beacon, etc. If the information is specified, it is possible to implement a content such as a virtual object (V) swimming between the buildings.

8 is a view showing a wearable device in the form of a Google glass according to an embodiment of the present invention.

Referring to FIG. 8, the wearable device 100 of the present invention may be provided in various shapes, and may be configured in the form of transparent, translucent, opaque glass, or the like. For example, the wearable device 100 may be provided in the form of a Google Glass product.

In particular, the virtual reality implementation system of the present invention, as applied to the virtual gallery system, a virtual curator is displayed, through which the writer's history, auction information, the history of the work, the creative intention of the work in a narrative manner In addition, by selecting a menu displayed together on the display panel of the wearable device 100, the item may be purchased directly, and the corresponding product may be selected by selecting a virtual advertisement or an actual product advertisement displayed together with the artwork on the display panel. There is also an effect that can be purchased.

In addition, the virtual reality implementation system of the present invention is applied to the guard post, the wide-angle IP camera 600 through the step motor in conjunction with the wearable device 100 is operated, without actually going to the outer duty patrol, soldiers of the guard post There is a characteristic effect that the boundary duty is possible through the images taken by each wide-angle IP camera 600 as intended by the state that actually stays in the guard post.

In addition, as the virtual reality implementation system of the present invention is applied to military drones, as well as to determine the current position of the enemy and enemy tanks, as well as the direction of attack on the enemy, future movement route, retreat route and attack route of the friendly forces, etc. In this way, it is possible to move troops and carry out operations quickly and safely.

In the above, the configuration and operation of the virtual reality implementation system according to the present invention has been shown according to the detailed description and drawings, but this is merely described by way of example, and various changes and modifications without departing from the spirit of the present invention. This is possible.

Claims

In a virtual reality implementation system:

A wearable device that is wearable by a user, the display panel including a real object existing in a specific space defined by a plurality of location information transceiving sensors and a virtual object virtually embodied in the specific space;

Collecting location information of the real object and location information of the wearable device from the location information transceiving sensor and a plurality of optical motion sensors that detect movement of the user and the real object in the specific space, and transmit the location information to the wearable device; A user computer for transmitting the image data of the virtual object and the image data of the virtual object;

The wearable is stored when the image data of the real object and the image data of the virtual object are stored and the location information of the real object and the location information of the wearable device are determined by partially overlapping the real object and the virtual object. The display panel of the device may be configured to display an overlapping portion of the real object and the virtual object located at a short distance with the wearable device according to a depth of view between the image data of the real object and the image data of the virtual object. And a server configured to transmit image data of the real object and image data of the virtual object to the user computer.
The method of claim 1,

The virtual reality implementation system;

At least one three-dimensional optical scanning device scanning the real object to generate three-dimensional image data and outputting three-dimensional image data;

And a rendering computer configured to receive the 3D image data from the 3D optical scanning device and to perform a rendering operation to transmit image data of the real object to the server.
The method of claim 1,

The virtual reality implementation system;

Further comprising a wide-angle IP camera for driving to change the shooting direction in response to the movement of the wearable device under the control of the server;

The wearable device may display an image captured by the wide-angle IP camera on the display panel.
The method of claim 1,

The virtual reality implementation system;

And a plurality of pressure sensors provided on a bottom surface of the specific space to further detect location information of the real object and the wearable device.
The method of claim 1,

The wearable device includes;

And displaying additional information about the real object and the virtual object, and if the additional information is selected, processing to be connected to an additional service corresponding to the additional information.
The method according to any one of claims 1 to 5,

The server;

The image data of the real object and the image data of the virtual object are further displayed on the display panel of the wearable device in order to further display the real object and the virtual object in response to a three-dimensional angle of the user's gaze. Virtual reality implementation system, characterized in that provided.
The method of claim 6,

The location information transmission and reception sensor;

And a GPS device, a communication network base station, a wireless communication repeater, and a drone for recognizing location information of the real object and the wearable device.
In the virtual reality implementation method of the virtual reality implementation system:

Defining a specific space using a plurality of location information transceiving sensors;

The location information transmitting and receiving sensor senses the location information of the real thing existing in the specific space and the location information of the wearable device worn by the user having a display panel displaying a virtual object virtually implemented in the specific space. and;

The position information of the real object and the position information of the wearable device may be obtained from the position information transceiving sensor and a plurality of optical motion sensors that detect movement of the user and the real object in the specific space through a user computer provided in the specific space. Collect and transmit image data of the real object and image data of the virtual object to the wearable device; And

When the server determines the location information of the real object and the location information of the wearable device in the specific space and the real object and the virtual object partially overlap, the image data of the real object and the virtual on the display panel of the wearable device The overlapping portion of the real object and the virtual object located near the wearable device is displayed according to the depth of view between the image data of the object, and the image data of the real object and the virtual object are displayed to the user computer. The virtual reality implementation method of the virtual reality implementation system, characterized in that for transmitting the image data.
The method of claim 8,

The method;

Scan the real object through at least one three-dimensional optical scanning device to generate three-dimensional image data and output three-dimensional image data;

A rendering computer receives the three-dimensional image data from the three-dimensional optical scanning device and performs a rendering operation to transmit the image data of the real object to the server; And

The server may further include storing image data of the real object.