KR20170120299A - Realistic contents service system using leap motion - Google Patents

Abstract

The present invention relates to a real-sensible contents service system, and more particularly, to a real-time contents service system in which a user can check a 360 degree VR (Virtual Reality) image in various directions using a leap motion, The present invention relates to a sensible contents service system using lip motion that can obtain various information about trees, plants, animals, or flowers.

Description

Description of the Related Art [0002] Real-time contents service system using lip motion [

The present invention relates to a real-sensible contents service system, and more particularly, to a real-time contents service system in which a user can check a 360 degree VR (Virtual Reality) image in various directions using a leap motion, The present invention relates to a sensible contents service system using lip motion that can obtain various information about trees, plants, animals, or flowers.

Virtual Reality (VR) is a user interface technology that allows users to experience what is possible within a software program of a computer through a sense of sight, hearing, etc. using special glasses and gloves, But the world.

2. Description of the Related Art Recently, various types of multimedia contents are widely produced and consumed. Accordingly, attempts have been made to provide users with more diverse viewpoints at different points of view beyond the limit of a unidirectional planar content.

In particular, there is a need for a realistic contents service that allows a user to experience a specific space in a first person view through a multi-view video technique in various real environments such as a museum, an exhibition hall, a performance hall,

Also, the 360 degree VR image is an image that allows the user to feel the virtual reality, and the user moves the screen vertically and horizontally to make him feel as if he is in the space.

In the case of the conventional 360-degree VR image, the user has to experience a virtual reality by clicking or dragging the screen using a mouse, so that the operation is limited, which makes it inconvenient to use and it is difficult to display various contents together.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a realistic content capable of maximizing an experience effect of a virtual reality by allowing a user to experience a 360- Service system.

Another object of the present invention is to provide a map, a ground view, and an aerial view of a place where a 360-degree VR image is photographed, and to provide various types of contents by providing additional information on trees, plants, A content-based service providing system,

According to an aspect of the present invention, there is provided a portable terminal including a lip motion controller for detecting a user's hand motion and generating a cursor movement command, a click command or a drag command, And a 360-degree panorama image, converts the 360-degree panorama image into a 360-degree VR (Virtual Reality) image, outputs a content providing screen including the 360-degree VR image, receives the command from the lip motion controller, And a computer for controlling a state output to the content providing screen.

In a preferred embodiment, the computer stores a real-life content providing program, and the real-time content providing program causes the computer to display the 360-degree panorama image and convert the 360-degree panorama image into the 360- Editing means; A content providing screen output means for outputting the 360-degree VR image to the content providing screen; And lip motion command processing means for receiving an instruction from the lip motion controller and controlling content output from the content providing screen.

In a preferred embodiment, the content providing screen includes: a view 360 window for outputting the 360-degree VR image when clicked; A content card window for outputting content information related to the 360-degree VR image when clicked; And a help window for outputting the usage of the lip motion controller upon clicking.

In a preferred embodiment, when the view 360 window is clicked, a position where the 360-degree VR image is photographed is displayed as a map, and when a predetermined portion of the map is clicked, a 360-degree VR image of the clicked point is displayed as a ground view And displays the aerial view. When the ground view or the aerial view is dragged, the image is displayed by moving in the dragged direction.

In a preferred embodiment, when the content card window is clicked, information about a tree, an animal, a plant, or a flower in the region where the 360-degree panoramic image is photographed is output in a card format.

The present invention has the following excellent effects.

First, according to the real-sensible contents service system of the present invention, since the user can experience 360-degree VR images while using the lip motion without using an input device such as a mouse, the immersion degree of the virtual reality can be greatly improved There is an advantage.

In addition, according to the real-service contents service system of the present invention, when a map of a place where a 360 degree VR image is shot is provided first and a specific point on the map is selected, a 360 degree VR image It is possible to maximize the experience effect of the virtual reality by combining the geographical position and the image.

In addition, according to the real-sensible contents service system of the present invention, it is possible to provide a user with various information by providing information about a tree, an animal, a plant, or a flower in a place where a 360 degree VR image is photographed.

1 is a block diagram illustrating a configuration of a real-time contents service system according to an embodiment of the present invention;
2 is a view for explaining functions of a real-time content providing program according to an embodiment of the present invention;
FIG. 3 is a view showing a content providing screen provided by a realistic contents service system according to an embodiment of the present invention; FIG.
FIG. 4 is a view showing a map provided by a real-feeling contents service system according to an embodiment of the present invention; FIG.
FIG. 5 is a view showing an aerial view and a ground view of a 360-degree VR image provided by a real-feeling contents service system according to an embodiment of the present invention;
FIG. 6 is a view showing a content card provided in a real-feeling contents service system according to an embodiment of the present invention.

Although the terms used in the present invention have been selected as general terms that are widely used at present, there are some terms selected arbitrarily by the applicant in a specific case. In this case, the meaning described or used in the detailed description part of the invention The meaning must be grasped.

Hereinafter, the technical structure of the present invention will be described in detail with reference to preferred embodiments shown in the accompanying drawings.

However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. Like reference numerals designate like elements throughout the specification.

1, a real-sensory contents service system 100 according to an exemplary embodiment of the present invention includes a lip motion controller 110 and a computer 120, And a display device 130 for outputting an image.

The real-time contents providing program for providing a real-life contents service is stored in the computer 120. The real-time contents providing program functions as the real-time contents providing program through the display device 130, And outputs the content.

In addition, the computer 120 is not only a general personal computer but also a broad computer device including a smart device such as a smart phone, a tablet PC, and an embedded system.

In addition, the real-time content providing program may be stored in a separate recording medium as a computer program, and the recording medium may be designed and configured specifically for the present invention or may be provided by a person having ordinary knowledge in the field of computer software And may be available.

For example, the recording medium may be a magnetic medium such as a hard disk, a floppy disk and a magnetic tape, an optical recording medium such as a CD and a DVD, a magneto-optical recording medium capable of serving also as magnetic and optical recording, Or the like, or a hardware device specially configured to store and execute program instructions by itself or in combination.

The real-time content providing program may be a program in which a program command, a local data file, a local data structure or the like is composed solely or in combination, and may be stored in a computer using an interpreter or the like, Lt; RTI ID = 0.0 > a < / RTI > high-level language code.

The lip motion controller 110 detects a gesture of a hand of the user 10 and generates and outputs a command for moving, clicking, or dragging a cursor displayed on the display device 130.

In addition, the lip motion controller 110 can use a method of photographing a hand image, and can detect a gesture by detecting a position or shape of a hand in a space using a proximity sensor.

The computer 120 is connected to the lip motion controller 110 and receives a cursor movement instruction, a click instruction, or a drag instruction from the lip motion controller 110.

In addition, the computer 120 controls an image output from the display device 130 according to a command received from the lip motion controller 110.

2, the computer 120 stores a real-life content providing program for providing a real-life content service, and the real-time content providing program includes the computer 120, the image editing unit 121, Content providing screen output means 122, and lip motion command processing means 123, as shown in Fig.

First, the image editing unit 121 receives a 360-degree panorama image from an image-capturing device 20 (which may be a car or a dron) that performs 360-degree panoramic image capturing, and stitches ) To generate a 360 degree VR image.

The content providing screen output means 122 outputs the 360 degree VR image produced by the image editing means 121 to the display device.

Also, the content providing screen output means 122 can output a 360 degree VR image through a flash viewer, for example.

3, the content providing screen output means 122 outputs the content providing screen 200. The content providing screen 200 includes a view 360 window 210, The card window 220 and the help window 230 are displayed.

In addition, the contents providing screen output means 122 may output an intro page when there is no detection of the gesture for a predetermined waiting time (may be one minute) to the lip motion controller 110, A predetermined intro video can be repeatedly reproduced on the intro page.

In addition, when the view 360 window 210 is clicked, the location where the 360-degree panorama image is photographed is first output to the map.

In addition, the map 211 may be a map in which an area for providing contents is displayed in an animation format as shown in FIG.

Also, the content providing screen output means 122 outputs a 360-degree VR image of the clicked position when a predetermined portion of the map 211 is clicked.

Further, the 360-degree VR image may include an aerial view as shown in FIG. 5 (a), or a ground view as shown in (b).

In addition, the 360-degree VR image may be a moving image. When a drag command is inputted through the lip motion controller 110 during moving image output, the moving image may be moved up or down or left or right to show a view in a moving direction

In addition, the outputted moving image can be recorded and displayed again or rolled back, and can be outputted as a slide image.

Also, although not shown, the map view window may be output together with the 360-degree VR image, and when the map view window is clicked, the map 211 is displayed.

When the content card window 220 is clicked on the content providing screen 200, the content card 221 as shown in FIG. 6 is output.

In addition, the content card 221 displays information related to the 360-degree VR image in a card format, and provides information about a tree, an animal, a plant, or a flower in an area where the image is captured.

If the right and left corners of the content card 221 are clicked, the previous or next content card can be displayed in a slide manner. If the cursor is positioned at the corner of the card without clicking, You can change the card to show it.

In addition, when clicking on the image of the tree, fauna, flora or flower of the content card 221, the image can be enlarged, and detailed additional information can be output.

Also, when the help window 230 is clicked on the content providing screen 200, a page indicating the usage of the lip motion controller 110 is also moved.

For example, the lip motion controller 110 outputs a cursor movement command when the hand is moved up and down, left and right, and outputs a click command when the palm is grasped and extended. When the palm is grasped, When moving it, a drag command can be outputted.

The lip motion command processing means 123 receives a cursor movement instruction, a click instruction or a drag instruction from the lip motion controller 110 and controls the content output from the content presentation screen output means 122 to change.

Therefore, according to the real-sensory contents service system 100 of the present invention, the user can control the 360-degree VR image by using the hand-operated operation, so that the interface can be freely operated and the 360- So that the immersion of the virtual reality experience can be maximized.

In addition, since the user can obtain information on trees, plants, flowers, or flowers in the region where the 360-degree VR image is photographed, it is possible to acquire various information together.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, Various changes and modifications will be possible.

100: sensible contents service system 110: lip motion controller
120: Computer 121: Image editing means
122: content providing screen output means 123: lip motion command processing means
130: Display device

Claims (5)

A lip motion controller for generating a cursor movement command, a click command or a drag command by sensing a user's hand motion and outputting the motion command; And
A 360 degree panorama image is received and converted into a 360 degree VR (Virtual Reality) image, a content providing screen including the 360 degree VR image is output, and an instruction is received from the lip motion controller, And a computer for controlling a state output to the content providing screen.
The method according to claim 1,
The real-time content providing program is stored in the computer,
Wherein the real-time content providing program comprises:
Image editing means for receiving the 360-degree panorama image and converting the 360-degree panorama image into the 360-degree VR (Virtual Reality) image;
A content providing screen output means for outputting the 360-degree VR image to the content providing screen; And
And lip motion command processing means for receiving an instruction from the lip motion controller and controlling content output from the content providing screen.
3. The method of claim 2,
The content providing screen includes:
A view 360 window for outputting the 360-degree VR image when clicked;
A content card window for outputting content information related to the 360-degree VR image when clicked; And
And a help window for displaying the usage of the lip motion controller when the user clicks the lip motion controller.
The method of claim 3,
When the view 360 window is clicked, a position where the 360-degree VR image is photographed is displayed as a map, and when a predetermined portion of the map is clicked, a 360-degree VR image of the clicked point is displayed as a ground view or an aerial view, Wherein when the ground view or the aerial view is dragged, the moving image is displayed in a dragged direction.
The method of claim 3,
And outputting, in a card format, information about a tree, an animal, a plant, or a flower in the area where the 360-degree panoramic image is photographed, when the content card window is clicked.

Images