WO2021075835A1

WO2021075835A1 - Content provision method and system based on virtual reality sound

Info

Publication number: WO2021075835A1
Application number: PCT/KR2020/013968
Authority: WO
Inventors: 조성배; 최하연; 박수민; 박예빈; 최세나
Original assignee: 실버라이닝스튜디오 주식회사
Priority date: 2019-10-17
Filing date: 2020-10-14
Publication date: 2021-04-22
Also published as: KR20210045806A; KR102297532B1

Abstract

The present invention comprises the steps of: producing content based on a virtual reality sound; and executing the content, wherein the step of producing the content based on the virtual reality sound comprises the steps of: when a request for generating the content based on the virtual reality sound is received from a user, generating, by a content generation unit, a plurality of sound rooms including a plurality of sound objects; receiving, as an input by an input unit, at least one of a starting sound, a viewing sound, and a tap sound of at least one of the plurality of sound objects; and receiving, as an input by the input unit, at least one of the size, position, and distance of the sound object.

Description

Virtual reality sound-based content providing method and system

The present invention relates to a virtual reality sound-based content providing method and system, and in particular, a method of providing virtual reality sound-based content in which sound is output when contacting a virtual reality-based sound space using a camera ray installed in a user terminal And a system.

Most of the conventional VR/AR contents are provided through a display mounted on a terminal, and it is common for a user to manipulate while looking at the display. Such conventional VR/AR content has a problem in that the visually impaired cannot use the VR/AR content.

As a prior art, a game application program based on sound virtual reality recorded on a recording medium, a game system using the same, and a method for providing it (Public Patent No. 10-2019-0003152) is a game that proceeds according to sound, and gestures using a mobile terminal within the game. It merely discloses a method of providing game content that performs a mission according to the following.

The problem to be solved of the present invention is to create and provide sound content in a virtual space based on an auditory element rather than a visual element, and contact the virtual reality-based sound space using a camera ray installed on a user terminal in the virtual space. There is a challenge in providing virtual reality sound-based content that outputs sound.

The present invention includes the step of producing virtual reality sound-based content and executing the content in order to solve the conceived problem, and the step of producing the virtual reality sound-based content includes: Upon receiving the content creation request, the content generation unit generates a plurality of sound rooms including a plurality of sound objects, and the input unit generates at least one of a starting sound, a viewing sound, and a tap sound of at least one of the plurality of sound objects. And receiving an input; and receiving, by an input unit, at least one of a size, a position, and a distance of the sound object.

According to the present invention, it is possible to produce and provide auditory-centered virtual reality content rather than visual-centered virtual reality content, and enjoy virtual reality sound-based content more simply without wearing a VR device on the head. Using the present invention, it is possible to produce various categories of virtual reality content such as sound-based games and guides.

1 and 2 are conceptual diagrams illustrating a virtual reality sound-based content providing method according to an embodiment of the present invention.

3 is a block diagram of a system for providing contents based on virtual reality sound according to an embodiment of the present invention.

4 is a flowchart illustrating a virtual reality sound-based content production method according to an embodiment of the present invention.

5 is a flowchart illustrating a method of executing contents based on a virtual reality sound according to an embodiment of the present invention.

6 to 8 are reference diagrams illustrating a method of producing sound-based content according to an embodiment of the present invention.

Specific structural or functional descriptions of the embodiments according to the concept of the present invention disclosed in the present specification are exemplified only for the purpose of describing the embodiments according to the concept of the present invention, and the embodiments according to the concept of the present invention are It may be implemented in various forms and is not limited to the embodiments described herein.

Since the embodiments according to the concept of the present invention can apply various changes and have various forms, the embodiments will be illustrated in the drawings and described in detail in the present specification. However, this is not intended to limit the embodiments according to the concept of the present invention to specific disclosed forms, and includes all changes, equivalents, or substitutes included in the spirit and scope of the present invention.

The terms used in the present specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this specification, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described herein, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance the possibility of the presence or addition.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 and 2 are conceptual diagrams illustrating a virtual reality sound-based content providing method according to an embodiment of the present invention. Referring to FIG. 1, in the present invention, when the user 100 searches for

sound objects

320 and 340 preset in the virtual space 300 through the user terminal 200, the

sound objects

320 and 340 are searched. It is possible to provide virtual reality sound-based content that operates to generate an event. The location and size of the

sound objects

320 and 340 may be set based on the location and size input by the content creator. Different sound files may be set for the

sound objects

320 and 340. The first sensing area 310 may be configured with a predetermined radius based on the center point of the first sound object 320, and the camera ray 210 of the user terminal 200 is the sound object 320 in the sensing area 310. If you look in the direction of ), a preset sound may be generated in the sound object. The user 100 may sense a sound generated through the user terminal 200. The second sensing area 330 may be configured with a predetermined radius based on the center point of the second sound object 340. Depending on the content creator,

additional sensing areas

350 and 360 may be set and arranged to detect sound objects in a wider space. In the case of game content, an additional detection area may be set to adjust the difficulty level, or in the case of guide content, an additional detection area may be additionally set according to the user's age. A plurality of

sound objects

320 and 340 are arranged in one sound room 300 so that the user 100 can search for sound objects arranged in a virtual space.

That is, in the present invention, there are sound files arbitrarily arranged in the space where the user is standing, and the sound in that direction may be output according to the direction of the camera ray installed in the user terminal, or the sound may be output when the user satisfies specific conditions of use. . The specific conditions of use may be sound output when an interaction with a user terminal such as a screen touch, a gaze operation for a preset time, and a screen slide operation is satisfied.

3 is a block diagram of a virtual reality sound-based user terminal according to an embodiment of the present invention.

Referring to FIG. 3, the user terminal 200 may be installed with a dedicated application for executing contents based on virtual reality sound. The user terminal 200 includes a content generation unit 210, a content execution unit 220, a sound recognition unit 230, a screen providing unit 240, a control unit 250, a sound providing unit 260, and a storage unit 270. ), an input unit 280, and a communication unit 290.

The user terminal 200 is a computing device, which can execute a processor determined by operating system software and various application software, such as a smartphone or tablet PC, and is a mobile computing device that can be easily used while moving because it is easy to carry. It is not.

The content generator 210 may generate virtual reality sound-based content. The content may be composed of a plurality of sound rooms including a plurality of sound objects. The sound object is an object including a sound in which a sense of three-dimensionality and a sense of distance are felt in virtual reality, and may be disposed in a sound room in a virtual reality space. The sound room is a space in which sound objects can be placed, and a user terminal can create multiple sound rooms within one content. A plurality of sound rooms can be arranged, and the user terminal can move freely. The sound of opening and closing the door is generated when moving between the sound rooms, so that the user terminal can recognize the movement between the sound rooms.

The content generation unit 210 may receive at least one of a starting sound, a viewing sound, a tap sound, a size, a location, and a distance of each sound object from a producer, and generate the sound object in a virtual reality space based on the input.

The content execution unit 220 can execute the generated content,

The sound recognition unit 230 may be configured with a camera ray based on a gyroscope or an accelerator sensor. That is, the sound recognition unit 230 may output a preset sound when the virtual laser contacts the sound object in the direction the camera ray is looking at.

The screen providing unit 240 may execute a dedicated application and display it to a user, and may display a template for producing content.

The controller 250 controls processing of a process related to execution of the dedicated application software, and controls the operation of each component of the terminal 200.

The sound providing unit 260 may output at least one of a start sound, a viewing sound, and a tap sound mapped to the corresponding content according to the occurrence of an event.

The storage unit 270 may store a dedicated application for producing or operating virtual reality sound-based content. The storage unit 270 may store the generated sound space content.

The input unit 280 receives an input event executed by an input means. The input unit 280 may be a touch screen, and transmits a touch event to the controller 250. Values for the starting sound, viewing sound, tapping sound, size, position, and distance of each sound object can be input from the user.

The communication unit 290 is a communication module that serves to exchange data with an external device.

Referring to FIG. 4, a method of providing virtual reality sound-based content includes producing a virtual reality sound-based content and executing the content.

First, in the step of producing virtual reality sound-based content, when receiving a request for generating virtual reality sound-based content from a user, the content generation unit generates a plurality of sound rooms including a plurality of sound objects (S410). The sound object is an object including a sound in which a sense of three-dimensionality and a sense of distance are felt in virtual reality, and may be disposed in a sound room in a virtual reality space. The sound room is a space in which sound objects can be placed, and a user terminal can create multiple sound rooms within one content. A plurality of sound rooms can be arranged, and the user terminal can move freely. The sound of opening and closing the door is generated when moving between the sound rooms, so that the user terminal can recognize the movement between the sound rooms.

The input unit receives at least one of a starting sound, a viewing sound, and a tap sound from among the plurality of sound objects (S420).

The input unit receives at least one of the size, location, and distance of the sound object (S430). The content generation unit generates the sound object based on at least one of the starting sound, the viewing sound, the tap sound, the size, the position, and the distance. It is created in a virtual reality space (S440). The content generation unit generates sound space content in which a plurality of sound rooms including sound objects are arranged (S450).

Referring to FIG. 5, in the executing of the virtual reality sound-based content, the content execution unit loads the sound space content stored in the storage unit and executes the content including at least one sound object in the virtual space (S510). .

When the sound recognition unit detects the sound object in the content, an event occurs (S520). In this case, the sound recognition unit may be a camera ray installed in the user terminal, but is not limited thereto. According to an embodiment, the sound recognition unit may be configured with a gyroscope or an accelerator sensor-based camera ray. That is, when the virtual laser contacts the sound object in the direction the camera is looking at, the already set sound may be output.

The control unit reflects the input value corresponding to the operation of the user terminal to the content. In this case, the operation of the user terminal may be at least one of a basic operation, a start operation, a gaze operation, a touch operation, and a setting operation. The basic operation may be activated when the sound object is not performing any other operation, and the starting operation may be activated when a cycle of the sound object starts.

The gaze movement can be operated when the user terminal moves and is directed in the direction in which the sound object is located. It is possible to set to perform another operation after the set time in the program has elapsed, and to stop the set operation when the user terminal does not see the direction of the sound object.

The touch operation can be operated when the user terminal moves in the direction in which the sound object is located and touches the screen. It is possible to set to perform different actions after the time set in the program has elapsed. The setting operation can be operated when the time set by the manufacturer is exceeded. At this time, it is possible to set whether to use each condition when creating content.

An input value corresponding to the operation of the user terminal, and may be at least one of a sound reproduction operation, a sound stop operation, a movement operation, and a restart operation of the sound object content.

In the sound reproducing operation, a sound set based on the coordinates at which the sound object is located is reproduced, and in the sound stopping operation, the sound may be stopped when the sound object is reproducing the sound. The moving operation may move the user terminal to an adjacent sound room, and the restart operation may initialize a timer in the sound object and start a new cycle.

That is, for the sound reproducing operation and the sound stopping operation, it is possible to set an interruption prohibition time in which the user terminal cannot operate even if other interaction conditions are satisfied for a set time. In addition, the moving operation and the restarting operation can be operated in parallel with the sound reproduction operation and the sound stop operation, and in this case, the operation may be performed after the set prohibition time has elapsed. The cycle may end under the condition that each sound object performs a restart operation from the start.

6 to 8 are reference diagrams illustrating a method for producing sound-based content according to an embodiment of the present invention.

6 to 8 are diagrams for explaining a GUI for content creation. Referring to FIG. 6, a name of a sound space 610 can be set, and a plurality of sound rooms 620 can be selected. When a sound room is selected, a specific image 630 may be added or a specific background music 640 may be added.

Referring to FIG. 7, when a sound room is selected, sounds 710 of a plurality of sound objects arranged in the sound room may be set. The first sound object 720, the second sound object 730, and the third sound object 740 can be set, and by selecting the first sound object 720, the start sound 750 and the sound when seeing 760 ) And tap sound 770 can be set, respectively.

Referring to FIG. 8, a size 810, a location 820, and a distance 830 of a plurality of sound objects arranged in a sound room may be set. Each can be selected, and the size, location, and distance can be set through the scroll bar 840. The placement map 850 may show how the sound object is disposed at what location in the sound room and in what size.

The present invention has been described with reference to the embodiments shown in the drawings, but these are only exemplary, and those of ordinary skill in the art will understand that various modifications and equivalent other embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the technical idea of the attached registration claims.

Claims

In the method of providing virtual reality sound-based content,

Including the step of producing a virtual reality sound-based content and executing the content,

The step of producing the virtual reality sound-based content,

Generating a plurality of sound rooms including a plurality of sound objects by a content generation unit upon receiving a request for content creation based on a virtual reality sound from a user;

Receiving, by an input unit, at least one of a starting sound, a viewing sound, and a tap sound from among the plurality of sound objects;

And receiving at least one of a size, a location, and a distance of the sound object by an input unit.
The method of claim 1,

Generating, by a content generation unit, the sound object in a virtual reality space based on at least one of the starting sound, the viewing sound, the tap sound, the size, the location, and the distance;

A method for providing contents based on virtual reality sound, further comprising the step of, by a content generation unit, generating sound space contents in which a plurality of sound rooms including sound objects are arranged.
The method of claim 1,

The sound object is an object including a sound in which a sense of three-dimensional sense and a sense of distance are felt in virtual reality, and a virtual reality sound-based content providing method disposed in a sound room of a virtual reality space.
The method of claim 1,

The step of executing the content,

Executing, by the content execution unit, content including at least one sound object in the virtual space;

Generating an event when the sound recognition unit detects the sound object in the content;

The virtual reality sound-based content providing method further comprising the step of the control unit reflecting the input value corresponding to the operation of the user terminal to the content.
In a virtual reality sound-based content providing system,

It is composed of a plurality of sound rooms including a plurality of sound objects, and receives at least one of a starting sound, a viewing sound, a tap sound, a size, a location, and a distance of each of the sound objects, and based on this, the sound object is transferred to the virtual reality space. A content generation unit that generates; And

A virtual reality sound-based content providing system comprising a sound recognition unit that outputs a preset sound when a virtual laser installed in a user terminal is in a direction gaze on the sound object generated by the content generation unit.