WO2023195830A1

WO2023195830A1 - System and method for converting sound in virtual space

Info

Publication number: WO2023195830A1
Application number: PCT/KR2023/004772
Authority: WO
Inventors: 조현석
Original assignee: 조현석
Priority date: 2022-04-08
Filing date: 2023-04-10
Publication date: 2023-10-12
Also published as: KR102523048B1

Abstract

A method for converting a sound in a virtual space implemented by a system for converting a sound in the virtual space according to an embodiment of the present invention may comprise the steps of: forming a virtual atmosphere in the virtual space; generating a physical force in the virtual space; and generating virtual data on the virtual atmosphere on the basis of the physical force, wherein the virtual data is data about the state of the virtual atmosphere changed by the physical force.

Description

Sound conversion system and method in virtual space

The present invention relates to a sound conversion system and method in virtual space, and more specifically, to a sound conversion system and method in virtual space that converts sounds that a user can hear based on physical forces generated in virtual space. It's about.

In the reproduction of stereoscopic sound in a VR (Virtual Reality) environment, stereoscopic sound can be reproduced by adjusting the direction of multi-channel virtual speakers in response to changes in the direction of the head through head tracking based on headphones.

In the case of object-based audio that uses images using computer graphics, such as games, the three-dimensional position of the object sound source can be reproduced in more detail by rendering the direction and distance of the object sound source according to head tracking.

However, when recording a real space, it is difficult to express all sounds with object-based audio, so a hybrid audio format including channel-based audio and object-based audio is used.

Currently, Dolby's ATMOS and DTS's DTS-X are used for movie content, and Dolby's AC4 and MPEG's MPEG-H 3D Audio are used for broadcast content.

Meanwhile, Republic of Korea Patent No. 10-2271395 (2021.06.24) discloses a sound effect method and a computing device for performing the same.

However, as rays are emitted based on certain points in the virtual space to generate sound effects (sounds), there is a limitation in that sound effects are generated only for certain points.

The present invention is intended to solve the above problems, and to provide a sound conversion system and method in virtual space that can generate sound according to the occurrence of physical force in virtual space regardless of the predetermined position in virtual space. It is Ham.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and problems not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings. .

A sound conversion method in a virtual space implemented by a sound conversion system in a virtual space according to an embodiment of the present invention includes the steps of forming a virtual atmosphere in the virtual space; Generating physical force in the virtual space; and generating virtual data on the virtual atmosphere based on the physical force, wherein the virtual data may be data about the state of the virtual atmosphere changed by the physical force.

According to the sound conversion method in virtual space according to an embodiment of the present invention, there is an advantage of being able to generate sound according to the generation of physical force in virtual space regardless of a predetermined position in virtual space.

The effects of the present invention are not limited to the effects described above, and effects not mentioned can be clearly understood by those skilled in the art from this specification and the attached drawings.

1 is a schematic diagram illustrating communication of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 2 is a schematic block diagram of a server of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 3 is a schematic diagram illustrating virtual data of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 4 is a schematic diagram illustrating virtual data, wave data, and sound of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 5 is a schematic flowchart illustrating a sound conversion method in virtual space according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the presented embodiments, and those skilled in the art who understand the spirit of the present invention may add, change, or delete other components within the scope of the same spirit, or create other degenerative inventions or this invention. Other embodiments that are included within the scope of the invention can be easily proposed, but this will also be said to be included within the scope of the invention of the present application.

Also, specifying a predetermined location in the virtual space; specifying the virtual data corresponding to the predetermined location; Converting the virtual data into wave data; And it may further include converting the wave data into sound.

Additionally, the method may further include transmitting the virtual data or the wave data to another electronic device.

Additionally, the method may further include changing character characteristics based on the virtual data.

A sound conversion system in virtual space according to another embodiment of the present invention includes an atmosphere forming unit that forms a virtual atmosphere in virtual space; a physical force generator that generates physical force in the virtual space; and a virtual data generator that generates virtual data on the virtual atmosphere based on the physical force, wherein the virtual data may be data about the state of the virtual atmosphere that is changed by the physical force.

Additionally, a location specification unit that specifies a predetermined location in the virtual space; a virtual data specification unit that specifies the virtual data corresponding to the predetermined location; A wave data conversion unit that converts the virtual data into wave data; And it may further include a sound converter that converts the wave data into sound.

In addition, it may further include a communication unit that transmits the virtual data or the wave data to another electronic device.

In addition, it may further include a characteristic changing unit that changes the characteristics of the character based on the virtual data.

Components with the same function within the scope of the same idea shown in the drawings of each embodiment are described using the same reference numerals.

Figure 2 is a schematic block diagram of the configuration of a server of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 4 is a schematic diagram for explaining virtual data, wave data, and sound of a sound conversion system in virtual space according to an embodiment of the present invention.

Figure 5 is a schematic flowchart for explaining a sound conversion method in virtual space according to an embodiment of the present invention.

In order to more clearly express the technical idea of the present invention, the attached drawings simplify or omit parts that are less relevant to the technical idea of the present invention or that can be easily derived from those skilled in the art.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only the case where it is "directly connected," but also the case where it is "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, this does not mean excluding other components unless specifically stated to the contrary, but may further include other components, and one or more other features. It should be understood that it does not exclude in advance the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

In this specification, 'part' includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Additionally, one unit may be realized using two or more pieces of hardware, and two or more units may be realized using one piece of hardware.

In this specification, some of the operations or functions described as being performed by a terminal or device may instead be performed on a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

Hereinafter, the sound conversion system 10 and method in virtual space according to an embodiment of the present invention will be described with reference to FIGS. 1 to 5.

For example, the present invention may refer to a system 10 and a method for converting sounds generated in a virtual reality environment to a user.

For example, as shown in FIG. 1, the sound conversion system 10 in the virtual space includes a server (S) that forms a virtual space and calculates/processes events occurring in the virtual space; and a user electronic device (P1, P2) that communicates with the server (S) and plays its character in a virtual space.

For example, there may be multiple users, such as a first user and a second user.

The user's electronic devices (P1, P2) refer to devices that can communicate with the server (S) and play their characters in the virtual space, and may be mobile terminals, desktops, etc., but are not limited to the types. You can.

The sound conversion method in the virtual space can be implemented by the sound conversion system 10 in the virtual space.

Hereinafter, the sound conversion method and system 10 in the virtual space will be described in more detail with reference to FIGS. 1 to 5.

For example, as shown in FIG. 2, the server S includes an atmosphere forming unit 110, a physical force generating unit 120, a virtual data generating unit 130, a location specifying unit 140, which will be described below. It may include a controller 100 including a virtual data specification unit 150, a wave data conversion unit 160, a sound conversion unit 170, and a characteristic change unit 180, and may receive a predetermined calculation value/input from the administrator. An input unit 500 that can receive values, data, etc., a communication unit 300 that communicates with other electronic devices (P1, P2) including the user's electronic device (P1, P2), and a device that stores predetermined data/information. It may further include a memory unit 200 and a display unit 400 that displays predetermined data/information.

Meanwhile, as will be explained in more detail below, the wave data converter 160 and/or the sound converter 170 are not part of the server S but are part of the user's electronic devices P1 and P2. It may also be included in the configuration.

Here, as an example, the sound conversion method may include forming a virtual atmosphere in the virtual space (S10).

The step of forming the virtual atmosphere (S10) may be implemented by the atmosphere forming unit 110.

For example, the administrator of the server (S) may input a predetermined input value defining the virtual atmosphere of the virtual space through the input unit 500, and the atmosphere forming unit 110 may input a predetermined value entered by the administrator. The virtual standby corresponding to the input value can be formed.

For example, a predetermined input value defining the virtual atmosphere may mean temperature, pressure, humidity, etc. of the virtual space.

Meanwhile, in the step of forming the virtual waiting (S10), the user may input a predetermined input value defining the virtual waiting through his/her electronic device (P1, P2) and transmit it to the communication unit 300, The atmosphere forming unit 110 may form the virtual atmosphere corresponding to a predetermined input value entered by the user.

Meanwhile, the sound conversion method may further include generating a physical force in the virtual space (S20).

Here, the physical force may mean the force that is the source of generating sound in the virtual space.

For example, the step of generating the physical force (S20) may be implemented by the physical force generator 120.

For example, the administrator of the server S may preset an object that generates the physical force in a virtual space through the input unit 500.

For example, an object that generates physical force could be a bomb that explodes at a specific point in time.

At this time, the physical force generator 120 can explode a bomb when a specific point in time arrives and generate the physical force corresponding to the explosive force on the virtual atmosphere of the virtual space.

For example, the physical force may mean temperature, pressure, humidity, etc. that change with time and affect the virtual atmosphere.

Meanwhile, in the step of generating the physical force (S20), the user can input a predetermined input value defining the physical force through his/her electronic device (P1, P2) and transmit it to the communication unit 300, and generate the physical force. Unit 120 may generate the physical force corresponding to a predetermined input value input by the user on the virtual atmosphere.

For example, the user's character may install a bomb in the virtual space that explodes at a specific time.

Meanwhile, the sound conversion method may further include a step (S30) of generating virtual data on the virtual atmosphere based on the physical force.

Here, the virtual data may mean data about the state of the virtual atmosphere that is changed by the physical force generated on the virtual atmosphere.

That is, the physical force is generated on the virtual atmosphere by the step (S20) of generating the physical force in the initial state set by the step (S10) of forming the virtual atmosphere, and the physical force is generated on the virtual atmosphere by the physical force. It can change from the initial state to another state.

For example, in the virtual atmosphere, the temperature, pressure, and/or humidity of the virtual atmosphere may increase or decrease due to the physical force over time, and changes such as waves may occur.

Accordingly, the virtual data may mean data about the state of the virtual atmosphere changed by the physical force.

For example, the step of generating the virtual data (S30) may be implemented by the virtual data generator 130.

For example, as shown in FIG. 3, the virtual data generator 130 generates the physical force over time based on the object that generated the physical force at a predetermined location (X1) in the virtual space. You can define the state of the virtual atmosphere that changes by.

The state of the virtual atmosphere at the location of X2, which is relatively close to It can be defined as the virtual data that is relatively little affected by the physical force, and the state of the virtual atmosphere at the location of X4, which is far away from It can be.

The virtual data generator 130 generates the virtual data on the virtual atmosphere based on the physical force when the physical force is generated from an object that generates the physical force, regardless of the user's character position in the virtual space. can do.

That is, the virtual data generator 130 may generate the virtual data that changes in the virtual atmosphere over time based on the point in time when the physical force was generated, regardless of the user's character position.

For example, the virtual data may be generated by the virtual data generator 130 and stored in the memory unit 200 according to the location of the virtual space and the passage of time from when the physical force was generated.

Meanwhile, the sound conversion method may further include a step (S40) of specifying a predetermined location in the virtual space.

Here, the predetermined location refers to a specific location in the virtual space for generating sound in the virtual space, and may refer to the location of the user's character.

The step of specifying the predetermined location (S40) may be implemented by the location specification unit 140.

For example, the user may input a predetermined location in the virtual space through his/her electronic devices (P1, P2) or input an input value for locating his/her character at a predetermined location and transmit it to the communication unit 300. The location specification unit 140 can position the user's character at a location in the virtual space corresponding to a predetermined input value entered by the user or specify the location.

Meanwhile, the user may input not only the predetermined location but also a specific point in time or time in the present or the past through his/her electronic devices (P1, P2).

Meanwhile, the sound conversion method may further include a step (S50) of specifying the virtual data corresponding to the predetermined location.

The step of specifying the virtual data (S50) may be implemented by the virtual data specification unit 150.

For example, the virtual data specification unit 150 selects the virtual data corresponding to the predetermined location and/or a specific time point specified by the step (S40) of specifying the predetermined location among the numerous virtual data. (specific) can be done.

For example, the virtual data specification unit 150 may select (specify) the virtual data corresponding to the predetermined location and/or specific time point among the numerous virtual data stored in the memory unit 200.

Afterwards, the sound conversion method may further include a step (S60) of converting the virtual data selected by the step (S50) of specifying the virtual data into wave data.

For example, the wave data is intermediate data for converting the virtual data into sound, and may mean data having information about waves (sound waves) corresponding to the virtual data.

For example, the step of changing to wave data is a step that is implemented only when the virtual data exists by specifying the virtual data (S50), and may not be implemented if the virtual data does not exist.

For example, the step of converting into wave data (S60) may be implemented by the wave data conversion unit 160.

For example, the wave data conversion unit 160 may be a component of the controller 100 of the server S, but may also be a component of the user's electronic devices P1 and P2.

If the wave data conversion unit 160 is a component of the user's electronic device (P1, P2), the user's electronic device (P1, P2) is the virtual data specified in the step (S50). Virtual data can be received, and the received virtual data can be converted into the wave data.

For example, the wave data converter 160 may use the virtual data to generate the wave data including frequency, pitch, wavelength, period, amplitude, sound pressure, phase, etc. that constitute a sound wave.

After this, the sound conversion method may further include converting the wave data into sound (S70).

Here, sound refers to a sound that a user can hear through a speaker or headphone, and the step of converting the sound into sound (S70) can be implemented by the sound conversion unit 170.

For example, the sound conversion unit 170 is a component that converts the wave data, which is digital information, into sound (mp3, FLAC, or wav, etc.), which is an audible sound wave, and is a component of the controller 100 of the server (S). It may be, or it may be a component of the user's electronic devices (P1, P2).

As a result, the user can hear sounds generated in the virtual space at a certain location and time point through the user's electronic devices (P1, P2).

Meanwhile, the sound conversion method may further include transmitting the virtual data, the wave data, or the sound to another electronic device (S80).

To explain this in more detail, the virtual data, the wave data, or the sound at a predetermined location and point in the virtual space specified by the first user among the plurality of users are transmitted to the server (S) or the first user. It may be transmitted to the second user's electronic device (P2) through the user's electronic device (P1).

As a result, the second user can hear the sound from the location specified by the first user or where the first user's character is located.

Meanwhile, the sound conversion method may further include a step (S90) of changing the characteristics of the character based on the virtual data.

The step of changing the characteristics of the character (S90) may be implemented by the characteristic change unit 180.

To explain this in more detail, when a user's character (Player Character) or NPC (Non-Player Character) is located in the virtual space by specifying the predetermined location (S40), numerous physical forces are generated. The virtual data according to the character may be acquired, and the characteristic change unit 180 may change the characteristics of the character according to the acquired virtual data.

For example, when the physical force is generated by playing a piano, the character that acquires the virtual data generated by the physical force may change to a gentle personality and/or appearance, and if the physical force is generated by an explosion of an explosive. In this case, the character that has acquired the virtual data generated by the physical force may change to an aggressive personality and/or appearance.

That is, the characteristic changing unit 180 can change the characteristics (personality, appearance, etc.) of the character based on the virtual data corresponding to the character located in the virtual space.

Meanwhile, in FIG. 5, the step of specifying the predetermined location (S40) is described as being implemented after the step of generating the virtual data, but it is not limited thereto, and the step of forming the virtual atmosphere (S10) or It is obvious that this can be implemented immediately after the step of generating the physical force (S20).

Meanwhile, the sound conversion system 10 in the virtual space may refer to a device that implements the sound conversion method in the virtual space through the configurations described above.

As described above, the sound conversion method and system 10 in the virtual space can generate and store the virtual data, regardless of whether a character exists, when the physical force is generated in the virtual space.

As a result, the user can obtain the virtual data corresponding to a specific location in the virtual space and a specific time in the past, finally listen to the sound, and transmit it to other users.

In the above, the configuration and features of the present invention have been described based on the embodiments according to the present invention, but the present invention is not limited thereto, and various changes or modifications may be made within the spirit and scope of the present invention. It is obvious to those skilled in the art, and therefore, it is stated that such changes or modifications fall within the scope of the appended patent claims.

Claims

In the sound conversion method in virtual space implemented by the sound conversion system in virtual space,

forming a virtual atmosphere in the virtual space;

Generating physical force in the virtual space; and

It includes: generating virtual data on the virtual atmosphere based on the physical force,

The virtual data is,

Data about the state of the virtual atmosphere changed by the physical force,

How to convert sound in virtual space.
According to paragraph 1,

Specifying a predetermined location in the virtual space;

specifying the virtual data corresponding to the predetermined location;

Converting the virtual data into wave data; and

Converting the wave data into sound; further comprising,

How to convert sound in virtual space.
According to paragraph 2,

Transmitting the virtual data or the wave data to another electronic device; further comprising,

How to convert sound in virtual space.
According to paragraph 2,

Further comprising: changing the characteristics of the character based on the virtual data,

How to convert sound in virtual space.
an atmosphere forming unit that forms a virtual atmosphere in virtual space;

a physical force generator that generates physical force in the virtual space; and

It includes a virtual data generator that generates virtual data on the virtual atmosphere based on the physical force,

The virtual data is,

Data about the state of the virtual atmosphere changed by the physical force,

A sound conversion system in virtual space.
According to clause 5,

a location specification unit that specifies a predetermined location in the virtual space;

a virtual data specification unit that specifies the virtual data corresponding to the predetermined location;

A wave data conversion unit that converts the virtual data into wave data; and

Further comprising a sound conversion unit that converts the wave data into sound,

A sound conversion system in virtual space.
According to clause 6,

Further comprising; a communication unit transmitting the virtual data or the wave data to another electronic device;

A sound conversion system in virtual space.
According to clause 6,

Further comprising a characteristic change unit that changes the characteristics of the character based on the virtual data,

A sound conversion system in virtual space.