WO2017119568A1 - Sound-based game control apparatus and method - Google Patents

Abstract

The present invention proposes a sound-based game control apparatus and method that enable controlling a game by evaluating user input information when the user input information corresponding to a sound outputted to the user is obtained. The apparatus, according to the present invention, comprises: a sound output unit for outputting a sound in at least one direction of a user; an evaluation information generation unit for obtaining user input information corresponding to the sound, and generating evaluation information obtained by evaluating the input information on the basis of information on the sound; and a game control unit for, on the basis of the evaluation information, controlling a game played by the user.

Description

Sound-based game control device and method

The present invention relates to an apparatus and method for controlling a game. More particularly, the present invention relates to an apparatus and method for controlling a game based on a sound signal.

Conventional games are generally designed to be enjoyed depending on the user's perspective. Although a sound is included in a conventional game, the sound can only perform a function of providing a user with specific information or inducing a user's interest. Therefore, in the related art, the visually impaired may not enjoy the game regardless of his / her intention.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and proposes a sound-based game control apparatus and method for controlling a game by evaluating the input information when the user's input information is obtained corresponding to the sound output to the user. The purpose.

However, the object of the present invention is not limited to the above-mentioned matters, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

The present invention has been made to achieve the above object, a sound output unit for outputting sound in at least one direction of the user; An evaluation information generation unit obtaining input information of the user in response to the sound and generating evaluation information evaluating the input information based on the information on the sound; And a game controller for controlling a game executed by the user based on the evaluation information.

Preferably, the evaluation information generation unit compares the input information with information about the sound and generates as the evaluation information whether the input information matches the information about the sound.

Preferably, when it is determined that the input information and the sound information match, the game controller controls the game so that a score is given to a game score, and the input information and the sound information do not match. If determined, the game score is given to the game score or the game is terminated.

Preferably, the evaluation information generation unit information on at least one point touched on the screen of the device for executing the game with the input information, the point touched when the screen of the device is divided into at least two local screens Information on a local screen to which the device belongs, information on a button input among buttons output on the screen of the device, information on a tilt of the device, information on a character input on the screen of the device, Acquire at least one of information on the number of touches input on the screen and information on the movement of the user.

Preferably, the evaluation information generating unit is at least one of a sensor attached to the body of the user, a sensor mounted on the device worn by the user, a sensor formed on the bottom surface of the space in which the user is located and the sensor for photographing the user Information about the movement of the user is obtained as the input information by using one sensor.

Preferably, the evaluation information generator is information about the output direction of the sound, information on the type of the sound, information on the size of the sound, information on the content of the sound and the sound as information about the sound. Use at least one piece of information about the moving direction of.

Preferably, when the evaluation information generation unit uses the information on the type of the sound as information on the sound, the information on the output direction of the sound, the information on the content of the sound and the At least one piece of information on a moving direction of a sound is further used as information on the sound.

Preferably, the evaluation information generator determines whether the content of the sound is related to any of language and numbers when the information on the content of the sound is used as the information on the sound.

Preferably, when it is determined that the content of the sound is related to a number, the evaluation information generation unit obtains information on the number of touches input on the screen of the device that executes the game with the input information, and the content of the sound is language. If it is determined to be related to the information obtained by the input information about the points touched in a sliding manner on the screen of the device.

Preferably, when the evaluation information generation unit uses the information on the size of the sound as the information on the sound, the information on the content of the sound is further used as the information on the sound when generating the evaluation information.

Preferably, the sound-based game control device further comprises a screen division processing unit for dividing the screen of the device running the game into at least two local screens.

Preferably, the screen division processing unit operates when information on the type of sound is used as information on the sound.

Preferably, the screen division processing unit does not operate when information on the movement direction of the sound is used as the information on the sound.

Preferably, the sound-based game control device further comprises an audible information generating unit for generating information on an audible frequency or information on the audible volume for at least one ear of the user.

Preferably, the audible information generation unit operates when information on the size of the sound is used as the information on the sound.

Preferably, the sound-based game control device calculates a time difference between the time of outputting the sound and the time of obtaining the input information by measuring the time of outputting the sound and the time of obtaining the input information, respectively, And a time difference comparator for determining whether the time difference exceeds a reference value, and wherein the evaluation information generator is based on information obtained by comparing the time difference with the reference value when it is determined that the time difference exceeds the reference value. Create

Preferably, the sound-based game control device further comprises a sound adjusting unit for changing the point of outputting the sound or the size of the sound.

Preferably, the sound adjusting unit changes the point at which the sound is output based on at least one of information about the location of the user, information about the physical condition of the user, and information about the direction of the user's gaze; Change the volume of the sound.

In addition, the present invention comprises the steps of outputting sound in at least one direction of the user; Acquiring input information of the user corresponding to the sound and generating evaluation information evaluating the input information based on the information on the sound; And controlling a game executed by the user based on the evaluation information.

Preferably, the generating step compares the input information with information about the sound and generates the evaluation information as to whether the input information matches the information about the sound.

Preferably, the controlling step controls the game so that a score is given to a game score when it is determined that the input information and the information about the sound match, and the input information does not match the information about the sound. If it is determined that the game score is deducted or the game is terminated to control the game.

Preferably, the generating may include information on at least one point touched on a screen of a device that executes the game with the input information, and a touched point when the screen of the device is divided into at least two local screens. Information on a local screen to which the device belongs, information on a button input among buttons output on the screen of the device, information on a tilt of the device, information on a character input on the screen of the device, Acquire at least one of information on the number of touches input on the screen and information on the movement of the user.

Preferably, the generating may include at least one of a sensor attached to a body of the user, a sensor mounted on a device worn by the user, a sensor formed on a bottom surface of a space in which the user is located, and a sensor for photographing the user. Information about the movement of the user is obtained as the input information by using one sensor.

Preferably, the generating may include information on an output direction of the sound, information on the type of the sound, information on the size of the sound, information on the content of the sound, and the sound as information on the sound. Use at least one piece of information about the moving direction of.

Preferably, the generating may include information on an output direction of the sound, information on the content of the sound and the information when generating the evaluation information when the information on the type of the sound is used as the information on the sound. At least one piece of information on a moving direction of a sound is further used as information on the sound.

Preferably, the generating may determine whether the content of the sound relates to a language or a number when the information on the content of the sound is used as the information on the sound.

Preferably, in the generating step, when it is determined that the content of the sound is related to a number, information about the number of touches input on the screen of the device that executes the game is input as the input information, and the content of the sound is in a language. If it is determined to be related to the information obtained by the input information about the points touched in a sliding manner on the screen of the device.

Preferably, the generating step further uses information on the content of the sound as information on the sound when generating the evaluation information when the information on the size of the sound is used as the information on the sound.

Preferably, the method further includes dividing the screen of the device executing the game into at least two local screens between the outputting and the generating.

Preferably, the dividing step operates when information on the type of the sound is used as the information on the sound.

Preferably, the dividing step does not work when information on a movement direction of the sound is used as well as information on the type of the sound as information on the sound.

Preferably, the method further includes obtaining information on an audible frequency or information on an audible volume for at least one ear of the user between the outputting and the generating.

Preferably, the acquiring step operates when information on the size of the sound is used as the information on the sound.

Preferably, between the outputting time and the generating step, between the time of outputting the sound and the time of acquiring the input information by measuring the time of outputting the sound and the time of acquiring the input information, respectively. Calculating a time difference, and determining whether the time difference exceeds a reference value, wherein the generating step is based on information obtained by comparing the time difference with the reference value when it is determined that the time difference exceeds the reference value. To generate the evaluation information.

Preferably, the method further includes changing the point of outputting the sound or changing the size of the sound between the outputting and the generating.

Preferably, the changing may include changing a point at which the sound is output based on at least one of information about the location of the user, information about the physical condition of the user, and information about the direction of the user's gaze. Or change the volume of the sound.

The present invention also proposes a computer program stored in a computer-readable recording medium for executing the above sound-based game control method.

The present invention can achieve the following effects through the configuration for achieving the above object.

First, since the game is controlled based on the user's hearing information, the visually impaired can enjoy the game.

Second, it is possible for the user to close the eyes and enjoy the game, and eliminate eye strain caused by playing the game for a long time.

Third, because the game proceeds based on auditory information, the imagination and reality can be maximized more than when the game proceeds based on visual information.

1 is a conceptual diagram illustrating a sound signal based game method according to a first embodiment of the present invention.

2 is a conceptual diagram illustrating a sound signal based game method according to a second embodiment of the present invention.

3 is a conceptual diagram illustrating a game sound signal setting method according to an embodiment of the present invention.

4 is a conceptual diagram illustrating a game progress method using a sense of space of a sound according to an embodiment of the present invention.

5 to 7 are conceptual views illustrating a method of setting a sound signal in a game according to the first embodiment of the present invention.

8 and 9 are conceptual views illustrating a method of setting a sound signal in a game according to a second embodiment of the present invention.

10 is a conceptual diagram illustrating a method of setting a sound signal in a game according to a third embodiment of the present invention.

11 is a conceptual diagram illustrating a sound adjusting method in consideration of an external environment according to an embodiment of the present invention.

12 is a flowchart illustrating a sound-based game control method according to an embodiment of the present invention.

13 is a block diagram schematically showing a sound-based game control apparatus according to a preferred embodiment of the present invention.

FIG. 14 is a block diagram illustrating components that may be additionally included in the sound-based game control apparatus of FIG. 13.

15 is a flowchart schematically illustrating a sound-based game control method according to an exemplary embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the following will describe a preferred embodiment of the present invention, but the technical idea of the present invention is not limited thereto and may be variously modified and modified by those skilled in the art.

Game sound refers to all sounds expressed in the game. For example, the background sound you hear when you play the game, the sound of the car's engine in the game, the gunshot when you shoot with the gun, and the click sound when the player presses the menu button. Included in The sound of the game is used to provide game player feedback and meaning of the game.

The game sound can play the following roles. Game sounds can induce tension in the game by expanding the emotions generated through the user's game play or inducing changes in the user's emotions and foretelling future events and events. In addition, the game sound can help the user to concentrate the game play by maximizing the user's attention, maximize the purpose and atmosphere of the game, and improve the overall quality of the game by arranging the sound and music according to the game plan.

Game sounds are as follows. First of all, it is background music, which is all musical elements that come out of the game, and there are many repetitive patterns, and they are produced differently according to the game environment such as the genre of the game and the composition of the times.

A sound effect is a sound that is added to add realism to the scene and includes all the contents conveying the game situation. It can be included as an important factor in playing the game.

Character voices are often produced by professional voice actors as the proportion of voice elements increases due to the development of all voice elements such as giggles and screams and game hardware.

As game players play the game, the game sound is supported in real time, allowing users to interact with the sound, react to it, listen to BGM (joyful music), and immerse themselves in the game. In addition to the above cases, in the current game market, a case in which a sound signal is used as information for playing a game is increasing.

Hereinafter, a sound based game control apparatus and method will be described.

The sound-based game control method according to an aspect of the present invention is connected to the user device to provide a game to the user through a sound signal providing unit implemented to supply a first sound signal to the user's left ear and a second sound signal to the user's right ear. Providing a control sound signal for manipulation; And controlling a game to be executed through the user device based on an input signal input through the user device based on the control sound signal. The control sound signal may be a first sound signal or a second sound signal, and the input signal may be a first input signal corresponding to the first sound signal or a second input signal corresponding to the second sound signal.

The first input signal may be a touch signal or a slide signal on the left split touch screen divided based on the left button input signal of the user device or the left and right split of the touch screen of the user device. The second input signal may be a touch signal or a slide signal on the right split touch screen divided based on the right button input signal of the user device or the left and right division of the touch screen of the user device.

In addition, the first input signal may be a left tilt signal generated by tilting the user device to the left. The second input signal may be a right tilt signal generated by tilting the user device to the right.

The first frequency and the first volume of the first sound signal are determined based on the audible frequency of the left ear, the audible volume, and the like, and the second frequency and the second volume of the second sound signal are based on the audible frequency, audible volume, etc. of the right ear. Can be determined.

In addition, the first frequency and the first volume of the first sound signal may be determined based on the position of the left ear, and the second frequency and the second volume of the second sound signal may be determined based on the position of the right ear. In this case, the position of the left ear and the position of the right ear may be determined based on the location information of the user and the body information of the user, and the location information of the user and the body information of the user may be generated based on the infrared sensing module.

On the other hand, the sound-based game control method according to another aspect of the present invention, the control sound for the game operation to the user through a sound signal providing unit which is connected to the user device is implemented to supply a sound signal having a different volume volume to the user's ears Providing a signal; And controlling a game executed through the user device with an input signal input through the user device based on the control sound signal. The control sound signal is a first sound signal of a first volume or a second sound signal of a second volume, and the game is set such that an input signal is generated corresponding to only the first sound signal.

A user device for performing sound based game control according to an aspect of the present invention includes a processor. The processor is connected to the user device to provide a first sound signal to the user's left ear, and to provide a control sound signal for game operation to the user through a sound signal provider configured to supply a second sound signal to the user's right ear. The controller may be configured to control a game executed through the user device with an input signal input through the input unit of the user device based on the control sound signal. The control sound signal may be a first sound signal or a second sound signal, and the input signal may be a first input signal corresponding to the first sound signal or a second input signal corresponding to the second sound signal.

The first input signal is a touch signal or a slide signal on the left split touch screen divided based on the left button input signal of the user device or the left and right division of the touch screen of the user device, and the second input signal is a right button input signal of the user device. Alternatively, the touch signal may be a touch signal or a slide signal on the right split touch screen divided based on left and right division of the touch screen of the user device.

In addition, the first input signal may be a left tilt signal generated by tilting the user device to the left, and the second input signal may be a right tilt signal generated by tilting the user device to the right.

The first frequency and the first volume of the first sound signal are determined based on the audible frequency and audible volume of the left ear, and the second frequency and the second volume of the second sound signal are determined based on the audible frequency and audible volume of the right ear. Can be.

In addition, the first frequency and the first volume of the first sound signal may be determined based on the position of the left ear, and the second frequency and the second volume of the second sound signal may be determined based on the position of the right ear. In this case, the position of the left ear and the position of the right ear may be determined based on the location information of the user and the body information of the user, and the location information of the user and the body information of the user may be generated based on the infrared sensing module.

A user device for performing sound based game control according to another aspect of the present invention includes a processor. The processor provides a control sound signal for game operation to the user through a sound signal providing unit which is connected to the user device and is configured to supply sound signals having different volume levels to the user's ears, based on the control sound signal. The input signal input through the device is implemented to control a game executed through the user device. The control sound signal is a first sound signal of a first volume or a second sound signal of a second volume, and the game is set such that an input signal is generated corresponding to only the first sound signal.

Sound-based game control method and apparatus according to an embodiment of the present invention described above allows the user to enjoy the game based on a variety of senses by utilizing the sound signal in the game. As a result, the user can enjoy the game using various senses, and the game developer can develop various games using the hearing.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram illustrating a sound signal based game method according to a first embodiment of the present invention.

In FIG. 1, a method of controlling the user device 120 in a predetermined time according to a specific sound or a command heard by the user 110 is disclosed. The user device 120 may be implemented as a device (game device) or system for a game such as a smartphone, a tablet, a computer (PC), and the like.

For convenience of description, a game progress method based on a sound signal providing unit 130 such as an earphone is disclosed, but a game progress method based on a speaker capable of distinguishing between left and right sides may also be performed.

Referring to FIG. 1, the user 110 detects a direction of a specific sound heard through the ear of the user 110 and proceeds to play a game by pressing a touch screen screen or a button of the user device 120 according to the direction of the sound. have. Alternatively, the user 110 may detect a direction of a specific sound coming into the ear of the user 110 and may touch the touch screen in a predetermined direction in a slide manner or move the user device 120 in a specific direction to play a game.

As a specific example, the zombie attack voice may be heard through the first earphone 130a worn on the left ear of the user 110 or the second earphone 130b worn on the right ear of the user 110. The user 110 may press the touch screen (or button) of the user device 120 in response to the direction in which the sound is heard, and the direction in which sound is heard in response to the manipulation of the touch screen (or button) of the user 110. Attacks on zombies located at may take place in the game.

When the user 110 perceives that the sound is heard through the user's right ear, the user 110 touches (or presses the right button) the right screen of the user device 120 to attack the zombies coming from the right side in the game. Can be performed. Conversely, when the user 110 perceives that the sound is heard through the user's left ear, the user 110 attacks the zombie coming from the left in the game by touching (or pressing the left button) the left screen of the user device 120. This can be done.

If the user 110 perceives that the sound is heard through the right and left ears of the user 110, by simultaneously touching (or pressing the right button / left button) the right screen and the left screen of the user device 120. Attacks on zombies coming from the right and left sides of the game can be performed.

As another example, animal sounds such as cat sounds and dog sounds may be heard through the first earphone 130a worn on the left ear of the user 110 or the second earphone 130b worn on the right ear of the user 110. The rule of the game may be a manner in which the user 110 reacts by recognizing a direction in which a cat sound comes out.

It may be assumed that a cat sound is output through the first earphone 130a and a dog sound is output through the second earphone 130b. The user may recognize a cat sound played through the first earphone 130a and touch the left button (or the left side on the touch screen). The game may be progressed by determining whether the value input by the actual user 110 is correct based on the touch result. If the touch result is different from the cat sound / dog sound actually played, a penalty may be scored or the game may end.

As another example, the sound of flying stones may be heard through the first earphone 130a worn on the left ear of the user 110 or the second earphone 130b worn on the right ear of the user 110. When the sound of the stone is heard from the left or the right side, the game is released by touching the screen of the user device 120 in a sliding manner or by tilting the user device 120 to avoid the stone. Can proceed. In this game, the game can be controlled in a sliding or tilting direction without dividing the touch screen of the user device 120 to the left and the right.

That is, the game may be operated by manipulating the user device 120 to a predetermined time based on the sound heard by the user 110.

2 is a conceptual diagram illustrating a sound signal based game method according to a second embodiment of the present invention.

In FIG. 2, a method of playing a game by manipulating the user device 120 according to an instruction of a command coming into the ear of the user 110 is disclosed.

Referring to FIG. 2, when the command “3” is heard through the left earphone 130a / right earphone 130b worn by the user, the display screen of the user device 120 is commanded in the direction in which the command is heard within a predetermined time. The game may proceed by pressing the number of times. If the command '5' is heard through the second earphone 130b, the game may be progressed by solving the game mission by continuously touching the right screen of the user device 120 five times within a predetermined time.

As another example, the game may be progressed by dividing the screen of the user device 120 to the left / right, listening to a command, and touching the screen in a sliding manner as in the hearing / white game. For example, when a command of 'left up' is heard to the left ear of the user 110, the user 110 may touch the left screen of the divided screen of the user device 120 in a sliding manner from below to upward. . When the command 'downwardly left' is heard to the left ear of the user 110, the user 110 may touch the left screen of the divided screen of the user device 120 in a sliding manner from the up direction to the down direction.

That is, the game proceeds by manipulating the user device 120 until a set time based on the sound coming into the ear of the user 110, and touching the screen of the user device 120 according to the type, command, and direction of the sound to play the game. This can be done.

The game may be played based on the volume information as well as the sound heard from the left and the sound from the right. For example, in the case of a rice barley game, the game may be performed by touching the screen in response to the barley sound having a volume greater than the reference value, without touching the screen to the barley sound having a volume smaller than the reference value.

On the other hand, it is also possible to play the game based on the content information of the sound signal. For example, in the case of a rice barley game, the screen does not touch the 'barley' sound with a volume lower than the reference value, and the screen does not touch the 'barley' sound with the volume higher than the reference value. The game can be played by touching the screen in response to only the small volume / high volume 'rice' sounds.

The sound-based game progression method as described above may be performed based on a stereoscopic sound such as a binaural sound. The binaural sound may be a sound recorded by binaural recording using a binaural effect. The binaural effect is a phenomenon in which the direction of sound is perceived by the sound pressure difference and the phase difference of sound reaching the two ears of the user (a sense of directionality) and a phenomenon in which the two ears feel the sound more than listening in one ear. Binaural recording may be performed using a dummy head in which a microphone is installed to generate binaural sound.

3 is a conceptual diagram illustrating a game sound signal setting method according to an embodiment of the present invention.

In FIG. 3, a method of adaptively determining a frequency of a sound signal and a magnitude of a sound signal according to the hearing ability of the user 110 is disclosed.

Referring to FIG. 3, information about hearing sensitivity of the user 110 may be obtained first in order to proceed with a game. Since hearing sensitivity is different for each user 110, a procedure for acquiring hearing sensitivity of the user 110 may be performed to set an initial sound value (or an initial sound characteristic). For example, the user device 120 may input information of a predetermined decibel into the left ear of the user to obtain information about an audible frequency and audible volume that the left ear of the user can hear. In the same manner, the user device 120 may input information of a predetermined decibel into the right ear of the user 110 to obtain information about an audible frequency, audible volume, etc. that the right ear of the user 110 may hear.

The initial audible frequency (left) 121, the initial audible volume (left) 122, the initial audible frequency (right) 123, the initial audible volume (right) 124 and the like thus obtained are game settings. Can be used to adjust the difficulty. For example, the success of the mission may be determined depending on whether the volume information of the small size heard by the left ear or the right ear can be heard in the mission having a high difficulty according to the volume in the game.

In addition, the information about the initial audible frequency (left) 121, the initial audible volume (122), the initial audible frequency (right) 123, the initial audible volume (right) 124, and the like thus obtained is the user 110 ) Can be used to set the volume for less hearing fatigue. When the user 110 continuously uses hearing during the game, the user 110 may feel auditory fatigue.

Accordingly, in the present invention, the initial audible frequency (left) 121, the initial audible volume (left) 122, the initial audible frequency (right) 123, the initial audible volume (right) 124 of the user 110, etc. In consideration of this, the user 110 may set the frequency / volume of the appropriate level so as not to feel the fatigue as much as possible in the game.

4 is a conceptual diagram illustrating a game progress method using a sense of space of a sound according to an embodiment of the present invention.

In FIG. 4, a method of playing a game using a three-dimensional space of sound is disclosed.

Referring to FIG. 4, when a game is played based on a stereoscopic sound system such as binaural sound, the user 110 may detect that the sound is input from various directions about the user 110.

For example, front left top 201, front left bottom 202, front right top 203, front right bottom 204, rear left top 205, rear left bottom 206, rear right top ( 207, the user 110 may sense that the sound signal is input in various directions such as the rear right bottom 208, and the game may be progressed through the response to the sound signal in the 3D space. The sound signal on the 3D space may be provided not only on a separately implemented stereo sound system but also on earphones (or headphones).

In more detail, the game may be performed by catching a worm such as a mosquito 210 to obtain a score. In the game, the mosquito 210 may be simulated as flying in the surrounding 3D space of the user 110. The user 110 may play a game based on a virtual reality (VR) device 220 and a user motion detection sensor (not shown) that senses movements of the user 110.

The sound of the mosquito 210 flying is based on the stereoscopic sound according to the movement direction of the mosquito 210, the front left top 201, the front left bottom 202, the front right top 203, the front right bottom 204 , The upper left rear 205, the rear lower left 206, the rear upper right 207, the rear lower right 208, and the like, may be heard by the user 110 in various directions, and the user 110 may be a VR device 220. The position of the mosquito 210 can be felt in three dimensions. The sound signal may be generated such that a louder sound is transmitted to the user 110 as the mosquito 210 is closer to the ear of the user 110.

That is, the user 110 may sense the position of the mosquito 210 through the VR device 220, and the sound according to the position of the mosquito 210 may be provided based on a stereoscopic sound.

The user 110 may take an operation of catching the mosquito 210 according to the position of the mosquito 210 acquired based on visual information, auditory information, and the like. The motion detection sensor for detecting the motion of the user 110 may be a user. The motion of the operation 110 may be sensed to determine whether the mosquito 210 is caught by the operation of the user 110. The motion detection sensor may be implemented to be worn on the body of the user 110, and may be formed on the bottom surface 240 of the space 230 in which the user 110 is located.

In order to operate the game based on the three-dimensional sound signal as described above, it is necessary to set up a game in consideration of the position, direction, and physical condition of the user 110 in the space 230.

5 to 7 are conceptual views illustrating a method of setting a sound signal in a game according to the first embodiment of the present invention.

5 to 7 disclose a method of adjusting a stereoscopic signal provided to the user 110 based on the information on the position of the user 110.

First, referring to FIG. 5, the user 110 may move from a current position to another position during game play. When three-dimensional sound is delivered to the user 110 without considering the position of the user 110, the sense of space provided to the user 110 may be uniform, and the progress of the game in consideration of the position of the user 110 may be performed. When performed, the user 110 may feel a difference from the actual reality. More specifically, the position of the left ear and the right ear of the user 110 is determined based on the position of the user 110, and adjustment of the spatial sound of the stereoscopic sound in consideration of the position of the left and right ears of the user 110 is required.

The user device may obtain information about the position of the left ear / right ear of the user 110 in the following manner. Hereinafter, although an embodiment of the present invention uses the term game system, the game system may be interpreted as a user device having a large meaning. The game system may set a certain point as the default point 310, and the left ear / right side of the user 110 according to the moving position of the user 110 and the moving position of the user 110 based on the default point 310. The position of the ear can be determined.

The game system may implement a module for determining the position of both ears of the user 110 such as an infrared sensor and a laser. A user's ear position determiner such as an infrared detector, a laser, etc. may determine a moving position of the user 110 based on the default point 310, and additionally detect a shape of the user 110 to detect the head of the user 110. The location of the left and right ears located in the portion can be determined.

Alternatively, a sensor capable of sensing the weight of the user 110 is separately implemented as a user ear position determiner on the bottom surface 240 of the space 230 where the user 110 is located, and the user ear position determiner 110 ) Can be determined as the position of the user 110 and the rough position of the left and right ears of the user 110 standing based on the position of the user 110 can be predicted.

The determined information about the positions of the left and right ears of the user 110 may be input to the sound adjusting unit of the game system. The information about the positions of the left and right ears may be information about the positions of the left and right ears in the 3D space.

The sound adjusting unit may be implemented to adjust the sound signal in consideration of positional information of the left and right ears of the user 110. The default sound may be three-dimensional sound generated when the user 110 is located at the default point 310 and the user 110 stands in the front.

The sound adjusting unit may provide the adjusted sound to the user 110 by adjusting the volume of the default sound in consideration of the positional information of the left and right ears of the user 110.

For example, if the user 110 is facing the front at a point 320 away from the default point 310 to the left, the adjusted sound delivered to the location is transmitted to the left ear of the user 110. The volume of the first sound to be lowered, and the volume of the second sound delivered to the right ear of the user 110 may be a high sound.

In this manner, the sound signal adjusted according to the position of the left / right ear of the user 110 may be provided to the user 110. In addition, when this method is used and a plurality of users play the game using different game systems at different locations, different sound signals are provided according to the positions of the left and right ears of each user, so that the game is more realistic and diverse. Can be configured and provided to each user.

5 described above is an example of adjusting a volume of a sound signal output from each side 201 to 208 in consideration of the position of the user 110. However, the present invention is not limited thereto, and as shown in FIGS. 6 and 7, the devices 331 to 338 and 341 to 348 which output sound signals from each side according to the position of the user 110 may be changed. It is also possible. To this end, it is preferable that a plurality of devices 331 to 338 and 341 to 348 outputting a sound signal are mounted at a predetermined distance between the upper and lower ends of the space 230.

Meanwhile, in the present invention, the plurality of sound signal output devices may not be provided at each stage of the space 230, and the positions of the devices outputting the sound signal may be changed according to the position of the user 110.

8 and 9 are conceptual views illustrating a method of setting a sound signal in a game according to a second embodiment of the present invention.

8 and 9 disclose a method of adjusting a stereoscopic signal provided to a user based on information about a physical condition of the user. The game system may further consider the body information of the user 110 so that the position of the left ear and the right ear of the user 110 are more accurately predicted.

In the present invention, the sense of space of the sound signal felt by the user 110 may be adjusted in consideration of the physical condition of the user 110. For example, the spatial feeling of the sound signal sensed by the user 1 having a height of 180 cm and the user 2 having a height of 160 cm may be different from each other. Therefore, it is necessary to adjust the spatial sense of the sound signal in consideration of the physical condition of the user 110. The sound signal generated based on the user 3 whose height is 170 cm may be assumed as the default sound signal. In this case, the sound signal transmitted to the user 2 having a height of 160 cm may be a signal in which the default sound signal is adjusted to have a sense of space below 10 cm based on the default signal. Also, the sound signal transmitted to the user 1 having a height of 180 cm may be a signal obtained by adjusting the default sound signal to have a sense of space above 10 cm based on the default signal.

The adjustment of the default sound signal may be performed by the sound adjusting unit, and may be performed based on the volume of the sound signal, the frequency, the adjustment of the volume of each of the plurality of speakers, or based on various sound signals stored in a database. Can be.

For example, the database of the game system may store a sound signal for a phenomenon occurring at various heights based on the position of the ear of the user 110, determine the position of the ear of the user 110, and determine the user 110. The sound signal according to the position of the ear may be provided to the user 110. Specifically, in the case of a paper squeaking sound, the database of the game system contains a squeaking paper at the same position as the human ear, a paper squeaking 10 cm below the human ear, and a paper squeaking 10 cm above the human ear. Various sound signals may be stored, and the game system may provide the sound signal to the user 110 in consideration of the physical condition of the user 110.

The example described above is an example of adjusting the volume of the sound signal output from each side in consideration of the physical condition of the user 110. However, the present invention is not limited thereto, and as shown in FIGS. 8 and 9, the devices 351 to 358 and 361 to 368 that output sound signals from each side according to the position of the user 110 may be changed. It is also possible. To this end, it is preferable that a plurality of devices 351 to 358 and 361 to 368 outputting sound signals are mounted at a predetermined distance between the upper and lower ends of the space 230.

Meanwhile, in the present invention, the plurality of sound signal output devices may not be provided at each stage of the space 230, and the positions of the devices outputting the sound signal may be changed according to the position of the user 110.

10 is a conceptual diagram illustrating a method of setting a sound signal in a game according to a third embodiment of the present invention.

In FIG. 10, a method of setting a sound signal provided to the user 110 based on the information about the direction of the eyes of the user 110 is disclosed.

Referring to FIG. 4, the gaze direction of the user 110 stares at the left direction. In this case, the left wall surface is set forward, and the right wall surface is set backward. The first speaker 201 positioned at the front left upper side, the second speaker 202 positioned at the lower left front side, the third speaker 203 positioned at the upper right front side, and the fourth speaker positioned at the lower right front side ( 204, the fifth speaker 205 located at the rear left upper side, the sixth speaker 206 located at the lower rear left rear side, the seventh speaker 207 located at the upper rear right side, and the fifth speaker located at the lower rear right side. The order of the sound signals is set in order in the order of the eight speakers 208. When the order of the sound signals is set as described above, the user device 120 determines whether the touch signal of the user 110 is correctly input during the game in accordance with the order.

10, the gaze direction of the user 110 stares at the right direction. In this case, the right wall surface is set forward, and the left wall surface is set backward. The seventh speaker 207 located at the front left upper side, the eighth speaker 208 located at the front left bottom side, the fifth speaker 205 located at the front right upper side, and the sixth speaker located at the front right bottom side ( 206, the third speaker 203 located at the rear left upper side, the fourth speaker 204 located at the rear left lower side, the first speaker 201 located at the rear right upper side, and the second speaker located at the lower right rear side. The order of the sound signals is set in order in the order of the two speakers 202. When the order of the sound signals is set as described above, the user device 120 determines whether the touch signal of the user 110 is correctly input during the game in accordance with the order.

Meanwhile, the user device 120 may determine which direction the gaze direction of the user 110 gazes before setting the order of the sound signals in order.

The user device 120 obtains information about the gaze direction of the user 110 to determine which direction the gaze direction of the user 110 is gazing. In the present invention, the information on the eye gaze direction of the user 110 may be calculated through a camera mounted on at least one side of the space 230.

In addition, the information on the gaze direction of the user 110 may be calculated through the VR device 220 mounted on the head of the user. In this case, the user device 120 calculates a direction toward the front part of the VR device 220 based on the location information of the sensors mounted on the front part and the rear part of the VR device 220, and from this, Information about the gaze direction may be obtained.

11 is a conceptual diagram illustrating a sound adjusting method in consideration of an external environment according to an embodiment of the present invention.

In FIG. 11, when there is a signal flowing from the outside based on the location of the user 110, a method for increasing game immersion of the user 110 by canceling an external signal in consideration of the location of the user 110 is disclosed. .

Referring to FIG. 11, a microphone device (not shown) for receiving a sound signal from an external environment may be implemented in each of the left earphone 130a and the right earphone 130b worn by the user 110.

In more detail, a microphone device (left) may be implemented in the left earphone 130a, and a microphone device (right) may be implemented in the right earphone 130b.

The microphone device left installed in the left earphone 130a may receive a signal flowing into the left side of the user 110 and measure a left external noise signal 381. The microphone device right installed in the right earphone 130b may receive a signal flowing into the right side of the user 110 and measure the right external noise signal 382.

The left external noise signal 381 and the right external noise signal 382 received by each of the microphone device left and the microphone device right may flow into the sound controller. The sound adjusting unit may adjust the magnitude of the sound signal flowing into the left earphone 130a and the right earphone 130b based on the left external noise signal 381 and the right external noise signal 382. For example, when the right external noise signal 382 is larger than the left external noise signal 381, the volume of the sound signal flowing through the right earphone 130b is the volume of the sound signal flowing through the left earphone 130a. It can be set relatively large.

Alternatively, the left external noise signal 381 and the right external noise signal 382 received by the microphone device left and the microphone device respectively may be introduced into the sound adjusting unit, and the sound adjusting unit may include the left external noise signal 381. ) And a noise canceling signal may be generated in consideration of characteristics of the right external noise signal 382 and the noise flowing from the outside of the user 110 may be deleted.

12 is a flowchart illustrating a sound-based game control method according to an embodiment of the present invention.

First, the user device 120 provides an individual sound signal to both ears of the user 110 (S410).

The sound signal provider may be connected to the user device 120 to supply the first sound signal to the left ear of the user 110, and to supply the second sound signal to the right ear of the user 110. The sound signal providing unit may be an earphone, a headphone, or a plurality of speakers separately implemented. The sound signal providing unit may provide a user with a control sound signal for game operation.

In this case, the first frequency and the first volume of the first sound signal are determined based on the audible frequency and the audible volume of the left ear, and the second frequency and the second volume of the second sound signal are the audible frequency and audible volume of the right ear. It can be determined based on.

The first frequency and the first volume of the first sound signal may be determined based on the position of the left ear, and the second frequency and the second volume of the second sound signal may be determined based on the position of the right ear. The position of the left ear and the position of the right ear may be determined based on the location information of the user 110 and the body information of the user 110, and the location information and the body information may be generated based on the infrared sensing module.

After operation S410, the user device 120 controls a game that is being executed by an input signal input by the user based on the control sound signal in operation S420.

The control sound signal may be a first sound signal or a second sound signal, and the input signal may be a first input signal corresponding to the first sound signal or a second input signal corresponding to the second sound signal.

In detail, the first input signal may be a touch signal or a slide signal on the left split touch screen divided based on the left button input signal of the user device 120 or the left and right division of the touch screen of the user device 120. The second input signal may be a touch signal or a slide signal on the right divided touch screen divided based on the right button input signal of the user device 120 or the left and right division of the touch screen of the user device 120.

Alternatively, the first input signal may be a left tilt signal generated by tilting the user device 120 to the left, and the second input signal may be a right tilt signal generated by tilting the user device 120 to the right.

According to another embodiment of the present invention, the sound-based game control method is connected to the user device 120, the user through the sound signal providing unit is implemented to supply a sound signal having a different volume to the ear of the user 110 The controller 110 may provide a control sound signal for game operation and control a game executed through the user device 120 through an input signal input through the user device 120 based on the control sound signal.

The control sound signal is a first sound signal that is a first volume or a second sound signal that is a second volume, and the game may be set such that an input signal is generated corresponding to only the first sound signal.

The operations of the user device 120 described above with reference to FIGS. 1 through 12 may be performed based on a processor mounted therein.

The sound-based game control apparatus described above with reference to FIGS. 1 to 12 may be used to execute an auditory VR game.

Hearing VR games are virtual reality (VR) games that can be experienced only by hearing. Unlike conventional visual games, hearing VR games are differentiated games that are played only by hearing. Hearing VR games can be embodied in the form of a game of fighting zombies, for example, when you close your eyes and experience a mysterious experience as if the zombies are next to you, and you can play with your eyes closed. It is a game.

Hearing VR games are also VR games that can be experienced without a VR device. In this auditory VR game, anyone can experience auditory virtual reality using only earphones.

Hearing VR games can also maximize your imagination by focusing on your hearing. Hearing VR games have the advantage that virtual reality, which is perceived by hearing, stimulates the imagination more than virtual reality, which makes the brain more active than when watching a movie.

The sound-based game control device proposed by the present invention may control the user device 120 by adjusting a direction within a predetermined time according to a specific sound or command heard by an ear to execute the auditory VR game. The sound-based game control device may be specifically controlled in the following manner.

(1) When the player operates the user device 120 by detecting the direction of a specific sound coming into the ear, the user device 120 interprets the input information according to the operation to advance the game. The player may operate the user device 120 by touching one side of the screen of the user device 120, pressing a button displayed on the screen of the user device 120, or sliding the screen of the user device 120. There is a method of inputting information, a method of moving the user device 120 to orient the sound or avoiding in the opposite direction.

① Example 1: When a zombie attack voice is heard from the earphone, remove the zombie by touching the smartphone screen in the direction that the sound is heard within a predetermined time using the weapon in the direction of the zombie attack voice. At this time, if the zombie attack voice is heard simultaneously left and right, you can touch the left and right screen of the smartphone at the same time.

② Example 2: Animal sounds such as cat sounds and dog sounds come from the left and right earphones at random. At this time, in response to the sound of the cat only, touch the left and right screen of the smartphone. If you touch the screen of your smartphone to a sound other than the sound of a cat, the game ends. Or, if you press a cat sound, you can end the game if you misalign left and right.

③ Example 3: If the sound of a stone is heard from the left or the right, avoid the stone by sliding or tilting the smartphone screen to the opposite side of the sound within the set time. In this case, you can control the game with sliding or tilting direction without having to divide the smartphone screen into left and right sides.

(2) When the player operates the user device 120 according to the instruction of the command coming into the ear, the user device 120 interprets the input information according to the operation to advance the game. The player may operate the user device 120 by touching one side of the screen of the user device 120, pressing a button displayed on the screen of the user device 120, or sliding the screen of the user device 120. A method of inputting information, a method of moving the user device 120 to operate the user device 120 according to an instruction of a command, and the like.

① Example 1: If the command '3' is heard from the left or the right, press the smartphone screen in the direction in which the command is heard within the specified time as many times as the command. If the command '5' is heard from the right side, you must touch the right side of the smartphone screen five times in a time.

② Example 2: Listening to a command in a state in which the smartphone screen is divided into left and right sides like a white flag game, slide up and down. When the command 'left up' is heard to the left ear, it slides upward from the left screen of the divided screens. If you hear the command `` left down '' to the left ear, it slides downward from the left screen of the divided screens.

(3) When the player operates the user device 120 according to the volume of the sound heard by the ear, the user device 120 interprets the input information according to the operation to advance the game. The player may operate the user device 120 by touching one side of the screen of the user device 120, pressing a button displayed on the screen of the user device 120, or sliding the screen of the user device 120. A method of inputting information, a method of moving the user device 120 to operate the user device 120 according to an instruction of a command, and the like.

(4) When the player operates the user device 120 according to the moving sound coming into the ear, the user device 120 interprets the input information according to the operation to advance the game. The player may operate the user device 120 by touching one side of the screen of the user device 120, pressing a button displayed on the screen of the user device 120, or sliding the screen of the user device 120. A method of inputting information, a method of moving the user device 120 to operate the user device 120 according to an instruction of a command, and the like.

① Example 1: Zombie's sounding exhaling sound starts from the left and moves to the right without interruption. It detects this with your ear and moves your smartphone screen without touching it from left to right. Move and touch the screen without interruption to orient the zombie sound, and the machine gun fires continuously and shoots. However, if the direction is not correct or the touch is broken, the game ends.

In Example 1, the zombie is caught while controlling the user device 120 by adjusting the direction of the moving sound to the ear.

Each of the examples described above determines success or failure according to the response speed from the time of the sound coming into the ear to the time of operating the user device 120, and thus the score is also determined. For example, if a zombie sounds to attack and does not touch the user device 120 within 1 second, the player dies. Like this, a rule to set a specific time is made and the game ends when there is no reaction from the player.

The above (1) to (4) is an example of a case where the player proceeds the game by controlling the user device 120 in a direction within a predetermined time according to a specific sound or command heard by the ear.

However, the present invention is not limited thereto, and the game may be progressed by touching a screen for outputting information related to a sound signal heard by the player among the screens divided by the user device 120. Examples of such cases include a multiplication table game and a color matching game.

In the case of a multiplication game, 5 is output on the left side of the screen of the user device 120 and 6 is output on the right side of the screen. After outputting the sound signal '2 × 3' to the player's ear, the game is judged by comparing the value displayed on the screen touched by the player with the value obtained by analyzing the sound signal to determine whether the player has corrected the game. Continue.

In the case of the color matching game, yellow is displayed on the left screen of the user device 120 and red is displayed on the right screen. Thereafter, the sound signal is output to the player's ear, and then the game continues by comparing the value displayed on the screen touched by the player with the value obtained by analyzing the sound signal to determine whether the player has corrected the answer.

For example, when the player touches the left screen of the user device 120 in a situation in which 'red' is output as a sound signal, the user device 120 displays a value (yellow) and a sound signal displayed by the screen touched by the player. Compare the values (red) obtained from the analysis. Thereafter, the user device 120 determines that the player has not answered the correct answer, deducts the game score of the player or ends the game.

On the other hand, if the player touches the screen on the right side of the user device 120 in a situation where 'red' is output as a sound signal, the user device 120 analyzes the sound signal and the value (red) displayed by the screen touched by the player. Compare the values (red) obtained. Thereafter, the user device 120 determines that the player has corrected the answer, and scores the game score of the player to continue the game.

As mentioned above, one Embodiment of this invention was described with reference to FIGS. Hereinafter, the preferable form of this invention which can be inferred from such one Embodiment is demonstrated.

13 is a block diagram schematically showing a sound-based game control apparatus according to a preferred embodiment of the present invention.

According to FIG. 13, the sound-based game control apparatus 500 includes a sound output unit 510, an evaluation information generation unit 520, a game control unit 530, a power supply unit 540, and a main control unit 550.

The power supply unit 540 supplies power to each component of the sound-based game control apparatus 500.

The main controller 550 performs a function of controlling the overall operation of each component of the sound-based game control apparatus 500.

The sound output unit 510 outputs sound in at least one direction of the user.

The evaluation information generator 520 performs a function of acquiring user input information in response to the sound output by the sound output unit 510. In addition, the evaluation information generation unit 520 evaluates the user's input information based on the information on the sound, and thus performs the function of generating the evaluation information obtained through the evaluation.

The evaluation information generator 520 may compare the input information with the information about the sound and generate whether the input information matches the information about the sound as the evaluation information.

The evaluation information generator 520 may include information about at least one touched point on the screen of the device that executes the game as input information, and a local screen to which the touched point belongs when the screen of the device is divided into at least two local screens. Information on the button, among the buttons displayed on the screen of the device, information on the tilt of the device, information on the characters entered on the screen of the device, the number of touches entered on the screen of the device At least one piece of information may be obtained. The information on the point may include, for example, location information of the point. In addition, in the present embodiment, a character is a concept encompassing a language of each country or numbers, symbols, etc. commonly used.

The evaluation information generator 520 uses at least one sensor attached to a user's body, a sensor mounted on a device worn by the user, a sensor formed on the bottom surface of the space where the user is located, and a sensor for photographing the user. Information about the user's movement can be obtained as input information.

The evaluation information generation unit 520 is information about the sound output direction, information about the type of sound, information about the size of the sound, information about the content of the sound and information about the movement direction of the sound At least one piece of information can be used.

When the evaluation information generation unit 520 uses the information on the type of sound as information on the sound, information about the output direction of the sound, information on the content of the sound, and information on the movement direction of the sound when the evaluation information is generated. At least one of the information may be further used as information about the sound.

The above-described example of the zombie attack voice is an example of using information on the type of sound and information on the output direction of the sound as information on the sound. In addition, examples of animal sounds such as cat sounds and dog sounds described above are examples of using information on the type of sound and information on the contents of the sound as information on the sound. In addition, the above-mentioned example of the sound of flying stones is an example of using information on the type of sound and information on the direction of movement of the sound as information on the sound.

The evaluation information generator 520 may determine whether the content of the sound relates to a language or a number when the information on the content of the sound is used as the information about the sound. When it is determined that the content of the sound is related to the number, the evaluation information generator 520 may obtain information about the number of touches input on the screen of the device that executes the game as the input information. On the other hand, if it is determined that the content of the sound is language related, the evaluation information generator 520 may obtain information about the touched points on the screen of the device as input information. This function of the evaluation information generation unit 520 is related to the example of the case where the player operates the user device 120 according to the instruction of the command coming into the ear.

When using the information on the size of the sound as information about the sound, the evaluation information generation unit 520 may further use information about the content of the sound as information on the sound when generating the evaluation information. This function of the evaluation information generator 520 is related to the example for the rice barley game.

The game controller 530 performs a function of controlling a game executed by the user based on the evaluation information generated by the evaluation information generator 520.

If it is determined by the evaluation information generator 520 that the input information and the sound information match, the game controller 530 may control the game so that an additional point may be given to the game score. On the other hand, if it is determined by the evaluation information generator 520 that the input information and the sound information do not match, the game controller 530 may control the game so that a deduction is given to the game score or the game ends.

As illustrated in FIG. 14, the sound-based game control apparatus 500 may include at least one of a screen division processor 560, an audible information generator 570, a time difference comparator 580, and a sound adjuster 590. It may further include therein. FIG. 14 is a block diagram illustrating components that may be additionally included in the sound-based game control apparatus of FIG. 13.

The screen division processor 560 divides the screen of the device that executes the game into at least two local screens.

The screen division processor 560 may operate when information on the type of sound is used as information about the sound. On the other hand, the screen dividing processor 560 may not operate when information about the type of sound is used as information about the sound and information about a moving direction of the sound. Examples of zombie attack voices, examples of animal sounds, and the like are examples of the former, and examples of sounds of stones flying and the like are examples of the latter.

The audible information generation unit 570 generates a function of generating information on an audible frequency or information on an audible volume for at least one ear of the user.

The audible information generation unit 570 may operate when information about a sound size is used as information about the sound.

The time difference comparator 580 performs a function of measuring the time of outputting the sound and the time of acquiring the input information, respectively. In addition, the time difference comparator 580 calculates a time difference between the time of outputting the sound and the time of obtaining the input information. In addition, the time difference comparator 580 performs a function of determining whether the time difference between the time of outputting the sound and the time of obtaining the input information exceeds the reference value.

When it is determined that the time difference exceeds the reference value, the evaluation information generator 520 may generate evaluation information based on information obtained by comparing the time difference with the reference value.

The sound adjusting unit 590 changes a point at which the sound is output or changes the size of the sound.

The sound adjuster 590 may change the point at which the sound is output or change the size of the sound based on at least one of information about the user's position, information about the user's physical condition, and information about the user's gaze direction. have.

Next, a method of operating the sound-based game control apparatus 500 will be described. 15 is a flowchart schematically illustrating a sound-based game control method according to an exemplary embodiment of the present invention.

First, the sound output unit 510 outputs sound in at least one direction of the user (S610).

Thereafter, the evaluation information generator 520 acquires user input information corresponding to the sound output by the sound output unit 510 (S620).

Thereafter, the evaluation information generator 520 generates evaluation information evaluating user input information based on the information on the sound (S630). In FIG. 15, steps S620 and S630 are distinguished for convenience, but the two steps may not be distinguished in this embodiment.

Thereafter, the game controller 530 controls the game executed by the user based on the evaluation information generated by the evaluation information generator 520 (S640).

Meanwhile, between steps S610 and S620, the screen division processor 560 may divide the screen of the device for executing the game into at least two local screens (Step A).

Meanwhile, between steps S610 and S620, the audible information generation unit 570 may obtain information about an audible frequency or information about an audible volume for at least one ear of the user. This step performed by the audible information generating unit 570 may be performed between step S610 and Step A, or may be performed between Step A and S620.

Meanwhile, between steps S610 and S620, the time difference comparator 580 measures the time of outputting the sound and the time of obtaining the input information, respectively, and calculates the time difference between the time of outputting the sound and the time of acquiring the input information. The calculating, the determining whether the time difference exceeds the reference value, and the like may be sequentially performed. In this case, when it is determined that the time difference exceeds the reference value, the evaluation information generator 520 may generate evaluation information based on the information obtained by comparing the time difference with the reference value in step S630.

Meanwhile, between steps S610 and S620, the sound adjusting unit 590 may change a point at which the sound is output or change the size of the sound.

Although all components constituting the embodiments of the present invention described above are described as being combined or operating in combination, the present invention is not necessarily limited to these embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented in one independent hardware, each or some of the components of the components are selectively combined to perform some or all of the functions combined in one or a plurality of hardware It may be implemented as a computer program having a. In addition, such a computer program is stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, and the like, and is read and executed by a computer, thereby implementing embodiments of the present invention. The recording medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In addition, all terms including technical or scientific terms have the same meaning as commonly understood by a person of ordinary skill in the art unless otherwise defined in the detailed description. Terms used generally, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be interpreted in an ideal or excessively formal sense unless explicitly defined in the present invention.

The above description is merely illustrative of the technical idea of the present invention, and various modifications, changes, and substitutions may be made by those skilled in the art without departing from the essential characteristics of the present invention. will be. Accordingly, the embodiments disclosed in the present invention and the accompanying drawings are not intended to limit the technical spirit of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by the embodiments and the accompanying drawings. . The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

The present invention can be applied to the game field.

Claims (20)

1. A sound output unit configured to output sound in at least one direction of the user;

   An evaluation information generation unit obtaining input information of the user in response to the sound and generating evaluation information evaluating the input information based on the information on the sound; And

   A game controller for controlling a game executed by the user based on the evaluation information

   Sound-based game control device comprising a.
2. The method of claim 1,

   And the evaluation information generating unit compares the input information with information about the sound and generates as the evaluation information whether the input information matches the information about the sound.
3. The method of claim 2,

   If it is determined that the input information and the sound information match, the game controller controls the game to give a bonus to a game score, and if it is determined that the input information and the sound information do not match, the game. And the game is controlled so that a score is given to a score or the game is terminated.
4. The method of claim 1,

   The evaluation information generator includes information about at least one point touched on the screen of the device that executes the game with the input information, and a local screen to which the touched point belongs when the screen of the device is divided into at least two local screens. Information on a button, information on a button input among buttons output on the screen of the device, information on a tilt of the device, information on a character input on the screen of the device, input on the screen of the device The sound-based game control device, characterized in that for obtaining at least one information of the information on the number of touches and the information on the movement of the user.
5. The method of claim 4, wherein

   The evaluation information generator may include at least one sensor attached to a body of the user, a sensor mounted on a device worn by the user, a sensor formed on a bottom surface of the space where the user is located, and a sensor for photographing the user. The sound-based game control device, characterized in that for obtaining the information on the movement of the user as the input information.
6. The method of claim 1,

   The evaluation information generator is information about the output direction of the sound, information about the type of the sound, information about the size of the sound, information about the contents of the sound and the movement direction of the sound as information about the sound. Sound-based game control device, characterized in that for using at least one information of the information.
7. The method of claim 1,

   When the evaluation information generation unit uses the information on the type of the sound as the information on the sound, the information on the output direction of the sound, the information on the content of the sound and the movement direction of the sound when generating the evaluation information Sound-based game control device, characterized in that further using at least one of the information on the information about the sound.
8. The method of claim 1,

   And the evaluation information generator determines whether the content of the sound relates to a language or a number when the information on the content of the sound is used as the information about the sound.
9. The method of claim 8,

   If it is determined that the content of the sound is related to a number, the evaluation information generation unit obtains information on the number of touches input on the screen of the device that executes the game with the input information, and determines that the content of the sound is language related. And obtaining information about the touched points on the screen of the device by the input information.
10. The method of claim 1,

    When the evaluation information generation unit uses the information on the size of the sound as the information on the sound, when generating the evaluation information, the sound-based, characterized in that to further use the information about the content of the sound as information on the sound Game control device.
11. The method of claim 1,

    Screen division processing unit for dividing the screen of the device running the game into at least two local screens

    Sound-based game control device further comprising.
12. The method of claim 11,

    The screen division processor is operated when the information on the type of the sound is used as information on the sound.
13. The method of claim 11,

    The screen division processing unit does not operate when the information on the movement direction of the sound is used in addition to the information on the type of the sound as the information on the sound.
14. The method of claim 1,

    An audible information generation unit for generating information on an audible frequency or information on an audible volume for at least one ear of the user

    Sound-based game control device further comprising.
15. The method of claim 14,

    The audible information generating unit is operated when the information on the size of the sound is used as the information on the sound.
16. The method of claim 1,

    Measuring a time at which the sound is output and a time at which the input information is obtained, respectively, calculating a time difference between the time at which the sound is output and the time at which the input information is obtained, and determining whether the time difference exceeds a reference value Time difference comparison part

    More,

    And the evaluation information generator generates the evaluation information based on information obtained by comparing the time difference with the reference value when it is determined that the time difference exceeds the reference value.
17. The method of claim 1,

    Sound adjusting unit for changing the point of outputting the sound or changing the size of the sound

    Sound-based game control device further comprising.
18. The method of claim 17,

    The sound adjusting unit changes the point at which the sound is output based on at least one of information on the location of the user, information on the physical condition of the user, and information on the direction of the user's gaze, or the size of the sound. Sound-based game control device, characterized in that for changing.
19. Outputting sound in at least one direction of the user;

    Acquiring input information of the user corresponding to the sound and generating evaluation information evaluating the input information based on the information on the sound; And

    Controlling a game executed by the user based on the evaluation information

    Sound-based game control method comprising a.
20. A computer program stored in a computer-readable recording medium for executing the sound-based game control method according to claim 19.

Images