KR102216880B1 - A game server and a computer program providing custom voice - Google Patents

Abstract

A computer program stored in a computer-readable storage medium according to some embodiments of the present disclosure, wherein the computer program includes instructions for causing a processor of a game server to perform the following operations, the operations being: a plurality of user terminals Receiving voice data related to the first content from each; Filtering the voice data received from each of the plurality of user terminals to obtain candidate voice data; Receiving a feedback signal for the candidate voice data from each of the plurality of user terminals; Determining basic audio data to be applied to the first content from among the candidate audio data based on the feedback signal; And applying the basic voice data to the first content.

Description

Game server and computer program providing custom voice {A GAME SERVER AND A COMPUTER PROGRAM PROVIDING CUSTOM VOICE}

The present disclosure relates to a game server providing a custom voice and a computer program stored in a computer-readable storage medium.

With the recent rapid development of IT technology, the game industry is growing together. As the game industry grows, game companies that provide game services are also explosively created. Meanwhile, due to the increase of game companies providing game services, competition in the game service market is intensifying. Accordingly, game companies are constantly making efforts to acquire the competitiveness of their respective games. In particular, game companies are constantly searching for elements that can induce interest in game users.

For example, MMORPG (Massively Multiplayer Online Role Playing Game), in which numerous simultaneous users perform missions or quests in the game, understands the story of the game for smooth progression, and quests related to the game's story (mission It is important to do).

Here, game companies that provide game services provide voices of characters existing in the game as voice actors in order to gain the competitiveness of the games they provide. Specifically, game companies provide the voice of a character existing in the game as a voice actor when guiding the game story to the game user or when the game user performs an in-game quest. For example, in a general game service, when an NPC (Non-Player Character) existing in the game guides the game story, the voice of a pre-recorded voice actor is provided along with the text. For another example, in a general game service, when an NPC existing in the game provides information related to the progress of a quest, a voice actor's voice previously recorded along with the text is provided.

Accordingly, there may be a need in the art for a method of securing the diversity of voices for guiding the story of the game or for guiding the quest in the game.

Korean Patent Application Publication No. 10-2019-0029757

The present disclosure has been devised in response to the above-described background technology, and an object thereof is to provide a game server that provides a custom voice and a computer program stored in a computer-readable storage medium.

The technical problems of the present disclosure are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

According to some embodiments of the present disclosure for solving the problems as described above, a computer program stored in a computer-readable storage medium is disclosed. The computer program includes instructions for causing a processor of a game server to perform the following operations, the operations comprising: receiving voice data related to first content from each of a plurality of user terminals; Filtering the voice data received from each of the plurality of user terminals to obtain candidate voice data; Receiving a feedback signal for the candidate voice data from each of the plurality of user terminals; Determining basic audio data to be applied to the first content from among the candidate audio data based on the feedback signal; And applying the basic voice data to the first content.

In addition, the operation of receiving voice data related to the first content from each of the plurality of user terminals includes a recording button related to the first content displayed on a game screen from a first user terminal among the plurality of user terminals. Receiving an input signal; Causing a recording screen to be output from the game screen displayed on the first user terminal in response to the input signal; And after the recording screen is output from the game screen displayed on the first user terminal, receiving first voice data of the first user related to the first content from the first user terminal; I can.

In addition, the recording screen may include a script display area corresponding to the first content.

In addition, the operation of filtering the voice data received from each of the plurality of user terminals to obtain candidate voice data includes: obtaining text data by inputting the voice data into a voice recognition model; And determining the candidate voice data based on the text data.

In addition, the operation of obtaining the candidate speech data based on the text data may include comparing a first sentence including at least one text pre-stored in a memory with a second sentence included in the text data; Comparing the first sentence and the second sentence to calculate a match rate of the at least one text between the first sentence and the second sentence; And determining voice data related to text data including a second sentence having a matching rate equal to or greater than a predetermined level as the candidate voice data.

In addition, the operation of obtaining the candidate speech data based on the text data may include comparing a first sentence including at least one text pre-stored in a memory with a third sentence included in the first text data, Calculating a first match rate of the at least one text between the text and the third sentence.-The first text data includes second voice data received from a second user terminal among the plurality of user terminals to the voice recognition model. Text data obtained by input -; Computing a second match rate of the at least one text between the first sentence and the fourth sentence by comparing the first sentence and the fourth sentence included in the second text data-The second text data is Text data obtained by inputting third voice data received from a third user terminal among a plurality of user terminals into the voice recognition model; And determining the second voice data as the candidate voice data when the first match rate is greater than or equal to a preset level and the second match rate is less than the preset level.

In addition, the operation of receiving a feedback signal for the candidate voice data from each of the plurality of user terminals includes receiving an input signal for a voice listening button displayed on a game screen from a fourth user terminal among the plurality of user terminals. action; In response to the input signal, causing a voice listening screen to be output from the game screen displayed on the fourth user terminal; And receiving a feedback signal for the candidate voice data from the fourth user terminal after the voice listening screen is output from the game screen displayed on the fourth user terminal.

In addition, the voice listening screen may include: a list output area of the candidate voice data obtained by filtering the voice data received from each of the plurality of user terminals; And a score input area for inputting a score for the candidate voice data included in the list.

In addition, the feedback signal includes a score for the candidate speech data, and based on the feedback signal, determining basic speech data to be applied to the first content among the candidate speech data includes: And determining the first candidate speech data having the highest score among the candidate speech data as the basic speech data.

Further, the method may further include an operation of determining second candidate voice data having the score equal to or greater than a preset score as selected voice data that can be additionally applied to the first content.

In addition, when a first selection signal for selecting the first selection speech data among the selection speech data is received from a fifth user terminal, when the fifth user terminal displays the first content, the first selection speech data An operation of setting to be output; And when a second selection signal for selecting second selection audio data from among the selected audio data is received from a sixth user terminal, when the sixth user terminal displays the first content, the second selection audio data is It may further include an operation of setting to be output.

In accordance with some embodiments of the present disclosure for solving the problem as described above, a game server is disclosed. The game server comprises: a communication unit for receiving voice data related to first content from each of a plurality of user terminals; And a processor configured to obtain candidate voice data by filtering the voice data received from each of the plurality of user terminals, wherein the communication unit receives a feedback signal for the candidate voice data from each of the plurality of user terminals. Further, the processor may determine basic audio data to be applied to the first content among the candidate audio data based on the feedback signal, and apply the basic audio data to the first content.

Technical solutions obtainable in the present disclosure are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly to those of ordinary skill in the technical field to which the present disclosure belongs from the following description. It will be understandable.

The present disclosure may provide a game server that provides a custom voice for enhancing the entertainment elements of users playing a game and a computer program stored in a computer-readable storage medium.

The effects obtainable in the present disclosure are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those of ordinary skill in the art from the following description. .

Various aspects are now described with reference to the drawings, wherein like reference numbers are used collectively to refer to like elements. In the examples that follow, for illustrative purposes, a number of specific details are presented to provide a thorough understanding of one or more aspects. However, it will be apparent that such aspect(s) may be practiced without these specific details.
1 is a block diagram of a game server communicating with a plurality of user terminals according to some embodiments of the present disclosure.
2 is a flowchart illustrating an example of a method of applying basic voice data to first content by a game server according to some embodiments of the present disclosure.
3 is a flowchart illustrating an example of a method of receiving, by a game server, first voice data from a first user terminal according to some embodiments of the present disclosure.
4 is a diagram for describing an example of a game screen according to some embodiments of the present disclosure.
5 is a diagram for describing an example of a recording screen according to some embodiments of the present disclosure.
6 is a flowchart illustrating an example of a method of determining, by a game server, candidate voice data according to some embodiments of the present disclosure.
7 is a flowchart illustrating an example of a method for receiving a feedback signal for candidate voice data by a game server according to some embodiments of the present disclosure.
8 is a diagram for describing an example of a voice listening screen according to some embodiments of the present disclosure.
9 is a flowchart illustrating an example of a method of determining, by a game server, selected voice data according to some embodiments of the present disclosure.
10 is a diagram for describing an example of a voice selection screen according to some embodiments of the present disclosure.
11 shows a simplified and general schematic diagram of an exemplary computing environment in which some embodiments of the present disclosure may be implemented.

Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for illustrative purposes, a number of specific details are disclosed to aid in an overall understanding of one or more aspects. However, it will also be appreciated by those of ordinary skill in the art that this aspect(s) may be practiced without these specific details. The following description and the annexed drawings set forth in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in the principles of the various aspects may be used, and the descriptions described are intended to include all such aspects and their equivalents. Specifically, as used herein, "an embodiment", "example", "aspect", "example" and the like are not construed as having any aspect or design being better or advantageous than other aspects or designs. May not.

In addition, various aspects and features will be presented by a system that may include one or more devices, terminals, servers, devices, components and/or modules, and the like. The devices, terminals, servers discussed in connection with the drawings, that various systems may include additional devices, terminals, servers, devices, components and/or modules, etc. It should also be understood and appreciated that it may not include all of devices, components, modules, etc.

The terms "computer program" "component", "module", "system" and the like as used herein may be used interchangeably, and computer-related entities, hardware, firmware, software, a combination of software and hardware, or Refers to the execution of software. For example, a component may be, but is not limited to, a process executed on a processor, a processor, an object, an execution thread, a program, and/or a computer. For example, both an application running on a computing device and a computing device may be components. One or more components may reside within a processor and/or thread of execution. A component can be localized on a single computer. A component can be distributed between two or more computers.

In addition, these components can execute from a variety of computer readable media having various data structures stored therein. Components can be, for example, via a signal with one or more data packets (e.g., data from one component interacting with another component in a local system, a distributed system, and/or a signal through another system and a network such as the Internet. Depending on the data being transmitted), it may communicate via local and/or remote processes.

Hereinafter, the same or similar components are assigned the same reference numerals regardless of the reference numerals, and redundant descriptions thereof will be omitted. In addition, in describing the embodiments disclosed in the present specification, when it is determined that detailed descriptions of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the present specification is not limited by the accompanying drawings.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present disclosure. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements.

Although the first, second, etc. are used to describe various devices or components, it is a matter of course that these devices or components are not limited by these terms. These terms are only used to distinguish one device or component from another device or component. Therefore, it goes without saying that the first device or component mentioned below may be a second device or component within the spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which this disclosure belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

In addition, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise or is not clear from the context, "X employs A or B" is intended to mean one of the natural inclusive substitutions. That is, X uses A; X uses B; Or, when X uses both A and B, “X uses A or B” can be applied to either of these cases. In addition, the term "and/or" as used herein should be understood to refer to and include all possible combinations of one or more of the listed related items.

In addition, the terms “information” and “data” as used herein may often be used interchangeably with each other.

The suffixes “module” and “unit” for constituent elements used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have distinct meanings or roles by themselves.

Objects and effects of the present disclosure, and technical configurations for achieving them will become apparent with reference to the embodiments to be described later in detail together with the accompanying drawings. In describing the present disclosure, when it is determined that a detailed description of a well-known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in the present disclosure and may vary according to the intention or custom of users or operators.

However, the present disclosure is not limited to the embodiments disclosed below, and may be implemented in various different forms. The present embodiments are provided only to make the present disclosure complete, and to completely inform the scope of the disclosure to those of ordinary skill in the art to which the present disclosure belongs, and the present disclosure is only defined by the scope of the claims. . Therefore, the definition should be made based on the contents throughout this specification.

1 is a block diagram of a game server communicating with a plurality of user terminals according to some embodiments of the present disclosure.

Referring to FIG. 1, the game server 100 and the plurality of user terminals 200 may mutually transmit and receive data for a game service providing a custom voice according to some embodiments of the present disclosure through a network.

Game server 100 may include any type of computer system or computer device, such as, for example, a microprocessor, mainframe computer, digital processor, portable device and device controller, and the like. In addition, the game server 100 may provide a game service that provides a custom voice to each of the plurality of user terminals 200.

Each of the plurality of user terminals 200 includes, for example, a personal computer (PC), a notebook (note book), a mobile terminal, a smart phone, a tablet PC (tablet PC), and a wearable device ( wearable device), and the like, and may include all types of terminals that can access wired/wireless networks. In addition, each of the plurality of user terminals 200 may receive a game service providing a custom voice provided by the game server 100.

As shown in FIG. 1, a plurality of user terminals 200 include a first user terminal 210, a second user terminal 220, a third user terminal 230, a fourth user terminal 240, and a fifth user terminal. A user terminal 250 and a sixth user terminal 260 may be included. However, since each of the plurality of user terminals 200 described above is expressed for convenience of description of the present disclosure, the plurality of user terminals 200 may be more or less than the number of user terminals listed above.

Networks according to some embodiments of the present disclosure include Public Switched Telephone Network (PSTN), x Digital Subscriber Line (xDSL), Rate Adaptive DSL (RADSL), Multi Rate DSL (MDSL), Very High Speed (VDSL). Various wired communication systems such as DSL), Universal Asymmetric DSL (UADSL), High Bit Rate DSL (HDSL), and local area network (LAN) can be used.

In addition, the network presented here is CDMA (Code Division Multi Access), TDMA (Time Division Multi Access), FDMA (Frequency Division Multi Access), OFDMA (Orthogonal Frequency Division Multi Access), SC-FDMA (Single Carrier-FDMA) and Various wireless communication systems such as other systems can be used.

The network according to the embodiments of the present disclosure may be configured regardless of its communication mode, such as wired and wireless, and is composed of various communication networks such as a personal area network (PAN) and a wide area network (WAN). Can be. In addition, the network may be a known World Wide Web (WWW), and may use a wireless transmission technology used for short-range communication such as infrared (IrDA: Infrared Data Association) or Bluetooth (Bluetooth).

The techniques described herein may be used not only in the networks mentioned above, but also in other networks.

According to some embodiments of the present disclosure, the game server 100 may include a communication unit 110, a memory 120, and a processor 130. However, the above-described components are not essential to implement the game server 100, and the game server 100 may have more or fewer components than the components listed above.

The communication unit 110 of the game server 100 may include one or more modules that enable communication between the game server 100 and a communication system, or between the game server 100 and a plurality of user terminals 200. . In addition, the communication unit 110 may include one or more modules that connect the game server 100 to one or more networks.

According to some embodiments of the present disclosure, the communication unit 110 of the game server 100 may receive voice data related to the first content from each of the plurality of user terminals 200.

Specifically, the communication unit 110 may receive an input signal for a recording button from the first user terminal 210 of the plurality of user terminals 200. Here, the record button may be a button related to the first content displayed on the game screen.

In this case, the processor 130 may cause the recording screen to be output from the game screen displayed on the first user terminal 210 in response to the input signal. Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from a game screen to a recording screen to the first user terminal 210. Here, the recording screen may include a script display area corresponding to the first content.

Description of the above-described game screen and recording screen will be described later in detail with reference to FIGS. 4 and 5.

In this specification, the first content displayed in each of the plurality of user terminals 200 is the content related to the user's story progression in the game, the content related to the user's quest progress, the content related to the user's mission progress, the user's tutorial progress It may be at least one of content related to. However, the first content is not limited to the above-described example, and various content related to the game may be the first content.

Meanwhile, after the recording screen is output to the first user terminal 210, the communication unit 110 may receive first voice data of the first user related to the first content from the first user terminal 210.

The memory 120 may store a program for the operation of the processor 130 and may temporarily or permanently store input/output data. The memory 120 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among disks and optical disks. The memory 120 may be operated under control by the processor 130.

According to some embodiments of the present disclosure, the memory 120 may store a first sentence including at least one text in relation to the first content provided as a game service. Here, the first sentence may be used when the processor 130 performs filtering to obtain candidate voice data.

In the present specification, voice data that the game server 100 receives from each of the plurality of user terminals 200 may have a sentence form. In addition, the speech recognition model may include an acoustic model and a language model. The acoustic model means modeling the signal characteristics of speech. The language model refers to a modeling of linguistic sequence relationships such as words or syllables corresponding to the recognized vocabulary. However, the speech recognition model is not limited to the above example.

According to some embodiments of the present disclosure, the processor 130 may acquire text data corresponding to the speech data by using a language model included in the speech recognition model.

Here, the text data corresponding to the voice data may be data obtained by converting the voice recorded by the user into text. Specifically, the text data may include a plurality of texts in which the voice recorded by the user is converted into text. Also, the text data may include sentences to which texts are connected. Here, a plurality of texts may mean a plurality of syllables.

For example, a game user is an NPC's ambassador related to the first content, saying, “It's been a while, small agreement. Are you good at finding the secret of the god of war?" In this case, the text data corresponding to the voice data is “O”, “Lan”, “Man”, “Lee”, “Ya”, “Seo”, “Hyup”, “Moo”, “God”, “Us”. , “Rain”, “Bo”, “To”, “Find”, “A”, “Work”, “Silver”, “Good”, and “Sun” may contain multiple texts. In addition, the text data corresponding to the voice data is "It's been a while, small negotiation." You can include sentences such as "Are you good at finding the secrets of the god of war?" However, it is not limited thereto.

As described above, the processor 130 may filter the voice data received from each of the plurality of user terminals 200. Also, the processor 130 may obtain candidate voice data by filtering voice data related to the first content.

Specifically, the processor 130 may input voice data received from each of the plurality of user terminals 200 into the voice recognition model. Further, the processor 130 may obtain text data corresponding to the speech data as an output of the speech recognition model. In this case, the processor 130 may obtain candidate voice data based on the text data.

More specifically, the processor 130 may compare the first sentence previously stored in the memory 120 with the second sentence included in the text data. Also, the processor 130 may compare the first sentence and the second sentence to calculate a match rate of at least one text between the first sentence and the second sentence. In addition, the processor 130 may recognize text data including a second sentence having a matching rate equal to or greater than a preset degree. Also, the processor 130 may determine speech data related to the recognized text data as candidate speech data.

Here, the first sentence is a sentence pre-stored in the memory 120 for comparison with the second sentence recorded by the user, and may be a sentence related to the first content. Specifically, the first sentence may correspond to a voice to be applied to the first content. For example, the first sentence may be a sentence included in the dialogue of the NPC related to the first content. However, it is not limited thereto.

In addition, the second sentence may correspond to a user's voice included in the voice data. For example, the second sentence may be a sentence recorded by a user reading a dialogue of an NPC related to the first content. However, it is not limited thereto.

A description of the above-described processor 130 calculating a match rate of at least one text between the first sentence and the second sentence and determining the candidate voice data will be described later in detail with reference to FIG. 6.

According to some embodiments of the present disclosure, candidate voice data may be transmitted to a plurality of user terminals 200 through the communication unit 110 and provided to a plurality of game users through the plurality of user terminals 200.

Meanwhile, the communication unit 110 may receive a feedback signal for candidate voice data from each of the plurality of user terminals 200.

Specifically, the communication unit 110 may receive an input signal for a voice listening button displayed on the game screen from the fourth user terminal 240 among the plurality of user terminals 200.

In this case, the processor 130 may cause the audio listening screen to be output from the game screen displayed on the fourth user terminal 240 in response to the input signal. Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from a game screen to a voice listening screen to the fourth user terminal 240. Here, the voice listening screen may include a list output area of candidate voice data and a score input area for inputting scores for candidate voice data included in the list.

A description of the above-described voice listening screen will be described later in detail with reference to FIG. 8.

Meanwhile, the communication unit 110 may receive a feedback signal for candidate voice data from the fourth user terminal 240 after the voice listening screen is output to the fourth user terminal 240.

Here, the feedback signal may include a score for each of the candidate voice data, whether it likes or dislikes, and the like. However, the feedback signal is not limited thereto, and may be any signal capable of recognizing a user's preference for each of the candidate voice data. For example, the feedback signal may include a grade for each candidate voice data (eg, Good Grade, Not Bad Grade, Bad Grade, etc.).

That is, a plurality of game users may provide the game server 100 with various types of preference expressions for candidate voice data as a feedback signal.

For example, the fourth user may recognize candidate voice data through the fourth user terminal 240. In addition, the fourth user may input likes or dislikes according to a preference for the candidate voice data through the fourth user terminal 240. In this case, the fourth user terminal 240 may transmit a feedback signal including likes or dislikes for the candidate voice data to the game server 100. However, the present invention is not limited thereto, and as described above, the fourth user terminal 240 may transmit a feedback signal further including a rating and score for the candidate voice data to the game server 100.

Meanwhile, the processor 130 may determine basic voice data to be applied to the first content among candidate voice data based on the feedback signal. In addition, the processor 130 may apply the determined basic voice data to the first content.

For example, the processor 130 may recognize a score for each candidate speech data included in the feedback signal. Also, the processor 130 may apply the first candidate voice data having the highest score to the first content.

As another example, the processor 130 may recognize whether or not a like is included in the feedback signal. Also, the processor 130 may apply the first candidate voice data having the highest number of likes to the first content.

As another example, the processor 130 may calculate a score for each candidate voice data included in the feedback signal and an average score of the number of likes. Specifically, when calculating the average score, the processor 130 may reflect the score as it is, and may reflect the score as 20 points per likes. For example, if the score is 90 points and the number of likes is 3 times, the processor 130 may calculate 75 points, which is an average of 60 points obtained by calculating the score of 90 points and 3 likes, as the average score. Meanwhile, the processor 130 may apply the first candidate voice data having the highest score and the average score of the number of likes to the first content.

According to some other embodiments of the present disclosure, the processor 130 may determine selected voice data applicable to the first content among candidate voice data based on the feedback signal.

For example, the processor 130 may recognize a score for each candidate speech data included in the feedback signal. In addition, the processor 130 may determine the second candidate voice data having a score equal to or greater than a preset score as selected voice data that can be additionally applied to the first content. Meanwhile, the processor 130 may delete the third candidate voice data whose score is less than the preset score from the candidate voice data list so that it cannot be applied to the first content.

As another example, the processor 130 may recognize whether or not to like each candidate voice data included in the feedback signal. In addition, the processor 130 may determine the second candidate voice data whose number of likes is equal to or greater than a preset number as selected voice data that can be additionally applied to the first content. Meanwhile, the processor 130 may delete the third candidate voice data having a dislike number equal to or greater than a preset number from the candidate voice data list so that it cannot be applied to the first content.

As described above, the processor 130 may determine basic voice data to be applied to the first content among candidate voice data. In addition, the processor 130 may apply the determined basic voice data to the first content.

In this case, the processor 130 may apply voice data pre-stored in the memory 120 to a preset sentence among sentences corresponding to the first content. Further, the processor 130 may apply basic voice data to the rest of the sentences other than the preset sentence.

For example, the processor 130 may apply voice data of a voice actor previously stored in the memory 120 as the first sentence of dialogue of a non-player character (NPC) in the game. In addition, the processor 130 may apply voice data recorded by the user to lines after the first sentence among lines of the NPC in the game.

However, it is not limited to the above-described example, and the processor 130 of the game server 100 may apply voice data recorded by the user in response to all sentences corresponding to the first content. In addition, if there is no suitable user's voice data related to the first content, the processor 130 may apply pre-stored voice data of the voice actor to all sentences corresponding to the first content. In addition, if there is no suitable user's voice data related to the first content, the processor 130 may not apply separate voice data to all sentences corresponding to the first content.

In the games that are being developed recently, the story of the game is gradually becoming vast in order to gain the competitiveness of the game. As the story of the game gradually becomes vast, quests related to the story of the game are also increasing.

Meanwhile, a general game service provides voices for guiding the story of the game and voices for guiding quests in the game as voice actors. In this case, the guidance voice provided to the in-game user may be composed of one voice actor's voice. That is, in a general game service, there is a concern that the user who plays the game feels bored because the guide voice provided to the in-game user is configured as a unit.

The game server 100 according to the present disclosure collects the user's voice data and provides it to the game user through appropriate filtering. That is, the game server 100 according to the present disclosure may secure diversity of guide voices provided to game users. Accordingly, the game server 100 according to the present disclosure can inspire interest of game users.

Meanwhile, in order for a game service provider to provide a number of voice actors in response to an enormous game story, high costs (eg, voice recording costs) may be consumed.

Meanwhile, since the game server 100 according to the present disclosure provides voice data collected from game users, the cost for securing various voices to be provided in the game can be reduced.

The processor 130 typically controls the overall operation of the game server 100. The processor 130 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or driving an application program stored in the memory 120.

In order to drive an application program stored in the memory 120, the processor 130 may control at least some of the components described with reference to FIG. 2. Further, the processor 130 may operate by combining at least two or more of the components included in the game server 100 to drive the application program.

Various embodiments described herein may be implemented in a recording medium and a storage medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases herein. The described embodiments may be implemented by the processor 130 itself.

According to software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code can be implemented as a software application written in an appropriate programming language. The software code may be stored in the memory 120 and executed by the processor 130.

2 is a flowchart illustrating an example of a method of applying basic voice data to first content by a game server according to some embodiments of the present disclosure.

Referring to FIG. 2, the processor 130 of the game server 100 may receive voice data related to the first content from each of the plurality of user terminals 200 through the communication unit 110 (S100).

Specifically, the processor 130 may receive first voice data of the first user related to the first content from the first user terminal 210 of the plurality of user terminals 200 through the communication unit 110. In addition, the processor 130 may receive second voice data of the second user related to the first content from the second user terminal 220 among the plurality of user terminals 200 through the communication unit 110.

That is, the processor 130 may receive voice data related to the first content from each of the plurality of user terminals 200 through the communication unit 110.

A description of how the processor 130 receives voice data related to the first content from each of the plurality of user terminals 200 through the communication unit 110 will be described in more detail later with reference to FIG. 3.

Meanwhile, the processor 130 of the game server 100 may filter voice data received from each of the plurality of user terminals 200 to determine candidate voice data (S200).

Specifically, the processor 130 may convert voice data received from each of the plurality of user terminals 200 into text data. Further, the processor 130 may determine candidate voice data based on the text data.

More specifically, the processor 130 may compare text data with a script corresponding to the first content pre-stored in the memory 120. In addition, the processor 130 may calculate a match rate through comparison. In this case, the processor 130 may obtain voice data corresponding to text data having a matching rate equal to or greater than a preset degree as candidate voice data.

A description of a method of determining the candidate voice data based on the matching rate by the processor 130 described above will be described later in more detail with reference to FIG. 6.

The processor 130 of the game server 100 may receive a feedback signal for the candidate voice data from each of the plurality of user terminals 200 through the communication unit 110 (S300).

Specifically, the processor 130 may provide candidate voice data to each of the plurality of user terminals 200 in response to a specific input signal of each of the plurality of user terminals 200.

After the candidate voice data is provided to each of the plurality of user terminals 200, the processor 130 may receive a feedback signal for the candidate voice data from the plurality of user terminals 200.

A description of how the processor 130 receives feedback signals for candidate voice data from the plurality of user terminals 200 through the communication unit 110 will be described in more detail later with reference to FIG. 7.

The processor 130 of the game server 100 may determine basic voice data to be applied to the first content among candidate voice data based on the feedback signal (S400). Then, the processor 130 may apply the determined basic voice data to the first content (S500).

For example, the processor 130 may recognize a score for each candidate speech data included in the feedback signal. Also, the processor 130 may apply the first candidate voice data having the highest score to the first content.

As another example, the processor 130 may recognize whether or not'like' is included in the feedback signal. Also, the processor 130 may apply the first candidate voice data having the highest number of likes to the first content.

Accordingly, the game server 100 may provide a different game environment by applying voice data of users, not voice actors, to the first content. In addition, the game server 100 may increase entertainment elements of users playing games by providing a different game environment.

A description of how the processor 130 determines basic voice data will be described in more detail later with reference to FIG. 9.

According to some other embodiments of the present disclosure, the processor 130 of the game server 100 may provide a reward to a user who provides the voice data determined as basic voice data.

For example, the processor 130 may set a special effect to be displayed on a character of a user who has provided voice data determined as basic voice data.

As another example, the processor 130 may provide cyber money (eg, cache) that can be used in a game to an account of a user who has provided the voice data determined as basic voice data.

Accordingly, the game server 100 may induce a plurality of users to provide voice data corresponding to the first content.

3 is a flowchart illustrating an example of a method for receiving first voice data from a first user terminal by a game server according to some embodiments of the present disclosure.

Referring to FIG. 3, the processor 130 of the game server 100 transmits an input signal to the record button related to the first content displayed on the game screen from the first user terminal 210 through the communication unit 110. Can receive (S110).

In this case, the processor 130 may cause the recording screen to be output from the game screen displayed on the first user terminal in response to the input signal (S120).

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from a game screen to a recording screen to the first user terminal 210. Here, the recording screen may include a script display area corresponding to the first content.

Accordingly, the game server 100 checks the script when the game user records the voice related to the first content and displays it on the game screen so that the game user can easily read it, thereby lowering the barrier to entry to the voice recording.

Meanwhile, after the recording screen is output to the first user terminal 210, the processor 130 transmits the first voice data of the first user related to the first content from the first user terminal 210 through the communication unit 110. Can receive (S130). Here, the first voice data may be voice data recorded by a first user reading a script of a recording screen displayed on the first user terminal 210.

Description of the above-described game screen and recording screen will be described later in detail with reference to FIGS. 4 and 5.

4 is a diagram for describing an example of a game screen according to some embodiments of the present disclosure.

Referring to FIG. 4, the processor 130 of the game server 100 may cause a game screen to be displayed in each of the plurality of user terminals 200 through the communication unit 110.

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for controlling to output a game screen to each of the plurality of user terminals 200.

In this case, each of the plurality of user terminals 200 may output a game screen 300 as shown in FIG. 4.

According to some embodiments of the present disclosure, the game screen 300 includes a background area 304, a pop-up screen area 305, a dialogue presentation area 306, a recording button 301, a voice listening button 302, and a voice. It may include at least one of the selection buttons 303. However, since the above-described components are not essential for implementing the game screen 300, the game screen 300 may have more or fewer components than the components listed above.

First, the overall contents of the game may be displayed in the background area 304 of the game screen 300. For example, in the background area 304, an in-game character and an in-game environment may be displayed. In addition, the background area 304 may include a dialogue display area 306 such as an in-game character or NPC.

In addition, buttons for various game services may be displayed on a part of the background area 304 of the game screen 300. Specifically, as shown in FIG. 4, a recording button 301, a voice listening button 302, and a voice selection button 303 may be displayed.

Meanwhile, the processor 130 receives input signals for each of the recording button 301, the voice listening button 302, and the voice selection button 303 that may be included in the game screen 300 through the communication unit 110. can do.

For example, the processor 130 may receive an input signal for the recording button 301 from each of the plurality of user terminals 200 through the communication unit 110. In this case, the processor 130 may cause the recording screen to be output from the game screen 300 displayed on each of the plurality of user terminals 200 in response to an input signal to the record button 301. Here, the recording screen may be output on the pop-up screen display area 305 included in the background area 304.

A description of the above-described recording screen will be described later in more detail with reference to FIG. 5.

As another example, the processor 130 may receive an input signal for the voice listening button 302 from each of the plurality of user terminals 200 through the communication unit 110. In this case, the processor 130 may cause the audio listening screen to be output from the game screen 300 displayed on each of the plurality of user terminals 200 in response to an input signal to the audio listening button 302. . Here, the voice listening screen may be output on the pop-up screen display area 305 included in the background area 304.

A description of the above-described voice listening screen will be described later in more detail with reference to FIG. 8.

As another example, the processor 130 may receive an input signal for the voice selection button 303 from each of the plurality of user terminals 200 through the communication unit 110. In this case, the processor 130 may cause the voice selection screen to be output from the game screen 300 displayed on each of the plurality of user terminals 200 in response to an input signal to the voice selection button 303. . Here, the voice selection screen may be output on the pop-up screen display area 305 included in the background area 304.

A description of the above-described voice selection screen will be described later in more detail with reference to FIG. 10.

On the other hand, when a recording screen, a voice listening screen, or a voice selection screen is displayed on the pop-up display area 305 described above, the in-game character and in-game environment displayed on the background area 304 are paused. It can be marked as

However, the present invention is not limited thereto, and even if a recording screen, a voice listening screen, or a voice selection screen is displayed on the pop-up display area 305, in-game characters and in-game environments displayed on the background area 304 The moving state may be maintained on the background area 304 excluding the pop-up display area 305.

5 is a diagram for describing an example of a recording screen according to some embodiments of the present disclosure.

According to some embodiments of the present disclosure, the processor 130 may receive an input signal for the record button 301 from the first user terminal 210 of the plurality of user terminals 200 through the communication unit 110. have.

In this case, the processor 130 records in the game screen 300 displayed on the first user terminal 210 in response to an input signal to the recording button 301 received from the first user terminal 210. The screen 310 may be caused to be output as shown in FIG. 5.

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from the game screen 300 to the recording screen 310 to the first user terminal 210.

More specifically, the processor 130 may transmit a control signal to the first user terminal 210 through the communication unit 110 so that the recording screen 310 is output on the pop-up display area 305 of the game screen 300. .

In this case, the first user terminal 210 of the plurality of user terminals 200 may output the recording screen 310 as shown in FIG. 5. Here, the recording screen 310 is a screen in which user interaction is possible, and a user's voice may be recorded through a specific button. However, it is not limited thereto.

According to some embodiments of the present disclosure, the recording screen 310 may include at least one of a script display area 311 and a recording start and recording stop button 312. However, since the above-described components are not essential for implementing the recording screen 310, the recording screen 310 may have more or fewer components than the components listed above.

Meanwhile, when the first user completes the recording, the first user terminal 210 may transmit the first voice data of the first user to the game server 100.

Specifically, as the first user terminal 210 receives input signals for the recording start and recording stop buttons 312, it may recognize whether the first user has finished recording. In addition, the first user terminal 210 may transmit the first voice data of the first user to the game server 100 according to whether the recognized first user has completed recording.

That is, the processor 130 of the game server 100 displays the recording screen 310 on the first user terminal 210, and then the first content related to the first content from the first user terminal 210 through the communication unit 110. The first voice data of the first user can be received.

Meanwhile, the user playing the game can easily record his/her own voice through the record button 301 on the game screen 300 without having to access a separate page to record the voice related to the first content.

According to some other embodiments of the present disclosure, the recording screen 310 may include a filter effect button (not shown). In this case, the processor 130 may receive an input signal for the filter effect button from the first user terminal 210 of the plurality of user terminals 200 through the communication unit 110.

In this case, the processor 130 may apply a filter effect to the voice of the first user in response to an input signal to the filter effect button received from the first user terminal 210.

Specifically, the processor 130 may convert the first voice data received from the first user terminal 210 into a voice and apply a filter effect. More specifically, the processor 130 may input the first voice data to the voice modulation filter. Further, the processor 130 may obtain the first voice data to which the filter effect is applied as an output of the voice modulation filter.

However, the present disclosure is not limited thereto, and the processor 130 may receive the first voice data of the first user recorded with the filter effect applied from the first user terminal 210. Here, the filter effect may mean, for example, an effect of converting a user's voice into a female voice, a male voice, or a specific character's voice.

As described above, the processor 130 of the game server 100 may provide a unique recording environment to a plurality of users, thereby inducing the plurality of users to provide voice data corresponding to the first content.

In order to record the voice related to the first content, it is not necessary to access a separate page, and the voice of the user can be easily recorded through the record button 301 on the game screen 300.

6 is a flowchart illustrating an example of a method of determining, by a game server, candidate voice data according to some embodiments of the present disclosure.

Referring to FIG. 6, the processor 130 of the game server 100 may acquire text data by inputting voice data into the voice recognition model (S210). Here, the voice data may be data received from each of the plurality of user terminals 200. In addition, the voice data may have a sentence form.

In addition, the speech recognition model used by the processor 130 may include an acoustic model and a language model. The acoustic model means modeling the signal characteristics of speech. The language model refers to a modeling of linguistic sequence relationships such as words or syllables corresponding to the recognized vocabulary. However, the speech recognition model is not limited to the above example.

According to some embodiments of the present disclosure, the processor 130 may acquire text data corresponding to the speech data by using a language model included in the speech recognition model.

Specifically, the processor 130 may input speech data into a speech recognition model implementing speech to text (STT) technology. Further, the processor 130 may obtain text data corresponding to the speech data as an output value of the speech recognition model.

As described above in FIG. 1, text data corresponding to voice data may be data obtained by converting a voice recorded by a user into text. Specifically, the text data may include a plurality of texts in which the voice recorded by the user is converted into text. Also, the text data may include sentences to which texts are connected. Here, a plurality of texts may mean a plurality of syllables.

For example, a game user is an NPC's ambassador related to the first content, saying, “It's been a while, small agreement. Are you good at finding the secret of the god of war?" In this case, the text data corresponding to the voice data is “O”, “Lan”, “Man”, “Lee”, “Ya”, “Seo”, “Hyup”, “Moo”, “God”, “Us”. , “Rain”, “Bo”, “To”, “Find”, “A”, “Work”, “Silver”, “Good”, and “Sun” may contain multiple texts. In addition, the text data corresponding to the voice data is "It's been a while, small negotiation." You can include sentences such as "Are you good at finding the secrets of the god of war?" However, it is not limited thereto.

According to some embodiments of the present disclosure, the processor 130 may compare a first sentence previously stored in the memory 120 with a second sentence included in text data. Here, the first sentence and the second sentence may be sentences related to the first content. For example, the first sentence may include a sentence related to the dialogue of the NPC in the game. The second sentence may include a sentence recorded by the user reading the dialogue of the NPC in the game.

The first sentence may include at least one text. For example, the first sentence is "It's been a while, small agreement. Are you good at finding the secret of the god of war?" In this case, at least one text included in the first sentence is “oh”, “lan”, “man”, “i”, “e”, yo”, “so”, “hyup”, “mu”, “God”, “Right”, “Rain”, “Bo”, “To”, “Find”, “A”, “Work”, “Silver”, “Good”, “Ha”, “Go”, “Re It can be "", "God", "Go", "Yo". That is, at least one text included in the first sentence may mean syllables included in the first sentence.

The second sentence is, for example, "It's been a while, small agreement. Are you good at finding the secret of the god of war?" In this case, at least one text included in the second sentence is “O”, “Ran”, “Man”, “Lee”, “Ya”, “So”, “Hyup”, “Moo”, “God”, It can be "right", "rain", "bo", "to", "find", "is", "work", "silver", "well", "sun". That is, at least one text included in the second sentence may mean syllables included in the second sentence.

In this case, the processor 130 may calculate a match rate of at least one text between the first sentence and the second sentence (S230).

Specifically, the processor 130 may compare text included in the first sentence and at least one text included in the second sentence based on the order of each text. In addition, the processor 130 may calculate a matching rate according to a degree to which at least one text included in the second sentence matches at least one text included in the first sentence or a different degree.

For example, the first sentence is "It's been a while, small agreement. Are you doing well to find the secret of the god of war?”, and the second sentence is “It's been a long time, Sohyup. In the case of "Are you good at finding Mushin's secret?", 17 of the 25 texts included in the first sentence may match.

In this case, the processor 130 may calculate a match rate of '17/25' since 17 texts match the text included in the second sentence among 25 texts included in the first sentence. Alternatively, the processor 130 may calculate '68%', which is a percentage of '17/25', as a match rate.

According to some embodiments of the present disclosure, when the match rate is greater than or equal to a preset level (S240, Yes), the processor 130 may determine voice data related to text data including the second sentence as candidate voice data (S250). .

For example, when the match rate is 60% or more, the processor 130 may determine voice data related to text including the second sentence as candidate voice data.

Meanwhile, when the match rate is less than a predetermined level (S240, No), the processor 130 may exclude voice data related to text data including the second sentence from the candidate voice data.

For example, when the match rate is less than 60%, the processor 130 may exclude voice data related to text including the second sentence from the candidate voice data.

For example, the processor 130 may compare a first sentence previously stored in the memory 120 with a third sentence included in the first text data. Also, the processor 130 may calculate a first match rate of at least one text between the first sentence and the third sentence. Here, the first text data may be text data obtained by inputting second voice data received from a second user terminal among the plurality of user terminals 200 into the voice recognition model.

Also, the processor 130 may compare the first sentence and the fourth sentence included in the second text data. Also, the processor 130 may calculate a second matching rate of the at least one text between the first sentence and the fourth sentence. Here, the second text data may be text data obtained by inputting the third voice data received from the third user terminal 230 among the plurality of user terminals 200 into the voice recognition model.

In this case, the processor 130 may determine only the second voice data as candidate voice data when the first match rate is greater than or equal to a preset level (eg, 60%) and the second match rate is less than a preset level. Further, the processor 130 may exclude the third voice data from the candidate voice data.

That is, the processor 130 may recognize whether or not the content corresponding to the first content is properly included in the voice data recorded by the user of the dialogue corresponding to the first content. In addition, the processor 130 may filter only voice data that properly includes content corresponding to the first content, thereby ensuring the quality of the voice data.

According to some other embodiments of the present disclosure, when filtering voice data, the processor 130 of the game server 100 may obtain text data corresponding to the voice data by using a language model included in the voice recognition model. I can.

In this case, the processor 130 may recognize whether or not profanity is included in the voice data. Also, when the voice data includes profanity, the processor 130 may exclude voice data including the profanity from the candidate voice data.

Specifically, the processor 130 may compare the profanity text pre-stored in the memory 120 with at least one text corresponding to the voice data. In addition, the processor 130 may exclude the voice data from the candidate voice data when there is a text matching the profanity text among at least one text corresponding to voice data.

Accordingly, the game server 100 can preserve a more comfortable game environment by excluding voice data containing profanity.

7 is a flowchart illustrating an example of a method for receiving a feedback signal for candidate voice data by a game server according to some embodiments of the present disclosure.

Referring to FIG. 7, the processor 130 of the game server 100 may receive an input signal for a voice listening button from a fourth user terminal 240 among a plurality of user terminals 200 (S310).

In this case, the processor 130 may cause the audio listening screen to be output from the game screen displayed on the fourth user terminal 240 in response to the input signal (S320).

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from a game screen to a voice listening screen to the fourth user terminal 240. Here, the voice listening screen may include at least one of a list output area of candidate voice data and a score input area for inputting scores for candidate voice data included in the list.

Meanwhile, the processor 130 may receive a feedback signal for candidate voice data through the communication unit 110 after the voice listening screen is output to the fourth user terminal 240 (S330). Here, the feedback signal may include a score for each of the candidate voice data, whether it likes or dislikes, and the like.

"Like" or "dislike" included in the feedback signal may be information input by the game user according to the game user's preference for specific candidate voice data. For example, the fourth user may recognize candidate voice data through the fourth user terminal 240. In addition, the fourth user may input likes or dislikes according to a preference for the candidate voice data through the fourth user terminal 240. In this case, the fourth user terminal 240 may transmit a feedback signal including likes or dislikes for the candidate voice data to the game server 100.

Accordingly, the game server 100 may receive feedback from the game user in various ways (here, scores, likes or dislikes). Meanwhile, a game user may select a convenient method from among various methods and provide feedback to the game server 100.

A description of the above-described voice listening screen will be described later in detail with reference to FIG. 8.

8 is a diagram for describing an example of a voice listening screen according to some embodiments of the present disclosure.

Referring to FIG. 8, the processor 130 may receive an input signal for a voice listening button 302 from a fourth user terminal 240 of a plurality of user terminals 200 through the communication unit 110.

In this case, the processor 130 responds to the input signal to the voice listening button 302 received from the fourth user terminal 240, and the voice from the game screen 300 displayed on the fourth user terminal 240 It may cause the listening screen 320 to be output.

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from the game screen 300 to the voice listening screen 320 to the fourth user terminal 240.

More specifically, the processor 130 may transmit a control signal to the fourth user terminal 240 through the communication unit 110 so that the voice listening screen 320 is output on the pop-up display area 305 of the game screen 300. have.

In this case, the fourth user terminal 240 of the plurality of user terminals 200 may output a voice listening screen 320 as shown in FIG. 8. Here, the voice listening screen 320 is a screen in which user interaction is possible, and the user can listen to a voice corresponding to the candidate voice data through a specific button. Also, the user may input feedback on the candidate voice data through a specific input area. However, it is not limited thereto.

According to some embodiments of the present disclosure, the voice listening screen 320 may include a list 321 of candidate voice data. In addition, the list of candidate voice data 321 may include at least one of a nickname item, a play button input area 322, a like and dislike button input area 323, and a score input area 324. However, since the above-described components are not essential for implementing the voice listening screen 320, the voice listening screen 320 may have more or fewer components than the above-listed components.

According to some embodiments of the present disclosure, the fourth user terminal 240 may recognize an input signal for at least one play button included in the play button input area 322. In addition, the fourth user terminal 240 may output candidate voice data corresponding to the at least one play button as sound in response to an input signal.

Meanwhile, when the fourth user completes the score input, the fourth user terminal 240 may transmit a feedback signal including the input score to the game server 100.

Specifically, the fourth user terminal 240 may recognize whether all scores have been input to the score input area 324. In addition, as the fourth user terminal 240 recognizes that all scores have been input, the fourth user terminal 240 may transmit a feedback signal including the score to the game server 100.

Additionally, the fourth user terminal 240 may recognize an input signal for a like button or a dislike button included in the like and dislike display area 323. In addition, the fourth user terminal 240 may transmit an input signal for a like button or a dislike button to the game server 100.

That is, the processor 130 of the game server 100 outputs the voice listening screen 320 to the fourth user terminal 240 and then sends the candidate voice data from the fourth user terminal 240 through the communication unit 110. It is possible to receive a feedback signal for.

On the other hand, the user playing the game can easily input feedback information through the voice listening button 302 on the game screen 300 without having to access a separate page to provide feedback on the candidate voice data.

9 is a flowchart illustrating an example of a method of determining, by a game server, selected voice data according to some embodiments of the present disclosure.

Referring to FIG. 9, the processor 130 of the game server 100 may determine the first candidate voice data as basic voice data based on a feedback signal for the candidate voice data (S410). Here, the basic voice data means voice data that is basically applied to the first content.

Specifically, the processor 130 may recognize the first candidate speech data having the highest score by using the score for the candidate speech data included in the feedback signal. Further, the processor 130 may determine the first candidate voice data having the highest score as the basic voice data.

As described above, the processor 130 may determine basic voice data to be applied to the first content among candidate voice data. In addition, the processor 130 may apply the determined basic voice data to the first content.

In this case, the processor 130 may apply voice data pre-stored in the memory 120 to a preset sentence among sentences corresponding to the first content. Further, the processor 130 may apply basic voice data to the rest of the sentences other than the preset sentence.

For example, the processor 130 may apply voice data of voice actors pre-stored in the memory 120 to the first sentence of the dialogue of the NPC in the game. In addition, the processor 130 may apply voice data recorded by the user to lines after the first sentence among lines of the NPC in the game.

However, it is not limited to the above-described example, and the processor 130 of the game server 100 may apply voice data recorded by the user in response to all sentences corresponding to the first content. In addition, if there is no suitable user's voice data related to the first content, the processor 130 may apply pre-stored voice data of the voice actor to all sentences corresponding to the first content. In addition, if there is no suitable user's voice data related to the first content, the processor 130 may not apply separate voice data to all sentences corresponding to the first content.

Meanwhile, the processor 130 may determine the second candidate voice data as the selected voice data based on the feedback signal for the candidate voice data (S420). Here, the selected voice data means voice data that can be additionally applied to the first content.

Specifically, the processor 130 may recognize second candidate speech data having a score equal to or greater than a preset score, using a score for candidate speech data included in the feedback signal. Further, the processor 130 may determine at least one second candidate voice data whose score is equal to or greater than a preset score as the selected voice data.

According to some other embodiments of the present disclosure, the processor 130 may recognize the first candidate voice data having the largest number of likes by using the number of likes for candidate voice data included in the feedback signal. Further, the processor 130 may determine the first candidate voice data having the highest number of likes as basic voice data.

Meanwhile, the processor 130 may recognize at least one second candidate voice data whose number of likes is equal to or greater than a preset number by using the number of likes for the candidate voice data included in the feedback signal. Further, the processor 130 may determine at least one second candidate voice data whose number of likes is equal to or greater than a preset number as the selected voice data.

That is, the processor 130 of the game server 100 may determine the basic voice data and the selected voice data using the feedback signals received from each of the plurality of user terminals 200.

The processor 130 of the game server 100 may provide voice data with high popularity as selective voice data along with the first content according to feedback from users playing the game. In addition, the processor 130 may provide voice data with the highest popularity as basic voice data along with the first content. Accordingly, users playing the game can enjoy the game more interestingly through various voices provided in the game.

According to some embodiments of the present disclosure, the processor 130 of the game server 100 may receive a selection signal for selecting selected voice data from each of the plurality of user terminals 200 through the communication unit 110. In this case, the processor 130 may set the first content displayed on each of the plurality of user terminals 200 and the selected voice data corresponding to the selection signal to be interlocked and output.

For example, the processor 130 may receive a first selection signal from the fifth user terminal 250 through the communication unit 110 for selecting the first selection speech data from among the selection speech data. In this case, when the fifth user terminal 250 displays the first content, the processor 130 may set the first selection voice data to be output.

As another example, the processor 130 may receive a second selection signal from the sixth user terminal 260 through the communication unit 110 for selecting the second selection speech data from among the selection speech data. In this case, when the sixth user terminal 260 displays the first content, the processor 130 may set the second selection voice data to be output.

According to some other embodiments of the present disclosure, the processor 130 of the game server 100 may receive a selection signal for selecting voice data of a specific user from each of the plurality of user terminals 200 through the communication unit 110. have. In this case, the processor 130 may set the first content displayed in each of the plurality of user terminals 200 and the voice data of the specific user to be interlocked and output.

According to some embodiments of the present disclosure, when the processor 130 of the game server 100 sets the basic voice data or the selected voice data to be output in conjunction with the first content in each of the plurality of user terminals 200, the The nickname of the user who provided the basic voice data or the selected voice data may be set to be displayed in a region of the game screen.

For example, when displaying the first content in the eighth user terminal, the processor 130 interlocks with the setting so that basic voice data is output, and in one area of the first content screen, “- this voice is 'Provided by It can be set to display a message such as -“.

Accordingly, the game server 100 may induce a plurality of users to provide voice data corresponding to the first content.

In the above description of FIGS. 2, 3, 6, 7 and 9, the order of each step may be changed as necessary, and at least one or more steps may be omitted or added. In addition, the above-described steps are only examples of the present disclosure, and the scope of the present disclosure is not limited thereto.

10 is a diagram for describing an example of a voice selection screen according to some embodiments of the present disclosure.

Referring to FIG. 10, the processor 130 of the game server 100 may receive an input signal for the voice selection button 303 from each of the plurality of user terminals 200 through the communication unit 110.

In this case, the processor 130 selects a voice from the game screen 300 displayed on each of the plurality of user terminals in response to an input signal to the voice selection button 303 received from each of the plurality of user terminals 200 It may cause the screen 330 to be output.

Specifically, the processor 130 may control the communication unit 110 to transmit a control signal for switching from the game screen 300 to the voice selection screen 330 to each of the plurality of user terminals 200.

More specifically, the processor 130 transmits a control signal to each of the plurality of user terminals 200 through the communication unit 110 so that the voice selection screen 330 is output on the pop-up display area 305 of the game screen 300. I can.

In this case, each of the plurality of user terminals 200 may output a voice selection screen 330 as shown in FIG. 10. Here, the voice selection screen 330 is a screen in which user interaction is possible, and a user can listen to a voice corresponding to the basic voice data and the selected voice data through a specific button. In addition, the user may select at least one of basic voice data and selected voice data to be applied to specific content in the game through a specific selection box. However, it is not limited thereto.

According to some embodiments of the present disclosure, the voice selection screen 330 may include a list 331 of basic voice data and selected voice data. In addition, the list 331 of basic voice data and selected voice data may include at least one of a play button input area 332, a popularity ranking display area 333, and a check box display area 334. However, since the above-described components are not essential for implementing the voice selection screen 330, the voice selection screen 330 may have more or fewer components than the above-listed components.

According to some embodiments of the present disclosure, a seventh user terminal among the plurality of user terminals 200 may recognize an input signal for at least one play button included in the play button input area 332. And, in response to the input signal, the seventh user terminal may output basic voice data or selected voice data corresponding to the at least one play button as sound.

Meanwhile, when the seventh user terminal checks at least one box included in the check box display area 334, the seventh user terminal may transmit a selection signal corresponding to the checked box to the game server 100.

That is, the processor 130 of the game server 100 may receive a selection signal from the seventh user terminal through the communication unit 110 after the voice selection screen 330 is output to the seventh user terminal. In addition, the processor 130 may set the selection voice data corresponding to the selection signal to be output in conjunction with the first content displayed on the seventh user terminal.

On the other hand, without the need to access a separate page to select the voice data to be applied to the first content for playing the game, the voice data to be applied to the first content can be conveniently accessed through the voice selection button 303 on the game screen 300. You can choose.

11 shows a simplified and general schematic diagram of an exemplary computing environment in which embodiments of the present disclosure may be implemented.

While the present disclosure has generally been described above with respect to computer-executable instructions that can be executed on one or more computers, those skilled in the art will appreciate that the present disclosure may be implemented in combination with other program modules and/or as a combination of hardware and software. will be.

In general, modules herein include routines, procedures, programs, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Further, to those skilled in the art, the method of the present disclosure is not limited to single-processor or multiprocessor computer systems, minicomputers, mainframe computers, as well as personal computers, handheld computing devices, microprocessor-based or programmable household appliances, and the like (each of which It will be appreciated that it may be implemented with other computer system configurations, including one or more associated devices).

The described embodiments of the present disclosure may also be practiced in a distributed computing environment where certain tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Computers typically include a variety of computer-readable media. Computer-readable media can be any computer-readable media, including volatile and non-volatile media, transitory and non-transitory media, removable and non-transitory media. Includes removable media. By way of example, and not limitation, computer-readable media may include computer-readable storage media and computer-readable transmission media.

Computer-readable storage media include volatile and nonvolatile media, transitory and non-transitory media, removable and non-removable media implemented in any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Includes the medium. Computer-readable storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital video disk (DVD) or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage, or other magnetic storage. Devices, or any other medium that can be accessed by a computer and used to store desired information.

Computer-readable transmission media typically implement computer-readable instructions, data structures, program modules or other data on a modulated data signal such as a carrier wave or other transport mechanism. Includes all information transmission media. The term modulated data signal refers to a signal in which one or more of the characteristics of the signal is set or changed to encode information in the signal. By way of example, and not limitation, computer-readable transmission media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above-described media are also intended to be included within the scope of computer-readable transmission media.

An exemplary environment 1100 is shown that implements various aspects of the present disclosure, including a computer 1102, which includes a processing device 1104, a system memory 1106, and a system bus 1108. do. System bus 1108 couples system components, including but not limited to, system memory 1106 to processing device 1104. The processing unit 1104 may be any of a variety of commercially available processors. Dual processors and other multiprocessor architectures may also be used as processing unit 1104.

The system bus 1108 may be any of several types of bus structures that may be additionally interconnected to a memory bus, a peripheral bus, and a local bus using any of a variety of commercial bus architectures. System memory 1106 includes read-only memory (ROM) 1110 and random access memory (RAM) 1112. The basic input/output system (BIOS) is stored in non-volatile memory 1110 such as ROM, EPROM, EEPROM, etc. This BIOS is a basic input/output system that helps transfer information between components in the computer 1102, such as during startup Includes routines. RAM 1112 may also include high speed RAM such as static RAM for caching data.

Computer 1102 also includes internal hard disk drive (HDD) 1114 (e.g., EIDE, SATA)-This internal hard disk drive 1114 can also be configured for external use within a suitable chassis (not shown). Yes--, magnetic floppy disk drive (FDD) 1116 (for example, to read from or write to removable diskette 1118), and optical disk drive 1120 (e.g., CD-ROM To read the disk 1122 or read from or write to other high-capacity optical media such as DVD). The hard disk drive 1114, magnetic disk drive 1116, and optical disk drive 1120 are each connected to the system bus 1108 by a hard disk drive interface 1124, a magnetic disk drive interface 1126, and an optical drive interface 1128. ) Can be connected. The interface 1124 for implementing an external drive includes, for example, at least one or both of USB (Universal Serial Bus) and IEEE 1394 interface technologies.

These drives and their associated computer readable media provide non-volatile storage of data, data structures, computer executable instructions, and the like. In the case of computer 1102, drives and media correspond to storing any data in a suitable digital format. Although the description of the computer-readable storage medium above refers to a removable optical medium such as a HDD, a removable magnetic disk, and a CD or DVD, those skilled in the art may include a zip drive, a magnetic cassette, a flash memory card, a cartridge, It will be appreciated that other types of computer-readable storage media, such as etc., may also be used in the exemplary operating environment and that any such media may contain computer-executable instructions for performing the methods of the present disclosure. .

A number of program modules, including the operating system 1130, one or more application programs 1132, other program modules 1134, and program data 1136, may be stored in the drive and RAM 1112. All or part of the operating system, applications, modules, and/or data may also be cached in RAM 1112. It will be appreciated that the present disclosure may be implemented on a number of commercially available operating systems or combinations of operating systems.

A user may input commands and information to the computer 1102 through one or more wired/wireless input devices, for example, a pointing device such as a keyboard 1138 and a mouse 1140. Other input devices (not shown) may include a microphone, IR remote control, joystick, game pad, stylus pen, touch screen, and the like. These and other input devices are often connected to the processing unit 1104 through the input device interface 1142, which is connected to the system bus 1108, but the parallel port, IEEE 1394 serial port, game port, USB port, IR interface, It can be connected by other interfaces such as etc.

A monitor 1144 or other type of display device is also connected to the system bus 1108 through an interface such as a video adapter 1146. In addition to the monitor 1144, the computer generally includes other peripheral output devices (not shown) such as speakers, printers, etc.

Computer 1102 may operate in a networked environment using logical connections to one or more remote computers, such as remote computer(s) 1148 via wired and/or wireless communication. The remote computer(s) 1148 may be a workstation, server computer, router, personal computer, portable computer, microprocessor-based entertainment device, peer device, or other common network node, and is generally It includes many or all of the described components, but for brevity, only memory storage device 1150 is shown. The logical connections shown include wired/wireless connections to a local area network (LAN) 1152 and/or to a larger network, eg, a wide area network (WAN) 1154. Such LAN and WAN networking environments are common in offices and companies, and facilitate an enterprise-wide computer network such as an intranet, all of which can be connected to a worldwide computer network, for example the Internet.

When used in a LAN networking environment, the computer 1102 is connected to the local network 1152 via a wired and/or wireless communication network interface or adapter 1156. Adapter 1156 may facilitate wired or wireless communication to LAN 1152, which also includes a wireless access point installed therein to communicate with wireless adapter 1156. When used in a WAN networking environment, the computer 1102 may include a modem 1158, connected to a communication server on the WAN 1154, or through the Internet, etc. to establish communication through the WAN 1154 Have means. The modem 1158, which may be an internal or external and a wired or wireless device, is connected to the system bus 1108 through a serial port interface 1142. In a networked environment, program modules described for the computer 1102 or portions thereof may be stored in the remote memory/storage device 1150. It will be appreciated that the network connections shown are exemplary and other means of establishing communication links between computers may be used.

Computer 1102 is associated with any wireless device or entity deployed and operated in wireless communication, e.g., a printer, scanner, desktop and/or portable computer, portable data assistant (PDA), communication satellite, wireless detectable tag. It operates to communicate with any equipment or place and phone. This includes at least Wi-Fi and Bluetooth wireless technologies. Thus, the communication may be a predefined structure as in a conventional network or may simply be ad hoc communication between at least two devices.

Wi-Fi (Wireless Fidelity) allows you to connect to the Internet, etc. without wires. Wi-Fi is a wireless technology such as a cell phone that allows such devices, for example computers, to transmit and receive data indoors and outdoors, ie anywhere within the coverage area of a base station. Wi-Fi networks use a wireless technology called IEEE 802.11 (a, b, g, etc.) to provide a secure, reliable and high-speed wireless connection. Wi-Fi can be used to connect computers to each other, to the Internet, and to a wired network (using IEEE 802.3 or Ethernet). Wi-Fi networks can operate in unlicensed 2.4 and 5 GHz radio bands, for example at 11 Mbps (802.11a) or 54 Mbps (802.11b) data rates, or in products that include both bands (dual band). have.

A person of ordinary skill in the art of the present disclosure includes various exemplary logical blocks, modules, processors, means, circuits and algorithm steps described in connection with the embodiments disclosed herein, electronic hardware, (convenience). For the sake of clarity, it will be appreciated that it may be implemented by various forms of program or design code or a combination of both (referred to herein as "software"). To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends on the particular application and design constraints imposed on the overall system. A person of ordinary skill in the art of the present disclosure may implement the described functions in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

The various embodiments presented herein may be implemented as a method, apparatus, or article of manufacture using standard programming and/or engineering techniques. The term “article of manufacture” includes a computer program, or media, accessible from any computer-readable device. For example, computer-readable storage media include magnetic storage devices (e.g., hard disks, floppy disks, magnetic strips, etc.), optical disks (e.g., CD, DVD, etc.), smart cards, and flash Memory devices (eg, EEPROM, cards, sticks, key drives, etc.), but are not limited thereto. The term “machine-readable medium” includes, but is not limited to, wireless channels and various other media capable of storing, holding, and/or transmitting instruction(s) and/or data.

It is to be understood that the specific order or hierarchy of steps in the presented processes is an example of exemplary approaches. Based on the design priorities, it is to be understood that within the scope of the present disclosure a specific order or hierarchy of steps in processes may be rearranged. The appended method claims provide elements of the various steps in a sample order, but are not meant to be limited to the specific order or hierarchy presented.

The description of the presented embodiments is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these embodiments will be apparent to those of ordinary skill in the art, and general principles defined herein may be applied to other embodiments without departing from the scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments presented herein, but is to be interpreted in the widest scope consistent with the principles and novel features presented herein.

Claims (12)

A computer program stored on a computer-readable storage medium, comprising:
The computer program includes instructions for causing a processor of the game server to perform the following operations, the operations:
Receiving an input signal for a record button related to the first content displayed on the game screen from at least one of the plurality of user terminals;
When receiving the input signal, a recording screen including a filter effect button is output in a pop-up display area of the game screen displayed on the at least one user terminal so that voice recording is performed in conjunction with the progress of the first content Transmitting a control signal to the at least one user terminal as possible;
Applying a filter effect to the voice data when voice data related to the first content is received together with an input signal to the filter effect button from the at least one user terminal after transmitting the control signal;
Filtering the voice data to obtain candidate voice data;
Receiving a feedback signal for the candidate voice data from each of the plurality of user terminals;
Determining basic audio data to be applied to the first content from among the candidate audio data based on the feedback signal;
The voice data pre-stored in the memory is applied as voice data for a preset specific sentence among sentences corresponding to the first content, and the basic voice data is applied to the rest of the sentences corresponding to the first content other than the specific sentence. Applying as voice data for sentences; And
Setting information on a user who has provided the basic audio data to be displayed in a region on a screen on which the basic audio data is output;
Containing,
A computer program stored on a computer-readable storage medium.
delete The method of claim 1,
The recording screen,
Including a script display area corresponding to the first content,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
Filtering the voice data to obtain candidate voice data,
Obtaining text data by inputting the speech data into a speech recognition model; And
Determining the candidate speech data based on the text data;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 4,
Based on the text data, the operation of obtaining candidate speech data,
Comparing a first sentence including at least one text pre-stored in the memory with a second sentence included in the text data;
Comparing the first sentence and the second sentence to calculate a match rate of the at least one text between the first sentence and the second sentence; And
Determining voice data related to text data including a second sentence having the matching rate equal to or greater than a predetermined level as the candidate voice data;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 4,
Based on the text data, the operation of obtaining candidate speech data,
A first match rate of the at least one text between the first sentence and the third sentence is determined by comparing a first sentence including at least one text previously stored in the memory and a third sentence included in the first text data. Calculating operation-the first text data is text data obtained by inputting second voice data received from a second user terminal among the plurality of user terminals into the voice recognition model;
Computing a second match rate of the at least one text between the first sentence and the fourth sentence by comparing the first sentence and the fourth sentence included in the second text data-The second text data is Text data obtained by inputting third voice data received from a third user terminal among a plurality of user terminals into the voice recognition model; And
Determining the second voice data as the candidate voice data when the first match rate is greater than or equal to a preset level and the second match rate is less than the preset level;
Containing,
A computer program stored on a computer-readable storage medium.

The method of claim 1,
The operation of receiving a feedback signal for the candidate voice data from each of the plurality of user terminals,
Receiving an input signal from a fourth user terminal among the plurality of user terminals for a voice listening button displayed on a screen on which a game is played;
In response to the input signal, causing a voice listening screen to be output on a screen on which the game is played, displayed on the fourth user terminal; And
Receiving a feedback signal for the candidate voice data from the fourth user terminal after the voice listening screen is output from the game screen displayed on the fourth user terminal;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 7,
The above voice listening screen is:
A list output area of the candidate voice data obtained by filtering the voice data; And
A score input area for inputting a score for the candidate voice data included in the list;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 1,
The feedback signal,
Including a score for the candidate speech data,
Based on the feedback signal, the operation of determining basic voice data to be applied to the first content among the candidate voice data,
Determining a first candidate speech data having the highest score among the candidate speech data as the basic speech data by using the feedback signal;
Containing,
A computer program stored on a computer-readable storage medium.
The method of claim 9,
Determining second candidate voice data having the score equal to or greater than a preset score as selected voice data that can be additionally applied to the first content;
Further comprising,
A computer program stored on a computer-readable storage medium.
The method of claim 10,
When a first selection signal for selecting a first selection audio data from among the selection audio data is received from a fifth user terminal, the first selection audio data is output when the fifth user terminal displays the first content The operation of setting to be possible; And
When a second selection signal for selecting a second selection audio data from among the selection audio data is received from a sixth user terminal, the second selection audio data is output when the sixth user terminal displays the first content Setting to be possible;
Further comprising,
A computer program stored on a computer-readable storage medium.

As a game server,
A communication unit for receiving an input signal for a recording button related to the first content displayed on the game screen from at least one of the plurality of user terminals; And
In the case of receiving the input signal through the communication unit, including a filter effect button in the pop-up display area of the game screen displayed on the at least one user terminal so that voice recording is performed in conjunction with the progress of the first content A processor that controls the communication unit to transmit a control signal to the at least one user terminal to output a recording screen;
Including,
The processor,
After transmitting the control signal through the communication unit, when voice data related to the first content is received from the at least one user terminal together with an input signal to the filter effect button, a filter effect is applied to the voice data and,
Filtering the voice data to obtain candidate voice data,
Receiving a feedback signal for the candidate voice data from each of the plurality of user terminals through the communication unit,
Based on the feedback signal, determine basic voice data to be applied to the first content among the candidate voice data,
The voice data pre-stored in the memory is applied as voice data for a preset specific sentence among sentences corresponding to the first content, and the basic voice data is applied to the rest of the sentences corresponding to the first content other than the specific sentence. Applied as voice data for sentences,
Setting information on a user who has provided the basic audio data to be displayed in a region on the screen on which the basic audio data is output,
Game server.

Images