KR20200102113A - Method and system for creating rhythm game cues with face - Google Patents

Abstract

Disclosed are a method and a system for generating a cue for a rhythm game using a face. The method for the rhythm game cue includes: a step of setting music according to a game start request; and a step of providing the rhythm game using the music in a face play method according to a face action.

Description

Method and system for creating rhythm game cues with faces {METHOD AND SYSTEM FOR CREATING RHYTHM GAME CUES WITH FACE}

The description below relates to the technology of providing a rhythm game.

Rhythm game is a game in which hands or body are used to match music, and is also called a music game or rhythm action game.

In a rhythm game, it is required to perform a designated operation at an accurate timing, and the type of operation to be performed by the user and the accuracy of the operation performed by the user are usually displayed on the screen.

For example, Korean Patent Publication No. 10-2010-0096606 (published on September 02, 2010) discloses a game service providing method and system capable of changing a note line in real time when a rhythm game is in progress.

In the early rhythm games, various input devices such as controllers imitating instruments such as guitars, drums, and maracas or foot mats for use in dance games or control pads were used to receive user manipulation.

Recently, rhythm games using input devices such as touch pads have been developed for mobile devices such as smartphones.

It provides a method and system capable of providing a rhythm game progressing through face play using faces.

It provides a method and system capable of providing a rhythm game using a face action as a user input.

A method and a system capable of generating a cue for each beat to be applied to a rhythm game of a corresponding music based on motion information for each beat obtained from an image related to music is provided.

It provides a method and system capable of providing various dance style rhythm games for one music.

A method executed on a computer system, the computer system comprising at least one processor configured to execute computer readable instructions contained in a memory, the method comprising, by the at least one processor, according to a game start request Setting music; And providing, by the at least one processor, a rhythm game using the music in a face play method according to a face action.

According to an aspect, the facial action may include a face direction and a facial expression.

According to another aspect, the providing may include generating and providing a cue indicating a face action for face play.

According to another aspect, the providing may include exposing a queue indicating a face action on a game screen composed of a face image of a user input through a camera.

According to another aspect, the providing may include providing a queue of a face action predetermined in accordance with a beat of a playback section when the music starts playing.

According to another aspect, the providing may include generating a cue for each beat to be applied to the rhythm game based on motion information of a dancer in relation to the music.

According to another aspect, the providing comprises: acquiring motion information for each beat of the music from an analysis result of an image of a dancer's actual motion in relation to the music or data from a sensor attached to the dancer's body. ; And generating a cue for each beat to be applied to the rhythm game by associating a previously defined cue for each motion type with the motion information for each beat.

According to another aspect, the providing may further include recognizing the user's face action and providing a hit result for the cue according to whether the face action is the same as the cue.

According to another aspect, the cue moves in a predetermined direction and speed after being exposed on the game screen, and in the providing step, the center point of the cue is hit when the same face action as the cue is recognized. It may further include determining whether a hit has occurred based on whether the area is within the error range.

According to another aspect, in the setting, music corresponding to a game condition selected or specified by a user may be automatically set.

There is provided a computer program stored in a non-transitory computer-readable recording medium for executing the method on the computer system.

A computer system comprising: at least one processor configured to execute computer-readable instructions included in a memory, the at least one processor comprising: a music setting unit configured to set music according to a game start request; And it provides a computer system including a providing unit for providing a rhythm game using the music in a face play method according to a face action.

1 is a block diagram illustrating an example of an internal configuration of a computer system according to an embodiment of the present invention.
2 is a diagram illustrating an example of components that may be included in a processor of a computer system according to an embodiment of the present invention.
3 is a flow chart illustrating an example of a method for generating a rhythm game cue that can be performed by a computer system according to an embodiment of the present invention.
4 is a table for explaining examples of cues for face play according to an embodiment of the present invention.
5 illustrates an example of a rhythm game screen using a face image in an embodiment of the present invention.
6 is an exemplary diagram for explaining a cue movement direction and a hit area in a rhythm game screen according to an embodiment of the present invention.
FIG. 7 is an exemplary diagram for explaining a process of determining whether a queue is hit in accordance with an embodiment of the present invention.
8 is a flowchart illustrating an example of a method of generating a cue for each beat to be applied to a rhythm game according to an embodiment of the present invention.
9 shows an example of an operation type-queue table in which queues are matched for each operation type according to an embodiment of the present invention.
10 shows an example of a bit-by-bit queue generated as motion information in an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention relate to a technology for providing a rhythm game, and more particularly, to a technology for providing a rhythm game with a face.

Embodiments including those specifically disclosed in the present specification can provide a rhythm game progressing through face play using a face, and through this, significant advantages can be achieved in terms of fun elements, diversity, and efficiency.

1 is a block diagram illustrating an example of an internal configuration of a computer system according to an embodiment of the present invention. For example, a system for generating a rhythm game cue according to embodiments of the present invention may be implemented through the computer system 100 of FIG. 1.

As shown in FIG. 1, the computer system 100 is a processor 110, a memory 120, a permanent storage device 130, a bus 140, an input/output interface as a component for executing a method for generating a rhythm game queue. 150 and a network interface 160.

The processor 110 may include or be part of any device capable of processing a sequence of instructions as a component for a rhythm game. The processor 110 may include, for example, a processor and/or a digital processor in a computer processor, mobile device, or other electronic device. The processor 110 may be included, for example, a server computing device, a server computer, a series of server computers, a server farm, a cloud computer, a content platform, and the like. The processor 110 may be connected to the memory 120 through the bus 140.

Memory 120 may include volatile memory, permanent, virtual or other memory for storing information used by or output by computer system 100. The memory 120 may include, for example, random access memory (RAM) and/or dynamic RAM (DRAM). Memory 120 may be used to store any information, such as state information of computer system 100. The memory 120 may also be used to store instructions of the computer system 100 including instructions for a rhythm game, for example. Computer system 100 may include one or more processors 110 as needed or where appropriate.

Bus 140 may include a communication infrastructure that enables interaction between various components of computer system 100. Bus 140 may carry data between components of computer system 100, for example, between processor 110 and memory 120, for example. Bus 140 may include wireless and/or wired communication media between components of computer system 100 and may include parallel, serial or other topological arrangements.

Persistent storage device 130 is a component such as a memory or other persistent storage device as used by computer system 100 to store data for a predetermined extended period of time (e.g., compared to memory 120). Can include. Persistent storage device 130 may include nonvolatile main memory as used by processor 110 in computer system 100. The persistent storage device 130 may include, for example, a flash memory, a hard disk, an optical disk, or other computer-readable medium.

The input/output interface 150 may include interfaces to a keyboard, mouse, voice command input, display, or other input or output device. Configuration commands and/or input for a rhythm game may be received through the input/output interface 150.

The network interface 160 may include one or more interfaces to networks such as a local area network or the Internet. The network interface 160 may include interfaces for wired or wireless connections. Configuration commands and/or input for a rhythm game may be received through the network interface 160.

Further, in other embodiments, the computer system 100 may include more components than the components of FIG. 1. However, there is no need to clearly show most of the prior art components. For example, the computer system 100 may be implemented to include at least some of the input/output devices connected to the input/output interface 150 described above, or a transceiver, a global positioning system (GPS) module, a camera, various sensors, Other components such as a database may be further included.

In the present invention, it is possible to provide a rhythm game progressing through face play using a face.

In the present invention, an input method of a rhythm game, for example, an input method using a separate controller or a dance mat, or a touch-based input method is changed to an action using a face (face direction, facial expression, etc.).

FIG. 2 is a diagram showing an example of components that can be included in a processor of a computer system according to an embodiment of the present invention, and FIG. 3 is a rhythm game that can be performed by a computer system according to an embodiment of the present invention. It is a flow chart showing an example of a queue creation method.

As shown in FIG. 2, the processor 110 may include a music setting unit 210, a queue providing unit 220, and a result providing unit 230. Components of the processor 110 may be expressions of different functions performed by the processor 110 according to a control command provided by at least one program code. For example, the music setting unit 210 may be used as a functional expression that operates to control the computer system 100 so that the processor 110 sets music for a rhythm game.

The processor 110 and the components of the processor 110 may perform steps S310 to S330 included in the method for generating a rhythm game queue of FIG. 3. For example, the processor 110 and the components of the processor 110 may be implemented to execute an instruction according to the code of the operating system included in the memory 120 and the at least one program code described above. Here, at least one program code may correspond to a code of a program implemented to process a method for generating a rhythm game cue.

The rhythm game cue generation method may not occur in the illustrated order, and some of the steps may be omitted or an additional process may be further included.

The present invention provides a rhythm game in which scores are obtained by taking the same facial action (turning a face direction, opening a mouth, closing eyes, etc.) as a cue given according to a beat according to music.

The processor 110 may load a program code stored in a program file for a method of generating a rhythm game cue into the memory 120. For example, a program file for a method of generating a rhythm game queue may be stored in the permanent storage device 130 described with reference to FIG. 1, and the processor 110 is a program file stored in the permanent storage device 130 through a bus. The computer system 110 can be controlled so that the program code is loaded into the memory 120. In this case, each of the music setting unit 210, the queue providing unit 220, and the result providing unit 230 included in the processor 110 and the processor 110 is a corresponding part of the program code loaded into the memory 120 It may be different functional expressions of the processor 110 for executing the subsequent steps S310 to S330 by executing the command of. In order to execute the steps S310 to S330, the processor 110 and components of the processor 110 may directly process an operation according to a control command or control the computer system 100.

In step S310, the music setting unit 210 may set music for a rhythm game according to a game start request from a user (game player). For example, the music setting unit 210 may set specific music according to a user's selection. As another example, the music setting unit 210 may automatically set music corresponding to at least one game condition, such as a game difficulty level or a game mode selected or specified by a user.

In step S320, when the playback of the music set in step S310 starts, the cue providing unit 220 may provide a cue for face play according to the music being played. For example, for each music, a cue suitable for the beat of each section may be defined in advance based on note data of the corresponding music, and the cue providing unit 220 is a cue for the corresponding music according to the set music. You can take a cue definition and expose that cue for music playback. Depending on the embodiment, a cue for each bit to be applied to the rhythm game of the music may be generated based on the motion information for each bit obtained from an image related to music. Accordingly, the cue providing unit 220 A queue corresponding to motion information can be exposed. Here, the'music-related video' may be an image in which one or a plurality of dancers dance to the corresponding music. Bit-by-bit motion information may be extracted for the motion of the dancer in the image. When there is one dancer in the image, various motion information, such as a dancer's facial expression, arms, legs, body, and gaze, may be used as motion information for each bit. When the dancer in the image is composed of a plurality of dancers, not only the motion information of the single dancer described above, but also the distance or position change between the dancers may be included in the motion information. For example, a case in which a plurality of dancers gather and then perform a group dance that spreads widely, or a case in which some dancers perform a group dance that moves rapidly to the right or left may be included as motion information for each bit.

In step S330, the result providing unit 230 may recognize the user's face action as a user input for the rhythm game, and at this time, provide a hit result according to the recognized face action for the cue. The processor 110 may configure the user's face image input through the camera as a game screen, and the result providing unit 230 may recognize the user's face action using the camera image while the rhythm game is in progress. . The result providing unit 230 may provide a hit result for each cue by determining whether the user takes the same face action as that of the cue given in accordance with the music playback section.

In the present invention, a cue for face play may mean an interface that visually indicates a face action to be taken by a user. The facial action may include a change in facial expressions such as a direction in which the face (head) is turned, a shape of a mouth, or a blinking eye.

4 shows an example of a cue applicable to a rhythm game according to an embodiment of the present invention. 4 shows a cue-action table 400 in which face actions are defined for each cue.

Referring to FIG. 4, the cue-action table 400 includes a list of cues applicable to a rhythm game with a face, and action type, UI, exposure position information (x position, etc.) previously defined for each cue. It may include.

', 노출 위치 정보는 '왼쪽에서 x축으로 50% 지점'이 정의될 수 있다.For example, for'left arrow cue', the action type is'turn head left', the UI is'←', and the exposure position information is defined as '10% point from left to x-axis'. I can. Also, in the case of'mouth cue', the action type is'open mouth' and the UI is'

', As for the exposure location information, '50% point from the left to the x-axis' may be defined.

5 is a diagram showing an example of a rhythm game screen with a face in an embodiment of the present invention.

As illustrated in FIG. 5, the processor 110 may configure an interface screen 500 for a rhythm game using an image input through a camera, that is, a camera image photographing a user's face.

The cues for face play appear at positions respectively determined based on the X coordinate of the rhythm game screen 500 according to exposure position information for each cue included in the cue-action table 400 of FIG. 4.

Then, the cue appears on the rhythm game screen 500 and then moves in the Y-axis direction of the rhythm game screen 500, for example, from the bottom to the top, as shown in FIG. 6.

The cue movement direction and movement speed in the rhythm game screen 500 are all the same regardless of the cue type, and two or more cues do not appear at the same time, but appear at a predetermined time interval between the cues.

Referring to FIG. 6, the cue providing unit 220 may provide a cue corresponding to the beat of a playback section in accordance with music playback in a manner that appears at the bottom of the rhythm game screen 500 and moves to the top.

The cue is moved for a predetermined time (N seconds) set on the rhythm game screen 500, at this time, the moving time until the cue appears on the rhythm game screen 500 and reaches the hit area 601 It can mean.

In this case, the hit area 601 may mean a reference line for determining whether a face action for the queue is hit.

After the cue appears on the rhythm game screen 500, the result providing unit 230 determines whether the user takes the same face action as the corresponding cue based on the hit area 601 determined on the rhythm game screen 500 or not. I can judge.

Referring to FIG. 7, the result providing unit 230 may determine whether a hit has occurred based on the hit area 601 at a time when the same face action as that of the cue is recognized, according to the location of the center point of the cue.

Based on the movement direction of the queue (eg, the Y-axis direction), ± a certain range (N pixels) in the hit area 601 can be set as an error range, and the result providing unit 230 recognizes the same face action as the queue. If the center point of the corresponding queue is within the error range based on the hit area 601 at the time point, it may be determined as a hit success, and out of the error range, it may be determined as a hit failure.

The result providing unit 230 processes the hit successful cue to disappear immediately after applying a predetermined effect (explosion effect, etc.) indicating the success of the hit, and in the case of the failed hit, the cue is blurred while leaving the hit area 601 to be a rhythm game. After moving to the top of the screen 500, it may be processed to disappear.

Hit success can be classified as perfect if the center point of the cue coincides with the hit region 601, and as good if it is within the error range even if it does not coincide with the hit region 601, and the perfect score is higher than the good. Application effects can also be defined differently.

Accordingly, in the present invention, it is possible to provide a rhythm game progressing through face play using face action.

8 is a flowchart illustrating an example of a method of generating a cue for each beat to be applied to a rhythm game according to an embodiment of the present invention.

In step S801, the queue providing unit 220 may acquire motion information for each bit from an image related to music. The motion information may include all motion and expression information that can be expressed as a dance motion, such as a head, an arm, a pelvis, a leg, a joint, and a position change between a plurality of dancers. For example, the cue providing unit 220 may capture the actual motion of a dancer dancing to music and obtain motion information for each bit of the music through analysis of the captured image. Depending on the embodiment, it is also possible to attach a sensor directly to the body of a dancer dancing to music to obtain motion information for each beat of the music from data acquired through the sensor.

In step S802, the cue providing unit 220 converts the cue corresponding to the motion information for each beat acquired in step S801 to a cue for each beat to be applied to the rhythm game of the music based on the previously defined cue for each motion type. Can be generated.

9 illustrates an example of an operation type-cue table 900 in which queues are matched for each operation type.

Referring to FIG. 9, an action type-cue table 900 can be built in advance by matching a cue 902 of a type suitable for a corresponding action for each action type 901 that can be expressed by a human body. For example, it is possible to match the'left arrow cue' in which the action type'turn the head left' is defined for the dancer's movement raising the left arm. Alternatively, in the case of a group dance that spreads widely after a plurality of dancers are gathered, a cue with a wide mouth open may be matched. In another example, when some dancers perform a group dance that moves rapidly to the right or left, a cue that turns the head to the right or to the left may be matched.

The cue providing unit 220 may generate a cue for each beat to be applied to the rhythm game based on motion information for each beat obtained from an image related to the music for music set for the rhythm game.

Referring to FIG. 10, the cue providing unit 220 may obtain motion information for each bit according to the dance style in the image from an image of a dancer dancing to a specific music, after which the motion type-cue table 900 By correlating the cue matched to each motion by using, a cue for each beat to be applied to the rhythm game of the music can be created.

Accordingly, the cue providing unit 220 may generate a cue that suits music well and apply it to a rhythm game of the music. In addition to producing customized cue rhythm games according to the dancer's dance style, it is possible to produce various style rhythm games according to the dancer for one piece of music. For example, in the case of music of a musician group with several members, a rhythm game with a different cue may be produced for each member according to the dance movement of each member for one music.

As described above, according to embodiments of the present invention, it is possible to provide a rhythm game in which a face action is used as a user input through face play using a face. Furthermore, according to embodiments of the present invention, a cue for each beat to be applied to the rhythm game of the music may be generated based on motion information for each beat obtained from an image related to music, and various dance styles for one music Can provide a rhythm game.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable gate array (PLU). It may be implemented using one or more general purpose computers or special purpose computers, such as a logic unit), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be embodyed in any type of machine, component, physical device, computer storage medium or device to be interpreted by the processing device or to provide instructions or data to the processing device. have. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. In this case, the medium may be one that continuously stores a program executable by a computer, or temporarily stores a program for execution or download. In addition, the medium may be a variety of recording means or storage means in a form in which a single or several pieces of hardware are combined, but is not limited to a medium directly connected to a computer system, but may be distributed on a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and And a ROM, RAM, flash memory, and the like, and may be configured to store program instructions. In addition, examples of other media include an app store that distributes applications, a site that supplies or distributes various software, and a recording medium or a storage medium managed by a server.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (20)

In the method executed on a computer system,
The computer system includes at least one processor configured to execute computer readable instructions contained in a memory,
The above method,
Setting, by the at least one processor, music according to a game start request; And
Providing, by the at least one processor, a rhythm game using the music in a face play method according to a face action
How to include. The method of claim 1,
The facial action includes a face direction and a facial expression
The method characterized by. The method of claim 1,
The providing step,
Creating and providing a cue indicating a face action for face play
How to include. The method of claim 1,
The providing step,
Exposing a queue indicating a face action on a game screen composed of a face image of a user input through a camera
How to include. The method of claim 1,
The providing step,
Providing a preset face action cue according to the beat of the playback section when the music starts playing
How to include. The method of claim 1,
The providing step,
Generating a cue for each beat to be applied to the rhythm game based on motion information of a dancer in relation to the music
How to include. The method of claim 1,
The providing step,
Acquiring motion information for each beat of the music from an analysis result of an image of a dancer's actual motion in relation to the music or data from a sensor attached to the dancer's body; And
Generating a cue for each beat to be applied to the rhythm game by correlating the motion information for each beat with a cue defined in advance for each motion type
How to include. The method of claim 4,
The providing step,
Recognizing the user's face action and providing a hit result for the cue according to whether the face action is the same as the cue
How to further include. The method of claim 4,
The cue moves in a predetermined direction and speed after being exposed on the game screen,
The providing step,
Determining whether a hit is made based on whether the center point of the queue is within an error range based on the hit area at a time when the same face action as the queue is recognized
How to further include. The method of claim 1,
The setting step,
Automatically setting music corresponding to game conditions selected or specified by the user
The method characterized by. A computer program stored on a non-transitory computer readable recording medium for executing the method of any one of claims 1 to 10 on the computer system. In a computer system,
At least one processor configured to execute computer readable instructions contained in memory
Including,
The at least one processor,
A music setting unit for setting music according to a game start request; And
A providing unit that provides a rhythm game using the music in a face play method according to a face action
Computer system comprising a. The method of claim 12,
The facial action includes a face direction and a facial expression
Computer system, characterized in that. The method of claim 12,
The providing unit,
Creating and providing a cue that directs face actions for face play
Computer system, characterized in that. The method of claim 12,
The providing unit,
Exposing a cue indicating a face action on a game screen composed of a user's face image input through a camera
Computer system, characterized in that. The method of claim 12,
The providing unit,
When playback of the music starts, providing a preset face action cue according to the beat of the playback section
Computer system, characterized in that. The method of claim 12,
The providing unit,
Creating a cue for each beat to be applied to the rhythm game based on the dancer's motion information in relation to the music
Computer system, characterized in that. The method of claim 12,
The providing unit,
Acquiring motion information for each beat of the music from an analysis result of an image of a dancer's actual motion in relation to the music or data from a sensor attached to the dancer's body,
Creating a cue for each beat to be applied to the rhythm game by matching the motion information for each beat with a cue defined in advance for each motion type
Computer system, characterized in that. The method of claim 15,
The providing unit,
Recognizing the user's face action and providing a hit result for the cue according to whether the face action is the same as the cue
Computer system, characterized in that. The method of claim 15,
The cue moves in a predetermined direction and speed after being exposed on the game screen,
The providing unit,
Determining whether a hit is made based on whether the center point of the queue is within an error range based on the hit area at a time when the same face action as the queue is recognized
Computer system, characterized in that.

Images