JP2017136377A - Orchestra direction game apparatus and orchestra direction game program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an orchestra direction game allowing a player to input an instruction important for directing an orchestra, such as temporal strength of voice, temporal change in tempo, and a temporal change in rhythm.SOLUTION: An orchestra direction game apparatus: evaluates moving trajectory of a player's fingers as a pattern; defines, just like a normal direction operation, a player's "act" as temporal reproduction elements of the music piece such as a change in tempo, a change in strength, and a change in rhythm of the music piece; compares the player's intention represented by the "act" with a standard performance state of the temporal reproduction elements corresponding to instruction signs CS stored in an orchestra direction game program; and reproduce by changing the standard performance state according to the difference. The orchestra direction game apparatus defines respectively, the temporal reproduction elements of the music piece such as the tempo, strength, and rhythm of the music piece into the respective patterns of the instruction signs CS 8 and 9 so as to enable the orchestra performance in a form finely reflecting the player's intention.SELECTED DRAWING: Figure 9

Description

    The present invention is a game device having a display with a touch panel capable of inputting by touching a finger, on the touch panel according to indication signs having various shapes displayed on the display, The present invention relates to an orchestra commanding game apparatus and an orchestra commanding game program capable of commanding an orchestra displayed on a display by performing a corresponding input operation.

    In such a conventional music game, for example, an instruction sign is moved on a display along a predetermined route, and when the instruction sign reaches a predetermined icon or position, the player corresponds to the touch panel (display). Touch a position (there may be a musical instrument such as a drum), determine the timing and quality of the touch position, and change the sound of the drum or music played at that time The method of making it common was (for example, patent document 1).

JP2008-2000295

    However, with this method, only the timing of touching the touch panel at a certain point in time and the accuracy of the touch position are evaluated, and the music playback process can be changed in order to perform the music playback process. However, it has not been possible to control the playback mode of the music for a predetermined time following that according to the touch mode of the touch panel on the player over time. For example, the player cannot instruct the game machine side of the crescendo, which is an instruction to perform so as to gradually increase the sound to be performed, using such a method.

    Therefore, the contents that can be instructed by the player are limited to simple things such as the intensity of the sound and the presence or absence of the sound, and the orchestra such as the intensity of the sound over time, the tempo change over time, the rhythm change over time, etc. It was not possible to input important instructions for conducting.

    Accordingly, the present invention provides an orchestra commanding game apparatus and orchestra capable of inputting important instructions for commanding an orchestra, such as the strength of sound over time, changes in tempo over time, and changes in rhythm over time. An object is to provide a command game and an orchestra command game program.

A first aspect of the present invention includes a display (6) and a sound reproduction device (8),
On the display (6), a touch panel (5) composed of touch sensors is stacked and installed.
A performance in which an image of the orchestra (17) and a performance image (PC) composed of a time scale image (TS) composed of a time axis (TX) and a reference position (SL) set on the time axis are displayed on the display (6). Image display means (2),
Music playback means (9) for playing back predetermined music via the sound playback device (8),
An indication mark (CS) indicating a “swing” of a command to be input by the player via the touch panel when the music is commanded indicates a contact pattern of the player's finger with respect to the touch panel in a pattern over time. A plurality of stored memory means (7) in which an indicator set (SET) is stored;
The instruction sign set (SET) corresponding to the music reproduced by the music reproduction means (8) is read from the memory means (7), and the instruction sign (CS) constituting the instruction sign set is read from the time. A time scale image display means (11) for moving and displaying on the scale image (TS) in synchronization with the music reproduced by the music reproduction means;
Touch mode analysis means (10) for analyzing a pattern of “swing” corresponding to the orchestra commanding operation that is input over time from the touch panel in accordance with the timing at which the indication mark to be moved passes through the reference position. ,
An input operation evaluation judging means (12) for comparing the analysis result of the analyzed “swing” pattern with a reference value of the indicator mark to be moved and displayed to evaluate a deviation from the reference value;
Music parameter fluctuation control means (9) for controlling the performance parameters of the music reproduced from the music reproduction means (9) to change over time according to the deviation from the reference value;
It is characterized by having.

    The second aspect of the present invention is characterized in that the indication mark is constituted by an icon indicating a movement mode of a finger on the touch panel (5) as a two-dimensional figure.

    According to a third aspect of the present invention, the indicator is composed of an icon indicating a movement manner of a plurality of fingers on a touch panel as a two-dimensional figure.

According to the first aspect of the present invention, the memory means (7) is provided with an indication mark (CS) indicating a “swing” of a command to be input by the player, and a contact pattern of the player's finger with respect to the touch panel is a pattern over time. A large number of instruction sign sets (SET) stored in the form of instructions are stored, and the touch condition analysis means (10) inputs the instruction signs over time from the touch panel in accordance with the timing of passing the reference position. Analyzes the player's “swing” pattern. Then, the input motion evaluation judging means (12) compares the analysis result of the “swing” pattern with the reference value of the indicator mark that is moved and displayed, evaluates the deviation from the reference value, and controls the music parameter fluctuation control. The means (9) controls the performance parameters of the music reproduced from the music reproduction means (9) to change with time in accordance with the deviation from the reference value.
By using various indication signs (CS) with elements over time, the orchestra can be commanded such as sound intensity over time, tempo changes over time, and rhythm changes over time. This makes it possible to input important instructions and to provide an advanced music game that is comparable to the actual command.

    According to the second aspect of the present invention, the indication sign is configured by an icon indicating a finger movement mode on the touch panel (5) as a two-dimensional figure, so that the player can input intuitively. You can understand what “shake” should be, and even beginners can easily enjoy it.

According to the third aspect of the present invention, the indication sign (CS) is constituted by an icon indicating a movement form of a plurality of fingers on the touch panel as a two-dimensional figure, so that a more complicated “swing” can be achieved. And advanced “command” actions.
Note that the numbers in parentheses are for the sake of convenience indicating the corresponding elements in the drawings, and therefore the present description is not limited to the descriptions on the drawings.

FIG. 1 is a block diagram showing an example of an orchestra commanding game apparatus to which the present invention is applied. FIG. 2 is a diagram showing an example of a display mode in the orchestra commanding game apparatus of FIG. FIG. 3 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 4 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 5 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 6 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 7 is a view showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 8 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 9 is a diagram showing another example of a display mode in the orchestra commanding game apparatus of FIG. 1. FIG. 10 is a diagram illustrating an example of an input mode of a player on the touch panel / display. FIG. 11 is a diagram showing another example of the input mode of the player on the touch panel / display. FIG. 12 is a flowchart illustrating an example of a touch mode analysis program. FIG. 13 is a schematic diagram illustrating an example of an instruction sign set. FIG. 14 is a diagram illustrating an example of a determination table.

    Embodiments of the present invention will be described below with reference to the drawings.

    As shown in FIG. 1, the orchestra-conducting game device 1 constituting the computer has a main control unit 2, and the main control unit 2 includes a touch panel 5, a display, which is an input unit via a bus line 3. 6, a game program memory 7, a music reproduction control unit 9, a touch mode analysis unit 10, an instruction sign display control unit 11, and an input operation evaluation determination unit 12. The touch panel 5 and the display 6 have a structure in which a panel-like touch sensor having the same size as the display surface is stacked on the display surface of the display 6 made of a flat display element such as a liquid crystal. Further, the music playback control unit 9 is connected to a sound playback device 8 such as a speaker or an earphone.

    Further, as shown in FIG. 2, the orchestra commanding game apparatus 1 has a casing 13 that is formed in a thin plate shape as a whole, and the front surface of the casing 13 and therefore a plane parallel to the paper surface of FIG. Is provided with an input display device 15 in which the touch panel 5 and the display 6 are combined. The casing 13 is formed to have a thin thickness in the direction perpendicular to the paper surface of FIG. 2 and is formed in a rectangular plate shape as a whole.

    In addition, the orchestra-conducting game apparatus 1 shown in FIG. 1 actually allows a CPU and memory (not shown) to be time-shared by multitasking by causing a computer to read and execute a predetermined program stored in a memory (not shown). Thus, the function shown in each block shown in FIG. 1 is executed. However, the orchestra commanding game apparatus 1 can be configured with hardware corresponding to each block, and each block can be configured to be controlled by CPUs or MPUs distributed in each block. Is possible.

    Since the orchestra commanding game apparatus 1 has the above-described configuration, when performing an orchestra commanding game using the orchestra commanding game apparatus 1, the main control unit is based on a play start command from the player or the like. 2 reads the orchestra command game program GPR from the game program memory 7, and the main control unit 2 controls the progress of the game based on the read orchestra command game program GPR. The orchestra command game program GPR stored in the game program memory 7 can be downloaded via a communication line such as the Internet or read from various memory elements storing the orchestra command game program GPR. It is stored in the game program memory 7 of the command game device 1.

    As shown in FIG. 2, the orchestra commanding game apparatus 1 basically performs an orchestra 17 composed of a large number of orchestra members 16 on the player via the touch panel 5 to conduct a command, ie, a commanding action. The player plays a command based on his / her command action by changing the music played from the sound playback device 8 with time according to the contents of the command action. The music to be played is heard through the sound reproducing device 8 and is enjoyed. At the same time, the orchestra commanding game apparatus 1 calculates the difference between the music played based on the player's command and the music previously stored in the orchestra commanding game program GPR as reference playback data, and presents it to the player. .

    Therefore, when playing the orchestra command game, the main control unit 2 starts with a number of orchestras in step S1 of FIG. 12 based on the touch mode analysis program TSA of the orchestra command game program GPR shown in FIG. An image of the orchestra 17 composed of the members 16 is displayed on the display 6 as a performance image PC, and is automatically selected by a music selection subroutine (not shown) constituting the orchestra command game program GPR, or an instruction via the player's touch panel 5 The operation of reproducing the predetermined music selected on the basis of the sound reproduction device 8 via the music reproduction control unit 9 is started. The orchestra command game program GPR is stored in the game program memory 7 so that the music data and the performance image PC of the orchestra 17 that can be commanded by the player in the orchestra command game apparatus 1 and can be played are read out in the game program memory 7. Since it has a shape, such processing can be easily performed.

    The performance image PC on which the image of the orchestra 17 is displayed, as shown in FIG. 2, displays an image of the orchestra 17 made up of a number of orchestras 16 below the performance image PC, and above that is a time scale. An image TS is displayed. The time scale image TS is displayed in a straight line in the longitudinal direction of the display 6, and in the direction perpendicular to the time axis TX in the vicinity of the left end of the performance image PC of FIG. A reference line SL as a reference position set and displayed at the position is displayed on the time axis TX, and an icon 19 constituting the indication sign CS generated by the indication sign display control unit 11 is sounded on the time axis TX. Display control is performed in such a manner as to horizontally move in the direction of arrow A from the right end of FIG. 2 toward the left end at a predetermined speed corresponding to the music output by the playback device 8. The image of the orchestra 17 is not described in detail here, but the whole is divided into a plurality of parts such as a stringed instrument part, a wind instrument part, and a percussion instrument part. Is assigned. This allocation state is displayed on the display 6 in such a manner that it is distinguished by the instrument or hair color of the orchestra member 16 via the main control unit 2 according to the instruction of the orchestra command game program GPR.

    The orchestra command game is started when the music playback control unit 9 starts playback of the music via the sound playback device 8. The main control unit 2 starts the music playback operation by the music playback control unit 9. At this time, the process proceeds to step S2 of the touch mode analysis program TSA, and the instruction sign display control unit 11 reads the instruction sign set SET of the music to be reproduced from the game program memory 7 and sets the instruction sign set SET to the music to be reproduced. It is instructed to display on the time scale image TS of the display 6 in synchronization. The instruction sign set SET is stored in the game program memory 7 as a part of the orchestra command game program GPR, and the instruction sign set SET corresponds to music that can be played back by the orchestra command game apparatus 1 as shown in FIG. Each setting is stored.

    In other words, the instruction sign set SET indicates, for each piece of music that can be played back by the sound playback device 8, the command “shake” to be input via the touch panel 5 when the player conducts the music. The finger contact mode is stored in a form in which the finger contact pattern is indicated by a figure, that is, by a finger contact pattern over time, in synchronization with the music data DATA of the music, and thus the music reproduced and output by the sound reproducing device 8. Is set. As shown in FIG. 13, the instruction mark set SET is an aggregate of a large number of finger signs CS, and each instruction mark CS indicates a contact mode (that is, a contact pattern) of the player's finger with respect to the touch panel 5 over time. ing. This instruction sign set SET does not necessarily indicate the correct “washes” when directing the music played by the sound playback device 8, but is merely a standard when the player directs the music on the touch panel 5. It serves as a general indicator. Note that the contents to be instructed to the orchestra by the instruction sign CS (for example, “tempo”, “decrescendo: decrescendo (belowly weak)”, “diminuendo diminuendo (belowly weak)”, “ crescendo: “crescendo” and the like, and the target data (for example, “whole”, “first violin”, etc.) indicating which part of the orchestra is stored as attribute data.

    In the following, each instruction mark CS will be described. However, the instruction mark CS is not limited to the pattern described below, and indicates an appropriate “time swing” when commanding each part or whole of the orchestra. Any pattern can be used. For example, FIG. 2 shows an indication mark CS1 composed of five icons 19 as a whole (for the indication mark CS, the indication mark CSn (n = 1.2 · ······················································· Indicates simply the indication mark CS). This instruction sign CS1 (the same applies to all instruction signs CS, which will be described later) is synchronized with the music reproduced by the sound reproduction device 8 by the instruction sign display control unit 11, and is performed at a predetermined speed. The time axis TX is controlled so as to move and display in the direction of arrow A. For example, the indication mark CS1 has a full length set to L12, and is composed of five (any number) circular icons 19. The circular icon 19 is displayed by moving the icon 19 on the performance image PC in the direction of arrow A and passing the reference line SL displayed on the left side. This is an icon for instructing to perform a “tap” to make a contact with a light tap. In this case, since the instruction mark CS1 is composed of five icons 19, the player is requested to perform five taps while the length L12 of the instruction mark CS1 passes through the reference line SL. The interval L between the icons 19 constituting the instruction mark CS1 is equal or different, but this is determined in advance by the orchestra-directed game program GPR depending on the performance mode of the music to be played (played).

    The length L12 of the indicator sign CS1 on the performance image PC and the interval L between the icons 19 represent the contents that the conductor (player) wants to instruct the band member 16 with the indicator sign CS1. It may be an overall tempo or a performance instruction for a particular instrument part. For example, in the orchestra command game program GPR, these instruction indicators CS1 are used to indicate staccato :: staccato (separate sound). In the case of the indication sign CS1 in FIG. 2, as described above, the player taps the touch panel 5 five times with one finger in accordance with the timing at which each icon 19 constituting the indication sign CS1 passes the reference line SL. You are asked to do so. In addition, the position on the touch panel 5 to touch may be anywhere. For example, the finger 20 touches the position P1 in FIG. 10 five times with ton, ton, ton, ton and ton. This position P1 is effective at any position on the touch panel 5, and the touch described later may be used so that the position P1 may be shifted on the touch panel 5 between taps (so that the touch is effective). Processed by the aspect analysis unit 10. The interval L between the icons 19 constituting the indication sign CS1 corresponds to the touch time interval of the finger 20, and the interval L between the icons 19 constituting other indication signs CS described later has the same meaning, Further, the interval L1 between the indicator signs CS has the same meaning (see FIG. 13).

    In FIG. 3, as another example of the indicator sign CS, the total length of the sign is L13, and a set of two icons 19 and 19 arranged vertically with respect to the time axis TX and the set of these icons 19 and 19 are four. An indication mark CS2 arranged at an appropriate interval L on the group and performance image PC is shown. This instruction mark CS2 performs a “double tap” that causes the player to touch the touch panel 5 with two fingers at the same time when the pair of icons 19 and 19 passes the reference line SL. It is an icon to instruct. In this case, since the instruction mark CS2 is composed of a set of four icons 19 and 19, the player is requested to perform four double taps. In addition, the position on the touch panel 5 to touch may be anywhere. For example, the ton, ton, ton, and ton are touched four times with the two fingers 20a and 20b at the positions P2 and P3 in FIG. The positions P2 and P3 are effective at any position on the touch panel 5, and the positions P2 and P3 may be shifted on the touch panel 5 between taps (touch is effective). It is processed by the touch mode analysis unit 10 described later.

    FIG. 4 shows an instruction mark CS3 including a horizontally long icon 19A as still another example of the instruction mark CS. The icon 19A has a large number of dots 21 arranged in a line in the horizontal direction of the performance image PC, which is the moving display direction (that is, the time direction) of the icon 19, and the indicator sign CS3 has a length. While the horizontally long icon 19 of L2 passes through the reference line SL, it is requested to continuously tap an arbitrary position P1 (see FIG. 10) on the touch panel 5 with a finger (one finger). This is an indication mark CS3 requesting “tap”. At this time, if the time interval between the taps on the touch panel 5 by the finger 20 is equal to or shorter than a predetermined time, the touch mode analysis unit 10 described later processes the touch as an effective finger, and the number of times does not matter. (Of course, as another embodiment, it is possible to evaluate the number of taps).

    FIG. 5 shows, as yet another example of the instruction mark CS, an instruction mark CS4 including a set of icons 19B and 19B ′ in which two round figures are connected by an arrow 22. These icons schematically indicate “swing” (moving mode) over time to be input by the player in a two-dimensional figure. That is, the icons 19 </ b> B and 19 </ b> B ′ have the directions of the arrows 22 opposite to each other, and the directions of the arrows 22 indicate the directions of the fingers to be moved by the player on the touch panel 5. That is, in the case of the indication sign CS4 in FIG. 5, while the first icon 19B passes the reference line SL (time corresponding to the time direction of the icon 19B, that is, the length L3 in the horizontal direction of the performance image PC), FIG. As shown, the finger 20 is required to move on the touch panel 5 in a shape of drawing an arc that swells downward in the direction of arrow C, which is the direction indicated by the arrow 22 of the icon 19B. Next, as shown in FIG. 10, while the second icon 19B ′ passes the reference line SL (time corresponding to the time direction of the icon 19B ′, that is, the length L4 in the horizontal direction of the performance image PC), It is required to move the finger 20 on the touch panel 5 in a shape of drawing an arc swelled downward in the direction of arrow B, which is the direction indicated by the arrow 22 of the icon 19B ′. The indication mark CS4 composed of this set of icons 19B and 19B 'is the passing time of the reference line SL of the icons 19B and 19B' according to the lengths L3 and L4 of the icons 19B and 19B '. This is a request for “swing” that is swung over time in the directions of arrows C and B in FIG. 10, and is used, for example, to indicate the overall performance tempo of the orchestra 17. In the orchestra command game program GPR, the lengths L3 and L4 are basically the same length, but instructions to change the speed of ritardando (Ritardando: gradually slow) and accelerando (Accelerando: gradually fast) In this case, the length may be different. As a result, a high-level command operation by the player is possible.

    FIG. 6 shows an icon 19C in which the lengths L5, L6, and L7 in the arrow A direction, that is, the direction of movement of the icons, are set to predetermined lengths as yet another example of the instruction mark CS. The indication mark CS5 including the single icon 19C is displayed while the icon 19C passes the reference line SL (time corresponding to the time direction of the icon 19C, that is, the length L5, L6, L7 in the horizontal direction of the performance image PC). 10), as shown in FIG. 10, with the finger 20 touching the player on the touch panel 5, the player is caused to move in the direction of arrow D, that is, to the right in the figure in a straight line over time. The requested indicator CS5. This is because the orchestra-directed game program GPR indicates the performance rhythm of the orchestra 17, the tempo of each part, and the articulation (slur slur: smooth) etc. It is also used to give instructions.

    FIG. 7 is similar to FIG. 6, but the indicator sign CS6 of FIG. 6 is configured in such a manner that icons 19C and 19C having the same length L5, L6, and L7 are stacked in parallel above and below the time scale image TS. ing. This instruction mark CS6 is displayed while the pair of upper and lower icons 19C, 19C constituting the instruction mark CS passes through the reference line SL (the lengths L5, L6, L7 in the time direction of the icon 19C, that is, the horizontal direction of the performance image PC). Etc.), two fingers 20a for the player as shown in FIG. This is an indication mark CS6 that requests the player to move in a straight line over time in the directions of arrows E and E, that is, to the right in the figure, while touching 20b on the touch panel 5. Similar to the case of FIG. 6, in the orchestra-directed game program GPR, the performance rhythm of the orchestra 17 and the tempo of each part are indicated, and articulations such as slur (slur: smooth) It is also used when instructing the connection of sounds with various strengths and expressions. 6 and 7 is set in the orchestra command game program GPR so as not to overlap.

    In FIG. 8, as another example of the instruction mark CS, a plurality of semicircles (upward in the case of FIG. 8) extending in the direction of arrow A, that is, the length L8 in the time direction, This shows an indication mark CS7 composed of icons 19D in a connected shape. As shown in FIG. 10, the instruction mark CS7 is displayed to the player while the icon 19D passes the reference line SL (time corresponding to the time direction of the icon 19D, ie, the length L8 in the horizontal direction of the performance image PC). On the other hand, in the state where the finger 20 is touched on the touch panel 5, as shown by the arrow F, a plurality of upward semicircles are drawn on the right side of the figure in the same pattern as the icon 19D (see FIG. 8). In the case of the indication mark CS7 which requests the player to move with time (in the form of drawing a semicircle five times). In the orchestra command game program GPR, this is used when the performance rhythm of the orchestra 17 and the tempo of each part are instructed.

    In FIG. 9, as another example of the instruction sign CS, the same direction is displayed in the direction of arrow A which is the moving direction of the icon, that is, the lengths L9 and L10 in the time direction and overlapped in the vertical direction in the figure. As the pair of icons 19D and 16D of the length goes to the right in the figure, the distance L11 between each other becomes shorter, and the indicator sign CS8 (indicator sign CS on the left in the figure) that is deflated, Each of the pair of icons 19D, 16D is shown as an indicator mark CS9 (indicator mark CS on the right side in the figure) that is widened with the distance L11 between each other increasing in the right direction in the figure.

    For example, in the case of the indicator sign CS8 on the left side in FIG. 9, this indicator mark CS is displayed while the icons 19D and 19D constituting each indicator mark CS pass through the reference line SL (the pair of icons 19D and 19D In the time direction, that is, the time corresponding to the length L9 in the horizontal direction of the performance image PC), as shown in FIG. 11, the two fingers 20a and 20b are touched on the touch panel 5 with the arrow, as shown in FIG. As shown by G, in the same pattern as the icons 19D, 19D, the player is made to move with time in a pattern with a leading edge, in which the distance L12 between each other becomes shorter toward the right in the figure. The requested indicator CS8.

    In the case of the indicator sign CS9 on the right side in FIG. 9, the icons 19D and 19D constituting the indicator sign CS9 pass through the reference line SL (the time direction of the pair of icons 19D and 19D, that is, the performance image PC 11), as shown by an arrow H in a state where two fingers 20a and 20b are touched on the touch panel 5 with respect to the player as shown in FIG. This is an instruction mark CS9 that requests the player to move with time in a pattern that spreads forward in a pattern similar to 19D and 19D, with the distance L12 between each other increasing in the right direction in the figure.

    In the orchestra commanding game program GPR, these instruction indicators CS indicate, for example, the sound intensity of the entire orchestra 17 or a specific part. Used when instructing crescendo (step by step).

    In the orchestra command game program GPR, the meanings indicated by the instruction signs CS can be arbitrarily set, but are preferably set to be as similar as possible to the actual command operation. In addition to the above-described instruction mark CS, various instruction marks CS can be set according to the actual command operation.

    In this way, as shown in FIG. 13, the instruction mark set SET in which various instruction signs CS are set has a form in which each instruction mark CS corresponds to the music reproduced by the music reproduction control unit 9, that is, music data DATA. It is set for each song in time synchronization. Thereby, when the music data DATA is reproduced by the music reproduction control unit 9, the instruction sign display control unit 11 corresponds to the music data DATA being reproduced in synchronization with the reproduction operation based on the instruction sign set SET. The set instruction signs CS are sequentially displayed on the display 6. For example, as shown in FIG. 2, this display is displayed in the form of moving in the direction of arrow A from the left end of the time axis TX of the time scale image TS of the performance image PC of the display 6. When the reference line SL is reached, the music reproduction control unit 9 and the instruction sign display control unit 11 perform the orchestra command game so that the part of the music data DATA corresponding to the instruction sign CS is reproduced from the sound reproduction device 8. Control based on the program GPR.

    Thus, the music data DATA is reproduced from the sound reproducing device 8, and at the same time, the performance image PC of the music corresponding to the music data DATA by the orchestra member 16 is displayed on the display 6 based on the orchestra command game program GPR. The display 6 is displayed as if the orchestra member 16 is playing a musical piece.

    In this state, the player visually confirms a large number of instruction signs CS displayed in a form of moving at a constant speed, for example, in the direction of arrow A in FIG. Corresponding “swing” is input over time via the touch panel 5 according to the pattern shown. This “swing” of the player corresponds to an operation of conducting an orchestra that plays the music being played from the sound playback device 8 when the instruction sign CS passes the reference line SL. In addition, as already described, each instruction mark CS indicates the “swing” of the standard command conducted by the conductor over time according to the orchestra command game program GPR. Therefore, the player performs “swing” indicated by each indication mark CS on the reference line SL of the time scale image TS on the display 6 via the touch panel 5 as shown in FIG. 10 and FIG. A sense of presence as if the orchestra 17 displayed on the performance image PC is commanded by inputting (touching operation) over time in such a manner that the finger touches the touch panel 5 at the timing when each indication mark CS passes. Can be tasted.

    In this way, when the player inputs a time-dependent “shake” corresponding to the indication sign CS by touching the finger 20, 20 a, 20 b on the touch panel 5, an input signal SG corresponding to the touch operation is touched from the touch panel 5. It is output to the aspect analysis unit 10. The main control unit 2 enters step S3 of the touch mode analysis program TSA, analyzes the input signal SG with respect to the touch mode analysis unit 10, and performs "" as a conductor input by the player via the touch panel 5. Command to analyze what the “shake” is. The touch mode analysis unit 10 reads the determination table TBL stored as a part of the data of the orchestra-directed game program GPR from the game program memory 7 and performs an analysis operation on the “swing” input by the player based on the determination table TBL. To do.

    That is, as shown in FIG. 14, the determination table TBL stores contents to be analyzed by the touch mode analysis unit 10 for each indication sign CS. For example, items for measuring the timing and time of finger touch are stored. The columns of the indicated measurement time MT, the index NF indicating the number of fingers to be touched, the number of touches NB on the touch panel NB, and the input pattern determination DI indicating whether or not to determine the movement pattern of the finger on the touch panel 5 are provided. ing. It is possible to add appropriate measurement items and determination items as necessary. For example, with respect to the instruction mark CS1, the finger touch (timing T0 indicating progress or progress of the finger touch with respect to the touch panel 5 with respect to the point in time when the instruction mark CS1 reaches the reference line SL, and the finger touch corresponding to each icon 19 ( The touch time length T1 of the finger 20 (corresponding to the time required for the icon 19 to pass the reference line SL) and the finger 20 is touched (tapped) to the next icon 19 away from the touch panel 5. Touch interval T2 (corresponding to the interval L in FIG. 2), the total touch time T3 from the first touch corresponding to the first icon 19 to the last touch corresponding to the fifth icon 19 (interval L12 in FIG. 2). Etc.) are stored in the column of the measurement time MT. Furthermore, in the indication mark CS1, “1” is stored in the field of the index NF, and it is defined that the indication mark CS1 is touched with one finger. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination field is “0”, and it is defined that the determination of the movement pattern of the player's finger is not required for the instruction mark CS1.

    With respect to the instruction mark CS2 shown in FIG. 3, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 of the player and the advance based on the time when the instruction mark CS2 reaches the reference line SL, a pair of icons 19, The touch time length T1 (corresponding to the time required for the pair of icons 19 and 19 to pass through the reference line SL) and the fingers 20a and 20b are touch panels. Touch interval T2 (corresponding to the interval L in FIG. 3) until touching (tapping) the next pair of icons 19 and 19 apart from 5, the first corresponding to the first pair of icons 19 and 19 Measurement is performed so as to measure the total touch time T3 (corresponding to the interval L13 in FIG. 2) from the first touch to the last touch corresponding to the fourth pair of icons 19, 19. It is stored in the column between MT. Furthermore, in the indication mark CS2, “2” is stored in the field of the index NF, and it is defined that the indication mark CS2 is touched with two fingers. Further, the number of touches NB is “−”, and the number of touches is not defined. Furthermore, the input pattern determination column is “0”, and it is defined that the determination of the movement pattern of the finger of the player is not necessary for the instruction mark CS2.

    With respect to the instruction mark CS3 shown in FIG. 4, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 by the player and the time interval T4 (tap between taps) with respect to the time when the instruction mark CS3 reaches the reference line SL. Etc.) corresponding to the interval between the dots 21 in FIG. 4 and the like are stored in the column of the measurement time MT. Further, in the indication mark CS3, “1” is stored in the field of the index NF, and it is defined that the indication mark CS3 is touched with one finger. Further, for example, the number of touches NB column is “11”, and “11” is the number of touches indicating the number of times that the player should touch the touch panel 5 while the indication mark CS passes the reference line SL. It is prescribed. Further, the input pattern determination column is “0”, and it is defined that the determination of the movement pattern of the player's finger is not required for the instruction mark CS3.

    For the indication mark CS4 shown in FIG. 5, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 of the player and the progress based on the time when the leading icon 19 of the indication sign CS4 reaches the reference line SL, the finger 20 Touch time length T1 (corresponding to the time required for the pair of icons 19, 19 connected by the arrow 22 to pass the reference line SL, and thus the distance L3, L4 in the moving direction of the pair of icons 19, 19) Measured) so as to measure the touch interval T2 (corresponding to the interval L1 in FIG. 5) until the finger 20 moves away from the touch panel 5 and is touched (tapped) with the next set of icons 19 and 19. It is stored in the time MT column. Further, in the indication mark CS4, “1” is stored in the field of the index NF, and it is defined that the indication mark CS4 is touched with one finger. Further, the number of touches NB is “−”, and the number of touches is not defined. Furthermore, the input pattern determination column is “1”, and it is defined that the indication marker CS4 is to determine the contact movement mode of the player's finger 20 on the touch panel 5, that is, the finger movement pattern. Yes.

    The movement pattern of the instruction mark CS4 is determined as shown by an arrow C in FIG. 10 while the player's finger 20 is on the touch panel 5 while the first icon 19B having the length L3 passes the reference line SL. Then, a pattern determination is made as to whether or not an arc is drawn from left to right in a swelled downward shape. Further, while the next icon 19B ′ passes through the reference line SL, an arrow B in FIG. As shown, pattern determination is performed as to whether an arc is drawn from right to left in a bulging downward shape.

    For the instruction mark CS5 shown in FIG. 6, the finger touch corresponding to the timing T0 and the icon 19c indicating delay or advance of the finger touch on the touch panel 5 of the player, based on the time when the instruction mark CS5 reaches the reference line SL. The touch time length T1 of the finger 20 at the time (the time required for the icon 19c to pass through the reference line SL, and thus corresponding to the length L5, L6, L7, etc. in the moving direction of the icon 19c) is measured. It is stored in the column of measurement time MT. Further, in the indication mark CS5, “1” is stored in the field of the index NF, and it is defined that the indication mark CS5 is touched with one finger. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination column is “1”, and it is specified that the finger movement pattern of the player is determined for the instruction mark CS5.

    As shown by an arrow D in FIG. 10, the movement of the instruction mark CS5 is determined by the player's one finger 20 on the touch panel 5 and the instruction mark CS5 including the icon 19c passing through the reference line SL. In the meantime, as shown by an arrow D in FIG. 10, a pattern determination is made as to whether or not the line is moving from left to right.

    With respect to the instruction mark CS6 shown in FIG. 7, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 by the player with respect to the time point when the instruction mark CS6 reaches the reference line SL, and a pair of icons 19c, 19c The touch time length T1 of the fingers 20a and 20b when touching the finger corresponding to (the time required for the pair of icons 19c and 19c to pass the reference line SL, and thus the length of the pair of icons 19c and 19c in the moving direction) Are stored in the column of the measurement time MT so as to be measured. Further, in the indication mark CS6, “2” is stored in the field of the index NF, and it is defined that the indication mark CS6 is touched with two fingers. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination column is “1”, and it is specified that the finger movement pattern of the player is determined for the instruction mark CS6.

    The determination of the movement pattern of the instruction mark CS6 is based on the instruction mark CS6 including a pair of icons 19c and 19c on the touch panel 5 when the two fingers 20a and 20b of the player are on the touch panel 5, as shown by an arrow D in FIG. While passing through the line SL, as shown by the two arrows E in FIG. 11, it is determined whether the pattern is moving linearly from the left to the right.

    With respect to the indication mark CS7 shown in FIG. 8, the finger touch corresponding to the timing T0 and the icon 19c indicating the delay or advance of the finger touch on the touch panel 5 of the player, based on the time when the indication mark CS7 reaches the reference line SL. The touch time length T1 of the finger 20 at the time of measurement (the time required for the icon 19D to pass the reference line SL, and thus corresponding to the length L8 in the moving direction of the icon 19D, etc.) is measured. Stored in the column. Furthermore, in the indication mark CS7, “1” is stored in the field of the index NF, and it is specified that the indication mark CS7 is touched with one finger. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination column is “1”, and it is specified that the finger movement pattern of the player is determined for the instruction mark CS7.

As shown by an arrow F in FIG. 10, the movement of the instruction sign CS7 is determined by the player's one finger 20 on the touch panel 5 and the instruction sign CS7 including the icon 19D passing through the reference line SL. In between, as shown by arrow F in FIG. 10, a plurality of semi-circles that protrude upward from the left to the right, as many as the icons 19D (5 in the case of FIG. 8).
The pattern is judged as to whether it is moving in a drawn form.

    With respect to the instruction mark CS8 shown in FIG. 9, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 by the player with respect to the point in time when the instruction mark CS8 reaches the reference line SL, and a pair of icons 19D and 19D. The touch time length T1 of the fingers 20a and 20b when touching the finger corresponding to (the time required for the pair of icons 19D and 19D to pass the reference line SL, and thus the length of the pair of icons 19D and 19D in the moving direction) Is stored in the column of the measurement time MT so as to be measured. Further, in the indication mark CS8, “2” is stored in the field of the index NF, and it is specified that the indication mark CS8 is touched with two fingers. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination column is “1”, and it is specified that the finger movement pattern of the player is determined for the instruction mark CS8.

    The determination of the movement pattern of the instruction mark CS8 is based on the instruction mark CS8 including a pair of icons 19D and 19D on the touch panel 5 when the two fingers 20a and 20b of the player are on the touch panel 5, as shown by an arrow G in FIG. While passing through the line SL, as shown by the two arrows G in FIG. 11, a pattern determination is made as to whether or not the pattern is moving forward from left to right.

    Further, for the indication mark CS9 shown in FIG. 9, the timing T0 indicating the delay or advance of the finger touch on the touch panel 5 by the player with respect to the time point when the indication mark CS9 reaches the reference line SL, and a pair of icons 19D. , The touch time length T1 of the fingers 20a and 20b corresponding to the finger touch corresponding to 19D (the time required for the pair of icons 19D and 19D to pass the reference line SL, and thus the moving direction of the pair of icons 19D and 19D) Is stored in the column of measurement time MT so as to be measured. Furthermore, in the indication mark CS9, “2” is stored in the field of the index NF, and it is specified that the indication mark CS9 is touched with two fingers. Further, the number of touches NB is “−”, and the number of touches is not defined. Further, the input pattern determination column is “1”, and it is specified that the movement pattern of the player's finger is determined for the instruction mark CS9.

    The determination of the movement pattern of the instruction mark CS9 is based on the instruction mark CS9 consisting of a pair of icons 19D and 19D on the touch panel 5 when the two fingers 20a and 20b of the player are on the touch panel 5, as shown by an arrow H in FIG. While passing through the line SL, as shown by the two arrows H in FIG. 11, it is determined whether or not the pattern is moving forward from left to right.

    The determination of this pattern is to determine what two-dimensional figure the finger 20, 20a, 20b draws on the touch panel 5 (finger movement mode) in relation to the indicator mark CS. As the two-dimensional figure, an arc drawn in a predetermined direction (arrows B, C, etc.) shown in FIG. 5, a straight line moving in one direction shown in FIGS. 6 and 7, a plurality, one shown in FIG. There are various types depending on the indication sign CS, such as a semicircle that continues in the direction and a pair of straight lines that expand and contract in a predetermined direction as shown in FIG. Any figure can be used as a determination target. That is, the more the contents of the player instructing the orchestra by “swing”, the more types of corresponding indicator signs CS, and the more patterns to be determined.

    Note that the content to be analyzed by the touch mode analysis unit 10 shown in the determination table TBL of FIG. 14 is an example, and any item may be provided with any content as necessary. In the touch mode analysis unit 10, for each indication mark CS shown in the determination table TBL, the movement trajectory of the finger on the touch panel 5 input by the player via the touch panel 5, that is, “swing”, is determined in advance. Analyze and calculate based on the criteria.

    The analysis result analyzed by the touch mode analysis unit 10 is output to the input operation evaluation determination unit 12. The main control unit 2 enters step S4 of the touch mode analysis program TSA, and the input action evaluation determination unit 12 analyzes the input result of the player's “swing” (touch action pattern), that is, each instruction indicator. Based on the measurement analysis results of the measurement time MT, the index NF, the number of touches NB, and the input pattern determination DI for CS, compared with the determination criteria set in advance in the orchestra command game program GPR, Directs the numerical evaluation of the completeness / artisticity of the swing. As this evaluation method, various known methods such as a pattern matching method can be employed. For example, for the measurement times T0, T1, T2, T3, T4, etc., a standard time is stored in advance as a reference value for each indicator CS in the orchestra command game program GPR. Is evaluated quantitatively. As for the input pattern, the command elements over time such as the size, length, amplitude, number of touches, and number of vibrations of the input pattern are similarly compared with the reference values set and stored in the orchestra command game program GPR. Thus, the deviation from the reference value is quantitatively evaluated. The evaluation here is not necessarily the superiority or inferiority of the player's command, and the artistry of the player may be exhibited as a result.

    In particular, when determining the input pattern, the determination parameters such as the size, length, amplitude, number of touches, number of vibrations, etc. of the input pattern are simply deviated from the reference value. Instead of changing the state, various musical performance parameters such as the tempo, rhythm, strength, pause, and other various musical performance parameters from the sound reproduction device 8 are elapsed over time according to the amount of deviation from the reference value. By making it fluctuate | variate automatically, a player's original music expression is attained and an advanced play is attained.

    For example, in the case of the indication sign CS4 in FIG. 5, when the player moves the finger 20 in the arc shape in the directions of arrows C and B in FIG. 10 on the touch panel 5, and inputs “swing” corresponding to the indication sign CS4. In addition, the touch mode analysis unit 10 measures and calculates the amplitude “W1” of the player “swing” at predetermined sampling time intervals, and the input motion evaluation determination unit 12 stores the reference amplitude WS (a plurality of reference amplitudes). The reference amplitude value WS may be set as a reference value), and the tempo as the expression parameter of the music to be played at that time is gradually changed in several stages according to the size of the width W1 that changes every moment. It is also possible to control to change. Therefore, for example, when the player wants to advance (delay) the tempo of the currently played music in a short time, when the player inputs a “swing” corresponding to the instruction indicator CS4, By inputting a small (large) amplitude W1 during a short period of time, the input motion evaluation determination unit 12 can reproduce the music reproduced from the sound reproduction device 8 according to the amplitude W1 of the “swing” input by the player. The tempo of the player is synchronized with the time when the player inputs “swing”, and is controlled so as to be advanced or delayed in multiple steps over time and continuously. Since this control is performed in real time when the player inputs “swing” corresponding to the instruction sign CS4, the “swing” of the player is reflected in the playback mode of the music output from the sound playback device 8 without delay. Is done.

    Similarly, for example, when the player inputs “swing” corresponding to the instruction mark CS4, the moving speed of the finger in the direction of the arrow B or C is measured and calculated, and the moving speed is gradually decreased during the input. If it is, it is determined that ritardando as a performance parameter is instructed, and the playback speed of the music output from the sound playback device 8 is gradually decreased, and the moving speed is input. If the speed is gradually increased, it is determined that accelerando (accelerando) is instructed as a musical performance parameter, and the playback speed of the music output from the sound playback device 8 is gradually increased. It is also possible to control the speed so as to be early (slowly gradually with time). Such a point can be applied not only to the instruction mark CS4 but also to all the instruction marks CS that move the finger over time on the touch panel 5.

    In any case, the “swing” input by the player, that is, the temporal trajectory on the touch panel 5 is analyzed as a temporal pattern by the touch mode analysis unit 10 and the input motion evaluation determination unit 12, and the orchestra commanding game is previously performed. A sound reproducing apparatus that changes corresponding performance parameters (time-dependent performance parameters) set in the program GPR in multiple stages over time and in real time in accordance with the deviation from the reference value. By playing from 8, various music expressions are possible.

    At this time, the main control unit 2 uses the orchestra command game program GPR on the performance image PC to determine what the performance parameter changes over time by the “swing” that the player will input from now on the performance image PC. ”Or the like, and the player may be informed in advance of what will change due to“ swing ”that is input to the player. Thus, the player can input “swing” in the form of recognizing what is changed by “swing” input by the player, and the motivation for the game can be improved.

    Further, in the orchestra command game program GPR, when the instruction mark CS is set to give instructions to a specific orchestra part, for example, a specific instrument part such as the first violin or the second violin, the orchestra command The main control unit 2 displays the instruction destination such as “first violin” and “second violin” on the performance image PC by the game program GPR, and at the same time, the instruction content is also “slur” or the like. When displayed on the performance image PC, it is more convenient.

    The player's “swing” evaluated by the input motion evaluation determination unit 12 is output to the music reproduction control unit 9 as a result of the determination. Based on the determination result input to the music playback control unit 9 based on step S5 of the touch mode analysis program TSA, the main control unit 2 includes the performance image PC of the orchestra of the currently playing music. Then, the audio reproduction state is changed and an instruction is issued to output to the display 6 and the sound reproduction device 8. Various known methods can be used as to how the result of the evaluation determination by the input operation evaluation determination unit 12 is reflected in the image and sound output to the display 6 and the sound reproduction device 8.

    The input motion evaluation determination unit 12 compares the movement trajectory of the player's finger, that is, “swing”, not only with the time T0, T1, T2, T3, T4 but also with the pattern of the indicator mark CS with the reference value over time. Therefore, by defining the time-dependent playback elements of the music, such as the tempo, strength, and rhythm of the music, in each pattern of the indication signs CS, the input operation of “swing” input by the player Corresponding to the evaluation determination in real time by the evaluation determination unit 12, the music reproduction control unit 9 performs (reproduces) the reproduction mode in real time by reflecting the evaluation determination result. I can do it. As a result, it is possible to perform orchestra performance in a form that more accurately reflects the player's intention.

    In other words, by evaluating the movement trajectory of the player's finger as a pattern, the tempo of the music, changes in strength, changes in the rhythm, etc., such as changes in the tempo, changes in rhythm, etc. The player's will shown in “Swing” can be compared with the standard performance state of the playback element over time corresponding to the instruction indicator CS stored in the orchestra-directed game program GPR. In accordance with the difference, the standard performance state is changed and reproduced.

    Note that the time axis TX displayed in the time scale image TS, and thus the direction of movement of the indicator mark CS, is not limited to the horizontal direction that is the long display direction of the display 6 of FIG. The direction can also be set in an arbitrary direction such as obliquely.

2. Performance image display means (main control unit)
5 ... Touch panel 6 ... Display 7 ... Memory means (game program memory)
8: Sound reproduction device 9: Music reproduction means, music parameter fluctuation control means (music reproduction control unit)
10: Touch mode analysis means (touch mode analysis unit)
11. Time scale image display means (indicator sign display control unit)
17 …… Orchestra 19, 19A, 19B, 19B ′, 19C, 19D …… Icon CS …… Indicator PC …… Performance image SL …… Reference position (reference line)
TS …… Time scale image TX …… Time axis SET …… Indicator set

Claims (1)

A touch panel comprising a display, a sound generator, and a touch sensor;
Music playback means for playing back a predetermined music via the sound generator;
Memory means for storing an indication sign corresponding to a signal to be input by the user via the touch panel according to a change with time of a position indicated by the user on the surface of the touch panel;
An image including a reference position for indicating to the user when to input the signal via the touch panel is displayed on the display, and the indication sign read from the memory means is displayed on the image and read. Image display means for changing the relative positional relationship between the position of the indicator on the image and the position of the reference position on the image in synchronization with the reproduction of music by the music reproduction means;
Analysis means for analyzing a signal corresponding to a change over time of a position indicated by a user on the surface of the touch panel, which is input via the touch panel in accordance with a timing at which the relative positional relationship becomes a predetermined positional relationship; ,
An evaluation means for evaluating the deviation from the reference value by comparing the analysis result by the analysis means and the reference value corresponding to the indicator mark;
Music parameter changing means for changing the parameters of the music in real time based on the result of the evaluation means;
A game device having

Images