JP5941811B2 - Program, music output method and music output system - Google Patents

Description

  The present invention relates to a program, a music output method, and a music output system for acquiring music information from an external device and causing a computer to perform audio output based on the acquired music information.

In recent years, mobile terminals such as smartphones and tablet terminals have become widespread, and functions that can be executed on mobile terminals are being expanded by downloading various applications to mobile terminals via a network.
In Patent Document 1, a virtual musical instrument GUI (Graphical User Interface) is displayed on a portable terminal connected to the karaoke device, and a voice is played through a speaker connected to the karaoke device based on a performance operation performed via the virtual musical instrument GUI. Technology to output has been proposed. By using the technique disclosed in Patent Document 1, it is possible to enjoy playing musical instruments together with karaoke in a karaoke box.

JP 2011-138130 A

  In the technique disclosed in Patent Document 1, a drum, a guitar string, a piano keyboard, and the like are displayed as a GUI on a portable terminal, and sound is output based on a performance operation on the GUI. Therefore, when a user who cannot play each instrument performs a performance operation, an incorrect sound is output. Therefore, the technique disclosed in Patent Document 1 has a problem that only a user who can play each instrument to a certain degree can enjoy playing the instrument.

  The present invention has been made in view of such a problem, and an object of the present invention is to provide a program, a music output method, and a music output system that allow a user who cannot play a musical instrument to enjoy the musical instrument performance. Is to provide.

The program according to the present invention includes a step of acquiring, from a karaoke apparatus that performs audio output based on the music information related to the music, and music identification information acquired from the karaoke apparatus, An information acquisition step of acquiring the music information and the musical score information related to the musical instrument from an external device based on the musical instrument specifying information specifying the musical instrument used for the musical piece, and the voice output by the karaoke device from the karaoke device; Obtaining a synchronization signal for synchronizing timing; displaying a musical instrument screen for accepting a simulated performance operation for the musical instrument on a display device; receiving a simulated performance operation for the musical instrument via the instrument screen; The operation timing of the received pseudo performance operation is based on the score information. Judgment step for judging whether or not the timing coincides, and voice output based on the music information or the score information is performed or received based on the acquired synchronization signal in accordance with the judgment result in the judgment step And a sound output step for performing sound output based on the simulated performance operation.

Program according to the present invention, before Symbol audio output step, when it is determined that the match in the determining step, based on the acquired synchronization signal, have rows audio output based on the score information or pre Kiraku song information, the If it is determined not to match at decision step, an audio output based on the pseudo performance operation it received and said row Ukoto.

The program according to the present invention causes a computer to execute a mode reception step for accepting the setting of the first mode or the second mode, and in the sound output step, when the setting of the first mode is accepted, When it is determined that they do not match, audio output based on the music information or the music score information is not performed, and when the setting of the second mode is accepted, when it is determined that they do not match in the determination step, the music information Alternatively, voice output based on the score information is performed.
The program according to the present invention, in the display step, from the music information, extracts the code information to be used, includes information indicating the extracted code information, a display instrument screen for receiving pseudo performance operation for the instrument device and wherein and Turkey be displayed on.

The program according to the present invention includes a step of receiving, from the karaoke device, a tone or tempo change instruction related to a song based on the song information, and music information acquired from the external device according to the received change instruction. The step of changing the tone or tempo related to the musical score information and the step of performing sound output based on the musical score information or music information whose tone or tempo has been changed are executed.

The music output method according to the present invention is a step in which a communication device that communicates with an external device acquires music identification information for identifying music from a karaoke device that performs audio output based on the music information related to the music. Acquiring the music information and the musical score information related to the musical instrument from an external device based on the music identification information acquired from the karaoke apparatus and the musical instrument specifying information specifying the musical instrument used for the musical composition; and the karaoke A step of acquiring a synchronization signal for synchronizing the timing with the sound output from the karaoke device from a device, a display step of displaying a musical instrument screen for accepting a pseudo performance operation for the musical instrument on a display device, and via the musical instrument screen The step of receiving a pseudo performance operation for the musical instrument and the operation timing of the received pseudo performance operation include A determination step for determining whether or not the performance timing is based on the information, and an audio output based on the music information or the score information is performed based on the acquired synchronization signal according to the determination result in the determination step. Or a step of outputting sound based on the received pseudo performance operation.

Music output system according to the present invention includes a providing apparatus for providing the music information relating to music, the karaoke device及beauty easy song output unit for audio output based on the music information to which the providing device provides the karaoke device, when performing an identification information output unit for outputting the music identification information for identifying the music Previous Kiraku song output device, an audio output based on the music information, the synchronization signal for synchronizing the voice output and timing the and an output section for outputting Previous Kiraku song output device, before Kiraku music output device, based on the musical instrument specifying information for specifying the musical instruments used in the music identification information and the music acquired from the karaoke device An information acquisition unit that acquires music information related to the music and musical score information related to the musical instrument from the providing device, and a display that displays a musical instrument screen that accepts a pseudo performance operation on the musical instrument on the display device A reception unit that receives a pseudo performance operation on the musical instrument via the instrument screen; a determination unit that determines whether or not the operation timing of the received pseudo performance operation matches a performance timing based on the score information; Audio that performs audio output based on the music information or the music score information based on the synchronization signal acquired from the karaoke device or performs audio output based on the received pseudo performance operation according to a determination result by the determination unit And an output unit.

According to the present invention, the computer acquires the music information and the score information from the external device based on the music identification information and the musical instrument specifying information acquired from the karaoke apparatus. Therefore, it is possible to acquire from the karaoke device designation of music information and score information to be acquired from the external device. In addition, a computer that has acquired music information and score information from an external device performs voice output based on music information or score information based on a synchronization signal from a karaoke device that performs voice output based on the music information. Therefore, the computer can output a sound corresponding to the musical instrument in synchronization with the sound output by the karaoke apparatus. In addition, the computer displays a musical instrument screen for accepting a pseudo performance operation for the musical instrument, and accepts the pseudo performance operation via the musical instrument screen. The computer determines whether or not the operation timing of the received pseudo performance operation matches the performance timing based on the score information, and depending on the determination result, the sound output based on the score information or the sound based on the pseudo performance operation Output. Therefore, it is possible to output sound according to whether or not the pseudo performance is appropriate.

According to the present invention, when the operation timing of the received pseudo performance operation matches the performance timing based on the score information, the computer performs audio output based on the score information or the music information based on the synchronization signal from the karaoke device. If they do not match, sound output based on the pseudo performance operation is performed. Therefore, if the operation timing of the pseudo performance is appropriate, it is possible to output a sound that matches the sound (music) being output by the karaoke apparatus. Further, when the pseudo performance is not appropriate, it is possible to notify the performer (user) that the performance is not appropriate.

According to the present invention, the computer accepts the setting of the first mode or the second mode. When the operation timing of the pseudo performance does not coincide with the performance timing based on the score information, if the first mode is set, the computer does not perform audio output based on the music information or the score information, and the second mode is set. Then, audio output based on music information or score information is performed. Therefore, according to the set mode, it is possible to switch between the case where the sound output matching the sound (music piece) being output by the karaoke apparatus and the case where the sound output is not performed.
Further, according to the present invention, the computer displays a musical instrument screen including chord information used in music. Since the chord information is displayed as the instrument screen, the instrument can be played easily.

According to the present invention, when the computer receives an instruction to change the tone or tempo related to the music being output from the karaoke device, the computer changes the tone or tempo related to the music information and the score information according to the received change instruction. Then, the computer performs audio output based on the changed musical score information or the changed music information. Therefore, it is possible to reflect the contents instructed to change by the karaoke apparatus in the musical score information and music information output by the computer.

In the present invention, even when a user who cannot play a musical instrument operates the computer, the computer outputs sound corresponding to the musical instrument in synchronization with the sound output of the music by the karaoke apparatus. Therefore, even a user who cannot play a musical instrument can enjoy the feeling of playing a musical instrument and enjoy playing a musical instrument.

It is a schematic diagram which shows the structural example of the karaoke delivery system which concerns on Embodiment 1. FIG. It is a block diagram which shows the internal structural example of a commander apparatus and an input device. It is a schematic diagram which shows the structural example of a reservation music table. It is a block diagram which shows the example of an internal structure of a server apparatus. It is a schematic diagram which shows the structural example of music DB, registration user DB, and a login information table. It is a block diagram which shows the internal structural example of a portable terminal. It is a flowchart which shows the procedure of the login process in a karaoke delivery system. It is a flowchart which shows the procedure of the login process in a karaoke delivery system. It is a flowchart which shows the procedure of the karaoke reservation process from a portable terminal. It is a flowchart which shows the procedure of the process which concerns on karaoke. It is a flowchart which shows the procedure of the audio | voice output process by a portable terminal. It is a schematic diagram which shows the example of a display screen of a portable terminal. It is a flowchart which shows the procedure of the audio | voice output process by a portable terminal. It is a schematic diagram which shows the example of a display screen in intermediate mode. It is a flowchart which shows the procedure of the logout process performed from a portable terminal. It is a flowchart which shows the procedure of the logout process performed from a commander apparatus. It is a flowchart which shows the procedure of the process which concerns on the karaoke of this Embodiment 2. It is a flowchart which shows the procedure of the process which concerns on the karaoke of this Embodiment 2. It is a flowchart which shows the procedure of the process which concerns on the karaoke of this Embodiment 3.

  Below, the program concerning this invention, the music output method, and a music output system are explained in full detail based on drawing which shows the karaoke delivery system which is the embodiment.

(Embodiment 1)
FIG. 1 is a schematic diagram illustrating a configuration example of a karaoke distribution system according to the first embodiment. The karaoke distribution system of the first embodiment includes a commander device (karaoke device) 2 installed in a karaoke store, a server device 1 managed by a karaoke distribution company, a mobile terminal 4 of a user who uses the karaoke store, and the like. Is connectable to a network N such as the Internet.
In response to a request from the commander device 2 or the portable terminal 4, the server device 1 transmits the music information related to the music used for karaoke via the network N to the commander device 2 (output device, first music output device) and the portable terminal. 4 (second music output device). Note that the music information is, for example, MIDI (Musical Instrument Digital Interface) data, and accompaniment information of all musical instruments used in the music, tempo, tone, strength (velocity), chord constituent sound, lyrics, Includes timing information. In the karaoke distribution system of the first embodiment, the server device 1 provides the portable terminal 4 with the musical score information related to the musical instrument used for each piece of music in response to a request from the portable terminal 4. The musical score information is prepared for each musical instrument, and includes the chord score, rhythm score, lyrics, timing information, and the like of each musical instrument. In the first embodiment, the score information is described as information different from the music information, but the score information may be provided as part of the music information. In this case, musical score information is included in the music information provided from the server device 1 to the commander device 2 and the portable terminal 4.

The mobile terminal 4 is a communication device provided with a touch panel 43 (see FIG. 6), and is, for example, a smartphone, a mobile phone, a tablet terminal, or the like.
In the karaoke store, in addition to the commander device 2, an input device 3, a monitor device 6, a speaker 7, a microphone 8, and the like for inputting to the commander device 2 are installed. In the first embodiment, the input device 3 performs wireless communication with the commander device 2, and the monitor device 6, the speaker 7, and the microphone 8 are each connected to the commander device 2 via the relay device 5.
In the first embodiment, the mobile terminal 4 can be connected to the relay device 5, and is configured to be able to output sound through the relay device 5 through the speaker 7.
In addition, although this Embodiment 1 demonstrates the structure provided with each apparatus which comprises a karaoke delivery system 1 each, you may provide multiple each apparatus.

  FIG. 2 is a block diagram illustrating an internal configuration example of the commander device 2 and the input device 3. The commander device 2 includes a control unit 20, a RAM (Random Access Memory) 21, a storage unit 22, a first communication unit 23, a second communication unit 24, a third communication unit 25, and the like. These units are connected to each other via a bus.

The control unit 20 is a CPU (Central Processing Unit), an MPU (Micro Processor Unit), or the like, and controls operations of the above-described hardware units connected through a bus. In addition, the control unit 20 executes a predetermined operation by reading a control program stored in advance in the storage unit 22 into the RAM 21 and sequentially executing the program.
The RAM 21 is an SRAM (Static RAM), a DRAM (Dynamic RAM), a flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 20.
The storage unit 22 is an HDD (Hard Disk Drive), a flash memory, or the like, and stores a control program executed by the control unit 20 and various data in advance. The storage unit 22 stores a reserved music table 22a. Further, the storage unit 22 also stores music information (MIDI data) downloaded from the server device 1.

FIG. 3 is a schematic diagram showing a configuration example of the reserved music table 22a. The reserved music table 22a stores information on the music reserved for karaoke via the input device 3 or the portable terminal 4 in the reserved order. The reserved song table 22a stores a song ID, song information, presence / absence of a musical instrument, instrument information, and the like in association with each reserved song. The contents stored in the reserved music table 22a are updated by the control unit 20 every time a new music is reserved or whenever a reserved music is downloaded from the server device 1. Note that the song ID column stores song identification information for identifying a song, and the song information column stores MIDI data downloaded from the server device 1. In the column of presence / absence of musical instrument, information indicating whether or not the musical instrument performance is instructed when karaoke reservation is made is stored. When instructed, “Yes” is stored, and when not instructed, “ “None” is stored. The instrument information column stores information indicating the instructed instrument when the instrument performance is instructed.
The reserved music table 22a is, for example, a first-in first-out table (queue), and is added to the tail when the information of the reserved music is registered, and is read from the head when the information is read.

The first communication unit 23 is an interface for connecting to the network N, and communicates with the server device 1 via the network N, for example.
The second communication unit 24 is an interface for connecting to the relay device 5 and performs communication with the relay device 5 connected via a predetermined signal line. The second communication unit 24 outputs screen information to the monitor device 6 and outputs audio information to the speaker 7 via the relay device 5 in accordance with an instruction from the control unit 20. Further, the second communication unit 24 acquires the voice information collected by the microphone 8 via the relay device 5.

The third communication unit 25 is a wireless local area network (LAN) module, an infrared communication module, a Bluetooth (registered trademark) module, or the like, and performs wireless communication with the input device 3.
Note that the second communication unit 24 may be configured to perform wireless communication with the relay device 5, and the third communication unit 25 is wired to the input device 3 via a predetermined signal line. It may be configured to communicate.

The input device 3 includes a control unit 30, a RAM 31, a storage unit 32, a communication unit 33, a touch panel 34, and the like. These units are connected to each other via a bus.
The control unit 30 is a CPU, an MPU, or the like, and controls operations of the above-described hardware units connected via a bus. The control unit 30 executes a predetermined operation by reading out a control program stored in advance in the storage unit 32 to the RAM 31 and sequentially executing the program.

The RAM 31 is an SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 30.
The storage unit 32 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 30 and various data.

  The communication unit 33 is a communication unit similar to the third communication unit 25 of the commander device 2, and performs wireless communication with the commander device 2. If the third communication unit 25 of the commander device 2 is configured to perform wired communication via a predetermined signal line, the communication unit 33 also performs wired communication with the commander device 2 via the predetermined signal line. Configured to do.

The touch panel 34 includes an operation unit 34a and a display unit 34b.
The operation unit 34 a has various operation keys necessary for the user to operate the input device 3 and the commander device 2, receives information corresponding to the operation key operated by the user, and receives the received information to the control unit 30. Send it out. The control unit 30 executes various processes according to signals acquired from the operation unit 34a.
The display unit 34 b is a liquid crystal display, a plasma display, an organic EL (Electro Luminescence) display, or the like, and displays various information according to instructions from the control unit 30.

FIG. 4 is a block diagram illustrating an internal configuration example of the server apparatus 1. The server device 1 includes a control unit 10, a RAM 11, a storage unit 12, a communication unit 13, and the like. These units are connected to each other via a bus.
The control unit 10 is a CPU, an MPU, or the like, and controls the operation of each hardware unit connected via a bus. In addition, the control unit 10 executes a predetermined operation by reading a control program stored in advance in the storage unit 12 into the RAM 11 and sequentially executing the program.

The RAM 11 is SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 10.
The storage unit 12 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 10 and various data. The storage unit 12 stores a music database (hereinafter referred to as a music DB) 12a, a registered user database (hereinafter referred to as a registered user DB) 12b, and a login information table 12c. Details of the music DB 12a, the registered user DB 12b, and the login information table 12c will be described later.

The communication unit 13 is an interface for connecting to the network N, and communicates with the commander device 2 and the mobile terminal 4 via the network N, for example.
The server device 1 may include an operation unit and a display unit in addition to the above-described units. Thereby, for example, the contents of the music DB 12a stored in the storage unit 12 can be updated via the operation unit.

FIG. 5 is a schematic diagram illustrating a configuration example of the music DB 12a, the registered user DB 12b, and the login information table 12c. FIG. 5A illustrates the music DB 12a, FIG. 5B illustrates the registered user DB 12b, and FIG. 5C illustrates the login information table 12c. .
The music DB 12a stores information related to music provided (distributed) by the server device 1 to the commander device 2 and the mobile terminal 4 via the network N. The music DB 12a stores a music ID, music information (MIDI data), musical score information of the instrument used, and the like in association with each music. The content stored in the music DB 12a is updated by the control unit 10 each time a new music that can be distributed is added. Note that the musical score information column of the musical piece DB 12a stores musical score information for each instrument. In FIG. 5A, the piano musical score information is described as “piano information” and the guitar musical score information is described as “guitar information”. Yes.

The registered user DB 12b stores information on each user registered as a user in order to use the score information distribution service provided by the server device 1. The registered user DB 12b stores the user ID and password of each registered user in association with each other. The contents stored in the registered user DB 12b are updated by the control unit 10 each time a new user is registered.
The login information table 12c stores information on users (groups) who are currently using (logged in) the score information distribution service by the server device 1. The login information table 12c stores commander information, user ID, portable terminal information, and the like in association with each logged-in user (group). The stored content of the login information table 12 c is updated by the control unit 10 every time the user logs in through the commander device 2 and every time the user logs in through the mobile terminal 4. In the commander information column, information for specifying the commander device 2 that has logged in to the server device 1 is stored. For example, the IP (Internet Protocol) address of the commander device 2 is stored. In the user ID column, the user ID of the user who has logged in via the commander device 2 is stored. In the column of mobile terminal information, information for specifying the mobile terminal 4 that has logged in to the server device 1 is stored, for example, the IP address of the mobile terminal 4 is stored. In the first embodiment, after the commander device 2 first logs in to the server device 1, the mobile terminal 4 logs in using the same user ID and password.

FIG. 6 is a block diagram illustrating an internal configuration example of the mobile terminal 4. The portable terminal 4 includes a control unit 40, a RAM 41, a storage unit 42, a touch panel 43, a first communication unit 44, a second communication unit 45, and the like. These units are connected to each other via a bus.
The control unit 40 is a CPU, an MPU, or the like, and controls the operation of each hardware unit connected via a bus. In addition, the control unit 40 executes a predetermined operation by reading a control program stored in advance in the storage unit 42 to the RAM 41 and sequentially executing the program.
The RAM 41 is an SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 40.
The storage unit 42 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 40 and various data. For example, the storage unit 42 stores a musical instrument application (hereinafter referred to as a musical instrument application) that is a program according to the present invention, and when the control unit 40 executes the musical instrument application, use of a service provided by the server device 1 is used. Is possible. The musical instrument application is downloaded from a predetermined web server via the network N. The storage unit 42 also stores music information (MIDI data) and score information downloaded from the server device 1.

The touch panel 43 includes an operation unit 43a and a display unit 43b.
The operation unit 43 a has various operation keys necessary for the user to operate the mobile terminal 4, receives information corresponding to the operation key operated by the user, and sends the received information to the control unit 40.
The display unit 43b is a liquid crystal display, a plasma display, an organic EL display, or the like, and displays various types of information according to instructions from the control unit 40.

The first communication unit 44 is an interface for connecting to the network N, and communicates with the server device 1 via the network N, for example.
The second communication unit 45 is an interface for connecting to the relay device 5 and performs communication with the relay device 5 connected via a predetermined signal line. For example, the second communication unit 45 outputs audio information to the speaker 7 via the relay device 5 in accordance with an instruction from the control unit 40. In addition, the 2nd communication part 45 is connected to the earphone connection port provided in the portable terminal 4, for example, By connecting the other end side of the signal wire | line connected to the relay apparatus 5 to an earphone connection port, The second communication unit 45 can be connected to the relay device 5. The second communication unit 45 may be configured to perform wireless communication with the relay device 5.

  Below, the process which each apparatus which has the structure mentioned above performs in the karaoke delivery system of this Embodiment 1 is demonstrated. In the karaoke distribution system of the first embodiment, a user who wants to use the score information distribution service provided by the server device 1 performs user registration in advance and obtains a user ID and password. When using the karaoke distribution system (music score information distribution service), the user logs in to the server apparatus 1 from both the commander apparatus 2 and his / her own mobile terminal 4 in the karaoke store.

  7 and 8 are flowcharts showing the procedure of the login process in the karaoke distribution system. 7 shows processing performed by the input device 3 on the left side, processing performed by the commander device 2 in the center, processing performed by the server device 1 on the right side, and processing performed by the server measure 1 on the left side in FIG. And the processing performed by the mobile terminal 4 is shown on the right side.

A user who enters (enters) a karaoke store first operates the input device 3 and logs in to the server device 1 via the commander device 2. The input device 3 displays a login screen for logging in to the server device 1 on the touch panel 34 as an initial screen, and the user operates the touch panel 34 to input a user ID and a password.
The control unit 30 of the input device 3 receives the user ID and password via the touch panel 34 (S1), and transmits the received user ID and password from the communication unit 33 to the commander device 2 (S2).

The control unit 20 of the commander device 2 transmits the user ID and password received from the input device 3 and its identification information (IP address) from the first communication unit 23 to the server device 1 and requests login (S3). .
The control unit 10 of the server device 1 authenticates based on whether or not the user ID and password acquired from the commander device 2 are already stored in the registered user DB 12b (S4), and determines whether or not the authentication has been successful (S5). ). If the user ID and password acquired from the commander device 2 are not stored in the registered user DB 12b, the control unit 10 determines that authentication cannot be performed (S5: NO), and displays an error indicating that authentication cannot be performed (login failure) in the network N. Is notified to the commander device 2 (S6). The control unit 20 of the commander device 2 instructs the input device 3 to display an error indicating a login failure via the third communication unit 25 (S7), and the control unit 30 of the input device 3 gives an error to the touch panel 34. Display (S8), and the process ends. In this case, the user can try to log in again, or can use only the provision of music information without using the score information distribution service provided by the server device 1.

  The control unit 10 of the server device 1 determines that the authentication is successful when the user ID and password acquired from the commander device 2 are already stored in the registered user DB 12b (S5: YES). In this case, the control unit 10 registers the IP address (commander information) acquired from the commander device 2 in association with the user ID in the login information table 12c (S9). Then, the control unit 10 notifies the commander device 2 of the completion of login via the network N (S10). The control unit 20 of the commander device 2 instructs the input device 3 to display information indicating login completion via the third communication unit 25 (S11), and the control unit 30 of the input device 3 completes login to the touch panel 34. Is displayed (S12), and the process is terminated.

  When the login from the commander device 2 is successful with respect to the server device 1, the user logs in to the server device 1 via the mobile terminal 4. First, the user causes the control unit 40 of the mobile terminal 4 to execute the musical instrument application. Thereby, the portable terminal 4 displays a login screen for logging in to the server device 1 on the touch panel 43 as an initial screen of the musical instrument application, and the user operates the touch panel 43 to input a user ID and a password. Note that the user ID and password input at this time are the same as those used in the login process from the commander device 2.

The control unit 40 of the portable terminal 4 receives the user ID and password via the touch panel 43 (S21), and receives the received user ID and password and its identification information (IP address) from the first communication unit 44 to the server device 1. To request login (S22).
The control unit 10 of the server device 1 performs authentication based on whether or not the user ID and password acquired from the mobile terminal 4 are already stored in the registered user DB 12b (S23), and determines whether or not authentication has been performed (S24). ). When the user ID and password acquired from the portable terminal 4 are already stored in the registered user DB 12b, the control unit 10 determines that authentication has been successful (S24: YES), and this user ID is stored in the login information table 12c. It is determined whether or not there is (S25).

  When the user ID and password acquired from the portable terminal 4 are not stored in the registered user DB 12b, the control unit 10 determines that authentication cannot be performed (S24: NO). In this case, or when it is determined that the authenticated user ID is not stored in the login information table 12c (S25: NO), the control unit 10 generates an error indicating that the authentication cannot be performed (login failure) via the network N. To the portable terminal 4 (S26). The control unit 40 of the portable terminal 4 displays an error on the touch panel 43 (S27) and ends the process. In this case, the user can try to log in again or use the music information providing service by the server device 1 via the commander device 2.

When determining that the authenticated user ID is stored in the login information table 12c (S25: YES), the control unit 10 associates the user ID with the user ID stored in the login information table 12c from the portable terminal 4. The acquired IP address (mobile terminal information) is registered (S28). Thereby, the commander apparatus 2 and the portable terminal 4 which each user (group) uses can be matched.
Moreover, the control part 10 of the server apparatus 1 notifies the completion of login to the portable terminal 4 via the network N (S29), and the control part 40 of the portable terminal 4 displays information indicating the completion of login on the touch panel 43 (S30). ), The process is terminated. A plurality of portable terminals 4 can be associated with one commander device 2.

  Next, a process performed by each device when the user makes a karaoke reservation via the portable terminal 4 while logged in to the server apparatus 1 from the commander device 2 and the portable terminal 4 as described above. In addition, karaoke reservation is registering the song (music) which a user wants to sing.

  FIG. 9 is a flowchart showing the procedure of the karaoke reservation process from the portable terminal 4. In FIG. 9, the process performed by the commander device 2 on the left side, the process performed by the server device 1 on the center, and the process performed by the mobile terminal 4 are illustrated on the right side.

The mobile terminal 4 that is executing the musical instrument app displays a reception screen for karaoke reservation on the touch panel 43 when the login to the server device 1 is successful. The user operates the touch panel 43 to select a music piece to be reserved via the reception screen. When the user wants to play a musical instrument on the selected music piece, the user selects (specifies) the musical instrument to be played. Note that the selection of the instrument is not essential.
The control unit 40 of the portable terminal 4 receives the music and musical instrument selected by the user via the touch panel 43 (S41), and requests the server apparatus 1 for music information of the selected music (S42). Specifically, the control unit 40 transmits the music ID (music identification information) of the selected music and the musical instrument information (musical instrument specifying information) indicating the selected musical instrument to the server device 1 via the network N.

The control part 10 of the server apparatus 1 reads the music information and score information according to the request | requirement from the portable terminal 4 from music DB12a (S43). Specifically, the control unit 10 reads out music information corresponding to the music ID acquired from the mobile terminal 4 and musical score information corresponding to the music information and indicated by the musical instrument information acquired from the mobile terminal 4. The control unit 10 transmits the read music information and score information to the portable terminal 4 via the network N (S44).
The control unit 40 of the portable terminal 4 downloads music information and score information from the server device 1 (external device) via the first communication unit (information acquisition unit) 44 (S45), and stores it in association with the music ID. Store in the unit 42, and the process ends. Note that the musical score information includes musical instrument information.

The control unit 10 of the server device 1 transmits the music information and the music ID transmitted to the mobile terminal 4 and the musical instrument information acquired from the mobile terminal 4 to the commander device 2 via the network N (S46).
The control unit 20 of the commander apparatus 2 downloads music information from the server apparatus 1 (S47), and reduces the volume (volume) of the musical instrument indicated by the musical instrument information acquired from the server apparatus 1 with respect to the downloaded music information. (S48). The control unit 20 stores the processed music information in the reserved music table 22a in association with the music ID and instrument information acquired from the server device 1 (S49), and ends the process. The control unit 20 stores “Yes” in the column of presence / absence of a musical instrument in the reserved music table 22a.

When the musical instrument information is not acquired from the server device 1, the control unit 20 of the commander device 2 stores the downloaded music information as it is in the reserved music table 22a in association with the music ID, and whether or not there is a musical instrument. Store “None” in the column.
In the processing described above, the server device 1 transmits the music information and the score information to the portable terminal 4, and transmits the music information to the commander device 2, and then performs a charging process according to the music information and the score information. Also good.

In the process described above, the commander device 2 performs a process of reducing the volume of the musical instrument that the user desires to play when downloading the music information from the server apparatus 1. The information may be output when the monitor device 6 and the speaker 7 output the information.
Karaoke reservations can be made not only from the portable terminal 4 but also through the commander device 2, but when performed through the commander device 2, only music can be selected and performance instruments cannot be specified. And Therefore, when a karaoke reservation is made via the commander device 2, the reserved tune table 22a stores the tune ID and tune information of the tune downloaded from the server device 1, and the “None” column shows “None”. Is stored.

  In addition, once the music information is downloaded from the server device 1 to the commander device 2, the music information is accumulated in the storage unit 22 of the commander device 2. Therefore, when the mobile terminal 4 requests the music information from the server device 1, the mobile terminal 4 checks whether the music information is already stored in the commander device 2. Also good. Note that the musical score information is stored only in the server apparatus 1, and therefore needs to be acquired from the server apparatus 1.

  Note that when performing a karaoke reservation through the commander device 2, a musical instrument may be designated. In this case, the commander device 2 sends the music ID and instrument information to the server device 1 to request the music information, and the server device 1 provides the music information to the commander device 2 and also provides the music information and the score information. This is provided to the mobile terminal 4 associated with the commander device 2.

  Next, karaoke reservation is performed as described above, music information is downloaded to the commander device 2, and processing related to karaoke performed by each device when the commander device 2 starts karaoke processing will be described. When the commander device 2 starts karaoke processing, it is assumed that music information and score information are downloaded to the mobile terminal 4. The karaoke process performed by the commander device 2 is a process necessary when performing karaoke. For example, a process of outputting sound to the speaker 7 based on music information, and displaying lyrics on the monitor device 6 based on music information. There is processing to do. The commander device 2 also performs processing for scoring the user's singing voice input via the microphone 8 based on the music information downloaded from the server device 1, processing for displaying the scoring result on the monitor device 6, and the like.

FIG. 10 is a flowchart showing a procedure of processing related to karaoke. In FIG. 10, the process performed by the commander device 2 is shown on the left side, and the process performed by the mobile terminal 4 is shown on the right side.
When starting the karaoke process, the control unit 20 of the commander device 2 reads the information of the music stored at the head of the reserved music table 22a (S51). Based on the read information, the control unit 20 determines whether or not there is a musical instrument designated by the user for this song (S52). Specifically, the control unit 20 determines whether or not the information indicating the presence / absence of the musical instrument is “present” in the read information. If it is determined that there is no musical instrument (S52: NO), the control unit 20 proceeds to step S55.

If it is determined that there is a musical instrument (S52: YES), the control unit (output unit) 20 outputs a synchronization signal for synchronizing the music output timing to the portable terminal 4 (S53), and controls the portable terminal 4 The unit 40 acquires the synchronization signal from the commander device 2 (S54). The synchronization signal includes the song ID read from the reserved song table 22a in step S51, and the control unit 40 of the portable terminal 4 uses the song ID included in the synchronization signal to output the next song. Can be grasped.
When the commander device 2 and the mobile terminal 4 are synchronized based on the synchronization signal, the control unit 20 of the commander device 2 starts outputting the music based on the music information read from the reserved music table 22a in step S51. (S55). On the other hand, the control unit 40 of the portable terminal 4 reads the score information corresponding to the music ID notified by the synchronization signal from the storage unit 42, and to the score touch panel (display device, display unit) 43 based on the read score information. Is started (S56).

The music output started by the control unit 20 of the commander device 2 in step S55 includes display of lyrics on the monitor device 6 based on the music information, sound output from the speaker 7 based on the music information, and the like.
The synchronization signal is transmitted / received using, for example, an audio watermark technique. In this case, the control unit 20 of the commander device 2 outputs a synchronization signal including the music ID from the speaker 7 as an inaudible audio watermark. The portable terminal 4 has a microphone (not shown), and the control unit 40 collects a voice watermark with the microphone, analyzes the obtained data, and acquires a synchronization signal. The audio watermark may be output before the music output by the commander device 2 is started, or may be output after being embedded in a few seconds (for example, the intro part of the music) after the music output is started.

  In addition to the audio watermark, the commander device 2 outputs a predetermined audio (for example, a click sound such as “click”) from the speaker 7 and the mobile terminal 4 collects the synchronization signal with the microphone. Thus, it may be transmitted and received. In addition to using audio output, the synchronization signal may be transmitted / received via the server device 1, the commander device 2 and the portable terminal 4 can perform wireless LAN communication, and an access point is installed in the karaoke room. Then, it may be directly transmitted / received via the access point. Further, if the mobile terminal 4 can be connected to the relay device 5 via, for example, a USB (Universal Serial Bus) cable, the commander device 2 and the mobile terminal 4 transmit and receive a synchronization signal via the relay device 5 and the USB cable. May be.

Further, the commander device 2 displays a predetermined video (for example, a video sequentially switched to a predetermined color, a video flashing at a predetermined timing) on the monitor device 6, and the mobile terminal 4 takes a picture with a camera (not shown), The obtained image data may be analyzed and acquired as a synchronization signal. In this case, the mobile terminal 4 has a camera.
Furthermore, without using the synchronization signal, the portable terminal 2 collects the music output from the commander device 2 with a microphone, analyzes the obtained data, and identifies the music being output and the output location (performance location). The score display and voice output may be performed based on the specific result. Also in this case, the music output by the commander device 2 and the score display by the portable terminal 4 can be synchronized.

  The control unit 20 of the commander device 2 determines whether or not the output of the music information started in step S55 is completed (S57). Specifically, when the music information is output to the end, or when the user operates the input device 3 (commander device 2) to instruct output stop while the music information is being output, the control unit 20 displays the music information. Is determined to have been output. When it is determined that the output of the music information has not ended (S57: NO), the control unit 20 continues to output the music information, and when it is determined that the output of the music information has ended (S57: YES), the operation It is determined whether or not termination is instructed (S58). When the user operates the input device 3 (commander device 2) to instruct the operation end of the commander device 2, the control unit 20 determines that the operation end has been instructed.

When it is determined that the operation end is not instructed (S58: NO), the control unit 20 returns the process to step S51 and reads the information of the music stored at the head of the reserved music table 22a (S51). That is, the music information of the next reserved music is read out, and the processes in and after step S52 are repeated based on the read information. When it is determined that the operation end has been instructed (S58: YES), the control unit 20 ends the above-described processing.
With the processing described above, the start timing of the music output by the commander device 2 and the score display by the portable terminal 4 can be synchronized. Further, when the commander device 2 outputs the synchronization signal including the current output position (performance position, location information) in the music information and the score information to the portable terminal 4 every predetermined time during the music output, the music by the commander device 2 It is possible to always synchronize the output and the score display by the portable terminal 4.

Based on the synchronization signal acquired from the commander device 2 as described above, the portable terminal 4 that starts displaying the score displays a musical instrument screen on the touch panel 43 that accepts a simulated performance operation of the musical instrument for the displayed score. And the portable terminal 4 receives the pseudo performance operation by the user via the musical instrument screen, and performs sound output (performance output) according to the received pseudo performance operation.
Below, the audio | voice output process which the portable terminal 4 performs is demonstrated. FIG. 11 is a flowchart showing a procedure of audio output processing by the mobile terminal 4, and FIG. 12 is a schematic diagram showing an example of a display screen of the mobile terminal 4.

When acquiring the synchronization signal from the commander device 2, the control unit 40 of the portable terminal 4 reads out the music information and the music score information corresponding to the music ID notified by the synchronization signal from the storage unit 42 to the RAM 41, and reads out the music score information. The display of the score based on is started (S61). Further, the control unit 40 of the portable terminal 4 displays a musical instrument screen that accepts a simulated performance operation of the musical instrument indicated by the musical instrument information on the touch panel 43 based on the musical instrument information included in the read musical score information (S62).
FIG. 12A shows an example of a piano instrument screen, and FIG. 12B shows an example of a guitar instrument screen.

As shown in FIG. 12, the display screen of the portable terminal 4 (touch panel 43) displays a musical score area R1 where a musical score is displayed, a type display area R2 where a musical instrument type is displayed, and a musical instrument screen which accepts a simulated performance of the musical instrument. It has a musical instrument region R3 and the like. In addition to this, the display screen of the portable terminal 4 includes a button for accepting a key (tone) change, and a room effect function for adding ambient (sound field effect) when outputting sound. Buttons for instructing are displayed.
In the score area R1, lyrics, score (code score, rhythm score), and the like are displayed based on the score information, and are sequentially scrolled (turned pages) as time passes. In addition, the instrument type displayed in the type display area R2 and the instrument screen displayed in the instrument area R3 are displayed in conjunction with each other, the piano keyboard is displayed as the piano instrument screen, and the guitar instrument screen is displayed as the guitar instrument screen. The guitar strings are displayed. The user can perform a pseudo performance on the musical instrument by operating the musical instrument screen. When a drum is selected as the musical instrument, a plurality of drums constituting the drum set are displayed on the drum instrument screen.

The control unit 40 of the portable terminal 4 determines whether or not a pseudo performance operation for the instrument screen is accepted via the touch panel 43 (S63). When it is determined that the simulated performance operation is not accepted (S63: NO), the control unit 40 proceeds to step S67. Note that when the pseudo performance operation is not performed, the control unit 40 only displays the score.
When it is determined that the simulated performance operation is received (S63: YES), the control unit 40 determines whether the received simulated performance operation is appropriate based on the score information (S64).
For example, when the operation timing of the received pseudo performance operation matches the performance timing based on the score information (the rhythm score included in the score information, timing information), the control unit 40 determines that the pseudo performance operation is appropriate. . If the operation timing and tone color (pitch) of the received pseudo performance operation match the performance based on the score information (the chord score, the rhythm score, and the timing information included in the score information), the control unit 40 performs the pseudo performance operation. Is determined to be appropriate.

If it is determined that the simulated performance operation is appropriate (S64: YES), the control unit 40 performs voice output based on the location (score information) corresponding to the received simulated performance operation in the score information (S65). . Specifically, the control unit 40 generates an output sound based on the code indicated by the score information (code information), and outputs the output sound from the second communication unit 45 to the speaker (voice output unit) 7 via the relay device 5. . For example, when the chord indicated by the score information is a C code, the control unit 40 generates a chord of do, mi, and so, and outputs it to the speaker 7 for sound output.
In addition, the control part 40 may perform the audio | voice output based on the music information corresponding to score information (location corresponding to the received pseudo performance operation) instead of score information. At this time, the control unit 40 extracts the music information of the musical instrument that is being subjected to the pseudo performance operation from the music information, and outputs the constituent sound included in the extracted music information to the speaker 7 to output the sound.

When it is determined that the simulated performance operation is not appropriate (S64: NO), the control unit 40 performs sound output based on the received simulated performance operation on the speaker 7 (S66). Here, the control unit 40 outputs a timbre corresponding to the operation location at a timing corresponding to the timing when the instrument screen is operated.
The control unit 40 of the mobile terminal 4 determines whether or not the music being output has ended (S67). If it is determined that the music has not ended (S67: NO), the process returns to step S63, and the pseudo performance is performed. Each time an operation is accepted, the processes in steps S64 to S66 are repeated. When it is determined that the music being output is finished (S67: YES), that is, when the output is performed up to the end of the music, the control unit 40 ends the above-described processing.

Through the processing described above, the user can perform a musical performance of the musical instrument using the portable terminal 4, and can enjoy the musical instrument performance when the user is not singing.
In the above-described processing, when the pseudo performance operation performed by the user is appropriate, the sound output (song) that matches the sound (song) being output by the commander device 2 is performed by performing sound output based on the score information or music information. Musical instrument performance). On the other hand, when the pseudo performance operation is not appropriate, by performing sound output based on the pseudo performance operation, the commander device 2 performs sound output (instrument performance) that does not match the sound (musical piece) being output, and the performance is not appropriate. This can be notified to the performer (user). When the pseudo performance operation is not appropriate, a predetermined sound (error sound) may be output instead of performing sound output based on the pseudo performance operation, or sound output may not be performed. Even in this case, the player can be notified that the performance is not appropriate.

By the way, some users (performers) are unfamiliar with musical instrument performance, but there are cases where the user wants to taste the atmosphere in which performance is being performed properly, or when the performance is not appropriate. Therefore, different processing may be performed according to the level of the performer.
Below, the modification of the audio | voice output process which the portable terminal 4 performs is demonstrated. Here, in the portable terminal 4 (musical instrument application), the beginner mode, the intermediate mode, and the advanced mode can be switched, and the portable terminal 4 performs processing according to the set mode.

FIG. 13 is a flowchart showing a procedure of audio output processing by the portable terminal 4, and FIG. 14 is a schematic diagram showing an example of a display screen in the intermediate mode. The process shown in FIG. 13 is a modification of the process shown in FIG. 11, and the same processes as those shown in FIG. In FIG. 13, the illustration of steps S61 and S62 in FIG. 11 is omitted.
When the control unit 40 of the portable terminal 4 performs the processing of steps S61 to S63 in FIG. 11 and determines that the pseudo performance operation has been received (S63: YES), the control unit 40 determines whether or not the elementary mode is set by the user. (S71). In steps S61 and S62 in FIG. 11, when the elementary mode and the advanced mode are set (selected), the display screen shown in FIG. 12 is displayed, and when the intermediate mode is set, it is shown in FIG. The display screen is displayed. However, the display screen is not limited to this. For example, when the beginner mode is set, the display screen shown in FIG. 14 may be displayed.

If it is determined that the elementary mode is set (S71: YES), the control unit 40 determines whether or not the operation timing of the received pseudo performance operation is appropriate based on the score information (S72). For example, the control unit 40 determines that the operation timing is appropriate when the operation timing of the pseudo performance operation coincides with the performance timing based on the score information (the rhythm score included in the score information, timing information).
When it is determined that the operation timing is appropriate (S72: YES), the control unit 40 performs audio output based on the location corresponding to the received pseudo performance operation in the score information (S73). Here, instead of the score information, sound output based on music information corresponding to the score information (location corresponding to the received pseudo performance operation) may be performed. When determining that the operation timing is not appropriate (S72: NO), the control unit 40 shifts the processing to step S67. That is, when the operation timing is not appropriate, no sound is output. When the operation timing is not appropriate, a predetermined sound (error sound) may be output to notify the player that the operation timing (performance timing) is not appropriate.

When it is determined that the elementary mode is not set (S71: NO), the control unit 40 determines whether or not the intermediate mode is set (S74). If it is determined that the intermediate mode is set (S74: YES), the control unit 40 determines whether or not the performance by the received pseudo performance operation is appropriate based on the score information (S75).
When the intermediate mode is set, a display screen as shown in FIG. 14 is displayed on the mobile terminal 4 (touch panel 43). Similar to the display screen shown in FIG. 12, the intermediate mode display screen has a score area R1 and a type display area R2, and displays a chord performance screen that accepts chords as a pseudo performance of the instrument instead of the instrument area R3. It has area | region R4. In the example shown in FIG. 14, all the chord information used in the music being output is displayed in a line at the top of the chord performance screen so that different voicing can be selected for each area below each chord information. It is configured. When the user operates each area below the chord information (touch operation, tracing operation, etc.), each chord and voicing is selected, and a pseudo performance can be performed on the instrument.

For example, the control unit 40 of the portable terminal 4 determines that the operation code and operation timing of the pseudo performance operation received via the chord performance screen shown in FIG. 14 is the score information (the chord score, the rhythm score, the timing information included in the score information). ), It is determined that the performance is appropriate.
Note that, for example, a button for switching such a mode is displayed on the display screen of the portable terminal 4, and the mode can be switched even when the music is being played by the user operating the button. it can. Further, when displaying the display screen shown in FIG. 14 on the touch panel 43, the control unit 40 of the portable terminal 4 extracts chord information used for this music from the score information downloaded from the server device 1.

  When it is determined that the simulated performance operation is appropriate (S75: YES), the control unit 40 performs voice output based on the location corresponding to the received simulated performance operation in the score information (S76). Here, voice output based on music information corresponding to the score information may be performed instead of the score information. If it is determined that the simulated performance operation is not appropriate (S75: NO), the control unit 40 proceeds to step S67. That is, if the pseudo performance operation is not appropriate, no sound is output. Also here, if the pseudo performance operation is not appropriate, a predetermined sound (error sound) may be output to notify the player that the operation timing (performance timing) is not appropriate.

  When it is determined that the intermediate mode is not set (S74: NO), that is, when the advanced mode is set, the control unit 40 performs sound output based on the received pseudo performance operation on the speaker 7 (S77). ). Specifically, the control unit 40 generates an output sound based on a chord played by the user and outputs the output sound to the speaker 7. Then, the control part 40 of the portable terminal 4 performs the process of step S67.

Through the processing described above, the user can enjoy playing the musical instrument in accordance with the level of progress in his musical instrument performance.
In addition to the processing described above, it is determined only whether or not a pseudo performance operation is performed during operation in the beginner mode, and if it is operated, sound output based on score information or music information is performed. Also good. In this case, even if the operation timing is not appropriate, voice output (musical instrument performance) that matches the output music from the commander device 2 can be performed, and the atmosphere of playing the musical instrument can be easily enjoyed. In the case of determining only whether or not a pseudo performance operation is being performed, not only an operation performed by the user on the musical instrument screen but also an operation in which the user shakes (vibrates) the mobile terminal 4 is accepted as the pseudo performance operation. You may do it. In this case, the user can play a musical instrument that matches the music output from the commander device 2 by simply shaking the mobile terminal 4, and can more easily enjoy the atmosphere of playing the musical instrument. In this case, the mobile terminal 4 includes a detection unit that detects vibration, such as a gyro sensor.

  Further, during operation in the intermediate mode, it may be determined whether or not the operation timing and tone color (operation code) of the pseudo performance operation are appropriate, and processing corresponding to each determination result may be performed. . For example, if the operation timing is appropriate but the operation code (tone color) is not appropriate, an inappropriate tone color corresponding to the operation code may be output at an appropriate timing based on the score information or the music information. If the operation code (tone) is appropriate but the operation timing is not appropriate, an appropriate tone (code) based on the score information or music information may be output at a timing according to the inappropriate operation timing. Good.

Further, in step S64 in FIG. 11 and in steps S72 and S75 in FIG. 13, the result of determining whether or not the pseudo performance operation is appropriate is used to score the pseudo performance operation, and the scoring results are sequentially displayed on the touch panel. You may display on 43 (for example, musical score area | region R1 in a display screen).
Further, in step S62 in FIG. 11, the control unit 40 of the mobile terminal 4 may display information on the touch panel 43 by adding information for assisting the pseudo performance operation by the user to the musical instrument screen based on the score information. For example, in the musical instrument screen shown in FIG. 12A, the gray keyboard indicates the keyboard to be played next. By adding such guide information to the musical instrument screen, the musical instrument performance can be performed more easily.

Next, logout processing in the karaoke distribution system will be described. The logout process can be performed from the commander device 2 and the portable terminal 4, but when performed from the portable terminal 4, only the portable terminal 4 logs out. On the other hand, when the commander device 2 is used, the commander device 2 and all the mobile terminals 4 associated with the commander device 2 log out.
FIG. 15 is a flowchart illustrating a procedure of logout processing performed from the mobile terminal 4. In FIG. 15, the process performed by the server device 1 is illustrated on the left side, and the process performed by the mobile terminal 4 is illustrated on the right side.

When the user of the portable terminal 4 wants to log out from the karaoke distribution system (server device 1), he / she operates the portable terminal 4 to instruct logout. When receiving a logout instruction via the touch panel 43 (S81), the control unit 40 of the portable terminal 4 transmits its own identification information (IP address) from the first communication unit 44 to the server device 1 to request logout. (S82).
The control unit 10 of the server device 1 deletes the identification information of the mobile terminal 4 that has requested logout from the mobile terminal information in the login information table 12c (S83), and notifies the mobile terminal 4 of the logout completion via the network N. (S84). The control unit 40 of the portable terminal 4 displays information indicating logout completion on the touch panel 43 (S85), and ends the process. Therefore, the mobile terminal 4 can log out one by one. For example, when karaoke is performed by a plurality of people, even if one of them stops karaoke, only the mobile terminal 4 of the person logs out, and other people can continue to log in.

FIG. 16 is a flowchart illustrating a procedure of logout processing performed from the commander device 2. In FIG. 16, the processing performed by the input device 3 is shown on the left side, the processing performed by the commander device 2 is shown in the center, and the processing performed by the server device 1 is shown on the right side.
A user who wants to end karaoke operates the input device 3 and instructs logout to the karaoke distribution system (server device 1). When receiving a logout instruction via the touch panel 34 (S91), the control unit 30 of the input device 3 requests logout from the communication unit 33 to the commander device 2 (S92). The control unit 20 of the commander device 2 transmits its own identification information (IP address) from the first communication unit 23 to the server device 1 and requests logout (S93).

When logout is requested from the commander device 2, the control unit 10 of the server device 1 deletes all information corresponding to the identification information (commander information) of the commander device 2 that has requested logout from the login information table 12c ( S94). Specifically, the control unit 10 deletes the identification information acquired from the commander device 2 and the user ID and portable terminal information corresponding to the identification information. The control unit 10 notifies the commander apparatus 2 of logout completion via the network N (S95).
The control unit 20 of the commander device 2 instructs the input device 3 to display information indicating logout completion via the third communication unit 25 (S96), and the control unit 30 of the input device 3 completes logout on the touch panel 34. Is displayed (S97), and the process is terminated. Therefore, when ending karaoke, all the mobile terminals 4 can be logged out collectively by logging out from the commander device 2. When the portable terminal 4 logged out by the logout process from the commander apparatus 2 accesses the server apparatus 1 next time, the server apparatus 1 is notified that the logout has been completed.

  As described above, in the karaoke distribution system of the first embodiment, not only karaoke based on music information distributed from the server apparatus 1 to the commander apparatus 2 but also musical instrument performance based on musical score information distributed to the mobile terminal 2 is enjoyed. be able to. In addition, by performing voice output (musical instrument performance) based on musical score information or music information on the mobile terminal 4, even a user who cannot perform a musical instrument can enjoy the atmosphere of playing the musical instrument.

  In the first embodiment, the server device 1 is configured to provide the same music information to the commander device 2 and the mobile terminal 4, but only the music information of the instrument designated by the user is provided to the mobile terminal 4. May be. In this case, the server apparatus 1 may store the music information for each instrument in the music DB 12a in advance, and read and provide the music information of the musical instrument designated by the user from the music DB 12a. Further, when providing the music information to the mobile terminal 4, the server device 1 extracts and provides the music information of the musical instrument designated by the user from the music information (information including the music information of all musical instruments). May be.

In the first embodiment, the mobile terminal 4 is configured to receive a pseudo performance operation by the user via the touch panel 43, but is not limited to such a configuration. For example, a configuration in which a pseudo performance operation is received by an input with a pointing device such as a mouse with respect to a musical instrument screen displayed on the display unit 43b of the mobile terminal 4 may be employed.
In the first embodiment, the musical score information displayed on the touch panel 43 by the mobile terminal 4 may be output to the monitor device 6 via the relay device 5 and displayed on the monitor device 6.
Further, the musical score information provided by the server device 1 to the portable terminal 4 is also provided to the commander device 2, and the musical instrument performance realized by the portable terminal 4 can be realized by the input device 3 connected to the commander device 2. Good.

  In the first embodiment, the mobile terminal 4 is configured to display the score based on the score information in synchronization with the synchronization signal from the commander device 2, but the score display is not necessarily performed. For example, the mobile terminal 4 may be configured to display a musical instrument screen or a chord performance screen in synchronization with a synchronization signal from the commander device 2 and to accept a pseudo performance operation by a user.

(Embodiment 2)
Below, the karaoke delivery system which concerns on Embodiment 2 is demonstrated. Since the karaoke distribution system of the second embodiment can be realized by the same configuration as the karaoke distribution system of the first embodiment, the same components are denoted by the same reference numerals and description thereof is omitted.

In the karaoke distribution system of the first embodiment, the karaoke reservation is made from the portable terminal 4 when the user wants to perform a musical instrument performance. Specifically, when the user makes a karaoke reservation via the portable terminal 4, the music information is provided from the server device 1 to the commander device 2 and the portable terminal 4, and the score information is provided to the portable terminal 4. The configuration was
On the other hand, in the karaoke distribution system of the second embodiment, the musical instrument performance is also possible for the music reserved for karaoke through the commander device 2. Specifically, when the user makes a karaoke reservation through the commander device 2, the commander device 2 notifies the portable terminal 4 of the song ID of the reserved song, and the portable terminal 4 displays the musical score information of this song. Is acquired from the server device 1. Thereby, it is possible to perform music output by the commander device 2 and musical score display and music output (musical instrument performance output) by the portable terminal 4 as in the first embodiment.

Below, in the karaoke delivery system of this Embodiment 2, when the commander apparatus 2 is performing the karaoke process, the process which each apparatus performs is demonstrated.
FIG. 17 is a flowchart showing a procedure of processing related to karaoke according to the second embodiment. In FIG. 17, the process performed by the commander device 2 is illustrated on the left side, the process performed by the portable terminal 4 is illustrated in the center, and the process performed by the server device 1 is illustrated on the right side.
The commander device 2 and the mobile terminal 4 of the second embodiment perform the following processing while performing the processing shown in FIG. 10, similarly to the commander device 2 and the mobile terminal 4 of the first embodiment.

  In the commander device 2 that is executing the karaoke process, the control unit 20 reads information on the music to be output next from the reserved music table 22a (S101). Specifically, the control unit 20 reads the music information stored at the head of the reserved music table 22a. Based on the read information, the control unit 20 determines whether or not there is a musical instrument for this music (next music) (S102). Specifically, the control unit 20 determines whether or not the information indicating the presence or absence of the musical instrument included in the read information is “present”. If it is determined that there is a musical instrument (S102: YES), the control unit 20 ends the process without doing anything. If there is a musical instrument, since the portable terminal 4 has already downloaded the musical score information and the music information from the server device 1, there is no processing to be performed here.

When it is determined that there is no musical instrument (S102: NO), the control unit 20 outputs the music ID of the next music read in step S101 to the mobile terminal 4 (S103), and the control unit 40 of the mobile terminal 4 The music ID output from the commander device 2 is acquired (S104). Note that the music ID of the next music may be transmitted / received using, for example, an audio watermark technique, or may be output in addition to the synchronization signal when the commander device 2 periodically outputs the synchronization signal. Good.
The control unit 40 of the portable terminal 4 determines whether or not a musical instrument performance is instructed by the user in advance (S105). For example, in the portable terminal 4 (musical instrument application), whether or not to perform a musical instrument performance during karaoke, or when performing a musical instrument performance, a musical instrument can be selected (set) in advance. Based on the above, it is determined whether or not the musical instrument performance is instructed in advance. When it is determined that the musical instrument performance is not instructed (S105: NO), the control unit 40 ends the process without performing anything.

When it is determined that the musical instrument performance is instructed (S105: YES), the control unit 40 obtains the musical piece ID acquired from the commander device 2 and the musical instrument information indicating the preset musical instrument via the network N. And request music information (S106).
The control unit 10 of the server device 1 reads music information and score information in response to a request from the mobile terminal 4 from the music DB 12a (S107), and transmits the music information and the music score information to the mobile terminal 4 via the network N (S108).
The control unit 40 of the portable terminal 4 downloads the music information and the score information from the server device 1 (S109), stores them in the storage unit 42 in association with the music ID, and ends the process.

On the other hand, the control unit 10 of the server device 1 transmits the music ID of the music information transmitted to the mobile terminal 4 and the musical instrument information acquired from the mobile terminal 4 to the commander device associated with the mobile terminal 4 via the network N. 2 (S110).
When the control unit 20 of the commander device 2 acquires the music ID and the musical instrument information from the server device 1, the musical instrument information acquired from the server device 1 with respect to the music information stored in the music DB 12 a in association with the music ID. Is performed to reduce the volume of the musical instrument indicated by (S111). The control unit 20 stores the processed music information in the reserved music table 22a again (S112), and ends the process. At this time, the control unit 20 stores “Yes” in the column of presence / absence of the corresponding musical instrument in the reserved music table 22a.

As described above, with respect to music for which karaoke reservation has been made from the commander device 2, the mobile terminal 4 can download music information and score information from the server device 1 by notifying the mobile terminal 4 of the music ID. . Therefore, it is possible to perform a musical instrument performance.
When the mobile terminal 4 requests the server apparatus 1 for music information (music information and score information), the mobile terminal 4 determines whether the music is reserved for karaoke via the own apparatus or is reserved for karaoke via the commander apparatus 2. Also, information indicating whether the music is a tune is transmitted to the server device 1. Thereby, the server apparatus 1 can determine whether music information should be provided to the commander apparatus 2 or only musical instrument information should be provided.

In the above-described processing, when a karaoke reservation is made via the commander device 2, musical instrument performance can be performed on all portable terminals 4 that have acquired the song ID of the next song from the commander device 2. In addition, when a karaoke reservation is made via the mobile terminal 4, the musical instrument can be played only on the mobile terminal 4.
In the karaoke distribution system according to the second embodiment, it is possible to perform a plurality of musical instruments (pseudo performance) using a plurality of portable terminals 4, so that karaoke reservation is performed via any one of the portable terminals 4. In this case, it is necessary to be able to play musical instruments on other portable terminals 4 as well.
Below, in the karaoke delivery system of this Embodiment 2, when the commander apparatus 2 is performing the karaoke process, the modification of the process which each apparatus performs is demonstrated.

  FIG. 18 is a flowchart showing a procedure of processing related to karaoke according to the second embodiment. The process shown in FIG. 18 is a modification of the process shown in FIG. 17, and the same process as the process shown in FIG. Also, in FIG. 18, the illustration of the processing after step S108 in FIG. 17 is omitted.

The control unit 20 of the commander device 2 performs the process of step S101 in FIG. And the control part 20 performs the process of step S103, without performing the process of step S102 in FIG. 17, and outputs music ID of the following music to the portable terminal 4 (S103).
The control unit 40 of the portable terminal 4 acquires the music ID output from the commander device 2 (S104), and determines whether or not music information corresponding to the acquired music ID has already been downloaded (S115). Specifically, the control unit 40 determines whether or not music information corresponding to the music ID is already stored in the storage unit 42.

When it is determined that the music information has already been downloaded (S115: YES), the control unit 40 of the mobile terminal 4 ends the process and when it is determined that the music information has not yet been downloaded (S115: NO). The process after step S105 in FIG. 17 is performed.
By the above-described processing, the mobile terminal 4 that has already downloaded the music information, that is, the mobile terminal 4 that has made the karaoke reservation, and the mobile terminal 4 that has not yet downloaded the music information, that is, the mobile phone that has not made the karaoke reservation. Musical instruments can be played with both terminals 4.

  In addition, about the music by which the karaoke reservation was performed via any portable terminal 4, the commander apparatus 2 was a musical instrument of the musical instrument designated by the portable terminal 4 which performed the karaoke reservation together with the music ID of the next music. Information may also be output to each portable terminal 4. And when each portable terminal 4 is comprised so that only the specification of musical instruments other than the instrument designated with the portable terminal 4 which performed karaoke reservation can be performed, the portable terminal 4 (user) which performed karaoke reservation, It is possible to avoid duplication of musical instruments to be played with other portable terminals 4 (users).

(Embodiment 3)
Below, the karaoke delivery system which concerns on Embodiment 3 is demonstrated. Since the karaoke distribution system of the third embodiment can be realized by the same configuration as the karaoke distribution system of the first embodiment, the same components are denoted by the same reference numerals and description thereof is omitted.

  The karaoke distribution system of the third embodiment has the same function as the karaoke distribution system of the first embodiment described above. Furthermore, the karaoke distribution system according to the third embodiment is configured so that the commander changes the key (tone) or tempo (speed) of the music through the commander device 2 during the output of the music by the commander device 2 and the portable terminal 4. Not only the music output by the apparatus 2 but also the music output by the portable terminal 4 and the score to be displayed further have a function of changing the key (tone) or tempo (speed).

Hereinafter, in the karaoke distribution system of the third embodiment, processing performed by each device when the key (tone) or tempo (speed) of the music is changed via the commander device 2 will be described.
FIG. 19 is a flowchart showing a procedure of processing related to karaoke according to the third embodiment. In FIG. 19, the process performed by the commander device 2 is shown on the left side, and the process performed by the mobile terminal 4 is shown on the right side.
The commander device 2 and the portable terminal 4 of the third embodiment perform the processing shown in FIG. 10 in the same manner as the commander device 2 and the portable terminal 4 of the first embodiment, and also the commander device of the second embodiment. The following processing is performed while performing the processing shown in FIG.

  In the commander device 2 that is executing the karaoke process, the control unit 20 determines whether or not an instruction to change the key or the tempo is given to the music being output (S121). The commander device 2 is provided with an operation button for changing the key of the music being output, an operation button for changing the tempo, etc., and the user is outputting by appropriately operating each operation button. The key and tempo can be instructed to change the song.

  When it is determined that the change is not instructed (S121: NO), the control unit 20 shifts the process to step S127. When it is determined that the change is instructed (S121: YES), the control unit 20 includes information indicating the changed key or tempo (key information, tempo information) in the synchronization signal, and outputs the synchronization signal to the portable terminal 4. (S122) The control unit 40 of the mobile terminal 4 acquires a synchronization signal from the commander device 2 (S123). As a result, the mobile terminal 4 can acquire the key or tempo information instructed to change via the commander device 2. Note that the music key information and tempo information may always be added to the synchronization signal periodically output by the commander device 2 or may be output only when a change instruction is given. Further, the changed key information and tempo information may be transmitted and received independently without adding to the synchronization signal, for example, using an audio watermark technique.

  In the commander device 2 that outputs a synchronization signal to which key information or tempo information of music is output, the control unit 20 performs a key or tempo change process on the currently output music information based on a change instruction ( S124). And the control part 20 continues a music output based on the changed music information. Further, the control unit 40 of the portable terminal 4 changes the currently output music information based on the key information or tempo information of the music notified by the synchronization signal (S125), and changes the currently displayed musical score information. (S126). And the control part 40 continues a music output based on the changed music information, and continues a score display based on the changed music score information.

The control unit 20 of the commander device 2 determines whether or not the output of the currently output music information has been completed (S127). If it is determined that the output has not ended (S127: NO), the control unit 20 returns the process to step S121, and repeats the processes of steps S122 to S127 each time a change instruction for the music being output is received. When it is determined that the output of the music information being output has ended (S127: YES), the control unit 20 ends the above-described processing.
By the above-described processing, when a key or tempo change instruction is given for the music currently being output, not only the key or tempo for the music output by the commander device 2 but also the music output by the portable terminal 4 and the display are displayed. You can also change the key or tempo for the score.

  The preferred embodiments of the present invention have been specifically described above. However, each configuration, operation, and the like can be changed as appropriate, and are not limited to the above-described embodiments.

1 Server device (providing device)
2 Commander device (output device, first music output device)
4 Mobile terminals (second music output device)
7 Speaker (Audio output unit)
20 Control unit (output unit)
43 Touch Panel 43b Display Unit 44 First Communication Unit (Information Acquisition Unit)

Claims (7)

On the computer,
Acquiring music identification information for identifying music from a karaoke device that performs audio output based on music information related to the music;
An information acquisition step of acquiring the music information and the musical score information related to the musical instrument from an external device based on the musical piece identification information acquired from the karaoke device and the musical instrument specifying information specifying the musical instrument used for the musical piece;
From the karaoke device, obtaining a synchronization signal for synchronizing the timing and the voice output by the karaoke device;
A display step of displaying a musical instrument screen for accepting a pseudo performance operation on the musical instrument on a display device;
Receiving a pseudo performance operation for the musical instrument via the musical instrument screen;
A determination step of determining whether or not the operation timing of the received pseudo performance operation matches the performance timing based on the score information;
A sound output step for performing sound output based on the music information or the score information based on the acquired synchronization signal or performing sound output based on the received pseudo performance operation according to the determination result in the determination step; A program characterized by having executed.   In the audio output step, if it is determined that they match in the determination step, sound output based on the score information or the music information is performed based on the acquired synchronization signal, and if it is determined that they do not match in the determination step The program according to claim 1, wherein audio output based on the simulated performance operation is performed. On the computer,
Executing a mode reception step for accepting the setting of the first mode or the second mode;
In the audio output step, when the setting of the first mode is accepted and it is determined in the determination step that they do not match, the audio output based on the music information or the score information is not performed, and the second mode 2. The program according to claim 1, wherein when the setting is accepted and the judgment step determines that they do not coincide with each other, audio output based on the music information or the score information is performed.   In the display step, chord information to be used is extracted from the musical score information, and a musical instrument screen that includes information indicating the extracted chord information and receives a pseudo performance operation on the musical instrument is displayed on a display device. Item 4. The program according to any one of Items 1 to 3. In the computer,
Receiving a tone or tempo change instruction relating to the music based on the music information from the karaoke device;
Changing the tone or tempo related to the music information and score information acquired from the external device according to the received change instruction;
The program according to any one of claims 1 to 4, further comprising: executing voice output based on musical score information or music information whose tone or tempo has been changed. A communication device that communicates with an external device
Acquiring music identification information for identifying music from a karaoke device that performs audio output based on music information related to the music;
Acquiring the music information and the musical score information relating to the musical instrument from an external device based on the musical piece identification information obtained from the karaoke device and the musical instrument specifying information identifying the musical instrument used for the musical piece;
From the karaoke device, obtaining a synchronization signal for synchronizing the timing and the voice output by the karaoke device;
A display step of displaying a musical instrument screen for accepting a pseudo performance operation on the musical instrument on a display device;
Receiving a pseudo performance operation for the musical instrument via the musical instrument screen;
A determination step of determining whether or not the operation timing of the received pseudo performance operation matches the performance timing based on the score information;
Performing sound output based on the music information or the score information based on the acquired synchronization signal according to the determination result in the determination step, or performing sound output based on the received pseudo performance operation. The music output method characterized by this. A providing device for providing music information related to the music;
A karaoke device及beauty easy song output unit for audio output based on the music information to which the providing device provides,
The karaoke device
An identification information output unit for outputting the music identification information for identifying Previous Kiraku song output unit music,
When performing voice output based on the music information, and an output unit for outputting a synchronization signal for synchronizing the voice output timing Previous Kiraku song output unit,
Before Kiraku song output device,
An information acquisition unit that acquires music information related to the music and music score information related to the musical instrument from the providing device based on the music identification information acquired from the karaoke device and the musical instrument specifying information specifying the musical instrument used for the music When,
A display unit for displaying a musical instrument screen for receiving a pseudo performance operation on the musical instrument on a display device;
A reception unit that receives a pseudo performance operation for the musical instrument via the musical instrument screen;
A determination unit that determines whether or not the operation timing of the received pseudo performance operation matches the performance timing based on the score information;
Audio that performs audio output based on the music information or the music score information based on the synchronization signal acquired from the karaoke device or performs audio output based on the received pseudo performance operation according to a determination result by the determination unit A music output system comprising an output unit.

Images