JP2008304821A - Musical piece concert release system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a musical piece concert release system capable of allowing even a user who cannot play a musical instrument to easily prepare a musical piece. <P>SOLUTION: The musical piece concert release system shown in Fig.1 includes a plurality of radio terminals 10 and a musical piece server 20. The musical piece server 20 extracts performance information and concert information from musical piece information on the basis of an instruction transmitted from a host terminal 10H. The radio terminal 10 instructs timing when performance operation information is to be input in synchronization with reproduction of accompaniment information for the user to play while utilizing the performance information. The radio terminal 10 records performance notes reproduced according to the input timing of the performance operation information on the basis of the input timing of the performance operation information. The recorded performance notes are stored as performance recording information and uploaded to the musical piece server 20. The musical piece server 20 merges the performance recording information recorded by each radio terminals 10, and creates combined musical piece information. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a music ensemble publishing system that enables even a user who cannot play an instrument to easily ensemble music and publish the tune that has been played.

  In recent years, a plurality of users residing in a remote place use a PC or a network to jointly produce music. For example, a user who can play a musical instrument plays a performance part of the musical instrument in charge. At this time, the user who plays the musical instrument records his / her performance and provides the recorded performance information to a remote user via the Internet or the like. Then, the user who has received the performance information performs a process such as mixing on a plurality of pieces of performance information to create music.

  Non-Patent Document 1 discloses a system capable of performing in real time a plurality of users playing musical instruments at remote locations using a P2P (peer-to-peer) connection.

  Non-Patent Document 2 discloses a system capable of playing music performed by a rock band, orchestra, or the like using a mobile phone. Specifically, a plurality of users gather at the same place, and each user performs a performance operation based on the displayed simple musical score using a mobile phone that has downloaded a simple musical score in which the musical score corresponding to the music is simplified. Do. Thereby, the user of a mobile phone can perform an ensemble of music in real time in real time.

  In addition, Non-Patent Document 3 discloses a system in which music played by a rock band or an orchestra can be played using a wireless terminal, as in the system disclosed in Non-Patent Document 2. In this system, the performance level can be set according to the performance capability of the user. In addition, a user of each wireless terminal can create an original score using the wireless terminal, and can also exchange a score created using the communication function of the wireless terminal between the users.

"WIRED VISION Co-star in real time with" home musicians "around the world", [Search May 29, 2007], Internet URL <http://wiredvision.jp/news/200705/2007051622.html> ““ Send Melody Project ”! [Search June 7, 2007], Internet URL <http://dwango.jp/sp/hassin/index.html?cp_webto=pctop> ““ Daigo! Band Brothers ”” [Search June 8, 2007], Internet URL <http://www.nintendo.co.jp/ds/abbj/>

  The system disclosed in Non-Patent Document 1 described above has a recording function for recording a user's performance in addition to a function for co-starring a plurality of users who play musical instruments in real time. A user who uses the system disclosed in Non-Patent Document 1 uses the recording function described above to record his / her performance as performance information, and a user who has received the recorded performance information includes the performance information. On the other hand, it is possible to create music by performing processing such as mixing.

  However, the system disclosed in Non-Patent Document 1 described above is assumed to be used by a plurality of users having musical instrument performance. For this reason, the user who does not have the performance capability of a musical instrument cannot use the system which said nonpatent literature 1 discloses. Therefore, there is a problem that it is very difficult for a user who does not have a musical instrument playing ability to create or perform music using the system disclosed in Non-Patent Document 1.

  In addition, as described above, the systems disclosed in Non-Patent Document 2 and Non-Patent Document 3 transmit a simple musical score to a mobile phone held by the user, and the user operates the mobile phone according to the simple musical score, This is a system that allows you to experience the ensemble of music in a pseudo manner. However, users who use the systems disclosed in Non-Patent Document 2 and Non-Patent Document 3 need to be gathered at the same place. In addition to the systems disclosed in Non-Patent Document 2 and Non-Patent Document 3, in addition to the systems disclosed in Non-Patent Document 2 and Non-Patent Document 3, a recording means for recording the ensemble music must be prepared separately. It was.

  Further, in the system disclosed in the above non-patent document, the performance part of the musical instrument to be played is determined in advance. Accordingly, when the number of participants in the ensemble is small, it is not possible to assign users to all performance parts. In addition, when there are too many people participating in the ensemble, there are too many users performing a specific performance part, and the balance of the performance parts at the time of the ensemble may be lost. As described above, in the system disclosed in the above-mentioned non-patent literature, there is a problem that it is difficult to change the performance part assignment according to the number of users participating in the ensemble.

  Thus, in view of the above problems, the present invention allows a user who cannot play a musical instrument to experience a musical ensemble in a pseudo manner while being at a remote place. It is an object of the present invention to provide a music ensemble publishing system capable of recording and publishing ensemble music.

  In order to solve the above-mentioned problem, the invention according to claim 1 is a music ensemble publishing system comprising one or more terminals and a server connected to the one or more terminals via a network. Notification means for notifying the user of the playback timing of the performance notes recorded in the performance information related to the performance part for which each terminal is in charge as performance operation timing, and playback of the performance notes at the timing when the performance operation information is input And recording means for recording the played musical notes as performance record information based on the timing at which the performance operation information is input, and the server is configured to record the performance information from music information stored in advance. Performance information setting means for extracting and setting in each terminal, composition means for synthesizing the performance recording information transmitted from each terminal and creating composite music information, Characterized in that it comprises.

  According to a second aspect of the present invention, in the music ensemble disclosure system according to the first aspect, the performance information setting means extracts the performance information from the music information according to the number of the one or more terminals. , Including.

  According to a third aspect of the present invention, in the music ensemble publishing system according to the first aspect, the performance information setting means extracts a predetermined number of performance information from the music information and determines the number of the one or more terminals. And setting means for setting the performance information in each terminal accordingly.

  According to a fourth aspect of the present invention, in the music ensemble publishing system according to any one of the first to third aspects, the notification means notifies the performance operation timing to each performance note. And

  According to a fifth aspect of the present invention, in the music ensemble publishing system according to any one of the first to third aspects, the notifying unit is a group of performance notes composed of a plurality of performance notes recorded continuously. When the performance operation information corresponding to the first performance note is input, the playback means notifies only the playback timing of the first performance note of the performance note group. It is characterized by continuously playing the musical notes.

  According to a sixth aspect of the present invention, in the music ensemble publishing system according to any one of the first to fifth aspects, the reproduction means includes means for reproducing accompaniment information relating to another performance part, and the notification. The means includes means for synchronizing the playback timing of the accompaniment information and the playback timing of the performance notes to notify the performance operation timing, and the recording means corresponds to the timing when the performance operation information is input The performance time information to be obtained is acquired based on the time information recorded in the accompaniment information, and the reproduced performance note and the performance time information are recorded in association with each other.

  The invention according to claim 7 is the music ensemble disclosure system according to claim 6, wherein the performance information setting means includes means for extracting the accompaniment information from the music information and setting the information in each terminal. The means uses time information recorded in the accompaniment information as reference time information for synthesizing the performance recording information transmitted from each terminal.

  According to an eighth aspect of the present invention, in the music ensemble publishing system according to any one of the first to seventh aspects, each terminal further includes voice input means for inputting voice, and the recording means Voice information input to the voice input means is recorded as the performance recording information.

  A ninth aspect of the present invention is the music concert release system according to any one of the first to eighth aspects, wherein the server distributes the synthesized music information through the Internet.

  According to a tenth aspect of the present invention, in the music ensemble publishing system according to any one of the first to ninth aspects, each terminal is a mobile phone.

  According to the music ensemble disclosure system of the present invention, the notification means of each terminal notifies the playback timing of performance information synchronized with the accompaniment information to be played back as the performance operation timing. The playback means of each terminal plays back the performance notes recorded in the performance information at the timing when the performance operation information is input. The recording means records performance notes at the timing when performance operation information is input, and stores the performance notes as performance recording information. As a result, the user of each terminal can play a performance part corresponding to each musical instrument individually and record the performance, thereby experiencing a ensemble performance in a remote place.

  The performance information setting means sets performance information according to the number of terminals participating in the music ensemble disclosure system. The notifying means changes the notification content of the performance operation timing according to the content of the performance note recorded in the performance information. As a result, it is possible to flexibly respond to changes in performance information settings and performance operation levels according to the number of terminals, so even users who cannot play musical instruments or users who are not familiar with performance using performance information, You can experience a musical ensemble while you are in a remote place.

  The synthesizing unit of the server synthesizes the performance record information transmitted from each terminal based on the time information recorded in the accompaniment information to create synthesized music information. As described above, since the performance record information is synthesized as it is without being quantized, the user of the wireless terminal creates original synthesized music information even when compared with the music information that is master information. The created composite music information can be released as an ensemble music.

<Overall configuration of music ensemble disclosure system>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an overall configuration diagram of a music ensemble disclosure system according to the present embodiment. The music ensemble publishing system shown in FIG. 1 includes a plurality of wireless terminals 10, 10.

  One of the plurality of wireless terminals 10, 10... Is set as the host terminal 10H. The wireless terminal 10 excluding the host terminal 10H operates as the client terminal 10C. In FIG. 1, a music ensemble disclosure system is composed of one host terminal 10H and three client terminals 10C1, 10C2, and 10C3.

  In the following description, the host terminal 10H and the client terminal 10C are not particularly distinguished, and the common function and property are collectively referred to as the wireless terminal 10 when describing them. In addition, the client terminals 10C1 to 10C3 are not particularly distinguished from each other, and will be collectively referred to as the client terminal 10C when common functions and properties are described.

  The host terminal 10H and the client terminal 10C are terminals having the same role in the performance of the performance part that they are in charge of and the recording of the performance, but the roles of setting the operation of the system are different.

  The host terminal 10H and the client terminal 10C are mobile phones that can be operated by a user. In the example of FIG. 1, one user has the host terminal 10 </ b> H, and the following three users operate the client terminals 10 </ b> C <b> 1 to 10 </ b> C <b> 3 respectively. In the music ensemble publishing system shown in FIG. 1, the users of the wireless terminals 10 may be operated at the same place or may be operated at their homes.

  The music server 20 is a server that holds performance information related to performance parts played by the users of the wireless terminals 10 and distributes the performance information to the wireless terminals 10 respectively. In addition, the music server 20 synthesizes performance record information that records performances using the performance information, and creates composite music information. For this reason, the music server 20 is not involved in the operation of the wireless terminal 10 when the user of each wireless terminal 10 plays the performance part using the performance information.

<Configuration of wireless terminal>
FIG. 2 is a block diagram of the wireless terminal 10. That is, it is a functional block diagram common to the host terminal 10H and the client terminal 10C. The wireless terminal 10 includes a control unit 100, a monitor 101, an operation unit 102, a speaker 103, a microphone 104, a storage unit 105, and a wireless unit 106.

  The control unit 100 includes a CPU, a RAM, and the like and performs overall control of the wireless terminal 10. The control unit 100 also includes a timing notification unit 111, a music playback unit 112, and a recording unit 113. The timing notification unit 111 notifies the user of the timing at which the user should input the performance operation information by graphical display on the monitor 101 during performance using the performance information. The music playback unit 112 plays back the performance sound described in the performance information PI based on the timing when the user inputs the performance operation information. The performance sound reproduced by the music reproduction unit 112 is output from the speaker 103. The recording unit 113 records the performance sound described in the performance information PI at the timing when the performance operation information is input, and stores it in the storage unit 105 as performance recording information RI.

  The monitor 101 is used to display various information such as the timing at which the user should input performance operation information and the playback state of the performance information PI. The monitor 101 may be a touch panel display. In this case, the operation unit 102 is displayed on the monitor 101 as a software key.

  The operation unit 102 includes a plurality of buttons such as a numeric keypad. The user of the wireless terminal 10 operates the operation unit 102 to input various operation information such as performance operation information and setting information.

  The microphone 104 is an audio input interface. The storage unit 105 also stores performance information PI and accompaniment information AI downloaded from the music server 20 and performance recording information RI. The wireless unit 106 performs wireless communication with the music server 20.

<Configuration of music server>
Next, the configuration of the music server 20 will be described with reference to FIG. FIG. 3 is a block diagram of the music server 20. The music server 20 includes a music storage unit 201, a performance information generation unit 202, a content holding unit 203, a synthesis unit 204, a recording information storage unit 205, a distribution unit 206, and a communication unit 207.

  The music storage unit 201 stores various music as music information SI. The user of the host terminal 10H selects the music information SI from the music storage unit 201 via a web browser or the like.

  The performance information generation unit 202 acquires the selected music information SI from the music storage unit 201, and creates performance information PI and accompaniment information AI from the music information SI based on the distribution information DI transmitted from the host terminal 10H. .

  The content holding unit 203 holds the selected music information SI and the performance information PI and accompaniment information AI created by the performance information generation unit 202. The content holding unit 203 stores distribution information DI for distributing the performance information PI and the accompaniment information AI to the host terminal 10H and the client terminal 10C.

  The synthesizing unit 204 synthesizes the performance recording information RI transmitted from each wireless terminal 10 to create synthesized music information MI. The recorded information storage unit 205 stores the performance recording information RI transmitted from each wireless terminal 10 and the synthesized music information MI created by the synthesizing unit 204.

  The distribution unit 206 notifies each wireless terminal 10 of the storage destination URL of the performance information PI and the synthesized music information MI, and performs the performance information PI and the accompaniment in response to the acquisition request for the performance information PI received from each wireless terminal 10. Information AI is transmitted to each wireless terminal 10.

  The communication unit 207 transmits / receives data to / from each wireless terminal 10 connected via the Internet 30 using a protocol such as TCP / IP.

<Performance information and performance using performance information>
Next, the contents of the performance information PI will be described. The performance information PI is information corresponding to a performance part assigned to each wireless terminal 10 and is information describing information about instrument sounds output from each wireless terminal 10. For example, MIDI data can be used as the performance information PI. That is, the performance information PI includes score information. The music reproducing unit 112 can reproduce the performance sound according to the performance information PI. The performance sound here refers to information corresponding to a performance note indicating the scale of the sound to be generated and the length of the sound. When MIDI data is used as the performance information PI, the music playback unit 112 has MIDI sound source data.

  Next, processing of the timing notification unit 111 and the music playback unit 112 when the user performs a performance using the performance information PI will be described.

  Specifically, first, the music reproducing unit 112 continuously reproduces the accompaniment information AI regardless of whether performance operation information is input. The accompaniment information AI is performance information PI corresponding to the part of the accompaniment performance. Further, the music playback unit 112 does not continuously play the performance information PI, but plays back each performance sound described in the performance information PI based on the performance operation information input by the user.

  Further, the timing notification unit 111 synchronizes the reproduction timing of the accompaniment information AI with the performance timing of the performance sound described in the performance information PI. Then, the timing notification unit 111 notifies the user of the performance timing as the timing at which the performance operation information should be input in accordance with the accompaniment information AI. At this time, the timing notification unit 111 graphically displays the performance timing on the monitor 101.

  In addition, the music playback unit 112 detects performance operation information input by the user. When the input timing of the performance operation information matches the performance timing, the music playback unit 112 outputs the performance sound described in the performance information PI to the speaker 103. On the other hand, if the input timing does not match the performance timing, the music playback unit 112 plays back the performance sound corresponding to the performance timing closest in time to the input timing, for example.

  Thus, “a performance using the performance information PI” refers to reproducing the performance sound described in the performance information PI according to the input timing of the performance operation information. For this reason, the timing at which the performance sound described in the performance information PI is actually reproduced depends on the performance operation of the user. For this reason, depending on the input timing of the performance operation information, a performance sound that is not reproduced may be generated among the performance sounds described in the performance information PI. Therefore, even if the user of the wireless terminal 10 performs using the performance information PI, the user can perform with originality and can feel as if he / she is actually playing a specific performance part. It can be done.

<Music information>
As described above, the performance information PI is information for each performance part assigned to each wireless terminal 10. A set of performance information PI is music information SI. That is, the music information SI is information describing all the performance information PI of all performance parts.

  The music information SI is a set of performance information PI and has header information SIH. FIG. 4 is a diagram showing the description content of the header information SIH. The header information SIH describes rules for how performance parts are allocated according to the number of wireless terminals 10 participating in the music ensemble disclosure system.

  Next, each track shown in FIG. 4 will be described. As shown in FIG. 4, the music recorded with the music information SI is composed of five performance parts from track T1 to track T5. These performance parts are performance parts corresponding to each instrument such as a violin and a piano. Therefore, the music information SI includes performance information PI corresponding to each of the tracks T1 to T5.

  As shown in FIG. 4, the tracks T <b> 2 to T <b> 5 are performance parts assigned according to the number of wireless terminals 10. For example, if the number of wireless terminals 10 participating in the music ensemble publishing system is two, the header information SIH assigns tracks T2 and T4 to the wireless terminal 10 with ID = 1, and the wireless terminal 10 with ID = 2. To be assigned tracks T3 and T5.

  If the number of wireless terminals 10 participating in the music ensemble disclosure system is three, the header information SIH assigns tracks T2 and T5 to the wireless terminal 10 with ID = 1, and the wireless terminal 10 with ID = 2. Is assigned to the track T3, and the track T4 is assigned to the wireless terminal 10 with ID = 3.

  Thus, when the number of wireless terminals 10 participating in the music ensemble is smaller than the number of tracks, a plurality of tracks can be assigned to the wireless terminal 10.

  If the number of wireless terminals 10 participating in the music ensemble is larger than the number of tracks, a plurality of wireless terminals 10 may be assigned to one track. Further, when the number of wireless terminals 10 is larger than the number of tracks, the tracks may be divided by time, and the divided tracks may be allocated for each wireless terminal 10. As a method of dividing the track by time, for example, dividing the track by the reproduction start time and the reproduction end time of each phrase can be considered. In this case, accompaniment information AI corresponding to each divided track may be created based on the condition for dividing the track.

  In the header information SIH shown in FIG. 4, the track T <b> 1 is defined as a track for accompaniment performance common to the wireless terminals 10. The accompaniment performance track corresponds to the accompaniment information AI. Further, it is not necessary to fix the accompaniment performance track to the track T1, and any track other than the track assigned as performance information PI to each wireless terminal may be used. For example, the accompaniment performance track corresponding to the track T2 may be any one of the tracks T1 and T3 to T5, or a combination of a plurality of tracks. In this case, the track T1 is defined to be assigned to the wireless terminal 10 as performance information PI.

  The ID of the wireless terminal 10 assigned to each track described above is set in the host terminal 10H that has acquired the header information SIH. That is, the host terminal 10H allocates an ID to each wireless terminal 10 according to the number of wireless terminals 10 participating in the music ensemble disclosure system. Normally, the host terminal 10H allocates IDs to all the wireless terminals 10 including the own device. Alternatively, the host terminal 10H may be positioned as a setting terminal, assign an ID only to the client terminal 10C, and reproduce the performance information PI only by the client terminal 10C.

<Flow of music system processing>
In the following description, the flow of processing of the music ensemble publishing system of the present embodiment will be described by taking as an example the case where the users of the four wireless terminals 10 shown in FIG. 1 use the music ensemble publishing system. Further, the place where the user of the wireless terminal 10 operates the wireless terminal 10 is not questioned.

  The wireless terminal 10 possessed by one of the users who use the music ensemble publishing system is used as the host terminal 10H. Further, the wireless terminal 10 possessed by another user is used as the client terminal 10C. Further, it is assumed that the mail address of each wireless terminal 10 is registered in the host terminal 10H.

  First, the user of the wireless terminal 10 downloads an application program having functions such as the timing notification unit 111, the music playback unit 112, and the recording unit 113 from the music server 20 and installs it in the wireless terminal 10. Note that when the application program is already installed in the wireless terminal 10, the user does not need to perform the above-described operation.

  Next, the user of the host terminal 10H activates the application program and accesses the music server 20 via the application program. Then, the user of the host terminal 10H selects the music information SI from the music storage unit 201. The music server 20 creates a content holding unit 203 for each user who has selected the music information SI, and stores the music information SI in the created content holding unit 203. Then, the music server 20 transmits header information SIH included in the selected music information SI to the host terminal 10H. Hereinafter, operations in the application program will be described as operations of the timing notification unit 111, the music playback unit 112, the recording unit 113, or the control unit 100.

  Next, the control unit 100 of the host terminal 10H assigns an ID to each wireless terminal 10 based on the number of the wireless terminals 10 and the received header information SIH. The ID assignment to each wireless terminal 10 may be performed manually by the user of the host terminal 10H or automatically by the control unit 100 of the host terminal 10H. Then, the control unit 100 of the host terminal 10H transmits distribution information DI in which the mail address of each wireless terminal 10 is associated with the ID assigned to each wireless terminal 10 to the music server 20. Thus, the host terminal 10H is different from the client terminal 10C in that it performs an operation of assigning an ID to each wireless terminal 10.

  When the music server 20 receives the distribution information DI, the performance information generation unit 202 generates performance information PI and accompaniment information AI based on the received distribution information DI and header information SIH. Then, the performance information generation unit 202 stores the generated performance information PI and accompaniment information AI in the content holding unit 203.

  Next, the distribution unit 206 of the music server 20 notifies each wireless terminal 10 that the performance information PI and the accompaniment information AI can be downloaded. For example, the distribution unit 206 may transmit the URL of the content holding unit 203 to each wireless terminal 10 with reference to the distribution information DI. The distribution unit 206 may notify the URL of the content holding unit 203 only to the host terminal 10H. In this case, the host terminal 10H may notify the URL of the content holding unit 203 to the client terminal 10C.

  When the distribution unit 206 of the music server 20 notifies the URL of the content holding unit 203, the user of the wireless terminal 10 operates the operation unit 102 to access the content holding unit 203, and downloads performance information PI and accompaniment information AI. . At this time, the music server 20 permits each wireless terminal 10 to download only the performance information PI and the accompaniment information AI corresponding to the IDs assigned thereto.

  Then, the user of each wireless terminal 10 performs the performance part using the downloaded performance information PI and accompaniment information AI. At this time, the user of the wireless terminal 10 does not need to gather and perform the performance using the performance information PI, and can perform the performance using the performance information PI at home, for example.

  Here, the operation of the wireless terminal 10 during performance using performance information and the operation of the recording unit 113 during performance using performance information will be described with reference to FIG. FIG. 5 is a diagram illustrating a display example of the monitor 101 of the wireless terminal 10 during performance using the performance information PI.

  First, the operation of the wireless terminal 10 will be described. First, the user activates the downloaded application program. Then, performance information PI and accompaniment information AI are set for the application program by a user operation.

  Next, as shown in FIG. 5, the timing notification unit 111 displays a performance score PIS based on the selected performance information PI on the monitor 101. The notes described in the performance score PIS shown in FIG. 5 correspond to the performance sound described in the performance information PI. As a result, the wireless terminal 10 enters a performance standby state using the performance information PI. At this time, on the monitor 101, the pointer P indicating the performance position of the performance information PI indicates the head position of the performance score PIS. FIG. 5 shows a state in which the performance using the performance information PI has progressed halfway. For this reason, the pointer P points to a note written in the middle of the performance score PIS. Further, the user may automatically reproduce the performance information PI as an exemplary performance and confirm the contents of the performance part that he / she is in charge of in advance.

  Then, when the user presses the “#” key 123 which is a performance start instruction button, a performance using the performance information PI is started. Specifically, the music playback unit 112 starts playback of the accompaniment information AI, and the timing notification unit 111 synchronizes with playback of the accompaniment information AI, and plays the performance score PIS displayed on the monitor 101 from the right to the left. Move in the direction. As a result, the position where the pointer P points to the musical score PIS for performance changes. The numbers displayed on the lower side of the monitor 101 are, in order from the left, the serial number of the measure in which the pointer P indicates the performance score PIS, the number of beats in the measure indicated by the pointer P, and the performance time. Correspond.

  The user presses the “2” key 127 at a timing when the pointer P indicates a note in the performance score PIS. Here, pressing the “2” key 127 means that the performance operation information of the performance information PI has been input. The music playback unit 112 performs the performance sound corresponding to the performance timing closest to the timing when the user presses the “2” key 127 among the performance timings described in the performance information PI according to the performance operation information input by the user. Play. Thus, the user can perform using the performance information PI by pressing the “2” key 127 at an appropriate timing. Further, the user may press any one of the “1” key to the “6” key shown in FIG. 5 instead of pressing the “2” key 127.

  The user can also interrupt the performance by pressing the “*” key 121. At this time, when the user presses the “*” key 121, the timing notification unit 111 temporarily stops the movement of the musical score PIS for performance, and the music playback unit 112 temporarily stops the playback of the accompaniment information AI. Then, when the user presses the “*” key 121 again, the timing notification unit 111 and the music playback unit 112 resume the above operations. In addition, the user can reset the performance by pressing the “0” key 122 after pressing the “*” key 121, and can restart the performance using the performance information PI from the beginning.

  Next, the operation of the recording unit 113 will be described in detail. When the user presses the “#” key 123 and the performance using the performance information PI is started, the recording unit 113 starts recording the performance using the performance information PI. Specifically, the recording unit 113 records the performance sound described in the performance information PI, which is reproduced according to the input performance operation information, at the timing when the performance operation information is input. That is, the recording unit 113 does not record the sound itself output from the speaker 103.

  The recording unit 113 records the performance sound described in the performance information PI using the time information described in the accompaniment information AI. Here, the time information is a description of the performance timing of the performance sound described in the performance information PI or the accompaniment information AI as an elapsed time from the reproduction start time.

  That is, the recording unit 113 acquires the performance time information corresponding to the timing at which the performance operation information is input as the elapsed time from the reproduction start time of the accompaniment information AI. The recording unit 113 records the performance sound described in the performance information PI in association with performance time information indicating the timing at which the performance sound is reproduced.

  Hereinafter, returning to the processing flow of the music system, the description will be continued.

  When the performance using the performance information PI is completed, the recording unit 113 stores the recorded performance sound as performance recording information RI. Thereafter, the user reproduces the performance record information RI and confirms the performance contents using the performance information PI. At this time, the user of the wireless terminal 10 may perform the performance part again by using the performance information PI when the timing of pressing the “2” key 127 is incorrect and an accurate performance cannot be performed. Further, only a part of the performance information PI corresponding to a specific phrase of the performance part may be played again.

  In addition, the following operation is mentioned as an operation method for confirming one's performance content. For example, when it is desired to reproduce only the performance recording information RI, the “7” key 124 may be pressed. When the performance recording information RI and the accompaniment information AI are reproduced together, the “8” key 125 may be pressed. If only the accompaniment information AI is to be reproduced, the “9” key 126 may be pressed.

  After confirming the performance record information RI, the user of the wireless terminal 10 operates the operation unit 102 to upload the performance record information RI to the music server 20. The music server 20 stores the performance recording information RI uploaded from the wireless terminal 10 in the recording information storage unit 205.

  When a plurality of performance parts are assigned to the wireless terminal 10, the user of the wireless terminal 10 needs to download a plurality of performance information PI. Then, the above-described operation may be performed for each downloaded performance information PI.

  When the music server 20 confirms that the performance recording information RI corresponding to all the performance parts has been uploaded, the music server 20 notifies the user of the host terminal 10H that the performance recording information RI can be merged.

  The user of the host terminal 10H operates the operation unit 102 to access the music server 20, and instructs to merge the performance recording information RI. In response to the merge instruction, the composition unit 204 of the music server 20 merges the performance record information RI uploaded from each wireless terminal 10 to create composite music information MI. At this time, the synthesizing unit 204 merges the performance record information RI without performing processing such as quantization (adjustment of the performance timing of the performance sound described in the performance record information RI) for each performance record information RI. The created composite music information MI is stored in the recording information storage unit 205. Further, the synthesizing unit 204 can create the synthesized music information MI corresponding to various formats such as MIDI SMF, Compact MIDI DATA, and mp3.

  As described above, the performance recording information RI is recorded using the same time information as the time information of the accompaniment information AI. For this reason, it can be considered that the performance recording information RI recorded by each wireless terminal 10 is recorded using the same time information. Therefore, the synthesizing unit 204 does not need to perform time synchronization processing between the performance recording information RIs, and merges the performance recording information RI using the time information described in the accompaniment information AI as reference time information.

  Next, the distribution unit 206 notifies the wireless terminal 10 that each user of the wireless terminal 10 has finished recording the performance part and that the composite music information MI has been created. At this time, the distribution unit 206 simultaneously notifies the storage destination URL of the composite music information MI. The user of the wireless terminal 10 operates the operation unit 102 to access the music server 20. Then, the user of the wireless terminal 10 downloads the synthesized music information MI and reproduces the downloaded synthesized music information MI. Note that the user of the host terminal 10H may make it possible for a third party to view the composite music information MI and the like by publishing the recording information storage unit 205 as a private site or public site. Further, an image or a message may be attached to the synthesized music information MI and provided to a third party.

  As described above, in the music ensemble publishing system according to the present embodiment, the user of each wireless terminal 10 performs the performance part individually using the downloaded performance information PI and simultaneously performs the performance using the performance information. Record. Thereby, the user of the wireless terminal 10 can experience the performance of the musical performance part in a pseudo manner. In addition, a performance using the performance information PI individually recorded by the user is recorded, and the recorded performance recording information RI is synthesized to create composite music information MI. Thereby, a plurality of users at remote locations can perform a pseudo ensemble performance. In addition, the composite music information MI is created without performing processing such as quantization on the performance recording information RI. Thereby, compared with the music information SI which is master information, the synthetic music information MI with originality can be disclosed as an ensemble music.

  In the above-described embodiment, the user is described as performing using the performance information PI. However, the present invention is not limited to this, and sound may be input via the microphone 104. For example, a vocal part may be created in addition to the musical performance part, and the vocal part may be assigned to a specific wireless terminal 10. In this case, the melody or lyrics of the vocal part may be displayed on the monitor 101, and the voice may be input according to the display on the monitor 101. As another example, a chorus part may be created. In this case, chorus parts are assigned to the plurality of wireless terminals 10. This makes it possible to create a music with more originality.

  Moreover, in the said embodiment, although demonstrated that the control part 100 of the host terminal 10H allocates ID to each radio | wireless terminal 10 based on the header information SIH transmitted from the music server 20, it is not restricted to this. Absent. For example, the music server 20 may not transmit the header information SIH to the host terminal 10H. In this case, the host terminal 10H may notify the music server 20 of the number of each wireless terminal 10 and the mail address of each wireless terminal 10 as distribution information DI. And the performance information generation part 202 of the music server 20 should just assign ID to each radio | wireless terminal 10 based on the received delivery information DI and header information SIH.

  In the above embodiment, the distribution unit 206 of the music server 20 has been described as permitting each wireless terminal 10 to download only the performance information PI and accompaniment information AI corresponding to the assigned ID. It is not limited to. For example, the user of each wireless terminal 10 may download performance information PI and accompaniment information AI corresponding to the musical instrument to be played. In this case, the performance information generation unit 202 may generate the performance information PI and the accompaniment information AI without receiving the distribution information DI. In this case, the host terminal 10 </ b> H only needs to transmit only the mail address of each wireless terminal 10 to the music server 20.

  In the above embodiment, the music server 20 has been described as creating the performance information PI and the accompaniment information AI. However, the present invention is not limited to this, and the host terminal 10H creates the performance information PI and the accompaniment information AI. May be. In this case, the host terminal 10H transmits the created performance information PI and accompaniment information AI to the client terminal 10C.

  In the above embodiment, the music server 20 has been described as creating the performance information PI and the accompaniment information AI. However, the present invention is not limited to this, and the wireless terminal 10 holds the music information SI and the host terminal 10H. The performance information PI and accompaniment information AI may be created based on the ID transmitted from.

  Moreover, in the said embodiment, although the several radio | wireless terminal 10 demonstrated as what participates in a music concert public disclosure system, you may take charge of all the performance parts with the one radio | wireless terminal 10. FIG.

  In the above-described embodiment, it has been described that the user of the wireless terminal 10 does not perform an operation of designating a scale during performance using the performance information PI. However, a scale is assigned to the numeric keypad of the wireless terminal 10 shown in FIG. May be.

  In the above embodiment, when a plurality of performance parts are assigned to one wireless terminal 10, the user has been described as performing using the performance information PI for each performance information PI. The performance is not limited, and a performance using a plurality of performance information PIs may be performed simultaneously.

  However, when performing using a plurality of performance information PIs, the number of times the performance operation information is input increases, which may make it difficult to perform using the performance information PI. In such a case, the performance information generation part 202 should just provide an input attribute with respect to the performance sound which a user needs to input performance operation information. And the timing notification part 111 should just point the performance timing of the performance sound to which the input attribute was provided as timing which should input performance operation information.

  Taking a triplet as an example, the input attribute is assigned to the performance sound corresponding to the first note of the triplet, and the input attribute is not assigned to the performance sound corresponding to the second and third notes. Then, during performance using a plurality of performance information PI, the user inputs performance operation information at the timing when the pointer P indicates the first note of the triplet. As a result, the performance sound corresponding to the first note of the triplet is reproduced, and subsequently, the performance sound corresponding to the second and third notes is automatically and continuously reproduced. That is, the performance sound corresponding to the second and third notes is reproduced even if performance operation information is not input.

  At this time, the performance sound corresponding to the second and third notes is reproduced with the timing at which the performance operation information corresponding to the first note is input as the reference time. That is, the performance sound corresponding to the second and third notes is a relative time difference between the performance timing of the performance sound corresponding to the first note and the performance timing of the performance sound corresponding to the second and third notes, and Playback is performed at a timing based on the reference time.

  In the musical score PIS for performance displayed on the monitor 101, a note having an input attribute and a note having no input attribute are displayed in different colors. As a result, the user can easily identify a note for which performance operation information needs to be input.

  Moreover, although the description has been given using the first performance sound of the tuplet as an example of the performance sound to which the input attribute is given, the input attribute may be given to the first performance sound of a phrase composed of a plurality of performance notes.

  Note that the attribute for the performance sound described above may be given based on the performance level set by the user. In this case, when the timing notification unit 111 displays the performance score PIS on the monitor 101, an attribute may be given to the performance sound according to the set performance level.

1 is an overall configuration diagram of a music ensemble disclosure system according to the present embodiment. 1 is a block diagram of a wireless terminal 10. FIG. 3 is a block diagram of a music server 20. FIG. It is a figure which shows the description content of header information SIH. It is a figure which shows the example of a display of the monitor 101 of the radio | wireless terminal 10 at the time of the performance using performance information PI.

Explanation of symbols

10 wireless terminal 10H host terminal 10C (10C1, 10C2, 10C3) client terminal 20 music server 100 control unit 105 storage unit 111 timing notification unit 112 music playback unit 113 recording unit 202 performance information generation unit 203 content holding unit 204 synthesis unit 205 recording Information storage

Claims (10)

A music ensemble publishing system comprising one or more terminals and a server connected to the one or more terminals via a network,
Each terminal
Notifying means for notifying the user of the playback timing of the performance notes recorded in the performance information related to the performance part that each terminal is in charge of as the performance operation timing;
Reproduction means for reproducing the performance notes at the timing when performance operation information is input;
Recording means for recording the reproduced performance notes as performance record information based on the timing at which the performance operation information is input;
With
The server
Performance information setting means for extracting the performance information from music information held in advance and setting the information on each terminal;
Combining means for synthesizing the performance record information transmitted from each terminal to create composite music information;
A music ensemble disclosure system characterized by comprising: In the music concert release system according to claim 1,
The performance information setting means includes:
Extraction means for extracting the performance information from the music information according to the number of the one or more terminals;
A music ensemble publishing system characterized by including: In the music concert release system according to claim 1,
The performance information setting means includes:
A setting means for extracting a predetermined number of performance information from the music information and setting the performance information in each terminal according to the number of the one or more terminals;
A music ensemble publishing system characterized by including: In the music concert public disclosure system according to any one of claims 1 to 3,
The music ensemble disclosure system, wherein the notification means notifies the performance operation timing to each performance note. In the music concert public disclosure system according to any one of claims 1 to 3,
The notification means notifies only the playback timing of the first performance note of the performance note group as the performance operation timing corresponding to the performance note group composed of a plurality of performance notes recorded continuously,
The music ensemble publishing system characterized in that, when the performance operation information corresponding to the first performance note is input, the reproduction means continuously reproduces the plurality of performance notes. In the music concert release system according to any one of claims 1 to 5,
The reproducing means includes
Means for reproducing accompaniment information relating to other performance parts;
Including
The notification means includes
Means for synchronizing the playback timing of the accompaniment information and the playback timing of the performance notes to notify the performance operation timing;
Including
The recording means acquires performance time information corresponding to the timing at which the performance operation information is input based on the time information recorded in the accompaniment information, and associates the reproduced performance notes with the performance time information. Music ensemble disclosure system characterized by attaching and recording. In the music concert release system according to claim 6,
The performance information setting means includes:
Means for extracting the accompaniment information from the music information and setting it in each terminal;
Including
The music ensemble publishing system characterized in that the synthesizing means uses time information recorded in the accompaniment information as reference time information for synthesizing the performance recording information transmitted from each terminal. In the music concert public disclosure system according to any one of claims 1 to 7,
Each terminal further
Voice input means for inputting voice,
With
The music ensemble publishing system characterized in that the recording means records voice information input to the voice input means as the performance recording information. In the music concert public disclosure system according to any one of claims 1 to 8,
The music ensemble publishing system, wherein the server distributes the synthesized music information through the Internet. In the music concert release system according to any one of claims 1 to 9,
Each terminal is a mobile phone.

Images