JP2008096462A - Concert system and personal digital assistant - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a concert system which plays in concert by being separately performed with a plurality of personal digital assistants. <P>SOLUTION: A number key assignor 11 detects operation to a number key of a mobile phone by a user to output to a MIDI control module 12. The MIDI control module 12 outputs a MIDI signal corresponding to operation to the number key to a MIDI controller 13 based on input from the number key assignor 11. Simultaneously, the MIDI control module 12 transmits the MIDI signal to another mobile phone through a transmission module 14. The MIDI controller 13 adjusts timing of the MIDI signal input from the MIDI control module 12 and the MIDI signal received from the other mobile phone via a receiving module 15 to output it to a sound source 6. The sound source 6 generates musical sound data based on the input MIDI signal and reproduces from a speaker 9 after being converted into an analog voice signal with a D/A part 8. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an ensemble system including a portable information terminal that can be used as an electronic musical instrument.

  Conventional portable information terminals are known that emit electronic sounds by pressing numeric keys. By using such portable information terminals, a user can play music (for example, patents). Reference 1).

In addition, by using a plurality of portable information terminals that can reproduce music data, and each portable information terminal playing a system that reproduces each part of the music, one piece of music can be reproduced on a plurality of portable information terminals. Is also known (see, for example, Patent Document 2).
JP 2005-321581 A JP 2004-144811 A

However, in the conventional portable information terminal, even when one piece of music is reproduced on a plurality of terminals, only the assigned parts are reproduced separately from each terminal. It was not possible to perform and ensemble using the terminal.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an ensemble system capable of performing separately and performing on a plurality of portable information terminals.

  The present invention has been made to solve the above problems, and the invention according to claim 1 is an ensemble system including a plurality of portable information terminals, wherein the portable information terminal includes a plurality of operation keys. Input means having detection means, detection means for detecting an operation on the operation key, pronunciation information generation means for generating pronunciation information for generating a sound corresponding to the operation key detected by the detection means, and the pronunciation Generated by the transmitting means for transmitting information to other portable information terminals constituting the ensemble system, the receiving means for receiving pronunciation information from other portable information terminals constituting the ensemble system, and the pronunciation information generating means And sounding means for sounding based on the sounding information received and the sounding information received by the receiving means.

  The invention according to claim 2 is the invention according to claim 1, wherein the pronunciation information includes part information, and the portable information terminal includes a part selection means for selecting a part for performance, Part receiving means for receiving a part to be played on the portable information terminal from another portable information terminal constituting the concert system, and a part selected by the part selecting means overlaps with a part received by the part receiving means Is further provided with part duplication notifying means for notifying that effect.

  The invention according to claim 3 further includes timbre selection means for selecting a timbre for performance in the invention according to claim 1 or claim 2, wherein the sounding means of the portable information terminal includes the sound generation means. The timbre selected by the timbre selection means is uttered based on the corresponding pronunciation information.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the portable information terminal is configured to generate the sound information based on the pronunciation information generated by the pronunciation information generating means. It further comprises sounding time adjusting means for adjusting the time of sounding by the sounding means and the time of sounding by the sounding means based on the sounding information received by the receiving means.

  According to a fifth aspect of the present invention, an input unit having a plurality of operation keys, a detection unit for detecting an operation on the operation key, and a sound corresponding to the operation key detected by the detection unit are generated. A pronunciation information generating means for generating pronunciation information for transmitting, a transmitting means for transmitting the pronunciation information to another terminal, a receiving means for receiving the pronunciation information from one or more other terminals, and the pronunciation information generating means A portable information terminal comprising sound generation means for sound generation based on the generated sound generation information and the sound generation information received by the reception means.

  The invention described in claim 6 is an ensemble system composed of a plurality of portable information terminals and a sound source system, wherein the portable information terminal is connected to input means having a plurality of operation keys, and to the operation keys. Detecting means for detecting the operation of the sound generating means, sounding information generating means for generating sounding information for sounding the sound corresponding to the operation key detected by the detecting means, and transmitting means for transmitting the sounding information to the sound source system And the sound source system includes sound generation means for generating sound based on the sound generation information received from the plurality of portable information terminals.

  According to the present invention, since sound information is transmitted and received between a plurality of portable information terminals constituting the ensemble system, sounds played on other portable information terminals can be heard on one's own portable information terminal, You can listen to the sound played on your mobile information terminal on other mobile information terminals. Therefore, an ensemble can be performed even in a situation where the sound reproduced from another portable information terminal cannot be heard directly.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram showing a configuration of a mobile phone (portable information terminal) according to an embodiment of the present invention.

  In FIG. 1, a CPU 1 is a CPU (Central Processing Unit) that controls each unit in the mobile phone 20. The ROM 2 is a ROM (Read Only Memory) that holds programs executed by the CPU 1. The RAM 3 is a RAM (Random Access Memory) that provides a memory area used by the CPU 1.

  The user interface 4 (input means) is an interface that takes in user instructions and outputs them to the CPU 1, and has 12 operation keys with numbers “0” to “9” and “#” and “*”. (Hereinafter referred to as number keys) and various direction keys. The display unit 5 is a display that displays information to be shown to the user based on an instruction from the CPU 1.

  The sound source 6 (sound generation means) generates and outputs musical sound data based on a MIDI (Musical Instruments Digital Interface) signal from the CPU 1, and is, for example, an FM (Frequency Modulation) sound source or a PCM (Pulse Code Modulation) sound source. is there.

  The sound source 6 of the present embodiment is compliant with the GM system level 1 (General MIDI System Level 1) standard, and is preliminarily provided with timbre data of 128 kinds of musical instruments and timbre data of drum sets.

  The communication module 7 is a module for communicating with other mobile phones, and is, for example, wireless communication such as Bluetooth (registered trademark) or infrared communication such as IrDA (Infrared Data Association).

  The D / A unit 8 converts digital musical tone data input from the sound source 6 into an analog musical tone signal. The speaker 9 reproduces the musical sound signal output from the D / A unit 8. The bus line 10 is a data bus that interconnects the units in the mobile phone. Note that the cellular phone of the present invention has a telephone function and the like other than those shown in FIG.

Next, the operation of the above-described embodiment will be described with reference to FIGS.
FIG. 2 is a functional configuration diagram showing functions when performing using the mobile phone of FIG.

  In FIG. 2, the number key assigner 11 (detection means) is a function of the CPU 1 and assigns 12 sounds, which are basic sounds of a melody instrument, to 12 number keys of the user interface 4. The number key assigner 11 detects an operation of pressing or releasing each number key on the user interface 4 and outputs a detection result to the MIDI control module 12.

  The MIDI control module 12 (pronunciation information generating means) is a function of the CPU 1, and based on the detection result of the number key assigner 11, the number key information of the melody musical instrument assigned to the user interface 4 is converted into a MIDI signal (pronunciation information). To replace.

  The MIDI control module 12 outputs a MIDI signal to the MIDI controller 13 and transmits the same MIDI signal to another mobile phone via the transmission module 14.

  When the number key assigner 11 detects pressing of the number key, the MIDI control module 12 issues a note-on of the note number (pitch) corresponding to the number key. On the other hand, when the number key assigner 11 detects the release of the number key, the MIDI control module 12 issues a note-off of the note number (pitch) corresponding to the number key.

  The MIDI controller 13 (sound generation time adjusting means) is a function of the CPU 1 and inputs MIDI signals from the MIDI control module 12 and inputs MIDI signals from other mobile phones via the receiving module 15. A MIDI signal is output to each channel of the sound source 6.

  The MIDI controller 13 also has a function of adjusting the latency from when the user operates the number key with the number key assigner 11 until when it is actually reproduced from the speaker of the own terminal.

  In the present embodiment, the MIDI controller 13 inputs the MIDI signal received from the other terminal in addition to the MIDI signal output from the MIDI control module 12 of the own terminal, but the MIDI signal from the other terminal is input via the communication means. Therefore, there will be a delay.

  For this reason, in the latency adjustment in the MIDI controller 13, for the MIDI signal generated by the own terminal, the MIDI signal is input to the MIDI controller of the counterpart terminal after the MIDI signal is output from the MIDI control module of the own terminal. Delay by the delay time required until

  For example, there is a method of setting this delay time in advance according to the type of communication means with the counterpart terminal. When the communication means differs depending on the terminal performing the concert, the latency of all terminals can be adjusted by setting a delay time for each channel corresponding to each terminal.

  Specifically, for example, the delay time of the channel played on the terminal is 0.4 seconds, the delay time of the channel played on the partner terminal 1 communicating at a high transfer speed is 0.2 seconds, and the slow transfer speed The delay time of the channel played by the partner terminal 2 that performs communication is set to 0 seconds (no delay).

  At this time, the MIDI signal from the own terminal is output to the sound source 6 with a delay of 0.4 seconds, the MIDI signal received from the counterpart terminal 1 is output to the sound source 6 with a delay of 0.2 seconds, and the MIDI signal received from the counterpart terminal 2 is output. The signal is output to the sound source 6 as it is.

  Returning to FIG. 2, the transmission module 14 (transmission means) is one function of the communication module 7 of FIG. 1, and transmits the MIDI signal output from the MIDI control module 12 to another mobile phone. The receiving module 15 (receiving means) is one function of the communication module 7 in FIG. 1 and receives MIDI signals transmitted from other mobile phones and outputs them to the MIDI controller 13.

  The MIDI signal output from the MIDI controller 13 is input to the sound source 6, and the sound source 6 outputs the tone color corresponding to the MIDI signal as digital musical tone data. The D / A unit 8 converts the digital musical tone data output from the sound source 6 into an analog musical tone signal and reproduces it from the speaker 9.

Next, an ensemble system for performing an ensemble using three mobile phones will be described with reference to FIGS. Note that the number of mobile phones in the ensemble system is not limited to three, but may be two or more.
FIG. 3 is a diagram showing an example of an ensemble system composed of three mobile phones. In FIG. 3, mobile phones 31 to 33 switch MIDI channels depending on the part to be played, and all parts are reproduced by all mobile phones by transmitting and receiving MIDI signals to and from each other.

  The mobile phone 31 plays a melody part using MIDI channel 1, the mobile phone 32 plays a bass part using MIDI channel 2, and the mobile phone 33 plays a drum part using MIDI channel 10. Is played.

  FIG. 4 is a flowchart showing a performance procedure in the mobile phone 31 of FIG. In FIG. 4, when a setting instruction for musical instrument performance is input from the user interface 4 (step S401), the CPU 1 starts a setup process (step S402).

  In the setup process, the setting request information is exchanged between the mobile phones 31 to 33 shown in FIG. 3, and the parts (melody, bass, drum, etc.) to be played on each mobile phone, and the tone used for the part (Acoustic Grand Piano) , Acoustic Bass, etc.) and channel settings. The details of the setup process will be described below with reference to the flowchart of FIG.

  In the setup process, it is first determined whether or not the communication module 7 has received setting request information from other terminals (mobile phones 32 and 33 in FIG. 3) (part receiving means, step S501). If setting request information has not been received (step S501: NO), the process proceeds to step S503. On the other hand, if the setting request information has been received (step S501: Yes), the CPU 1 sets the part and tone stored in the setting request information, and uses the channel for playing the mobile phone that is the transmission source of the setting request information. Is assigned (step S502).

  Subsequently, the CPU 1 determines whether or not the user has performed a setting of part and tone color (part selection means) and a transmission operation by the user interface 4 (step S503). If it is determined that no user operation has been performed (step S503: No), the process proceeds to step S508.

  On the other hand, when an operation is performed by the user (step S503: Yes), it is determined whether the part designated by the user is not assigned to another mobile phone in the process of step S502 (step S504).

  If the part has already been assigned to another mobile phone (step S504: No), the CPU 1 displays on the display unit 5 that the part has been set (part duplication notification means, step S505). Then, it returns to step S501 again and continues a process.

  On the other hand, if the part is not assigned to another mobile phone (step S504: Yes), the CPU 1 sets the part and tone specified by the user for performance on the own terminal, and assigns a channel (step). S506).

  Subsequently, the CPU 1 transmits the part and tone color set in step S506 from the communication module 7 to the mobile phones 32 and 33 (step S507). Finally, in step S502 and step S506, it is determined whether the part, tone color setting, and channel assignment have been completed for the terminal and all of the mobile phones 32 and 33 (step S508).

  If the setting has not been completed (step S508: No), the processing from step S501 to step S508 is repeated. On the other hand, when all the settings are completed (step S508: Yes), the setup process is terminated.

  In the flowchart of FIG. 5, the part and tone color to be played are set in step S503 and the channel number is automatically assigned. However, the channel number may be directly set. Further, only the part or only the timbre may be set in step S503. If there are only parts, the timbre may be assigned automatically. If only the timbre is used, the timbre overlap is checked instead of the part in step S504. In the case of setting only the timbre, another timbre of the same part may be set with another mobile phone.

  Returning to FIG. 4, when the setup process is completed, the ensemble by the three mobile phones 31 to 33 is started. When the ensemble starts, the user performs by pressing and releasing the 12 number keys on the user interface 4.

  When the number key of the user interface 4 is operated by the user (step S403), the operation is detected by the number key assigner 11 (step S404). The number key assigner 11 always scans the operation of the number keys during performance, and outputs the detection result to the MIDI control module 12.

  The MIDI control module 12 inputs the detection result of the number key assigner 11, and determines whether any number key is pressed (step S405). If there is no pressed number key (step S405: No), the process returns to step S404 to perform processing.

  On the other hand, if there is a pressed number key (step S405: Yes), the MIDI control module 12 issues a note-on of the note number assigned to the pressed number key. The note-on issued by the MIDI control module 12 is input to the MIDI controller 13 and transmitted from the transmission module 14 to the mobile phones 32 and 33 (step S406).

  Subsequently, the MIDI control module 12 determines whether any number key is released from the detection result of the input number key assigner 11 (step S407). If there is no released number key (step S407: No), the process returns to step S404 to perform processing.

  On the other hand, if there is a released number key (step S407: Yes), the MIDI control module 12 issues a note-off of the note number assigned to the pressed number key. The note-off issued by the MIDI control module 12 is input to the MIDI controller 13 and transmitted from the transmission module 14 to the mobile phones 32 and 33 (step S406). Note that when sound is generated from the sound source 6, note-on needs to be identified for all timbres, but the necessity of identifying note-off depends on the timbre.

  Subsequently, the MIDI controller 13 adjusts the timing between the note-on or note-off input from the MIDI control module 12 and the note-on or note-off input from the reception module 15 (step S409), and the channel in which the sound source 6 is set. Output to. Each channel of the sound source 6 outputs digital musical tone data based on the input from the MIDI controller 13 with the set timbre and reproduces it from the speaker 9.

  Thereafter, steps S403 to S409 are repeatedly executed until the performance is completed, and not only the melody part of channel 1 set in the terminal itself but also the base part of channel 2 set in the mobile phone 32 and the mobile phone 33 are set. The drum part of the channel 10 is also reproduced from the speaker 9. When the performance is finished (step S410: Yes), the performance procedure is finished.

  In this embodiment, since MIDI signals are transmitted and received between a plurality of mobile phones, sounds played on other mobile phones can be heard on their mobile phones, and at the same time, sounds played on their mobile phones can be heard. Can be heard on other mobile phones. Therefore, it is possible to perform an ensemble even in a situation where the sound reproduced from another mobile phone cannot be heard directly.

  Subsequently, as another embodiment, an ensemble system that performs ensembles using three mobile phones and listens to performance sounds using a common sound source system will be described with reference to FIG. Note that the number of mobile phones in this embodiment is not limited to three, but may be two or more. In FIG. 6, mobile phones 61 to 63 switch the MIDI channel according to the part to be played, and transmit / receive MIDI signals to / from the sound source system 64. The tone generator system 64 has the same configuration as that shown in FIG. 1, has the same functions as those shown in FIG. 2, receives MIDI signals from the mobile phones 61 to 63, and reproduces the performance sounds of all parts.

  The sound source system 64 sets the part, tone color, and channel to be played on each mobile phone according to the setting request information transmitted from the mobile phones 61 to 63, and performs setup. FIG. 7 is a flowchart showing the setup process in the sound source system 64.

  In FIG. 7, the sound source system 64 determines whether or not the setting request information has been received from any one of the mobile phones 61 to 63 (step S701). If not received (step S701: No), the process proceeds to step S705.

  On the other hand, when the setting request information is received (step S701: Yes), it is determined whether the part stored in the setting request information has already been assigned to another mobile phone (step 702).

  If the part is already assigned to another mobile phone (step S702: No), the sound source system 64 indicates that the part is already set with respect to the mobile phone that is the transmission source of the setting request information. Transmit (step S703). Thereafter, the process returns to step S701 again to continue the processing.

  On the other hand, if the part is not assigned to another mobile phone (step S702: Yes), the sound source system 64 uses the part and tone stored in the setting request information as the mobile that is the transmission source of the setting request information. A setting is made for performance of the telephone, and a channel is assigned (step S704).

  Finally, it is determined whether the part, tone color setting, and channel assignment have been completed for all the terminals of the mobile phones 61 to 63 (step S705). If the setting has not been completed (step S705: No), the processing from step S701 to step S705 is repeated. On the other hand, if all the settings have been completed (step S705: Yes), the setup process ends.

  When the MIDI signal is received from the mobile phones 61 to 63 after the setup process is completed, the sound source of the sound source system 64 outputs digital musical tone data while switching channels based on the MIDI signal and reproduces it from the speaker.

  In the ensemble system of FIG. 6, the setting of the part, tone color, and channel to be played by each mobile phone is performed by transmitting / receiving setting request information by the mobile phones 61 to 63 as in FIG. The system 64 may be notified. In the present embodiment, the part and the timbre are set, but only the part or only the timbre may be set. When only the timbre is set, the duplication of the timbre is checked in each mobile phone.

  As mentioned above, although embodiment of this invention was explained in full detail, the concrete structure is not restricted to this embodiment, The design change etc. of the range which does not deviate from the summary of this invention are included. For example, in this embodiment, wireless communication such as Bluetooth (registered trademark) or infrared communication such as IrDA is used as a communication means with another mobile phone, but data transfer using a mobile phone network may be used.

  The present invention is suitable for use in an ensemble system that performs ensembles using a plurality of portable terminals that can perform based on user input.

It is a block diagram which shows the structure of the mobile telephone (mobile information terminal) which concerns on one Embodiment of this invention. It is a functional block diagram which shows the functional structure of the mobile telephone of FIG. It is a figure which shows an example of the ensemble system comprised by three mobile telephones. It is a flowchart which shows the procedure of the performance in the mobile telephone 31 of FIG. It is a flowchart which shows the process of step S402 of FIG. It is a figure which shows an example of the system which ensembles with three mobile telephones and reproduces | regenerates with a common sound source system. It is a flowchart which shows the setup process in the sound source system 64 of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... User interface (input means), 5 ... Display part, 6 ... Sound source (sounding means), 7 ... Communication module, 8 ... D / A part, 9 ... Speaker, DESCRIPTION OF SYMBOLS 10 ... Bus line, 11 ... Number key assigner (detection means), 12 ... MIDI control module (sound generation information generation means), 13 ... MIDI controller (sound generation time adjustment means), 14 ... Transmission module (transmission means), 15 ... Reception module (Receiving means), 20, 31-33, 61-63 ... mobile phone (portable information terminal), 64 ... sound source system

Claims (6)

An ensemble system composed of a plurality of portable information terminals,
The portable information terminal
Input means having a plurality of operation keys;
Detecting means for detecting an operation on the operation key;
Pronunciation information generating means for generating pronunciation information for generating a sound corresponding to the operation key detected by the detection means;
Transmitting means for transmitting the pronunciation information to another portable information terminal constituting the ensemble system;
Receiving means for receiving pronunciation information from other portable information terminals constituting the ensemble system;
A ensemble system comprising: sound generation means for sound generation based on the sound generation information generated by the sound generation information generation means and the sound generation information received by the reception means. The pronunciation information further includes part information;
The portable information terminal
A part selection means for selecting a part for performance;
Part receiving means for receiving a part for performing on the portable information terminal from another portable information terminal constituting the ensemble system;
2. The ensemble system according to claim 1, further comprising a part duplication notifying unit for notifying that when the part selected by the part selecting unit overlaps with the part received by the part receiving unit. . Further includes a timbre selecting means for selecting a timbre for playing,
3. The ensemble system according to claim 1, wherein the sound generation unit of the portable information terminal generates a sound based on sound generation information corresponding to the timbre selected by the timbre selection unit. The portable information terminal
A pronunciation time adjusting means for adjusting a time of sound generation by the sound generation means based on the sound generation information generated by the sound generation information generation means and a time of sound generation by the sound generation means based on the sound generation information received by the reception means; The ensemble system according to any one of claims 1 to 3, further comprising: Input means having a plurality of operation keys;
Detecting means for detecting an operation on the operation key;
Pronunciation information generating means for generating pronunciation information for generating a sound corresponding to the operation key detected by the detection means;
Transmitting means for transmitting the pronunciation information to another terminal;
Receiving means for receiving pronunciation information from one or more other terminals;
A portable information terminal comprising: sound generation means for sound generation based on the sound generation information generated by the sound generation information generation means and the sound generation information received by the reception means. An ensemble system composed of a plurality of portable information terminals and a sound source system,
The portable information terminal
Input means having a plurality of operation keys;
Detecting means for detecting an operation on the operation key;
Pronunciation information generating means for generating pronunciation information for generating a sound corresponding to the operation key detected by the detection means;
Transmitting means for transmitting the pronunciation information to the sound source system,
The ensemble system is characterized in that the sound source system includes sound generation means for generating sound based on the sound generation information received from the plurality of portable information terminals.

Images