JP2006195215A - Communication terminal device and musical performance system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a musical performance by a plurality of players by providing a playing function suitable to at least continuous variation in interval as a music playing function mounted on a communication terminal device and also providing a function of generating data on the musical performance by the plurality of players. <P>SOLUTION: A communication terminal device comprises a linear detection section (detecting means) 4 which detects at least a contact position provided to the housing of a primary terminal body, a musical performance waveform generation section which generates a musical performance waveform signal on the basis of the detection signal of the detection section, and an output section which audio-outputs the musical performance waveform signal. Musical performances by the plurality of players are communicated between terminals in the signal form of the musical performance waveform signal or in the signal form of musical performance data corresponding to the detection signal of the detection section and carried out by putting them together. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a communication terminal device, and more particularly to a communication terminal device having a music performance function and a function of creating performance data in cooperation between a plurality of communication terminal devices, and a performance system.

  Communication terminal devices such as mobile phones have been proposed and put into practical use with various functions by adding applications. For example, an incoming call notification function called by a name such as ringtone or ringtone incorporates a music playback function in the communication terminal device. The communication terminal device is provided with a sound source to realize these functions, but this sound source is not only used as a ring tone but also used as a playback player by playing back downloaded music. For example, some communication terminal devices are equipped with a function for reproducing a music code signal such as MP3, and are used as portable audio players.

  As described above, in addition to using the communication terminal device as a device for playing music, use of the communication terminal device as a device for playing music has also been proposed (see, for example, Patent Documents 1 and 2).

  In Patent Document 1, the vibration of a mobile phone is detected by a vibration sensor provided in the mobile phone, a rhythm sound signal is formed by a signal proportional to the magnitude of the vibration, and the function of a rhythm instrument such as a mascara sound is provided in the mobile phone. Is disclosed.

In Patent Document 2, a touch pad and a pressure sensor are provided in a mobile phone device, and the volume of a selected tone is generated by a pressure value, and the pitch assigned to the numeric key is designated by pressing the numeric key. Is disclosed. Further, this patent document also discloses that a real-time performance content is transmitted to drive a sound source built in another communication terminal device.
JP 2003-125455 A JP 2004-37646 A

  The music performance function installed in the communication terminal apparatus proposed in the past has a problem that it does not have sufficient functions to satisfy the performance.

  For example, performance content and expressiveness are insufficient. The performance function of music installed in the communication terminal device that has been proposed in the past is a performance that mainly determines the timing and volume of sounds of percussion instruments, rhythm instruments, etc. There is a problem that it is not satisfactory enough to express changes in pitch and volume, especially continuous pitch.

  In the above-mentioned Patent Document 2, it is proposed to use the numeric keys provided in the mobile phone for pitch specification. However, the input method using the numeric keys is greatly different from the actual instrument performance input method, and is arranged in a grid pattern. The operation of selecting a number key and determining the pitch is not suitable for performance. Although the numeric keys are suitable for digital input, it is difficult to perform tremolo or the like because analog amounts such as pressing force and finger vibration cannot be detected.

  In addition to the above-described problem that the performance content and expressiveness are insufficient, there is a problem that the performance is not suitable for performance by a plurality of players.

  In addition to solo performances that are performed alone, there are ensemble performance modes in which a plurality of performers perform using various musical instruments. What has been proposed in the past is merely a solo performance, and it is not possible to enjoy the performance form of an ensemble.

  In the above-mentioned Patent Document 2, it is proposed to transmit the contents of the real-time performance, but this configuration is merely transmitted to other communication terminal devices using the communication function of the communication terminal device to generate sound. However, the performance form of an ensemble in which a plurality of performers perform using various musical instruments on a single terminal is not performed.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to solve the above-described problems and to provide a performance function suitable for at least continuous pitch change in a music performance function mounted on a communication terminal device.

  It is another object of the present invention to provide a function for generating performance data by a plurality of performers so that a plurality of performers can perform.

  The communication terminal device and the performance system according to the present invention include a combination of a plurality of performances and a communication terminal device in a signal form of a performance waveform signal generated based on a detection signal of a detection means operated by a user for performance operation. A first mode for performing transmission and reception and a second mode for performing synthesis processing of a plurality of performances and transmission and reception between communication terminal devices in the signal form of the detection signal of the detection means are included.

  In the communication terminal device according to the first aspect of the present invention, in the communication terminal device including a receiving unit, a linear detection unit that detects at least a contact position provided in a casing of the terminal main body, and the detection unit And a performance waveform generating means for generating a performance waveform signal based on the detected signal, and an output means for outputting the performance waveform signal generated by the performance waveform generating means by voice.

  Since the detection means has a linear detection region, it is possible to input a pitch that changes continuously according to the position where the user touches.

  The performance waveform generation means generates a performance waveform signal based on the detection signal of the detection means. The output means performs voice output by driving, for example, a speaker or the like included in the communication terminal device by the performance waveform signal.

  In the first aspect, preferably, the apparatus includes waveform data recording means for recording the performance waveform signal as performance waveform data, and performance waveform synthesis means for synthesizing a plurality of performance waveform signals, wherein the performance waveform synthesis means comprises: The performance waveform signal obtained from the performance waveform data read from the waveform data recording means and the performance waveform signal generated by the performance waveform generation means are synthesized, and the output means outputs the synthesized performance waveform signal as a voice. To do.

  The performance waveform synthesis means synthesizes two performance waveform signals. The signals to be synthesized are the performance waveform signal obtained from the performance waveform data read from the waveform data recording means and the performance waveform signal generated by the performance waveform generation means. The former performance waveform signal is generated by, for example, another communication terminal device, transmitted and received in the form of performance waveform data, stored in waveform data recording means, and performances by other performers are recorded. The performance waveform synthesizing means generates a performance waveform signal from the performance waveform data recorded in the waveform data recording means, and synthesizes the performance waveform signal obtained by performing with the communication terminal device, thereby performing a plurality of performances. combine.

  The waveform data recording means records the performance waveform signal synthesized by the performance waveform synthesis means in the form of performance waveform data. The recorded performance waveform data can be transmitted to another communication terminal device by the transmission / reception function of the communication terminal device. The other communication terminal device stores the received performance waveform data in the waveform data recording means, reads out the performance waveform data, reproduces it and outputs it as a sound, and also performs the performance waveform by the performance of the other communication terminal device as described above. It can be synthesized with the signal and output as sound or recorded in the waveform data recording means.

  By repeating the above operation between a plurality of communication terminal devices, musical performance data composed of a predetermined part is generated.

  According to a second aspect of the present invention, there is provided a communication terminal device comprising: a linear detection means for detecting at least a contact position provided in a casing of a terminal body; and a performance for recording a detection signal of the detection means as performance data. Data recording means, performance waveform generation means for generating a performance waveform signal based on the detection signal of the detection means and / or the recorded detection signal, and output means for outputting the performance waveform signal as audio And

  In this second aspect, the detection signal of the detection means can be recorded as performance data, and a performance waveform signal can be generated based on this, or combined with performance data of other parts received from the outside.

  Furthermore, this invention can be made into the form of a performance system, and can employ | adopt either a 1st aspect and a 2nd aspect similarly to the communication terminal device mentioned above.

  A first aspect of the performance system of the present invention is a performance system that combines performances of a plurality of parts between a plurality of communication terminal devices, and performs transmission and reception between the communication terminal devices in a signal form of performance waveform data.

  The reproducing means reproduces the performance waveform signal obtained by the operation of the detecting means by the user, and outputs the solo performance of each performer as a voice. Further, by synthesizing and playing this performance waveform signal with both performance waveform signals obtained from performance waveform data received from the outside, it is possible to simultaneously output the performances of a plurality of players. The synthesized performance waveform signal can be transmitted as new performance waveform data to another communication terminal device.

  In a second aspect, the performance system of the present invention is a performance system that combines performances of a plurality of parts between a plurality of communication terminal devices, and each communication terminal device is a user provided in a casing of a terminal body. A detection means for detecting an operation, a performance data recording means for recording a detection signal of the detection means as performance data, and a performance waveform signal based on the detection signal of the detection means and / or the recorded detection signal. A performance waveform generation means, a reproduction means for reproducing the performance waveform signal, a transmission / reception means for transmitting and receiving data, and a conversion means for performing a conversion process between the detection signal and performance data. Uses a detection signal obtained by converting performance data of one or more parts received by the transmission / reception means and a part detection signal obtained from the detection means. A performance waveform signal is generated, and the performance waveform generation means is based on one or both of a part detection signal obtained from the detection means and a detection signal of another part generated from the performance data. The transmission / reception means adds performance data obtained by adding performance data obtained by converting a part detection signal obtained from the detection means to performance data of another part received by the transmission / reception means. It is characterized by transmitting.

  The performance data in the second aspect corresponds to the detection signal of the detection means. Data recording and transmission / reception is performed in the form of performance data. Therefore, if the received performance data includes a plurality of parts, any part can be selectively reproduced or edited. The performance data to be transmitted is added with the performance data of the part generated by the communication terminal device every time transmission / reception is performed between the communication terminal devices.

  According to the communication terminal device of the present invention, the communication terminal device can be provided with a performance function suitable for at least continuous pitch change. Further, according to the communication terminal device of the present invention, it is possible to have a function of generating performance data by a plurality of performers.

  According to the performance system of the present invention, performance data by a plurality of performers can be generated in each communication terminal device, and a performance by a plurality of performers can be performed using the generated performance data.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  First, a schematic configuration of the communication terminal apparatus of the present invention will be described with reference to FIG. FIG. 1 shows an outline of a communication terminal device. Although the communication terminal device 1 shows a configuration example of a mobile phone, the communication terminal device 1 is not limited to a mobile phone and can be any terminal device having a communication function.

  The communication terminal device 1 includes a linear detection unit 4 that can input at least one of a tone color, a pitch, and a volume in a part of the housing 2 in addition to the configuration that a mobile phone normally includes. FIGS. 1A, 1B, and 1C show a configuration example in which the detection unit 4 is provided on the side surface portion 3 of the housing 2, and FIG. The example of a structure provided in is shown.

  The detection unit 4 is a component of the performance means according to the present invention, and detects that the player has made contact with a part of the body (for example, a finger) at an arbitrary position in the elongated area extending linearly. The touched position is output as a detection signal. The communication terminal device 1 sets the pitch at the time of performance based on the position from the detection signal detected by the detection unit 4. For example, by associating the position on the straight line along the longitudinal direction of the detection unit 4 with the pitch, the pitch can be input at the contacted position. The timing of pronunciation and the length of sound are determined by the timing and length of contact. Similarly, a volume and tone can be input.

  In the case of a configuration including only one detection unit 4a as shown in FIGS. 1A and 1B, the detection unit is typically used to input a pitch. It is also possible to select which element of the volume is input and input the selected element. In addition, this selection part can utilize the number key with which the communication terminal device 1 is provided.

  In the case of a configuration including two detection units 4b and 4c as shown in FIG. 1C, the two detection units 4b and 4c are set so as to input two elements of a pitch and a timbre or volume. Selectable. For example, typically, two elements of pitch and volume are input. At this time, the timbre can be set by a numeric key provided in the communication terminal device 1.

  Moreover, the detection part 6 shown in FIG.1 (d) is the structure provided in the back surface part 5 of the housing | casing 2, Comprising: It is the shape of a curved line, ie, a ring shape or circular arc shape here. According to this configuration, the performer can perform the performance operation by turning his / her finger and obtain good operability. In addition, the length of the detection portion can be increased, so that the resolution can be increased. .

  When the numeric key is used, only the on / off can be detected because the stroke is short. However, in the detection unit of the present invention, the detection region that extends linearly on the side surface or the back surface of the housing 2 is used. By providing this, it is possible to widen the amount of change by utilizing the length and width of the housing 2.

  In addition, as an element which comprises a detection part, arbitrary sensors, such as a pressure sensor which detects the pressure of a piezoelectric element etc., a capacitance sensor which detects the fluctuation | variation of a capacity | capacitance, a resistance sensor which detects an electrical resistance, are applicable. .

  In addition to the above, in the configuration of the folding mobile phone, a detection is made by a connecting portion that rotatably connects a housing provided with an operation portion including numeric keys and a housing provided with a display portion. A tone color, a pitch, a sound volume, etc. can also be input according to the rotation angle in a connection part.

  FIG. 2 is a block diagram for explaining the system configuration of the communication terminal apparatus 1 of the present invention. In FIG. 2, control of each unit 202 to 212 is controlled by a control unit 201 such as a CPU (Central Processing Unit) via a control line 230, and data movement between each unit 204 to 209 is performed via a data line 231. . The control unit 201 performs predetermined control in accordance with a program or a command input from the operation unit 202.

  The operation unit 202 is a part for inputting each operation included in the communication terminal device, and can be configured by various operation keys such as numeric keys.

  The display unit 203 is a display part included in the communication terminal device, and can be configured by, for example, a liquid crystal display device.

  The recording unit 204 includes a ROM that is a nonvolatile read-only memory in which programs, font data, and the like are recorded, and a RAM that is a readable / writable memory for temporarily recording data. The ROM may include a rewritable memory. The recording unit 204 records performance waveform data, performance data, and the like obtained by the performance waveform synthesis unit 208 by synthesizing the performance waveform received by the communication unit 205 or generated by the performance waveform generation unit 207.

  The communication unit 205 is a transmission / reception unit that transmits a transmission wave from the antenna 220 and receives a reception signal received by the antenna 220. The voice processing unit 207 is a part that performs voice processing by the communication terminal device, converts a voice signal input from a microphone (not shown) into digital data, and further transmits the data as transmission data by data processing such as compression. Output to. Further, the received data from the communication unit 205 is expanded and converted into an analog audio signal, and the audio is output from the speaker 222 via the I / F unit 210. In the present embodiment, performance waveform data obtained by performance is also converted into an analog voice signal and output as a voice.

  The performance waveform generation unit 208 receives the detection signal from the detection unit 221 that detects a performance operation, and modulates the waveform data prepared in the sound source unit 206 to generate a performance waveform signal.

  Here, the performance waveform signal is a waveform signal obtained by modulating the waveform data of the sound source unit 206 with the detection signal from the detection unit 221. On the other hand, the detection signal is a control signal formed by the detection signal from the detection unit 221, and the waveform signal can be generated by modulating the waveform data of the sound source unit 206.

  The performance waveform signal generated by the performance waveform generation unit 208 can be output as an audio signal by driving the speaker 222 and can also be recorded in the recording unit 204.

  The performance waveform synthesis unit 209 synthesizes the performance waveform signal generated by the operation of the detection unit 221 and the performance waveform signal received from another communication terminal device 1. The performance waveform signal obtained by the synthesis is output as an audio signal by driving the speaker 222 or recorded in the recording unit 204. By generating performance waveform signals for each part and synthesizing these performance waveform signals by the performance waveform synthesis unit 209, a plurality of parts can be played simultaneously. Furthermore, the number of parts to be played simultaneously can be increased by adding performance waveform signals for parts.

  When a performance waveform signal is used as the form of a signal to be recorded, the performance waveform signal is recorded as one signal. Therefore, when the performance waveforms of a plurality of parts are superimposed on the performance waveform signal, the original waveform is recorded. A new performance waveform signal obtained by performing the performance waveform signal is overwritten.

  On the other hand, as described later in detail, when performance data corresponding to a detection signal is used as the form of a signal to be recorded, the performance data is recorded as data for each element such as tone color, pitch, and volume of each part. When the performance of a plurality of parts is overlapped in the performance data, the performance data of the new part obtained by the performance is added to the original performance signal. Therefore, the performance data of each part is maintained as it is.

  The I / F unit 210 is means for connecting the detection unit 221 and the speaker 222 to the control line 230 and the data line 231.

  Hereinafter, the first aspect of the communication terminal apparatus of the present invention will be described with reference to FIGS. 3 to 9, and the second aspect of the communication terminal apparatus of the present invention will be described with reference to FIGS. An embodiment of the performance system will be described with reference to FIGS.

  First, the first aspect of the communication terminal device of the present invention will be described. In the first aspect, the performance waveform signal generated by the performance of the communication terminal device is converted into performance waveform data and transmitted, and the received performance waveform data is converted and reproduced as a performance waveform signal. Also, a plurality of parts are played by synthesizing waveforms in the state of the performance waveform signal.

  FIG. 3 is a block diagram for explaining a functional configuration of the first aspect of the communication terminal apparatus of the present invention. In FIG. 3, a performance unit 301 generates a performance waveform signal in response to a performance operation by a user, and drives the playback unit 302 with the generated performance waveform signal to output sound.

  The performance unit 301 includes a selection unit 301a, a sound source unit 301b, a detection unit 301c, and a performance waveform generation unit 301d. The sound source unit 301b records waveform data of timbres of musical instruments such as drums, basses, and guitars, and can be selected from the selection unit 301a.

  For example, the selection unit 301a can use a numeric key provided in the communication terminal device, and can associate a numeric key with the tone color of each musical instrument and select a tone color by pressing the numeric key.

  The detection unit 301c detects a position or pressure with which a finger or the like is in contact with the sensor shown in FIG. 1, and performs a performance operation by associating the detection signal with a pitch or volume on the time axis.

  The performance waveform generation unit 301d modulates the waveform data from the sound source unit 301b with the detection signal from the detection unit 301c, and generates a performance waveform signal similar to the performance of the musical instrument. Here, the performance waveform signal is an analog waveform signal, and is amplified by the amplifier 302a of the reproduction unit 302 to drive the speaker 302b and output the sound. Since the performance waveform signal is obtained by modulating the waveform data of the sound source in accordance with the performance operation, the sound output by the voice has the same tone as when the instrument is played.

  The generated performance waveform signal can be encoded in the form of performance waveform data by the encoder 306 and recorded in the waveform data recording unit 304. The recorded performance waveform data can be decoded by the decoder 305 into the form of a performance waveform signal. The decoded performance waveform signal can be played back by the playback unit 302 and output as audio.

  The waveform data recording unit 304 can record the performance waveform signal received by the transmission / reception unit 310 provided in the communication terminal device. The received performance waveform signal is a performance waveform signal played by another communication terminal device.

  The recorded performance waveform data is decoded into a performance waveform signal form by the decoder 305 and sent to the performance waveform synthesis unit 303. The performance waveform signal generated by the performance unit 301 is also input to the performance waveform synthesis unit 303, and the performance waveform signal obtained by reception and the performance waveform signal generated by the performance unit 301 can be synthesized. . The synthesized performance waveform signal is a waveform signal obtained by superimposing two performance waveform signals, and the synthesized performance waveform signal is reproduced by the reproduction unit 302 and output as a sound, so that a plurality of parts are played at the same time. Sound can be generated.

  By using this performance waveform synthesis, for example, a performance waveform signal in which the performance of the bass part is recorded is received from another communication terminal device, and the performance unit 301 selects a guitar sound source and performs the performance. When the performance waveform signal of the part is generated, and the performance waveform signal of the bass part and the performance waveform signal of the guitar part are synthesized in the performance waveform synthesis unit 303 and reproduced by the reproduction unit 302, the bass and guitar parts are simultaneously reproduced. Sounds similar to those played can be output.

  The performance waveform signal synthesized by the performance waveform synthesis unit 303 is encoded in the form of performance waveform data by the encoder 306, recorded in the waveform data recording unit 304, decoded by the decoder 305, and reproduced by the reproduction unit 302. In addition to reproduction, the data can be transmitted to another communication terminal device by the transmission / reception unit 310 (corresponding to the communication unit 205 in FIG. 2).

  The communication terminal device that has received this transmission signal can generate a performance waveform signal by performing reproduction or superimposing performances of different parts by the same operation as described above.

  FIG. 4 is a flowchart for explaining an operation example in the configuration example shown in FIG. 3, and FIG. 5 shows an example of a guidance screen displayed on the communication terminal device.

  When an application for performing a performance is started, a guidance screen (FIG. 5A) for selecting a timbre is displayed. For example, parts such as drums, basses, guitars, and vocals are displayed on the guidance screen, and a sound source of a corresponding tone color is selected by selecting the part. If a vocal is selected, in addition to selecting a vocal sound source, voice input may be selected by a microphone without selecting a sound source (S1).

  Next, a guidance screen for selecting a performance mode (FIG. 5B) is displayed, and a performance mode is selected (S2). The performance mode includes, for example, a solo mode and a mix mode. The solo mode is a mode in which the performer performs alone and does not synthesize performance waveforms. On the other hand, the mix mode is a mode in which a performance waveform signal is generated by performing by a performer while a performance waveform signal already played and recorded is reproduced, and these performance waveform signals are synthesized.

  When the mixed mode is selected, a guidance screen for selecting a reproduction file (FIG. 5C) is displayed, and a reproduction file is selected (S3). In the reproduction file, already generated performance waveform signals are recorded, and can be received and recorded from other communication terminal devices by the transmission / reception unit of the communication terminal device. Further, when a playback file is not recorded in the recording unit, it may be acquired by connecting to another communication terminal device.

  If part information is set in the acquired playback file, the part information can be displayed on a guidance screen (FIG. 5D) to check the performance state of the part. In the example of FIG. 5D, it is possible to confirm that the performance waveform signal has already been generated for the drum part, but the other parts (bass, guitar, vocal) are not yet performed. In the confirmation of the part information, the timbre may be changed if it overlaps with the already selected timbre part.

  Performance waveform synthesis by the performance waveform synthesis unit (mixer) is set (S4), and a performance is performed (S5). When displaying a guidance screen (FIG. 5 (e)) for selecting whether to record a performance and recording a performance waveform signal generated by the performance, the recording data of the waveform data recording unit 304 is updated (S8). If the recording is not performed, the generated performance waveform signal is deleted (S7).

  Next, a guide screen (FIG. 5 (f)) on whether or not to transmit the song data to the performer is displayed, and the recorded performer waveform signal is transmitted to the next performer or the next performer of the received performance waveform signal. Transfer to. The transmission destination displays a guidance screen (FIG. 5G) for selecting a transmission destination, and transmits it to the selected transmission destination displayed on the guidance screen (FIG. 5H).

  6 and 7 are a schematic diagram and an operation state diagram for explaining an operation example between the communication terminal devices by the performance system of the present invention. FIG. 8 shows an example of a guidance screen.

  In the example shown in FIGS. 6 and 7, four performance parts, Part A to Part D, are shared and played by Mr. A to D, and all part data obtained by synthesizing the performances of each part is played by the performer. Shown when sending to everyone.

  Here, the first sender is Mr. A, and it is shown that the message is sent in the order of Mr. B, Mr. C, and Mr. D, but the sending order should be set in advance at Mr. A who is the sender. Alternatively, the receiver can arbitrarily select and set the next transmission destination. When the transmission order is set in advance at the transmission source, the transmission source sets the data of the transmission destination sequence, sends this sequence data together with the performance waveform signal, and the receiving side transmits the next transmission according to the data of the transmission destination sequence. The player who is set at the end of the transmission order repeats the previous sending operation, and transmits the generated performance waveform signal to all the persons set in the transmission destination order data.

  Mr. A, who is the transmission source, plays the part A and plays the drum part (1), generates and records a performance waveform signal (2), and transmits it to the next Mr. B (3). Mr. B receives the performance waveform signal transmitted from Mr. A (4), reproduces the performance waveform signal sent in charge of Part B (5), plays the bass part (6), and mixes. Then, a performance waveform signal in which part B is superimposed on part A is generated and recorded (7) and transmitted to the next Mr. C (8).

  Mr. C receives the performance waveform signal transmitted from Mr. B (9), plays the performance waveform signal sent in charge of Part C (10), plays the guitar part (11), and mixes. Then, a performance waveform signal in which part C is superimposed on part A and part B is generated and recorded (12), and transmitted to the next Mr. C (13).

  Mr. D receives the performance waveform signal transmitted from Mr. C (14), plays the performance waveform signal sent in charge of Part D (15), plays the vocal part (16), and mixes it. Then, a performance waveform signal in which part D is superimposed on part A, part B, and part C is generated and recorded (17) to complete all parts.

  Mr. D sends all completed parts to Mr. A, Mr. B, and Mr. C (18).

  Mr. C, B, and A receive the performance waveform signal sent from Mr. D (19, 20, 21) and reproduce it (22, 23, 24).

  Next, an example of a guidance screen in the case where the part in charge of the performer is not set in advance and the receiver performs with reference to the unperformed part will be described with reference to FIG.

  The example of the guidance screen shown in FIG. 8A shows an example of the guidance screen when the sender selects the drum part and when the next recipient receives it. In this case, a check is added to the drum part, indicating that the bass part, guitar part, and vocal part are not yet played.

  The following guide screen example shown in FIG. 8B shows a guide screen example when the first receiver selects the guitar part and when the second receiver receives the guide part. In this case, a check is added to the drum part and the guitar part, indicating that the bass part and vocal part are not yet played.

  The following guide screen example shown in FIG. 8C shows a guide screen example when the second receiver selects the base part and when the third receiver receives the guide part. In this case, the drum part, the guitar part, and the bass part are checked, indicating that the vocal part is not yet played.

  The following guidance screen example shown in FIG. 8D shows a guidance screen example when the third last recipient selects the vocal part. In this case, a check is added to the drum part, guitar part, bass part, and vocal part, indicating that all parts have been played.

  FIG. 9 is a diagram for explaining a data configuration example of a reproduction file in the first mode.

  The reproduction file includes, for example, a header part for bibliographic items of the reproduction file and a performance waveform data part for recording performance waveform data.

  The header section includes, for example, title information indicating the title name of the performance, the number of parts constituting the performance (for example, “4” if the performance is composed of four parts), and the contents of each part (for example, drum, bass, etc.) , Guitar, vocal, etc.), player information representing the name of the player who played each part, and the like.

  The performance waveform data is data obtained by encoding the performance waveform signal as described above. The performance waveform of each part by each performer is synthesized, and the performance waveform signal is output by the playback unit by being converted to the performance waveform signal by the decoder. can do.

  Next, a second aspect of the communication terminal apparatus of the present invention will be described. In the second aspect, the performance of each part of the communication terminal device is transmitted in the form of performance data representing performance elements of timbre, pitch, and volume, and the sound source is selected and modulated using the received performance data. Play the performance. Also, a performance by a plurality of parts is performed by synthesizing at the performance data stage and modulating the sound source according to the synthesis result.

  FIG. 10 is a block diagram for explaining a functional configuration of the second aspect of the communication terminal apparatus of the present invention. In FIG. 10, a performance unit 1001 generates a performance waveform signal in response to a performance operation by the user, and drives the playback unit 1003 with the generated performance waveform signal to output sound.

  The performance unit 1001 includes a selection unit 1001a, a sound source unit 1001b, a detection unit 1001c, and a performance waveform generation unit 1001d.

  Here, the selection unit 1001a, the sound source unit 1001b, and the detection unit 1001c are the same as the selection unit 301a, the sound source unit 301b, and the detection unit 301c shown in FIG.

  Similar to the performance waveform generation unit 301d shown in FIG. 3, the performance waveform generation unit 1001d modulates the waveform data from the sound source unit 301b with the detection signal from the detection unit 301c, and performs the same performance waveform as when the musical instrument is played. In addition to generating a signal, the waveform data can also be modulated by a detection signal (and a selection signal) obtained by decoding performance data recorded in a performance data recording unit 1004 to be described later. A performance waveform signal can be generated based on performance data that has been played or performance data that has been played by the player, and the sound can be output by the playback unit 1002.

  The performance waveform signal output from the performance waveform generation unit 1001d is the same waveform signal as the output of the performance waveform generation unit 301d shown in FIG. 3, and is amplified by the amplifier 302a of the reproduction unit 302 to drive the speaker 302b and generate sound. Output. Since the performance waveform signal is obtained by modulating the waveform data of the sound source in accordance with the performance operation, the sound output by the voice has the same tone as when the instrument is played.

  In the first mode shown in FIG. 3, the performance waveform is synthesized by synthesizing the performance waveform signal by the performance waveform synthesis unit 303, whereas in the second mode, the performance waveform generation unit 1001d is synthesized. To do.

  As described above, the performance waveform generation unit 1001d receives the performance detection signal from the detection unit 1001c and the recorded performance detection signal, and modulates the waveform data based on the synthesized signal. Therefore, the performance waveform signal is generated and output from the performance waveform generator 1001d by synthesizing the current performance and the existing performance.

  Therefore, the performance waveform generation unit 1001 of the second mode has both the function of the performance generation unit 301d of the first mode and the function of the performance waveform synthesis unit 303.

  The detection signal detected by the detection unit 1001c by the performance operation by the user and the selection signal of the operation unit (selection unit) 1001a for selecting a timbre are encoded in the form of performance data by the encoder 1006 and stored in the performance data recording unit 1004. Record in the temporary memory 1004a. The performance data recorded in the temporary memory 1004a records the performance by the performer. The performance data received from the transmission / reception unit 1010 is recorded in the memory 1004b of the performance data recording unit 1004. The performance data recorded in the memory 1004b records performances already performed by other performers.

  Therefore, the performance data recording unit 1004 records both performance data of performance data currently played by the performer and performance data already played by other performers received via the transmission / reception unit 1001.

  Here, the performance data can be recorded in a performance data format in which each part of tone, pitch, and volume is coded for each part. By using this data format, a plurality of players can be recorded. It is possible to record each part of the performance tone, pitch, and volume of each part according to. Also, playback and editing for each part, or combination playback of any part can be performed.

  The performance data recorded in the memory 1004a and the memory 1004b of the performance data recording unit 1004 can be individually or simultaneously decoded into the original detection signal and selection signal form by the decoder 1005. The selection signal obtained by decoding is used for selecting waveform data by the sound source unit 1001b. The detection signal obtained by decoding is converted into a performance waveform signal by the performance waveform generator 1001d using the selected waveform data. The performance waveform signal generated in this way can be reproduced by the reproduction unit 1002 and output as sound.

  When the performance data recorded in the memory 1004a is used, the performance by the performer is reproduced. When the performance data recorded in the memory 1004b is used, the performance already performed by another performer is reproduced. Will do. Further, when both performance data recorded in the memory 1004a and the memory 1004b are used at the same time, the performance by the performer and the other performances by other performers is played back, which is the same as when a plurality of parts are performed at the same time. Sound can be generated. Also, when playing the performances of other performers, they can be played back by part.

  Whether to perform playback from one's own performance, playback from another player, playback by part, simultaneous playback of multiple parts, or the like is input to the performance waveform generation unit 1001d according to the operation of the operation unit 202 by the user. This can be done by selecting a signal. When the detection signal from the detection unit 1001d is input, the actual performance can be output as voice, and when the detection signal obtained by decoding the performance data recorded in the temporary memory 1004a is input, the performance is reproduced. When the detection signal obtained by decoding the performance data recorded in the memory 1004b is input, the performance of another player can be reproduced, and the part is specified from the performance data recorded in the memory 1004b. When the detection signal obtained by decoding is input, the performance for each part can be reproduced, and the detection obtained by decoding the performance data recorded in the temporary memory 1004a and the performance data recorded in the memory 1004b. When inputting a signal, a plurality of parts can be played simultaneously.

  With this configuration, for example, performance data in which a performance of a base part is recorded is received from another communication terminal device, and a guitar sound source is selected and played by the performance unit 1001 to detect the guitar part. When the signal is generated and the waveform data is modulated by the performance waveform generation unit 1001d with the detection signal of the bass part and the detection signal of the guitar part and reproduced by the reproduction unit 1002, the bass and guitar parts are played simultaneously. Can output the same sound.

  Performance data recorded in the temporary memory 1004a can be written in the memory 1004b. As a result of this writing, performance data is recorded in the memory 1004b for all the played parts.

  The performance data of each part recorded in the memory 1004b can be decoded by the decoder 1005 and reproduced by the reproduction unit 1002, and can be transmitted to other communication terminal devices by the transmission / reception unit 1010.

  The communication terminal device that has received this transmission signal can reproduce it by an operation in the same manner as described above, or can generate a performance waveform signal by superimposing performances of other parts.

  FIG. 11 is a flowchart for explaining an operation example in the configuration example shown in FIG. An example of the guidance screen displayed on the communication terminal device will be described with reference to FIG.

  When an application for performing a performance is started, a guidance screen (FIG. 5A) for selecting a timbre is displayed. For example, parts such as drums, basses, guitars, and vocals are displayed on the guidance screen, and a sound source of a corresponding tone color is selected by selecting the part. If a vocal is selected, in addition to selecting a vocal sound source, voice input may be selected by a microphone without selecting a sound source (S11).

  A guidance screen for selecting a playback file (FIG. 5C) is displayed, and a playback file is selected. The performance data already generated is recorded in the reproduction file, and can be received and recorded from another communication terminal device by a transmission / reception unit provided in the communication terminal device. If no playback file is recorded in the performance data recording unit 1004, it may be obtained by connecting to another communication terminal device (S12).

  If part information is set in the acquired playback file, the part information can be displayed on a guidance screen (FIG. 5D) to check the performance state of the part. In the example of FIG. 5D, it is possible to confirm that the performance waveform signal has already been generated for the drum part, but the other parts (bass, guitar, vocal) are not yet performed. In the confirmation of the part information, the timbre may be changed if it overlaps with the already selected timbre part. The part to be reproduced is selected with reference to the part information, and the performance of the selected part is reproduced (S13).

  A performance is performed in accordance with the reproduction, and the performance data of the player is recorded in a temporary memory (S15). The player's performance recorded in the temporary memory 1004a can be replayed by repeating the steps (S13) to (S15), and the performance data can be updated (S16).

  A guidance screen (FIG. 5 (e)) for selecting whether to record the performance is displayed (S17), and when the performance data generated by the performance is recorded, the performance data in the temporary memory 1004a is updated (S19). When recording is not performed, the performance data in the temporary memory 1004a is erased (S18).

  As in the first mode described above, the performance data is transmitted by displaying a guidance screen (FIG. 5 (f)) on whether or not to transmit the song data to the performer, and to the next performer of the recorded performance waveform signal. Or the received performance waveform signal is transferred to the next performer. The transmission destination displays a guidance screen (FIG. 5G) for selecting a transmission destination, and transmits it to the selected transmission destination displayed on the guidance screen (FIG. 5H).

  FIG. 12 is an operation state diagram for explaining an operation example between communication terminal apparatuses in the performance system according to the second aspect of the present invention. FIG. 13 shows an example of a guidance screen.

  In the example shown in FIG. 12 and FIG. 13, four performance parts, Part A to Part D, are transmitted sequentially from Mr. A to Mr. F, among which A, C, E, and F share the performance. B and D do not participate in the performance. The completed performance data is sent to the transmission destination, and the transmission destination can be all performers, all the transmitters, or an arbitrarily determined transmission destination. In the following description, a source that transmits performance data first is referred to as a transmission source, and a source that transmits performance data to a receiver is referred to as a transmission source.

  Here, the first sender is Mr. A, and B, C, D, E, and F are shown in this order, but the transmission order is the same as in the first mode described above. It can be set in advance at the stage of Mr. A who is the transmission source, or the receiver may arbitrarily select and set the next transmission destination. When the transmission order is set in advance at the transmission source, the transmission source sets the data of the transmission destination sequence, sends this sequence data together with the performance waveform signal, and the receiver transmits the next transmission according to the data of the transmission destination sequence. The player who is set at the end of the transmission order repeats the previous operation, and transmits the generated performance waveform signal to all the members set in the transmission destination order data.

  Mr. A who is the transmission source is in charge of Part A, plays the drum part (31), generates and records performance data (32), and transmits it to the next Mr. B (33).

  Mr. B receives the performance data transmitted from Mr. A (34), reproduces the received performance data (35), selects the transmission destination without performing the performance (36), and receives the received performance data. Is transferred (37).

  Mr. C receives the performance data transferred from Mr. B (38), plays the performance data sent in charge of Part C, plays the guitar part (39), and records the performance data of Part C. (40), the transmission destination is selected (41), and the received performance data and the performance data that has been played are transmitted to the next Mr. D (42).

  Mr. D receives the performance data transmitted from Mr. B (43), selects the transmission destination without reproducing the received performance data or performing the performance (44), and receives the received performance data. Is transferred to Mr. E (45).

  E receives the performance data transferred from Mr. D (46), plays the performance data sent in charge of Part B, plays the bass part (47), and records the performance data of Part B (48), the transmission destination is selected (49), and the received performance data and the performance data received are transmitted to the next Mr. F (50).

  Mr. F receives the performance data transferred from Mr. E (51), plays the performance data sent in charge of Part D, plays the vocal part (52), and records the performance data of Part D. (53). Mr. F transmits the performance data of all completed parts to the selected transmission destination (54).

  The receiver can reproduce all the parts by reproducing the performance data, and can also extract and reproduce each part. In addition, the selected part can be replaced with performance data of each performance.

  FIG. 14 is a diagram for explaining a data configuration example of a reproduction file in the second mode.

  Similar to the playback file of the first aspect, the playback file includes a header portion for the bibliographic items of the playback file and a performance waveform data portion for recording performance waveform data. Since the header part can be the same as that of the first aspect, description thereof is omitted.

  The performance data is data obtained by encoding the detection signal as described above. The performance data for each part by each player is recorded, and the performance waveform is generated by the performance waveform generation unit by converting the detection data into the detection signal by the decoder. The signal can be converted into a signal and output by the playback unit.

  The performance data can include data for each element constituting the performance. For example, the part A data includes drum tone color data, pitch data, and volume data, and the part B data includes base tone color data, pitch data, and volume data.

  FIG. 15 is a diagram for explaining an example of writing data in a reproduction file. FIG. 15A shows the setting of the reproduction file by the transmission source and the writing state of the first performance data. In this example, when the transmission source sets “4” as the number of parts in the header part, four part items of part A to part D are set in the part information in the header part, and part in the player information in the header part. Performer items corresponding to the four parts A to D are set. In the performance data section, four data areas of part A to part D are set in accordance with the number of parts.

  After the playback file is set, when the first performer performs the performance for part A and records the performance data of part A (for example, a drum part), the performer name is written in part A of the part information, and the performance is performed. In the data area of part A of the data, drum tone color data, drum pitch data, and drum volume data are written.

  FIG. 15B shows a state in which performance data is written by the next performer. When the next performer performs a performance for part B and records the performance data of part B (for example, the base part), the player name is written in part B of the part information, and the data area of part B of the performance data is recorded. Are written with timbre data of the base, pitch data by the base, and volume data by the base.

  Below, the usage example of the performance system using the communication terminal device of this invention is demonstrated using FIGS.

  An example of the performance system shown in FIG. 16 is a mode in which performance data is generated by various combinations of performers in charge of a plurality of parts by exchanging performance data between the communication terminal devices.

  For example, performance data is transmitted and received between the communication terminal devices arbitrarily among the four communication terminal devices for A to D. The receiver selects an arbitrary part from the empty parts, performs the performance, records the performance data, and transmits it to the next communication terminal device. When there are more empty parts, the next receiver selects an arbitrary part from the empty parts, performs the performance, records the performance data, and transmits it to the next communication terminal apparatus.

  By repeating the above operation until there are no more empty parts, performance data of various combinations of parts and performers can be generated.

  For example, when performance data is generated between four communication terminal devices for four parts, 24 combinations are possible.

  Another example of the performance system shown in FIG. 17 is that the performance data is transmitted from the communication terminal device to the plurality of communication terminal devices, and the received plurality of communication terminal devices add the performance data, and then each of the plurality of communication terminal devices. In this mode, a large number of pieces of performance data are generated one after another by repeating the operation of transmitting performance data.

  For example, when performing a performance of four parts, after transmitting to one communication terminal device from one communication terminal device as a transmission source, each communication terminal device is transferred to each of n communication terminal devices at each reception stage. When the performance data is transmitted, n cubed performance data can be generated.

  In this performance system, for example, performance data is generated by transmitting a theme of music from a transmission source, creating performance data by a large number of players based on the theme, and returning completed performance data to the transmission source. Can be configured. The sender can compete the performance among the performers by evaluating the returned performance data.

  FIG. 18 shows an example of the data structure of a reproduction file in the performance system of FIG. In this reproduction file, in the data structure of the reproduction file shown in FIG. 14, the route information is added to the header portion, the path route of the generated performance data is recorded, and the history of the performance data is recorded together with the player information. Thus, the performance data may be identified.

  In the performance system of the present invention, by using the communication terminal device of the present invention, a plurality of performers can combine the performance data of each part and enjoy the same performance as if the performers performed at the same place at the same time. it can. In addition, performance data by various performers can be generated.

  The communication terminal device of the present invention is not limited to a mobile phone and can be applied to various types of communication terminal devices such as a PC having a communication function.

It is a figure for demonstrating schematic structure of the communication terminal device of this invention. It is a block diagram for demonstrating the system configuration | structure of the communication terminal device of this invention. It is a block diagram for demonstrating the function structure of the 1st aspect of the communication terminal device of this invention. It is a flowchart for demonstrating the operation example in the structural example of the 1st aspect of the communication terminal device of this invention. It is an example of the guidance screen displayed on the communication terminal device of this invention. It is the schematic for demonstrating the operation example between the communication terminal devices by the performance system of this invention. It is an operation | movement state diagram for demonstrating the operation example between the communication terminal devices by the performance system of this invention. It is a figure for demonstrating the example of a guidance screen displayed on the communication terminal device of this invention. It is a figure for demonstrating the data structural example of the reproduction | regeneration file in a 1st aspect. It is a block diagram for demonstrating the function structure of the 2nd aspect of the communication terminal device of this invention. It is a flowchart for demonstrating the operation example in the structural example of the 2nd aspect of the communication terminal device of this invention. It is an operation | movement state diagram for demonstrating the operation example between the communication terminal devices in the performance system by the 2nd aspect of this invention. It is an example of the guidance screen displayed on the communication terminal device of this invention. It is a figure for demonstrating the data structural example of the reproduction | regeneration file in a 2nd aspect. It is a figure for demonstrating the example of the data writing of the reproduction | regeneration file in the performance system of this invention. It is a figure for demonstrating the usage example of the performance system using the communication terminal device of this invention. It is a figure for demonstrating the usage example of the performance system using the communication terminal device of this invention. It is a figure for demonstrating the example of a data structure of the reproduction | regeneration file at the time of the performance system of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Communication terminal device, 2 ... Housing | casing, 3 ... Side part, 4, 4a, 4b, 4c ... Detection part, 5 ... Back part, 6 ... Detection part, 201 ... Control part, 202 ... Operation part, 203 ... Display , 204 ... Performance data recording unit, 205 ... Communication unit, 206 ... Sound source unit, 207 ... Audio processing unit, 208 ... Performance waveform generation unit, 209 ... Performance waveform synthesis unit, 210 ... I / F unit, 221 ... Detection unit , 222, speaker, 230, control line, 231, data line, 301, performance unit, 301a, selection unit, 301b, sound source unit, 301c, detection unit, 301d, performance waveform generation unit, 302, playback unit, 302a, amplifier , 302b ... speaker, 303 ... performance waveform synthesis unit, 304 ... waveform data recording unit, 305 ... decoder, 306 ... encoder, 310 ... transmission / reception unit, 1001 ... performance unit, 1001a ... selection unit, 1001b Sound generator unit, 1001c ... detection unit, 1001d ... performance waveform generation unit, 1002 ... reproduction unit, 1002a ... amplifier, 1002b ... speaker, 1004 ... performance data recording unit, 1004a ... temporary memory, 1004b ... memory, 1005 ... decoder, 1006 ... Encoder, 1010... Transceiver unit.

Claims (12)

Linear detection means for detecting at least the contact position provided in the casing of the terminal body;
A performance waveform generating means for generating a performance waveform signal based on the detection signal of the detection means;
A communication terminal apparatus comprising: output means for outputting the performance waveform signal generated by the performance waveform generation means by voice. Waveform data recording means for recording the performance waveform signal as performance waveform data;
A performance waveform synthesis means for synthesizing a plurality of performance waveform signals;
The performance waveform synthesis means synthesizes a performance waveform signal obtained from the performance waveform data read from the waveform data recording means and the performance waveform signal generated by the performance waveform generation means,
The communication terminal apparatus according to claim 1, wherein the output unit outputs the synthesized performance waveform signal by voice.   The transmission / reception means transmits the performance waveform signal generated by the performance waveform generation means and / or the performance waveform signal synthesized by the performance waveform synthesis means as performance waveform data. The communication terminal device according to 1. Linear detection means for detecting at least the contact position provided in the casing of the terminal body;
Performance data recording means for recording the detection signal of the detection means as performance data;
A performance waveform generating means for generating a performance waveform signal based on the detection signal of the detection means and / or the recorded detection signal;
A communication terminal apparatus comprising output means for outputting the performance waveform signal by voice.   5. The communication terminal apparatus according to claim 4, wherein the transmission / reception means transmits the detection signal of the detection means and / or the recorded detection signal as performance data. The performance waveform generating means combines the detection signal of the detection means and the detection signal obtained from the performance data recording means,
5. The communication terminal apparatus according to claim 4, wherein the output means outputs the synthesized performance waveform signal as a voice. The performance data recording means has a first recording area for temporarily recording performance data corresponding to a detection signal of the detection means, and a second recording area for recording performance data received by the transmission / reception means,
6. The communication terminal apparatus according to claim 5, wherein the performance waveform generating means generates a performance waveform signal based on performance data read from the first and second recording areas. The performance data recording means has a function of recording performance data for each part,
5. The communication terminal apparatus according to claim 4, wherein the performance waveform generating means generates a performance waveform signal based on performance data of a plurality of parts. An operation unit including operation keys and a sound source having a plurality of sound source waveform data corresponding to a plurality of timbres,
The performance data recording means records the detection signal of the detection unit together with the selection signal of the sound source waveform data by operation of the operation key as performance data,
The said performance waveform generation means produces | generates a performance waveform signal by modulating the sound source waveform data selected based on the said selection signal based on the said detection signal. The communication terminal device described. A performance system that combines performances of a plurality of parts between a plurality of communication terminal devices,
Each communication terminal device
Detecting means for detecting a user operation provided in the casing of the terminal body;
A performance waveform generating means for generating a performance waveform signal in accordance with a detection signal of the detection means;
Reproducing means for reproducing the performance waveform signal;
A transmission / reception means for transmitting / receiving data;
Performance waveform synthesizing means for synthesizing the performance waveform signal by adding the performance waveform signal of the part obtained according to the detection signal of the detection means to the performance waveform signal of one or more parts received by the transmission / reception means; ,
The reproduction means reproduces a performance waveform signal obtained by synthesizing one or both of the performance waveform signal obtained according to the detection signal of the detection means and the performance waveform signal corresponding to the performance waveform data received by the transmission / reception means. And
The performance system is characterized in that the transmitting / receiving means transmits the synthesized performance waveform signal as performance waveform data. A performance system that combines performances of a plurality of parts between a plurality of communication terminal devices,
Each communication terminal device
Detecting means for detecting a user operation provided in the casing of the terminal body;
Performance data recording means for recording the detection signal of the detection means as performance data;
A performance waveform generating means for generating a performance waveform signal based on the detection signal of the detection means and / or the recorded detection signal;
Reproducing means for reproducing the performance waveform signal;
A transmission / reception means for transmitting / receiving data;
Conversion means for performing conversion processing between the detection signal and performance data,
The performance waveform generating means generates a performance waveform signal using a detection signal obtained by converting performance data of one or more parts received by the transmitting / receiving means and a part detection signal obtained from the detection means. And
The performance waveform generation means generates a performance waveform signal based on one or both of the detection signal of the part obtained from the detection means and the detection signal of the other part generated from the performance data,
The transmission / reception means transmits performance data obtained by adding performance data obtained by converting a part detection signal obtained from the detection means to performance data of another part received by the transmission / reception means. Characteristic performance system. Each of the communication terminal devices includes an operation unit including operation keys and a sound source having a plurality of sound source waveform data corresponding to a plurality of timbres,
The performance data recording means records the detection signal of the detection unit together with the selection signal of the sound source waveform data by operation of the operation key as performance data,
The performance system according to claim 11, wherein the performance waveform generation means generates a performance waveform signal by modulating sound source waveform data selected based on the selection signal based on the detection signal.

Images