JP3551000B2 - Automatic performance device, automatic performance method, and medium recording program - Google Patents

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an automatic performance technique, and more particularly to an automatic performance technique for generating a musical tone by combining a performance of a player and an automatic performance.
[0002]
[Prior art]
One of the uses of the automatic performance device is that the player plays the main melody while automatically performing the accompaniment. For example, the automatic accompaniment function of an electronic musical instrument and karaoke correspond to this. In the case of an automatic accompaniment of an electronic musical instrument, for example, an ensemble is completed by, for example, a player playing a piano and automatically playing a bass or drums to be an accompaniment. On the other hand, in karaoke, an instrumental sound of an accompaniment is automatically performed, and a player sings the main melody to complete an ensemble. This allows the player to enjoy playing in a more organized environment than when playing alone.
[0003]
The invention is particularly, but not exclusively, suitable for automatic performance devices for karaoke. Hereinafter, a karaoke automatic performance device will be described as an example.
[0004]
At present, among songs sung in karaoke, in addition to the sound of the main melody sung by the performer (hereinafter referred to as "main sound"), other sounds in the form of chorus and round singing (hereinafter "secondary sound") ) May be included. These secondary voices may be sung by a different singer than the main voice, such as chorus or chorus, or by repeating the voice of the main voice singer, the secondary voice may be sung by the same singer. Sometimes sung.
[0005]
In karaoke, since there is usually only one player, only the main voice part can be sung, and it is difficult to sing the secondary voice part. However, in order to faithfully reproduce the atmosphere of the music, it is important to reproduce the sub-voice portion.
[0006]
In a conventional automatic performance apparatus for karaoke, there are roughly two types of techniques for reproducing a secondary voice.
[0007]
As a first technique, there is a method of recording a secondary voice portion in data to be automatically played in advance and reproducing the portion.
[0008]
As a second technique, there is a method of performing processing such as a delay or a pitch change on a main sound, such as an echo, to process an original sound, thereby generating a pseudo-secondary sound. In the present specification, processing for processing an original sound such as an echo is collectively referred to as “effect processing”.
[0009]
[Problems to be solved by the invention]
In the first related art, various types of secondary sounds can be easily reproduced. However, since the secondary voice is a performance of another person, subtle singing turns and the like do not match, and it is difficult for the primary voice and the secondary voice to harmonize. In addition, it is impossible to reproduce the secondary voice formed by the performer's own voice. Further, as the amount of the secondary voice is increased and the sound quality is improved, the required information amount is increased, so that the processing becomes complicated and the scale of the apparatus must be increased.
[0010]
In the second related art, since the sub-voice is obtained by effecting the main voice, the sound quality, singing, and the like match. In particular, when the sub-voice is formed by the performer's own voice, a natural ensemble can be obtained. Further, even when the slave voice is another person's voice, a wide range of responses can be made by performing a plurality of effect processes and artificially synthesizing another person's voice.
[0011]
However, the conventional effect processing can be performed only once in real time. Therefore, it is difficult to reproduce the main sound a plurality of times or to reproduce a sub sound that repeats with a time difference from the main sound.
[0012]
SUMMARY OF THE INVENTION An object of the present invention is to provide an automatic performance device, an automatic performance method or a medium on which a program is recorded, which can reproduce various forms of secondary sounds.
[0013]
[Means for Solving the Invention]
According to one aspect of the present invention, there is provided an automatic performance device which synthesizes first performance information generated by operation of a voice or a performance operation element and second performance information reproduced according to automatic performance data to produce an automatic performance. The performance data includes a recording instruction and a reproduction instruction of the first performance information together with the second performance information, and reading means for reading the automatic performance data; and recording of the first performance information in accordance with the recording instruction in the automatic performance data. Recording means for reading the performance information recorded by the recording means in accordance with the reproduction instruction in the automatic performance data, and reproducing the reproduced performance information as third performance information; first performance information and second performance information Means for generating a musical tone based on the third performance information reproduced by the reproducing means, and further comprising an effect processing instruction in the automatic performance data, Automatic performance device is provided having an effect processing unit for performing effect processing on at least one of the performance information of the optimum third performance data.
[0014]
According to another aspect of the present invention, there is provided an automatic performance method for synthesizing first performance information generated by operation of a voice or performance operator and second performance information reproduced according to automatic performance data, and Using the automatic performance data which includes a recording instruction and a reproduction instruction of the first performance information together with the second performance information, a first reading step for reading the automatic performance data, and a first step in accordance with the recording instruction in the automatic performance data. A recording step of recording performance information, a reproduction step of reading performance information recorded in the recording step in accordance with a reproduction instruction in the automatic performance data, and reproducing the same as third performance information; Generating a musical tone based on the performance information and the third performance information reproduced in the reproducing step, further comprising an effect processing instruction in the automatic performance data; Information to automatic performance method having the effect processing step of performing effect processing on at least one of the performance information of the third performance data are provided.
[0015]
According to still another aspect of the present invention, there is provided an automatic performance program which synthesizes first performance information generated by operation of a voice or a performance operation element and second performance information reproduced according to automatic performance data to produce a sound. In the recorded medium, a reading procedure for reading the automatic performance data by using the automatic performance data including a recording instruction and a reproduction instruction of the first performance information together with the second performance information, and a recording instruction in the automatic performance data. , A recording procedure for recording the first performance information, a reproduction procedure for reading the performance information recorded in the recording procedure in accordance with the reproduction instruction in the automatic performance data, and reproducing the same as the third performance information; Generating a tone based on the information, the second performance information, and the third performance information reproduced by the reproduction procedure. Includes physical instruction, a medium recording a program for executing the effect processing procedure for performing effect processing on a computer in at least one of the performance information of the first performance data to third performance data are provided.
[0016]
Since the third performance information is created using the first performance information itself, it is possible to create a good synthesized sound of the ensemble. Further, since the first performance information is recorded / reproduced, the third performance information can be reproduced at an arbitrary timing.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 shows a method for reproducing a secondary voice according to an embodiment of the present invention.
[0018]
FIG. 1A is a table showing a performance example according to the present embodiment. During the time shown on the horizontal axis of the table, the processing shown in the figure is performed for each item arranged on the vertical axis of the table.
[0019]
The automatic performance data shown above the table includes accompaniment data and instruction data. While the musical tone is automatically performed based on the accompaniment data, a process for creating a sub-voice is instructed based on the instruction data.
[0020]
The lower part of the table shows the main voice, the recorded content, and the subordinate voice. In the item of the main voice and the sub-voice, the phrase actually pronounced is described, and in the item of the recorded content, the recorded content stored in the recording device in the automatic performance device is described.
[0021]
The performer plays a series of phrases such as "Sai, Sai, and Tulip Hanaga" as the main voice along with the accompaniment.
[0022]
On the other hand, according to the instruction of the instruction data, the start / stop of the recording of the main voice is instructed before and after the portion corresponding to “Tulip's story” in the timing of the music to be automatically played. In accordance with this instruction, the phrase "Tulip no Hanaga" of the main voice is recorded in the recording device.
[0023]
For the recorded phrase, reproduction start / stop is instructed in accordance with the instruction to reproduce the instruction data. In accordance with this instruction, the main sound recorded in the recording device is reproduced and becomes a sub sound. In this example, a chorus effect is produced by playing the same phrase with a time difference between the main voice and the slave voice.
[0024]
FIG. 1B is a conceptual diagram of the present embodiment. As described above, the automatic performance data includes the accompaniment data for performing the accompaniment, and the instruction data for recording / reproducing the main voice and reproducing the sub-voice. The performer sings a song along with the accompaniment that is automatically performed based on the accompaniment data, and this is the main voice. On the other hand, recording / reproduction of the main voice to the recording device is instructed by the instruction data synchronized with the accompaniment data. The recording device records the main sound in accordance with the instruction, and reproduces the recorded main sound to generate a sub sound.
[0025]
The feature of this embodiment lies in that a sub-voice is generated by recording / reproducing a main voice sung by the user, and is generated so as to be superimposed on the main voice. Therefore, the sound quality and the singing turn of the main voice and the sub-voice match, and a natural ensemble can be formed. Further, since the main sound recorded on the recording device can be reproduced from the middle, reproduced repeatedly, or reproduced with a time lag, the secondary sound can be generated in various forms. Become. Further, a high-fidelity musical tone can be generated only by adding a recording / reproducing instruction to the data of the automatic performance, so that an increase in the amount of information can be avoided.
[0026]
FIG. 2 is a table showing another example of performance of the sub-voice according to the present embodiment. The configuration of the table is the same as the configuration of the table shown in FIG. 1A. During the time shown on the horizontal axis of the table, the processing shown for each item arranged on the vertical axis of the table is performed. I have.
[0027]
FIG. 2A shows a performance example in which a part of the recorded main voice is repeatedly reproduced. First, the phrase "ichi-ni-san" of the main voice is all recorded on the recording device. The secondary voice repeats the reproduction of only the part of "Nii-san" after reproducing all the phrases of "Nii-san" with a time lag. In other words, the phrase "Ichi-ni-san-ni-san" is generated as a secondary voice. In this manner, by shifting the start / stop position of reproduction or increasing the number of times of reproduction, it is possible to generate a secondary voice having a repetition from the middle of a phrase, which cannot be performed by conventional delay processing alone.
[0028]
FIG. 2B is a performance example in which an instruction for effect processing is added to the instruction data. The phrases "one day" and "in the woods" of the main voice are recorded, respectively, and are played back as a secondary voice with a certain delay. Further, the instruction data issues an instruction for effect processing for the phrase of the secondary voice to be reproduced. In this example, it is assumed that the performer is a male, and a pitch-up and a filter process are instructed for the reproduced sound part of "one day" to generate a secondary voice that simulates a female voice. It is assumed that a pitch-down and a filter process are instructed for the reproduced sound to generate a secondary voice simulating a bear's voice. With these sub-voices, the performer can obtain an effect as if the three people, a woman and a bear, are singing. In this way, the instruction data can instruct various effect processes in addition to the instruction for recording / reproducing the main sound.
[0029]
In addition to the above-described performance examples, various effects can be reproduced by reproducing the sub-voice by combining recording / reproduction and effect processing. For example, effects such as fade-in / out and chorus can be produced.
[0030]
FIG. 3 is a diagram showing a configuration example of the automatic performance data of the present embodiment.
FIG. 3A is a diagram schematically illustrating the configuration of the automatic performance data. The automatic performance data has an area for each track, in which event data and duration data are stored in pairs. The event data indicates specific automatic performance processing such as generation / stop of a musical tone and recording / reproduction of a main voice, and the duration data indicates a time interval from one event data to the next event data. In the present embodiment, tracks T1 to T4 are prepared as tracks for accompaniment data, and track T5 is prepared as a track for instruction data. However, the number of these tracks may be increased or decreased as necessary.
[0031]
In the present embodiment, the duration indicates a time interval, but the duration may indicate the length of a rest on a musical score, or may indicate the absolute elapsed time from the start of a music piece. Although the automatic performance data of this embodiment is recorded in parallel for each track, information of all tracks may be collected together and recorded in series with the track number.
[0032]
FIG. 3B is a table showing the recorded contents of the event data.
As event data of the accompaniment data, E1: a) key-on, b) key-off, E2: note number, E3: velocity, and the like are recorded, and operations such as tone generation / silence of a musical tone are instructed.
[0033]
As events of the instruction data, C1: recording a) start, b) stop, c) memory address, and C2: reproduction a) start, b) stop, c) memory address. According to these instructions, the main sound is recorded / reproduced, and the sub sound is generated. The recording / playback memory address specifies the position at which recording / playback in the recording device is started.
[0034]
As other events of the instruction data, C3: program change, C4: control change, and the like are also recorded. The program change sets the type, timbre, nature, etc. of the musical tone to be generated, and the control change controls various settings based on the operation of the operation element. In this specification, a program change and a control change are collectively called an effect process. In addition to these instructions for effect processing, there are also instructions for the main voice, musical sounds to be played automatically, and the like, in addition to the instructions for generating the secondary voice.
[0035]
FIG. 3C is a configuration diagram of the automatic performance process. Each track of the automatic performance data is arranged in the vertical direction of the table in track number order. The horizontal axis of the table and the straight line drawn on each track indicate the passage of time.
[0036]
Tracks T1 to T4 store accompaniment data of drums, guitar, bass, and piano, respectively, and track T5 stores instruction data. A vertical straight line on each track indicates the presence of an event, and each event is processed at intervals of a circled duration. In this example, for the sake of convenience, the duration and event interval are shown in a simplified manner as compared with the actual performance. In addition, performance information of instruments other than the above may be input to the track of the accompaniment data.
[0037]
The timing of the event processing and the counting of the duration time for all tracks are controlled by a common timer, and the automatic performance processing proceeds in synchronization with time for all tracks.
[0038]
FIG. 4 is an overall view of the system of the automatic performance device in the present embodiment.
First, the player selects a song or a playing method by using the panel switch 5 while viewing the information on the monitor 23.
[0039]
The bus 10 is connected to a timer 12, a CPU 13, a ROM 14, a RAM 15, and an external storage device 16. The CPU 13 performs automatic performance processing in accordance with automatic performance data in an external storage device 16 such as a hard disk drive (HDD), in accordance with a program in a ROM 14, using a RAM 15 as an arithmetic register, and time-synchronized in accordance with a timer 12. Perform control.
[0040]
The main voice of the performer is analog-input from the microphone 1 and is converted into a digital signal by the A / D converter 2. When a player plays an electronic piano or the like, digital signals are directly input from the keyboard 11 (hereinafter, in this embodiment, the signals input by the players are collectively referred to as performance signals). In the present embodiment, the microphone 1 and the keyboard 11 are used as input means, but a performance signal may be input by other means. For example, a line output from a guitar amplifier or the like may be input to the A / D converter 2, or a signal from a MIDI musical instrument may be directly input to the bus 10.
[0041]
A predetermined tone signal is supplied from the sound source 6 in accordance with the accompaniment data in the automatic performance data read from the external storage device 16. When the operator 7 is operated, the parameters of the sound source 6 are changed, and the pitch of the musical tone signal is changed.
[0042]
The instruction data in the automatic performance data instructs recording of the performance signal in the RAM 4 and reading of the performance signal recorded in the RAM 4. The RAM 4 is of a two-port type capable of recording and reading at the same time.
[0043]
Further, the instruction data instructs effect processing on three types of signals, that is, a "performance signal read from the RAM 4", a "performance signal from a player", and a "tone signal automatically played". The effect processing may be performed only on a part of the above three types of signals. In addition to the processing performed by the DSP 3, the effect processing includes processing performed by the CPU 13 and the sound source 6, and processing performed by a combination of the DSP 3, the sound source 6, and the operation device 7. Further, the instruction of the effect processing can be set in advance by the player using the panel switch 5 or the operator 7 in addition to the instruction by the instruction data.
[0044]
The signal after the effect processing is converted into an analog signal by the D / A converter 21 and output from the amplifier 22.
[0045]
The external storage device 13 is a floppy disk drive (FDD), a magneto-optical disk (MO) drive, a CD-ROM (compact disk-read only memory) drive, or the like, in addition to the HDD.
[0046]
A hard disk drive (HDD) as the external storage device 16 can store various data such as operation programs and automatic performance data. When the operation program is not stored in the ROM 14, the operation program is stored in the hard disk in the HDD, and is read into the RAM 15. Can be done. In this way, an operation program can be easily added or upgraded. A CD-ROM (compact disk-read only memory) drive can read operation programs and various data stored in the CD-ROM. The read operation program and various data are stored in a hard disk in the HDD. New installation and version upgrade of the operation program can be easily performed.
[0047]
The communication interface 32 is connected to a communication network 33 such as a LAN (local area network), the Internet, or a telephone line, and is connected to the server computer 31 via the communication network 33. When the above-mentioned operation programs and various data are not stored in the HDD, the operation programs and data can be downloaded from the server computer 31. The automatic performance device as a client transmits an operation program and a command for requesting data download to the server computer 31 via the communication interface 32 and the communication network 33. Upon receiving this command, the server computer 31 distributes the requested operation program and data to the automatic performance apparatus via the communication network 33, and the automatic performance apparatus transmits the operation program and data via the communication interface 32. Is received and stored in the HDD, thereby completing the download.
[0048]
This embodiment may be implemented by a commercially available personal computer or the like in which an operation program and various data corresponding to the embodiment are installed. In this case, the operation program and various data corresponding to the present embodiment may be provided to the user in a state where the program is stored in a storage medium such as a CD-ROM or a floppy disk which can be read by a personal computer. When the personal computer or the like is connected to a communication network such as a LAN, the Internet, or a telephone line, the operation program or various data may be provided to the personal computer or the like via the communication network.
[0049]
FIG. 5 is a flowchart of the main processing of the automatic performance in the embodiment of the present invention.
[0050]
FIG. 5A shows a main flowchart. When the process starts, first, all settings are initialized in step SA1. Next, in step SA2, a process is performed by an operation on the panel, and a music piece and a performance method are selected. In accordance with this selection, an automatic performance process for one music is performed in step SA3. After the performance of the music, the process returns to step SA2 and the same processing is repeated.
[0051]
FIG. 5B is a flowchart showing details of the automatic performance processing shown in step SA3 of FIG. 5A. First, a timer interrupt occurs in step SB1. When a timer interrupt occurs, the values of the durations Dn of all tracks are decremented by one in step SB2. The duration up to the next event is updated by decrementing the duration Dn.
[0052]
Next, event processing is performed in step SB3. In the event processing, first, the duration Dn of each track is determined. If the duration Dn is 0, the next event is read out, and event processing such as, for example, generating a musical tone or recording a main voice is performed. If there is no track in which the duration Dn is 0, the process directly proceeds to the next step. In step SB4, it is determined whether or not the performance of the music has been completed. If not completed, the process returns to step SB1 to continue the processing, and if completed, returns.
[0053]
FIG. 6 is a flowchart showing details of the event processing shown in step SB3 of FIG. 5B.
[0054]
When the process starts, the track number Tn is set to n = 1 in step SC1. In the present embodiment, since there are four types of musical tone tracks and one type of instruction track, n changes from 1 to 5.
[0055]
At step SC2, it is determined whether or not the duration Dn recorded on the track Tn is 0. When Dn = 0, it indicates that it is time to perform the next event process. When Dn ≠ 0, the process proceeds to step SC7, and when Dn = 0, the process proceeds to step SC3.
[0056]
Event processing is performed in steps SC3 to SC5. First, the next data is read in step SC3. In step SC4, it is determined whether or not the read data is event data. As shown in FIG. 3A, since the event and the duration are recorded as a pair, the data that is read first is the event, and the process proceeds to step SC5 according to the Y arrow of step SC4. After performing a specific event process in step SC5, the process returns to step SC3. Since the data read in step SC3 after the processing of the event is a duration, in step SC4, the process proceeds to step SC6 according to the arrow N.
[0057]
In step SC6, a new duration is input to Dn according to the duration read in step SC3.
[0058]
At Step SC7, it is determined whether or not n = 5. If n = 5, it means that the processing of all the tracks T1 to T5 has been completed, so the processing returns. On the other hand, if n ≠ 5, n is incremented by 1 in step SC8, and the process returns to step SA2. Thus, the processing from step SC2 is repeated on the next track.
[0059]
FIG. 7 is a flowchart showing details of the event processing of the instruction data.
In step SD1, it is determined whether or not recording is to be started. If Yes, the process proceeds to step SD2 according to the arrow Y, and after specifying a memory address for starting recording, recording is started in step SD3. If No, steps SD2 and SD3 are bypassed according to the arrow of N.
[0060]
In step SD4, it is determined whether or not to stop recording. If Yes, the process proceeds to step SD5 according to the arrow Y to instruct to stop recording. If No, step SD5 is bypassed according to the arrow of N.
[0061]
In step SD6, it is determined whether or not the reproduction has started. In the case of Yes, the process proceeds to step SD7 according to the arrow Y, and after specifying the memory address of the reproduction start, the reproduction is started in step SD8. If No, steps SD7 and SD8 are bypassed according to the arrow of N.
[0062]
At step SD9, it is determined whether or not to perform the effect processing. If Yes, the process proceeds to step SD10 according to the arrow Y, and the effect processing is performed at step SD10. If No, step SD10 is bypassed according to the arrow of N.
[0063]
At step SD11, it is determined whether or not the reproduction is stopped. If Yes, the process proceeds to step SD12 according to the arrow Y to stop the reproduction. If No, step SD12 is bypassed according to the arrow of N.
[0064]
After performing the above processing, the process returns. In the present embodiment, a case has been described in which fixed event processing is performed in series, but the order of events may be changed. Also, processing may be performed in parallel instead of in series.
[0065]
As described above, the present invention has been described by taking the automatic performance device for karaoke as an example, but the present invention is not limited to the automatic performance device for karaoke, but can be applied to other automatic performance devices. It will be apparent to those skilled in the art that various changes, improvements, combinations, and the like can be made.
[0066]
【The invention's effect】
As described above, according to the present invention, it is possible to generate a wide range of secondary sounds by recording / reproducing a part of the main audio.
[Brief description of the drawings]
FIG. 1 shows a method of reproducing a secondary voice according to an embodiment.
FIG. 2 shows another performance example according to the embodiment.
FIG. 3 is a diagram showing a configuration of automatic performance data.
FIG. 4 is an overall view of a system of the automatic performance device in the present embodiment.
FIG. 5 is a flowchart of main processing of automatic performance according to the embodiment of the present invention.
FIG. 6 is a flowchart showing details of event processing.
FIG. 7 is a flowchart showing event data processing of a designated track.
[Explanation of symbols]
1 microphone, 2 A / D converter, 3 DSP, 4 RAM, 5 panel switch, 6 sound source, 7 operator, 10 bus, 11 keyboard, 12 timer, 13 CPU, 14 ROM, 15 RAM, 16 external storage device, 21 D / A converter, 22 amplifier, 23 monitor, 31 server computer, 32 communication interface, 33 communication network

Claims (6)

An automatic performance device which synthesizes first performance information generated by operation of a voice or a performance operation element and second performance information reproduced according to automatic performance data to produce sound.
The automatic performance data includes a recording instruction and a reproduction instruction of the first performance information together with the second performance information,
Reading means for reading automatic performance data;
Recording means for recording first performance information in accordance with a recording instruction in the automatic performance data;
Reproducing means for reading the performance information recorded by the recording means in accordance with the reproduction instruction in the automatic performance data and reproducing the read performance information as third performance information;
An automatic performance device having means for generating a musical tone based on the first performance information, the second performance information, and the third performance information reproduced by the reproducing means. The automatic performance data includes an instruction for effect processing,
2. The automatic performance apparatus according to claim 1, further comprising effect processing means for effecting an effect process on at least one of the first to third performance information. In an automatic performance method for synthesizing and generating first performance information generated by operation of a voice or performance operator and second performance information reproduced according to automatic performance data,
Using automatic performance data that includes a recording instruction and a reproduction instruction of the first performance information together with the second performance information,
A reading process for reading automatic performance data,
A recording step of recording first performance information according to a recording instruction in the automatic performance data;
A reproduction step of reading out the performance information recorded in the recording step in accordance with a reproduction instruction in the automatic performance data and reproducing the same as third performance information;
Generating a musical tone based on the first performance information, the second performance information, and the third performance information reproduced in the reproducing step. As the automatic performance data, data including an instruction for effect processing is used,
4. The automatic performance method according to claim 3, further comprising an effect processing step of effecting at least one of the first to third performance information. A medium in which an automatic performance program which synthesizes first performance information generated by operation of a voice or performance operator and second performance information reproduced in accordance with automatic performance data to produce a sound is provided.
Using automatic performance data that includes a recording instruction and a reproduction instruction of the first performance information together with the second performance information,
A reading procedure for reading the automatic performance data,
A recording procedure for recording the first performance information in accordance with a recording instruction in the automatic performance data;
A reproduction procedure for reading out the performance information recorded in the recording procedure in accordance with the reproduction instruction in the automatic performance data and reproducing the read out as third performance information;
A medium in which a program for causing a computer to execute a procedure for generating a musical tone based on the first performance information, the second performance information, and the third performance information reproduced by the reproduction procedure is recorded. As the automatic performance data, data including an instruction for effect processing is used,
6. The medium according to claim 5, further comprising an effect processing procedure for effecting at least one of the first to third performance information.

Images