JP2010054856A - Electronic musical instrument - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily create music content in which high-quality musical instrument performance sound is recorded and which sufficiently presents the atmosphere and the realistic sensation upon the musical instrument performance. <P>SOLUTION: A mixing signal generated by a mixing process of mixing a music signal generated in response to a performance operation to an operator and an externally generated sound signal is recorded as music content. When performing the mixing process of the music signal and the sound signal, the rise of the music signal at a sound source following the performance operation start of the operator and/or the fall of the music signal at the sound source following the performance operation end of the operator are detected. While the sound signal fades out or fades in on the basis of the detection of the rise and/or the fall of the music signal, the mixing with the music signal is performed. Accordingly, the high-quality musical instrument performance sound (music signal) is recorded, and the music content capable of sufficiently presenting the atmosphere and the realistic sensation upon the performance is easily created by a performer who only performs the music. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic musical instrument capable of generating music content in which musical instrument performances performed by a performer are recorded. In particular, the present invention relates to a technique for generating music content in which musical instrument performance sounds are recorded with high sound quality and can sufficiently convey the surrounding atmosphere and presence when playing musical instruments.

Recently, with the spread of communication networks such as the Internet, users generate music content such as videos, and post (upload) the generated music content to a server connected via the communication network. In the same manner, a so-called music content sharing service is provided in which a large number of music contents posted by other users can be shared and enjoyed by many users. For example, the invention described in Patent Document 1 shown below is an example of the technology related to such technology.
JP 2005-346492 A

  In the prior art, music content that can be generated and posted by a user includes a moving image (not only a video signal but also a video of a performance scene that is played by a user operating a musical instrument (natural musical instrument or electronic musical instrument). Including a sound signal input from a microphone) and a recording of only a musical sound emitted from a musical instrument in response to a performance operation. For such recording and recording, external devices such as a video camera (which may include an imaging device, a microphone, etc.) and an audio recorder (acoustic input device) that are generally prepared separately from the musical instrument are used. Has been done. In this specification, a musical sound generated outside the apparatus that is input using an external device is referred to as an acoustic signal. In addition, the term “musical sound” is not limited to musical sound, but is used in the sense that it may include voice or other arbitrary sounds.

  By the way, the sound signal included in the video recorded using the external device and the recorded sound signal include not only the musical sound (performance sound) emitted from the musical instrument operated by the performer but also the performer. Sounds other than the performance sound that is emitted by the player or around the performer (referred to as ambient sounds for convenience) are also recorded. However, from the viewpoint of listening to music, in view of the fact that ambient sounds that are irrelevant to the performance operation are usually easily perceived by the user as noise, conventional music content is “musical sound that is uttered from an instrument purely based on the performance operation. (Performance sound) "is not suitable for appreciation. Therefore, in order to avoid recording surrounding sounds when playing a musical instrument, it is conceivable to directly record the musical sound (waveform) signal itself generated based on the performance operation by the performer. Surrounding sounds that can convey the atmosphere and realism (so-called live feeling) at the time of musical instrument performance generated after the performance is completed are not recorded at all. For example, even if the performer puts in an improvisational explanation of the performance song, such as “Next song will go next. Even if the audience was cheering or applauding, the surrounding sounds were not recorded at all, so the music content was recorded (recorded or recorded) what the performer really played on the spot. It is difficult for a user who enjoys the music content to know whether there is any. As described above, the conventional music contents are not suitable for appreciating “musical sounds (performance sounds)”, and also have a problem that they are also music contents that are poor in creating an atmosphere and a sense of presence during performance.

  The present invention has been made in view of the above points. When recording a performance of an electronic musical instrument or recording a performance scene, the performance sound generated during the performance is recorded with high sound quality. Users can easily create music content that is suitable for appreciating "musical sound (performance sound)" and creating an atmosphere and realistic sensation during performance, in combination with recording surrounding sounds before and after. An object is to provide an electronic musical instrument.

  An electronic musical instrument according to the present invention includes an operation element, a storage unit, a sound source that generates a musical sound signal according to a performance operation of the operation element, an input unit that inputs an externally generated acoustic signal, and the sound source. Mixing means for mixing the generated musical sound signal and the acoustic signal input from the input means to generate a mixing signal; recording means for recording the generated mixing signal as music content in the storage means; Detecting means for detecting a rising edge of a musical tone signal at the sound source accompanying the start of a performance operation of the operating element and / or a falling edge of a musical tone signal at the sound source accompanying the end of a performance operation of the operator; and a rising edge of the musical tone signal; And / or on the basis of the detection of the fall, the sound signal is faded out and / or faded in before being mixed with the musical sound signal. Control means for controlling the mixing means, and the mixing signal consists of only the acoustic signal before the start of the performance operation and after the end of the performance operation, and only the musical sound signal from the start of the performance operation to the end of the performance operation. It is recorded as music content consisting of.

  According to the present invention, the mixing signal generated by mixing the musical tone signal generated according to the performance operation of the operator and the externally generated acoustic signal is recorded as music content. When mixing the musical sound signal and the acoustic signal, the musical sound signal at the sound source accompanying the rise of the musical sound signal at the sound source accompanying the start of the performance operation of the operator and / or the completion of the performance operation of the operator. And a control is performed to mix the sound signal with the sound signal while fading out and / or fading in the sound signal based on detection of the rising edge and / or falling edge of the music signal. As a result, before the start of the performance operation and after the end of the performance operation, only the sound signal is included, and from the start of the performance operation to the end of the performance operation, music content including only the musical sound signal is recorded in the storage means. In this way, the music player's performance sound (musical sound signal) is recorded with high sound quality and music content that can fully convey the atmosphere and realism of the performance is simply operated by the player without being particularly conscious. Then you can easily create it just by playing.

  According to the present invention, an external sound (acoustic signal) generated externally is input, while a musical instrument performance sound (musical sound signal) generated in response to the performance operation of the controller is input to the sound source before The generated sound signal is mixed with the sound signal while performing the fade-out / fade-in control on the sound signal in accordance with the detection of the rising edge (performance start) / falling edge (end of performance). Record the signal as music content. As a result, it is possible for the performer to easily generate music content in which the musical instrument performance sound is recorded with high sound quality and can sufficiently convey the atmosphere and the realism during performance.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing an embodiment of the overall configuration of an electronic musical instrument according to the present invention. The electronic musical instrument shown in this embodiment is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire electronic musical instrument. For this CPU 1, ROM 2, RAM 3, storage device 4, detection circuits 5 and 6, display circuit 7, sound source / effect circuit 8, communication interface (I / F) via communication bus 1D (for example, data and address bus) 9 are connected to each other. The ROM 2 stores various control programs executed by or referred to by the CPU 1, various data, and the like. The RAM 3 is used as a working memory for temporarily storing various data generated when the CPU 1 executes a predetermined program, or as a memory for temporarily storing a currently executing program and related data. The A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like.

  The storage device 4 stores various data and various control programs executed by the CPU 1. When the control program is not stored in the ROM 2 described above, the control program is stored in the storage device 4 (for example, a hard disk), and is read into the RAM 3 so that the control program is stored in the ROM 2. The CPU 1 can be operated as described above. In this way, control programs can be easily added and upgraded. The storage device 4 is not limited to a hard disk (HD), but a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), a DVD (Digital Versatile Disk), or a flash memory. Any storage device may be used as long as the storage device uses various types of storage media such as semiconductor memory. The storage medium may be detachable from the electronic musical instrument or may be built in the electronic musical instrument.

  The performance operator 5A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. (Keyboard etc.) can be used not only for manual playing by the user's own playing but also as a means for setting tone color, effect and the like. The detection circuit 5 generates a detection output by detecting the pressing and release of each key of the performance operator 5A.

  A setting operator (switch or the like) 6A instructs setting / setting of various performance parameters such as tone color / effect or volume and tempo used during performance, and the start / end of automatic performance based on automatic performance data. Various operation elements such as an automatic performance switch and a recording switch for instructing start / end of recording (recording) of a user performance are included. Of course, in addition to the above, the setting operator 6A is used to select, set, and control pitches, tones, effects, etc. The numeric keypad for inputting numeric data, the keyboard for inputting character data, or the screen position on the display 7A. Various operators such as a mouse for operating a designated pointer may be included. The detection circuit 6 detects the operation state of the setting operation element 6A, and outputs switch information and the like corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 7 displays various screens corresponding to the above switch operations on a display 7A composed of, for example, a liquid crystal display panel (LCD), a CRT, or the like, as well as various types stored in the ROM 2 or the storage device 4. Data or the control state of the CPU 1 can also be displayed. The performer can easily set various performance parameters to be used at the time of performance, select an automatic performance piece, and the like by referring to the various information displayed on the display 7A.

  The tone generator / effect circuit 8 can simultaneously generate musical sound signals on a plurality of channels, inputs performance information given via the communication bus 1D, synthesizes musical sounds based on the performance information, and generates musical sound signals. appear. An effect can also be given to the generated musical sound signal. A musical tone signal generated from the sound source / effect circuit 8 is generated from a sound system 8A including an amplifier and a speaker, and can be recorded in the RAM 3 or the storage device 4 without using a microphone. Any conventional configuration may be used for the configuration of the sound source / effect circuit 8 and the sound system 8A. For example, the tone generator / effect circuit 8 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., or may be configured with dedicated hardware, or by software processing by the CPU 1. It may be configured.

  The communication interface (I / F) 9 is a MIDI input / output interface for transmitting / receiving MIDI performance data between an external device and the electronic musical instrument, and a data input / output for transmitting / receiving various information such as non-MIDI data and control programs. For example, RS-232C, USB (Universal Serial Bus), IEEE1394 (Eye Triple E 1394), Bluetooth (trademark), an infrared transmitter / receiver and the like having an interface function. In addition, an electronic musical instrument and an external device (for example, a server device) on the network can be connected via a wired or wireless communication network such as a LAN (Local Area Network), the Internet, or a telephone line. This is a network interface capable of transmitting and receiving various data and various information to and from the server device. Such a communication interface 9 may be both wired and wireless and may include both.

  The communication interface (I / F) 9 is, for example, a USB host terminal. The USB host terminal includes Motion-JPEG, DV, MPEG-, such as a Web camera, a digital video camera, and a digital still camera compatible with the USB video class. 2. Connected is an imaging device 9A capable of transmitting moving / still images made up of compressed data such as MPEG-4 and uncompressed data. In this case, it goes without saying that the USB video class driver is built in the electronic musical instrument. The communication interface (I / F) 9 is an audio interface, for example, and an audio input device 9B capable of transmitting an analog audio signal such as a microphone or an audio recorder is connected to the audio interface. In addition, the electronic musical instrument, the imaging device, and the sound input device that can be connected to each other are not limited to those corresponding to all data formats, and may be any ones corresponding to at least one data format. In addition, communication may be performed using a dedicated driver in addition to the USB video class, and the data format in that case is not limited to the above format. Furthermore, the imaging device and the sound input device may be built in the electronic musical instrument in advance.

  The performance operator 5A is not limited to a keyboard instrument, but may be any type of instrument such as a stringed instrument, a wind instrument, or a percussion instrument. Further, the performance operator 5A, the display 7A, the sound source / effect circuit 8 and the like are not limited to those built in one apparatus body, and each apparatus is configured separately, and each apparatus is configured using communication means such as a communication interface or various networks. Needless to say, it may be configured to connect the two.

  Next, the operation performed by the performer in the electronic musical instrument shown in FIG. 1 and the musical sound generated in response to the operation and the surrounding sound generated around the performer at that time are recorded (recording and recording). An overview of the function of generating music content will be described with reference to FIG. FIG. 2 is a functional block diagram showing an outline of a music content generation function in the electronic musical instrument shown in FIG.

  The automatic performance data storage unit I stores automatic performance data. The automatic performance data to be stored is music data (song data) representing the music of the entire music, accompaniment style data, chord progression data, etc., when the user manually plays the music by operating the performance operator 5A. This automatic performance data is used to play back performance (such as automatic accompaniment). That is, the automatic performance unit J sequentially reads the automatic performance data stored in advance in the ROM 2 and the storage device 4 over time in accordance with the operation of the automatic performance switch by the user, and the read automatic performance data is read as a musical sound generation unit. Supply to K. When automatic performance data is supplied from the automatic performance unit J, the musical sound generation unit K generates a musical sound signal according to the performance environment (tone color, volume, effect, etc.) set by the user based on the automatic performance data. On the other hand, the performance operator 5A generates operation information corresponding to a performance operation (for example, key pressing / key release operation) by the user, and supplies the generated operation information to the tone generation unit K. When the operation information is supplied from the performance operator 5A, the music generation unit K generates a music signal according to the performance environment based on the operation information. The musical tone generation unit K sequentially supplies the musical tone signal generated based on the automatic performance data or the operation information to the mixing unit H and the rising / falling detection unit L.

As is known in the art, when the automatic performance data is pattern sequence data that defines the playback order of pattern data such as accompaniment style data, chord data is separately performed for the automatic performance section J. It is supplied in accordance with the chord progression data stored in the operator 5A or the automatic performance data storage unit I, and tone conversion processing is performed in accordance with this chord progression data to generate a musical tone. When the automatic performance data is chord progression data, the chord data read out to the automatic performance section J is supplied for pitch conversion of the accompaniment style data.
The automatic performance data storage unit I and the automatic performance unit J may be provided as necessary, and are not essential in the electronic musical instrument according to the present invention (there is no need to be provided if the back performance is not required).

  The image pickup unit A (USB camera or the like) performs performance operations (not only operation of performance operators but also other operations such as automatic performance start / end operations) performed by a player who plays the electronic musical instrument. Take a picture. The performance operation moving image (video signal) shot by the imaging unit A is sent to the video recording unit B. The recording (recording) instruction unit M instructs the video recording unit B and the audio recording unit D to start / end recording of the video signal and the audio signal according to the operation of the recording switch by the user. When the video recording unit B receives a recording start instruction from the recording (recording) instruction unit M, the video recording unit B starts recording. Here, the video image (video signal) sent from the imaging unit A is recorded (recorded) over time. . Note that the recording format for recording a moving image in the video recording unit B is arbitrary (the same as the video signal format sent from the imaging unit A described above, or may be converted to another video signal format). Good). On the other hand, the sound input unit F is typically a microphone, and inputs a surrounding sound appropriately generated when the performer plays the electronic musical instrument (especially before the performance starts and after the performance ends). Convert to sound signal. The analog acoustic signal is converted into a digital signal by the A / D conversion unit G and then supplied to the mixing unit H.

  The rising / falling detection unit L detects the rising and falling of the tone signal generated by the tone generation unit K. However, in this specification, the rising / falling of the musical sound signal does not represent an attack (rising part) / release (falling part) of each sound or a series of continuous sounds in one or a plurality of continuous sounds. Rather, it represents the first occurrence point (rising edge) of the tone signal based on the start of the performance and the last end point (falling edge) of the tone signal based on the end of the performance. The mixing unit H mixes the analog sound signal supplied from the sound input unit F and the tone signal generated by the tone generation unit K. At that time, fade-out / fade-in control is started for the analog sound signal based on the detection timing of the rising / falling of the tone signal in the rising / falling detection unit L (see FIG. 3 or FIG. 5). Note that the time required for the fade-out / fade-in control may be a fixed time, or the user may set an arbitrary time. The time may be a short time (for example, less than 1 second) that does not cause noise, or may be a longer time (for example, about 5 seconds).

  When the audio recording unit D receives a recording start instruction from the recording (recording) instruction unit M, the audio recording unit D records (records) the mixing signal generated by the mixing processing by the mixing unit H over time. However, as a recording mode of the mixing signal recorded by the audio recording unit D, the mixing signal generated without the time delay by the delay instruction unit N being recorded in the mixing unit H is recorded (FIGS. 3 and 4 to be described later). (See FIG. 5 and FIG. 6 to be described later) and recording the mixing signal generated by the time delay by the delay instruction unit N performed by the mixing unit H. The delay instruction unit N instructs the mixing unit H to perform mixing processing of each signal after delaying the sound signal and the musical sound signal by a predetermined time. A detailed description of the above embodiment will be given later. Note that the recording format for recording a musical tone signal in the audio recording unit D is arbitrary (for example, uncompressed audio, compressed audio, etc.).

  The file creation unit E includes a moving image (video signal) recorded by the video recording unit B and a mixing signal (a mixture of an acoustic signal and a musical tone signal) recorded by the audio recording unit D. Create a multimedia file (music content) consisting of The created multimedia file is stored in the file storage unit C. The multimedia file stored in the file storage unit C can be supplied to other devices outside the electronic musical instrument via the communication interface 9 or a removable storage medium. Can be uploaded to other servers.

  As described above, in the electronic musical instrument shown in the present embodiment, as an example of the recording mode of the mixing signal recorded by the audio recording unit D, the mixing signal generated without time delay by the delay instruction unit N is recorded. There are a first embodiment and a second embodiment for recording a mixing signal generated by performing a time delay by the delay instruction unit N. Therefore, first, the first embodiment will be described with reference to FIGS. 3 and 4.

  FIG. 3 is a conceptual diagram for explaining the first embodiment described above. Here, in order to make the explanation easy to understand, the video signal to be recorded by the video recording unit B is shown in the upper stage, and the mixing signal to be recorded by the audio recording unit D is divided into an acoustic signal and a musical sound signal before mixing, Shown in the bottom row. That is, FIG. 3 corresponds to the contents of the multimedia file created by the file creation unit E over time from recording / recording start to recording / recording end. In the drawing, the hatched portions indicate the locations where moving images, ambient sounds, and performance sounds are actually recorded for convenience.

  When the performer instructs to start recording / recording, recording of the video signal supplied from the image pickup unit A is started, and the sound signal generated by the sound input unit F (microphone) and the musical sound generation unit K are generated. Recording of the mixing signal obtained by mixing the musical sound signal is started. However, even if the recording of the mixing signal is started, a musical tone signal representing silence is recorded since the performance with the electronic musical instrument has not started from the start of the recording / recording until the start of the performance. On the other hand, the acoustic signal is recorded even if the performance with the electronic musical instrument is not started. That is, only the surrounding sound (acoustic signal) is reflected in the mixing signal from the start of recording / recording to the start of performance.

  When a performance with an electronic musical instrument is started, a musical sound signal generated in response to a performance operation is recorded instead of a musical sound signal representing silence. Recording of the musical tone signal generated in response to the performance operation continues until the performance with the electronic musical instrument is completed. On the other hand, even if the performance with the electronic musical instrument is started, the sound signal is continuously recorded regardless of the relationship, but fade-out control is started for the sound signal in response to the detection of the rising edge of the tone signal. Therefore, an acoustic signal input from the acoustic input unit F (microphone) after the time required for fading out has not been reflected in the mixing signal. In this way, both the performance sound (musical sound signal) generated in response to the performance operation and the surrounding sound (acoustic signal) are reflected in the mixing signal from the start of the performance until the time required for fade-out elapses. (However, as the time goes by, ambient sounds will gradually disappear.) Thereafter, only the performance sound (musical sound signal) is reflected in the mixing signal.

  When the performance on the electronic musical instrument is finished, a musical tone signal representing silence is recorded until recording is completed, not a musical tone signal generated in response to the performance operation. On the other hand, since the fade-in control is started for the sound signal in response to the detection of the fall of the music signal, only the surrounding sound (sound signal) is reflected in the mixing signal after the fall of the music signal is detected. Is done. Further, when the performer instructs the end of recording / recording, the recording of the video signal and the recording of the mixing signal obtained by mixing the audio signal and the musical tone signal are ended. As described above, between the start and end of recording / recording, the moving image (video signal) is always reflected by continuously recording, while the source of the mixing signal is For the sound signal and musical sound signal, by performing fade-out / fade-in control on the sound signal in accordance with the performance start / end timing, only the surrounding sound (sound signal) is obtained until the performance starts and after the performance ends. Only the performance sound (musical sound signal) is reflected during most of the time except for the time required for fading out from the performance start to the performance end.

  FIG. 4 is a flowchart showing an example of the “rising / falling detection process” for realizing the first embodiment. The process is a process started by the CPU 1 in response to power-on of the electronic musical instrument, and corresponds to the function of the rising / falling detection unit L. In addition, although illustration was abbreviate | omitted here, it cannot be overemphasized that the process applicable to each function shown in FIG. 2 is operate | moving separately.

  In step S1, it is determined whether or not the rising edge of the tone signal has been detected based on the tone signal supplied from the tone generator K. For example, the attack portion of the musical sound signal that first appears after the start of recording / recording is set as the rising edge of the musical sound signal. When the rising edge of the tone signal is detected (YES in step S1), the mixing unit H is instructed to start the fade-out control of the acoustic signal (step S2). The mixing unit H generates a mixing signal by mixing with a musical sound signal while fading out the acoustic signal according to the instruction. In step S3, it is determined whether or not the falling edge of the tone signal has been detected based on the tone signal supplied from the tone generator K. For example, a predetermined time after the release part of the musical sound signal appears (a period longer than the silence period in the part played by the user appearing in the middle of the music to be recorded, which may be a fixed length, or If the attack portion of the musical tone signal does not appear in succession (the length may be set), the release portion of the last musical tone signal is set as the falling edge of the musical tone signal. When the falling edge of the tone signal is detected (YES in step S3), the mixing unit H is instructed to start the fade-in control of the acoustic signal (step S4). The mixing unit H generates a mixing signal by performing mixing with a musical sound signal (but silence) while fading in the acoustic signal according to the instruction.

  In the case of the first embodiment described above, the surrounding sound (acoustic signal) and the performance sound (musical sound signal) inevitably overlap each other until the time required for fade-out elapses from the start of the performance (see FIG. 3). ). For this reason, for example, when the sound of the surroundings is extremely loud when the performance of a quiet song is started, it is inconvenient because the user generates music content that makes it difficult to hear the performance sound at the start of the performance. Therefore, in the second embodiment, music content is generated by performing signal control so that surrounding sounds (acoustic signals) and performance sounds (musical sound signals) do not overlap from the start of recording to the end of recording. This will be described below.

  FIG. 5 is a conceptual diagram for explaining the second embodiment described above. First, even if the performer instructs the start of recording / recording, the acoustic signal and the musical sound signal are temporarily buffered without immediately starting the recording with respect to the acoustic signal and the musical sound signal. When the time required for the fade-out control for the sound signal elapses from the recording / recording start instruction, the buffered sound signal and the musical sound signal are read out sequentially, and these signals are mixed to generate a mixing signal. At that time, when the rising edge of the musical tone signal is detected, fade-out of the buffered acoustic signal is started and mixed with the musical tone signal. On the other hand, when the falling edge of the musical sound signal is detected, the sound signal is faded in after being delayed by the buffered time, that is, the time required for fade-out control. Mix with the signal. In this way, in the second embodiment, the fade-out control of the acoustic signal started at the start of the performance is completed before recording the musical sound signal generated in response to the start of the performance.

  In this case, the recording timing of the moving image (video signal), the performance sound (musical sound signal), and the surrounding sound (acoustic signal) are recorded by the amount corresponding to the mixing processing by delaying the acoustic signal and the musical sound signal. Therefore, it is necessary to record in the file storage unit C after adjusting the time at the end of recording / recording. Such time (timing) adjustment is performed by returning the recording time of the sound signal and the musical sound signal to the time that is buffered by the file creation unit E, that is, the time required for the fade-out control, and then recording it in the file storage unit C. It is good to do so. Alternatively, the video signal is buffered in the same manner as the sound signal and the musical sound signal without starting recording immediately in accordance with the recording / recording start instruction. The generation timing may not be shifted.

  FIG. 6 is a flowchart showing an example of “rising / falling detection process” for realizing the second embodiment. In step S11, it is determined whether or not the rising edge of the musical tone signal has been detected based on the delayed musical tone signal. When the rising edge of the tone signal is detected (YES in step S11), the mixing unit H is instructed to start fade-out control of the acoustic signal delayed in the same manner as the tone signal (step S12). In step S13, it is determined whether or not the falling edge of the tone signal has been detected. When the falling edge of the tone signal is detected (YES in step S13), a fade-in reservation is performed (step S14). In this fade-in reservation, if the fade-in control of the sound signal is started immediately after the performance ends, the surrounding sound (acoustic signal) and the performance sound (musical signal) may overlap. This is the time designated for delaying the start of the fade-in control of the acoustic signal (time when the performance end is designated). In step S15, it is determined whether or not a predetermined time has elapsed since the fade-in reservation. If it is determined that a predetermined time (time required for fade-out control) has elapsed since the fade-in reservation (YES in step S15), the mixing unit H is instructed to start fade-in control of the delayed acoustic signal (step S15). S16).

  As described above, ambient sounds generated externally (acoustic signals) are input, and musical instrument performance sounds (musical sound signals) generated in accordance with the performance operation are directly input from the sound source at a stage before being output externally. When the rising edge (performance start) / falling edge (performance end) of the musical tone signal is detected, fade-out / fade-in control is performed on the acoustic signal to perform the mixing processing with the musical tone signal. In this way, music content is automatically generated by combining only the surrounding sounds before the performance starts and after the performance ends, and only the instrument performance sounds from the performance start to the performance end. As a result, the performer can easily generate music content in which the musical instrument performance sound is recorded with high sound quality and can sufficiently convey the atmosphere and the realism during performance.

If the applause of the audience is detected by the rising / falling detection unit L in accordance with the acoustic signal and the applause is detected before the start of the performance, the time required for fading out until the applause ends even if the music signal rises. May be extended. In such a case, needless to say, in the second embodiment, the start of recording of the musical sound signal is delayed by an amount corresponding to the extension of the time required for fading out. Further, the singing may be detected according to the acoustic signal, and the volume of the acoustic signal may be increased even after the fade-out.
If the automatic performance data includes a mark such as “ending” in the automatic performance data, the rising / falling detection unit L may start the fade-in control using this as a signal. Further, fade-in control may be started at the “interlude start” mark in the automatic performance data, and fade-out control may be started at the “interlude end” mark. In this case, it is convenient to automatically record the applause of the audience performed during the interlude as appropriate.
If applause is detected near the end of the song (it can be detected that it is near the end of the song based on the playback position of the automatic performance data), fade-in control is started without waiting for the fall of the tone signal. You may let them.

In addition, you may make it perform the mixing process accompanied by the fade-out / fade-in control of an acoustic signal after recording each of an acoustic signal and a musical tone signal. In other words, once the sound signal and the tone signal are recorded without lowering the volume (but the sound signal and the tone signal are recorded on different tracks), the tone signal track is automatically analyzed after recording and the tone signal is recorded. Rising / falling is detected, mixing processing is performed while fading out / fade in the acoustic signal at the corresponding position in the acoustic signal track, and the generated mixing signal is stored.
In addition, as detection of the rising / falling of the tone signal, the first note-on or all-note-off in the performance information is detected (a predetermined time has elapsed since then), and fade-out and fade-in control is started according to the detection. You may make it do. Alternatively, fade-out or fade-in control may be started by detecting an automatic performance start or stop instruction. This is because these detections are substantially equal to the rising / falling detection of the tone signal.
Needless to say, the electronic musical instrument according to the present invention is not limited to one capable of both recording and recording, and may be any one capable of only recording.

1 is a block diagram of a hardware configuration showing an example of the overall configuration of an electronic musical instrument according to the present invention. It is a functional block diagram which shows the outline of the music content production | generation function in an electronic musical instrument. It is a conceptual diagram for demonstrating 1st Embodiment which records a mixing signal, without performing the time delay by a delay instruction | indication part. It is a flowchart which shows one Example of the "rising / falling detection process" which implement | achieves 1st Embodiment. It is a conceptual diagram for demonstrating 2nd Embodiment which performs the time delay by a delay instruction | indication part and records a mixing signal. It is a flowchart which shows one Example of the "rising / falling detection process" which implement | achieves 2nd Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Storage device, 5, 6 ... Detection circuit, 5A ... Performance operator, 6A ... Setting operator, 7 ... Display circuit, 7A ... Display, 8 ... Sound source / effect Circuit: 8A ... Sound system, 9 ... Communication interface, 1D ... Communication bus, A ... Imaging unit, B ... Video recording unit, C ... File storage unit, D ... Audio recording unit, E ... File creation unit, F ... Sound input , G ... A / D conversion unit, H ... mixing unit, I ... automatic performance data storage unit, J ... automatic performance unit, K ... musical sound generation unit, L ... rising / falling detection unit, M ... recording (recording) Instruction unit, N ... delay instruction unit

Claims (4)

An operator,
Storage means;
A sound source that generates a musical sound signal in response to a performance operation of the operator,
An input means for inputting an externally generated acoustic signal;
Mixing means for generating a mixing signal by mixing a musical sound signal generated by the sound source and an acoustic signal input from the input means;
Recording means for recording the generated mixing signal in the storage means as music content;
Detecting means for detecting a rise of a musical sound signal in the sound source accompanying the start of a performance operation of the operator and / or a fall of a musical sound signal in the sound source accompanying the end of the performance operation of the operator;
Control means for controlling the mixing means to perform mixing processing with the musical sound signal while fading out and / or fading in the acoustic signal based on detection of rising and / or falling of the musical sound signal;
The mixing signal includes only the acoustic signal before the start of the performance operation and after the end of the performance operation, and is recorded as music content including only the musical sound signal from the start of the performance operation to the end of the performance operation. Electronic musical instrument.   It further comprises video input means for inputting a video signal of the performer who operates the operation element, and the recording means is configured so that the player's operation and the musical sound signal generated in response to the operation coincide with each other in time. The electronic musical instrument according to claim 1, wherein the video signal is recorded as music content in parallel with the mixing signal.   The control means mixes the musical sound signal and the acoustic signal after a time delay from the time of actual signal generation or signal input in order to complete the fading out of the acoustic signal at the start of rising of the musical sound signal. 3. The electronic musical instrument according to claim 1, wherein the mixing means is controlled so as to perform processing.   4. The electronic musical instrument according to claim 1, wherein the control means controls the mixing means so as to start fade-in of the acoustic signal at the end of falling of the musical sound signal.

Images