JP2008233557A - Electronic musical instrument and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic musical instrument capable of presenting musical performance data synchronized with a music content distributed by streaming from a server device. <P>SOLUTION: A playback position of the music content being played back through stream distribution from the server device is acquired, and the acquired playback position of the music content is converted into a musical music position for controlling generation of a musical sound based upon musical performance data, based upon tempo map data, having been acquired from the server device, related to the music content. While the playback position and/or playback tempo are changed to meet the converted musical music position, the musical performance data associated with the music content distributed by pseudo-streaming from the server device are played back to be represented in a predetermined form. Consequently, a user can receive presentation of the musical performance data on a musical performance guide etc., synchronized with the music content distributed by streaming and based upon the musical performance data distributed by pseudo-streaming. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an electronic musical instrument and a program that can receive data distribution from an external server device via a communication network. In particular, an electronic musical instrument capable of synchronously presenting performance data such as a performance guide based on pseudo-streamed data in accordance with the progress of musical sounds generated based on stream-distributed data And the program.

Recently, data distribution from an external server device (server computer) via a communication network is widely received by a user-side device, and the distributed data is appropriately used by a user-side device. . An electronic musical instrument is not an exception, and generates musical sounds based on data streamed from an external server device connected via a communication network, or based on performance data (eg, MIDI data) distributed pseudo-streamed, Some of them are capable of generating musical sounds. As a technique for receiving data distribution from an external server device via such a communication network, for example, the technique described in Patent Document 1 or Patent Document 2 shown below is an example. Patent Document 1 describes a technique for distributing video data, audio data, and the like in a stream, while Patent Document 2 describes a technique for distributing MIDI data in a pseudo stream (also referred to as progressive download).
JP-A-2005-148565 Japanese Patent Laid-Open No. 2004-045706

  By the way, there are cases where the user wants to practice playing a melody or the like in a manual performance while listening to an accompaniment or listening to an exemplary performance performed by a performer. In such a case, since it is necessary to perform a melody performance guide as the accompaniment and the model performance as a model progress, conventionally, the electronic musical instrument has received distribution of necessary data from an external server device in advance (so-called By downloading and distributing the data after all of the data has been downloaded, the accompaniment and the model performance as a model and the melody performance guide are controlled synchronously. However, in this case, the electronic musical instrument needs to have storage means (hard disk) having a storage capacity sufficient to store a large amount of data downloaded from an external server device. Many electronic musical instruments have only a storage means with a smaller storage capacity than a personal computer.

  Therefore, instead of performing a performance guide in accordance with the progress of musical sounds generated based on stored data that requires storage means (hard disk) having sufficient storage capacity, data stream-distributed from an external server device It is advisable to perform a performance guide in accordance with the progress of the musical sound generated based on the music. In that case, the data for generating the sound and the data for playing the guide are collectively packetized at the same timing in the external server device, and the data for stream delivery is created, and this is sent to the electronic musical instrument. It is conceivable to synchronize the generation of musical sounds on the electronic musical instrument side and the performance guide by distributing the stream. However, it is necessary to perform the performance guide prior to generating the musical sound of the corresponding part, and it is time consuming and troublesome to create the data for stream delivery as described above while making such fine time adjustment. Not only that, creating such data itself is difficult and impractical. Therefore, an electronic musical instrument that can perform a performance guide in accordance with the progress of musical sounds generated by stream distribution from an external server device is very useful, but there has never been such an instrument. In this specification, the term “musical sound” is not limited to musical sound, but is used in the sense that it may include voice or any other sound.

  The present invention has been made in view of the above-described points, such as a performance guide based on data distributed in a pseudo stream via a communication network in synchronization with music reproduction based on data distributed via a communication network. The present invention intends to provide an electronic musical instrument and a program capable of presenting performance data.

  The electronic musical instrument according to the present invention associates a large number of music contents with performance data corresponding to the musical sound generated based on the reproduction of the music content, and tempo map data indicating the tempo of the musical sound to be reproduced and the change thereof. Connection means for connecting a server device having a function of storing the stored music content, performance data, and tempo map data via a communication network, and a number of devices stored in the server device. The designation means for designating one of the music contents, the data acquisition means for obtaining tempo map data associated with the designated music content from the server device, and the distribution of the designated music content are started. , Instruction means for instructing the server device, and the server device Receiving a music content streamed in response to the instruction, and simultaneously playing back the music content that has been received simultaneously, and a pseudo-stream distribution in response to the instruction from the server device A second playback means for sequentially playing back the performance data at a stage when a part of the performance data is downloaded while downloading the performance data; an acquisition means for acquiring a playback position of the music content being played; Based on the acquired tempo map data, conversion means for converting the playback position of the acquired music content into a musical song position for controlling generation of musical sound based on performance data; and the converted musical Changing means for changing the playback position and / or playback tempo of the performance data being played back based on the position of the correct music; Performance data presenting means for presenting performance data in a predetermined manner according to the reproduction of the data, and the performance delivered in a pseudo stream from the server device in synchronization with the reproduction of the music content streamed from the server device Data is reproduced and performance data is presented in a predetermined manner.

  According to the present invention, while receiving music content that is stream-distributed from a server device connected via a communication network, the music content that has already been received is reproduced in sequence, and pseudo-stream distribution is performed from the server device. In a case where the performance data is sequentially reproduced at a stage where a part of the performance data is downloaded while downloading the performance data related to the music content, the reproduction position of the music content being reproduced is acquired, and the server Based on the tempo map data associated with the music content acquired from the device, the playback position of the acquired music content is converted into a musical song position for controlling the generation of musical sounds based on the performance data. Then, the performance data is reproduced while changing the reproduction position and / or reproduction tempo so as to match the converted musical song position, and the performance data is presented in a predetermined manner according to the reproduction. Thereby, in synchronization with the reproduction of the music content stream-distributed from the server device, the performance data distributed from the server device is reproduced and performance data such as a performance guide is presented. In this way, even if the user uses an electronic musical instrument that does not have a storage means with a sufficient storage capacity, simply connecting the electronic musical instrument to the server device via the communication network provides an accompaniment or a model. The user can easily and quickly perform effective performance practice at any time while referring to the model performance and receiving performance data such as a performance guide synchronized with the progress of the model performance as an accompaniment or model. . Furthermore, it is not necessary to previously generate dedicated stream delivery data for synchronizing the music content and the performance guide in the server device.

  The present invention may be constructed and implemented not only as an apparatus invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

  According to the present invention, tempo map data is acquired from a server device connected via a communication network, and the playback position and / or playback tempo of performance data distributed from the server device based on the tempo map data is reproduced. There is an effect that it can be changed according to the music content being stream-distributed and reproduced from the server device connected via the communication network, and performance data can be presented to the user based on this. In particular, when performing a performance guide as presentation of performance data, the user refers to the music content being played back, and performs an effective performance practice by receiving a performance guide synchronized with the progress of the music content being played back. Can be made easier and more effective. When the performance guide is displayed in a musical score format or the like according to the time position where the performance is to be performed, the performance data is collectively acquired as a pseudo stream, so that it is possible to display a special effect such that the performance data can be displayed before and after the time position where the performance guide should be performed. be able to. In addition, by playing a key corresponding to the performance data on the keyboard of the electronic musical instrument or driving a sound source as presentation of performance data, it seems that the user is performing according to the music content being played back. It can be felt and enjoyed.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing the overall configuration of an electronic musical instrument according to the present invention. The electronic musical instrument shown in this embodiment is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire electronic musical instrument. For this CPU 1, via a data and address bus 1D, ROM 2, RAM 3, performance operation detection circuit 4, setting operation detection circuit 5, display circuit 6, tone generator circuit 7, effect circuit 8, external storage device 9, communication network interface (I / F) 10 and MIDI interface (I / F) 11 are connected to each other. Further, the CPU 1 is connected to a timer 1A for measuring the interrupt time and various times in the timer interrupt process (interrupt process). For example, the timer 1A generates a clock pulse, and gives the generated clock pulse to the CPU 1 as a processing timing command or to the CPU 1 as an interrupt command. The CPU 1 executes various processes according to these instructions.

  The ROM 2 stores various programs executed by the CPU 1 and various data. The RAM 3 is used as a working memory that temporarily stores various data generated when the CPU 1 executes a predetermined program, or as a memory that stores a currently executed program and related data. A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like. As will be described in detail later, in this embodiment, the server device 10A, which is downloaded or pseudo-streamed from the external server device 10A connected to the electronic musical instrument main body via the communication network X, can perform the performance practice stored. Song list data (see FIG. 2 to be described later) for displaying a list of songs (music contents) to the user, performance data (for example, MIDI data) related to an arbitrary song that the user wants to practice, and a tempo associated therewith Map data (see FIG. 3 described later) or the like, or digital audio data (for example, MP3 data) stream-distributed from the server device 10A can be temporarily stored.

  The performance operator 4A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. The keyboard or the like can be used for manual performance by the user's own hand-playing, as well as music (for example, a model) to the external server device 10A connected to the electronic musical instrument body via the communication network X. It can also be used as an instruction means for instructing the start / stop of reproduction of a model performance or accompaniment). The performance operation detection circuit 4 generates a detection output by detecting pressing and release of each key of the performance operator 4A. The setting operation element (switch, etc.) 5A includes, for example, a switch for selecting a song that the user wants to practice, a switch for designating the position and part of the song that the user wants to practice, and the communication network X. A switch for instructing the external server device 10A connected to start / stop playback of a user-desired song (as will be described later, the electronic musical instrument responds to a song playback start instruction to the server device 10A according to the server device 10A). 10A to receive a stream distribution and generate a musical sound). Of course, the setting operator 5A is also a numeric keypad for inputting numeric data, a keyboard for inputting character data, or a predetermined display displayed on the display 6A. Various operators such as a mouse used for operating the pointing device may be included. The setting operation detection circuit 5 detects the operation state of each switch, and outputs switch information corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 6 has a song list screen (not shown) that presents songs that can be practiced with the electronic musical instrument based on song list data, for example, on a display 6A composed of a liquid crystal display panel (LCD), a CRT, etc. For example, a performance guide using display of a musical score or the like corresponding to a music position corresponding to the reproduction of performance data, a currently set manual performance environment, a control state of the CPU 1 or the like is displayed. By referring to these various types of information displayed on the display 6A, the user can easily select, for example, a song to be practiced, set a performance environment related to manual performance, or practice manual performance. Become.

  The tone generator circuit 7 can simultaneously generate musical tone signals on a plurality of channels, and provides performance information generated in response to manual operation of the performance operator 4A by the user, which is given via the data and address bus 1D. Performance information generated according to the stored performance data, digital audio data streamed from the external server device 10A, or the like is input, and a musical tone signal is generated based on the performance information and data. The musical sound signal generated from the sound source circuit 7 is given an effect via the effect circuit 8 and the like, and is generated from the sound system 8A including an amplifier and a speaker. Any conventional configuration may be used for the sound source circuit 7, the effect circuit 8, and the sound system 8A. For example, the tone generator circuit 7 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., and may be configured by software processing by the CPU 1 or by dedicated hardware. May be.

  The external storage device 9 stores various data and various control programs executed by the CPU 1. When no control program is stored in the ROM 2, the control program is stored in the ROM 2 by storing the control program in the external storage device 9 (for example, a hard disk) and reading it into the RAM 3. The CPU 1 can be operated in the same manner as in the case. In this way, control programs can be easily added and upgraded. The external storage device 9 is not limited to a hard disk (HD), but a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), a DVD (Digital Versatile Disk), etc. Any storage device may be used as long as the storage device uses various external storage media. Alternatively, a semiconductor memory such as a flash memory may be used.

  The communication network interface (I / F) 10 is connected to a wired or wireless communication network X such as a LAN, the Internet, a telephone line, etc., and is connected to an external server device 10A (server computer) via the communication network X. It is an interface for connecting to the electronic musical instrument side a control program or various data from the server device 10A. Such a communication network interface 10 may include both of them, not wired or wireless. The server apparatus 10A stores a large amount of various data, and for the electronic musical instrument connected via the communication network X, the corresponding data is stored in the data stored in response to a request from the electronic musical instrument. Stream delivery or pseudo-stream delivery can be performed according to the type. Needless to say, when the control program and various data are not stored in the ROM 2 or the external storage device 9 (for example, hard disk), the control program and various data can be downloaded from the server device 10A.

  The MIDI interface (I / F) 11 inputs performance data (MIDI data) in MIDI format from the externally connected MIDI device 11A or the like to the electronic musical instrument, or receives performance data in MIDI format from the electronic musical instrument. This is an interface for outputting to another MIDI device 11A or the like. The other MIDI device 11A may be any device that generates data in MIDI format in response to a manual performance operation by a user. Any type of operation device such as a keyboard type, a guitar type, a wind instrument type, a percussion instrument type, a gesture type, etc. (Or comprising an operation form).

  Note that the electronic musical instrument is not limited to one in which the performance operator 4A, the display 6A, the sound source circuit 7 and the like are built in one apparatus body, but each is configured separately, and each of the electronic musical instruments is configured using communication means such as a MIDI interface or various networks. Needless to say, the apparatus may be configured to be connected. Furthermore, the electronic musical instrument according to the present invention is not limited to the above-described form, and a musical tone is generated according to a user's manual operation such as a switch, button, or pad that also functions as a performance operator such as a personal computer, a karaoke device, or a game device. As long as it generates the above, it may be applied to any form of apparatus or device.

  In the electronic musical instrument shown in FIG. 1, a communication guide using a musical score display by driving the display 6A, a performance guide that automatically turns on / off by driving a keyboard LED (not shown), etc. The music content stream-distributed from the server device 10A connected via the network can be played in accordance with the progress of the musical sound generated by reproducing (analyzing / reconstructing) the music content in real time. Therefore, an outline of the performance guide function that performs in synchronism with the generation of musical sounds according to the stream distribution of the music content from the server apparatus 10A and the performance guide according to the pseudo stream distribution of the performance data from the server apparatus 10A. This will be described with reference to FIG.

  FIG. 2 is a block diagram schematically showing an embodiment of the performance guide function. The arrows in the figure indicate the flow of data and signals. The flow of data that is stream-distributed from the server apparatus 10A to the electronic musical instrument EM is indicated by dotted lines, and the flow of data that is pseudo-stream or download-distributed Is indicated by a solid line. In addition, although the structure which implement | achieves a performance guide function may have hardware etc. other than what is shown in FIG. 2, the case where the minimum required resource is used is demonstrated here.

  The server apparatus 10A delivers a content storage function for storing a large number of music contents and related data, and the stored music contents and related data to external devices connected via the communication network X. Has a data distribution function. The storage unit DC realizes the content storage function. Here, the storage unit DC stores a large number of music contents, and displays a list of the stored many music contents as information such as song names and artist names. A song list PLC for storing the song list is stored. As an example of a specific method for storing music contents in the storage unit DC, folders SF (Song1, Song2, Song3,...) Associated with each category of song genre so that each music content can be classified by song genre etc. ..) and is stored as a song data set file SD (Song1.html). One song data set file SD (Song1.html) is associated with a plurality of data (files). There are several methods for associating each data. For example, a separate association file composed of a link path to each piece of data to be associated is prepared, the data file name assigned to each piece of data is made common, and the extension is different for each piece of data. There is a method of collecting each data associated with one folder. Of course, the method is not limited to the above method, and any method may be used as long as the user can easily manage / specify a plurality of data to be associated.

  The plurality of data associated with each other is digital audio data (Song1.mp3), performance data such as MIDI (Song1.mid), and tempo map data (Song1.map). Digital audio data (Song1.mp3) is data (music content) for generating a model performance or accompaniment that serves as a model. Depending on the actual live performance by a musician or teacher (music teacher), It is data generated by recording a musical tone generated from an electronic musical instrument or the like while sampling, and applying data compression to the recorded musical tone that has been recorded (ie, it may not be performed) (that is, Not performance data such as MIDI). Digital audio data may typically be stored in a mixed state without separating all parts of the song, such as right hand parts, left hand parts, their minus ones, or accompaniment parts that the user does not play, It may be stored as multi-channel data divided for each part, or may be stored as separate data for each part. In such digital audio data, information on the reproduction position of a song is specified so that it can be specified by a combination of a sampling frequency and a sample count, an elapsed time from the beginning of the song, or the like.

  The performance data (Song1.mid) is, for example, MIDI data that can generate musical sounds (digital audio signals) such as songs based on the associated digital audio data by controlling an electronic musical instrument. The performance data is also control data required when controlling the electronic musical instrument to perform the performance guide. Tempo map data (Song1.map) is generated in the electronic musical instrument by generating (synthesizing / reconstructing) music content stream-distributed from the server device 10A in real time and pseudo-stream distribution from the server device 10A. This is data for performing in synchronization with a performance guide based on reproduction (analysis / reconstruction) of performance data. Specifically, information specifying the playback position in music content such as sample count and time specified in digital audio data, music tempo specified in performance data, or musical song position such as beat and measure It is data for conversion into information to be performed. Such tempo map data may be any known data, and an example thereof is shown in FIG. FIG. 3 is a conceptual diagram showing an embodiment of the data structure of tempo map data.

  The tempo map data reproduces the video or audio of the performance by the musicians or teachers (music teachers) already recorded by the content creator, and listens to the reproduced musical tone for each known beat device (see Fig. (Not shown), and a change in tempo is recorded according to the time interval of the tapping operation. However, in general, when recording a tempo change at one beat intervals that allows the user to tap the switch accurately and reasonably, the time interval is too coarse to capture the tempo change in the song, so it is supplemented with a finer time interval. While recording tempo changes in time series. For example, like the tempo map data shown in FIG. 3A, the number of samples included in the time interval is recorded in time series every 1/24 beat from the beginning of the song. If the sampling frequency for recording the musical sound generated according to the performance is 48 KHz and the performance tempo of the song is 120 beats / min, the number of samples included in 1/24 beat is “1000”. Corresponds to the sample. However, in the example shown in FIG. 3A, a complementary value (two samples in this case) is taken into consideration to compensate for a subtle timing shift for each beat.

  On the other hand, the tempo map data shown in FIG. 3B is composed of time-series data indicating the tempo, time signature, and number of continuous bars for each song. According to the tempo map data shown in FIG. 3 (b), the tempo is 120 and the time signature is 4/4 from the beginning of the song to the first 200 bars, the tempo is 140 and the time is 4/4 in the next 160 bars, and the next This means that the 200 bars of tempo = 140, time signature = 3/4, and the last 200 bars, tune = 120, time signature = 4/4, the music (specifically, digital audio data) is reproduced. In the electronic musical instrument, such tempo map data is taken in from the server device 10A prior to distribution of music content (digital audio data) and performance data (MIDI data), and based on this, it is simulated from the server device 10A. The performance guide control based on the stream-delivered performance data is performed in accordance with the progress of the musical sound generated based on the music content stream-distributed from the server device 10A (details will be described later). In the tempo map data shown in this embodiment, a “−” sign is added to the number of continuous measures at the beginning of a song. This “-” sign inserts a blank period from the start of playback of music content streamed from the server apparatus 10A to the start of playback of performance data distributed from the server apparatus 10A (start of performance guide). The numerical value following the “−” sign indicates the length (number of bars) of the blank period.

  Returning to the description of FIG. 2, the data transfer unit FF implements a data distribution function. Here, the electronic musical instrument EM connected from the server device 10 </ b> A via the communication network X is stored in the storage unit DC. The data (song list data, digital audio data, tempo map data, performance data) are transmitted in a distribution manner determined in advance for each data as required. For example, the data transfer unit FF transmits song list data to the electronic musical instrument EM in response to the electronic musical instrument EM being connected via the communication network X. Further, in accordance with a song selection instruction from the electronic musical instrument EM connected via the communication network X, tempo map data associated with the selected music is downloaded and distributed, and further, a reproduction start instruction is issued from the electronic musical instrument EM. In response, the digital audio data stream distribution of the selected song and the pseudo-stream distribution of performance data associated with the selected song are started.

  As is well known, streaming distribution of digital audio data by the server device 10A is performed according to, for example, RTP (Real-time Transport Protocol). That is, the server apparatus 10A divides the digital audio data into predetermined fixed sample numbers, and generates a packet using the fixed sample number as a payload (packet contents information). A header consisting of a sequence number (serial number) is added to this packet with an appropriate value as an initial value, and the value is incremented by one for each delivery of the data packet. Alternatively, a header consisting of a time stamp based on the sampling clock is added. The server device 10A distributes the generated packets (RTP data packets) to the electronic musical instrument EM one after another. For example, assuming that uncompressed audio data with a sampling frequency of 48 kHz is packetized every 160 samples, a packet containing 160 samples of audio data is delivered to the electronic musical instrument EM every 3.3 milliseconds. The header attached to each packet is a sequence number N (initial value), N + 1, N + 2,..., Or a time stamp M, M + 160, M + 320,. Since the data distribution by the packet communication conforms to RTP (and therefore conforms to UDP (User Datagram Protocol)), even if the packet transmitted by the server device 10A cannot be received on the electronic musical instrument EM side (that is, Packet loss), the server apparatus 10A does not retransmit the corresponding packet.

  On the other hand, the electronic musical instrument EM is configured as shown in FIG. 1 described above, and not only can a manual performance by a user be realized, but also music contents (streamed from the server device 10A connected via the communication network X) ( The performance data from the server device 10A is used as a performance guide such as displaying a musical score on the display 6A or turning on / off a keyboard LED (not shown) in accordance with the progress of the music reproduced based on the digital audio data). Can be received upon receiving the pseudo stream distribution. The data transfer unit FR receives song list data, digital audio data, tempo map data, and performance data from the data transfer unit FF in the server device 10A. The storage unit DE stores song list data, tempo map data, and performance data sent from the server device 10A (indicated by hatching in the drawing). The song list data is automatically acquired and stored in response to the connection of the electronic musical instrument EM and the server device 10A via the communication network X. The user interface unit YI controls the display circuit 6 and the like so that a large number of music contents stored in the server device 10A are displayed in a list on the display 6A based on the song list data stored in the storage unit DE. The user can select a song to be practiced based on a list of songs (music contents) displayed on the display 6A. Only the tempo map data and performance data related to the song selected by the user are acquired and stored.

  The reproduction unit PE reproduces music content (digital audio data) streamed from the server device 10A and generates musical sounds (digital audio signals). That is, the electronic musical instrument EM sequentially reproduces the received music content while receiving the music content streamed from the server device 10A. Specifically, in response to receiving successively delivered packets from the server apparatus 10A by the data transfer unit FR, the payload in the received packet is buffered, and the buffered data is analyzed / reviewed in real time. Configure to generate music. The electronic musical instrument EM monitors the sequence number (or time stamp) in the header in the packet reception process, and this monitoring causes a change in the arrival of the packet due to the communication congestion (communication traffic amount) in the communication network X. Even so, it is possible to generate musical sounds in the correct order. If the next packet to be reproduced has not arrived at the timing of the reproduction process, silence is generated for a predetermined number of fixed samples (for example, 160 samples) used at the time of packet generation. Generate musical sounds. That is, even if the next packet following the packet that has not arrived has arrived first, it is not reproduced ahead of schedule.

  The measuring unit K counts the number of samples of the musical sound (digital audio signal) generated by the reproducing unit PE and stores the sample count value in the storage unit DE. Since any known method for counting the number of samples from the digital audio signal in the measurement unit K may be used, the description thereof is omitted here. The musical tone output unit OT generates the generated musical tone. The MIDI playback unit MP sequentially plays back the performance data distributed from the server device 10A by the pseudo stream and stored in the storage unit DE as much as it can be played back from the received one. That is, the performance data is sequentially reproduced when a part of the performance data is downloaded while downloading the performance data distributed in the pseudo stream from the server device 10A. Further, when the MIDI playback unit MP receives the music position and / or tempo update information from the conversion unit CV during playback of the performance data, the MIDI playback unit MP changes the music position and / or the playback tempo of the music and plays back the performance data. The conversion unit CV converts the musical composition position and tempo information of the digital audio data into performance data based on the sample count value stored in the storage unit DE while being updated at any time according to the reproduction of the digital audio data by the reproduction unit PE. Is converted into musical position and tempo information of musical tone. A signal (audio signal) generated by playing the performance data in the MIDI playback section MP is sent to the performance guide control section G (performance data presentation section).

  The performance guide control unit G (performance data presentation unit) is a user interface unit YI that presents performance data such as a performance guide based on a signal (audio signal) generated by the reproduction of performance data by the MIDI playback unit MP. To control. When performing a performance guide, the user interface unit YI controls display on the display 6A, lighting / extinguishing of a keyboard LED (not shown), and the like. That is, when the performance data is played back by the MIDI playback section MP, the display on the display 6A is updated in accordance with the progress of the music according to the control instruction from the performance guide control section G, or a keyboard LED (not shown) is turned on. Or control. In this way, the user interface unit YI drives a device for performing performance guides such as the display circuit 6 and the keyboard LED based on the control instruction from the performance guide control unit G, and the music content streamed from the server device 10A ( A performance guide that matches (synchronizes) with the progress of the musical sound generated in response to the reproduction of (digital audio data) is performed.

  Next, specific processing (performance guide) is performed in which the generation of musical sounds according to the stream distribution of the music content from the server device 10A and the performance guide according to the pseudo stream distribution of the performance data from the server device 10A are synchronized. The control process will be described with reference to FIGS. However, here, for convenience of illustration, the above processing is divided into the first half and the second half in the order of processing. FIG. 4 is a flowchart showing an embodiment of the first half process in the “performance guide control process”. FIG. 5 is a flowchart showing an embodiment of the second half process subsequent to the first half process in the “performance guide control process”. Hereinafter, the “performance guide control process” will be described with reference to the flowcharts shown in FIGS. 4 and 5.

  As shown in FIG. 4, in step S1, a list of a large number of music contents stored in the server device 10A from the server device 10A connected via the communication network X (specifically, a song describing a song name and the like) List data). In step S2, a list of songs (music contents) is displayed on the display 6A based on the acquired song list data, and the user is prompted to select a song to practice. The step S3 requests the server apparatus 10A connected via the communication network X to transmit tempo map data associated with the selected song in response to the user's operation for selecting the song that the user wants to practice. The tempo map data downloaded and distributed from the server device 10A is acquired. In step S4, in response to a user operation, the position of the music for which performance practice is to be started (performance start position) and the performance part of the music for which performance practice is desired are acquired. In step S5, the performance guide and performance data playback tempo and the performance position at which the performance guide and performance data playback are started are initialized. Step S6 waits for a user operation and requests the server apparatus 10A to start playback of a song selected as a song to be practiced. Specifically, a reproduction start instruction is transmitted. Step S7 receives the distribution of the music content of the song selected as the song to be practiced and the associated performance data from the server device 10A, and acquires these data. That is, when the server device 10A receives the playback start instruction, it starts streaming distribution of the music content (digital audio data) selected for the song to be played and is associated with the music content selected for the song to be played. Since the pseudo-stream distribution of the performance data is started, the electronic musical instrument EM acquires each data according to the data distribution. In addition, the electronic musical instrument EM automatically reproduces the acquired music content in response to the acquisition of the stream-distributed music content without a user's instruction for reproduction.

  As shown in FIG. 5, in step S8, whether or not there is a missing packet streamed from the server apparatus 10A, that is, a packet (packet loss) that was not received on the electronic musical instrument EM side among the packets transmitted by the server apparatus 10A. ) Is determined. This packet loss is determined by detecting the timeout of arrival of the corresponding packet. When it is determined that there is no missing packet (no in step S8), the digital audio data included in each packet is reproduced in the correct order for the received packet, and the reproduced digital audio data is measured and sampled. The count value is updated (step S9). In step S10, using the tempo map data downloaded from the server device 10A in step S3, the musical song position (eg, bar, beat, etc.) of the currently played song is obtained according to the measured sample count value. The sample count value is a playback position of the music content currently being played back, and is a control unit in the music content for controlling the generation of a musical sound based on the music content. On the other hand, the musical song position is a control unit in the performance data for controlling the generation of musical sounds based on the performance data. That is, here, the playback position of the currently played music content, which is the control unit of the music content, is converted into a musical song position, which is the control unit of the performance data.

  Step S11 updates the current position (playback position) and tempo of the song being played based on the performance data in accordance with the obtained musical song position. For example, the playback position and playback tempo of the song being played based on the performance data are updated so that the song position matches the song being played according to the stream distribution from the server device 10A after a predetermined time has elapsed. In step S12, the current position (reproduction position) and tempo of the performance data being reproduced are changed according to the updated current position and tempo, and a performance guide is performed based on the reproduction of the performance data. That is, the playback position and playback tempo of the song being played in response to the stream distribution from the server apparatus 10A, the performance guide position based on the performance data distributed from the server apparatus 10A and the tempo for the performance guide And the performance guide synchronized with the musical sound emitted in response to the stream distribution is performed. Even if tempo information is defined in the performance data, the tempo information is ignored. Step S13 generates a musical sound in response to a manual performance operation by the user. In step S14, it is determined whether or not the reproduction position has reached the end of the song, that is, the end of the performance data. When it is determined that the playback has been performed up to the end of the song, that is, when the playback has ended (yes in step S14), the processing ends. On the other hand, when it is determined that the reproduction has not been performed up to the end of the music (no in step S14), the process returns to step S8, and the processes in steps S8 to S14 are repeatedly executed.

On the other hand, if it is determined in step S8 that the packet is missing (yes in step S8), the sample count value is updated by the number of samples included in the missing packet (step S15). Pauses playback of performance data. In other words, if the next packet to be played back has not arrived (if there is a packet loss), silent music is generated for the predetermined number of fixed samples (for example, 160 samples) used at the time of packet generation. As a result, the performance data is paused for the duration of silence, and the performance guide is advanced more than necessary before the generated music. Do not do it. After the processes in steps S15 and S16, the process returns to step S8.

  As described above, the electronic musical instrument according to the present invention sequentially receives the music content received at the same time while receiving the music content stream-distributed from the server device connected via the communication network. In addition, while downloading performance data related to the music content distributed in a pseudo stream from the server device, the performance data is sequentially reproduced when a part of the performance data is downloaded, and a performance guide is based on the performance data. I do. When performing these processes simultaneously, the playback position of the music content being played back is acquired, and the playback position of the acquired music content is acquired based on tempo map data associated with the music content acquired in advance from the server device. Are converted into musical song positions for controlling the generation of musical sounds based on the performance data. Then, the performance data is reproduced while changing the reproduction position and / or reproduction tempo so as to match the converted musical musical position. As a result, a performance guide is performed by reproducing the performance data distributed from the server device in synchronization with the reproduction of the music content distributed from the server device. In this way, even if the user uses an electronic musical instrument that does not have a storage means with a sufficient storage capacity, simply connecting the electronic musical instrument to the server device via the communication network provides an accompaniment or a model. Users can easily and quickly perform performance performance anywhere and anytime while referring to model performances and receiving performance data such as performance guides that are synchronized with the progression of model performances that serve as examples and accompaniment. be able to. Furthermore, it is not necessary to previously generate dedicated distribution data for synchronizing the music content and presentation of performance data such as a performance guide in the server device.

Note that the generation of musical sounds according to the stream distribution of music content by the server device, the performance guide according to the reproduction of performance data by the electronic musical instrument, and the generation of musical sounds of the electronic musical instrument by the user's performance operation (keyboard) operation / It is convenient that you can practice performance more effectively by switching the parts by specifying practice parts such as both hands.
Note that the music content stream-distributed from an external server device is not limited to digital audio data. For example, it may be video data (musical sound + video) in which a model performance operation as a model is recorded. In this case, the electronic musical instrument does not count the number of samples of the digital audio signal, but counts the number of frames, which is moving image information included in the moving image data, and the reproduction of the moving image data in the server device according to the counted number of frames. It is recommended to synchronize. Furthermore, the content of the music content is not limited to a model performance or accompaniment as a model, but may be any content such as a voice instruction by a performer or performance instructor or points to be noted during performance. .
Note that the performance data delivered from the external server device to the pseudo stream is not limited to MIDI data, and any performance data such as a performance guide can be presented on an electronic musical instrument. . For example, the performance data may be logical score data. When performing musical performance guides using musical scores, using logical musical score data with a smaller data size compared to bitmap data rather than using bitmap data, which inevitably increases the data size, the progression of the song In contrast, the score display needs to be updated less. Therefore, the present invention is particularly effective when performing performance guidance by acquiring such logical score data from the server device.

In addition, the user can arbitrarily create, update, and change various data such as music contents, song list data, performance data, and tempo map data stored in the server device, or set correspondence between these data from the electronic musical instrument. You may be able to do that.
The performance data may be presented in any other manner of presentation as well as a performance guide that can present the performance operator to be performed next to the user. In addition, for example, a presentation mode such as driving the performance operator (keyboard) 4A of the own device to automatically perform a key pressing operation, driving the tone generator circuit 7 to generate a musical sound, or the like may be used. . In addition, the performance guide may be displayed in the form of a musical score according to the time position where the performance is to be performed. In this case, the performance data obtained as a batch is used as a pseudo stream and before and after the time position where the performance is to be performed. It should be displayed.

1 is a block diagram of a hardware configuration showing an overall configuration of an electronic musical instrument according to the present invention. It is the block diagram which showed typically one Example of the performance guide interlocking | linkage function. It is a conceptual diagram which shows one Example of tempo map data. It is a flowchart which shows one Example of the first half process of a performance guide control process. It is a flowchart which shows one Example of the first half process of a performance guide control process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 1A ... Timer, 2 ... ROM, 3 ... RAM, 4 ... Performance operation detection circuit, 5 ... Setting operation detection circuit, 4A ... Performance operation element, 5A ... Setting operation element, 6 ... Display circuit , 6A ... display, 7 ... sound source circuit, 8 ... effect circuit, 8A ... sound system, 9 ... external storage device, 10 ... communication network interface, 10A ... server device, 11 ... MIDI interface, 11A ... MIDI device, 1D ... communication Bus, X ... Communication network, EM ... Electronic musical instrument, DC (DE) ... Memory, SF ... Song folder, SD ... Song file, PLC ... Song list, FF (FR) ..Data transfer unit, K ... Measurement unit, CV ... Conversion unit, PE ... Play unit, MP ... MIDI playback unit, YI ... User interface unit, G ... Performance guide control Part OT ··· tone output section

Claims (2)

A function of storing a large number of music contents in association with performance data corresponding to musical sounds generated based on the reproduction of the music contents, and tempo map data indicating the tempo of the musical sounds to be reproduced and changes thereof, respectively. Connection means for connecting a server device having a function of distributing the stored music content, performance data, and tempo map data via a communication network;
A designation means for designating any one of a large number of music contents stored in the server device;
Data acquisition means for acquiring tempo map data associated with the designated music content from the server device;
Instruction means for instructing the server device to start distribution of the designated music content;
A first reproduction means for sequentially reproducing the music content that has already been received while receiving the music content that is stream-distributed according to the instruction from the server device;
Second playback means for sequentially playing back the performance data when a part of the performance data is downloaded while downloading performance data distributed in a pseudo stream according to the instruction from the server device;
Obtaining means for obtaining a reproduction position of the music content being reproduced;
Conversion means for converting the playback position of the acquired music content based on the acquired tempo map data into a musical song position for controlling generation of musical sound based on performance data;
Changing means for changing the playback position and / or playback tempo of the performance data being played based on the converted musical song position;
Comprising performance data presenting means for presenting performance data in a predetermined manner according to reproduction of the performance data,
An electronic musical instrument, wherein performance data is reproduced in a predetermined manner by reproducing performance data distributed from the server device in synchronization with reproduction of music content stream-distributed from the server device. On the computer,
A function of storing a large number of music contents in association with performance data corresponding to musical sounds generated based on the reproduction of the music contents, and tempo map data indicating the tempo of the musical sounds to be reproduced and changes thereof, respectively. Connecting a server device having a function of delivering the stored music content, performance data, and tempo map data via a communication network;
A procedure for designating any one of a large number of music contents stored in the server device;
Obtaining tempo map data associated with the designated music content from the server device;
A procedure for instructing the server device to start distributing the designated music content;
A procedure for sequentially playing back the music content that has been received simultaneously while receiving the music content that is streamed in response to the instruction from the server device;
A procedure of sequentially playing the performance data when a part of the performance data is downloaded while downloading the performance data distributed in a pseudo stream according to the instruction from the server device;
Obtaining a playback position of the music content being played;
A procedure for converting the playback position of the acquired music content into a musical song position for controlling generation of musical sound based on performance data based on the acquired tempo map data;
Changing the playback position and / or playback tempo of the performance data being played based on the converted musical song position;
A program for executing a procedure for presenting performance data in a predetermined manner in accordance with reproduction of the performance data.

Images