JP5109426B2 - Electronic musical instruments and programs - Google Patents

Description

  The present invention relates to an electronic musical instrument and a program that use an external content playback apparatus having a content storage / playback function. In particular, the present invention relates to an electronic musical instrument and program that can easily present performance data such as a performance guide in synchronization with content reproduction in an external content reproduction apparatus.

Conventionally, when connected to an external device such as an electronic musical instrument via a MIDI sequencer in a recording / playback device such as an MD (Mini Disc), a hard disk recorder, or various digital VTRs, the connected external device according to predetermined tempo map data A device that controls (electronic musical instrument) synchronously is known. For example, the technique described in Patent Document 1 shown below is an example. In the conventionally known technique shown in Patent Document 1, recording is performed by outputting a synchronization signal for synchronizing an external device in accordance with tempo map data associated with digital audio data recorded in a recording / reproducing apparatus. It describes that the recording / reproduction of digital audio data by a reproduction apparatus and the reproduction of performance data (here, MIDI data) by an electronic musical instrument are synchronously controlled.
JP 9-288484 A

  Recently, a large number of music contents (for example, MP3 format digital audio data or moving image data) can be stored in a storage device such as a hard disk or a semiconductor memory housed in a small casing. A so-called portable media player, portable audio player, or the like, which can reproduce music content appropriately selected by the user from a large number of music contents, and so-called portable media player, portable audio player, etc. Portable content playback devices equipped with are becoming widely used. In addition, in the electronic musical instrument, the performance operator to be operated by the user is sequentially specified by controlling the display of the musical score in the corresponding range as the music progresses and lighting control of light emitting elements such as the keyboard LED provided near the keyboard. Conventionally, it has been known that a performance guide can be performed. Therefore, in an electronic musical instrument, it is useful to be able to perform a performance guide using an enormous number of music contents stored in the content playback device in order to effectively use such an external content playback device. is there. In this specification, the term “musical sound” is not limited to musical sound, but is used in the sense that it may include voice or any other sound.

  However, in order to synchronize with the playback of music content on an external content playback device, the electronic musical instrument can perform performance guides such as display update control of musical scores and lighting control of light emitting elements such as keyboard LEDs. The user needs to make a setting in advance such as associating the music content stored in the external content playback apparatus with the performance data and tempo map data stored in the electronic musical instrument. Is not only annoying, but it is difficult to make such settings, especially for children and beginners. Also, each piece of data must be managed for each song, which is troublesome. For this reason, an electronic musical instrument that can perform performance practice using an external content playback device while receiving a performance guide has not yet been considered.

  The present invention has been made in view of the above-described points, and the user uses an external content playback device to receive performance data such as a performance guide synchronized with the playback of music content on the content playback device. It is an object to provide an electronic musical instrument and a program that can be easily practiced.

The electronic musical instrument according to the present invention associates a large number of music contents with performance data corresponding to the musical sound generated based on the reproduction of the music content, and tempo map data indicating the tempo of the musical sound to be reproduced and the change thereof. One of a plurality of music contents stored in the connected content reproduction device and a connection means for connecting a content reproduction device having at least a function of storing the content and at least a function of reproducing the stored music content Designation means for designating, data acquisition means for obtaining performance data and tempo map data associated with the designated music content from the connected content reproduction device, and selecting and playing the designated music content Instruct the playback to the connected content playback device A content reproduction instruction means, said reproduction means for reproducing the acquired performance data in accordance with the reproduction instruction, in accordance with the reproduction of the music contents according to the reproduction instruction in the connected content reproducing apparatus, from the content reproduction apparatus Obtaining a sample count value according to the audio sample data sent, obtaining means for obtaining the playback position of the music content currently being played based on the obtained sample count value, and based on the acquired tempo map data, Conversion means for converting the playback position of the currently played music content in the content playback apparatus to a musical song position for controlling the generation of musical sound based on performance data, and the converted musical song Based on the position, the playback position and / or playback tempo of the performance data being played back And presenting performance data in synchronism with the musical sound emitted from the connected content reproduction device, comprising: changing means for changing; and performance data presentation means for presenting performance data in a predetermined manner according to reproduction of the performance data. It is characterized by performing.

According to the present invention, a large number of music contents are stored in association with performance data corresponding to the musical sound generated based on the reproduction of the music content, and tempo map data indicating the tempo of the musical sound to be reproduced and its change. Performance data and tempo map data associated with the designated music content are acquired from the content playback apparatus. Acquiring the playback position of the music content currently being played according to the playback of the specified music content by the content playback device, and acquiring the playback position of the acquired music content based on the acquired tempo map data It is converted into musical song positions for controlling the generation of musical sounds based on already-played performance data. The music content reproduction position is obtained based on the sample count value obtained according to the audio sample data sent from the content reproduction device. Then, the acquired performance data is reproduced while changing the reproduction position and / or reproduction tempo so as to match the converted musical musical position, and the performance data is presented in a predetermined manner according to the reproduction. That is, the synchronization control between the playback position of the music content being played back by the content playback apparatus and the playback position of the performance data played back by the electronic musical instrument is performed on the electronic musical instrument side that receives the performance data from the content playback apparatus. In this way, the user can record music data stored in an external content playback device and performance data such as a performance guide in synchronization with music based on the playback of the music content emitted from the content playback device on the electronic musical instrument side. This is convenient because it is not necessary to make settings such as associating the performance data and tempo map data necessary for presentation with each other. In addition, since the content playback device can be easily connected to any electronic musical instrument, it is easy to exchange, and even if the content playback device is replaced, synchronization control is performed on the electronic musical instrument side. While listening to the musical tone that is the model performance on the device, the user can easily and quickly perform any effective performance practice while receiving performance data such as performance guides synchronized with the musical tone of the model performance on the electronic instrument side. Can be done.

  The present invention may be constructed and implemented not only as an apparatus invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

  According to the present invention, music content, performance data and tempo map data associated with the music content are stored in an external content playback device, and the electronic musical instrument acquires the performance data and tempo map data from the content playback device. The performance data is presented to the user while changing the playback position and / or playback tempo of the performance data being played back on the electronic musical instrument side based on the tempo map data in accordance with the music content being played back by the external content playback device. The effect that it can be obtained. In particular, when a performance guide is provided as presentation of performance data, the user listens to a musical sound from the content reproduction apparatus, while the electronic musical instrument side receives an effective performance guide synchronized with the musical sound emitted from the content reproduction apparatus. This makes it easier to perform practical performance practice and is more effective.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing the overall configuration of an electronic musical instrument according to the present invention. The electronic musical instrument shown in this embodiment is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire electronic musical instrument. For this CPU 1, via a data and address bus 1D, ROM 2, RAM 3, performance operation detection circuit 4, setting operation detection circuit 5, display circuit 6, tone generator circuit 7, effect circuit 8, external storage device 9, communication network interface (I / F) 10, MIDI interface (I / F) 11, and USB (Universal Serial Bus) interface UI (specifically USB Host) included in a connector CN for connecting a portable content playback device (not shown), A serial communication network interface (I / F) SI, an analog audio interface (I / F) AI, and the like are connected to each other. Further, the CPU 1 is connected to a timer 1A for measuring the interrupt time and various times in the timer interrupt process (interrupt process). For example, the timer 1A generates a clock pulse, and gives the generated clock pulse to the CPU 1 as a processing timing command or to the CPU 1 as an interrupt command. The CPU 1 executes various processes according to these instructions.

  The ROM 2 stores various programs executed by the CPU 1 and various data. The RAM 3 is used as a working memory that temporarily stores various data generated when the CPU 1 executes a predetermined program, or as a memory that stores a currently executed program and related data. A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like. As will be described in detail later, in this embodiment, a list of songs (music contents) that can be practiced, acquired from an external portable content playback apparatus connected to the electronic musical instrument main body via the connector CN, is presented to the user. Playlist data (see FIG. 2 to be described later), performance data (in detail, MIDI data) relating to an arbitrary song that the user wants to practice, and tempo map data (see FIG. 3 to be described later) associated therewith, It can be stored temporarily.

  The performance operator 4A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. The keyboard etc. can be used for manual performance by the user's own hand-playing or chord input for automatic accompaniment, as well as external portable content connected to the electronic musical instrument body via the connector CN It can also be used as a control means for controlling the playback apparatus. The performance operation detection circuit 4 generates a detection output by detecting pressing and release of each key of the performance operator 4A. The setting operation element (switch or the like) 5A includes, for example, a switch for selecting a song that the user wants to practice, a switch for designating the position and part of the song that the user wants to practice, and a connector CN. There are a switch for instructing a connected portable content playback apparatus to start playback of content, a switch for instructing start / stop of automatic accompaniment that is automatically played in accordance with a user's manual performance, and the like. Of course, the setting operator 5A is also a numeric keypad for inputting numeric data, a keyboard for inputting character data, or a predetermined display displayed on the display 6A. Various operators such as a mouse used for operating the pointing device may be included. The detection circuit 5 detects the operation state of each switch and outputs switch information corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 6 displays, for example, a song list screen (not shown) that presents songs that can be practiced based on playlist data on a display 6A composed of, for example, a liquid crystal display panel (LCD) or a CRT, and playback of performance data. For example, a performance guide using a display such as a musical score corresponding to the position of the music, a currently set manual performance environment, or a control state of the CPU 1 is displayed. By referring to these various types of information displayed on the display 6A, the user can easily select a song to practice, set a performance environment for manual performance, or practice manual performance, for example. Become.

  The tone generator circuit 7 can simultaneously generate musical tone signals on a plurality of channels, and is generated in response to manual operation of the performance operator 4A given by the user via the data and address bus 1D, or stored in advance. Various pieces of performance information generated in accordance with the performance data being inputted are input, and a musical tone signal is generated based on the performance information. The musical sound signal generated from the sound source circuit 7 is given an effect via the effect circuit 8 and the like, and is generated from the sound system 8A including an amplifier and a speaker. Any conventional configuration may be used for the sound source circuit 7, the effect circuit 8, and the sound system 8A. For example, the tone generator circuit 7 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., and may be configured by software processing by the CPU 1 or by dedicated hardware. May be.

  The external storage device 9 stores various data and various control programs executed by the CPU 1. When no control program is stored in the ROM 2, the control program is stored in the ROM 2 by storing the control program in the external storage device 9 (for example, a hard disk) and reading it into the RAM 3. The CPU 1 can be operated in the same manner as in the case. In this way, control programs can be easily added and upgraded. The external storage device 9 is not limited to a hard disk (HD), but a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), a DVD (Digital Versatile Disk), etc. Any storage device may be used as long as the storage device uses various external storage media. Alternatively, a semiconductor memory such as a flash memory may be used.

  The communication network interface (I / F) 10 is connected to a wired or wireless communication network X such as a LAN, the Internet, or a telephone line, and is connected to a server device (server computer) 10A via the communication network X. This is an interface for fetching a control program or various data from the server device 10A to the electronic musical instrument side. That is, when the control program and various data are not stored in the ROM 2 or the external storage device 9 (for example, a hard disk), it is used to download the control program and various data from the server device 10A. Such a communication network interface 10 may include both of them, not wired or wireless. The MIDI interface (I / F) 11 inputs performance data (MIDI data) in MIDI format from another externally connected MIDI device 11A or the like to the electronic musical instrument, or receives performance data in MIDI format from the electronic musical instrument. This is an interface for outputting to another MIDI device 11A or the like. The other MIDI device 11A may be any device that generates data in MIDI format in response to a manual performance operation by a user. Any type of operation device such as a keyboard type, a guitar type, a wind instrument type, a percussion instrument type, a gesture type, etc. (Or comprising an operation form).

  The portable content playback device connector CN is an interface device for externally connecting a known content playback device such as a mobile content playback device (not shown) to transmit / receive information to / from the electronic musical instrument and the mobile content playback device. is there. The connector CN has a different interface for each type of information to be transmitted / received as a communication path (or signal line) for transmitting / receiving information between the electronic musical instrument and the portable content reproduction apparatus. Here, a USB interface UI (specifically USB Host) that can transmit and receive digital audio data and digital audio signals, and a serial communication network interface that can transmit control commands (commands) for controlling the operation of the portable content playback device (I / F) The example which has three communication paths of SI and analog audio interface (I / F) AI which can transmit / receive an analog audio signal was shown. The USB interface UI may also serve as control command (command) communication. Since each of these interfaces is publicly known, description thereof is omitted here. When the electronic musical instrument and the portable content playback device are connected via the connector CN including the plurality of interfaces, the performance of the portable content playback device is controlled from the electronic musical instrument or stored in the portable content playback device. And tempo map data can be taken into the electronic musical instrument side, and digital audio data generated from the portable content playback device can be obtained at the electronic musical instrument side (details will be described later). The USB interface UI included in the electronic musical instrument is an interface device called a so-called USB host controller, and thus the electronic musical instrument is a USB host device. On the other hand, the USB interface included in the portable content playback device is an interface device called a so-called USB target controller, and thus the portable content playback device is a USB target device.

  Here, a portable content playback apparatus connected to an electronic musical instrument via the connector CN will be briefly described. 2. Description of the Related Art As is known in the art, a portable content playback apparatus uses a large number of music contents made up of digital audio data, moving image data, and the like with music-associated information (not shown) associated with the music contents such as a music title and music genre. ) Etc., music content storage function for storing in a built-in data storage (for example, hard disk or semiconductor memory), and music content stored in the built-in data storage in response to a user operation (may include decoding) It is a device having at least a playback function and a data transmission / reception function for transmitting / receiving various types of information including music content to / from an external device. That is, unlike a device (external storage device 9) that can simply store music content such as an external hard disk device or USB memory, the portable content playback device can only store a large number of music content. Rather, it is a device that can generate a musical sound by reproducing any music content from among the stored many music contents according to user designation or randomly. Furthermore, the device includes an interface for connecting an external device, and is a device that can transmit and receive information such as music content to and from the external device connected to the interface. In addition to the above-mentioned, the portable content playback apparatus can use other functions such as a list of music contents stored in the built-in data storage and the names and album names of the music contents being played back based on the music accompanying information. In addition, a display function for displaying on a display device such as a built-in liquid crystal panel may be provided.

Note that the electronic musical instrument is not limited to one in which the performance operator 4A, the display 6A, the sound source circuit 7 and the like are built in one apparatus body, but each is configured separately, and each of the electronic musical instruments is configured using communication means such as a MIDI interface or various networks. Needless to say, the apparatus may be configured to be connected. Furthermore, the electronic musical instrument according to the present invention is not limited to the above-described form, and a musical tone is generated according to a user's manual operation such as a switch, button, or pad that also functions as a performance operator such as a personal computer, a karaoke device, or a game device. As long as it generates the above, it may be applied to any form of apparatus or device.
Of course, the content playback apparatus that can be connected to the electronic musical instrument need not be portable.

  In the electronic musical instrument shown in FIG. 1, a performance guide that uses a score display by driving the display 6A, a performance guide that automatically turns on / off by driving a keyboard LED (not shown), and the like are connected via the connector CN. It can be executed in conjunction (synchronization) with the reproduction of the music content in the connected portable content reproduction device. An outline of a performance guide interlocking function for performing performance guidance on the electronic musical instrument side in synchronization with the playback of music content on the portable content playback apparatus will be described with reference to FIG. FIG. 2 is a block diagram schematically showing an embodiment of the performance guide interlocking function. The arrows in the figure indicate the flow of data and signals. In addition, although the structure which implement | achieves a performance guide interlocking | linkage function may have hardware other than what is shown in FIG. 2, it demonstrates here the case where a required minimum resource is used.

  The portable content playback device CS has a music content storage function for storing a large number of music content, a music content playback function for playing back stored music content, and a data transmission / reception function for transmitting / receiving various types of information to / from external devices. Have. The storage unit DC realizes the music content storage function. Here, the storage unit DC stores a large number of music contents, and the stored many music contents are displayed in a list with information such as a song name and an artist name. A playlist (Playlist) PLC is stored. As an example of a specific method for storing music contents in the storage unit DC, folders SF (Song1, Song2, Song3,...) Associated with each category of song genre so that each music content can be classified by song genre etc. ..) and is stored as a song data set file SD (Song1.html). One song data set file SD (Song1.html) is associated with a plurality of data (files). There are several methods for associating each data. For example, a separate association file composed of a link path to each piece of data to be associated is prepared, the data file name assigned to each piece of data is made common, and the extension is different for each piece of data. There is a method of collecting each data associated with one folder. Of course, the method is not limited to the above method, and any method may be used as long as the user can easily manage / specify a plurality of data to be associated.

  The plurality of data associated with each other is digital audio data (Song1.mp3), performance data such as MIDI (Song1.mid), and tempo map data (Song1.map). Digital audio data (Song1.mp3) is data for generating a musical tone that serves as a model, and is generated from natural or electronic musical instruments according to actual live performances by musicians or teachers (music teachers). It is data generated by recording a musical sound while sampling it and performing data compression on the recorded sampled musical sound (that is, not performance data such as MIDI). Digital audio data may typically be stored in a mixed state without separating all parts of the song, such as right hand parts, left hand parts, their minus ones, or accompaniment parts that the user does not play, It may be stored as multi-channel data divided for each part, or may be stored as separate data for each part. In such digital audio data, information on the reproduction position of a song is specified so that it can be specified by a combination of sampling frequency and sample count, elapsed time from the beginning of the song, or the like.

  The performance data (Song1.mid) is, for example, MIDI data that can generate musical sounds (digital audio signals) such as songs based on the associated digital audio data by controlling an electronic musical instrument. The performance data is also control data required when controlling the electronic musical instrument to perform the performance guide. Tempo map data (Song1.map) is data for synchronizing the playback of the digital audio data in the portable content playback device and the playback of the performance data in the electronic musical instrument. Specifically, information specifying the playback position in music content such as sample count and time specified in digital audio data, music tempo specified in performance data, or musical song position such as beat and measure It is data for conversion into information to be performed. Such tempo map data may be any known data, and an example thereof is shown in FIG. FIG. 3 is a conceptual diagram showing an embodiment of the data structure of tempo map data.

  The tempo map data can be played by the performer or a person other than the performer at every beat while listening to the music generated from natural or electronic musical instruments according to the actual live performance by the performer or teacher (music teacher). Are generated by tapping a switch of a known dedicated device (not shown) and recording a change in tempo according to the time interval of the tapping operation. However, in general, when recording a tempo change at one beat intervals that allows the user to tap the switch accurately and reasonably, the time interval is too coarse to capture the tempo change in the song, so it is supplemented with a finer time interval. While recording tempo changes in time series. For example, like the tempo map data shown in FIG. 3A, the number of samples included in the time interval is recorded in time series every 1/24 beat from the beginning of the song. If the sampling frequency for recording the musical sound generated according to the performance is 48 KHz and the performance tempo of the song is 120 beats / min, the number of samples included in 1/24 beat is “1000”. Corresponds to the sample. However, in the example shown in FIG. 3A, a complementary value (two samples in this case) is taken into consideration to compensate for a subtle timing shift for each beat.

  On the other hand, the tempo map data shown in FIG. 3B is composed of time-series data indicating the tempo, time signature, and number of continuous bars for each song. According to the tempo map data shown in FIG. 3 (b), the tempo is 120 and the time signature is 4/4 from the beginning of the song to the first 200 bars, the tempo is 140 and the time is 4/4 in the next 160 bars, and the next This means that the 200 bars of tempo = 140, time signature = 3/4, and the last 200 bars, tune = 120, time signature = 4/4, the music (specifically, digital audio data) is reproduced. In the electronic musical instrument, such tempo map data is fetched from the portable content playback device together with the performance data, and a performance guide based on the performance data in the electronic musical instrument is used as a base to reproduce digital audio data in the portable content playback device. (The details will be described later). In the tempo map data shown in this embodiment, a “−” sign is added to the number of continuous measures at the beginning of a song. This “−” sign means that a blank period from the start of playback of digital audio data in the portable content playback apparatus to the start of playback of performance data in the electronic musical instrument (start of performance guide) is inserted. The numerical value following the number indicates the length (number of measures) of the blank period.

  Returning to the description of FIG. 2, the data transfer unit FF realizes a data transmission / reception function. Here, the electronic musical instrument EM connected to the connector CN from the portable content reproduction device CS is stored in the storage unit DC. Among them, playlist data, tempo map data, and performance data are transmitted as necessary. That is, the data transfer unit FF transmits playlist data to the electronic musical instrument EM in response to the electronic musical instrument EM being attached to the connector CN. Also, in response to the selection of a song by the electronic musical instrument EM connected to the connector CN, tempo map data and performance data associated with the selected song are transmitted. The playback unit PC realizes a music content playback function, and the corresponding stored in the storage unit DC in response to a playback instruction of music from the electronic musical instrument EM connected to the connector CN (or an instruction on the own device). Play back the digital audio data of the song you want to play. The musical sound generated by playing back the digital audio data by the playback unit PC is sent to the headphones H (audio output unit) of the portable content playback device CS. Therefore, the user can monitor the musical sound from the audio output of the portable content playback device CS.

  On the other hand, the electronic musical instrument EM has a configuration as shown in FIG. 1 described above, and not only can a manual performance by the user be realized, but also the progress of a song being played in the portable content playback device CS connected via the connector CN. Accordingly, the user can be provided with a performance guide by displaying a musical score on the display 6A or turning on / off a keyboard LED (not shown). The data transfer unit FR receives playlist data, tempo map data, and performance data transmitted from the data transfer unit FF in the portable content playback device CS, and sends the received data to the storage unit DE. . The storage unit DE stores playlist data, tempo map data, and performance data sent from the portable content playback device CS (indicated by hatching in the drawing). The playlist data is automatically acquired and stored in response to the portable content playback device CS being connected to the electronic musical instrument EM. The user interface unit YI controls the display circuit 6 and the like so that a large number of music contents stored in the portable content playback device are displayed in a list on the display 6A based on the playlist data stored in the storage unit DE. The user can select a song to be practiced based on a list of songs (music contents) displayed on the display 6A. Only the relevant tempo map data and performance data are acquired and stored before the digital audio data of the song desired by the user is played back in the portable content playback device CS according to the song selection by the user.

  The storage unit DE stores a sample count value in addition to the above data. The sample count value is output by the measurement unit K. The measuring unit K counts the number of samples of musical sound (digital audio signal) generated with the reproduction of digital audio data by the reproduction unit PC of the portable content reproduction unit CS. Since any known method for counting the number of samples from the digital audio signal in the measurement unit K may be used, the description thereof is omitted here. The playback unit PE plays back the performance data stored in the storage unit DE. When the playback unit PE receives the song position and tempo update information from the conversion unit CV during playback of the performance data, the playback unit PE changes the song position and the playback tempo of the song and plays the performance data. The conversion unit CV converts the song position and tempo information in the digital audio data into the performance data based on the sample count value stored in the storage unit DE while being updated as needed in response to the reproduction of the digital audio data in the portable content reproduction device CS. Convert to song position and tempo information. A signal (audio signal) generated by playing the performance data in the playback unit PE is sent to the performance guide control unit G (performance data presentation unit).

  The performance guide control unit G (performance data presentation unit) controls the user interface unit YI to present performance data such as a performance guide based on a signal (audio signal) generated by the reproduction of performance data by the reproduction unit PE. Control. When performing a performance guide, the user interface unit YI controls display on the display 6A, lighting / extinguishing of a keyboard LED (not shown), and the like. That is, when the performance data is reproduced by the reproduction unit PE, the display on the display 6A is updated in accordance with the progress of the music in accordance with a control instruction from the performance guide control unit G, and a keyboard LED or the like (not shown) is turned on. To do. In this way, the user interface unit YI drives a device for performing performance guidance, such as the display circuit 6 and the keyboard LED, based on a control instruction from the performance guide control unit G, so that the music content (digital data) in the portable content playback device CS is driven. A performance guide on the electronic musical instrument EM side is performed in synchronization with the progress of the musical sound generated based on the reproduction of the (audio data).

  Next, specific processing (performance guide control processing) for performing performance guidance on the electronic musical instrument EM side in synchronization with reproduction of music content on the portable content playback device CS side will be described with reference to FIG. FIG. 4 is a flowchart showing an example of the “performance guide control process”. In this processing, at least the electronic musical instrument EM and the portable content playback device CS are powered on, the portable content playback device CS is attached to the connector CN of the electronic musical instrument EM, and the user performs a predetermined operation with the setting operator 5A. This process is activated on the electronic musical instrument EM side in response to the above operation. The “performance guide control process” will be described below with reference to the flowchart shown in FIG.

  In step S1, a list of a large number of music contents stored in the portable content playback device (specifically, playlist data describing the song titles) is stored from the portable content playback device attached to the connector CN of the electronic musical instrument. get. In step S2, a list of songs (music contents) is displayed on the display 6A based on the acquired playlist data, and the user is prompted to select a song to practice. In step S3, performance data and tempo map data associated with the selected music are transmitted to the portable content playback device connected via the connector CN in response to the user's operation for selecting the music to be practiced. A request for transmission is made, and the corresponding information returned from the portable content playback device is acquired. In step S4, in response to a user operation, the position of the music for which performance practice is to be started (performance start position) and the performance part of the music whose performance is to be practiced are acquired. Step S5 initializes the tempo at the time of the performance guide and the performance position at which the performance guide is started. Step S6 waits for a user operation and requests the portable content playback device to start playback of a song selected as a song to be practiced (specifically, playback of digital audio data). Specifically, a playback start command is transmitted. Step S7 waits for the reception of the audio sample data generated in response to the playback of the digital audio data, and starts playback of the performance data received from the portable content playback device in step S3.

  Step S8 receives the digital audio sample data, measures the received digital audio sample data, and updates the sample count value. Step S9 uses the tempo map data received from the portable content playback device in step S3, and according to the measured sample count value, the musical song position (eg, bar, Beat). The sample count value is a reproduction position of the music content currently being reproduced in the portable content reproduction device, and is a control unit in the music content for controlling the generation of the musical sound based on the music content. On the other hand, the musical song position is a control unit in the performance data for controlling the generation of musical sounds based on the performance data. That is, here, the playback position of the currently played music content, which is the control unit of the music content, is converted into a musical song position, which is the control unit of the performance data.

  Step S10 updates the current position (playback position) and tempo of the song being played based on the performance data in the electronic musical instrument in accordance with the obtained musical song position. For example, the playback position and playback tempo of the performance data being played back on the electronic musical instrument are updated so that the musical sound being played back and the song position match in the portable content playback device after a predetermined time has elapsed. In step S11, the current position (reproduction position) and tempo of the performance data being reproduced are changed according to the updated current position and tempo, and a performance guide is performed based on the reproduction of the performance data. That is, the musical sound generated from the portable content playback device by matching the playback position and playback tempo of the current song on the portable content playback device with the performance guide position of the song on the electronic musical instrument side and the tempo for the performance guide. Perform a performance guide synchronized with the. Step S12 generates a musical sound in response to a manual performance operation by the user. In step S13, it is determined whether or not the playback position has reached the end of the song, that is, the end of the performance data. If it is determined that the playback has been performed up to the end of the song, that is, if the playback has ended (YES in step S13), the processing ends. On the other hand, when it is determined that the reproduction has not been performed up to the end of the music (NO in step S13), the process returns to step S8 and the processes in steps S8 to S13 are repeatedly executed.

  As described above, a large number of music contents are stored in association with the performance data corresponding to the musical sound generated based on the reproduction of the music content, and the tempo map data indicating the tempo of the musical sound to be reproduced and the change thereof. Performance data and tempo map data associated with the designated music content are acquired from the content reproduction device in accordance with the designation of the music content. In order to acquire the playback position of the music content currently being played from the content playback apparatus, and to control the generation of the musical sound based on the acquired performance data, based on the acquired tempo map data, the playback position of the acquired music content Convert to a musical song position. Then, the performance data is reproduced while changing the reproduction position and / or the reproduction tempo so as to match the musical position of the music after the conversion, and the performance data is presented in a predetermined manner according to the reproduction. In this case, the user is required to perform a performance guide in synchronization with the music content stored in the external content playback device and the musical sound based on the playback of the music content emitted from the content playback device on the electronic musical instrument side. The user does not have to make a setting such as associating the performance data and the tempo map data with each other, and only by connecting the content playback device to the electronic musical instrument while listening to the musical tone that is an exemplary performance on the content playback device ( On the other hand, the electronic musical instrument can perform effective performance practice by receiving performance data such as a performance guide synchronized with the musical tone of the model performance.

To play audio files with a portable content playback device, play performance data with an electronic musical instrument, or generate musical tones with an electronic musical instrument by a user's performance control (keyboard) operation, specify a practice part such as a right hand / left hand / two hands. If you switch the part with, you can practice performance more effectively.
Note that the portable content playback apparatus plays back not only digital audio data. For example, it may be moving image data (musical sound + video) recording a performance operation as a model. In this case, the electronic musical instrument does not count the number of samples of the digital audio signal, but counts the number of frames that are moving image information included in the moving image data, and reproduces the moving image data in the portable content reproduction device according to the counted number of frames. It is recommended to synchronize with.

Note that the user can create / update / change various data such as music content, playlist data, performance data, and tempo map data stored in the portable content playback device, or set the correspondence between these data. Needless to say, it can be done arbitrarily.
The performance data and the tempo map data are not limited to be stored separately, and the associated data among these data may be stored together as one file.
The performance data may be presented in any manner other than a performance guide that presents a model or a performance operator to be performed next to the user. A presentation mode such as driving a performance operator (keyboard) 4A included in the keyboard to automatically perform a key pressing operation or driving a tone generator circuit 7 to generate a musical sound may be used.
Although the synchronization between the portable content playback device and the electronic musical instrument is performed based on the sample count value obtained by counting on the electronic musical instrument side, the present invention is not limited to this. For example, the position of the song currently being played by the portable content playback device may be sent periodically to the electronic musical instrument. In this case, it is preferable that the portable content playback device periodically sends the song position according to the sample count value or a predetermined time interval. Alternatively, the electronic musical instrument may be able to periodically inquire and acquire the position of the currently playing music from the portable content playback device.

1 is a block diagram of a hardware configuration showing an overall configuration of an electronic musical instrument according to the present invention. It is the block diagram which showed typically one Example of the performance guide interlocking | linkage function. It is a conceptual diagram which shows one Example of tempo map data. It is a flowchart which shows one Example of a performance guide control process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 1A ... Timer, 2 ... ROM, 3 ... RAM, 4 ... Performance operation detection circuit, 5 ... Setting operation detection circuit, 4A ... Performance operation element, 5A ... Setting operation element, 6 ... Display circuit , 6A ... display, 7 ... sound source circuit, 8 ... effect circuit, 8A ... sound system, 9 ... external storage device, 10 ... communication network interface, 10A ... server device, 11 ... MIDI interface, 11A ... MIDI device, CN ... Portable content playback device connector, UI: USB interface, SI ... Serial communication interface, AI ... Analog audio interface, 1D ... Communication bus, X ... Communication network, CS ... Portable content playback device , EM ... Electronic musical instrument, DC (DE) ... Memory, SF ... Song folder, SD ... Song file , PLC ... play list, FF (FR) ... data transfer unit, H ... headphone, K ... measurement unit, CV ... conversion unit, PC (PE) ... playback unit, YI ... User interface part, G ... Performance guide control part

Claims (2)

A function of storing a large number of music contents in association with performance data corresponding to musical sounds generated based on the reproduction of the music contents, and tempo map data indicating the tempo of the musical sounds to be reproduced and changes thereof, respectively. Connection means for connecting a content reproduction apparatus having at least a function of reproducing the stored music content;
Designation means for designating any one of a large number of music contents stored in the connected content reproduction device;
Data acquisition means for acquiring performance data and tempo map data associated with the designated music content from the connected content playback device;
Content reproduction instruction means for instructing reproduction to the connected content reproduction apparatus so as to select and reproduce the designated music content;
Playback means for playing back the acquired performance data in response to the playback instruction;
In response to the playback of the music content according to the playback instruction in the connected content playback device, a sample count value is obtained according to the audio sample data sent from the content playback device, and a current playback is performed based on the obtained sample count value Acquisition means for acquiring the playback position of the music content in the medium;
Conversion that converts the playback position of the currently played music content in the acquired content playback device into a musical song position for controlling the generation of musical sound based on performance data based on the acquired tempo map data Means,
Changing means for changing the playback position and / or playback tempo of the performance data being played based on the converted musical song position;
Comprising performance data presenting means for presenting performance data in a predetermined manner according to reproduction of the performance data,
An electronic musical instrument characterized by presenting performance data synchronized with a musical sound emitted from the connected content reproduction apparatus. On the computer,
A function of storing a large number of music contents in association with performance data corresponding to musical sounds generated based on the reproduction of the music contents, and tempo map data indicating the tempo of the musical sounds to be reproduced and changes thereof, respectively. Connecting a content playback device having at least a function of playing back the stored music content;
A procedure for designating any one of a large number of music contents stored in the connected content reproduction device;
Obtaining performance data and tempo map data associated with the designated music content from the connected content playback device;
A procedure for instructing reproduction to the connected content reproduction device so as to select and reproduce the designated music content;
Replaying the acquired performance data in response to the replay instruction;
In response to the playback of the music content according to the playback instruction in the connected content playback device, a sample count value is obtained according to the audio sample data sent from the content playback device, and a current playback is performed based on the obtained sample count value To get the playback position of the music content inside,
A procedure for converting a playback position of music content currently being played back on the acquired content playback device into a musical song position for controlling generation of musical sound based on performance data based on the acquired tempo map data When,
Changing the playback position and / or playback tempo of the performance data being played based on the converted musical song position;
A program for executing a procedure for presenting performance data in a predetermined manner in accordance with reproduction of the performance data.

Images