JP2008216890A - Electronic music device, electronic music device system and program used for them - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To operate an electronic musical device in conjunction with broadcasting, even when musical performance data are not included in a broadcasting content itself. <P>SOLUTION: Musical piece data corresponding to each of one or more musical pieces included in a broadcasting content which is broadcast from a broadcast station is obtained beforehand. Based on timing control information corresponding to timing when each of one or more music piece is broadcast, by using the corresponding music piece data, it is controlled to drive at least any one of a sound source, a performance operator or a display device, so as to be synchronized with each of one or more music pieces which are performed when broadcasting the broadcast contents. Thereby, it becomes possible to operate the electronic musical device in conjunction with broadcasting, even when the musical piece data are not included in the broadcasting content which is broadcast from the broadcast station by considering that the electronic musical instrument is operated in conjunction with the music piece during broadcasting, and it becomes easy to produce the broadcasting content for operating the electronic musical instrument in conjunction with broadcasting. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an electronic music apparatus that can operate in conjunction with music being broadcast, an electronic music apparatus system, and a program used therefor. In particular, an electronic music apparatus, an electronic music apparatus system, and an electronic music apparatus system that can easily perform the production of broadcast contents in which the electronic music apparatus operates in conjunction with each other and the copyright management relating to the music used to operate the electronic music apparatus in an interlocked manner, And a program used for them.

Conventionally, music that flows from a receiving device such as a television or radio, that is, video, audio, or music that is played back based on a predetermined broadcast signal that is transmitted from a broadcasting station to an unspecified number of users as needed. 2. Description of the Related Art There is known an electronic music apparatus that can perform operations such as driving a sound source and playing music in conjunction with a broadcast of a program that includes, for example, a program being broadcast. As an example of such a device, for example, there is a device described in Patent Document 1 shown below. In the apparatus described in Patent Document 1, by playing the broadcast signal including digital data for musical instrument performance (for example, MIDI data), the musical instrument performance in response to reception of the broadcast by the receiving-side apparatus, Video and audio can be played back.
Japanese Patent No. 2538921

  By the way, in the conventional apparatus as described in Patent Document 1 described above, a MIDI data packet is included in a data channel of a broadcast signal transmitted from a broadcast station (transmission side apparatus), and the packetized MIDI data ( Music data) is transmitted as a broadcast signal (broadcast wave) in synchronization with a video signal, audio signal, etc., and used in an electronic music device (receiving device) to drive a sound source and play music Is linked to the music played in the program being broadcast. That is, the receiving side apparatus receives a broadcast wave transmitted from a broadcast station (transmitting side apparatus), and reproduces video based on a video signal included in the received broadcast wave and sound based on an audio signal. Automatic performance based on MIDI data in an electronic music device is possible. However, conventionally, since MIDI data is packetized and transmitted in advance by being included in a data channel of a broadcast signal, it is difficult to produce broadcast content including such MIDI data. Moreover, when it is desired to replace the music to be played in the program, there is a problem that it is troublesome to newly recreate the broadcast content from the beginning. Furthermore, in the conventional method of including MIDI data in a broadcast signal, it is difficult to manage copyrights related to music used for interlocking driving of an electronic music apparatus. In other words, the conventional broadcast is for an unspecified number of users, and in view of the recent increase in the number of broadcast channels, when individual users can arbitrarily select only the content that they want to view, It is not suitable for copyright management such as individual charging according to the selected content for the user.

  The present invention has been made in view of the above points, and an electronic music apparatus capable of operating an electronic music device in conjunction with music flowing in a program during the broadcast of the program without including music data in the broadcast content itself. The present invention intends to provide a music apparatus, an electronic music apparatus system, and a program used for them. It is another object of the present invention to provide an electronic music device, an electronic music device system, and a program used therefor that can easily manage the copyright of music used to operate the electronic music device.

  According to a first aspect of the present invention, there is provided an electronic music device including at least one of a sound source, a performance operator, and a display, and one or more of the electronic music device included in broadcast content broadcast from a broadcasting station. Music information acquisition means for acquiring music data corresponding to each music in advance; acquisition means for acquiring timing control information corresponding to the timing at which each of one or more pieces of music included in the broadcast content is broadcast from a broadcast station; The broadcast content according to the corresponding music data among the acquired one or more music data based on the driving means for driving at least one of a sound source, a performance operator, and a display, and the acquired timing control information For controlling the driving means to be synchronized with each of one or a plurality of music flowing at the time of broadcasting Comprising the stage.

  According to the present invention, music data corresponding to each of one or more pieces of music included in broadcast content broadcast from a broadcast station is acquired in advance, and each of one or more pieces of music included in the broadcast content is further transmitted to the broadcast station. Based on timing control information corresponding to the timing of broadcasting from the music, using the corresponding music data among the stored music data at a timing according to the timing control information, and one or more music flowing at the time of broadcasting the broadcast content Control is performed so as to drive at least one of a sound source, a performance operator, and a display in synchronization with each other. In this way, even if the broadcast content broadcast from the broadcasting station does not include music data for operating at least one of the sound source, the performance operator, and the display in the electronic music device, Since the electronic music device can be operated in conjunction with the music being broadcast, it is not necessary to create broadcast content including music data in consideration of the electronic music device operating in conjunction with the broadcast in advance. Broadcast content can be easily created.

  According to a second aspect of the present invention, there is provided an electronic music apparatus including at least one of a sound source, a performance operator, and a display, and one or more of the electronic music apparatus included in broadcast content broadcast from a broadcasting station. Music information acquisition means for acquiring in advance music specifying information for accessing music data corresponding to each music, and timing control corresponding to the timing at which each of one or more pieces of music included in the broadcast content is broadcast from a broadcast station Based on the acquired timing control information, acquisition means for acquiring information, drive means for driving at least one of a sound source, a performance operator, and a display, and the acquired one or more pieces of music specifying information The music data according to the corresponding music specifying information is acquired at any time, and the broadcast content is broadcast according to the acquired music data. That 1 so as to be synchronized with each of the plurality of music comprising a control means for controlling so as to drive the driving means. This also makes it possible to easily produce broadcast content because it is not necessary to produce broadcast content in advance in consideration of the interlocking operation of the electronic music apparatus with broadcasting.

  An electronic music apparatus system according to claim 4 of the present invention is an electronic music apparatus system comprising a server and an electronic music apparatus that are communicably connected to each other via a communication network, and is broadcast from a broadcasting station. Means for storing music data corresponding to each of one or more pieces of music included in the content, and timing control information corresponding to a timing at which each of the one or more pieces of music included in the broadcast content is broadcast from a broadcast station; A server including means for transmitting the stored one or more music data and timing control information in response to an instruction from the electronic music device; and one or more music data and timing control information transmitted from the server Based on the stored timing control information and the acquired one or more music data. Means for controlling at least one of a sound source, a performance operator, and a display so as to synchronize with each of one or a plurality of music flowing at the time of broadcasting of the broadcast content according to corresponding music data And an electronic music device.

  An electronic music apparatus system according to claim 5 of the present invention is an electronic music apparatus system comprising a server and an electronic music apparatus that are communicably connected to each other via a communication network, and is broadcast from a broadcasting station. The music data corresponding to each of one or more music included in the content, the music specifying information for accessing the music data, and the timing at which each of the one or more music included in the broadcast content is broadcast from the broadcast station Means for storing timing control information corresponding to the electronic music apparatus, means for transmitting the stored music specifying information and timing control information in response to an instruction from the electronic music apparatus, and the transmitted music from the electronic music apparatus In response to access based on specific information, the corresponding music data is transmitted among the stored music data. A server including a stage, means for receiving and storing one or more pieces of music specifying information and timing control information transmitted from the server, and the one or more pieces of music acquired based on the stored timing control information Means for accessing the server according to the corresponding music specifying information among the specific information and receiving the music data corresponding to the music specifying information as needed, and 1 to 1 flowing when the broadcast content is broadcast according to the received music data And an electronic music apparatus including means for controlling to drive at least one of a sound source, a performance operator, and a display so as to be synchronized with each of the plurality of music.

  The present invention may be constructed and implemented not only as an apparatus invention but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

  According to the present invention, the music data is separated from the broadcast content distributed from the broadcast station without including the music data used for interlocking operation of the electronic music apparatus in the broadcast content transmitted from the broadcast station. Since it is acquired from the server, it is possible to easily produce copyrighted contents that can be operated in conjunction with the electronic music device and to manage the copyright regarding the music that is used to operate the electronic music device in conjunction. The effect of becoming.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a hardware configuration block diagram showing the overall configuration of an electronic music apparatus according to the present invention. The electronic music apparatus shown in this embodiment is controlled by a microcomputer comprising a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3, such as an electronic musical instrument or a personal computer. Equipment. The CPU 1 controls the operation of the entire electronic music apparatus. For this CPU 1, the ROM 2, RAM 3, detection circuits 4 and 5, display circuit 6, sound source circuit 7, effect circuit 8, external storage device 10, short-distance communication interface (I / F) via the data and address bus 1D 11 and a network interface (I / F) 12 are connected to each other. Further, the CPU 1 is connected to a timer 1A for measuring the interrupt time and various times in the timer interrupt process (interrupt process). For example, the timer 1A generates a clock pulse, and gives the generated clock pulse to the CPU 1 as a processing timing command or to the CPU 1 as an interrupt command. The CPU 1 executes various processes according to these instructions.

  The ROM 2 stores various programs executed by the CPU 1 and various data. The RAM 3 is used as a working memory that temporarily stores various data generated when the CPU 1 executes a predetermined program, or as a memory that stores a currently executed program and related data. A predetermined address area of the RAM 3 is assigned to each function and used as a register, flag, table, memory, or the like. The performance operator 4A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. A keyboard or the like) can be used for manual performance by the user's own hand-playing, as well as for selecting a program for which the electronic music device is to be operated in conjunction when receiving a broadcast by a receiver such as a television or radio. It can also be used as an input means. In addition, an automatic driving means (not shown) is provided for each key, and each key can be driven so that a key pressing operation is automatically performed according to the music data file without being operated by the user. . The detection circuit 4 generates a detection output by detecting the pressing and release of each key of the performance operator 4A. Although not shown here, a display unit made up of a light emitting element such as an LED (referred to as a keyboard LED) may be provided for each of a plurality of keys constituting the keyboard.

  For example, the setting operator (switch or the like) 5A instructs the display 6A to display a “TV program guide” (see FIG. 3 to be described later) for selecting a program for which the electronic music apparatus is to be operated in conjunction with the broadcasting. There are a program selection switch, an interlock setting switch for instructing whether or not to drive the electronic music device in conjunction with the music to be broadcast. Of course, in addition to these, a numeric keypad for inputting numeric data, a keyboard for inputting character data, and a predetermined pointing device displayed on the display 6A, which are used for selecting, setting and controlling the pitch, tone color, effect, etc. Various operators such as a mouse used for operation may be included. The detection circuit 5 detects the operation state of each switch and outputs switch information corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 6 displays a “TV program guide” (see FIG. 3 to be described later) acquired from the server 12A on a display 6A (display) constituted by, for example, a liquid crystal display panel (LCD), a CRT, or the like, or is playing back Or the control state of the CPU 1 is displayed. By referring to the “TV program guide” displayed on the display 6A, the user can easily perform a selection operation of a program for which the electronic music apparatus is to be operated in conjunction. The tone generator circuit 7 can simultaneously generate musical tone signals in a plurality of channels, and is generated in response to the operation of the performance operator 4A given by the user via the data and address bus 1D, or a music data file. Various performance information included in the music is input, and a musical tone signal is generated based on the performance information. The musical sound signal generated from the sound source circuit 7 is given an effect via the effect circuit 8 and is generated from the sound system 9 including an amplifier and a speaker. Any conventional configuration may be used for the sound source circuit 7, the effect circuit 8, and the sound system 9. For example, the tone generator circuit 7 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., or may be configured with dedicated hardware, or configured with software processing by the CPU 1. May be.

  The external storage device 10 stores various data such as a music data file in a MIDI format, data related to control such as various control programs executed by the CPU 1, and the like. When no control program is stored in the ROM 2, the control program is stored in the ROM 2 by storing the control program in the external storage device 10 (for example, a hard disk) and reading it into the RAM 3. The CPU 1 can be operated in the same manner as in the case. In this way, control programs can be easily added and upgraded. The external storage device 10 is not limited to a hard disk (HD), but a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), a DVD (Digital Versatile Disk), etc. Any storage device may be used as long as the storage device uses various external storage media. Alternatively, a semiconductor memory such as a flash memory may be used. The short-range communication interface (I / F) 11 is connected between the electronic peripheral device 11A and an external peripheral device 11A that can receive a program broadcast from a broadcasting station such as a television or an STB (set top box). It is an interface for sending and receiving various data. Such a short-range communication interface 11 is a general-purpose wired or wireless interface such as RS-232C, USB (Universal Serial Bus), IEEE1394 (Eye Triple E 1394), Bluetooth (trademark), infrared transceiver, and the like. Good.

  The network interface (I / F) 12 is connected to a wired or wireless communication network X such as a LAN (Local Area Network), the Internet, or a telephone line, and is connected to the server computer 12A via the communication network X. This is an interface for taking a control program or various data from the server computer 12A into the electronic music apparatus. In this embodiment, a music data file and playback start timing control information are sent from the server 12A to the electronic music device in response to a request for broadcast-related music information from the electronic music device (details will be described later). ). Further, when the control program and various data are not stored in the ROM 2 or the external storage device 10 (for example, hard disk), it is used for downloading the control program and various data from the server computer 12A. Such a network interface 12 may include both of them, not wired or wireless.

  The performance operator 4A is not limited to a keyboard instrument, but may be any type of instrument such as a stringed instrument, a wind instrument, or a percussion instrument. Further, the performance operator 4A, the display 6A, the tone generator circuit 7 and the like are not limited to those built in one apparatus main body, but are configured separately, and each apparatus is configured using a communication means such as a short-range communication interface or various networks. Needless to say, it may be configured to connect the two. Further, the electronic music apparatus according to the present invention is not limited to the electronic musical instrument or the personal computer as described above, but may be any form such as a karaoke apparatus, a game apparatus, a portable communication terminal such as a mobile phone, and an automatic performance piano. You may apply to an apparatus and an apparatus. When applied to a portable communication terminal, not only when a predetermined function is completed with only the terminal, but also a part of the function is provided on the server side, and the predetermined function is realized as a whole system composed of the terminal and the server. You may make it do.

  In the electronic music apparatus shown in FIG. 1, the performance operator (keyboard) 4A of the own device is driven to automatically perform a key pressing operation, the tone generator circuit 7 is driven to play music, and the display 6A. Is displayed in the program being broadcast, such as displaying the musical score of the music being broadcast by driving, and further turning on / off automatically by driving a keyboard LED (not shown) Perform in conjunction with the music. Therefore, an outline of an interlocking operation system capable of operating an electronic music device in conjunction with music played in such a broadcast program will be described with reference to FIG. FIG. 2 is a system block diagram schematically showing an embodiment of the overall configuration of the electronic music apparatus system according to the present invention. The interlocking operation system may have hardware other than that shown in FIG. 2, but here, a case where the minimum necessary resources are used will be described.

  The linked operation system shown in this embodiment is a television broadcast station B that distributes the produced broadcast content (program) as a television broadcast, and an end user device that receives the broadcast content (program) from the television broadcast station B. A television receiver T that can arbitrarily receive and use a user-desired program among broadcast contents (programs) to be distributed; an electronic musical instrument DM that operates in conjunction with music played in the program being broadcast; It can be roughly divided into servers S connected to a communication network. The television broadcasting station B broadcasts the broadcast content produced by the content production device CS wirelessly or by wire. The broadcast (distribution) form of broadcast content from the television broadcast station B may be digital broadcast or analog broadcast. Broadcast content distributed from such a television broadcasting station B is produced by the content production device CS. For example, music programs such as concerts, commercials including music, movies and dramas including music, etc. Content that includes music in addition to audio. In addition, a computer (not shown) provided in the television broadcasting station can be appropriately connected to a server S (to be described later) via an existing communication network such as the Internet so that bidirectional communication is possible. It can be reflected in the “TV program guide” (see FIG. 3) stored in the server S. The content production device CS is a device for producing broadcast content including a video signal, an audio signal, and a data signal, or changing the content of the broadcast content such as video, audio, and music. However, the broadcast content produced by the content production device CS does not include a music data file (such as MIDI data) used to operate the electronic music device in an interlocked manner.

  The television receiver T includes at least a reception / decoding unit RD, a video reproduction unit V such as a cathode ray tube, a liquid crystal display or a plasma display, and an audio reproduction unit M such as a speaker. The reception / decoding unit RD receives a broadcast signal distributed as a television broadcast from the television broadcast station B, and decodes the received broadcast signal into a video signal, an audio signal, and a data signal. The decoded video signal is sent to the video reproduction unit V, and the video reproduction unit V displays a video based on the decoded video signal. On the other hand, the decoded audio signal is sent to the audio reproduction unit M, and the audio reproduction unit V generates a sound based on the decoded audio signal. The decoded data signal is used according to the type of the data signal by a data utilization unit (not shown). For example, there is a character broadcast that displays characters.

  The electronic musical instrument DM is an electronic music apparatus as shown in FIG. 1 described above, and a performance operator (keyboard) 4A of its own apparatus is provided in accordance with the music played in the program being broadcast on the television broadcasting station B. Interlocking operations such as driving, playing the sound source circuit 7 to play music, displaying the score of the music being broadcast on the display 6A, and turning on / off a keyboard LED (not shown) It is a device that can be performed. The control unit C issues a reproduction start instruction to the reproduction unit G in accordance with the reproduction start timing control information stored in the storage unit R. In response to a playback start instruction from the control unit C, the playback unit G stores the music according to the corresponding music specifying information (for example, a music data file name or a music data file URL (Uniform Resorce Locator)) stored in the storage unit R. The corresponding music data file is read out from a large number of music data files stored in the section R, or connected appropriately via the communication section I so that bidirectional communication is possible via an existing communication network such as the Internet. The corresponding music data file is received from the server S by stream delivery. The music control information composed of the combination of the music specifying information and the reproduction start timing control information stored in the storage unit R is information acquired from the server S in response to a broadcast-related music information request via the communication unit I. . The music data file read from the storage unit R (or the music data file streamed from the server S) is at least one of the sound source unit O, the performance operator (keyboard) driving unit KD, and the display unit driving unit DD. The electronic music apparatus is operated in conjunction with the music that is sent and played during the broadcast of the program distributed from the television broadcasting station B. That is, the reproduction start of the music data file is controlled based on the reproduction start timing control information, and at least one of the sound source unit O, the performance operator driving unit KD, and the display unit driving unit DD is controlled based on the reproduced music data file. One is controlled, and music is generated from the electronic musical instrument DM, a performance operator (keyboard) is driven, and a display ( Display, keyboard LED, etc.).

  The server S stores (stores) music piece control information related to music in the broadcast content. The music control information includes music specifying information for specifying a music data file (for example, a standard MIDI data file) corresponding to music included in the broadcast content, and a timing for starting reproduction of the music data file (according to the broadcast of the program). Reproduction start timing control information for controlling the music), and corresponding information is sent to the electronic musical instrument DM according to the designation from the electronic musical instrument DM and stored in the storage unit R. . Note that the music flowing in the broadcast content may be a part of the music data (from the beginning to the middle of the music, or only a part of the middle), and in this case, information specifying the part in the music control information May be included. Then, at the time of reproduction, only a part specified by this part specifying information needs to be reproduced. Alternatively, the music data may be data consisting of only a part of the original music. The server S stores a “television program guide” in addition to the music control information described above. The electronic musical instrument DM can appropriately acquire the “TV program guide” from the server S, and displays the acquired “TV program guide” on the display 6A. Then, the user can arbitrarily designate a program from a “TV program guide” (see FIG. 3 described later) displayed on the display 6A of the electronic musical instrument DM, and is designated from the server S in accordance with this user designation. The music control information related to the program can be acquired. Therefore, a “television program guide” that is displayed on the display 6A of the electronic musical instrument DM and used for designating a program for which the user wants the electronic music device to operate in conjunction will be described with reference to FIG. FIG. 3 is a conceptual diagram showing an example of a “TV program guide”.

  As shown in FIG. 3, the “TV program guide” is a program that is scheduled to be broadcast by each of the broadcasting stations A to C within a predetermined period (for example, one week or one month). Listed for each band. As a list of programs displayed for each broadcasting station A to C, a related music list is displayed for each program in addition to the name of the program scheduled to be broadcast. The related music list displays, for example, a music title, an artist name, etc. as information on music (related music) used in each program. The list-displayed programs include a program in which the music data file of the related music is stored in the server S and a program in which the music data file of the related music is not stored in the server S. Each program is displayed in a different display form so that it can be understood at a glance from the “TV program guide” being displayed. For example, a program in which music data files of related music are stored in the server S is highlighted (indicated by hatching in the drawing for the sake of convenience).

  When one of the programs highlighted in the “TV program guide” is arbitrarily clicked by the user, a broadcast-related music information request is sent to the server S accessed from the electronic musical instrument DM. Then, in response to the broadcast-related music information request, the server S returns music control information related to the clicked program to the electronic musical instrument DM. That is, the user can acquire music control information related to music played in the program by selecting a desired program from the programs displayed in the program list. In addition, in response to clicking on a program displayed in a list, the broadcast-related music information request is not immediately sent to the server S. For example, in response to clicking on a program displayed in a list, program details ( For example, when a user newly clicks the “acquire” button provided in the detailed display, the broadcast related to the server S is displayed. A music information request may be sent. Further, it may be possible that the user can specify only music that the electronic musical instrument DM is desired to operate in conjunction with the music that is played in the clicked program. In such a case, only the music piece control information related to the music designated by the user is acquired from the server S.

  Next, the electronic musical instrument DM (electronic music apparatus) and the server S constituting the interlocking operation system shown in FIG. 2 are each executed in the program desired by the user who is viewing with the television receiver T. A series of processing outlines until the electronic musical instrument DM operates in conjunction with music will be described. However, since the distribution form of the music data file from the server S can be broadly divided into a download system and a stream distribution system (a so-called sequential distribution system called streaming), description will be made separately for each distribution form.

  First, the download method will be described with reference to FIGS. FIG. 4 is a flowchart for explaining an example of “interlocking operation processing” executed by each of the electronic musical instrument DM and the server S. FIG. 5 is a conceptual diagram showing information transmission / reception timing and music reproduction timing between the electronic musical instrument DM and the server S in the case of the download method. The process shown in FIG. 4 is a software program that is appropriately started in each of the electronic musical instrument DM or the server S shown in FIG. 2, and is always in a predetermined standby state after the program is started. It is started when an access request is received from the instrument DM. On the other hand, the processing on the electronic musical instrument DM side is started according to the operation of the program selection switch by the user. Actually, the electronic musical instrument DM and the server S independently execute the processes from the start of user access to the reproduction of the music data file, but here, in order to make the explanation easier to understand, a series of processes are performed. A process executed by each of the electronic musical instrument DM and the server S will be described along the flow of the above. That is, since each process is performed in parallel while transmitting and receiving predetermined information between the electronic musical instrument DM that has requested access and the server S that has been requested to access, each process is sequentially performed along the flow of transmission and reception of this information. explain. Hereinafter, “linked operation processing” in the case of the download method will be described with reference to FIGS. 4 and 5.

  First, in response to the user's operation of the program selection switch, the electronic musical instrument DM makes an access request to the predetermined server S, and connects (accesses) to the server S via the communication network (step S1). The server S transmits television program guide data in response to an access request from the electronic musical instrument DM (step S11). When receiving the TV program guide data from the server S, the electronic musical instrument DM displays “TV program guide” on the display 6A based on the received TV program guide data (step S2). When a TV program including broadcast related music by the user using the displayed “TV program guide” is selected (step S3), a broadcast related music information request is sent from the electronic musical instrument DM to the server S. In response to this, the server S executes processing related to copyright management for the corresponding music data, that is, music data corresponding to the related music list described in the “TV program guide” (step S12). As processing related to copyright management, for example, there are processing such as charging according to the use of music data and granting a usage right for determining a range in which music data can be used. When the process related to copyright management is completed, the server S transmits music control information (music data file + reproduction start timing control information) to the electronic musical instrument DM (step S13).

  When receiving the music control information from the server S, the electronic musical instrument DM stores the received music control information (music data file + playback start timing control information) (step S4). That is, the music data file is downloaded here. After downloading the music data file, the stored reproduction start timing control information is compared with the current time to determine whether or not the music reproduction start timing of the music data file has arrived (step S5). It is assumed that the electronic musical instrument DM has a built-in clock for obtaining the current time. In order to obtain an accurate time, it may be a radio clock, or time information may be acquired from an NTP (Network Time Protocol) server via a network, and the time of the built-in clock may be corrected periodically. If it is determined that the music playback start timing has arrived (YES in step S5), playback of the corresponding music data file is started. Since the music reproduction start timing stored in the electronic musical instrument DM and managed in the electronic musical instrument DM is set in advance at the same time as the corresponding music flows in the program being broadcast, it is shown in FIG. Thus, the music (music part in the figure) flowing in the program that the user is watching on the television receiver T and the music reproduced in the electronic musical instrument DM (music reproduction in the figure) are synchronized with the same time. Will be played. Further, as can be understood from FIG. 5, the reproduction of the music part in the television receiver T based on the broadcast signal distributed from the television broadcasting station B and the musical sound reproduction based on the relevant musical data file in the electronic musical instrument DM are: Each is executed in an independent process.

  Next, the case of the streaming distribution method will be described with reference to FIGS. FIG. 6 is a flowchart for explaining another example of the “interlocking operation process” executed by each of the electronic musical instrument DM and the server S. FIG. 7 is a conceptual diagram showing the timing of information transmission / reception between the electronic musical instrument DM and the server S and the timing of music playback in the case of the streaming distribution method. Here, in order to facilitate understanding of the description, each process will be described in order along the flow of transmission / reception of predetermined information between the electronic musical instrument DM and the server S. Hereinafter, the “linked operation processing” in the case of the streaming distribution method will be described with reference to FIGS. 6 and 7.

  The processing from step S21 to step S23 in the electronic musical instrument DM is the same as the processing from step S1 to step S3 shown in FIG. 4 described above, and the processing of step S31 and step S32 in the server S is described above. Since it is the same as the process of step S11 and step S12 shown in FIG. 4, description is abbreviate | omitted here. When the server S completes the copyright process in step S32, it transmits music control information (music data file URL + streaming request timing control information) to the electronic musical instrument DM (step S33).

  When the electronic musical instrument DM receives the music control information from the server S, it stores the received music control information (music data file URL + streaming request timing control information) (step S24). Then, the stored streaming request timing control information is compared with the current time to determine whether or not the timing for making the streaming request has arrived (step S25). If it is determined that the timing for making the streaming request has arrived (YES in step S25), the streaming request is made based on the music data file URL, and the corresponding music data file stored in the server S is accessed. In response to the access to the music data file based on the music data file URL, the server S performs streaming distribution of the corresponding music data file to the electronic musical instrument DM (step S34). The electronic musical instrument DM temporarily stores the music data file streamed from the server S in a temporary storage memory (RAM or the like) and reproduces it (step S27). In response to the end of playback of the streamed music data file, the music data file streamed from the temporary storage memory is erased (cleared) (step S28). Also in this case, as in the case of the download method described above, as shown in FIG. 7, the music that flows in the program that the user is watching on the television receiver T and the reproduced music in the electronic musical instrument DM are the same. Played in sync with the time. Further, as can be understood from FIG. 7, the reproduction of the music part at the television receiver T based on the broadcast signal distributed from the television broadcasting station B and the reproduction of the musical sound based on the relevant musical data file in the electronic musical instrument DM are: Each is executed in an independent process.

  In this way, the music data used for operating the electronic musical instrument DM in conjunction with the broadcast content (program) transmitted from the television broadcast station B or the like is not included in the broadcast content but separated from the broadcast content. Since it is stored in the server S and can be acquired as required by the user, it is not necessary to produce broadcast content in consideration of the electronic instrument DM operating in conjunction with the broadcast in advance. Production of content becomes easy. In addition, by making it possible to acquire music data used for interlocking operation of the electronic musical instrument DM according to the needs of individual users, copyright management for each music data can be performed according to the acquisition status of each user. Can be easily done.

  Note that the electronic musical instrument DM may have already acquired a music data file related to music in a broadcast program. For example, the user has already downloaded a music data file (including playback start timing control information) from the server S, or a music data file recorded on a medium such as a CD or DVD (including playback start timing control information). Is pre-purchased and stored. FIG. 8 shows the timing of music playback in such a case. As can be understood from FIG. 8, in this case, the electronic musical instrument DM does not access the server S and plays only within the electronic musical instrument DM. By managing the playback start timing based on the start timing control information and playing back the music data file, the electronic musical instrument DM alone performs a linked operation (in this case, playback of the music) that matches the music being played in the program being broadcast. Do.

In the case of streaming music data files, there is a time lag between when the music data file is requested to be delivered to the server S and when the music data file is received and playback can be started. There is a possibility that the playback timing and the timing of the interlocking operation on the electronic musical instrument DM based on the music data file cannot be accurately matched. Therefore, after receiving the music data file by streaming distribution, the streaming distribution request is slightly advanced from the electronic musical instrument DM so that the reproduction start timing of the music data file can be accurately matched with the music reproduction timing in the program being broadcast. The music data file may be started to be reproduced according to the reproduction start timing control information in a state in which the data is transmitted to the server S and ready for reproduction start of the music data file.
Note that the broadcast content including music that causes the electronic musical instrument DM to operate in conjunction with the electronic musical instrument DM is not limited to the television broadcast, but may be the radio broadcast. Or the broadcast for portable terminals like 1seg may be sufficient.
If the broadcast content is commercial, a commercial broadcast table that displays only the commercial including the related music list is prepared instead of or in addition to the TV program table (see FIG. 3). May be displayed on the display 6A.

  The format of the music data file is the “event + absolute time” format in which the event occurrence time is expressed in absolute time within the song or measure, and the event occurrence time is expressed in terms of the time from the previous event. “Event + relative time” format, “pitch (rest) + note length” format that represents performance data in terms of note pitch and note length or rest and rest length, for each minimum performance resolution Any format may be used, such as a “solid method” format in which an area of memory is secured and an event is stored in a memory area corresponding to the time at which a performance event occurs. Also, on the memory, time-series music data may be stored in a continuous area, or music data scattered and stored in a skip area may be separately managed as continuous data. Good. That is, it is only necessary to be able to manage music data that is continuous in time series, and it does not matter whether the music data is continuously stored in the memory.

1 is a block diagram of a hardware configuration showing an overall configuration of an electronic music apparatus according to the present invention. 1 is a system block diagram schematically showing an embodiment of an overall configuration of an electronic music apparatus system according to the present invention. It is a conceptual diagram which shows one Example of a "television program guide." It is a flowchart for demonstrating one Example of the "interlocking operation | movement process" which each of an electronic musical instrument and a server performs. It is the conceptual diagram which showed the timing of transmission / reception of the information between the electronic musical instrument and a server in the case of a download system, and the timing of music reproduction. It is a flowchart for demonstrating another Example of the "interlocking operation process" which each of an electronic musical instrument and a server performs. It is the conceptual diagram which showed the timing of transmission / reception of the information between an electronic musical instrument and a server in the case of a streaming delivery system, and the timing of music reproduction. It is the conceptual diagram which showed the timing of music reproduction when music control information has already been acquired.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4,5 ... Detection circuit, 4A ... Performance operator, 5A ... Setting operator, 6 ... Display circuit, 6A ... Display, 7 ... Sound source circuit, 8 ... Effect circuit, DESCRIPTION OF SYMBOLS 9 ... Sound system, 10 ... External storage device, 11 ... Short distance network interface, 11A ... Peripheral device, 12 ... Network interface, 12A (S) ... Server computer, 1D ... Communication bus, X ... Communication network, T ... Television reception B: TV broadcasting station, CS: content production device, RD: reception / decoding unit, V: video playback unit, M: audio playback unit, DM: electronic musical instrument, C: control unit, R ... storage unit, I ... Communication unit, G ... reproduction unit, O ... sound source unit, KD ... performance operator drive unit, DD ... display drive unit

Claims (8)

In an electronic music apparatus having at least one of a sound source, a performance operator, and a display,
Music information acquisition means for acquiring in advance music data corresponding to each of one or more pieces of music included in broadcast content broadcast from a broadcast station;
Obtaining means for obtaining timing control information corresponding to a timing at which each of one or a plurality of music included in the broadcast content is broadcast from a broadcast station;
Drive means for driving at least one of a sound source, a performance operator, and a display;
Based on the acquired timing control information, the driving means is driven to synchronize with each of one or more music flowing at the time of broadcasting of the broadcast content according to the corresponding music data among the acquired one or more music data. An electronic music apparatus comprising control means for controlling to perform. In an electronic music apparatus having at least one of a sound source, a performance operator, and a display,
Music information acquisition means for acquiring in advance music specifying information for accessing music data corresponding to each of one or more pieces of music included in broadcast content broadcast from a broadcast station;
Obtaining means for obtaining timing control information corresponding to a timing at which each of one or a plurality of music included in the broadcast content is broadcast from a broadcast station;
Drive means for driving at least one of a sound source, a performance operator, and a display;
Based on the acquired timing control information, music data according to the corresponding music specifying information among the acquired one or more pieces of music specifying information is acquired at any time, and 1 to 1 flowing at the time of broadcasting the broadcast content according to the acquired music data An electronic music apparatus comprising control means for controlling to drive the drive means in synchronization with each of a plurality of music.   Comprising a selection means for selecting desired music from one or more music included in broadcast content broadcasted from a broadcast station, and the music information acquisition means includes only music data corresponding to the selected music; The electronic music apparatus according to claim 1, wherein only the music specifying information for accessing the music data is acquired. An electronic music apparatus system comprising a server and an electronic music apparatus that are communicably connected to each other via a communication network,
Music data corresponding to each of one or more pieces of music included in the broadcast content broadcast from the broadcast station, and timing control information corresponding to the timing at which each of the one or more pieces of music included in the broadcast content is broadcast from the broadcast station. And a server including means for transmitting the stored one or more music data and timing control information in response to an instruction from the electronic music device;
Means for receiving and storing one or more music data and timing control information transmitted from the server, and according to the corresponding music data among the obtained one or more music data based on the stored timing control information And an electronic music apparatus including means for controlling to drive at least one of a sound source, a performance operator, and a display so as to synchronize with each of one or a plurality of music flowing during the broadcast of the broadcast content. Electronic music equipment system. An electronic music apparatus system comprising a server and an electronic music apparatus that are communicably connected to each other via a communication network,
Each piece of music data corresponding to one or more pieces of music included in broadcast content broadcasted from a broadcast station, piece of music specifying information for accessing the piece of music data, and one or more pieces of music included in the broadcast content Means for storing timing control information corresponding to timing broadcast from a broadcasting station, means for transmitting the stored music specifying information and timing control information in response to an instruction from the electronic music device, and the electronic music A server including means for transmitting corresponding music data among the one or more stored music data in response to access based on the transmitted music specifying information from a device;
A means for receiving and storing one or more pieces of music specifying information and timing control information transmitted from the server, and a corresponding piece of music among the one or more pieces of music specifying information acquired based on the stored timing control information Means for accessing the server according to the specific information and receiving the music data corresponding to the music specific information at any time, and synchronizing with each of one or a plurality of music flowing during the broadcast of the broadcast content according to the received music data Thus, an electronic music apparatus system comprising an electronic music apparatus including at least a means for driving one of a sound source, a performance operator, and a display.   6. The electronic music apparatus system according to claim 4, wherein the server includes means for executing a process related to predetermined copyright management for music data to be transmitted to the electronic music apparatus. On the computer,
A procedure for acquiring in advance music data corresponding to each of one or more pieces of music included in broadcast content broadcast from a broadcast station;
A procedure for acquiring timing control information corresponding to a timing at which each of one or more pieces of music included in the broadcast content is broadcast from a broadcast station;
Based on the acquired timing control information, at least a sound source and a performance are synchronized with each of one or a plurality of music flowing at the time of broadcasting of the broadcast content according to the corresponding music data among the acquired one or a plurality of music data. A program for executing a procedure for controlling one of an operator and a display to be driven. On the computer,
A procedure for acquiring in advance music specifying information for accessing music data corresponding to each of one or more pieces of music included in broadcast content broadcast from a broadcast station;
A procedure for acquiring timing control information corresponding to a timing at which each of one or more pieces of music included in the broadcast content is broadcast from a broadcast station;
Based on the acquired timing control information, music data according to the corresponding music specifying information among the acquired one or more pieces of music specifying information is acquired at any time, and 1 to 1 flowing at the time of broadcasting the broadcast content according to the acquired music data A program for executing a procedure for controlling at least one of a sound source, a performance operator, and a display to be synchronized with each of a plurality of music.

Images