JP2012203523A - Live distribution system, data relay device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a live distribution system which performs live distribution of music matching a mental state of an individual listener in accordance with playing manipulation by a player.SOLUTION: A listener can input a desired sensory expression word for music to be live-distributed. The input sensory expression word is presented and then the player can grasp what music the listener likes to listen to at present. With respect to music being live-distributed, the number of players and the number of listeners are totaled and displayed respectively. A listener can show that the listener sympathizes with the music. The number of listeners and the number of listeners sympathizing with music are totaled and displayed for each music to allow the player to compare reactions of listeners to the music that the player is playing with other player's music. Thus, when the music is distributed through a communication network, the player can live-distribute the music while always grasping sensibility that a listener desires for the music, a listener can timely receive music matching his or her current metal state.

Description

  The present invention relates to a live distribution system that distributes music via a communication network in real time according to a performance operation by a performer, a data relay device that assists the live distribution, and a program. In particular, the present invention relates to a technique that enables a performer to grasp a song that matches the feelings (feelings) of individual listeners and distribute it live as appropriate.

  Conventionally, it has been widely performed that a player himself actually operates an electronic musical instrument or sings (herein referred to as a performance operation for convenience) and distributes a song (specifically, song data, etc.) via a communication network. In that case, the listener searches for a song to be listened to using a song name, a composer name of the song, or a genre name of the song from among a large number of songs stored in advance in a database or the like. You can receive data about songs. Recently, in addition to the search conditions described above, images of delivered songs that can be received by listeners who have listened to songs such as “feeling healed”, “feeling exhilarating”, “feeling bright and energetic”, etc. By associating a sensitivity expression word expressing an impression or the like with a word (phrase) for each song, a listener can search for a song using the sensitivity expression word as a keyword. An example of the device related to such a device is the device described in Patent Document 1 shown below.

JP 2001-306580 A

  However, in a conventionally known device as described in Patent Document 1 described above, a listener can search for a desired song according to a sensibility expression word from among songs stored in advance and can be distributed. It just makes it possible. Therefore, among the many songs stored in the database in advance, “I want to be healed”, “I want to be refreshed”, “I want to be cheerful and cheerful”, etc. If there is no song associated with a sensibility expression such as “feel”, “exhilarating”, “bright and cheerful”, the corresponding song will not be extracted even if a song search is performed. The listener had the inconvenience that he could not receive such a song at all, even though he wanted to listen to the song he had in his current feelings immediately.

  Such inconvenience is that a music player who provides a song performs music performance operations while taking into consideration the image and impression of the song that the listener will receive when listening to the song. This is due to the fact that the created performance information must be registered in advance in the database (in some cases, the performer himself associates the emotional expression word). That is, in the conventional apparatus, the performer does not know in advance what kind of feeling the listener who is trying to receive the song is and what kind of song he wants to listen to in advance. There was a problem that it was not possible to provide timely songs according to their feelings. Therefore, the musicians can perform the music in a timely manner according to the feelings (feelings) of the individual listeners who want to receive the music, and the listeners are desired according to the performance operations of those musicians. There has been a demand for a device that can deliver a song with a specific feeling in real time (so-called live streaming delivery, hereinafter simply referred to as live delivery or live broadcast), but such a device is still provided. Not.

  The present invention has been made in view of the above points, and when a music piece is delivered to a listener in real time via a communication network in accordance with a performance operation by the player, the player reflects the feelings of the listener. A live distribution system, data relay device, and program that enable a listener to receive live distribution of a song that is in his / her current state from a performer while The purpose is to provide.

  The live distribution system according to claim 1 of the present invention is a live distribution system that distributes music in real time to a large number of listeners simultaneously via a communication network in accordance with a performance operation by a performer. Means for acquiring a sensitivity expression word desired by a person to be distributed, presenting the acquired sensitivity expression word, means for registering the distribution music in association with any of the presented sensitivity expression words, A means for streaming transmission of performance information generated at any time in response to a performance operation by a performer, and a song associated with the same sensitivity expression word as the transmitted song, and the number of performers who are distributing the song and A transmission device having means for displaying at least one of the number of listeners listening to those songs and the number of sympathizers who sympathize with those songs, and all songs being distributed are associated with each song. Means for displaying the number of performers who are distributing those songs and the number of listeners who are listening to those songs, and means for registering the desired emotion expressions for the songs distributed by the listener And means for acquiring and displaying at least one of the number of listeners listening to each song and the number of sympathizers who sympathize with the song, together with the song information corresponding to each of the sensitivity expression words A listening device comprising: means for selecting one of the songs being distributed; means for streaming receiving and playing performance information of the selected song; and means for expressing that the player has sympathized with the played song And classifying all the songs being distributed according to the Kansei expression words associated with the performers, listening to the number of performers who are delivering one or more songs corresponding to each Kansei expression word and each song The number of listeners who sympathize with each song A means for counting and outputting at least one of the above, and receiving performance information of all the songs being distributed, and transmitting the performance information of the songs selected by the listener from the received performance information via a communication network And a relay device having means for streaming transmission to the listener.

  According to the present invention, when distributing music to a large number of listeners simultaneously in real time via a communication network in accordance with a performance operation by the performer, the performer has the feelings of individual listeners who want to perform ( It is possible to selectively broadcast live songs that match each feeling after understanding their feelings. A listener who operates the listening device can input a desired emotional expression word for a song distributed live via a communication network. When a desired emotional expression word is input to a song delivered live by the listener, the desired emotional expression word is presented to each of the inputted listeners for live distribution. The player who operates the transmitter can see what the listener wants to listen to by viewing the presentation. In addition, since the number of performers and the number of listeners are aggregated and displayed for the songs that are being distributed live according to the sensibility expressions, the listeners can use them as a reference when selecting the songs they want to listen to. The performer can decide what kind of song he / she will provide while checking the trends of other performers during live distribution. Then, the listener can select any one of the songs that are being distributed live, and can express that they have sympathized with the selected song. Accordingly, the music information of the corresponding song is displayed for each of the sensitivity expression words, and the number of listeners and the number of empathy who sympathize with the music are displayed for each song. Can compare the listener's response to the song he is playing with other performers. In this way, when delivering a song over a communication network, the performer can perform live delivery while grasping the sensibility that the listener wants for the song at any time, while the listener is in the current state of mind. You will be able to receive timely distribution of songs.

  According to a second aspect of the present invention, there is provided a data processing device data relay device that communicates between a transmitting device that generates performance information in response to a performance operation of a performer and a listening device that generates musical sounds based on the performance information. A data relay apparatus that is connected so as to be able to transmit and receive data via a network and retransmits the performance information streamed from the transmission apparatus to the listening apparatus, and a sensitivity desired by the listener for the music distributed by the listener Means for receiving an expression word and presenting the received emotion expression word to the transmission device; means for receiving a sensitivity expression word associated with a song distributed by a player from the transmission device; and the transmission device Means for receiving performance information streamed from the receiver, retransmitting the received performance information to the listening device, and classifying the song being retransmitted according to the emotional expression word. The number of performers who are distributing songs including other songs corresponding to the sensibility expression words and the listeners who are listening to the corresponding songs are totaled, and the totaled results are output to the transmitting device and the listening device. Means for receiving sympathy information expressing that the listener has sympathized with the song from the listening device, counting the number of sympathizers sympathizing with the re-sent song based on the sympathy information, and transmitting the tabulated result And a device for outputting to the listening device. According to this, the performer who operates the transmission device can perform live distribution while grasping the sensibility that the listener desires for the music as needed, while the listener who operates the listening device is in the current state of mind. You will be able to receive your songs in a timely manner.

  The present invention can be constructed and implemented not only as a system and apparatus invention, but also as a method invention. Further, the present invention can be implemented in the form of a program of a processor such as a computer or a DSP, or can be implemented in the form of a storage medium storing such a program.

  According to the present invention, the listener can input the emotional expression word desired for the distributed music and express that he / she sympathized with the distributed music, while the performers are distributed live by each listener. The musician receives the presentation of the desired sensibility expression words and can confirm the number of performers, listeners, and sympathizers for the song being delivered live. While it becomes possible to perform live distribution while grasping, the listener can receive timely distribution of songs that are in the current state of mind.

It is the block diagram which showed one Example of the whole structure of the live delivery system which concerns on this invention. It is a hardware configuration block diagram showing an example of the entire configuration of any one of the devices constituting the live distribution system. It is a flowchart which shows one Example of a live broadcast transmission process. It is a flowchart which shows one Example of a live broadcast relay process. It is a flowchart which shows one Example of a live broadcast listening process. It is a conceptual diagram which shows one Example of "the feeling screen of the music currently performed". It is a conceptual diagram which shows one Example of a "music list screen." It is a conceptual diagram which shows one Example of the "feeling screen where the performance is calculated | required."

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

  First, an outline of a live distribution system according to the present invention will be described with reference to FIG. FIG. 1 is a block diagram showing an embodiment of the overall configuration of a live distribution system according to the present invention. Although there may be a live distribution system other than that shown in FIG. 1, here, a case where the minimum necessary resources are used will be described.

  The live distribution system shown in FIG. 1 includes one or more live broadcast transmission devices O (hereinafter referred to as transmission devices), one or more live broadcast listening devices R (hereinafter referred to as listening devices), and each of these devices and a communication network (see FIG. 1). And a live broadcast relay device T (hereinafter referred to as a relay device) that is connected via an unillustrated device. In the live distribution system shown in this embodiment, the listener operates the listening device R via a known communication network such as the Internet or a dedicated line, and a large number of performers are currently distributing live via the relay device T. While the music player can selectively receive a live distribution of a desired song from among a number of songs, the player performs live operation of the song he / she performs via the relay device T by operating the transmission device O. Distribution can be made to a large number of listeners at the same time.

  The transmission device O is, for example, a dedicated electronic music device such as an electronic musical instrument or a general-purpose electronic music device such as a personal computer. In the case of an electronic musical instrument, music data of the musical composition generated in response to the musical instrument performance operation by the performer is transmitted in real time to the relay device T by streaming (so-called net musical instrument). In the case of a personal computer, audio data generated by recording a song performed by the performer with a microphone, or video generated by shooting a musical instrument performance scene actually performed by the performer himself / herself Data or the like is transmitted in real time to the relay device T by streaming. Note that the music data, audio data, video data, and the like, which are generated according to the performance operation of the performer, are referred to herein as performance information. Further, the transmission device O can transmit and register the song information and the emotional expression word information input by the performer before the performance to the relay device T. Further, the transmission device O can receive the screen information from the relay device T and display each screen (see FIGS. 6 to 8) as described later.

  The song information is information such as a song name attached to a song to be distributed live by a performer. Kansei expression word information is information that is expressed in words (phrases) about the player's feelings attached to the song delivered live by the performer, more specifically, what is the song that the performer is currently playing It is information indicating whether or not the performance is performed with a special feeling, or what kind of feeling (feelings) the present listener wants to listen to the song. For example, if the song is intended for a listener who wants to be healed, the emotional expression word information can be “healed”, if the song is for a listener who wants to feel refreshed, “I'll give you refreshed” If it is a song for listeners, it is "bright and cheerful", etc., and the performer considers the image and impression of the song that the listener who listened to the song being played (live distribution) will receive It can be entered arbitrarily.

  The relay device T is a server device such as a computer, for example, and is a device for relaying performance information transmitted from each transmission device O by streaming to each listening device R, that is, live broadcast (live) via a communication network. Distribution). In this relay device T, music information and emotion expression word information transmitted from the transmission device O can be registered together with a device ID unique to each transmission device O, and the performance information (including the device ID) is transmitted from the transmission device O. ) Is transmitted, the registered music information and emotional expression word information can be associated with the performance information by the device ID. The relay device T distributes the associated performance information to a listener who wants to distribute the music (listening device R). Further, the relay device O displays screen information for displaying each screen (see FIGS. 6 to 8) as will be described later and display contents of each screen (specifically, the number of performers, the number of listeners, the number of sympathizers). Screen information for updating the number, feelings, song titles, etc. of people who are seeking performance with the same feeling is transmitted to the transmitting device O and the listening device R.

  Further, based on the emotional expression word information transmitted from each transmitting device O, the relay device T counts the number of each performing live broadcasting for each feeling, and calculates the number of players for each feeling as the counting result. Presented to the transmitting device O and the listening device R. Specifically, the number of performers who are delivering live music of the same feeling based on the Kansei expression information registered by the performers is counted for each feeling. Further, the relay device T feels the number of listeners having the same feeling listening to the selected song based on the selection information (song name and feeling) transmitted from each listening device O in response to the song selection by the listener. Aggregate every time. Then, the counting results can be sent to the transmission device O and the listening device R (as the above screen information).

  The listening device R is, for example, a dedicated electronic music device such as an electronic musical instrument or a general-purpose electronic music device such as a personal computer. The listening device R listens to the number of performers for each feeling presented from the relay device T and the music of that feeling. The number of people is displayed for each feeling. A user (listener) who operates the listening device R can select a song that matches the user's own feeling from among the displayed feelings of the song being distributed live. For this purpose, the listening device R receives the screen information from the relay device T and displays each screen described later (see FIGS. 6 and 7). Then, the listening device R requests the relay device T to distribute the selected song live according to the song selection by the listener, and relays the performance information related to the selected song generated according to the performance operation of the performer. Receive by streaming via the device T. In addition, the listening device R can transmit to the relay device T and register the feeling (user sensitivity information) that the player wants to play (user sensitivity information) or the sympathy information indicating that the player has sympathized with the music.

  In this embodiment, the transmission device O can also serve as the listening device R. That is, when operating as the transmission device O, for example, performance information such as music data, audio data, and video data generated according to the performance operation of the performer is transmitted to the relay device T by streaming transmission, while the listening device. When operating as R, the performance information is streamed from the relay device T. Therefore, even when operating as the transmission device O, it is possible to acquire the music (performance information) distributed live by other performers via the relay device T.

  Next, an embodiment of the hardware configuration of the transmission device O, the relay device T, and the listening device R will be described. FIG. 2 is a block diagram of a hardware configuration showing an embodiment of the overall configuration of any one of the above devices. However, since each of the above devices can be described as using the same hardware configuration, here, only one diagram of the transmission device O will be described as a representative.

  The apparatus is controlled by a microcomputer including a microprocessor unit (CPU) 1, a read only memory (ROM) 2, and a random access memory (RAM) 3. The CPU 1 controls the operation of the entire apparatus. ROM 2, RAM 3, detection circuits 4 and 5, display circuit 6, sound source / effect circuit 7, storage device 8, and communication interface (I / F) 9 are connected to the CPU 1 via a data and address bus 1D. ing.

  The ROM 2 stores various control programs executed by or referred to by the CPU 1, various data, and the like. The RAM 3 is used as a working memory for temporarily storing various data generated when the CPU 1 executes a predetermined program, or as a memory for temporarily storing a currently executing program and related data. The A predetermined address area of the RAM 3 is assigned to each function, and is used as a register, a flag, a table, a temporary memory, or the like.

  The performance operator 4A is, for example, a keyboard provided with a plurality of keys for selecting the pitch of a musical tone, and has a key switch corresponding to each key. A keyboard or the like) is used not only for manual performance by a player's own hand-playing, but also a sensibility expression associated with music data (performance information) generated in response to a performance operation and distributed live on the communication network X It can also be used for selection of word information (see FIG. 8 described later) and operation mode setting. The detection circuit 4 generates a detection output by detecting the pressing and release of each key of the performance operator 4A.

  A setting operator (switch, etc.) 5A is a selection switch for selecting emotion expression word information associated with music data (performance information) generated in response to a performance operation and distributed live in the communication network X, for example, the operation of the electronic musical instrument Mode switch to set the mode to live broadcast transmission mode or live broadcast listening mode, live broadcast start button or live broadcast end button to instruct live broadcast start / end instructions, or various settings related to musical tone control such as pitch, tone, effect, etc. when performing Switches for determining (parameters), increment buttons and decrement buttons for sequentially positioning the cursor every time one of the items displayed on each screen described later, and the item where the cursor is positioned Consists of various controls such as the Enter button.

  Of course, the setting operation element 5A has a numeric data input numeric keypad and a character data input keyboard for selecting / setting / controlling pitches, tones, effects, etc., or a pointer displayed on the display 6A. Various operators such as a mouse for operating the above may be included. The detection circuit 5 detects the operation state of the setting operation element 5A, and outputs switch information and the like corresponding to the operation state to the CPU 1 via the data and address bus 1D.

  The display circuit 6 displays various screens to be described later (see FIGS. 6 to 8) on a display 6A composed of, for example, a liquid crystal display panel (LCD) or a CRT, and sets various settings relating to musical tone control. The status, various data stored in the ROM 2 and the storage device 8, or the control state of the CPU 1 are displayed. Further, the performance operation mode of the performer himself or the performance operation mode of other performers may be displayed as a moving image based on the video data. The display 6A may be a so-called touch panel that can be touch-operated on the screen.

  The tone generator / effect circuit 7 can simultaneously generate musical tone signals on a plurality of channels, and performance information (and / or communication) generated in response to a performance operation by a user given via the data and address bus 1D. Performance information distributed live via the network X) is input, and musical sounds are generated based on the performance information. Furthermore, various acoustic effects are appropriately given to the generated musical sound. The musical sound generated from the sound source / effect circuit 7 is generated from a sound system 7A including an amplifier and a speaker. Any conventional configuration may be used for the configuration of the sound source / effect circuit 7 and the sound system 7A. For example, the tone generator / effect circuit 7 may employ any of various tone synthesis methods such as FM, PCM, physical model, formant synthesis, etc., may be configured with dedicated hardware, or may be a DSP (Digital Signal Processor). ) Or software processing by the CPU 1.

  The storage device 8 stores various control programs executed by the CPU 1 in addition to various data. When the control program is not stored in the ROM 2 described above, the control program is stored in the storage device 8 (for example, a hard disk) and is read into the RAM 3 to store the control program in the ROM 2. It is possible to cause the CPU 1 to execute the same operation as in FIG. In this way, control programs can be easily added and upgraded. The storage device 8 is not limited to a hard disk (HD), but may be a flexible disk (FD), a compact disk (CD-ROM / CD-RAM), a magneto-optical disk (MO), or a DVD (Digital Versatile Disk). Any storage device may be used as long as it uses a storage medium in the form. Alternatively, a semiconductor memory such as a flash memory may be used.

  The communication interface (I / F) 9 includes the device and one or more external devices Z (in the case of the transmission device O and the listening device R, the relay device T, in the case of the relay device T, the transmission device O and Interface for listening to and receiving performance information such as music data, audio data, video data and other various information via the communication network X. The communication interface 9 only needs to be connectable to a communication network X such as a LAN, the Internet, a telephone line, etc., and may be both wired or wireless. It goes without saying that many other devices Z can be connected to the communication network X.

In the above-described embodiment, the performance operator 4A is not limited to a keyboard instrument, and may be any type such as a stringed instrument, a wind instrument, or a percussion instrument. Further, the electronic musical instrument is not limited to one having the performance operator 4A, the display 6A, the sound source / effect circuit 7 and the like built in one apparatus body, but each is configured separately and using an interface such as a MIDI interface or various networks. Needless to say, each device may be configured to be connected.
Note that the transmission device O (or listening device R) is not limited to an electronic musical instrument, but music data, audio data, and video generated in response to a user operation on a personal computer, karaoke device, electronic game device, or other multimedia device. Any device / apparatus may be used as long as data or the like can be transmitted (or received) to / from the relay device T by streaming via the communication network X.
The relay device T may not include the detection circuit 4 and the performance operator 4A, the sound source / effect circuit 7 and the sound system 7A, and the listening device R may include the detection circuit 4 and the performance operator 4A. It is not necessary to have.

  The transmission device O that can be connected to the communication network X as described above can distribute, for example, song data generated in accordance with the performance operation of the performer live via the communication network X, while the listening device. R is capable of acquiring music data of a desired music from a large number of music live-distributed from a transmitting apparatus in real time and reproducing the music. Then, the process regarding the live distribution (live broadcasting) of such a music is demonstrated using FIGS.

  FIG. 3 is a flowchart showing an example of the “live broadcast transmission process”. This process is a process for causing an electronic musical instrument, a personal computer, or the like to function as the transmission device O, and is started according to, for example, the setting of the live broadcast transmission mode by the user. A user who has set the live broadcast transmission mode performs a streaming distribution (live distribution) in real time to a larger number of listeners via the communication network X by performing music performance by operating the performance operator 4A. It becomes.

  Step S1 displays the screen on the display 6A in response to the reception of the screen information (feelings list data) of the “feelings screen of music currently being played” (see FIG. 6) from the relay device T. The screen information includes the number of performers and the number of listeners for each feeling aggregated by the relay device T. Further, when screen information for updating the screen is received when the relay device T is accessed periodically, the display (feelings, number of performers, number of listeners) of the screen is updated. As a result, the number of performers and listeners displayed is reflected almost in real time, and new feelings are added and feelings that no one is playing are deleted from the screen. Or In step S2, it is determined whether or not any one of the feelings has been selected by the performer on the displayed “feeling screen of the music currently being played”.

  If it is determined that any feeling has been selected on the “feelings screen of music currently being played” (YES in step S2), a “song list screen” corresponding to the feeling selected from the relay device T (FIG. 7). Screen information (music list data) is acquired and the screen is displayed on the display 6A. This “song list screen” display is also periodically updated. In step S4, the feeling selected by the performer is transmitted to the relay device T and registered as a feeling that the performer can put in the song.

  Here, the “feeling screen of the currently played music” and the “music list screen” will be described. FIG. 6 is a conceptual diagram showing an example of a “feeling screen of music currently being played”. FIG. 7 is a conceptual diagram showing an example of a “song list screen”. These screens are common screens that can be displayed on both the player side and the listener side devices, and are based on the feelings of the players who have included the songs currently being distributed live on the communication network X. Present it separately.

  As shown in FIG. 6, the “feelings screen of music currently being played” A displays the player's feelings B included in each song, and shows the songs with the same feeling for each feeling B. Displays the number of performers playing and the number of listeners listening to those songs. In the example shown here, four different feelings, such as “I will encourage you”, “I will hurt you”, “I will give you more” and “I will heal you”, are displayed in Kansei expressions (of course, more) In other cases, it is possible to display other feelings by scrolling the screen), for example, there are “12 people” who are playing a song with the feeling of “encourage”, It is shown that there are “43” listeners who are listening to songs with a feeling of “I will encourage you”. In other words, for each feeling B, the number of performers who provide a song with that feeling and the number of listeners receiving a live distribution of the song with that feeling are displayed. The number of performers and the number of listeners are updated in real time according to the increase or decrease in the number of performers who are delivering music live via the communication network X or listeners who are receiving live music delivery via the communication network X. It has become so.

  When the “feeling screen of music currently being played” A is displayed on the display 6A, the user uses, for example, an operator C such as an increment button or a decrement button provided near the screen to display the screen. Position the cursor K on the desired feeling and then press the Enter button D, or if the display 6A is a touch panel, the feeling can be selected by directly touching the desired feeling on the screen. The display can be changed to a “song list screen” E (see FIG. 7) that presents a list of songs with feelings. Here, as an example, a display example in the case where “encourage” is selected in the “feeling screen of music currently being played” A is shown.

  As shown in FIG. 7, the “song list screen” E displays the player's feelings (here “encourage”) selected on the “feelings screen of currently playing music” A at the top of the screen. At the same time, the music titles F (music information) of one or a plurality of music pieces with different performers are displayed. In the example shown here, four songs with titles such as “Very happy now”, “Listen to my song”, “Alafor Gogo!”, “Untitled” are displayed (of course, more, for example, in FIG. If there are 12 performers who are playing “encouraging” songs and the number of song names is 12, other songs can be displayed by scrolling the screen). In addition, the number of listeners receiving live distribution of the song corresponding to each song name F and the number of sympathizers who are sympathetic with the feelings of the song are displayed. For example, there are “24 people” listening to a song with the song name “Alafor Gogo!” With the feeling of “I'll encourage you”, and “20 people out of 24” who sympathized with the song. It is shown. The number of listeners is updated in real time according to the increase or decrease in the number of listeners receiving live distribution of the song via the communication network X, and the number of sympathizers indicates that the listener arbitrarily sympathized with the song It is updated by entering

  The user selects a song to be delivered live by performing an operation such as pressing the Enter button D after positioning the cursor K on the screen to the desired song name using the operation element C such as an increment button or a decrement button. (However, when one device serves as both the transmitting device O and the listening device R, the music selection operation can be performed only in the live broadcast transmission mode). In addition, it is possible to return from the “music list screen” E to the “feelings screen of music currently being played” A by operating a “return to feeling list” button (not shown).

  Returning to the explanation of FIG. 3, when it is determined that any feeling is not selected on the “feeling screen of the music currently being played” (NO in step S <b> 2), the relay device T determines that “play is required. The screen information (feeling list data for which performance is requested) of the “feeling screen being played” (see FIG. 8) is acquired and displayed on the display 6A (step S5). In step S6, it is determined whether or not the performer has performed an operation of additionally inputting a new feeling that has not yet been included in any of the songs being distributed live. As an operation for additionally inputting a new feeling by the performer, for example, an operation for selecting from feelings displayed on the “feeling screen where performance is required” shown in FIG. If it is determined that these operations have not been performed (NO in step S6), the process returns to step S1. When it is determined that an operation for additionally inputting a new feeling has been performed (YES in step S6), a word (phrase) representing the feeling to be added is input, and the feeling that the performer puts the input feeling in the song Remember as.

  The “feeling screen for which performance is required” will be described with reference to FIG. FIG. 8 is a conceptual diagram showing an example of a “feeling screen for which performance is required”.

As shown in FIG. 8, the “feeling screen where performance is requested” G displays the feeling H of the listener who is seeking performance and the number of listeners who have the same feeling. In the example shown here, four different feelings, such as “I want you to encourage me,” “I want you to hurt me,” “I want to give you more,” and “I want you to heal,” are displayed in Kansei expressions (of course, there are many more) In other cases, it is possible to display other feelings by scrolling the screen.) Among them, there are 123 listeners who want to perform live distribution of songs with feelings such as “I want you to encourage me.” It is shown. That is, for each feeling H corresponding to the listener's current feelings (feelings), the number of listeners who want to live-distribute songs with their feelings is displayed. Is updated in real time in accordance with the input status of the fact that a listener wants to perform live distribution of music (user sensitivity information). Aggregation of the number of listeners who have the same feeling that the performer wants to perform is performed by the relay device T.

  The performer performs live distribution by performing an operation such as pressing the Enter button D after positioning the cursor K on the desired listener's feeling using an operator C such as an increment button or a decrement button. You can decide how you want to be in the song.

  Returning to the description of FIG. 3, in step S8, the name of the song to be played is input (stored) in accordance with the input operation by the performer. However, the music title input operation is not indispensable for the performer, and “untitled” is automatically input (stored) as the music title when the performer does not perform the music title input operation. In step S9, it is determined whether or not a live broadcast start instruction such as a live broadcast start button is pressed by the performer is made. If it is determined that a live broadcast start instruction has not been issued (NO in step S9), the process of step S9 is repeated to enter a standby state without advancing the process until a live broadcast start instruction is issued. On the other hand, if it is determined that a live broadcast start instruction has been given (YES in step S9), the feeling of the song to be played (sensitivity expression word information) and the song title (song information) input to the relay device T are transmitted to the relay device T. These are registered by transmitting (step S10). In step S11, performance information generated in response to a performance operation such as an operation of a musical instrument by the performer or a singing by the performer is stream-transmitted to the relay device T. In step S12, screen information (music detail screen data) of a “music detail screen” (not shown) is acquired from the relay device T, and the screen is displayed on the display 6A.

  In the “song detail screen”, in addition to the feeling of the song being streamed and the song name input by the performer, the sympathy information from the listener who is listening to the streamed song by operating the listening device R And comments are reflected. Since the “song detail screen” is regularly updated, the performer who performs live distribution by operating the transmitting device O performs the performance operation by viewing the “song detail screen” while performing the performance operation. It is possible to perform live distribution while confirming the listener's reaction to the song, such as how the listener is sympathizing with the listener and how it is felt. What is the listener's reaction (specifically, the number of listeners and the number of empathy) between the music played by other performers who lively distribute the music of the same feeling and the music played by their own performance? Thus, it may be possible to immediately switch the screen display from the song detail screen related to the performance operation to the song list screen so that it can be compared and confirmed.

  In step S13, it is determined whether or not a live broadcast end instruction such as a live broadcast end button is pressed by the performer is made. If it is determined that the live broadcast end instruction has not been issued (NO in step S13), the process returns to step S10 and the processes from step S10 to S13 are repeated. If it is determined that the live broadcast end instruction has been issued (YES in step S13), the streaming transmission of the performance information to the relay apparatus T is ended, and a notification that the live distribution is ended is transmitted to the relay apparatus T (step S13). S14). After the process is completed, the process returns to step S1.

  FIG. 4 is a flowchart illustrating an example of “live broadcast relay processing”. The process is a process executed by the relay apparatus T, and is started in response to the activation operation of the relay apparatus T. In step S21, it is determined whether or not there is an access from the transmission apparatus T. If it is determined that there is an access from the transmission device T (YES in step S21), the processing from steps S22 to S24 is performed. On the other hand, when it is determined that there is no access from the transmitting device T (NO in step S21), it is determined whether there is an access from the listening device R (step S25). If it is determined that there is an access from the listening device R (YES in step S25), the processing from steps S26 to S30 is performed.

  As a process when there is an access from the transmitting device T, step S22 is performed according to the reception of the song feeling (sensitivity expression information) and the song name (song information) transmitted from the transmitting device T. Screen information for updating each screen of the “feeling screen of music” (see FIG. 6) and “song list screen” (see FIG. 7) is transmitted to each device, and “song detail screen” (not shown) ) Screen information is newly created. Specifically, the number of performers is increased with respect to the “feelings screen of music currently being played”, or the feeling is added if the feeling of the received song is new. And the screen information is updated or newly generated so that the “song detail screen” can be displayed.

  In step S23, in response to receiving the performance information streamed from the transmission device O, the received performance information is buffered for a predetermined time in order to stream-distribute the received performance information to the listening device R. The performance information held in the buffer is updated as needed according to the transmission of performance information from the transmission device O. In step S24, in response to the reception of the streaming transmission end notification of the specific song from the transmission device O, the “feeling screen of music currently being played” (see FIG. 6) and the “song list screen” (see FIG. 7). Are updated, and the screen information on the “song detail screen” (not shown) related to the song is deleted. Specifically, if the number of performers on the “feelings screen of the music currently being played” is reduced or if no other performers are streaming live with the same feelings, the feelings are deleted. The screen information is updated or deleted in order to delete the song name related to the “song list screen” or not to display the “song detail screen”.

  On the other hand, as a process when there is an access from the listening device R, step S26 is to display the “feeling screen of music currently being played” (see FIG. 6) transmitted from the listening device R or to receive an update request. In response, the screen information (feeling list data) of the screen is transmitted to the requesting listening device R. In step S27, in response to the display of the “song list screen” (see FIG. 7) transmitted from the listening device R or the reception of the update request, the screen information (song list data) of the screen is sent to the listening device R that has requested it. Send to. In step S28, in response to the display of the “feeling screen for which performance is requested” (see FIG. 8) transmitted from the listening device R or the reception of the update request, the screen information of the screen (a list of feelings for which performance is requested) Data) to the requested listening device R. Although not shown in the flowchart shown here, when the live broadcast transmitting apparatus O requests a feeling list, a song list, or a requested feeling list, the same processing as steps S26 to S28 is executed. To do.

  In step S29, in response to receiving a music reproduction request from the listening device R, screen information (music information) of the “music detail screen” (not shown) of the music designated for the requested listening device R. Detailed screen data) and the performance information of the buffered music. Further, screen information for updating the number of listeners in the “feeling screen of music currently being played” (see FIG. 6) and the “song list screen” (see FIG. 7) is transmitted to all the transmitting devices O and the listening devices R. Send to. In step S30, the screen information for updating the number of sympathizers on the “song list screen” (see FIG. 7) in response to receiving the sympathy information and arbitrary comments transmitted from the listening device R is transmitted to all the transmission devices. O and the listening device R are transmitted, and the screen information in which the received arbitrary comment is additionally displayed on the “song detail screen” (not shown) is displayed on the “song detail screen” of the song. Transmit to device O. Step S31 ends streaming distribution of the song (performance information) to the listening device R in response to receiving notification from the listening device R that the song playback is finished. ”(See FIG. 6) and“ Song List Screen ”(see FIG. 7), the screen information for updating the number of listeners is transmitted to all the transmitters O and R.

  FIG. 5 is a flowchart showing an example of the “live broadcast listening process”. The process is a process for causing an electronic musical instrument, a personal computer, or the like to function as the listening device R, and is started according to, for example, the setting of the live broadcast listening mode by the user. In step S41, in response to the reception of the screen information (feeling list data) of the “feelings screen of music currently being played” (see FIG. 6) from the relay device T connected via the communication network X, the screen Is displayed on the display 6A. In addition, when screen information for periodically accessing the relay device T and updating the screen is received, the screen (feelings, number of performers, number of listeners) is updated. As a result, the number of performers and listeners displayed is reflected almost in real time, and new feelings are added or feelings that no one is playing are deleted. .

  In step S42, it is determined whether any feeling has been selected on the displayed "feelings screen of music being played". When it is determined that any feeling is selected in the “feelings screen of music currently being played” (YES in step S42), the “song list screen” of songs corresponding to the feeling selected from the live broadcast relay device T The screen information (music list data) (see FIG. 7) is acquired, and the screen is displayed on the display 6A (step S43). That is, a search for music is performed using the selected feeling as a keyword. The “Song List Screen” display is also updated periodically.

  On the other hand, if it is determined that none of the feelings are selected on the “feelings screen of the music currently being played” (NO in step S42), whether or not the player desires to play is input. Is determined (step S44). If it is determined that the feeling of performance is not input (NO in step S44), the process returns to step S41. If it is determined that the feeling of performance is input (YES in step S44), the relay apparatus T is notified that the performance of the music corresponding to the selected feeling is requested (step S45). Based on the notification, the relay device T generates / updates the screen information of the “feeling screen for which performance is requested” (see FIG. 8). Thereafter, the process returns to step S41. In other words, the feelings input here are emotional expression word information corresponding to the user's individual feelings (feelings) such as “I want to be healed”, “I want to be refreshed”, “I want to be cheerful and energetic” as a listener. Therefore, it is reflected in the “feeling screen where performance is required” (see FIG. 8).

  In step S46, it is determined whether or not the listener has selected a song from the “song list screen” (see FIG. 7). That is, it is determined whether or not a song to be listened to has been selected from the currently distributed live songs displayed on the “song list screen” by the listener. If it is determined that the song has not been selected (NO in step S46), for example, a “feeling screen of currently played music” such as operating a “return to feeling list” button (not shown). It is determined whether or not an operation for returning to (see FIG. 6) has been performed (step S54). If it is determined that the return operation has been performed (YES in step S54), the process returns to step S41 to display the “feeling screen of currently played music”. If it is determined that the return operation has not been performed (NO in step S54), the process returns to step S46.

  If it is determined that the song has been selected (YES in step S46), the relay device T is requested to stream the selected song (step S47). In step S48, screen information (music detail screen data) of the “music detail screen” (not shown) of the selected music is obtained from the relay device T, and the screen is displayed on the display 6A. The screen is updated regularly. In step S49, live performance is received by receiving performance information from the relay device T and performing streaming playback. In step S50, it is determined whether empathy information or an arbitrary comment has been input by the listener. If it is determined that sympathy information or an arbitrary comment has been input (YES in step S50), the input sympathy information or arbitrary comment is transmitted to the relay device T (step S51). That is, when a user who is a listener listens to a song being played and sympathizes with the user or wants to post an arbitrary comment to the performer, the user, for example, a “sympathize” button (not shown) By pressing a “comment post” button (not shown) after inputting an arbitrary comment, empathy information and a comment can be transmitted to the relay apparatus T. The sent sympathy information and arbitrary comments are reflected on the “tune detail screen” (not shown) by the relay device T. The empathy information is also reflected as the number of sympathizers on the “song list screen” (see FIG. 7).

  In step S52, it is determined whether or not a reproduction end instruction (forced end instruction) such as a “end of reproduction” button (not shown) is operated by the listener. If it is determined that a reproduction end instruction has not been given (NO in step S52), the process returns to step S49. If it is determined that a reproduction end instruction has been issued (YES in step S52), the streaming reproduction is terminated, and a message indicating the completion is transmitted to the relay device T (step S53). Thereafter, the process returns to step S46. When the playback of a song being played to the end is completed, the streaming distribution of the song is automatically ended and a message to that effect is transmitted to the relay device T.

  As described above, in the live distribution system according to the present invention, when a song is transmitted and received between devices via a communication network, a song that matches the feeling (feelings) of the individual listener is used for a performance operation by the performer. In addition, live (real-time) delivery is possible. That is, in response to a listener who operates the live performance listening device inputting a desired emotional expression word for a song distributed live via a communication network, each of the listeners input by the live performance relay device performs live distribution. By presenting a desired sensibility expression word to the song to be played, the player who operates the live performance transmission device can see the presentation and know what song the listener currently wants to listen to.

  In addition, the live performance relay device counts the number of performers and listeners for the music being distributed live and distributes it to the live performance transmission device and the live performance listening device, so that the listener can select the song he wants to listen to. While it can be used as a reference, the performer can use it as a reference when deciding the music to provide. Then, when the live performance listening device expresses that the listener sympathized with the song being delivered live, the live performance relay device adds the number of listeners and the song for each song being delivered live that is classified into the same emotional expression word. By summing up the number of sympathetic sympathizers and distributing them to a live performance transmitter or a live performance listening device, the performer can compare the listener's response to the song he is playing with other players' songs. it can.

  In this way, when performing live distribution in which a song to be played in accordance with a player's performance operation is transmitted and received to a large number of devices simultaneously via a communication network, While listening to the desired sensibilities at any time, it will be possible to deliver live, while listeners will be able to receive timely distribution of songs that fit their current feelings.

1 ... CPU, 2 ... ROM, 3 ... RAM, 4,5 ... detection circuit, 4A ... performance operator, 5A ... setting operator, 6 ... display circuit, 6A ... display, 7 ... sound source / effect circuit, 7A ... sound System: 8 ... Storage device, 9 ... Communication interface, 1D ... Data and address bus, A ... A feeling screen of the music currently being played, B ... A feeling of the player in each song, C ... Increment button and display Operation buttons such as the increment button, D ... Enter button, E ... Song list screen, F ... Song title, G ... Feeling screen for performance, H ... Feelings of listeners seeking performance, K ... Cursor, O ... Live broadcast transmission device, R ... Live broadcast listening device, T ... Live broadcast relay device, Z ... Other devices

Claims (3)

A live distribution system that distributes music to a large number of listeners simultaneously via a communication network in accordance with performance operations by a performer,
Means for acquiring a Kansei expression word desired by a listener for a song to be distributed, presenting the acquired Kansei expression word, and means for registering a song to be distributed in association with any of the presented Kansei expression words; The means for streaming transmission of performance information generated at any time in response to a performance operation by the performer, and the number of performers who are distributing the song with respect to the song associated with the same sensitivity expression word as the transmitted song And a means for displaying at least one of the number of listeners listening to those songs and the number of sympathizers who sympathized with those songs,
A means for displaying the number of performers who are delivering the songs and the number of listeners who are listening to those songs for each of the emotional expression words associated with each song for all the songs being delivered, and listeners Sympathy with the number of listeners listening to each song and the song, together with means for registering the desired emotional expression word for the song to be distributed, and the song information of the corresponding song for each of the sensitivity expression words Means for acquiring and displaying at least one of the number of sympathizers, means for selecting any one of the songs being distributed, means for streaming receiving and playing the performance information of the selected songs, and A listening device having means for expressing sympathy with the song;
All songs being distributed are classified according to Kansei expression words associated with the performer, and the number of performers who are distributing one or more songs corresponding to each Kansei expression word and listening to each song A means for counting and outputting at least one of the number of sympathizers and the number of sympathizers who sympathize with each song, and receiving performance information of all the songs being distributed, and selected by the listener from the received performance information A live distribution system comprising: a relay device having means for streaming transmission of performance information of a song to a listener through a communication network. A transmitter that generates performance information in response to a performance operation of a performer and a listening device that generates a musical sound based on the performance information are connected via a communication network so that data can be transmitted and received, and the transmission device performs streaming transmission. A data relay device for retransmitting performance information to the listening device,
Means for receiving a sentiment expression word desired for a song distributed by the listener from the listening device, and presenting the received sentiment expression word to the transmission device;
Means for receiving a sentiment expression word associated with a song distributed by the performer from the transmission device;
Means for receiving performance information streamed from the transmission device, and retransmitting the received performance information to the listening device;
The retransmitted songs are classified according to the Kansei expression words, and the number of performers who are delivering songs including the other songs corresponding to the Kansei expression words and the listeners who are listening to the songs are totaled. , Means for outputting the counting result to the transmission device and the listening device;
Receiving sympathy information expressing that the listener has sympathized with the song from the listening device, summing up the number of sympathizers who sympathized with the re-sent song based on the sympathy information, and counting the result of the transmission device and the A data relay device comprising means for outputting to a listening device. A transmitter that generates performance information in response to a performance operation of a performer and a listening device that generates a musical sound based on the performance information are connected via a communication network so that data can be transmitted and received, and the transmission device performs streaming transmission. A program for resending performance information to the listening device,
On the computer,
Receiving from the listening device a sentiment expression word desired by the listener for the song to be delivered, and presenting the received sentiment expression word to the transmission device;
A procedure of receiving a sentiment expression word associated with a song distributed by a performer from the transmission device;
Receiving the performance information streamed from the transmission device, and retransmitting the received performance information to the listening device;
The retransmitted songs are classified according to the Kansei expression words, and the number of performers who are delivering songs including the other songs corresponding to the Kansei expression words and the listeners who are listening to the songs are totaled. , A procedure for outputting the counting result to the transmission device and the listening device;
Receiving sympathy information expressing that the listener has sympathized with the song from the listening device, summing up the number of sympathizers who sympathized with the re-sent song based on the sympathy information, and counting the result of the transmission device and the A program for executing a procedure for outputting to a listening device.

Images