WO2014181773A1 - 音楽セッション管理方法及び音楽セッション管理装置 - Google Patents

音楽セッション管理方法及び音楽セッション管理装置 Download PDF

Info

Publication number
WO2014181773A1
WO2014181773A1 PCT/JP2014/062168 JP2014062168W WO2014181773A1 WO 2014181773 A1 WO2014181773 A1 WO 2014181773A1 JP 2014062168 W JP2014062168 W JP 2014062168W WO 2014181773 A1 WO2014181773 A1 WO 2014181773A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
performance
performance sound
music session
music
Prior art date
Application number
PCT/JP2014/062168
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
健太郎 長谷見
Original Assignee
ヤマハ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ヤマハ株式会社 filed Critical ヤマハ株式会社
Priority to CN201480025795.XA priority Critical patent/CN105190741A/zh
Priority to KR1020157031455A priority patent/KR20150137117A/ko
Publication of WO2014181773A1 publication Critical patent/WO2014181773A1/ja

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058—Transmission between separate instruments or between individual components of a musical system
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/175—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor

Definitions

  • the present invention relates to a technique for managing a music session in which a plurality of users located at points separated from each other participate.
  • performance sound data representing performance sound (musical sound or singing voice) in which a single user (first user) played a musical piece with a specific instrument is registered in the server and registered.
  • a technique for utilizing performance sound data for a music session is disclosed.
  • the server searches for performance sound data that matches a search condition according to an instruction from a user (second user) who desires a music session, and the retrieved performance sound data is sent to the user (second user). By transmitting, the user (second user) can experience a music session in which he / she plays a desired musical instrument in parallel with the performance sound of the performance sound data.
  • an object of the present invention is to provide a technique that allows a plurality of users to participate in a music session while complementing a performance part of a performance piece.
  • a music session management method of the present invention is a music session management method for managing a music session using a plurality of terminal devices, which is a music tune composed of a plurality of performance parts, An acquisition step of acquiring performance sound data representing performance sounds of at least one performance part from at least one terminal device, and a storage device storing a plurality of complementary data representing performance sounds of a plurality of performance parts of the performance music , A selection step of selecting performance data representing the performance sound of the part to be complemented of the performance tune, a performance sound of the performance sound data acquired from the terminal device in the acquisition step, and the complementary data selected in the selection step A playback control step of playing back the performance sound of the data on another terminal device.
  • a music session management device for managing a music session using a plurality of terminal devices, which is a music tune composed of a plurality of performance parts.
  • a performance sound data acquisition unit for acquiring performance sound data representing performance sound of at least one performance part from at least one terminal device, and a plurality of complementary data representing performance sounds of a plurality of performance parts of the performance music
  • a complementary data selection unit for selecting complementary data representing the performance sound of the part to be complemented of the musical composition from the storage device, and the performance sound of the performance sound data acquired from the terminal device by the performance sound data acquisition unit
  • a reproduction control unit that reproduces the performance sound of the complementary data selected by the complementary data selection unit on another terminal device.
  • the performance tunes are to be complemented. It is possible to realize a music session of a plurality of participants while complementing the part.
  • FIG. 1 is a block diagram of a music session system according to the first embodiment of the present invention.
  • FIG. 2 is a block diagram of the terminal device.
  • FIG. 3 is a block diagram of the music session management apparatus.
  • FIG. 4 is a schematic diagram of the contents stored by the storage device of the music session management device.
  • FIG. 5 is a schematic diagram of the contents stored in the storage device of the music session management device.
  • FIG. 6 is a block diagram of a functional configuration of the music session management apparatus.
  • FIG. 7 is a flowchart of the operation of the music session management apparatus.
  • FIG. 8 is a display example of the terminal device.
  • FIG. 9 is a flowchart of the complementary data registration process.
  • FIG. 10 is a display example of the terminal device.
  • FIG. 10 is a display example of the terminal device.
  • FIG. 11 is a flowchart of the complementary data selection process.
  • FIG. 12 is a display example of the terminal device.
  • FIG. 13 is a block diagram of a music session system in the third embodiment.
  • FIG. 14 is a display example of the terminal device.
  • FIG. 15 is a display example of the terminal device.
  • FIG. 1 is a block diagram of a music session system 100A according to the first embodiment of the present invention.
  • the music session system 100A includes a plurality of terminal devices 12 and a music session management device 14, and performs a music session using each terminal device 12 owned by the performer of each performance part of the song.
  • This is a communication system to be realized.
  • a music session means that a plurality of performers perform different performance parts in parallel (ensemble).
  • “Performance” implies singing by a singer in addition to playing a musical instrument. Accordingly, the “performance part” includes both the instrument part and the singing part, and the “performer” includes both the instrument player and the singer.
  • FIG. 2 is a block diagram of each terminal device 12.
  • Each of the plurality of terminal devices 12 is a communication terminal (for example, a personal computer or a mobile phone) located at a point separated from each other, and communicates with the music session management device 14 via a communication network 16 (for example, a mobile communication network or the Internet). Communicate with each other.
  • each terminal device 12 is realized by a computer system including a control device 21, a storage device 22, a communication device 23, a display device 24, an input device 25, a recording device 26, and a playback device 27.
  • the control device 21 is an arithmetic processing device that executes various kinds of control processing and arithmetic processing by executing a program stored in the storage device 22.
  • the storage device 22 (for example, a semiconductor recording medium) stores a program executed by the control device 21 and various data used by the control device 21.
  • the communication device 23 communicates with the music session management device 14 or another terminal device 12 via the communication network 16. Communication between each terminal device 12 and the communication network 16 may be realized by either wired communication or wireless communication.
  • the display device 24 (for example, a liquid crystal display panel) displays an image instructed from the control device 21.
  • the input device 25 is a device that receives an instruction from the user for the terminal device 12 and includes, for example, a plurality of operators operated by the user. Note that a touch panel configured integrally with the display device 24 can be used as the input device 25.
  • the recording device 26 records the performance sound of the user performing a specific performance part of the music.
  • the recording device 26 of the first embodiment generates performance sound data Da representing performance sound by the user.
  • the performance sound data Da is, for example, acoustic data (sample series) representing the time waveform of the performance sound.
  • a signal input circuit that receives a musical sound signal supplied from an electric musical instrument or an electronic musical instrument according to a performance operation by the user and generates performance sound data Da, or a singing sound or musical instrument sounded by the user.
  • a sound collection device that collects performance sounds and generates performance sound data Da is preferably used as the recording device 26.
  • the playback device 27 radiates sound instructed from the control device 21.
  • the playback device 27 includes a D / A converter that converts digital data (playback data Dc, performance sound data Da) supplied from the control device 21 into an analog sound signal, and an amplifier that amplifies the converted sound signal.
  • a sound emitting device for example, a headphone or a speaker
  • the playback device 27 includes a D / A converter that converts digital data (playback data Dc, performance sound data Da) supplied from the control device 21 into an analog sound signal, and an amplifier that amplifies the converted sound signal.
  • a sound emitting device for example, a headphone or a speaker
  • each terminal device 12 can participate in a music session in which each performance part of a specific music (hereinafter referred to as “performance music”) is performed in parallel by a plurality of people.
  • performance music a specific music
  • the performance sounds registered in advance in the music session management device 14 are insufficient for the music session. It is used as a performance sound of a performance part (hereinafter referred to as a “part to be complemented”).
  • a music session over all performance parts of a musical composition is realized by complementing the shortage of performers with performance sounds prepared in advance.
  • FIG. 3 is a block diagram of the music session management device 14.
  • the music session management device 14 is a server device (for example, a web server) that manages a music session in which a user of each terminal device 12 participates, and includes a control device 31, a storage device 32, and a communication device 33.
  • the control device 31 is an arithmetic processing device that executes various kinds of control processing and arithmetic processing by executing a program stored in the storage device 32.
  • the communication device 33 communicates with each terminal device 12 via the communication network 16.
  • the storage device 32 stores a program executed by the control device 31 and various data used by the control device 31.
  • a known recording medium such as a semiconductor recording medium or a magnetic recording medium or a combination of a plurality of types of recording media can be employed as the storage device 32.
  • the storage device 32 is installed in an external device (for example, an external server device) separate from the music session management device 14, and the music session management device 14 writes and reads information to and from the storage device 32 via the communication network 16. It is also possible to execute. That is, the storage device 32 is not an essential element of the music session management device 14.
  • the storage device 32 stores user data U and recorded data R of each music piece for each user.
  • the user data U is basic information about the user of each terminal device 12, and specifies, for example, user identification information, a display name, and a performance part (a performance part played by a user in a past music session). .
  • the recorded data R of each song includes supplementary data Db and related data Q.
  • the complementary data Db is acoustic data (typically a sample series representing the time waveform of the performance sound) representing the performance sound of each performance part of the music, and the performance sound of the part to be complemented among the performance music in the music session. Used for playback.
  • the related data Q is metadata related to the performance sound represented by the complementary data Db, and is used for searching for the complementary data Db to be applied to the complement target part. The generation of the complementary data Db and the specific contents of the related data Q will be described later.
  • FIG. 4 the state in which the user data U and the recorded data R of each piece of music are individually stored for each user is illustrated for convenience. However, in actuality, as illustrated in FIG.
  • FIG. 6 is a functional configuration diagram of the music session management device 14.
  • the control device 31 of the music session management device 14 executes a program stored in the storage device 32, thereby managing a plurality of music sessions using the plurality of terminal devices 12 in FIG.
  • Functions (performance sound data acquisition unit 51, complementary data registration unit 52, display processing unit 53, complementary data selection unit 54, reproduction control unit 55) are realized.
  • a configuration in which each function of the control device 31 is distributed to a plurality of devices (for example, a plurality of server devices installed at different positions), or a part of the function of the control device 31 is a dedicated electronic circuit (for example, a DSP). Realizing configurations may also be employed.
  • the performance sound data acquisition unit 51 acquires performance sound data Da representing the performance sound of the performance part of each participant in the music session from the terminal device 12 of each participant via the communication network 16 and the communication device 33.
  • the complementary data registration unit 52 stores the recording data R including the complementary data Db corresponding to the performance sound data Da acquired from the terminal devices 12 by the performance sound data acquisition unit 51 in the storage device 32.
  • the display processing unit 53 causes the display device 24 to display the screen by transmitting image data of various screens related to the music session to the terminal device 12 of each participant of the music session.
  • the complementary data selection unit 54 selects the complementary data Db to be applied to the part to be complemented for the musical piece from the plurality of complementary data Db (recorded data R) stored in the storage device 32.
  • the playback control unit 55 causes the playback device 27 of the terminal device 12 of each participant in the music session to play back sound. Specifically, the reproduction control unit 55 transmits reproduction data Dc including performance sound data Da of other participants to the terminal device 12 of each participant of the music session. When the number of participants in the music session is less than the total number of performance parts of the performance song, the playback control unit 55 plays back including the supplementary data Db selected by the supplementary data selecting unit 54 and the performance sound data Da of other participants. Data Dc is transmitted to each terminal device 12.
  • the control device 21 of each terminal device 12 supplies the playback device 27 with the playback data Dc received by the communication device 23 from the music session management device 14 and the performance sound data Da generated by the recording device 26 so as to be played back as sound. To do. Accordingly, it is possible for a plurality of participants located at points separated from each other to experience a music session in real time using each terminal device 12.
  • FIG. 7 is a flowchart of the operation of the music session management device 14.
  • the terminal device 12 of any of the plurality of participants in the music session (hereinafter referred to as “specific participant”) starts the music session to the music session management device 14 in response to an instruction from the user to the input device 25.
  • the music session management device 14 starts the process of FIG.
  • the display processing unit 53 of the music session management device 14 displays the screen GA of FIG. 8 on the display device 24 of the terminal device 12 of the specific participant (SA1).
  • the specific participant appropriately operates the input device 25 while referring to the screen GA displayed on the display device 24, thereby specifying a desired performance tune to be played.
  • the specific participant operates the input device 25 of the terminal device 12 to perform the complement target part (that is, the performance performance among a plurality of performance parts of the performance song). It is possible to specify a performance part that does not exist.
  • One or a plurality of performance parts can be designated as the complement target parts.
  • the control device 31 of the music session management device 14 receives the specification of the performance piece and the part to be complemented from the terminal device 12 of the specific participant (SA2).
  • SA2 specific participant
  • a configuration is also adopted in which participants in a music session are recruited (accepting a participation request from an arbitrary terminal device 12) for a predetermined time after the performance song is confirmed.
  • the specific participant does not specify the complement target part.
  • the music session process is executed without using the complement data Db in the storage device 32 (SA4).
  • the performance sound data acquisition unit 51 acquires the performance sound data Da from the terminal device 12 of each participant in the music session, and the playback control unit 55 receives the performance sound data acquisition unit 51 from each terminal device 12.
  • the reproduction data Dc including the acquired performance sound data Da is transferred to another terminal device 12.
  • the reproduction control unit 55 performs reproduction data Dc including performance sound data Da of the performance part M1 received from the terminal device 12 of the participant P1 and performance sound data Da of the performance part M2 received from the terminal device 12 of the participant P2. Is transmitted to the terminal device 12 of the participant P3.
  • the reproduction data Dc including the performance sound data Da of the participant P2 and the performance sound data Da of the participant P3 is transmitted to the terminal device 12 of the participant P1, and the performance sound data Da of the participant P3 and the participant
  • the reproduction data Dc including the performance sound data Da of P1 is transmitted to the terminal device 12 of the participant P2.
  • the reproduction data Dc received from the music session management device 14 and the performance sound data Da generated by the recording device 26 of the own device are reproduced from the reproduction device 27. Therefore, a music session by a plurality of participants P1 to P3 located in a remote place is realized.
  • the supplemental data registration unit 52 determines whether or not it is necessary to register the supplemental data Db using the performance sound data Da received from each terminal device 12 in the current music session. (SA5).
  • the necessity of registration of the complementary data Db is selected in accordance with an instruction (or an instruction from a specific participant) from the participants (P1, P2, P3) who are in charge of each performance part of the performance song in the music session. . If the determination result of step SA5 is negative (SA5: NO), the process of FIG. 7 ends without executing the registration of the complementary data Db.
  • a step of allowing a participant (or a specific participant) to view the performance sound performed in the music session may be inserted before determining whether or not the supplementary data Db is registered in step SA5.
  • the music session management device 14 may temporarily store data indicating the performance sound, or each terminal device 12 may temporarily store the data indicating the performance sound. It may be memorized.
  • step SA5 determines whether the determination result of step SA5 is affirmative (SA5: YES).
  • step SA6 the complementary data registration process of FIG. 9 is executed (SA6).
  • Complementary data registration processing is executed for each of the plurality of performance sound data Da received from each terminal device 12 in the current music session.
  • the complementary data registration unit 52 When the complementary data registration process is started, the complementary data registration unit 52 generates the complementary data Db corresponding to the performance sound data Da (SB1). In the first embodiment, a case where the performance sound data Da is used as the complementary data Db is exemplified. The complementary data registration unit 52 generates related data Q related to the performance represented by the complementary data Db as exemplified below (SB2 to SB5).
  • the complementary data registration unit 52 analyzes the musical feature amount of the performance sound represented by the complementary data Db (SB2). Specifically, for the performance sound represented by the complementary data Db (performance sound data Da), the characteristic amount such as the performance tempo and the key of the singing voice is specified. Further, the complementary data registration unit 52 generates evaluation information by evaluating the performance represented by the complementary data Db (SB3). Specifically, by comparing the model data for specifying the standard melody of each performance part of the performance music and the supplementary data Db, evaluation information according to the degree of difference in melody between the two (skillful performance A corresponding score). A publicly-known technique (for example, the technique of Patent Document 2) is arbitrarily adopted for evaluation of skill of performance.
  • the supplementary data registration unit 52 generates information related to the performance sound represented by the supplementary data Db (hereinafter referred to as “performance information”) (SB4).
  • performance information For example, the performance part, the date and time of the performance, the personal information of the performer (for example, performer name, gender, age, address, etc.), the performance tendency (for example, the tendency of arrangement such as “jazz style”), the period of the music activity (for example, the month)
  • Performance information including various kinds of information such as music orientation (professional orientation / hobby degree, etc.), player comments, and the like.
  • the performance information is specified in accordance with an instruction from the user to the terminal device 12, for example.
  • the display processing unit 53 displays the screen GB of FIG.
  • FIG. 10 illustrates a screen GB for designating a performance part performed by a participant in a music session, a performance tendency (Arrangement) intended by the participant, and a player's comment.
  • the complementary data registration unit 52 generates performance information in response to an input from the user with respect to the screen GB. It should be noted that the music information and genre that the performer frequently performs, identification information of other users who perform music sessions with the performer, etc. are specified according to the history of past music sessions, for example, and included in the performance information Is also possible.
  • the complementary data registration unit 52 generates related data Q including the feature amount analyzed in step SB2, the evaluation information (melody, rhythm) generated in step SB3, and the performance information generated in step SB4 (SB5). ). Then, the complementary data registration unit 52 stores the recording data R in which the complementary data Db generated in step SB1 and the related data Q generated in step SB5 are associated with each other in the storage device 32 (SB6). Further, the complementary data registration unit 52 updates the user data U of the user according to the contents of the recorded data R of each user (SB7). Specifically, the performance part designated by the user data U is updated according to the recorded data R.
  • the supplemental data registration process described above is repeated for each music session, so that various recorded data R (complementary data Db) corresponding to the performances of a large number of users for each performance part of a plurality of music pieces. ) Is stored in the storage device 32.
  • the total number of recorded data R stored in the storage device 32 automatically increases with the repetition of the music session (that is, it is not necessary to generate and register the recorded data R independently of the music session).
  • the supplement data selection unit 54 is suitable for the complement target part designated by the specific participant among the plurality of supplement data Db stored in the storage device 32 for the performance music of the current music session.
  • Data Db is selected (SA7).
  • the supplementary data is retrieved from a plurality of supplementary data Db (recorded data R) stored in the storage device 32 using a search condition corresponding to the related data Q of the recorded data R corresponding to each participant in the music session. Db is searched.
  • the complementary data Db that matches the preference or performance tendency of each participant in the music session is searched.
  • FIG. 11 is a flowchart of the complementary data selection process (SA7) executed by the complementary data selection unit 54 to select the complementary data Db.
  • SA7 complementary data selection process executed by the complementary data selection unit 54 to select the complementary data Db.
  • the complementary data selection unit 54 refers to the user data U of each user stored in the storage device 32, so that the recorded data R of each participant in the current music session is recorded. (That is, the recorded data R including the supplementary data Db generated in the past performance of each participant) is searched from the storage device 32, and the related data in each searched recorded data R (hereinafter referred to as “related data for search”). Q) is specified (SC1).
  • the supplementary data selection unit 54 selects K pieces of data from the recorded data R of a plurality of users (regardless of whether or not the participant of the current music session is included) according to the search condition according to the search related data Q (
  • the recorded data R (K is a natural number) is searched (SC2).
  • the recorded data R including the related data Q correlated with the search related data Q is searched.
  • Recorded data R including related data Q that matches or approximates search related data Q and recorded data R that includes related data Q whose evaluation information matches or approximates search related data Q are searched from storage device 32. .
  • the display processing unit 53 presents the K pieces of recorded data R selected by the supplemental data selection unit 54 to the specific participant's terminal device 12 as selection candidates (SC3). Specifically, the display processing unit 53 displays the screen (list) GC of FIG. 12 presenting K pieces of recorded data R on the display device 24 of the terminal device 12 of the specific participant. That is, the display processing unit 53 proposes K pieces of recorded data R (complementary data Db) suitable for the current music session to the specific participant as candidates for the complement target part.
  • information designated by the related data Q (for example, information such as a player name, performance part, performance tendency (Arrangement), performance date and time (Posted)) is displayed for each of the K recorded data R. Is done.
  • the specific participant can select the recorded data R of the desired performance from the K recorded data R presented on the screen GC by appropriately operating the input device 25 of the terminal device 12. It is also possible to change the arrangement order of the K pieces of recorded data R according to the information specified by the related data Q of each recorded data R.
  • the K pieces of recorded data R are arranged according to various sort conditions such as the order of performance dates and times, the order of the number of times selected in a past music session (popular order), and the order of evaluation indicated by the evaluation information. Is possible.
  • a configuration may be employed in which each participant listens to the performance sound of the complementary data Db by transmitting the complementary data Db in each recorded data R to the terminal device 12 and reproducing it from the reproducing device 27.
  • the specific participant of the music session can select any of the K pieces of recorded data R by appropriately operating the input device 25 of the terminal device 12.
  • the complementary data selection unit 54 of the music session management device 14 accepts the selection of the recorded data R by the specific participant from the terminal device 12 (SC4), and the complementary data Db in the recorded data R is applied to the complement target part. (SC5).
  • the supplemental data selection unit 54 performs the supplemental data according to the search condition according to the search related data Q of each participant of the current music session and the instruction from the specific participant. Select Db.
  • Supplementary data selection unit 54 performs adjustment processing for adjusting the acoustic characteristics of the performance sound for the supplementary data Db selected in step SC5 (SC6). Specifically, the supplemental data selection unit 54 performs acoustic characteristics (for example, music such as tempo and key) of the performance sound data Da acquired by the performance sound data acquisition unit 51 from the terminal device 12 of each participant in the current music session. The acoustic characteristics of the performance sound of the complementary data Db are adjusted so as to match or approximate the characteristic feature).
  • a known technique is arbitrarily employed for adjusting the acoustic characteristics (for example, tempo conversion and key adjustment). The above is the specific content of the complementary data selection process (SA7).
  • the reproduction control unit 55 executes a music session process using the complementary data Db selected in the complementary data selection process SA7 (SA8). Specifically, the reproduction control unit 55 and the performance sound data Da acquired by the performance sound data acquisition unit 51 from each terminal device 12 and the supplemental data Db selected by the supplemental data selection unit 54 (for the complementary data selection process). The reproduction data Dc including the complementary data Db) after the adjustment processing in step SC6 is transmitted to the other terminal device 12.
  • the participant P1 who plays the performance part M1 and the participant P2 who plays the performance part M2 participate in the music session of the performance music composed of the three performance parts M1 to M3 as in the above example.
  • the performance part M3 is designated as a complement target part.
  • the reproduction control unit 55 includes the performance sound data Da acquired by the performance sound data acquisition unit 51 from the terminal device 12 of the participant P1 and the performance part M3 (part to be complemented) selected by the complementary data selection unit 54.
  • the reproduction data Dc including the complementary data Db is transmitted to the terminal device 12 of the participant P2.
  • the reproduction data Dc including the performance sound data Da of the participant P2 and the complementary data Db of the performance part M3 are transmitted to the terminal device 12 of the participant P1.
  • the reproduction data Dc received from the music session management device 14 and the performance sound data Da generated by the recording device 26 of the own device are reproduced from the reproduction device 27. Therefore, the participant P1 and the participant P2 can experience the music session of the musical composition for all the performance parts (M1 to M3) including the complement target part (performance part M3) that does not actually exist. It is.
  • the supplementary data registration unit 52 receives from each terminal device 12 in the current music session, similarly to the end of the music session process (SA4). Registration of the complementary data Db using the performance sound data Da is executed (SA5, SA6).
  • the music session processing using the performance sound data Da transmitted from the plurality of terminal devices 12 and the supplementary data Db prepared in advance is executed, so that the part to be complemented for the music is complemented.
  • the music data session is stored in the storage device 32 with the supplementary data Db corresponding to the performance sound data Da acquired from each terminal device 12 by the performance sound data acquisition unit 51 during execution of the music session.
  • the complementary data Db is created and registered independently of each user's performance, there is an advantage that a large number and variety of complementary data Db can be easily registered.
  • the supplementary data Db is searched under the search condition corresponding to the search related data Q in the recorded data R corresponding to the past performance of each participant in the music session, the details of the part to be supplemented are detailed. Even if each participant of the music session does not specify the conditions in detail, it is possible to select the supplementary data Db that matches the preference and tendency of each participant (thus, each participant can experience the music session comfortably). There are advantages. Further, in the first embodiment, any of the K recorded data R searched using the search related data Q is selected by the participant of the music session. A special effect that the data Db can be selected is also realized.
  • the adjustment process (SC6) for adjusting the acoustic characteristics of the performance sound of the complementary data Db is executed, the natural impression that is musically harmonized with the performance sound represented by the performance sound data Da of each participant is performed.
  • the data Db can be used for a music session.
  • Second Embodiment A second embodiment of the present invention will be described.
  • standard referred by description of 1st Embodiment is diverted, and each detailed description is abbreviate
  • the recording device 26 of each terminal device 12 of the second embodiment includes an audio device.
  • the acoustic device is an element that gives various acoustic characteristics to the performance sound (participant's singing sound or musical instrument performance sound) by each participant of the music session.
  • an amplifier amplifier
  • effect imparting device effector
  • characteristics setting information information related to the acoustic device used by the music session by appropriately operating the input device 25 of the terminal device 12.
  • the characteristic setting information includes, for example, the type and model of the audio equipment, and various setting values of the audio equipment (that is, information related to the acoustic characteristics given to the performance sound).
  • the control device 21 of the terminal device 12 transmits the characteristic setting information input by the user from the communication device 33 to the music session management device 14.
  • the complementary data registration unit 52 of the music session management device 14 acquires characteristic setting information from the terminal device 12 of each participant in the music session in the complementary data registration process (SA6 / FIG. 9).
  • the related data Q including the characteristic setting information is generated together with the exemplified information (musical feature amount, evaluation information, performance information) (SB5).
  • the complementary data selection process SA7 / FIG. 11
  • the characteristic setting information in the related data Q is added to the search for the complementary data Db. That is, recorded data R including related data Q whose characteristic setting information matches or approximates search related data Q of each participant in the music session is preferentially selected in the complementary data selection process.
  • Other configurations and operations are the same as those in the first embodiment.
  • the characteristic setting information such as the type and setting value of the audio equipment used by each participant in the music session easily reflects the performance tendency and preference of the participant. Therefore, according to the second embodiment in which the complementary data Db is selected using the related data Q including the characteristic setting information, it is possible to select the complementary data Db that matches the preference and tendency of each participant in the music session.
  • the aforementioned effects are particularly prominent.
  • acoustic device simulator a program that simulates the operation of the acoustic device.
  • a setting value applied when the acoustic device simulator is executed is transmitted to the music session management apparatus 14 as characteristic setting information. Therefore, it is not necessary for the user to directly input the characteristic setting information.
  • the characteristic setting information for specifying the setting value at the time of each player's performance is registered as the related data Q
  • the characteristic setting information of the desired player is transmitted to the acoustic device at the time of each player's performance.
  • a setting value of a simulator that is, characteristic setting information (setting values) can be shared among a plurality of performers. Therefore, there is an advantage that other performers can easily reproduce the timbre corresponding to the set value of the desired performer.
  • any one of a plurality of terminal devices 12 used for a music session (hereinafter referred to as “management terminal device”) realizes the same function as the music session management device 14 of each of the above-described forms.
  • FIG. 13 is a block diagram of the music session system 100B of the third embodiment.
  • the music session system 100 ⁇ / b> B includes a plurality of terminal devices 12 that communicate with each other via a communication network 16.
  • Each of the plurality of terminal devices 12 has the same configuration as the terminal device 12 of the first embodiment (FIG. 2).
  • the control device 21 of the management terminal device 12 selected from the plurality of terminal devices 12 used for the music session is the control device 31 of the music session management device 14 of each of the above-described forms.
  • the storage device 22 of the management terminal device 12 stores user data U and recorded data R of each music piece for each user.
  • user data U and recorded data R are stored in a storage device separate from the management terminal device 12 (for example, a storage device of an external server device), and the management terminal device 12 writes and reads information to and from the storage device. It is also possible to execute.
  • the performance sound data acquisition part 51 of the management terminal device 12 of 3rd Embodiment acquires the performance sound data Da showing the performance sound of each participant of a music session from the other terminal device 12 similarly to 1st Embodiment.
  • the performance sound data Da of the participant who uses the management terminal device 12 is acquired from the recording device 26.
  • the complementary data registration unit 52 generates the complementary data Db from the performance sound data Da of each participant, and stores the recording data including the complementary data Db and the related data Q in the storage device 22 for each participant.
  • the complementary data selection unit 54 of the management terminal device 12 stores the complementary data Db for the complement target part in the storage device 22 under the search condition corresponding to the search related data Q of each participant in the music session. Select from.
  • the reproduction control unit 55 sends the performance sound of the performance sound data Da acquired by the performance sound data acquisition unit 51 and the performance sound of the complementary data Db selected by the complementary data selection unit 54 to the reproduction device 27 of each terminal device 12. Let it play.
  • the reproduction control unit 55 includes the performance sound data Da acquired by the performance sound data acquisition unit 51 from the recording device 26 of its own device (management terminal device 12) and the complementary data selected by the complementary data selection unit 54.
  • the performance sound is reproduced from the reproduction device 27, and the performance sound data Da acquired by the performance sound data acquisition unit 51 from the other terminal device 12 and the complementary data selection unit 54. Is reproduced from the reproduction device 27 of the own device (management terminal device 12).
  • each terminal device 12 can experience a music session by a plurality of persons while complementing the complement target part with the supplement data Db. That is, the same effect as that of the first embodiment is realized in the third embodiment. Note that the configuration of the second embodiment can also be applied to the third embodiment.
  • the usage status (popularity) of each supplementary data Db and evaluation results by other users can be included in the related data Q.
  • the related data Q includes the number of past music sessions (playback times) to which the supplementary data Db is applied and the evaluation results by each participant of the music session using the supplementary data Db.
  • the evaluation result of the complementary data Db for example, the score scored by each participant of the music session and the number of votes by each participant (number of positive evaluations) are preferably used.
  • supplement data Db for example, supplement data Db selected by the user from screen GB in FIG. 10
  • screen GD in FIG. 14 It is also possible to display on the display device 24.
  • the number of reproductions and the number of votes of the supplementary data Db and comments by each participant of the music session to which the supplementary data Db is applied are displayed.
  • it is possible to display on the screen GD the ranking when a plurality of complementary data Db corresponding to a common music is sorted by, for example, the number of votes or the number of reproductions.
  • the performance sound data Da acquired by the performance sound data acquisition unit 51 is stored in the storage device 32 as the complementary data Db.
  • the complementary data Db corresponding to the performance sound data Da is generated.
  • the method (the difference between the formats of the performance sound data Da and the complementary data Db) is not questioned.
  • data for example, data in MIDI format or VSQ format
  • designating each note of the performance sound represented by the performance sound data Da in time series can be stored in the storage device 32 as the complementary data Db.
  • the process of reconverting the complementary data Db into the same format as the performance sound data Da (a format representing the time waveform of the performance sound) is executed by the music session management device 14 or each terminal device 12.
  • the content of the related data Q in each recorded data R is not limited to the examples of the above-described embodiments.
  • the performance sound data Da of the music session to which the complementary data Db is applied (the performance sound of each participant in the music session using the complementary data Db as the part to be supplemented) It is also possible to specify the complementary data Db generated from the data Da).
  • the priority at the time of searching for the complementary data Db is variably set according to an instruction from the user, for example. Is also possible.
  • the search for the complementary data Db that prioritizes the characteristic setting information in the related data Q and the search for the complementary data Db that prioritizes the evaluation information among the related data Q are selectively executed.
  • the music session management device 14 executes billing processing when a music session is instructed by the user of the terminal device 12, and starts the music session on the condition that the billing processing is successful.
  • a configuration is also employed in which the contents of the service are differentiated between users who have been charged (hereinafter referred to as “paid members”) and users who have not been charged (hereinafter referred to as “free members”).
  • a configuration is adopted in which the number of executions of a music session and the number of times that the performance sound data Da is registered as the complementary data Db are limited to a predetermined range for a free member, and the restriction is released for a paid member.
  • a configuration that restricts the function to be reflected is also suitable.
  • the K pieces of recorded data R selected by the complementary data selection unit 54 it is possible to preferentially arrange the recorded data R of the paying member on the screen GC of FIG. Moreover, it is good also as a structure which gives the right equivalent to a pay member, or gives money and a present to the artist who created the supplementary data Db popular with listeners. According to the above configuration, there is an advantage that the billing process of each user is promoted and effective monetization is realized.
  • a browsing screen (page) for presenting information on a specific user can be displayed on the display device 24 of each terminal device 12.
  • the screen GE of FIG. 15 is displayed on the display device 24 for a specific user selected by an operation on the terminal device 12.
  • Various information indicated by the related data Q in the recorded data R of the user is displayed on the screen GE.
  • the music session for all the performance parts of the performance music is realized using the complementary data Db.
  • the music session over all the performance parts of the performance music is not necessarily required. That is, it is possible to complement only a part of the performance parts among the plurality of performance parts for which the performer is lacking in the performance music as the complement target parts with the supplement data Db.
  • the case where each participant of the music session uses one terminal device 12 is illustrated for convenience. However, a plurality of participants may share one terminal device 12. It is.
  • the method for selecting the complementary data Db by the complementary data selection unit 54 is arbitrary.
  • a configuration in which the complementary data selection unit 54 randomly selects any one of the plurality of complementary data Db stored in the storage device 32 for the music piece of the music session is also employed. That is, the search for the complementary data Db using the related data Q can be omitted.
  • the higher-order supplementary data Db is supplemented in the order of the number of reproductions and the number of votes (for example, descending order). It is also possible for the data selection unit 54 to make a selection.
  • the user of the terminal device 12 selects any one of the K pieces of recorded data R (complementary data Db) searched by the complementary data selection unit 54 using the search related data Q.
  • the supplementary data selection unit 54 it is also possible for the supplementary data selection unit 54 to narrow down to one supplementary data Db by a search using the related data Q for search. That is, the selection of the recorded data R by the music session participants can be omitted.
  • the configuration in which the reproduction data Dc indicating the performance sound (performance sound data Da, complementary data Db) is exchanged between the terminal devices 12 is exemplified. It is also possible to send and receive captured images (still images and moving images) between the terminal devices 12 as playback data Dc together with performance sounds.
  • sound corresponding to the reproduction data Dc is reproduced from the reproduction device 27 and an image corresponding to the reproduction data Dc is displayed on the display device 24.
  • the image indicated by the reproduction data Dc is not limited to an image obtained by capturing an actual performance. For example, an image recorded in advance can be used as the reproduction data Dc.
  • the related data Q of each user is used for selecting (searching) the complementary data Db.
  • the use of the related data Q is not limited to the selection of the complementary data Db.
  • the related data Q of each user can be used for specifying (matching) a plurality of users whose preferences and tendencies are similar or match each other.
  • a user P2 corresponding to the related data Q that correlates with or matches the related data Q of the user P1 is searched for and presented to the user P1.
  • there is an advantage that it is possible to easily find other users that match each user's preference and tendency. is there.
  • the playback sound data Dc is transmitted to the terminal device 12 of the participant of the music session.
  • the user of the terminal device 12 that is the transmission destination of the playback sound data Dc (complementary data Db) It is not essential to actually participate in the session (ie take charge of a specific performance part of a performance piece).
  • the reproduction sound data Dc including the performance sound data Da of each participant in the music session and the supplement data Db of the part to be complemented is used by a user who does not participate in the music session (use that desires to listen to the performance sound of the performance song). It is also possible to reproduce the performance sound of the performance tune by transmitting it to the terminal device 12.
  • a music session management apparatus is a music session management apparatus that manages a music session using a plurality of terminal devices, and that performs performance sounds of at least one performance part of a performance music composed of a plurality of performance parts.
  • a performance sound data acquisition unit that acquires performance sound data to be represented from at least one terminal device, and a storage device that stores a plurality of complementary data representing performance sounds of a plurality of performance parts of the performance music, and complements the performance music
  • a complementary data selection unit for selecting complementary data representing the performance sound of the target part, and the performance sound data acquired by the performance sound data acquisition unit from the terminal device and the complementary data selection unit selected
  • a playback control unit that plays back the performance sound of the complementary data on another terminal device.
  • the part to be complemented for the performance music is a performance part different from the performance part represented by the performance sound data acquired by the performance sound data acquisition unit from the terminal device.
  • the performance tunes are to be complemented. It is possible to realize a music session of a plurality of participants while complementing the part.
  • the music session management device further includes a complementary data registration unit that stores, in the storage device, complementary data corresponding to performance sound data acquired from the terminal device by the performance sound data acquisition unit. .
  • a complementary data registration unit that stores, in the storage device, complementary data corresponding to performance sound data acquired from the terminal device by the performance sound data acquisition unit.
  • the complementary data registration unit stores related data related to the performance of the performance sound data acquired by the performance sound data acquisition unit in the storage device in association with the complementary data corresponding to the performance sound data
  • the data selection unit selects the complementary data searched under the search condition according to the related data of the past performance by the participant of the music session from among the plurality of complementary data stored in the storage device.
  • the related data relates to the musical characteristic amount of the performance sound represented by the performance sound data, the evaluation information indicating the result of evaluating the performance sound represented by the performance sound data, and the acoustic characteristics given to the performance sound represented by the performance sound data. According to the configuration including at least one of the characteristic setting information, the above effect is particularly remarkable.
  • the complementary data selection unit executes an adjustment process for adjusting the acoustic characteristics of the performance sound of the complementary data selected from the storage device, and the reproduction control unit is configured such that the performance sound data acquisition unit is transmitted from the terminal device.
  • the performance sound of the acquired performance sound data and the performance sound of the complementary data subjected to the adjustment process are reproduced on the other terminal device.
  • the adjustment process for adjusting the acoustic characteristics of the performance sound of the complementary data is performed, for example, the natural impression complementary data that is musically harmonized with the performance sound represented by the performance sound data of each terminal device Can be used for music sessions.
  • the terminal device of the present invention is a terminal device used for a music session, and obtains performance sound data representing the performance sound of each performance part of a performance song from the recording device of the own device and other terminal devices.
  • a playback control unit that causes the playback device of the own device to play back the performance sound of the performance sound data acquired by the performance sound data acquisition unit from another terminal device and the performance sound of the complementary data acquired by the complementary data selection unit;
  • the music session management device and the terminal device are realized by hardware (electronic circuit) such as a DSP (Digital Signal Processor) dedicated to music session management, a CPU (Central Processing Unit), and the like. This is also realized by the cooperation of the general-purpose arithmetic processing device and the program.
  • the program of the present invention can be provided in a form stored in a computer-readable recording medium and installed in the computer.
  • the recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disk) such as a CD-ROM is a good example, but a known arbitrary one such as a semiconductor recording medium or a magnetic recording medium This type of recording medium can be included.
  • the program of the present invention can be provided in the form of distribution via a communication network and installed in a computer.
  • the music session management method of the present invention is a music session management method for managing a music session using a plurality of terminal devices, wherein the performance of at least one performance part of a performance music composed of a plurality of performance parts is provided.
  • a playback control step of playing back by the terminal device for example, the part to be complemented for the performance music is a performance part different from the performance part represented by the performance sound data acquired from the terminal device in the acquisition step.
  • it further includes a registration step of storing, in the storage device, complementary data corresponding to the performance sound data acquired from the terminal device in the acquisition step.
  • related data related to the performance of the performance sound data acquired in the acquisition step is stored in the storage device in association with the complementary data corresponding to the performance sound data
  • the selection step from among the plurality of supplementary data stored in the storage device, the supplementary data searched under a search condition corresponding to past related performance data by a participant in the music session is selected.
  • the related data includes a musical feature amount of the performance sound represented by the performance sound data, evaluation information indicating a result of evaluating the performance sound represented by the performance sound data, and a performance sound represented by the performance sound data. It includes at least one of characteristic setting information regarding the acoustic characteristics to be given.
  • the selection step adjustment processing for adjusting the acoustic characteristics of the performance sound of the complementary data selected from the storage device is executed, and in the reproduction control step, the performance sound data acquired from the terminal device by the acquisition step And the performance sound of the complementary data subjected to the adjustment process are reproduced by the other terminal device.
  • a plurality of users can participate in a music session while complementing the performance part of the performance music.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/JP2014/062168 2013-05-08 2014-05-02 音楽セッション管理方法及び音楽セッション管理装置 WO2014181773A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201480025795.XA CN105190741A (zh) 2013-05-08 2014-05-02 音乐合奏管理方法及音乐合奏管理装置
KR1020157031455A KR20150137117A (ko) 2013-05-08 2014-05-02 음악 세션 관리 방법 및 음악 세션 관리 장치

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013098721A JP2014219558A (ja) 2013-05-08 2013-05-08 音楽セッション管理装置
JP2013-098721 2013-05-08

Publications (1)

Publication Number Publication Date
WO2014181773A1 true WO2014181773A1 (ja) 2014-11-13

Family

ID=51867253

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/062168 WO2014181773A1 (ja) 2013-05-08 2014-05-02 音楽セッション管理方法及び音楽セッション管理装置

Country Status (4)

Country Link
JP (1) JP2014219558A (ko)
KR (1) KR20150137117A (ko)
CN (1) CN105190741A (ko)
WO (1) WO2014181773A1 (ko)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022028570A (ja) * 2020-08-03 2022-02-16 株式会社デザインＭプラス 記録データ再生方法およびシステム

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019159259A1 (ja) * 2018-02-14 2019-08-22 ヤマハ株式会社 音響パラメータ調整装置、音響パラメータ調整方法および音響パラメータ調整プログラム
KR102122195B1 (ko) * 2018-03-06 2020-06-12 주식회사 웨이테크 인공지능 합주 시스템 및 인공지능 합주 방법
CN108766408A (zh) * 2018-05-24 2018-11-06 广州音乐猫乐器科技有限公司 一种电子乐器合奏系统和方法
US11922913B2 (en) 2020-09-04 2024-03-05 Roland Corporation Information processing device, information processing method, and non-transitory computer readable recording medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001331176A (ja) * 2000-05-23 2001-11-30 Yamaha Corp 楽曲再生方法、マルチメディアデータ再生方法、サーバクライアントシステムおよびサーバ装置
JP2006243102A (ja) * 2005-03-01 2006-09-14 Yamaha Corp 演奏補助装置及び演奏補助プログラム
JP2012018329A (ja) * 2010-07-08 2012-01-26 Yamaha Corp セッション端末及びネットワークセッションシステム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4797523B2 (ja) * 2005-09-12 2011-10-19 ヤマハ株式会社 合奏システム
JP4692189B2 (ja) * 2005-09-28 2011-06-01 ヤマハ株式会社 合奏システム
JP4752425B2 (ja) * 2005-09-28 2011-08-17 ヤマハ株式会社 合奏システム
JP2012018282A (ja) * 2010-07-07 2012-01-26 Cellius Inc 演奏ファイル管理装置、演奏ファイル再生装置および演奏ファイル再生方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001331176A (ja) * 2000-05-23 2001-11-30 Yamaha Corp 楽曲再生方法、マルチメディアデータ再生方法、サーバクライアントシステムおよびサーバ装置
JP2006243102A (ja) * 2005-03-01 2006-09-14 Yamaha Corp 演奏補助装置及び演奏補助プログラム
JP2012018329A (ja) * 2010-07-08 2012-01-26 Yamaha Corp セッション端末及びネットワークセッションシステム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022028570A (ja) * 2020-08-03 2022-02-16 株式会社デザインＭプラス 記録データ再生方法およびシステム

Also Published As

Publication number Publication date
CN105190741A (zh) 2015-12-23
KR20150137117A (ko) 2015-12-08
JP2014219558A (ja) 2014-11-20

Similar Documents

Publication Publication Date Title
US9817551B2 (en) System and method for recording and sharing music
Huber et al. Modern recording techniques
Horning Chasing sound: Technology, culture, and the art of studio recording from Edison to the LP
WO2014181773A1 (ja) 音楽セッション管理方法及び音楽セッション管理装置
JP2016070999A (ja) カラオケ効果音設定システム
US20140277638A1 (en) System and method of predicting user audio file preferences
WO2014142288A1 (ja) 楽曲編集装置および楽曲編集システム
WO2021246104A1 (ja) 制御方法および制御システム
JP2012018282A (ja) 演奏ファイル管理装置、演奏ファイル再生装置および演奏ファイル再生方法
Skea Rudy Van Gelder in Hackensack: Defining the jazz sound in the 1950s
KR20140054810A (ko) 반주음악 제작 서비스 시스템 및 그 방법, 그리고 이에 적용되는 장치
JP2017068142A (ja) カラオケシステム及びプログラム
Duffell Making Music with Samples: Tips, Techniques & 600+ Ready-to-use Samples
JP6474292B2 (ja) カラオケ装置
JP2015225302A (ja) カラオケ装置
JP3621906B2 (ja) カラオケ映像作品のコンテストを行うカラオケ演奏装置
JP5551983B2 (ja) カラオケ演奏制御システム
JP6176721B2 (ja) カラオケ用プログラム、情報処理装置及びホスト装置
JP2012194381A (ja) 歌唱音声評価装置
JP2012220744A (ja) 楽曲の評価のための方法、サーバ装置およびプログラム
JP4444070B2 (ja) 楽曲専用の複数のカラオケ映像作品の中から１つの作品を選んで再生可能なカラオケ演奏装置
JP2023113579A (ja) 音源データの分離・再合成方法、及びカラオケ伴奏用音源提供システム
JP2002041063A (ja) カラオケ装置及び記録媒体
McDermott An interdisciplinary analysis of popular music genres in the recording studio and billboard charts
Masse Record producer: how has the profession changed over the years?

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480025795.X

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14794151

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20157031455

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14794151

Country of ref document: EP

Kind code of ref document: A1