JP7143607B2 - MUSIC PLAYBACK SYSTEM, TERMINAL DEVICE, MUSIC PLAYBACK METHOD, AND PROGRAM - Google Patents

Description

The present disclosure relates to a music playback system, method, and program, and more particularly to a music playback system, method, and program capable of synthesizing and outputting music on multiple tracks.

The present disclosure also relates to a terminal device used in the music playback system.

2. Description of the Related Art DAWs (Digital Audio Workstations) are known as applications used for music production on general-purpose terminals such as PCs (Personal Computers) and smartphones. A DAW realizes a multi-track recorder (over-recording) function by software, and can record vocals and sounds of musical instruments via an audio interface. In addition, the DAW can play MIDI (Musical Instruments Digital Interface) data or add special effects to sound source waveforms by using plug-ins. A DAW is known as an application that can easily combine a plurality of tracks into one finally into music data.

Here, Patent Literature 1 discloses a music reproducing device that reproduces music data. The music reproducing device described in Patent Literature 1 has a hardware sound source that produces sounds of a plurality of musical instruments based on MIDI data, and a software sound source that generates sounds based on MIDI data. If software tone generators are used to reproduce all musical instruments in a music reproducing apparatus, the processing load may increase, and a situation may arise in which music cannot be reproduced smoothly. To address this problem, the music playback device described in Patent Document 1 determines whether or not the processing load when generating sound using a software sound source is higher than a predetermined processing load. When the music reproducing apparatus determines that the processing load is high, it reproduces musical instruments with low sound volume using the hardware sound source, and reproduces the remaining musical instruments using the software sound source.

Further, Patent Document 2 discloses a musical tone synthesizing apparatus that performs musical tone synthesis on software using a personal computer or the like. In Patent Document 2, a musical tone signal is generated by a processor executing a plurality of generation processes. Among the plurality of generation processes executed by the processor, the musical tone synthesizer can perform a generation process that requires a large amount of calculation for processing one sound, a generation process that cannot change the sampling period, or a generation process that cannot change the generation algorithm. Decide the execution order so that the process has priority. The musical tone synthesizer executes a plurality of generation processes in the order specified by the determined execution order every predetermined period, and generates a musical tone signal in each generation process. At this time, the musical tone synthesizer changes at least one of the number of tones, the sampling period, and the content of the musical tone generation algorithm that can be changed in the generation process, which is executed last in the execution order. Control the amount of processor load.

Furthermore, Patent Document 3 discloses a network sound system. The network sound system described in Patent Document 3 includes terminal equipment and an external terminal (base station) having sound sources and effectors for expensive and valuable electronic musical instruments. The terminal device transmits performance information to the external device. The external device uses its own sound source to reproduce audio information based on the performance information, and transmits the audio information to the terminal device. Also, the terminal device transmits audio information to the external device. The external device applies the effector to the received audio information, and transmits the effector-applied audio information to the terminal device. By doing so, the terminal device can create music (audio information) using the sound source of the expensive electronic musical instrument and the high-performance effector arranged outside.

JP 2012-220511 A JP 2007-94439 A JP-A-2004-94163

A user can easily create music by operating a DAW on a general-purpose terminal. However, if the performance of general-purpose terminals is low, sound skipping may occur due to low CPU specs when using multiple functions that place a high load on the CPU (Central Processing Unit), such as applying complex effects, in a DAW. , making music difficult.

In general, DAW technology can achieve low-delay playback by minimizing the buffer size during sound source playback. In that case, since buffering processing occurs frequently, it is necessary to stably output music data without delay from effect processing or a mixer. However, when applying complex effect processing or when playing MIDI sound sources that reproduce a large number of sample data, there are many processes with high CPU load, and it is difficult to obtain stable output when low-spec terminals are used. difficult.

In order to address the above problem, Japanese Patent Application Laid-Open No. 2002-200002 outputs part of the sound output from the music playback device from a hardware sound source when the processing load is high. By doing so, the processing load can be reduced compared to the case where software tone generators are used for all musical instruments. However, in Patent Document 1, the tone generator to be used is automatically switched according to the processing load, so an unintended change from the software tone generator to the hardware tone generator is implemented. In Patent Literature 1, by limiting the use of the hardware sound source to musical instruments with low volumes, the effect of sound source switching can be reduced. However, even if the influence of sound source switching can be reduced, music cannot be reproduced correctly as intended by the user.

In Japanese Patent Laid-Open No. 2002-200013, the generation process that requires a large amount of calculations required for processing one sound, the generation process that cannot change the sampling period, or the generation process that cannot change the content of the tone generation algorithm is executed so as to be prioritized. Order is determined. In Japanese Unexamined Patent Application Publication No. 2002-100002, the generation process of musical tone generation whose calculation content is changed is executed late, and by changing the calculation content in the generation process whose execution order is late, it is possible to adjust the CPU load. However, even in Patent Document 2, although it is possible to adjust the processing load, it is not possible to correctly reproduce music as intended by the user.

In Patent Document 3, since music can be created using the sound source and effector of the external device, the specifications required for the terminal device itself can be reduced. For example, in Patent Document 3, by placing all tracks and plug-ins other than recording tracks in an external device, the CPU load of the terminal device (work terminal) can be reduced, eliminating the need to use a high-spec terminal as the terminal device. . However, in some situations it may be possible to process some of the tracks other than the recording track in the terminal device. Patent Document 3 does not consider effective use of the resources of the external device, and Patent Document 3 does not describe selection of a track or the like that uses the external device depending on the situation.

An object of the present disclosure is to provide a music playback system, a terminal device, a music playback method, and a program that are capable of effectively using resources of an external device when playing back music using a work terminal and an external device. do.

In order to achieve the above object, the present disclosure provides an outsourcing method for outsourcing which track among the plurality of tracks to an external terminal based on an index indicating the processing load when reproducing the plurality of tracks to be reproduced. outsource management means for determining whether a track is to be an outsourced track; track reproduction means for reproducing a track other than the track determined as the outsourced track among the plurality of tracks; Provided is a terminal device comprising: a sound source receiving means for receiving a reproduced music stream of a target track; and a synthesized output means for synthesizing and outputting the reproduced music stream with the track reproduced by the track reproducing means.

The present disclosure also includes a work terminal and an external terminal that can communicate with the work terminal, and the work terminal detects the plurality of outsource management means for determining which track among the tracks to be outsourced to the external terminal as an outsource target track, and transmitting an instruction to reproduce the outsource target track to the external terminal; track reproducing means for reproducing a track other than the track determined as the outsource target track, sound source receiving means for receiving a reproduced music stream of the outsource target track from the external terminal, and the track playback. means for synthesizing and outputting a track to be played back and said playback music stream, said external terminal comprising: outsource instruction receiving means for receiving an instruction to play said outsource target track; Provided is a music reproducing system comprising: track reproducing means for reproducing a track; and sound source transmitting means for transmitting the music reproduced by the track reproducing means to the work terminal as the reproduced music stream.

According to the present disclosure, which of the plurality of tracks is to be outsourced to an external terminal based on an index indicating the processing load when reproducing the plurality of tracks to be reproduced. determining, reproducing a track other than the track determined as the outsource target track among the plurality of tracks, receiving a reproduced music stream of the outsource target track from the external terminal, and reproducing the played track and the playback music stream, and outputting the synthesized music stream.

According to the present disclosure, a computer determines which of the plurality of tracks to be outsourced to an external terminal based on an index indicating the processing load when the plurality of tracks to be reproduced is played. and reproduces a track other than the track determined as the outsourced track among the plurality of tracks, receives a reproduced music stream of the outsourced track from the external terminal, and receives the reproduced music stream A program is provided for executing a process of synthesizing and outputting a track and the reproduced music stream.

A music reproduction system, a terminal device, a music reproduction method, and a program according to the present disclosure can effectively use the resources of the external device when music is reproduced using the work terminal and the external device.

1 is a block diagram showing a schematic configuration of a music playback system according to the present disclosure; FIG. 1 is a block diagram showing a music playback system according to a first embodiment of the present disclosure; FIG. FIG. 2 is a block diagram showing software configurations of a work terminal and an external terminal; FIG. 4 is a schematic diagram showing a configuration example of a track in a DAW; 4 is a flow chart showing an operation procedure for collecting meta information; 4 is a flow chart showing the operation procedure of the work terminal when playing music. 4 is a flowchart showing a procedure for calculating a plugin score; 4 is a flowchart showing a track score calculation procedure; 4 is a flow chart showing an operation procedure when a playback failure or the like occurs; 4 is a flow chart showing an operation procedure for determining a track to be outsourced; 4 is a flow chart showing the operation procedure of evaluation value calculation for each track. 4 is a flow chart showing an operation procedure for determining a track to be outsourced;

An outline of the present disclosure will be described prior to description of the embodiments. FIG. 1 shows a schematic configuration of a music playback system according to the present disclosure. The music reproduction system 10 has a work terminal (terminal device) 20 and an external terminal (terminal device) 30 . The work terminal 20 has outsource management means 21 , track reproduction means 22 , sound source reception means 23 , and synthesis output means 24 . The external terminal 30 has outsource instruction receiving means 31 , track reproducing means 32 and sound source transmitting means 33 .

The outsource management means 21 determines which of the plurality of tracks to be reproduced is to be an outsource target track to be outsourced to the external terminal 30 . The outsource management means 21 determines the outsource target track based on the index indicating the processing load when the work terminal 20 reproduces a plurality of reproduction target tracks. The outsource management means 21 transmits an instruction to reproduce the outsource target track to the external terminal 30 . The track reproducing means 22 reproduces the tracks other than the outsourced tracks among the plurality of tracks to be reproduced.

The outsource instruction receiving means 31 of the external terminal receives an instruction to reproduce the outsource target track from the outsource management means 21 . The track reproducing means 32 reproduces the outsource target track. The sound source transmitting means 33 transmits the music reproduced by the track reproducing means 32 to the work terminal 20 as a reproduced music stream.

The sound source receiving means 23 of the work terminal 20 receives the reproduced music stream of the outsourced track from the external terminal 30 . The synthesizing output means 24 synthesizes the track reproduced by the track reproducing means and the reproduced music stream received from the external terminal 30 and outputs the result.

In the music reproduction system according to the present disclosure, the outsource management means 21 determines the tracks to be outsourced to the external terminal 30 based on the index indicating the processing load when the work terminal 20 reproduces a plurality of tracks to be reproduced. do. The outsource management unit 21 determines, for example, the reproduction of a track that exceeds the CPU capacity of the work terminal 20 as an outsource target track to be outsourced to the external terminal 30 . By doing so, it is possible to perform music reproduction without causing reproduction defects such as sound skipping during music reproduction. In addition, the resources of the external terminal 30 can be effectively used compared to the case where all tracks are outsourced to the external device terminal.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. FIG. 2 shows a music playback system according to the first embodiment of the present disclosure. The music reproduction system 100 has a work terminal 101 , an audio interface (IF) 102 , an audio output device 103 , a score data input device 104 , an audio input device 105 and an external terminal 107 . The work terminal 101 and the external terminal 107 can communicate with each other via a network 106 such as the Internet. Note that although only one external terminal 107 is illustrated in FIG. 2 , the music reproduction system 100 may include a plurality of external terminals 107 .

The work terminal 101 is configured as a computer device including a CPU, memory, and the like. For example, a home PC, a smart phone, or the like can be used as the work terminal 101 . The work terminal 101 executes a music production application such as a DAW that provides an integrated music production environment. The work terminal 101 has a TCP/IP (Transmission Control Protocol/Internet Protocol) communication function for using the network 106 . The work terminal 101 also has a USB (Universal Serial Bus) port. A work terminal 101 corresponds to the work terminal 20 in FIG.

The audio IF 102 mainly has a function of mutual conversion between digital signals and analog signals. The audio IF 102 has input terminals for analog signals and MIDI signals. Audio IF 102 is connected to audio output device 103 , musical score data input device 104 , audio input device 105 , and work terminal 101 . The audio IF 102 is USB-connected to the work terminal 101, for example. The audio IF 102 is also connected to the audio output device 103 and the audio input device 105 via audio cables, and is connected to the musical score data input device 104 via a MIDI cable. The audio IF 102 has, for example, a DSP (Digital Signal Processor) that is a processor specialized for signal processing.

The audio output device 103 includes, for example, audio equipment such as speakers and headphones. The musical score data input device 104 is, for example, an external MIDI device, which converts music played by the user into MIDI data in a predetermined format and outputs the MIDI data. A MIDI keyboard, for example, is used for the musical score data input device 104 . In addition to the function of outputting MIDI data, the score data input device 104 may also have the function of receiving MIDI data output from the audio IF 102 and playing music according to the received MIDI. The voice input device 105 is configured as a device having a function of outputting an analog voice (music) signal, such as a microphone, a musical instrument, or an amplifier.

In the above, an example in which the score data input device 104 is connected to the work terminal 20 via the audio IF 102 has been described with reference to FIG. is not limited. For example, the score data input device 104 may be directly connected to the USB port of the work terminal 20 via a USB cable.

The external terminal 107 is configured as a computer device including a CPU, memory, and the like. For the external terminal 107, for example, a home PC, a smart phone, or the like can be used. The external terminal 107 executes a music production application such as a DAW that provides an integrated music production environment. External terminal 107 has a TCP/IP communication function for using network 106 . Also, the external terminal 107 may have a USB port for connecting with an audio IF (not shown). The external terminal 107 corresponds to the external terminal 30 in FIG.

FIG. 3 shows the software configuration of the work terminal 101 and the external terminal 107. As shown in FIG. The work terminal 101 has outsource management means 111 , sound source streaming reception means 112 , DAW application 113 , OS (Operating System) 114 , and audio driver 115 . These elements can be implemented in the work terminal 101 by executing a program read from the memory by the CPU of the work terminal 101 .

The OS 114 has an audio driver 115 for using the audio IF 102 and satisfies requirements for executing the DAW application 113 . The audio IF 102 includes an ADC (Analog to Digital Converter) 121 and a DAC (Digital to Analog Converter) 122 . ADC 121 converts an audio signal input from audio input device 105 (see FIG. 2) into a digital signal. The audio driver 115 acquires the audio signal converted into a digital signal from the ADC 121 . Also, the audio driver 115 outputs a digital audio signal to the DAC 122 . The DAC 122 converts the digital audio signal into an analog signal and outputs it to the audio output device 103 .

The DAW application 113 is application software used for music production and music playback. The DAW application 113 can simultaneously reproduce a plurality of audio tracks that handle voice waveforms and MIDI tracks that handle MIDI data and MIDI sound sources. Also, the DAW application 113 can assign a plurality of plug-in effects that change the characteristics of sound by adding waveform changes to each track. Furthermore, the DAW application 113 has at least one of an audio recording function and a MIDI recording function. The DAW application 113 also functions as the track reproduction means 22 and synthesis output means 24 of FIG. The DAW 113 also functions as track recording means.

Outsource management means 111 manages track and plug-in information developed on the DAW. The DAW application 113 has a function of cooperating with the outsource management means 111 to collect and store track and plug-in information as meta information. The outsource management means 111 determines outsource target tracks for which reproduction processing is outsourced to the external terminal 107 among the plurality of tracks on the DAW application 113 . The outsource management means 111 transmits information (outsource data) on outsource target tracks to the external terminal 107 . Outsource data includes, for example, sound source data, plug-in data, change difference data, and the like. Outsource management means 111 corresponds to outsource management means 21 in FIG.

The outsource management means 111 determines the outsource target track based on the index indicating the processing load when a plurality of playback target tracks are played on the work terminal 101 . The outsource management means 111 determines outsource target tracks based on, for example, information on a plurality of tracks to be played and plug-in information applied to each track. The outsource management means 111 calculates a score (track score) indicating the processing load, for example, for each process. Here, the process is a general term for track processing and plug-in processing, and the outsource management means 111 calculates track scores for combinations of tracks and plug-ins applied to the tracks. For example, the higher the processing load, the higher the track score value. The outsource management means 111 determines outsource target tracks based on the calculated track scores.

For example, the outsource management means 111 calculates a plug-in score indicating the processing load of each plug-in for each plug-in. The outsource management means 111 calculates a sub-score (provisional score) indicating the processing load of the track, and calculates a track score by adding the plug-in score of the plug-in applied to the track to the sub-score.

For example, the outsource management unit 111 adds a plug-in score to a plug-in with a larger CPU calculation amount. The outsource management unit 111 assigns a large plug-in score to a plug-in having a large amount of sampled sound source, for example, as a MIDI software sound source. Further, the outsource management means 111 assigns a large plug-in score to an effector plug-in that uses, for example, a highly functional reverb.

The outsource management means 111 adds the subscores of tracks with relatively long reproduction times, for example, to the subscores of the tracks. For example, if a work terminal has a track that has a long playback time for the entire music piece, the CPU load on the work terminal 101 increases because the proportion of the time in which there is a track that simultaneously executes CPU processing increases. The outsource management means 111, for example, assigns a large value to the subscore of a track whose playback time exceeds a predetermined percentage of the entire music piece.

For example, the outsource management means 111 selects tracks in ascending order of track scores, and accumulates the track scores of the selected tracks. The outsource management means 111 determines a track whose accumulated track score is equal to or higher than a reference score as an outsource target track. The outsource management means 111 may determine the outsource target track, for example, when the user presses a predetermined button.

Sound source streaming receiving means 112 receives streaming data from external terminal 107 via network 106 . The sound source streaming receiving means 112 outputs the received streaming data to the stream track on the DAW. The DAW application 113 cooperates with the sound source streaming receiving means 112 and has a function of reproducing stream tracks (stream data) as audio in real time (for example, with a low delay of about 10 ms). The sound source streaming receiving means 112 corresponds to the sound source receiving means 23 in FIG.

The external terminal 107 has outsource instruction receiving means 171 , sound source streaming transmitting means 172 , DAW application 173 and OS 174 . In the external terminal 107, these elements are implemented by the CPU executing a program read from the memory. The OS 174 satisfies the requirements for executing the DAW application 173 . The DAW application 173, like the DAW application 113 of the work terminal 101, can simultaneously reproduce a plurality of audio tracks handling voice waveforms and MIDI tracks handling MIDI data and MIDI sound sources. Also, the DAW application 173 can assign a plurality of plug-in effects that change the characteristics of sound by adding waveform changes to each track.

Outsource instruction receiving means 171 receives outsource data transmitted from work terminal 101 . The outsource instruction receiving means 171 develops the received outsource data on the DAW application 173 . The outsource instruction receiving means 171 has a function of controlling playback start and playback stop in the DAW application 173 . The sound source streaming transmission means 172 converts audio reproduced by the DAW application 173 into stream data and transmits the stream data to the work terminal 101 via the network 106 . The outsource instruction receiving means 171 corresponds to the outsource instruction receiving means 31 in FIG. 1, and the sound source streaming transmitting means 172 corresponds to the sound source transmitting means 33 in FIG. The DAW application 173 also functions as the track playback means 32 in FIG.

Here, in this embodiment, the work terminal 101 receives stream data of audio data from the external terminal 107 . In this embodiment, independent transmission and reception of MIDI data of a specific track between the work terminal 101 and the external terminal 107 is not assumed. In this embodiment, it is assumed that when there is a track to be played back that uses an external MIDI device such as a physical synthesizer, that track will be played back on the work terminal 101 . For this reason, the outsource management means 111 excludes tracks using external MIDI devices from outsource target tracks. Further, when recording is performed using the work terminal 101, the outsource management means 111 also excludes the recording track from the outsource target tracks.

FIG. 4 shows an example of track configuration in a DAW. For example, tracks 01 and 03 are audio tracks and track 02 is a MIDI track. It is assumed that tracks 01 to 03 are created tracks. A recording track is a track on which data to be recorded is recorded when the user performs recording using the musical score data input device 104 . A stream track is an audio track for reproducing stream data transmitted from the external terminal 107 . A master track is a track that integrates all tracks. The audio of the master track is output to the audio output device 103 (see FIG. 2).

One or more plug-ins can be applied to each track. When a plug-in to be applied to a track is specified, the DAW application 113 applies processing of the plug-in to reproduce the track. In the example of FIG. 4, plug-in 1 is applied to track 01, plug-ins 2 and 3 are applied to track 02, and plug-in 4 is applied to track 03. . Plug-in 5 is applied to the recording track, and plug-ins 6 and 7 are applied to the master track. Tracks on the DAW may include tracks to which plug-ins are not applied.

Next, the operation procedure will be explained. In the following description, it is mainly assumed that eight tracks T1 to T8 are developed on the DAW. A track T1 is an audio track corresponding to vocals, and a compressor, an equalizer, a pitch shifter, and a reverb plug-in are applied to the track T1. It is also assumed that the ratio of the playback time of track T1 to the entire music is 60%.

Track T2 is an audio track corresponding to chorus, and compressor, equalizer, delay, and reverb plug-ins are applied to track T2. It is also assumed that the reproduction time ratio of track T2 to the entire music piece is 40%. A track T3 is an audio track corresponding to a guitar, and a compressor, an amplifier simulator, and an equalizer plug-in are applied to the track T3. It is also assumed that the reproduction time ratio of track T3 to the entire music piece is 100%.

A track T4 is an audio track corresponding to a guitar, and an amp simulator and a delay plug-in are applied to the track T4. It is also assumed that the ratio of the playback time of track T4 to the entire music is 10%. Track T5 is a MIDI track corresponding to bass, and an instrument and an equalizer plug-in are applied to track T5. It is also assumed that the reproduction time ratio of track T5 to the entire music piece is 95%.

Track T6 is a MIDI track corresponding to drums, and instrument and reverb plug-ins are applied to track T6. It is also assumed that the ratio of the playback time of track T6 to the entire music is 100%. Track T7 is a MIDI track corresponding to a synthesizer, and overdrive and phaser plug-ins are applied to track T7. It is also assumed that the ratio of the playback time of track T7 to the entire music is 20%. It is assumed that a physical synthesizer (MIDI IN/MIDI OUT) is used to reproduce track T7.

Track T8 is a MIDI track corresponding to a synthesizer, and instrument, compressor, and equalizer plug-ins are applied to track T8. It is also assumed that the ratio of the playback time of track T8 to the entire music is 70%. In the following example, in addition to these eight tracks, consider the situation where the user records an electric guitar on track T9, which is an audio track.

FIG. 5 shows the operation procedure of meta information collection. The outsource management means 111 defines the track developed on the DAW application 113 as a track object T, and stores it in the track list (step A1). The outsource management means 111 executes step A1 each time a new track is added or track information is changed, and adds the track object of the newly added track to the track list.

The outsource management means 111 initializes variables for each of the track objects stored in the track list (step A2). At step A2, the outsource management means 111 uses a variable isMIDI that indicates whether the track type of each track is audio or MIDI, and a variable hasMIDIOut that indicates whether or not an external device is used using MIDI OUT. set. The outsource management means 111 also sets a variable length indicating the total playback time of the data included in the track. Further, the outsource management means 111 sets the variable isOutsourced indicating whether or not the track is outsourced to false indicating that the track is not outsourced, and initializes the score value score of the track to 1.

Subsequently, the outsource management means 111 defines the plug-in associated with the track as a plug-in object P and stores it in the plug-in list (step A3). The outsource management means 111 initializes variables for each plug-in object stored in the plug-in list (step A4). At step A4, the outsource management means 111 sets, for example, a variable plgEnabled indicating whether the plug-in is enabled or disabled, and a variable isPlginst indicating whether the plug-in is a musical instrument plug-in for MIDI. The outsource management unit 111 also sets a variable pluginData indicating the amount of plug-in data, and a variable isSpatialEffect indicating whether or not there is a spatial effect function. Furthermore, the outsource management means 111 initializes the score value score of the plug-in to zero.

FIG. 6 shows the operating procedure of the work terminal 101 during music reproduction. A user adds a track to the DAW application 113 of the work terminal 101 (step B1). Also, the user adds a plug-in in relation to any track (step B2). When a track is added in step B1, a track object corresponding to that track is added to the track list. Also, when a plug-in is added in step B2, a plug-in object corresponding to the plug-in is added to the plug-in list. The outsource management means 111 calculates a plug-in score (step B3) and a track score (step B4).

FIG. 7 shows the calculation procedure of the plug-in score. The outsource management means 111 selects one plug-in (plug-in object) from the plug-in list (step C1). Outsource management means 111 determines whether the selected plug-in is valid (step C2). At step C2, the outsource management means 111 refers to the variable plgEnabled of the plug-in object P, for example, and determines whether or not the plug-in is valid.

When the outsource management means 111 determines that the plug-in is valid in step C2, it initializes the provisional score to 0 (step C3). The outsource management means 111 determines whether or not the plug-in type selected in step C1 is VSTi (Virtual Studio Technology instruments) (step C4). At step C4, the outsource management means 111 refers to the variable isPlginst of the plug-in object P, for example, and determines whether the plug-in type is VSTi.

When the outsource management means 111 determines that the plug-in type is VSTi, it determines whether or not the data amount of the plug-in exceeds a predetermined data amount, for example, 500 Mbytes (step C5). At step C5, the outsource management means 111 refers to the variable pluginData of the plugin object P, for example, and determines whether the value of pluginData exceeds 500 Mbytes. When the outsource management means 111 determines in step C5 that the data amount exceeds 500 Mbytes, it adds "2" to the provisional score (step C6). When the outsource management means 111 determines that the data amount does not exceed 500 Mbytes in step C5, it adds "1" to the provisional score (step C7).

After adding "2" to the provisional score in step C6 or adding "1" to the provisional score in step C7, the outsource management means 111 determines whether or not the plug-in is a spatial effect. (step C8). Even when the outsource management means 111 determines that the plug-in type is not VSTi in step C4, it proceeds to step C8 and determines whether the plug-in is a spatial effect. At step C8, the outsource management means 111 refers to, for example, the variable isSpatialEffect of the plug-in object P to determine whether or not the plug-in is a spatial effect. When the outsource management means 111 determines in step C8 that the plug-in is a spatial effect, it adds "1" to the provisional score (step C9).

The outsource management means 111 substitutes the temporary score value for the variable score of the plug-in object P selected in step C1 (step C10). After that, the outsource management means 111 determines whether or not there is an unselected plug-in object in the plug-in list (step C11). If the outsource management means 111 determines in step C2 that the plug-in is not valid, it proceeds to step C11 and determines whether or not there is an unselected plug-in object.

At step C11, the outsource management means 111 determines, for example, among the plug-in objects P included in the plug-in list, whether there remains a plug-in object corresponding to the plug-in added at step B2 in FIG. . If the outsource management means 111 determines in step C11 that there is an unselected plug-in object, it returns to step C1 and selects one of the unselected plug-in objects. If it is determined in step C11 that there is no unselected plug-in object, the plug-in score calculation process ends.

FIG. 8 shows the track score calculation procedure. The outsource management means 111 selects one track (track object) from the track list (step D1). The outsource management means 111 initializes the provisional score to "1" (step D2). The outsource management means 111 determines whether or not the track type is MIDI (step D3). At step D3, the outsource management means 111 refers to the variable isMIDI of the track object T, for example, and determines whether or not the track type is MIDI.

When the outsource management means 111 determines that the track type is MIDI in step D3, it determines whether or not the track uses a physical synthesizer (step D4). At step D4, the outsource management means 111 refers to the variable hasMIDIOut of the track object T, for example, and determines whether or not the track uses a physical synthesizer. When the outsource management means 111 determines in step D4 that the track uses a physical synthesizer, the outsource management means 111 excludes the track from outsourcing (step D5).

If the outsource management means 111 determines in step D3 that the track type is not MIDI, it determines whether or not the playback time of the track exceeds a predetermined ratio, for example, 70% of the playback time of the entire music piece. (step D6). At step D6, the outsource management means 111 determines whether the value of the variable length of the track object T, for example, exceeds 70% of the reproduction time of the entire piece of music. When the outsource management means 111 determines in step D6 that the playback time exceeds 70% of the total, it adds "1" to the provisional score (step D7).

The outsource management means 111 adds the plug-in score (variable score of the plug-in object P) calculated for each plug-in associated with the track selected in step D1 to the temporary score (step D8). In step D8, for example, when two plug-ins P1 and P2 are associated with the selected track, the outsource management means 111 converts the score of the plug-in object P1 and the score of the plug-in object P2 into temporary scores. add to If the outsource management means 111 determines in step D4 that the physical synthesizer is not used, and if it determines in step D6 that the playback time does not exceed 70%, the process proceeds to step D8, and the plug-in score is added to the temporary score. to add.

The outsource management means 111 substitutes the temporary score value for the variable score of the track object T selected in step D1 (step D9). After that, the outsource management means 111 determines whether or not there is an unselected track object in the track list (step D10). At step D10, the outsource management means 111 determines, for example, whether a track object corresponding to the track added at step B1 in FIG. 6 remains in the track list.

If the outsource management means 111 determines in step D10 that there are unselected track objects, it returns to step D1 and selects one of the unselected track objects. If it is determined in step D10 that there is no unselected plug-in object, the track score calculation process ends.

Returning to FIG. 6, the user adjusts the plug-in parameters (step B5). The user presses the play button on the DAW application 113 of the work terminal 101 to instruct the DAW application 113 to start playing (step B6). The DAW application 113 reproduces each track developed on the DAW (step B7). At this time, it is assumed that the DAW application 113 reproduces all the developed tracks on the work terminal 101 . When the user presses the stop button (step B8), the DAW application 113 terminates reproduction.

When the reproduction ends, the outsource management means 111 records the total track score calculated in step B4 as log information logScore (step B9). The total value of track scores recorded in step B9 is recorded as the total value of track scores in the case where reproduction processing could be performed without occurrence of reproduction defects such as sound skipping on the work terminal 101 . The outsource management means 111 may record the total value of track scores as log information at an arbitrary timing after the start of reproduction. The outsource management means 111, for example, recalculates the track score and the plug-in score each time a track or plug-in is added, and records the track score as log information.

The outsource management means 111 calculates a track score of "2" by adding a provisional score of "1" to the total plug-in score of "1" for the three plug-ins applied to track T1, for example. do. The outsource management unit 111 calculates a track score of "3" by adding a provisional score of "1" to the sum of the plug-in scores of the four applied plug-ins of "2" for the track T2. The outsource management unit 111 calculates a track score of "1" by adding a provisional score of "1" to the total plug-in score of "0" for the three applied plug-ins for the track T3. The outsource management unit 111 calculates a track score of "3" by adding a provisional score of "2" to the total plug-in score of "1" for the two applied plug-ins for the track T4.

The outsource management unit 111 calculates a track score of "3" by adding a provisional score of "1" to the sum of the plug-in scores of the two applied plug-ins of "2" for the track T5. The outsource management unit 111 calculates a track score of "4" by adding a provisional score of "1" to the total plug-in score of "3" of the two applied plug-ins for the track T6. The outsource management unit 111 calculates a track score of "1" by adding a provisional score of "1" to the total plug-in score of "0" for the three plug-ins applied to the track T7. The outsource management unit 111 calculates a track score of "3" by adding a provisional score of "1" to the total plug-in score of "2" for the three applied plug-ins for the track T8.

FIG. 9 shows an operation procedure when a reproduction defect or the like occurs. The user uses, for example, the DAW application 113 of the work terminal 101 to record on the recording track while reproducing the existing track. At this time, it is assumed that the DAW application 113 is reproducing all existing tracks. When a playback defect such as sound skipping occurs during recording, the user presses a predetermined button (COMPLAIN button) (step E1). When the COMPLAIN button is pressed, the outsource management means 111 of the work terminal 101 determines the tracks whose playback is to be outsourced to the external terminal 107 (step E2).

FIG. 10 shows an operation procedure for determining tracks to be outsourced. The outsource management means 111 refers to the log information and sets a local score localScore used as a reference score (threshold value) (step F1). In step F1, the outsource management means 111 sets, as a local score, the total value of the track scores recorded as log information, which is one before the latest one. This local score indicates the total value of the track scores that can be played back on the work terminal 101 without causing playback failure.

The outsource management means 111 sorts the tracks included in the track list in ascending order of score (step F2). The outsource management means 111 initializes the evaluation score estScore to 0 (step F3). Outsource management means 111 selects one track (track object) from the track list sorted in ascending order of score (step F4). The outsource management means 111 selects the track object with the lowest score in the initial selection. The outsource management means 111 adds the track score of the selected track to the evaluation score (step F5). In step F5, the outsource management means 111 adds the value of the variable score of the selected track object to the evaluation score estScore, for example.

The outsource management means 111 compares the evaluation score with the local score set in step F1, and determines whether the evaluation score is greater than or equal to the local score (step F6). When the outsource management means 111 determines in step F6 that the score for evaluation is equal to or higher than the local score, it determines whether or not the selected track uses an external MIDI device (step F7). When the outsource management means 111 determines in step F7 that the selected track does not use an external MIDI device, it determines the selected track as an outsource target track (step F8).

If the outsource management means 111 determines in step F6 that the score for evaluation is not equal to or greater than the local score, and if it determines in step F7 that an external MIDI device is used, the outsource management means 111 determines that the selected track is outsourced in step F4. do not do. The outsource management means 111 determines whether or not there is an unselected track in the track list (step F9). If the outsource management means 111 determines in step F9 that there is an unselected track, it returns to step F4 and selects the track with the next highest score. By repeating steps F4 to F9 until there are no more unselected tracks, it is determined whether or not to outsource the tracks in descending order of the score.

For example, let us consider a case where the DAW application 113 has played back seven tracks in which the track T2 does not exist among the eight tracks described above. In this case, the track score total value “17” is recorded in the track score log information logScore.

The user presses the COMPLAIN button when he/she feels that the playback is defective after adding the track T2. The total track score at this time is 20. In step F1, the outsource management means 111 sets the previous track score total value "17" as the local score. At step F2, the outsource management means 111 sorts the track objects T1 to T8 in ascending order of score. As a result of sorting, the order of the tracks in the track list is track T3 (score "1"), track T7 (score "1"), track T1 (score "2"), track T2 (score "3"), track T4. (score of "3"), track T5 (score of "3"), track T8 (score of "3"), and track T6 (score of "4").

The outsource management means 111 sequentially adds the scores of the track objects included in the track list to the evaluation score, and in step F6 determines whether the evaluation score is equal to or greater than the local score. In other words, when the track scores sorted in ascending order are sequentially added, the outsource management means 111 determines which tracks are selected so that the sum total of the track scores is greater than or equal to the local score. to judge. In the above case, if the track T6 with the highest score is selected, the score for evaluation becomes equal to or greater than the local score "17", and in step F8 the track T6 is determined as the outsource target track.

In addition, when the outsource target track is determined again after the outsource target track is determined once, the outsource management means 111 sets the local score at the time of determining the outsource target track for the first time in step F1 as the local score. may decide. Even in that case, if the COMPLAIN button is pressed immediately after determining the outsource target track, the outsource management means 111, in step F1, converts the total value of the previously recorded track scores to the local score. may be set as

For example, when the DAW application 113 reproduces seven tracks without the track T2, and the reverb plug-in is not applied to the track T6 in the previous reproduction. think. In that case, the track score total value "17" is recorded as the log information logScore of the track score immediately before, and the total track score value "16" is recorded as the log information of the track score two times before. .

Assume that the user presses the COMPLAIN button immediately after starting recording when recording is being performed on the work terminal 101 while the reproduction of the track T6 is outsourced to the external terminal 107 . In that case, the outsource management means 111 may refer to log information two logs before and set the local score to "16" in step F1. In this case, when the track T8 is selected among the tracks sorted in ascending order of score, the evaluation score becomes equal to or higher than the local score "16". In this case, the outsource management means 111 determines two tracks, track T6 and track T8, as outsource target tracks in step F8.

Returning to FIG. 9, when the outsource target track is determined, the outsource management means 111 of the work terminal 101 transfers the data of the outsource target track and the plug-in data applied to the outsource target track to the external terminal. 107 (step E3). The outsource instruction receiving means 171 of the external terminal 107 receives the data of the outsource target track and the plug-in data applied to the outsource target track from the work terminal 101 .

The outsource instruction receiving means 171 develops the outsource target track and the plug-in applied to the outsource target track on the DAW application 173 (step E4). After developing the track, the outsource instruction receiving means 171 notifies the work terminal 101 that preparations for starting recording have been completed (step E5). The work terminal 101 uses a display device (not shown) or the like to notify the user that recording can be started (step E6).

The user presses the record button (step E7). When the recording button is pressed, the outsource management means 111 of the work terminal 101 transmits a stream data transmission start request to the external terminal 107 (step E8). When the outsource instruction receiving means 171 receives the request, the DAW application 173 of the external terminal 107 starts playing back the track according to the playback start position described in the request. At this time, if the outsource target track includes a plurality of tracks, the DAW application 173 applies the plug-in to each of the plurality of tracks and synthesizes the plug-in application results of the plurality of tracks. The sound source streaming transmitting means 172 starts transmitting the stream data of the track reproduced by the DAW application 173 (step E9).

The sound source streaming receiving means 112 receives the stream data and passes the received stream data through to the stream track (see FIG. 4) of the DAW application 113 . The DAW application 113 synchronizes the playback start timing of the stream track with the playback start timing of other tracks, and starts playback of the existing track (playback of monitor sound) (step E10). Also, the DAW application 113 starts recording the recording track (step E11).

The user plays the musical instrument while listening to the monitor sound, and transmits performance data to the work terminal 101 (step E12). The DAW application 113 acquires through the audio IF 102 a music signal output from the audio input device 105 (see FIG. 2) used by the user for performance. The DAW application 113 synthesizes the music signal data of the recording track with the existing track and reproduces it (step E13). While recording continues, transmission of stream data from the external terminal 107 to the work terminal 101 and reproduction of monitor sound on the work terminal 101 are performed.

After finishing the performance, the user presses the recording stop button (step E14). When the recording stop button is pressed, the DAW application 113 stops recording the performance data and saves the recording file (step E15). Further, when the recording button is stopped, the outsource management means 111 requests the external terminal 107 to stop the stream transmission (step E16). When the DAW application 173 of the external terminal 107 is requested to stop the stream transmission, the playback of the track is temporarily stopped, and the sound source streaming transmission means 172 stops the transmission of the stream data (step E17).

The user repeatedly performs recording operations and adds tracks and plug-ins in the music playback system 100 . The user presses the COMPLAIN button when a problem such as playback failure occurs. When the COMPLAIN button is pressed, the outsource management unit 111 of the work terminal 101 determines the outsource target tracks again.

In this embodiment, the outsource management unit 111 of the work terminal 101 selects a track to be outsourced to the external terminal 107 for reproduction based on information on a plurality of tracks to be reproduced and information on plug-ins applied to the tracks. decide. For example, by outsourcing to the external terminal 107 the reproduction of a track that exceeds the CPU capacity of the work terminal 101, it is possible to realize a reproduction environment that does not cause discomfort when playing a musical instrument. Also, even if the processing capability of the work terminal 101 is low, it is possible to prevent defective reproduction during recording without being affected by the capacity of the DAW project. In this embodiment, the outsourced tracks are determined based on the track information and the plug-in information, so that the resources of the external terminal 107 can be efficiently used.

Here, since an external hardware sound source was originally used as a sound source during MIDI playback, there was not much of a problem even if the terminal itself operating the DAW had a low specification. However, with the passage of time, the quality of software tone generators has improved, MIDI tone generators have come to be handled as all-in-one software DAW environments, and the required specifications for operating terminals have improved. For example, software tone generators with large-capacity effects, such as VSTi, and DAWs are becoming more sophisticated year by year, and the recommended operating environment standards for terminals that operate DAWs are becoming higher. In an old-generation general-use PC that cannot meet the requirements, when the CPU load becomes high, playback defects such as sound skipping may occur.

On the other hand, in recent years, mobile terminals equipped with relatively high-performance processors, such as smartphones and tablet terminals, have become widespread, and some DAW applications for mobile terminals have become available. However, DAW applications for mobile terminals are for easy music production rather than for professional use, and compared to products for desktop environments, their usage is narrower and they lack integration. In this embodiment, when a mobile terminal is used as the work terminal 101, even with a mobile terminal that lacks specs to operate a DAW product for a multifunctional desktop environment, a music production environment that covers device independence and integration. is feasible.

Next, a second embodiment of the present disclosure will be described. The configuration of the music playback system according to this embodiment may be the same as the configuration of the music playback system according to the first embodiment shown in FIG. Also, the configurations of the work terminal 101 and the external terminal 107 in this embodiment may be the same as the configurations of the work terminal 101 and the external terminal 107 used in the first embodiment shown in FIG. The present embodiment differs from the first embodiment in that the outsource management means 111 determines outsource target tracks using the CPU usage rate as an index indicating the processing load during playback of each track. Other points may be the same as in the first embodiment.

In this embodiment, the outsource management means 111 measures the CPU usage rate (processor usage rate) for each track as an index indicating the processing load when the DAW application 113 reproduces each track. The outsource management means 111 measures the average CPU usage rate from the start of playback of the track until the end of playback, for example. The outsource management means 111 determines outsource target tracks based on the measured CPU usage rate. The outsource management means 111 selects a reference usage rate based on, for example, the measured CPU usage rate, and calculates an evaluation value for each track using the CPU usage rate of each track and the reference usage rate. The outsource management means 111 determines outsource target tracks based on the calculated evaluation values.

FIG. 11 shows the operation procedure of evaluation value calculation for each track. The outsource management means 111 selects one track from the track list (step G1). The DAW application 113 reproduces the track selected in step G1, and the outsource management means 111 measures the average CPU usage during track reproduction as a background process (step G2). In step G2, the DAW application 113 applies the plug-in to play back the track if there is a plug-in applied to the selected track.

The outsource management means 111 determines whether or not there is an unselected track (step G3). At step G4, the outsource management means 111 selects, among the tracks included in the track list, the tracks added at step B1 in FIG. 6 and the tracks to which the plug-ins added at step B2 are applied. determine if there is If the outsource management means 111 determines in step G3 that there are unselected tracks, it returns to step G1 and selects one of the unselected tracks. The outsource management means 111 repeats steps G1 to G3 until there are no more unselected tracks, thereby measuring the CPU usage rate during playback of each track.

When the outsource management means 111 determines that there is no unselected track in step G3, it selects a reference CPU usage rate (step G4). In step G4, the outsource management means 111 selects, for example, the lowest CPU usage rate among the measured CPU usage rates as the reference CPU usage rate baseR. The outsource management means 111 uses the reference CPU usage rate selected in step G4 to calculate the evaluation value of each track (step G5). In step G5, the outsource management means 111 calculates, for example, a value obtained by subtracting the reference CPU usage rate baseR from the CPU usage rate of each track as the evaluation value of each track.

The outsource management means 111 measures the average value of the CPU usage rate when the eight tracks T1 to T8 described above are individually reproduced by the DAW application 113, for example. For example, assume that the measured result of the average CPU usage rate while the track T1 is being reproduced is 58%. In addition, the average CPU usage rate during playback of track T2 is 50%, the average CPU usage rate during playback of track T3 is 52%, and the average CPU usage rate during playback of track T4 is 52%. is 48%. Further, the measured average CPU usage rate during playback of track T5 is 58%, the average CPU usage rate during playback of track T6 is 62%, and the average CPU usage rate during playback of track T7 is 58%. is 42%. Assume that the measured result of the average CPU utilization during playback of track T8 is 56%.

In the above case, the outsource management means 111 selects the average CPU usage rate of 42% of the track T7 with the lowest average CPU usage rate as the reference usage rate baseR in step G4. In step G5, the outsource management means 111 calculates the difference between the average CPU usage rate of each track and the reference usage rate baseR (42%) as the evaluation value Tr of each track.

FIG. 12 shows an operation procedure for determining tracks to be outsourced. The outsource management means 111 sets a threshold of CPU utilization (step H1). In step H1, the outsource management means 111 sets, for example, 100%-base CPU usage rate baseR as the threshold localR of the CPU usage rate. The outsource management means 111 initializes the total evaluation value to 0 (step H2).

The outsource management means 111 sorts the tracks included in the track list in ascending order of evaluation value (step H3). Outsource management means 111 selects one of the tracks from the track list sorted in ascending order of evaluation value (step H4). The outsource management means 111 selects the track with the lowest evaluation value in the initial selection. The outsource management means 111 adds the evaluation value Tr of the selected track to the total evaluation value estR (step H5).

The outsource management means 111 compares the evaluation total value estR with the threshold value localR set in step H1, and determines whether the evaluation total value estR is equal to or greater than the threshold value localR (step H6). When the outsource management means 111 determines in step H6 that the total evaluation value is equal to or greater than the threshold value, it determines whether or not the selected track uses an external MIDI device (step H7). When the outsource management means 111 determines that the track selected in step H7 does not use an external MIDI device, it determines the track as an outsource target track (step H8).

If the outsource management means 111 determines in step H6 that the total evaluation value is not equal to or greater than the threshold value, and if it determines in step H7 that an external MIDI device is used, the outsource management means 111 outsources the selected track in step H4. and not. The outsource management means 111 determines whether or not there is an unselected track in the track list (step H9). If the outsource management means 111 determines in step H9 that there is an unselected track, it returns to step H4 and selects the track with the next highest evaluation value. By repeating steps H4 to H9 until there are no more unselected tracks, it is determined whether or not to outsource the tracks in order from the track with the lowest evaluation value.

The user presses the COMPLAIN button when he/she feels that the playback of the eight tracks T1 to T8 is defective. Of the eight tracks, track T7 has the lowest average CPU usage, with an average CPU usage of 42%. In that case, the outsource management means 111 sets "58" as the value of the threshold value localR in step H1. At step H3, the outsource management means 111 sorts the tracks T1 to T8 in ascending order of evaluation value. As a result of sorting, the order of the tracks in the track list is track T7 (evaluation value "0"), track T4 (evaluation value "4"), track T2 (evaluation value "8"), track T3 (evaluation value "10"). ), track T8 (evaluation value “14”), track T1 (evaluation value “16”), track T5 (evaluation value “16”), and track T6 (evaluation value “20”).

The outsource management means 111 sequentially adds the evaluation values of the tracks included in the track list to the total evaluation value, and in step H6 determines whether the total evaluation value is equal to or greater than the threshold value "58". to decide. In other words, when the outsource management means 111 sequentially adds the evaluation values of the tracks sorted in ascending order, the sum of the evaluation values reaches the threshold It is determined whether the number is "58" or more. In the above case, the total evaluation value exceeds the threshold "58" when the evaluation value of track T5 is added. Therefore, in step H8, tracks T5 and T6 are determined as outsourced tracks.

In this embodiment, the outsource management means 111 determines the outsource target track based on the CPU usage rate when each track is reproduced. Also in this case, by outsourcing the reproduction of tracks exceeding the CPU capacity of the work terminal 101 to the external terminal 107, a comfortable reproduction environment can be realized when playing a musical instrument. Also in the present embodiment, outsourced tracks are determined based on the CPU usage rate during playback of each track, so that the resources of the external terminal 107 can be efficiently used.

Note that in each of the above embodiments, the program can be stored and supplied to the computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media such as flexible disks, magnetic tapes, or hard disks, magneto-optical recording media such as magneto-optical discs, compact discs (CDs), or digital versatile disks (DVDs). and semiconductor memory such as mask ROM (read only memory), PROM (programmable ROM), EPROM (erasable PROM), flash ROM, or RAM (random access memory). The program may also be delivered to the computer using various types of transitory computer readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable media can deliver the program to the computer via wired channels, such as wires and optical fibers, or wireless channels.

Although the embodiments of the present disclosure have been described in detail above, the present disclosure is not limited to the above-described embodiments, and changes and modifications can be made to the above-described embodiments without departing from the scope of the present disclosure. are also included in the present disclosure.

For example, some or all of the above-described embodiments may be described in the following supplementary remarks, but are not limited to the following.

[Appendix 1]
Outsource management means for determining which track among the plurality of tracks is to be outsourced to an external terminal based on an index indicating the processing load when the plurality of tracks to be played is played. When,
track reproducing means for reproducing a track other than the track determined as the outsource target track among the plurality of tracks;
a sound source receiving means for receiving a reproduced music stream of the outsource target track from the external terminal;
A terminal device comprising synthesis output means for synthesizing and outputting a track reproduced by said track reproduction means and said reproduced music stream.

[Appendix 2]
further comprising recording means for recording music played by the user on a recording track;
The terminal device according to appendix 1, wherein the outsource management means determines the outsource target track from among the plurality of tracks excluding the recording track.

[Appendix 3]
The terminal device according to appendix 2, wherein the track reproduced by the track reproducing means includes the recorded track.

[Appendix 4]
4. The outsource management means according to any one of Appendices 1 to 3, wherein, among the plurality of tracks, a track using an external MIDI (Musical Instruments Digital Interface) device is excluded from tracks to be outsourced to the external terminal. Terminal equipment.

[Appendix 5]
5. The terminal according to any one of appendices 1 to 4, wherein, when a plug-in to be applied to the track is specified, the track reproducing means applies processing of the plug-in to the track to reproduce the track. Device.

[Appendix 6]
The outsource management means calculates a track score as an index indicating the processing load for each track based on track information about each of the plurality of tracks and plug-in information about the plug-in; 6. The terminal device according to appendix 5, wherein the outsource target track is determined based on the score.

[Appendix 7]
The outsource management means calculates a plug-in score indicating the processing load of each plug-in for each plug-in, and adds a provisional score calculated based on the playback time of the track to the plug-in score applied to the track. 7. The terminal device according to appendix 6, wherein a score obtained by adding a plug-in score is calculated as the track score.

[Appendix 8]
The value of the track score increases as the processing load increases,
The outsource management means sequentially selects tracks in descending order of the track score, accumulates the track scores, and determines a track with the accumulated track score equal to or higher than a reference score as the outsource target track. The terminal device according to appendix 6 or 7.

[Appendix 9]
Supplementary Note 8: The outsource management means calculates the track score when the track reproduction means performs reproduction, records the calculated track score as log information, and refers to the log information to set the reference score. The terminal device described in .

[Appendix 10]
the index indicating the processing load is a processor usage rate when the track reproducing means reproduces each track;
6. The terminal device according to any one of Appendices 1 to 5, wherein the outsource management means determines the outsource target track based on the processor usage rate.

[Appendix 11]
11. The terminal device according to appendix 10, wherein the outsource management means measures a processor usage rate when the track reproduction means reproduces each track.

[Appendix 12]
The outsource management means sets a reference processor usage rate based on the measured processor usage rate, and calculates an evaluation value for each track based on the measurement result of the processor usage rate for each track and the reference processor usage rate. 12. The terminal device according to appendix 11, wherein the outsource target track is determined based on the calculated evaluation value.

[Appendix 13]
The outsource management means sets the minimum processor usage rate among the measured processor usage rates as the reference processor usage rate, and compares the measured processor usage rate of each track with the reference processor usage rate. 13. The terminal device according to appendix 12, wherein the difference is calculated as the evaluation value.

[Appendix 14]
The outsource management means selects tracks in order from the track with the smallest evaluation value, accumulates the evaluation values, and selects a track whose accumulated evaluation value is equal to or greater than a threshold value as the outsource target track. 14. The terminal device according to appendix 12 or 13 for determining.

[Appendix 15]
14. The terminal device according to any one of appendices 1 to 14, wherein the outsource management means determines the outsource target track when a user presses a predetermined button.

[Appendix 16]
When the outsource management means determines the outsource target track, the outsource management means notifies the external terminal of information identifying the outsource target track and information identifying the plug-in applied to the outsource target track. 15. The terminal device according to any one of 1 to 15.

[Appendix 17]
a work terminal;
An external terminal capable of communicating with the work terminal,
The work terminal is
determining which track among the plurality of tracks is to be outsourced to the external terminal based on an index indicating the processing load when the plurality of tracks to be played is played; outsource management means for transmitting an instruction to reproduce a source target track to the external terminal;
track reproducing means for reproducing a track other than the track determined as the outsource target track among the plurality of tracks;
a sound source receiving means for receiving a reproduced music stream of the outsource target track from the external terminal;
synthesis output means for synthesizing and outputting the track reproduced by the track reproduction means and the reproduced music stream,
The external terminal is
an outsource instruction receiving means for receiving an instruction to reproduce the outsourced track;
a track reproducing means for reproducing the outsourced track;
and a sound source transmitting means for transmitting the music reproduced by the track reproducing means to the work terminal as the reproduced music stream.

[Appendix 18]
The work terminal further comprises recording means for recording music played by the user on a recording track,
18. The music reproducing system according to appendix 17, wherein the outsource management means determines the outsource target track from among the plurality of tracks excluding the recording track.

[Appendix 19]
determining which track among the plurality of tracks is to be outsourced to an external terminal based on an index indicating the processing load when the plurality of tracks to be played is played;
playing back a track other than the track determined as the outsource target track among the plurality of tracks;
receiving a reproduced music stream of the track to be outsourced from the external terminal;
A music reproducing method for synthesizing and outputting the reproduced track and the reproduced music stream.

[Appendix 20]
Furthermore, the music played by the user is recorded on the recording track,
20. The music reproducing method according to appendix 19, wherein, in determining the outsource target track, the outsource target track is determined from among the plurality of tracks excluding the recording track.

[Appendix 21]
to the computer,
determining which track among the plurality of tracks is to be outsourced to an external terminal based on an index indicating the processing load when the plurality of tracks to be played is played;
playing back a track other than the track determined as the outsource target track among the plurality of tracks;
receiving a reproduced music stream of the track to be outsourced from the external terminal;
A program for executing a process of synthesizing and outputting the reproduced track and the reproduced music stream.

[Appendix 22]
further causing the computer to perform processing for recording music played by the user on a recording track;
22. The program according to attachment 21, wherein, in determining the outsource target track, the outsource target track is determined from among the plurality of tracks excluding the recording track.

10: Music Reproduction System 20: Work Terminal 21: Outsource Management Means 22: Track Reproduction Means 23: Sound Source Reception Means 24: Composite Output Means 30: External Terminal 31: Outsource Instruction Reception Means 32: Track Reproduction Means 33: Sound Source Transmission Means 100: Music Playback System 101: Work Terminal 102: Audio Interface 103: Voice Output Device 104: Musical Score Data Input Device 105: Voice Input Device 106: Network 107: External Terminal 111: Outsource Management Means 112: Sound Source Streaming Reception Means 113 : DAW application 114: OS
115: Audio driver 121: ADC
122: DACs
171: Outsource instruction receiving means 172: Sound source streaming transmitting means 173: DAW application 174: OS

Claims (10)

Based on an index indicating the processing load of each track when each of the plurality of tracks to be played is played, outsourced tracks whose playback is to be outsourced to an external terminal are determined among the plurality of tracks. outsourced control means;
track reproducing means for reproducing a track other than the track determined as the outsource target track among the plurality of tracks;
a sound source receiving means for receiving a reproduced music stream of the outsource target track from the external terminal;
A terminal device comprising synthesis output means for synthesizing and outputting a track reproduced by said track reproduction means and said reproduced music stream. further comprising recording means for recording music played by the user on a recording track;
2. The terminal device according to claim 1, wherein said outsource management means determines said outsource target track from among said plurality of tracks excluding said recording track. 3. The terminal device according to claim 1, wherein said outsource management means excludes, among said plurality of tracks, tracks that use an external MIDI (Musical Instruments Digital Interface) device from tracks to be outsourced to said external terminal. if a plug-in to be applied to the track is specified, the track playback means applies processing of the plug-in to the track to play back the track;
The outsource management means calculates a track score as an index indicating the processing load for each track based on track information about each of the plurality of tracks and plug-in information about the plug-in; 4. The terminal device according to any one of claims 1 to 3, wherein the outsource target track is determined based on the score. The value of the track score increases as the processing load increases,
The outsource management means sequentially selects tracks in descending order of the track score, accumulates the track scores, and determines a track with the accumulated track score equal to or higher than a reference score as the outsource target track. The terminal device according to claim 4. the index indicating the processing load is a processor usage rate when the track reproducing means reproduces each track;
4. Any one of claims 1 to 3, wherein said outsource management means measures a processor utilization rate when said track reproduction means reproduces each track, and determines said outsource target track based on said measured processor utilization rate. The terminal device according to item 1. The outsource management means sets a reference processor usage rate based on the measured processor usage rate, and calculates an evaluation value for each track based on the measurement result of the processor usage rate for each track and the reference processor usage rate. 6. Tracks are selected in ascending order of said evaluation value, said evaluation values are cumulatively added, and a track whose cumulatively added evaluation value is equal to or greater than a threshold value is determined as said outsource target track. The terminal device described in . a work terminal;
An external terminal capable of communicating with the work terminal,
The work terminal is
Based on an index indicating the processing load of each track when each of the plurality of tracks to be played is played, outsourced tracks whose playback is to be outsourced to the external terminal are determined among the plurality of tracks. and outsource management means for transmitting an instruction to reproduce the outsourced track to the external terminal;
track reproducing means for reproducing a track other than the track determined as the outsource target track among the plurality of tracks;
a sound source receiving means for receiving a reproduced music stream of the outsource target track from the external terminal;
synthesis output means for synthesizing and outputting the track reproduced by the track reproduction means and the reproduced music stream,
The external terminal is
outsource instruction receiving means for receiving an instruction to reproduce the outsource target track;
a track reproducing means for reproducing a track to be outsourced;
A music reproduction system comprising a sound source transmitting means for transmitting the music reproduced by the track reproducing means to the work terminal as the reproduced music stream. An outsource target track for outsourcing the reproduction of one of the plurality of tracks to an external terminal based on an index indicating the processing load of each track when the terminal device reproduces each of the plurality of tracks to be reproduced. determine the
The terminal device reproduces a track other than the track determined as the outsource target track among the plurality of tracks,
a terminal device receiving a reproduced music stream of the outsourced track from the external terminal;
A music reproduction method in which a terminal device synthesizes and outputs the reproduced track and the reproduced music stream. to the computer,
Based on an index indicating the processing load of each track when each of the plurality of tracks to be played is played, a track to be outsourced from among the plurality of tracks whose playback is to be outsourced to an external terminal is determined. ,
playing back a track other than the track determined as the outsource target track among the plurality of tracks;
receiving a reproduced music stream of the track to be outsourced from the external terminal;
A program for executing a process of synthesizing and outputting the reproduced track and the reproduced music stream.

Images