WO2016208000A1

WO2016208000A1 - Display control device, display control method, and display control program

Info

Publication number: WO2016208000A1
Application number: PCT/JP2015/068185
Authority: WO
Inventors: 四郎鈴木; 孝義熊倉; 利尚佐飛
Original assignee: ＰｉｏｎｅｅｒＤＪ株式会社
Priority date: 2015-06-24
Filing date: 2015-06-24
Publication date: 2016-12-29

Abstract

This display control device (7) is provided with a noise detection unit (71) that detects a noise component included in a musical piece, and a display control unit (72) that displays, on a display unit (5), the detection result of the noise detection unit (71) in association with musical piece time information.

Description

Display control apparatus, display control method, and display control program

The present invention relates to a display control device, a display control method, and a display control program.

Conventionally, a configuration is known in which a preceding tune being played is switched to a subsequent tune (see, for example, Patent Document 1).
In the configuration described in Patent Document 1, when the music player switches from the preceding music piece to the subsequent music piece by crossfade, the beat position X immediately before the position at which the preceding music piece starts to fade out is acquired and the subsequent music piece fades in. The beat position Y immediately after the position for completing is acquired. Then, the music player moves the tune of the song forward by starting the playback of the succeeding song ahead of time while playing the preceding song so that the beat position X and the beat position Y match. Even when you are playing, you can switch and play songs without disrupting the rhythm.

JP 2008-242287 A

By the way, the cross fade as described above is one method of mixing performed in the DJ performance. In this case, it is conceivable to use processing as described in Patent Document 1.
However, in the process as described in Patent Document 1, only the beat positions of the preceding tune and the succeeding tune are matched, and therefore, a dissonance may occur when both the preceding tune and the subsequent tune are being played. There is. For this reason, it is necessary for the DJ to listen to the music in advance, and to determine in advance a location with good mixing compatibility that does not generate dissonance, and this preparation is troublesome.

An object of the present invention is to provide a display control device, a display control method, and a display control program that can support good music mixing.

The invention described in claim 1 includes a stuttering detection unit that detects a stuttering component included in a song, and a display control unit that displays a detection result of the stuttering detection unit in association with time information of the song. It is the display control apparatus characterized by the above.

The invention according to claim 7 is a display control method in which the display control device displays information on the sound component of the music on the display unit, and the display control device detects the stuttering component included in the music. It is a display control method characterized by performing a detection step and a display control step of displaying the detection result of the stuttering detection step on the display unit in association with the time information of the music.

The invention described in claim 8 is a display control program that causes a display control apparatus to execute the display control method according to claim 7.

1 is a block diagram showing a schematic configuration of a music playback device according to an embodiment of the present invention. The figure which shows a compatibility degree setting table. It is a schematic diagram showing a display screen of a stuttering detection result, showing a state before a selection operation of a predetermined section of the preceding music is performed. It is a schematic diagram showing a display screen of a stuttering detection result, and shows a state after a selection operation of a predetermined section of the preceding music is performed. The flowchart which shows the music analysis process which a music reproduction apparatus implements. FIG. 5 is a flowchart showing music analysis processing, showing processing following FIG. 4. Explanatory drawing of the detection process of a harmonic structure component. Explanatory drawing of the detection process of the repetition component of the same pitch of a harmonic structure component. The flowchart which shows the music information display process which a music reproduction apparatus implements. It is a schematic diagram showing the display screen of the noise detection result which concerns on the modification of this invention, and shows the state before selection operation of the predetermined area of a preceding music is performed. The state after selection operation of the predetermined area of a preceding music is performed in the state shown to FIG. 9A. The state after selection operation of the predetermined area of a preceding music is performed in the state shown to FIG. 9A.

An embodiment of the present invention will be described with reference to the drawings.
[Configuration of music playback device]
First, based on FIG. 1, FIG. 2, FIG. 3A, and FIG. 3B, the structure of the music reproduction apparatus which concerns on one Embodiment of this invention is demonstrated.
As shown in FIG. 1, the music playback device 1 is a system for performing DJ performances such as mixing such as crossfading and scratch operation (operation in which the user shifts the playback direction of music back and forth to produce a special sound). It is.

Here, it is known that when cross-fading between stuttering and stuttering, incompatibility is unlikely to occur and cross-fade compatibility is good. In addition, it is known that when a musical sound and a musical sound are cross-faded, a dissonance is likely to occur, so that cross-fading is not compatible. Note that a musical tone is a sound that has a harmonic structure composed of a fundamental tone and a harmonic, and that can feel the pitch. A roaring sound is a sound other than a musical sound, that is, a sound that does not have a harmonic structure, and is a sound whose pitch is not felt. Examples of musical sounds include vocal, piano, guitar, and bass sounds. Examples of the roaring sound include drum, percussion, and scratch sounds.

The music playback device 1 supports good cross-fading of the music so that the above-mentioned dissonance does not occur or the dissonance does not stand out (the dissonance is generated so that the user does not feel discomfort). The music reproducing device 1 includes a first storage unit 2, a second storage unit 3, an operation unit 4, a display unit 5, a sound processing device 6, and a display control device 7.

The first storage unit 2 stores music data 21 and the like. The music data 21 may be stored in an external device or an external server that can communicate with the audio processing device 6 and the display control device 7.
The 2nd memory | storage part 3 memorize | stores various data used with display control apparatuses, such as a display control program and a compatibility degree setting table as shown in FIG.
The operation unit 4 includes a keyboard, a mouse, a touch panel, etc. (not shown).
The display unit 5 is configured by a liquid crystal display or the like.
The sound processing device 6 performs signal processing such as cross-fade processing on the music data 21 stored in the first storage unit 2 based on an operation of a jog dial or a pitch controller (not shown), and the processed sound signal is sounded. Output to the output unit 8.

The display control device 7 includes a stuttering detection unit 71, a display control unit 72, a first memory 73, and a second memory 74. The noise detection unit 71 and the display control unit 72 are configured by a CPU (Central Processing Unit) processing a display control program and data stored in the second storage unit 3.

The stuttering detection unit 71 detects a stuttering component and a musical tone component included in each of a plurality of music pieces. The stuttering detecting unit 71 includes a section dividing unit 711, a component detecting unit 712, a ratio calculating unit 713, and a section attribute determining unit 714.

The section dividing unit 711 acquires the music data 21 from the first storage unit 2 based on the operation of the operation unit 4. The section dividing unit 711 divides the music data 21 by a predetermined unit and takes in the section data. In the present embodiment, the configuration in which the music data 21 is divided in units of measures is exemplified. However, for example, the music data 21 may be divided in units of beats, or development of music may be analyzed in advance and divided in units of development.
The component detection unit 712 detects a stuttering component included in each section of the music based on the section data captured by the section division unit 711.
The ratio calculation unit 713 calculates the ratio at which the stuttering component is included in each section based on the detection result of the component detection unit 712, and stores the calculation result in the first memory 73.
The section attribute determination unit 714 determines whether each section is a stuttering section or a musical sound section based on the calculation result of the ratio calculation unit 713, and stores the determination result in the second memory 74.

The display control unit 72 causes the display unit 5 to display the detection result of the stuttering detection unit 71. The display control unit 72 includes a result display unit 721, a selection detection unit 722, and a display change unit 723.

The result display unit 721 displays the detection result of the stuttering detection unit 71 on the display unit 5 in association with the time information of the preceding music and the subsequent music. Specifically, as shown in FIG. 3A, the result display unit 721 causes the display unit 5 to display the preceding music information 50 related to the preceding music and the subsequent music information 55 related to the subsequent music.
The preceding music information 50 includes a waveform 501 of the preceding music and sound component information 502 of the preceding music. The sound component information 502 includes a plurality of section bars 503, and represents that the right section is reproduced after the section corresponding to the left section bar 503 in FIG. 3A. The result display unit 721 sets the color of the section bar 503 according to the detection result of the stuttering detection unit 71. The succeeding music information 55 has the same configuration as the preceding music information 50, and includes a waveform 551 and sound component information 552 composed of a plurality of section bars 553.

The selection detection unit 722 detects a selection operation at an arbitrary position in the time information of the preceding music by the operation unit 4. When the selection determination operation is performed in a state where the cursor CR is displayed on the predetermined section bar 503 of the preceding music information 50 as shown by a two-dot chain line in FIG. 3A, the selection detection unit 722 performs the section bar 503. It is detected that the section is selected.

The display changing unit 723 changes the display state of the detection result of the subsequent music according to the detection result of the stuttering component in the selected section. Based on the compatibility setting table stored in the second storage unit 3 and the data stored in the first memory 73 and the second memory 74, the display change unit 723 determines whether the selected section and each section of the succeeding song are Set the compatibility. As shown in FIG. 3B, the display change unit 723 displays the compatibility information 554 indicating the degree of compatibility above the section bar 553 corresponding to each section. The display change unit 723 displays stuttering ratio information 555 indicating the ratio of stuttering components below the section bar 553.
Note that the display positions of the compatibility information 554 and the stuttering ratio information 555 are not limited to the positions described above, and may be other positions as long as the information can be recognized as information corresponding to each section.

[Operation of music playback device]
Next, music analysis processing and music information display processing will be described as operations of the music playback device 1.

First, the music analysis process will be described with reference to FIGS.
As illustrated in FIG. 4, when the section dividing unit 711 of the display control device 7 detects a music analysis processing start operation for a predetermined music based on the operation of the operation unit 4 by the user, the music data 21 of the music is obtained. Obtained from the first storage unit 2 (step S1). Thereafter, the section division unit 711 sets the section number M to 1 (step S2), and takes in section data for the Mth one bar (step S3).

Next, the component detection unit 712 analyzes the section data and measures the power spectrum as shown in FIG. 6 (step S4). The power spectrum is a result of the component detector 712 obtaining the intensity of each frequency every predetermined time (for example, every 0.1 seconds) and averaging the obtained intensity for each frequency. The power spectrum measures the intensity of 4 octaves for each of the 12 floor names (Do, Ray, Les, Mi, Mi, Fa, So, So, La, La, Shi, Shi). It is the result. In addition, the power spectrum represents the sound of one floor name for each of a plurality of power spectrums arranged continuously in the horizontal axis direction. That is, among the plurality of power spectra corresponding to the sound of one floor name, the leftmost power spectrum represents the fundamental sound, for example, when the sound corresponding to one floor name is composed of four power spectra, The second, third, and fourth power spectrums from the left represent sounds (1, 2, 4, and 8th harmonics) that are 1, 2, and 4 octaves above the fundamental tone.

Thereafter, as shown in FIG. 4, the ratio calculation unit 713 adds up all the power spectra measured by the component detection unit 712 to calculate the total sound component amount (Psa) (step S <b> 5).
Then, the component detector 712 detects a harmonic structure component (Pgr), that is, a musical tone component from the power spectrum (step S6). Specifically, the component detection unit 712 has two or more power spectra out of four power spectrums constituting a sound of one floor name, that is, two or more octaves. If the sound component is composed of the sound, the sound component of the floor name is determined to be a harmonic structure component. On the other hand, the component detection unit 712 determines that the sound component of the floor name is not a harmonic structure component when the power spectrum equal to or higher than the musical sound authorization threshold Lm is 1 or 0. For example, in the case of a power spectrum as shown in FIG. 6, the component detection unit 712 has two power spectra of “do”, “mi”, and “fa” because the two power spectra are equal to or higher than the musical sound recognition threshold Lm. It is determined that the component is a harmonic structure component, and the other sound components are determined not to be a harmonic structure component.

Here, as described above, when musical sounds are cross-faded, a dissonance tends to be generated, so it is not preferable to present to the user that the cross-fade of this combination is good. However, it is a musical sound, but the rap (one of the singing methods, singing to rhythmically speaking without adding much melody and rhyme at the end of a measure) etc. Compared to musical tones that do not repeat the same pitch, dissonance is less likely to occur even when cross-fading with other musical tones. Therefore, in the present embodiment, a musical sound such as a lap in which the same pitch is repeated is regarded as a stuttering sound and presented to the user as a sound that is unlikely to generate a dissonance even if crossfade with other musical sounds. The processes of S7 and S8 are performed.

As shown in FIG. 4, the component detection unit 712 detects the same pitch repeat component (Pgrex) in the harmonic structure component detected in step S6 (step S7). Specifically, the component detection unit 712 has the same component as the harmonic structure component detected in step S6 continuously in a plurality of sections (for example, four or more sections) including the section in which the harmonic structure component is detected. If detected, it is determined that the harmonic structure component is a repetitive component. For example, as shown in FIG. 7, when a power spectrum of four consecutive sections (M-3, M-2, M-1, and Mth sections) is detected, “do”, “mi”, “ Since the harmonic structure component of “F” is included in all of the four sections, it is determined that the harmonic structure component is a repetitive component of the same pitch.
By the processing in step S7, a musical sound component that can be regarded as a stuttering component is detected.

Thereafter, as shown in FIG. 4, the ratio calculation unit 713 subtracts the repetitive component (Pgrex) having the same pitch from the harmonic structure component (Pgr). Then, the ratio calculation unit 713 adds up the power spectrums constituting the harmonic structure components after the subtraction, and calculates the musical sound component amount (Pss) (step S8). For example, when there are four harmonic structure components (16 spectrums) and three (12 spectra) are repetitive components, the ratio calculation unit 713 has one harmonic structure component (4 The power spectrum is summed up for the spectrum of the book.
By the processing in step S8, the tone component amount is calculated by removing the tone component that can be regarded as a stutter component from the power spectrum that is regarded as a tone component from the viewpoint of the component structure.

Next, as shown in FIG. 5, the ratio calculation unit 713 performs a calculation process of the stuttering component ratio (Rs) based on the following formula (1) (step S9), and the total amount of the sound component and the stuttering component ratio are calculated as the music In association with the section number M, it is stored in the first memory 73 (step S10).
Rs (%) = (1−tone component amount / total tone component amount) × 100 (1)
Thereafter, the section attribute determination unit 714 determines whether or not the stuttering component ratio is equal to or greater than a stuttering recognition threshold (for example, 51%) as a threshold (step S11). If the section attribute determination unit 714 determines that the condition of step S11 is satisfied, the section attribute determination unit 714 identifies the Mth section as a stuttering section, and stores the stuttering section flag in association with the music piece and the section number M in the second memory 74. (Step S12). On the other hand, if the section attribute determination unit 714 determines that the condition of step S11 is not satisfied, the section attribute determination unit 714 associates the musical sound section flag indicating the musical sound section with the music and the section number M and stores them in the second memory 74 (step S13). .

After the section attribute determination unit 714 performs step S12 or step S13, the section division unit 711 adds 1 to the section number M (step S14). Then, the section attribute determination unit 714 determines whether or not the analysis of the last section of the music has ended (step S15). If the section attribute determination unit 714 has not ended, the process of step S3 is performed. The music analysis process ends.

As described above, when the same harmonic structure component is detected continuously in four sections by the processing in steps S7 to S9, the harmonic structure component in the latest section is regarded as a sound component, and the ratio of the sound component is calculated. To do. However, although the harmonic structure components in the three sections before the latest section can be regarded as a stuttering component, the same harmonic structure components are continued in four sections in the processing for each of the three sections. In some cases, the ratio of the stuttering component is calculated without being regarded as a stuttering component. In this case, the harmonic structure component in the three sections is regarded as a stuttering component, the stuttering component ratio is recalculated, the data in the first memory 73 is updated, and the second calculation is performed based on the recalculation result of the stuttering component ratio. Each section flag in the memory 74 may be updated.

Next, the music information display process will be described with reference to FIGS. 3A, 3B, and 8. FIG.
The music information display process is performed after the music analysis process for a plurality of music.
First, the user operates the operation unit 4 to select a preceding tune and a subsequent tune to be crossfade. As shown in FIG. 8, when the result display unit 721 of the display control device 7 detects the selection operation of the preceding song and the succeeding song (steps S21 and S22), the song data 21 of the preceding song and the succeeding song is stored in the first storage unit. 2 (step S23).
In the present embodiment, a case will be described in which one preceding song and one following song are selected, but the same processing is performed when two or more songs are selected.

In addition, the result display unit 721 displays the total sound component amount, the stutter component ratio, and each section flag (stuttering section flag or musical section section flag) of each section of the preceding music and the following music, in the first memory 73 and the second memory 74. (Step S24). Thereafter, the result display unit 721 displays the preceding song information 50 and the subsequent song information 55 on the display unit 5 (step S25). At this time, the result display unit 721 may display the preceding song information 50 and the subsequent song information 55 of all the sections of the music at once, or may display a part of the sections, and the rest based on the operation of the operation unit 4. You may make it update to the display of this area.

The result display unit 721 displays the

waveforms

501 and 551 based on the music data. In addition, the result display unit 721 displays the

sound component information

502 and 552 based on the total amount of sound components and each section flag. Specifically, the result display unit 721 sets the color of the section bar 503 of each section constituting the preceding music based on Table 1 below, and the sound component information in which the section bar 503 is arranged in the reproduction order of each section. 502 is displayed below the waveform 501. The result display unit 721 also sets the color of the section bar 553 for the succeeding music and displays the sound component information 552 below the waveform 551.
The user can recognize both the attribute of each section (whether it is a stuttering section) and the sound intensity of the entire section by looking at the section bars 503 and 553 in which colors are set based on Table 1. .

When the preceding music information 50 and the succeeding music information 55 as shown in FIG. 3A are displayed on the display unit 5 by the above processing, the user moves the cursor CR by the operation of the operation unit 4 and determines the predetermined music of the preceding music. Select the section as a crossfade candidate section.
When the selection detection unit 722 detects a selection operation for a predetermined section of the preceding tune (step S26), the display change unit 723 determines whether the selected section and each section of the subsequent tune are based on the compatibility setting table shown in FIG. A degree of compatibility is set (step S27). At this time, the display changing unit 723 refers to the compatibility setting table after rounding off the ratio of the stuttering components in the selected section and each section of the succeeding music to a value of 1%, for example. For example, when the stuttering component ratio in the selected section shown in FIG. 3B is 20%, the display changing unit 723 has a compatibility degree of 35 points for sections in which the stuttering component ratio is 30%, 40%, 70%, and 90%. Set to 40 points, 55 points, and 100 points, respectively.

In the compatibility level setting table, when both the preceding music and the subsequent music are in a stuttering section (Rs ≧ stuttering recognition threshold (51%)), a score (70 points or more) indicating that the compatibility is good is set. Is a musical interval (Rs <stuttering authorization threshold), a score (less than 70 points) indicating that the compatibility is bad is set. In addition, the compatibility level setting table is configured such that when one of the preceding music and the subsequent music is a stuttering section and the other is a musical sound section, a score indicating that the compatibility is good is set. Furthermore, the compatibility of each section of the succeeding music with respect to the selected section of the preceding music is set so that the score increases as the ratio of the stuttering component in each section of the succeeding music increases. The degree of compatibility indicates that the higher the score, the less likely the dissonance is generated and the better the compatibility.

Then, as shown in FIG. 3B, the display changing unit 723 displays the stuttering ratio information 555 and the compatibility information 554 of the succeeding music on the display unit 5 as characters (steps S28 and S29), and ends the music information display process. .
Thereafter, when the user sets a combination of sections to be crossfade based on the display on the display unit 5, the sound processing device 6 performs processing based on this combination. For example, the audio processing device 6 ends the reproduction of the preceding music and starts the reproduction of the subsequent music by performing a crossfade between the selection section of the preceding music and the selection music of the subsequent music after starting the reproduction of the preceding music. To start.

During the crossfade, the fade-out of the preceding song, the fade-in of the succeeding song, or the volume adjustment may be performed based on the operation of the jog dial or the like by the user. You may go to
Further, when the user performs an operation for setting a section in which the preceding music is crossfade using the operation unit 4, the sound processing device 6 detects the setting operation and sets the section as a crossfade section. In addition, among the sections of the subsequent music, a section having a good crossfade compatibility with the set section of the preceding music may be set as a crossfade section, and a section having a bad compatibility may not be set. For example, when the setting section of the preceding music is a music section, the audio processing device 6 can set the stuttering section of the subsequent music as a crossfade section based on the section flag in the second memory 74 and also set the musical sound section. It may be impossible to set. Similarly, when the set section of the preceding music is a stuttering section, the audio processing device 6 may be able to set all the sections of the subsequent music as a crossfade section.

[Effect of the embodiment]
As described above, the display control device 7 detects the stuttering component of the music and displays the detection result on the display unit 5 in association with the time information of the music.
For this reason, the user, for example, sees the detection result that the predetermined section of the preceding music is a music section, and easily selects the stuttering section of the subsequent music as a section having good compatibility with the predetermined section and crossfade (mixing). be able to. Therefore, it is possible to provide the display control device 7 that can support crossfading of good music.
In particular, in this embodiment, since the

section time

503 and 553 are used to represent the time information of the music, for example, compared to a configuration in which time information is represented using only characters such as “section 1”, the user The detection result of the stuttering component in the time information can be grasped intuitively.

In addition, the display control device 7 calculates the ratio of the stuttering component in a predetermined section of the music. If the calculation result is equal to or greater than the stuttering authorization threshold, the display control apparatus 7 determines that the section is a stuttering section. It is determined that it is a section. Then, the display control device 7 causes the display unit 5 to display that each section is a stuttering section or a musical sound section as a detection result of the stuttering component.
Therefore, the user can easily select the stuttering section that crossfades with the musical sound section while looking at the display unit 5.
In particular, in the present embodiment, the stuttering section is displayed in red or orange, and the musical sound section is displayed in blue or light blue, so that the user can intuitively identify the stuttering section and the musical sound section.

Further, the display control device 7 measures the power spectrum of a plurality of frequencies in each section of the music and detects a sound component having no harmonic structure as a stuttering component.
In this way, by performing a theoretical analysis taking the harmonic structure into consideration, the display control device 7 can appropriately determine whether each section is a stuttering section.

Moreover, the display control apparatus 7 calculates the total value of all power spectra for each section, and displays the calculation result on the display unit 5 as the intensity of the sound component of each section.
Here, even in the case of crossfading between stuttering sections, if the intensity of both sound components is high, a sense of incongruity may be felt.
In this embodiment, since the intensity of the sound component of each section is displayed on the display unit 5, the user can avoid performing the crossfade with a combination of sections having a high intensity of the sound component.
In particular, in the present embodiment, since the intensity of sound is represented by shades of color, for example, even in a stuttering section, a section where the sound intensity is high is displayed in red, and a low section is displayed in orange. Sound intensity can be identified intuitively.

In addition, when the same component as the musical tone component included in the predetermined section of the music is continuously detected in a plurality of sections including the section, the display control device 7 regards the musical sound component in the plurality of sections as a stuttering component. .
Therefore, a section that can be regarded as a stuttering sound such as a lap can be presented to the user as a section having a good crossfade compatibility with the musical sound section, and the range of DJ performance can be expanded.

[Modification]
Note that the present invention is not limited to the above embodiment, and various improvements and design changes can be made without departing from the scope of the present invention.

For example, in the above embodiment, the result display unit 721 displays the

sound component information

502 and 552 representing both the attribute of each section and the sound intensity, but as shown in FIG. The

sound component information

502A and 552A representing the sound intensity separately may be displayed on the display unit 5.
The sound component information 502A includes stuttering ratio information 505A composed of a plurality of section bars 506A and sound intensity information 507A composed of a plurality of section bars 508A. The sound component information 552A has the same configuration as the sound component information 502A, and includes stuttering ratio information 555A and sound intensity information 557A each composed of a plurality of section bars 556A and section bars 558A.
The stuttering

ratio information

505A and 555A represents the stuttering component ratio of the section. The section bars 506A and 556A of the

noise ratio information

505A and 555A are blue when the noise component ratio is less than 25%, light blue when the ratio is 25% or more and less than 50%, orange when it is 50% or more and less than 75%, and 75%. If it is above, it is displayed in red.
The

sound intensity information

507A and 557A represents the sound intensity of the section. The section bars 508A and 558A of the

sound intensity information

507A and 557A are green if the total amount of sound components is less than the first intensity threshold, light green if the total amount of sound components is less than the first intensity threshold, and the second intensity threshold. As described above, if it is less than the third intensity threshold, it is displayed in yellow green, and if it is greater than or equal to the third intensity threshold, it is displayed in yellow. Note that the

sound intensity information

507A and 557A may not be displayed.

Then, in the state shown in FIG. 9A, when an operation for selecting a predetermined section is performed with the cursor CR indicated by a two-dot chain line, the display change unit 723 displays the predetermined section and each section of the subsequent music, as in the above embodiment. The compatibility information 554 is displayed as shown in FIG. 9B.
Here, if a stuttering section is selected as a section that crossfades to a music section, it is difficult for a dissonance to occur. However, it is considered that the higher the ratio of stuttering in this stuttering section, the less likely that a dissonance will occur.
As shown in FIG. 9A, by displaying stuttering

ratio information

505A and 555A representing only the stuttering component ratio on the display unit 5, the user can select a section in which dissonance is less likely to occur as a section to be crossfade. . Further, since the

sound intensity information

507A and 557A representing only the sound intensity is displayed at a position different from the

sound ratio information

505A and 555A, the user can recognize the sound ratio and sound intensity of each section independently. it can.

When the selection operation for the predetermined section of the preceding music is performed from the state shown in FIG. 9A, the display change unit 723 may display the compatibility information 554B instead of the sound component information 552A as shown in FIG. . The compatibility information 554B includes a plurality of section bars 559B. The interval bar 559B is black if the compatibility is 0 point or 10 points, gray if it is 20 points or more and 50 points or less, light gray if it is 60 points or more and 80 points or less, white if it is 90 points or 100 points. Is displayed.

The colors of the section bars 503, 553, 506A, 556A, and 559B shown in FIGS. 3A, 9A, and 10 may be other colors, and the threshold for setting the color is not limited to the above-described values. Other values may be used.
The result display unit 721 and the display change unit 723 set the color of the

waveforms

501 and 551 corresponding to each section, the color of the frame surrounding the

waveforms

501 and 551, or the color in the frame to a predetermined color. The sound ratio (detection result), sound intensity, or compatibility may be expressed.
The result display unit 721 and the display change unit 723 express the stuttering ratio (detection result), sound intensity, or degree of compatibility with the size and blinking state of the section bars 503, 553, 506A, 556A, 559B and the

compatibility information

554, 554B. May be.
The result display unit 721 and the display change unit 723 may represent the stuttering ratio or the intensity or compatibility of the sound with a figure such as a circle or a triangle, or “(the stuttering component ratio is high)”, “strong sound”, It may be expressed by characters such as “(compatibility) is good”.

The result display unit 721 and the display change unit 723 represent the time information of the music with section bars 503, 553, 506A, 556A, and 559B. For example, “section 1” or “playback time 1 minute 0 seconds to 1 minute 5 seconds” It may be expressed by characters such as “no section”. In this case, the stuttering ratio and the intensity or compatibility of the sound may be displayed on the top and bottom or left and right of the character representing the time information, or the stuttering ratio and sound may be set by setting the color and size of the character representing the time information. The strength or compatibility may be expressed.
The result display unit 721 and the display change unit 723 may display the sound component information and compatibility information of the selected two or more songs at a time when at least one of the preceding and subsequent songs is selected. Good.
The result display unit 721 and the display change unit 723 may use a plurality of display units to display information on the preceding song on one side and information on the subsequent song on the other side.

The display changing unit 723 may display the sound component information of the music and the compatibility information so as to overlap each other, for example, by displaying a character indicating the degree of compatibility in the section bar 553 of FIG. 3A.
When the selection section of the preceding music is a music section, the display changing unit 723 may display only the compatibility information 554 related to the stuttering section of the subsequent music and may not display the compatibility information 554 related to the musical sound section. That is, the display change unit 723 may display the compatibility information 554 only for a section having a good crossfading compatibility with the selected section.
When the selection section of the preceding music is a music section, the display change unit 723 displays only the compatibility information 554 related to the musical tone section of the subsequent music, and does not display the compatibility information 554 related to the stuttering section, and the selection section is a stuttering section. The compatibility information 554 regarding all sections of the succeeding music may not be displayed. That is, the display change unit 723 may display the compatibility information 554 only for a section where the selected section and the crossfade are not compatible.
The display changing unit 723 may display compatibility information of the preceding music when a predetermined section of the subsequent music is selected.

The component detection unit 712 continuously acquires the music data 21 from the first storage unit 2 without providing the section division unit 711 in the stuttering detection unit 71, and the music data acquired so far every predetermined time You may perform the process of step S4, S6, S7 with respect to unanalyzed data.

The ratio calculation unit 713 may calculate the stuttering component ratio (Rs) based on the number of power spectra that constitute the harmonic structure component.
For example, the power spectrum as shown in FIG. 6 is measured, the power spectrum of the harmonic structure component is “Do”, “Mi”, “Fa”, and the total number of power spectra is 48. In this case, the ratio calculation unit 713 may calculate the stuttering component ratio (Rs) as 88% (= (48-6) / 48 × 100).

The display control device of the present invention may be applied to products other than DJ equipment such as a music player as described in Patent Document 1.

7 ... Display control device, 71 ... Stuttering detection unit, 72 ... Display control unit, 713 ... Ratio calculation unit, 714 ... Section attribute determination unit.

Claims

A stutter detection unit that detects stutter components included in the music;
A display control apparatus comprising: a display control unit that displays a detection result of the stuttering detection unit in association with time information of the music piece and is displayed on a display unit.
The stuttering detection unit
A component detection unit for detecting a stuttering component included in a predetermined section of the music;
A ratio calculation unit that calculates a ratio in which the stuttering component is included in the predetermined section,
The display control apparatus according to claim 1, wherein the display control unit displays a calculation result of the ratio calculation unit as the detection result.
The stuttering detection unit
A component detection unit for detecting a stuttering component included in a predetermined section of the music;
A ratio calculating unit that calculates a ratio in which the stuttering component is included in the predetermined section;
A section attribute determining unit that determines that the predetermined section is a stuttering section when the ratio is equal to or greater than a threshold, and determines that the predetermined section is a musical section when the ratio is less than the threshold;
The display control apparatus according to claim 1, wherein the display control unit displays the determination result of the section attribute determination unit as the detection result.
4. The display control apparatus according to claim 2, wherein the component detection unit detects a sound component having no harmonic structure as a stuttering component.
The ratio calculating unit calculates a ratio of a sum value of power spectrums constituting the stutter component to a sum value of all power spectra in the predetermined section,
The display control apparatus according to claim 4, wherein the display control unit causes the display unit to display the sum value of the total power spectrum as the intensity of the sound component in the predetermined section.
When the same component as the musical tone component included in the predetermined section is continuously detected in a plurality of sections including the section, the component detection unit regards the musical sound component in the plurality of sections as a stuttering component. The display control apparatus according to claim 2, wherein the display control apparatus is characterized.
The display control device is a display control method for displaying information on the sound component of the music on the display unit,
The display control device
A stutter detection step for detecting a stutter component included in the music;
A display control method comprising: executing a display control step of displaying the detection result of the stuttering detection step on the display unit in association with the time information of the music.
A display control program for causing a display control device to execute the display control method according to claim 7.