JP2010237381A - Singing support system, support content estimation device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To specify whether it is suitable to support what kind of contents by which support medium, in environment where singing is performed. <P>SOLUTION: Time difference sequence between voice output timing and ideal timing is measured (delay measurement) for each support medium, by supporting measurement by each of a plurality of support media for an object singer. It is estimated that singing support by a predetermined support amount performed by the support medium in which a distribution degree of the time difference sequence is less than a threshold, or the smallest, is a support content suitable for environment to which singing is performed at the point. When singing support is requested in singing of a musical piece, a support content corresponding to singing environment where singing is performed is extracted, and singing support by this support content, that is, singing support in which singing is stably performed under present surrounding environment, is performed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention is a singing support system that performs singing support so that the timing at which a singer sings each singing sound can be matched with the timing at which each singing sound is uttered when the song is properly sung. About.

  In recent years, as a technique for supporting singing as described above, a method of adjusting the display timing and display mode of characters by using a telop (see Patent Documents 1 to 3), a volume of a guide melody (see Patent Document 4), and the like. Has been proposed.

JP-A-2005-173256 Japanese Patent Laid-Open No. 10-039882 JP2007-292922 JP-A-2005-148627

By the way, if the environment where the singing is performed is different, it is expected that the appropriate support content will be different accordingly, so it can be said that it is desirable to perform the singing support accordingly.
For example, if the place where the singing is performed is bright and obstructing the viewing of the display device that displays the telop, the generation timing of the singing sound is adjusted even if the display timing of the telop is adjusted. It is difficult to contribute. In such an environment, it can be said that it is desirable to perform singing support using a support medium that is not related to visibility, such as changing the volume of the guide melody, instead of displaying the telop.

  In addition, if the place where the singing is performed is noisy and the change in the volume of the guide melody is prevented from being recognized, the timing of generating the singing sound should be adjusted even if the volume of the guide melody is adjusted. Hard to contribute. In such an environment, it can be said that it is desirable to implement singing support using a support medium that is not related to volume change recognizability, such as adjusting the display timing of a telop instead of changing the volume of the guide melody.

  However, in the above-described method, even if it is possible to estimate what kind of content is suitable for support using a single support medium such as telop or guide melody, singing is performed. It is impossible to estimate what kind of support is appropriate for which support medium in a given environment.

  The present invention has been made to solve such problems, and the purpose of the present invention is to support what kind of content by which support medium in an environment where singing is performed. It is to provide a technique for estimating the above.

  In order to solve the above-mentioned problem, the first configuration is that when a singer sings each song sound when singing (hereinafter referred to as “speech timing”), each song sound is uttered when the song is properly sung. One or more support media used at the time of support, and one or more support amounts indicating the degree of support by the support media, as support content to be matched with timing (hereinafter referred to as “ideal timing”) Is a singing support system capable of supporting singing with a plurality of types of support contents combining any of the above, and an information collecting unit for collecting information related to singing by a singer, and estimating support contents suitable for the singer The content estimation unit includes a singing support unit that performs singing support based on the support content estimated by the content estimation unit.

  Among these, the information collection unit sings each of the one or more support media in a state where a song (hereinafter referred to as “target song”) is performed by a singer (hereinafter referred to as “target song”). Measurement support means for performing singing support for measurement (hereinafter referred to as “measurement support”) that is performed while changing the support amount of the support medium, and repeatedly performing a predetermined measurement period for each support medium; For each measurement period in which measurement support is performed by the measurement support means, each utterance timing by the target singer is compared with a corresponding ideal timing among the ideal timings in the target music, and the utterance timing and A system for acquiring a time difference series composed of each of the time differences in a partial period in which the time difference from the ideal timing has converged within a predetermined range. An acquisition means, a measurement parameter acquisition means for acquiring an environmental parameter related to the surrounding environment where the singing is performed, and a time difference series acquired by the series acquisition means in a state where the singing of the target music is being performed; And measurement information storage means for storing the measurement information including the support contents of the measurement support performed at the time of acquisition in association with the environmental parameters acquired by the measurement parameter acquisition means.

  The content estimation unit divides the measurement information of the environmental parameters indicating the same surrounding environment stored in the information collection unit into groups for each support medium that defines the support content, and a time difference series in the measurement information of each group A dispersion calculating means for calculating a degree of dispersion for the measurement information, and a group of the measurement information in which the degree of dispersion calculated by the dispersion calculating means is less than a predetermined threshold or the smallest. The support estimation means for estimating the support by the support medium corresponding to the above as the support content suitable for the surrounding environment specified by the environment parameter that is the target of calculation by the variance calculation means, and the support estimated by the support estimation means Support content storage means for storing the content in association with the environmental parameter.

  Then, the singing support unit, when a singing person requests a singing support when singing the music, a support time parameter acquiring means for acquiring an environmental parameter related to the surrounding environment where the singing is performed, When there is a request for singing support at the time of singing, out of the support content stored by the content estimation unit, content extraction means for extracting the support content corresponding to the environmental parameter acquired by the support time parameter acquisition means, Singing support means for carrying out singing support based on the support content extracted by the content extraction means.

  With this configuration, measurement support by each of a plurality of support media is performed when singing, and the time difference series between the utterance timing and the ideal timing is measured for each support medium, and the variance of the time difference series is less than the threshold value. The singing support by the support medium that is the smallest or the smallest can be estimated as the support content suitable for the surrounding environment where the singing is performed at that time.

  Singing support whose degree of variance of the time difference series is less than the threshold or the smallest means that the time difference has converged within a narrow range and has been supported in a stable manner with a certain time difference. Yes. In other words, it can be said that the support content that can be stably sung is estimated here.

  When there is a request for singing support when singing a song, the support content corresponding to the surrounding environment where the singing is performed at that time is extracted, and singing support by this support content, that is, stable in the current surrounding environment Singing support can be carried out with the support content that can be sung in an effort.

  In the present invention, the support medium is “to change the character display color” in terms of the support content for adjusting the timing for changing the character display color in the telop. In this case, the change timing is “the amount of support”. Is. The support content for adjusting the character display amount (number of characters) in the telop is “changing the character display amount”. In this case, the display amount is the “support amount”. The support content for changing the character display mode (size, etc.) in the telop is “changing the character display mode”. In this case, the display mode is “support amount”. Further, the support content for adjusting the volume of the guide melody in accordance with the ideal timing is “changing the volume of the guide melody”. In this case, the volume is the “support amount”. The support content for adjusting the performance sound (for example, bass sound) to notify the ideal timing is “adjusting the performance sound”. In this case, the degree of adjustment of the performance sound (the volume of the sound) Is the “amount of support”.

  In addition, the measurement support in the above invention is repeatedly performed for each support medium for each measurement period. For example, a part of the period during which the same music is sung may be performed as a “measurement period”. Moreover, you may implement the whole period when a music is sung as a "measurement period."

  In addition, in order to repeat measurement support, for example, when a part of the same music is sung as a “measurement period”, the singing by the singer is performed and the measurement is performed. The measurement support may be performed by a support medium different from the one that has been performed so far, provided that the time corresponding to the period remains.

  In the above configuration, the time difference obtained by comparing the utterance timing and the ideal timing may be specified as follows. First, when the singer sings a song, each singing sound is a singing section, and the transition pattern of the pitch in the singing section is a section where each singing sound is uttered when the same song is sung appropriately. Contrast with the transition pattern of the pitch in the guide section corresponding to the corresponding singing section in the guide section. And the position on the time axis in the singing section is corrected (along the time axis) until the transition pattern of the pitch in the singing section is the closest to the transition pattern of the pitch in the guide section (the degree of approximation is maximized). The amount of correction when shifting back and forth is specified as the time difference described above.

  Any method may be adopted as a method for correcting the position on the time axis so that the transition pattern is approximated in this way, for example, as described in JP-A-2005-107330. It is conceivable to adopt such a method.

  In addition, the condition for acquiring the time difference series composed of the time differences thus identified is that the time difference has converged within a predetermined range. For example, each time difference specified during measurement support is only within a certain range. A state in which it does not fluctuate or the time difference calculated during measurement support continuously becomes a small value within a certain range.

  The above-mentioned “environment where the singing is performed” refers to, for example, the model and function of the singing support system, the surrounding brightness (light quantity), the surrounding noise (noise level), the shape of the indoor space and the wide space This is a parameterized environment parameter. In addition, for these environmental parameters, for example, values that change sequentially, such as light quantity and noise level, may be obtained by various sensors, and preset values are obtained for other fixed values. And it is sufficient.

  In addition, in the above configuration, when a singer requests singing support when singing a song, the support content corresponding to the surrounding environment at that time is not limited to a specific support medium, It is desirable that the support amount indicating the degree can be extracted.

As a configuration for this purpose, the first configuration is desirably a second configuration (claim 2) shown below.
In the information collection unit having the above configuration, the measurement information storage unit includes, as the support content of the measurement support performed when acquiring the time difference series, a support medium for measurement support performed when acquiring the time difference series, and A support amount of measurement support performed in a partial period corresponding to the time difference series is stored in association with the environmental parameter acquired by the measurement parameter acquisition means.

  In the content estimation unit, the support estimation unit is configured to measure the group of measurement information in which the degree of dispersion calculated by the dispersion calculation unit is less than a predetermined threshold value or the smallest. The support based on the support medium corresponding to the group and the support amount in the measurement information of the group is estimated as the support content suitable for the surrounding environment defined by the environment parameter.

  With this configuration, singing support with a predetermined support amount implemented with a support medium in which the degree of variance of the time difference series is less than the threshold value or the smallest support content suitable for the surrounding environment Can be estimated as Then, when the singer requests singing support when singing the music, the support content corresponding to the surrounding environment at that time is extracted, and this support content sings with a specific support amount by a specific support medium. Support can be implemented.

  In this configuration, the support amount stored in association with the coping singer may be the support amount at the time when the time difference has converged, among the support amounts of the measurement support performed during a partial period, or a part thereof The average amount of support for the entire period may be used.

  Further, in each of the above configurations, a specific method for calculating the degree of dispersion is not particularly limited, but for example, a method like the third configuration (claim 3) shown below can be considered.

  In the content estimation unit configured as described above, when the variance calculation unit sets dti [k] (k is an index corresponding to an ideal timing) as a time difference sequence in the measurement information of a target group, The degree of dispersion is calculated according to Equation 1.

(K and m are indexes corresponding to ideal timing)
If it is this structure, based on the dispersion | distribution degree computed by the said Formula 1, the assistance content suitable for the surrounding environment where the song is performed can be estimated.

In order to solve the above-described problem, a support content estimation apparatus (claim 4) may be provided, comprising all the means in any one of the first to third configurations.
If it is this structure, the effect | action and effect similar to any one of the said 1st to 3rd structure can be acquired.

  In order to solve the above problem, a program for causing a computer system to execute various processing procedures for causing all the means in any one of the first to third configurations to function (claim 5). Good.

If it is a computer system that executes this program, it is possible to configure a part of the singing support system according to any one of the first to third aspects.
The above-mentioned program is composed of an ordered sequence of instructions suitable for processing by a computer system, and uses a singing support system, a singing content estimation device, and the like via various recording media and communication lines. It is provided to the user who performs.

Block diagram showing the overall configuration of the karaoke system Flow chart showing information collection process Diagram showing the operation of the karaoke system Flow chart showing singing support processing Flow chart showing support content identification processing Diagram showing how information is registered in the measurement table The figure which shows a mode that each information of measurement information is registered into a support content table Flow chart showing support content notification processing

Embodiments of the present invention will be described below with reference to the drawings.
(1) Overall Configuration The karaoke system 1 is configured such that a server 2 composed of a well-known computer system and each of one or more karaoke apparatuses 3 are communicably connected via a network 100. In addition, this karaoke system 1 functions as a singing support system in the present invention.

  The server 2 includes a control unit 21 that controls the entire server, a storage unit 23 that stores various information, a communication unit 25 that controls communication via the network 100, and a user interface (U / I) unit 27 including a keyboard and a display. , A media drive 29 for inputting / outputting information via a recording medium.

  The karaoke device 3 includes a control unit 31 that controls the entire device, a storage unit 33 that stores music data and video data indicating the accompaniment content and lyrics of the performance music, a communication unit 35 that controls communication via the network 100, and the like. A display unit 41 for displaying video; an operation unit 43 including a plurality of keys and switches; a voice input / output unit 49 for controlling voice input from the microphone 45 and voice output from the speaker 47; An environmental sensor 52 for detecting environmental parameters related to the surrounding environment at the installation location is provided.

  Here, “peripheral environment” means, for example, the model and function of the singing support system, the brightness of the surroundings (light intensity), the noise of the surroundings (noise level), the shape and size of the indoor space, etc. These are parameterized environmental parameters. Among these environmental parameters, the environmental sensor 52 detects and acquires values of parameters that change sequentially, such as light quantity and noise level. On the other hand, environmental parameters that do not change sequentially are set to fixed values, but are updated in response to an arbitrary operation or an external command when the change is necessary.

  In this karaoke system 1, the timing at which a singer utters each singing sound when singing (hereinafter referred to as “voice timing”), and the timing at which each singing sound is uttered when the song is properly sung (hereinafter “ideal timing”). As a support content to be adapted to the above), any one of a plurality of support media used for support and one or more support amounts indicating the degree of support by the support media are respectively combined. The singing support is implemented by a plurality of types of support contents.

The “support medium” here refers to support contents for adjusting the timing for changing the character display color in the telop, which is “to change the character display color”. In this case, the change timing is “ Amount of support ". The support content for adjusting the character display amount (number of characters) in the telop is “changing the character display amount”. In this case, the display amount is the “support amount”. The support content for changing the character display mode (size, etc.) in the telop is “changing the character display mode”. In this case, the display mode is “support amount”. Further, the support content for adjusting the volume of the guide melody in accordance with the ideal timing is “changing the volume of the guide melody”. In this case, the volume is the “support amount”. The support content for adjusting the performance sound (for example, bass sound) to notify the ideal timing is “adjusting the performance sound”. In this case, the degree of adjustment of the performance sound (the volume of the sound) ”) Is the“ support amount ”.
(2) Processing by Karaoke Device 3 Hereinafter, various processing procedures started when the control unit 31 of the karaoke device 3 executes a program stored in the storage unit 33 will be described.
(2-1) Information Collection Processing First, when the singing of a song is performed by a singer in a state where the collection mode for collecting information in the karaoke apparatus 3 is set to “ON”, the information is repeatedly executed. A processing procedure of the information collection processing will be described with reference to FIG. Here, “the song is being sung by the singer” is determined based on the fact that the music is being played and the period during which the song is to be performed has not ended.

  When this information collection process is activated, first, the surrounding environment where the singing is performed is specified (s110). Here, values such as the light quantity LI and the noise level NL detected by the environment sensor 52 are detected, a system value #T indicating the model and function of the singing support system, and a space value indicating the shape and area of the indoor space. Setting values such as SP are read from the storage unit 33, and these values are acquired as environment parameters that define the surrounding environment. In the present embodiment, values that change sequentially, such as the light amount LI and the noise level NL, are quantized after detection, and are obtained as values indicating each region in a certain range.

  Next, measurement support using the i-th support medium is selected from a plurality of types of measurement support as singing support for measurement (hereinafter referred to as “measurement support”) performed in the subsequent processing (s120). In the present embodiment, since a variable i for setting a value i indicating the order of support media used for measurement support is prepared, the i-th support medium is based on the value of the variable i. Measurement support by is selected. The variable i is reset to the initial value “1” after being sequentially incremented from the initial value “1” to the upper limit value in the process described later.

  Next, measurement support using the i-th support medium selected in s120 is started (s130). Here, singing support for measurement is started, in which singing support is performed while sequentially changing the support amount in the i-th support medium to each of Xi [1] to Xi [n] (n: any number). (See “Measurement Support” in FIG. 3A).

  Next, a process of sequentially calculating the time difference between the utterance timing and the ideal timing by comparing each utterance timing of the singing sound by the singer with the ideal timing of the corresponding singing sound among the ideal timings in the target music (Time difference series calculation processing) is started (s140). With this process, a time difference sequence including a time difference between the utterance timing and the ideal timing is generated as the measurement support progresses (see “delay measurement” in FIG. 3A).

  In this time difference series calculation process, first, when a singer sings each song sound when singing a song, the song segment is set as a song segment, and the pitch transition pattern in the song segment is sung when the same song is properly sung. Each of these is compared with the transition pattern of the pitch in the guide section corresponding to the corresponding singing section among the guide sections which are sections to be uttered. And the position on the time axis in the singing section is corrected (along the time axis) until the transition pattern of the pitch in the singing section is the closest to the transition pattern of the pitch in the guide section (the degree of approximation is maximized). The correction amount in the case of shifting back and forth is calculated as the time difference described above. At this time, any method may be employed as a method of correcting the position on the time axis so that the transition pattern is approximated. For example, a method described in JP-A-2005-107330 is used. Can be considered.

  Next, it is checked whether or not an end condition FNi for ending the i-th measurement support is satisfied (s150). Here, the time difference calculated in the process of changing the support amount in measurement support has converged to a predetermined range, or the i-th measurement support has ended (for example, the time required for changing to all support amounts) It is determined that the end condition FNi is satisfied.

  The above-mentioned “when the time difference converges within a predetermined range” means that, for example, each time difference calculated during measurement support varies only within a certain range, or the time difference calculated during measurement support continues. In other words, it may be a small value within a certain range.

  If it is determined in s150 that the termination condition is not satisfied (s150: NO), it is checked whether or not the singing of the target song by the target singer has ended (s160). Here, it is determined that the singing of the target music by the singer has ended when the performance of the target music has ended.

If it is determined in s160 that the singing by the singer has not ended (s160: NO), the process returns to s150.
Further, when it is determined that the ending condition is satisfied in s150 (s150: YES), or when it is determined that the singing by the singer is ended in s160 (s160: YES), s130 The measurement support started in is terminated (s170).

  Next, among the time differences calculated in the measurement support carried out so far, a time difference series dti [k] (k is an ideal timing) consisting of a predetermined number of time retroactive from the time point when the measurement support is ended in s170. , K = 1, 2,...) Is acquired (s180). In this s180 (especially, when “YES” is determined in s160), the time difference series dti is not calculated as a time difference series dti consisting of a predetermined number of time differences retroactive from the time point when the measurement support is ended. Among the time differences, a time difference sequence in a section where the average of a predetermined number of time differences is smallest may be acquired.

  Next, the time difference series dti [k] acquired in s180, the support content (support medium i and the support amount Xi [j]) when the measurement support is ended in s170, and in s110 Measurement information including the acquired environmental parameters (LI, NL, #T, SP) and the like is generated and transmitted to the server 2 (s190) (see FIG. 3A).

  Here, the support amount X [j] that defines the support content is calculated by a feedback function FBi represented by the following Equation 1.

In the server 2 that has received the measurement information, the support content suitable for the surrounding environment specified in s110 is specified and stored in the support content specifying process described later.
Next, it is checked whether or not the measurement support by all the support media is completed (s200). Here, when the value of the variable i is the upper limit value, it is determined that the measurement support by all the support media is completed.

  If it is determined in s200 that measurement support by all support media has not been completed (s200: NO), after the variable i is incremented (i + 1 → i) (s210), this information collection process Ends.

  On the other hand, when it is determined that the measurement support by all the support media has been completed (s200: YES), after the variable i described above is initialized (1 → i) (s220), this information collection process Ends.

Thus, after the information collection process is completed, the information collection process is executed again based on the value of the variable i changed in s210 or s220.
(2-2) Singing Support Processing Subsequently, in the state where the support mode for performing singing support in the karaoke apparatus 3 is set to “ON”, the singing support process is performed at the timing when the singing of the music by the singer is started. The singing support process procedure will be described with reference to FIG.

  When this singing support process is activated, first, the surrounding environment where the singing is performed is specified (s310). Here, as in the information collection process described above, values such as the light amount LI, the noise level NL, the system value #T, and the spatial value SP are acquired as environment parameters that define the surrounding environment.

  Next, a request command for notifying the support content suitable for the surrounding environment specified in s310 is transmitted to the server 2 (s320). Here, the request command is transmitted to the server 2 together with the environmental parameters acquired in s310 (see “request command” in FIG. 3B). The server 2 that has received this request command, based on the environmental parameters transmitted together with the request command, a request response indicating support contents (support medium iopt and support amount Xopt_i) suitable for the surrounding environment specified by the environment parameters. Is returned (see “request response” in FIG. 3B).

  Thus, after transmitting the request command in s320, when receiving a request response from the server 2 (s330), the support content indicated by the request response is determined as the support content when the singer sings the music ( s340).

Next, along with the performance of the music, singing support based on the support content determined in s340 is started (s350) (see FIG. 3B).
Then, after being in a standby state until the performance of the music is completed (s360: NO), with the completion of the performance of the music (s360: YES), the singing support started by s350 is completed (s370). Thereafter, the singing support process ends.
(3) Processing by Server 2 Hereinafter, various processing procedures started when the control unit 21 of the server 2 executes a program stored in the storage unit 23 will be described.
(3-1) Support Content Specifying Process First, the processing procedure of the support content specifying process started every time the server 2 receives measurement information from the karaoke apparatus 3 will be described with reference to FIG. This measurement information is information that the karaoke apparatus 3 transmits in s190 of the information collection process, and includes a time difference series dti [k], support contents (support medium i and support amount Xi [j]), and environmental parameters. (LI, NL, #T, SP) and the like (see FIG. 3A).

  When this support content specifying process is activated, first, the measurement information received prior to the activation is registered in a data table (measurement table) for registering measurement information (s410). Here, the time difference series dti [k] and the support contents (support medium i and support amount Xi [j]) in the measurement information are measured as measurement information corresponding to the environmental parameters (LI, NL, #T, SP). It is registered in the table (see FIG. 6).

  Next, one or more pieces of measurement information corresponding to the environmental parameters registered in s410 are extracted from the measurement information registered in the measurement table at this time (s420) (see FIG. 7A). . Here, each of the measurement information corresponding to the environmental parameter registered in s410 and the environmental parameter whose value combination matches or approximates a predetermined threshold value or more is extracted.

Next, each piece of measurement information extracted in s420 is divided into measurement information groups having the same support medium i that defines the support content (s430) (see FIG. 7B).
Next, the degree of dispersion of the time difference series dti [k] is calculated for each measurement information grouped in s430, and this is averaged for each support medium i (s440). Here, the degree of dispersion vdti of each measurement information of the same group is calculated by the following formula 2 based on the time difference series dti [k] of the measurement information, and these are averaged for each support medium i, The degree of dispersion for each support medium i is obtained (see FIG. 7C).

Note that “m” in Equation 2 is an index corresponding to the ideal timing, similarly to k.
Next, based on the degree of dispersion vdti of each support medium i obtained in s440, a support medium iopt that defines support contents suitable for the surrounding environment is estimated (s450). Here, the support medium iopt with the degree of dispersion vdti being the minimum or less than the predetermined threshold is a support medium that specifies support contents suitable for singing a song in the surrounding environment specified by the corresponding environment parameter It is estimated to be.

  As described above, the singing support by the support medium i having the smallest dispersion degree vdti or less than the threshold value converges in a narrow range of the time difference of the time difference series dti [k], and is stable at a constant time difference. It means that it was support contents that could sing. Therefore, the support medium iopt estimated here can be said to be a support medium that defines the support contents that can be stably sung in a certain time difference in the surrounding environment at that time.

  Next, for each support medium iopt specified in s450, a support amount Xopt_i [j] for performing singing support using the support medium iopt is specified (s460). Here, the support amount Xi [j] that defines the support content referred to when specifying the support medium iopt in the above s450, that is, the support amount of the support medium that defines the support content suitable for the target singer is the support medium. It is specified as a support amount Xopt_i [j] when performing singing support by iopt. When there are a plurality of support amounts Xi [j] that define the referred support contents, one of the support amounts or the average support amount is set as the support amount Xopt_i [j]. It should be specified.

  This will be described with reference to FIG. 7. When the support medium 4 is specified as the support medium iopt (see FIG. 7C), the support content referred to when specifying the support medium 4 ( A support amount X4 [9] that defines support medium 4, support amount X4 [9]) (see FIG. 5B) is specified as support amount Xopt_i [j].

  Then, the support content including the support medium iopt and the support amount Xopt_i [j] specified by s450 and s460 is registered in the support content registration data table (support content table) in association with the environment parameter (s470). (See FIG. 7 (d)).

In addition, when the support content corresponding to the singing frequency is already registered in the corresponding support content table, this support content is overwritten.
After finishing s470 in this way, this support content specific process is complete | finished.
(3-2) Support Content Notification Process Next, the processing procedure of the support content notification process that is activated in response to a request command to notify the support content from the karaoke apparatus 3 will be described with reference to FIG. This request command is transmitted by the karaoke apparatus 3 at s320 of the singing support process, and is transmitted together with the environmental parameters (see “request command” in FIG. 3B).

  When this support content notification processing is activated, first, based on the environmental parameters received prior to the activation, the support content suitable for singing a song in the surrounding environment defined by the environmental parameters is extracted ( s520). Here, out of the support contents (support medium iopt and support amount Xopt_i) registered in the support content table at this time, it corresponds to the environment parameter received prior to the start of the support content notification process (value combination) The contents of support are extracted (matching or approximating a predetermined threshold value or more).

Then, after the request response indicating the support content extracted in s520 is returned to the karaoke apparatus 3 that is the transmission source of the request command (s530), the support content notification processing is ended.
This request response is received by the karaoke apparatus 3 at s330 of the singing support process (see “request command” in FIG. 3B).
(4) Action and Effect In the karaoke system 1 configured as described above, a time difference sequence between the utterance timing and the ideal timing is measured for each support medium by performing measurement support using a plurality of support media when singing ( The information collection process of FIG. 2), the singing support with a predetermined amount of support carried out with the support medium in which the degree of variance of the time difference series is less than the threshold value or the smallest, the singing is performed at that time It can be estimated (specified) as the support content suitable for the surrounding environment being performed (s450 and s460 in FIG. 5).

  Then, when there is a request for singing support at the time of singing the music, the support content corresponding to the surrounding environment where the singing is performed is extracted (s520 in FIG. 8), and the singing support by this support content, that is, the current time Singing support can be implemented with support contents that can be stably sung in the surrounding environment (s530 in FIG. 4 and s340 and s350 in FIG. 4).

At this time, based on the degree of dispersion calculated from the above equation 12, the support content suitable for the surrounding environment where the singing is performed can be estimated.
(5) Modifications Embodiments of the present invention have been described above, but the present invention is not limited to the above-described embodiments, and can take various forms as long as they belong to the technical scope of the present invention. Needless to say.

  For example, in the above embodiment, the karaoke apparatus 3 and the server 2 are configured to operate in cooperation with each other, but all the processes are performed only on the karaoke apparatus 3 side. Moreover, you may comprise so that each process implemented by the karaoke apparatus 3 may be implemented by another apparatus.

  Moreover, in the said embodiment, the information collection process by the karaoke apparatus 3 is comprised so that the performance of a music is performed and it may be repeatedly performed in the condition where the period which should sing in the music in performance has not ended. ing. That is, a part of the period during which the same music is sung is a measurement period by measurement support. However, the information collection process may be repeated each time a song is sung by a singer so that the entire period in which the song is sung becomes a measurement period by measurement support.

  Moreover, in the said embodiment, it is comprised so that the assistance content specific process by the server 2 may be started whenever the measurement information from the karaoke apparatus 3 is received. However, this support content specifying process may be configured to be started for a certain period or when a predetermined event occurs regardless of reception of the measurement information. In this case, it is preferable to start from s420 without performing s410, to extract measurement information corresponding to any of the environmental parameters in s420, and to perform s420 and subsequent steps on other environmental parameters after s470.

In the above embodiment, the case where values such as the light quantity LN, the noise level NL, the system value #T, and the spatial value SP are adopted as the environmental parameters that define the surrounding environment is exemplified. Needless to say, values other than those described above can be adopted as long as the surrounding environment in which the singing is performed can be defined.
(6) Correspondence with the present invention In the embodiment described above, the control unit 31 of the karaoke apparatus 3 that executes the information collecting process is the information collecting unit in the present invention, and controls the server 2 that executes the support content specifying process. The unit 21 is a content estimation unit in the present invention, and the control unit 31 of the karaoke apparatus that executes the singing support process and the control unit 21 of the server 2 that executes the support content notification process are the singing support unit in the present invention.

  2 corresponds to the measurement support means in the present invention, s180 corresponds to the sequence acquisition means in the present invention, and s110 in FIG. 2 corresponds to the measurement parameter acquisition means in the present invention. S190 and s410 in FIG. 5 correspond to the measurement information storage unit in the present invention, s440 in FIG. 5 corresponds to the variance calculation unit in the present invention, and s450 and s460 in FIG. 5 correspond to the support estimation unit in the present invention. FIG. S470 corresponds to the support content storage means in the present invention, s310 in FIG. 4 corresponds to the support parameter acquisition means in the present invention, s520 and s530 in FIG. 8 correspond to the content extraction means in the present invention, and FIG. s340 and s350 correspond to the singing support means in the present invention.

  The server 2 that executes the support content specifying process corresponds to the support content estimation apparatus according to the present invention.

DESCRIPTION OF SYMBOLS 1 ... Karaoke system, 2 ... Server, 21 ... Control part, 23 ... Memory | storage part, 25 ... Communication part, 27 ... User interface part, 29 ... Media drive,
DESCRIPTION OF SYMBOLS 3 ... Karaoke apparatus, 31 ... Control part, 33 ... Memory | storage part, 35 ... Communication part, 41 ... Display part, 43 ... Operation part, 45 ... Microphone, 47 ... Speaker, 49 ... Voice input / output part, 52 ... Environmental sensor, 100: Network.

Claims (5)

The timing at which the singer utters each singing sound (hereinafter referred to as “speech timing”) when singing is matched with the timing (hereinafter referred to as “ideal timing”) when each singing sound is sung when the song is properly sung As a support content for doing so, a plurality of types of support in which any one or more support media used for support and one or more support amounts indicating the degree of support by the support media are combined. A singing support system capable of supporting singing by content,
From an information collection unit that collects information related to singing by a singer, a content estimation unit that estimates support content suitable for a singer, and a singing support unit that performs singing support based on the support content estimated by the content estimation unit, Become
The information collecting unit
In a state where a song (hereinafter referred to as “target song”) is sung by a singer (hereinafter referred to as “target song”), singing support by each of the one or more support media, and the amount of support by the support media Measurement support means for repeatedly performing a singing support for measurement (hereinafter referred to as “measurement support”) performed while changing the above for each support medium,
For each measurement period in which measurement support is performed by the measurement support means, each utterance timing by the target singer is compared with a corresponding ideal timing among the ideal timings in the target music, and the utterance timing And a sequence acquisition means for acquiring a time difference sequence consisting of each of the time differences in a partial period in which the time difference between the ideal timing and the ideal timing has converged within a predetermined range;
In the state where the target song is being sung, a measurement parameter acquisition means for acquiring environmental parameters related to the surrounding environment where the singing is performed;
Measurement information including the time difference sequence acquired by the sequence acquisition unit and the support content of the measurement support performed at the time of acquisition is stored in association with the environmental parameter acquired by the measurement parameter acquisition unit. Measurement information storage means,
The content estimation unit
A distribution for grouping the measurement information of the environmental parameters indicating the same surrounding environment stored in the information collecting unit for each support medium that defines the support content, and calculating the degree of dispersion for the time difference series in the measurement information of each group A calculation means;
For the group of measurement information whose degree of variance calculated by the variance calculation means is less than a predetermined threshold value or the smallest, the support by the support medium corresponding to the group is used for the variance calculation. A support estimation means for estimating the support content suitable for the surrounding environment defined by the environmental parameters to be calculated by the means;
Support content storage means for storing the support content estimated by the support estimation means in association with the environmental parameter, and
The singing support section
When receiving a request for singing support when singing a song from a singer, a parameter acquisition means for support for acquiring environmental parameters related to the surrounding environment where the singing is performed;
When there is a request for singing support when a song is sung by a singer, the support content corresponding to the environmental parameter acquired by the support parameter acquisition means is extracted from the support content stored by the content estimation unit. Content extraction means;
A singing support means for carrying out singing support based on the support content extracted by the content extraction means. In the information collecting unit,
The measurement information storage means includes, as the support content of the measurement support performed when acquiring the time difference series, a support medium for measurement support performed when acquiring the time difference series, and a partial period corresponding to the time difference series Is stored in association with the environmental parameter acquired by the measurement parameter acquisition means,
In the content estimation unit,
The support estimation means includes a support medium corresponding to the group of measurement information in which the degree of dispersion calculated by the dispersion calculation means is less than a predetermined threshold value or the smallest. The singing support system according to claim 1, wherein the support based on the support amount in the measurement information of the group is estimated as support content suitable for the surrounding environment defined by the environment parameter. In the content estimation unit,
When the time difference series in the measurement information of the target group is dti [k] (k is an index corresponding to the ideal timing), the variance calculating means calculates the variance according to the following formula 1. The singing support system according to claim 1, wherein:
(K and m are indexes corresponding to ideal timing) A support content estimation apparatus comprising all the means included in the content estimation unit according to any one of claims 1 to 3.   The program for making a computer system perform the various process procedures for functioning as all the means with which the content estimation part in any one of Claim 1 to 3 is provided.