JP6736914B2 - Music selection device, karaoke system, and music selection program - Google Patents

Description

The present invention relates to a music piece selection device used when selecting a music piece to be sung by a karaoke device, a karaoke system that allows users to enjoy singing along with automatic performance of a music piece, and music piece selection that can be executed by various information processing devices. For programs. In particular, the present invention relates to a music selection device, a karaoke system, and a karaoke program that allow the user to use additional functions according to his or her singing skill.

In a karaoke device that enjoys singing along with accompaniment performance, a form of a music selection device using an information processing device is generally used instead of the form of a booklet (songbook) that has posted the music name and the music number correspondingly It has become a target. In the music selection form by such a music selection device, the user can easily extract the target music by inputting various search conditions. It is also possible to make a reservation directly to the karaoke device by selecting the extracted music.

In the karaoke field, various services are provided that use information about users who are registered as members. Also for music selection, a mode has been proposed in which the user's musical range is taken into consideration and a music suitable for the user is selected. In patent document 1, the music sung by the user is recorded in the user-specific song history management table for each user, and based on the music range in the original song key of the music recorded in the user-specific song history management table. A karaoke song selection assisting system has been proposed which calculates a singing person range for each user and selects a music piece having a music range included in the singing range of the user.

JP, 2008-152169, A

By the way, some karaoke devices are provided with various additional functions for performing singing evaluation such as singing score and practicing singing. Conventionally, such an additional function has been selected by a user operation. On the other hand, there are songs that can be easily sung by users performing karaoke and songs that cannot be sung. For example, it can be said that a song that needs to be vocalized beyond its own range is a song that is difficult to sing. When a song score, which is one of the additional functions, is performed on such a song that is difficult to sing, it is difficult to obtain a good result. An object of the present invention is to enable an additional function suitable for singing a music piece based on the relationship between the music piece selected by the user and the singing power of the user.

When performing karaoke, the tone of the voice may change depending on the physical condition of the user. For example, there are situations in which a high voice can be reasonably produced, or a song can be sung with a rich voice volume, or vice versa. An object of the present invention is to enable an additional function suitable for the user's tone by determining the additional function by using the tone of the user's voice as an additional condition.

Therefore, the music selection device according to the present invention employs the following configuration.
Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music feature information corresponding to the music selected in the music selection process and the pitch included in the voice feature information, the difficulty level of the music for the logged-in user is determined as a condition. , Based on the conditions, to determine the additional function according to the singing ability state of the user, the additional function determination process to associate with the song selected in the song selection process,
Performing a change amount determination process of determining the change amount of the range information over time,
In the additional function determination process, the change amount determined in the change amount determination process is used as an additional condition for determining the additional function.

Furthermore, in the music selection apparatus according to the present invention,
The voice characteristic information acquired in the voice characteristic acquisition process is acquired by measuring a voice input from a microphone.

Furthermore, in the music selection apparatus according to the present invention,
The voice characteristic acquisition process is characterized in that the voice characteristic information is acquired based on a singing voice of the login user input from the microphone when the music is reproduced.

Furthermore, in the music selection apparatus according to the present invention,
The additional function determination process is characterized in that the additional function corresponding to the condition or the condition and the additional condition is presented and selected by the login user to determine the additional function.

Furthermore, in the music selection apparatus according to the present invention,
The additional function determined by the music selection processing is the first additional function when both the condition and the additional condition are satisfied, and the second additional function when both the condition and the additional condition are not satisfied. Function and
The first additional function is an additional function of competing with other users for ranking of song evaluation,
The second additional function is characterized in that it does not include an additional function of competing with other users for ranking of song evaluation.

Further, the karaoke system according to the present invention,
A karaoke system including a reproduction unit and a control unit,
The reproducing unit can reproduce music information,
The control unit is
Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music feature information corresponding to the music selected in the music selection process and the pitch included in the voice feature information, the difficulty level of the music for the logged-in user is determined as a condition. , Based on the condition, to determine the additional function according to the singing ability state of the user, the additional function determination process to associate with the song selected in the song selection process,
A reproduction process of causing the reproduction unit to reproduce the music information corresponding to the music selected in the music selection process, and executing the additional function determined in the additional function determination process,
Run a variation determination process of determining temporal variation of the sound area information, and
In the additional function determination process, the change amount determined in the change amount determination process is used as an additional condition for determining the additional function.

The music selection program according to the present invention is
Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music characteristic information corresponding to the music selected in the music selection process and the pitch included in the voice characteristic information, the difficulty level of the music for the logged-in user is determined as a condition, Based on the conditions, the additional function according to the singing ability state of the user is determined, the additional function determination process associated with the song selected in the song selection process,
A variation determination process of determining temporal variation of the sound zone information, was executed in the information processing apparatus,
In the additional function determination process, the change amount determined in the change amount determination process is used as an additional condition for determining the additional function.

According to the music selection device, the karaoke system, and the music selection program according to the present invention, the additional function is determined in consideration of the voice feature information of the login user and the relationship (basic condition) between the selected music. With such a configuration, it becomes possible for the logged-in user to use an additional function according to the degree of music difficulty.

Further, in the present invention, the temporal change amount of the voice feature information is used as an additional condition for determining the additional function. With such a configuration, it is possible to use an additional function according to the change in the tone of the voice by using the change in the tone of the login user (additional condition) when singing.

Further, in the present invention, the voice feature information is acquired by measuring the voice input from the microphone. With such a configuration, it becomes possible to acquire highly accurate voice feature information using the actual voice of the login user. Note that the voice feature information may have a form in which the logged-in user inputs it by his/her own report, instead of the form in which actual measurement is performed.

Furthermore, in the present invention, when reproducing the music, by acquiring the voice feature information based on the singing voice of the login user input from the microphone, it becomes possible to obtain the voice feature information when singing, in addition to normal singing There is no need to perform a voice feature acquisition process separately. Therefore, the voice feature information can be acquired without imposing a particular burden on the user.

Further, in the present invention, the additional function to be used is determined by presenting a plurality of additional functions to the login user and allowing the login user to select the additional function. With such a configuration, the logged-in user can select whether or not to use the additional function, or select the additional function to be used from a plurality of candidates.

Further, in the present invention, the additional function to be used is determined by performing the condition determination on the first condition and the second condition. At that time, as the first additional function, an additional function that competes with other users in the ranking of singing evaluation is determined. With this configuration, for example, when the user's voice is in good condition, the first additional function makes it possible to leave a good singing evaluation ranking. In addition, the second additional function does not include an additional function of competing with other users in the ranking of singing evaluation. For example, by relating to singing practice, the singing ability can be improved. It will be possible.

The figure which shows the karaoke system of this embodiment. Flow chart showing the music selection processing of the present embodiment Flow chart showing the additional function determination processing of the present embodiment Diagram showing various data configurations used in this embodiment The figure which shows the mode of the monitor at the time of the range acquisition process of this embodiment. The figure which shows the music confirmation screen of this embodiment The figure for demonstrating music difficulty determination of this embodiment. The figure which shows the additional function selector child screen (at the time of low difficulty) of this embodiment The figure which shows the music confirmation screen (at the time of low difficulty) of this embodiment The figure which shows the additional function selector screen (at the time of high difficulty) of this embodiment The figure which shows the music confirmation screen (at the time of high difficulty) of this embodiment Flow chart showing the music reproduction process of the present embodiment The figure which shows the data structure of the range information of this embodiment. Flowchart showing additional function determination processing (with additional conditions) of another embodiment FIG. 6 is a diagram for explaining determination of a user's tone and music difficulty level according to another embodiment. The figure which shows the additional function selector screen (low difficulty, at the time of good condition) of other embodiment. The figure which shows the additional function selector screen of another embodiment (high difficulty, low key)

FIG. 1 is a diagram showing the configuration of the karaoke system of the present embodiment. The karaoke system according to the present embodiment includes a karaoke device 2 (commander) and a remote control device 1. The karaoke device 2 and the remote control device 1 are connected so as to form a network using the LAN 100 and the access point 130.

The karaoke device 2 installed in a store such as a karaoke box includes a sound control unit 25 as a performance unit for playing music. The karaoke device 2 also includes an operation unit 21 that receives various inputs from the user. The karaoke device 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits the input to the CPU 30. Further, the karaoke device 2 includes a hard disk 32 as a storage unit that stores various kinds of information. The karaoke device 2 includes a LAN communication unit 24 as a communication unit that connects to the LAN 100 and joins the network.

Further, the karaoke device 2 is provided with a video reproducing means for displaying the lyrics video and the background video on the monitor 41. This video reproducing means is a video reproducing section 29 for reproducing the video based on the video information, a video RAM 28 for temporarily accumulating the video to be reproduced, a video for superimposing a lyric telop on the reproduced video, and giving a video effect. The control unit 31 is provided.

Further, the karaoke device 2 can display various information on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays the video information input from the video control unit 31 and a touch panel 34 that outputs the touch-input position to the operation processing unit 22. The touch panel monitor 33 functions as an input unit, like the operation unit 21 of the karaoke device 2 or the touch panel monitor 11 of the remote control device 1. By selecting a song on the touch panel monitor 33, the user can perform various operations on the karaoke device 2, such as making the karaoke device 2 make a reservation directly.

Further, the karaoke apparatus 2 is configured to include a CPU 30 for controlling and controlling each component, and a control unit including a memory 27 for temporarily storing information necessary for executing various programs.

With such a configuration, the karaoke device 2 executes various processes, but the main functions of the karaoke device 2 are capable of executing music reservation processing, music reproduction processing, and the like. The music reservation process is a process for designating and reserving a music based on the designation from the user, and is executed in cooperation with the remote control device 1. The reservation information formed by the music selection process of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in the reservation table in the memory 27. The music reproduction process is a process for reproducing the reserved music, and is a process in which the music performance process and the lyrics reproduction process are executed in synchronization with each other.

The music performance process is a process for causing the sound control unit 25 to perform a performance based on the performance information included in the music information. The music played by the sound control unit 25 is emitted from the speaker 42 together with the singing voice input from the microphones 43a and 43b. The lyrics reproduction process is a process of performing song assistance by displaying the lyrics information included in the music information on the monitor 41. A background image display process for displaying a background image by superimposing it on the lyrics displayed in the lyrics reproduction process may be executed.

On the other hand, the remote control device 1 is capable of executing a music selection process of searching for a music piece based on an instruction from the user and transmitting reservation information to the karaoke device 2 for a music piece for which a reproduction instruction has been given. Further, the remote control device 1 can receive various information from the karaoke device 2 or the host device 5 connected to the Internet, and can execute various processes. In this embodiment, the operation unit 17 and the touch panel monitor 11 are provided as a user interface that receives various instructions from the user. The touch panel monitor 11 is configured to include a display unit 11a and a touch panel 11b, displays various interfaces on the display unit 11a, and can accept touch input from a user.

Further, the remote controller 1 controls the memory 14 as a storage unit for storing a database required for the music selection process, various programs, and various information generated by the program execution, and for integrally controlling these configurations. The remote control unit is included. The remote controller control unit interprets an input from the CPU 15, a video control unit 13 that forms a video to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores video information to be displayed, the touch panel monitor 11 or the operation unit 17. Then, the operation processing unit 18 for notifying the CPU 15 is included.

The remote control device 1 is wirelessly connected to the access point 130 by the wireless LAN communication unit 16, and thus is connected to the network configured by the LAN 100. Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 will be received by the associated karaoke device 2.

With such a configuration of the remote control device 1, various input from the user is received from the touch panel monitor 11 or the operating unit 17, and various information is provided by displaying the video information on the touch panel monitor 11, so that the karaoke device 2 is provided. It is possible to perform various kinds of processing such as music selection processing for transmitting reservation information to be output.

The present invention is characterized by the music selection device such as the remote controller 1 capable of executing the music selection process as described above. Note that the music selection process can be performed on the karaoke device 2 side instead of being performed on the remote control device 1.

FIG. 2 is a flowchart showing the music selection processing of this embodiment. Here, the music selection process executed by the remote controller 1 will be described. When using the karaoke system, a user who has registered in advance can use the remote control device 1 to log in to the karaoke system and receive a service using his or her own user information.

FIG. 6 shows a music confirmation screen of this embodiment. The login state of the user will be described using this music confirmation screen. In the login user field 103, the personal image 103a to 103e (face portion in this embodiment) of the user who has logged in to the karaoke system is displayed. In addition, the user whose background is highlighted (white) at the right end in the login user column 103 is the active user 103e (Mr. A in this example), and the service for the active user 103e, that is, the user information of the active user 103e. The service that uses is running. Switching of the active user can be performed by operating the user switching button 101. Further, a user who has not registered as a user can operate the guest button 102 to use the karaoke system as a guest user.

The remote control device 1 makes it possible to recommend an additional function using the range information in the user information. When the user starts the music selection process using the remote control device 1, the range acquisition process for the active user is executed (S101). The range acquisition process is a process of acquiring range information indicating a range in which the active user can speak, and the range information is defined by the highest pitch value and the lowest pitch value. In the present embodiment, the karaoke device 2 is used to execute the range acquisition process to measure the range of the current active user, but the range acquisition process may be performed on the remote control device 1 side.

FIG. 5 shows the state of the monitor 41 during the range acquisition processing of this embodiment. The range acquisition process is a process performed for each user. As shown in FIG. 5, the musical notes 401 are sequentially scrolled from right to left on the score 401, and the pitched performance sound corresponding to the current sound 402 is played by the speaker 42. To output from. The user speaks using one of the microphones 43a and 43b so as to match the pitch with the performance sound output from the speaker 42. If the pitch of the voice input to the microphones 43a and 43b matches the pitch of the current sound 402, the karaoke apparatus 2 determines the pitch of the current sound as the sungable pitch. The karaoke device 2 sequentially increases the current sound 402 by scrolling the notes, and determines the lowest singerable pitch (lowest pitch value) and the highest singerable pitch (highest pitch value). Judgment is made and the range information of the user to be measured is acquired and stored in the user information together with the measurement date.

FIG. 4A shows the data structure of user information. The user information is configured to include a user ID for identifying the user, a password for performing authentication at the time of login, and range information measured in the range acquisition process. In the present embodiment, the range information is stored in the user information in this way. For example, when the music selection is performed again on the same day, the range information stored in the user information is read to perform the music selection process. It is possible to omit the range acquisition process at the time. In another embodiment described later, the tone of the user's singing is determined based on the history of the range information.

As the range acquisition process, the scoring function of the karaoke device 2 can be used in addition to the form described in FIG. It is possible to measure the highest pitch value and the lowest pitch value that the user can utter using the singing voice input to the microphones 43a and 43b during the music reproducing process. In the present embodiment, the range information formed by the highest pitch value and the lowest pitch value is used, but either the highest pitch value or the lowest pitch value (the pitch limit value in the present invention) is used. May be.

After acquiring the current user's range (highest pitch value, lowest pitch value) in the range acquisition process (S101), the user uses the search function of the remote control device 1 to select a song to be sung (S102: Yes). Then, the music confirmation screen of the selected music is displayed. The song confirmation screen displays song-related information such as singer name, song name, and singing. The user should refer to these song-related information to check whether the song he or she wants to sing is correct. You can After the music is selected, the additional function determination process (S200) using the selected music and the acquired musical range of the user is executed. The additional function determining process (S200) is a process for determining an additional function preferable for the user to use.

FIG. 3 is a flowchart showing the processing of the additional function determination processing (S200) of this embodiment. In the additional function determination process (S200), first, the range information of the user acquired in the range acquisition process (S101) is read (S201). Then, music range information of the selected music is acquired (S202).

FIG. 4C is a diagram showing the data structure of the music information of this embodiment. The music information has meta information including various information related to the music information and actual information for executing various processes such as performance and displaying lyrics. The meta information has music-related information such as a music ID for identifying music information, a music name, a singer name, a lyricist name, and a composer name. The music related information can be used as a search target item when the user searches for music. In this embodiment, the musical composition range information is included in the meta information. The musical range information is, like the user's musical range information, information defined by the lowest pitch value and the highest pitch value when the song is sung. The range information of the user read in S201 is compared with the range information of the music read in S202 (S203), and it is determined whether the selected music has a high difficulty level or a low music level for the user (S204).

FIG. 7 is a diagram for explaining the music difficulty determination of the present embodiment. FIG. 7(A) is an example of a song determined to have a low difficulty level for singing for the selected user. The measured range corresponds to the range information acquired in the range acquisition process, and the range of the selected song corresponds to the song range information included in the meta information of the selected song. As shown in FIG. 7A, when the range of the selected song is included in the measured range, the difficulty level of the selected song is determined to be low (S204: low), and the additional function is displayed on the song confirmation screen. The first additional function is presented on the selector screen 107 (S205). On the other hand, as shown in FIG. 7B, when the measurement range exceeds the range of the selected song (at least one of the lowest pitch value and the highest pitch value), the difficulty level of the selected song is determined to be high (S204). : High), the second additional function is presented on the additional function selector screen 107 on the music confirmation screen (S206).

8 and 10 show the additional function selector screen 107 displayed on the touch panel monitor 11. FIG. 8 shows the additional function selector screen 107 when the selected song has a low degree of difficulty for the user as shown in FIG. 7(A). On the other hand, FIG. 10 is an additional function selector screen 107 in the case where the selected song has a high degree of difficulty for the user as shown in FIG. 7B. The karaoke device 2 can execute various additional functions. At present, a large number of additional functions are prepared and it is possible for the user to select by themselves, but in the present embodiment, the additional function according to the singing ability state of the user is used by the additional function selector screen 107. And recommended to users.

The additional function selector screen 107 shown in FIG. 8 includes a comment display field 108a for displaying a comment according to the degree of difficulty for the user, an additional function specification field 109a for presenting a plurality of additional functions and allowing the user to select the additional function. An additional function unspecified column 110 and a decision button 111 to be selected when is not used are displayed. The user selects an additional function to be used from the additional functions presented in the additional function specification column 109a, or selects the additional function non-designation column 110 when the additional function is not used.

The additional function designation field 109a in FIG. 8 is displayed in the case of a song having a low difficulty level for the user as shown in FIG. 7A, and the user can select any of the six additional functions. .. (1) Nationwide scoring is an additional function of performing singing evaluation based on singing voices input to the microphones 43a and 43b during music reproduction processing, and competing users nationwide for a scoring value as a result of singing evaluation. (2) The analysis scoring is an additional function of performing singing evaluation based on the singing voice input to the microphones 43a and 43b during the music reproducing process and evaluating the singing of the user from a plurality of evaluation item viewpoints. (3) The challenge scoring is an additional function of performing song evaluation based on the song voice input to the microphones 43a and 43b during the music reproduction process, and stopping the music reproduction process when the song evaluation does not satisfy the criterion. .. (4) The karaoke competition is an additional function of competing users who are seated in the ranking of singing evaluation. (5) Video posting is an additional function of capturing an image of a singing user with the camera 44, uploading it to the server together with the recorded singing voice, and disclosing it on the web. Then, (6) recording posting is an additional function of uploading the recorded singing voice to the server and disclosing it on the web.

On the other hand, the additional function selector screen 107 shown in FIG. 10 is displayed in the case of a music having a high difficulty level for the user as shown in FIG. 7B. In the comment display field 108b, the comment content indicating that the user has a high degree of difficulty is displayed. The user can select one of the two additional functions by using the additional function designation field 109b. (1) The voice training is an additional function of assisting the singing by reproducing the sound of the singing melody loudly when reproducing the music. (2) The weak area training is an additional function for strengthening a section where it is difficult to sing by performing song evaluation during music reproduction and repeatedly reproducing a section that does not satisfy a certain standard.

As described above, in the present embodiment, the additional function considering the degree of difficulty for the selected music piece for the user is recommended. In particular, when a song having a low difficulty level is selected by the user, as shown in the additional function selector screen 107 of FIG. The first additional function) is included. On the other hand, when a song having a high difficulty level is selected for the user, as shown in the additional function selector screen 107 of FIG. 10, an additional function (second Additional functions), for example, additional functions specialized for singing practice are included.

The user performs an operation of selecting an additional function desired to be used (touches a frame displayed to the left of the name of the additional function) from the plurality of additional functions displayed in the additional function designation fields 109a and 109b, or When the additional function is not used, the additional function unspecified column 110 is selected and operated, and the enter button 111 displayed at the lower right is operated (S207).

When the additional function is selected on the additional function selection child screen 107 (S207: Yes), the selected additional function is associated with the music displayed on the music confirmation screen (S208). On the other hand, when the additional function undesignated column 110 is selected and the additional function is not selected (S207: No), the additional function determination process ends without associating the additional function. FIG. 9 is a music confirmation screen when an additional function (national scoring) is selected on the additional function selector screen 107 of FIG. 8, and FIG. 11 is an additional function (on the additional function selector screen 107 of FIG. It is a music confirmation screen when (voice training) is selected. The song confirmation screen displays song-related information such as singer name, song name, and singing. The user should refer to these song-related information to check whether the song he or she wants to sing is correct. You can

Further, this music confirmation screen is provided with an additional function selection field 105, and the user can use the "change" button displayed at the lower right of the additional function selection field 105 to add an additional function to be used during music reproduction. It is possible to change the function. In the music confirmation screens of FIGS. 9 and 11, the additional function selected by the user on the additional function selector screen 107 of FIGS. 8 and 10 (“national scoring” in FIG. 9 and “voice” in FIG. 11 respectively). Training”) is selected. The user uses this additional function selection field 105 when he or she wants to select an additional function other than the one recommended on the additional function selection child screen 107 or to change the additional function selected on the additional function selection child screen 107. Then, the additional function can be selected and changed.

A reservation button 106 is provided on the music confirmation screen, and by operating the reservation button 106 (S104: Yes), reservation information is transmitted from the remote control device 1 to the karaoke device 2 (S105). FIG. 4B shows a data structure of reservation information. The reservation information includes a music ID for identifying the music to be reserved, a user ID for identifying the user who made the reservation (active user), and an additional function ID for identifying the selected additional function. There is. The karaoke device 2 registers the received reservation information in the reservation table and executes the music reproduction process.

FIG. 12 is a flow chart of the music reproduction process of this embodiment. After being activated, the karaoke apparatus 2 executes the music reproduction process to reproduce the music reserved by the user. When the music reproducing process is started, the karaoke device 2 checks the reservation information registered in the reservation table (S301) to confirm whether or not there is a music to be reproduced next. When it is determined that there is a music piece to be reproduced next (S302: Yes), the music piece information corresponding to the music piece ID included in the reservation information is read out and the music piece reproduction is started (S303).

The music reproduction is executed based on the actual information in the music information. As shown in FIG. 4C, the actual information of the music information includes performance information, lyrics information, and song evaluation information. The performance information is information for playing the accompaniment sound of karaoke, which is configured to include control information for an electronic musical instrument based on the MIDI standard, or compressed audio information recording an actual performance. The lyrics information is information displayed in synchronization with the performance information to assist the singing, and the lyrics displayed in synchronization with the performance may be changed in color. The singing evaluation information is information for evaluating the singing voice of the user at the time of reproducing the music and is configured to include a melody to be sung. When performing song evaluation during music reproduction, it is possible to calculate a score value by comparing the song evaluation information input to the microphones 43a and 43b with the song evaluation information.

When an additional function is specified for the music to be played, that is, when the additional information ID is included in the reservation information (S304: Yes), the additional function corresponding to the additional function ID at the time of reproducing the music. Is executed (S306). The additional function is a function executed during music reproduction, such as song evaluation, recording, recording, and singing practice, as described in the additional function selector screen 107 of FIGS. On the other hand, when the additional function is not designated for the music to be played (S304: No), the additional function is not executed during the reproduction of the music. When it is determined that the music reproduction is completed (S305, S307: Yes), the process returns to the beginning of the flow to execute the music reproduction process for the next music.

In the above, regarding the karaoke system of the present embodiment, the determination of the additional function using the change of the user's range has been described, but by adopting such a configuration, there are many additional functions that can be used in the karaoke system. In the middle, the user can use the additional function according to the difficulty level for the selected song. It should be noted that the present invention is not limited to the above-described embodiment, and various modified examples can be adopted.

In the above-described embodiment, the additional function is determined based on the difficulty level of the music for the user, but it is also possible to add the condition to the determination of the additional function. In the modification, the tone of the user's singing is adopted as an additional condition for determining the additional function. FIG. 13 is a diagram showing a data structure of range information used in the modified example. The range information is configured to include the measurement date, the highest pitch value, and the lowest pitch value. The range information used in the modified example is recorded together with the measurement date in this way. In the modified example, the tone of the user's singing is determined using the history (change over time) of the range information acquired in the range acquisition process (S101).

FIG. 14 is a flowchart showing the additional function determination process (with additional conditions) used in the modification. In the flow chart of FIG. 14, the processes having the same reference numerals as those in the flow chart of FIG. 3 have the same contents, and thus the description thereof is omitted here. In the modified example, the amount of change in the range information over time is calculated (S251), and the tone of the user's singing is determined. FIG. 15 is a diagram for explaining determination of a user's tone and musical piece difficulty level in a modified example. In FIG. 15, FIG. 15(A-1) and FIG. 15(B-1) show the case where the user is in good condition. In the range information, when the amount of change is detected by comparing the first measurement range acquired by the previous range acquisition process with the second measurement range newly acquired this time, and the amount of change is expanded (for example, 15(A-1) and FIG. 15(B-1)), it is determined that the user's singing ability is good. On the other hand, when the amount of change is reduced (for example, the state of FIG. 15(A-2) and FIG. 15(B-2)), it is determined that the user's singing ability is poor.

In the modified example, in addition to the case classification according to the difficulty level of the music for the user (S252), the case classification according to the user's condition (S253, S254) is performed. By using these two conditions, four additional function selector screens S255 to S258 are displayed.

If the user has a low difficulty level and the user is doing well (in the case of FIG. 15(A-1)), the additional function selector screen 107 that recommends the first additional function is displayed as in FIG. 8 (S255). ). In this case, since it is considered that the music can be easily sung by the user, an additional function (first additional function) of competing with other users in the order of singing evaluation, or recording or recording is recommended.

When the user has a high degree of difficulty and the user is in a bad condition (in the case of FIG. 15B-2), the additional function selector screen 107 that recommends the second additional function is displayed as in FIG. (S258). In this case, singing is considered to be a difficult song for the user, so competing with other users in the ranking of singing evaluation, or performing additional singing assistance or singing practice without including additional functions to record such as recording and recording. The additional function (second additional function) is recommended.

If the user has a low degree of difficulty but the user is not in good condition (in the case of FIG. 15A-2), the additional function selector screen 107 that recommends the first and second additional functions is displayed ( S256). FIG. 16 is a diagram showing the additional function selector screen 107 (low difficulty level, in case of malfunction) in this case. The additional function selector screen 107 is provided with an additional function specification column 109a for selecting the first additional function and an additional function specification column 109b for selecting the second additional function. In addition, comment display columns 108c and 108d for the additional functions are provided in the additional function designation columns 109a and 109b, respectively, and comments for the first additional function and the second additional function are displayed. In this way, when the difficulty level is low for the user, but when the user is sick, both the first and second additional functions are recommended to widen the range of selection by the user. At that time, comments corresponding to the determination results in S252 and S253 are displayed in the additional function designation fields 109a and 109b, respectively, so that the user can refer to them for selecting additional functions. ..

When the user has a high degree of difficulty and the user is doing well (in the case of FIG. 16(B-1)), the additional function selector screen 107 for recommending the first and second additional functions is displayed as in S256. It is displayed (S257). FIG. 17 is a diagram showing the additional function selector screen 107 (low difficulty level, in case of malfunction) in this case. On the additional function selector screen 107, an additional function specification field 109a for selecting the first additional function, an additional function specification field 109b for selecting the second additional function, and a comment display field 108c for the additional function. , 108d are provided. Comments corresponding to the determination results in S252 and S253 are displayed in the comment display fields 108c and 108d, which are different from the comment contents in the comment display fields 108a and 108b in FIG.

As described above, in the modified example, the additional function is determined by using the amount of change in the range information, and it is possible to determine the additional function according to the tone of the user. Below, the above-mentioned embodiment and other embodiments regarding modifications will be described.

In the above-described embodiment and modified example, it is assumed that additional functions corresponding to two levels of difficulty (high or low) are recommended based on the basic condition of comparing the user's range information with the range information of the selected song. However, it is also possible to set the difficulty determination in three or more steps. In that case, the additional function according to each judged stage is recommended. Further, the additional condition based on the amount of change in the range information is not limited to the two-stage tone determination (good or bad), and the tone determination may be performed in three or more stages. When additional conditions are used, instead of using the basic conditions (difficulty level determination) and additional conditions (tone determination) as in the modified example, the user range information and music range are replaced. It is also possible to select the recommended additional function by using both the value obtained by comparing the information and the variation amount of the range information.

In the above-described embodiment and modification, the additional function selector screen 107 is recommended and the user is allowed to select the additional function. However, the additional function to be used is determined without the user's selection, and the additional function is used when the music is reproduced. Good. Further, in the above-described embodiment and modification, the user is allowed to select the additional function to be used on the music confirmation screen. However, when the user is allowed to select it, if it is the period from the selection of the music to the reproduction. The user may be allowed to select the additional function at an appropriate timing.

In the above embodiment, the range information (speech feature information) measured in the range acquisition process (S101) is acquired, but the range information (speech feature information) is not limited to the form measured in the range acquisition process. Instead, the value set and input by the user may be used. Alternatively, the current range information estimated based on changes in the range information measured in the past may be used. In addition, in the modified example, it is necessary to measure the range information in order to check the tone of the user, but the range information is measured for each music selection process in which one piece of music is reserved as in the above-described embodiment and the modified example. The range acquisition process (S101) is not limited to the mode in which the process is performed, and the process may be performed at least once when the user logs in, at an appropriate timing. In addition, when performing a plurality of times, since the tone of the voice may be improved by singing, the tone of the user may be determined based on the amount of change between the ranges measured on the day. ..

In the above-described embodiment, the additional function is associated with each reserved music piece, but the additional function that is once decided to be used may be continuously used during the use of the karaoke system. In the karaoke system of the present embodiment, since a plurality of users log in and use it, the additional function to be used may be associated with each user, or the determined additional function may be applied to all users. The user may select whether or not to continue to use the additional function from the above.

In the modified example described with reference to FIG. 15, the first measurement range measured last time and the second measurement range measured this time are compared, but the first measurement range that is the past measurement range has been changed so far. It may be calculated by, for example, taking the average of a plurality of sound ranges measured in step 1.

In the above-described embodiment, the voice range (range information) is used as the voice feature information about the user's voice, but the voice feature information includes the highest pitch value and the lowest pitch value like the range information. Alternatively, it may be either the highest pitch value or the lowest pitch value. For example, in a mode in which only the highest pitch value is used, the difficulty level of the music for the user can be determined by comparing the highest pitch value of the user with the highest pitch value of the music. Further, it is possible to determine the tone of the user based on the history of the highest pitch value of the user.

As the voice feature information, not only the pitch of the voice but also the volume (volume) of the voice may be used. As an additional condition for checking the user's condition, when the volume of the voice is used, the amount of change is detected by comparing the previously acquired first measured volume range with the newly acquired second measured volume range. If is increasing, it is determined that the user's singing ability is good. On the other hand, when the amount of change is reduced, it is determined that the user's singing ability is poor. Alternatively, either the upper limit value or the lower limit value may be used as the volume limit value to determine the tone of the singing ability of the user. Alternatively, in the case of the volume, the judgment may be made not by the upper limit value or the lower limit value but by an index relating to the voice volume. For example, in the voice volume acquisition process instead of the range acquisition process of the above-described embodiment, the user is made to sing a specific phrase, and the average value of the volume of the sung singing voice is measured as voice volume information that is an index of the user's singing ability. .. When the voice volume information measured this time is higher than the voice volume information measured in the past, it is determined that the singing ability of the user is good. On the other hand, when the voice volume information measured this time is lower than the voice volume information measured in the past, it is determined that the singing ability of the user is poor. As described above, as the voice feature information, one or both of the value regarding pitch and the value regarding volume may be used. As for the value related to the pitch and the value related to the volume, at least one of the upper limit value and the lower limit value can be used. Further, as the value related to the volume, it is possible to use an average value of singing voices, which is an index of the voice volume of the user.

Although the music selection process by the remote control device 1 has been described above with respect to the embodiment of the present invention, this music selection process can be executed not only by the remote control device 1 but also by the karaoke device 2. That is, the remote control device 1 or the karaoke device 2 can function as the music selection device in the present invention. In addition, recently, it has become possible to perform similar music selection processing using a mobile terminal device such as a smart phone possessed by a user. A portable terminal device that executes such music selection processing also belongs to the category (music composition device) of the present invention. Further, a music selection program for realizing music selection processing in various information processing devices such as the remote control device 1, the karaoke device 2, the mobile terminal device, etc., also belongs to the category of the present invention.

1: Remote control device 33: Touch panel monitor 2: Karaoke device 34: Touch panel 5: Host device 35: Display unit 11: Touch panel monitor 41: Monitor 11a: Display unit 42: Speaker 11b: Touch panel 43a, 43b: Microphone 12: Video RAM 44 : Camera 13: Video control unit 101: User switching button 14: Memory 102: Guest button 15: CPU 103: Login user column 16: Wireless LAN communication unit 103a to 103e: Alternate image 17: Operation unit 105: Additional function selection column 18 : Operation processing unit 106: reservation button 21: operation unit 107: additional function selector screen 22: operation processing unit 108a to 108d: comment display column 24: LAN communication unit 109a: additional function designation column (first additional function)
25: Acoustic control unit 109b: Additional function specification field (second additional function)
27: Memory 110: Additional function unspecified column 28: Video RAM 111: Enter button 29: Video playback unit 130: Access point 30: CPU 401: Music score 31: Video control unit 402: Sound 32: Hard disk

Claims (7)

Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music feature information corresponding to the music selected in the music selection process and the pitch included in the voice feature information, the difficulty level of the music for the logged-in user is determined as a condition. , Based on the conditions, to determine the additional function according to the singing ability state of the user, the additional function determination process to associate with the song selected in the song selection process,
Performing a change amount determination process of determining the change amount of the range information over time,
The music selection device, wherein the additional function determination process uses the change amount determined by the change amount determination process as an additional condition for determining the additional function. The music selection apparatus according to claim 1, wherein the voice characteristic information acquired by the voice characteristic acquisition process is acquired by measuring a voice input from a microphone. The music selection apparatus according to claim 2, wherein the voice characteristic acquisition processing acquires the voice characteristic information based on a singing voice of the login user input from the microphone when the music is reproduced. The additional function determination process determines the additional function by presenting the additional function corresponding to the condition or the condition and the additional condition and causing the logged-in user to select the additional function. 4. The music composition selecting device according to claim 3. The additional function determined by the music selection processing is the first additional function when both the condition and the additional condition are satisfied, and the second additional function when both the condition and the additional condition are not satisfied. Function and
The first additional function is an additional function of competing with other users for ranking of song evaluation,
The music selection device according to any one of claims 1 to 4, wherein the second additional function does not include an additional function of competing with another user in a ranking of song evaluation. A karaoke system including a reproduction unit and a control unit,
The reproducing unit can reproduce music information,
The control unit is
Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music feature information corresponding to the music selected in the music selection process and the pitch included in the voice feature information, the difficulty level of the music for the logged-in user is determined as a condition. , Based on the conditions, to determine the additional function according to the singing ability state of the user, the additional function determination process to associate with the song selected in the song selection process,
A reproduction process of causing the reproduction unit to reproduce the music information corresponding to the music selected in the music selection process, and executing the additional function determined in the additional function determination process,
Run a variation determination process of determining temporal variation of the sound area information, and
The karaoke system, wherein the additional function determination process uses the change amount determined in the change amount determination process as an additional condition for determining the additional function. Login process that logs the user in as a login user,
A voice feature acquisition process for obtaining voice feature information of the login user,
Music selection processing for accepting selection of music by the login user,
Based on the relationship between the pitch included in the music characteristic information corresponding to the music selected in the music selection process and the pitch included in the voice characteristic information, the difficulty level of the music for the logged-in user is determined as a condition, Based on the conditions, the additional function according to the singing ability state of the user is determined, the additional function determination process associated with the song selected in the song selection process,
A variation determination process of determining temporal variation of the sound zone information, was executed in the information processing apparatus,
The music selection program, wherein the additional function determination process uses the change amount determined in the change amount determination process as an additional condition for determining the additional function.