JP2015191160A - Program for karaoke, information processor and host device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program for Karaoke which allows a user to listen to a part in a designated section in sound recording information obtained by recording singing and confirm evaluation information for the listening part.SOLUTION: A program for Karaoke makes an information processor execute: a transmission step of transmitting posting information including sound recording information corresponding to a section received by a reception step to a host device; a reproduction step of reproducing the sound recording information included in the posting information received from the host device; and a display step of displaying on display means evaluation information formed on the basis of singing reference information corresponding to music information used at the time of sound recording of the sound recording information and a singing voice being an object of sound recording of the sound recording information in synchronization with reproduction of the sound recording information.

Description

  The present invention relates to a karaoke program that can be executed by various information processing apparatuses such as a portable terminal, a personal computer, and a karaoke apparatus, an information processing apparatus, and a host apparatus.

  Conventionally, at night stores such as karaoke boxes and snacks, karaoke is enjoyed to enjoy singing along with the performance. Currently, with the spread of mobile terminals and personal computers and the development of communication infrastructure via the Internet, not only karaoke devices installed in karaoke boxes, but also personally owned mobile terminals (smartphones, mobile phones, tablet terminals, etc.), It is possible to enjoy karaoke by using various information processing devices such as a personal computer and a home game machine.

  It is possible to perform karaoke by executing the karaoke program in such an information processing apparatus. Currently, karaoke dealers provide karaoke programs on smartphones and tablet terminals, and users can enjoy karaoke by acquiring karaoke programs via a communication line and installing them on the corresponding information processing device. ing.

  Patent Document 1 discloses a moving image information distribution system capable of distributing a singing voice and moving image information in which a state of singing is recorded. This moving image information distribution service provides a new way of enjoying posting by a plurality of users by combining moving image information of a plurality of users. Specifically, by uploading the video information recorded using the karaoke device to the host device and publishing it, distributing the released video information to the collaborator user, and creating further recording information, It is possible to create a collaboration video with one song.

JP 2012-209856 A

  As seen in the video information distribution system disclosed in Patent Document 1, in the field of karaoke, not only how to enjoy singing, but also singing and singing to other people (singing posting service) ) Has come to be enjoyed. In the singing posting service, singing voices recorded through one piece of music are usually posted. Therefore, when listening to the posted singing voice, it is necessary to reproduce it from the beginning of the music, and as a result, it takes time to listen to even the singing voice that is not of interest. For this reason, it took time and effort to find a favorite one from among many singing voices.

  In addition, the amount of communication required for posting the singing voice recorded through one song has increased, and it has not been possible to easily post (or listen to the posted singing) using a mobile communication network such as a smartphone. . In addition, the volume of recorded information recorded through one piece of music is large, and it is expected that the load on the host device that stores and publishes the posted singing voice will also increase. Therefore, it is not easy to enjoy posting and listening to information processing devices owned by individuals.

  In view of such circumstances of karaoke singing postings, the present invention aims to improve services related to singing postings and listening to information processing devices owned by individuals such as smartphones. Furthermore, this invention aims at confirming on the user side which reproduces the posted song how the posted song is different from the original song.

Therefore, the karaoke program according to the present invention is characterized by adopting the following configuration.
A karaoke program executed in an information processing apparatus capable of communicating with a host device via a network,
A storage step of storing recording information including singing voice information indicating the singing voice input from the microphone in the storage means;
An accepting step of accepting designation of a section from among the reproduction sections of the recording information stored by the storing step;
A transmission step of transmitting post information including the recording information corresponding to the section received by the reception step to a host device;
A reproduction step of reproducing the recording information included in the posted information received from the host device;
In synchronization with the reproduction of the recording information, the evaluation information formed based on the singing reference information corresponding to the music information used at the time of recording the recording information and the singing voice that is the recording target of the recording information. And a display step of displaying on the display means.

Furthermore, in the karaoke program according to the present invention,
The storage step forms and stores evaluation information based on the singing reference information corresponding to the music information and the singing voice input from the microphone,
In the transmission step, the evaluation information stored in the storage step is included in post information and transmitted to the host device.

Furthermore, in the karaoke program according to the present invention,
The reproduction step forms evaluation information based on the singing reference information corresponding to the music information used when recording the recording information and the recording information.

Furthermore, in the karaoke program according to the present invention,
The storing step extracts the pitch information from the singing voice input from the microphone and stores it in the storage means,
The transmitting step transmits post information including the recording information and pitch information corresponding to the section received by the receiving step to a host device,
The reproduction step forms evaluation information based on the singing reference information corresponding to the music information used when recording the recording information and the pitch information.

Furthermore, the karaoke program according to the present invention is:
Causing the information processing apparatus to further execute a second receiving step of accepting the change of the singing standard information;
In the reproduction step, evaluation information is formed based on the singing standard information accepted in the second acceptance step and the recording information or the pitch information.

Furthermore, in the karaoke program according to the present invention,
The reproduction step forms second evaluation information based on the singing voice input from the microphone and the singing reference information corresponding to the music information used when recording the recording information,
In the display step, the second evaluation information is displayed on the display means in synchronization with the reproduction of the recorded information.

An information processing apparatus according to the present invention includes:
An information processing apparatus capable of communicating with a host device via a network,
Storage means for storing recording information including singing voice information indicating a singing voice input from a microphone;
Accepting means for accepting designation of a section from the reproduction sections of the recording information stored in the storage means;
Transmitting means for transmitting post information including the recording information corresponding to the section received by the receiving means to a host device;
Playback means for playing back recording information included in the posted information received from the host device;
In synchronization with the reproduction of the recording information, the evaluation information formed based on the singing reference information corresponding to the music information used at the time of recording the recording information and the singing voice that is the recording target of the recording information. Display means for displaying on the display means.

  According to the karaoke program and the information processing apparatus according to the present invention, the recorded information recorded in synchronization with the reproduction of the music information is transmitted (posted) as the post information for a specified predetermined time section. It is possible to reduce the volume of recording information included in the posted information and reduce the burden on the host device and the communication line. Moreover, it becomes possible for the user who contributes to specify the listening place of the singing. In addition, for the listener who listens to the posted information, it is possible to listen to the singing listening place with respect to the uploaded posted information, and it is possible to efficiently listen to the posted information.

  Furthermore, when playing the posted information, by displaying on the display means the evaluation information formed based on the singing standard information corresponding to the music information used at the time of recording the recording information and the singing voice that was the recording target, The user who plays the posted song can check how the posted song is different from the original song. Therefore, the user who reproduces the posting information can check an excellent singing location and an inferior singing location in the posting information. Also, in the posted information, it is conceivable that singing and turning different from the original singing will gain popularity. By referring to the evaluation information, the user who plays the posted information can objectively confirm the characteristics of the song that is different from the original.

The schematic diagram which shows the mode of the singing contribution which concerns on embodiment of this invention The figure which shows the portable terminal (information processing apparatus) which concerns on embodiment of this invention. The figure which shows the data structure of the music information which concerns on embodiment of this invention. The flowchart which shows the posting process in the portable terminal which concerns on embodiment of this invention The block diagram which shows the reproduction | regeneration processing (at the time of the first time) which concerns on embodiment of this invention The figure which shows the music selection screen which concerns on embodiment of this invention The figure which shows the music detail screen which concerns on embodiment of this invention The figure which shows the music song screen which concerns on embodiment of this invention. The figure which shows the scoring result display screen which concerns on embodiment of this invention The figure which shows the recording information management screen which concerns on embodiment of this invention The figure which shows the recording information edit screen which concerns on embodiment of this invention The figure which shows the various forms of the edit window which concerns on embodiment of this invention The figure which shows the contribution related information input screen which concerns on embodiment of this invention. The figure which shows the data structure of the contribution information which concerns on embodiment of this invention. The figure which shows the scoring ranking screen which concerns on embodiment of this invention The block diagram which shows the reproduction | regeneration processing (at the time of contribution information reproduction | regeneration) concerning embodiment of this invention The figure which shows the recording information reproduction screen which concerns on embodiment of this invention The block diagram which shows the reproduction | regeneration processing (at the time of the first time) which concerns on other embodiment of this invention. The figure which shows the data structure of the contribution information which concerns on embodiment of this invention. The block diagram which shows the reproduction | regeneration processing (at the time of contribution information reproduction | regeneration) concerning embodiment of this invention

  FIG. 1 is a schematic diagram showing a state of a singing contribution according to an embodiment of the present invention, and is a diagram showing a configuration of the entire singing contribution system. The singing contribution system according to the present invention has various information processing devices (mobile terminal, karaoke device, personal computer, etc.) in which a karaoke program is installed, with the karaoke host device 5 as the core. The karaoke host device 5 and the various information processing devices are communicatively connected via a network such as the Internet. Various forms such as a smartphone, a tablet terminal, and a mobile phone can be used for the mobile terminal. In the figure, for the sake of convenience, the posting terminal for posting and the listening terminal for listening to posts are described separately. However, the posting function and the listening function for posting may be provided in the same terminal (information processing apparatus). Good.

  A singing contribution when using a mobile terminal will be described. A karaoke program is installed in advance on the mobile terminal, and the user requests the karaoke host device 5 for a song to be sung using the karaoke program. In the case of a portable terminal, music information to be played is not stored, so music is requested from the karaoke host device 5 and performance is performed based on the received music information (non-accumulation type). On the other hand, in the case of a karaoke device, music information is previously received from the karaoke host device 5 and stored, and a performance is performed based on the stored music information (accumulation type). The music to be sung in this way may be acquired as either a non-accumulation type or an accumulation type.

  The portable terminal performs a performance based on the received music information. At that time, the singing voice is recorded in synchronization with the performance to form the recording information, and the posting information including the recording information is transmitted to the karaoke host device 5. The karaoke host device 5 that has received the posted information accumulates it in the storage unit 51 and also publishes various information related to the posted information, such as a song title and a poster, to the listening terminal side through the Web server 52. On the listening terminal side, post information desired to be listened to is selected based on various information disclosed through the Web server 52, and a request is made to the karaoke host device 5. Upon receiving the post information request, the karaoke host device 5 transmits the selected post information to the requested listening terminal. The listening terminal can play the received posted information and listen to the recorded recording information.

  A configuration of the mobile terminal 1 will be described as an example of an information processing apparatus capable of executing a karaoke program according to an embodiment of the present invention. FIG. 2 is a diagram showing a configuration of the mobile terminal 1 according to the embodiment of the present invention. As the mobile terminal 1, a smartphone, a tablet terminal, a mobile phone, or the like can be used. When the karaoke program according to the present invention is installed in the portable terminal 1, it becomes possible to execute a posting process that can post a singing voice.

  The mobile terminal 1 according to the present embodiment includes a control unit that includes a CPU 11, a RAM 12, a storage unit 13, an image processing unit 14, and an acoustic processing unit 16. The storage unit 13 can employ non-volatile storage means such as a hard disk or SSD. The storage unit 53 stores the karaoke program of this embodiment and various data used in the karaoke program.

  The CPU 11 is a unit that performs overall control of the mobile terminal 1 and executes various controls based on programs and data stored in the storage unit 13. The RAM 12 temporarily stores data generated by the control of the CPU 11.

  The acoustic processing unit 16 is a unit that performs input / output of acoustic relations of the mobile terminal 1. This is a means for causing the speaker 17a to emit sound under the control of the CPU 11. The acoustic processing unit 16 is connected to the microphone 17b, and can capture surrounding sounds such as a singing voice from the microphone 17b.

  The touch panel display unit 18 includes a display unit 18b that displays an image and a touch panel 18a disposed on the front surface or the back surface of the display unit 18b. Various types of touch panel 18a that can recognize the touch position of the user, such as a capacitance method, can be employed. The CPU 11 can display on the display unit 18b and determine which part of the displayed image is touch-input by touch input from the touch panel 18a.

  The image processing unit 14 is a means for inputting and outputting image relations of the mobile terminal 1. The image processing unit 14 displays and outputs the image formed by the CPU 11 on the display unit 18b. And it has the function to take in an image from the front camera 15F arrange | positioned at the front surface (touch panel display part 18 side) of the portable terminal 1, or the rear camera 15R arrange | positioned at the back surface of the portable terminal 1. FIG.

  The communication unit 19 can perform wireless communication using a mobile wireless network, a wireless LAN, and the like, and can wirelessly communicate with the access point to connect the mobile terminal 1 to the Internet. The mobile terminal 1 can download various programs (also called “applications”) including a karaoke program from a server on the Internet. The karaoke program may be installed from the external memory EX connected to the external memory connection terminal 22 in addition to the form using the communication line. The communication unit 19 may be further provided with short-distance communication means such as an infrared communication unit or Bluetooth (trademark).

  The mobile terminal 1 according to the present embodiment is configured to include an input switch 20 in addition to the touch panel 18a as input means. The input switch 20 can be provided with various switches such as a power switch, a volume control switch, and a switch whose input application is changed according to a program.

  In the portable terminal 1 of the present embodiment, it is possible to upload the recorded information recorded along with the song to the host device by installing the karaoke program.

  FIG. 3 shows a data structure of music information according to the embodiment of the present invention. The music information is information that is stored in the storage unit 51 of the karaoke host device 5 and distributed based on a request from the portable terminal 1. The mobile terminal 1 that has received the music information performs various processes based on the music information, such as playing performance information included in the music information. The music information of this embodiment is divided into meta information, which is various information related to the music information, and actual information that executes various processes such as performance. The meta information includes song identification information for identifying song information, song name, singer name, songwriter name, and composer name.

  The actual information of the music information includes performance information, lyrics information, guide vocal information, and reference pitch information (corresponding to “singing reference information” in the present invention). The performance information is composed of control information for an electronic musical instrument based on the MIDI standard, compressed audio information recording an actual performance, or the like, and is information for playing an accompaniment sound of karaoke. The lyric information is information that is displayed in synchronization with the performance information in order to assist the singing, and may be configured to change the color of the displayed lyrics in synchronization with the performance. Guide vocal information is audio information corresponding to a part to be sung, such as the main melody, and can be turned on / off by the user. The reference pitch information is information used for the evaluation process (scoring), and is information defining the pitch of the part to be sung. The song evaluation process is performed by comparing the pitch of the singing voice signal input from the microphone 17b with the reference pitch information.

  FIG. 4 is a flowchart showing the posting process according to the embodiment of the present invention. Here, the form at the time of using the portable terminal 1 is demonstrated. This posting process is started by starting a karaoke program on the portable terminal 1 and selecting a predetermined menu. In the posting process of the present embodiment, the user can give various instructions on the display screen 31 displayed on the touch panel display unit 18. When the posting process is started, the user can select a desired music via a music selection screen displayed on the display screen 31 (S101).

  FIG. 6 shows an example of a music selection screen according to the embodiment of the present invention. This music selection screen allows you to select the music recommended by the karaoke dealer, and displays music for each item such as “Featured work”, “Like! Ranking”, “Similar! Ranking” Has been. The user can select a song to be sung using this song selection screen. In addition, on the music selection screen, it is also possible to listen to post information posted on the displayed music. When listening is desired, it is possible to reproduce the posted information of the music by operating the playback button displayed on the right side of each music. Note that the selection of music is not limited to the music selection screen of FIG. 6, and it is also possible to search by specifying a music name or singer name.

  When the user decides a song to be sung, the song detail screen shown in FIG. 7 is displayed on the display screen 31. In this music detail screen, various information regarding the music, such as the song name and singer name, as well as various settings during performance can be made. In the present embodiment, it is possible to set the sound emission of guide vocals (guide vocal information described in FIG. 3), the key (performance pitch), and the tempo (performance speed). A user who confirms various information related to music and performs various settings related to performance operates the playback start button 311 labeled “singing” to start performance of the music information.

  On this music detail screen, tabs such as “My Score”, “Ranking”, and “Linked Service” are displayed, and the user can refer to related information by specifying a desired tab. . By selecting “My Score” among these, it is possible to view the highest score or history of the singing score for the displayed music. “Ranking” allows browsing the ranking of scoring information including other users for the displayed music. By operating the ranking detail display button 312 displayed on the right side, a detailed ranking can be viewed.

  By operating the reproduction start button 311 labeled “sing” (S102: Yes), the performance information is started to be played for the designated music piece (S103). In the present embodiment, the song evaluation process S104 and the recording process S105 are performed during the performance of the music. The singing evaluation process S104 is a process of evaluating the singing by comparing the reference pitch information included in the music information and the pitch of the singing voice signal input from the microphone 17b. In this embodiment, the singing evaluation is performed. It is set as the form which performs scoring converted into a score.

  The recording process S105 is a process of recording a singing voice signal input from the microphone 17b to form recording information. In the present embodiment, the recording sound signal and the performance sound signal based on the performance information are mixed and recorded. It has become. It is good also as recording only a song audio | voice signal not only in such a form. In that case, when the recorded information is reproduced, the singing state can be reproduced by performing the performance information of the corresponding music in synchronization.

  FIG. 8 shows a music singing screen displayed on the display screen 31 during music performance. On the song singing screen of the present embodiment, based on the lyrics display area 314 in which lyrics are synchronously displayed based on the lyrics information included in the song information, the reference pitch information and the singing voice input from the microphone 17b. An evaluation display area 313 that can confirm the singing evaluation is provided. The evaluation display area 313 has a horizontal axis as a time axis and a vertical axis as a pitch axis, and a pitch bar 313a based on reference pitch information scrolls to the left as the performance progresses. . The position indicated by the broken line corresponds to the current timing, that is, the singing position. In addition, the pitch of the singing voice input from the microphone 17b with the singing of the singer is sequentially formed on the left side of the broken line as a solid line 313b. In addition, it is good also as changing the display form (a color, a shape, etc.) of the bar of the singing location by the case where the pitch of a song voice adapts to reference | standard pitch information, and the case where it does not adapt.

  Thus, in the present embodiment, as evaluation information, the pitch based on the reference pitch information is displayed as the bar 313a during the singing, and the pitch of the singing voice input from the microphone 17b is displayed as the solid line 313b. It is possible to sing while confirming the singing state.

  Furthermore, a playback management tool 315 is displayed below the song singing screen. This reproduction management tool includes a performance bar that indicates the suspension of performance information and the progress of the performance status. When the performance of the music is finished (S106: Yes), the result of the singing evaluation process (in this case, scoring information) is displayed on the display screen 31.

  FIG. 5 is a block diagram showing a reproduction process (first time) according to the embodiment of the present invention. The reproduction process of this embodiment is a process that is mainly executed by the acoustic processing unit 16 under the control of the CPU 11. In the pitch detection process (P101), the pitch information is extracted by performing an acoustic analysis process such as FFT on the singing voice input from the microphone 17b. In this embodiment, the pitch is used as the evaluation target, but as the evaluation target, various characteristics of the singing voice such as the volume as well as the pitch can be used. The first reproduction process (P104) is a process of reproducing a musical piece as an accompaniment based on performance information in the musical piece information. In the first reproduction process (P104), reference pitch information, that is, information indicating the pitch to be sung is output to the evaluation process (P102) in synchronization with the reproduction of the music.

  In the evaluation process (P102), evaluation information is formed based on the reference pitch information output in the first reproduction process (P104) and the pitch information output in the pitch detection process (P101). In the evaluation information in this embodiment, the pitch bar 313a based on the reference pitch information and the pitch of the singing voice input from the microphone 17b are displayed as a solid line 313b in the evaluation display area 313 described with reference to FIG. Information. The evaluation information formed in the evaluation process (P102) is displayed and output on the touch panel display unit 18 in the display process (P103). Note that the evaluation information can be formed in various forms as long as it is information that can teach the singing evaluation based on the reference pitch information and the pitch of the singing voice, such as the difference of the pitch of the singing voice with respect to the reference pitch information. is there.

  On the other hand, the performance information in the music information reproduced in the first reproduction process (P104) is output as a performance sound and mixed with the singing voice input from the microphone 17b (P106). In the recording process (P105), the signal after the performance sound and the singing voice are mixed is recorded. The recorded signal is temporarily stored in the RAM 12 or the like of the portable terminal 1 as recording information. Further, the mixed signal (P106) is emitted from the speaker 17a.

  FIG. 9 shows a screen example of the scoring result display screen. At that time, the portable terminal 1 transmits the singing music scoring information to the karaoke host device 5 and compares it with other scoring information related to the music, and acquires and displays the ranking related to the music (S107). The user who has confirmed the scoring information operates the button labeled “Next” to proceed to the management process of the recording information recorded in the recording process S105.

  FIG. 10 shows a recording information management screen for performing various types of management of recording information. On this recording information management screen, the user can select “post singing voice”, “reproduce singing voice”, “save singing voice”, “end”, and the like. When “Reproduce singing voice” is selected, the recording information formed in the recording process of S105 is reproduced. The user can listen to and confirm the recording information of his / her song. When “save” is selected (S108), the formed recording information is saved in the storage unit 13 in the portable terminal 1 (S109). The stored recording information can be read out later for playback or posting. When “Finish” is selected, the recorded recording information is discarded, and a series of posting processes is terminated.

  When “Post a singing voice” is selected (S110: Yes), a process for transmitting the formed voice information to the karaoke host apparatus 5 starts. In the present embodiment, only the section (within a predetermined time) designated by the user in the editing process is included in the posted information and transmitted in the formed recording information. Therefore, the capacity of the recording information is reduced, the burden on the communication line and the karaoke host device 5 can be reduced, and the posting user can also post by specifying the singing place. It becomes. In addition, for the listener who listens to the posted information, it is possible to listen to the singing listening place with respect to the uploaded posted information, and it is possible to efficiently listen to the posted information. Instead of such a form, all the recording information may be transmitted (posted).

  When transmitting the formed audio information to the karaoke host device 5, first, an editing process S111 is executed. As described above, this editing process is an editing (cutting out) process so that the recording information can be stored within a predetermined time (within 90 seconds in the present embodiment), and the operation of the cutout section is performed by the user (contributor) himself. Done. FIG. 11 shows a recording information editing screen according to the embodiment of the present invention. On this recording information editing screen, an editing window 317 for editing the recording information, an editing tool 318, and a “OK” button for designating the end of editing are displayed. The user can specify the section within a predetermined time by operating the operator displayed on the editing window 317 or the editing tool 318 to specify the cut-out section and operating the “OK” button. is there. The editing tool 318 includes two wheel switches that can specify the start time (start position) of the cut-out section and the end time (end position) of the cut-out section, playback of the specified section, and the start of the specified section. It is possible to specify whether to apply fade-in and fade-out at the end. In the present embodiment, it is possible to use a manipulator displayed in the editing window 317 and a wheel switch displayed in the editing tool 318 for specifying a cut-out section (designating a start position and an end position). . By tracing around each wheel switch, the start time and end time can be advanced and retracted.

  FIG. 12 shows various forms of the editing window according to the embodiment of the present invention. FIG. 12A shows an edit window 317 having the same form as the display screen 31 of FIG. In the editing window 317, waveform information indicating the amplitude value of the recording information formed by the recording process is displayed. The waveform information is expected to have a large amplitude in a section such as rust. In addition, the amplitude is expected to be small in the interval such as interlude, prelude, and postlude. The user operates the operation element 317a for designating the section start position and the operation element 317b for designating the section end position based on the amplitude of the waveform information (or the wheel switch in the editing tool 318 in FIG. 11) to cut out. Specify the interval. At this time, the distance between the two operators 317a and 317b is not longer than a predetermined time (90 seconds). The user can specify the section to be cut out using the interface of the editing window 317.

  FIG. 12B shows a form in which the section type is displayed in the edit window 317. This section type is acquired based on the section information of the reproduced music information when performing the recording process. In the case of posting a limited section, it is common to post a singing section among the section types. Therefore, in the present embodiment, a mode is adopted in which only the section type corresponding to the singing section is displayed in the editing window 317 among the section types. The user can specify the section to be posted by operating the operation element 317a and the operation element 317b based on the section displayed in the editing window 317 (or the wheel switch in the editing tool 318 in FIG. 11). It has become. Further, in the present embodiment, the display form (in the present embodiment, the shape of the arrows at both ends) is changed according to the section type, and the user can easily grasp the section type. Thus, in the form using the section information, it may be possible to easily specify the section type separation position. For example, by setting the operation elements 317a and 317b to be attached to the head or end of the section specified by the section type, it is possible to cut out the recording information accurately and easily at the section position of the section type. .

  FIG. 12C shows that a plurality of sections can be specified in the recording information. The user can designate the number of sections using an interface (not shown), and the operators 317a to 317d are displayed according to the designated number of sections. In the example of FIG. 12C, two sections are cut out, and two operators 317a to 317d (four in total) are displayed in each section. When a plurality of sections can be specified in this way, the total of each section needs to be within a predetermined time. Accordingly, the movement range of each of the operators 317a to 317d is limited so as not to exceed a predetermined time.

  FIG. 12A illustrates a form for displaying waveform information, FIG. 12B illustrates a form for displaying section types, and FIG. 12C illustrates a form for allowing a plurality of sections to be specified. Can be performed in appropriate combinations. In addition, a simple interface as shown in FIG. The section designation shown in FIG. 12D is an interface for designating the section start time. The user can set the section start time by matching the rotary drum 317e for specifying the start fraction and the rotary drum 317f for specifying the start seconds to the start position 317g. In this case, a section from the designated section start time to a predetermined time (90 seconds in this embodiment) is designated in the recording information.

  In the present embodiment, a time length limit (90 seconds) is provided for the recording information included in the posted information. However, in the present invention, this time length restriction is not necessarily provided. Further, in the editing process, the section type portion (prelude, interlude, postlude, etc.) corresponding to the non-singing section may be automatically deleted in the recording information. When listening to the recording information included in the posted information, it is conceivable that the part where the user is singing is the main listening target. By performing such deletion processing, it is possible to delete a portion unnecessary for listening and to reduce the capacity of post information to be uploaded. This deletion process may be performed on the recording information in the uploaded post information in the karaoke host device 5.

  When the editing process (S111) for designating the section in the recording information is completed, the user to be posted is authenticated. If the user has already logged in (S112: Yes), the process proceeds directly to related information input (S114). If the user has not logged in (S112: No), the user is logged in. A login process (S113) is executed. At that time, if the user does not have an account, new registration for acquiring an account is performed. When the user login is completed, various post related information to be included in the post information is input (S114). This post-related information is various information that is disclosed together with the recording information, and in the present embodiment, post text and post images can be used.

  FIG. 13 shows a post related information input screen according to the embodiment of the present invention. On this post-related information input screen, a user name registered in the account of the logged-in user, a post text entry field 319, a post image selection button 320, and a post button 321 are displayed. In this embodiment, the user name registered in the account is used as it is, but this user name may be changed by user input. When the post text entry field 319 is designated, it is possible to perform text input using a soft keyboard or the like. The posting user inputs a comment to be communicated to other users regarding the posting. The posted image selection button 320 includes an image selection button 320a and a shooting button 320b. When the image selection button 320a is operated, a posted image is selected from images stored in the storage unit 13 of the portable terminal 1. Is possible. On the other hand, when the shooting button 320b is operated, it is possible to take a picture with the front camera 15F or the rear camera 15R of the portable terminal 1 and use the taken image as a post image.

  The user who has finished inputting the posting related information operates the posting button 321 indicated as “posting” to thereby display the posting information including the edited recording information, the input posting related information, etc. 5 (S116). FIG. 14 shows a data structure of post information according to the embodiment of the present invention. The posting information of this embodiment is composed of meta information and actual information. The actual information includes recording information, pitch information, and reference pitch information. The recording information is the recording information of the section designated by the editing process, and in the present embodiment, the performance sound and the singing voice are mixed.

  The pitch information is information indicating a time-series change of the singing voice input from the microphone 17b in the singing evaluation process (S104 or P102) during singing. As with the recording information, this pitch information is obtained by cutting out a section designated by the editing process. The reference pitch information is included in the music information that is the subject of singing and, like the recording information and the pitch information, is a section that is specified by the editing process. As described above, in the present embodiment, the pitch information and the reference pitch information corresponding to the location specified in the section of the recording information are included, and when the recording information is reproduced, the evaluation information is based on the pitch information and the reference pitch information. Can be formed. Therefore, when playing back recorded information, it is possible to confirm what kind of singing the posted user is performing on the reference pitch information by forming and displaying evaluation information based on the pitch information and the reference information. It becomes possible. For example, in addition to being able to confirm in which part the singing is successful or making a mistake, it is possible to check the user's own singing.

  In the present embodiment, the pitch information and the reference pitch information are included in the post information necessary for forming the evaluation information, but the evaluation information itself may be included in the post information. For example, various forms are adopted as long as it is possible to confirm the difference between the recording information and the reference pitch information, such as recording the evaluation display area 313 displayed when recording information is recorded, as the evaluation information. It is possible.

  The meta information includes information related to the music used during recording, such as music identification information, music name, singer name, and the like. In addition, user identification information included in the account of the poster is included in order to be able to identify which user posted the posted information. In addition, as information on the performance of music, key (pitch) information and tempo (speed) information set before the start of performance are included. Moreover, final evaluation information such as a scoring value calculated at the end of the performance is included, and can be used for ranking posting information. Also included are edit position information indicating the cut-out section of the recording information, allocation section information recorded in the section type allocation process (S112), and posting related information input on the posting related information input screen of FIG.

  Post information transmitted (posted) to the karaoke host device 5 is stored in the storage unit 41 of the karaoke host device 5 and is also disclosed on the Web server 52. Prior to publishing on the Web server 52, it is judged whether or not inappropriate sound has been recorded, or whether or not inappropriate images and words are included in the post-related information. Only posted information may be made public.

  In the present embodiment, in the karaoke program that enables posting processing, posting information can be listened to. Then, about the listening form of this posting information, the form using the portable terminal 1 is demonstrated. Note that the posting information is not limited to the portable terminal 1 and may be executed in various information processing apparatuses such as a karaoke apparatus, a personal computer, or a game machine.

  FIG. 15 shows a scoring ranking screen that enables selection of posting information to be listened to. This scoring ranking screen is a screen displayed by operating the ranking detail display button 312 displayed in the “ranking” tab in the music detail screen described with reference to FIG. On the scoring ranking screen, scoring values, user names, and playback start buttons 322a to 322c are displayed in descending order of scoring values (evaluation information) in the posted information for the music specified on the music detail screen. It is a screen. The user can listen to the recording information of the user by selecting the playback start buttons 322a to 322c corresponding to the user who wants to listen. Note that a user whose playback start buttons 322a to 322c are not displayed is a user who has not posted and cannot listen to the recording information.

  By operating the playback start buttons 322a to 322c for a certain user, playback of recorded information is started. FIG. 16 is a block diagram showing a reproduction process (at the time of reproduction of posted information) according to the embodiment of the present invention. Although it is possible to reproduce only the posted information, in the present embodiment, the second evaluation information is formed by reproducing the posted information and executing the singing evaluation process on the singing voice input from the microphone 17b. In addition, it is possible to compare with evaluation information based on posted information. Furthermore, in this embodiment, it is possible to perform a further posting process by performing a recording process on the singing voice input from the microphone 17b.

  In the pitch detection process (P101), the second pitch information is detected by performing an acoustic analysis process such as FFT on the singing voice input from the microphone 17b. On the other hand, post information is separated into recording information (performance sound + singing voice), reference pitch information, and pitch information in a separation process. In the evaluation process (P102), the first evaluation information for the recorded information in the posted information is formed based on the reference pitch information and the pitch information, and the second detected by the reference pitch information and the pitch detection process (P101). The second evaluation information is formed based on the pitch information. 1st evaluation information is evaluation with respect to the recording information of contribution information, and 2nd evaluation information is evaluation with respect to the song sung according to reproduction | regeneration of contribution information this time. In the display process (P103), the first evaluation information and the second evaluation information are displayed on the touch panel display unit 18.

  The recording information separated in the separation process (P107) is reproduced in the second reproduction process (P108), and sound is output from the speaker 17a. As described above, in the present embodiment, it is possible to form the first evaluation information based on the pitch information and the reference pitch information included in the recording information, and to reproduce the singing evaluation for the recorded information by the posted user. Yes. A user who receives and reproduces the posted information can check the singing evaluation of the posted user based on the first evaluation information displayed and output on the touch panel display unit 18. Further, in the present embodiment, second evaluation information based on the singing voice and the reference pitch information is formed for the singing voice sung in conjunction with the reproduction of the posted information, and is displayed on the touch panel display unit 18. Yes. According to such a configuration, the user who reproduces the posted information can compare the first evaluation information and the second evaluation information, and can compare and confirm the own song and the posted user song. It becomes.

  FIG. 17 shows an example of a recorded information reproduction screen displayed when the posted information is reproduced. This is a case where the reproduction start button 322b is operated for Mr. B who is second in the scoring ranking screen of FIG. On the recording information playback screen, the song name, singer name, contributor's user name, scoring value (final evaluation information), post image 325, post text 326, and lyrics information 327 input as post related information are displayed. The The lyrics information 327 can be acquired from the corresponding music information based on the music identification information included in the posted information. At that time, all the lyrics information may be displayed for the music to be played back, but based on the editing position information in the posted information, the lyrics information 327 at the location corresponding to the recording information cut out by the editing process is displayed. It is good.

  An evaluation display area 313 is provided at the center of the recorded information reproduction screen. In the evaluation display area 313, the pitch based on the reference pitch information is displayed as a bar 313a, and the (first) pitch information included in the posted information is displayed as a broken line 313b. The display form related to the evaluation information is substantially the same as the evaluation display area 313 described with reference to FIG. 8. The horizontal axis is the time axis, the vertical axis is the pitch axis, and the bar 313a and the broken line 313b are used for the progress of the performance. Scroll to the left along with it. The position indicated by the broken line corresponds to the current timing, that is, the singing position. Thus, in this embodiment, when reproducing the posted information, the first display information is displayed in the evaluation display area 313 based on the first pitch information included in the posted information and the reference pitch information. It becomes possible to confirm what kind of singing is performed on the reference pitch information by the posted user.

  When playing the recorded information, the bar display format (color, shape, etc.) of the singed part is different depending on whether the pitch information (first pitch information) of the recorded information matches the reference pitch information or not. It may be changed. At that time, a plurality of reference pitch information may be provided for each difficulty level, and may be switched by a user who performs playback. When performing evaluation based on pitches as in the present embodiment, it is conceivable that the range of compatible pitches is different, for example, the higher the difficulty level, the narrower the range of compatible pitches. When reproducing the posted information, the user who plays the posted information can set the degree of difficulty through a user interface (not shown) to switch the reference pitch information and evaluate the posted information based on different evaluation criteria. In this case, not only the display of the evaluation display area 313 in FIG. 17 but also the final evaluation information (scoring value) described in FIG. 9 may be changed according to the set difficulty level.

  Further, in the present embodiment, the second pitch information detected in the pitch detection process (P101) is displayed by a solid line 313c. In the present embodiment, the second evaluation information is formed by the bar 313a based on the reference pitch information and the solid line 313c based on the second pitch information. By displaying the second evaluation information together with the first evaluation information, the user's singing singing in accordance with the reproduction of the posted information is the reference pitch information, and the pitch information of the user who has posted (the first pitch information). It is possible to confirm how they differ with respect to the pitch information.

  A playback management tool 323 including a section type designation button, a progress bar for designating a playback position, and a pause button is displayed at the bottom of the recording information playback screen. Below the playback management tool 323, a voting button 324a labeled “similar !!” and a voting button 324b labeled “like!” Are displayed. The user who has listened to the recorded information can evaluate the recorded information by operating these voting buttons 324a and 324b. Note that these voting buttons 324a and 324b may be displayed or operable when the recording information is listened to for a certain period of time or when the listening is completed. It is possible to suppress fraud in which voting is performed without listening to recorded information.

  The voting operation by the voting buttons 324a and 324b is transmitted to the karaoke host device 5 as voting information regarding the post information being listened to. The karaoke host device 5 counts voting information for each voting item and uses it to rank each item described in FIG. 6 (“Like!”, “Similar!”) To introduce post information. It becomes possible.

  As described above, the posting process and the listening process for the posted information have been described using the portable terminal 1 as an example. However, the posting process and the listening process are not limited to the portable terminal 1, but also a karaoke device, a personal computer, It can be performed in various information processing devices such as game machines, and can provide postings by singing recording to a wide range of users.

  In the embodiment described above, the recording information is formed by mixing the performance sound and the singing voice as shown in the data structure of the posted information in FIG. In addition to such a form, it is conceivable to record recording information by recording only the singing voice. 18 to 20 show forms in which only the singing voice is posted as recording information. FIG. 18 is a block diagram showing a reproduction process (first time) according to another embodiment of the present invention, and FIG. 19 shows a data structure of post information according to another embodiment of the present invention. FIG. 20 is a block diagram showing a reproduction process (at the time of reproduction of posted information) according to the embodiment of the present invention. 18 to 29 correspond to FIGS. 5, 14, and 16, respectively, in the above-described embodiment.

  Here, the difference between the new embodiment and the above-described embodiment will be described. In the block diagram of FIG. 18, in this embodiment, the recording target of the recording process (P105) is different. In the embodiment described above, an acoustic signal obtained by mixing a performance sound and a singing voice is a recording target. In the present embodiment, only a singing voice input from the microphone 17b is a recording target. Therefore, only the singing voice is included in the recording information included in the posting information. In this case, when the recorded information is reproduced, the music sound is reproduced to reproduce the performance sound. Therefore, in this embodiment, the reference pitch information included in the posted information in the above-described embodiment is not required. The reference pitch information of the music information reproduced in synchronization with the reproduction of the posted information is used.

  FIG. 20 is a block diagram showing a reproduction process when the posted information is reproduced. In the present embodiment, the received post information is separated into (first) pitch information and recording information in the separation process (P107), and the recorded information is reproduced in the second reproduction process (P108). In synchronism with the reproduction of the recorded information, the performance information in the music information is reproduced in the first reproduction process (P110). The music information to be reproduced can be determined by referring to the music identification information described in the meta information in the posted information. In the first reproduction process (P110), the reference pitch information is output in synchronization with the reproduction of the performance information. In the evaluation process (P102), the first evaluation information is formed based on the reference pitch information and the (first) pitch information, and the (second) pitch information detected in the pitch detection process (P101); Second evaluation information is formed based on the reference pitch information. In the display process (P103), the formed first evaluation information and second evaluation information are displayed on the touch panel display unit 18.

  In the mixing process (P111), the performance sound reproduced in the first reproduction process (P110) and the singing voice reproduced in the second reproduction process (P108) are mixed to reproduce the singing state at the time of posting. To do. Moreover, in this embodiment, it is also possible to record the newly sung singing voice and handle it as recording information for new post information because the singing voice and the performance sound are handled separately. In the recording process (P105), the singing voice input from the microphone 17b is recorded to form recording information. The formed recording information can be posted to the karaoke host device 5 as new posting information through a posting process similar to that shown in FIG.

  Even in the form of recording only the singing voice in this way, when reproducing the posted information, it was formed based on the singing reference information corresponding to the music information used at the time of recording the recording information and the singing voice that was the recording target. By displaying the evaluation information on the display means, it is possible to confirm how the posted song is different from the original song on the user side who reproduces the posted song.

DESCRIPTION OF SYMBOLS 1 ... Portable terminal (information processing apparatus) 17b ... Microphone 11 ... CPU 18 ... Touch panel display part 12 ... RAM 18a ... Touch panel 13 ... Memory | storage part 18b ... Display part 14 ... Image control part 19 ... Communication part 15F ... Front camera 20 ... Input Switch 15R ... Rear camera 21 ... External input terminal 16 ... Sound processing unit 22 ... External memory connection terminal 17a ... Speaker

Claims (7)

A karaoke program executed in an information processing apparatus capable of communicating with a host device via a network,
A storage step of storing recording information including singing voice information indicating the singing voice input from the microphone in the storage means;
An accepting step of accepting designation of a section from among the reproduction sections of the recording information stored by the storing step;
A transmission step of transmitting post information including the recording information corresponding to the section received by the reception step to a host device;
A reproduction step of reproducing the recording information included in the posted information received from the host device;
In synchronization with the reproduction of the recording information, the evaluation information formed based on the singing reference information corresponding to the music information used at the time of recording the recording information and the singing voice that is the recording target of the recording information. A karaoke program characterized by causing an information processing apparatus to execute a display step to be displayed on a display means. The storage step forms and stores evaluation information based on the singing reference information corresponding to the music information and the singing voice input from the microphone,
The karaoke program according to claim 1, wherein in the transmission step, the evaluation information stored in the storage step is included in post information and transmitted to the host device. The karaoke program according to claim 1, wherein the reproduction step forms evaluation information based on singing reference information corresponding to music information used at the time of recording the recording information and the recording information. The storing step extracts the pitch information from the singing voice input from the microphone and stores it in the storage means,
The transmitting step transmits post information including the recording information and pitch information corresponding to the section received by the receiving step to a host device,
The karaoke program according to claim 1, wherein the reproduction step forms evaluation information based on singing standard information corresponding to music information used at the time of recording the recording information and the pitch information. Causing the information processing apparatus to further execute a second receiving step of accepting the change of the singing standard information;
5. The program according to claim 3, wherein the reproduction step forms evaluation information based on the singing standard information accepted in the second acceptance step and the recording information or the pitch information. The reproduction step forms second evaluation information based on the singing voice input from the microphone and the singing reference information corresponding to the music information used when recording the recording information,
The karaoke program according to any one of claims 1 to 5, wherein the display step displays the second evaluation information on a display unit in synchronization with the reproduction of the recorded information. An information processing apparatus capable of communicating with a host device via a network,
Storage means for storing recording information including singing voice information indicating a singing voice input from a microphone;
Accepting means for accepting designation of a section from the reproduction sections of the recording information stored in the storage means;
Transmitting means for transmitting post information including the recording information corresponding to the section received by the receiving means to a host device;
Playback means for playing back recording information included in the posted information received from the host device;
In synchronization with the reproduction of the recording information, the evaluation information formed based on the singing reference information corresponding to the music information used at the time of recording the recording information and the singing voice that is the recording target of the recording information. An information processing apparatus comprising: display means for displaying on the display means.