JP4788628B2 - Karaoke device and karaoke network system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for obtaining a more suitable scoring result of singing scoring by a karaoke device. <P>SOLUTION: A control unit 12 measures the time T1 from when test character data are displayed on a monitor 36 by a video control unit 38 until when a singing voice signal input by a microphone 25 is output to a DSP 24c. The control unit 12 acquires a time T2 in which the singing voice signal input to the DSP 24c is processed in the DSP 24c. Further, the control unit 12 acquires the time T3 up to when lyrics telop data reproduced by a reproducing unit 12c are output to the video control unit 38. The control unit 12 waits for the sum of the time T1, time T2, and time T3 after lyrics of karaoke music are displayed on the monitor 36 based upon character data, and calculates the pitch difference between pitch data extracted after the wait and pitch data of a singing melody of karaoke music on which a comparison is based to perform scoring corresponding to the calculated pitch difference. <P>COPYRIGHT: (C)2008,JPO&amp;INPIT

Description

  The present invention relates to singing scoring in a karaoke apparatus, and particularly to a technique for obtaining an appropriate scoring result.

  Conventionally, a scoring function is known as an incidental function of a karaoke apparatus. This scoring function is the following function. That is, singing data indicating a singing state such as a pitch or pronunciation timing uttered by the singer is generated by sampling a singer's voice signal input from the microphone. Next, the singing data is compared with scoring reference data in karaoke data such as MIDI data, and a predetermined score is given based on the comparison result to generate scoring data. When the singing part ends, the scores in the scoring data are totaled to calculate a total score. The total score is displayed as it is on a scoreboard or a display, or a video reflecting the total score such as a video including a predetermined message or predetermined expression content is output to the display (for example, see Patent Document 1).

  By the way, some karaoke apparatuses as described above have a mechanism in which karaoke lyrics telop displayed on the screen changes color in conjunction with karaoke performance of music generated based on, for example, MIDI data. In such a karaoke apparatus, the music performance and the karaoke lyrics display are synchronized, and the lyrics telop changes color at a predetermined timing. Then, a singer who sings at the timing when the lyrics telop changes color is pronounced at a timing later than the music performance, and the singing score may be lowered due to the delay in the pronunciation.

Therefore, a karaoke apparatus is known that calculates the difference between the singer's pronunciation timing and the karaoke performance output timing of the music, and changes the timing of the color change of the lyrics telop displayed on the screen (see, for example, Patent Document 2). .
JP-A-11-224094 (pages 4-6, FIG. 5) Japanese Patent Laying-Open No. 2005-173256 (pages 3 to 6, FIGS. 4 and 5)

  However, in the karaoke apparatus as described above, after the karaoke performance is started, the timing of the color change of the lyrics telop displayed on the screen is calculated by calculating the difference between the singer's pronunciation timing and the karaoke performance output timing of the song. In order to repeat the procedure of changing the singing, while the procedure is repeated, the song is scored at the delayed pronunciation timing, and the singing score may be lowered.

  This invention is made | formed in view of such a malfunction, The place made into the objective is to provide the technique which can obtain a more suitable scoring result in the singing scoring in a karaoke apparatus.

  The karaoke apparatus of the present invention, which has been made to solve the above-mentioned problems, measures the time T1 from when the test character data is displayed until the voice signal indicating the test character data is input, The time T1 is corrected and the singing is scored.

  Specifically, the above-described karaoke apparatus (4: In this column, in order to facilitate understanding of the invention, the components described in the “Best Mode for Carrying Out the Invention” column are included as necessary. Although shown in parentheses, this description does not mean that the scope of the claims is limited.) In the measurement means (12), the display control means (38) displays the test character data. The time T1 from when it is displayed in (36) until the voice signal indicating the test character data is input by the voice signal input means (25, 24) is measured. Further, the pitch extraction means (12) displays the lyrics of the karaoke song indicated by the lyrics data in the music data by the display control means on the display means based on the character data, and then delays the time T1 for the voice signal input means. The pitch data of the karaoke singing is extracted from the voice signal of the karaoke singing input. Then, the scoring means (12) includes the pitch data of the karaoke song melody in the music data acquired by the music data acquisition means (12) and the pitch data of the karaoke song extracted by the pitch extraction means. The pitch difference is calculated and scored according to the calculated pitch difference. As an example, a singer who sings when the display color of the lyrics of the karaoke song is changed may be delayed in singing. Therefore, the voice signal indicating the test character data such as “A” by the voice signal input means from when the measurement means causes the display control means to display the test character data such as “A” on the display means. Time T1 until is input is measured. That is, the delay time T1 for singing by the singer is measured before singing. In addition, when singing a song, the pitch data of the karaoke song is extracted with a delay of the singing delay time T1 by the singer. And the pitch difference between the pitch data of the song melody of the karaoke song in the music data and the pitch data of the extracted karaoke song is calculated, and the score is scored according to the calculated pitch difference, etc. is there.

  According to the karaoke apparatus of the present invention configured as described above, the singing delay time T1 by the singer who sings when the display color of the lyrics of the karaoke song is changed is measured before singing, When singing, the pitch data of the karaoke song is extracted with a delay of the delay time T1, and the singing is scored. Therefore, even if the singing is delayed when singing, it is possible to notify a more appropriate scoring result.

  In addition, the scoring program has time T2 data required for data processing from when the audio signal is input to the scoring program until the scoring is completed, and the time T2 indicated by the time T2 data is also corrected for scoring. Good.

  Specifically, as described in claim 2, the scoring program data has time T2 data required for data processing from when a voice signal in scoring program processing is input to the scoring program until scoring is completed. is doing. The scoring program data acquisition means (12) can acquire scoring program data from the scoring program data storage means (16). Furthermore, time T2 data extraction means (12) extracts the time T2 data from the scoring program data acquired by the scoring program data acquisition means. The pitch extraction means displays the time T2 data extracted by the extraction means at time T1 after the display control means displays the lyrics of the karaoke song indicated by the lyric data in the music data on the display means based on the character data. The pitch data of the karaoke song may be extracted from the voice signal of the karaoke song input by the voice signal input means with a delay of the total time including the time T2 indicated by.

  According to the karaoke apparatus configured as described above, the time T2 required for data processing from when the audio signal is input to the scoring program until the scoring is completed is extracted from the scoring program data before the singing scoring, and the singing scoring is performed. When the time T2 is delayed by the total time added to the time T1, the pitch data of the karaoke song is extracted and scored. Therefore, even when the singing is delayed when singing, it is possible to notify a more appropriate scoring result.

Alternatively, a time T2 required for data processing from when an audio signal is input to the scoring program until the scoring is completed may be calculated, and this T2 may also be corrected and scored.
Specifically, as described in claim 3, the kind of digital filter predetermined by the order data extraction means (12) from the scoring program data acquired by the scoring program data acquisition means (12), and the digital filter The data indicating the order of and the sampling time of the audio signal are extracted. The calculating means (12) completes scoring after the audio signal is input to the scoring program based on the type of digital filter extracted by the order data extracting means, the order of the digital filter, and the sampling time of the audio signal. A time T2 required for data processing until the calculation is calculated. The pitch extracting means displays the time T2 calculated by the calculating means at time T1 after the display control means displays the lyrics of the karaoke song indicated by the lyrics data in the music data on the display means based on the character data. The pitch data of the karaoke song may be extracted from the voice signal of the karaoke song input by the voice signal input means with a delay of the added total time. For example, the order data extraction means uses, for example, the type of digital filter used in a DSP (Digital Signal Processor), the order of the digital filter, the order of the audio signal, from the scoring program data acquired by the scoring program data acquisition means. Data indicating the sampling time is extracted. In addition, based on the type of the extracted digital filter, the order of the digital filter, and the sampling time of the audio signal, a time T2 required for data processing from when the audio signal is input to the scoring program until the scoring is completed is calculated. Is done. When singing, the singing delay time T1 by the singer is delayed by the total time including the time T2 required for data processing from when the audio signal is input to the scoring program until the scoring is completed. Pitch data of karaoke singing is extracted. And the pitch difference between the pitch data of the song melody of the karaoke song in the music data and the pitch data of the extracted karaoke song is calculated, and the score is scored according to the calculated pitch difference, etc. is there.

  According to the karaoke apparatus configured as described above, the time T2 required for data processing from when the audio signal is input to the scoring program until the scoring is completed is measured before the singing is scored, and when the singing is scored, the time The pitch data of the karaoke song is extracted by delaying T2 by the total time added to the above-described time T1, and the song is scored. Therefore, even when the singing is delayed when singing, it is possible to notify a more appropriate scoring result.

Further, as described in claim 4, the display control means may display the time T1 measured by the measurement means on the display means.
According to the karaoke apparatus configured in this way, the time T1 measured by the measuring means is displayed on the display means, so that the singer can know the habit of delaying singing. Therefore, for a singer who sings while watching the display color of the karaoke lyrics changed, assistance for improving the singing score can be obtained.

  A karaoke network system comprising a karaoke device, a host server, and a network connecting the karaoke device and the host server, storing the time T1 in the host server and correcting the time T1 read from the host server Singing is recommended.

  Specifically, as described in claim 5, the storage unit (2 b) of the host server (2) logs in the registered user who is permitted to log in to the host server by the authentication unit (2 a). The time T1 related information in which the identification information related to the registered user and the time T1 information received by the host server side receiving means (2c) is associated is stored. Further, when the host server side control means (2a) determines whether or not the time T1 related information including the identification information relating to the registered user is stored in the storage means, The identification information about the registered user and the time T1 information are transmitted to the karaoke apparatus by controlling the host server side transmission means (2c) from the time T1 related information. And the pitch extraction means of a karaoke apparatus judges whether the identification information and time T1 information regarding a registered user were received by the karaoke apparatus side receiving means (14), and when judging that it has received, The pitch data of the karaoke song is extracted assuming that the time T1 to be delayed is the time T1 indicated by the time T1 information received by the karaoke apparatus side receiving means. For example, the storage unit of the host server stores time T1 related information in which identification information about the user such as a user ID and time T1 information indicating the time T1 measured by the measurement unit are associated. When it is determined that the time T1 related information including the logged-in user ID is stored in the storage unit, the user ID and the time T1 information are transmitted from the time T1 related information regarding the user ID to the karaoke apparatus. And when it is judged that the karaoke apparatus has received the user ID and the time T1 information, the pitch data of the karaoke song is extracted assuming that the time T1 to be delayed is the time T1 indicated by the received time T1 information. And so on.

  According to the karaoke network system configured as described above, a test for measuring the time T1 can be omitted for a singer whose user ID and time T1 information are stored in the host server. In addition, since the user ID and time T1 information are stored in the host server, the user ID and time T1 information are stored in the host server for any karaoke apparatus connected to the host server. For memorized singers, the test of measuring time T1 can be omitted. Therefore, the test for measuring the time T1 can be omitted for the singer in which the time T1 related information in which the identification information related to the registered user and the time T1 information are associated is stored in the storage means of the host server. improves. Moreover, the use frequency of a karaoke network system can be raised by the convenience of a singer improving.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Description of configuration of karaoke network system 1]
FIG. 1 is a block diagram showing the overall configuration of the karaoke network system 1.

  As shown in FIG. 1, the karaoke network system 1 includes a host server 2 that distributes music data, content data to be provided to the user, and the like to the karaoke device 4 and music specified by the user who uses karaoke. And a karaoke device 4 for performing karaoke performance. The karaoke network system 1 is configured such that the karaoke device 4 can communicate with the host server 2 via the Internet 200. Hereinafter, the host server 2 and the karaoke apparatus 4 will be described in this order.

The Internet 200 corresponds to a “network”.
[Description of the configuration of the host server 2]
First, as shown in FIG. 1, the host server 2 includes a control unit 2a for controlling the operation of the entire apparatus, a database 2b for storing various information, and an interface unit 2c for connecting the host server 2 to the karaoke apparatus 4. And. Hereinafter, the control unit 2a, the interface unit 2c, and the database 2b will be described in this order.

  In response to a request from the karaoke apparatus 4 on the karaoke store side, the control unit 2a authenticates a registered user who wants to log in to the host server 2, distributes / updates a personal Web page to the registered user, and logs in The user ID and time T1 of the registered user are extracted from the user registration database related to the registered user and transmitted to the karaoke apparatus 4. The control unit 2a is linked to the database 2b. The term “cooperation” as used herein refers to the personal web received by the control unit 2a in order for the control unit 2a to perform user authentication, distribution of a personal web page, and extraction of the user ID and time T1 of the registered user from the user registration database. By reflecting the page update data and the user registration data in the database 2b, the data used for the service performed by the control unit 2a is associated with the database 2b.

  The interface unit 2c is configured to connect the host server 2 to the router 130 on the host server side. As a result, the host server 2 is connected to the LAN 100 on the karaoke store side via a VPN (virtual private network) formed on the Internet 200 between the router 130 on the host server side and the router 120 on the karaoke store side. ing. That is, communication between the host server 2 and the karaoke apparatus 4 is performed via the VPN on the Internet 200 and the LAN 100 on the karaoke store side.

  The database 2b includes a user registration database 2d, a personal web page database 2e, and the like. Hereinafter, the user registration database 2d and the personal Web page database 2e will be described in this order.

(A) User registration database 2d
The user registration database 2d stores registration information related to users who have authority to use the host server 2.

  FIG. 6A is an explanatory diagram showing specific contents of the user registration database 2d. The user registration database 2d is a table of user registration data including various information such as a nickname, a user ID, a password, a path indicating a storage location of the personal Web page data of the user, and a time T1.

  In the karaoke network system 1 of the present embodiment, the control unit 2a of the host server 2 refers to the user registration database 2d, thereby authenticating the user who has requested login, associating the user with the nickname, and the user and the user. The personal web page is associated with the user and the time T1 is associated with the user.

(B) Personal Web page database 2e
The personal web page database 2e is data of a personal web page for publishing information on a karaoke song of a registered user (hereinafter also referred to as a registered user), information provided by the user, and the like on the Internet 200. Accumulate.

  FIG. 6B is an explanatory diagram showing specific contents of the personal Web page database 2e. The personal web page data is a collection of data for displaying the personal web page in a predetermined format by the web browser included in the karaoke apparatus 4, such as text data, layout information by HTML, image / audio / video data, etc. Consists of

  In the present embodiment, the personal web page has information on the scoring result for the user's singing using the karaoke device 4 as content. FIG.6 (c) is a figure which shows the example of a display on the web browser of the personal web page which has the content of the score result of a song. Here, the Web page title is displayed as a personal Web page of the nickname “Sasaki”. The information of “Singing result of singing” by “Sasaki” is displayed.

  The control unit 2a corresponds to “authentication unit” and “host server side control unit”, the database 2b corresponds to “storage unit”, the interface unit 2c includes “host server side reception unit”, and “host server”. Corresponds to “side transmission means”.

[Description of configuration of karaoke device 4]
As shown in FIG. 1, the karaoke device 4 includes a control unit 12 that controls the operation of the karaoke device 4 as a whole, an interface unit 14 for connecting the karaoke device 4 to the LAN 100, music that shows the accompaniment content and lyrics of the performance tune. A hard disk (HDD) 16 for storing content data such as data and video data, a program for operating the karaoke device 4, a plurality of key switches, an operation unit 18 for performing a music reservation operation, an operation unit 18, an operation processing unit 22 that processes a signal from the sound source 18, a microphone 25, a MIDI sound source 30 that performs performance reproduction based on performance data (MIDI data) stored in the HDD 16, and an audio of a musical piece from a digital signal output from the MIDI sound source 30 A signal (signal related to sound and sound) is generated, and the generated audio signal and microphone 2 are generated. An audio control unit 24 that amplifies an audio signal input from the video signal and outputs the amplified audio signal to the speaker 28; a video RAM 32 that temporarily stores image data; and a video playback unit that controls playback of video based on the image data stored in the video RAM 32 34, a video control unit 38 for controlling the display of the video reproduced by the video reproduction unit 34 on the monitor 36, and the like. Here, the control unit 12 controls the interface unit 14 to transfer various types of information to the host server 2 and receive various types of information received from the host server 2.

  Among these, as illustrated in FIG. 4A, the HDD 16 stores a music data memory area 51 for storing music data, and a user memory for storing user data associated with the user ID of the user and time T1 data. An area 52, a scoring memory area 53 for storing scoring data indicating the singing scoring results, a time T2A memory area 54 for storing time T2A data indicating the time T2A included in the scoring program data, and a time T2 data indicating time T2 A time T2 memory area 55 for storing, a time T3 memory area 56 for storing time T3 data indicating the time T3, a scoring place memory area 57 for storing scoring place data indicating the place of the karaoke store where the scored karaoke apparatus 4 is installed, A scoring program memory area 58 for storing scoring program data, a color for controlling karaoke T1temp memory area 60 for storing T1temp data for identifying whether to store karaoke control program memory area 59, and the time T1 data to the host server 2 for storing Ke control program data is provided. Hereinafter, description will be made in the order of music data, user data, scoring data, time T2 data, time T3 data, scoring place data, scoring program, karaoke control program, and T1temp data.

(C) Music data The music data is data indicating the accompaniment content and lyrics of the performance music. As shown in FIG. 4B, this music data is used for scoring data included in the music title and music number, performance data (MIDI data), and songs included in the performance data when the performance data is MIDI data. Singing data according to the progress of the karaoke song, when the lyrics telop data indicating the lyrics telop including the character data indicating the lyrics of the karaoke song and the character data of the lyrics are displayed on the monitor 36 Color change timing clock data for changing the character color of the lyrics and time T2B data indicating time T2B are included. The time T2B is a time set in advance as a delay time T2 (see FIG. 3) described in the [Description of the configuration of the scoring unit 40 of the karaoke apparatus 4] section described later. In addition, as shown in FIG. 4 (c), this music data is such that, when the performance data is MPEG data, the performance data (MPEG data) does not include the scoring data for scoring the song. This is a difference from the case where the performance data is MIDI data. The configuration excluding this difference is the same as the configuration when the performance data is MIDI data. Further, the structure of MIDI data (performance data) and MPEG data (performance data) is in accordance with a publicly known technique, and therefore detailed description thereof is omitted here.

(D) User data User data is data in which a user ID of a user and time T1 data are associated with each other. As shown in FIG. 4D, the user data includes a user memory in which numerical values “1 to n” of user ID numbers (1 to n) are associated with times (A1 to An) of time T1. Stored in area 52. For example, in the user data corresponding to the user ID number (1), the numerical value “1” of the user ID number (1) is associated with the time (A1) of the time T1 in the user memory area 52. It is stored in (1).

(E) Scoring data The scoring data is data indicating a singing scoring result. As shown in FIG. 5A, the scoring data includes numerical values “1 to n” of user ID numbers (1 to n), song number numbers (C1 to Cn), and song names ( D1 to Dn), singing score (E1 to En), singing date and time (F1 to Fn), and time T1 (G1 to Gn) are associated and stored in the scoring memory area 53. For example, the scoring data corresponding to the user ID number (1) includes the numerical value “1” of the user ID number (1), the music number number (C1), and the song name (D1) indicating the name of the song. The singing score (E1), the singing date (F1), and the time T1 (G1) are associated and stored in the scoring memory area 53 (1).

(F) Time T2 data The time T2 data is data indicating the time T2 specified in the time T2 specifying process described in the [Time T2 specifying process of the control unit 12] section described later.

(G) Time T3 data The time T3 data is data indicating a time T3 corresponding to a delay time T3 (see FIGS. 2 and 3) described in the [Description of the configuration of the scoring unit 40 of the karaoke apparatus 4] section described later. is there.

(H) Scoring location data The scoring location data is data indicating the location of the karaoke store where the scored karaoke apparatus 4 is installed.

(I) Scoring program data The scoring program data is data including pitch data of the singing melody of a karaoke song that becomes a reference for comparison when singing. In the scoring program memory area 58, as shown in FIG. 5B, a scoring program main body memory area 71 for storing the scoring program data main body, and a time T2A for storing time T2A data indicating the time T2A included in the scoring program data. Memory area 72, time T1A memory area 73 for storing time T1A data indicating time T1A, digital filter type memory area 74 for storing digital filter type data indicating the type of digital filter, and digital filter indicating the order of the digital filter The order memory area 75 of the digital filter for storing the order data and the sampling period memory area 76 of the audio signal are provided. The following description will be made in the order of time T2A data, time T1A data, digital filter type data, digital filter order data, and audio signal sampling cycle data.

First, the time T2A data is data indicating a time set in advance as a delay time T2 (see FIG. 3) described in the “Description of the configuration of the scoring unit 40 of the karaoke apparatus 4” column described later.
The time T1A data is data indicating a time set in advance as a delay time T1 (see FIG. 3) described in the “Description of the configuration of the scoring unit 40 of the karaoke apparatus 4” column described later.

  The type data of the digital filter is data indicating the type of digital filter used in the DSP 24c described in [Description of the configuration of the scoring unit 40 of the karaoke apparatus 4] described later.

  The order data of the digital filter is data indicating the order of the digital filter used in the DSP 24c described in [Description of the configuration of the scoring unit 40 of the karaoke apparatus 4] described later.

  The sampling cycle data of the audio signal is data indicating the sampling cycle of the audio signal used in the DSP 24c described in [Description of the configuration of the scoring unit 40 of the karaoke apparatus 4] described later.

(Nu) Karaoke control program data The karaoke control program data is data such as a system program and an application program for controlling the operation of the karaoke apparatus 4.

(L) T1temp data The T1temp data is data for identifying whether or not the time T1 data is stored in the host server 2. For example, when the T1temp data is data indicating the numerical value “0”, this indicates that the time T1 data is stored in the host server 2, and when the T1temp data is data indicating the numerical value “1”, the time T1 data is Indicates that no data is stored in the host server 2.

  The monitor 36 corresponds to “display means”, and the HDD 16 corresponds to “music data storage means” and “scoring program data storage means”. In addition, the control unit 12 includes “music data acquisition means”, “measurement means”, “pitch extraction means”, “scoring means”, “scoring program data acquisition means”, “order data extraction means”, “calculation means”, And “karaoke device side control means”. Further, the video control unit 38 corresponds to “display control unit”, the microphone 25 and the audio control unit 24 correspond to “audio signal input unit”, and the operation unit 18 and the operation control unit 22 correspond to “authentication request information reception unit”. The interface unit 14 corresponds to “karaoke device side transmission means” and “karaoke device side reception means”. The performance data corresponds to “karaoke performance data”, the scoring data corresponds to “pitch data of singing melody of a karaoke song”, and the lyrics telop “lyric data including character data indicating the lyrics of the karaoke song” The color change timing clock data corresponds to “color change data”.

[Description of the configuration of the scoring unit 40 of the karaoke apparatus 4]
Next, the structure of the scoring part 40 which has the function to sing a song in the karaoke apparatus 4 is demonstrated. FIG. 2 is a block diagram illustrating a configuration of the scoring unit 40 of the karaoke apparatus 4.

  As shown in FIG. 2, the scoring unit 40 includes a microphone 25, a microphone amplifier 24a, an A / D converter 24b, a DSP 24c, an HDD 16, a reading unit 12a, a comparison unit 12b, a MIDI sound source, a D / A converter 24d, and a video control unit 38. And a monitor 36 and the like. Hereinafter, the microphone amplifier 24a, the A / D converter 24b, the DSP 24c, and the comparison unit 12b are excluded except for the microphone 25, the HDD 16, the MIDI sound source, the video control unit 38, and the monitor 36 described in the [Description of the configuration of the karaoke apparatus 4] column. The reading unit 12a, the reproducing unit 12c, and the D / A converter 24d will be described in this order.

  The microphone amplifier 24a amplifies the singing voice signal input from the microphone 25 and outputs it to the A / D converter 24b. The A / D converter 24b digitizes the input singing voice signal and outputs it to the DSP 24c. The DSP 24c divides the input singing voice signal into frames of, for example, 50 ms, counts the frequency for each frame, calculates the average volume, and outputs it to the comparison unit 12b. Note that the comparison unit 12b compares the volume value output from the DSP 24c with a predetermined volume value, and is input when the volume value output from the DSP 24c is greater than the predetermined volume value. The frequency count value and the average sound volume value for each frame are read by the comparison unit 12b. The comparison unit 12b calculates pitch data and volume based on the frequency count value and the average volume value. Further, the comparison unit 12b is a karaoke song melody pitch data that is used as a reference for singing from the score data of the song data reproduced by the reproduction unit 12c, which will be described later, and the above calculated pitch data. The pitch difference is calculated and scored according to the calculated pitch difference. The reading unit 12a reads the scoring program data from the scoring program memory area 58 provided in the HDD 16 and outputs it to the DSP 24c. The playback unit 12c reads and plays music data from the music data memory area 51 provided in the HDD 16, outputs the played performance data to the MIDI sound source 30, and outputs the played scoring data to the comparison unit 12b for playback. The lyrics telop data and the color change timing clock data are output to the video control unit 38. The D / A converter 24 d converts the musical sound signal output from the MIDI sound source 30 and the audio signal output from the A / D converter 24 b into an analog signal and outputs the analog signal to the speaker 28.

Here, the reason why the input of the singing voice signal is delayed when the singing is scored will be described. FIG. 3 is an explanatory diagram schematically showing factors that delay the input of the singing voice signal.
First, as shown in FIG. 3, a singer who sings at the timing when the lyrics telop changes color is pronounced after seeing the color change of the lyrics telop displayed on the monitor 36. Then, there is a delay between the time when the singer recognizes the color change displayed on the monitor 36 and the time when the voice is produced. This delay time is called singing delay time. It is assumed that this singing delay time varies depending on the reflexes of each singer. In addition, there is a delay until the singing voice signal input from the microphone 25 is output to the main body 45 of the karaoke apparatus 4. That is, there is a delay until the singing voice signal input from the microphone 25 is output to the DSP 24c via the A / D converter 24b (see FIG. 2). This delay time is referred to as a microphone delay time. Here, when the singing voice signal input from the microphone 25 is output to the DSP 24c via the A / D converter 24b as a digital value, the control unit 12 switches between the A / D converter 24b and the DSP 24c. When the data of the connected signal (data bus) is extracted, it is determined whether or not the microphone sound is input based on whether or not the data is larger than a predetermined value. For example, a comparator (not shown) is used to detect that the singing voice signal is greater than a predetermined voltage with the A / D converter 24b, and the control unit 12 is notified of the detected signal. In the case of detecting with an analog value, the delay time Tq of the A / D converter 24b is not considered, so it is determined whether or not a singing voice signal is input from the microphone after adding Tq to the detected time. The delay time of the analog signal transmitted by the analog circuit such as the microphone 25 or the microphone amplifier 24a is sufficiently small compared with the digital circuit such as the A / D converter 24b or the DSP 24c. In the configuration of the invention, the effect is not affected even if the delay time is not taken into consideration. A time obtained by adding the above-described microphone delay time to the above-described singing delay time and summing it up is referred to as a delay time T1 (see FIG. 3).

  Further, there is a delay until the singing voice signal input to the DSP 24c (see FIG. 2) is processed inside the DSP 24c as described above and output to the comparison unit 12b. This delay time is referred to as delay time T2 (see FIG. 3). This delay time T2 is specified by the type of digital filter used in the DSP 24c, the order of the digital filter, and the sampling time of the audio signal.

  Further, there is a delay until the reproduction unit 12c (see FIG. 2) outputs the reproduced lyrics telop data and color change timing clock data to the monitor 36 via the video control unit 38. This delay time is referred to as a delay time T3 (see FIG. 3). This delay time T3 is a design value specified at the time of design.

[Description of other configurations]
The routers 120 and 130 described above are so-called VPN gateways that use VPN technology that creates a state in which a communication path on an external network such as the Internet 200 is encrypted and is virtually connected by a dedicated line. The routers 120 and 130 are placed at connection points between the Internet 200 as an external network and the LAN 100 as an internal network and the network on the host server 2 side, respectively, and encrypt communication from the internal network and send it to the Internet 200 side. . Also, the communication from the Internet 200 side is decrypted and sent to the internal network.

[Description of login process of karaoke device 4]
Below, the process sequence of the login process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of Fig.7 (a). This process is executed when the karaoke apparatus 4 is activated. FIG. 7A is a flowchart illustrating a procedure of “login process of the karaoke device 4” executed by the control unit 12 of the karaoke device 4.

  First, it is determined whether a user ID and a password have been input (S110). Specifically, for example, a guidance screen for logging in is displayed on the monitor 36 of the karaoke apparatus 4, and whether or not a user ID and a password are input via the operation processing unit 22 by operating the operation unit 18. to decide. If it is determined that the user ID and password are not input (S110: NO), the process waits until the user ID and password are received. If it is determined that the user ID and password are received (S110: YES). , The process proceeds to S120.

  In the process of S120, the received user ID and password are transmitted to the control unit 2a of the host server 2 together with information for requesting login to the host server 2. When the process of S120 ends, the process proceeds to S130.

  In the process of S130, it is determined whether or not the user ID or the user ID and the time T1 data are received from the control unit 2a of the host server 2. If it is determined that the user ID or the user ID and time T1 data are received (S130: YES), the process proceeds to S140. On the other hand, when it is determined that the user ID or the user ID and the time T1 data are not received (S130: NO), the process returns to S110.

  In the process of S140, the login information is displayed on the monitor 36. Specifically, the user ID received in the process of S130 described above is displayed on the monitor 36 by controlling the video control unit 38. When the process of S140 ends, the process returns to S110.

[Description of login processing of host server 2]
Below, the processing procedure of the login process executed by the control unit 2a of the host server 2 will be described based on the flowchart of FIG. This process is executed when the host server 2 is activated. FIG. 7B is a flowchart illustrating a procedure of “login process of the host server 2” executed by the control unit 2a of the host server 2.

  First, it is determined whether a user ID and a password have been received (S910). Specifically, it is determined whether or not a user ID and a password are received together with information for requesting the login of the registered user transmitted from the karaoke apparatus 4. If it is determined that the user ID and password are not received (S910: NO), the process waits until the user ID and password are received. If it is determined that the user ID and password are received (S910). : NO), the process proceeds to S920.

  In the process of S920, the user ID registered in the user registration database 2d (see FIG. 6A) of the database 2b is used as the user ID and password transmitted together with the information for requesting the login of the registered user. By verifying the password and the password, it is determined whether or not the user who has requested the login can be authenticated. When it is determined that the transmitted user ID and password match the user ID and password registered in the user registration database 2d (S920: YES, authentication OK), the process proceeds to S930. On the other hand, if it is determined that the transmitted user ID and password do not match the user ID and password registered in the user registration database 2d (S920: NO, authentication NG), the process returns to S910.

  In the process of S930, it is determined whether or not there is time T1 data in an area (my page) corresponding to the user ID. Specifically, it is determined whether time T1 data corresponding to the user ID in the above-described user registration database 2d (see FIG. 6A) is stored. If it is determined that there is time T1 data in the area (My Page) corresponding to the user ID (S930: YES), the process proceeds to S940. On the other hand, when it is determined that there is no time T1 data in the area corresponding to the user ID (my page) (S930: NO), the process proceeds to S960.

  In the process of S940, time T1 data is read from the area (my page) corresponding to the user ID. Specifically, time T1 data corresponding to the user ID in the above-described user registration database 2d (see FIG. 6A) is read. When the process of S940 ends, the process proceeds to S950.

In the process of S950, the user ID and the time TI data are transmitted to the karaoke apparatus 4 that requested the login. When the process of S950 is completed, the process returns to S910.
In the process of S960, the user ID is transmitted to the karaoke apparatus 4 that requested the login. When the process of S960 is completed, the process returns to S910.
This process ends.

[Description of Karaoke Performance Processing of Control Unit 12]
Below, the process sequence of the karaoke performance process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG. This process is executed when the karaoke apparatus 4 is activated. FIG. 8 is a flowchart illustrating a procedure of “a karaoke performance process performed by the control unit 12” executed by the control unit 12 of the karaoke apparatus 4.

  First, it is determined whether or not a music selection number has been received from the operation processing unit 22 (S210). Specifically, a guidance screen for inputting, for example, a song number for karaoke performance is displayed on the monitor 36 of the karaoke device 4, and the music selection selected via the operation processing unit 22 by operating the operation unit 18. It is determined whether or not a number has been accepted. If it is determined that the music selection number has not been received (S210: NO), the process waits until the music selection number is received. If it is determined that the music selection number has been received (S210: YES), the process proceeds to S212. .

  In the process of S212, music data corresponding to the music selection number is read from the HDD 16. Specifically, the music data corresponding to the selected music number is read from the music data memory area 51 provided in the HDD 16. When the process of S212 is completed, the process proceeds to S214.

  In the process of S214, it is determined whether or not an instruction for singing a song is accepted from the operation processing unit 22. Specifically, for example, a guidance screen for inputting an instruction for scoring a song is displayed on the monitor 36 of the karaoke apparatus 4, and an instruction for scoring a song is accepted via the operation processing unit 22 when the operation unit 18 is operated. It is determined whether or not. And when it is judged that the instruction | indication which carries out song scoring was received (S214: YES), it transfers to the process of S216. On the other hand, if it is determined that the instruction for singing is not accepted (S214: NO), the process proceeds to S230.

In the process of S216, the process proceeds to a time T1 specifying process in a [time T1 specifying process] column described later. When the process of S216 is completed, the process proceeds to S218.
In the process of S218, the process proceeds to a time T2 specifying process in a [time T2 specifying process] column described later. When the process of S218 is completed, the process proceeds to S222.

  In the process of S222, the music data read from the HDD 16 in the process of S212 is played back. Specifically, as described above in the “Description of the configuration of the scoring unit 40 of the karaoke device 4” column, the music data read from the HDD 16 is reproduced, and the reproduced performance data is output to the MIDI sound source 30. The reproduced scoring data is output to the comparison unit 12b, and the reproduced lyrics telop data and color change timing clock data are output to the video control unit 38. When the process of S222 is completed, the process proceeds to S224.

In the process of S224, the process proceeds to a scoring process in a [Scoring process] column described later. When the process of S224 ends, the process returns to S210.
This process ends.

  In the process of S230, the music data read from the HDD 16 in the process of S212 is played back. Specifically, the performance data of the music data is played back, and the music data read from the HDD 16 is played back and played back as described in the section “Description of the configuration of the scoring unit 40 of the karaoke device 4”. The performance data is output to the MIDI sound source 30, the reproduced scoring data is output to the comparison unit 12b, and the reproduced lyrics telop data and color change timing clock data are output to the video control unit 38. When the process of S230 ends, the process proceeds to S234.

In the process of S234, it is determined whether or not the performance reproduction has ended. If it is determined that the performance reproduction has not ended (S234: NO), the process returns to S230. On the other hand, if it is determined that the performance reproduction has ended (S234: YES), the process returns to S210.
This process ends.

[Description of Time T1 Identification Process of Control Unit 12]
Below, the process sequence of the time T1 specific process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG. This process is executed when the process proceeds to S216 during execution of the karaoke performance process of the control unit 12 described above. FIG. 9 is a flowchart showing a procedure of “time T1 specifying process of the control unit 12” executed by the control unit 12 of the karaoke apparatus 4.

  First, it is determined whether or not the user ID and time T1 data are received. Specifically, it is determined whether or not the user ID and the time T1 data are received in the process of S130 in the [login process of karaoke apparatus 4] column described above. If it is determined that the user ID and time T1 data are received (S310: YES), the process proceeds to S312. On the other hand, if it is determined that the user ID and time T1 data have not been received (S310: NO), the process proceeds to S314.

  In the process of S312, “T1temp = 0” is set. Specifically, the user ID and time T1 data are stored in a memory (not shown) built in the control unit 12, and the time T1 data is stored in the host server 2 in the T1temp memory area 60 memory area provided in the HDD 16. A numerical value “0” indicating this is stored. When the process of S312 is completed, the process proceeds to S338.

  In the process of S314, it is determined whether or not to perform a reflex nerve test. Specifically, as described above in the section “Description of the configuration of the scoring unit 40 of the karaoke device 4”, it is determined whether or not to perform a test for measuring the delay time T1 (see FIG. 3). If it is determined that a reflex nerve test is to be performed (S314: YES), the process proceeds to S316. On the other hand, when it is determined not to perform the reflex nerve test (S314: NO), the process proceeds to S330.

  In the process of S316, the monitor 36 is instructed to display “Please speak when something is displayed”. Specifically, the video control unit 38 is controlled to display “Please speak when something is displayed” on the monitor 36. When the process of S316 is completed, the process proceeds to S318.

  In the process of S318, the monitor 36 is instructed to delete the screen. Specifically, the video display unit 38 is controlled to erase the screen display displayed on the monitor 36. When the process of S318 is completed, the process proceeds to S320.

  In the process of S320, the monitor 36 is instructed to display “A”, for example. Specifically, the video control unit 38 is controlled to display, for example, “A” on the monitor 36. When the process of S320 is completed, the process proceeds to S322.

  In the process of S322, the timer is reset and time measurement is started. Specifically, time measurement is started by a timer (not shown) built in the control unit 12. When the process of S322 ends, the process proceeds to S324.

  In the process of S324, it is determined whether or not a microphone voice is input. Specifically, as described above in the section “Description of the configuration of the scoring unit 40 of the karaoke device 4”, the singing voice signal input from the microphone 25 is transmitted via the A / D converter 24b (see FIG. 2). It is determined whether or not the signal has been output to the DSP 24c.

  If it is determined that the microphone sound is input (S324: YES), the process proceeds to S328. On the other hand, if it is determined not to input the microphone sound (S324: NO), the process proceeds to S326.

In the process of S326, the numerical value “1” is added to the timer. When the process of S326 is completed, the process returns to S324.
In the process of S328, the numerical value of T1 is measured and set to “T1temp = 0”. Specifically, the time measurement by a timer (not shown) built in the control unit 12 is terminated. Then, the user ID and the time T1 data are stored in a memory (not shown) built in the control unit 12, and the time T1 data is stored in the host server 2 in the T1temp memory area 60 memory area provided in the HDD 16. The numerical value “0” is stored. When the process of S328 is completed, the process proceeds to S338.

  In the process of S330, T1A is read from the scoring program. Specifically, the music data corresponding to the selected music number is read from the time T1A memory area 73 (see FIG. 5B) provided in the scoring program memory area 58 provided in the HDD 16. . When the process of S330 is completed, the process proceeds to S332.

  In the process of S332, “T1 = T1A” and “T1temp = 1” are set. Specifically, the user ID and the time T1A data read from the time T1A memory area 73 are stored as time T1 data in a memory (not shown) built in the control unit 12, and the T1temp memory area 60 memory provided in the HDD 16 is stored. A numerical value “1” indicating that the time T1 data is not stored in the host server 2 is stored in the area. When the process of S332 is completed, the process proceeds to S338.

  In the process of S338, the monitor 36 is instructed to initialize the screen. Specifically, the video control unit 38 is controlled to initialize the screen of the monitor 36. When the process of S338 is completed, the process proceeds to S340.

  In the process of S340, it is determined whether or not “T1temp = 0”. Specifically, it is determined whether or not the numerical value stored in the T1temp memory area 60 provided in the HDD 16 is “0”. If it is determined that “T1temp = 0” (S340: YES), the process proceeds to S342. On the other hand, if it is determined that “T1temp = 0” is not satisfied (S340: NO), this process is terminated.

  In the process of S342, T1 is stored in the user memory corresponding to the user ID. Specifically, the user ID and time T1 data stored in a memory (not shown) built in the control unit 12 are read, and the user ID and time T1 data are associated with the user memory area 52 provided in the HDD 16. Remember. When the process of S342 is finished, this process is finished.

[Description of time T2 specifying process of control unit 12]
Below, the process sequence of the time T2 specific process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG. This process is executed when the process proceeds to S218 during the karaoke performance process of the control unit 12 described above. FIG. 10 is a flowchart showing a procedure of “time T2 specifying process of the control unit 12” executed by the control unit 12 of the karaoke apparatus 4.

  First, the scoring program is read and transferred to the DSP 24c (S412). Specifically, as described in the section “Description of the configuration of the scoring unit 40 of the karaoke device 4”, the scoring program data is read from the scoring program memory area 58 provided in the HDD 16 and output to the DSP 24c. When the process of S412 is completed, the process proceeds to S414.

  In the process of S414, it is determined whether time T2A data is attached to the scoring program data. Specifically, it is determined whether or not time T2A data is stored in the time T2A memory area 72 (see FIG. 5B) provided in the scoring program memory area 58. If it is determined that the time T2A data is attached to the scoring program data (S414: YES), the process proceeds to S416. On the other hand, when it is determined that the time T2A data is not attached to the scoring program data (S414: NO), the process proceeds to S422.

  In the process of S416, the time T2A data is extracted and stored in the HDD 16. Specifically, the time T2A data is read from the time T2A memory area 72 (see FIG. 5B) provided in the scoring program memory area 58, and the read time T2A data is set in the time T2A memory area 54 provided in the HDD 16. Time T2A data is stored. When the process of S416 is completed, the process proceeds to S422.

  In the process of S422, it is determined whether or not time T2B data is attached to the music data. Specifically, whether or not the music data (see FIGS. 4B and 4C) read out in the process of S212 in the karaoke performance process of the control unit 12 described above has time T2B data. Judging. When it is determined that the time T2B data is attached to the music data (S422: YES), the process proceeds to S424. On the other hand, when it is determined that the time T2B data is not attached to the music data (S422: NO), the process proceeds to S426.

  In the process of S424, “T2 = T2B” is set. Specifically, the time T2B data is read from the music data, and the read time T2B data is stored as time T2 data in the time T2 memory area 55 provided in the HDD 16. When the process of S424 ends, this process ends.

  In the process of S426, it is determined whether or not time T2A data is stored in the HDD 16. Specifically, it is determined whether or not time T2A data is stored in the time T2A memory area 54 provided in the HDD 16. If it is determined that the time T2A data is stored in the HDD 16 (S426: YES), the process proceeds to S428. On the other hand, when it is determined that the time T2A data is not stored in the HDD 16 (S426: NO), the process proceeds to S430.

  In the process of S428, “T2 = T2A” is set. Specifically, the time T2A data stored in the time T2A memory area 54 provided in the HDD 16 is read, and the read time T2A data is stored in the time T2 memory area 55 provided in the HDD 16 as time T2 data. When the process of S428 is finished, this process is finished.

In the process of S430, the process proceeds to an analysis process in the [Analysis process] column for a scoring program described later. When the process of S430 is completed, the process proceeds to S432.
In the process of S432, “T2 = T2C” is set. Specifically, the T2C data calculated in the process of S520 in the analysis process in the [Analysis process] column for the scoring program described later is stored as time T2 data in the time T2 memory area 55 provided in the HDD 16. When the process of S432 is completed, the present process is terminated.

[Description of Analysis Process of Control Unit 12]
Below, the process sequence of the analysis process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG. This process is executed when the process proceeds to S430 during execution of the time T2 specifying process of the control unit 12 described above. FIG. 11 is a flowchart illustrating a procedure of “analysis processing of the control unit 12” executed by the control unit 12 of the karaoke apparatus 4.

  First, the type of the digital filter of the DSP 24c and the order of the digital filter are extracted from the scoring program, and the sample delay number Tn is specified (S510). Specifically, the digital filter type is read from the digital filter type memory area 74 provided in the scoring program memory area 58, the digital filter order is read from the digital filter order memory area 75, and the sample delay number Tn is specified. . When the processing of S510 is completed, the process proceeds to S520.

  In the process of S520, the delay time T2C of the DSP 24c is calculated from Tn and the sampling frequency Fs of the audio signal. Specifically, the sampling frequency Fs of the audio signal is read from the sampling period memory region 76 of the audio signal provided in the scoring program memory area 58, and the sampling delay number Tn specified in the processing of S510 and the sampling frequency of the audio signal The delay time T2C of the DSP 24c is calculated from Fs. When the process of S520 is finished, this process is finished.

[Description of scoring process of control unit 12]
Below, the process procedure of the scoring process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of Fig.12 (a). This process is executed when the process proceeds to S224 during execution of the karaoke performance process of the control unit 12 described above. FIG. 12A is a flowchart illustrating a procedure of “scoring process of the control unit 12” executed by the control unit 12 of the karaoke apparatus 4.

  First, T1 is read from the memory of the control unit 12 (S610). Specifically, the user ID and time T1A data stored in a memory (not shown) built in the control unit 12 in the above-described time T1 specifying process of the control unit 12 are read from the memory. When the process of S610 is completed, the process proceeds to S612.

  In the process of S612, T2 is read from the time T2 memory of the HDD 16. Specifically, the time T2 data stored in the time T2 memory area 55 provided in the HDD 16 in the time T2 specifying process of the control unit 12 described above is read from the HDD 16. When the process of S612 is completed, the process proceeds to S614.

  In the process of S614, T3 is read from the time T3 memory of the HDD 16. Specifically, the time T3 data is read from the time T3 memory area 56 provided in the HDD 16. When the process of S614 ends, the process proceeds to S616.

  In the process of S616, it is determined whether or not a color change timing clock has been input. Specifically, it is determined whether or not a color change timing clock is input from the color change timing clock data reproduced in S222 of the karaoke performance process of the control unit 12 described above. If it is determined that the color change timing clock has not been input (S616: NO), it waits until the color change timing clock is input, and if it is determined that the color change timing clock has been input (S616). : YES), the process proceeds to S618.

  In the process of S618, the process waits for “T1 + T2 + T3” time. Specifically, the time T1, the time T2, and the time T3 are summed from the time T1 data read in S610, the time T2 data read in S612, and the time T3 data read in S614. Wait for the time. When the process of S618 is completed, the process proceeds to S620.

  In the process of S620, the pitch is detected, the input voice data is compared with the scoring data, the scoring result is calculated, and stored in the scoring memory of the HDD 16 in association with the song name and date / time. Specifically, as described in the section “Description of the configuration of the scoring unit 40 of the karaoke device 4”, the frequency count value and the average volume value for each frame output from the DSP 24c are read, and the frequency count value and Pitch data and volume are determined based on the average volume value. Furthermore, the pitch difference between the pitch data of the singing melody of the karaoke song, which is a reference for comparison when singing the song from the score data of the music data, and the pitch data calculated above is calculated, and the calculated pitch difference Scoring according to. And it is memorize | stored in the user memory area 52 provided in HDD16 with the user ID, the music number, the music name, the score of the singing score mentioned above, the date and time of the singing time measured by the clock built in the control unit 12. The time T1 data is associated and stored in the scoring memory area 53 provided in the HDD 16. When the process of S620 is completed, the process proceeds to S622.

  In the process of S622, the scoring result is transferred to the video control unit. Specifically, the score of the singing score scored in the process of S620 is transferred to the video control unit 38. Then, the video control unit 38 is controlled to display the singing score on the monitor 36. When the process of S622 is completed, the process proceeds to S624.

  In the process of S624, it is determined whether or not the performance reproduction has ended. If it is determined that the performance reproduction has not ended (S624: NO), the process returns to S616. On the other hand, when it is determined that the performance reproduction has ended (S624: YES), this process ends.

[Description of Lyric Display Color Changing Process of Video Control Unit 38]
Below, the process sequence of the lyric display color change process performed by the image | video control part 38 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG.12 (b). This process is executed corresponding to the process of S222 or the process of S230 of the karaoke performance process of the control unit 12 described above. FIG. 12B is a flowchart showing the procedure of “the lyrics display color changing process of the video control unit 38” executed by the video control unit 38 of the karaoke apparatus 4.

  First, it is determined whether or not a one-screen lyrics telop has been received (S710). Specifically, it is determined whether or not the reproduced lyrics telop data and color change timing clock data output from the control unit 12 in the process of S222 or S230 of the karaoke performance process of the control unit 12 are received. . If it is determined that the one-screen lyrics telop has not been received (S710: NO), it waits until the one-screen lyrics telop is received, and if it is determined that the one-screen lyrics telop has been received. (S710: YES), the process proceeds to S712.

  In the process of S712, the character “Mx = M1” in the characters M1 to Mm for one screen displayed on the monitor 36 is assumed. Specifically, the mathematical expression “Mx = M1” is stored in a counter (not shown) built in the video control unit 38. When the process of S712 is completed, the process proceeds to S714.

  In the process of S714, characters M1 to Mm for one screen of the lyrics telop are extracted from the song data, and display of the characters M1 to Mm is instructed to the monitor 36. Specifically, characters M1 to Mm for one screen are extracted from the received lyrics telop data, and the characters M1 to Mm are displayed by controlling the monitor 36. When the process of S714 is completed, the process proceeds to S716.

  In the process of S716, it is determined whether or not a color change timing clock is output. Specifically, it is determined whether or not a color change timing clock is output from the received color change timing clock data. If it is determined that the color change timing clock has not been output (S716: NO), it waits until the color change timing clock is output, and if it is determined that the color change timing clock has been output (S716). : YES), the process proceeds to S718.

  In the processing of S718, the monitor 36 is instructed to change the color of the character Mx. Specifically, the display color of the character Mx in the characters M1 to Mm displayed in S714 is changed by controlling the monitor 36. When the process of S718 ends, the process proceeds to S720.

  In the process of S720, it is determined whether or not “Mx = Mm” is satisfied. Specifically, it is determined whether or not the display color of the characters M1 to Mm has been changed up to the character Mm. If it is determined that “Mx = Mm” is satisfied (S720: YES), this process ends. On the other hand, if it is determined that “Mx = Mm” is not satisfied (S720: NO), the process proceeds to S722.

  In the processing of S722, “Mx = Mx + 1” is set. Specifically, the numerical value “1” is added to the mathematical expression “Mx = 1” stored in the counter built in the video control unit 38 to obtain the mathematical formula “Mx = Mx + 1”, and the mathematical expression “Mx = Mx + 1” is stored in the counter built in the video control unit 38. Mx = Mx + 1 ”is stored. When the process of S722 ends, the process returns to S710.

[Description of logout process of karaoke device 4]
Below, the process sequence of the logout process performed by the control part 12 of the karaoke apparatus 4 is demonstrated based on the flowchart of FIG.7 (c). This process is executed when the karaoke apparatus 4 is activated. FIG. 7C is a flowchart illustrating a procedure of “logout process of the karaoke device 4” executed by the control unit 12 of the karaoke device 4.

  First, it is determined whether or not logout has been input (S150). Specifically, for example, a guidance screen for logging out is displayed on the monitor 36 of the karaoke device 4, and it is determined whether or not logout is input via the operation processing unit 22 by operating the operation unit 18. If it is determined that logout is not input (S150: NO), the process waits until logout is input. If it is determined that logout is input (S150: YES), the process proceeds to S160. To do.

  In the process of S160, the contents of the scoring memory are transmitted to the control unit 2a of the host server 2. Specifically, the content data of the scoring memory stored in the scoring memory area 53 provided in the HDD 16 and the scoring place data stored in the scoring place memory area are transmitted to the control unit 2a of the host server 2. When the process of S160 is completed, the process returns to S150.

[Description of logout processing of host server 2]
Hereinafter, a processing procedure of logout processing executed by the control unit 2a of the host server 2 will be described based on the flowchart of FIG. This process is executed when the host server 2 is activated. FIG. 7D is a flowchart illustrating a procedure of “logout process of the host server 2” executed by the control unit 2a of the host server 2.

  First, it is determined whether or not the contents of the scoring memory have been received (S980). Specifically, it is determined whether or not the content data and scoring location data of the scoring memory transmitted from the karaoke apparatus 4 have been received. If it is determined that the content of the scoring memory has not been received (S980: NO), the process waits until the content of the scoring memory is received, and if it is determined that the content of the scoring data has been received (S980: YES), the process proceeds to S990.

  In the process of S990, the contents of the scoring memory are stored in an area (My Page) corresponding to the scoring memory ID. Specifically, the content data of the scoring memory including the time T1 data in the area (my page) corresponding to the user ID transmitted from the karaoke apparatus 4 in the user registration database 2d (see FIG. 6A) of the database 2b. And storing the scoring place data. When the process of S990 is completed, the process returns to S980.

[Description of effects]
According to the karaoke network system 1 of the present embodiment, the following operational effects are achieved. In other words, some karaoke apparatuses having a singing scoring function have a mechanism in which the karaoke lyrics telop displayed on the screen changes color in synchronization with the karaoke performance of the music generated based on the MIDI data, for example. is there. Then, a singer who sings at the timing when the lyrics telop changes color is pronounced at a timing later than the music performance, and the singing score may be lowered due to the delay in the pronunciation. Therefore, a karaoke device is known that calculates the difference between the singer's pronunciation timing and the karaoke performance output timing of the song and changes the timing of the color change of the lyrics telop displayed on the screen, but the karaoke performance is started. After that, in order to repeat the procedure of calculating the difference between the singer's pronunciation timing and the karaoke performance output timing of the song and changing the color change timing of the lyrics telop displayed on the screen, Will be scored at the delayed pronunciation timing, and the singing score may be lowered.

  (1) On the other hand, the karaoke apparatus 4 of this embodiment is comprised as follows. That is, when the control unit 12 of the karaoke apparatus 4 causes the video control unit 38 to display test character data such as “A” on the monitor 36, the singing voice signal input by the microphone 25 is converted into an A / D converter. The time T1 until it is output to the DSP 24c via 24b (see FIG. 2) is measured. When the scoring program data has a time T2A that is processed in advance in the DSP 24c and output to the comparison unit 12b, the control unit 12 has a scoring program memory area provided in the HDD 16. The time T2A data is read from the 58 time T2A memory area 72, and the time indicated by the read time T2A data is defined as time T2. On the other hand, when the scoring program data does not have time T2A data in advance, the control unit 12 selects the digital filter type from the digital filter type memory area 74 of the scoring program memory area 58 provided in the HDD 16. Reading, the order of the digital filter is read from the order memory area 75 of the digital filter, and the sample delay number Tn is specified. Further, the control unit 12 reads the sampling frequency Fs of the audio signal from the sampling period memory region 76 of the audio signal provided in the scoring program memory region 58, and specifies the specified sample delay number Tn, the sampling frequency Fs of the audio signal, From this, a time T2C of the DSP 24c is calculated, and this time T2C is set as a time T2. Further, the control unit 12 reads the time T3 data from the time T3 memory area 56 provided in the HDD 16, and sets the time indicated by the time T3 data as the time T3. Further, the control unit 12 sums the time T1, the time T2, and the time T3 after the video control unit 38 displays the lyrics of the karaoke song indicated by the lyric data in the music data on the monitor 36 based on the character data. After waiting, the frequency count value and the average volume value for each frame output from the DSP 24c after the standby are read, and the pitch data and the volume are calculated based on the frequency count value and the average volume value. Furthermore, the pitch difference between the pitch data of the singing melody of the karaoke song, which is a reference for comparison when singing the song from the score data of the music data, and the pitch data calculated above is calculated, and the calculated pitch difference Scoring according to.

  With this configuration, the time from when the control unit 12 causes the video control unit 38 to display the test character data on the monitor 36 to when the singing voice signal input by the microphone 25 is output to the DSP 24c. T1 is measured. The control unit 12 reads the time T2 data from the HDD 16, or reads the digital filter type, digital filter order, and audio signal sampling frequency Fs from the HDD 16 to calculate the DSP 24c processing time T2 to obtain the time T2. To do. The control unit 12 acquires time T3 from the HDD 16. The control unit 12 displays the lyrics of the karaoke song on the monitor 36 based on the character data, and then waits for a total time of time T1, time T2, and time T3, and the pitch data extracted after the standby is compared with the reference for comparison. The pitch difference with the pitch data of the singing melody of the karaoke song to be calculated is calculated, and scoring is performed according to the calculated pitch difference. Therefore, even when the singing is delayed when singing, it is possible to notify an appropriate scoring result.

  (2) Moreover, the karaoke network system 1 of the present embodiment is configured as follows. That is, in the karaoke network system 1, the user ID received by the interface unit 2c when the database 2b of the host server 2 is logged in to the host server 2 by a registered user who is permitted to log in to the host server 2 by the control unit 2a. And the time T1 data is associated and stored in the user registration database. Further, the interface unit 2c determines whether or not the user registration database including the user ID is stored in the database 2b. If the interface unit 2c determines that the user registration database is stored in the database 2b, the user ID and the user ID are stored from the user registration database including the user ID. The time T1 data is transmitted to the karaoke apparatus 4 by controlling the interface unit 2c. Then, the control unit 12 of the karaoke apparatus 4 determines whether or not the user ID and the time T1 data have been received by the interface unit 14. Is the time T1 indicated by the time T1 data received by.

  Since it is configured in this way, a test for measuring the time T1 can be omitted for a singer whose user ID and time T1 data are stored in the host server 2. Further, since the user ID and the time T1 data are stored in the host server 2, any karaoke device 4 connected to the host server 2 can be assigned to the host server 2 by the user ID. For a singer in which time T1 data is stored, the test for measuring time T1 can be omitted. Therefore, the user registration database in which the user ID and the time T1 data are associated with each other can be omitted for a singer stored in the database 2b of the host server 2 and the test for measuring the time T1 can be omitted. . Moreover, the utilization frequency of the karaoke network system 1 can be raised by improving the convenience of the singer.

[Description of Other Embodiments]
In the said embodiment, although the time T1 which the control part 12 of the karaoke apparatus 4 measured is not displayed on the monitor 36, you may display. According to the karaoke apparatus configured as described above, the time T1 measured by the control unit 12 is displayed on the monitor 36, so that the singer can know the habit of delaying singing. Therefore, for a singer who sings while watching the display color of the karaoke lyrics changed, assistance for improving the singing score can be obtained.

1 is a block diagram illustrating an overall configuration of a karaoke network system 1. FIG. It is a block diagram which shows the structure of the scoring part 40 of the karaoke apparatus 4. FIG. It is explanatory drawing which shows typically about the factor which the input of a singing voice signal delays. (A) is explanatory drawing which shows the memory area provided in HDD16, (b) is explanatory drawing which shows the data structure of the music data in case performance data is MIDI data, (c) is performance data in MPEG. It is explanatory drawing which shows the data structure of the music data in the case of data, (d) is explanatory drawing which shows a user memory area. (A) is explanatory drawing which shows a scoring memory area, (b) is explanatory drawing which shows a scoring program memory area. (A) is explanatory drawing which shows the specific content of the user registration database 2d, (b) is explanatory drawing which shows the specific content of personal Web page database 2e, (c) is the content of the scoring result of a song It is a figure which shows the example of a display on the web browser of the personal web page which has. (A) is a flowchart which shows the procedure of the "login process of the karaoke apparatus 4" which the control part 12 of the karaoke apparatus 4 performs, (b) is the "login of the host server 2" which the control part 2a of the host server 2 performs 7 is a flowchart showing a procedure of “processing”, (c) is a flowchart showing a procedure of “logout process of karaoke device 4” executed by the control unit 12 of the karaoke device 4, and (d) is a control unit of the host server 2. It is a flowchart which shows the procedure of the "logout process of the host server 2" which 2a performs. It is a flowchart which shows the procedure of the "karaoke performance process of the control part 12" which the control part 12 of the karaoke apparatus 4 performs. It is a flowchart which shows the procedure of the "time T1 specific process of the control part 12" which the control part 12 of the karaoke apparatus 4 performs. It is a flowchart which shows the procedure of the "time T2 specific process of the control part 12" which the control part 12 of the karaoke apparatus 4 performs. It is a flowchart which shows the procedure of the "analysis process of the control part 12" which the control part 12 of the karaoke apparatus 4 performs. (A) is a flowchart which shows the procedure of the "scoring process of the control part 12" which the control part 12 of the karaoke apparatus 4 performs, (b) is the "video control part 38 which the video control part 38 of the karaoke apparatus 4 performs. Is a flowchart showing a procedure of “lyric display color changing process”.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Karaoke network system, 2 ... Host server, 2a ... Control part, 2b ... Database, 2c ... Interface part, 2d ... User registration database, 2e ... Personal Web page database, 4 ... Karaoke apparatus, 12 ... Control part, 12a ... Reading unit, 12b ... Comparison unit, 12c ... Playback unit, 14 ... Interface unit, 16 ... Hard disk (HDD), 18 ... Operation unit, 22 ... Operation processing unit, 24 ... Audio control unit, 24a ... Microphone amplifier, 24b ... A / D converter, 24c ... DSP, 24d ... D / A converter, 25 ... microphone, 28 ... speaker, 30 ... MIDI sound source, 32 ... video RAM, 34 ... video playback unit, 36 ... monitor, 38 ... video control unit, 40 ... scoring section, 45 ... main body section, 51 ... music data memory area, 52 ... user memory area, 53 ... scoring system 54 ... Time T2A memory area, 55 ... Time T2 memory area, 56 ... Time T3 memory area, 57 ... Scoring place memory area, 58 ... Scoring program memory area, 59 ... Karaoke control program memory area, 60 ... T1temp memory Area 71. Scoring program body memory area 72 time T2A memory area 73 time T1A memory area 74 digital filter type memory area 75 digital filter order memory area 76 sampling period memory area 120 , 130 ... router, 200 ... Internet.

Claims (5)

Display means capable of displaying character data indicating the lyrics of the karaoke song;
Data for karaoke performance, pitch data of singing melody of karaoke song, lyric data including character data indicating lyrics of karaoke song, and display color of the lyric character data when the lyric character data is displayed on the display means, karaoke Song data storage means for storing song data including color change data for changing the character color of the lyrics to be sung according to the progress of the song;
Music data acquisition means capable of acquiring the music data from the music data storage means;
Displaying the lyrics of the karaoke song indicated by the lyrics data in the song data acquired by the song data acquisition means on the display means based on the character data, based on the color change data in the song data at that time, Display control means for changing the display color of the character data indicating the lyrics of the karaoke song displayed on the display means, the character color of the lyrics to be sung according to the progress of the karaoke song;
An audio signal input means for inputting an audio signal of karaoke singing;
Measuring means for measuring a time T1 from when the display control means displays the test character data on the display means to when the voice signal indicating the test character data is input by the voice signal input means;
The karaoke song lyrics indicated by the lyrics data in the song data by the display control means are displayed on the display means based on the character data and then delayed by the time T1 and input by the voice signal input means. A pitch extraction means for extracting pitch data of the karaoke song from the voice signal of the song;
A pitch difference between the pitch data of the singing melody of the karaoke song in the music data acquired by the music data acquisition unit and the pitch data of the karaoke song extracted by the pitch extraction unit is calculated and calculated. Scoring means for scoring according to the pitch difference;
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
Scoring program data storage means for storing scoring program data for causing a computer to function as the scoring means;
The scoring program data has in advance time T2 data required for data processing from when the audio signal in the scoring program processing is input to the scoring program until scoring is completed,
Scoring program data acquisition means capable of acquiring the scoring program data from the scoring program data storage means;
A time T2 data extracting means for extracting the time T2 data from the scoring program data acquired by the scoring program data acquiring means;
The pitch extraction means causes the display control means to display the lyrics of the karaoke song indicated by the lyric data in the music data on the display means based on the character data, and is then extracted by the extraction means at the time T1. The pitch data of the karaoke song is extracted from the voice signal of the karaoke song input by the voice signal input means with a delay of the total time including the time T2 indicated by the time T2 data. The karaoke apparatus according to claim 1,
Scoring program data storage means for storing scoring program data for causing a computer to function as the scoring means;
Scoring program data acquisition means capable of acquiring the scoring program data from the scoring program data storage means;
Order data extraction means for extracting data indicating a predetermined digital filter type, order of the digital filter, and sampling time of the audio signal from the scoring program data acquired by the scoring program data acquisition means; ,
Data from the time the audio signal is input to the scoring program until the scoring is completed based on the type of the digital filter extracted by the order data extraction means, the order of the digital filter, and the sampling time of the audio signal A calculating means for calculating a time T2 required for processing;
With
The pitch extraction means is calculated by the calculation means at the time T1 after the display control means displays the lyrics of the karaoke song indicated by the lyric data in the music data on the display means based on the character data. A karaoke apparatus which extracts pitch data of a karaoke song from the voice signal of the karaoke song input by the voice signal input means with a delay of a total time including the time T2. In the karaoke apparatus in any one of Claims 1-3,
The karaoke apparatus, wherein the display control means causes the display means to display a time T1 measured by the measuring means. A karaoke device according to any one of claims 1 to 4, a host server, and a network connecting the karaoke device and the host server, and various information between the karaoke device and the host server. A karaoke network system configured to be able to transmit and receive via the network,
The host server is
Host server side receiving means capable of receiving authentication request information including user identification information and password information transmitted from the karaoke device, or user identification information and time T1 information indicating the time T1;
A registered user who is a user permitted to log in to the host server is authenticated by the authentication request information received by the receiving means on the host server side, and the authenticated registered user is permitted to log in to the host server. Authenticating means to
The time when the registered user who is permitted to log in to the host server by the authenticating means associates the identification information and the time T1 information related to the registered user received by the receiving means on the host server side during the login to the host server. Storage means for storing T1-related information;
Host server side transmission means capable of transmitting the identification information related to the registered user stored in the storage means and the time T1 information to the karaoke device;
It is determined whether or not time T1 related information including identification information related to the registered user is stored in the storage unit. If it is determined that the time T1 related information is stored, the registered user is determined from the time T1 related information related to the registered user. Host server side control means for controlling the host server side transmission means to transmit the identification information and the time T1 information to the karaoke apparatus;
With
The karaoke apparatus further includes authentication request information receiving means for receiving authentication request information about the user,
Karaoke device side transmitting means for transmitting the authentication request information received by the authentication request information receiving means to the host server;
When a registered user who is permitted to log in to the host server by the authentication unit determines whether or not the time T1 is measured by the measuring unit while logging in to the host server, and determines that the time is measured Karaoke device side control means for controlling the karaoke device side transmission means to transmit the identification information on the registered user and the time T1 information indicating the time T1 to the host server;
Karaoke device side receiving means capable of receiving identification information and time T1 information relating to a registered user transmitted from the host server;
With
The pitch extracting means determines whether or not the identification information and time T1 information related to the registered user has been received by the karaoke apparatus side receiving means. A karaoke network system characterized by extracting pitch data of a karaoke song as being the time T1 indicated by the time T1 information received by the karaoke apparatus side receiving means.

Images