JP2011221064A - Karaoke system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke system which converts a timbre of a voice and allows a user to easily select the type of timbre converted.SOLUTION: The karaoke system comprises: a karaoke main body 20 having output signal generation means which generates an output signal based on a voice signal outputted from a microphone 30 and the information of accompaniment music; a speaker 40 which reproduces the output signal into a voice; a gradient sensor for measuring gradient; and a mobile terminal 60 having communicating means which transmits the gradient information measured by the gradient sensor to the karaoke main body. The karaoke main body 20 has timbre type determination means which determines a timbre type to which the voice signal output from the microphone 30 is converted based on the gradient information and timbre conversion means which converts the timbre of the voice signal output from the microphone 30 in order to generate the conversion voice information based on the timbre type.

Description

  The present invention relates to a karaoke system for converting the timbre of a voice.

  Conventionally, as shown in Patent Document 1, a karaoke system for converting the tone of a voice by a user has been proposed.

JP-A-1-20597

In the karaoke system shown in Patent Document 1, since the timbre to be converted is fixed, it is difficult to easily select the timbre to be converted.
An object of the present invention is to solve the above problems and provide a karaoke system that allows a user to easily select a timbre type to be converted in a karaoke system that converts a timbre of a voice.

The invention according to claim 1, which has been made to solve the above problems,
A microphone that generates an audio signal from audio;
Accompaniment music information acquisition means for acquiring accompaniment music information, and an output signal generation means for generating an output signal based on an audio signal output from the microphone and accompaniment music information acquired by the accompaniment information acquisition means When,
In a karaoke system comprising a speaker that reproduces the output signal as audio,
A tilt sensor for measuring the tilt,
A portable terminal further comprising a communication means for transmitting the inclination information measured by the inclination sensor to the karaoke apparatus body;
The karaoke apparatus body is
A timbre type determining means for determining a timbre type to which an audio signal output from the microphone is converted based on the gradient information transmitted by the portable terminal;
Further comprising timbre conversion means for converting the timbre of the voice signal output from the microphone to generate converted voice information based on the timbre type determined by the timbre type determination means;
The output signal generation means generates the output signal by synthesizing the converted voice information and the accompaniment music information.

The invention according to claim 2 is the invention according to claim 1,
The timbre type determining means determines the timbre type by determining the attitude of the mobile terminal based on the gradient information transmitted by the mobile terminal based on a threshold value.
Thereby, the kind of timbre is determined reliably.

The invention according to claim 3 is the invention according to claim 1 or 2,
The karaoke apparatus main body further includes pitch correction means for correcting the pitch of the audio signal output from the microphone based on the accompaniment music information.
Thus, even when the user utters the accompaniment music at a different pitch, converted voice information suitable for the accompaniment music is generated.

The invention according to claim 4 is the invention according to claims 1 to 3,
The karaoke apparatus main body further includes rhythm correction means for correcting the rhythm of the audio signal output from the microphone based on the accompaniment music information.
Thereby, even if the user utters the rhythm of the accompaniment music, the converted voice information suitable for the accompaniment music is generated.

The invention according to claim 5 is the invention according to claims 1 to 4,
The portable terminal further includes an acceleration sensor that measures acceleration,
The transmission means transmits the acceleration information measured by the acceleration sensor to the karaoke apparatus body through the communication means,
The karaoke apparatus main body further includes effect adding means for adding an effect to the converted voice information generated by the timbre converting means based on the acceleration information transmitted from the portable terminal.
Thereby, the user can add an effect to the converted voice information by a simple operation of moving the mobile terminal.

  According to the present invention, since the karaoke apparatus main body determines the timbre type based on the inclination information of the mobile terminal, the user can select the type of musical sound by an easy operation of tilting the mobile terminal.

1 is an overall view of a karaoke system showing an embodiment of the present invention. It is a block diagram of a karaoke system. It is a flowchart of a main process. It is a flowchart of a timbre determination process. It is a flowchart of a pitch correction process. It is a flowchart of a rhythm correction process. It is a flowchart of an effect addition process. It is explanatory drawing of timbre determination. It is explanatory drawing of a pitch comparison process. It is explanatory drawing of a rhythm correction process. It is explanatory drawing of an additional effect process.

(Outline of the present invention)
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. As shown in FIG. 1, the karaoke system 100 of the present invention includes a karaoke device main body 20, a microphone 30 connected to the karaoke main device 20, a speaker 40, an image display device 50, and a portable terminal 60. ing. The karaoke apparatus body 20 is connected to the public communication network 900. The karaoke apparatus body 20 acquires “accompaniment video information” from the public communication network 900. Then, the karaoke apparatus body 20 extracts the “accompaniment music information” from the “accompaniment video information” and combines the “accompaniment music information” with the “voice signal” output from the microphone 30 to generate an “output signal”. To do. Then, the “output signal” is output to the speaker 40. Further, the karaoke apparatus body 20 generates an “accompaniment video signal” from the acquired “accompaniment video information” and outputs the “accompaniment video signal” to the image display device 50.

  The user utters the microphone 30 while listening to the accompaniment music reproduced from the speaker 40 or watching the accompaniment moving image displayed on the image display device 50. In the present invention, the “voice signal” output from the microphone 30 is converted into a timbre by the karaoke apparatus body 20 and output to the speaker 40. The user can select the type of timbre to which the “voice signal” is converted by tilting the portable terminal 60. Further, the user can add an effect to the “voice signal” by shaking the mobile terminal 60. Below, the karaoke system 100 which implement | achieves such a function is demonstrated in detail.

(Karaoke system block diagram)
A block diagram of the karaoke system 100 will be described below with reference to FIG. The karaoke apparatus body 20 includes a CPU 11, a storage unit 13, a voice input interface 14, an output signal generation unit 15, an image generation unit 16, a communication unit 17, an external communication unit 18, and an operation unit 19. These components are connected to each other by a bus 9.

  A CPU (Central Processing Unit) 11 performs various calculations and processes in cooperation with the storage unit 13.

The storage unit 13 includes a RAM (Random Access Memory) that is a main storage device, and an auxiliary storage device such as a nonvolatile memory or a hard disk. The RAM is used as a working area for the CPU 11 and temporarily stores programs processed by the CPU 11 and data processed by the CPU 11 in its address space.
Various programs and parameters for controlling the control unit 30 are stored in the auxiliary storage device of the storage unit 13. Various functions are realized by the various programs being processed by the CPU 11. The auxiliary storage device of the storage unit 13 includes an accompaniment video information acquisition program 13a, an accompaniment music information acquisition program 13b, an output signal generation program 13c, a timbre type determination program 13d, a timbre conversion program 13e, a pitch correction program 13f, and a rhythm correction program 13g. Further, an effect addition program 13h and an accompaniment moving image generation program 13i are stored. The storage unit 13 includes an accompaniment video information storage area 13j, an accompaniment music information storage area 13k, a tilt information storage area 13m, an acceleration information storage area 13n, a voice information storage area 13p, a tone color type storage area 13q, and a converted voice information storage area. 13r.

The accompaniment moving image information acquisition program 13a is a program for acquiring “accompaniment moving image information” via the external communication unit 18 and storing it in the accompaniment moving image information storage area 13j.
The accompaniment music information acquisition program 13b is a program that extracts and acquires “accompaniment music information” from “accompaniment video information” stored in the accompaniment video information storage area 13j and stores it in the accompaniment music information storage area 13k.
The output signal generation program 13c synthesizes “synthesized voice information” by synthesizing “accompanied music information” stored in the accompaniment music information storage area 13k and “converted voice information” stored in the converted voice information storage area 13r. This is a program that generates and outputs the “converted speech information” to the output signal generation unit 15 and causes the output signal generation unit 15 to generate an “output signal”.
The timbre type determination program 13d is a program for determining the timbre type for converting the “voice information” based on the “tilt information” output from the tilt sensor 64 of the portable terminal 60.
The timbre conversion program 13e is a program that converts the timbre of “voice information” to generate “converted voice information”.
The pitch correction program 13f is a program for correcting a pitch shift from “accompaniment music information” of “voice information”.
The rhythm correction program 13g is a program for correcting a rhythm shift from “accompaniment music information” of “audio information”.
The effect addition program 13h is a program for adding an effect to the “converted voice information” based on the “acceleration information” output from the acceleration sensor 65 of the mobile terminal 60.
The accompaniment moving image generation program 13i outputs a drawing command for generating a “moving image signal” to be output to the image display device 50 from the “accompaniment moving image information” stored in the accompaniment moving image information storage area 13j to the image generation unit 16. It is a program.
Accompaniment video information acquisition program 13a, accompaniment music information acquisition program 13b, output signal generation program 13c, tone color type determination program 13d, tone color conversion program 13e, pitch correction program 13f, rhythm correction program 13g, effect addition program 13h, accompaniment video The generation program 13i may be configured as an ASIC (Application Specific Integrated Circuit).

The accompaniment video information storage area 13j stores “accompaniment video information” acquired by the accompaniment video information acquisition program 13a.
The accompaniment music information storage area 13k stores “accompaniment music information” acquired by the accompaniment music information acquisition program 13b. The “accompaniment music information” includes MIDI data (Musical Instrument Digital Interface).
The “inclination information” transmitted from the portable terminal 60 is sequentially stored in the inclination information storage area 13m.
In the acceleration information storage area 13n, “acceleration information” transmitted from the portable terminal 60 is sequentially stored.
The “voice information” generated by the voice input interface 14 is stored in the voice information storage area 13p.
The timbre type storage area 13q stores the timbre type determined by the timbre type determination program 13d.
In the converted voice information storage area 13r, “converted timbre information” generated by the timbre conversion program 13e is stored.

  A microphone 30 is connected to the voice input interface 14. The connection method between the voice input interface 14 and the microphone 30 includes both wired and wireless connection methods. The voice input interface 14 converts the physical / logical format of the “voice signal” output from the microphone 30 to generate “voice information”, and outputs the “voice information” to the bus 9.

  A speaker 40 is connected to the output signal generator 15. The output signal generation unit 15 includes a D / A converter that converts a digital signal into an analog signal and an operational amplifier that amplifies the analog signal.

  An image display device 50 such as an LCD (Liquid Crystal Display) is connected to the image generation unit 16. The image generation unit 15 includes a GPU (Graphics Processing Unit) and a VRAM. The GPU generates “image data” in accordance with a drawing command from the accompaniment moving image generation program 13 i and stores it in the VRAM. The “image data” stored in the VRAM is output to the image display device 50 as an “image signal”.

  The communication unit 17 is a device that communicates with the mobile terminal 60. The communication unit 17 is a wireless standard interface based on infrared communication or Bluetooth (registered trademark).

  The external communication unit 18 is connected to a public communication network such as a so-called Internet or a public communication telephone communication network. The external communication unit 18 includes a LAN (Local Area Network), USB (Universal Serial Bus), IEEE1394, RS232, RS422, and other communication interfaces, and a wireless interface such as a so-called wireless LAN defined in IEEE802. The karaoke apparatus body 20 acquires “accompaniment video information” via the external communication unit 18.

  The operation unit 19 is for the user to operate the karaoke apparatus body 20. The operation unit 19 includes an input unit such as a plurality of buttons and a touch panel, and an input interface that converts a physical / logical format of an input operation signal output from the input unit and outputs the converted signal to the bus 9. . The user can select “accompaniment moving image information” to be reproduced by the speaker 40 or the image display device 50 by operating the operation unit 19.

The mobile terminal 60 is a mobile terminal such as a so-called smart phone having a tilt sensor 64 and an acceleration sensor 65 or a PDA (Personal Digital Assistant).
The portable terminal 60 includes a CPU 61, a storage unit 63, a tilt sensor 64, an acceleration sensor 65, and a communication unit 66, and these components are connected to each other via a bus 69.
The CPU 61 performs various calculations and processes in cooperation with the storage unit 63.

The storage unit 63 includes a RAM (Random Access Memory) that is a main storage device and an auxiliary storage device such as a nonvolatile memory or a hard disk. The RAM is used as a working area of the CPU 61, and temporarily stores a program processed by the CPU 61 and data processed by the CPU 61 in its address space.
Various programs and parameters for controlling the portable terminal 60 are stored in the auxiliary storage device of the storage unit 63. When the portable terminal 60 is a smartphone, the auxiliary storage device of the storage unit 63 stores a program that realizes a call function and a mail function.

  The inclination sensor 64 is a sensor that measures the inclination of the mobile terminal 60 in three directions of X, Y, and Z. The “tilt information” measured and generated by the tilt sensor 64 is transmitted to the karaoke apparatus body 20 via the communication unit 66. The “tilt information” is transmitted to the karaoke apparatus body 20 at intervals of several milliseconds to several tens of milliseconds.

  The acceleration sensor 65 is a sensor that detects accelerations in the X, Y, and Z directions of the mobile terminal 60. The “acceleration information” detected and generated by the acceleration sensor 65 is transmitted to the karaoke apparatus body 20 via the communication unit 66. The “acceleration information” is transmitted to the karaoke apparatus body 20 at intervals of several milliseconds to several tens of milliseconds.

  The communication unit 66 is a device that communicates with the communication unit 17 of the karaoke apparatus body 20. The communication unit 66. This is a wireless standard interface corresponding to the interface of the communication unit 17 such as infrared communication or Bluetooth (registered trademark).

(Description of main processing)
Below, the main process performed with the karaoke apparatus main body 20 is demonstrated using FIG.
When the user operates the operation unit 19 to select “accompaniment video information” to be played back by the speaker 40 or the image display device 50, the main process starts and the process proceeds to S11.
In the process of S11 “accompaniment music information acquisition”, the accompaniment video information acquisition program 13a acquires “accompaniment video information” via the external communication unit 18 and stores it in the accompaniment video information storage area 13j. And the accompaniment music information acquisition program 13b extracts and acquires "accompaniment music information" from the "accompaniment moving image information" memorize | stored in the accompaniment moving image information storage area 13j, and memorize | stores it in the accompaniment music information storage area 13k. When the process of S11 ends, the process proceeds to S12.

  In the process of S12 “Accompaniment music information reproduction start”, the output signal generation program 13c outputs “accompaniment music information” stored in the accompaniment music information storage area 13k to the output signal generation unit 15. The output signal generation unit 15 generates an “output signal” and outputs it to the speaker 40. In the process of S12, the accompaniment moving image generation program 13i generates a drawing command for generating a “moving image signal” to be output to the image display device 50 from the “accompaniment moving image information” stored in the accompaniment moving image information storage area 13j. The image is output to the image generation unit 16. When the process of S12 ends, the process proceeds to the determination process of S13.

  In the determination process of S <b> 13, the CPU 11 determines whether or not a “reproduction stop signal” for stopping reproduction of “accompaniment music information” and “accompaniment video information” is input to the bus 9. The “reproduction stop signal” is generated when the user operates the operation unit 19 or the output signal generation program 13c outputs “accompaniment music information” stored in the accompaniment music information storage area 13k to the end. 9 is input. If the CPU 11 determines that the “reproduction stop signal” has been input to the bus 9 (YES in S13), the process proceeds to S31. On the other hand, if the CPU 11 determines that the “reproduction stop signal” has not been input to the bus 9 (NO in S13), the process proceeds to S14.

  In the determination process of S14 “with voice input”, the CPU 11 determines whether or not “voice information” has been input from the voice input interface 14 to the bus 9. When the CPU 11 determines that “voice information” is input from the voice input interface 14 to the bus 9 (YES in S14), the “voice information” is stored in the voice information storage area 13p, and S15. Proceed to the process. If the CPU 11 determines that “voice information” is not input from the voice input interface 14 to the bus 9 (NO in S14), the process returns to the determination process in S13.

  In S15 “timbre determination process”, the timbre type determination program 13d executes a timbre determination process for determining a timbre type for converting “voice information”. Details will be described later with reference to the timbre conversion processing flow shown in FIG. When the process of S15 ends, the process proceeds to S16.

  In S16 “pitch correction process”, the pitch correction program 13f executes a pitch correction process for correcting a shift of the pitch of the “voice signal” from the “accompaniment music information”. Details will be described later with reference to the flow of pitch correction processing shown in FIG. When the process of S16 ends, the process proceeds to S17.

  In S17 “Rhythm correction process”, the rhythm correction program 13g executes a rhythm correction process for correcting a deviation of the “sound information” rhythm from the “accompaniment music information”. Details will be described later using the flow of the rhythm correction process shown in FIG. When the process of S17 ends, the process proceeds to the determination process of S18.

  In S18 “tone conversion process”, the timbre conversion program 13e converts the “voice information” stored in the voice information storage area 13p into the timbre type determined in the process of S15 and stored in the timbre type storage area 13q. Then, “converted voice information” is generated and stored in the converted voice information storage area 13r. If nothing is stored in the timbre type storage area 13q (in the processing of S15-2, the timbre type determination program 13d determines that A = 0 and B = 0, and in the processing of S15-3, the timbre In the case where the type determination program 13d determines the timbre as nothing and the timbre), in the process of S18, the timbre conversion program 13e performs no particular process. When the process of S18 ends, the process proceeds to the determination process of S19.

  In the determination process of S19 “operation input present”, the CPU 11 determines whether or not “acceleration information” of a predetermined value or more is input to the bus 9. When the CPU 11 determines that “acceleration information” equal to or greater than a predetermined value is input to the bus 9 (YES in S19), the process proceeds to S20. When the CPU 11 determines that “acceleration information” of a predetermined value or more is not input to the bus 9 (NO in S19), the process proceeds to S21.

  In S20 “addition effect processing”, the effect addition program 13h executes addition effect processing for adding an effect to the “converted voice information” based on the “acceleration information” output from the acceleration sensor 65 of the mobile terminal 60. Details will be described later with reference to the flow of effect addition processing shown in FIG. When the process of S20 ends, the process proceeds to S21.

  In the process of S21 “output signal generation”, the output signal generation program 13c executes “accompaniment music information” stored in the accompaniment music information storage area 13k and “converted audio information” stored in the converted audio information storage area 13r. To generate “synthesized speech information”, and output the “synthesized speech information” to the output signal generation unit 15. The output signal generation unit 15 generates an “output signal” and outputs the “output signal” to the speaker 40. The speaker 40 reproduces the “output signal” as sound. When the process of S21 ends, the process returns to the determination process of S13.

  In the process of S31 “Accompaniment music information reproduction end”, the output signal generation program 13c stops outputting the “accompaniment music information” to the output signal generation unit 15. In addition, the accompaniment moving image generation program 13 i stops outputting the drawing command to the image generation unit 16. When the process of S31 ends, the main process ends.

(Tone determination processing)
The timbre determination process will be described below with reference to FIG.
When the tone determination process starts, the process proceeds to S15-1.
In the processing of S15-1 “information acquisition”, the timbre type determination program 13d acquires “inclination information” stored in the inclination information storage area 13m and “acceleration information” stored in the acceleration information storage area 13n. And stored in the working area of the RAM. When the process of S15-1 ends, the process proceeds to S15-2.

In the process of S15-2 “posture calculation”, the timbre type determination program 13d calculates the inclination of the portable terminal 60 based on the “tilt information” and “acceleration information” stored in the working area of the RAM. Specifically, first, the timbre type determination program 13d calculates the direction of gravity based on the “acceleration information”. Next, the tone color type determination program 13d calculates the attitude of the portable terminal 60 from the calculated gravity direction and “gradient information”. This will be specifically described with reference to FIG. As shown in FIGS. 8A, 8B, and 8D, X, Y, and Z coordinates for the portable terminal 60 are set. The X coordinate direction is the width direction of the mobile terminal 60, and the Y coordinate direction is the vertical direction of the mobile terminal 60 orthogonal to the X coordinate direction. The Z coordinate method is the thickness direction of the portable terminal 60 orthogonal to the X coordinate direction and the Y coordinate direction. The tone color type determination program 13d determines the inclination angle θxz (shown in FIG. 8A) of the portable terminal 60 on the XZ plane and the inclination angle θyz of the portable terminal 60 on the YZ plane from the direction of gravity and the “gradient information”. (Shown in FIG. 8B) is calculated. Then, the timbre type determination program 13d calculates the values of A and B by collating the calculated inclination angles θxz and θyz of the portable terminal 60 with the reference shown in FIG. The initial value of A and B is 1.
The criteria shown in FIG. 8C will be described in detail. The values of A and B are determined depending on whether the inclination angles θxz and θyz of the mobile terminal 60 satisfy the following expressions 1 to 4.
−5 ° ≦ θxz ≦ 5 ° ... Formula 1
−5 ° ≦ θyz ≦ 5 ° Formula 2
When both Expression 1 and Expression 2 are satisfied, it is determined that A = 0 and B = 0.
θyz ≦ θxy Equation 3
When Expression 3 is satisfied without satisfying Expression 1 and Expression 2, A = 2 is determined.
θyz ≦ −θxy (Formula 4)
If Expression 4 is satisfied without satisfying Expression 1 and Expression 2, B = 2 is determined.
When the process of S15-2 is completed, the process proceeds to S15-3.

In the process of S15-3 “Tone determination”, the timbre type determination program 13d determines a timbre based on the attitude of the mobile terminal 60 calculated in the process of S15-2, and stores the determined timbre type as a timbre type. It memorize | stores in the area | region 13q. Specifically, the timbre type determination program 13d determines the timbre by collating A and B determined in S15-2 with the reference shown in FIG. In this embodiment, as shown in FIG. 8E, the timbre type is a musical tone of a musical instrument. When the process of S15-3 is completed, the timbre determination process is terminated.
As described above, the timbre type determination program 13d determines the attitude of the portable terminal 60 from the “gradient information” using the predetermined threshold (the reference shown in FIG. 8C), and further determines the attitude of the portable terminal 60. Therefore, the timbre type is determined with certainty.

(Pitch correction processing)
The flow of the pitch correction process will be described below with reference to FIG. When the pitch correction process is started, the process proceeds to S16-1.
In the process of S16-1 “acquisition of voice information”, the pitch correction program 13f stores the “voice information” stored in the voice information storage area 13p in the working area of the RAM. When the process of S16-1 ends, the process proceeds to S16-2.

  In the process of S16-2 “accompaniment music information acquisition”, the pitch correction program 13f stores the “accompaniment music information” stored in the accompaniment music information storage area 13k in the working area of the RAM. When the process of S16-2 ends, the process proceeds to S16-3.

  In the determination process of S16-3 “pitch deviation is not less than a predetermined value”, the pitch correction program 13f compares the “accompaniment music information” stored in the working area of the RAM with the “voice information”, and the pitch of the “voice information”. Is deviated from the pitch of “accompaniment music signal information” by a predetermined amount or more. In FIG. 9, the vertical direction means the pitch, and the horizontal direction means time. As shown in (1) and (2) of FIG. 9, the pitch correction program 13f determines that the pitch of “speech information” is greater than or equal to a pitch based on the pitch of “accompaniment music signal information” (eg, a quarter tone or more). ) If it is determined that there is a deviation (YES in S16-3), the process proceeds to S16-4. On the other hand, when the pitch correction program 13f determines that the pitch of “speech information” is not shifted from the pitch of “accompaniment music signal information” by a predetermined amount or more (NO in S16-3), the pitch correction processing is performed. Ends. Note that the pitch based on the pitch of the “accompaniment music signal information” is not only a pitch that matches the pitch of the “accompaniment music signal information” but also a pitch that has a predetermined relationship with the pitch of the “accompaniment music signal information” (for example, “ It is meant to include a pitch shifted by one octave from a pitch of the “accompaniment music signal information” or a pitch in a chord relationship shifted by 3 or 5 degrees.

In the process of S16-4 “pitch correction”, the pitch correction program 13f determines that “sound information” has been shifted in the determination process of S16-4 as shown in (3) and (4) of FIG. Is corrected and stored in the working area of the RAM. Specifically, the pitch is corrected so that the pitch is based on the pitch of the “accompaniment music signal information”, as with the sounds other than (3) and (4) in FIG. When the process of S16-4 ends, the pitch correction process ends.
By this pitch correction process, even if the user utters the musical accompaniment that is reproduced from the speaker 40, “converted voice information” that matches the accompaniment music is generated.

(Rhythm correction processing)
The flow of the rhythm correction process will be described below using FIG. When the rhythm correction process is started, the process proceeds to S17-1.
In the process of S17-1 “Rhythm deviation is not less than a predetermined value”, the rhythm correction program 13g compares the “accompaniment music information” and the “voice information” stored in the working area of the RAM, and the rhythm of the “voice information” is It is determined whether or not the rhythm of the “accompaniment music information” deviates by a predetermined amount or more. In FIG. 10, the horizontal axis represents time (delta time). As shown in (1) to (4) of FIG. 10, when the rhythm correction program 13g determines that the rhythm of “audio information” is deviated from the rhythm of “accompaniment music information” by a predetermined amount or more (S17). -1 determination process is YES), the process proceeds to S17-2. On the other hand, if the rhythm correction program 13g determines that the rhythm of “voice information” is not deviated from the rhythm of “accompaniment music information” by a predetermined amount or more (NO in S17-1), the rhythm correction process is performed. finish.

In the process of S17-2 “Rhythm correction process”, the rhythm correction program 13g, as shown in (5) to (8) of FIG. The rhythm of “information” is corrected and updated and stored in the voice information storage area 13p. Specifically, as shown in (5) to (8) of FIG. 10, the rhythm correction program 13g extends the sound that has been stopped to input "voice information" early so as to match the "accompaniment music information". Processing is performed and processing for delaying input so that the sound that has been input earlier matches the “accompaniment music information” is performed. When the process of S17-2 ends, the rhythm correction process ends.
By this rhythm correction processing, even if the user utters the accompaniment music reproduced from the speaker 40, “converted sound information” that matches the accompaniment music is generated.

(Effect addition processing)
The effect adding process flow will be described below with reference to FIG.
When the effect addition process is started, the process proceeds to S20-1.
In the processing of S20-1 “Acquire acceleration data”, the effect addition program 13h stores “acceleration information” stored in the acceleration information storage area 13n in the working area of the RAM. When the process of S20-1 ends, the process proceeds to S20-2.

  In the process of S20-2 “motion recognition”, the effect addition program 13h recognizes the motion of the mobile terminal 60 from the “acceleration information” stored in the working area of the RAM. Specifically, as shown in FIGS. 11A and 11B, the effect addition program 13 h recognizes the movement of the mobile terminal 60 in the X, Y, and Z coordinate directions. When the process of S20-2 ends, the process proceeds to S20-3.

  In the process of S20-3 “determination of additional effect”, the effect addition program 13h determines the additional effect from the movement of the mobile terminal 60 recognized in the process of S20-2. Specifically, the effect addition program 13h provides an effect (for example, delaying output, adding vibrato, etc.) to be added to the “converted audio information” based on the criteria shown in the table of FIG. decide. That is, when the user swings the mobile terminal 60 in specific directions of X, Y, and Z, the effect corresponding to the swing direction is determined. Alternatively, as illustrated in FIG. 11D, the effect addition program 13 h detects a specific movement such as rotation of the mobile terminal 60 and determines an effect to be added to the “converted sound information”. When the process of S20-3 ends, the process proceeds to S20-4.

In the process of S20-4 “add effect”, the effect addition program 13h adds the effect determined in the process of S20-3 to “converted voice information”, and updates and stores it in the converted voice information storage area 13r. When the process of S20-4 ends, the effect addition process ends.
By this effect addition process, the user can add an effect to the “converted voice information” by a simple operation of moving the mobile terminal 60.

(Summary)
As described above, according to the present invention, the type of timbre to which the voice uttered by the user is converted can be selected by a simple operation in which the user tilts the portable terminal 60.

  In the embodiment described above, the karaoke apparatus body 20 acquires “accompaniment video information”, but may be an embodiment that acquires “accompaniment music information” without a video. Further, in the embodiment described above, the karaoke apparatus body 20 acquires “accompaniment video information” and “accompaniment music information” from the public communication network 900, but “accompaniment” stored in a removable disk such as a DVD or CDROM. The “moving image information” and “accompaniment music information” may be acquired by a reading device such as a DVD drive or a CD drive.

  Although the present invention has been described above in connection with the most practical and preferred embodiments at the present time, the present invention is not limited to the embodiments disclosed herein. The invention can be changed as appropriate without departing from the spirit or concept of the invention that can be read from the claims and the entire specification, and a karaoke system with such changes should also be understood as being included in the technical scope. Don't be.

9 Bus 11 CPU
13 storage unit 13a accompaniment video information acquisition program 13b accompaniment music information acquisition program 13c output signal generation program 13d tone color type determination program 13e tone color conversion program 13f pitch correction program 13g rhythm correction program 13h effect addition program 13i accompaniment video generation program 13j accompaniment video information Storage area 13k Accompaniment music information storage area 13m Tilt information storage area 13n Acceleration information storage area 13p Voice information storage area 13q Tone type storage area 13r Conversion voice information storage area 14 Voice input interface 15 Output signal generation section 16 Image generation section 17 Communication section 18 External Communication Unit 19 Operation Unit 20 Karaoke Device Main Body 30 Microphone 40 Speaker 50 Image Display Device 60 Portable Terminal 61 CPU
63 storage unit 64 tilt sensor 65 acceleration sensor 66 communication unit 69 bus 100 karaoke system 900 public communication network

Claims (5)

A microphone that generates an audio signal from audio;
Accompaniment music information acquisition means for acquiring accompaniment music information, and an output signal generation means for generating an output signal based on an audio signal output from the microphone and accompaniment music information acquired by the accompaniment information acquisition means When,
In a karaoke system comprising a speaker that reproduces the output signal as audio,
A tilt sensor for measuring the tilt,
A portable terminal further comprising a communication means for transmitting the inclination information measured by the inclination sensor to the karaoke apparatus body;
The karaoke apparatus body is
A timbre type determining means for determining a timbre type to which an audio signal output from the microphone is converted based on the gradient information transmitted by the portable terminal;
Further comprising timbre conversion means for converting the timbre of the voice signal output from the microphone to generate converted voice information based on the timbre type determined by the timbre type determination means;
The karaoke system characterized in that the output signal generation means generates the output signal by synthesizing the converted voice information and the accompaniment music information.   2. The karaoke system according to claim 1, wherein the timbre type determining means determines the timbre type by determining the attitude of the mobile terminal based on the gradient information transmitted by the mobile terminal based on a threshold value.   3. The karaoke system according to claim 1, wherein the karaoke apparatus main body further includes pitch correction means for correcting the pitch of the audio signal output from the microphone based on the accompaniment music information.   The karaoke system according to any one of claims 1 to 3, wherein the karaoke apparatus main body further includes rhythm correction means for correcting the rhythm of the audio signal output from the microphone based on the accompaniment music information. The portable terminal further includes an acceleration sensor that measures acceleration,
The transmission means transmits the acceleration information measured by the acceleration sensor to the karaoke apparatus body through the communication means,
The karaoke apparatus main body further includes effect adding means for adding an effect to the converted voice information generated by the timbre converting means based on the acceleration information transmitted from the portable terminal. The karaoke system described in Crab.

Images