JP2003084779A - Karaoke system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke system which enables a user to control production of musical sounds based on musical piece data without complicated operation or the like even while singing a karaoke musical piece. SOLUTION: When a singer sings to a microphone unit 140 in accordance with the accompaniment of the karaoke musical piece, his or her singing voice is supplied to a karaoke device main body part 110. When the singer moves the microphone unit 140 while singing the karaoke musical piece, the movement is detected by an operation sensor MS incorporated in the microphone unit 140, and the movement track or the like of the movement is detected by the karaoke device main body part 110. Performance control information is generated by the detected movement track or the like, and performance of the karaoke musical piece based on musical piece data is controlled by the performance control information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke system for generating musical tones based on music data.

[0002]

2. Description of the Related Art In a karaoke apparatus, a singer selects and instructs a song to be sung from a large number of karaoke songs, and the song data (MI
A karaoke piece is played by reading and reproducing DI (Musical Instrument Digital Interface) data or the like.

As described above, in the present karaoke apparatus, the singer can select a karaoke piece to be sung from a large number of karaoke pieces, and may select a karaoke piece or the like which does not match his or her singing ability. is there. In such cases,
When a normal karaoke performance is performed, the singer cannot sing along with the karaoke performance. In order to eliminate such an inconvenience, a normal karaoke apparatus is provided with an operation panel or the like for setting performance parameters such as tempo, pitch, and volume in the apparatus body. By properly operating this operation panel, each singer can set the tempo, pitch, etc. at the time of karaoke performance according to his or her singing ability.

[0004]

However, there are times when the singer wants to change the tempo, pitch, etc. after starting to sing a karaoke piece. For example, if the singer thought that he could sing the song without changing the tempo or pitch before starting singing, he would like to change the tempo or pitch due to the reason that some parts could not be sung well when actually singing. Or the tempo of the performance may be made faster or slower depending on the atmosphere of listeners around. In such a case, the singer had to perform a complicated work that hinders the singing, such as performing an operation of appropriately adjusting the operation panel while singing a karaoke song.

The present invention has been made in consideration of the above circumstances, and it is possible to control the generation of musical tones based on music data without performing a complicated operation even while singing a karaoke music. The purpose is to provide a karaoke system that can.

[0006]

In order to solve the above problems, a karaoke system according to the present invention is a unit which can be carried by a user and which detects a motion of a user carrying the unit. And a karaoke system for performing a performance based on music data, wherein the karaoke device acquires an operation detection result of a user detected by the operation detection unit, and the music. It is characterized by having a musical sound generating means for generating a musical sound based on the data and the motion detection result acquired by the acquiring means.

With this configuration, when the user sings a karaoke song, the user can control the generation of a musical tone according to the song data of the karaoke song by moving the motion detecting unit carried by the user. it can. For example, if the motion detection unit is moved in a predetermined manner so that the performance tempo in the performance based on the music data, the performance-related parameters such as the pitch, and the like can be changed, the user can operate the karaoke device. It is possible to change the performance parameters as described above by an operation that can be easily performed while singing a karaoke piece such as moving a carried operation detection unit without operating a section or the like.

[0008]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. A. Configuration of Embodiment First, FIG. 1 is a diagram schematically showing an appearance of a karaoke system according to an embodiment of the present invention. The karaoke system 100 is installed in, for example, a private room dedicated to karaoke,
The karaoke device main unit (karaoke device) 110, a display device 120, a speaker 130, a microphone unit (motion detection unit) 140, and a lighting device 150 are provided.

The illumination device 150 is provided on the ceiling or the like in the room where the karaoke system 100 is installed, and illuminates the room (especially the singer) with light. The illuminating device 150 can adjust the color of the emitted light, the intensity of the light, and the like. Then, the color and intensity of the light emitted from the lighting device 150 can be controlled based on a control signal supplied from the karaoke device main body 110 via a signal cable or the like (not shown).

The microphone unit 140 is a unit equipped with a microphone that is used by a singer to sing a karaoke song using the karaoke system 100, and is the same as a microphone used in a conventional karaoke system. The appearance is almost the same.
As shown in FIG. 2, the microphone unit 140 includes a motion sensor MS and a CPU (Central Processing Unit).
11, a memory 12, a display unit 13, an operation switch 14, and a microphone 15. That is, the microphone unit 140 has a configuration in which constituent elements such as the motion sensor MS are added to the microphone 15 used in a normal karaoke system.

The motion sensor MS detects a motion of a singer who holds the microphone unit 140 and sings, and outputs the motion detection result to the CPU 11. As the motion sensor MS, a sensor such as a three-dimensional acceleration sensor, a three-dimensional speed sensor, a two-dimensional acceleration sensor, or a two-dimensional speed sensor can be used. In the present embodiment, the two-dimensional acceleration sensor is used, Motion sensor MS like
Has an x-axis detector MSx and a y-axis detector MSy. These x-axis detection unit MSx and y-axis detection unit MSy
Detects acceleration in the x-axis direction (horizontal direction) and y-axis direction (vertical direction), respectively.

The CPU 11 is a ROM (Read Only Memory).
The operation sensor MS, the display unit 13, and other unit parts are controlled according to a program recorded in the memory 12 including y). CPU11 is a motion sensor MS
When the detection result is supplied from the
Every 5 msec), an operation detection signal corresponding to this detection result is output to the karaoke apparatus main body 110 (see FIG. 1) via the signal cable 160 (see FIG. 1). Note that the signal output from the microphone unit 140 to the karaoke device main body 110 is not limited to what is performed by so-called wired communication, in which the operation detection result is output to the karaoke device main body 110 via the signal cable 160. Wireless communication may be used.

The display unit 13 is, for example, a 7-segment type LED (Light Emitting Diode) or LCD.
(Liquid Crystal Display) Display and one or more L
It has an ED light emitting device and the like, and displays various information such as an operating state and a setting state. The operation switch 14 is a switch used for performing various settings such as power on / off of the microphone unit 140 and mode setting.

When a singing voice of a singer who holds the microphone unit 140 is input to the microphone 15, an audio signal corresponding to the input voice is input to the signal cable 1 of the microphone 15.
It outputs to the karaoke apparatus main body part 110 via 60 (refer FIG. 1).

Driving power is supplied to each component of such a microphone unit 140 from a battery power source (not shown). As such a battery power source, a primary battery may be used, or charging may be performed. Possible secondary batteries may be used.

Next, the configurations of the karaoke device main body 110, the display device 120 and the speaker 130 will be described with reference to FIG. As shown in the figure, the karaoke device body 110 includes a CPU 21 connected to a bus 32,
ROM22, RAM23, HDD (Hard Disk Drive
e) 24, communication interface 25, and operation unit 26
A lighting device interface 27 and a display control unit 28.
, Tone generator 29, DSP (Digital Signal Process)
or) 30 and a reception processing circuit 31.

The CPU 21 controls various parts of the karaoke device body 110 by performing various arithmetic processes. ROM2
2 stores a start-up program necessary for starting the karaoke apparatus main body 110. When the power supply of the karaoke apparatus main body 110 is turned on, the boot program is read by the CPU 21, and the CPU 21 loads the system program and the application program stored in the HDD 24 into the RAM 23 according to the boot program and follows them. Perform the processing. In addition to these programs, the HDD 24 stores a plurality of song data used for karaoke performance. In this embodiment, MIDI data is used as music data used for karaoke performance, and the HDD 24 stores MIDI data for performing karaoke music.

The communication interface 25 is an interface for performing data communication with the center station via a communication network (not shown) such as a public line network or ISDN (Integrated Services Digital Network). In the karaoke apparatus main body 110, when there is a performance instruction of a karaoke piece which is not stored in the HDD 24, a distribution request is made to the center station for the music piece data of the karaoke piece, and according to the request, The communication interface 25 receives the music piece data distributed via a communication network (not shown) and fetches the music piece data into the device, so that the karaoke music piece can be played.

The operation unit 26 is provided with a ten-key pad, various switch groups, etc., and the user operates these switches and the like to specify a karaoke piece to be reserved and set various modes.
It is possible to input the setting of musical tone parameters such as volume and tempo.

The lighting device interface 27 is an interface for outputting a control signal to the above-described lighting device 150 (see FIG. 1) via a signal cable (not shown).

The display control unit 28 superimposes character data such as lyrics shown in the song data of the karaoke song being played on the image corresponding to the image data supplied from the CD changer 34, and the image / lyrics are displayed. Generate data.
The display control unit 28 outputs the generated video / lyric data to the display device 120, so that the video / lyric data is displayed on the display device 120.
The video corresponding to the lyrics data is displayed. The CD changer 34 selects and reproduces the video data recorded in the CD-ROM in the format such as MPEG under the control of the CPU 21 during the karaoke performance, and outputs the reproduced video data to the display control unit 28.

The sound source device 29 generates a musical tone signal based on the music data corresponding to the karaoke music selected by the user. In the present embodiment, since MIDI data is used as the music data, the sound source device 29 is a MIDI sound source device. Further, the tone generator 29 controls performance parameters such as tempo, volume, timing, and tone color according to the performance control information supplied from the CPU 21 when generating a tone signal based on the music data. That is, the tone generator 29 does not generate a tone signal faithful to the song data, but generates a tone signal in which the performance control information supplied from the CPU 21 is reflected in the content shown in the song data.

The DSP 30 performs processing such as echo addition, reverberation effect addition, and processing for locating a sound image at a specific position on the tone signal generated by the tone generator 29 according to the performance control information supplied from the CPU 21. To do. In this way, the tone signal to which the effects and the like have been added by the DSP 30 is output to the amplifier 33. In the amplifier 33, the musical tone signal supplied from the DSP 30 and the audio signal supplied from the microphone unit 140 (see FIGS. 1 and 2) are mixed and amplified, and then the mixed musical tone signal is supplied to the speaker 130. A musical sound including the singing sound and the performance sound of the karaoke piece is output and is emitted.

B. Processing during karaoke performance Next, the processing during karaoke performance by the karaoke system 100 having the above configuration will be described. First, when a user inputs a song number or the like for designating a certain karaoke song via the operation unit 26, the CPU 21 reads out song data of the karaoke song corresponding to the entered song number from the HDD 24, and the RAM 23. To temporarily store. And CP
U21 sequentially reads the music data temporarily stored in the RAM 23 and outputs it to the tone generator 29.

Further, the CPU 21 instructs the CD changer 34 to read the video data from the CD-ROM in which the video data corresponding to the karaoke music specified by the inputted music number is recorded. As a result, the CD changer 34 reads the video data designated by the CPU 21 and outputs it to the display controller 28. As a result, the tone generator 29 starts to generate a musical tone signal corresponding to the song data, and the display device 120 displays an image corresponding to the karaoke song.

As described above, in the karaoke system 100, the music performance and the video display of the karaoke music designated by the user are started as in the case of the ordinary general karaoke system, but the karaoke according to the present embodiment. In the system 100, under the control of the CPU 21 of the karaoke apparatus main body 110, processing for reflecting the operation performed by the user on the microphone unit 140 in the performance of the karaoke piece is performed, and the microphone unit 140 of the user is performed. A process for reflecting the operation for (1) on the irradiation method by the illumination device 150, the image displayed on the display device 120, and the like is performed.

Here, FIG. 4 shows a functional configuration of the karaoke system 100 when performing a process for performing a music performance or the like that reflects the operation content of the user with respect to the microphone unit 140 as described above. As shown in the figure, when a karaoke song or the like is designated and the karaoke song is started to be played as described above, the user (hereinafter referred to as a singer) holds the microphone unit 140 and sings. Become. When the microphone unit 140 is moved by moving the hand held by the singer during such a singing operation, the operation content is detected by the operation sensor MS. In the present embodiment, the x-axis detection units MSx and y are used as the motion sensor MS.
Since the axis detection unit MSy is adopted, the singer's action with respect to the microphone unit 140 is the acceleration α in the X-axis direction.
x and acceleration in each axis direction such as acceleration αy in the Y axis direction are detected. This detection result is a predetermined cycle (25 mse
It is output from the microphone unit 140 to the karaoke apparatus main body 110 for each c).

In the karaoke device main body 110 which has received the signal indicating the result of the singer's motion detection transmitted from the microphone unit 140, first, the reception processing circuit 31 performs a predetermined filtering process on the received motion detection signal. Reception processing is performed, and the karaoke device main body 11
It is converted into a signal that can be processed by 0 and taken into the device. In this way, the motion detection signal (αx,
αy) is supplied to the movement locus detection processing unit 41 and the peak detection processing unit 42.

The movement locus detection processing unit 41 analyzes the movement detection signal (αx, αy) supplied from the reception processing circuit 31, and detects the movement locus of the microphone unit 140 from the analysis result. Here, the detection of the movement locus by the movement locus detection unit 41 is performed from the time when αx and αy are values smaller than a preset minute set value (that is, the microphone unit 140 is hardly moved). It is judged that the operation has started when αx or αy becomes larger than the set value, and after detecting the start of this operation, the time when αx and αy become smaller than the preset minute set value is regarded as one break. Done.
That is, the movement locus detection processing unit 41 determines that αx or αy
Is set as a start point, and after the start point is detected, a movement locus of a series of movements of the microphone unit 140 until αx and αy become smaller than the set value is set as a motion detection signal (αx, αy). Detect based on.

The movement locus detector 41 obtains information on the movement locus of the microphone unit 140 from αx and αy supplied from the reception processing circuit 31 during the series of operations described above. Here, the information about the movement locus is shape information drawn by the movement locus, information indicating a movement direction when the movement locus is drawn, and the like. As described above, the movement locus detection period of a series of operations may be set from the values of αx and αy. The movement locus detection processing unit 41 may detect one movement locus according to αx and αy only while the switch is pressed. In this case,
The operator may perform a desired operation while pressing the switch only while performing a movement for detecting the movement locus.

The movement locus detection processing section 41 has the motion detection signals αx, α supplied from the reception processing circuit 31 as described above.
Information regarding the movement trajectory of the microphone unit 140 is detected from y, and the detection result is used as the performance control information generation unit 44.
And output to the display and illumination control unit 43.

The peak detection processing section 42 includes the reception processing circuit 3
The peak value of the motion detection signal (αx, αy) supplied from 1 is detected. More specifically, first, the reception processing circuit 3
From the motion detection signals αx and αy supplied from 1, the absolute value of acceleration | α | expressed by the following equation (1) is obtained. | Α | = (αx * αx + αy * αy) ^1/2 (1)

Thus, every time the motion detection signals αx and αy are supplied, the peak detection processing section 42 obtains the absolute value of acceleration | α | from the motion detection signal, and the time-dependent waveform of this absolute value | α | Information such as the local peak occurrence time and local peak value of is detected.

The peak detection processing section 42 receives the motion detection signals αx and αy supplied from the reception processing circuit 31 as described above.
The information on the peak value of the acceleration of the movement of the microphone unit 140 is detected from, and the detection result is output to the performance control information generation unit 44 and the display / illumination control unit 43.

By referring to the control information table 45, the performance control information generation unit 44 relates to the information on the movement locus detected by the movement locus detection processing unit 41 and the peak value detected by the peak detection processing unit 42 as described above. Based on the information, the performance control information for controlling the performance of the karaoke music according to the music data by the tone generator 29 is generated. As shown in FIG. 5, the control information table 45 stores the shape of the movement trajectory (including the movement direction) and the information indicating the control content in association with each other. Here, the control contents include various control contents relating to music performance such as setting tone color of a generated musical tone, setting tempo, setting volume, imparting effect (reverberation effect), and locating sound image at a specific position. Yes, in the example shown, "1 rotation circle and clockwise"
Is associated with the control content for the karaoke piece performance such as "timbre is piano", and the control content is such that "timbre is organ with counterclockwise rotation".

The performance control information generation unit 44 refers to the control information table 45 in which the shape and the performance control content are stored in association with each other in this way, and thereby the motion trajectory supplied from the motion trajectory detection processing unit 41. Performance control information for controlling the tone generator device 29 and the DSP 30 is generated based on the information regarding the above. As a specific example, when the singer moves the microphone unit 140 clockwise in a one-rotation circle, the performance control information generation unit 44, based on the information about the movement trajectory detected according to this movement. Performance control information for instructing the tone generator 29 to set the tone color to piano is generated. Further, the performance control information generation unit 44 refers to the control information table 45 as described above, generates performance control information according to the information regarding the movement trajectory supplied from the movement trajectory detection processing unit 41, and also performs the peak detection processing unit. The performance control information is generated according to the information about the peak value supplied from 42. For example, performance control information or the like for generating a volume corresponding to the local peak value supplied from the peak detection processing unit 42 is generated.

The performance control information for controlling the performance of the karaoke piece thus generated by the performance control information generating section 44 is supplied to the tone generator 29 and the DSP 30.
In the tone generator 29, the song data (MIDI data) of the karaoke song set by the singer as described above is RA.
It is read from M23 and sequentially supplied. The tone generator 29 generates a musical tone signal according to the MIDI data thus sequentially supplied. At this time, the sound source device 29
Generates a tone signal by reflecting the performance control information supplied from the performance control information generation unit 44. For example, when the performance control information such as the tone color of the piano is supplied as described above, the pitch, timing, tempo, etc. are MID.
According to the I data, the tone color of "piano" according to the performance control information is adopted as the tone color. That is, the tone generator 29 generates a tone signal according to the control content of the parameters specified in the performance control information according to the MIDI data, except for the parameters (timbre in this case) specified by the performance control information. Of.

The musical tone signal generated by reflecting the performance control information in this way is supplied from the tone generator 29 to the DSP 30. The DSP 30 subjects the musical tone signal supplied from the tone generator 29 to signal processing according to the performance control information supplied from the performance control information generation unit 44. For example, if the performance control information is an instruction to give an echo, the DSP 30 performs signal processing for giving an echo according to the instruction. In this way, the DSP 30 performs signal processing according to the performance control information and then outputs the processed musical tone signal to the amplifier 33.

The musical tone signal output from the DSP 30 is appropriately amplified by the amplifier 33, mixed with the audio signal (singing sound) supplied from the microphone unit 140, and then output to the speaker 130. As a result, the singer performs the microphone unit 1 from the speaker 130.
The performance sound of the karaoke piece corresponding to the musical sound signal reflecting the operation performed on 40 is emitted together with the singing sound.

Information regarding the movement locus detected by the movement locus detection processing unit 41 and the peak detection processing unit 4 are also provided.
Information regarding the peak value detected by 2 is supplied to the display and illumination control unit 43. The display / illumination control unit 43 controls the display control information for controlling the content displayed on the display device 120 and the illumination for controlling the irradiation content of the illumination device 150 based on the information about the movement trajectory and the information about the peak value. The control information is generated and each control information is output to the display device 120 and the lighting device 150.

In the present embodiment, the display control information generated by the display and illumination control section 43 is one of the parameters (timbre, pitch, volume, etc.) used when the karaoke piece is played by the operation of the singer. It is image information or the like for superimposing character information indicating how the parameters have been changed. In the case where such display control information is generated, when the tone color of the part in which the karaoke piece is played is changed to piano by the movement of the microphone unit 140, the background image read from the CD changer 34 is displayed. Character information such as "changing tone color to piano sound" is superimposed and displayed on the display device 120. The display control information is not limited to such superimposing image information, but may be any information that can change the display content of the display device 120, such as the CD changer 3.
The control information may be an instruction to change the image data read out from No. 4.

In the present embodiment, the lighting control information generated by the display and lighting control section 43 is the lighting device 1.
This is information for controlling the color, intensity, etc. of the light emitted by 50. For example, when the local peak value detected by the peak detection processing unit 42 becomes large, the display and lighting control unit 43 generates the lighting control information such that the light emitted from the lighting device 150 becomes strong, and the local peak value is calculated. The illumination control information is generated such that the light emitted from the illumination device 150 becomes weaker when the illumination becomes smaller.
In this way, the detected local peak value, that is, light having an intensity corresponding to the degree of acceleration of the singing person moving the microphone unit 140 is emitted from the illumination device 150. In addition, if the configuration is such that the irradiation position of the lighting device 150 can be changed (such as the irradiation position of the spotlight can be changed), the display and lighting control unit 43 generates the lighting control information for controlling the irradiation position. , May be output to the lighting device 150.

As described above, in the karaoke system 100 according to this embodiment, the singer is the microphone unit 140.
By moving the, it is possible to control the performance content of the karaoke song, and the content displayed on the display device 120 and
It is also possible to control the irradiation content and the like by the lighting device 150.

C. Concrete Example of Method for Reflecting Movement of Microphone Unit in Karaoke Performance As described above, in the karaoke system 100, the singer does not perform the karaoke piece faithfully to the song data, but rather sings the song by the singer. Therefore, it is possible to reflect the movement of the microphone unit 140 that is being gripped. Here, how the microphone unit 140 is moved and how it can be reflected in the performance of the karaoke piece is determined by the stored contents of the control information table 45 described above. Various control contents can be assigned to various operation patterns by appropriately changing the contents. In the following, when the information illustrated in FIG. 5 is registered in the control information table 45, the singer makes the microphone unit 140 circular (see FIGS. 9 and 10) and triangular (see FIGS. 11 and 12). ), A quadrangle (see FIGS. 13 and 14), and a figure of eight (see FIGS. 15 and 16) as an example, a method of reflecting the movement of the microphone unit 140 in the karaoke piece performance will be described.

As described above, the microphone unit 14
In order to reflect the movement of 0 in the music performance, the movement locus detection processing unit 41 detects the movement locus and reflects the detection result in the music performance. In the present embodiment, the movement locus detection processing unit 41 uses the shape recognition table shown in FIG. 8 which is prepared and stored in advance, and αx, α supplied from the microphone unit 140 according to the procedure shown in FIGS. 6 and 7.
The movement trajectory shape is detected based on y.

C-1. When the microphone unit 140 is moved along a circular shape Here, regarding the movement locus detection processing according to the procedure shown in FIGS. 6 and 7, when the microphone unit 140 is specifically moved along various shapes. Will be described as an example. First, a case where the operator moves the microphone unit 140 along a clockwise circular shape as shown in FIG. 9 will be described.

When the operator moves the microphone unit 140, the movement locus detection processing section 41 detects that the microphone unit 140 has started movement based on αx and αy, that is, the movement start starting point SP (step Sa
1), the recognition point count number NP used for shape recognition is set to 1 (step Sa2). Here, the recognition point count number NP is a count number indicating the number of recognition points for recognizing the moving direction of the microphone unit 140 for shape recognition, and the recognition point count number NP = 1 is the first. The recognition point NP1 and the recognition point count number NP = 2 indicate the recognition point NP2 of the second eye.

After that, the movement locus detection processing unit 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation along the clockwise circular shape is performed,
As shown in FIG. 9, the moving direction of the microphone unit 140 from the detected start point SP, that is, the direction from the start point SP to the first recognition point NP1 is the lower right direction. In this way, when the direction from the starting point SP to the recognition point NP1 is detected and the microphone unit 140 continues to move thereafter, the process of the movement locus detection processing unit 41 proceeds to step Sa4, and the recognition point count number NP is set to 2. It And
The moving direction of the microphone unit 140 after moving from the start point SP to the lower right, that is, the first recognition points NP1 to NP2.
The direction to the second recognition point NP is detected (step Sa
6).

Here, in step Sa3, 1 from the starting point SP.
When the direction to the second recognition point NP1 is detected as "lower right", when the direction from the first recognition point NP1 to the second recognition point NP2 is detected as "lower left", the microphone unit is detected. It is determined that 140 is moving along the “clockwise circular shape”, and the movement locus detection processing unit 41 sets the shape flag “clockwise circular shape” (step Sa
8).

In this way, the movement locus detection processing unit 41 determines that the movement locus of the microphone unit 140 is moving along the "clockwise circular shape", and if such a shape flag is set, the following steps will be performed. A process for checking whether or not the microphone unit 140 is moving along the determined shape by referring to the shape recognition table shown in FIG.

Prior to a detailed description of such confirmation processing, the contents of the shape recognition table shown in FIG. 8 will be described. As shown in the figure, in the shape recognition table, there are "clockwise circular shape", "counterclockwise circular shape", "clockwise quadrangle", "counterclockwise quadrangle", "clockwise triangle", and "counterclockwise triangle". The "count number" and the recognition point NP1 are associated with each of the shapes identifiable by the movement locus detection processing unit 41, such as "clockwise triangle", "clockwise eight-character", and "counterclockwise eight-character". , NP2 ... And the moving direction corresponding to the NP2 are stored. Here, the moving direction corresponding to each recognition point indicates the moving direction from the starting point SP in the case of the recognition point NP1. In the illustrated table, a direction such as "lower right" is stored as a direction corresponding to the recognition point NP1 of "clockwise circular shape". This indicates that the direction from the starting point SP to the recognition point NP1 is "lower right". Further, for the recognition points NP2, NP3, ..., The directions corresponding to the moving directions from the immediately preceding recognition point are stored.
In the illustrated table, the recognition point NP of “clockwise circular shape”
Although a direction such as "lower left" is stored as the direction corresponding to 2, the condition for detecting a "clockwise circular" movement locus is that the direction from the recognition point NP1 to the recognition point NP2 is "lower left". It indicates that there is.

The "count number" stores data indicating the number of recognition points at which it is detected whether or not the movement locus of each shape has been passed until the detection is completed. In the case of “clockwise circular shape”, “4” is stored, and it is confirmed whether or not four recognition points have been passed until the detection of the movement trajectory such as “clockwise circular shape” is completed. This means that the recognition point NP1 to recognition point NP4 is 4 for this shape.
The direction corresponding to one recognition point will be stored. Also, "8" is stored in the "count number" corresponding to the "clockwise eight-shaped". This is eight recognition points until the detection of the movement trajectory such as "clockwise eight-shaped" is completed. It means that it is confirmed whether or not the vehicle has passed.

By referring to the shape recognition table in which the above data is stored, the movement locus detection processing unit 41 performs processing for confirming whether or not the microphone unit 140 is moving along the flagged shape. Do it.

First, as described above, "clockwise circular shape"
When the shape flag is set (step Sa8), the movement locus detection processing unit 41 subtracts the current recognition point count number NP from the “count number” associated with the set shape flag, and sets 1 to this. The incremented value is set as the recognition point count number NP (step S
a12). Specifically, since the current recognition point count number NP is 2 and the “count number” corresponding to the “clockwise circular shape” is 4, the recognition point count number NP
Is set to 4-2 + 1 = 3. Then, the movement locus detection processing unit 41 indicates that the movement direction of the microphone unit 140 from the recognition point NP2, that is, the direction to the next recognition point NP3 is the “clockwise circular shape” of the shape recognition table. Direction corresponding to "NP3", that is, "upper left"
Then, it is determined whether or not (step Sa13). Here, when they match, it is confirmed that the microphone unit 140 is moving along the “clockwise circular shape” which is the shape indicated by the shape flag set by the microphone unit 140,
If they do not match, it is determined that they have not moved along the “clockwise circular shape”.

If it is determined that the microphone unit 140 has not moved along the "clockwise circular shape" (determination "NO" in step Sa13), the movement locus detection processing unit 41 determines that the shape cannot be recognized. (Step S
a14), reset the shape flag set above.

On the other hand, when it is confirmed that the microphone unit 140 is moving along the “clockwise circular shape” (determination “YES” in step Sa13), the movement locus detection processing unit 41 causes the recognition point count number. It is determined whether NP (3 at this point) matches the value (= 4) stored in the “count number” of the shape recognition table (step Sa15). In other words, the movement locus detection processing unit 41 determines whether or not the direction check has been performed at the number of recognition points required to recognize the shape indicated by the set shape flag, and the recognition point count number NP and the count number are When they do not match (when the direction check is not completed at all recognition points), the recognition point count number NP is incremented by 1 (step Sa16), that is, the recognition point count number NP = 4 is set. Then, the movement locus detection processing unit 41 returns the processing to step Sa13, and checks the recognition point NP4 which is the recognition point corresponding to the newly set recognition point count number NP. Specifically, the movement locus detection processing unit 41 determines that the direction “upper right” stored in “NP4” of the shape recognition table.
And the moving direction of the microphone unit 140 from the recognition point NP3, that is, the direction from the recognition point NP3 to the recognition point NP4, is determined (step Sa13).

If the two match, it is confirmed that the microphone unit 140 is moving along the "clockwise circular shape" which is the shape indicated by the shape flag set by the microphone unit 140, and the two do not match. In this case, it is determined that the movement is not along the “clockwise circular shape”.

When it is determined that the microphone unit 140 is not moving along the "clockwise circular shape" (determination "NO" in step Sa13), the movement locus detection processing unit 41 determines that the shape cannot be recognized ( Step S
a14), reset the shape flag set above. On the other hand, when it is confirmed that the microphone unit 140 is moving along the “clockwise circular shape” (determination “YES” in step Sa13), the movement locus detection processing unit 4
1 is the recognition point count number NP (at this point,
It is determined whether or not 4) matches the value (= 4) stored in the "count number" of the shape recognition table (step S).
a15). Since the determination here is “YES”, the movement locus detection processing unit 41 advances the processing to step Sa17. That is, the microphone unit 14 is moved along the “clockwise circular shape” that is the shape indicated by the set shape flag.
It is concluded that 0 has moved, and the shape recognition is completed.

The performance control information generation unit 4 which has received the recognition result from the movement locus detection processing unit 41 completed as described above.
4 generates performance control information (timbre is piano) according to the recognition result (circular, clockwise) to generate the sound source device 29.
Output to. Sound source device 2 to which this performance control information is supplied
In 9, the parameters other than the tone color are tone signals according to the pitch, timing and tempo specified by the MIDI data corresponding to the designated karaoke piece,
As for the timbre, a musical tone signal for generating a musical tone of the "piano" timbre is generated.

By performing the above processing, when the singer rotates the microphone unit 140 in a circular clockwise direction, a control corresponding to the circular clockwise operation for playing a karaoke piece based on MIDI data is performed. It is possible to reflect the contents (set the tone to piano).

Next, as shown in FIG. 10, a case where the operator moves the microphone unit 140 along a counterclockwise (counterclockwise) circular shape will be described. When the operator moves the microphone unit 140, the movement locus detection processing unit 41 detects that the microphone unit 140 has started movement based on αx and αy, that is, the movement start start point SP (step Sa1), and recognizes the shape. The recognition point count number NP used for is set to 1 (step Sa2).

After that, the movement locus detection processing section 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed along the counterclockwise circular shape, as shown in FIG. 10, the moving direction of the microphone unit 140 from the detected start point SP, that is, from the start point SP to the first recognition point NP1. Is the lower left direction. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a5, the recognition point count number NP is set to 2. Then, the moving direction of the microphone unit 140 after moving from the start point SP to the lower left, that is, the direction from the first recognition point NP1 to the second recognition point NP2 is detected (step Sa7).

Here, in step Sa3, 1 from the starting point SP.
When the direction to the second recognition point NP1 is detected as "lower left", when the direction from the first recognition point NP1 to the second recognition point NP2 is detected as "lower right", the microphone unit is detected. It is determined that 140 is moving along the “counterclockwise circular shape”, and the movement locus detection processing unit 41 sets the shape flag “counterclockwise circular shape” (step Sa
10).

In this way, the movement locus detection processing unit 41 determines that the microphone unit 140 is moving along the "counterclockwise circular shape", and if such a shape flag is set, the movement shown in FIG. The microphone unit 1 is referred to according to the determined shape by referring to the shape recognition table shown.
A process for confirming whether or not 40 is moving is performed. That is, the "count number" and "NP1" to "NP" associated with the "counterclockwise circular shape" in the shape recognition table.
4 ”is used to confirm the above-mentioned“ clockwise circular shape ”(step Sa12 to step Sa1).
The confirmation process is performed in the same procedure as 7). Therefore, FIG.
When the microphone unit 140 is moved as shown in 0, the movement locus detection processing unit 41 determines that the movement locus is “counterclockwise circular shape”. Then, the result of shape recognition is output from the movement trajectory detection processing unit 41 to the performance control information generation unit 44. As a result, performance control information for instructing the control contents (timbre to be an organ) corresponding to the circular counterclockwise direction (counterclockwise direction) is supplied from the performance control information generating section 44 to the tone generator 29. In the tone generator 29 to which the performance control information is supplied, the parameters other than the tone color are tone signals in accordance with the pitch, timing, and tempo specified by the MIDI data corresponding to the specified karaoke piece, For, a tone signal for generating a tone of the "organ" tone color is generated.

By performing the above-described processing, when the singer rotates the microphone unit 140 in a counterclockwise direction in a circle, this circular clockwise operation corresponds to the performance of a karaoke piece based on MIDI data. It is possible to reflect the control content (tones are changed to organ sounds).

C-2. When the microphone unit 140 is moved along the triangular shape Next, as shown in FIG. 11, a case where the operator moves the microphone unit 140 along the clockwise triangular shape will be described. The operator operates the microphone unit 14
When 0 is moved, the movement locus detection processing unit 41 causes αx,
Based on αy, the microphone unit 140 starts moving, that is, the movement start point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step Sa2).

After that, the movement locus detection processing section 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed along the clockwise triangular shape, as shown in FIG. 11, the moving direction of the microphone unit 140 from the detected start point SP, that is, from the start point SP to the first recognition point NP1. The direction is the lower right direction. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a4, the recognition point count number NP is set to 2. Then, the moving direction of the microphone unit 140 after moving from the start point SP to the lower right, that is, the direction from the first recognition point NP1 to the second recognition point NP2 is detected (step Sa6).

Here, in step Sa3, 1 from the starting point SP.
When the direction to the second recognition point NP1 is detected as "lower right", when the direction from the first recognition point NP1 to the second recognition point NP2 is detected as "left side", the microphone It is determined that the unit 140 is moving along the "clockwise triangular shape", and the movement locus detection processing unit 41 sets the shape flag "clockwise triangular shape" (step Sa
9).

In this way, the movement locus detection processing unit 41 determines that the movement locus of the microphone unit 140 is moving along the "clockwise triangular shape", and if such a shape flag is set, the following steps are performed. A process for checking whether or not the microphone unit 140 is moving along the determined shape by referring to the shape recognition table shown in FIG. That is, the "count number" and the "NP" associated with the "clockwise triangular shape" in the shape recognition table.
Using the data stored in "1" to "NP3", the confirmation processing is performed in the same procedure as the above-described "clockwise circular shape" confirmation processing (steps Sa12 to Sa17). Therefore, as shown in FIG.
When 0 is moved, the movement locus detection processing unit 41 determines that the movement locus is “clockwise triangular”. This recognition result is output from the movement trajectory detection processing unit 41 to the performance control information generation unit 44. As a result, performance control information for instructing the control content (inserting a clap sound (see FIG. 5)) corresponding to the clockwise triangle is supplied from the performance control information generation unit 44 to the sound source device 29. In the tone generator 29 to which the performance control information is supplied, a musical tone signal is generated by adding a clapping voice signal to the musical tone signal according to the MIDI data corresponding to the karaoke piece.

By performing the above-described processing, when the singer rotates the microphone unit 140 clockwise along the triangle, the triangle clockwise operation is performed when playing a karaoke piece based on MIDI data. The corresponding control content (inserting a clap sound) can be reflected.

Next, a case where the operator moves the microphone unit 140 along the counterclockwise triangular shape as shown in FIG. 12 will be described. When the operator moves the microphone unit 140, the movement locus detection processing unit 41 causes the microphone unit 1 to move based on αx and αy.
40 has started moving, that is, the movement start starting point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step S).
a2).

After that, the movement locus detection processing unit 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed along the counterclockwise triangular shape, as shown in FIG. 12, the moving direction of the microphone unit 140 from the detected start point SP, that is, from the start point SP to the first recognition point NP1. Is the lower left direction. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a5, the recognition point count number NP is set to 2. Then, the moving direction of the microphone unit 140 after moving from the start point SP to the lower right, that is, the direction from the first recognition point NP1 to the second recognition point NP2 is detected (step Sa6).

Here, in step Sa3, 1 from the starting point SP.
When the direction to the second recognition point NP1 is detected as "lower left", when the direction from the first recognition point NP1 to the second recognition point NP2 is detected as "right side", the microphone unit is detected. It is determined that 140 is moving along the "counterclockwise triangular shape", and the movement locus detection processing unit 41 sets the shape flag "counterclockwise triangular shape" (step Sa9).

In this way, the movement locus detection processing unit 41 determines that the microphone unit 140 is moving along the "counterclockwise triangular shape", and if such a shape flag is set, thereafter, FIG. The processing for checking whether or not the microphone unit 140 is moving along the determined shape is performed by referring to the shape recognition table shown. That is, the "counterclockwise triangular shape" of the shape recognition table
"Count number" and "NP1" associated with
Using the data stored in "NP3", the confirmation processing is performed in the same procedure as the above-described "clockwise circular shape" confirmation processing (steps Sa12 to Sa17). Therefore, when the microphone unit 140 is moved as shown in FIG. 12, the movement locus detection processing unit 41 determines that the movement locus is “counterclockwise triangular shape”, and according to the determined shape. Musical tone control etc. will be performed.

C-3. When the microphone unit 140 is moved along the quadrangular shape Next, as shown in FIG. 13, a case where the operator moves the microphone unit 140 along the clockwise quadrangular shape will be described. The operator operates the microphone unit 14
When 0 is moved, the movement locus detection processing unit 41 causes αx,
Based on αy, the microphone unit 140 starts moving, that is, the movement start point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step Sa2).

After that, the movement locus detection processing unit 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed along the clockwise quadrangular shape, as shown in FIG. 13, the moving direction of the microphone unit 140 from the detected start point SP, that is, from the start point SP to the first recognition point NP1. The direction is the right lateral direction. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a18, it is determined that the microphone unit 140 is moving along the "clockwise quadrangular shape", and the movement locus detection processing unit 41 sets the shape flag "clockwise quadrangular shape".

In this way, the movement locus detection processing unit 41 judges that the microphone unit 140 is moving along the "clockwise quadrangular shape", and if such a shape flag is set, the steps thereafter are shown in FIG. The microphone unit 1 is referred to according to the determined shape by referring to the shape recognition table.
A process for confirming whether or not 40 is moving is performed. That is, the “count number” and “NP1” to “NP” associated with the “clockwise quadrangular shape” in the shape recognition table.
4 ”is used to confirm the above-mentioned“ clockwise circular shape ”(step Sa12 to step Sa1).
The confirmation process is performed in the same procedure as 7). Therefore, FIG.
When the microphone unit 140 is moved as shown in FIG. 3, the movement locus detection processing unit 41 determines that the movement locus is “clockwise quadrangular”. Then, the recognition result is output from the movement trajectory detection processing unit 41 to the performance control information generation unit 44. As a result, the performance control information for instructing the control content corresponding to the quadrangle clockwise (the tone color is changed to the guitar) is supplied from the performance control information generation unit 44 to the sound source device 29. In the tone generator 29 to which the performance control information is supplied, the parameters other than the tone color are tone signals in accordance with the pitch, timing and tempo specified by the MIDI data corresponding to the specified karaoke piece, For, the tone signal for generating the tone of the "guitar" is generated.

By performing the above-described processing, when the singer rotates the microphone unit 140 clockwise along the square shape, the square clockwise operation is performed in the performance of the karaoke piece based on the MIDI data. It is possible to reflect the corresponding control content (changing the tone color to a guitar tone).

Next, as shown in FIG. 14, the case where the operator moves the microphone unit 140 along the counterclockwise quadrangular shape will be described. When the operator moves the microphone unit 140, the movement locus detection processing unit 41 causes the microphone unit 1 to move based on αx and αy.
40 has started moving, that is, the movement start starting point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step S).
a2).

After that, the movement locus detection processing unit 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed along the counterclockwise quadrangular shape, as shown in FIG. 14, the moving direction of the microphone unit 140 from the detected start point SP, that is, from the start point SP to the first recognition point NP1. The direction of is almost downward. Therefore, the processing of the movement locus detection processing unit 41 proceeds to step Sa19, determines that the microphone unit 140 is moving along the "counterclockwise quadrangular shape", and the movement locus detection processing unit 41 determines that the shape flag "counterclockwise". Set "circular quadrilateral".

In this way, the movement locus detection processing unit 41 judges that the microphone unit 140 is moving along the "counterclockwise quadrangular shape", and if such a shape flag is set, thereafter, FIG. The processing for checking whether or not the microphone unit 140 is moving along the determined shape is performed by referring to the shape recognition table shown. That is, the "counterclockwise quadrangular shape" of the shape recognition table
"Count number" and "NP1" associated with
Using the data stored in “NP4”, the confirmation process is performed in the same procedure as the above-described “clockwise circular shape” confirmation process (steps Sa12 to Sa17). Therefore, when the microphone unit 140 is moved as shown in FIG. 14, the movement locus detection processing unit 41 determines that the movement locus is “counterclockwise quadrangular”. Then, the recognition result is output from the movement trajectory detection processing unit 41 to the performance control information generation unit 44. As a result, the performance control information for instructing the control content corresponding to the quadrangle clockwise (the tone color is changed to the guitar) is supplied from the performance control information generation unit 44 to the sound source device 29. In the tone generator 29 to which the performance control information is supplied, the parameters other than the tone color correspond to the designated karaoke piece M.
A tone signal is generated according to the pitch, timing, and tempo specified by the IDI data, and a tone signal for generating a tone color of "guitar" is generated.

By performing the above processing, when the singer rotates the microphone unit 140 in a clockwise direction along a square shape, the square clockwise movement is performed in playing a karaoke piece based on MIDI data. It is possible to reflect the corresponding control content (changing the tone color to a guitar tone).

C-4. When the microphone unit 140 is moved along the figure eight shape Next, as shown in FIG. 15, a case where the operator moves the microphone unit 140 along the figure eight shape clockwise will be described. The operator operates the microphone unit 14
When 0 is moved, the movement locus detection processing unit 41 causes αx,
Based on αy, the microphone unit 140 starts moving, that is, the movement start point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step Sa2).

After that, the movement locus detection processing section 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed in the clockwise eight-character shape, as shown in FIG. 15, the moving direction of the microphone unit 140 from the detected start point SP, that is, the first recognition point NP1 from the start point SP. The direction to is the upper right direction. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a20, it is determined that the microphone unit 140 is moving along the "clockwise eight-shaped", and the movement locus detection processing unit 41 sets the shape flag "clockwise eight-shaped".

In this way, the movement locus detection processing unit 41 judges that the microphone unit 140 is moving along the "clockwise eight-shaped", and if such a shape flag is set, thereafter, FIG. The shape recognition table shown in FIG.
A process for confirming whether or not 40 is moving is performed. That is, the "count number" and "NP1" to "NP" associated with the "clockwise octagonal shape" of the shape recognition table.
8 "using the data stored in the" clockwise circular shape "confirmation process (step Sa12 to step Sa1).
The confirmation process is performed in the same procedure as 7). More specifically,
After the shape flag is set as described above, the direction in which the movement locus of the microphone unit 140 is stored in "NP2" to "NP8" associated with "clockwise eight-shaped", that is, "lower right" → “Lower left” → “Upper left” …… “Lower right”
→ Check if you are moving along the "upper right". Therefore, as shown in FIG.
When 40 is moved, the movement locus detection processing unit 41 determines that the movement locus is “clockwise eight-shaped”. The recognition result is output from the movement locus detection processing unit 41 to the performance control information generation unit 44. As a result, performance control information for instructing the control content corresponding to the figure-eight clockwise direction (for example, the tone color is made into a trumpet) is supplied from the performance control information generation unit 44 to the tone generator 29. In the tone generator 29 to which the performance control information is supplied, for the parameters other than the tone color, the pitch and timing specified by the MIDI data corresponding to the designated karaoke piece,
A tone signal according to the tempo is generated, and a tone signal for generating a tone having a tone color of "trumpet" is generated.

By performing the above-described processing, when the singer rotates the microphone unit 140 clockwise along the figure-eight shape, the figure-eight figure is used for playing the karaoke piece based on the MIDI data. It is possible to reflect the control content corresponding to the model clockwise operation (making the tone color a trumpet sound).

Next, as shown in FIG. 16, a case where the operator moves the microphone unit 140 along a counterclockwise eight-shape will be described. When the operator moves the microphone unit 140, the movement locus detection processing unit 41 causes the microphone unit 1 to move based on αx and αy.
40 has started moving, that is, the movement start starting point SP is detected (step Sa1), and the recognition point count number NP used for shape recognition is set to 1 (step S).
a2).

After that, the movement locus detection processing section 41 detects the movement direction of the microphone unit 140 from the starting point SP to the first recognition point NP1 (step Sa3).
Here, when the operation is performed in the counterclockwise eight-shape, as shown in FIG. 16, the moving direction of the microphone unit 140 from the detected start point SP, that is, the first recognition point from the start point SP. The direction toward NP1 is directly below. Therefore, the process of the movement locus detection processing unit 41 is performed in step S
Proceeding to a21, it is determined that the microphone unit 140 is moving along the "counterclockwise eight-shaped", and the movement locus detection processing unit 41 causes the shape flag "counterclockwise eight-shaped".
To set.

In this way, the movement locus detection processing unit 41 determines that the microphone unit 140 is moving along the "counterclockwise eight-shape" and sets such a shape flag. A process for checking whether or not the microphone unit 140 is moving along the determined shape by referring to the shape recognition table shown in FIG. That is, the "counterclockwise figure eight" of the shape recognition table
"Count number" and "NP1" associated with
Using the data stored in “NP8”, the confirmation processing is performed in the same procedure as the above-described “clockwise circular shape” confirmation processing (steps Sa12 to Sa17). More specifically, after the shape flag is set as described above, the movement trajectory of the microphone unit 140 is stored in “NP2” to {NP8 ”associated with“ counterclockwise eight-shaped ”. Direction, that is, “lower left” → “lower right” → “upper right” ……
Check if you are moving along the "lower left" → "upper left". Therefore, when the microphone unit 140 is moved as shown in FIG. 16, the movement locus detection processing unit 41 determines that the movement locus is “counterclockwise eight-shaped”. The recognition result is the movement locus detection processing unit 4
1 to the performance control information generation unit 44. As a result, performance control information for instructing the control content corresponding to an eight-shaped counterclockwise rotation (for example, setting the tone color to clarinet) is supplied from the performance control information generation unit 44 to the sound source device 29. In the tone generator 29 to which the performance control information is supplied, for the parameters other than the tone color, the pitch specified by the MIDI data corresponding to the specified karaoke piece,
A tone signal is generated according to the timing and the tempo, and a tone signal for generating a tone of the "clarinet" tone color is generated.

By performing the above processing, when the singer rotates the microphone unit 140 in the clockwise direction along the figure-eight shape, the figure-eight figure is used for playing the karaoke piece based on the MIDI data. It is possible to reflect the control content corresponding to the counterclockwise motion of the mold (making the tone color a clarinet sound).

The movement locus detection processing unit 41 has been described above.
8 is a specific example of a processing procedure for detecting the movement locus of the microphone unit 140 according to the above, the shapes other than the above shapes, such as a waveform and a mountain shape, are recognized in the shape recognition table shown in FIG. It is possible to recognize by storing the information for doing so. If you want to recognize a shape other than the above-mentioned shape, you can change the shape recognition table and the above processing procedure appropriately according to the shape. Good.

As described above, in the karaoke system 100 according to the present embodiment, the microphone unit 140 held by the singer who sings a karaoke piece is arranged along various shapes such as a circle, a quadrangle, a triangle, and a figure eight shape. By moving the shape, the control content assigned to the shape can be reflected in the performance of the karaoke piece. Thus, while it is moved to the microphone unit 140 singer along the any shape in advance, if you know that such what control contents are reflected, which itself is singing karaoke In addition, various musical tone parameters such as tone color, tempo, timing, and volume can be controlled by moving the microphone unit 140 along a predetermined shape. Therefore, singing such as moving the microphone unit 140 along a desired shape without performing a complicated operation such as operating a switch group of an operation unit provided in the karaoke apparatus body 110 during singing a karaoke song. However, it is possible to change various performance-related parameters and the like by means of operations that can be easily performed.

The singer is the microphone unit 1
By moving 40 to a predetermined shape, not only the performance of a karaoke piece but also another device, for example, a lighting device 150.
The display content of the display device 120 and the like can be controlled. Therefore, by moving the microphone unit 140 quickly, the karaoke system 100
It is also possible to lighten the room in which is installed, or to darken the room by slowly moving the microphone unit 140. In addition, by moving the microphone unit 140 along one operation, for example, in the shape of an eight-shaped counterclockwise, control of the lighting device 150, control of the display content of the display device 120, and karaoke music. If the performance content is controlled, for example, when the singer performs a certain action, the performance tempo of the karaoke piece is increased, the blinking and illuminating period of the lighting device 150 is increased, and the display device 120 feels fast. It is also possible to perform a coordinated control of music performance such as displaying a certain image, lighting, and display.

D. Modifications The present invention is not limited to the above-described embodiment, and various modifications as exemplified below are possible.

(Modification 1) In the above-described embodiment, the tone color at the time of playing a karaoke piece is changed according to the shape drawn by the movement trajectory of the microphone unit 140, the speed of movement (absolute value | α |), and the like. However, it is also possible to perform control such as insertion or insertion of a predetermined sound, but it is also possible to perform control of other performance contents when performing a karaoke piece. For example, when the microphone unit 140 is moved along a certain shape, the DSP 30 is controlled so that the position of the virtual sound source of the performance sound of the karaoke piece is located away from the position of the karaoke device body 110. When the microphone unit 140 is moved along another shape, sound image localization control such as controlling the DSP 30 so that the position of the virtual sound source is close to the karaoke device main body 110 is performed. Good.
When the virtual sound source position is controlled according to the detection result (movement locus) of the motion sensor MS in this way, the DSP 30 is supplied from the sound source device 29 with delay processing and panning processing according to the position of the target virtual sound source. It may be applied to the tone signal.

Further, in addition to the control such as controlling the position of the virtual sound source according to the detection result (movement locus) of the motion sensor MS as described above, a predetermined area is determined according to the detection result of the motion sensor MS. You may make it control for reproducing the sound field space of. For example, when the microphone unit 140 is moved along a certain shape, the reverberation effect imparting process is performed on the musical tone signal as if the performance sound of the karaoke piece is reproduced in a wide space (such as a concert hall). The DSP 30 may be instructed to do so. As a method of imparting reverberation to a musical tone signal in this way, a so-called impulse response convolution type reverberation imparting method is known. This impulse response convolutional reverberation sound adding method stores in advance the impulse response collected when an impulse sound is generated in a sound field space such as a concert hall, and stores it in advance for a sample data string of a musical tone signal. By convoluting the impulse response, the reverberant tone signal is obtained. Microphone unit 1 as above
When 40 is moved along a certain shape and the above reverberation effect imparting process is performed according to the motion detection result,
The DSP 30 may perform the above-described impulse response convolution processing on the tone signal supplied from the tone generator 29.

(Modification 2) Further, how to reflect the detection result of the motion sensor MS mounted on the microphone unit 140 to the performance, illumination and display of the karaoke piece is limited to the example described in the above embodiment. It is not something that will be done. For example, a timing at which the absolute value | α | of the motion detection signals αx and αy detected by the motion sensor MS becomes larger than a predetermined value is detected, and the performance tempo of the karaoke piece and the light emission timing of the illumination are detected according to the detected timing. Etc. may be controlled. With this configuration, if the singer performs a motion of periodically moving the microphone unit 140 largely, the timing of the large motion is detected, and the performance tempo and the like can be controlled according to the detected timing. For example, if the singer shortens the time interval during which the microphone unit 140 is greatly moved, the playing tempo of the karaoke song becomes faster, and if the time interval during which the microphone unit 140 is greatly moved is increased, the playing tempo of the karaoke song becomes slower. Such control may be performed.

(Modification 3) Further, in the above-described embodiment, the timbre and the inserted sound are controlled according to the movement locus of the microphone unit 140. However, in addition to these controls, the shape in which the microphone unit 140 exists You may make it control a sound volume etc. according to the position when it is being moved along. For example, when the microphone unit 140 is moved in a circular clockwise direction as shown in FIG. 9, the movement locus detection processing unit 41 outputs the position in the movement locus shape to the performance control information generation unit 44, and the performance is performed. The control information generation unit 44 may generate performance control information for controlling the volume and the like according to the position information. In this case, if the performance control information generation unit 44 generates performance control information for instructing to decrease the volume as it goes to a position lower than the start point SP in the figure,
When the microphone unit 140 is moving in the vicinity of the starting point SP, a musical sound is generated with a relatively large volume, and when moving in the vicinity of the recognition point NP1 and the recognition point NP3, the generated volume is slightly reduced, and the recognition point NP2 is generated. It is possible to perform volume adjustment such that the generated volume is further reduced when moving in the vicinity. If the volume and the like are controlled according to the relative position of the starting point SP of the microphone unit 140 as a reference, when the singer moves the microphone unit 140 along a larger circular shape. Therefore, the movement locus passes through a position lower than the starting point SP. That is, when the microphone unit 140 is moved along a larger circular shape, the volume range changed by the movement increases,
Conversely, the microphone unit 1 along a smaller circular shape
When 40 is moved, the width of the volume changed by the movement becomes smaller. Therefore, when the singer moves the microphone unit 140 along a certain shape, the singer can freely control the change range of parameters such as volume by adjusting the size of the shape.

(Modification 4) In the above-described embodiment, the two-dimensional acceleration sensor is used as the motion sensor MS for detecting the motion of the singer with respect to the microphone unit 140. However, the singer, etc. (limited to the singer) Not)
Any type of sensor such as a three-dimensional acceleration sensor, a three-dimensional speed sensor, a two-dimensional speed sensor, a tilt sensor, a strain sensor, an impact sensor, or the like may be used as long as it can detect any operation with respect to the microphone unit 140. You can

(Fifth Modification) In the above-described embodiment, the motion sensor MS is mounted on the microphone unit 140 having the microphone 15 for the singer to input the singing sound. You may make it comprise as a motion detection unit which mounts the motion sensor MS in another housing. Such motion sensor MS
If the microphone is mounted in a separate housing from the microphone 15,
As shown in FIG. 7, the singer can hold and use the rod-shaped microphone unit 300 equipped with a microphone in one hand and the rod-shaped motion detection unit 310 equipped with a motion sensor in the other hand. . Further, the motion detection unit 310 is not limited to a rod shape or the like, and may be any type as long as it can be attached to a position where the movement of a singer or the like can be detected, and for example, a type that can be attached around the hand or foot of the singer or the like. Or may be of a type that can be attached by being attached to a part of the body.

(Modification 6) In the above-described embodiment, a karaoke piece is played in accordance with the detection result of one motion sensor MS built in the microphone unit 140.
Although the lighting, the display, and the like are controlled, the performance of the karaoke piece or the like may be controlled according to the detection results of the plurality of motion sensors MS. When a plurality of motion sensors MS are used, a control target is assigned to each motion sensor MS in advance, for example, one motion sensor MS is assigned a karaoke song performance, and another motion sensor MS is assigned such as lighting and display. , The control object assigned according to the detection result of each motion sensor MS may be controlled, or the average of the detection results of the plurality of motion sensors MS may be obtained, and the karaoke piece may be calculated according to the average of the detection results. May be controlled.

(Variation 7) Further, in the above-described embodiment, the singer can control the music performance of the karaoke music by moving the microphone unit 140, but the music data is vocal. When the sound data is included, the generation of vocal sound based on the vocal sound data may be controlled according to the detection result of the motion sensor MS.

As described above, the MIDI data used as music data for karaoke performance includes data including a vocal track in addition to an accompaniment track for music performance and a lyrics track for displaying lyrics. The vocal sound track is a data of a vocal sound sung by a professional singer. For example, an ADPCM (Adaptive Differentia) audio signal generated by singing by a professional singer.
Pulse Code Modulation) Data is used. When performing a performance based on song data including a vocal sound track, the karaoke device body 110 is provided with an audio reproduction device, and the audio reproduction device reproduces the vocal sound data of the vocal sound track to reproduce the vocal sound. It is like this. The operation detection result of the operation sensor MS may be reflected in the reproduction of the vocal sound data of the vocal sound track. For example, the reproduction volume of the vocal sound may be controlled or an echo may be added to the reproduced vocal sound according to the shape of the movement trajectory detected as in the above-described embodiment.

(Variation 8) In the above-described embodiment, the singer can control the performance of the karaoke piece by moving the microphone unit 140. However, the lyrics information and the melody can be controlled. A singing voice synthesizer that synthesizes a singing voice based on information may be mounted on the karaoke device body 110, and singing voice synthesis by the singing voice synthesizer may be controlled according to the detection result of the motion sensor MS.

As shown in FIG. 18, the karaoke device body 110 'of the karaoke system 100' is the same as the karaoke device body 110 in the above embodiment.
It has a configuration in which 80 is added. The singing synthesizer 180
Lyrics information included in song data for karaoke performance (MID
In the case of I data, the singing sound signal is synthesized according to the lyric track) and the melody information (accompaniment track in the case of MIDI data). As the singing voice synthesizer 180, various known singing voice synthesizing devices can be used, and for example, a singing voice synthesizer to which a rule synthesizing technique is applied can be used. The singing voice synthesizer applying the rule synthesis technology has a database that stores voice sample data in units of phonemes and phoneme chains containing multiple phonemes. Is read from the database and connected to synthesize a singing sound signal, and such a singing synthesizer can be used.

In this modified example, the singing voice synthesizer 180 includes a microphone unit 140 in which the singer has information such as information about the movement locus detected by the movement locus detection processing unit 41 and information about the peak value detected by the peak detection processing unit 42. Information is supplied according to the operation performed on the. The singing voice synthesizer 180 does not synthesize the singing voice signal faithfully to the lyrics information and the melody information shown in the song data as described above, but moves the locus detection processing unit 41.
And the singing sound signal reflecting the information on the operation supplied from the peak detection processing unit 42 is synthesized and output to the amplifier 33. More specifically, the singing voice synthesizer 180 has a table that describes the control content to be reflected in the singing voice synthesis in association with the information regarding the movement trajectory and the information regarding the peak value. Then, when the singing voice synthesizer 180 is supplied with information about a certain movement locus, for example, a movement locus in a circular clockwise direction (see FIG. 7), it is said that the table is a circular clockwise movement locus. The control content associated with the information, for example, the control content of synthesizing the singing sound signal with a female voice is reflected in the singing sound synthesis.

In addition to the timbre control such as synthesizing a singing sound signal with a female voice according to the detection result of the motion sensor MS as described above, a singing voice synthesizer according to the detection result of the motion sensor MS Various elements such as the timing at which 180 synthesizes the singing sound signal and the volume may be controlled. For example, when the microphone unit 140 is moved along a rectangular clockwise shape (see FIG. 9),
When the singing voice synthesizer 180 starts synthesizing the singing sound signal according to the action detection result and the microphone unit 140 is moved along the quadrangle counterclockwise shape (see FIG. 10), the action detection result The singing voice synthesizer 180 may perform control such that the singing voice signal stops synthesizing. In this way, when the singer uses the karaoke system 100 'to sing a duet song, when the singer wants to sing the other party's singing part, the microphone unit 140 has a rectangular clockwise shape. When moved along, the singing sound of the singing part of the other party is synthesized by the singing synthesizer 180. On the other hand, when the singer wants to stop the singing of the singing part of the other party, the microphone unit 140 can be moved along the shape of the quadrangle counterclockwise to stop the synthesis of the singing sound of the singing part of the other party. You can
Therefore, the singer can arbitrarily control the progress of the singing part of the other party of the duet song by an operation that can be easily performed while singing, such as moving the microphone unit 140.

(Modification 9) Further, in the above-described embodiment, when controlling the music performance, lighting, display, etc. according to the detection result (movement locus etc.) of the motion sensor MS, the karaoke music being played is controlled. You may make it perform the control. For example, the control contents such as illumination and display based on the detection result of the motion sensor MS may be changed according to the tone of the karaoke song selected by the singer. That is, even when the singer performs the same operation with respect to the microphone unit 140, different control is performed depending on whether the karaoke piece being played is an uptempo piece or a slow ballad piece. You may For example, in the case of an up-tempo song, control is performed such that the controllable range of the intensity of the light emitted by the lighting device 150 is made brighter, the displayed content is a moving image, and in the case of a slow ballad. The control range may be such that the controllable range of the intensity of the light emitted from the illumination device 150 is darkened and the display content is a video with a loose image. When the control content is changed according to the tune in this way, information for identifying the tune is included in the song data in advance, and when a certain karaoke song is designated, the tune included in the song data is identified. The control mode may be determined by referring to the information to be controlled.

[0109]

As described above, according to the present invention,
Even while singing a karaoke song, it is possible to control the tone generation based on the song data without performing a complicated operation.

[Brief description of drawings]

FIG. 1 is a diagram schematically showing an appearance of a karaoke system according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a microphone unit that is a component of the karaoke system.

FIG. 3 is a block diagram showing a configuration of a karaoke device body which is a component of the karaoke system.

FIG. 4 is a block diagram showing a functional configuration of the karaoke system when playing a karaoke piece.

FIG. 5 is a diagram showing an example of information stored in a control information table of the karaoke system.

FIG. 6 is a flowchart showing a processing procedure for detecting a movement locus of the microphone unit.

FIG. 7 is a flowchart showing a processing procedure for detecting a movement trajectory of the microphone unit.

FIG. 8 is a diagram for explaining the contents of a shape recognition table used for detecting the movement trajectory of the microphone unit.

FIG. 9 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 10 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 11 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 12 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 13 is a diagram illustrating a movement locus detection process of the microphone unit.

FIG. 14 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 15 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 16 is a diagram for explaining a movement trajectory detection process of the microphone unit.

FIG. 17 is a diagram schematically showing an appearance of a modified example of the karaoke system.

FIG. 18 is a block diagram showing a functional configuration of a modified example of the karaoke system when playing a karaoke piece.

[Explanation of symbols]

11 ... CPU, 12 ... Memory, 15 ... Microphone, 21 ... CPU, 22 ... ROM, 23 ... RA
M, 28 ... Display control unit, 29 ... Sound source device, 30 ...
DSP, 33 ... Amplifier, 41 ... Movement locus detection processing unit, 42 ... Peak detection processing unit, 43 ... Display and lighting control unit, 44 ... Performance control information generation unit, 100 ... Karaoke system, 110 ... ... Karaoke device body, 12
0 ... Display device, 130 ... Speaker, 140 ... Microphone unit, 150 ... Lighting device, 180 ... Singing synthesizer, 300 ... Microphone unit, 310 ...
… Motion detection unit, MS… Motion sensor

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Kobayashi Eiko             Yamaha stock, 10-1 Nakazawa-machi, Hamamatsu-shi, Shizuoka             In the company F term (reference) 5D108 BB06 BE03 BG06                 5D378 FF07 MM12 MM16 MM65 MM68                       MM97

Claims (9)

[Claims] 1. A unit that can be carried by a user,
A karaoke system including a motion detection unit that detects a motion of a user carrying the unit, and a karaoke device that performs a performance based on song data, wherein the karaoke device is detected by the motion detection unit. A karaoke system comprising: an acquisition unit that acquires a user's motion detection result; and a musical sound generation unit that generates a musical sound based on the music data and the motion detection result acquired by the acquisition unit. 2. The musical tone generating means controls at least one of a tempo of a musical tone to be generated, a tone volume, a timing, a tone color, and an effect to be generated which are specified by music data based on the operation detection result. The karaoke system according to claim 1. 3. The musical tone generating means controls a sound image position of a musical tone generated based on the music data, based on the result of the motion detection.
Karaoke system described in. 4. The motion detection unit has a microphone for inputting a user's voice, and the musical sound generating means produces a sound by synthesizing a musical sound based on the music data and a voice input to the microphone. The karaoke system according to any one of claims 1 to 3, wherein 5. When the music data includes vocal sound data, the musical sound generating means controls generation of vocal sound based on the vocal sound data based on the motion detection result. The karaoke system according to any one of claims 1 to 4, wherein: 6. The karaoke device has a singing sound synthesizer for synthesizing a singing sound based on the lyrics information and the melody information included in the song data, and the singing sound synthesizer uses the acquisition means. The karaoke system according to any one of claims 1 to 5, wherein synthesis of a singing sound is controlled according to the acquired motion detection result. 7. The karaoke device, when the musical tone is generated by the musical tone generating means based on the music data, a displaying means for displaying an image, and the displaying means based on the motion detection result acquired by the acquiring means. 7. A display control means for controlling an image displayed on the display, further comprising:
Karaoke system according to any one of. 8. The environment control means for controlling the environment around the user of the karaoke system based on the motion detection result acquired by the acquisition means. Karaoke system according to any one. 9. The environment control means includes a lighting device that irradiates light around the user, and controls the lighting device based on a motion detection result acquired by the acquisition means. The karaoke system according to claim 8, which is characterized in that.