JP7434083B2 - karaoke equipment - Google Patents

Description

The present invention relates to a karaoke device.

Electronic musical instruments are known that are equipped with sound sources (so-called multitimbral sound sources) that can simultaneously generate musical sound signals from multiple different musical instruments and output each musical sound signal independently (so-called individual output). There is. Instrument sounds based on a plurality of musical sound signals output by a multitimbral sound source can be emitted from independent speakers.

For example, by emitting guitar, bass, and drum instrument sounds based on musical sound signals generated by a multitimbral sound source separately from speakers installed at appropriate locations, you can create a realistic feeling similar to a live performance by a band. be able to.

Patent Document 1 discloses an electronic musical instrument that includes a first output terminal for outputting a musical tone signal of a first tone to the outside, and a second output terminal for outputting a musical tone signal of a second tone to the outside. is disclosed.

Japanese Patent Application Publication No. 9-330083

By the way, in a typical karaoke apparatus, a plurality of musical tone signals generated by a multitimbral sound source are stereo-mixed by a digital mixer and emitted as karaoke performance sound. Therefore, since a plurality of musical instrument sounds are collectively emitted from one speaker, it is not possible to obtain a sense of presence similar to that of a live performance.

SUMMARY OF THE INVENTION An object of the present invention is to provide a karaoke apparatus that enables karaoke performances that have a realistic feel similar to live performances.

One invention to achieve the above object is a karaoke device that can communicate with a mobile terminal owned by a user, and which uses a musical instrument that is used to play a selected song based on performance data of the song. an identification unit that identifies musical instrument information indicating the karaoke device; an acquisition unit that acquires first position information indicating the position of the mobile terminal in a room in which the karaoke device is installed; a generation unit that generates assignment information that associates a compatible mobile terminal with the specified instrument information; and a sound source that generates a musical tone signal for each instrument based on performance data of a song and outputs it independently for each instrument. a sound source control unit that controls a musical tone signal of a musical instrument indicated by musical instrument information included in the assignment information to a mobile terminal associated with the musical instrument information; The karaoke apparatus includes a sound source control section that causes a sound emitting means to output a musical tone signal of a musical instrument indicated by musical instrument information not included in assignment information.
Other features of the present invention will become clear from the description and drawings described below.

According to the present invention, it is possible to perform a karaoke performance with a realistic feeling similar to a live performance.

It is a diagram showing a karaoke room according to the first embodiment. FIG. 1 is a diagram showing a karaoke apparatus according to a first embodiment. It is a figure showing a karaoke main body concerning a 1st embodiment. It is a diagram showing the inside of the karaoke room according to the first embodiment in detail. FIG. 3 is a diagram showing an assignment table according to the first embodiment. It is a flowchart which shows the processing of the karaoke apparatus concerning a 1st embodiment. 7 is a diagram showing the correspondence between localization designation information and musical instrument information according to Modification 1. FIG. 7 is a diagram showing details of the inside of a karaoke room according to modification 1. FIG. It is a flowchart which shows the processing of the karaoke apparatus concerning a 2nd embodiment.

<First embodiment>
A karaoke apparatus according to a first embodiment will be described with reference to FIGS. 1 to 6.

==Karaoke machine==
The karaoke device K is a device for performing karaoke and for users to sing karaoke. Karaoke device K is installed in karaoke room R. Karaoke room R is an example of a "room."

Users U1 to U3 shown in FIG. 1 are those who use the karaoke apparatus K. Each user owns a mobile terminal M1 to a mobile terminal M3. The mobile terminal is a terminal such as a smartphone, and is equipped with application software dedicated to the karaoke device (hereinafter referred to as "dedicated application"), a speaker for emitting various sounds, and the like.

After entering Karaoke Room R, the user operates a mobile terminal to start a pre-installed dedicated application. The mobile terminal executes a dedicated application and performs pairing with the karaoke device K. Pairing can be performed using a known method. After the pairing is completed, the karaoke device K and the mobile terminal can communicate with each other. In addition, along with the pairing, the karaoke apparatus K acquires terminal identification information (for example, terminal ID) for identifying each mobile terminal.

As shown in FIG. 2, the karaoke apparatus K according to the present embodiment includes a karaoke main body 10, a speaker 20, a display device 30, a microphone 40, a remote control device 50, and a photographing means 60.

The karaoke main body 10 performs various controls related to karaoke performance and singing, such as controlling the performance of selected songs, controlling the display of lyrics and background images, and processing audio signals input through the microphone 40. The speaker 20 is configured to emit sound based on a signal from the karaoke main body 10. The speaker 20 is an example of a "sound emitting means." In this embodiment, two speakers (a left speaker 20a and a right speaker 20b) are arranged at a constant interval in the karaoke room R (see FIG. 4). Note that the number of speakers 20 is not limited to two. The display device 30 is configured to display videos and images on a screen based on signals from the karaoke main body 10. The microphone 40 is configured to convert the singing voice based on the user's karaoke singing into an analog audio signal and input it to the karaoke main body 10. The remote control device 50 is a device for performing various operations on the karaoke main body 10. The photographing means 60 is a camera capable of photographing the inside of the karaoke room R where the karaoke apparatus K is installed.

As shown in FIG. 2, the karaoke main body 10 includes a control section 11, a communication section 12, a storage section 13, a sound processing section 14, a display processing section 15, and an operation section 16. Each component is connected to bus B via an interface (not shown).

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a implements various control functions by executing operating programs stored in the memory 11b. The memory 11b is a storage device that stores programs to be executed by the CPU 11a and temporarily stores various information when the programs are executed.

The communication unit 12 provides an interface for communicating with each mobile terminal.

The storage unit 13 is a large-capacity storage device that stores various data, and is, for example, a hard disk drive.

The storage unit 13 stores music data for performing a karaoke performance of music and music identification information in association with each other. The song identification information is unique information set for each song, such as a song ID. The music data includes performance data, reference data for scoring karaoke singing by users, and the like.

The performance data is the source data of the karaoke performance sound. The performance data is, for example, MIDI format data, and includes performance information and timbre designation information for different channels for each instrument used to perform the music. Performance information is data corresponding to musical tone signals. The timbre specification information is information for specifying the timbre of the musical instrument sound based on the musical tone signal.

The storage unit 13 also stores lyrics caption data for displaying lyrics captions on the display device 30 etc. in accordance with the karaoke performance of the song, background image data such as a background image displayed on the display device 30 etc. during the karaoke performance, etc. Memorize each song.

Under the control of the control unit 11 , the audio processing unit 14 controls the karaoke performance of music and processes audio signals based on singing voices input through the microphone 40 . The acoustic processing section 14 includes a sound source 14a. The sound source 14a generates a musical tone signal based on the performance data and outputs it to the speaker 20 via a mixer (not shown). Furthermore, the sound source 14a according to this embodiment can transmit a part of the generated musical tone signal to the mobile terminal. Specifically, the sound source 14a is a multitimbral sound source, and a tone color for generating a musical tone signal for each musical instrument is set for each channel based on tone color designation information included in the performance data. Then, the sound source 14a generates musical tone signals for each musical instrument based on the performance information, and outputs them independently for each musical instrument.

The display processing section 15 performs processing related to various displays on the display device 30 and the remote control device 50 under the control of the control section 11 . For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics captions and various icons are superimposed on a background image during a karaoke performance of a song. The operation unit 16 includes a panel switch, a remote control receiving circuit, etc., and sends operation signals such as a song selection signal and a performance stop signal to the control unit 11 in response to the user's operation of the panel switch of the karaoke device K or the remote control device 50. Output. The control unit 11 detects an operation signal from the operation unit 16 and executes a corresponding process.

==Karaoke body==
As shown in FIG. 3, the karaoke main body 10 according to the present embodiment includes a specifying section 100, an acquiring section 200, a generating section 300, and a sound source controlling section 400. The identification unit 100, the acquisition unit 200, the generation unit 300, and the sound source control unit 400 are realized by the CPU 11a executing a program stored in the memory 11b.

[Specific part]
The identification unit 100 identifies musical instrument information based on the performance data of the selected song. The musical instrument information indicates the musical instrument used to play the music. The musical instrument information is specified as a musical instrument name, for example. The specifying unit 100 outputs the specified musical instrument information to the generating unit 300.

Here, in the example of FIG. 1, assume that music X is selected by user U1. In this case, the specifying unit 100 reads the performance data of the song X from the storage unit 13. Then, the specifying unit 100 specifies the musical instrument information by extracting the timbre designation information of all channels included in the performance data of the song X. Note that when the performance data is in MIDI format, the tone color designation information is expressed as a numerical value (tone color designation number) of a predetermined byte. In this case, the specifying unit 100 can specify the musical instrument information by referring to a comparison table between tone color designation numbers and musical instrument information stored in the storage unit 13 in advance.

In the following, it is assumed that six types of musical instrument information ("guitar", "bass", "piano", "saxophone", "trumpet", and "drum set") are specified based on the performance data of song X.

[Acquisition part]
The acquisition unit 200 acquires first position information indicating the position of the mobile terminal in the room where the karaoke device is installed.

The acquisition unit 200 can obtain the position from the image of the mobile terminal photographed by the photographing means 60 using a known method. The position of the mobile terminal in the room can be indicated by XY coordinate values based on a certain position (for example, the left speaker 20a and the right speaker 20b).

After each user enters the karaoke room R and the pairing between the mobile terminal and the karaoke device K is completed, the photographing means 60 starts photographing and transmits the video to the acquisition section 200. The acquisition unit 200 associates the received video with the terminal identification information acquired during pairing. After that, acquisition of the first position information can be performed at various timings. For example, the acquisition unit 200 can acquire the first position information based on the video received at the time when a certain song is selected or when the karaoke performance of the selected song is started.

For example, in the example of FIG. 1, when the karaoke performance of song Obtain (X1, Y1), (X2, Y2), (X3, Y3). The acquisition unit 200 associates terminal identification information with each location information and outputs it to the generation unit 300. The position information (X1, Y1), (X2, Y2), and (X3, Y3) are each examples of "first position information."

Note that the acquisition unit 200 may transmit an instruction signal to the mobile terminal to cause the mobile terminal to emit light at a timing when acquisition of the first position information is necessary. The mobile terminal emits light (for example, lights up the display screen) based on the instruction signal. The photographing means 60 photographs the mobile terminal emitting light and transmits the image to the karaoke apparatus K. In this case, the acquisition unit 200 can link the terminal identification information to the position information indicating the position where the light was emitted.

[Generation part]
The generation unit 300 generates assignment information that associates the mobile terminal corresponding to the acquired first position information with the specified musical instrument information.

Assume that, as in the above example, six types of musical instrument information are output from the specifying unit 100, and the position information of each of the mobile terminals M1 to M3 is output from the acquisition unit 200. In this case, the generation unit 300 generates three pieces of assignment information by associating any one piece of musical instrument information with each mobile terminal.

Assignment information can be generated in various ways. In this embodiment, the generation unit 300 generates assignment information based on the acquired first position information and second position information indicating the position of the sound emitting means.

FIG. 4 shows a left speaker 20a, a right speaker 20b, and mobile terminals M1 to M3 placed on a table T in a karaoke room R. In FIG. 4, the description of the karaoke main body 10 and the like is omitted.

The generation unit 300 generates assignment information according to the position of each mobile terminal and the distance from the center line CL of the left speaker 20a and the right speaker 20b. Specifically, the generation unit 300 analyzes the video shot by the shooting means 60 using a known method, thereby generating the position information (X1, Y1), (X2, Y2), (X3) of each mobile terminal. , Y3), the distance between each mobile terminal and the center line CL is determined. Note that the position of the center line CL in this example is determined by the positions of the left speaker 20a and the right speaker 20b, and is an example of "second position information."

Furthermore, in this example, the storage unit 13 stores an assignment table (see FIG. 5). The assignment table lists information on musical instruments used in karaoke performance in the order in which it is preferable to emit sound at a position close to the center line CL. Note that the assignment table may be a common table that can be applied to any song, or a different table may be set for each song.

The generation unit 300 refers to the assignment table shown in FIG. 5 in order of distance from the center line CL, and associates musical instrument information with each mobile terminal (specifically, the terminal identification information of each mobile terminal). conduct.

In the case of FIG. 4, the generation unit 300 generates assignment information A1 in which musical instrument information "guitar" is associated with the mobile terminal M2 in order of distance from the center line CL, and musical instrument information "guitar" is associated with the mobile terminal M1. Assignment information A2 is generated in which musical instrument information "saxophone" is associated with the mobile terminal M3, and assignment information A3 is generated in which musical instrument information "saxophone" is associated with the mobile terminal M3. The generation section 300 outputs the generated assignment information to the sound source control section 400.

[Sound source control section]
The sound source control section 400 controls the sound source 14a. Furthermore, in this embodiment, the sound source control unit 400 transmits the musical tone signal of the instrument indicated by the instrument information included in the assignment information to the mobile terminal associated with the instrument information, and To cause a sound emitting means to output a musical tone signal of a musical instrument indicated by musical instrument information not included in the information.

As described above, the sound source 14a can generate a musical tone signal for each musical instrument based on the performance data and output it independently for each musical instrument. Based on the assignment information, the sound source control unit 400 causes a part of the musical tone signal outputted by the sound source 14a to be transmitted to a mobile terminal owned by a user using the karaoke apparatus K. The mobile terminal can emit musical instrument sounds with predetermined tones based on the received musical tone signals. On the other hand, the sound source control unit 400 controls the sound source 14a and causes the speaker 20 to output the musical tone signal of the musical instrument indicated by the musical instrument information not included in the assignment information.

Specifically, in the above example, assume that the generation unit 300 outputs assignment information A1 to assignment information A3. The sound source control unit 400 refers to the assignment information A1 and controls the sound source 14a to transmit a musical tone signal corresponding to the musical instrument information "guitar" to the mobile terminal M2. Similarly, the sound source control unit 400 refers to the assignment information A2 and controls the sound source 14a to transmit a musical tone signal corresponding to the musical instrument information "Bass" to the mobile terminal M1. The sound source control unit 400 also refers to the assignment information A3 and controls the sound source 14a to transmit a musical tone signal corresponding to the musical instrument information "saxophone" to the mobile terminal M3. Transmission of musical tone signals to each mobile terminal is performed based on the terminal identification information of each mobile terminal.

As a result, the musical instrument sound "Bass" is emitted from the mobile terminal M1, the instrumental sound "Guitar" is emitted from the mobile terminal M2, and the instrumental sound "Saxophone" is emitted from the mobile terminal M3. Ru.

On the other hand, the sound source control unit 400 controls the sound source control unit 400 to emit musical sound signals from the musical instruments ("piano", "trumpet", "drum set") indicated by the instrument information not included in the assignment information from the left speaker 20a and the right speaker 20b. Controls the sound source 14a. The sound source 14a outputs musical tone signals of these three musical instruments to a mixer. The mixer generates a mixing signal by stereo-mixing the musical tone signals of the three musical instruments, and outputs it to the left speaker 20a and the right speaker 20b. As a result, musical instrument sounds such as "piano", "trumpet", and "drum set" are emitted from the left speaker 20a and the right speaker 20b, respectively. Note that the process by the mixer is performed only when there are two or more types of musical instruments indicated by the musical instrument information not included in the assignment information.

Further, when transmitting musical tone signals from the karaoke apparatus K to each mobile terminal, there is a possibility that a delay peculiar to digital communication may occur. As a result, there is a possibility that the musical instrument sounds emitted from the karaoke device K and the musical instrument sounds emitted from the mobile terminal are misaligned.

Therefore, the sound source control section 400 controls the sound source 14a to delay the musical tone signal of the musical instrument indicated by the musical instrument information not included in the assignment information by a predetermined period of time from the transmission of the musical tone signal of the musical instrument indicated by the instrument information included in the assignment information. Alternatively, the sound may be outputted to the sound emitting means.

==About processing in karaoke equipment==
Next, a specific example of processing in the karaoke apparatus K according to this embodiment will be described with reference to FIG. FIG. 6 is a flowchart showing an example of processing in the karaoke apparatus K. In this example, assume that user U1 selects song X in the situation shown in FIG. It is also assumed that pairing between the mobile terminal owned by each user and the karaoke device K has been completed.

The specifying unit 100 specifies instrument information indicating the instrument used to perform the song X based on the performance data of the selected song X (Identifies the instrument information. Step 10).

The acquisition unit 200 acquires first position information indicating the positions of the mobile terminals M1 to M3 in the karaoke room R in which the karaoke apparatus K is installed (first position information is acquired for each mobile terminal. Step 11).

The generation unit 300 generates assignment information that associates the mobile terminal corresponding to the first location information acquired in step 11 with the musical instrument information specified in step 10 (generates assignment information for each mobile terminal. Step 12).

With the start of the karaoke performance of song (Send a musical tone signal to each mobile terminal. Step 14). Furthermore, the sound source control section 400 controls the sound source 14a to cause the sound emitting means to output a musical tone signal of the instrument indicated by the instrument information not included in the assignment information among the instrument information specified in step 10 (in accordance with the assignment information). Output the musical tone signal of the instrument indicated by the instrument information not included to the sound emitting means. Step 15). Based on the processing in steps 14 and 15, musical instrument sounds based on each musical tone signal are emitted from the speaker 20 of the karaoke apparatus K and the mobile terminals M1 to M3.

The karaoke apparatus K repeatedly performs the processing of steps 14 and 15 until the karaoke performance of the song X ends (until Y in step 16).

As is clear from the above, the karaoke apparatus K according to this embodiment can communicate with a mobile terminal owned by a user. The karaoke device K includes an identification unit 100 that identifies instrument information indicating the instrument used to perform the selected song based on the performance data of the selected song, and a mobile phone in the room where the karaoke device K is installed. an acquisition unit 200 that acquires first location information indicating the location of the terminal; a generation unit 300 that generates assignment information that associates the mobile terminal corresponding to the acquired first location information with the specified musical instrument information; , a sound source control unit 400 that controls a sound source 14a that generates a musical sound signal for each instrument based on performance data of a song and outputs it independently for each instrument, the musical sound of the instrument indicated by the instrument information included in the assignment information. A sound source control unit 400 that causes a signal to be transmitted to a mobile terminal associated with the musical instrument information, and that causes the sound emitting means to output a musical tone signal of the instrument indicated by the musical instrument information that is not included in the assignment information among the specified musical instrument information. and has.

According to such a karaoke apparatus K, some of the plurality of musical instrument sounds constituting a karaoke performance can be emitted from a mobile terminal placed in a room. Therefore, compared to the case where a plurality of musical instrument sounds are emitted all at once from the speakers of the karaoke device, the user can listen to the karaoke performance with the feeling of actually playing a musical instrument. That is, according to the karaoke apparatus K according to the present embodiment, it is possible to perform a karaoke performance with a sense of presence like a live performance.

Further, the generation unit 300 according to the present embodiment can generate assignment information based on the acquired first position information and second position information indicating the position of the sound emitting means. By using the assignment information generated in consideration of the positional relationship with the sound emitting means provided in the karaoke apparatus K in this way, it is possible to perform a karaoke performance with a more realistic feeling.

Further, the sound source control unit 400 according to the present embodiment delays the musical tone signal of the musical instrument indicated by the musical instrument information not included in the assignment information by a predetermined period of time from the transmission of the musical tone signal of the musical instrument indicated by the musical instrument information included in the assignment information. It can be outputted to the sound emitting means. According to such karaoke apparatus K, it is possible to perform karaoke with a sense of realism without being affected by delays peculiar to digital communication.

<Modification 1>
Generation of assignment information is not limited to the example of the above embodiment.

In this modification, the specifying unit 100 further specifies the localization designation information based on the performance data of the selected song. The localization designation information indicates the optimal position at which the musical instrument indicated by the musical instrument information is placed. The localization designation information is set for each channel, and is included in the music performance data together with the timbre designation information. That is, the localization designation information is set for each musical instrument. Furthermore, the localization designation information is set to any value from 0 to 127, with 0 at the left end, 64 at the center, and 127 at the right end, and the optimal value is set for each song. FIG. 7 is a diagram showing the correspondence between localization designation information and instrument information in song X.

Further, the localization designation information can be indicated as an X coordinate value in a certain space (for example, a karaoke room). In the karaoke room R, when the localization designation information is expressed as a numerical value from 0 to 127, the position of the left speaker 20a is set to "X=0", and the center (position corresponding to the center line CL in FIG. 4) is set to "X=64". ”, and the position of the right speaker 20b can be set to “X=127” (see FIG. 8). In this case, each musical instrument can set any value from 0 to 127 as localization designation information.

The specifying unit 100 outputs the specified localization designation information to the generating unit 300 together with the specified musical instrument information. For example, in the example of FIG. 7, the specifying unit 100 associates the localization designation information “X=80” with the musical instrument information “guitar” and outputs it to the generating unit 300.

On the other hand, in this modification, the generation unit 300 generates assignment information based on the acquired first position information and the specified localization designation information.

For example, assume that the specifying unit 100 outputs six types of musical instrument information and localization designation information, and the acquiring unit 200 outputs position information for each of the mobile terminals M1 to M3. Note that the position information here is assumed to be indicated as the value of the X coordinate in the karaoke room R. Specifically, assume that the location information of mobile terminal M1 is "X = 32," the location information of mobile terminal M2 is "X = 74," and the location information of mobile terminal M3 is "X = 106." (See Figure 8).

In this case, the generation unit 300 compares the acquired location information of each mobile terminal with the localization designation information, and determines the localization designation information closest to each location information. The generation unit 300 then generates assignment information based on the musical instrument information linked to the determined localization designation information. For example, the generation unit 300 determines the localization designation information “X=32” that matches the location information “X=32” of the mobile terminal M1, and specifies the musical instrument information “Bass” that is linked to the localization designation information. do. The generation unit 300 generates assignment information A4 that associates the musical instrument information "bass" with the mobile terminal M1. Similarly, the generation unit 300 determines the localization designation information “X=80” that is closest to the location information “X=74” of the mobile terminal M2, and generates the musical instrument information “guitar” linked to the localization designation information. Identify. The generation unit 300 generates assignment information A5 that associates the musical instrument information "guitar" with the mobile terminal M2. Furthermore, the generation unit 300 determines the localization designation information "112" that is closest to the location information "106" of the mobile terminal M3, and specifies the musical instrument information "saxophone" that is linked to the localization designation information. The generation unit 300 generates assignment information A6 that associates the musical instrument information "saxophone" with the mobile terminal M3. The generation section 300 outputs the generated assignment information to the sound source control section 400.

In this way, in the karaoke apparatus K according to the present modification, the specifying unit 100 further specifies localization designation information indicating the optimal position at which the instrument indicated by the musical instrument information is placed, based on the performance data of the selected song. . The generation unit 300 generates assignment information based on the acquired first position information and the specified localization designation information. According to such a karaoke apparatus K, by emitting the sound of the musical instrument based on the optimal position where the musical instrument is placed, it is possible to perform a karaoke performance with a more realistic feeling.

<Modification 2>
Furthermore, instead of generating the assignment information based on the first location information and the second location information, the assignment information is generated based on the first location information and the location information of the user (i.e., the singer) who performs karaoke singing. May be generated.

Specifically, the generation unit 300 specifies the singer's position by analyzing the video photographed by the photographing means 60 using a known method, and calculates the relationship between the singer's position and the position of each mobile terminal. Find the distance.

Further, in the case of this example, the storage unit 13 stores an assignment table in which optimal instrument information is set in order of proximity to the singer.

The generation unit 300 refers to the assignment table in order of location information that is closest to the singer, and associates musical instrument information with each mobile terminal (specifically, the terminal identification information of each mobile terminal).

According to such karaoke device K, it is possible to emit musical instrument sounds that are preferably emitted near the singer from the mobile terminal.

<Second embodiment>
Next, with reference to FIG. 9, a karaoke apparatus according to a second embodiment will be described. In this embodiment, an example will be described in which the emitted musical instrument sound is adjusted in accordance with the operation of the mobile terminal by the user. Description of the same configuration as in the first embodiment will be omitted.

[Sound source control section]
When the sound source control unit 400 according to the present embodiment receives an adjustment signal for adjusting the musical tone signal output from the sound source 14a from one mobile terminal, the sound source control unit 400 controls the musical tone signal transmitted to the one mobile terminal. The sound source 14a is controlled to be adjusted based on the adjustment signal.

In this embodiment, by running a dedicated application on each mobile terminal, the user can adjust the musical instrument sounds that are emitted.

For example, suppose a user picks up a mobile device with a dedicated application running on it. In this case, the mobile terminal determines the raised height, and transmits a volume control signal corresponding to the determined height to the karaoke apparatus K in association with the terminal identification information. For example, assume that the user lifts the mobile terminal 10 cm. In this case, the mobile terminal transmits a volume control signal that increases the volume by 10%.

Further, assume that the user touches the display screen of the mobile terminal while the dedicated application is running. In this case, the mobile terminal detects the position and number of fingers touching the display screen, and sends an effect control signal corresponding to the position and number of fingers to the karaoke apparatus K in association with the terminal identification information. For example, suppose a user wants to apply distortion as an effect. In this case, the user selects an icon portion corresponding to distortion on the display screen of the mobile terminal. At this time, the intensity (depth) of the distortion can be adjusted depending on the number of fingers placed on the icon area. For example, when the icon portion is touched with two fingers, the mobile terminal transmits an effect control signal that applies distortion of the second lowest intensity among five levels.

Alternatively, suppose that the user shakes the mobile terminal running the dedicated application from side to side. In this case, the mobile terminal detects the cycle based on the shaking motion, and transmits a vibrato control signal corresponding to the cycle to the karaoke apparatus K in association with the terminal identification information. For example, assume that the user is shaking the mobile terminal at a frequency f. In this case, the mobile terminal transmits a vibrato control signal that provides vibrato with period f.

Note that the volume control signal, effect control signal, and vibrato control signal are examples of "adjustment signals."

Here, the mobile terminal M1 transmits a volume control signal to increase the volume by 10%, and the mobile terminal M2 transmits an effect control signal to apply distortion of the second lowest intensity among the five levels. Assume that a vibrato control signal that provides a vibrato with a period f is transmitted from M3.

In this case, the sound source control section 400 refers to the assignment information A1 described in the first embodiment, and when transmitting the musical tone signal corresponding to the musical instrument information "guitar" to the mobile terminal M2, the sound source control section 400 applies distortion based on the effect control signal. The sound source 14a is controlled to provide the following.

Similarly, the sound source control section 400 refers to the assignment information A2, and when transmitting the musical tone signal corresponding to the musical instrument information "Bass" to the mobile terminal M1, the sound source control section 400 instructs the mobile terminal M1 to increase the volume by 10% based on the volume control signal. Controls the sound source 14a. Further, the sound source control unit 400 refers to the assignment information A3, and when transmitting a musical tone signal corresponding to the musical instrument information "saxophone" to the mobile terminal M3, the sound source control unit 400 is configured to apply vibrato at a period f based on the vibrato control signal. Controls the sound source 14a.

As a result, mobile terminal M1 emits a "bass" musical instrument sound with a higher volume than usual, mobile terminal M2 emits a "guitar" instrumental sound with a distortion effect, and mobile terminal M3 emits a "guitar" musical instrument sound with a distortion effect. The sound of a ``saxophone'' instrument with vibrato is emitted.

==About processing in karaoke equipment==
Next, a specific example of processing in the karaoke apparatus K according to this embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing an example of processing in the karaoke apparatus K. In this example, assume that user U1 selects song X in the situation shown in FIG. It is also assumed that pairing between the mobile terminal owned by each user and the karaoke device K has been completed.

Steps 20 to 23 are similar to steps 10 to 13 of the first embodiment.

After step 23, if an adjustment signal for adjusting the musical tone signal output from the sound source 14a is received from one mobile terminal (Y in step 24), the sound source control unit 400 transmits the adjustment signal to the one mobile terminal. The sound source 14a is controlled to adjust the transmitted musical tone signal based on the adjustment signal. The sound source control unit 400 controls the sound source 14a and causes the musical tone signal adjusted based on the adjustment signal to be transmitted to the mobile terminal associated with the musical instrument information (sends the adjusted musical tone signal to the mobile terminal. Step 25 ).

On the other hand, if the adjustment signal for adjusting the musical tone signal output from the sound source 14a is not received from any mobile terminal (N in step 24), the sound source control section 400 controls the sound source 14a, The musical tone signal of the musical instrument indicated by the musical instrument information included in the assignment information is transmitted to the mobile terminal associated with the musical instrument information (musical tone signal is transmitted to each mobile terminal. Step 26). Note that in step 25, the same process as step 26 is executed for mobile terminals other than the mobile terminal that transmitted the adjustment signal.

Furthermore, the sound source control section 400 controls the sound source 14a to cause the sound emitting means to output a musical tone signal of the instrument indicated by the instrument information not included in the assignment information among the instrument information specified in step 20 (in accordance with the assignment information). The musical tone signal of the instrument indicated by the instrument information not included is output to the sound emitting means. Step 27). Based on the process in step 25 or 26 and the process in step 27, the speaker 20 of the karaoke apparatus K and the mobile terminals M1 to M3 emit musical instrument sounds based on each musical tone signal.

The karaoke apparatus K repeatedly performs the processes from step 24 to step 27 until the karaoke performance of the song X ends (until Y in step 28).

As is clear from the above, in the karaoke apparatus K according to the present embodiment, when the sound source control unit 400 receives an adjustment signal for adjusting the musical tone signal output from the sound source 14a from one mobile terminal, the sound source control unit 400 The sound source 14a is controlled to adjust the musical tone signal transmitted to the mobile terminal based on the adjustment signal.

According to such karaoke device K, the user can change the emitted musical instrument sound by operating the mobile terminal. Therefore, the user can enjoy the feeling of participating in a live performance.

<Others>
The above embodiments are presented as examples and do not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, substitutions, and changes can be made without departing from the gist of the invention. The above-described embodiments and their modifications are included within the scope and gist of the invention as well as within the scope of the invention described in the claims and its equivalents.

100 identification unit 200 acquisition unit 300 generation unit 400 sound source control unit K karaoke device

Claims (5)

A karaoke device that can communicate with a mobile terminal owned by a user,
an identification unit that identifies instrument information indicating an instrument used to perform the selected song based on the performance data of the selected song;
an acquisition unit that acquires first position information indicating a position of the mobile terminal in a room where the karaoke device is installed;
a generation unit that generates assignment information that associates a mobile terminal corresponding to the acquired first location information with the specified musical instrument information;
A sound source control unit that generates a musical sound signal for each instrument based on performance data of a song and controls a sound source that outputs independently for each instrument, the sound source control unit generating a musical sound signal of the instrument indicated by the instrument information included in the assignment information. a sound source control unit that causes a mobile terminal associated with the musical instrument information to transmit the musical sound signal and outputs, to a sound emitting means, a musical tone signal of an instrument indicated by musical instrument information that is not included in the assignment information among the specified musical instrument information; ,
A karaoke machine with The sound source control section outputs the musical tone signal of the musical instrument indicated by the musical instrument information not included in the assignment information to the sound emitting means after delaying the musical tone signal of the instrument indicated by the instrument information included in the assignment information by a predetermined time. The karaoke apparatus according to claim 1, characterized in that: 3. The generating unit generates the assignment information based on the acquired first position information and second position information indicating the position of the sound emitting means. Karaoke equipment. The specifying unit further specifies localization designation information indicating an optimal position at which the instrument indicated by the instrument information is placed, based on the performance data of the selected song,
The karaoke apparatus according to claim 1 or 2, wherein the generation unit generates the assignment information based on the acquired first position information and the specified localization designation information. When the sound source control section receives an adjustment signal for adjusting a musical tone signal output from the sound source from one mobile terminal, the sound source control section adjusts the musical tone signal to be transmitted to the one mobile terminal based on the adjustment signal. The karaoke apparatus according to any one of claims 1 to 4, characterized in that the sound source is controlled to adjust the sound source.

Images