JP2013047746A - Karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enhance satisfaction when reproducing posted data from a user by a karaoke device.SOLUTION: A voice control unit 13 included in a karaoke device includes: a monaural/stereo conversion unit 13a which converts an external input sound (microphone) inputted as a monaural sound source signal and posted data to a stereo sound source signal and distributes sound source signals of respective channels by left and right channels to output them; and a synthesizing unit 13b which mixes multichannel sound source signals outputted from the monaural/stereo conversion unit 13a for each of the left and right channels and outputs them to left and right speakers 23a and 23b. The voice control unit 13 selectively executes operation (a) of converting the external input sound and posted data from the monaural sound source signals to the stereo sound source signal and outputting the stereo sound source signal and operation (b) of outputting the external input sound and posted data as the monaural sound source signals, in accordance with conditions indicated by various flags such as a posting reproduction flag associated with posted data and an external output flag set on the basis of features of a musical piece or a performance mode.

Description

  The present invention relates to a karaoke apparatus for reproducing post data including recorded data of singing sounds and performance sounds posted in an online karaoke system.

  Conventionally, as a service form of the online karaoke system, posted data including sound source data and video data of singing sounds and musical instrument performance sounds by the user is posted to the server of the online karaoke system, and each user posted on the server A service for reproducing data with a karaoke device has been proposed (see Patent Document 1). In such a posting system, the appearance of a singer or musical instrument player imaged with a camera provided in the karaoke apparatus is recorded. Moreover, the singing sound and performance sound which were input with the microphone with which karaoke apparatus is equipped are recorded. These recorded or recorded data are uploaded as post data to the server of the communication karaoke system. The uploaded post data can be reproduced via the Internet by a karaoke apparatus connected to the communication karaoke system, a terminal such as a personal computer or a mobile phone.

  In addition, when playing post data on a karaoke device connected to the online karaoke system, the singing sound or performance sound output from the playback of the post data is output simultaneously with another singing sound or performance sound input with the microphone provided in the karaoke device. Are output at the same time. In addition, a plurality of different pieces of post data singing or playing the same music are simultaneously output. As a result, a service that allows users to enjoy collaboration with others who are not there has been proposed.

JP 2011-53541 A

  Generally, a karaoke apparatus installed in a commercial facility such as a karaoke box is equipped with two left and right speakers. Therefore, when reproducing the data of the karaoke music produced by the stereo sound source of two left and right channels, different sounds are output from the left and right speakers, respectively, so that karaoke performance with a sense of reality can be enjoyed.

  However, the input data of the microphone provided in the karaoke device, the post data recording the singing sound and the performance sound are created as a monaural sound source, and even if two stereo left and right speakers are provided, the speaker output Sometimes the same sound is output from both the left and right speakers. Also, when collaborating with input sounds from a plurality of microphones or posting data, a plurality of external input sounds are all mixed and the same sound is output from both speakers.

  On the other hand, if the karaoke device is equipped with a plurality of speakers, there is a demand for listening to sound with a sense of presence by outputting different sounds from each speaker for sound sources such as post data and microphone input sound. There is a demand from users who want to listen to a sound with a sense of unity by outputting a sound that is intentionally synthesized from a plurality of sound sources. However, a technology capable of meeting such a request has not been realized so far, and the user's request could not be met.

  The present invention has been made in order to solve the above-described problems. When post data recorded with a single-channel sound source is played back on a karaoke apparatus, a speaker output is made as a single-channel sound source, or a plurality of channels are output. It is an object of the present invention to increase user satisfaction by making it possible to select whether to output a speaker as a sound source according to conditions.

  The karaoke apparatus of the present invention made to achieve the above object is characterized by comprising post data acquisition means, post reproduction setting acquisition means, post reproduction determination means, and audio output control means.

  The post data acquisition means acquires post data that is recorded as a single channel sound source signal by a user of the communication karaoke system and is uploaded in the communication karaoke system. The post reproduction setting acquisition means acquires post reproduction setting information indicating whether the post data acquired by the post data acquisition means is reproduced on a single channel or on a predetermined plurality of channels. The posting reproduction determining means determines whether to reproduce the posting data on a single channel or on a predetermined plurality of channels based on the posting reproduction setting information acquired by the posting reproduction setting acquisition means.

  Then, the audio output control means converts the single-channel sound source signal in the post data into the multi-channel sound source signal when the post reproduction judgment means judges that the reproduction is performed on the plurality of channels, and converts the converted sound source signal into a plurality of sound source signals. Output from a plurality of predetermined speakers corresponding to the channels. On the other hand, when it is determined to reproduce with a single channel, a single-channel sound source signal in the posted data is output as the same sound from a plurality of speakers.

  According to such a configuration, according to arbitrary contents in the acquired post reproduction setting information, the reproduction sound of the post data is output from the speaker as a single channel, or is converted into a sound source signal of a plurality of channels and the plural speakers are converted. Can be switched. In addition, the output in a plurality of channels here is, for example, a stereo output in which speakers are divided into two left and right systems, a surround output having more channels than stereo, and the like. Further, the output on a single channel is a monaural output that outputs a reproduction sound consisting of a single signal source regardless of whether the speaker is single or plural.

  According to the present invention, when reproducing posted data, different sound is output from each speaker with a sound source signal of a plurality of channels to listen to a realistic sound, or the sound is output from each speaker in the same way with a sound source signal of a single channel. It is possible to respond to requests from users who want to listen to sounds with a sense of unity.

  It is also possible to perform control such that a reproduced sound of the posted data is output only from a specific speaker by muting (muting) one of the sound source signals converted into a plurality of channels. In this way, it is possible to obtain an effect that the user can easily hear a specific sound source. In addition, it may be configured such that the user can specify from which speaker the reproduced sound of the posted data is output.

  By the way, it can be considered that the specific acquisition destination of the post reproduction setting information is as described in claim 2. In other words, the posting reproduction setting information is set with an output method indicating whether the posting data is reproduced on a single channel or a predetermined plurality of channels when the posting data is posted. Post reproduction setting information and post data are associated with each other. Then, the posting reproduction setting acquisition unit acquires the posting reproduction setting information associated with the posting data acquired by the posting data acquisition unit. With this configuration, it is possible to output a playback sound based on the posted data on the playback side in an output format that reflects the intention of the poster.

  Further, when posting data is reproduced in the karaoke device, simultaneously with the output of the reproduction sound of the posting data, the external input sound such as another singing sound or performance sound input with the microphone provided in the karaoke device can be output simultaneously. Conceivable. At that time, as with the output of the playback sound of the posted data, external input sound can be output from the speaker with a single channel depending on the conditions, or converted to a sound source signal of multiple channels and output from multiple speakers. It is good to configure so that it can.

  Therefore, it is conceivable to configure as described in claim 3. That is, the karaoke apparatus is configured to acquire an external input sound acquisition means for acquiring an external input sound consisting of a user's singing sound or musical instrument performance sound as a single channel sound source signal, and a reproduction sound based on the external input sound source signal. External output setting acquisition means for acquiring external output setting information indicating whether to output in one channel or a predetermined plurality of channels, and based on the external output setting information acquired by the external output setting acquisition means, External output determination means for determining whether to output a speaker output of an external input sound that is performed in parallel with reproduction on a single channel or on a plurality of channels is further provided.

  When the external output determination means determines that the external input sound is to be output in a plurality of channels, the audio output control means outputs the single-channel sound source signal in the external input sound acquired in parallel with the post data reproduction process. The sound source signal is converted into a plurality of channels, and the converted sound source signal is output together with the reproduced sound of the posted data from a plurality of speakers corresponding to the plurality of channels. On the other hand, if it is determined that the external input sound is to be played back on a single channel, the single-channel sound source signal in the external input sound acquired in parallel with the post data playback processing is posted as the same sound from multiple speakers. Output along with data playback sound.

  According to such a configuration, the external input sound that is output simultaneously with the post data can be output from the speaker as a single channel according to any content in the acquired external output setting information, Conversion to a sound source signal of a channel and output from a plurality of speakers can be selected. As a result, in the simultaneous output of posted data and external input sound, you can output different sounds from each speaker with multi-channel sound source signals and listen to realistic sounds, or the same from each speaker with single-channel sound source signals It is possible to respond to the demands of users who want to listen to sound with a sense of unity by outputting sound.

  Also, mute any sound source signal in post data converted to multiple channels or external input sound, so that post data playback sound or external input sound is output from a specific speaker only. It is also possible to control such that the reproduction sound of the posted data and the external input sound are distributed to different speakers and output. In this way, it is possible to obtain an effect that the user can easily hear a specific sound source from post data and external input sound that are output at the same time, or the realism is increased. In addition, it may be configured such that the user can specify which sound source is output from which speaker.

  By the way, regarding a specific setting method and acquisition of the external output setting information, it can be considered as described in claim 4. In other words, the karaoke apparatus is a singer or performance that is predetermined in the music played by the music performance performed by the music performance means of the karaoke apparatus in parallel with the reproduction of the posted data by the audio output control means and the output of the external input sound. At least one of the conditions regarding the number of persons, the conditions regarding whether the music is a song for singing or a musical instrument performance, or the conditions regarding whether a specific operation mode is specified for the performance of the music In accordance with the above condition, the external output setting information further includes an external output setting means for setting an output method indicating whether the external input sound is output by a single channel or a predetermined plurality of channels. The external output setting acquisition unit acquires the external output setting information set by the external output setting unit.

  By configuring in this way, for example, the number of people who participate in singing or performance, whether it is a song or performance song, or whether a specific mode such as practice mode or live (production) mode is specified The contents of the external output setting information can be set with contents reflecting the user's intention. Then, it is possible to output post data reproduction sound and external input sound in the output format from the speaker indicated by the external output setting information.

  Furthermore, it is conceivable that an external input sound such as a singing sound or a performance sound by a user is recorded and uploaded to a predetermined posting server or the like in the communication karaoke system as posting data. At this time, it is preferable that the posting side can set in advance whether the posted data is to be output in a single channel or a plurality of channels when reproduced.

  Therefore, it is conceivable to configure as described in claim 5. That is, the karaoke apparatus is a recording means for generating the recording data of the external input sound composed of the sound source signal of the single channel acquired by the external input sound acquisition means, or the recording data generated by the recording means is reproduced on a single channel, Recording setting acquisition means for acquiring recording setting information indicating whether or not to reproduce on a plurality of predetermined channels, post data in posting reproduction setting information to be added to recording data based on the recording setting information acquired by the recording setting acquisition means Post playback setting means for setting an output method indicating whether to play back a single channel or a predetermined multiple channels, and recording data and a post corresponding to the recording data set by the post playback setting means Upload post data including playback setting information to a predetermined post server in the online karaoke system Further comprising a post means.

  According to such a configuration, the playback sound based on the recording data is output from the speaker as a single channel or converted into a sound source signal of a plurality of channels from a plurality of speakers according to any content of the acquired recording setting information. The output can be specified by the contributor.

  Further, a specific setting method and acquisition of the recording setting information can be considered as described in claim 6. In other words, the karaoke apparatus is a singer or performance that is predetermined in the music played by the music performance performed by the music performance means of the karaoke apparatus in parallel with the reproduction of the posted data by the audio output control means and the output of the external input sound. At least one of a condition regarding the number of persons who perform the music, a condition regarding whether the music is a song for singing or a musical instrument performance, or a condition regarding whether a predetermined operation mode is specified for the performance of the music In accordance with the above conditions, the recording setting information further includes recording setting means for setting an output method indicating whether the recording data is reproduced on a single channel or on a predetermined plurality of channels. The recording setting acquisition unit acquires the recording setting information set by the recording setting unit.

  By configuring in this way, for example, the number of people who participate in singing or performance, whether it is a song or performance song, or whether a specific mode such as practice mode or live (production) mode is specified In, the contents of the recording setting information can be set with contents reflecting the intention of the poster. Then, the posting data can be uploaded by adding the posting reproduction setting information to the posting data in the output format from the speaker indicated by the recording setting information.

It is a block diagram which shows schematic structure of a karaoke system. 3 is an explanatory diagram showing a functional configuration of a voice control unit 13. FIG. It is a flowchart which shows the procedure of an audio | voice output control process. It is a flowchart which shows the procedure of an audio | voice output control process.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In addition, this invention is not limited to the following embodiment at all, and can be implemented in various aspects.
[Description of configuration of karaoke system 1]
As shown in FIG. 1, the karaoke system 1 includes a karaoke device 10 installed in a karaoke store such as a karaoke box, and an external karaoke server 30. The karaoke apparatus 10 is connected to a karaoke box LAN (hereinafter simply referred to as “LAN”) 40. The LAN 40 is connected to the router 50. Thereby, the karaoke apparatus 10 can perform data communication with the karaoke server 30 via the LAN 40 and the router 50 via the Internet 60.

  The karaoke apparatus 10 is mainly configured of a control unit 11 that controls the entire apparatus. The control unit 11 is an information processing device mainly composed of a CPU, ROM, RAM, I / O, and the like, and executes various processes based on programs and data read from the HDD 19. The control unit 11 is connected to the bus line 12, and the audio control unit 13 is connected to the control unit 11.

  An operation processing unit 14, an image input unit 15, an interface unit 16, a video RAM 17, a video reproduction unit 18, and a hard disk drive (HDD) 19 are connected to the bus line 12. The audio control unit 13 is connected with two microphones 20a and 20b, a MIDI sound source 22, and two left and right speakers 23 (left speaker 23a and right speaker 23b) corresponding to stereo output.

  The operation processing unit 14 processes a signal from the operation unit 14a. From the operation unit 14a, information such as a music number for specifying music data to be played, a performance speed of the music data, and a performance key is input by the user. The operation unit 14a is embodied as, for example, a remote controller that performs wireless communication with the apparatus main body. A camera 15 a is connected to the image input unit 15. The camera 15a is installed in a room in which the karaoke apparatus 10 is installed, and can shoot a karaoke singer or a musical instrument player. A signal from the camera 15 a is processed by the image input unit 15, and the processed video signal is output through the bus line 12. The interface unit 16 is configured to connect the karaoke apparatus 10 to the LAN 40. Thereby, as described above, data communication with the karaoke server 30 via the Internet 60 becomes possible.

  The video RAM 17 temporarily stores video information. The video RAM 17 is also connected to the video reproduction unit 18. The video playback unit 18 plays back video based on video information from the video RAM 17 and video data transmitted via the bus line 12. The video played by the video playback unit 18 includes a background and lyrics image displayed together with the karaoke performance, a video of the user's posted video downloaded from the karaoke server 30, and the like. A video control unit 24 is connected to the video playback unit 18. A display unit 25 is connected to the video control unit 24. The display unit 25 is embodied as a monitor device. With this configuration, the video control unit 24 can display the video output from the video playback unit 18 on the display unit 25.

  The HDD 19 is a so-called hard disk drive device, and is used for reproducing a karaoke database in which a large number of karaoke music data distributed from the karaoke server 30 are recorded, a system program or application program for controlling the operation of the karaoke device 10, and various information contents. Various data such as used data are stored. The HDD 19 stores post data acquired from the karaoke server 30.

  Next, a configuration connected to the voice control unit 13 will be described. The two microphones 20a and 20b are input devices for inputting a karaoke singing sound or musical instrument performance sound by a user as a single channel (monaural) signal. The MIDI sound source 22 generates musical sounds based on MIDI (Musical Instrument Digital Interface) data. The music data stored in the HDD 19 described above includes MIDI data for generating musical sounds, information for determining the number of people who sing and perform, and the like. The left and right speakers 23a and 23b change the sound source signal output from the sound control unit 13 into sound and output the sound.

  The sound control unit 13 converts the music data stored in the HDD 19 into a sound source signal via the MIDI sound source 22, and externally input sound from the microphones 20 a and 20 b and post data input through the control unit 11. It converts into a sound source signal and outputs those sound source signals to the left and right speakers 23a, 23b. Also, the external input sound from the microphones 20a and 20b is digitized and recorded as a single channel monaural sound source signal.

  The audio control unit 13 individually outputs the stereo sound source signals composed of the left and right channels to the left and right speakers 23a and 23b. Also, a monaural sound source signal composed of a single channel is output to the left and right speakers 23a and 23b as the same sound. Furthermore, in the reproduction of music data and the output of external input sound (singing sound / performance sound) and the reproduction of post data performed in parallel therewith, from the microphones 20a and 20b according to specific conditions indicated by flags and the like. The external sound input and the monaural sound source signal of the posted data are converted into a stereo sound source signal, and the converted stereo sound source signal is distributed to the left and right speakers 23a and 23b for output (detailed procedures will be described later). A well-known technique can be used as a method for converting a monaural sound source signal into a stereo sound source signal.

  Next, the configuration of the karaoke server 30 will be described. The karaoke server 30 is a known server device and constitutes a computer system. The karaoke server 30 mainly distributes music data to a plurality of karaoke apparatuses 10. In this example, the karaoke server 30 has a database 31 and uploads the database 31 to the database 31 from a plurality of karaoke apparatuses 10 through a communication network. The posted video data (posted data) is accumulated. This posting data is made up of data that records video and audio of a user who sang or performed using the karaoke apparatus 10.

  The post data is associated with the music information and the post reproduction flag. The music information is information that can specify the music, and can be searched based on the music information. The music information may be a music number or a music title, or may include a singer's name for convenience of search. The post reproduction flag is information for designating whether to reproduce the sound in monaural or stereo when reproducing the post data.

  Such post data and associated information are created when the karaoke apparatus 10 performs a musical performance. For example, the post data is created from the user's video input from the camera 15a via the image input unit 15 and the user's singing sound and performance sound input from the microphones 20a and 20b when the music is played. . The music information is the music number and the music title of the music played at this time. Further, the posting reproduction flag associates the content determined based on the specific condition with the posting data before uploading the posting data to the karaoke server 30.

  It is conceivable that the post data created in this way is temporarily stored in the HDD 19 and uploaded to the karaoke server 30 after obtaining the approval of the user related to the creation of the post data. In this way, a sufficient number of post data can be stored in the database 31 of the karaoke server 30. Then, the karaoke apparatus 10 downloads post data selected by the user from the karaoke server 30 through the control unit 11 and the interface unit 16, and reproduces the post data in synchronization with the performance of the music associated with the post data. At the same time, the user's singing sound and performance sound input with the microphone provided in the karaoke apparatus 10 are simultaneously output. Further, the karaoke apparatus 10 can simultaneously reproduce a plurality of different post data corresponding to the same music piece.

[Description of Functional Configuration of Voice Control Unit 13]
Next, a characteristic functional configuration of the voice control unit 13 of the karaoke apparatus 10 will be described with reference to FIG.

  The voice control unit 13 includes a monaural / stereo conversion unit 13a and a synthesis unit 13b. The monaural / stereo conversion unit 13a converts the external input sound and post data from the microphones 20a and 20b input as the monaural sound source signal into a stereo sound source signal, distributes the sound source signal of each channel to the left and right channels, and outputs them. To do. The synthesizing unit 13b mixes the multi-channel sound source signals output from the monaural / stereo conversion unit 13a according to the left and right channels, and outputs them to the left and right speakers 23a and 23b.

  The monaural / stereo conversion unit 13a converts the external input sound and posted data into a stereo sound source signal as described above, and outputs the stereo sound source signal and outputs the monaural sound source signal as they are under the conditions indicated by various flags. It executes selectively according to the control from the control unit 11 based on.

  FIG. 2A is an explanatory diagram schematically illustrating an example in which the monaural / stereo conversion unit 13a converts a monaural sound source signal into a stereo sound source signal. Here, a case is assumed in which the sound source signals of the two external input sounds 1 and 2 and the sound source signals of the two posted data 1 and 2 are reproduced and output simultaneously.

  The monaural / stereo conversion unit 13a converts the monaural sound source signals of the input external input sounds 1 and 2 and the posted data 1 and 2 into a stereo sound source signal of two left and right channels, respectively. At this time, the external input sound 1 is converted into a stereo sound source signal that outputs sound only on the left (L) side, or converted into a stereo sound source signal that outputs sound from both the left and right sides. The right (R) side is muted and output. Conversely, the external input sound 2 is converted into a stereo sound source signal that outputs sound only on the right (R) side, or after being converted into a stereo sound source signal that outputs sound from both the left and right sides. The left (L) side is muted and output. In this way, the output destinations of the stereo sound source signals of each external input sound are set to the left and right speakers 23a so that the output destinations of the stereo sound source signals of the plurality of external input sounds are evenly distributed to the left and right speakers 23a, 24b. , 24b.

  In addition, the post data 1 is converted into a stereo sound source signal that outputs sound only on the left (L) side, or converted to a stereo sound source signal that outputs sound from both the left and right sides, and then the right ( Mute (R) side and output. Conversely, post data 2 is converted into a stereo sound source signal that outputs sound only on the right (R) side, or left after being converted into a stereo sound source signal that outputs sound from both the left and right sides. The (L) side is muted and output. In this way, the output destination of the stereo sound source signal of each piece of post data is distributed to the left and right speakers 23a, 24b so that the output destination of the stereo sound source signal of the plurality of post data is evenly distributed to the left and right speakers 23a, 24b. Allocate to either

  The synthesizer 13b mixes the stereo sound source signal (L side) of the external input sound 1 and the stereo sound source signal (L side) of the posted data 1 and outputs the mixed sound to the left speaker 23a, and also the stereo sound source of the external input sound 2 The signal (R side) and the stereo sound source signal (R side) of the posted data 2 are mixed and output to the right speaker 23b.

  FIG. 2B is an explanatory diagram schematically illustrating an example in which the monaural / stereo conversion unit 13a outputs a monaural sound source signal as it is without converting the monaural sound source signal into a stereo sound source signal. Here, a case is assumed in which two sound source signals of external input sound 1 and post data 1 are reproduced and output simultaneously.

  The external input sound 1 and the monaural sound source signal of the posted data 1 input to the monaural / stereo conversion unit 13a are output as the same sound to the left and right channels, respectively. The synthesizer 13b mixes the monaural sound source signal of the external input sound 1 and post data 1 output to the L side and outputs it to the left speaker 23a, and also outputs the external input sound 1 and post data 1 output to the R side. The monaural sound source signal is mixed and output to the right speaker 23b.

[Description of audio output control processing]
Below, the procedure of the audio | voice output control process which the control part 11 of the karaoke apparatus 10 performs is demonstrated based on the flowchart of FIG. This process is executed when the user selects a musical piece to be played. Further, this process is classified into each stage of pre-reproduction process, mid-reproduction process, and post-reproduction process corresponding to each stage before, during and after the reproduction of the music selected by the user.

(1) Pre-reproduction processing As shown in FIG. 3, the control unit 11 first refers to the attribute data of the performance target music selected by the user, and the music is determined to be sung or performed by a plurality of people. It is determined whether or not (S100). When the musical piece to be played is a musical piece that is sung or played by a plurality of persons (S100: YES), the control unit 11 proceeds to the process of S106 and sets the external output flag to “stereo”. Subsequently, the control unit 11 proceeds to the process of S108, and sets the posted recording flag to “stereo”.

  The external output flag is setting information for designating whether the external input sound from the microphones 20a and 20b is output from the speaker in monaural or from the speaker in stereo, and is held in the memory of the control unit 11 or the like. The The post recording flag is information that specifies whether to set the post reproduction flag to be added to post data generated by recording external input sound from the microphones 20a and 20b to monaural or stereo. Held in the memory of the unit 11.

  On the other hand, when the musical piece to be played is a musical piece that is sung or played alone (S100: NO), the control unit 11 proceeds to the process of S102 and determines whether or not the musical piece is a musical instrument musical piece. When the musical piece to be played is a musical instrument musical piece (S102: YES), the control unit 11 proceeds to the process of S106 and sets the external output flag to “stereo”. Subsequently, the control unit 11 proceeds to the process of S108, and sets the posted recording flag to “stereo”.

  On the other hand, when the musical piece to be played is not an instrument musical piece (S102: NO), the control unit 11 proceeds to the process of S104 and determines whether or not a specific performance mode is designated for the performance of the current musical piece. To do. The performance mode here refers to normal performance for each mode, such as “practice mode” that is a dedicated mode for singing and practicing performance, and “live mode” that enhances the sense of realism in production. This is a function for adding different effects, and the user can select a desired performance mode when playing music.

  When a specific performance mode such as “practice mode” or “live mode” is designated (S104: YES), the control unit 11 proceeds to the process of S106 and sets the external output flag to “stereo”. Subsequently, the control unit 11 proceeds to the process of S108, and sets the posted recording flag to “stereo”. On the other hand, when the specific performance mode is not designated (S104: NO), the control unit 11 proceeds to the process of S110 and sets the external output flag to “monaural”. Subsequently, the control unit 11 proceeds to the process of S112, and sets the posted recording flag to “monaural”.

  Next, in S <b> 114, the control unit 11 determines whether or not to reproduce post data associated with the music in synchronization with the performance of the music specified by the user. The post data is reproduced by the control unit 11 based on data downloaded from the karaoke server 30 in accordance with a selection instruction from the user. When the posted data is to be reproduced (S114: YES), the control unit 11 proceeds to the process of S116, while when the reproduction is not performed (S114: NO), the control unit 11 proceeds to the process of S122.

  In S116, which proceeds when the posted data is played back, the control unit 11 reads the posted playback flags associated with all the posted data to be played back, and sets all of the posted playback flags to “monaural”. It is determined whether or not it has been done. When it is determined that the posting reproduction flag of all the posting data is set to “monaural” (S116: YES), the control unit 11 proceeds to the process of S122, while the posting reproduction flag is set to “stereo”. If it is determined that there is post data that has been posted (S116: NO), the control unit 11 proceeds to the process of S118.

  In S118 that proceeds when there is post data for which the post playback flag is set to “stereo”, the control unit 11 performs monaural / stereo conversion unit 13a for all post data for which the post playback flag is set to “stereo”. To convert a monaural sound source signal to a stereo sound source signal. At this time, the control unit 11 may convert the stereo sound source signal so that sound is output from only one of the left and right channels from the beginning, or the stereo sound source signal so that sound is output from both the left and right sides. After conversion, the sound of unnecessary channels may be muted and output.

  Next, the control unit 11 outputs the stereo sound source signal of each piece of post data so that the output destination of the stereo sound source signal of each post data converted in S118 is evenly distributed to the left and right speakers 23a and 24b. The destination is set (S120). For example, if there is one post data, the control unit 11 sets the output destination to either the left or right. If the posted data is an even number, the control unit 11 assigns the same number of output destinations to the left and right. If there are five pieces of post data, the control unit 11 assigns output destinations such as three on the left side, two on the right side, two on the left side, and three on the right side. Further, it may be configured such that the user can specify which post data to be reproduced from which speaker is output.

  And the control part 11 reproduces | regenerates each posting data of reproduction | regeneration object according to each setting according to the performance start of a music (S122). In other words, the control unit 11 controls the audio control unit 13 so that post data whose posting reproduction flag is monaural is reproduced and output in monaural, and post data whose posting reproduction flag is stereo is reproduced and output in stereo. Further, based on the stereo sound source signal, the control unit 11 controls the audio control unit 13 so as to output to the assigned speaker at the predetermined output destination. Up to this point corresponds to the pre-reproduction process in the audio output control process. The following description refers to FIG. 4 (to S200 in FIG. 4).

(2) Processing during reproduction As shown in FIG. 4, in S200, the control unit 11 determines whether or not there is an external input sound from the microphones 20a and 20b provided in the karaoke apparatus 10 during reproduction of the music. When there is an external input sound (S200: YES), the control unit 11 proceeds to the process of S202, while when there is no external input sound (S200: NO), the control unit 11 proceeds to the process of S212.

  In S202, which proceeds when there is an external input sound, the control unit 11 records the external input sound in data of a predetermined format. Next, in S204, the control unit 11 reads the external output flag set in the pre-reproduction process and determines whether or not the external output flag is set to “stereo”. When the external output flag is set to “stereo” (S204: YES), the control unit 11 proceeds to the process of S206, while when the external output flag is set to “monaural” (S204: NO). The control unit 11 proceeds to the process of S210.

  In S206, which proceeds when the external output flag is set to “stereo”, the control unit 11 converts the monaural sound source signal of each external input sound into a stereo sound source signal through the monaural / stereo conversion unit 13a. At this time, the control unit 11 may convert the stereo sound source signal so that sound is output from only one of the left and right channels from the beginning, or the stereo sound source signal so that sound is output from both the left and right sides. After conversion, the sound of unnecessary channels may be muted and output. Next, the control unit 11 allocates the output destination of each external input sound so that the output destination of the stereo sound source signal of each external input sound converted in S206 is evenly distributed to the left and right speakers 23a and 24b. And output through the voice control unit 13 (S208). For example, if there is one external input sound, the control unit 11 assigns the output destination of the stereo sound source signal to either the left or right and outputs it. If there are two external input sounds, the control unit 11 assigns and outputs the output destinations of these stereo sound source signals one by one to the left and right. Also, the karaoke apparatus 10 may be configured so that the user can specify which microphone's external input sound is output from which speaker.

  On the other hand, in S <b> 210, which proceeds when the external output flag is set to “monaural”, the control unit 11 outputs the external input sound as the same sound from all the speakers through the audio control unit 13. Next, in S212, the control unit 11 determines whether or not the music performance has ended. When the performance of the music has not ended (S212: NO), the control unit 11 returns to the process of S200, whereas when the performance of the music has ended (S212: YES), the control unit 11 proceeds to the process of S214. . The process so far corresponds to the process during reproduction in the audio output control process.

(3) Post-reproduction processing In S214, which is performed when the performance is completed, the control unit 11 determines whether there is recording data in which the external input sound is recorded in the current performance. When there is recorded data (S214: YES), the control unit 11 proceeds to the process of S216, whereas when there is no recorded data (S214: NO), the control unit 11 ends this process. In S216, which proceeds when there is recorded data, the control unit 11 reads the posted recording flag set in the pre-reproduction process and determines whether the posted recording flag is set to "stereo". When the posted recording flag is set to “stereo” (S216: YES), the control unit 11 proceeds to the process of S218, and sets the recording / playback flag associated with the current recording data to “stereo”. On the other hand, when the posted recording flag is set to “monaural” (S216: NO), the control unit 11 proceeds to the process of S220, and sets the recording / reproducing flag associated with the current recording data to “monaural”.

  Then, the control unit 11 associates the post data including the current recording data and the video data captured by the camera 15a, the music information of the music played this time, and the post reproduction flag set in S218 or S220 with the karaoke. Uploading to the server 30 (S222), the process ends.

[Correspondence between Configuration of Embodiment and Configuration described in Claims]
Correspondence between each configuration of the karaoke apparatus 10 of the embodiment and the configuration described in the claims is as follows. The control unit 11 according to the embodiment includes a posting reproduction setting acquisition unit, a posting reproduction determination unit, an external output setting acquisition unit, an external output determination unit, an external output setting unit, a recording setting acquisition unit, a recording setting unit, and This corresponds to post reproduction setting means. The control unit 11 and the interface unit 16 correspond to a post data acquisition unit and a post unit. The voice control unit 13 corresponds to voice output control means, external input sound acquisition means, and recording means.

[effect]
According to the karaoke apparatus 10 of the embodiment, the following effects can be obtained.
Depending on the content of the post reproduction flag associated with the post data distributed from the karaoke server 30, the reproduced sound of the post data is output as a monaural sound source signal or converted into a stereo sound source signal and the left and right speakers 23a, 23b can be output separately. Further, according to the content of the external output flag set in accordance with the type of performance music and the performance mode, the external input sound from the microphones 20a and 20b input simultaneously with the reproduction of the posted data is output as a monaural sound source signal. Or converted into a stereo sound source signal and output separately from the left and right speakers 23a, 23b.

  This makes it possible to output different sounds from each speaker with stereo sound source signals in the playback output of post data and external input sound, to listen to sounds with a sense of presence, or to output sound from each speaker in the same way with monaural sound source signals. It is possible to respond to the user's request to hear a sound with a sense of unity.

  Further, by muting one of the left and right channels of the sound source signal converted into stereo, it is possible to output the reproduced sound of the posted data and the external input sound from only a specific speaker. By doing in this way, the effect that it becomes easy for a user to hear a specific sound source is also acquired.

  Regarding the setting of the post play flag, when post data is posted, the post play flag indicating whether the post data is played back in monaural or stereo is associated with the post data. Thus, the playback sound based on the posted data can be output on the playback side in an output format reflecting the intention of the poster.

  Regarding the setting of the external output flag, it depends on the number of people participating in the singing and performance, whether it is a song or performance, or whether a performance mode such as practice mode or live (production) mode is specified. By selecting stereo or monaural, the contents of the external output flag can be set reflecting the intention of the user who selected the music or performance mode.

  Depending on the content of the post recording flag set according to the type of performance music and the performance mode, select whether the post data generated by recording the external input sound is played back in monaural or converted to stereo. Then, it can be posted in association with the posting data as a posting reproduction flag. This post recording flag is set based on the number of people who participate in singing and performance, whether it is a song or performance, or whether a performance mode such as practice mode or live (production) mode is specified. By selecting stereo or monaural accordingly, the content of the posted recording flag can be set reflecting the intention of the user who selected the music or performance mode.

[Modification]
As mentioned above, although embodiment of this invention was described, this invention is not limited to said embodiment at all, It is possible to implement in various aspects.

  In the karaoke apparatus 10 of the above-described embodiment, an example in which an external input sound from a microphone or a monaural sound source signal of posted data is converted into a left and right channel stereo sound source signal has been described. On the other hand, it may be configured to convert the sound source signal into a plurality of channels of two or more channels corresponding to 4-channel stereo having more channels than stereo or surround output.

  Further, in the above embodiment, the external input sound from the microphone and the post data converted into the stereo sound source signal are configured to control to output the sound only on the right or left channel, You may make it the structure which controls so that a sound converted into a threo sound source signal may be output from both the left and right channels, respectively.

  DESCRIPTION OF SYMBOLS 1 ... Karaoke system, 10 ... Karaoke apparatus, 11 ... Control part, 12 ... Bus line, 13 ... Voice control part, 13a ... Monaural / stereo conversion part, 13b ... Composition part, 14 ... Operation processing part, 14a ... Operation part, DESCRIPTION OF SYMBOLS 15 ... Image input part, 15a ... Camera, 16 ... Interface part, 17 ... Video RAM, 18 ... Image | video reproduction | regeneration part, 19 ... Hard disk drive (HDD), 20a, 20b ... Microphone, 22 ... MIDI sound source, 23a ... Left speaker, 23b ... right speaker, 24 ... video control unit, 25 ... display unit, 30 ... karaoke server, 31 ... database, 40 ... LAN in karaoke box, 50 ... router, 60 ... internet.

Claims (6)

Post data acquisition means for acquiring post data that is recorded as a single channel sound source signal and singing sound or musical instrument performance sound by a user of the online karaoke system is uploaded in the online karaoke system;
Posting reproduction setting acquisition means for acquiring posting reproduction setting information indicating whether to reproduce the posting data acquired by the posting data acquisition means on a single channel or on a predetermined plurality of channels;
Based on the post reproduction setting information acquired by the post reproduction setting acquisition means, post reproduction determination means for determining whether to reproduce the post data on a single channel or a predetermined plurality of channels;
When it is determined by the posting / playback determination means that playback is performed on a plurality of channels, the single-channel sound source signal in the posted data is converted into the plurality of channels' sound source signals, and the converted sound source signals are associated with the plurality of channels. Audio output control means for outputting a single-channel sound source signal in the posted data as the same sound from the plurality of speakers, when it is determined to be reproduced by a single channel while being output from a plurality of predetermined speakers. A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
In the posting reproduction setting information, when the posting data is posted, an output method indicating whether the posting data is reproduced on a single channel or a predetermined plurality of channels is set,
The posting reproduction setting information and the posting data are associated with each other,
The post reproduction setting acquisition unit acquires the post reproduction setting information associated with the post data acquired by the post data acquisition unit. In the karaoke apparatus of Claim 1 or Claim 2,
External input sound acquisition means for acquiring external input sound consisting of singing sound or musical instrument performance sound by a user of the karaoke apparatus as a single channel sound source signal;
External output setting acquisition means for acquiring external output setting information indicating whether to output a reproduction sound based on a sound source signal of the external input sound in a single channel or a predetermined plurality of channels;
Based on the external output setting information acquired by the external output setting acquisition means, whether the speaker output of the external input sound that is performed in parallel with the reproduction of the posted data is output in a single channel or in multiple channels And an external output determining means for determining
The audio output control means is a single-channel sound source in the external input sound acquired in parallel with the post data reproduction process when the external output determination means determines that the external input sound is output in a plurality of channels. The signal is converted into the sound source signal of the plurality of channels, and the converted sound source signal is output together with the reproduction sound of the posted data from the plurality of speakers corresponding to the plurality of channels, while the external input sound is single When it is determined to reproduce on the channel, a single channel sound source signal in the external input sound acquired in parallel with the reproduction processing of the posted data is set as the same sound from the plurality of speakers, and the reproduced sound of the posted data is reproduced. A karaoke device characterized by being output in conjunction with. The karaoke apparatus according to claim 3,
The number of singers or performers determined in advance in the music played by the music performance performed by the music performance means of the karaoke device in parallel with the reproduction of the posted data by the voice output control means and the output of the external input sound Or at least one of the conditions relating to whether the music is a song for singing or a musical instrument performance, or the conditions relating to whether a predetermined specific mode is specified for the performance of the music According to the conditions, the external output setting information further comprises an external output setting means for setting an output method indicating whether to output the external input sound in a single channel or a predetermined plurality of channels,
The external output setting acquisition unit acquires the external output setting information set by the external output setting unit. In the karaoke apparatus according to claim 3 or claim 4,
Recording means for generating recording data of external input sound consisting of a single-channel sound source signal acquired by the external input sound acquisition means;
Recording setting acquisition means for acquiring recording setting information indicating whether the recording data generated by the recording means is reproduced on a single channel or on a plurality of predetermined channels;
Based on the recording setting information acquired by the recording setting acquisition means, whether to post the posted data in a single channel or a predetermined plurality of channels in the posted playback setting information to be given to the recorded data Posting playback setting means for setting the output method indicating
Posting means for uploading the posted data including the recorded data and the posted playback setting information corresponding to the recorded data set by the posted playback setting means to a predetermined posting server in the communication karaoke system. A karaoke device characterized by this. The karaoke apparatus according to claim 5,
The number of singers or performers determined in advance in the music played by the music performance performed by the music performance means of the karaoke device in parallel with the reproduction of the posted data by the voice output control means and the output of the external input sound Or at least one of the conditions regarding whether the music is a song for singing or a musical instrument performance, or the conditions regarding whether a predetermined operation mode is specified for the performance of the music According to conditions, the recording setting information further comprises a recording setting means for setting an output method indicating whether to reproduce the recording data in a single channel or a predetermined plurality of channels,
The karaoke apparatus, wherein the recording setting acquisition unit acquires the recording setting information set by the recording setting unit.

Images