JP6182394B2 - Online karaoke system characterized by selection of duet singers and control method thereof - Google Patents

Description

  According to the present invention, a server, a karaoke apparatus, and a user terminal are communicably connected to each other through a transmission path, and a first user who uses the karaoke apparatus and a second user who uses the user terminal perform a duet song. The present invention relates to a communication karaoke system and a control method therefor, and particularly relates to a feature having a selection by a second user.

  A communication karaoke system is known in which bases are communicably connected via a transmission line and a communication duet is performed between the bases. For example, in the communication karaoke system described in Patent Document 1, after performing synchronization processing between the communication karaoke system at point A and the communication karaoke system at point B, guide data is transmitted to each other, and the received guide data is converted into the received guide data. Based on this, the same guide data is reproduced simultaneously. That is, in this communication karaoke system, the reproduction of karaoke music is started simultaneously in each karaoke system.

  Recently, one-person karaoke performed by one person is also popular. This one-person karaoke is performed for various purposes such as practice of singing karaoke, relieving stress, and killing time. Against this background, single-person karaoke specialty stores and dedicated rooms are also increasing.

JP 2010-112981 A

  By the way, the case where the user who performed karaoke alone changes a mind and desires a duet song is assumed. In this case, if a duet song is recruited only for users of the karaoke room at the desired time, it is difficult to collect a large number of users for recruitment, and as a result, there may be frequent cases where duet song cannot be performed. .

  In addition, regarding the communication duet, the delay state of the transmission path connecting the bases is not always constant, and the processing load in each communication karaoke system is not always the same. For this reason, in the above-mentioned communication karaoke system, the reproduction timings of the guide data are not always aligned with each other. If the reproduction timing of the guide data is deviated, the sound and the performance sound are deviated, and it becomes difficult to fully enjoy the duet singing.

  The present invention has been made in view of these circumstances, and an object of the present invention is to collect a large number of users to be recruited and to easily establish a duet song. Moreover, there exists in suppressing the bad influence on the duet song by transmission delay.

  In order to achieve the above object, the present invention connects a server, a karaoke apparatus, and a user terminal so that they can communicate with each other via a transmission line, and a second user who uses the user terminal and a first user who uses the karaoke apparatus. A communication karaoke system that causes each person to perform a duet singing, wherein the server includes the singing sound data of the first user as a basis of the karaoke singing sound and the karaoke singing sound as a basis of the karaoke performance sound. Server-side storage means for storing performance sound data of the same music, and data distribution means for distributing a set of the singing sound data and the performance sound data to the user terminal in response to a recruitment request by the first user The user terminal includes terminal-side storage means for storing the distributed singing sound data and the performance sound data, and the stored singing sound Data reproduction means for reproducing the data and the performance sound data, and outputting the karaoke song sound of the first user in synchronization with the karaoke performance sound, and the second user at the time of data reproduction by the data reproduction means A mixed sound signal generating means for generating a mixed sound signal of the singing sound and the karaoke performance sound, and a signal transmitting means for transmitting the generated mixed sound signal to the karaoke apparatus, wherein the karaoke apparatus is transmitted. The apparatus further comprises signal reproduction means for receiving and reproducing the mixed sound signal and outputting the karaoke song sound and the karaoke performance sound of the second user.

  According to the present invention, since the singing sound data and the performance sound data are distributed to a plurality of user terminals, it is possible to collect more users for recruitment than to target only the users of the karaoke room, As a result, a duet song can be easily established.

  Moreover, according to this invention, a 2nd user performs a duet song with the karaoke song sound and karaoke performance sound of a 1st user based on the song sound data and performance sound data which were reproduced | regenerated and output by the user terminal. And a mixed sound signal is produced | generated and transmitted with this duet song. On the other hand, the first user performs duet singing with the karaoke song sound and karaoke performance sound of the second user based on the mixed sound signal reproduced and output by the karaoke apparatus. Thus, since the signal of each user's karaoke song sound is not reciprocated via a transmission line, the bad influence to the duet song by a transmission delay can be suppressed.

  In the communication karaoke system described above, the server-side storage means stores index information indicating the skill of singing for each of a plurality of users, and the data distribution means includes the first user's index information and the second user information. It is preferable to determine the user terminal to be a distribution target of a set of the singing sound data and the performance sound data with reference to the index information of the user. In this configuration, since the user terminal that is the data distribution target is determined based on the index information indicating the skill of singing, it is possible to select the second user having the singing level suitable for the first user.

  In the communication karaoke system described above, the user terminal includes an application unit that transmits an application response to the recruitment request to the server, and the server has one application when the application response is received from a plurality of the user terminals. It is preferable to provide user terminal selection means for selecting a user terminal and transmitting a notification of determination to each of the selected user terminal and the karaoke apparatus. In this configuration, when there are a plurality of application replies, the second user who is a duet can be notified to each of the second user and the first user.

  In the communication karaoke system described above, the server-side storage unit stores the singing video data of the first user, which is the basis of the singing video acquired together with the singing sound data, and the data distribution unit includes the singing voice data. Video data is paired with the singing sound data and the performance sound data and distributed to the user terminal, the terminal-side storage means stores the distributed singing video data, and the data reproduction means is stored. The singing video data is reproduced, the singing video of the first user is displayed in synchronization with the karaoke singing sound of the first user and the karaoke performance sound, and the user terminal reproduces the data by the data reproducing means. Video signal generating means for generating the video signal of the second user at the time, and the signal transmitting means shares the generated video signal with the mixed sound signal. Transmitted to the karaoke device, said signal reproducing means receives the transmitted video signal reproduced, it is preferable to display a singing image of the second user. In this configuration, each user can enjoy a duet singing with a video.

  Moreover, this invention uses the communication karaoke system which connected each of the server, the karaoke apparatus, and each of the some user terminal with the transmission path so that communication was possible, and the 1st user who uses the said karaoke apparatus, and the said user terminal are used. 2. A control method for causing each user to perform a duet singing, wherein the singing sound data of the first user as a basis for the karaoke singing sound and the same music as the karaoke singing sound as a basis for the karaoke performance sound The performance sound data is stored in a server-side storage means provided in the server, and one or more candidates for performing a duet singing from among the plurality of user terminals in response to a recruitment request by the first user An extraction step of causing the server to extract the user terminal, and for the extracted user terminal, the singing sound A data distribution step in which a set of data and performance sound data is distributed from the server and stored in a terminal-side storage means provided in the user terminal, and the user terminal is operated by the second user who intends to apply A terminal selection step for causing the server to receive the application response transmitted from the server and for the server to select one user terminal for performing a duet singing, and the singing sound data and the performance sound data at the time of synchronous playback. 2 A mixed sound signal transmitting step of causing the selected user terminal to generate a mixed sound signal of the singing sound of the user and the karaoke performance sound and transmitting the mixed sound signal from the user terminal to the karaoke device; The karaoke device receives and reproduces the mixed sound signal, and the second user's karaoke singing sound and the And performing a mixed sound signal reproducing step of outputting the Raoke performance sound.

  According to the present invention, a first user who uses a karaoke device and a second user who uses a user terminal using a communication karaoke system in which a server, a karaoke device and a user terminal are communicably connected via a transmission path. When performing a duet singing to each of the two, it is possible to collect a large number of second users to be recruited, and to easily establish a duet singing. Moreover, the bad influence to the duet song by transmission delay can be suppressed.

It is a figure explaining schematic structure of a communication karaoke system. It is a block diagram explaining the structure of a host apparatus. It is a conceptual diagram explaining customer information. It is a block diagram explaining the structure of a karaoke apparatus. It is a block diagram explaining the structure of a karaoke main body. It is a block diagram explaining the structure of a user terminal. It is a conceptual diagram explaining the state by which the host apparatus, the karaoke apparatus, and the user terminal were connected so that communication was possible via the transmission line. It is a flowchart explaining operation | movement of a karaoke apparatus, a host apparatus, and a user terminal. It is a conceptual diagram explaining transmission of the song moving image data from a karaoke apparatus to a host apparatus. It is a conceptual diagram explaining transmission of the group of recruitment video data and karaoke data from the host device to each user terminal. It is a conceptual diagram explaining the state which is performing a duet song in each of a user terminal and a karaoke apparatus.

  First, a first embodiment of the present invention will be described. The communication karaoke system shown in FIG. 1 has a host device 1, a karaoke device 2, and a user terminal 3. And these are connected via the transmission line 4 so that communication is possible. The karaoke apparatus 2 is installed in each karaoke room RM of the karaoke store KB, for example.

  Although details will be described later, the user terminal 3 reproduces the recruitment moving image data and the karaoke data distributed from the host device 1 when performing a duet song (hereinafter referred to as a communication duet) through the transmission line 4. The karaoke apparatus 2 outputs a mixed sound signal of the terminal user's singing sound and karaoke performance sound transmitted from the user terminal 3 through the transmission path 4. Hereinafter, each device will be described.

  The host device 1 functions as a server and accumulates and manages various information such as customer information. As illustrated in FIG. 2, the host device 1 includes a host-side control unit 11, a host-side communication unit 12, and a host-side storage unit 13. The host-side control unit 11 is a central part of control in the host device 1 and includes a CPU 11a and a memory 11b. The CPU 11a executes various controls according to the operation program stored in the memory 11b. The memory 11b is a storage element that stores a program to be executed by the CPU 11a and temporarily stores various types of information when the program is executed. The host-side communication unit 12 provides an interface for connecting the host device 1 to the transmission path 4. The set of the host-side control unit 11 and the host-side communication unit 12 is a data distribution unit that distributes a set of singing sound data and performance sound data (a set of recruitment video data and karaoke data described later) to the user terminal 3. It corresponds to.

  The host-side storage unit 13 is a storage device that stores a large amount of information, and corresponds to a server-side storage unit. The host-side storage unit 13 is composed of a hard disk drive or the like, and some of the areas are a customer information storage area, a song recording data storage area, a video recording data storage area, a recruitment video data storage area, and a karaoke data storage. Used as a region.

  The customer information storage area is an area in which attribute information and history information of the user (customer) are stored. As attribute information, for example, as shown in FIG. 3A, a user ID, an address, a telephone number, age, sex, occupation, and average score are stored. Among these, the user ID is information for identifying the user, and is given to each user. The average score is the average score value of the songs sung by the user. Moreover, as history information, as shown in FIG.3 (b) and FIG.3 (c), music ID, a use shop, a singing date, and a scoring value are memorize | stored, for example. Among these, the music ID is information for identifying karaoke music sung in the past. The scoring value is a score given by the scoring process of the karaoke device 2 when singing the karaoke music, and is an index indicating the skill of singing. Note that some of the users stored in the customer information storage area are also users of the user terminal 3.

  The singing recording data storage area shown in FIG. 2 is an area for storing audio data (hereinafter referred to as singing recording data) in which a microphone input sound at the time of karaoke singing is stored, and the video recording data storage area is at the time of karaoke singing. This is an area in which video data (hereinafter referred to as video recording data) taken of a user or a room is stored. The song recording data and the video recording data are data obtained by recording and recording a karaoke song performed in the karaoke room RM, and are uploaded from the karaoke apparatus 2 in response to a request from the user (room user) of the karaoke room RM. .

  A set of song recording data and video recording data (that is, song moving image data) is stored in a state associated with a user ID, a song ID, and history information. That is, the host-side storage unit 13 accumulates the song moving image data acquired along with the singing of the karaoke music in a state associated with the user ID indicating the user, the music ID indicating the karaoke music, and the history information. Remember.

  This song moving image data is used, for example, when performing an offline duet song (hereinafter referred to as a collaboration song). In the collaboration singing, the singing moving image data selected by the room user is downloaded from the host device 1 to the karaoke device 2 and reproduced together with the karaoke performance sound signal. By this reproduction, in the karaoke room RM, a sound based on the singing moving image data (karaoke singing sound) and a karaoke performance sound based on the karaoke performance sound signal are output, and a video based on the singing moving image data (singing video) is displayed. Then, by singing along with the voice based on the singing moving image data and the karaoke performance sound, the room user can enjoy the atmosphere of performing a duet with the singers of the singing moving image data. In collaboration singing, the singing video recorded and uploaded by the user is released, and the room user selects a favorite singing video from them, but the singing video to be used is not disclosed in the communication duet. These are distributed individually only to the user terminal 3 determined by the host device 1.

  The recruitment video data storage area is an area in which recruitment video data is stored. This recruiting video data is distributed from the host device 1 to the user terminal 3 when a room user (first user) recruits a communication duet partner. The recruitment video data of this embodiment includes recruitment audio data (corresponding to singing sound data) in which the voice at the time of singing is recorded, and recruitment recording data (corresponding to singing video data) in which the video at the time of singing is recorded. To be). The recruiting moving image data adopts a data format suitable for reproduction on the user terminal 3 and is stored in the recruiting moving image data storage area in a state associated with the user ID and the music ID.

  This recruitment video data is created from recruitment song video data obtained by recording and recording a karaoke song in a karaoke room RM, for example, by a room user who has decided to recruit a duet partner. The recruiting video data can also be created from the song video data for collaboration singing stored in the song recording data storage area or the video recording data storage area.

  The karaoke data storage area is an area in which karaoke data is stored. This karaoke data is distributed from the host apparatus 1 to the user terminal 3 together with recruitment video data when recruiting a communication duet partner. The karaoke data of this embodiment is composed of a set of recruitment performance data in which the performance sound of the karaoke music is recorded and recruitment lyrics data in which the lyrics of the karaoke music are recorded, similarly to the recruitment video data. A data format suitable for reproduction on the user terminal 3 is employed. The karaoke data in the present embodiment is created in advance for all communication duet target songs, and is stored in a state associated with the song ID.

  Next, the karaoke apparatus 2 will be described. The karaoke apparatus 2 performs karaoke performance and voice recording and video recording at the time of singing karaoke. For example, as shown in FIG. 4, a karaoke main body 21, a speaker 22, a monitor 23, and a singing microphone 24. A video camera 25 and a remote control device 26.

  The karaoke main body 21 is a part that performs various controls relating to karaoke singing such as performance control of selected karaoke music, display control of lyrics and background video, processing of microphone signals generated by the singing microphone 24, recording and recording control. is there. The karaoke main body 21 will be described in detail later.

  The speaker 22 is connected to the karaoke main body 21 and outputs sound based on a sound emission signal output from the karaoke main body 21. For example, in a normal karaoke singing performed in each karaoke room RM, a mixed sound of karaoke performance sounds reproduced based on room user's voice and music data stored in the karaoke main body 21 is output from the speaker 22. The Further, in the communication duet, a voice of a terminal user who uses the user terminal 3 and a mixed sound signal in which karaoke performance sounds are mixed are transmitted from the user terminal 3 to the karaoke main body 21 through the transmission path 4. In the karaoke main body 21, the terminal user's voice based on the received mixed sound signal and the karaoke performance sound are further mixed with the room user's voice, and the mixed sound output signal is output to the speaker 22. Thereby, the mixed sound of the room user's voice, the terminal user's voice, and the karaoke performance sound is output from the speaker 22.

  Therefore, the set of the karaoke main body 21 and the speaker 22 receives and reproduces the mixed sound signal transmitted from the user terminal 3, and outputs a karaoke song sound and karaoke performance sound of the terminal user (second user). It corresponds to a reproduction means (audio signal reproduction means).

  The monitor 23 is connected to the karaoke main body 21 and displays video on the screen based on the video signal from the karaoke main body 21. For example, lyrics and background video in a karaoke song to be sung are displayed. In the communication duet, the video of the terminal user is displayed on the monitor 23 based on the video signal transmitted from the user terminal 3 to the karaoke main body 21 through the transmission path 4.

  Therefore, the set of the karaoke main body 21 and the monitor 23 corresponds to signal reproduction means (video signal reproduction means) for receiving and reproducing the video signal transmitted from the user terminal 3 and displaying the terminal user's singing video.

  The singing microphone 24 is connected to the karaoke main body 21, and the room user's voice or the like is converted into a microphone signal and input to the karaoke main body 21. This microphone signal is appropriately adjusted by the karaoke main body 21 and mixed with the karaoke performance sound or the like. The video camera 25 generates a video signal by photographing the karaoke room RM. The video camera 25 is also connected to the karaoke main body 21, and the generated video signal is input to the karaoke main body 21. And the karaoke main body 21 displays the video based on the input video signal on the monitor 23, or converts the input video signal to generate song recording data.

  The remote control device 26 includes a short-range wireless communication unit capable of bidirectional communication for transmitting and receiving information to and from the karaoke main body 21 and is operated when a karaoke song is reserved. When reserving karaoke music, the remote control device 26 transmits an operation signal including a music ID for identifying the music to be played. And the karaoke main body 21 manages the karaoke music which the room user selected in the queue.

  Further, the remote control device 26 of the present embodiment is used when authenticating a room user or used when recruiting a communication duet partner. At this time, operation information corresponding to the operation by the room user is transmitted to the host device 1. In this case, an operation signal is transmitted to the host device 1 via the neighboring router device RT1 and the transmission path 4. The remote control device 26 that performs such an operation corresponds to an operation information transmitting means.

  Next, the karaoke main body 21 will be described in detail. As shown in FIG. 5, the karaoke main body 21 includes a main body side control unit 31, a main body side communication unit 32, a main body side storage unit 33, a sound source unit 34, an acoustic processing unit 35, a display processing unit 36, A video input unit 37 and an operation unit 38 are provided. These units are connected to a communicable state via the bus BS1.

  The main body side control unit 31 is a central part of control in the karaoke main body 21, and includes a CPU 31a and a memory 31b. The CPU 31a executes various controls according to the operation program stored in the memory 31b. For example, an operation input process for receiving an operation from the operation unit 38 or a sequencer process that operates as a sequencer is performed. The memory 31b is a storage element that stores a program to be executed by the CPU 31a and temporarily stores various types of information when the program is executed.

  The main body side communication unit 32 provides an interface for connecting the karaoke main body 21 to the transmission path 4 via the router device RT1. For this reason, the main body side communication unit 32 transmits and receives information to and from the router device RT1. The operation of the main body side communication unit 32 is controlled by the main body side control unit 31.

  The main body side storage unit 33 is a large-capacity storage device that stores various types of data, and includes, for example, a hard disk drive. The main body side storage unit 33 includes, for example, a music data storage area, a background video data storage area, a song recording data storage area, and a video recording data storage area.

  The music data storage area stores music data for playing the karaoke music selected by the remote control device 26, and the background video data storage area stores background video data for displaying the background video on the monitor 23. Is done.

  The music data includes MIDI data and lyrics data. MIDI data is music performance information (performance data) by an electronic musical instrument, and is composed of time-series note information. The note information is composed of various commands that control, for example, the timing of sound generation and mute, key pressing force, volume and sound quality, and playback tempo (pitch). The lyrics data is data for displaying the lyrics telop in the karaoke music on the monitor 23. The MIDI data and the lyrics data are stored in a state in which each karaoke piece that can be played by the karaoke apparatus 2 is associated with the song ID.

  The song recording data storage area stores song recording data recorded during karaoke singing, and the video recording data storage area stores video recording data shot during karaoke singing. Then, the song recording data and the video recording data are uploaded from the karaoke device 2 to the host device 1 in response to a request from the room user.

  The sound source unit 34 is a part that generates a karaoke performance sound signal based on MIDI data, and includes a CPU 34a, a memory 34b, and a waveform memory 34c. The CPU 34a executes various controls according to the operation program stored in the memory 34b. The memory 34b is a storage element that stores a program to be executed by the CPU 34a and temporarily stores various types of information when the program is executed. The waveform memory 34c is a storage element that stores waveform data of various sounds played by the target musical instrument in a readable manner. When the main body side control unit 31 performs sequencer processing, the sound source unit 34 processes waveform data according to MIDI data and outputs the processed musical sound signal to the acoustic processing unit 35.

  The acoustic processing unit 35 is a part that performs processing of the karaoke performance sound signal and processing of the microphone signal generated by the singing microphone 24. For example, in performance control of karaoke music, the sound processing unit 35 performs analog conversion on the musical sound signal output from the sound source unit 34 to generate a karaoke performance sound signal. Further, when a microphone signal from the singing microphone 24 is input, an audio signal is generated by appropriately adjusting. This audio signal is mixed with the karaoke performance sound signal and output to the speaker 22. In the communication duet, the acoustic processing unit 35 mixes the mixed sound signal and the audio signal received through the transmission path 4 and outputs the mixed sound signal to the speaker 22. In addition, when recording a karaoke song, the sound processing unit 35 converts the generated audio signal into digital song recording data and stores it in the main body side storage unit 33.

  The display processing unit 36 performs control such as display of a background video during karaoke performance. During normal karaoke performance, background video data is input to the display processing unit 36, and the background video data is decoded. Then, the display processing unit 36 combines the lyrics telop with the video signal of the background video generated by the decoding, and outputs the combined video signal to the monitor 23. At that time, the display processing unit 36 synthesizes the lyrics telop based on the lyrics data output by the sequencer processing in the main body side control unit 31. Also, the display color of the lyrics telop is changed according to the color change command output by the sequencer processing. As a result, the monitor 23 displays a video in which the lyrics telop is superimposed on the background video, and the display color of the lyrics telop is changed according to the progress of the karaoke music. In the communication duet, the display processing unit 36 outputs the video signal received through the transmission path 4 to the monitor 23. Here, when a video signal with lyrics is received, the video signal is output as it is, and when a video signal without lyrics is received, a video signal in which lyrics telop is synthesized is output.

  The video input unit 37 is a part that captures a video signal from the video camera 25, and is configured by, for example, an interface circuit. When shooting a video of a karaoke song, the video camera 25 outputs a video signal of a room user or the like. Then, the video input unit 37 outputs the input video signal to the display processing unit 36. Thereby, the video of the room user is displayed on the monitor 23. The video input unit 37 also converts the input video signal into digital video recording data and stores it in the main body storage unit 33.

  Further, as will be described later, a video signal obtained by photographing a terminal user or the like is transmitted from the user terminal 3 through the transmission path 4 during a communication duet. In this case, the video input unit 37 outputs the received video signal to the display processing unit 36. As a result, the video of the terminal user is displayed on the monitor 23.

  The operation unit 38 includes a panel switch, a remote control receiving circuit, and the like, and outputs an operation signal corresponding to the operation of the panel switch and the remote control device 26 to the main body side control unit 31. The main body side control unit 31 detects an operation signal by performing an operation input process, and executes a corresponding process. Note that the panel switch and the remote control device 26 include various key switches (not shown) for selecting an operation. A normal karaoke song or communication duet can be selected and executed by an operation through the remote control device 26.

  Next, the user terminal 3 will be described. The user terminal 3 is a device held by a terminal user, and corresponds to a personal computer 3A, a tablet computer 3B, a mobile phone 3C, and the like as shown in FIG. By executing the application software installed in the user terminal 3, the user terminal 3 can be used as a simple karaoke terminal. Also, a push notification from the host device 1 can be transmitted to the user terminal 3.

  As shown in FIG. 6A, the user terminal 3 includes a terminal-side control unit 41, a first communication unit 42, a second communication unit 43, a terminal-side storage unit 44, an input operation unit 45, and a camera. A control unit 46, a voice control unit 47, and a display control unit 48 are provided, and these are connected in a communicable state via the bus BS2. A camera unit 49 is connected to the camera control unit 46, a microphone unit 50 and a speaker unit 51 are connected to the audio control unit 47, and a display unit 52 is connected to the display control unit 48.

  The terminal-side control unit 41 is a central part of control in the user terminal 3 and includes a CPU 41a and a memory 41b. The CPU 41a executes various controls according to the operation program stored in the memory 41b. The memory 41b is a storage element that stores a program to be executed by the CPU 41a and temporarily stores various types of information when the program is executed.

  The 1st communication part 42 provides the interface for connecting with base station BTS and router apparatus RT2 so that communication is possible. The operation of the first communication unit 42 is controlled by the terminal-side control unit 41, performs wireless communication using a telecommunication carrier's line with the base station BTS, and performs short-range wireless communication with the router device RT2. Perform wired communication. The user terminal 3 is connected to the transmission path 4 via the base station BTS and the router device RT2, and transmits and receives various data and various signals to and from the host device 1 and the karaoke device 2.

  In addition, the 1st communication part 42 transmits the mixed sound signal which mixed the karaoke song sound and karaoke performance sound by a terminal user (2nd user) toward the karaoke apparatus 2 at the time of a duet song. For this reason, the set of the 1st communication part 42 and the terminal side control part 41 which controls operation | movement of this 1st communication part 42 is corresponded to the signal transmission means which transmits a mixed sound signal to the karaoke apparatus 2. FIG.

  The 2nd communication part 43 provides the interface for connecting with the headset 53 so that communication is possible. The second communication unit 43 performs short-range wireless communication or wired communication with the headset 53. By using the headset 53, the terminal user can view the video displayed on the user terminal 3, listen to the audio output from the user terminal 3, and input the audio to the user terminal 3. You can also do it for free.

  The terminal-side storage unit 44 is a storage device that stores information used in the user terminal 3. As shown in FIG. 6B, a partial area of the terminal-side storage unit 44 is used as an application storage area, a recruitment moving image data storage area, and a karaoke data storage area.

  The application storage area is an area where application software is installed. This application software is for using the user terminal 3 as a simple karaoke terminal, and is executed by the terminal-side control unit 41 based on an instruction from the terminal user.

  The recruitment video data storage area is an area in which recruitment video data is stored in the same manner as the recruitment video data storage area of the host device 1. That is, it is an area in which recruitment moving image data transmitted from the host device 1 through the transmission path 4 is stored.

  The karaoke data storage area is also an area where karaoke data is stored in the same manner as the karaoke data storage area of the host device 1. That is, it is an area where karaoke data transmitted from the host device 1 through the transmission path 4 is stored.

  As described above, the recruitment moving image data is composed of a set of recruitment audio data corresponding to singing sound data and recruitment recording data corresponding to singing video data. The karaoke data is composed of a set of recruitment performance sound data corresponding to performance sound data and recruitment lyrics data corresponding to lyrics data. For this reason, the terminal side memory | storage part 44 which memorize | stores these data is corresponded to a terminal side memory | storage means.

  In the present embodiment, the OS of the user terminal 3 or the application software is equipped with a MIDI sound source, and the host device 1 sends MIDI data and key / tempo setting information to the user terminal 3 as performance music data for recruitment. However, if the user terminal 3 is not equipped with a MIDI sound source, the host device 1 transmits audio data that sounds the sound source based on the MIDI data. The audio data can be recorded so as to be separable at the same time when the singing voice data for recruitment is recorded by the karaoke apparatus 2.

  The input operation unit 45 is a part that is input by a terminal user, and includes various input devices such as a touch panel, a keyboard, a mouse, and a trackball. Then, an operation signal corresponding to an input operation to the input operation unit 45 is output to the terminal side control unit 41. Based on this operation signal, the terminal-side control unit 41 recognizes an input operation of the terminal user. For example, an application notification to be described later can be transmitted (answered) to the host device 1 by operating the input operation unit 45. In this case, a set of the terminal side control unit 41, the input operation unit 45, and the first communication unit 42 corresponds to an application unit.

  The camera control unit 46 is a part that performs control related to shooting such as control of the camera unit 49. For example, the operation of the camera unit 49 is controlled, or a video signal obtained by photographing with the camera unit 49 is captured. The camera control unit 46 operates according to control from the terminal-side control unit 41.

  The voice control unit 47 is a part that performs voice-related control such as input / output of voice signals. For example, a microphone signal converted by the microphone unit 50 is captured, a sound emission signal is output to the speaker unit 51, and a microphone signal or sound emission is transmitted to the headset 53 connected to the second communication unit 43. Exchange signals.

  Furthermore, the voice control unit 47 synchronously reproduces the recruitment voice data and the recruitment performance sound data stored in the terminal-side storage unit 44 and mixes the microphone signal from the headset 53 or the microphone unit 50 in the communication duet. To do. Thereby, from the headset 53 or the speaker unit 51, the singing voice of the room user based on the recruiting sound data, the karaoke performance sound based on the playing performance sound data, and the singing voice of the terminal user are output. .

  The voice control unit 47 also operates according to the control from the terminal side control unit 41. For this reason, the set of the terminal side control unit 41, the voice control unit 47, and the speaker unit 51 (or the headset 53) is stored in the recruitment voice data (singing sound data) and the recruitment performance sound data (performance sound). Data) and the data reproducing means (sound data reproducing means) for outputting the karaoke song sound of the room user (first user) in synchronization with the karaoke performance sound.

  In addition, the voice control unit 47 acquires the microphone signal of the singing sound by the terminal user from the microphone unit 50 or the headset 53 in accordance with the karaoke singing sound based on the recruiting voice data. Then, the sound control unit 47 generates a mixed sound signal by mixing the performance sound signal obtained by reproducing the recruitment performance sound data with the microphone signal. The generated mixed sound signal is transmitted to the karaoke apparatus 2 via the first communication unit 42.

  For this reason, the set of the terminal-side control unit 41 and the voice control unit 47 corresponds to a mixed sound signal generating unit that generates a mixed sound signal of the terminal user's singing sound and karaoke performance sound during data reproduction. The set of the terminal-side control unit 41 and the first communication unit 42 corresponds to a signal transmission unit that transmits the generated mixed sound signal to the karaoke apparatus 2.

  The display control unit 48 is a part that performs display-related control such as control for the display unit 52. For example, the recruitment recording data stored in the terminal-side storage unit 44 is reproduced in synchronization with the recruitment audio data and the like, and the video based on the recruitment recording data is displayed on the display unit 52. In addition, the display control unit 48 causes the display unit 52 to display information necessary for recruiting duets, or causes the display unit 52 to display a terminal user image captured by the camera unit 49. It is also possible to include lyrics information in the performance music data for recruitment transmitted by the host device 1. If comprised in this way, it can synthesize | combine and display with another image | video on the display unit 52 of the received user terminal 3, changing a color of a lyrics.

  The display control unit 48 also operates according to the control from the terminal side control unit 41. For this reason, the set of the terminal-side control unit 41, the display control unit 48, and the display unit 52 reproduces the stored recording data for recruitment (singing video data) and sings the room user (first user). This corresponds to data reproduction means (recorded data reproduction means) for displaying the video in synchronization with the karaoke song sound and karaoke performance sound of the room user.

  Next, the operation of the communication karaoke system having the above configuration will be described. This karaoke system is characterized by communication duet processing. For this reason, the description will focus on the operation of the communication duet.

  As shown in FIG. 7, in this communication karaoke system, the host device 1, the karaoke device 2, and the user terminal 3 are connected via a transmission path 4 in a state where they can communicate with each other. In the example of FIG. 7, for the sake of convenience, one karaoke device 2 and three user terminals 3 are illustrated, but actually, a large number of karaoke devices 2 and user terminals 3 are connected.

  In this online karaoke system, when a room user (first user) wishes to sing a duet, the host device 1 makes a request to the host device 1 (server), so that the host device 1 has a plurality of terminal users (second users). ) That is, the host device 1 distributes the moving image data for recruitment by the room user to the plurality of user terminals 3 together with the karaoke data. When the terminal user who has viewed the recruitment video data responds to the recruitment, a communication duet is performed between the terminal user and the room user according to the recruitment.

  In this communication duet, the distributed moving image data and karaoke data are reproduced on the user terminal 3 of the terminal user who has made the offer. For this reason, the terminal user performs a duet singing on the sound based on the recruiting video data and the karaoke performance sound based on the karaoke data. The user terminal 3 generates a mixed sound signal obtained by mixing the singing voice of the terminal user and the karaoke performance sound, and transmits the mixed sound signal to the karaoke apparatus 2 through the transmission path 4. The karaoke apparatus 2 reproduces the received mixed sound signal and outputs the singing voice of the terminal user together with the karaoke performance sound. The room user performs a duet singing on the singing voice and the karaoke performance sound of the terminal user.

  FIG. 8 is a flowchart for explaining the operation of each device in the communication duet. As shown in the figure, when performing a communication duet, room user authentication processing (S10), recruitment video data generation processing (S20), distribution target terminal user selection processing (S30), duet partner The terminal user determination process (S40) and the duet singing process (S50) are performed. Each process will be specifically described below.

  In the room user authentication process (S10), the room user (singer) operates the remote control device 26 to perform a login process (S11). In this login process, a user ID and a password are input. Then, the host device 1 performs room user authentication processing (S12). In this authentication process, it is determined whether or not the combination of the entered user ID and password is correct, and if it is correct, the room user is specified.

  The recruitment moving image data generation process (S20) is a process of creating recruitment moving image data and storing it in the host device 1. In this process, first, a room user selects and reserves a karaoke piece for duet singing (S21). Thereby, the selected karaoke music is managed in a queue. In addition, the room user sets the karaoke device 2 to the singing video recording mode so that the state during singing can be recorded and recorded. Thereafter, the selected karaoke piece is played, and the room user sings his / her part in accordance with the performance sound. Then, the state during the singing is recorded and recorded, and stored in the main body storage unit 33 as singing recording data and video recording data (S22).

  If a satisfactory video is obtained, the room user operates the karaoke device 2 (remote control device 26) to instruct uploading. Thereby, as shown in FIG. 9, song moving image data (song recording data, video recording data) is uploaded (S23). On the other hand, the host device 1 stores the uploaded singing moving image data in the host-side storage unit 13 (S24). In addition, the host device 1 converts the singing moving image data, generates recruitment moving image data (recruitment audio data, recruitment recording data), and stores it in the host-side storage unit 13 (S25).

  The terminal user selection process (S30) is a process of selecting a terminal user to be distributed such as recruitment video data. In this selection process, the room user operates the karaoke device 2 and makes a recruitment request to the host device 1 (S31). For example, the remote control device 26 is operated to create a message appealing to the terminal user at the time of recruitment, or to set recruitment conditions. Thereafter, by operating the recruitment button, a recruitment command including a message and recruitment conditions is transmitted to the host device 1.

  The host device 1 that has received the recruitment command performs candidate extraction processing (S32). In this extraction process, the host device 1 refers to user attribute information and history information stored in the customer information storage area of the host-side storage unit 13, and extracts a terminal user suitable for the room user who requested the recruitment. To do. For example, the host device 1 refers to presence / absence of singing experience of the selected karaoke music piece, room user scoring value and terminal user scoring value, gender, age, etc., and extracts a terminal user as a candidate. . Note that it may be configured such that the terminal user can set whether or not to be extracted as a candidate, and only the terminal users for which permission is set are targeted for extraction.

  If the terminal user who becomes a candidate is extracted, a candidate narrowing-down process (S33) and a narrowing-down instruction (S34) are performed between the host device 1 and the karaoke device 2. For example, the host device 1 transmits a candidate list in which terminal users who are candidates are described to the karaoke device 2. On the other hand, the karaoke device 2 uses the remote control device 26 and the monitor 23 to present the received candidate list to the room user. When a narrowing instruction based on a room user's instruction is performed, information such as the narrowing conditions is transmitted from the karaoke apparatus 2 to the host apparatus 1. As a result, the host device 1 creates a new candidate list in consideration of the narrowing-down conditions and transmits it to the karaoke device 2. If such a process is repeated and the room user is convinced, information indicating that fact is transmitted to the host device 1 to determine one or more terminal users as candidates. In consideration of personal information, the room user may specify only the number of candidates, and the host device 1 may determine terminal users equal to or less than that number as candidates.

  The duet partner determination process (S40) is a process of determining a duet partner from among terminal users as candidates. In this determination process, the host-side control unit 11 of the host device 1 functions as a user terminal selection unit. Then, the host device 1 notifies the terminal user determined as a candidate that the room user is seeking a duet partner (S41). For example, as shown in FIG. 10, the host device 1 distributes the information of the recruitment content together with the recruiting moving image data and the karaoke data to the user terminal 3 of the terminal user who has been confirmed. The recruitment content is, for example, a karaoke song or a nickname of a room user. The information on the contents of recruitment, the moving image data for recruitment, and the karaoke data are received by the user terminal 3 (S42) and stored in the terminal-side storage unit 44. In these processes, a set of the host side control unit 11 and the host side communication unit 12 included in the host device 1 functions as a data distribution unit.

  The terminal user who is interested in the recruitment synchronously reproduces the recruitment moving image data and the karaoke data stored in the user terminal 3 by the user terminal 3 (S43). Then, the terminal user who has determined the intention to apply operates the user terminal 3 to transmit an application notification (application answer) (S44). For example, as an application notice, an application command indicating the intention of application is transmitted together with the user ID of the terminal user. This application notification is received by the host device 1 (S45). By receiving the application notification, the host device 1 determines a terminal user to be a duet partner and transmits a determination notification (S46). This determination notification is received by each of the user terminal 3 and the karaoke apparatus 2 of the determined terminal user (S47, S48).

  When application notifications are transmitted from a large number of terminal users, the host device 1 appropriately selects a predetermined number of terminal users. For example, the terminal users may be selected in the order in which the application notifications are received, or the terminal user with the highest scoring value may be selected from the terminal users who have received the application notifications within a predetermined period. And since the notification of determination is transmitted to the user terminal 3 and karaoke apparatus 2 of the determined terminal user, the terminal user of a duet can be notified to each of the terminal user and the room user.

  The duet singing process (S50) is a process for causing each of the determined terminal user and room user to perform a duet singing. In this process, a start notice is transmitted from the user terminal 3 of the determined terminal user (S51), and this start notice is received by the karaoke apparatus 2 (S52). Thereby, in the karaoke apparatus 2, a notice display is performed on the monitor 23, and the room user can recognize that a duet song is started.

  Thereafter, each of the terminal user and the room user performs a duet song (S53, S54). Here, as shown in FIG. 11, the recruiting moving image data is reproduced together with the karaoke data on the user terminal 3. For this reason, the terminal user performs a duet song while viewing audio and video based on these data. In the user terminal 3, the voice of the terminal user and the karaoke performance sound are mixed and a mixed sound signal is generated. This mixed sound signal is transmitted to the karaoke apparatus 2 via the transmission path 4 together with a video signal indicating the video of the terminal user photographed by the camera unit 49. In the karaoke apparatus 2, the terminal user's voice and karaoke performance sound are output from the speaker 22 by reproducing the mixed sound signal and the video signal, and the terminal user's video is displayed on the monitor 23. The room user performs a duet singing while watching the voice and video of the terminal user.

  In the communication karaoke system of this embodiment, a terminal user (second user) is a room user based on singing video data and karaoke data (singing sound data and performance sound data) reproduced and output by the user terminal 3. Performs duet singing with karaoke singing sound and karaoke performance sound of (first user). And a mixed sound signal is produced | generated with this duet song, and it transmits to the karaoke apparatus 2 which a room user uses. On the other hand, the room user performs a duet singing with the terminal user's karaoke singing sound and karaoke performance sound based on the mixed sound signal reproduced and output by the karaoke apparatus 2.

  As described above, since the singing video data and the karaoke data are distributed to the user terminal 3, it is possible to collect more users to be recruited than to target only the users of the karaoke room RM, and thus duet singing. Can be easily established. Moreover, since the signal of each user's karaoke song sound is not reciprocated via the transmission line 4, the bad influence on the duet song by a transmission delay can be suppressed.

  Further, when extracting the user terminal 3 that is a data distribution target, the host-side control unit 11 (data distribution means) refers to the score values (index information) of the room user and the terminal user. The terminal user of the singing level suitable for the user can be selected.

  The above description of the embodiment is for facilitating the understanding of the present invention, and does not limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof.

  For example, in the above-described embodiment, a system for performing a duet singing with both video and audio has been described. However, the present invention can be similarly applied to a system for performing a duet singing with only sound.

  In addition, the terminal user's scoring value is used in extracting candidate terminal users, but the present invention is not limited to this, and various methods can be used.

  Moreover, regarding the lyric display on the karaoke apparatus 2 at the time of communication duet, it may be synthesized with the video signal from the user terminal 3 or the lyric display function of the karaoke apparatus 2 may be used.

  Further, the recruiting video data and karaoke data distributed to the user terminal 3 may be automatically deleted after the duet singing ends.

  Furthermore, when a duet singing with a certain terminal user is finished, a duet singing by another terminal user and a room user according to the recruitment may be continued.

DESCRIPTION OF SYMBOLS 1 ... Host apparatus, 2 ... Karaoke apparatus, 3 ... User terminal, 3A ... Personal computer, 3B ... Tablet computer, 3C ... Mobile telephone, 4 ... Transmission path, 11 ... Host side control part, 11a ... CPU, 11b ... Memory, DESCRIPTION OF SYMBOLS 12 ... Host side communication part, 13 ... Host side memory | storage part, 21 ... Karaoke main body, 22 ... Speaker, 23 ... Monitor, 24 ... Singing microphone, 25 ... Video camera, 26 ... Remote control device, 31 ... Main body side control part, 31a ... CPU, 31b ... Memory, 32 ... Main body side communication section, 33 ... Main body side storage section, 34 ... Sound source section, 34a ... CPU, 34b ... Memory, 34c ... Waveform memory, 35 ... Sound processing section, 36 ... Display processing section , 37 ... Video input section, 38 ... Operation section, 41 ... Terminal side control section, 41a ... CPU, 41b ... Memory, 42 ... First communication section, 43 ... Second communication section, 4 Terminal side storage unit 45 ... Input operation unit 46 ... Camera control unit 47 ... Audio control unit 48 ... Display control unit 49 ... Camera unit 50 ... Microphone unit 51 ... Speaker unit 52 ... Display unit 53 ... Headset, KB ... Karaoke shop, RM ... Karaoke room, RT1 ... Router device, RT2 ... Router device, BTS ... Base station, BS1 ... Bus, BS2 ... Bus

Claims (5)

A communication karaoke in which a server, a karaoke apparatus, and a user terminal are communicably connected to each other via a transmission path, and a first user who uses the karaoke apparatus and a second user who uses the user terminal perform duet singing. A system,
The server
Server-side storage means for storing the singing sound data of the first user as the basis of the karaoke singing sound, and the performance sound data of the same music as the karaoke singing sound as the basis of the karaoke performance sound;
In response to a recruitment request by the first user, it comprises data distribution means for distributing the set of the singing sound data and the performance sound data to the user terminal,
The user terminal is
Terminal-side storage means for storing the delivered singing sound data and the performance sound data;
Data reproduction means for reproducing the stored singing sound data and the performance sound data, and outputting the karaoke singing sound of the first user in synchronization with the karaoke performance sound;
Mixed sound signal generating means for generating a mixed sound signal of the singing sound of the second user and the karaoke performance sound at the time of data reproduction by the data reproducing means;
Comprising signal transmission means for transmitting the generated mixed sound signal to the karaoke apparatus;
The karaoke device
A communication karaoke system comprising signal reproduction means for receiving and reproducing the transmitted mixed sound signal and outputting the karaoke song sound of the second user and the karaoke performance sound. The server-side storage means stores index information indicating the skill of singing for each of a plurality of users,
The data distribution means refers to the index information of the first user and the index information of the second user, and determines the user terminal that is a distribution target of a set of the singing sound data and the performance sound data. The communication karaoke system according to claim 1. The user terminal includes an application unit that transmits an application response to the application request to the server,
The server includes a user terminal selection unit that selects one user terminal when there is an application answer from a plurality of user terminals, and transmits a determination notification to each of the selected user terminal and the karaoke apparatus. The communication karaoke system according to claim 1 or 2. The server-side storage means stores the singing video data of the first user, which is acquired together with the singing sound data, and is the basis of the singing video,
The data distribution means distributes the singing video data to the user terminal in combination with the singing sound data and the performance sound data,
The terminal-side storage means stores the delivered singing video data,
The data reproduction means reproduces the stored singing video data, displays the singing video of the first user in synchronization with the karaoke singing sound of the first user and the karaoke performance sound,
The user terminal comprises video signal generation means for generating a video signal of the second user at the time of data reproduction by the data reproduction means,
The signal transmitting means transmits the generated video signal together with the mixed sound signal to the karaoke apparatus,
The communication karaoke system according to any one of claims 1 to 3, wherein the signal reproducing means receives and reproduces the transmitted video signal and displays the singing video of the second user. . Using a communication karaoke system in which a server, a karaoke device, and a plurality of user terminals are connected to each other via a transmission path, each of a first user who uses the karaoke device and a second user who uses the user terminal A control method for performing a duet song,
The server-side storage means provided in the server stores the singing sound data of the first user that is the basis of the karaoke singing sound and the performance sound data of the same music as the karaoke singing sound that is the basis of the karaoke performance sound. A memory step;
In response to the recruitment request by the first user, an extraction step for causing the server to extract one or more user terminals that are candidates for performing a duet singing from among the plurality of user terminals;
A data distribution step for causing the extracted user terminal to distribute a set of the singing sound data and the performance sound data from the server and storing the data in a terminal-side storage unit included in the user terminal;
A terminal selection step of causing the server to receive an application response transmitted from the user terminal by an operation of the second user who has an intention to apply, and causing the server to select one of the user terminals for performing a duet singing;
The selected user terminal generates a mixed sound signal of the second user's singing sound and the karaoke performance sound at the time of synchronous playback of the singing sound data and the performance sound data, and from the user terminal, the A mixed sound signal transmission step to be transmitted to the karaoke device;
A communication karaoke system which performs the mixed sound signal reproduction step of causing the karaoke device to receive and reproduce the transmitted mixed sound signal and outputting the karaoke song sound of the second user and the karaoke performance sound. Control method.

Images