JP6507793B2 - Karaoke system and karaoke apparatus - Google Patents

Description

  The present invention relates to a karaoke apparatus communicably connected to a server apparatus, and a karaoke system including the server apparatus and the karaoke apparatus. In particular, the present invention relates to a karaoke system and a karaoke apparatus capable of posting post information.

  Conventionally, a karaoke apparatus is known that enjoys singing along with the performance of music. The conventional karaoke device was to enjoy singing with people who were at the same place, but now with peripheral technology such as communication infrastructure, it sings together with other people who are not there via communication lines. A service to enjoy is provided.

  Patent Document 1 discloses a system for acquiring singing animation data using such a posting service. The singing animation data recorded and recorded by the karaoke apparatus is transmitted to the host apparatus and transmitted again to the karaoke apparatus, so that it is possible to enjoy the singing along with the voice and video of the singer who has been recorded and recorded previously. . In the system for acquiring singing moving image data disclosed in Patent Document 1, the host device determines the display layout of the background video data with reference to the composition frequency information. By adopting such a configuration, it is possible to make a display layout suitable for the number of images to be synthesized.

JP, 2014-109658, A

  The server apparatus used in the posting service as disclosed in Patent Document 1 is generally provided by a vendor who manages and operates a karaoke system. Therefore, in the conventional post service, the user uses a server apparatus set in advance. By the way, at present, on the Internet, a service that enables video posting is provided by each company. In addition, it is also possible for individuals to use large-capacity file server devices. Users who use the karaoke posting service are not only server devices managed by the karaoke company, but also video posting services operated by such other companies, or users of the user who recorded at the karaoke site in the file server device. It is conceivable that a request to save the video occurs.

  However, in the post service in karaoke, it is difficult to transmit post information as in the case of a server device managed by a karaoke company in order to perform collaboration with video and audio of another user. That is, the posting information can not be transmitted to a server device operated by another company without the permission of another user.

In order to solve the problems described above, the karaoke system according to the present invention adopts the following configuration.
A karaoke system comprising: a first server device managed by a karaoke company; a karaoke apparatus capable of communicating with a second server device managed by a company other than the karaoke company; and the first server device,
The first server device stores composite post information formed based on unit post information uploaded regarding the same music,
The karaoke apparatus is
Compound post information received from the first server device, and reproduction processing for reproducing music information corresponding to the compound post information.
Post information formation processing for recording video information input from an imaging device and recording audio information input from a microphone in synchronization with the reproduction processing to form unit post information;
A determination process of determining a transmission destination of unit post information formed in the post information formation process;
In the determination process, when the first server device is determined to be a transmission destination, a first post including identification information of composite post information used in the reproduction process and unit post information formed in the post information formation process A first transmission process of transmitting information to the first server device;
In the determination process, when the second server device is determined, the composite post information used in the reproduction process and identification information of the composite post information are not included, and the unit post information formed in the post information formation process is included. 2. A second transmission process of transmitting post information to the second server device.

Furthermore, in the karaoke system according to the present invention,
The karaoke apparatus can communicate with a mobile terminal,
The reproduction process reads out and reproduces user content stored in the portable terminal in addition to the composite post information and the music information.
The second transmission process includes the user content used in the reproduction process in the second post information.

Furthermore, in the karaoke system according to the present invention,
The karaoke apparatus combines the unit post information used in the reproduction process and the user content to execute a second post information forming process for forming second post information.

Furthermore, the karaoke system according to the present invention is
In the determination process, the transmission destination of the unit post information can be selected by the user.

The karaoke apparatus according to the present invention is
A first server apparatus managed by a karaoke company , and a karaoke apparatus capable of communicating with a second server apparatus managed by a company other than the karaoke company ,
The first server device stores composite post information formed based on unit post information uploaded regarding the same music,
The karaoke apparatus is
Compound post information received from the first server device, and reproduction processing for reproducing music information corresponding to the compound post information.
Post information formation processing for recording video information input from an imaging device and recording audio information input from a microphone in synchronization with the reproduction processing to form unit post information;
A determination process of determining a transmission destination of unit post information formed in the post information formation process;
In the determination process, when the first server device is determined to be a transmission destination, a first post including identification information of composite post information used in the reproduction process and unit post information formed in the post information formation process A first transmission process of transmitting information to the first server device;
In the determination process, when the second server device is determined, the composite post information used in the reproduction process and identification information of the composite post information are not included, and the unit post information formed in the post information formation process is included. 2. A second transmission process of transmitting post information to the second server device.

  A karaoke system and a karaoke apparatus according to the present invention can use a first server device and a second server device as transmission destinations of post information. At that time, the first server apparatus is sent the first post information including the identification information of the composite recording information and the unit post information formed in the post information forming process to the first server apparatus. It is possible to form composite post information to be used for In addition, the second post information including the unit post information formed in the post information formation process is transmitted to the second server device, that is, the information regarding the composite post information used in the reproduction process is not transmitted, but the unit post By transmitting only the information, information on other users who collaborated at the time of singing is not disclosed to the outside.

  Furthermore, in the karaoke system according to the present invention, it is possible to form the posting information using the user content possessed by the user who sings on the portable terminal.

  Furthermore, in the karaoke system according to the present invention, the unit posting information and the user content are combined in the karaoke apparatus to form the second posting information. It is assumed that the second server device does not have the function of combining a plurality of contents. In the karaoke system according to the present invention, by combining unit posting information and user content on the karaoke apparatus side, the second server apparatus having no content combining function is also combined as one work It is possible to send.

  Furthermore, in the karaoke system according to the present invention, it is possible for the user to select the transmission destination of the unit post information formed in the post information forming process. The user can select the first server device, the second server device, or both the first server device and the second server device as the transmission destination according to the mode of use of the user.

The figure explaining the outline of the karaoke contribution concerning the embodiment of the present invention A diagram showing a configuration of a karaoke system according to an embodiment of the present invention Diagram showing the configuration of a mobile terminal Flow chart showing the matching process in the karaoke management system Schematic diagram showing the matching process in the karaoke management system Flow chart showing remote control processing in the karaoke management system A schematic diagram showing remote control processing in the karaoke management system A diagram showing a music confirmation screen displayed on a mobile terminal Flow chart showing the main processing (part 1) executed by the karaoke apparatus Flow chart showing main processing (part 2) executed by the karaoke apparatus Figure showing the monitor when the singer is shooting A diagram showing a reproduction screen of composite post information stored in the first server device A diagram showing a reproduction screen of composite post information stored in the second server device Flow chart showing a processing example of the karaoke apparatus and surrounding configuration at the time of posting Flow chart showing a modified example regarding posting to the second server device

  The karaoke apparatus according to this embodiment is used for a karaoke posting system that can enjoy duets and chorus in karaoke. FIG. 1 is a diagram for explaining the outline of this karaoke posting system. The flow of karaoke posting will be briefly described using this figure. Here, although the case where recording of a singing voice is performed is demonstrated, the image recorded by the camera will be accompanied in fact.

  First, a singer performs singing according to a performance at a place where a karaoke system is installed, such as a karaoke box, and singing voice is recorded (a). The karaoke system is composed of a karaoke apparatus (also called "commander"), a monitor on which a lyric image and a background image output from the karaoke apparatus are displayed, and a remote control apparatus for transmitting an operation from the operator to the karaoke apparatus. The singing voice is recorded as first post information in recording means such as a hard disk built in the karaoke apparatus.

  The singer can also play the first posted information to confirm the recorded singing voice (b). If the singer desires, the first post information is uploaded onto the first server device and can be published via the Internet (c). The first server device is a server device managed and operated by a karaoke company, and is separated from a server device (second server device) managed and operated by a company other than the karaoke company appearing later. The ordinal number is attached. The first post information published on the first server device is downloaded by the singer who wishes to sing along with the singer on the karaoke system (d).

  The contents of the downloaded first post information can also be confirmed by reproducing it according to the music (e). The downloaded first song information is reproduced by the karaoke apparatus together with the music, and the singer can enjoy a duet with the previously recorded first song information. Furthermore, the singing voice of the singer who performed the singing along with the first singing information is recorded in the karaoke apparatus as second posting information (f). The recorded second post information can be reproduced in synchronization with the first post information and the music, and the singer can check his / her singing in duet mode (g).

  The singer can upload the second post information to the server as a new post. The second post information can be reproduced together with the first post information, but since the first post information is stored in the first server device, only the second post information is transmitted. Identification information of the first post information is added to the second post information in order to be associated with the first post information (h). The first server device receives the second post information to which the identification information of the first post information is added, so that the singer in (f) additionally reproduces the first post information at the time of singing, and sings the singing voice of itself. It can be seen that the second post information recording the has been created. The first post information and the second post information are a collaboration between the singer in (a) and the two singers in (f).

  The first post information and the second post information stored in the first server device are downloaded to a PC (personal computer) or a karaoke system according to a request from the user, and the first post information, the second post information, and the music information It is possible to enjoy collaborations by multiple singers based on (i). As mentioned above, although collaboration based on the 1st contribution information and the 2nd contribution information was explained, collaboration of two or more people (two or more people) becomes possible by repeating (d) and (f)-(h).

  As described above, in the karaoke posting system according to the present embodiment, it is possible to enjoy duets and choruses even with a person who is not present on the spot. Here, only the singing voice has been described, but in the case of applying to the present invention, shooting with a camera together with the singing voice and recording of video information will be executed by the karaoke apparatus.

  Next, an embodiment of a karaoke system that enables shooting with a camera along with recording of singing will be described with reference to FIG. The karaoke system in the present embodiment is configured to include a karaoke device 2 (commander) and a remote control device 1. In the example shown in FIG. 1, the remote control device 1 a, the remote control device 1 b, and the two remote control devices 1 are used for one karaoke device 2. Since the configurations of the remote control devices 1a and 1b are the same, the remote control device 1 will be described. The karaoke device 2 and the remote control device 1 are connected to form a network using the LAN 100 and the access point 110.

  The karaoke apparatus 2 installed in a store such as a karaoke box includes a sound control unit 25 as a playing unit for playing music. Moreover, the karaoke apparatus 2 is provided with the operation part 21 which receives the various input from a user. The karaoke apparatus 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits the interpretation to the CPU 30. Moreover, the karaoke apparatus 2 is equipped with the hard disk 32 as a memory | storage part which memorize | stores various information. The karaoke apparatus 2 includes a LAN communication unit 24 as a communication unit that connects to the LAN 100 and joins the network.

  In addition, the karaoke apparatus 2 includes video reproduction means for displaying a lyric image and a background image on the monitor 41. The video reproduction means includes a video reproduction unit 29 for reproducing a video based on the video information, a video RAM 28 for temporarily storing the video to be reproduced, a superimposing of a lyric telop on the reproduced video, and a video control unit for giving a video effect. 31 is configured.

  Furthermore, in the karaoke apparatus 2, in addition to the monitor 41 connected to the outside, various types of information can be displayed on the touch panel monitor 33. The touch panel monitor 33 is configured by superimposing a display unit 35 for displaying the video information input from the video control unit 31 and a touch panel 34 for outputting the position of the touch input to the operation processing unit 22. The touch panel monitor 33 functions as an input unit, similarly to the operation unit of the karaoke apparatus 2 or the touch panel monitor 11 of the remote control device 1 or the like. The user can perform various operations on the karaoke apparatus 2 such as making the karaoke apparatus 2 directly make a reservation or the like by selecting music on the touch panel monitor 33.

  Furthermore, the karaoke apparatus 2 is configured to include a CPU 30 for integrally controlling each component and a memory 27 for temporarily storing information necessary for executing various programs.

  Furthermore, a camera 44 is connected to the karaoke apparatus 2 as an external device for performing photographing. The camera image from the camera 44 can be recorded on the hard disk 32 as recording means and displayed on the monitor 41 in real time via the image control unit 31 responsible for image input / output. Further, together with the video information from the camera 44, it is possible to display the recording information of the singing partner recorded in advance on the monitor 41.

  With such a configuration, the karaoke apparatus 2 executes various processes, but as the main functions of the karaoke apparatus 2, it is possible to execute music reservation processing, music reproduction processing, and the like. The song reservation process is a process for designating and reserving a song based on a designation from a user, and is executed in cooperation with the remote control device 1. The reservation information specified by the input unit such as remote control device 1 is registered in the reservation table in memory 27 by the operation of the user. The music reproduction process is a process for reproducing a reserved music, and is a process in which the music performance process and the lyrics reproduction process are performed in synchronization.

  The music performance process is a process for causing the sound control unit 25 to perform a performance based on the performance information included in the music information. The music played by the sound control unit 25 is emitted from the speaker 42 together with the singing voice input from the microphone 43. The lyric reproduction process is a process of performing song assistance by displaying the lyric information included in the music information on the monitor 41. It is also possible to execute background image display processing in which a background image is superimposed and displayed on the lyrics displayed in the lyrics reproduction processing.

  On the other hand, the remote control device 1 can execute music selection processing for selecting a song to be sung, and can transmit various instructions such as reservation information to the karaoke device 2. Further, the remote control device 1 can also receive various information from the first server device 5 connected to the karaoke device 2 or the Internet, and can provide various information to the user. In the present embodiment, the operation unit 17 and the touch panel monitor 11 are provided as user interfaces for receiving various instructions from the user. The touch panel monitor 11 is configured to have a display unit 11a and a touch panel 11b, displays various interfaces on the display unit 11a, and can receive touch input from a user.

  Further, the remote control device 1 controls the memory 14 and these components as a storage unit for storing a database required for music retrieval, various programs, and various information generated with the execution of the programs. The remote control side control unit of In the remote control side control unit, the CPU 15, the video control unit 13 for forming a video to be displayed on the touch panel monitor 11, the video RAM 12 for temporarily storing the video information to be displayed, and the input from the touch panel monitor 11 or the operation unit 17 And an operation processing unit 18 for transmitting the information to the CPU 15.

  Further, the remote control device 1 is connected to the network configured by the LAN 100 by being wirelessly connected to the access point 110 by the wireless LAN communication unit 16. Each remote control device 1 is associated in advance with a specific karaoke device 2. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

  With such a configuration of the remote control device 1, various inputs from the user are accepted from the touch panel monitor 11 or the operation unit 17, and the video information is displayed on the touch panel monitor 11 to reserve music for the karaoke device 2, etc. It is possible to give various instructions.

  Next, the portable terminal 6 possessed by the user in the present invention will be described. The karaoke system according to the present embodiment communicates the portable terminal 6 with the karaoke apparatus 2 by associating the portable terminal 6 with the portable terminal 6 possessed by the user, and reserves the music from the portable terminal 6 or the like. It is possible to remotely control the

  FIG. 3 is a diagram showing the configuration of the portable terminal 6 according to the embodiment of the present invention. As the mobile terminal 6, a smartphone, a tablet terminal, a mobile phone or the like can be used. The program (application) according to the present invention is installed in the mobile terminal 6, and the mobile terminal 6 is used as a remote control of the karaoke apparatus 2 by executing association processing (sometimes referred to as tying processing) on the program. It becomes possible to use.

  The portable terminal 6 of the present embodiment includes a control unit configured to include a control unit 61, a RAM 62, a storage unit 63, an image processing unit 64, and an acoustic processing unit 66. The storage unit 63 can adopt nonvolatile storage means such as a hard disk, a NAND flash memory, and the like. The storage unit 63 stores a program capable of executing post processing in the present embodiment, and various data used in the program.

  The control unit 61 is a unit such as a CPU that controls the entire portable terminal 6 in an integrated manner, and executes various controls based on programs and data stored in the storage unit 63. The RAM 62 temporarily stores data generated by the control of the control unit 61.

  The sound processing unit 66 is means for performing input and output of sound related to the mobile terminal 6. It is a means to make the speaker 67 a emit sound under the control of the control unit 61. Further, the sound processing unit 66 is connected to the microphone 67 b and can capture surrounding sound from the microphone 67 b.

  The touch panel display unit 68 is configured to have a display unit 68 b for displaying an image and a touch panel 68 a disposed on the front surface or the back surface. It is possible to employ various types of touch panel 68 a that can recognize a user's touch position, such as a capacitive type. The control unit 61 can perform display on the display unit 68 b and determine which part of the displayed image is touch-input by touch input from the touch panel 68 a.

  The image processing unit 64 is means for performing input and output of the image relationship of the mobile terminal 6. The image processing unit 64 displays and outputs the image information formed by the control unit 61 to the display unit 68 b. The image processing unit 64 also has a function of capturing an image from the front camera 65 F disposed on the front surface (the touch panel display unit 68 side) of the portable terminal 6 or the rear camera 65 R disposed on the back surface of the portable terminal 6.

  The mobile terminal 6 of the present embodiment includes a mobile network communication unit 69 a and a wireless LAN communication unit 69 b in order to communicate with the outside. The mobile network communication unit 69a can perform wireless communication via a mobile wireless network, and can perform telephone calls or communication using the Internet by performing wireless communication with a wireless base station. The wireless LAN communication unit 69b can perform wireless LAN communication by wirelessly connecting to an access point connected on the LAN. By wirelessly connecting to the access point, it is possible to make a communication connection to a network on the LAN or the Internet.

  The mobile terminal 6 uses the mobile network communication unit 69a or the wireless LAN communication unit 69b to execute various programs (also referred to as "applications") including programs capable of executing post processing from a server on the Internet. It is possible to download. The program may be installed from the external memory EX connected to the external memory connection terminal 72 in addition to the form using the communication line. In addition to the mobile network communication unit 69a and the wireless LAN communication unit 69b, short distance communication means (infrared communication, Bluetooth (registered trademark), etc.) may be further provided.

  The portable terminal 6 of the present embodiment is configured to include an input switch 70 as an input unit in addition to the touch panel 68a. The input switch 70 can be provided with various switches such as a power switch, a volume control switch, and a switch whose input application is changed by a program to be executed.

  The mobile terminal 6 according to the present embodiment installs and executes the program provided by the karaoke company to associate the mobile terminal 6 with the karaoke apparatus 2 to be operated, and to transmit music from the mobile terminal 6 to the karaoke apparatus 2 It is possible to transmit various commands such as a reservation command of

  In the karaoke system installed in the karaoke shop described in FIG. 2, the user who visits the karaoke shop can cause the portable terminal 6 owned by the user to function as a remote control of the karaoke system to be used. Therefore, in the karaoke management system of this embodiment, the matching process which matches the portable terminal 6 which a user possesses, and the karaoke system used as an object is performed.

  Now, an example of the association processing for causing the portable terminal 6 to function as the remote control of the karaoke apparatus 2 will be introduced. In addition, various forms exist in the matching process other than the example introduced here. In the present invention, various types of association processing can be adopted as long as the association processing associates the portable terminal 6 possessed by the user with the karaoke system to be used. It does not ask various conditions such as the use / non-use of the server device 5 or the like.

  FIG. 4 is a flowchart showing the association processing in the karaoke management system of the present embodiment. Further, FIG. 5 is a schematic view showing the association processing in the karaoke management system. In the association process of the present embodiment, the user logs in to the karaoke system to be used, and the mobile terminal 6 of the user is associated with the karaoke system by logging in with the mobile terminal 6 using the same account. It is supposed to be.

  The user who has visited the karaoke shop inputs his account information using the input means such as the remote control device 1 or the like. The karaoke system transmits an apparatus-side log-in request to the first server apparatus 5 based on the input of the account information (S301). The apparatus side login request includes a karaoke apparatus ID (Karaoke apparatus identification information) in order to specify which karaoke system the request is from. The first server device 5 that has received the apparatus side login request (S201) performs authentication using the account information included in the received terminal side login request (S202). The authentication is performed based on whether or not the pair of the user ID and the password included in the account information matches the one stored in the storage unit 51 of the first server device 5 side. If the authentication is successful (S203: Yes), login completion is notified to the requested karaoke system (S204). In the karaoke system in which the login is completed, it is possible to receive various services using user information corresponding to the logged-in user (S302). On the other hand, when the authentication fails (S203: No), the first server device 5 transmits authentication error information to the requested karaoke system.

  When the login from the karaoke system is successful, the first server device 5 adds the karaoke device ID and the user ID to the association table stored in the storage unit 51 (S205). With this association table, the first server device 5 can determine which user is logged in to which karaoke system.

  On the other hand, the user starts a program in the portable terminal 6 possessed by the user, and transmits a terminal side login request to the first server device 5 (S101). The terminal side login request includes the account information (user ID and password) of the user. The first server device 5 having received the terminal-side login request performs authentication using the account information included in the received terminal-side login request, as in the case of the device-side login request (S206). When the authentication is successful (S207: Yes), the first server device 5 determines whether or not the association table stored in the storage unit 51 includes the user ID of the user who made the terminal side login request. When the user ID is present (S208: Yes), the association between the portable terminal 6 logged in by the terminal side login request and the karaoke system logged in by the device side login request is completed (S209). Then, an association completion notification is transmitted to the portable terminal 6 for which the terminal side login request has been made (S210). In the portable terminal 6 for which the association has been completed, the remote control process (S110) for remotely operating the associated karaoke system can be executed.

  As mentioned above, although the matching process for making the portable terminal 6 of this embodiment function as a remote control of the karaoke apparatus 2 was demonstrated, a device side login request and a terminal side login request ask which is earlier. is not. Next, the details of the remote control process (S110) executed on the associated portable terminal 6 will be described.

  FIG. 6 is a flowchart showing the remote control process in the karaoke management system of the present embodiment, and FIG. 7 is a schematic view showing the remote control process in the karaoke management system of the present embodiment. As shown in the example of the schematic diagram of FIG. 7, karaoke management in which the portable terminal 6 possessed by the user (user A) and the karaoke apparatus 2 (karaoke apparatus a) to be used by the user are associated. In the system, it is possible to transmit various information such as a reservation of music, a command for remotely operating the karaoke system, and the like from the portable terminal 6 to the karaoke system.

  In the remote control process, after the association process is completed, the karaoke system is operated by the portable terminal 6 by repeatedly executing the processes of S401 to S403 described later. The music confirmation screen displayed on the touch panel display unit 68 of the portable terminal 6 is shown in FIG. The music confirmation screen is a screen showing the details of the music specified based on the music name, singer name, etc. specified by the user, and the user can reserve the music on the music confirmation screen. On the music confirmation screen, in addition to music related information 601 such as singer name, song name, singing out, thumbnail image related to music, a key setting field, a collaboration setting field, and a playback setting field 602 capable of setting a collaboration use file setting field are displayed. Ru. The key setting is a field for setting the key (pitch) of the music to be reserved. By operating this key setting field, a sub-screen that enables the up and down of the key is displayed, and the user can perform key setting of the song to be sung according to his / her range.

  The collaboration setting field is a field for setting whether or not to post a collaboration (abbreviation of collaboration), that is, a singing voice recorded at the time of music reproduction and a photographed video (FIG. 1: equivalent to second posting information) to the server device. is there. In the collaboration setting field, it is possible to select "ON" or "OFF" according to the user's operation. In addition, when “do” is set in the collaboration setting field, a list regarding composite posting information corresponding to the music to be reserved is acquired from the first server device 5 and collaboration is selected by selecting the composite posting information. It is possible to select compound post information to be a target of The collaboration use file field is a field for setting the user content (corresponding to FIG. 1: first post information) stored in the mobile terminal 6. When performing a collaboration, the user can select user content to be used at the time of collaboration by selecting the collaboration use file field. As user content, in addition to moving image information, still image information, and audio information captured by the user using the portable terminal 6, various types of content such as moving image information, still image information, and audio information imported to the portable terminal 6 from the outside It is possible to use.

  In the music confirmation screen described above, the user can confirm the music to be reserved using the music related information 601, and can perform various settings regarding the time of reproduction using the reproduction setting field 602. The user who has made the confirmation and setting operates the reservation button 603 to make a reservation for the karaoke device 2 associated with the displayed music. By making a reservation, the portable terminal 6 transmits, to the karaoke apparatus 2 via the first server device 5, reservation information including music identification information indicating the reserved music and setting information on various settings at the time of reproduction. Be done. In addition, since the remote control device 1 which performs various operations is also provided in the karaoke system, the user can use the remote control device 1 to perform music reservation similar to the portable terminal 6 described above.

  In the remote processing shown in FIG. 6, when the portable terminal 6 determines that a command has been input by an operation such as touch operation of the reservation button 603 on the music confirmation screen of FIG. 8 (S401: Yes), (1) Transmission command information is transmitted to the server device 5 (S402). The transmission command information includes a command (command A) corresponding to the command input and a user ID (user A) stored in the portable terminal 6.

  The first server device 5 illustrated in FIG. 7 executes the transfer process based on the association table. In the transfer process, first, it is determined whether or not the user ID (user A) in the transmission command information sent from the portable terminal 6 exists on the association table. If there is a user ID in the transmission command information on the correspondence table, the transmission command information is transmitted to the karaoke device 2 to be transferred. The transfer command information includes a command (command A) in the transmission command information, a karaoke apparatus ID (karaoke apparatus a) as a destination, and a user ID (user A) of the user who has input the command. The karaoke device 2 (Karaoke device a) that has received the transfer command information executes processing in accordance with the command (command A) included in the transfer command information.

  The remote control process using the portable terminal 6 is repeatedly executed until an end instruction (logout or an instruction to cancel the association) is input to the portable terminal 6 (S403: Yes). When the end instruction is input (S403: Yes), the portable terminal 6 transmits the association release instruction to the first server device 5 (S404). The first server device 5 that receives the association cancellation instruction deletes the corresponding item (pair of karaoke device ID and user ID) from the association table.

  As described above, in the present embodiment, it is possible to remotely control the karaoke system to be used from the karaoke system or the portable terminal in which the user logs in. The main process performed by the karaoke apparatus 2 in the karaoke system in which the user has logged in will now be described with reference to FIGS. 9 and 10.

  In the main processing in the karaoke apparatus 2, first, the reservation information stored in the reservation list is confirmed, and if there is reservation information to be reproduced next, whether the reservation has a collaboration setting based on the setting in the reservation information ( S501: Confirm whether collaboration reservation is a reservation without collaboration setting (S501: Normal reservation). In the case of the normal reservation, normal music reproduction (S506) is performed to reproduce the music specified in the reservation information. On the other hand, in the case of collaboration reservation, the preparation process (S502 to S505) is executed before the reproduction of the music. In this preparation process, it is determined whether the second or subsequent post (second post) for which composite post information is specified in the reservation information or the first post (first post) for which composite post information is not specified (the first post). S502). If it is not the first post (S502), the karaoke apparatus 2 downloads the composite post information specified in the reservation information from the first server apparatus 5 (S503). Next, it is determined whether use of the user content is designated in the reservation information (S504). When the use of the user content is designated (S504: Yes), the user content is received from the portable terminal 6 associated with the karaoke apparatus 2. In addition, since the portable terminal 6 of the present embodiment is associated with the karaoke apparatus 2 via the first server apparatus 5, reception of user content in the karaoke apparatus 2 is performed via the first server apparatus 5. .

  In the present embodiment, the preparation process (S502 to S505) is performed immediately before the music reproduction, but the preparation process may be performed using a period from the time the music is reserved to the time before the music reproduction. By receiving composite post information and user content in advance, it becomes possible to start music playback without waiting for the reception period. After completion of each process in the preparation period, the reproduction of the music specified in the reservation information is started (S507). When a collaboration is performed, shooting using the camera 44 is started (S509). Further, during the music reproduction, a video reproduction process (S 509) using the video being shot by the camera 44, the downloaded combined post information, and the user content is executed.

  FIG. 11 shows a state of the monitor 41 at the time of the video reproduction process (S500). This example shows the case where the user performs the second collaboration and the case where the user content stored in the portable terminal 6 is used. Therefore, the downloaded compound post information includes the singing voice of one user who has posted before and a video obtained by imaging the state of singing. In the present specification, the term "multipost information" is used even if it is a single-person post. The monitor 41 is provided with a first post display area C1, an imaging display area B2, and a user content display area Y1. Moreover, the lyric display E displayed for song assistance is superimposed and displayed on the screen. In the first post display area C1, a video included in the composite post information is displayed. Then, an image being captured by the camera 44 is displayed in real time in the imaging display area B2. In the present embodiment, the video displayed in the first post display area C1 and the video displayed in the imaging display area B2 are displayed horizontally reversed. A user who sings while visually recognizing the monitor 41 can suppress a sense of incongruity due to a mirror image of the image of the user in the imaging display area B2. Further, at the time of reproduction, it is possible to reproduce the state at the time of imaging by horizontally inverting both the images and changing the position thereof.

  If it is determined that the reproduction of the music has ended (S510: Yes), the recording using the camera 44 is ended (S513). The video recorded on the camera 44 and the audio at the time of singing are temporarily stored in the karaoke apparatus 2 as unit post information. In the present embodiment, it is possible to audition unit posting information before posting. If the execution of trial listening is selected (S512: Yes), a trial listening process (S513) is executed. In the present embodiment, it is possible to select the first server device 5 operated and managed by the karaoke company and the other second server devices as upload destinations. In particular, uploading the video and audio of the other user used for the collaboration to the second server device is because the first server device 5 and the second server device 5 are different because the permission of the user is not obtained. When uploading to the server device, the contents are different. In the audition process (S513), it is possible to select the form of uploading to the first server device 5 and the case of uploading to the second server device, and to confirm the video and audio in each case.

  FIG. 12 shows a reproduction screen when uploaded to the first server device 5. Since the first server device 5 is a server device managed and operated by a karaoke company, permission to release audio and video is obtained even for the user who has previously captured an image. Therefore, the video formed when uploaded to the first server device 5 includes the same content as the video reproduction process (S 509). That is, the video included in the downloaded composite post information is displayed in the first post display area C1, and the video captured this time is displayed in the second post display area C2. Note that the first post display area C1 and the second post display area C2 (corresponding to the imaging display area B2) are horizontally reversed and their positions are switched as compared with the case of the video reproduction process (S509). It has become. Further, user content stored in the portable terminal 6 possessed by the user is displayed in the user content display area Y1.

  On the other hand, FIG. 13 shows a reproduction screen when uploaded to the second server device. The second server device is a server device that can be selected by the user as appropriate, and is not under the control of the karaoke company. Therefore, the first post display area C1 is not included in the video formed when uploaded to the second server device, and the second post display area C2 for displaying the video captured this time, and the portable terminal possessed by the user A user content display area Y1 for displaying the user content stored in 6 is provided. As described above, in the present embodiment, the posting content is made different according to the posting to the first server device 5 managed and operated by the karaoke company and the other second server devices. In particular, at the time of posting on the second server device, the video and audio of the user posted before are not uploaded, thereby protecting the rights of others and improving the degree of freedom of the posting destination.

  After the trial listening process (S513), the user can select a posting destination. When uploading to the first server device 5 (S514: Yes), the first upload process (S515) is executed. In the first upload process, the first server information 5 includes first post information including identification information of composite recording information downloaded and used this time and unit post information newly recorded and formed this time. Send to Moreover, when the user content of the portable terminal 6 is used, the used user content is also included in the first post information. The first server device 5 that has received the first post information combines the received first post information, the used composite video recording information, and the user content, and forms new composite post information. The formed composite post information is made public via the Internet and can be used for a new collaboration.

  On the other hand, when uploading to the second server device (S516), first, specification of the second server device from the user is accepted. The second server device is a server device compatible with the video posting service in which the user has acquired an account in advance, and in the specification of the second server device, the user identification information, password after selecting the video posting service , Etc., to enable access to the second server device. Thereafter, a second upload process (S518) of transmitting the second posted information to the second server device is executed. The second post information includes unit post information newly formed and recorded this time. In addition, when the user content of the portable terminal 6 is used, the user content is also included in the second post information.

  The main processing executed in the karaoke apparatus 2 has been described above, but the processing example of the karaoke apparatus 2 and the surrounding configuration (the first server device 5, the second server device, the portable terminal 6) at the time of posting will be described. This will be described using 14. In the flowchart of FIG. 14, the process performed by the karaoke device 2 is substantially the same as the process performed in the main process. Here, a case will be described where posting is performed using the composite posting information B stored in the first server device and the user content A stored in the portable terminal 6.

  When the karaoke apparatus 2 receives a music reproduction instruction accompanied by a collaboration instruction using the user content A and the composite posting information B (S601), the karaoke apparatus 2 receives the composite posting information B from the first server apparatus, The user content A is received from the portable terminal 6. In the present embodiment, the information transmission between the portable terminal 6 and the karaoke device 2 is actually performed via the first server device 5. During the music reproduction period, the karaoke apparatus 2 performs shooting with the camera 44 in synchronization with the music reproduction. Further, the karaoke apparatus 2 reproduces an image with the screen configuration described in FIG. 11 (S603). After the end of the music reproduction (S604: Yes), when the upload to the first server device is selected (S605: Yes), the first posting process of transmitting the first post information to the first server device 5 (S606) To do). The first post information includes unit post information newly formed at the time of music reproduction this time, identification information B of the combined post information B used, and user content A. The first server device 5 that has received the first post information uses the unit post information included in the received first post information, the composite post information B, and the user content A to have the screen configuration described in FIG. Compound post information B ′ is formed (S 611) and stored in the database in the first server device 5.

  On the other hand, when uploading to the second server device is selected (S 607: Yes), the user can select a video posting service corresponding to the second server device and log in, whereby the karaoke device 2 is used as the second server device It is set in a communicable state (S 608) In the present embodiment, it is assumed that the second server device does not have the function of combining a plurality of moving image information. Therefore, in the second post information uploaded to the second server device, the unit post information newly photographed this time and the user content A are combined in the karaoke device 2 (S609). The form of composition in the second post information is the screen configuration described in FIG. The second server device stores the received second post information as post information C for publication.

  The form of uploading to the second server device is not limited to this example, and various forms can be adopted. FIG. 15 shows a modified example regarding posting to the second server device, which is an alternative process of the part surrounded by a broken line in FIG. In the example shown in FIG. 14, after the karaoke apparatus 2 combines and uploads to the second server device, the second post information transmitted from the karaoke apparatus 2 includes the unit post information before combining and the user content A. It is good also as composition included. In the example of FIG. 15 (A), the second server device combines the received unit post information and the user content A, and then stores it as post information C for publication. Alternatively, the user content A may be transmitted from the portable terminal 6. In the example of FIG. 15 (B), a mode is employed in which unit post information is transmitted from the karaoke apparatus 2 to the second server apparatus, and the user content A is transmitted from the portable terminal 6 to the second server apparatus. In this case, for example, identification information (such as a file name) capable of specifying the used user content A is described in the unit post information. In the second server device, the user content A corresponding to the unit post information is determined and synthesized, and stored as post information C for publication.

  As mentioned above, although embodiment concerning this invention was described, it is not restricted to embodiment mentioned above, It is possible to employ | adopt various modifications. For example, in the present embodiment, the correspondence between the karaoke apparatus 2 and the portable terminal 6 has been described via the first server device 5, but the correspondence between the karaoke apparatus 2 and the portable terminal 6 is communication such as wireless LAN It may be performed directly via means. In this case, the portable terminal 6 is communicably connected to the access point 110 in the karaoke system.

  Further, in the present embodiment, the second server device is described as a server device that provides a video posting service, but as the second server device, not only a server device that performs a video posting service but also storage management of individual files The server apparatus may provide a cloud-type file management service.

  Furthermore, in the present embodiment, when user content stored in the portable terminal 6 is used, the first server device 5 and the second server device upload the user content, but the user content needs to be licensed And may not be suitable for uploading to the first server device 5 used for further posting, while being widely published. Therefore, the used user content may not be uploaded to the first server device (uploadable to the second server device).

1 (1a, 1b): remote control device 35: display unit 2: karaoke device 41: monitor 5: first server device 42: speaker 6: portable terminal 43: microphone 11: touch panel monitor 44: camera 11a: display unit 51: storage Unit 11b: Touch panel 61: Control unit 12: Video RAM 62: RAM
13: Video control unit 63: Storage unit 14: Memory 64: Image processing unit 15: CPU 65F: Front camera 16: Wireless LAN communication unit 65R: Rear camera 17: Operation unit 66: Sound processing unit 18: Operation processing unit 67a: Speaker 21: operation unit 67b: microphone 22: operation processing unit 68: touch panel display unit 24: LAN communication unit 68a: touch panel 25: acoustic control unit 68b: display unit 27: memory 69a: mobile network communication unit 28: video RAM 69b: Wireless LAN communication unit 29: Video reproduction unit 70: Input switch 30: CPU 72: External memory connection terminal 31: Video control unit 110: Access point 32: Hard disk 601: Music related information 33: Touch panel monitor 602: Reproduction setting field 34: Touch panel 603: reservation button

Claims (5)

A karaoke system comprising: a first server device managed by a karaoke company; a karaoke apparatus capable of communicating with a second server device managed by a company other than the karaoke company; and the first server device,
The first server device stores composite post information formed based on unit post information uploaded regarding the same music,
The karaoke apparatus is
Compound post information received from the first server device, and reproduction processing for reproducing music information corresponding to the compound post information.
Post information formation processing for recording video information input from an imaging device and recording audio information input from a microphone in synchronization with the reproduction processing to form unit post information;
A determination process of determining a transmission destination of unit post information formed in the post information formation process;
In the determination process, when the first server device is determined to be a transmission destination, a first post including identification information of composite post information used in the reproduction process and unit post information formed in the post information formation process A first transmission process of transmitting information to the first server device;
In the determination process, when the second server device is determined, the composite post information used in the reproduction process and identification information of the composite post information are not included, and the unit post information formed in the post information formation process is included. 2. A second transmission process of transmitting post information to the second server device. The karaoke apparatus can communicate with a mobile terminal,
The reproduction process reads out and reproduces user content stored in the portable terminal in addition to the composite post information and the music information.
The karaoke system according to claim 1, wherein the second transmission process includes the user content used in the reproduction process in the second post information. The karaoke system according to claim 2, wherein the karaoke apparatus executes a second post information formation process of combining the unit post information used in the reproduction process and the user content to form second post information. The karaoke system according to any one of claims 1 to 3, wherein in the determination process, the transmission destination of the unit post information can be selected by the user. A first server apparatus managed by a karaoke company , and a karaoke apparatus capable of communicating with a second server apparatus managed by a company other than the karaoke company ,
The first server device stores composite post information formed based on unit post information uploaded regarding the same music,
The karaoke apparatus is
Compound post information received from the first server device, and reproduction processing for reproducing music information corresponding to the compound post information.
Post information formation processing for recording video information input from an imaging device and recording audio information input from a microphone in synchronization with the reproduction processing to form unit post information;
A determination process of determining a transmission destination of unit post information formed in the post information formation process;
In the determination process, when the first server device is determined to be a transmission destination, a first post including identification information of composite post information used in the reproduction process and unit post information formed in the post information formation process A first transmission process of transmitting information to the first server device;
In the determination process, when the second server device is determined, the composite post information used in the reproduction process and identification information of the composite post information are not included, and the unit post information formed in the post information formation process is included. 2. A second transmission process of transmitting post information to the second server apparatus.