JP6210220B2 - Karaoke equipment - Google Patents

Description

  The present invention relates to a karaoke apparatus that can enjoy singing according to the performance of music, and in particular, can enjoy singing together among a plurality of users and can exchange messages between users who enjoy singing together. It relates to karaoke equipment.

  Conventionally, karaoke in which a song is enjoyed in a snack or a karaoke box is known as a place for socializing with friends who are present together. Currently, while various information terminals such as mobile phones are always in communication connection, a service called a social network service (SNS) is gaining popularity. In this social network service, it is possible to distribute information (messages) sent by registered users in substantially real time, and it is possible to convey a message such as what is currently being done.

  The use of such social network services is also being considered for karaoke devices. Patent Literature 1 discloses a communication karaoke system capable of registering other users who are using a karaoke apparatus within a predetermined range from a point where a target user is located. Patent Document 2 discloses a communication karaoke system that automatically creates a web page using a photograph taken during a karaoke performance.

JP 2012-185382 A JP 2011-175170 A JP 2013-156543 A

  At present, a service called “collaboration” is gaining popularity in karaoke equipment. Collaboration is a service that allows a plurality of users to enjoy singing together using a communication line. While recording the voice at the time of singing a certain user, recording the situation at the time of singing and posting it to the host device, and singing along with the voice and video posted by other users, among multiple users It is possible to enjoy singing. By repeating a plurality of times, it is possible to form voice and video of singing by a large number of people.

  Patent Document 3 discloses a posting reproduction apparatus using such a collaboration service. Conventionally, in such a collaboration service, communication with other users singing together confirms other users' profiles and the like. Alternatively, the message attached to the audio / video post is checked when the post is selected. Therefore, communication between users during singing cannot be taken, and a message or the like cannot be transmitted to other users about his / her singing situation or the like.

  An object of the present invention is to enable messages to be exchanged between users participating in a collaboration service when using such a collaboration service in karaoke, and to promote communication.

Therefore, the karaoke apparatus according to the present invention is
A karaoke apparatus comprising a performance means and a control means,
The performance means can perform performance information,
The control means can execute the reception process, the recording performance process, and the posting process,
Receive processing receives post information,
The posting information includes recording information, recording information, and posting message information.
In the recorded performance processing, performance information corresponding to a specified music piece is played, recording information and recording information are reproduced, input video input from the camera and singing voice input from the microphone are recorded, and the input video is recorded. Recording information, posted message information, and input message information input from the input unit are displayed on the display means,
The posting process transmits the input video recorded during the recording performance process, the singing voice, and the input message information input during the recording performance process to the host device,
The input message information is input by presenting a fixed message corresponding to the music being played to the user during the recording performance process and allowing the user to select the fixed message.
In addition, the karaoke apparatus according to the present invention is
A karaoke apparatus comprising a performance means and a control means,
The performance means can perform performance information,
The control means can execute the reception process, the recording performance process, and the posting process,
Receive processing receives post information,
The posting information includes recording information, recording information, and posting message information.
In the recorded performance processing, performance information corresponding to a specified music piece is played, recording information and recording information are reproduced, input video input from the camera and singing voice input from the microphone are recorded, and the input video is recorded. Recording information, posted message information, and input message information input from the input unit are displayed on the display means,
The posting process transmits the input video recorded during the recording performance process, the singing voice, and the input message information input during the recording performance process to the host device,
The input message information is input by presenting a fixed message corresponding to the progress of the music being played to the user during the recording performance process, and causing the user to select the fixed message.

Furthermore, in the karaoke apparatus according to the present invention,
The recorded performance process is displayed so that the correspondence between the input video and the input message information and the correspondence between the recording information and the posted message information can be recognized.

Therefore, in the karaoke apparatus according to the present invention,
In the recording performance process, the input message information and the posted message information are displayed in the same area provided in the display screen of the display means.

Therefore, in the karaoke apparatus according to the present invention,
The control means can execute a login process and a message posting process,
The login process logs the user in,
In the message posting process, the input message information input during the recording performance process is posted and transmitted to the account of the social network service of the user who specified the music.

Therefore, in the karaoke apparatus according to the present invention,
In the recorded performance process, response message information posted to the input message information posted and transmitted in the message posting process is displayed on the display means.

  According to the karaoke apparatus according to the present invention, in a karaoke apparatus capable of performing a collaboration service, messages can be exchanged between users who perform singing together during the recording performance process. Therefore, it is possible to improve communication between users who participate in the collaboration service.

  Further, in the karaoke apparatus according to the present invention, the display means displays so that the correspondence between the input video and the input message information and the correspondence between the recording information and the posted message information can be recognized. According to such a configuration, it is possible to grasp which user is sending which message. As a method for recognizing the correspondence, the video and message information are displayed in the corresponding area, the color of the frame of the video is associated with the color of the message information, or the code corresponding to the video and message information (user It is conceivable to display with a name.

  Furthermore, in the karaoke apparatus according to the present invention, the input message information and the posted message information are displayed in the same area provided in the display screen of the display means. According to such a configuration, the posted message information and the input message information can be visually recognized at the same time, and it is possible to satisfactorily grasp the exchange of messages and message interaction between users.

  Furthermore, in the karaoke apparatus according to the present invention, a standard message is presented to the user, and the standard message selected by the user is input as an input message. According to such a configuration, the user who is singing can easily input the input message information without the trouble of inputting a message using a keyboard or the like. In addition, by selecting from fixed messages, it is possible to prevent input message information to be posted from being contrary to public order and morals. In addition to the standard message, a free message in which a user inputs a free sentence using a keyboard or the like may be input. Even in this case, the censorship of the message performed by the karaoke dealer only needs to be a free message, the work of the karaoke dealer can be reduced, and the input message information can be quickly disclosed. It becomes.

  Furthermore, in the karaoke apparatus according to the present invention, the standard message presented to the user includes information related to the music being played or the singing situation. According to such a configuration, it is possible to post and transmit the name of the song being sung, the name of the singer, etc., and to convey information related to the song currently being sung to other users.

  Furthermore, in the karaoke apparatus according to the present invention, the input message information input during the recording performance process is posted and transmitted to the account of the social network service of the user who specified the music. According to such a configuration, it is possible to send a message not only to users participating in the collaboration service but also to users participating in the social network service.

  Furthermore, in the karaoke apparatus according to the present invention, the response message information posted for the input message information posted and transmitted in the message posting process is displayed on the display means. According to such a configuration, it is possible to confirm not only the message transmission to the social network service but also the reaction on the social network as the response message information. Therefore, interactive communication with users participating in the social network service is possible. The received response message information may be included in the posting information transmitted to the host device in the posting process.

The figure explaining the outline | summary of the karaoke contribution which concerns on embodiment of this invention The figure which shows the structure of the karaoke system which concerns on embodiment of this invention. The figure which shows the top screen which concerns on embodiment of this invention The figure which shows the user information which concerns on embodiment of this invention The figure which shows the service process with respect to the user which concerns on embodiment of this invention The figure which shows the utilization user top screen which concerns on embodiment of this invention The figure which shows the music confirmation screen which concerns on embodiment of this invention The flowchart which shows the main process of the karaoke apparatus which concerns on embodiment of this invention. The flowchart which shows the contribution reproduction | regeneration processing of the karaoke apparatus which concerns on embodiment of this invention. The figure which shows the data structure of the composite contribution information which concerns on embodiment of this invention. The figure which shows the data structure of the fixed form message information which concerns on embodiment of this invention. The figure which shows the mode of the karaoke apparatus at the time of the contribution reproduction | regeneration processing which concerns on embodiment of this invention, and a monitor The figure which shows the mode of the monitor at the time of the preview process which concerns on embodiment of this invention The figure which shows the data structure of the composite contribution information which concerns on embodiment of this invention. The flowchart which shows the contribution process which concerns on embodiment of this invention The figure which shows the data structure of the composite contribution information which concerns on embodiment of this invention. The figure which shows the mode of the monitor at the time of the preview process which concerns on other embodiment of this invention. The figure which shows the mode of the monitor at the time of the preview process which concerns on other embodiment of this invention. The figure for demonstrating the posting transmission to SNS in other embodiment of this invention. The figure which shows the mode of the monitor at the time of the contribution reproduction | regeneration processing which concerns on embodiment of this invention

  The karaoke apparatus of the present embodiment is used in a karaoke posting system that can enjoy duets, choruses, and the like in karaoke. FIG. 1 is a diagram for explaining the outline of this karaoke posting system. The flow of karaoke posting will be briefly described using this figure. Here, a case where singing voice is recorded will be described, but in reality, video recorded by a camera is accompanied.

  First, the singer performs singing according to the performance at a place where the karaoke system is installed, such as a karaoke box, and the singing voice is recorded (a). The karaoke system is composed of a karaoke device (also called “commander”), a lyric image output from the karaoke device, a monitor on which a background image is displayed, and a remote control device that transmits the operation from the operator to the karaoke device. The singing voice is recorded as first posting information in recording means such as a hard disk built in the karaoke apparatus.

  The singer can also reproduce the first posted information in order to confirm the recorded singing voice (b). If the singer wishes, the first posting information is uploaded on the host device and can be disclosed via the Internet (c). The published first posted information is downloaded by the karaoke system by the singer who wants to sing along with the singer (d).

  The content of the downloaded first posted information can be confirmed by playing it along with the music (e). The downloaded first posting information is reproduced together with the music on the karaoke device, and the singer can enjoy a duet with the first posting information recorded in advance. Furthermore, the singing voice of the singer who sang together with the first post information is recorded in the karaoke apparatus as the second post information (f). The recorded second posted information can be reproduced in synchronization with the first posted information and the music, and the singer can check his / her song in a duet format (g).

  The singer can upload the second posting information to the host device as a new posting. The second posted information can be reproduced together with the first posted information. However, since the first posted information is stored in the host device, only the second posted information is transmitted. The second posting information is given identification information of the second posting information in order to be associated with the first posting information (h).

  The first posting information and the second posting information stored in the server device are downloaded to a PC (personal computer) or a karaoke system according to a request from the user, and are based on the first posting information, the second posting information, and the music information. It is possible to enjoy collaboration among multiple singers (i). As mentioned above, although the collaboration based on the 1st contribution information and the 2nd contribution information was explained, the collaboration of two or more persons becomes possible by repeating (d) and (f)-(h).

  As described above, in the karaoke posting system of this embodiment, duet and choral can be enjoyed with a partner who is not present on the spot. Here, only the singing voice has been described, but when applied to the present invention, shooting with a camera and recording of video information are performed together with the singing voice in the karaoke apparatus.

  Next, an embodiment of a karaoke system that enables photographing by the camera 45 together with singing recording will be described with reference to FIG. FIG. 2 is a diagram showing a configuration of the karaoke system according to the embodiment of the present invention. The karaoke system in this embodiment includes a karaoke device 2 (commander) and a remote control device 1. In the example shown in FIG. 2, the remote controller 1a, the remote controller 1b, and the two remote controllers 1 are used for one karaoke apparatus 2. Since these remote control devices 1a and 1b have the same configuration, the remote control device 1 will be described. The karaoke device 2 and the remote control device 1 are connected so as to form a network using the LAN 100 and the access point 110.

  The karaoke apparatus 2 installed in a store such as a karaoke box includes an acoustic control unit 70 as a playing means for playing music. Moreover, the karaoke apparatus 2 includes an operation unit 21 as input means on the karaoke apparatus 2 side, which includes switches that accept various inputs from the user. The karaoke apparatus 2 includes an operation processing unit 22 that interprets an input from the operation unit 21 and transmits the input to the control unit 30. The karaoke apparatus 2 includes an HDD 32 (hard disk) as karaoke apparatus side storage means for storing various information. The karaoke apparatus 2 includes a LAN communication unit 24 as karaoke apparatus side communication means for connecting to the LAN 100 and joining the network.

  Further, the karaoke apparatus 2 includes video reproduction means for displaying lyrics video and background video on the monitor 41. This video playback means includes a video playback unit 29 for playing back video based on video information, a video RAM 28 for temporarily storing the video to be played back, a lyrics telop superimposed on the played back video, and a video effect is added. The video control unit 31 is configured.

  Furthermore, in this karaoke apparatus 2, various information can be displayed on the touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 is configured by superimposing a display unit 35 that displays video information input from the video control unit 31 and a touch panel 34 that outputs a touch input position to the operation processing unit 22. Various operations on the karaoke apparatus 2 can also be performed via the operation unit 21 provided on the front panel of the karaoke apparatus 2 or the like.

  The touch panel monitor 33 of the present embodiment can also function as an operation unit similar to the touch panel 11 that is an operation unit of the remote control device 1. The user can use the same operation means function as that of the remote control device 1 such as selecting music from the touch panel monitor 33 and causing the karaoke device 2 to make a reservation directly.

  Furthermore, the karaoke apparatus 2 includes a control unit 30 constituted by a CPU and a memory 27 for temporarily storing information necessary for executing various programs as control means for controlling and controlling each component. It is prepared for.

  With such a configuration, the karaoke apparatus 2 performs various processes, but as a main function of the karaoke apparatus 2, a music designation process, a music reproduction process, and the like can be performed. The music designation process is a process for designating and reserving music based on designation from the user, and is executed in cooperation with the remote control device 1. The reservation information transmitted from the remote control device 1 is registered in the reservation table stored in the memory 27. The music playback process is a process of playing a reserved music, and the performance process and the lyrics playback process are executed in synchronization.

  The performance process is a process for causing the sound control unit 70 to perform the performance data included in the music data. The music played by the acoustic control unit 70 is emitted from the speaker 42 together with the singing voice input from the singing microphones 44a and 44b. The lyrics reproduction process is a process for assisting the singing by displaying the lyrics data included in the music data on the monitor 41. A background video display process for superimposing a background video on the lyrics displayed in the lyrics reproduction process may be executed.

  A camera 45 is connected to the karaoke apparatus 2 as an imaging means for photographing the state of singing. The camera video from the camera 45 can be recorded on the HDD 32 as a recording means and displayed on the monitor 41 in real time via the video control unit 31 responsible for video input / output. Furthermore, simultaneously with the video information from the camera 45, the moving image information included in the composite post information can be displayed on the monitor 41. FIG. 12 shows a display example of the monitor 41 when there are three collaborators. As shown in FIG. 12, the video signal input from the camera 45 is displayed in real time in the moving image display area B1, and the video based on the moving image information previously captured and recorded is displayed in the moving image display area A1. Is displayed.

  On the other hand, the remote control device 1 transmits various instructions to the karaoke device 2 such as reservation information, and receives various information from the karaoke device 2 or the host device 5 connected on the Internet. In the present embodiment, an operation unit 17 such as a button and the touch panel monitor 11 are provided as user interfaces. The touch panel monitor 11 includes a display unit 11a and a touch panel 11b, displays various interfaces on the display unit 11a, and can accept a touch input from a user.

  Further, the remote control device 1 controls the memory 14 as a remote control side storage means for storing a database, various programs required for music search, and various information generated in accordance with the execution of the program, and these configurations. Remote control side control means. The remote control side control means includes a control unit 15 constituted by a CPU, a video control unit 13 for forming a video to be displayed on the display unit 11a, a video RAM 12 for temporarily storing video information to be displayed, and an operation unit 17. The operation processing unit 18 that interprets and transmits the input to the control unit 15 is included.

  Further, the remote control device 1 is connected to a network constituted by the LAN 100 by being wirelessly connected to the access point 110 by the wireless LAN communication unit 16. Each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

  With such a configuration of the remote control device 1, various inputs from the user (for example, login information to the host device 4, SNS account information, or message text input) are received from the touch panel monitor 11 or the operation unit 17. At the same time, it is possible to give various instructions such as music reservation to the karaoke apparatus 2 by providing various kinds of information by displaying the video information on the touch panel monitor 11.

  FIG. 2 is a diagram showing a top screen according to the embodiment of the present invention, that is, a screen immediately after starting the remote control device 1. In the present embodiment, various information is provided to the user who operates the remote control device 1 by displaying on the touch panel monitor 11 of the remote control device 1.

  The karaoke system of the present embodiment can log in by inputting authentication information (user identification information and password described later) from the touch panel monitor 11 of each remote control device 1. In particular, in the karaoke system of the present embodiment, a plurality of users can be logged in for each user, and information regarding each logged-in user (logged-in user) is always displayed at the top of the screen. In the present embodiment, a login user column 103 for displaying each user's image (avatar) is provided as information regarding each logged-in user. In addition to the image imitating a person or a character, various forms such as figures and symbols can be adopted as the portrait image.

  In addition, a guest icon 102 for a user who does not have an account and a user changeover switch 101 for switching the user are displayed. The logged-in user can receive various services using his / her user information by selecting a portrait image displayed in the logged-in user column 103 or operating the user changeover switch 101. Further, a user who does not have an account can receive a general service such as music selection by operating the guest icon 102. Note that when switching users, authentication such as a password may be performed, but switching may be performed simply without performing authentication.

  FIG. 4 is a diagram for explaining user information stored in the host device 5 for each user. In the present embodiment, the user information includes various information related to the user such as personal information, a my song table, and a my artist table. The user information is stored in advance in the storage unit of the karaoke host. The user information is associated with user identification information and a password for the user to log in to the host device 5 from the remote control device 1 and use the information. The personal information includes a user name (not limited to an actual name but may be a nickname), gender, age, song age, place of residence, hobby, and the like. These various types of information can also be set by logging in with the remote controller 1 or a personal computer (not shown) connected to a network such as the Internet, a portable information terminal, or the like. If the association between the remote control device 1 and the karaoke device 2 (namely, clinging) is completed in advance, various information input from the operation unit 17 of the remote control device 1 is sent to the karaoke device 2, and the karaoke device 2 You may log in to the host device 5.

  In particular, the personal information of the present embodiment includes account information of the SNS in order to post the singing situation to a social network service (hereinafter abbreviated as “SNS”). The account information includes user identification information (SNS_ID) in SNS and a password for logging in (SNS_password). When the SNS account information is registered in the personal information as in this embodiment, when logging in to the host device 5 from the remote control device 1 or the karaoke device 2, the user of the logged-in user is displayed in the host device 5. SNS account information is extracted from the information. The extracted SNS account information and the login authentication result (permission) are sent to the remote control device 1 or karaoke device 2 used by the logged-in user. Along with reservations and performances, it is possible to log in to the SNS based on the extracted account information, post a message, and receive a reply. Currently, a plurality of SNS services such as Twitter and Facebook (both are registered trademarks) are provided as SNS.

  In the karaoke apparatus 2 of the present embodiment, a plurality of SNSs may be usable. In this case, account information is stored for each SNS in the personal information, and posting is executed for all registered SNSs or SNS selected by the user. Some users do not want to store SNS account information (especially passwords) in user information used in the karaoke service. In such a case, every time you log in to the karaoke system, you will be prompted to enter your SNS password if your SNS user identification information and password are registered. It is good also as logging in to SNS.

  The My Uta table is a table that stores music registered by the user, and includes music identification information, pitch adjustment values, past singing grading information (highest or past multiple times), and the like. ing. Based on this My Uta table, the user can call, reserve, and play a favorite song registered in the past. At that time, by using the registered pitch adjustment value, it is also possible to perform (reproduce) with a pitch suitable for one's own song.

  The my artist table is a table for storing artists (singer) registered by the user, and includes singer identification information. Based on this My Artist table, the user can call, reserve, and perform a favorite favorite artist's song (a song or a related song).

  The history table is information that records various types of information related to the music that the user has played in the past. In the present embodiment, the music identification information of the music, the performance of the music that has been played in the past (the user has reserved and played) Singing date and time indicating the date and time, scoring information, and the like. Based on this history table, the user can call and sing songs that have been played in the past.

  FIG. 5 is a diagram showing how user information is transmitted and received. A user who visits the karaoke store inputs his / her own user identification information and identification information including a password, or reads the identification information stored in the IC card with an IC card reader provided in the remote control device 1 or the like. Thus, the authentication process S101 is executed. The karaoke device 2 or the remote control device 1 that has read the user identification information transmits the identification information to the host device 5 (S102), and the host device 5 that has received the identification information corresponds to the corresponding information from the database stored in the storage unit 51. The user information of the user to be extracted is extracted (S121) and transmitted to the karaoke device 2 or the remote control device 1 that has made an inquiry (S122).

  On the karaoke device 2 side that has received the user information (S103), various service processes such as a music selection process and a performance process are provided based on the received user information (S104). When logout is requested by the user (S105), the service processing is interrupted, and various information (logs) during the service processing or user information reflecting the setting change by the user is transmitted to the host device 5 (S106). Here, user information may transmit only the updated difference other than transmitting all information. In the host device 5 that has received the user information (S123), the database stored in the storage unit 51 is updated based on the received user information (S124).

  The flow from one user authentication process (login process) to logout has been described above. However, in the karaoke apparatus 2 and the remote control apparatus 1 of the present embodiment, a plurality of authenticated users (authenticated users) log in simultaneously. The user providing the service (hereinafter referred to as “active user”) can be switched and used by using the user interface described in FIG. Yes.

  FIG. 6 is a diagram showing an active user top screen according to the embodiment of the present invention. As shown in this figure, when a plurality of users are logged in, the logged-in user column 103 displays the logged-in images 103a to 103e (face portions in this embodiment) of the logged-in user. In the logged-in user column 103, the user whose background is highlighted at the right end is the active user 103e. In the state shown in the figure, the service for the active user 103e, that is, the user information of the active user 103e is used. The service is running. On this active user top screen, by selecting “Search for a song”, a search based on a singer name and a song name can be performed as in a conventional song book. In addition, by selecting “posted moving image” provided on the active user top screen, it is possible to reproduce a song posted by another user.

  After the active user selects this “posted moving image” and searches for the music, the music confirmation screen shown in FIG. 6 is displayed. The music confirmation screen displays the music name, singer name, user name of the contributor, and the like to confirm that the music to be reserved is correct. At that time, the song confirmation screen is provided with “collaboration recording setting” 爛. When “ON” is designated, the singer's singing state is recorded and recorded in accordance with the music to be played. Processing is executed. On the other hand, when “OFF” is designated, the process of recording and recording the state of the singer's singing is not executed, and only the reproduction of the posted moving image is executed.

  When the “reservation” button is operated on the music confirmation screen, reservation information including user identification information, music identification information, collaboration recording settings, and the like is transmitted from the remote control device 1 to the karaoke device 2. The received karaoke apparatus 2 sequentially adds reservation information to the reservation table and executes main processing.

  FIG. 8 is a flowchart showing the main processing according to the actual child form of the present invention. In the karaoke apparatus 2, the reservation list is confirmed as needed, and the type of reservation to be executed next is determined (S201). When the next reservation type is “normal reservation” on the reservation list, normal music reproduction (S202) for reproducing the composite post information corresponding to the designated post identification information is executed. The user can enjoy viewing the composite post information or singing in accordance with it (without recording).

  On the other hand, if the next reservation type is a collaboration reservation on the reservation list, it is determined in S203 whether or not it is the first posting (first posting). In the case of the first posting, since there is no composite posting information to be played back simultaneously, music playback (S205) and recording (S206) are started. On the other hand, if post information posted in advance is specified, that is, if it is the second or subsequent post, it is determined whether or not the composite post information specified in the collaboration reservation has been downloaded to the karaoke apparatus 2. If it has not been downloaded, the target post information is downloaded from the server device (S204).

  FIG. 10 shows the data structure of the composite post information (at the time of one collaboration) at the time of download. Post information of this embodiment includes post identification information (post ID) for identifying post information, music identification information (music ID) of the music used during recording, composite video, post message information, number of collaborations, collaboration user information It is included. The composite moving image includes composite recording information and composite recording information. The composite recording information is video information formed by combining recording information (unit recording information) included in each posting information among posting information performed a plurality of times. The composite recording information is audio information formed by combining recording information (unit recording information) included in each posting information among posting information performed a plurality of times and posting information performed a plurality of times. Since the example of the composite posting information shown in FIG. 10 is the first posting, the composite video is composed only of the recording information (unit recording information) and recording information (unit recording information) of the user A.

  In the present embodiment, the composite recording information is generated by mixing the unit recording information obtained by recording the voice of the singer and the previous recording information. In the present embodiment, a composite video of one file is generated by encoding a plurality of unit videos in the server device. In addition to such a form, a composite moving picture may be formed as a set of unit moving pictures by a plurality of files, and the karaoke apparatus 2 may combine a plurality of unit moving pictures and display them in one screen.

  The posted message information is information related to a message posted by the user who made the posting (in this case, user A) during singing. In the present embodiment, the posted message information includes a user ID, display start timing, and message content. Yes. The user ID is identification information of the user who posted the message during singing, and the display start timing is information indicating the display start timing of the message during music reproduction. As the display start timing, it is possible to use an appropriate unit such as a MIDI clock in addition to the minute and second indicating the elapsed time from the start of music reproduction. The message content is information indicating the posted message. In this embodiment, a fixed message can be used. When a standard message is used, a message ID (message identification information) is recorded in the message content. It is also possible to handle a message (free message) other than the fixed message, and in this case, a message formed of text information is recorded in the message content.

  The collaboration user information is information related to posting and the posted user. , Including user identification information (user ID). Collaboration No. Is information indicating the order of collaboration. The composite post information shown in FIG. 10 is composite post information downloaded for use in the second collaboration, and various information related to the (first) collaboration is registered in this composite post information.

  After downloading the composite posting information (S204), based on the downloaded composite posting information, the music information corresponding to the music identification information included in the composite posting information is played (reproduced) by the performance means (S205). In synchronism with this performance processing, lyrics display processing for displaying the lyrics information in the music information on the monitor 41 is also executed. Then, recording of the state of singing is started by the camera 45 (S206). In synchronization with this, a post reproduction process (S300) is executed. In this posting reproduction process, the composite moving image included in the composite posting information is reproduced, and the video recording unit 29 reproduces the composite recording information in the composite moving image, and the audio recording unit 25.

  FIG. 9 is a flowchart showing the post reproduction processing according to the embodiment of the present invention. In the present embodiment, during the execution of the posting reproduction process, a process of receiving a message related to the singing situation from the singing user is executed. The singer can input a message related to the singing situation using the touch panel monitor 33 installed on the front panel of the karaoke device 2, the touch panel monitor 11 of the remote control device 1, and the like. In particular, in the present embodiment, it is possible to input a message by selecting a fixed message displayed according to the progress of the music. Hereinafter, the message input will be described from the touch panel monitor 33.

  FIG. 11 is a diagram showing a data structure of the fixed message information according to the embodiment of the present invention. A plurality of the fixed message information is stored in a storage unit such as the HDD 32 of the karaoke apparatus 2. In the present embodiment, posting to the SNS can be performed by a simple operation of selecting (touch input) a message displayed on the touch panel monitor 33 without inputting a message with an input means such as a keyboard. Therefore, even a user who sings with the microphone 44 for singing in hand can easily post the situation of singing in real time. The message information of the present embodiment adopts a data configuration that can be used in common for a plurality of music pieces that can be played by the karaoke apparatus 2. The message information of the present embodiment includes a message ID (message identification information) start timing, end timing, and message content.

  The start timing and end timing are timing information associated with the progress of the music, and various information indicating the progress of the performance such as the time from the start of the performance or the number of MIDI clocks from the start of the performance can be specified. is there. When a message is to be displayed in association with a musical performance section (prelude, A melody, B melody, chorus, and subsequent performance), the start timing and end timing indicating each performance section of the performance information are used. . In this case, section information indicating the current performance section is included in the performance information in advance, the current performance section is determined according to the output of the section information, and the start timing and end timing in the message information are determined. The message contents corresponding to each performance section can be displayed. The start / end timing may not be used. In that case, it is possible to display the message content through one piece of music, or to display the message content at random for each appropriate period of one piece of music.

  The message content is composed of message text, pictographs, image information, and the like. Examples of various message contents are shown in the figure. In this example, information related to the currently played music and singing situation is input and displayed in the field indicated by the brackets “”. For example, the name of the currently playing song is displayed in the “music name” column, and the artist name (singer name) corresponding to the currently playing song is displayed in the “artist name” column. . In the “scoring information” field, the scoring information scored by the scoring function of the karaoke apparatus 2 is input and displayed. In the present embodiment, information related to the currently played music is input and displayed in the fixed message content. In this way, as information related to the music and singing situation, in addition to the music name, singer name, scoring information, the location and the name of the singing, the user name logged in at the same time, the number of songs sung that day, etc. It is possible to do. In addition, you may comprise so that the information relevant to a music and a singing situation may be attached to the message content to transmit instead of including in a message content, and can be browsed by the receiving side.

  In the present embodiment, the message information is configured to be versatile so that it can be used for a plurality of pieces of music, but the message information may be provided for each piece of music. In that case, music identification information is given to the message information, and message information corresponding to the music is used in the performance process. In such a form, it is possible to make the message display, end timing, and message content suitable for each music piece.

  Returning to the performance processing of FIG. 9, the control unit 30 monitors the start timing in the standard message information to be displayed stored in the HDD 32 for the music being played (S301), and displays it based on the start timing. The presence / absence of a fixed message is determined (S302). If it is determined that there is fixed message information to be displayed (S302: Yes), the fixed message is displayed on the display means based on the message content in the fixed message information (S303). In the present embodiment, the touch panel monitor 33 is employed as a message display means. In addition to the touch panel monitor 33, the display means includes a monitor 41 connected to the karaoke device 2 and a touch panel monitor 11 of the remote control device 1. Etc. can also be used.

  FIG. 12 shows the state of the karaoke apparatus 2 and the monitor during performance processing according to the embodiment of the present invention. The monitor 41 is provided with moving image display areas A1 and B1, and the moving image display area A1 reproduces and displays the combined moving image information (state of Mr. A's singing) in the combined posting information. On the other hand, in the moving image display area B1, a video being captured by the camera 45 (a state where Mr. B is singing) is displayed in real time. At this time, it is preferable to display the captured image in a state in which left and right are determined in the moving image display area B1. The user who sings can visually recognize his / her appearance in the same state as that reflected in the mirror, and can confirm a video with no sense of incongruity. Further, in the present embodiment, positions corresponding to the moving image display areas A1 and B1 (below the moving image display areas A1 and B1) and message display areas M1 and M2 are provided. In the message display area M1, a message is displayed based on the posted message information associated with the user ID of Mr. A in the composite posted information.

  As described with reference to FIG. 10, the posted message information includes a user ID, a display start timing, and message contents, and a message corresponding to the message contents is displayed at the display start timing as the music performance progresses. The When a standard message is used, a message corresponding to the message ID recorded in the message content is displayed. In the present embodiment, when the display start timing arrives, a display form is employed in which messages corresponding to the message contents are scroll-displayed from the right side to the left side of the message display area M1. In addition to the scroll display, various display forms such as displaying a message for a predetermined time at a fixed position can be adopted as the display form.

  In addition, on the touch panel monitor 33 installed on the front panel of the karaoke apparatus 2, a fixed message composed of message contents in the fixed message information is displayed in the message display frames E 1 and E 2. In this embodiment, a plurality of standard messages are displayed at the same time, and the user can select and input a desired standard message from a plurality of candidates. As will be described in the touch panel monitor 33, when the message display frames E1 and E2 are selected (touched) (S305: Yes), the messages displayed in the message display frames E1 and E2 are information to be posted in the future. Stored in (unit posting information). The posted message is deleted from the touch panel monitor 33 (S307). By executing such post reproduction processing, it becomes possible for a user who submits a song to convey various messages in words to a collaborator or a user who views the composite post information formed by the post. In addition to the conventional collaboration service, communication between users can be achieved.

  The recording of the singer described above is continued until the reproduction of the music ends (S308: Yes), and after the reproduction of the music ends, unit moving picture information (unit recording information, unit audio information) is generated (S207). . The user can select a preview process to confirm the unit moving image information (S209). The preview process (S209) is a process for reproducing the unit recording information in synchronization with the reproduction of the music information. FIG. 13 shows the state of the monitor 41 during the preview process. The monitor 41 displays the moving image display area A1 and the message display area M1 related to Mr. A, and the moving image display area A2 and the message display area M2 related to Mr. B who sang this time, as in the post reproduction process. . Note that, during recording, the video is displayed in the moving image display area B1 in a state where left and right are determined, but during reproduction, the moving image display area B1 is displayed in a state where it is not horizontally reversed.

  The user can upload unit posting information including the generated unit moving image information to the host device. When uploading the unit posting information is selected (S210: Yes), the karaoke apparatus 2 sends the unit posting information including the generated unit recording to the server via the LAN communication unit 24 as a communication unit. An upload process (S211) to be transmitted to the apparatus is executed.

  FIG. 14 shows the data structure of unit posting information to be uploaded. This unit post information includes post identification information (post ID) attached to the composite post information used when posting, music identification information (music ID) of the used music, post message information, unit video information, User information related to the user who specified the music is included. The posted message information includes the user ID that has input the message, the display start timing that is the message input timing when the music progresses, and the message content. As the message content, it is possible to use a free message composed of text information in addition to the message ID of the standard message information. The user information includes a collaboration No. indicating how many times the collaboration has been performed. And user identification information of the user who performed the collaboration.

  As described above, in this embodiment, it is possible to post a message related to the singing situation by a simple operation of touch-inputting a fixed message displayed on the touch panel monitor 33. When the monitor 41 or the touch panel monitor 11 of the remote control device 1 is used as a message display target, the message is selected by operating the operation units 21 and 17, and the message is recorded in information to be posted (unit posting information). The Post message information is uploaded to the host device and then released to many users. In such a case, it is necessary for the karaoke dealer to check (censor) whether or not an inappropriate message containing words that are contrary to slander and public order and morals to others is posted. When a standard message is used as in the present embodiment, a standard message prepared on the karaoke trader side is used, so that it is possible to reduce the trouble of message censorship at the time of publication. Even when a free message that allows a user to post a free sentence is adopted, it is only necessary to censor only the free message except for the standard message, and the labor of the karaoke trader can be sufficiently reduced.

  FIG. 15 shows a posting process when posting is made in the form of FIG. 12 (in the case of two collaborations). This posting process is a series of processes performed between the karaoke apparatus 2 and the host apparatus. On the host device side, composite post information is created in advance using unit post information B (subscript indicates a symbol attached to the posted user name) and stored in the storage unit 51. When composite post information is designated on the karaoke device 2 side (S401) and post identification information (post ID) is transmitted to the host device side (S402), the host device stores the composite post information corresponding to the post identification information. Obtained from the unit 51 (S451), and transmitted to the requested karaoke apparatus 2 (S452). The karaoke device 2 creates unit posting information A shown in FIG. 14 based on the composite posting information received (S403) and transmits it to the host device through the process described in the main processing of FIG. 8 (S404). The host apparatus that has received the unit posting information A (S453) uses the received unit posting information A and the unit posting information B that is the basis for creating the composite posting information used for posting, to create a new composite posting. Information (new composite posting information) is created (S454). The newly created new posting information is used for the next posting process.

  As described above, in the present embodiment, a composite video is formed by combining and encoding a plurality of unit videos on the host device side. However, the composite video provided to the karaoke device 2 includes a plurality of unit video information ( (Multiple files). In such a form, on the karaoke apparatus 2 side, a plurality of unit moving images can be combined and reproduced as a composite moving image.

  In the embodiment described with reference to FIGS. 12 and 13, the message display areas M1 and M2 are provided at positions corresponding to the moving image display areas A1 and B1 as the correspondence relationship between the moving image display areas A1 and B1. . The form of the correspondence between the moving image display areas A1 and B1 and the displayed message is not limited to such a form, and various forms can be adopted.

  FIG. 17 shows the state of the monitor 41 during preview processing according to another embodiment of the present invention. In the present embodiment, a common message display area M is provided to display a message. At that time, by attaching the user name displayed on the upper right of the moving image display areas A1 and B1 to the displayed message, it is possible to determine which user the message is. In addition, the correspondence between the messages displayed in the moving image display areas A1 and B1 is displayed such that the outer frame of the moving image display areas A1 and B1 is displayed in a unique color and the display color of the corresponding message is the same color as the outer frame You may make it recognizable.

  FIG. 18 shows the state of the monitor 41 during the preview process according to another embodiment of the present invention. This embodiment differs from FIG. 17 in that a plurality of users' messages are displayed in a common message display area M, and this embodiment differs in that the number of collaborations is 6 users. . Even when the number of collaborations increases in this way, by using the common message display area M, each of the video display areas A1 to F1 can be widened, and the video display areas A1 to F1 are displayed. It is possible to recognize the correspondence between messages.

  As described above, in the embodiment described above, the message input during singing is included in the unit posting information and posted, but the message input during singing may be posted to the social network service (SNS). FIG. 19 is a diagram for explaining posting transmission to the SNS according to another embodiment of the present invention. The karaoke apparatus 2 can communicate with the host apparatus 5 or various user terminals 7a to 7c via a network (Internet). In the figure, a host device 5 is connected to a network via a router 6, and a user terminal 7 c such as a mobile phone or a smartphone is wirelessly connected to the network via a radio base station 8.

  Under such a network environment, a message input to the karaoke apparatus 2 can be transmitted to a user who uses the user terminals 7a to 7c using SNS. In SNS, it is necessary to log in to identify a user. In the present embodiment, by storing SNS account information (SNS_ID and SNS_password) in the personal information of FIG. 4, when logging in to the karaoke system, the SNS is also logged in. The music performed in the performance process can specify the user who sings with the user identification information included in the reservation information. Therefore, in the performance process for each musical piece, the SNS and account associated with the user who sings are specified as posting targets. In addition, in the case of a guest user who does not have user information, it is good also as logging in to SNS and performing posting for every performance process.

  During the posting reproduction process described with reference to FIG. 9, in parallel with the process of storing the standard message (S306), the standard message is posted to the logged-in SNS, and the message is sent to the user using the user terminals 7a to 7c. Communicated. The same applies to not only fixed messages but also free messages. In addition, the SNS can reply to posted messages, and the reply message may be displayed on the monitor 41 together. FIG. 20 shows the state of the monitor 41 during the post reproduction process according to the embodiment of the present invention.

  In the display example of FIG. 20, a message corresponding to the user is displayed in the moving image display areas A1 and B1. In the moving image display area B1 of the user who is currently singing, in addition to the user's own input message displayed on the left side, a reply message D returned to the input message is displayed on the right side. In the reply message, the user name in the SNS of the user who sent the reply is also written. Thus, it becomes possible to expand the range of communication by posting the message input during singing to SNS. Both the input message and the reply message D are displayed at the input timing, and scrolled from the bottom to the top (possible from the top to the bottom). By displaying the input message and the reply message in this manner, it is possible to communicate by a message between a singing user and an external user (a user using SNS) during the singing period.

  The reply message from the SNS may be included in the unit posting information to be transmitted to the host device, or may not be included in the unit posting information. When included in the unit posting information, the reply message D may be included in the composite posting information, and when the composite posting information is reproduced, the communication by the message between the user and the user using the SNS may be reproduced.

1a, 1b ... remote control device 27 ... memory 11 ... touch panel monitor 28 ... video RAM
11a ... Display unit 29 ... Video playback unit 11b ... Touch panel 30 ... CPU
12 ... Video RAM 31 ... Video control unit 13 ... Video control unit 32 ... HDD (hard disk)
DESCRIPTION OF SYMBOLS 14 ... Memory 41 ... Monitor 15 ... CPU 42 ... Speaker 16 ... Wireless LAN communication part 44a, 44b ... Microphone for singing (microphone)
DESCRIPTION OF SYMBOLS 17 ... Operation part 45 ... Camera 18 ... Operation processing part 5 ... (Karaoke) host apparatus 19 ... Infrared communication part 51 ... Storage apparatus 2 ... Karaoke apparatus (commander) 6 ... Router 21 ... Operation part 7 ... User terminal 22 ... Operation process Unit 8 ... Radio base station 23 ... Infrared communication unit 100 ... LAN
24 ... LAN communication unit 110 ... access point 25 ... acoustic control unit 120 ... router

Claims (6)

A karaoke apparatus comprising a performance means and a control means,
The performance means can perform performance information,
The control means can execute the reception process, the recording performance process, and the posting process,
Receive processing receives post information,
The posting information includes recording information, recording information, and posting message information.
In the recorded performance processing, performance information corresponding to a specified music piece is played, recording information and recording information are reproduced, input video input from the camera and singing voice input from the microphone are recorded, and the input video is recorded. Recording information, posted message information, and input message information input from the input unit are displayed on the display means,
The posting process transmits the input video recorded during the recording performance process, the singing voice, and the input message information input during the recording performance process to the host device,
The input message information is input by presenting a fixed message corresponding to the music being played to the user during the recording performance process and causing the user to select the fixed message. A karaoke apparatus comprising a performance means and a control means,
The performance means can perform performance information,
The control means can execute the reception process, the recording performance process, and the posting process,
Receive processing receives post information,
The posting information includes recording information, recording information, and posting message information.
In the recorded performance processing, performance information corresponding to a specified music piece is played, recording information and recording information are reproduced, input video input from the camera and singing voice input from the microphone are recorded, and the input video is recorded. Recording information, posted message information, and input message information input from the input unit are displayed on the display means,
The posting process transmits the input video recorded during the recording performance process, the singing voice, and the input message information input during the recording performance process to the host device,
Input of the input message information is performed by presenting a fixed message corresponding to the progress of the music being played to the user during the recording performance process, and causing the user to select the fixed message. The karaoke apparatus according to claim 1 or 2, wherein the recorded performance process is displayed so that the correspondence between the input video and the input message information and the correspondence between the recorded information and the posted message information can be recognized. The karaoke apparatus according to any one of claims 1 to 3, wherein the recording performance process displays the input message information and the posted message information in the same area provided in the display screen of the display means. The control means can execute a login process and a message posting process,
The login process logs the user in,
The karaoke device according to any one of claims 1 to 4, wherein the message posting process posts and transmits the input message information input during the recording performance process to an account of a social network service of a user who designates the music piece. . The karaoke apparatus according to claim 5, wherein the recorded performance process causes the display unit to display response message information posted to the input message information posted and transmitted in the message posting process.