JP2015143762A - Karaoke system and karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow an applicant to select and determine a recruiter by referring to transition of a display mode of singing video expected during duet communication.SOLUTION: A karaoke system includes: recruitment procedure processing, by a karaoke device 4 at a recruiting side, of registering recruitment application information including setting of a video mode with a server 2; application procedure processing, by a karaoke device 4 at an applicant side, of setting a video mode by the melody block unit of music and browsing recruitment application information on the same music registered with the server 2; processing of estimating time series traffic transition on a network NW between the applicant side karaoke device 4 and the recruiting side karaoke device 4 by the melody block unit; processing of displaying, as a list, mode execution likelihood indicating execution possibility of the video mode on the applicant side karaoke device 4 on the basis of the time series traffic transition by the melody block unit; and processing, by the applicant side karaoke device, of determining the opposite recruiting side karaoke device 4.

Description

  The present invention relates to a karaoke system that performs duet communication between two karaoke apparatuses via a network, and a karaoke apparatus.

  For example, as disclosed in Patent Document 1, the same music is played synchronously among a plurality of karaoke apparatuses capable of transmitting and receiving information to and from each other via a network, and audio data and video data during each singing are performed. A technique of duet communication is disclosed in which a message is transmitted / received to / from each other.

JP 2005-77485 A

  When both users send and receive real-time moving images that are singing to each other during duet communication, the data transmission amount becomes very large. However, when video data is sent and received via a wide-area infrastructure network such as the Internet, for example, the amount of data that can be accepted for transmission, that is, traffic changes from moment to moment, and video data cannot be sent and received sufficiently depending on the timing. There is. The traffic situation may differ greatly depending on the combination of two karaoke apparatuses that perform duet communication.

  On the other hand, as a method for determining the combination of two karaoke devices that perform duet communication, applicants can arbitrarily choose from multiple registered information from recruiters who are seeking duet communication partners in advance. There is a method to decide by. Conventionally, when selecting applicants by such applicants, there has been an inconvenience that applicants cannot be selected in consideration of the difference in the display mode of the singing video depending on the mutual traffic situation.

  An object of the present invention is to provide a karaoke system and a karaoke apparatus in which an applicant can select and determine a recruiter with reference to a transition of a display mode of a singing video expected during a duet communication.

  In order to achieve the above object, a first invention has a server and a plurality of karaoke apparatuses capable of transmitting / receiving information to / from each other via a network, and determines a combination of two karaoke apparatuses that execute duet communication. A solicitation application for registering recruitment application information from the recruiting side karaoke apparatus to the server, including setting of the music to be subjected to duet communication and the video mode which is the display mode of the mutual singing video during the duet communication. From the procedural means and the karaoke device on the application side, set the target music for duet communication and the video mode in units of melody blocks of this music, and browse the application information for the same music registered in the server Recruitment corresponding to recruitment application information browsed by the first application procedure means, the application karaoke device, and the first application procedure means Traffic estimation means for estimating time-series traffic transition on the network with the karaoke device in units of melody blocks, and recruitment application information to be browsed by the first application procedure means, video mode set by the recruitment procedure means, First accuracy display means for displaying a list of mode execution accuracy indicating the feasibility of the video mode set by the first application procedure means on the application side karaoke device in units of melody blocks based on the time-series traffic transition; The application side karaoke device further comprises first partner device determination means for determining a recruitment side karaoke device of a partner to perform duet communication.

  The present invention determines a combination of two karaoke devices that execute duet communication among a plurality of karaoke devices that can transmit and receive information to and from each other via a network. In this duet communication, the same music is played in synchronization between the two karaoke apparatuses, and the audio data and video data during the singing are transmitted and received to each other to generate and display. First, the recruitment procedure for registering the recruitment application information in which the music to be sung is set in the server is performed by the karaoke apparatus used by the recruiter. After that, with the karaoke device used by other applicants, an application procedure is performed in which the music to be sung is set and the application information for the same music registered in the server is browsed. In this application procedure, there may be a case where a plurality of recruitment application information for the same music is registered, and the applicant selects one of the recruitment application information and decides the other party's recruitment karaoke apparatus for performing duet communication.

  On the other hand, when both users transmit and receive a moving image being sung in real time and display each other during duet communication, the data transmission amount becomes very large. However, when video data is sent and received via a wide-area infrastructure network such as the Internet, for example, the amount of data that can be accepted for transmission, that is, traffic changes from moment to moment, and video data cannot be sent and received sufficiently depending on the timing. There is. The traffic situation may differ greatly depending on the combination of two karaoke apparatuses that perform duet communication.

  Therefore, in the present invention, the display mode of the images during singing during the duet communication can be set in a plurality of video modes. For example, in addition to the video mode with the highest data transmission amount for sending and receiving whole body video images and displaying them, for example, in addition to the video (or still image) of each face alone, other parts are abstract video such as so-called avatars. A video mode with a reduced data transmission amount by replacing with a video mode, a video mode with the lowest data transmission amount to be displayed by replacing the whole body with an avatar, etc. are prepared. Note that it is assumed that both display in the same video mode during duet communication.

  In the recruitment process on the recruiter side, the video mode for the entire music is set in the recruitment application information. In addition, the applicant's application procedure sets the video mode for each melody block of the music, and lists the mode execution accuracy for each melody block that indicates the feasibility of the video mode set by the user when viewing each application information. indicate. This mode execution accuracy is based on the matching between the video mode of the entire music set in the recruitment procedure and the video mode in melody block units set in the application procedure, and the application side karaoke device and the recruitment application information being browsed Is identified and displayed based on the time-series traffic transition estimated in units of melody blocks on the network with the recruiting side karaoke apparatus corresponding to.

  Applicants can confirm the mode execution accuracy in units of melody blocks when performing duet communication with the corresponding recruitment karaoke device when browsing each recruitment application information, and refer to it for duet communication. Recruiters can be selected and determined.

  In this way, according to the present invention, information regarding the feasibility of the display mode of the singing video desired for the applicant can be presented in units of melody blocks for each recruitment application information, and the applicant refers to it. It is possible to provide the convenience of selecting and determining recruiters.

  In order to achieve the above object, the second invention is capable of transmitting / receiving information to / from a server and a plurality of recruiting karaoke devices via a network, and determining the karaoke device of the application side for duet communication. A karaoke apparatus, which sets a target music for duet communication and a video mode which is a display mode of a mutual singing video during duet communication in units of melody blocks of the music, and from the recruiting side karaoke apparatus to the server About the 2nd application procedure means to browse the application information for the same registered music and the application information to be browsed by the 2nd application means, it is included in the offer application information set in the offer side karaoke device In the video mode, the application karaoke device estimated by the server in units of melody blocks and the second application procedure means Based on the time-series traffic transition on the network with the recruiting side karaoke device corresponding to the recruiting application information to be viewed, the mode execution accuracy indicating the feasibility of the video mode set by the second application procedure means It has the 2nd accuracy display means which displays a list in a melody block unit, and the 2nd partner apparatus determination means which determines the offer side karaoke apparatus of the other party who carries out duet communication.

  According to the present invention, the applicant can select and determine the recruiter with reference to the transition of the display mode of the singing video expected during the duet communication.

It is a figure showing the whole karaoke system composition concerning one embodiment of the present invention. It is a functional block diagram which shows the main structures of the control system of a karaoke apparatus. It is a figure which shows the example of three video modes. It is a figure which shows an example of the screen for recruitment procedures displayed on the recruitment side karaoke apparatus. It is a figure which shows typically the recruitment application information database which a server memorize | stores. It is a figure which shows an example of the screen for application procedures displayed on an application side karaoke apparatus. It is a figure which shows the structural example of a melody block. It is a figure which shows an example of the recruitment application information list screen displayed on an application side karaoke apparatus. It is a figure which shows an example of the calculating formula which specifies the coincidence degree of desired video mode. It is a figure which shows an example of the recruitment application information detail screen displayed on an application side karaoke apparatus. It is a figure which shows typically the traffic history database which a server memorize | stores. It is a figure which shows the 1st example of the time series traffic transition in one router. It is a figure which shows the 2nd example of the time series traffic transition in one router. It is the sequence chart which put together the detail of the information transmitted between each apparatus in the process which determines the combination of duet communication. It is a flowchart which shows the processing content performed by CPU of a server. It is a flowchart which shows the processing content performed by CPU of the offer side karaoke apparatus. It is a flowchart which shows the processing content performed by CPU of the application side karaoke apparatus. It is a flowchart which shows the processing content performed by CPU of a router.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<Overall configuration of karaoke system>
The whole structure of the karaoke system concerning this embodiment is shown in FIG. The karaoke system 1 includes a server 2, a router 3 provided at each of a plurality of bases Q and R such as a store, and a plurality of karaoke apparatuses 4 connected to the router 3 at each base Q and R. The server 2 and a plurality of routers 3 are connected so as to be able to send and receive information via a wide area infrastructure network NW such as the Internet. In each base Q, R, a plurality of karaoke apparatuses 4 and routers 3 are connected via a local network such as a LAN. Connected to send and receive information. Each karaoke apparatus 4 includes at least a microphone 11, a speaker 12, a camera 13, and a monitor 14. In order to simplify the illustration, only two bases Q and R (two routers 3) are shown, but it is assumed that many other bases (multiple routers 3) are connected to the network NW. . Although not particularly illustrated, one karaoke device 4 may be connected to one router 3 at each site.

  In the illustrated example, the karaoke device 4B of the base Q and the karaoke device 4F of the base R perform duet communication. In this duet communication, the same music is played in synchronism between the two karaoke apparatuses 4B and 4F, and the audio data and the video data during the singing are transmitted and received to each other to be sounded and displayed on the other side. Due to this duet communication, users of the karaoke apparatuses 4B and 4F (X and Y in the figure) can simultaneously perform a duet singing (choral) while recognizing each other's singing behavior and voice while being between remote bases. )it can.

<Main components of karaoke equipment>
FIG. 2 is a functional block diagram showing the main configuration of the control system of the karaoke apparatus 4 capable of realizing the duet communication. The karaoke device 4 includes a main body device 20, a microphone 11 for inputting a singer's singing voice, and an amplifier 16 provided therein with a mixing circuit 15 for mixing a voice signal input from the microphone 11 and a reproduction signal of a song. A speaker 12 that reproduces the amplified signal output from the amplifier 16 as sound, a monitor 14 that displays a lyrics telop, a duet partner image described later, various operation screens, etc. on a CRT, and a camera 13 that shoots a singer And a remote controller 17 for remotely operating the main body device 20 via an infrared signal including processing request information.

  The main unit 20 connects a communication terminal 22 for connecting the wired LAN line 18, an audio input / output terminal 23 for connecting the amplifier 16, a video output terminal 24 for connecting the monitor 14, and the camera 13 to the apparatus housing 21. A video input terminal 25, a light receiving unit 26 that receives an infrared signal from the remote controller 17, an LED 27 that functions as a display unit that displays the operating state of the main unit 20, a numeric keypad that functions as an operation unit, a music selection button, and the like. Button / key 28 to be used.

  The main unit 20 is provided with a CPU 31 that executes various controls according to a control program. Connected to the CPU 31 are a RAM 32 for temporarily storing data relating to processing request information transmitted from the remote controller 17 and a ROM 33 in which programs executed by the CPU 31 and necessary data tables are stored. Further, the CPU 31 stores a video RAM 34 in which character video data for displaying lyrics telop and various message videos on the monitor 14, music data transmitted from the external server 2, lyrics data, video data, and the like. A network control unit 35 for receiving various data via the network NW such as the Internet, the router 3, the wired LAN line 18, and the communication terminal 22, and music data and moving image data received by the network control unit 35 An HDD 36 for saving is connected. The HDD 36 stores (stores) avatar video data and various databases, which will be described later, in addition to the background video data indicating the background video.

  Further, the CPU 31 is connected to a MIDI sound source board 37 that inputs MIDI data included in the song data read from the HDD 36 and outputs a sound source signal from a sound source specified by the input MIDI data. . The CPU 31 is connected to an audio control circuit 38 that inputs the output sound source signal and converts it into a signal that can be amplified by the amplifier 16. The CPU 31 is connected to a video control circuit 39 that performs video control for displaying the moving image data received from the server 2 on the monitor 14 via the video output terminal 24.

  Further, the CPU 31 is provided with an input circuit 40 for inputting a photographing signal from the camera 13, a conversion circuit 41 for converting an infrared signal received from the remote control 17 received by the light receiving unit 26 into a digital signal, and the apparatus housing 21. The display circuit 42 that outputs a display signal to the LED 27 that is lit when the various buttons and keys 28 are pressed, and the input circuit 43 that inputs a switching signal generated when the various buttons and keys 28 are pressed are connected. Has been.

<Features of this embodiment>
The karaoke system according to the present embodiment is characterized in a process of determining a combination of two karaoke apparatuses 4 that execute duet communication among a plurality of karaoke apparatuses 4 that can transmit and receive information to and from each other via a network NW (a diagram that will be described later). 14). As this process, first, a recruitment procedure is performed for registering recruitment application information in which a song to be sung is set in the server 2 with a karaoke apparatus used by the recruiter. After that, the karaoke apparatus used by other applicants sets up a song to be sung and performs an application procedure for browsing application information for the same song registered in the server 2 so far. In this application procedure, there may be a case where a plurality of recruitment application information for the same music is registered, and the applicant selects one of the recruitment application information and decides the other party's recruitment karaoke apparatus for performing duet communication.

  On the other hand, when both users transmit and receive a moving image being sung in real time and display each other during duet communication, the data transmission amount becomes very large. However, when video data is transmitted / received via a wide area infrastructure network NW such as the Internet, for example, the amount of data that can be accepted for transmission, that is, the traffic changes greatly every moment. In some cases, the video data may not be transmitted and received sufficiently, giving priority to display. The traffic situation may differ greatly depending on the combination of two karaoke apparatuses that perform duet communication.

  Therefore, in the present embodiment, the display mode of the images during singing during duet communication can be set in a plurality of stages of video modes. For example, as shown in FIG. 3A, a video mode is prepared in which moving images of the entire singer (that is, the entire video captured by the camera 13) are transmitted and received and displayed. This is not only the widest imaging area, but may also include movements around the singer, so the video data capacity is the largest, and the video mode requires the highest data transmission amount for the network NW. Hereinafter, this video mode is referred to as a “whole body” mode.

  In addition to this, as shown in FIG. 3B, for example, a video mode is prepared in which in addition to a moving image (or still image) of only each face, another body part is replaced with an abstract video such as a so-called avatar. This is because a part of the imaging area of the camera 13 is extracted, so that the volume of the video data can be reduced, and the data of the avatar itself is simply specified by the ID that is stored in the HDD in each karaoke device in common. Therefore, the amount of data transmission can be greatly reduced as compared with the whole body mode. Note that the face portion may be extracted by video processing using a known video recognition technique, and a user may arbitrarily select from a plurality of types of avatars prepared in advance. Hereinafter, this video mode is referred to as a “face + parts avatar” mode.

  In addition, as shown in FIG. 3C, for example, a video mode with the lowest data transmission amount is prepared by replacing the entire body (face + body) of the singer with an avatar. Hereinafter, this video mode is referred to as a “full avatar” mode.

  In the present embodiment, the above three video modes are prepared, but other modes in which the exposure level of the camera imaging area and the data transmission amount are adjusted may be prepared. For example, a video mode in which a moving image of only the singer's face is extracted from the camera imaging region and only that is enlarged and displayed can be considered. Further, in the present embodiment, it is assumed that both display in the same video mode during duet communication.

  Then, in the recruitment procedure on the recruiter side, the video mode through the entire music is set in the recruitment application information. In the applicant's application procedure, the video mode is set for each melody block, which will be described later, for the music, and the mode execution accuracy that indicates the feasibility of the video mode that you set when browsing the application information for each melody block. To display a list. This mode execution accuracy is based on the matching between the video mode of the entire music set in the recruitment procedure and the video mode in units of melody blocks set in the application procedure, and the application for karaoke that you are browsing It is determined and displayed based on the time-series traffic transition estimated in units of melody blocks on the network NW with the recruiting karaoke device corresponding to the information (detailed later in FIG. 10 etc.).

  Applicants can confirm the mode execution accuracy in units of melody blocks when performing duet communication with the corresponding recruitment karaoke device when browsing each recruitment application information, and refer to it for duet communication. Recruiters can be selected and determined. Below, the specific example of the process mentioned above is demonstrated sequentially.

<Specific examples of recruitment procedures>
When the recruiter performs an instruction operation to perform the recruitment procedure for the karaoke device, the recruitment procedure screen of the example shown in FIG. This recruitment procedure screen (displayed as “Duet entry screen” in the figure) has an introduction video I, a user name J1, a song age J2, a music input field J3, a singing pattern setting field J4, and user attributes. A setting field J5 and a video mode setting field J6 are displayed.

  The introduction video I is a video obtained by photographing the recruiter himself with the camera 13 in advance. The user name J1 (displayed as “user C” in the example shown in the figure) is a name for identifying the recruiter, and displays, for example, a handle name arbitrarily set by the recruiter himself. The song age J2 is an index obtained by evaluating the recruiter's singing skill in advance by a known technique.

  In the recruitment procedure performed on this recruitment procedure screen, the recruiter inputs the name of the song he wishes to sing in duet communication into the song input field J3, and the number of choruses desired to sing with that song in the song pattern setting field J4. Set. In the user setting field J5, the sex (male or female) of the recruiter himself and the actual age (in the example shown, one of teenagers or younger, 20s, 30s, or 40s or more) are set. Also, in the video mode setting field J6, the desired video mode (the whole body mode, the face + parts avatar mode, the full avatar mode in the example of the present embodiment) when displaying the video during singing with the other party through the entire music to be subjected to the duet communication. Any one).

  When the above recruitment procedure is performed, the recruiter side karaoke device generates recruitment application information based on the contents, and sends a recruitment application information registration request including the recruitment application information to the server 2 via the network NW. Send. The server 2 registers the received recruitment application information in the recruitment application information database as shown in FIG. In the recruitment application information database of the example shown in FIG. 5, user ID, user name, sex, age, desired video mode, duet song name, singing pattern, and base ID are stored in association with each other as recruitment application information.

  The user ID is identification information assigned to each individual recruiter, and may be given in advance when separately registered in the server 2 as a system member, or may be given by the server 2 for each recruitment procedure. The base ID is identification information of the router 3 belonging to the base of the transmission source of the application information, and may include the ID or IP address of the transmission source karaoke apparatus. In addition, the recruitment application information may include video data of the recruiter's introduction video I.

<Specific examples of application procedures>
On the other hand, when the applicant performs an instruction operation for performing an application procedure on the karaoke apparatus, an application procedure screen shown in FIG. 6 is displayed on the monitor 14. On this application procedure screen (displayed as “Duet Search Screen” in the figure), a music input field K1, a user attribute setting field K2, and a video mode setting field K3 are displayed.

  In the application procedure performed on the application procedure screen, the applicant inputs the name of a song desired to be sung by duet communication in the music input field K1. In the user setting column K2, the applicant's gender (male or female) and the actual age (in the example shown, teenagers, teenagers, thirties, teenagers and above) that the applicant wants to be a duet singing partner. Any one). Also, in the video mode setting field K3, a desired video mode (full body mode, face + parts avatar mode, full in the example of this embodiment) is displayed when the singing video is displayed with the other party in units of melody blocks of the music for duet communication. One of the avatar modes).

  Here, the melody block will be described. A general musical composition is configured to develop a plurality of melody blocks such as so-called intro, A melody, B melody, chorus, and outro in time series. For example, in the example shown in FIG. 7, the melody block configuration is different between a single chorus singing pattern and a full chorus singing pattern for the same music piece. In this example, not only the difference in the number of choruses between the first and second chords, but also the number of chorus repetitions may be different. Although not shown in particular, there may be a C melody or interlude depending on the music, or a chorus in which rust is omitted depending on the singing pattern. As described above, the composition of the melody block changes variously depending on the music and its singing pattern. However, depending on the type of the melody block, there are many cases where the user is particular about the change of the video mode for displaying the other party's singing video.

  In the present embodiment, the video mode desired by the applicant in the application procedure can be set for each melody block type (particularly, melody block unit). In the example shown in FIG. 6, A melody and B melody are collectively set in the same video mode.

  When the above application procedure is performed, the karaoke device on the applicant side transmits a recruitment application information search request including the above settings as search conditions to the server 2. The server 2 searches the recruitment application information database with the received search conditions, generates a recruitment application information list screen that displays a list of the recruitment application information in an order that matches the search conditions, and returns the recruitment application information list screen to the application-side karaoke apparatus. FIG. 8 shows an example of the recruitment application information list screen. In FIG. 8, on the recruitment application information list screen (shown as “Duet recruitment list screen” in the figure), the introduction videos I of the searched recruiters are displayed in a list in the order of suitability of the search conditions. The introduction video I displayed on the recruitment application information list screen may be obtained by, for example, linking with a user ID from a separately registered member database when the server 2 generates the list screen. May be obtained from each recruiting side karaoke device each time.

  Here, the degree of adaptation will be described. The degree of conformity in the present embodiment means an index indicating the degree to which each recruitment application information is comprehensively matched to a search condition composed of a plurality of conditions. In the example of the present embodiment, as described above, there are a duet music, a desired user attribute, and a desired video mode as search conditions included in the recruitment application information search request. As for the duet music and the desired user attribute, it is sufficient to narrow down the recruitment application information as a search condition as it is.

  However, as for the desired video mode, the applicant has set a single video mode for the entire song, while the applicant has set the video mode for each melody block type (in melody block units). It is necessary to consider the degree of matching between them. In addition, in order to secure transmission and reception of singing video during duet communication, when duet communication is performed between the recruiter side karaoke device corresponding to each recruitment application information and the applicant side karaoke device Expected changes in network traffic conditions must also be considered. Based on these video mode matching and network traffic, the execution possibility of the desired video mode in each melody block is specified as the mode execution accuracy. The method for specifying the mode execution accuracy will be described in detail later.

  Among the above-mentioned matching degrees, the matching degree of the desired video mode can be specifically specified using an arithmetic expression as shown in FIG. 9, for example. This calculation formula calculates a value obtained by accumulating the product of the importance and the mode execution accuracy in all combinations of each selected video mode and each melody block type. Note that Fscore in the arithmetic expression indicates the degree of mode matching, W [Vi] indicates the importance (W [whole body]> W [face + part avatar]> W [full avatar]) for the user in the video mode Vi, and P [Vi · Bj] indicates the mode execution accuracy of the video mode Vi in the melody block Bj, and O [Bj] indicates the selection state (1: selected, 0: not selected) of each melody block Bj set on the application procedure screen. Show.

  For example, in the setting example shown in the application procedure screen of FIG. 6 above, the duet music is “XXXXX”, the desired user attribute is “female in teens or under 20”, and the desired video mode is all. The melody block is set to desire the whole body mode. Correspondingly, on the recruitment application information list screen of FIG. 8, the recruitment application information (introduction video I) in the descending order of the degree of mode matching with the desired video mode from the recruitment application information whose duet music matches the user attribute. Is arranged. In other words, the introduction video (1, 2, 3 in the figure) of recruitment application information that sets the most desired whole body mode in the recruitment procedure is placed at the top, followed by the matching face + parts avatar mode An introduction video of recruitment application information (4, 5 in the figure) is placed, followed by an introduction video of recruitment application information (6, 7, 8 in the figure) that has set the most inconsistent full avatar mode Yes. Thus, by arranging the introduction video I of the recruitment application information in the order that matches the search conditions, the applicant can easily compare the recruitment application information based on the desired conditions.

  When the applicant selects and operates one of the introduction videos I on the recruitment application information list screen, the applicant's karaoke device sends a request for detailed recruitment application information requesting the detail screen of the recruitment application information to the server 2. Send. The server 2 generates a recruitment application information detail screen corresponding to the received request and returns it to the application side karaoke apparatus. FIG. 10 is a recruitment application information detail screen of Mr. C arranged third in FIG. 8, which corresponds to the recruitment application information on the recruitment procedure screen shown in FIG.

  In FIG. 10, the recruitment application information detail screen includes an introduction video I of Mr. C, a user attribute L1, a duet music L2, a singing pattern L3, a melody block configuration L4 based on this singing pattern, and each melody block. And an expected video mode L5 corresponding to, and a mode execution accuracy L6 corresponding to each predicted video mode. If the applicant wishes to perform a duet singing with the recruiter of this recruitment application information, by performing a predetermined confirmation operation (pressing the “decision button” in the illustrated example) while the screen is displayed, Duet communication can be started.

<Mode execution accuracy>
Here, the predicted video mode and the mode execution accuracy will be described. As described above, the mode execution accuracy is determined based on the degree of matching of the desired video mode between the recruiter and the applicant and the network traffic situation expected during the duet communication. This is an indicator of feasibility.

  In the example of this embodiment, the router 3 at each base measures, for example, an average traffic amount per minute for inbound traffic and outbound traffic passing through itself, and stores the history. Each router 3 transmits this network traffic information to the server 2 every 5 minutes, for example, and the server 2 records it in a traffic history database as shown in FIG. In the example of the traffic history database shown in FIG. 11, the base ID, router type, IP, operation mode, and network traffic information (up / down) in the past regular intervals are recorded in association with each other. In order to avoid the complexity of the illustration, the network traffic information is shown as five samples, but actually, more information is recorded at more various time intervals.

  Based on the contents of the traffic history database, the server 2 predicts the future traffic situation at each site (router 3) on the recruiting side and the applying side. For example, as shown in the time chart of the first example shown in FIG. 12, a normal operation is performed from the current time (18:00), and the start of duet communication is expected. Assume that the traffic change in one router 3 up to 18:08 is estimated as indicated by a thick solid line in the figure. The traffic change estimated in this way is hereinafter referred to as time-series traffic transition. This estimation method is estimated by referring to the traffic change tendency at the same time every day or the latest traffic change tendency in the past.

  In this example, it is assumed that traffic of about 26 Mbps or more is necessary to transmit and receive the singing video in the whole body mode. In addition, it is assumed that about 17 Mbps or more is required for transmission / reception in the face + parts avatar mode. Further, it is assumed that the full avatar mode is possible even at less than about 17 Mbps.

  In the example shown in FIG. 12 assuming a single chorus singing pattern, it is estimated that the time-series traffic transition monotonically increases from approximately 8 Mbps to 9 Mbps in the time zone of the intro melody block. In this case, it is specified that the full avatar mode (abbreviated as “avatar” in the drawing) is executed with 100% mode execution accuracy in the time period. In specifying the mode execution accuracy at this time, execution of the desired video mode (assuming the whole body mode) set for the intro block by the applicant with the desired video mode (assuming the whole body mode) on the applicant side as the upper limit It is specified considering accuracy, that is, matching.

  In addition, for example, in a time zone in an outro melody block, it is estimated that a time-series traffic transition monotonously increases from approximately 23 Mbps to 35 Mbps. In this case, it is specified that the face + part avatar mode (abbreviated as “face” in the figure) is executed with the mode execution accuracy of 30% and the whole body mode is 70% based on the respective time occupancy rates. Is done.

  The time-series traffic transition of the example shown in FIG. 12 tends to increase monotonically from 5 Mbps to 35 Mbps or more as time passes, and the full avatar mode is 100% for the intro and A melody and the full avatar mode for the B melody. 80%, face + parts avatar mode is 20%, rust is face + parts avatar mode is 100%, outro is face + parts avatar mode is 30% and whole body mode is 70%.

  In addition, the time-series traffic transition of the second example shown in FIG. 13 tends to decrease monotonically from 45 Mbps to 5 Mbps with the passage of time as a whole. Mode accuracy is specified for 20% full body mode and 80% face + parts avatar mode, rust for face + part avatar mode 50% and full avatar mode 50%, and outro for full avatar mode 100%. The

  On the recruitment application information detail screen of FIG. 10, the mode execution accuracy specified highest for each melody block is displayed, and the video mode corresponding to the mode execution accuracy is displayed as the predicted video mode. As a result, applicants can check the expected video mode and mode execution accuracy in melody block units when performing duet communication with the corresponding recruiting karaoke device when browsing each recruitment application information. In addition, you can select and decide who you want to communicate with duet.

<Sending and receiving various information during the combination determination process>
Details of information transmitted and received between the devices in the process of determining the combination of duet communication as described above are collectively shown in the sequence chart of FIG. In FIG. 14, first, the router 3 at each base measures the upstream and downstream traffic to the network at a predetermined time interval, and records the history. The router 3 transmits the history information as network traffic information to the server 2 at predetermined time intervals, and the server 2 records the received information in the traffic history database (see FIG. 11 above) (steps ST1 and ST11). Note that it is desirable that not all routers 3 transmit network traffic information at the same time, but transmit them at different times.

  Then, the recruiter operates the recruiting karaoke device and performs a duet recruitment procedure (see FIG. 4 above), thereby requesting registration of recruitment application information including the desired video mode through the music, its own user attributes, and the entire music. Is transmitted to the server 2. The server 2 registers the received recruitment application information in the recruitment application information database (see FIG. 5 above) (step ST2). The processing of the recruitment side karaoke apparatus and the server 2 in step ST2 corresponds to the recruitment procedure means described in each claim.

  On the other hand, applicants are recruited with search conditions including music, desired user attributes, and desired video mode in units of melody blocks by performing a duet application procedure (see Fig. 6 above) by operating the karaoke device on the application side. A search request for application information is transmitted to the server 2 (step ST3). The server 2 searches for the recruitment application information using the received search conditions, generates a recruitment application information list screen (see FIG. 8 above) in which the introduction video I is arranged in descending order of suitability, and sends it back to the application side karaoke device ( Step ST4). The karaoke device on the application side displays the received recruitment application information list screen on the monitor 14. In addition, the process of the application side karaoke apparatus in the above steps ST3 and ST4 and the server 2 corresponds to the first application procedure means described in each claim.

  The karaoke device on the application side displays the received recruitment application information list screen and requests the server 2 for details of the recruitment application information selected by the applicant (step ST5). Based on the network traffic information of the router 3 at the base where the requesting karaoke device corresponding to the request for application information details and the requesting karaoke device of the request source are respectively present, the received server 2 changes the time-series traffic between the devices. Is estimated. Then, based on the matching between this time-series traffic transition and the desired video mode of both sides, the mode execution accuracy and the expected video mode in melody block units are specified, and the recruitment application information details screen reflecting them (see FIG. 10 above) Is sent back to the requesting karaoke apparatus (step ST6). The application-side karaoke apparatus displays the received application information detail screen on the monitor 14. Note that the processing of the server 2 and the router 3 in steps ST6, ST1, and ST11 corresponds to the traffic estimation means described in each claim. Moreover, the process of the application side karaoke apparatus in this step ST6 and the server 2 is equivalent to the 1st accuracy display means as described in each claim.

  The above steps S5 and ST6 are repeated as necessary, and when the applicant finally determines the recruiter desired as a duet singing partner, the confirmation notice is transmitted to the server 2 (step S7). In addition, the process of the application side karaoke apparatus in this step ST7 is equivalent to the 1st other party apparatus determination means described in each claim.

  The server 2 deletes the recruitment application information specified by the received confirmation notification from the recruitment application information database, and notifies the start of duet communication to the corresponding recruiter and applicant karaoke devices (step ST8). At this time, both karaoke apparatuses are notified together with connection destination information such as the IP address of the other party. Thereafter, the recruiter-side karaoke device and the applicant-side karaoke device directly perform duet communication with the other party without using the server 2 (steps ST9 and ST10).

<Control flow of each device>

  Processing contents executed by the CPU of each device to realize the above method will be described with reference to flowcharts. First, the processing content executed by the CPU (not shown) of the server 2 will be described with reference to the flow of FIG. In FIG. 15, for example, when the server 2 is turned on, this flow is started.

  First, in step SS5, the CPU of the server 2 determines whether any information or request has been received from any router 3 or karaoke apparatus via the network NW. If nothing has been received, the determination is not satisfied (SS5: NO), and the routine goes to Step SS10.

  In step SS10, the CPU of the server 2 determines whether or not an operation for instructing the end of the process is input from the user. If the end operation has not been input, the determination is not satisfied (SS10: NO), and the process returns to step SS5 and the same procedure is repeated.

  On the other hand, if an end operation has been input, the determination is satisfied (SS10: YES), and this flow ends.

  On the other hand, if the server 2 receives any information or request via the network NW in the determination in step SS5, the determination is satisfied (SS5: YES), and the process proceeds to step SS15.

  In step SS15, the CPU of the server 2 determines the content of the information or request determined to be received in step SS5. When the content is the network traffic information received from the router 3 at each site, the process proceeds to step SS20.

  In step SS20, the CPU of the server 2 records the received network traffic information in the traffic history database (see FIG. 11 above) in association with the transmission source router 3. And it returns to step SS5 and repeats the same procedure.

  On the other hand, if it is determined in step SS15 that the received content is a recruitment application information registration request received from the karaoke apparatus, the process proceeds to step SS25.

  In step SS25, the CPU of the server 2 registers the received recruitment application information in the recruitment application information database (see FIG. 5 above) in association with the transmission source karaoke apparatus or user ID. And it returns to step SS5 and repeats the same procedure.

  On the other hand, if it is determined in step SS15 that the received content is a request for detailed application information received from the karaoke apparatus, the process proceeds to step SS30.

  In step SS30, the CPU of the server 2 searches the recruitment application information database using the search conditions (music and desired user attributes) included in the received recruitment application information detail request. Furthermore, the degree of suitability of each retrieved application information is specified, and the order of the recruitment application information is ranked in descending order of the suitability. Thereafter, the process proceeds to step SS35.

  In step SS35, the CPU of the server 2 generates a list screen (see FIG. 8) in which the recruitment application information (introduction video I) is arranged in descending order of suitability, and the application-side karaoke that is the sender of the recruitment application information detail request Reply to the device. Thereafter, the process proceeds to step SS40.

  In step SS40, the CPU of the server 2 determines whether or not a request for application information details has been received from the application side karaoke apparatus. If the request for detailed application information has not been received, the determination is not satisfied (SS40: NO), and the routine goes to Step SS55.

  On the other hand, when the request for detailed application information is received, the determination is satisfied (SS40: YES), and the routine goes to Step SS45.

  In step SS45, the CPU of the server 2 determines the devices on the basis of the network traffic information of the router 3 at the base where the recruiting side karaoke device corresponding to the requested requesting application information and the requesting application side karaoke device respectively exist. Estimate the time-series traffic transition between the two. Then, the mode execution accuracy and the predicted video mode are specified for each melody block based on the matching between the time-series traffic transition and the desired video modes of both. Thereafter, the process proceeds to step SS50.

  In step SS50, the CPU of the server 2 generates a recruitment application information detail screen (see FIG. 10 above) reflecting the mode execution accuracy and the predicted video mode specified in step SS45, and returns it to the requesting application side karaoke apparatus. To do. Thereafter, the process proceeds to step SS55.

  In step SS55, the CPU of the server 2 determines whether or not a duet partner confirmation notification is received from the application side karaoke apparatus. If the duet partner confirmation notification has not been received, the determination is not satisfied (SS55: NO), and the process returns to step SS40 and the same procedure is repeated.

  On the other hand, if a duet partner confirmation notification is received, the determination is satisfied (SS55: YES), and the routine goes to Step SS60.

  In step SS60, the CPU of the server 2 transmits a duet start notification including the connection destination information to each of the application side karaoke apparatus and the selected recruitment side karaoke apparatus. Then, it returns to step SS5 and repeats the same procedure.

  Next, the processing content executed by the CPU of the recruitment side karaoke apparatus will be described with reference to the flow of FIG. In FIG. 16, for example, this flow is started by turning on the power of the recruiting side karaoke apparatus.

  First, in step SS105, the CPU 31 of the recruitment karaoke apparatus determines whether or not an operation for instructing the recruitment procedure has been input from the user. If the recruitment procedure operation is not input, the determination is not satisfied (SS105: NO), and the process proceeds to Step SS110.

  In step SS110, the CPU 31 of the recruiting karaoke apparatus determines whether or not a duet start notification has been received from the server 2 via the network NW. When the duet start notification is not received, the determination is not satisfied (SS110: NO), and the process proceeds to Step SS115.

  In step SS115, the CPU 31 of the recruiting karaoke apparatus determines whether or not an operation for instructing the end of the process is input from the user. If the end operation has not been input, the determination is not satisfied (SS115: NO), and the process returns to step SS105 and the same procedure is repeated.

  On the other hand, if an end operation has been input, the determination is satisfied (SS115: YES), and this flow ends.

  On the other hand, if the recruitment procedure operation has been input in the determination in step SS105, the determination is satisfied (SS105: YES), and the process proceeds to step SS120.

  In step SS120, the CPU 31 of the recruitment karaoke apparatus displays a recruitment procedure screen (see FIG. 4 above) on the monitor 14. In addition, this recruitment procedure screen may send and receive and display a screen generated by the server 2 in response to a request from the recruitment side karaoke apparatus. Thereafter, the process proceeds to step SS125.

  In step SS125, the CPU 31 of the recruitment side karaoke apparatus generates recruitment application information based on the contents input and set by the user on the recruitment procedure screen. Thereafter, the process proceeds to step SS130.

  In step SS130, the CPU 31 of the recruitment side karaoke apparatus transmits the recruitment application information generated in step SS125 and the registration request to the server 2. Then, it returns to step SS105 and repeats the same procedure.

  On the other hand, if a duet start notification is received in the determination in step SS110, the determination is satisfied (SS110: YES), and the process proceeds to step SS135.

  In step SS135, the CPU 31 of the recruiting side karaoke apparatus directly accesses the connection destination of the partner applicant side karaoke apparatus included in the received duet start notification and executes duet communication. After the end, the process returns to step SS105 and the same procedure is repeated.

  Next, processing contents executed by the CPU 31 of the application side karaoke apparatus will be described with reference to the flowchart of FIG. In FIG. 17, for example, this flow is started when the application-side karaoke apparatus is turned on.

  First, in step SS205, the CPU 31 of the application side karaoke apparatus determines whether or not an operation for instructing an application procedure has been input from the user. When the application procedure operation is not input, the determination is not satisfied (SS205: NO), and the process proceeds to Step SS210.

  In step SS210, CPU31 of the application side karaoke apparatus determines whether a duet start notification is received from server 2 via network NW. When the duet start notification is not received, the determination is not satisfied (SS210: NO), and the process proceeds to Step SS215.

  In step SS215, CPU31 of the application side karaoke apparatus determines whether the operation which instruct | indicates the completion | finish of a process was input from the user. If the end operation has not been input, the determination is not satisfied (SS215: NO), and the same procedure is repeated by returning to step SS205.

  On the other hand, if an end operation has been input, the determination is satisfied (SS215: YES), and this flow ends.

  On the other hand, if the application procedure operation has been input in the determination in step SS205, the determination is satisfied (SS205: YES), and the process proceeds to step SS220.

  In step SS220, CPU31 of the application side karaoke apparatus displays the application procedure screen (see FIG. 6 above) on the monitor 14. In addition, this application procedure screen may send and receive and display a screen generated by the server 2 in response to a request from the application side karaoke apparatus. Thereafter, the process proceeds to step SS225.

  In step SS225, the CPU 31 of the application side karaoke apparatus transmits a recruitment application information search request to the server 2 under the search conditions based on the contents input and set by the user on the application procedure screen. Thereafter, the process proceeds to step SS230.

  In step SS230, the CPU 31 of the application side karaoke apparatus receives the recruitment application information list screen (see FIG. 8 above) returned from the server 2 and displays it on the monitor 14. Thereafter, the process proceeds to step S235.

  In step SS235, the CPU 31 of the application side karaoke apparatus stands by in a loop until an operation for selecting any application information is input from the user. If any application information is selected, the process proceeds to step SS240.

  In step SS240, the CPU 31 of the application side karaoke apparatus transmits a detailed request for the recruitment application information selected in step SS235 to the server 2. Thereafter, the process proceeds to step SS245.

  In step SS245, the CPU 31 of the application side karaoke apparatus receives the recruitment application information detail screen (see FIG. 10 above) returned from the server 2 and displays it on the monitor 14. Thereafter, the process proceeds to step S250.

  In step SS250, CPU31 of the application side karaoke apparatus determines whether operation which determines a duet partner was input from the user. If the duet partner confirmation operation is not input, the determination is not satisfied (SS250: NO), and the process returns to Step SS235 and the same procedure is repeated.

  On the other hand, if a duet partner confirmation operation is input, the determination is satisfied (SS250: YES), and the routine goes to Step SS255.

  In step SS255, the CPU 31 of the application side karaoke apparatus transmits to the server 2 a notification for confirming the recruiter on the recruitment application information detail screen displayed at that time as the counterpart of the duet communication. Then, it returns to step SS205 and repeats the same procedure.

  On the other hand, in the determination of step SS210, when a duet start notification is received, the determination is satisfied (SS210: YES), and the process proceeds to step SS260.

  In step SS260, the CPU 31 of the application side karaoke apparatus directly accesses the connection destination of the other recruiter side karaoke apparatus included in the received duet start notification and executes duet communication. After the end, the process returns to step SS205 and the same procedure is repeated.

  In addition, in the process of the above application side karaoke apparatus, the procedure of step SS220, SS225, SS230 is equivalent to the 2nd application procedure means described in each claim, and the procedure of step SS245 is the 2nd accuracy display means described in each claim. And the procedures of steps SS250 and SS255 correspond to the second counterpart device determining means described in each claim.

  Next, processing contents executed by the CPU (not shown) of the router 3 will be described with reference to the flowchart of FIG. In FIG. 18, for example, when the power of the router 3 is turned on, this flow is started.

  First, in step SS305, the CPU of the router 3 measures, for example, an average traffic amount per minute for inbound traffic and outbound traffic passing through the router 3 itself, and stores the history. Thereafter, the process proceeds to step SS310.

  In step SS310, the CPU of the router 3 determines whether or not a predetermined time interval for transmitting network traffic information to the server 2 has been reached. If the transmission timing to the server 2 has not been reached, the determination is not satisfied (SS310: NO), and the routine goes to Step SS320.

  On the other hand, when the transmission timing to the server 2 is reached, the determination is satisfied (SS310: YES), and the process proceeds to Step SS315.

  In step SS315, the CPU of the router 3 transmits the traffic history recorded in the past to the server 2 as network traffic information. Thereafter, the process proceeds to step SS320.

  In step SS320, the CPU of the router 3 determines whether or not an operation for instructing the end of the process is input from the user. If the end operation has not been input, the determination is not satisfied (SS320: NO), and the process returns to Step SS305 and the same procedure is repeated.

  On the other hand, if an end operation has been input, the determination is satisfied (SS320: YES), and this flow ends.

<Effect obtained by this embodiment>
As described above, in this embodiment, when the applicant browses the details of the recruitment application information, the mode execution accuracy based on the time-series traffic transition when performing duet communication with the corresponding recruitment karaoke device is set as the melody block. It is possible to confirm by the unit, and after selecting it, it is possible to select and decide the recruiter for duet communication.

  In this way, in the present embodiment, information regarding the feasibility of the display mode of the singing video desired for the applicant can be presented in units of melody blocks for each recruitment application information, and the applicant refers to it. Thus, it is possible to provide the convenience that the recruiter can be selected and determined.

  In the above embodiment, the time series traffic transition estimated between the two routers 3 connected via the Internet is replaced with the time series traffic transition between the two karaoke apparatuses (between the recruiting side and the application side). Although the execution accuracy is specified, the present invention is not limited to this. In addition, a time-series traffic transition may be directly estimated between two karaoke apparatuses via a local network such as a LAN, and the mode execution accuracy based on this may be specified.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

DESCRIPTION OF SYMBOLS 1 Karaoke system 2 Server 3 Router 4 Karaoke apparatus 11 Microphone 12 Speaker 13 Camera 14 Monitor NW Wide area infrastructure network (network)

Claims (2)

A karaoke system that has a server and a plurality of karaoke devices capable of transmitting and receiving information to and from each other via a network, and determines a combination of two karaoke devices that execute duet communication,
Recruitment procedure means for registering recruitment application information including the setting of the target music for duet communication and the video mode which is the display mode of the mutual singing video during duet communication from the recruitment side karaoke device,
The first application procedure for setting the music to be subjected to duet communication and the video mode in units of melody blocks of the music and viewing the application information for the same music registered in the server from the karaoke device on the application side Means,
Traffic estimation means for estimating time-series traffic transition on the network between the application side karaoke apparatus and the recruitment side karaoke apparatus corresponding to the recruitment application information to be browsed by the first application procedure means;
Regarding the recruitment application information to be browsed by the first application procedure means, the execution possibility of the video mode set by the first application procedure means is determined based on the video mode set by the recruitment procedure means and the time-series traffic transition. First accuracy display means for displaying a list of mode execution accuracy to be displayed on the application side karaoke device in units of melody blocks;
A first partner device determination means for determining a recruitment side karaoke device of a partner to perform duet communication in the application side karaoke device;
A karaoke system characterized by comprising: An application-side karaoke device that can exchange information with a server and a plurality of recruitment-side karaoke devices via a network, and determines a partner karaoke device for duet communication,
The same music registered in the server from the recruiting side karaoke device by setting the target music for duet communication and the video mode which is the display mode of the mutual singing video during duet communication in units of melody blocks of this music A second application procedure means for browsing the recruitment application information,
About the recruitment application information to be browsed by the second application procedure means, the video mode included in the recruitment application information set by the recruitment karaoke device, and the application karaoke device estimated by the server in units of melody blocks Execution of the video mode set by the second application procedure means based on the time-series traffic transition on the network with the recruiting side karaoke apparatus corresponding to the recruitment application information browsed by the second application procedure means Second accuracy display means for displaying a list of mode execution accuracy indicating the characteristics in units of melody blocks;
A second partner device determining means for determining a recruiting side karaoke device of a partner for duet communication;
A karaoke apparatus comprising:

Images