JP2022130028A - karaoke system - Google Patents

Abstract

To make it possible to easily convey specific information about a user who has sung a song as a model or utterances of the user to other users.SOLUTION: In a karaoke system, when a user (guide vocalist) corresponding to guide vocal data which is singing voice data of a model singing logs into the karaoke system (steps S3 to S6), a server device instructs a karaoke device to generate interview video data of the guide vocalist (step S7). The karaoke device generates interview video data of the guide vocalist by photographing the guide vocalist (steps S8 and S9), and sends the generated interview video data to the server device (step S10). The server device stores the interview video data received from the karaoke device in association with the guide vocal data (step S11).SELECTED DRAWING: Figure 2

Description

TECHNICAL FIELD The present invention relates to a karaoke system having a function capable of providing a user with a sample singing voice.

2. Description of the Related Art A service that allows a user of a karaoke system to use a good singing voice as a model for other users to sing is popular. In this service, multiple users of the karaoke system store and collect the singing voices sung along with one karaoke song, and select the best singing voice from the collected singing voices of the multiple users. pick out The selected singing voice can be reproduced in time with the music when another user sings the music. Other users can easily grasp the knack of singing by listening to the selected singing voice or by singing while listening to the singing voice. Patent Literature 1 below describes a technique related to such a service.

JP-A-2003-91291

By the way, other users who have listened to a user's excellent singing voice as a singing model may want to know specifically about the user who performed the excellent singing. In addition, other users' trust or familiarity with the user who performed the model song by conveying specific information about the user who performed the excellent model song to other users is formed, and it is conceivable that the motivation or enjoyment of practicing singing is increased in the other user. In addition, for example, if a user who performed a song as a model can convey to other users the singing tips and points to note when singing, the other users will be able to practice singing. You can get useful information.

The present invention has been made in view of the above-mentioned problems, for example, and an object of the present invention is to provide specific information about the user who sang as a model or the remarks of the user to other users. To provide a karaoke system capable of easily conveying information to people.

In order to solve the above problems, a first karaoke system of the present invention is a karaoke system comprising a server device and a karaoke device communicably connected to the server device, wherein the server device includes a plurality of One singing voice data that satisfies a predetermined condition is determined as specific singing voice data from among a plurality of singing voice data of singing performed by each user according to one song, and the specified singing voice data is A determination unit that stores in a storage device in association with user identification information of a specific user who is a user corresponding to specific singing voice data and music identification information of the one music, and user identification information of the specific user an instruction unit for instructing the karaoke machine to generate specific user photographed data, which is moving image data of the specific user, when the specific user photographed data is received from the karaoke machine; a storage control unit that stores the received photographed data of the specific user from the storage device in association with the specific singing voice data, the user identification information of the specific user, or the music identification information of the one music piece; wherein the karaoke device comprises a login unit that transmits user identification information of a user who logs into the karaoke system to the server device; a generator for generating the specific user photographed data by photographing the specific user; and a first transmitter for transmitting the specific user photographed data generated by the generator to the server device. It is characterized by

In the first karaoke system of the present invention, the determination unit of the server device selects one singing voice satisfying a predetermined condition from among a plurality of singing voice data of singing performed by a plurality of users along with one song. The data is determined as specific singing voice data. The predetermined condition is, for example, a criterion for judging whether or not the singing is excellent. It will be determined as data. Furthermore, the determination unit of the server device stores the specific singing voice data in the storage device in association with the user identification information of the specific user who is the user corresponding to the specific singing voice data and the music identification information of the one music. do. After that, the login section of the karaoke device transmits the user identification information of the user who logs into the karaoke system to the server device. For example, when a specific user operates a karaoke machine to log in to the karaoke system, the user identification information of the specific user is transmitted from the karaoke machine to the server device. The instruction unit of the server device instructs the karaoke device to generate specific user photographed data, which is moving image data obtained by photographing the specific user, when the user identification information of the specific user is received from the karaoke device. The generation unit of the karaoke device generates specific user photographed data by photographing the specific user when instructed by the server device to generate specific user photographed data. For example, the generation unit takes a picture of the specific user's appearance, and if the specific user mentions his/her own name, it is recorded, for example, the specific user's singing tips or points to note when singing. is recorded. The specific user photographed data generated in this manner includes specific information about the specific user, statements of the specific user, and the like. Further, the first transmission unit of the karaoke device transmits the specific user photographed data generated by the generation unit to the server device. The storage control unit of the server device receives the specific user photographed data from the karaoke device, and converts the received specific user photographed data into specific singing voice data, user identification information of the specific user, or music identification information of the one music piece. and stored in the storage device. According to the first karaoke system of the present invention, the specific user's photographic data is used to obtain specific information about the specific user, that is, the user who sang excellently as a model, or the statement of the user. etc. can be easily communicated to other users. For example, in response to a request from a karaoke device, etc., the server device transmits the specific user photographed data to the karaoke device, etc., and the karaoke device, etc. shoots a video of the specific user based on the received specific user photographed data By playing back, it is possible to easily convey specific information about the user who sang excellently as a model or utterances of the user to the user who is using the karaoke machine. .

Further, in the first karaoke system of the present invention, the generation unit of the karaoke device, when instructed by the server device to generate the specific user photographed data, generates a moving image asking the specific user a question. The specific user photographed data may be generated by reproducing the question video and photographing the specific user who responds to the question video. By using a question video, you can ask about matters that many other users want to know, such as the name of a specific user, tips for singing, points to note when singing, or matters that are widely useful for singing practice. You can ask a specific user a question and get an answer from the specific user. Therefore, it is possible to generate specific-user photographed data that matches the needs of many users.

In order to solve the above problems, a second karaoke system of the present invention includes a server device, a plurality of mobile terminals used by a plurality of users and connected to the server device so as to be communicable, A karaoke system comprising a server device and a karaoke device communicably connected, wherein the server device stores a plurality of singing voice data of the plurality of users singing along with one piece of music. One singing voice data that satisfies a predetermined condition is determined as specific singing voice data from and a determining unit for storing in a storage device in association with music identification information of a song, and generation of specific user photographed data, which is moving image data photographed by the specific user, by the specific user among the plurality of mobile terminals. an instruction unit for instructing a mobile terminal in use, receiving the specific user photographed data from the mobile terminal used by the specific user, and transmitting the received specific user photographed data to the specific singing voice data, user identification information of the specific user or music identification information of the one piece of music, and stored in the storage device, and each of the portable terminals generates the specific user photographed data. a generating unit for generating the specific user photographed data by photographing the specific user when instructed by the server device, and transmitting the specific user photographed data generated by the generating unit to the server device and a first transmission unit for transmitting.

In the second karaoke system of the present invention, the determination unit of the server device selects one singing voice that satisfies a predetermined condition from among a plurality of singing voice data of singing performed by a plurality of users along with one song. The data is determined as specific singing voice data. Furthermore, the determination unit of the server device stores the specific singing voice data in the storage device in association with the user identification information of the specific user who is the user corresponding to the specific singing voice data and the music identification information of the one music. do. Further, the instruction unit of the server device instructs the mobile terminal used by the specific user among the plurality of mobile terminals to generate specific user photographed data, which is video data obtained by photographing the specific user. The generation unit of the mobile terminal instructed by the server device to generate the specific user photographed data generates the specific user photographed data by photographing the specific user. Then, the first transmission unit of the mobile terminal transmits the specific user photographed data generated by the generation unit to the server device. The storage control unit of the server device receives the specific user photographed data from the mobile terminal used by the specific user, and stores the received specific user photographed data as the specific singing voice data, the user identification information of the specific user, or The information is stored in the storage device in association with the music identification information of the one music. The second karaoke system of the present invention has the same effects as the first karaoke system of the present invention. Further, according to the second karaoke system of the present invention, it is possible to generate the specific user photographed data via the mobile terminal used by the specific user. Therefore, it is possible to reduce the burden on the specific user who responds to the photographing.

Further, in the second karaoke system of the present invention, the generation unit of each of the portable terminals asks the specific user a question when instructed by the server device to generate the specific user photographed data. The specific user photographed data may be generated by playing back a moving image of the question, and photographing the specific user who responds to the moving image of the question.

Further, in the first or second karaoke system of the present invention, the server device receives the music identification information of the one music piece from the karaoke device, and the specific user photographed data corresponding to the one music piece. and when the karaoke device requests transmission of the specific singing voice data, the specific user photographed data and the specific singing voice data associated with the music identification information of the one song are transmitted to the karaoke device. comprising a second transmission unit, wherein the karaoke device transmits music identification information of the one music piece to the server device, and transmits the specific user photographed data and the specific singing voice data corresponding to the one music piece; a request unit that requests transmission from the server device; A playback unit for playing back the singing voice of the specific user may be provided.

In the karaoke system of this aspect, the request unit of the karaoke device transmits the music identification information of the one music piece to the server device, and also requests transmission of the specific user photographed data and the specific singing voice data corresponding to the one music piece. Make a request to the server device. A second transmission unit of the server device receives the music identification information of the one music piece from the karaoke device, and requests transmission of the specific user photographed data and the specific singing voice data corresponding to the one music piece from the karaoke device. If so, the specific user photographed data and the specific singing voice data associated with the music identification information of the one music piece are transmitted to the karaoke machine. The reproducing unit of the karaoke device reproduces the moving image of the specific user and the singing voice of the specific user based on the specific user photographed data and the specific singing voice data corresponding to the one song received from the server device. In this way, by reproducing the moving image of the specific user photographed based on the specific user photographed data on the karaoke machine, the user who sings using the karaoke machine can become the specific user, i.e., a model. It is possible to easily convey specific information about a user who has sung excellently or what the user has said.

According to the present invention, it is possible to easily convey to other users specific information about the user who sang as a model or the statement of the user.

1 is a block diagram showing a karaoke system according to a first embodiment of the present invention; FIG. 4 is a flow chart showing guide vocal-related data generation processing in the karaoke system of the first embodiment of the present invention. 4 is an explanatory diagram showing the data structure of guide vocal data in the karaoke system of the first embodiment of the present invention; FIG. 4 is an explanatory diagram showing the data structures of guide vocal data and interview moving image data in the karaoke system of the first embodiment of the present invention; FIG. 4 is a flow chart showing guide vocal-related data reproduction processing in the karaoke system of the first embodiment of the present invention. It is a block diagram which shows the karaoke system of the 2nd Embodiment of this invention. It is a flow chart which shows the guide vocal related data generation processing in the karaoke system of the second embodiment of the present invention. FIG. 11 is an explanatory diagram showing terminal association information in the karaoke system according to the second embodiment of the present invention;

[First embodiment]
(Karaoke system)
FIG. 1 shows the configuration of a karaoke system 1 according to the first embodiment of the present invention. As shown in FIG. 1 , the karaoke system 1 includes a server device 11 and a karaoke device 31 . The server device 11 and the karaoke device 31 are connected so as to be able to communicate with each other via a computer network 5 such as the Internet. Although not shown, the karaoke system 1 includes a plurality of karaoke machines 31, and each karaoke machine 31 is connected to the server device 11 so as to be able to communicate with each other.

The server device 11 is, for example, a server computer, and includes an arithmetic processing section 12 , a storage section 13 , an operation section 14 and a display section 15 . The arithmetic processing unit 12 includes a CPU (Central Processing Unit). The storage unit 13 is a magnetic storage device or a semiconductor storage device capable of storing information, such as a hard disk drive or a solid state drive. The operation unit 14 is a device for operating the server device 11 and inputting information, and is, for example, a keyboard and a mouse. The display unit 15 is a device for displaying information, such as a liquid crystal display.

Arithmetic processing unit 12 of server device 11 reads and executes a computer program stored in storage unit 13, for example, to obtain singing voice data collection unit 21, determination unit 22, instruction unit 23, storage control unit 24, guide vocal It functions as a related data transmission control section 25 , a device control section 26 and a communication control section 27 . The singing voice data collection unit 21, the determination unit 22, the instruction unit 23, and the storage control unit 24 will be explained together with the explanation of the guide vocal-related data generation process, which will be described later. The guide vocal-related data transmission control unit 25 will be explained together with the explanation of the guide vocal-related data reproduction process which will be described later. The device control section 26 performs basic control of the server apparatus 11 , and the communication control section 27 performs basic communication control between the server apparatus 11 and the karaoke apparatus 31 . The device control unit 26 and the communication control unit 27 correspond to an operating system, for example.

The karaoke device 31 includes an arithmetic processing section 32 , a storage section 33 , an operation section 34 , a display section 35 , a sound source 36 , a sound processing section 37 , a display processing section 38 and a photographing section 39 . The arithmetic processing unit 32 has a CPU. The storage unit 33 is a magnetic storage device or a semiconductor storage device capable of storing information, such as a hard disk drive or a solid state drive. The operation unit 34 includes buttons, a touch panel, and the like provided on the karaoke device 31 for operating the karaoke device 31 and inputting information. The display unit 35 is a device for displaying information, such as a small liquid crystal display provided in the karaoke device 31, for example. The sound source 36 is a synthesizer for playing music. The sound processing unit 37 mixes the sound of the music output from the sound source 36 and the singing voice of the user input via the microphone 40 connected to the karaoke device 31, and outputs the sound to the speaker connected to the karaoke device 31. 41 is a circuit that performs processing for outputting to 41, and the like. Also, the acoustic processing unit 37 can analog-digital convert the user's singing voice input via the microphone 40 and output the digital data of the user's singing voice to the arithmetic processing unit 32 . The display processing unit 38 is a circuit for controlling the display of images, lyrics, etc. on an external display 42 (for example, a large liquid crystal display device) connected to the karaoke device 31 . The photographing unit 39 is, for example, a video camera, and can photograph a user of the karaoke device 31, specifically, a user singing along with a musical piece, a user responding to an interview, or the like. A remote controller 43 is connected to the karaoke machine 31 by, for example, short-range wireless communication. The remote controller 43 is a device similar to a tablet terminal, and includes a display section such as a liquid crystal display and an operation section such as a touch panel. The user can remotely operate the karaoke device 31 using the remote controller 43 .

The arithmetic processing unit 32 of the karaoke device 31 reads and executes a computer program stored in the storage unit 33, for example, to perform a login unit 51, a singing scoring unit 52, a generation unit 53, a photographed data transmission control unit 54, a request unit 55 , a reproduction unit 56 , a device control unit 57 and a communication control unit 58 . The login unit 51, the singing scoring unit 52, the generation unit 53, and the photographed data transmission control unit 54 will be explained together with the explanation of the guide vocal-related data generation process, which will be described later. The request unit 55 and the reproduction unit 56 will be explained together with the explanation of the guide vocal-related data reproduction process described later. The device control section 57 performs basic control of the karaoke apparatus 31 , and the communication control section 58 performs basic communication control between the karaoke apparatus 31 and the server apparatus 11 .

(Guide vocal-related data generation processing)
Before describing the guide vocal-related data generation process, some terms will be defined. “User identification information” is information for identifying individual users. "Music identification information" is information for identifying individual music. "Singing voice data" is voice data of a song sung by the user along with the music. "Guide vocal" means singing that serves as a model for users to sing along with music. "Guide vocal data" is audio data of guide vocals. A "guide vocalist" means a person who performs a guide vocal, that is, a person who performs a song that serves as a model for the user to sing along with the music. An “interview video” is a video of a guide vocalist responding to an interview. “Interview video data” is data of an interview video. An “interviewer video” is a video in which an interviewer (interviewer) interviews a guide vocalist. Note that the guide vocal data is a specific example of specific singing voice data in the scope of claims. Also, the guide vocalist is a specific example of a specific user in the claims. Also, the interview moving image data is a specific example of the specific user photographed data in the scope of claims. Also, the interviewer animation is a specific example of the question animation in the claims.

FIG. 2 shows guide vocal related data generation processing executed in the karaoke system 1 . The guide vocal related data generation process is a process of determining guide vocal data and generating interview moving image data. The guide vocal-related data generation process is executed for a plurality of songs. Here, the case where the guide vocal-related data generation process is executed for one song M out of the plurality of songs will be described.

Before the guide vocal-related data generation process is performed, a plurality of pieces of singing voice data for the music piece M are stored and accumulated in the storage unit 13 of the server device 11 . Each piece of singing voice data of the song M is associated with song identification information of the song M, user identification information of the user who sang the song M, and scoring data of the singing of the song M by the user. . A plurality of pieces of singing voice data for the piece of music M are accumulated by the following processing. That is, while the user is singing along with the music piece M played by the karaoke device 31, the user's singing voice input to the sound processing unit 37 of the karaoke device 31 via the microphone 40 is reproduced. It is analog-digital converted by the processing unit 37 and output to the arithmetic processing unit 32 as digital data. Also, the singing scoring unit 52 of the karaoke device 31 scores the singing of the song M by the user, and when the singing of the song M by the user is finished, it generates scoring data indicating the scoring result of the singing. . The scoring data is data indicating the score of the song given by the song scoring unit 52 . Excellent singing, for example, singing with good pitch, rhythm, intonation, etc., is given a high score by the singing scoring section 52 . After the scoring data of the song M sung by the user is generated, the karaoke device 31 uses the digital data of the song M sung by the user as the singing voice data, the song identification information of the song M, the user's It is transmitted to the server device 11 together with the user identification information and the scoring data of the song M sung by the user. The singing voice data collection unit 21 of the server device 11 stores the singing voice data, the music identification information, the user identification information and the scoring data received from the karaoke device 31 in the storage unit 13 in association with each other. The above processing is executed each time the user sings along with the music M. When a plurality of users sing the music M, a plurality of singing voice data of the music M are stored and accumulated in the storage unit 13 of the server device 11 . Note that the process of accumulating singing voice data in this way is also executed for other songs.

In the guide vocal-related data generation process shown in FIG. 2, first, the determination unit 22 of the server device 11 selects one of the plurality of singing voice data for the music M stored in the storage unit 13 that satisfies a predetermined condition. is determined as the guide vocal data for the song M (step S1). In this embodiment, the predetermined condition is that the score indicated by the scoring data is the highest among the plurality of singing voice data for the song M. In step S1, the determination unit 22 compares the scores indicated by the scoring data associated with each of the plurality of singing voice data for the song M, and selects the singing voice data with the highest score as guide vocal data for the song M. elect. As a result, the singing voice data of the best singing for the music M is selected as the guide vocal data for the music M. As a result, the user corresponding to the guide vocal data for the song M (the user who sang the song M most excellently) is selected as the guide vocalist for the song M.

Subsequently, the determination unit 22 of the server device 11 determines the guide vocal data for the determined song M by combining the song identification information of the song M and the user identification information of the user corresponding to the guide vocal data, that is, the song M. is stored in the storage unit 13 in association with the user identification information of the guide vocalist (step S2). In the present embodiment, the singing voice data determined as the guide vocal data for the song M, the song identification information of the song M, and the user identification information of the user corresponding to the singing voice data are associated with each other as described above. Since it has already been formed by the process of accumulating the singing voice data, in step S2, the determination unit 22 utilizes this already formed association to determine the guide vocal data for the song M and the song identification information for the song M. and the user identification information of the guide vocalist for the song M.

FIG. 3 shows an example of the data structure of guide vocal data. In FIG. 3, user identification information 62 and music identification information 63 are added to guide vocal data 61 as metadata. By adding the user identification information 62 and the music identification information 63 to the guide vocal data 61 in this way, an association is formed between the guide vocal data 61, the user identification information 62, and the music identification information 63. . In step S2, for example, as shown in FIG. , the association between the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information for the song M is formed.

After that, assume that a certain user performs a login operation using, for example, the remote controller 43 wirelessly connected to the karaoke device 31 in order to log in to the karaoke system 1 (step S3 in FIG. 2: YES). During the login operation, the user inputs his/her own user identification information. When such a login operation is performed, the login section 51 of the karaoke device 31 transmits the user identification information of the user who performed the login operation to the server device 11 (step S4).

The device control unit 26 of the server device 11 receives the user identification information transmitted from the karaoke device 31 and performs login processing (step S5). In the login process, the device control unit 26 confirms whether or not the user who performed the login operation is a registered user based on the received user identification information. If the user is a registered user, the user is permitted to log in to the karaoke system 1 .

In the login process, after the login of the user who has performed the login operation is permitted, the instruction unit 23 of the server device 11 determines whether there is guide vocal data for the song M corresponding to the logged-in user. (step S6). The instruction unit 23 searches the storage unit 13 based on the user identification information transmitted from the karaoke device 31, and when the guide vocal data associated with the user identification information is found, instructs the logged-in user to It is determined that there is guide vocal data for the corresponding piece of music M. If guide vocal data for music M corresponding to a logged-in user exists, the logged-in user is a guide vocalist for music M.

If there is no guide vocal data for the piece of music M corresponding to the logged-in user (step S6: NO), the process returns to step S3. On the other hand, if there is guide vocal data for the song M corresponding to the logged-in user (step S6: YES), the instruction unit 23 of the server device 11 instructs the logged-in user, that is, the guide vocalist for the song M. Then, the karaoke machine 31 is instructed to generate the interview moving image data (step S7). For example, the instruction unit 23 transmits an interview moving image generation instruction signal indicating such an instruction to the karaoke device 31 .

The generation unit 53 of the karaoke device 31 receives from the server device 11 an instruction to generate interview video data of the guide vocalist for the song M (for example, receives an interview video generation command signal), and generates a song according to the instruction. The process of generating guide vocalist interview moving image data for M is started.

In the process of generating the interview moving image data, the generation unit 53 of the karaoke device 31 first reproduces the interviewer moving image (step S8). An interviewer video is a video in which some predetermined questions are asked to the user who sang the song. The data of the interviewer moving image are stored in advance in the storage unit 33 of the karaoke device 31 . For example, the interviewer video includes the voice of the question and the video of the interviewer asking the question. For example, in the interview video, "Please introduce yourself", "Please tell me if you have any singing tips or points to be aware of when singing", "Do you have any points to get a high score?" Includes audio questions such as: The video of the interviewer moving image is displayed on the external display 42 connected to the karaoke machine 31 or the display unit of the remote controller 43 wirelessly connected to the karaoke machine 31 . Also, the voice of the interviewer moving image is output from the speaker 41 connected to the karaoke device 31 .

At the same time when the interviewer moving image is reproduced, the generation unit 53 captures the guide vocalist for the song M by the capturing unit 39 and records the voice of the guide vocalist through the microphone 40 . The guide vocalist for song M responds to the interviewer's questions in the interview video, and provides his/her own name, tips for singing song M, points to note when singing song M, and a high score for singing song M. point etc. toward the microphone 40. The content of the talk by the guide vocalist about the music M is recorded via the microphone 40, and the appearance of the guide vocalist about the music M responding to the question is photographed by the photographing unit 39. - 特許庁

In the process of generating the interview moving image data, the generation unit 53 next generates the audio data of the guide vocalist speaking about the music M recorded via the microphone 40, and the audio data of the music M captured by the imaging unit 39. Together with the video data of the guide vocalist, the video data of the interview with the guide vocalist for the song M is generated (step S9).

After completion of the generation of the guide vocalist interview video data for the song M, the photographed data transmission control unit 54 of the karaoke device 31 transmits the generated guide vocalist interview video data for the song M to the server device 11 ( step S10).

The storage control unit 24 of the server device 11 receives the interview video data of the guide vocalist for the song M transmitted from the karaoke device 31, associates the received interview video data with the guide vocal data for the song M, and stores the data. 13 (step S11). In step S11, the guide vocalist interview video data for the song M transmitted from the karaoke device 31 may be associated with the guide vocalist user identification information for the song M or the song identification information for the song M. Since the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information for the song M are associated with each other, the guide vocalist for the song M transmitted from the karaoke device 31 is associated with any one of the guide vocal data for the song M, the user identification information of the guide vocalist for the song M, and the song identification information for the song M, the interview movie data is the song The other two of the guide vocal data about M, the user identification information of the guide vocalist about music M, and the music identification information of music M are associated with each other.

FIG. 4 shows an example of the data structure of guide vocal data and interview video data. In FIG. 4, user identification information 62, music identification information 63 and link information 64 are added to guide vocal data 61 as metadata. The link information 64 is information for linking the guide vocal data 61 and the interview moving image data 65, and is information indicating the location (address) where the interview moving image data 65 is stored in the storage unit 13, for example. By adding the link information 64 to the guide vocal data 61 to which the user identification information 62 and the music identification information 63 are added, the interview video data 65 is converted into the guide vocal data 61, the user identification information 62 and the music identification information 62. associated with. In step S11, for example, as shown in FIG. 4, the determination unit 22 stores the guide vocal data for the song M to which the user identification information of the guide vocalist for the song M and the song identification information for the song M are added. By adding link information indicating the location where the guide vocalist interview video data for the song M is stored in the unit 13, the guide vocalist interview video data for the song M is stored as the guide vocal data for the song M, the song The user identification information of the guide vocalist for M and the music identification information of the music M are associated.

(Guide vocal-related data playback processing)
FIG. 5 shows guide vocal-related data reproduction processing executed in the karaoke system 1 . The guide vocal related data reproduction process is a process of reproducing the interview moving image and the guide vocal based on the interview moving image data and the guide vocal data.

In the guide vocal-related data reproduction process, it is assumed that a certain user operates, for example, the remote controller 43 wirelessly connected to the karaoke device 31 to reserve the song M (step S21: YES). Here, it is assumed that a user who is not a guide vocalist for the song M logs into the karaoke system 1 and then reserves the song M. FIG.

When the song M is reserved, the request unit 55 of the karaoke device 31 transmits the song identification information of the song M to the server device 11, as well as the guide vocal data about the song M and the interview of the guide vocalist about the song M. A request to transmit the video data to the karaoke device 31 is issued to the server device 11 (step S22). For example, when the song M is reserved, the request unit 55 sends a guide vocal-related data request signal for requesting transmission of guide vocal data for the song M and interview video data for the guide vocalist for the song M. It is transmitted to the server device 11 together with the music identification information.

The guide vocal-related data transmission control unit 25 of the server device 11 receives the music identification information of the music M, and transmits the guide vocal data about the music M and the interview video data of the guide vocalist about the music M to the karaoke device 31. (for example, when the music identification information of the music M and the guide vocal-related data request signal are received), the guide vocal data and the music for the music M associated with the received music identification information of the music M Identify guide vocalist interview video data for M. Then, the guide vocal-related data transmission control unit 25 transmits the specified guide vocal data for the song M and interview video data of the guide vocalist for the song M to the karaoke device 31 (step S23).

Subsequently, the reproduction unit 56 of the karaoke device 31 receives the guide vocal data for the song M and the interview video data of the guide vocalist for the song M, which are transmitted from the server device 11. Based on the vocalist interview video data, the guide vocalist interview video for the song M is reproduced (step S24). The image of this interview moving image is displayed on the external display 42 connected to the karaoke machine 31 or the display section of the remote controller 43 wirelessly connected to the karaoke machine 31 . Also, the audio of the interview moving image is output from the speaker 41 . A user who has made a reservation for the song M can see the appearance of the guide vocalist for the song M by watching the video of the interview video and listening to the audio of the interview video, and can see the name of the guide vocalist for the song M. can be known, and the knack for singing the song M, points to note, points for obtaining a high score, and the like can be known.

Subsequently, the reproduction unit 56 reproduces the guide vocal for the music M based on the guide vocal data for the music M while playing the music M (step S25). At this time, the reproduction unit 56 synchronizes the performance of the music piece M with the reproduction of the guide vocal. Also, the music M and the voice of the guide vocal are output from the speaker 41 . As a result, the song M sung by the guide vocalist along with the performance of the song M is reproduced. A user who has reserved the music M can listen to the singing of the guide vocalist, and by singing along with the performance of the music M, the user can compare the singing of the guide vocalist with his/her own singing.

The guide vocal-related data transmission control unit 25 of the server device 11 receives a request from the karaoke device 31 to transmit the guide vocal data for the song M and the interview video data of the guide vocalist for the song M to the karaoke device 31. At the point in time, the guide vocalist's interview video data for the song M may not have been generated yet. In this case, the guide vocalist-related data transmission control unit 25 does not transmit the guide vocalist interview video data for the song M to the karaoke device 31 in step S23. Also, in this case, the reproduction unit 56 of the karaoke device 31 does not reproduce the interview video of the guide vocalist for the song M (step S24 is skipped).

As described above, the karaoke system 1 according to the first embodiment of the present invention generates interview video data of a guide vocalist. According to the karaoke system 1, using the interview video data, it is possible to easily convey to the user specific information about the guide vocalist, remarks of the guide vocalist (advice about singing in this embodiment), and the like. By conveying specific information about the guide vocalist to the user, it is possible to respond to the desire of the user to know about the guide vocalist. In addition, by conveying specific information about the guide vocalist to the user, the user's trust or familiarity with the guide vocalist is formed, and the user's willingness or enjoyment to practice singing can be enhanced. In addition, by conveying the words of the guide vocalist to the user, the user can obtain useful information for practicing singing, such as singing tips and points to note when singing.

In addition, the karaoke system 1 of the present embodiment stores the interview moving image data in the storage unit 13 of the server device 11, and transmits the interview moving image data from the server device 11 to the karaoke device 31 in response to a request from the karaoke device 31. , the karaoke device 31 reproduces the interview moving image. As a result, it is possible to easily convey specific information about the guide vocalist or the remarks of the guide vocalist to the user who sings using the karaoke device 31 . Since the user can sing with the karaoke device 31 immediately after being informed of singing tips and points to be noted in singing from the guide vocalist, the user can effectively practice singing. By storing the interview moving image data in the storage unit 13 of the server device 11 , the interview moving image data can be transmitted to the plurality of karaoke devices 31 that can communicate with the server device 11 . Therefore, it is possible to widely convey specific information about the guide vocalist or the remarks of the guide vocalist to many users.

Also, the karaoke system 1 of the present embodiment transmits interview video data of the guide vocalist for the song reserved by the user from the server device 11 to the karaoke device 31 when the user reserves the song. Thereby, when the user sings along with the performance of the music by the karaoke device 31, the user can watch the interview video of the guide vocalist about the music, and the guide vocalist conveys the information via the interview video. You can immediately practice singing the song according to singing tips or notes.

In addition, the karaoke system 1 of the present embodiment, in response to a request from the karaoke device 31, transmits the guide vocal data for one song and the interview video data of the guide vocalist for the song from the server device 11 to the karaoke device 31. Send to As a result, the user listens to the guide vocalist's singing voice for the song immediately after watching the interview video of the guide vocalist for the song. and listening to the voice of the song sung by the guide vocalist at the same time. Therefore, the user can specifically understand the knack of singing the music.

Also, the karaoke system 1 of the present embodiment generates interview video data of the guide vocalist when the guide vocalist logs into the karaoke system 1 . As a result, it is possible to efficiently and reliably generate guide vocalist interview video data. For example, in order to generate the guide vocalist's interview video data, it is possible to save the trouble of contacting the guide vocalist in advance and making a schedule for generating the interview video data. In addition, it is possible to prevent the failure to generate the guide vocalist's interview video data due to the difficulty of making such a schedule.

Also, the karaoke system 1 of the present embodiment uses the karaoke device 31 to generate interview video data of the guide vocalist. As a result, it is possible to photograph the guide vocalist at the site where the guide vocalist performs karaoke (such as in a karaoke room) and generate interview video data. Therefore, it is possible to generate an interview moving image with a sense of realism, and to improve the quality of the interview moving image.

Also, the karaoke system 1 of the present embodiment reproduces an interviewer moving image, and generates interview moving image data by photographing a guide vocalist who responds to the interviewer moving image. By using interview videos, the guide vocalist can provide information that many users want to know, such as the name of the guide vocalist, singing tips, and points to note when singing, or items that are widely useful for singing practice. You can ask a question and get the answer from a guide vocalist. Therefore, it is possible to generate interview moving image data that matches the needs of many users.

[Second embodiment]
FIG. 6 shows the configuration of a karaoke system 2 according to a second embodiment of the invention. In the karaoke system 2 of the second embodiment shown in FIG. 6, the same components as those of the karaoke system 1 of the first embodiment are denoted by the same reference numerals, and descriptions thereof are omitted. In the karaoke system 2 of the second embodiment, the mobile terminal 81 is included in the karaoke system 2, and the mobile terminal 81 generates interview video data of the guide vocalist.

As shown in FIG. 6 , the karaoke system 2 includes a server device 71 , a karaoke device 75 and a mobile terminal 81 . The server device 71 and the karaoke device 75 are connected so as to be able to communicate with each other via a computer network 5 such as the Internet. The server device 71 and the mobile terminal 81 are connected so as to be able to communicate with each other via a mobile communication network (not shown) and a computer network 5 such as the Internet. Although not shown, the karaoke system 2 includes a plurality of karaoke devices 75 and a plurality of mobile terminals 81. Each karaoke device 75 is connected to the server device 71 so as to be able to communicate with each other. 71 are communicably connected to each other. A plurality of portable terminals 81 are used by a plurality of users of the karaoke system 2, respectively.

The server device 71 is the same as the server device 11 in the first embodiment except for the instruction section 73 and the storage control section 74 of the arithmetic processing section 72 . The instruction unit 73 and the storage control unit 74 in the server device 71 will be explained together with the explanation of the guide vocal related data generation process of the second embodiment which will be described later.

The karaoke machine 75 is the same as the karaoke machine 31 of the first embodiment, except that it does not have the generation unit 53 and the photographed data transmission control unit 54 of the karaoke machine 31 of the first embodiment.

The mobile terminal 81 is, for example, a smart phone, a tablet, a notebook personal computer, or the like. The mobile terminal 81 includes an arithmetic processing unit 82 , a storage unit 83 , an operation unit 84 , a display unit 85 , a microphone 86 , a speaker 87 and an imaging unit 88 . The arithmetic processing unit 82 has a CPU. The storage unit 83 is a semiconductor storage device capable of storing information. The operation unit 84 includes buttons, a touch panel, and the like provided on the mobile terminal 81 for operating the mobile terminal 81 and inputting information. The display unit 85 is a device that displays information, and is a display provided in the mobile terminal 81 . A microphone 86 and a speaker 87 are built in the mobile terminal 81 . The imaging unit 88 is a camera built in the mobile terminal 81 or connected to the mobile terminal 81, and can shoot moving images.

The arithmetic processing unit 82 of the mobile terminal 81 reads and executes a computer program (for example, application software provided by a karaoke operator) stored in the storage unit 83 of the mobile terminal 81, for example, so that the generation unit 91, the captured data It functions as a transmission control section 92 , a terminal control section 93 and a communication control section 94 . The generation unit 91 and the photographed data transmission control unit 92 will be described together with the description of the guide vocal related data generation process of the second embodiment which will be described later. A terminal control unit 93 performs basic control of the mobile terminal 81 , and a communication control unit 94 performs basic communication control between the mobile terminal 81 and the server device 71 .

FIG. 7 shows guide vocal related data generation processing of the second embodiment executed in the karaoke system 2 . The guide vocal-related data generation process is executed for a plurality of songs. Here, a case where the guide vocal-related data generation process is executed for one song M out of the plurality of songs will be described.

As in the case of the guide vocal-related data generation processing of the first embodiment, before the guide vocal-related data generation processing of the second embodiment is performed, a plurality of music pieces M are stored in the storage unit 13 of the server device 71. of singing voice data are stored and accumulated.

In the guide vocal related data generation process of the second embodiment shown in FIG. One piece of singing voice data that satisfies a predetermined condition is determined as guide vocal data for the piece of music M (step S31). The predetermined condition is, as in the first embodiment, that the score indicated by the scoring data is the highest among a plurality of pieces of singing voice data for the piece of music M. FIG. Further, the contents of the process of step S31 are the same as the contents of the process of step S1 in the guide vocal-related data generation process of the first embodiment shown in FIG. By the processing of step S31, the singing voice data of the best singing for the music M is selected as the guide vocal data for the music M. As a result, the user corresponding to the guide vocal data for the song M is selected as the guide vocalist for the song M.

Subsequently, the determination unit 22 of the server device 71 stores the determined guide vocal data for the music M in the storage unit 13 in association with the music identification information for the music M and the user identification information for the guide vocalist for the music M. (step S32). The contents of the process of step S32 are the same as the contents of the process of step S2 in the guide vocal-related data generation process of the first embodiment shown in FIG.

Subsequently, the instruction unit 73 of the server device 71 identifies the terminal identification information of the mobile terminal 81 used by the guide vocalist for the song M based on the user identification information of the guide vocalist for the song M (step S33). The terminal identification information of the mobile terminal 81 is information for identifying each mobile terminal 81 . In this embodiment, the terminal identification information of the mobile terminal 81 is used by the server device 11 to send a push notification to the mobile terminal 81. Therefore, the terminal identification information of the mobile terminal 81 is the terminal identification used for the push notification. information (eg device token). For example, terminal association information as shown in FIG. 8 is stored in advance in the storage unit 13 of the server device 71 . The terminal association information includes user identification information of each registered user (for example, "U****") and terminal identification information of the mobile terminal 81 used by each registered user. (for example, "T****"). The instructing unit 73 specifies the terminal identification information of the portable terminal 81 used by the guide vocalist for the song M using the terminal association information as shown in FIG.

Subsequently, the instruction unit 73 of the server device 71 selects the mobile terminal 81 used by the guide vocalist for the song M (hereinafter simply referred to as "mobile terminal 81") based on the terminal identification information specified in step S33. ) to generate interview moving image data (step S34). Specifically, the instruction unit 73 sends a push notification indicating such an instruction to the mobile terminal 81 .

The terminal control unit 93 of the mobile terminal 81 notifies the guide vocalist of the song M that the push notification sent from the server device 71 has been received by displaying a banner, ringing sound, or the like. Then, when the guide vocalist for the song M operates the mobile terminal 81 to respond to the push notification, the generation unit 91 of the mobile terminal 81 generates interview video data of the guide vocalist for the song M. to start. The content of the processing for generating the guide vocalist interview video data for the song M is the processing for generating the guide vocalist interview video data for the song M in the guide vocalist-related data generation processing of the first embodiment ( Since this is the same as steps S8 and S9) in , a brief description will be given here.

In the process of generating guide vocalist interview video data for the song M, first, the generator 91 of the mobile terminal 81 reproduces the interviewer video (step S35). The interviewer moving image is displayed on the display unit 85 of the mobile terminal 81 . Data of the interviewer moving image are stored in advance in the storage unit 83 of the mobile terminal 81 . At the same time when the interviewer moving image is reproduced, the generation unit 91 captures the guide vocalist for the song M, which responds to the interviewer's question in the interviewer moving image, using the image capturing unit 88 of the mobile terminal 81, and also captures the voice of the guide vocalist. is recorded via the microphone 86 of the mobile terminal 81 . Next, the generating unit 91 combines the audio data of the voice spoken by the guide vocalist for the song M recorded via the microphone 86 with the video data of the guide vocalist for the song M shot by the shooting unit 88, An interview moving image data of the guide vocalist for the song M is generated (step S36).

After completion of the generation of the guide vocalist interview video data for the song M, the captured data transmission control unit 92 of the mobile terminal 81 transmits the generated guide vocalist interview video data for the song M to the server device 71 ( step S37).

The storage control unit 74 of the server device 71 receives the interview video data of the guide vocalist for the song M transmitted from the mobile terminal 81, and converts the received interview video data into the guide vocal data for the song M and the guide vocalist for the song M. or the music identification information of the music M, and stored in the storage unit 13 (step S38).

Note that the guide vocal-related data reproduction processing in the karaoke system 2 of the second embodiment is the same as that in the karaoke system 1 of the first embodiment, so the description thereof will be omitted here.

The karaoke system 2 of the second embodiment of the present invention also provides the same effects as the karaoke system 1 of the first embodiment of the present invention. In addition, in the karaoke system 2 of the second embodiment, the mobile terminal 81 generates interview video data of the guide vocalist based on the push notification from the server device 71 to the mobile terminal 81 . The guide vocalist can start the process of generating the interview video data by responding to the push notification at any timing. Therefore, the guide vocalist can respond to the interview of the interviewer moving image using, for example, free time. This makes it possible to reduce the burden on the guide vocalist involved in the generation of the interview video.

In each of the above embodiments, in the process of generating the guide vocalist's interview video data for the song M, the generator 53 of the karaoke device 31 (or the generator 91 of the mobile terminal 81) generates the song M spoken in response to the question. An interview video is generated by combining the guide vocalist's voice and the video of the guide vocalist responding to the question. In this case, in the guide vocal-related data generation process, after the server device 11 (71) receives the interview video data of the guide vocalist for the song M from the karaoke device 31 (75) (after step S10 in FIG. 2, or After step S37 in FIG. 7), the server apparatus 11 transmits the video of the guide vocalist singing the song M in response to the question, which is included in the interview video of the guide vocalist about the song M. For example, the picture-in-picture method or the like is used to synthesize the video of the guide vocalist. Also, in this case, the video data of the guide vocalist for the song M singing the song M is acquired by, for example, the following method. That is, as described above, the karaoke system 1 ( 2 ) performs processing for accumulating singing voice data of a plurality of users who respectively sing the music M in the storage unit 13 of the server device 11 . In this process, the video data of the plurality of users singing the music M are accumulated in the storage unit 13 of the server device 11 together with the singing voice data of the plurality of users singing the music M respectively. Then, when synthesizing the video of the guide vocalist of the song M singing the song M with the interview video of the guide vocalist of the song M, the song M stored in the storage unit 13 of the server device 11 is synthesized. The video data of the guide vocalist for the song M singing the song M is acquired from the video data of a plurality of users singing respectively. By synthesizing the video of the guide vocalist singing the music M with the interview video of the guide vocalist about the music M, the quantity and quality of information transmitted to the user through the interview video can be increased. In synthesizing the video of the guide vocalist singing the song M with the interview video of the guide vocalist about the song M, the guide vocalist speaking in response to the question included in the interview video of the guide vocalist about the song M. The video of the guide vocalist may be replaced with the video of the guide vocalist for the song M singing the song M.

Further, in each of the above-described embodiments, the interviewer moving image is reproduced in the process of generating the guide vocalist interview moving image data. Alternatively, it may be displayed on the external display 42 or the like, or the display unit 85 of the mobile terminal 81 . Also, instead of the guide vocalist's interview video, a guide vocalist's free talk video may be generated.

Further, in the karaoke system 1 of the first embodiment, when the guide vocalist for the song M logs in to the karaoke system 1, the guide vocalist interview video data for the song M is generated (step (see S3-S9). In this process, when the guide vocalist for the song M logs in to the karaoke system 1, if the guide vocalist's interview video data for the song M has already been generated, the guide vocalist's interview video for the song M is generated. The process of generating data may not be performed. As a result, it is possible to prevent redundant generation of interview videos of the same guide vocalist for the same song.

Further, in each of the above-described embodiments, in the guide vocal-related data reproduction process, the guide vocalist data is reproduced after the interview video of the guide vocalist is reproduced (steps S24 and S25 in FIG. 5). However, in the guide vocalist-related data reproduction process, the order of reproduction of the guide vocalist's interview video and the reproduction of the guide vocal data is not limited.

Also, in the guide vocal-related data reproduction process, the reproduction of the guide vocalist's interview video for one piece of music may be restricted to once for each user. This processing can be realized, for example, by storing the playback history of the guide vocalist's interview video for each song in the storage unit 13 or the like of the server device 11 (71) for each user.

Further, in each of the above embodiments, the interview video data of the guide vocalist generated in the karaoke system 1 (2) is transferred from the server device 11 (71) to the karaoke device 31 (75) in response to a request from the karaoke device 31 (75). and is reproduced by the karaoke device 31 (75). However, the method of using the guide vocalist interview video data generated in the karaoke system 1 (2) is not limited to this. For example, the user may connect to the Internet using a mobile terminal or the like, and download the interview video data of the guide vocalist or perform streaming playback.

Also, the method of associating the guide vocal data with the user identification information and the song identification information, or the method of associating the guide vocal data and the interview video data are not limited to the methods described in the embodiments.

Further, in each of the above embodiments, the condition for determining the guide vocal data from among the plurality of singing voice data is that the score indicated by the scoring data is the highest. The condition for determination is not limited to this.

In addition, the present invention can be modified as appropriate within the scope not contrary to the gist or idea of the invention that can be read from the scope of claims and the entire specification, and karaoke systems with such modifications also conform to the technical concept of the present invention. included.

Reference Signs List 1, 2 karaoke system 11, 71 server device 12, 72 arithmetic processing unit 13 storage unit (storage device)
22 decision unit 23, 73 instruction unit 24, 74 storage control unit 25 guide vocal-related data transmission control unit (second transmission unit)
31, 75 karaoke device 32 arithmetic processing unit 39 imaging unit 51 login unit 53 generation unit 54 photographed data transmission control unit (first transmission unit)
55 request unit 56 reproduction unit 81 mobile terminal 82 arithmetic processing unit 88 photographing unit 91 generation unit 92 photographed data transmission control unit (first transmission unit)

Claims (5)

A karaoke system comprising a server device and a karaoke device communicably connected to the server device,
The server device
One singing voice data that satisfies a predetermined condition is determined as specific singing voice data from among a plurality of singing voice data of singing performed by a plurality of users in tune with one song, and the specified singing voice data is A determination unit that stores in a storage device in association with user identification information of a specific user who is a user corresponding to the specific singing voice data and music identification information of the one music,
an instruction unit for instructing the karaoke machine to generate specific user photographed data, which is moving image data of the specific user, when the user identification information of the specific user is received from the karaoke machine;
The specific user photographed data is received from the karaoke device, and the received specific user photographed data is associated with the specific singing voice data, the user identification information of the specific user, or the song identification information of the one song. A storage control unit that stores in the storage device,
The karaoke device is
a login unit that transmits user identification information of a user logging into the karaoke system to the server device;
a generation unit that generates the specific user photographed data by photographing the specific user when the server device instructs to generate the specific user photographed data;
A karaoke system, comprising: a first transmission unit that transmits the specific user photographed data generated by the generation unit to the server device. In the karaoke machine, the generating unit reproduces a question moving image, which is a moving image for asking the specific user, when the server device instructs to generate the specific user photographed data, and reproduces the question moving image. 2. The karaoke system according to claim 1, wherein said specific user photographed data is generated by photographing said specific user who responds to the request. A karaoke system comprising a server device, a plurality of portable terminals used by a plurality of users and connected communicatively with the server device, and a karaoke device communicatively connected with the server device There is
The server device
One singing voice data that satisfies a predetermined condition is determined as specific singing voice data from among a plurality of singing voice data of singing performed by each of the plurality of users along with one song, and the specific singing voice data is determined as the specific singing voice data. , a determination unit that stores in a storage device in association with user identification information of a specific user who is a user corresponding to the specific singing voice data and music identification information of the one music piece;
an instruction unit for instructing a portable terminal used by the specific user among the plurality of portable terminals to generate specific user photographed data, which is video data obtained by photographing the specific user;
The specific user photographed data is received from the mobile terminal used by the specific user, and the received specific user photographed data is the specific singing voice data, the user identification information of the specific user or the one A storage control unit that stores in the storage device in association with music identification information of the music,
Each mobile terminal is
a generation unit that generates the specific user photographed data by photographing the specific user when the server device instructs to generate the specific user photographed data;
A karaoke system, comprising: a first transmission unit that transmits the specific user photographed data generated by the generation unit to the server device. In each of the mobile terminals, the generation unit reproduces a question video, which is a video for asking the specific user, when the server device instructs to generate the specific user photographed data, and reproduces the question video. 4. The karaoke system according to claim 3, wherein said specific user photographed data is generated by photographing said specific user responding to a moving image. The server device
When receiving the music identification information of the one music piece from the karaoke device and requesting transmission of the specific user photographed data and the specific singing voice data corresponding to the one music piece from the karaoke device, A second transmission unit that transmits the specific user photographed data and the specific singing voice data associated with the music identification information of one song to the karaoke device,
The karaoke device is
a request unit that transmits music identification information of the one music piece to the server device and requests the server device to transmit the specific user photographed data and the specific singing voice data corresponding to the one piece of music;
a reproduction unit that reproduces a moving image of the specific user and the singing voice of the specific user based on the specific user image data and the specific singing voice data corresponding to the one song received from the server device; 5. The karaoke system according to any one of claims 1 to 4, characterized by comprising:

Images