JP2016071186A - Karaoke device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform performance for livening up the atmosphere by using face images of participants of karaoke.SOLUTION: A karaoke device acquires (S102) a face image of each person from captured images captured by a camera for imaging a range where participants exist, and registers (S108) in a participant list. The karaoke device specifies (S110) the participant who is singing now, by recognizing an image of a microphone used for singing, from the captured images, and counts (S112) a singing number of each participant. The karaoke device determines (S114) superiority of the singing number of each participant registered in the participant list. Then, the karaoke device displays (S116, S118) a performance image to which a visual performance is performed to the face image of the specific participant determined based on superiority of the singing number, on a display.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a karaoke apparatus having a function of photographing and displaying karaoke participants.

  Patent Document 1 describes a karaoke device that takes a picture of a singer singing with a camera and displays it on a display. According to the karaoke apparatus described in Patent Document 1, a camera can track a singing singer and take a picture.

JP-A-10-240276

  According to the prior art as described above, it is said that a place can be excited by tracking and projecting a singer in a group participating in karaoke. However, in the system that projects only the singer, the effect of prompting the singing to the participants who do not sing very much among the groups participating in karaoke is poor.

  The present invention has been made to solve the above problems. An object of the present invention is to provide a technique for effectively performing an effect to excite a place using a participant's face image.

  The karaoke apparatus of the present invention includes an acquisition unit, a specifying unit, a determination unit, and a display control unit. The acquisition unit acquires a face image of a person from the captured image captured by the imaging unit that captures the range where the participant is present. The list creation means registers the face image acquired by the acquisition means in the participant list. The specifying means recognizes a microphone image used for singing from the captured image, and specifies a singer who is singing in the captured image. A determination means determines the degree of the experience of the singing of the participant registered in the participant list based on the identification result of the singer by the specifying means. The display control means causes a predetermined display means to display an effect image in which a visual effect is given to the face image of the specific participant determined based on the determination result by the determination means.

  According to the present invention, an effect image using a face image of the participant obtained from the captured image is displayed for the participant determined based on the degree of singing experience from the group using the karaoke apparatus. can do. By doing in this way, for example, by attracting attention to participants who are not singing, it is possible to increase the willingness to participate in singing and enhance the venue.

  In addition, as a method of determining the degree of experience of the singing of the participants, it is conceivable to count the number of times each participant sang and compare the dominance of the singing times. Therefore, it is preferable to configure as described in claim 2. That is, it further includes counting means for counting the number of times the singers have been performed for each participant registered in the participant list based on the result of specifying the singer by the specifying means. The determination means determines the superiority or inferiority by comparing the number of singings of each participant registered in the participant list. Then, the display control means causes the display means to display an effect image using the face image of the specific participant determined based on the superiority or inferiority of the singing frequency determined by the determination result. By doing in this way, according to the merits and demerits of each participant's singing frequency | count, the production image which encourages active participation to a song can be displayed.

  In addition, in order to excite the entire group using karaoke, it is important that participants with relatively little singing experience actively sing. Therefore, it is preferable to configure as described in claim 3. That is, the display control means uses the face image of a specific participant who has relatively little singing experience from among the participants registered in the participant list, and displays the effect image that prompts singing. Display on the means. By doing in this way, attention can be paid to the participant who has few singing times, active participation in the singing can be promoted, and the place can be excited effectively.

  Moreover, the karaoke apparatus of Claim 4 has the following characteristics. In other words, the display control means causes the display means to display an effect image in which an effect of a type corresponding to the number of times of singing by a specific participant is applied to the face image of the specific participant. By doing in this way, according to the participant's singing frequency | count, the production | presentation of the content suitable for each person with many singing frequency | counts and few people can be performed.

  In addition, as described in claim 5, the present invention can be realized as a program executed in a computer or a storage medium for storing the program.

1 is a block diagram illustrating a schematic configuration of a karaoke apparatus 10. FIG. The flowchart showing the procedure of effect image display processing. Explanatory drawing showing an example of a participant list. (A) Production image display example 1 (b) Production image display example 2

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, this invention is not limited to the following embodiment, It is possible to implement in various aspects.
[Description of configuration of karaoke apparatus 10]
As shown in FIG. 1, the karaoke apparatus 10 includes a control unit 11, a storage unit 12, a music playback unit 13, an audio control unit 14, a video control unit 15, a video input unit 16, and an operation unit 17. The karaoke apparatus 10 has a function of playing karaoke music requested by the user and a function of displaying various images on the display 23 when the music is played.

  The control unit 11 includes a CPU, a ROM, a RAM, and the like, and controls the operation of the karaoke apparatus 10 by executing various programs. The control part 11 creates the effect image which urges a participant to sing during performance of a music by executing the program of the effect image display process (refer FIG. 2) mentioned later (refer FIG. 4). Then, the control unit 11 causes the display 23 to display the created effect image.

  The storage unit 12 is a storage device such as a hard disk drive. The storage unit 12 stores a program executed by the control unit 11 and data used at the time of execution. Further, the storage unit 12 has a karaoke database in which a lot of music data corresponding to each karaoke music, lyrics data for displaying a telop representing the lyrics of the music, background image data to be displayed when the music is played, and the like are recorded. ing. Each piece of music data is composed of performance data (MIDI data) corresponding to the MIDI (Music Instrument Digital Interface) standard. The MIDI data includes performance data for playing the melody of the accompaniment part of karaoke music.

  The music playback unit 13 plays back music based on the music data stored in the storage unit 12. The voice control unit 14 is a device that controls voice input / output, and includes an input unit 14a, an output unit 14b, and the like. A microphone 19 is connected to the input unit 14a. Thereby, the input part 14a acquires a user's song sound. A speaker 21 is connected to the output unit 14b. The output unit 14 b outputs the sound source signal of the music reproduced by the music reproducing unit 13 and the sound source signal of the singing sound output from the input unit 14 a to the speaker 21. The speaker 21 outputs the sound source signal output from the output unit 14b in place of sound.

  The video control unit 15 reproduces and outputs video based on the video data sent from the control unit 11. A display 23 for displaying video is connected to the video control unit 15. As a result, the video control unit 15 displays the reproduced video on the display 23. The video input unit 16 is a control device that controls video input. A camera 25 is connected to the video input unit 16. Thereby, the video input unit 16 acquires image data captured by the camera 25. The camera 25 is an imaging device installed in a place (for example, a karaoke room) where the karaoke device 10 is installed, and images the entire state where the participants who perform karaoke using the karaoke device 10 are present, and images it. Output the image data.

  The operation unit 17 is an input device for performing various operations on the karaoke apparatus 10. The operation unit 17 includes a touch panel and various input buttons, and outputs an operation signal corresponding to the input operation to the control unit 11. In addition, since the other structure and function of the karaoke apparatus 10 are based on a well-known technique, detailed description here is abbreviate | omitted.

[Description of effect image display processing]
The procedure of the effect image display process which the control part 11 of the karaoke apparatus 10 performs is demonstrated, referring the flowchart of FIG. This process is started each time the performance of the music requested by the participant is started, and is executed in parallel with the music performance process. As a premise, the control unit 11 displays a background image on the display 23 based on predetermined background image data corresponding to the performance target music in parallel with the performance of the music. Further, the control unit 11 causes the display 23 to display a telop representing the lyrics in synchronism with the progress of the performance based on the lyrics data corresponding to the musical piece to be played.

  In S <b> 100, the control unit 11 determines whether or not a singing voice is input from the microphone 19. When the singing voice is input (S100: YES), the control unit 11 proceeds to S102. When the singing voice is not input (S100: NO), the control unit 11 repeats S100. In S <b> 102, the control unit 11 acquires, from the captured images captured by the camera 25, an image (face image) of each participant's face portion that is reflected in the captured image. Specifically, a face portion of a person is detected from a captured image input from the camera 25 by a known image recognition algorithm, and an image of the detected face portion is extracted. Japanese Patent No. 5002311 is an example of a known technique for recognizing a plurality of human faces from an image.

  In S <b> 104, the control unit 11 determines whether or not the processes of S <b> 106 to S <b> 112 have been performed on all face images of the participant's face image acquired in S <b> 102. When there is a face image that has not been processed (S104: NO), the control unit 11 proceeds to S106. In S106, the control unit 11 selects one of the unprocessed face images as a processing target, and a face image recognized as the same person as the selected processing target face image has already been registered in the participant list. It is determined whether or not.

  Here, the detailed contents of the participant list will be described with reference to FIG. As illustrated in FIG. 3, information corresponding to each information item of “ID”, “face image”, and “singing count” is registered in the participant list in association with each other. In the participant list, information registered up to the present time after the participant group starts using the karaoke apparatus 10 is accumulated. The ID is identification information assigned to each face image registered in the participant list. The face image is an image of the participant's face extracted from the image captured by the camera 25. The number of times of singing is information indicating how many times the participant corresponding to the face image registered in the participant list has sung.

  Returning to the flowchart of FIG. In S106, the control unit 11 compares the face image to be processed with the face image registered in the participant list using a known image recognition algorithm. And the control part 11 determines with the same person, when the similarity degree of both face images is high. When the person corresponding to the face image to be processed has already been registered in the participant list (S106: YES), the control unit 11 proceeds to S110. On the other hand, when the person corresponding to the face image to be processed is not registered in the participant list (S106: NO), the control unit 11 proceeds to S108. In S108, the control unit 11 assigns a new ID to the processing target face image, and additionally registers the processing target face image in association with the ID to which the processing target face image is added. At this time, the number of singings of the participant additionally registered in the participant list is zero.

  In the next S110, the control unit 11 performs image processing on the captured image captured by the camera 25, thereby determining whether or not the person corresponding to the face image to be processed is singing the music being played. . Specifically, the control unit 11 detects the image of the microphone 19 from the captured image captured by the camera 25 using a known image recognition algorithm. Then, an image of a person existing closest to the detected image of the microphone 19 is detected by image recognition. The detected person is specified as a singer, and it is determined whether or not the singer is the same as the person corresponding to the face image to be processed.

  When the person corresponding to the face image to be processed is not singing (S110: NO), the control unit 11 returns to S104. On the other hand, when the person corresponding to the face image to be processed is singing (S110: YES), the control unit 11 proceeds to S112. In S112, the control unit 11 adds 1 to the number of times of singing associated with the ID of the participant corresponding to the face image to be processed in the participant list. After S112, the control unit 11 returns to S104. On the other hand, when it determines with having processed about all the face images in S104 (S104: YES), the control part 11 progresses to S114. In S114, the control unit 11 determines the superiority or inferiority of the singing frequency for the singing frequency of each participant registered in the participant list.

  In S116, based on the superiority or inferiority of the number of singing times determined in S114, the control unit 11 creates an effect image in which a visual effect is applied to the face image of the participant who has the smallest number of singing times. And the control part 11 switches and displays the background image of the karaoke currently displayed on the display 23 at the predetermined timing during the performance of a music piece with the effect image created using the participant's face image with few singing times. Let At this time, the telop of the lyrics corresponding to the musical piece being played is superimposed and displayed on the effect image.

  Here, a display example of the effect image in S116 will be described with reference to FIG. As illustrated in FIG. 4A, the control unit 11 arranges the face image 51 of the participant with the smallest number of reservations in the participant list in the effect image 50. Moreover, the control part 11 arrange | positions the message 52 to the effect of encouraging singing with respect to a participant in the vicinity of the face image 51 as a speech which the participant with the fewest reservation frequency speaks in a participant list. In addition, the control unit 11 displays a telop representing the lyrics of the music superimposed on the effect image 50.

  Returning to the flowchart of FIG. In S <b> 118, the control unit 11 uses the captured image captured by the camera 25 to produce the content according to the number of times each participant sang the participant's image in the captured image. Create a production image. And the control part 11 switches the background image of the karaoke currently displayed on the display 23 to the effect image produced from the captured image, and displays it at the predetermined timing during the performance of a music.

  Specifically, the image of the person corresponding to each face image registered in the participant list is specified by image processing from the captured images obtained by capturing the current state of all participants by the camera 25. As a method for identifying a participant registered in the participant list from the captured images, for example, a method of detecting an image having high similarity to the face image in the participant list from the captured images by pattern matching can be cited. And about the image of the participant specified from the captured image, for example, an effect is given to a participant who has a large number of singing times based on the participant list. In addition, for the participant who has a small number of singing times based on the participant list, for example, an effect of giving a symbol representing a dark atmosphere is performed.

  Here, a display example of the effect image in S118 will be described with reference to FIG. As illustrated in FIG. 4B, the effect image 60 includes real images 61, 62, and 63 of a plurality of participants captured by the camera 25. Among these, it is assumed that the image 61 corresponds to the participant B who has the highest singing frequency in the participant list illustrated in FIG. 3, and the image 62 corresponds to the participant C who has the lowest singing frequency. The control unit 11 arranges a bright atmosphere design symbol indicating that the number of singings is large in the vicinity of the face image of the participant B who has many singings. On the other hand, the control part 11 arrange | positions the production | presentation pattern of the dark atmosphere showing that the frequency | count of singing is few in the vicinity of the face image of the participant C with few frequency | count of singing.

[effect]
According to the karaoke apparatus 10 of the embodiment, the following effects can be obtained.
About the participant determined based on the superiority or inferiority of the number of singing from the group using the karaoke apparatus 10, singing is promoted using the face image of the participant who sings less frequently, or using the face images of the plurality of participants It is possible to produce content according to the singing frequency. By doing this, it is possible to attract attention from participants who are not singing, or to attract participants who have a high number of singings, and to enhance the willingness to participate in singing Can do.

[Correspondence with configuration described in claims]
The correspondence between each configuration of the embodiment and the configuration described in the claims is as follows.
S102 (control unit 11) in FIG. 2 corresponds to an acquisition unit. S108 (control unit 11) in FIG. 2 corresponds to list creation means. S110 (control unit 11) in FIG. 2 corresponds to the specifying unit. S112 (control unit 11) in FIG. 2 corresponds to a counting unit. S114 (control unit 11) in FIG. 2 corresponds to a determination unit. S116 and S118 (control unit 11) in FIG. 2 correspond to display control means.

  DESCRIPTION OF SYMBOLS 10 ... Karaoke apparatus, 11 ... Control part, 12 ... Memory | storage part, 13 ... Music reproduction part, 14 ... Audio | voice control part, 14a ... Input part, 14b ... Output part, 15 ... Image | video control part, 16 ... Image | video input part, 17 ... operation unit, 19 ... microphone, 21 ... speaker, 23 ... display, 25 ... camera.

Claims (5)

An acquisition unit that acquires a face image of a person from among captured images captured by an imaging unit that captures a range in which a participant is present;
List creation means for registering the face image acquired by the acquisition means in a participant list;
A means for recognizing an image of a microphone used for singing from the captured image, and identifying a singer who is singing in the captured image;
Based on the identification result of the singer by the identification unit, a determination unit that determines the degree of experience of the singing of the participant registered in the participant list;
Display control means for causing a predetermined display means to display an effect image in which a visual effect is given to the face image of a specific participant determined based on the determination result by the determination means;
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
Based on the identification result of the singer by the specifying means, the apparatus further comprises a counting means for counting the number of times of singing for each participant registered in the participant list,
The determination means determines the superiority or inferiority by comparing the number of singings of each participant registered in the participant list,
The display control means causes the display means to display the effect image using a face image of a specific participant determined based on the superiority or inferiority of the singing frequency determined based on the determination result;
Karaoke device characterized by. In the karaoke apparatus of Claim 1 or Claim 2,
The display control means uses the face image of a specific participant who has relatively little singing experience from among the participants registered in the participant list, and displays the effect image for inviting singing. Displaying on the display means,
Karaoke device characterized by. The karaoke apparatus according to claim 2,
The display control means causes the display means to display the effect image in which the effect of the kind according to the number of times of singing of the specific participant is applied to the face image of the specific participant,
Karaoke device characterized by. An acquisition procedure for acquiring a face image of a person from among captured images captured by an imaging unit that captures a range in which a participant is present;
A list creation procedure for registering the face image acquired in the acquisition procedure in a participant list;
A specific procedure for recognizing a microphone image used for singing from the captured image and identifying a singer who sings in the captured image;
Based on the identification result of the singer in the specific procedure, a determination procedure for determining the degree of experience of the singing of the participant registered in the participant list,
A display control procedure for causing a predetermined display means to display an effect image in which a visual effect is given to the face image of a specific participant determined based on the determination result in the determination procedure;
A program that causes a computer to execute.