JP2011075804A - System for identifying face of person who attends karaoke party - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reliably inform that performance of a request musical piece is started, while it is individually notified to a person who reserves the requested musical piece. <P>SOLUTION: The system includes: a camera which is installed for taking images of persons who gather in a space where a Karaoke performance device is installed; and a spot light mounted on an electrical universal head, which individually illuminates persons who gather in the space where the Karaoke performance device is installed. On the basis of face image data of a plurality of persons who are imaged by the camera, and a face feature data corresponding to a personal ID associated with the request musical piece, a person of the personal ID specified among the plurality of persons imaged by the camera is identified, and his or her position is specified. Before starting performance of any request musical piece, the person corresponding to the person ID associated with the request musical piece is individually illuminated by the spot light. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a system for identifying faces of people gathering at a karaoke party, and more particularly, to a system that effectively informs a person who has reserved a request when a requested song is played.

  Karaoke is usually used by a group of multiple people in a party format. The karaoke system receives performance requests from people gathering at the karaoke party, registers them in a queue, and sequentially performs the performance processing.

  When the requested music is played, if the person who has reserved the request can be informed prior to the start of the performance, the karaoke can be used more smoothly and the enjoyment increases. The following technologies have been developed as systems intended for such a purpose.

Patent Document 1 (Japanese Patent Laid-Open No. 10-240274):
The karaoke apparatus described in this document is provided with an automatic tracking camera that automatically tracks a user who is selecting and inputting music with a remote controller and photographs its face, and tracks and captures a reservation input infrared signal as a trigger. In the reservation list display, the photographed user's face is displayed together with the name of the karaoke song reserved at that time. When the performance of a karaoke song starts, the photographed face is displayed together with the song title. This makes it easier to understand who sings.

Patent Document 2 (Japanese Patent Laid-Open No. 11-24681):
This document describes a karaoke performance device that captures and displays a video of a requesting person. This karaoke apparatus is provided with a function of happily informing who the person who reserved the karaoke music is.

  The main body of the karaoke performance device registers the music ID included in the request signal sent from the remote controller reservation device in the reservation list, and advances the performance of the karaoke music according to the reservation list. The remote control reservation device includes a video camera and temporarily stores the shot video. The user's video is taken and the video data is attached to the request signal.

  The main body of the karaoke performance device registers the music ID included in the request signal sent from the remote controller reservation device and the video data in the reservation list in association with each other, and each song is included in the reservation list during or before the performance of the music. The video data associated with the music ID is reproduced and displayed on the display. Thereby, it is possible to happily inform who the person who reserved the karaoke music is.

JP-A-10-240274 JP-A-11-24681

  According to the above-described prior art, when a requested song is played, the person who has reserved the request can be happily informed of who the person has reserved by displaying the person's face image or video. Can do.

  The karaoke space is a fun place for people to gather there, where there are people who concentrate on singing the requested songs to the karaoke performance, and those who listen to the songs, while the requested songs that they have reserved Until the performance starts, each person enjoys eating and drinking, having a conversation, and reading the table of contents. In such a case, when the requested song reserved by the user starts playing, even if his face image or video is displayed on the display, it is not always noticed immediately. In this case, there is no choice but to wait for someone to notice and let you know, but it is not enough in terms of making karaoke use smoother.

  The present invention has been made in view of the background as described above, and its purpose is to provide an individual alert to a person who has reserved a request when the requested song starts playing. It is to provide a system that can be surely notified.

The system according to the present invention is specified by the following items (11) to (19).
(11) The camera, spotlight, karaoke performance device, and computer system (12) The camera can shoot people gathering in the space where the karaoke performance device is installed (13) Spot The light is mounted on the electric pan head, and it is possible to individually illuminate people gathering in the space where the karaoke performance device is installed. (14) The karaoke performance device plays the requested songs registered in the queue in order. (15) The requested music registered in the queue is associated with a personal ID that identifies the requester. (16) The computer can access a face database in which the personal ID is associated with facial feature data. (17) The computer uses the facial image data of a plurality of people photographed by the camera and the facial feature data corresponding to the personal ID associated with the requested song. Therefore, it is possible to distinguish a plurality of people photographed with a camera by a personal ID associated with a requested song, and identify a person with a personal ID identified from a plurality of people photographed with a camera, and specify its position. (18) The computer identifies a person having a personal ID identified from a plurality of persons photographed by a camera, identifies the position, and individually illuminates the person at that position. (19) Before starting to play a requested song, the computer individually illuminates a person corresponding to the personal ID associated with the requested song with a spotlight.

The system according to the present invention will be described by the following items (21) to (30).
(21) A system including a camera, a super-directional speaker, a karaoke performance device, and a computer. (22) The camera can photograph people gathering in a space where the karaoke performance device is installed (23 ) The super directional speaker can transmit voice messages by individually selecting people gathering in the space where the karaoke performance device is installed. (24) The karaoke performance device will order the requested songs registered in the queue. (25) The requested music registered in the queue is associated with a personal ID identifying the requesting person. (26) The computer is a face database in which the personal ID is associated with facial feature data. (27) The computer can detect the facial feature data corresponding to the face image data of a plurality of people photographed by the camera and the personal ID associated with the requested song. Based on the data, a plurality of people photographed with the camera are distinguished by a personal ID associated with the requested song, and a person with a personal ID identified from the plurality of people photographed with the camera is identified and their positions are determined. (28) The computer identifies a person with a personal ID identified from a plurality of persons photographed with a camera, identifies the position, and aims at the person at that position. (29) Prior to the start of playing a requested song, the computer audibly sends a voice message to the person corresponding to the personal ID associated with the requested song. Output (30) A voice message tells you that the song you requested will begin playing

  When the requested song starts to be played, it is possible to notify the person who reserved the request while informing the individual attention.

It is a top view which shows the installation state of the system which makes 1st Embodiment of this invention. It is a block diagram which paid its attention to the data flow in the principal part of this invention system. It is a block diagram which shows the hardware structural example of the karaoke apparatus which makes the principal part of 1st Embodiment of this invention. It is a top view which shows the installation state of the system which makes 2nd Embodiment of this invention. It is a block diagram which shows the structural example of the karaoke apparatus which makes the principal part of 2nd Embodiment of this invention.

=== System Forming the First Embodiment of the Present Invention ===
FIG. 1 shows an installed state of a system according to the first embodiment of the present invention.
The system shown in the figure includes a camera 31, a spotlight 32, and a karaoke apparatus 100. The karaoke apparatus 100 includes a karaoke performance apparatus and a computer.

The camera 31 is configured using an image sensor such as a CCD or a CMOS, and is installed so that people 4a to 4e gathering in a karaoke use space (karaoke room) 30 in which the karaoke apparatus 100 is installed can be photographed.
The spotlight 32 is mounted on the electric head 33 and installed so that the people 4a to 4e gathering in the space 30 in which the karaoke apparatus 100 is installed can be individually illuminated.

=== Karaoke device ===
In FIG. 2, the karaoke apparatus 100 plays the requested songs registered in the queue in order. The requested music registered in the queue is associated with a personal ID that identifies the requester.

  The karaoke apparatus 100 can access a face database 210 in which a personal ID and face feature data are associated with each other. The face database 210 is not particularly limited, but is installed in the server 200 that is connected for communication via a communication network such as the Internet or Internet VPN.

  In the face database 210, face feature data associated with the personal ID of the karaoke user is accumulated. For facial feature data, for example, (1) IEICE Transactions D-II Vol.J84-D-II No3. Pp.500-508 March 2001, (2) Japan Society for Precision Engineering Research report vol.19, No.3, pp.1-10, 2004, (3) JP2009-110460, etc.

  The karaoke apparatus 100 receives the face feature data corresponding to the personal ID by accessing the face database 210 and transmitting the personal ID associated with the requested music registered in the queue as search data. Can do. Thereby, in the karaoke apparatus 100, face feature data can be matched with the request music and personal ID of a queue. The personal ID may be obtained by inputting the reservation music to the reservation person who performs the reservation operation when the requested music is reserved.

=== Karaoke device computer ===
1 and 2, the computer of the karaoke apparatus 100 uses a camera 31 based on face image data of a plurality of persons 4a to 4e photographed by the camera 31 and face feature data corresponding to the personal ID associated with the requested song. A plurality of people 4a to 4e photographed at 31 are distinguished by a personal ID accompanying the requested song, and a person (for example, 4c) having a personal ID identified from among the plurality of people 4a to 4e photographed by the camera 31 is identified. The position can be specified.

  In this computer, a person 4c having a personal ID identified from among a plurality of persons 4a to 4e photographed by the camera 31 is identified and its position is specified, and the person 4c at that position is individually illuminated. A software function for controlling the electric head 33 of the spotlight 32 is installed. The person is identified based on the face image data photographed by the camera 31 and the face feature data associated with the personal ID associated with the requested music. For this identification, for example, the documents (1) to (1) described above are used. 3) Use face recognition technology as described.

  As a result, the computer individually illuminates the person (for example, 4c) corresponding to the personal ID associated with the requested music piece with the spotlight before starting to play the requested music piece.

=== Specific Hardware Configuration Example of Karaoke Apparatus ===
FIG. 3 shows a schematic configuration example of the hardware main body of the karaoke apparatus used in the system of the present invention.
The karaoke apparatus 100 is a computer application device equivalent to a well-known personal computer, and the central processing unit 11 forming the core forms a computer main body including a CPU, a RAM, and a ROM.

  Under the control and management of the central processing unit 11, a hard disk device 12 serving as a large-capacity external storage, an optical disk playback device 13 such as a CD-ROM or DVD-ROM, a karaoke host device via a dedicated line or public communication line, etc. A communication control device 14 that communicates with a database server and the like, and a user interface device 15 that exchanges input from the user and responses to the user are installed. In addition, a music generation device 16 that generates an acoustic signal of accompaniment music based on music performance data in MIDI format, an acoustic device 17 that amplifies an accompaniment music, an acoustic signal from a microphone 171, etc., and generates a sound from a speaker 172, an LCD or PDP A display (display device) 182 using the above, a video processing device 18 for processing video data to be displayed on the display 182, an I / O (input / output) port 19 such as a USB port, and the like are installed.

  The hard disk device 12 stores karaoke data including accompaniment music data mainly composed of MIDI data and lyric character data that is a generation origin of lyrics subtitles for a large number of karaoke songs. In addition, for the long-format video data in a predetermined format, script data that defines the video data processing sequence (storage location and processing order of video data to be processed, etc.) Table of contents information such as the release year and the singing part of the lyrics is also stored.

  The user interface device 15 includes an operation panel 151 of the karaoke device 100 main body and a karaoke remote control device 152. In order to exchange operation information with the karaoke remote control device 152, short distance wireless communication means (IrDA transceiver, infrared LED, infrared light receiving element) capable of bidirectional communication is provided. The reservation operation of the requested song and the acquisition of the personal ID are performed via the user interface device 15.

  To the I / O port 19, a camera 31, a spotlight 32, an electric pan head 33, and the like are connected as external devices. The central processing unit 11 performs lighting control of the spotlight 32 and direction control of the electric camera platform 33 via the I / O port 19.

=== Effect of the system according to the first embodiment ===
According to the system of the first embodiment described above, when the requested song starts to be played, the spotlight 32 is irradiated to the person who reserved the requested song (for example, 4c). This makes it possible to reliably, effectively and happily notify that the requested song will be played from now on while performing individual alerts to the person 4c who has reserved the requested song.

=== System Forming Second Embodiment of the Invention ===
FIG. 4 shows an installed state of the system according to the second embodiment of the present invention.
If it demonstrates paying attention to the difference with 1st Embodiment mentioned above, in the system shown to the figure, it replaces with the spotlight 32 and the super-directional speaker 34 is installed. Superdirective speakers transmit sound information only to one person or a group of people as described in, for example, http://www.ntspat.co.jp/rpt/sudo.pdf. It can be made inaudible to people in the area.

  There are various types and forms of superdirective speakers. In the second embodiment shown in the figure, a superdirective speaker (speaker unit) 34 having an acoustic directivity only in a specific direction (front) is used. . This super-directional speaker 34 is mounted on an electric head 35 and selectively transmits acoustic information to any one person (for example, 4c) among the people 4a to 4e gathering in the space 30 where the karaoke apparatus 100 is installed. It is installed as possible.

  In the computer of the karaoke apparatus 100, a person (for example, 4c) having a personal ID identified from among a plurality of persons 4a to 4e photographed by the camera 31 is identified by face recognition, and its position is specified. A software function for controlling the electric head 35 of the super directional speaker 34 so as to match the acoustic direction with the person 4c is installed.

  Prior to the start of playing a certain requested song, the computer acoustically outputs a voice message to the person 4c corresponding to the personal ID associated with the requested song by the super-directional speaker 34. This voice message informs you that the performance of the song you requested will begin.

  In this embodiment, the sound directing direction is moved by moving the direction of the super-directional speaker 34 with the electric head 35. However, the phase control moves the sound directing direction while the speaker is fixed. When the superdirective speaker of the type is used, the electric camera platform 35 can be eliminated.

  FIG. 5 shows a schematic configuration example of the hardware main body of the karaoke apparatus used in the system of the second embodiment described above. When focusing on the difference from the configuration example shown in FIG. 3, in the system shown in FIG. 3, the camera 31, superdirective speaker 34, electric head 35, etc. are connected to the I / O port 19 as external devices. Has been. Moreover, it has the audio | voice production | generation part 341 for producing | generating the audio | voice signal of the audio | voice message reproduced by the super directional speaker 34 acoustically. The central processing unit 11 controls the direction of the super-directional speaker 34 by controlling the electric head 35 via the I / O port 19.

=== Features of the system according to the second embodiment ===
In the system of the second embodiment described above, when the requested song starts playing, a voice message is acoustically output to the person who reserved the requested song (for example, 4c), thereby reserving the requested song. It is possible to reliably notify the person 4c that the requested song will be played.

=== Combination of the first and second embodiments ===
The spotlight 31 of the first embodiment and the superdirective speaker 34 of the second embodiment can be provided side by side.

100 Karaoke equipment (including karaoke performance equipment and computer)
DESCRIPTION OF SYMBOLS 11 Central processing unit 12 Hard disk device 13 Optical disk reproducing device 14 Communication control device 15 User interface device 151 Operation panel 152 Karaoke remote control device 16 Music generation device 171 Microphone 172 Speaker 17 Audio device 18 Video processing device 182 Display (display device)
19 I / O (input / output) port 210 Face database 200 Server 30 Karaoke space (Karaoke room)
31 Camera 32 Spotlight 33, 35 Electric pan head 34 Super directional speaker 341 Sound generator 4a-4e People gathering in karaoke space

Claims (2)

A system comprising a camera, a spotlight, a karaoke performance device, and a computer,
The camera can shoot people who gather in the space where the karaoke performance device is installed,
The spotlight is mounted on the electric pan head and can individually illuminate people gathering in the space where the karaoke performance device is installed.
The karaoke device plays the requested songs in the queue in order,
The request song registered in the queue is associated with a personal ID that identifies the requester,
The computer can access a face database in which a personal ID and face feature data are associated,
Based on the face image data of a plurality of people photographed by the camera and the facial feature data corresponding to the personal ID associated with the requested song, the computer identifies the plurality of people photographed by the camera by the personal ID associated with the requested song. It is possible to identify and identify a person with a personal ID identified from among a plurality of people photographed with a camera,
The computer identifies a person with a personal ID identified from a plurality of people photographed with a camera, identifies its position, and controls the electric head of the spotlight to individually illuminate the person at that position Is possible,
Prior to starting playing a requested song, the computer individually illuminates a person corresponding to the personal ID associated with the requested song with a spotlight. A system comprising a camera, a super-directional speaker, a karaoke performance device, and a computer,
The camera can shoot people who gather in the space where the karaoke performance device is installed,
The super directional speaker can transmit voice messages by individually selecting people who gather in the space where the karaoke performance device is installed.
The karaoke device plays the requested songs in the queue in order,
The request song registered in the queue is associated with a personal ID that identifies the requester,
The computer can access a face database in which a personal ID and face feature data are associated,
Based on the face image data of a plurality of people photographed by the camera and the facial feature data corresponding to the personal ID associated with the requested song, the computer identifies the plurality of people photographed by the camera by the personal ID associated with the requested song. It is possible to identify and identify a person with a personal ID identified from among a plurality of people photographed with a camera,
The computer can control the super-directional speaker to identify a person with a personal ID identified from a plurality of people photographed by a camera, specify the position, and aim the person at the position. Yes,
Before starting to play a requested song, the computer outputs a voice message to the person corresponding to the personal ID associated with the requested song through a super-directional speaker. A system that conveys the idea that will start.

Images