JP5443926B2 - A system that individually zooms in and records when singing to identify the faces of people gathering at a karaoke party - Google Patents

Description

  The present invention relates to a system that individually zooms in and records when singing to identify the faces of people gathering at a karaoke party, and in particular, the face of a person who has reserved a request during a predetermined period before and after the performance of the requested song. The present invention relates to a system for photographing and recording in close-up.

  Karaoke is usually used by a group of multiple people in a party format. The karaoke system receives performance requests from people gathering at the karaoke party, registers them in a queue, and sequentially performs the performance processing. Here, when the requested song is played, if you record and record the person who reserved the request individually, the record will be a fun topic and a good memorial for those who gathered at the karaoke party Let's go. The following systems are provided as systems that can individually capture the face of a karaoke user.

Patent Document 1 (Japanese Patent Laid-Open No. 10-240274):
The karaoke apparatus described in this document is provided with an automatic tracking camera that automatically tracks a user who is selecting and inputting music with a remote controller and photographs its face, and tracks and captures a reservation input infrared signal as a trigger. In the reservation list display, the photographed user's face is displayed together with the name of the karaoke song reserved at that time. When the performance of a karaoke song starts, the photographed face is displayed together with the song title.

Patent Document 2 (Japanese Patent Laid-Open No. 11-24681):
This document describes a karaoke performance device that captures and displays a video of a requesting person. This karaoke apparatus is provided with a function of happily informing who the person who reserved the karaoke music is.

  The main body of the karaoke performance device registers the music ID included in the request signal sent from the remote controller reservation device in the reservation list, and advances the performance of the karaoke music according to the reservation list. The remote control reservation device includes a video camera and temporarily stores the shot video. The user's video is taken and the video data is attached to the request signal.

  The main body of the karaoke performance device registers the music ID included in the request signal sent from the remote controller reservation device and the video data in the reservation list in association with each other, and each song is included in the reservation list during or before the performance of the music. The video data associated with the music ID is reproduced and displayed on the display. Thereby, it is possible to happily inform who the person who reserved the karaoke music is.

JP-A-10-240274 JP-A-11-24681

  In the above-described prior art, when a requested song is played, the person who has reserved the request can be happily informed of who is the reserved person by displaying the person's face image or video. .

  The karaoke space is a fun place for people to gather there, where there are people who concentrate on singing the requested songs along with the karaoke performance and those who listen to the songs, while the requested songs that they have reserved Until the performance starts, each person enjoys eating and drinking, having a conversation, and reading the table of contents. In such a case, when the requested song starts playing, even if the video of the person who reserved the request is displayed on the display, it does not necessarily become a topical topic at that time.

  The present invention has been made in view of the background as described above, and its purpose is to capture and record a person who has reserved the request in a predetermined period before and after the start of the performance of the requested song. The purpose is to provide a system that can leave individual shooting records that can be used as a good commemoration story or a good commemoration of people gathered at a karaoke party.

The system according to the present invention is specified by the following items (1) to (9).
(1) A system including a camera, camera control means, a karaoke performance device, and a computer (2) The camera is capable of photographing people gathering in a space where the karaoke performance device is installed (3) The camera control means controls the direction and zoom of the camera so that a specific person can be individually zoomed in from among people gathering in the space where the karaoke performance apparatus is installed. (4) Playing the requested songs registered in the queue in order (5) The requested songs registered in the queue are associated with a personal ID identifying the requester (6) It is possible to access a face database in which IDs and face feature data are associated with each other. (7) The computer can collect face image data of a plurality of people photographed by a camera, Based on the personal ID associated with the strike song and the corresponding facial feature data, a plurality of people photographed with the camera are distinguished by the personal ID associated with the requested song and identified from the plurality of people photographed with the camera (8) The computer identifies a person with a personal ID identified from a plurality of persons photographed by a camera, identifies the position, and identifies the person with a personal ID. (9) The computer corresponds to the personal ID associated with the requested song for a predetermined period from immediately before the performance of a certain requested song. A person who zooms in, and stores the image data in the storage means in association with the personal ID.

  By recording and recording the person who reserved the request in a predetermined period before and after the performance of the requested song, it can be a fun topic for people gathered at the karaoke party or a good memorial. Personalized recording records can be kept.

It is a top view which shows the installation state of the system which makes one Embodiment of this invention. It is a block diagram which paid its attention to the data flow in the principal part of this invention system. It is a block diagram which shows the hardware structural example of the karaoke apparatus which makes the principal part of one Embodiment of this invention.

=== System Forming an Embodiment of the Present Invention ===
FIG. 1 shows an installed state of a system constituting one embodiment of the present invention.
The system shown in FIG. 1 includes a camera 31, camera control means, and a karaoke apparatus 100. The karaoke apparatus 100 includes a karaoke performance apparatus and a computer.

  The camera 31 is configured using an image sensor such as a CCD or a CMOS. This camera 31 has an electric zoom function and is mounted on an electric head 33 so that people 4a to 4e gathering in a karaoke use space (karaoke room) 30 in which the karaoke apparatus 100 is installed can be arbitrarily zoomed in and photographed. Is installed.

  In this embodiment, the camera control means is configured using a computer of the karaoke apparatus 100. This camera control means controls the direction and zoom of the camera 31, and zooms in on a specific person (for example, 4c) from among the people 4a to 4e gathering in the space where the karaoke apparatus 100 is installed. Can do.

  The camera control means can also be configured by being incorporated in the camera 31 body. In this case, the computer of the karaoke apparatus 100 only needs to send a direction and zoom command to the camera 31.

=== Karaoke device ===
In FIG. 2, the karaoke apparatus 100 plays the requested songs registered in the queue in order. The requested music registered in the queue is associated with a personal ID that identifies the requester.

  The karaoke apparatus 100 can access a face database 210 in which a personal ID and face feature data are associated with each other. The face database 210 is not particularly limited, but is installed in the server 200 that is connected for communication via a communication network such as the Internet or Internet VPN.

  In the face database 210, face feature data associated with the personal ID of the karaoke user is accumulated. For facial feature data, for example, (1) IEICE Transactions D-II Vol.J84-D-II No3. Pp.500-508 March 2001, (2) Japan Society for Precision Engineering Research report vol.19, No.3, pp.1-10, 2004, (3) JP2009-110460, etc.

  The karaoke apparatus 100 receives the face feature data corresponding to the personal ID by accessing the face database 210 and transmitting the personal ID associated with the requested music registered in the queue as search data. Can do. Thereby, in the karaoke apparatus 100, face feature data can be matched with the request music and personal ID of a queue. The personal ID may be obtained by inputting the reservation music to the reservation person who performs the reservation operation when the requested music is reserved.

=== Karaoke device computer ===
1 and 2, the computer of the karaoke apparatus 100 uses a camera 31 based on face image data of a plurality of persons 4a to 4e photographed by the camera 31 and face feature data corresponding to the personal ID associated with the requested song. A plurality of people 4a to 4e photographed at 31 are distinguished by a personal ID accompanying the requested song, and a person (for example, 4c) having a personal ID identified from among the plurality of people 4a to 4e photographed by the camera 31 is identified. The position can be specified.

  In this computer, a person 4c having a personal ID identified from among a plurality of persons 4a to 4e photographed by the camera 31 is identified and its position is specified, and the person 4c at that position is individually zoomed up and photographed. Thus, a software function capable of controlling the camera control means is installed. The person is identified based on the face image data photographed by the camera 31 and the face feature data associated with the personal ID associated with the requested music. For this identification, for example, the documents (1) to (1) described above are used. 3) Use face recognition technology as described.

  As a result, the computer individually zooms in for a person (for example, 4c) corresponding to the personal ID associated with the requested music for a predetermined period from immediately before the performance of a certain requested music, and uses the video data as the personal ID. The data are stored in the storage means in association with each other.

=== Specific Hardware Configuration Example of Karaoke Apparatus ===
FIG. 3 shows a schematic configuration example of the hardware main body of the karaoke apparatus used in the system of the present invention.
The karaoke apparatus 100 is a computer application device equivalent to a well-known personal computer, and the central processing unit 11 forming the core forms a computer main body including a CPU, a RAM, and a ROM.

  Under the control and management of the central processing unit 11, a hard disk device 12 serving as a large-capacity external storage, an optical disk playback device 13 such as a CD-ROM or DVD-ROM, a karaoke host device via a dedicated line or public communication line, etc. A communication control device 14 that communicates with a database server and the like, a user interface device 15 that exchanges an input from a user and a response to the user are installed. In addition, a music generation device 16 that generates an acoustic signal of accompaniment music based on music performance data in MIDI format, an acoustic device 17 that amplifies an accompaniment music, an acoustic signal from a microphone 171, etc., and generates a sound from a speaker 172, an LCD or PDP A display (display device) 182 using the above, a video processing device 18 for processing video data to be displayed on the display 182, an I / O (input / output) port 19 such as a USB port, and the like are installed.

  The hard disk device 12 stores karaoke data including accompaniment music data mainly composed of MIDI data and lyric character data that is a generation origin of lyrics subtitles for a large number of karaoke songs. In addition, for the long-format video data in a predetermined format, script data that defines the video data processing sequence (storage location and processing order of video data to be processed, etc.) Table of contents information such as the release year and the singing part of the lyrics is also stored.

  The user interface device 15 includes an operation panel 151 of the karaoke device 100 main body and a karaoke remote control device 152. In order to exchange operation information with the karaoke remote control device 152, short distance wireless communication means (IrDA transceiver, infrared LED, infrared light receiving element) capable of bidirectional communication is provided. The reservation operation of the requested song and the acquisition of the personal ID are performed via the user interface device 15.

  A camera 31 and an electric camera platform 33 are connected to the I / O port 19 as external devices. The central processing unit 11 performs zoom control of the camera 31 and direction control of the electric camera platform 33 via the I / O port 19.

=== Effect of Embodiment System ===
In the system described above, people who gathered at the karaoke party (4a-4e) enjoyed by recording and recording the person who reserved the request in a predetermined period before and after the start of the performance of the requested song. It is possible to leave a personalized recording record that can be a topical story or a good commemoration.

100 Karaoke equipment (including karaoke performance equipment and computer)
DESCRIPTION OF SYMBOLS 11 Central processing unit 12 Hard disk device 13 Optical disk reproducing device 14 Communication control device 15 User interface device 151 Operation panel 152 Karaoke remote control device 16 Music generation device 171 Microphone 172 Speaker 17 Audio device 18 Video processing device 182 Display (display device)
19 I / O (input / output) port 210 Face database 200 Server 30 Karaoke space (Karaoke room)
31 Camera 33 Electric pan head 4a-4e People gathering in karaoke space

Claims (1)

A system comprising a camera, a camera control means, a karaoke performance device, and a computer,
The camera can shoot people who gather in the space where the karaoke performance device is installed,
The camera control means controls the direction and zoom of the camera, and can shoot a specific person individually zooming up from the people gathering in the space where the karaoke performance device is installed,
The karaoke device plays the requested songs in the queue in order,
The request song registered in the queue is associated with a personal ID that identifies the requester,
The computer can access a face database in which a personal ID and face feature data are associated,
Based on the face image data of a plurality of people photographed by the camera and the facial feature data corresponding to the personal ID associated with the requested song, the computer identifies the plurality of people photographed by the camera by the personal ID associated with the requested song. It is possible to identify and identify a person with a personal ID identified from among a plurality of people photographed with a camera,
The computer can control the camera control means to identify a person with a personal ID identified from a plurality of people photographed by the camera, specify the position, and individually zoom up the person at that position And
The computer performs individual zoom-up photography of a person corresponding to the personal ID associated with the requested music for a predetermined period from immediately before the performance of the requested music, and stores the video data in the storage means in association with the personal ID. System.

Images