JP7258441B2 - karaoke device - Google Patents

Description

The present invention relates to a karaoke machine.

2. Description of the Related Art Conventionally, a karaoke machine is provided with a plurality of video output terminals so that a plurality of displays can be connected. When such a karaoke apparatus is installed in a karaoke bar, such as a karaoke box or a night bar, the displays are arranged so that the user can see any one of the displays wherever he is in the karaoke room. By displaying lyrics telops on all of these displays, the singer can sing while looking at the lyrics displayed on any of the displays.

In recent years, as displays have become larger screens, karaoke operators have come to provide high-definition karaoke videos, such as live videos of artists. Along with this, the number of users who want to thoroughly enjoy watching such high-definition karaoke videos is increasing. For users who want to thoroughly enjoy the karaoke video, the display of lyric telops on all displays as described above may hinder the enjoyment of the live video.

Therefore, techniques for switching between a display that displays lyrics telops and a display that does not display lyrics telops have been proposed (see Patent Literatures 1 and 2). In Patent Document 1, a user uses a remote control device during a karaoke performance to change the display mode of each display into a lyric display mode that displays lyric telops and an information display mode that displays information such as a list of songs played. A technique for manually switching to . In Patent Document 2, each monitor is provided with a remote control light-receiving part, and the monitor corresponding to the remote control light-receiving part that receives the reservation signal of the song displays the karaoke video of the song, and the other monitors display any video. A technique for automatically switching the display mode is described.

JP-A-9-114477 JP-A-11-126085

However, as time goes by and the place becomes lively due to an increase in the amount of alcohol consumed, users of karaoke establishments may find it unsatisfactory to sit down and sing while moving or dancing. . Therefore, if the display that displays the lyric telop is fixed as in the technique described in Patent Document 2, the singer must gaze at the display and cannot move freely, which prevents singing. you won't be able to enjoy it. On the other hand, although it is possible to switch the display that displays the lyrics telop using the technology described in Patent Document 1, it is troublesome for the singer to switch the display while singing. Moreover, it is difficult for a singer to reliably switch displays by operating a remote controller while singing.

The present invention has been made in view of the above problems, for example, and an object of the present invention is to enable a singer to enjoy karaoke singing while singing karaoke, and to allow users other than the singer to enjoy karaoke videos. To provide a karaoke device with which users can enjoy watching

In order to solve the above problems, the karaoke apparatus of the present invention includes a plurality of display units, and a plurality of photographing units provided in association with each of the plurality of display units for photographing a subject in the display direction of each display unit. In the karaoke device connected to, a performance control unit that plays the song based on the performance data of the song selected by the singer, and a display unit that displays a background image and lyrics telop along with the performance of the song , a facial feature data acquisition unit that acquires the facial feature data of the singer from the facial feature data indicating the facial features registered in advance, and output from the plurality of photographing units a face image data detection unit for detecting face image data representing a face image from the photographed image data of the singer; and the facial feature data of the singer from the face image data detected by the face image data detection unit. a face image data extraction unit for extracting the matching face image data; a face direction detection unit for detecting the face direction of the singer from the face image data extracted by the face image data extraction unit; and the face direction. a photographed image data selection unit that selects photographed image data in which the face direction of the singer is closer to the front from the photographed image data output from the plurality of photographing units based on the detection result of the detection unit; The display control unit displays the lyrics telop on the display unit associated with the image capturing unit that outputs the captured image data selected by the captured image data selection unit, and displays the lyrics telop on the display unit other than the display unit. is characterized by performing control not to display the lyric telop.

According to the present invention, a singer can enjoy singing karaoke while singing karaoke, and users other than the singer can enjoy watching karaoke video.

1 is a configuration diagram of a karaoke system provided with a karaoke device according to a first embodiment; FIG. 1 is a block diagram showing the configuration of a karaoke device according to a first embodiment; FIG. 3 is a block diagram showing the configuration of a video input/output unit of the karaoke device according to the first embodiment; FIG. 4 is a sequence diagram showing the operation of the karaoke system including the karaoke device according to the first embodiment; FIG. 4 is a diagram showing an example of a song reservation screen according to the first embodiment; FIG. 4 is a flow chart showing the operation of the karaoke device according to the first embodiment during karaoke performance. 4A and 4B are diagrams showing an example of a captured image represented by captured image data output from each camera according to the first embodiment; FIG. FIG. 11 is a diagram showing an example of a song reservation screen according to the second embodiment; FIG. It is a flowchart which shows the operation|movement at the time of a karaoke performance of the karaoke apparatus based on 2nd Embodiment. FIG. 10 is a diagram showing an example of a captured image represented by captured image data output from each camera according to the second embodiment;

<First embodiment>
A karaoke apparatus according to the first embodiment will be described with reference to FIGS. 1, 2, and 3. FIG. FIG. 1 is a configuration diagram of a karaoke system 1 including a karaoke device 3 according to the first embodiment. FIG. 2 is a block diagram showing the configuration of the karaoke device 3 according to the first embodiment. FIG. 3 is a block diagram showing the configuration of the video input/output unit 33 of the karaoke device 3 according to the first embodiment.

As shown in FIG. 1, a karaoke system 1 includes a server device 2, a plurality of karaoke devices 3, and a plurality of remote control devices 4, which can communicate information with each other. Also, as shown in FIG. 1, a wireless LAN (local area network) 5 is constructed by the karaoke device 3 and the remote control device 4, and the wireless LAN 5 is connected to the Internet 6 via a router and a modem (both not shown). It is connected. The server device 2 is also connected to the Internet 6 via a router and a modem (both not shown). Although one remote control device 4 is connected to one karaoke device 3 in FIG. 1 , a plurality of remote control devices 4 may be connected to one karaoke device 3 .

As shown in FIG. 2, the server device 2 stores identification information of users who use the karaoke system 1 (hereinafter referred to as user IDs) in association with login passwords, facial feature data, singing histories, and the like. , has a user database 21 . The facial feature data is data indicating features of the user's face, and is information capable of specifying at least the outline of the face and the positions of the eyes, nose, and mouth. For example, facial feature data is image data obtained by photographing a user's face.

The karaoke device 3 includes a storage unit 31, a communication circuit 32, a video input/output unit 33, a control unit 34 such as a CPU (central processing unit) that controls various processes in the karaoke device 3, and an audio processing unit 35. have

The storage unit 31 has a semiconductor storage device such as a flash memory, or a magnetic storage device such as a hard disk. The storage unit 31 stores a login user management table and a reserved music management table, which will be described later. The storage unit 31 also stores performance data, which will be described later. The communication circuit 32 has a circuit for communicating with another device (the server device 2 in this embodiment) via the router and the Internet 6 . The communication circuit 32 also has a circuit for building a wireless LAN with another device (the remote control device 4 in this embodiment).

The video input/output unit 33 has a plurality of video output terminals and a plurality of video input terminals, and one video input terminal is associated with one video output terminal. In this embodiment, as shown in FIG. 3, the video input/output unit 33 has three video output terminals 331a, 331b, 331c and three video input terminals 332a, 332b, 332c. The video output terminal 331a is associated with the video input terminal 332a, the video output terminal 331b is associated with the video input terminal 332b, and the video output terminal 331c is associated with the video input terminal 332c.

A plurality of display units (displays) are connected to the video output terminals 331a, 331b, and 331c. Specifically, the display 10a is connected to the video output terminal 331a, the display 10b is connected to the video output terminal 331b, and the display 10c is connected to the video output terminal 331c. The displays 10a, 10b, and 10c are arranged in the karaoke room so that the user can visually recognize one of the displays depending on the layout of the karaoke room in which the karaoke device 3 is installed. be.

Cameras, which are a plurality of photographing units, are connected to the video input terminals 332a, 332b, and 332c. Specifically, the video input terminal 332a is connected to the camera 11a, the video input terminal 332b is connected to the camera 11b, and the video input terminal 332c is connected to the camera 11c.

The cameras 11a, 11b and 11c are arranged so as to be able to photograph the display directions of the displays 10a, 10b and 10c. In this embodiment, the camera 11a captures the subject in the display direction of the display 10a, the camera 11b captures the subject in the display direction of the display 10b, and the camera 11c captures the subject in the display direction of the display 10c. Here, the display direction of the display is the direction facing the screen of the display, which is the front of the display.

The cameras 11a, 11b, and 11c also output captured image data obtained by capturing images to video input terminals 332a, 332b, and 332c of the karaoke machine 3, respectively. Specifically, the camera 11a outputs captured image data CD1 in the display direction of the display 10a to the video input terminal 332a. The camera 11b outputs captured image data CD2 in the display direction of the display 10b to the video input terminal 332b. The camera 11c outputs the captured image data CD3 in the display direction of the display 10c to the video input terminal 332c.

The control unit 34 functions as functional blocks 341 to 347, which will be described later, by reading and executing computer programs stored in the storage unit 31, for example.

The performance control unit 341 plays music based on the performance data of the music selected by the user (singer). The display control unit 342 performs control to display background images and lyric telops on the displays 10a, 10b, and 10c as the music is played. The facial feature data acquisition unit 343 acquires facial feature data of the singer.

The face image data detection unit 344 detects face image data from the photographed image data CD1, CD2 and CD3 input from the cameras 11a, 11b and 11c. The face image data extraction unit 345 extracts the face image data of the singer from the face image data detected by the face image data detection unit 344 based on the face feature data of the singer acquired by the face feature data acquisition unit 343. Extract. The face direction detection unit 346 detects the face direction of the singer based on the singer's face image data extracted by the face image data extraction unit 345 . Based on the face direction of the singer detected by the face direction detection unit 346, the photographed image data selection unit 347 selects the face direction of the singer from the photographed image data input from the cameras 11a, 11b, and 11c. Select the closest photographed image data.

The acoustic processing unit 35 controls the performance of music and processes the singing voice signal input through the microphone 8 under the control of the performance control unit 341 . The sound processing unit 35 includes, for example, a MIDI sound source, an A/D converter, a mixer including a DSP (Digital Signal Processor), a D/A converter, and an amplifier (all not shown). The performance control unit 341 sequentially reads the performance data of the reserved music pieces from the storage unit 31 based on the tempo clock signal, and inputs them to the MIDI sound source. The MIDI tone generator generates musical tone signals based on the input performance data. The A/D converter converts the singing voice signal input from the microphone 8 into digital voice data and inputs it to the mixer (DSP). A mixer mixes the musical tone signal and the digital audio data at an appropriate ratio. The D/A converter converts the mixed signal into an analog audio signal, and the amplifier amplifies the analog audio signal from the D/A converter and outputs it to the speaker 9 as a sound emission signal. As a result, the karaoke performance sound based on the sound emission signal and the singing voice from the microphone 8 are emitted from the speaker 9 .

The remote control device 4 has a touch panel 41, a storage section 42, a communication circuit 43, and a control section 44 such as a CPU (Central Processing Unit).

The touch panel 41 functions as a display unit that displays various types of information, and also functions as an input unit that receives user input operations. The storage unit 42 has a semiconductor storage device such as a flash memory. The communication circuit 43 has a circuit for constructing the karaoke device 3 and the wireless LAN 5 .

The control unit 44 controls various processes in the remote control device 4 by reading and executing computer programs stored in the storage unit 42, for example. In the present embodiment, the control unit 44 displays on the touch panel 41 a screen (a music search screen, a music reservation screen, etc., which will be described later) showing various information such as a music search menu and music search results. Further, the control unit 44 transmits information input by the user via the touch panel 41 to the karaoke device 3 and the server device 2 via the communication circuit 43 .

Next, with reference to FIGS. 4 and 5, the operation of the karaoke system 1 when a user reserves music will be described.

FIG. 4 is a sequence diagram showing the operation of the karaoke system 1 when a user reserves a song. FIG. 5 is a diagram showing an example of a song reservation screen according to the first embodiment. First, the user uses the remote controller 4 to perform a login operation by entering a user ID and a password. The control unit 44 of the remote control device 4 transmits the combination of the user ID and password input by the login operation to the server device 2 (step S401).

Server device 2 transmits to remote control device 4 the singing history and facial feature data corresponding to the combination of the user ID and password received from remote control device 4 (step S402). The control unit 44 of the remote control device 4 transmits the facial feature data received from the server device 2 together with the user ID to the karaoke device 3 as login user information (step S403).

The control unit 34 of the karaoke device 3 receives the login user information transmitted from the remote control device 4 via the communication circuit 32 . Then, the control unit 34 registers the received login user information in the login user management table (step S404). The login user management table is a table that stores user IDs of users and facial feature data in association with each other.

Next, the user operates the remote control device 4 to display a song search screen (not shown) on the touch panel 41 of the remote control device 4 . Then, the user searches for reservation candidate music (music desired to be sung) from the music search screen, and determines the reservation candidate music from the search results. Then, the control unit 44 of the remote control device 4 causes the touch panel 41 to display the song reservation screen 50 shown in FIG. At that time, the control unit 44 displays a list 51 of user icons (icons of users logged into the karaoke device 3) on the song reservation screen 50. FIG. The user selects his/her own user icon from the user icon list 51 displayed on the music reservation screen 50 . In the example shown in FIG. 5, user icons 52 to 54 of three users are displayed, and user icon 53 is selected. When the user performs the reservation operation on behalf of another user, the user icon of the other user may be selected. Further, the user icon is received by the remote control device 4 from the server device 2 when each user performs a login operation, and is associated with the user ID of the user.

When the user presses the transfer button 55 on the song reservation screen, the controller 44 of the remote controller 4 reserves the identification information of the song determined as a reservation candidate (hereinafter referred to as song ID) and the user ID. It is transmitted to the karaoke device 3 as music information (step S411). The user ID transmitted here is the user ID of the user corresponding to the user icon selected in the reservation operation. The controller 34 of the karaoke device 3 registers the reserved music piece information received from the remote control device 4 in the reserved music management table (step S412).

The operation of the karaoke apparatus 3 according to the first embodiment during karaoke performance will be described with reference to FIGS. 6 and 7. FIG. FIG. 6 is a flow chart showing the operation of the karaoke device 3 according to the first embodiment during karaoke performance. First, the control unit 34 of the karaoke device 3 reads reserved music information registered in the reserved music management table (step S601). It is assumed that the reserved music information is read one by one (one by one) in the order of registration. Further, it is assumed that the read reserved music information is deleted from the reserved music management table. Next, the control unit 34 reads the song data, lyrics telop data, and background image data corresponding to the song ID included in the read reserved song information from the storage unit 31 (step S602). Furthermore, the control unit 34 (more specifically, the facial feature data acquisition unit 343) reads facial feature data corresponding to the user ID included in the reserved music information from the login user management table (step S603).

Based on the read music data, lyrics telop data, and background image data, the control unit 34 starts performing karaoke (music performance) and displaying background images and lyrics telops on each display (step S604). ). The control unit 34 repeats the processing of steps S606 to S610 at predetermined time intervals until the karaoke performance ends (step S605).

First, the control unit 34 (more specifically, the face image data detection unit 344) detects the user's face image based on the photographed image data CD1, CD2, and CD3 continuously input from the cameras 11a, 11b, and 11c. Data is detected (step S606). As a method of detecting face image data, for example, there is a method described in Japanese Patent Application Laid-Open No. 2000-2833. In this method, edge detection is used to extract the contour of the image within the field of view indicated by each shot image data, and the region surrounded by the contour and having an area larger than a predetermined size is detected as the face image region. Furthermore, the face image data detection unit 344 uses the detected outline of the face image area and the positions of the eyes, nose, and mouth in the face image area to recognize the features of the user's face image, thereby Face image data is detected from photographed image data. FIG. 7 is a diagram showing an example of a captured image represented by captured image data input from each camera. A dashed frame in FIG. 7 schematically shows an area detected as face image data. Here, as shown in FIG. 7, it is assumed that face image data of two users are detected from the photographed image data CD1. It is also assumed that face image data of three users are detected from the photographed image data CD2. Furthermore, it is assumed that the face image data of one user is detected from the photographed image data CD3.

Next, the face image data extraction unit 345 extracts face image data that matches the face feature data of the singer read from the login user management table, that is, the face of the singer, from among the face image data detected in step S606. Image data is extracted (step S607). The face image data extracting unit 345 extracts the contour of the face, eyes, Compare the positions of the nose and mouth and quantify the degree of matching. Then, the face image data extracting unit 345 determines that the two do not match when the degree of matching is equal to or less than a predetermined threshold, and determines that the two match when the degree of matching exceeds the predetermined threshold. to decide. In this way, the face image data extraction unit 345 extracts the face image data of the singer from among the face image data detected from each photographed image data. Here, as shown in FIG. 7, it is assumed that facial image data FD1 that has been determined to match the facial feature data of the singer is extracted from facial image data detected from photographed image data CD1. It is also assumed that facial image data FD2 determined to match the facial feature data of the singer is extracted from the facial image data detected from the photographed image data CD2. Furthermore, it is assumed that facial image data FD3, which is determined to match the facial feature data of the singer, is extracted from facial image data detected from photographed image data CD3.

Next, the control unit 34 (more specifically, the face direction detection unit 346) detects all face image data (face image data FD1, FD2, FD3) extracted as matching the facial feature data of the singer. direction (hereinafter referred to as face direction) is detected (step S608). As a face direction detection method, for example, there is a method described in paragraphs 0018 to 0022 of Japanese Patent Application Laid-Open No. 2015-109614. In this method, horizontal lines and vertical lines, which are feature points such as eyes and nose, are detected from face image data, and the rotation angle of the face is determined from the detection results. Then, the direction of the singer's face is detected based on the rotation angle of the face. The face direction detection unit 346 detects the face direction of the singer from the face image data of the singer using such a method. Here, the face direction of the singer indicated by the face image data FD1 is detected as facing the front (the front direction in FIG. 7), and the face direction of the singer indicated by the face image data FD2 is the right direction (left direction in FIG. 7). , and the face direction of the singer indicated by the face image data FD3 is detected as leftward (rightward in FIG. 7).

Next, the control unit 34 (more specifically, the photographed image data selection unit 347) selects photographed image data including face image data in which the singer's face direction is closer to the front based on the detection result of step S608 ( step S609). The fact that the singer's face direction indicated by the face image data is close to the front means that the singer is gazing at the camera that outputs the photographed image data including the face image data. In the example shown in FIG. 7, photographed image data CD1 including face image data FD1 whose face direction is frontal is selected.

Finally, the control unit 34 (more specifically, the display control unit 342) controls display and non-display of the lyrics telop (step S610). At that time, the display control unit 342 displays the display 10a connected to the video output terminal 331a corresponding to the video input terminal 332a to which the camera 11a that outputs the captured image data CD1 selected in step S609 is connected. Identify it as a display to watch. Then, the display control unit 342 controls to display the lyric telop on the specified display 10a and not to display the lyric telop on the displays 10b and 10c. The display control unit 342 controls display and non-display of the lyric telop only in the lyric telop display section. Even if it is displayed, the display and non-display control of the lyric telop may not be performed.

The control unit 34 repeats the processing of steps S606 to S610 at predetermined time intervals until the karaoke performance ends, and terminates the processing when the karaoke performance ends. Note that, when reserved music information remains in the reserved music management table, the control section 34 repeatedly executes the processing of steps S601 to S610 for the reserved music information. It should be noted that the predetermined time is desirably short enough to detect the direction of the face by 30 degrees, for example, when the singer changes the direction of the face from one display to another by 90 degrees. In this case, when the direction of the singer's face changes by 60 degrees, another display is specified as the display that the singer is paying attention to, and the lyric telop is displayed. never

As described above, according to the first embodiment, the singer can display the lyric telop only on the display by focusing on the display that is easy for the singer to see according to the orientation, posture, and location of the body. Also, users other than the singer can enjoy the karaoke video by looking at any display other than the display on which the lyrics telop is displayed.

<Second embodiment>
Next, the karaoke system 1 according to the second embodiment will be described. When the user selects a duet song on the song search screen, the karaoke system 1 according to the second embodiment causes the user to specify a user icon for each singing part of the duet song on the song reservation screen, Associate singing parts with singers.

The configuration of the karaoke system 1 of the second embodiment is the same as that of the first embodiment. Therefore, for the second embodiment, the description of the configuration similar to that of the first embodiment will be omitted. Also, in the karaoke system 1 according to the second embodiment, the same reference numerals are given to the same names as in the first embodiment.

Also, the operation of the karaoke system 1 according to the second embodiment when the user reserves a song is the same as the operation of the karaoke system 1 according to the first embodiment shown in FIG. However, when the user determines a duet song as a reservation candidate song on the song search screen, the control unit 44 of the remote controller 4 causes the touch panel 41 to display a song reservation screen 80 shown in FIG.

FIG. 8 is a diagram showing an example of a song reservation screen according to the second embodiment. As shown in FIG. 8, on the music reservation screen 80, a list 81 of user icons is displayed for each singing part, and it is possible to designate a singer for each singing part. In addition, in this embodiment, for the sake of simplicity, it is assumed that a duet song containing two singing parts, a first singing part and a second singing part, is reserved.

For example, on the song reservation screen 80, users X and Y specify the user icon 83 of user X as the first singing part of the duet song of the reservation candidate, and user Y's user icon 83 as the second singing part. Assume that the icon 82 is specified. In this state, when the transfer button 85 on the music reservation screen is pressed, in step S411, the music ID of the reservation candidate, the ID of the first singing part, the user ID of user X, the ID of the second singing part, and The user ID of the user Y is transmitted to the karaoke machine 3 as reserved music information. The singing part ID is identification information that can identify the singing part, and is, for example, the part number of the singing part. When the reserved music information including the singing part ID and the user ID is transmitted, the karaoke device 3 associates the ID of the first singing part with the user ID of the user X, The ID of the second singing part and the user ID of user Y are associated with each other.

FIG. 9 is a flow chart showing the operation of the karaoke machine 3 according to the second embodiment during karaoke performance. The processing of steps S901, S902, and S904 is the same as the processing of steps S601, S602, and S604, but in step S903, the control unit 34 (more specifically, the facial feature data acquisition unit 343) Facial feature data of user X corresponding to the user ID associated with the ID of the first singing part included in the information, and user Y corresponding to the user ID associated with the ID of the second singing part included in the information from the login user management table.

After step S904, the control unit 34 alternately repeats the processing of steps S906 to S910 for each singing part at predetermined time intervals until the karaoke performance ends (step S905).

First, the processing of steps S906 to S910 performed for the first singing part will be described. The control unit 34 (more specifically, the face image data detection unit 344) detects the user's face image data based on the photographed image data continuously input from each camera (step S906). The method of detecting face image data is the same as the processing in step S606. Here, it is assumed that photographed image data CD1, CD2 and CD3 shown in FIG. 10 are input from the cameras 11a, 11b and 11c.

Next, the facial image data extraction unit 345 extracts facial image data that matches the facial feature data of user X read from the logged-in user management table from each facial image data detected in step S906 (step S907). ). Here, as shown in FIG. 10, it is assumed that face image data FD4 is extracted as face image data matching face feature data of user X from the face image data of photographed image data CD1. It is also assumed that facial image data FD5 is extracted as facial image data that matches the facial feature data of user X from the facial image data of photographed image data CD2.

Next, the control unit 34 (more specifically, the face direction detection unit 346) extracts all face image data (face image The face direction is detected for the data FD4, FD5) (step S908). The face direction detection method is the same as in step S608. Here, the face direction of the user X indicated by the face image data FD4 is detected as facing left (right direction in FIG. 10), and the face direction of the user X indicated by the face image data FD5 is detected facing front (front side in FIG. 10). direction).

Next, the control unit 34 (more specifically, the captured image data selection unit 347) selects captured image data including face image data in which the face direction of the user X is closer to the front based on the detection result of step S908. (Step S909). Here, the photographed image data CD2 including the face image data FD5 in which the face is facing forward is selected.

Finally, the control unit 34 (more specifically, the display control unit 342) controls display and non-display of the lyrics telop of the first singing part (step S910). At this time, the display control unit 342 causes the display 10b connected to the video output terminal 331b corresponding to the video input terminal 332b connected to the camera 11b that outputs the captured image data CD2 selected in step S909 to the user X. identify as the display that is gazing at. Then, the display control unit 342 controls to display the lyrics telop of the first singing part on the specified display 10b and not to display the lyrics telop of the first singing part on the displays 10a and 10c. Note that the display control unit 342 controls display and non-display of the lyric telops of the first singing part only in the display period of the lyric telops of the first singing part. In , even if the display that the singer of the first singing part is watching is specified, the display and non-display of the lyric telop of the first singing part may not be controlled.

The control section 34 performs the processing of steps S906 to S910 on the performance of the first singing part. When the processing for the first singing part is completed, the control section 34 starts the processing of steps S906 to S910 for the second singing part.

Next, the processing of steps S906 to S910 performed for the second singing part will be explained. The control unit 34 (more specifically, the face image data detection unit 344) detects the user's face image data based on the photographed image data continuously input from each camera (step S906). Here, it is assumed that photographed image data CD1, CD2 and CD3 shown in FIG. 10 are input from the cameras 11a, 11b and 11c.

Next, the facial image data extracting unit 345 extracts facial image data that matches the facial feature data of user Y read from the login management table from each facial image data detected in step S906 (step S907). Here, it is assumed that face image data FD6 is extracted as face image data matching the face feature data of user Y from the face image data of photographed image data CD1. It is also assumed that facial image data FD7 is extracted as facial image data matching the facial feature data of user Y from the facial image data of photographed image data CD2.

Next, the control unit 34 (more specifically, the face direction detection unit 346) extracts all face image data (face image The face direction is detected for the data FD6, FD7) (step S908). Here, it is detected that the face direction of the user Y indicated by the face image data FD6 is facing left (to the right in FIG. 10), and the face direction of the user Y indicated by the face image data FD7 is facing forward (toward the front in FIG. 10). ) is detected.

Next, the control unit 34 (more specifically, the captured image data selection unit 347) selects captured image data including face image data in which the face direction of user Y is closer to the front based on the detection result of step S908. (Step S909). Here, it is assumed that the photographed image data CD2 including the face image data FD7 with the face facing forward is selected.

Finally, the control unit 34 (more specifically, the display control unit 342) controls display and non-display of the lyrics telop of the second singing part (step S910). Specifically, the display control unit 342 causes the user Y to control the display 10b connected to the video output terminal 331b corresponding to the video input terminal 332b to which the camera 11b that outputs the selected captured image data CD2 is connected. Identify it as a display to watch. Then, the display control unit 342 controls to display the lyrics telop of the second singing part on the specified display 10b and not to display the lyrics telop of the second singing part on the displays 10a and 10c. The display control unit 342 controls display and non-display of the lyric telops of the second singing part only in the display period of the lyric telops of the second singing part. In , even if the display that the singer of the second singing part is watching is specified, the display and non-display of the lyric telop of the second singing part may not be controlled.

The control section 34 performs the processing of steps S906 to S910 on the second singing part. When the processing for the second singing part is completed, the control section 34 returns to the processing for the first singing part. The control unit 34 alternately repeats the processing of steps S906 to S910 for each singing part at predetermined time intervals until the karaoke performance ends, and ends the processing when the karaoke performance ends. Note that when reserved music information remains in the reserved music management table, the control unit 34 repeatedly executes the processing of steps S901 to S910 for the reserved music information. In the second embodiment, the processing of steps S906 to S910 is alternately repeated for each of the first singing part and the second singing part. Face image data that matches the feature data is extracted at the same time, the face direction of the singer of each singing part indicated by the extracted face image data is detected at the same time, and based on this detection result, the singer of each singing part is identified. By simultaneously extracting face image data in which the face is facing forward, steps S906 to S910 may be performed for each singing part at once.

As described above, according to the second embodiment, even when the user decides a singer for each singing part and sings a duet song composed of a plurality of singing parts, the same effect as the first embodiment can be obtained. be able to. In other words, the singer of each singing part can display the lyrics telop of the singing part in charge only on that display by focusing on the display that is easy for him/her to see according to the direction, posture, and location of the body while singing. can be done. Also, users other than the singer can enjoy the karaoke video by looking at any display other than the display on which the lyrics telop is displayed.

<Modification 1>
In the first and second embodiments, one photographed image data including face image data in which the face direction of the singer is close to the front is selected from the photographed image data output from each camera. Not limited to configuration. For example, it is conceivable that a plurality of photographed image data containing face image data in which the singer's face direction is close to the front is selected, and the singer's face direction based on the face image data is similarly close to the front. Therefore, in such a case, the transmittance of the lyric telop displayed on each display associated with the camera that is the output source of each shot image data selected in step S609 or step S909 is It may be changed according to the number of image data. For example, if two shot image data are selected, the transmittance of the lyrics telop displayed on each display may be set to 50%. Further, for example, when three shot image data are selected, the transmittance of the lyrics telop displayed on each display may be set to 67%. As a result, for example, when a singer sings while moving or dancing, it is possible to display lyrics telops on a display near the singer's line of sight. In addition, since the transmittance of the lyric telop is increased as the number of selected photographed image data increases, even if the number of displays displaying the lyric telop increases, users other than the singer can enjoy the karaoke video. becomes possible.

It should be noted that the present invention can be modified as appropriate within a range that does not contradict the gist or idea of the invention that can be read from the scope of claims and the entire specification, and karaoke machines and karaoke systems that involve such modifications are also subject to the scope of the present invention. Included in technical thought.

3 karaoke device 10a, 10b, 10c display (display unit)
11a, 11b, 11c Camera (shooting unit)
341 performance control unit 342 display control unit 343 face feature data acquisition unit 344 face image data detection unit 345 face image data extraction unit 346 face direction detection unit 347 photographed image data selection unit

Claims (3)

In a karaoke device connected to a plurality of display units and a plurality of photographing units provided in association with each of the plurality of display units for photographing a subject in a display direction of each display unit,
A performance control unit that plays the song based on the performance data of the song selected by the singer;
a display control unit that displays a background image and lyric telops on a display unit as the music is played;
a facial feature data acquisition unit that acquires the facial feature data of the singer from the facial feature data indicating facial features registered in advance;
a face image data detection unit for detecting face image data representing a face image from the photographed image data output from the plurality of photographing units;
a face image data extraction unit for extracting the face image data that matches the face feature data of the singer from the face image data detected by the face image data detection unit;
A face direction detection unit that detects the face direction of the singer from the face image data extracted by the face image data extraction unit;
A photographed image data selection unit that selects photographed image data in which the face direction of the singer is closer to the front from the photographed image data output from the plurality of photographing units based on the detection result of the face direction detection unit. and
The display control unit displays the lyric telop on the display unit associated with the photographing unit that outputs the photographed image data selected by the photographed image data selection unit, and displays the lyric telop on the display units other than the display unit. A karaoke device characterized by performing control not to display . When the music played by the performance control unit is a duet, the facial feature data acquisition unit obtains the facial feature data of the singer from the facial feature data registered in advance for each singing part of the song. to get to
The facial image data extracting unit extracts the facial image data that matches the facial feature data acquired by the facial feature data acquiring unit from the facial image data detected by the facial image data detecting unit. For each part, extract
The face direction detection unit detects the face direction of the singer for each singing part from the face image data extracted by the face image data extraction unit,
The photographed image data selection unit, based on the detection result of the face direction detection unit, selects the photographed image data in which the singer's face direction is closer to the front from the photographed image data transmitted from the plurality of photographing units. Select for each singing part,
The display control unit displays the lyric telop on the display unit associated with the photographing unit that transmitted the photographed image data selected by the photographed image data selection unit, and displays the lyric telop on the display units other than the display unit. 2. The karaoke apparatus according to claim 1, wherein control is performed for each singing part so as not to display . The display control unit displays lyrics on the display unit as the number of pieces of photographed image data selected by the photographed image data selection unit increases when a plurality of pieces of photographed image data are selected by the photographed image data selection unit. 3. The karaoke apparatus according to claim 1, wherein control is performed to increase the transmittance of telops.

Images