JP2021022059A - Karaoke device - Google Patents

Abstract

To provide a karaoke device capable of enhancing calculation accuracy of calorie intake associated with eating and drinking of each user when a plurality of users use one karaoke room.SOLUTION: A karaoke device includes: a calorie storage unit that stores first identification information for identifying food and drink and calories of the food and drink in association with each other; a first acquisition unit that extracts a face image of each user from a video obtained by photographing a plurality of users in a room and acquires it as user identification information; a second acquisition unit that acquires an eating and drinking record related to eating and drinking performed by the plurality of users in the room based on the video; and a generation unit that generates detailed data indicating calorie intake for each of the users based on the acquired eating and drinking record and the calories of the food and drink stored in the calorie storage unit.SELECTED DRAWING: Figure 2

Description

The present invention relates to a karaoke device.

Karaoke stores provide a service that provides food and drink to the karaoke room where the karaoke equipment is installed. The user of the karaoke room can order desired food and drink from the karaoke room and enjoy eating and drinking together with karaoke singing.

Here, the food and drink provided varies from high-calorie to low-calorie. For example, the calorie intake of one glass of beer is about 150 kcal per 100 ml, while that of one highball (whiskey 1: soda 4) is about 50 kcal per 100 ml.

Therefore, in Patent Document 1, the total calorie intake value of food and drink and the calorie consumption integrated value of the singer corresponding to the personal ID associated with the food and drink order data are compared, and according to the comparison result. A technique for switching the handling process of food and drink order data is disclosed. It is said that such a technique can surely support a singer's diet plan.

Japanese Unexamined Patent Publication No. 2001-154678

By the way, when one karaoke room is used by a plurality of users, a representative may order appropriate foods and drinks at once.

In such a case, since each user is free to share the provided food and drink, it is difficult to grasp what and how much each user has eaten. Therefore, when using the technique of Patent Document 1, it is difficult to correctly calculate the calorie intake of each user.

An object of the present invention is to provide a karaoke device capable of improving the calculation accuracy of calorie intake associated with eating and drinking of each user when one karaoke room is used by a plurality of users.

One invention for achieving the above object is a calorie storage unit that stores a first identification information for identifying food and drink provided at a karaoke store, a calorie of food and drink in association with each other, and the karaoke. Based on the first acquisition unit that extracts the face image of each user from the images obtained by photographing a plurality of users in the room of the store and acquires them as user identification information, and the above-mentioned image. Based on the second acquisition unit that acquires the food and drink records related to the food and drink performed by the plurality of users in the room, and the calories of the food and drink stored in the acquired food and drink record and the calorie storage unit, the plurality of users. It is a karaoke apparatus having a generation unit that generates detailed data indicating the calorie intake for each user.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

According to the present invention, when one karaoke room is used by a plurality of users, it is possible to improve the accuracy of calculating the calorie intake associated with eating and drinking of each user.

It is a figure which shows the karaoke apparatus which concerns on 1st Embodiment. It is a figure which shows the karaoke main body which concerns on 1st Embodiment. It is a figure which shows the calorie table stored in the calorie storage part which concerns on 1st Embodiment. It is a figure which shows the image in the karaoke room photographed by the photographing means which concerns on 1st Embodiment. It is a figure which shows the eating and drinking record for each face image stored in the storage means which concerns on 1st Embodiment. It is a figure which shows the specification displayed on the display device 30 which concerns on 1st Embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on 1st Embodiment. It is a figure which shows the karaoke main body which concerns on 2nd Embodiment. It is a figure which shows the specification displayed on the display device 30 which concerns on 2nd Embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on 2nd Embodiment. It is a figure which shows the calorie table stored in the calorie storage part which concerns on a modification. It is a figure which shows the eating and drinking record for each face image stored in the storage means which concerns on the modification.

<First Embodiment>
The karaoke device according to the first embodiment will be described with reference to FIGS. 1 to 7.

== Karaoke device ==
The karaoke device K is a device for performing karaoke of music and for the user to sing karaoke. The karaoke device K is installed in the karaoke room of the karaoke store. As shown in FIG. 1, the karaoke device K includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40, a remote control device 50, and a photographing means 60.

The karaoke main body 10 performs various controls related to karaoke performance and karaoke singing, such as performance control of selected songs, display control of lyrics and background images, and processing of audio signals input through a microphone 40. The speaker 20 is configured to emit sound based on the sound emitted signal from the karaoke main body 10. The display device 30 is configured to display an image or an image on the screen based on the signal from the karaoke body 10. The microphone 40 is configured to convert the singing voice of karaoke singing into an analog singing voice signal and input it to the karaoke main body 10. The remote control device 50 is a device for performing various operations on the karaoke main body 10. The photographing means 60 is a camera for photographing the inside of the karaoke room. A plurality of photographing means 60 may be provided in the karaoke room.

As shown in FIG. 2, the karaoke body 10 according to the present embodiment includes storage means 10a, communication means 10b, input means 10c, and control means 10d. Each configuration is connected to bus B via an interface (not shown).

[Memory means]
The storage means 10a is a large-capacity storage device that stores various types of data, such as a hard disk drive. The storage means 10a stores a plurality of music data for performing karaoke performance by the karaoke device K.

In the present embodiment, a part of the storage area of the storage means 10a functions as a calorie storage unit 100.

The calorie storage unit 100 stores the first identification information for identifying the food and drink provided at the karaoke store and the calories of the food and drink in association with each other. The first identification information is unique information given to each food or drink, such as a dedicated identification ID. The calorie of food and drink is the amount of heat absorbed in the body when the food and drink is ingested.

FIG. 3 shows an example of a calorie table stored in the calorie storage unit 100. For example, for food F1, the first identification information is "ID-F01" and the calorie is "800 kcal". Further, for the drink D1, the first identification information is "ID-D01" and the calorie is "100 kcal". The calorie table is preset according to the food and drink that can be provided for each karaoke store.

[Communication means / input means]
The communication means 10b provides an interface for communicating with the remote control device 50. The input means 10c is configured for the user to input various instructions. The input means 10c is a button or the like provided on the karaoke body 10. Alternatively, the remote control device 50 may function as the input means 10c. For example, when a plurality of users use one karaoke room in which the karaoke device K is installed, one user (representative) orders appropriate food and drink via the remote control device 50. The karaoke store clerk prepares food and drink according to the order and provides it to the karaoke room users.

[Control means]
The control means 10d performs various controls on the karaoke device K. The control means 10d includes a CPU and a memory (neither of which is shown). The CPU realizes various functions by executing a program stored in the memory.

In the present embodiment, the control means 10d functions as a first acquisition unit 200, a second acquisition unit 300, a generation unit 400, and a notification unit 500 by executing a program stored in the memory by the CPU.

(First acquisition department)
The first acquisition unit 200 extracts a face image of each user from a video obtained by photographing a plurality of users in a room of a karaoke store, and acquires it as user identification information.

As a method for extracting a user's face image from a video, a known image recognition processing method can be used. In addition, the user identification information is information for distinguishing a plurality of users.

For example, suppose that three users enter a karaoke room in which a karaoke device K is installed. The shooting means 60 starts shooting in the karaoke room from the time when the user enters the room. Therefore, the image obtained by the photographing means 60 includes the figures (faces and movements) of the three users.

The first acquisition unit 200 analyzes the image obtained by the photographing means 60 and extracts the face image of the user included in the image. In this example, the first acquisition unit 200 acquires the face images X1, X2, and X3 of three people as user identification information.

(Second acquisition department)
The second acquisition unit 300 acquires food and drink records relating to food and drink performed by a plurality of users in the room based on the video. The food and drink record is a record of what a user has eaten and how much he or she has eaten or eaten (for example, the ratio of eating or drinking).

Here, a specific example of acquiring a food and drink record will be described with reference to FIG. FIG. 4 is an image of the inside of the karaoke room taken by the shooting means 60. According to this video, users corresponding to the face images X1 to X3 are present in the karaoke room, and the ordered food and drink foods F1 to F3 and drinks are on the table T placed in the center. The DP, the drinks D1 to D3, the plates P1 to P3 for separating the food, and the glasses G1 to G3 for pouring the drink DP are placed. The image of the food and drink provided at the karaoke store is stored in the storage means 10a in association with the first identification information for identifying the food and drink. Further, the second acquisition unit 300 can recognize the types of empty plates and glasses as well as food and drink.

The second acquisition unit 300 acquires the food and drink record corresponding to the user identification information of the user based on the movement of the user included in the video.

For example, suppose that a user corresponding to the face image X1 reaches for the hood F1 to eat and drink, while a user corresponding to the face image X2 takes a picture of the hood F1 on a plate P2. Hereinafter, not only eating and drinking, but also serving on a plate and pouring into a glass will be referred to as "food and drink". In addition, when one user divides the plate into another user's plate, it is assumed that the user closest to the position where the plate is placed eats and drinks after the distribution.

The second acquisition unit 300 analyzes the movement of the user corresponding to the face image X1, and obtains an image of the hood at which the user reaches out and an image stored in advance in the storage means 10a. By comparing, it is specified that the food eaten and eaten by the user is food F1. In addition, the second acquisition unit 300 acquires the first identification information corresponding to the hood F1. When the second acquisition unit 300 identifies a certain hood as the hood F1, the second acquisition unit 300 stores the first identification information corresponding to the hood F1 in association with the position information on the table, and thereafter the position. The first identification information corresponding to the hood F1 can be specified based on the information. In this case, the position information shall be updated when the user moves the hood.

On the other hand, the second acquisition unit 300 specifies the ratio of eating and drinking by each user for each food and drink provided, and acquires the specified ratio as a food and drink record.

In the above example, the second acquisition unit 300 analyzes the movement of the user corresponding to the face image X1 and calculates the ratio of the user eating and drinking with respect to the specified food F1. The calculation of such a ratio can be performed by analyzing the video using a known method. Further, depending on the type of food and drink, it may be calculated back from the ratio remaining after the user eats and drinks.

For example, in the case of foods such as "yakisoba" and "pilaf", the ratio of eating and drinking is calculated by dividing the volume of eating and drinking by the model original volume of the food stored in advance. Can be calculated. Further, in the case of a drink provided by a pitcher, it can be calculated by dividing the capacity of eating and drinking by the capacity of the pitcher stored in advance. In addition, when a large number of foods and drinks such as "French fries" and "edamame" are provided together, the number of foods and drinks eaten by the user is calculated in advance as the predetermined total weight and the average weight per piece. The ratio can be calculated by dividing by the average total number stored based on. Also, in the case of foods and drinks with a relatively small number of dishes per plate, such as "fried chicken" and "pizza" that is served evenly cut, the number of foods and drinks eaten by the user is calculated and the predetermined source stored in advance is stored. The ratio can be calculated by dividing by the number of.

In the above example, the second acquisition unit 300 calculates that the ratio of the user corresponding to the face image X1 eating and drinking the food F1 is 60%, and the ratio of the user corresponding to the face image X2 eating and drinking the food F1. It is assumed that it is calculated as 40%. On the other hand, it is assumed that the user corresponding to the face image X3 does not eat or drink the food F1. In this case, the second acquisition unit 300 calculates that the ratio of the user corresponding to the face image X3 eating and drinking the food F1 is 0%.

The second acquisition unit 300 associates the acquired first identification information of the hood F1 with 60% of the food and drink ratio of the user corresponding to the face image X1 and acquires it as a food and drink record related to the face image X1. In addition, the second acquisition unit 300 associates the acquired first identification information of the hood F1 with 40% of the user's eating and drinking corresponding to the face image X2, and acquires it as a food and drink record related to the face image X2. .. Further, the second acquisition unit 300 associates the acquired first identification information of the hood F1 with 0% of the user eating and drinking corresponding to the face image X3, and acquires it as a food and drink record related to the face image X3. .. The second acquisition unit 300 stores the acquired food and drink records in the storage means 10a for each face image.

FIG. 5 is a food and drink record for each face image stored in the storage means 10a. According to the example of FIG. 5, for example, regarding the food F2, 60% of the users corresponding to the face image X1 eat and drink, and 20% of the users corresponding to the face image X2 and the users corresponding to the face image X3 respectively. I'm eating and drinking. Regarding the food F3, 30% of the users corresponding to the face image X1 eat and drink, 50% of the users corresponding to the face image X2 eat and drink, and 20% of the users corresponding to the face image X3 eat and drink. .. Regarding the drink DP, 50% of the users corresponding to the face image X1 eat and drink, 40% of the users corresponding to the face image X2 eat and drink, and 10% of the users corresponding to the face image X3 eat and drink. On the other hand, for drinks D1 to D3, 100% of the users corresponding to the face images X1 to X3 are eating and drinking.

In addition, one user may eat and drink the same food and drink in multiple times. In this case, the second acquisition unit 300 acquires the eating and drinking record by specifying the ratio of eating and drinking by the user each time the video of the user eating and drinking is obtained and summing the specified ratio.

In addition, if there is no leftover food or drink at the end of the usage time of the karaoke room, adjust appropriately so that the total ratio of food and drink by the user is 100%, and if there is leftover food, obtain a second acquisition. Part 300 specifies the proportion of food and drink when the amount of food and drink is 100% excluding leftover food, and acquires it as a food and drink record.

Alternatively, it may be complicated to obtain the ratio of eating and drinking for each food and drink, such as when a plurality of small dishes are ordered. In such a case, the second acquisition unit 300 may acquire the food and drink record by evenly specifying the ratio by the number of users who eat and drink based on the video. For example, when there are two users who eat and drink the food F1, a user who corresponds to the face image X1 and a user who corresponds to the face image X3, the second acquisition unit 300 determines the face regardless of the eating and drinking ratio. Eating and drinking records are acquired with the ratio of the user corresponding to the image X1 and the user corresponding to the face image X3 being 50%, respectively.

(Generator)
The generation unit 400 generates detailed data indicating the calorie intake for each of a plurality of users based on the acquired food and drink record and the calorie of the food and drink stored in the calorie storage unit 100.

In the above example, it is assumed that the usage time of the karaoke room has elapsed. In this case, the generation unit 400 obtains the calorie intake of each user corresponding to the face images X1 to X3. Here, the calorie table of FIG. 3 and the food and drink record of FIG. 5 will be described as examples.

The generation unit 400 obtains the calorie intake CI1 of the user corresponding to the face image X1. The calorie intake CI1 is (food F1 calorie 800 kcal x 60%) + (food F2 calorie 500 kcal x 60%) + (food F3 calorie 1000 kcal x 30%) + (drink DP calorie 700 kcal x 50%) + ( The calorie of drink D1 is 100 kcal x 100%) = 1530 kcal.

In addition, the generation unit 400 obtains the calorie intake CI2 of the user corresponding to the face image X2. The calorie intake CI2 is (food F1 calorie 800 kcal x 40%) + (food F2 calorie 500 kcal x 20%) + (food F3 calorie 1000 kcal x 50%) + (drink DP calorie 700 kcal x 40%) + ( The calorie of drink D2 is 150 kcal x 100%) = 1350 kcal.

In addition, the generation unit 400 obtains the calorie intake CI3 of the user corresponding to the face image X3. The calorie intake CI3 is (food F1 calorie 800 kcal x 0%) + (food F2 calorie 500 kcal x 20%) + (food F3 calorie 1000 kcal x 20%) + (drink DP calorie 700 kcal x 10%) + ( The calorie of drink D3 is 200 kcal x 100%) = 570 kcal.

The generation unit 400 generates detailed data in which the calculated calorie intake and the face image are linked. The generation unit 400 may generate detailed data based on a value obtained by rounding off a fraction (for example, 10 kcal or less) of the calculated calorie intake.

(Notification unit)
The notification unit 500 notifies a plurality of users of the details based on the generated detail data.

The details can be notified by various methods. For example, the notification unit 500 causes the display device 30 of the karaoke device K to display the details based on the detail data.

FIG. 6 shows an example of the details displayed on the display device 30. According to this specification, the calorie intake of the user corresponding to the face image X1 is 1530 kcal, the calorie intake of the user corresponding to the face image X2 is 1350 kcal, and the calorie intake of the user corresponding to the face image X3 is. It is 570 kcal. Each user can grasp the calorie intake associated with eating and drinking based on his / her face image.

As another method for notifying the details, for example, the notification unit 500 may transmit the details data to each user's mobile terminal using known short-range wireless communication. Alternatively, the notification unit 500 converts the detailed data into a two-dimensional code and displays it on the display device 30. By reading the two-dimensional code with their own mobile terminal, each user can check the details on the mobile terminal and grasp his / her own calorie intake. The notification unit 500 is not an essential configuration provided in the karaoke device K. For example, the generation unit 400 transmits the generated detailed data to a server device (not shown). Then, the server device may transmit the detailed data to each user's mobile terminal.

== Processing in karaoke equipment ==
Next, the process in the karaoke device K according to the present embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing processing in the karaoke device K. In this example, the calorie storage unit 100 stores the first identification information for identifying the food and drink provided at the karaoke store and the calories of the food and drink in association with each other.

When a plurality of users enter the karaoke room in which the karaoke device K is installed, the shooting means 60 starts shooting in the karaoke room (starting shooting in the karaoke room. Step 10).

The first acquisition unit 200 extracts a face image of each user from a video obtained by photographing a plurality of users in a room of a karaoke store and acquires it as user identification information (user identification information). Is obtained. Step 11).

The second acquisition unit 300 acquires food and drink records related to food and drink performed by a plurality of users in the room based on the video (acquires food and drink records for each user. Step 12).

When the usage time of the karaoke room has elapsed (in the case of Y in step 13), the generation unit 400 has a plurality of food and drink records acquired in step 12 and the calories of food and drink stored in the calorie storage unit 100. Generate detailed data indicating the calorie intake for each user (generate detailed data indicating the calorie intake. Step 14).

The notification unit 500 notifies a plurality of users of the details based on the generated detail data (notify the details, step 15).

As is clear from the above, the karaoke device K according to the present embodiment is a calorie memory that stores the first identification information for identifying the food and drink provided at the karaoke store and the calories of the food and drink in association with each other. The first acquisition unit 200, which extracts the face image of each user from the images obtained by photographing a plurality of users in the room of the karaoke store, and acquires the user identification information, and the image. Based on the second acquisition unit 300 that acquires food and drink records related to food and drink performed by a plurality of users in the room, and the calories of food and drink stored in the acquired food and drink record and calorie storage unit 100. A generation unit 400 that generates detailed data indicating the calorie intake for each of a plurality of users.

According to such a karaoke device K, it is possible to calculate the calorie intake for each user based on the eating and drinking records related to the actual eating and drinking. Therefore, the calorie intake of the user who eats and drinks much increases, and the calorie intake of the user who eats and drinks less often decreases. For example, in the example of the above embodiment, if the calorie intake of 3450 kcal when all foods and drinks are eaten and eaten is evenly divided among the three users, the calorie intake per user is 1150 kcal. On the other hand, according to the karaoke device K according to the present embodiment, the calorie intake of the user corresponding to the face image X1 that has eaten a lot is 1530 kcal, while the use corresponding to the face image X3 that has not eaten much. The calorie intake of the person is 570 kcal.

That is, according to the karaoke device K according to the present embodiment, when one karaoke room is used by a plurality of users, it is possible to improve the calculation accuracy of the calorie intake associated with eating and drinking of each user.

Further, the karaoke device K according to the present embodiment has a notification unit 500 that notifies a plurality of users of the details based on the generated detail data. According to such a karaoke device K, it is possible to notify each user of the calculated calorie intake.

In addition, the second acquisition unit 300 specifies the ratio of eating and drinking by each user for each food and drink provided, and acquires the specified ratio as a food and drink record. By recording the ratio of eating and drinking in this way, it is possible to improve the accuracy of calculating the calorie intake associated with eating and drinking by each user.

<Second Embodiment>
Next, the karaoke device according to the second embodiment will be described with reference to FIGS. 8 to 10. In this embodiment, an example will be described in which the detailed data includes not only the calorie intake of each user but also the calorie consumed by singing karaoke (calorie consumption). The calorie consumption is calculated based on the singing voice signal converted by the microphone 40 (details will be described later). Detailed description of the same configuration as that of the first embodiment will be omitted.

[Control means]
As shown in FIG. 8, in the present embodiment, when the CPU executes a program stored in the memory, the control means 10d uses the first acquisition unit 200, the second acquisition unit 300, the generation unit 400, and the notification. It functions as a unit 500 and a third acquisition unit 600.

(Third acquisition department)
The third acquisition unit 600 acquires the calories burned by the karaoke singing for each of the plurality of users based on the singing audio signals and the images obtained by the karaoke singing for each of the plurality of users in the room of the karaoke store.

For example, as described in the first embodiment, it is assumed that three users enter the karaoke room in which the karaoke device K is installed, and one user starts karaoke singing. In this case, the third acquisition unit 600 acquires the face image of the user who is singing karaoke from the image obtained by the photographing means 60.

Further, the third acquisition unit 600 calculates the calorie consumption based on the singing voice signal output from the microphone 40. As a method for calculating calories burned from a singing voice signal, a known technique such as Patent Document 1 can be used.

The third acquisition unit 600 associates the calorie consumption calculated for each face image of the user and stores it in the storage means 10a. When one user sings a karaoke song a plurality of times, the third acquisition unit 600 acquires the total calorie consumption value for each face image of the user when the usage time of the karaoke room elapses.

(Generator)
The generation unit 400 according to the present embodiment generates detailed data showing calorie intake and calorie consumption for each of a plurality of users.

For example, suppose that the third acquisition unit 600 acquires 150 kcal of calories burned as a result of the user corresponding to the face image X1 singing six karaoke songs during the usage time of the karaoke room. Similarly, the third acquisition unit 600 acquires 250 kcal of calories burned as a result of the user corresponding to the face image X2 singing 10 songs of karaoke, and the user corresponding to the face image X3 sings 8 songs of karaoke. It is assumed that 200 kcal of calories burned is acquired as a result of singing.

In this case, the generation unit 400 generates detailed data including the calorie intake calculated based on the food and drink record associated with each face image and the calorie consumption acquired by the third acquisition unit 600. The notification unit 500 causes the display device 30 of the karaoke device K to display the details based on the detail data.

FIG. 9 shows an example of the details displayed on the display device 30. The specification of FIG. 9 is based on the specification data including the calorie intake described in the first embodiment and the calorie consumption described above. As shown in FIG. 9, the specification may include a total calorie which is a value obtained by subtracting the calorie consumption from the calorie intake for each user. In this case, the generation unit 400 calculates the value of the total calories when generating the detailed data and includes it in the detailed data.

== Processing in karaoke equipment ==
Next, the process in the karaoke device K according to the present embodiment will be described with reference to FIG. FIG. 10 is a flowchart showing processing in the karaoke device K. In this example, the calorie storage unit 100 stores the first identification information for identifying the food and drink provided at the karaoke store and the calories of the food and drink in association with each other. Since steps 20 to 22 are the same processes as steps 10 to 12 of the first embodiment, detailed description thereof will be omitted.

The third acquisition unit 600 is based on the karaoke singing for each of the plurality of users based on the singing audio signal obtained by the karaoke singing for each of the plurality of users in the room of the karaoke store and the video taken in step 20. Acquire calories burned (obtain calories burned for each user. Step 23).

When the usage time of the karaoke room has elapsed (in the case of Y in step 24), the generation unit 400 has a plurality of users based on the food and drink records acquired in step 22 and the calories of food and drink stored in the calorie storage unit 100. Generate detailed data indicating the calorie intake for each and the calorie consumption for each of the plurality of users acquired in step 23 (generate the detailed data indicating the calorie intake and the calorie consumption. Step 25).

The notification unit 500 notifies a plurality of users of the details based on the generated detail data (notify the details, step 26).

As is clear from the above, the karaoke device K according to the present embodiment is used for each of the plurality of users based on the singing audio signals and images obtained by the karaoke singing of each of the plurality of users in the room of the karaoke store. It has a third acquisition unit 600 for acquiring calories burned by karaoke singing. In addition, the generation unit 400 generates detailed data showing calorie intake and calorie consumption for each of a plurality of users. According to such a karaoke device K, the detailed data can include the calorie intake and the calorie consumption for each user.

<Modification example>
By the way, among the foods and drinks provided, two or more different foods and drinks (hereinafter, each of which is referred to as "secondary food and drink") may be provided as a set on one plate. Such side foods and drinks have different calories.

For example, if you order a "fried chicken set" that includes "fried chicken" and "salad" as a side dish, the calories of "fried chicken" are higher than the calories of "salad".

Therefore, the calorie storage unit 100 of the present modification sets the second identification information for identifying the sub-food and drink and the calories of the sub-food and drink for each of the sub-food and drink having different calories contained in one food and drink. And memorize it. The second identification information is unique information given to each side food or drink, such as a dedicated identification ID.

FIG. 11 shows an example of a calorie table stored in the calorie storage unit 100. For example, for the food "fried chicken set", the first identification information is "ID-F04" and the calorie is "1050 kcal". In addition, the food "fried chicken set" includes "fried chicken (10 pieces)" and "salad (half of the plate)" as side foods and drinks. Regarding the supplementary food and drink "fried chicken", the second identification information is "ID-F04-01" and the calorie is "1000 kcal". Regarding the supplementary food and drink "salad", the second identification information is "ID-F04-02" and the calorie is "50 kcal". The calorie table may include both foods and drinks including supplementary foods and drinks and foods and drinks not including supplementary foods and drinks.

Here, regarding the provided food "fried chicken set", the user corresponding to the face image X1 eats 5 fried chicken, and the user corresponding to the face image X2 eats 3 fried chicken and 60 salads in total. % Eat, and the user corresponding to the face image X3 ate 2 fried chicken and 40% of the whole salad.

The second acquisition unit 300 analyzes the movement of the user corresponding to the face image X1 from the video, and stores the image of “fried chicken” at the point where the user reaches out and the storage means 10a in advance. By comparing with the image, it is specified that the food and drink eaten and eaten by the user is the "fried chicken" of the "fried chicken set". In addition, the second acquisition unit 300 acquires the second identification information corresponding to the “fried chicken”.

On the other hand, the second acquisition unit 300 specifies the ratio of eating and drinking by each user for each of the provided sub-foods and drinks, and acquires the specified ratio as a food and drink record.

In the above example, the second acquisition unit 300 analyzes the movement of the user corresponding to the face image X1 and, with respect to the identified "fried chicken", the ratio of the user eating and drinking ((5 ÷ 10) × 100% = 50%) is calculated.

The second acquisition unit 300 associates the acquired second identification information of "fried chicken" with 50% of the food and drink ratio of the user corresponding to the face image X1 and acquires it as a food and drink record related to the face image X1. .. As for "salad", the ratio is 0% because it is not eaten or eaten. In addition, the second acquisition unit 300 associates 30% of the user's eating and drinking ratio corresponding to the face image X2 with the acquired second identification information of the "fried", and obtains the "salad". The second identification information is associated with 60% of the food and drink of the user corresponding to the face image X2, and is acquired as a food and drink record related to the face image X2. Similarly, the second acquisition unit 300 associates the acquired second identification information of the "fried" with 20% of the user's eating and drinking corresponding to the face image X3, and acquires the "salad". 40% of the food and drink ratio of the user corresponding to the face image X3 is associated with the second identification information of the above, and the food and drink record related to the face image X3 is acquired. FIG. 12 is a food and drink record for each face image stored in the storage means 10a.

The generation unit 400 obtains the user's calorie intake CI4 corresponding to the face image X1, the user's calorie intake CI5 corresponding to the face image X2, and the user's calorie intake CI6 corresponding to the face image X3. Specifically, the calorie intake CI4 is (fried chicken calories 1000 kcal x 50%) + (salad calories 50 kcal x 0%) = 500 kcal. The calorie intake CI5 is (fried chicken calories 1000 kcal x 30%) + (salad calories 50 kcal x 60%) = 330 kcal. The calorie intake CI6 is (fried chicken calories 1000 kcal x 20%) + (salad calories 50 kcal x 40%) = 220 kcal.

As described above, in the present modification, the calorie storage unit 100 provides the second identification information for identifying the sub-food and drink and the sub-food and drink for each of the sub-food and drink having different calories contained in one food and drink. The second acquisition unit 300 specifies the ratio of eating and drinking by each user for each of the provided sub-foods and drinks, and acquires the specified ratio as a food and drink record. By recording the food and drink for each of the supplementary foods and drinks, the calculation accuracy of the calorie intake can be further improved.

<Others>
In the above embodiment, an example of notifying the details when the usage time of the karaoke room has elapsed has been described, but the present invention is not limited to this. For example, while using the karaoke room, the details may be notified at predetermined time intervals (for example, every 10 minutes). In this case, as described in the embodiment, the food and drink record is acquired with the amount of food and drink eaten at that time as 100%.

In addition, the second acquisition unit 300 acquires the food and drink record corresponding to the first identification information of the food and drink based on the state of the food and drink included in the video, not the movement of the user included in the video. You may.

For example, in the video, it is assumed that a part of the hood F1 is reduced. In this case, the second acquisition unit 300 compares the image of the hood whose part is reduced with the image stored in the storage means 10a in advance to determine that the hood eaten or eaten is the hood F1. Identify. In addition, the second acquisition unit 300 identifies the facial image of the user who eats and drinks the food F1 from the images before and after.

The second acquisition unit 300 specifies the ratio of eating and drinking by each user for each food and drink provided, and acquires the specified ratio as a food and drink record.

In the above example, the second acquisition unit 300 calculates the ratio remaining after eating and drinking with respect to the specified food F1. The second acquisition unit 300 acquires the calculated ratio as a linked food / drink record with the face image of the specified user.

The above-described embodiment is presented as an example and does not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The above-described embodiment and its modifications are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

100 Calorie storage unit 200 1st acquisition unit 300 2nd acquisition unit 400 Generation unit 500 Notification unit 600 3rd acquisition unit K Karaoke device

Claims (6)

A calorie storage unit that stores the calories of food and drink in association with the first identification information for identifying food and drink provided at the karaoke store.
A first acquisition unit that extracts facial images of each user from images obtained by photographing a plurality of users in the room of the karaoke store and acquires them as user identification information.
Based on the video, a second acquisition unit that acquires food and drink records related to food and drink performed by the plurality of users in the room, and
A generation unit that generates detailed data indicating the calorie intake for each of the plurality of users based on the acquired food and drink record and the calorie of the food and drink stored in the calorie storage unit.
Karaoke device with. The karaoke device according to claim 1, wherein the second acquisition unit specifies the ratio of eating and drinking by each user for each provided food and drink, and acquires the specified ratio as the food and drink record. The calorie storage unit stores the second identification information for identifying the sub-food and drink and the calorie of the sub-food and drink for each of the sub-foods and drinks having different calories contained in one food and drink. And
The karaoke device according to claim 2, wherein the second acquisition unit specifies the ratio of eating and drinking by each user for each of the provided supplementary foods and drinks, and acquires the specified ratio as the food and drink record. The karaoke device according to any one of claims 1 to 3, further comprising a notification unit that notifies the plurality of users of the details based on the generated detail data. While the plurality of users are in the room of the karaoke store, the generation unit generates detailed data at predetermined time intervals based on the eating and drinking records at that time.
The karaoke device according to claim 4, wherein the notification unit notifies the plurality of users of the details each time the generation unit generates the detail data. A third acquisition unit that acquires the calories burned by the karaoke singing for each of the plurality of users based on the singing audio signal obtained by the karaoke singing for each of the plurality of users in the room of the karaoke store and the video. Have and
The karaoke device according to any one of claims 1 to 5, wherein the generation unit generates detailed data indicating calorie intake and calorie consumption for each of the plurality of users.

Images