JP2013020366A - Game system, program, and information storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a novel usage form of a player's image.SOLUTION: Setting data for performance content having game appeal increased for each estimated customer stratum is prepared in advance. (In the case of a music game, for example, a recommended musical piece list for each customer stratum in which musical pieces for automatic play are collected is prepared.) A commercial game device 1300 obtains a device front image with an image sensor module 1326 and calculates a facial feature value of a person in the device front image. The device then determines the customer stratum of the person on the basis of the facial feature value and controls an attraction mode in accordance with the setting data for performance content for the determined customer stratum. In the case of a music game, for example, the device takes the statistics of customer strata determined by date and time condition and selects musical pieces from the recommended musical piece list for a main customer stratum to perform automatic play.

Description

  The present invention relates to a game system or the like for executing a given video game.

  Conventionally, a device has been devised to excite a game by using a player image taken by a video camera for a video game.

For example, a video camera capable of shooting a player is provided in an arcade game device for a battle game, and the player's face image is used as an icon for indicating the position of each player, so that who plays and who is in which position There is a known game that makes it easy to recognize whether or not the game is lively (for example, Patent Document 1).
Furthermore, when a character (player character) operated by the player is damaged, the face image of the player is shown to be artificially cracked, or the color of the face image is changed so that the face color is deteriorated. Some are used for damage production (for example, Patent Document 2).

Japanese Patent Laid-Open No. 11-244531 JP 2000-611145 A

  An object of the present invention is to realize a new usage form of a photographed image of a player, which is different from the usage form described above. It is a second object to increase the ability to attract customers more desirably.

In a first mode for solving the above-described problems, a photographing unit (for example, the image sensor module 1326 in FIG. 1) arranged with the photographing direction facing the front of the apparatus so as to include at least a person in the play position in the photographing range. , The photographing unit 102) of FIG.
A recognition unit for recognizing a human image included in a photographed image photographed by the photographing unit (for example, the control unit 1350 in FIG. 1, the face recognition chip 1356, the processing unit 200 in FIG. 10, the game control unit 202 in FIG. 11, the face Facial expression recognition unit 204);
A customer demographic determination unit (for example, the control unit 1350 in FIG. 1, the processing unit 200 in FIG. 10, FIG. 11 game control unit 202, customer segment determination unit 206),
An attraction mode control unit (for example, control unit 1350 in FIG. 1, processing unit 200 in FIG. 10, game control unit 202 in FIG. Control unit 210);
It is a game system equipped with.

The “play position” here refers to a range in which the player is normally playing a game. The “attraction mode” is a control mode executed in a so-called customer waiting state waiting for the appearance of a new player.
According to the first aspect, it is possible to capture the person around the device including the play position, determine the customer base of the person, and realize the effect contents of the attraction mode suitable for the customer base. Can be increased.

In a second form, the recognition unit recognizes a facial expression of a person shown in the captured image (for example, a control unit 1350, a face recognition chip 1356 in FIG. 1, and a processing unit 200 in FIG. 10). 11 has a game control unit 202 and a facial expression recognition unit 204) in FIG.
Based on the recognition result of the facial expression recognition unit, a favorable reaction person detection unit (for example, the control unit 1350 in FIG. 1 or FIG. 11) that detects that a person interested in the game system appears in the captured image. A game control unit 202, a responder detection unit 216),
Attraction mode data for storing data relating to the contents of the effect in the attraction mode (for example, the attraction mode data 512 in FIGS. 12 and 14 and the music library 520 in FIGS. 12 and 15) in association with the category information of the contents of the effect. A storage unit (for example, the control unit 1350 in FIG. 1, the IC memory 1352, the storage unit 500 in FIG. 10), and
When the attraction mode control unit detects the sensation responder detection unit, the attraction mode includes data related to the content of the attraction that the classification information is currently being executed and the content of the attraction satisfying a predetermined related condition. Control unit for detecting a favorable reaction person who selects from the storage unit and switches the contents of the presentation at a given timing (for example, control unit 1350 in FIG. 1, face recognition chip 1356, processing unit 200 in FIG. 10, game control unit in FIG. 11) 202, a game system according to the first embodiment, which includes a control unit 217) during detection of a favorable reaction person.

  According to the second embodiment, the same effect as the first embodiment can be obtained, the facial expression of the person around the device can be recognized, and the person who is interested in the game system from the change of the facial expression, that is, the favorable response Can be detected. And when a favorable reaction person is detected, other production contents related to the production contents currently being executed can be selected and executed. In other words, by further presenting other contents related to the contents showing interest, further interest can be raised and the effect of attracting customers can be further enhanced.

  According to a third aspect, the recognition unit recognizes a person image of each of the plurality of persons when the photographed image includes a plurality of persons, and the customer segment determination unit uses the recognition result of the recognition unit. And determining the customer base of each person shown in the photographed image, and the attraction mode control unit has a customer base of each person shown in the photographed image determined by the customer base determination part, and a predetermined customer base priority order. Based on the priority customer layer person selecting means (for example, the control unit 1350 in FIG. 1, the processing unit 200 in FIG. 10, the game control in FIG. 11). The game system according to the first or second mode includes a section 202, a priority customer layer person selection section 213, and steps S78 to S88 in FIG.

According to the third aspect, the same effect as in the first or second aspect can be obtained, and when a plurality of persons are reflected in the photographed image, the effect is based on the priority order of the customer base of the plurality of persons. A target person whose contents are to be optimized, that is, a priority customer group person can be selected. Then, it is possible to execute the production contents matching the customer segment of the priority customer segment.
In other words, it is possible to increase the effect of attracting customers by appealing to a specific person rather than appealing to multiple people with the greatest common factor for attracting customers. If multiple people are acquaintances, if one of them is interested in the game, the possibility of other people interested in the game is inevitably increased, which is effective.

  Here, focusing on the fact that a plurality of people are acquaintances, the recognition unit is not limited to a configuration that optimizes the content of the performance for a specific person. The customer image of each of the plurality of persons is recognized, and the customer segment determination unit determines the customer segment of each person in the captured image using the recognition result of the recognition unit, and the attraction The mode control unit uses the customer segment combination determined by the customer segment determination unit to control the effect contents of the attraction mode (for example, the control unit 1350 in FIG. 1, the processing unit 200 in FIG. 10, A game system according to the first or second embodiment having the game control unit 202 of FIG. 11, the priority customer layer person selection unit 213, and steps S130 to S134 of FIG. 21 is configured. Door can be.

  According to the 4th form, the effect similar to the 1st or 2nd form is acquired, and the content of production can be optimized according to the combination of a plurality of customer bases. A combination of customers may be a friend of the same name, a friend of the opposite sex, a lover, a couple, or a parent and child. Therefore, the effect of attracting customers is increased.

In the fifth embodiment, a registered player data storage unit (for example, the control unit 1350 in FIG. 1, the IC memory 1352, and the storage unit in FIG. 10) stores feature data that can be authenticated based on the recognition result of the recognition unit for each registered player. 500, the player registration data 530 in FIG. 12 and FIG. 16 and the stored data in the server system 1100 in FIG. 30, based on the recognition result of the recognition unit, that the registered player is reflected in the photographed image. A registered player detection unit (for example, a control unit 1350 in FIG. 1, a processing unit 200 in FIG. 10, a game control unit 202 in FIG. 11, a registered player detection unit 208, and step S70 in FIG. 23);
When the attraction mode control unit detects by the registered player detection unit, a registered player information storage unit that stores personal information for each registered player (for example, the control unit 1350, the IC memory 1352, FIG. 10 storage unit 500, player registration data 530 in FIGS. 12 and 16, and server system 1100 in FIG. 30), and the contents of the attraction mode based on the detected personal information of the registered player Registered player priority control means (for example, control unit 1350 in FIG. 1, processing unit 200 in FIG. 10, game control unit 202 in FIG. 11, registered player priority control unit 214, step S30 in FIG. 21, step S98 in FIG. 23) To S100), the game system according to any one of the first to fourth aspects.

  "Personal information" can be set as appropriate, such as age, gender, address, occupation, family structure, income, hobbies, interests, favorite music genre, history of purchased items, movie titles seen in the past, etc. It is.

  According to the fifth aspect, the same effect as any of the first to fourth aspects can be obtained, and a registered player, that is, a person who has played the game at least once in the past is included in the photographed image. And the contents of the effect can be changed based on the personal information of the registered player. In other words, it is possible to realize the production contents that match the preference of the registered player, and to further enhance the effect of attracting customers.

The sixth form is a person location detection unit (for example, the image sensor module 1326, the distance sensor 1328, the control unit 1350 in FIG. 1, the processing unit 200 in FIG. A game control unit 202, a player / gallery identification unit 205, and steps S24 to S26 in FIG.
The game system according to a fifth aspect, in which the registered player detection unit determines whether or not the registered player is reflected in the captured image when the person location detection unit detects.

  According to the sixth embodiment, the same effect as that of the fifth embodiment can be obtained, and the processing load can be reduced by making an opportunity to detect the registered player appropriate.

In the seventh embodiment, a customer segment database creation unit (for example, the control unit 1350, IC memory 1352 in FIG. 1) that creates a customer segment database by day of the week and / or by time of day using the determination result by the customer segment determination unit. , A processing unit 200 in FIG. 10, a storage unit 500, a customer segment database creation unit 211 in FIG. 11, a customer segment database 551 in FIG. 12, and steps S40 to S42 in FIG.
The attraction mode control unit refers to the customer base database and controls date and time reference control means (for example, the control unit 1350 in FIG. 1, the IC memory 1352, the processing unit 200 in FIG. 10, the storage unit). 500, the date / time reference control unit 212 of FIG. 11, and the steps S44 to S50 of FIG. 22).

  According to the seventh aspect, the same effect as any of the first to sixth aspects can be obtained, and in the environment where the game system is installed, the change in the customer base of the person who can be appealed according to the date and time conditions The content to appeal can be changed accordingly. For example, it is optimized for the composition conditions of the current customer base according to the installation environment, such as changing to the production content for students in the time zone with many students, and the production content for female customers in the time zone with many adult women. Control is possible, and the effect of attracting customers can be further enhanced.

  According to an eighth aspect of the present invention, there is provided a computer system that includes a photographing unit arranged with a photographing direction facing the front of the apparatus so as to include at least a person in a play position in a photographing range, and configured to execute a predetermined game. A recognition unit for recognizing a person image included in a photographed image photographed by the photographing unit, and a customer segment determination that uses the recognition result of the recognition unit to determine a customer segment including at least a sex and an age group of the person photographed in the photographed image The program for functioning as an attraction mode control unit that controls the contents of the effect in the attraction mode using the determination result by the customer segment determination unit.

  According to the eighth aspect, it is possible to cause the computer system to exhibit the same effect as in the first aspect.

  The ninth form is a computer-readable information storage medium storing the program of the eighth form. The “information storage medium” mentioned here includes, for example, a magnetic disk, an optical disk, an IC memory, and the like. According to the ninth aspect, by causing the computer to read and execute the program of the eighth form, it is possible to cause the computer system to exhibit the same effect as that of the first form.

The perspective appearance figure showing the example of composition of the arcade game device to which the present invention is applied. The figure which shows the example of a game screen. The conceptual diagram for demonstrating the content which concerns on the date standard control in attraction mode. The conceptual diagram for demonstrating the content which concerns on the neighbor reference | standard control in attraction mode. The conceptual diagram for demonstrating the content which concerns on the control at the time of likable reaction person detection in attraction mode. The conceptual diagram for demonstrating the content which concerns on the gallery number reference | standard control in play mode. The conceptual diagram for demonstrating the content which concerns on the appearance facial expression reference | standard control in play mode. The conceptual diagram for demonstrating the content which concerns on the designation | designated facial expression appropriateness reference progress control in play mode, specific timing facial expression reference | standard control, and facial expression change reference | standard control. The conceptual diagram for demonstrating the control content regarding collection of the sample investigation data for marketing using the recognition result of the facial expression. The functional block diagram which shows the function structural example of a game device for business use. The partial functional block diagram which shows the function structural example of a game control part. The partial functional block diagram which shows the structural example of the data etc. which are memorize | stored in a memory | storage part. The figure which shows an example of a data structure of customer segment setting data. The figure which shows an example of a data structure of attraction mode data. The figure which shows an example of a data structure of a music library. The figure which shows an example of a data structure of player registration data. The figure which shows an example of a data structure of facial expression theme setting data. The figure which shows an example of the data structure of play mode effect content setting data. The figure which shows an example of the data structure of play data. The flowchart for demonstrating the flow of the main processes. The flowchart for demonstrating the flow of an attraction mode control process. The flowchart for demonstrating the flow of a date-time condition reference | standard control process. The flowchart for demonstrating the flow of a neighbor reference | standard control process. The flowchart for demonstrating the flow of a favorable reaction person reference | standard control process. The flowchart for demonstrating the flow of a play mode control process. The flowchart for demonstrating the flow of a play music selection process. The flowchart for demonstrating the flow of an effect change process. The flowchart for demonstrating the flow of a prize payout process. The flowchart for demonstrating the flow of a leaving process on the way. The system block diagram which shows the structural example of the game system to which this invention is applied.

[First Embodiment]
As a first embodiment to which the present invention is applied, an arcade game device that executes a music game will be described as an example. Note that the types of games to which the present invention can be applied are not limited to music games and can be applied to any genre. In the present embodiment, a configuration in which a video game is realized by executing a dedicated game program in the arcade game apparatus will be described as an example. However, a web browser program, script control, or the like is used instead of the dedicated game program. It may be realized by. In other words, the video game may be realized as a so-called browser game in which information necessary for the game is acquired through a communication line such as the Internet and interactive display on the browser is realized.

[Configuration of arcade game device]
FIG. 1 is a perspective external view showing a configuration example of an arcade game apparatus 1300 that is a game system (computer system) to which the present invention is applied. The arcade game apparatus 1300 is provided with an operation input device 1306 that imitates a percussion instrument for a player to input various operations on an operation table 1304 that protrudes in front of the game apparatus main body 1301.

  The operation input device 1306 according to the present embodiment has an outer shape imitating a Japanese drum and incorporates pressure-sensitive sensors and vibration sensors in various places. When the player 2 hits the operation input device 1306 in the manner of hitting a Japanese drum with a dedicated operation rod 1308, an operation input signal is output to the control unit 1350 from the sensor at the hit location. In the present embodiment, two operation input devices 1306 are provided so that a plurality of players can play a game at the same time, but the number can be set as appropriate.

  Further, on the upper part of the game apparatus main body 1301, a video monitor 1322 realized by a flat panel display for displaying a game image, a CRT, or the like, a speaker 1324 for emitting game sound or sound effect, and an image sensor module 1326 are displayed. And a distance sensor 1328.

  The image sensor module 1326 is a device (photographing unit) that captures the state of the front of the device, and in the shooting range, the player is at a game play position (so-called play position), and at least the player's head, Desirably, the field angle of view and the direction of photographing are set and arranged so that the upper part of the chest can be seen. Imaging by the image sensor module 1326 is controlled by the control unit 1350, and the captured image data is output to the control unit 1350. Although the number of image sensor modules 1326 in this embodiment is one, a plurality of image sensor modules 1326 may be mounted. For example, an image sensor module for shooting each play position may be set.

  The distance sensor 1328 irradiates infrared rays, ultrasonic waves, and the like, detects the reflected wave, and outputs a detection signal to the control unit 1350. The control unit 1350 can calculate a distance to an object in front of the apparatus (for example, a player or a gallery viewed behind the player) by calculating a detection signal from the distance sensor 1328. The configuration of the distance sensor 1328 and the distance calculation from the detection signal can be realized by appropriately using known techniques.

  At the bottom and inside of the game apparatus main body 1301, an IC card reader / writer 1330 for reading data from and writing data to an IC card 1332 that is a portable card-type information storage medium, a coin insertion device 1340, A prize dispensing device 1342, a control unit 1350, and a power supply device (not shown) are provided.

  The IC card reader / writer 1330 also functions as an issuer of the IC card 1332, and the IC card 1332 is issued by registering the player through a predetermined procedure before or after the game starts. When the game is started after the IC card 1332 is inserted into the IC card reader / writer 1330, information associated with the ID stored in the IC card 1332 (for example, information such as past play history) can be used. Become. In the present embodiment, the arcade game device 1300 is used to issue the IC card 1332 and manage the registration information. However, a dedicated registration device and a card issuing device are separately provided as in the known online multiplayer game. It goes without saying that it is possible to prepare or manage the registration information with an external server device.

The control unit 1350 includes various microprocessors such as a CPU (Central Processing Unit) 1351, a GPU (Graphics Processing Unit) and a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), and an electric and electronic device such as an IC memory 1352. This constitutes a so-called computer board and control board. The control unit 1350 includes a communication device 1353, and can be connected to a communication line 1 such as the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network) by wire or wirelessly to perform data communication with an external device.
The control unit 1350 reads out a system program and a game program from an information storage medium such as an IC memory 1352 and a hard disk mounted thereon, performs arithmetic processing, and controls each unit of the arcade game apparatus 1300.

In addition, the control unit 1350 of this embodiment is equipped with a face recognition chip 1356.
The face recognition chip 1356 is realized by a known integrated circuit that realizes various functions for recognizing a facial expression of a person shown in an image taken by the image sensor module 1326.
The face recognition chip 1356 recognizes and extracts a part (person image part) in which a person is photographed from a photographed image photographed by the image sensor module 1326, and further recognizes a part in which a face is photographed (face image part). -Can be extracted. And “face feature values (eg, eye, eyebrows, nose, mouth, face contour, etc. size, angle, ratio, relative position, etc.) required for personal authentication and facial expression recognition using face images Numerical value) ”. Then, data such as age / sex / facial expression recognition result can be obtained from the face feature value.

When the business game device 1300 is turned on, the control unit 1350 reads and executes the game program, and the business game device 1300 functions as a game device that implements the present invention.
Until the predetermined coin insertion is detected by the coin insertion device 1340, the arcade game device 1300 is controlled in the attraction mode (meaning customer waiting mode) for soliciting players. In the attraction mode, various effects such as a screen that explains the game outline and play style to the passerby and automatic play are executed to appeal the game to the passerby. When the coin insertion device 1340 detects a predetermined coin insertion, the arcade game device 1300 switches from the attraction mode and starts control in the game play mode, and the music game is executed.

  A game screen generated along with the execution of the music game is displayed on the video monitor 1322, and the generated game sound is emitted from the speaker 1324. The player plays the game while listening to the game sound emitted from the speaker 1324 while watching the game screen displayed on the video monitor 1322.

  FIG. 2 is a diagram illustrating an example of a game screen in the present embodiment, and corresponds to a layout of a game screen in a single-player state. When a plurality of players play a game at the same time, the game screen is divided into top and bottom or left and right, and a plurality of such game screens are displayed in parallel for each player.

  A timing guide 40 is displayed at the top of the game screen W2. In the timing guide 40, the timing markers 42 and 44 are flow-displayed from the right to the left of the screen. The timing markers 42 and 44 are associated with input types in the music game, respectively. A best timing display 46 is fixedly displayed on the left side of the timing guide 40. When the timing markers 42 and 44 that are displayed while playing the music to be played overlap the best timing display 46, the score is added when the correct type of input associated with the marker is performed. That is, the timing at which the timing markers 42 and 44 overlap the best timing display 46 is set as a timing corresponding to the rhythm and tempo of BGM. It should be noted that the display control of the timing guide 40 and the data structure necessary for the display can be realized by appropriately using a known music game technique, and thus detailed description thereof is omitted.

  On the other hand, an effect display unit 47 is set at the lower part of the game screen W2. In the same display section, various effects for exciting the game are displayed. In the example shown in the figure, an effect is shown in which a rabbit character 48 (48a, 48b,...) Appears from the end of the screen and dances by swinging a pom pom intermittently according to the music.

  Then, the arcade game device 1300 according to the present embodiment executes a lottery by arithmetic processing in the control unit 1350 when the score at the time of completion of playing one song has reached a predetermined prize payout lottery activation reference value, When a prize is won in the lottery, a prize can be paid out by the prize payout device 1342 to praise the player. The prize payout device 1342 and the prize payout lottery can be omitted as appropriate.

[Use of face recognition]
Next, the use of face recognition in the arcade game apparatus 1300 of this embodiment will be described. In the arcade game apparatus 1300, by processing an image captured by the image sensor module 1326 with the face recognition chip 1356, a facial feature value of a person in front of the apparatus can be obtained and a facial expression can be recognized. Therefore, the arcade game device 1300 according to the present embodiment uses the recognition result of the facial feature value or facial expression for game control, improves the solicitation in the attraction mode control, and is new in the play mode control. Realize gaming experience.

[1. Use of face recognition in attraction mode control]
3 to 5 are diagrams for explaining the control content of the attraction mode using the recognition result of the face feature value and the facial expression.

  First, as shown in FIG. 3, the arcade game apparatus 1300 of the present embodiment can perform “date-and-time reference control” that optimizes the control content for the main customer layer in the control in the attraction mode. With the “date and time reference control”, the arcade game apparatus 1300 periodically photographs a passerby in front of the apparatus with the image sensor module 1326 while being controlled in the attraction mode, and the facial features of the person in the photographed image From this, the gender, age, etc. of the person in the screen are determined, and with this, the customer base of the person is determined. Then, it is possible to control the attraction mode with a content that is highly appealing to the main customer base in the environment where the arcade game device 1300 is installed.

  More specifically, for example, it is assumed that device front images G1 to G3 photographed at time t = 1, 2, 3,... By the image sensor module 1326 are obtained. The face recognition chip 1356 extracts a part in which the face appears in each of the device front images G1 to G3, that is, a face image, and calculates a face feature value from the extracted face image. In the figure, the portion where the face is shown is surrounded by a broken line so that it can be easily identified.

  As is well known, since there is a tendency for facial feature values depending on gender and age, gender and age can be determined from these. In this embodiment as well, gender and age are obtained in the same manner, and the customer segment of the person shown in the apparatus front images G1 to G3 is determined by comparing with a predetermined reference value (strictly “estimating”).

  The customer base setting is arbitrary. For example, it can be divided into 8 stages of less than teens, 10s,..., 60s and over 60s, and each can be set to a total of 16 customer segments divided by gender. The customer segment determination result based on the facial features is statistically processed for each date and time condition that can be defined by a combination of parameters such as a predetermined day of the week, time zone, and specific period (for example, summer vacation, New Year holidays, Christmas period, etc.). That is, a customer demographic is generated for each date and time condition and a customer demographic database is created. In the example of FIG. 3, the date and time conditions of “Sunday” and “Morning” indicate that there are many passersby corresponding to the third customer segment from the left.

Then, the arcade game device 1300 controls the contents of the attraction mode based on the statistical result of the customer segment with the date and time conditions matching the current date and time.
Specifically, since a music game is executed in the present embodiment, a song to be played automatically, which is one of the effect elements in the attraction mode, is assigned to the “customer segmentation” corresponding to the main customer segment in the date and time conditions that match the current date and time. Select a song from the “Recommended Song List”. The “customer stratified recommended music list” is stored in advance in an information storage medium such as an IC memory 1352 or a hard disk of the control unit 1350, or is periodically distributed from an external device via the communication line 1. The list includes a plurality of pieces of information for automatically playing a song popular with the corresponding customer segment. Note that the date and time condition may be a condition for only time (time zone) or a condition for only day of the week. Of course, the combination may be used.

  By selecting a song to be automatically played from the customer segment recommended song list corresponding to the main customer segment, it is possible to make the most effective appeal at the location where the arcade game device 1300 is located at the time and date conditions at that time Become. Although the figure shows that there is only one “major customer segment”, it goes without saying that a plurality of customers may be selected.

Next, as shown in FIG. 4, the arcade game apparatus 1300 of the present embodiment can execute “proximity reference control” that further optimizes the control content for the proximity person in the control in the attraction mode. By the “proximity reference control”, the arcade game device 1300 can further optimize the content for a person who has approached the device more than a certain amount to realize a more effective appeal.
Then, in connection with the proximity reference control, the arcade game device 1300 uses a registered player (a person registered as a user) in the captured image based on the result of face recognition based on the captured image captured by the image sensor module 1326. “Registered player detection function” for detecting that the image is captured, and the “registration player detection function” further optimizes the control contents of the attraction mode for the detected registered player based on the detected personal information of the registered player. Player priority control "can be executed.

  Specifically, the size of the face image extracted from the device front image G4 taken at time t = 4 (the range surrounded by the broken line in the device front image G4 in FIG. 4) is predetermined with respect to the screen size. In the apparatus front image G4 when the distance to the passerby obtained from the detection signal of the distance sensor 1328 reaches a predetermined proximity determination reference distance. It is determined that it is more suitable as an appeal target, and the customer segment is determined from the facial feature values of the nearby people, and the song is selected from the customer segment recommended song list corresponding to the determined customer segment, that is, optimized for the person approaching the device Appeal can be made.

  In addition, if there are a plurality of persons approaching the device, a person to be used as a reference for determining the proximity reference control target, that is, the effect content in the attraction mode, is selected based on a predetermined customer priority order. “Customer selection”. Specifically, when a plurality of persons close to the device are detected, each customer segment is determined from the face feature value, and a higher priority customer segment is selected based on a preset priority order, Appeal that is optimized for the customer segment (priority customer segment).

  More specifically, priorities are set for each of the set customer segments in descending order of the level assumed by the game device creator. In the example of FIG. 4, the result of “20s female” for the left person and “male 20s male” for the right person is obtained from the face feature values of the two persons shown in the apparatus front image G4. . On the other hand, from the priority order setting of the customer base, the former is determined to be higher, so that an appeal optimized for a person determined to be a “20s female” will be performed. In addition, although the setting of the priority order for each customer group can be set as appropriate, in this embodiment, the lower age is set higher than the age, and the female is set higher than the male in the gender. And

  Further, a face feature value is obtained for each person shown in the device front image G4, and is compared with the personal face feature value already acquired with the player registration to determine whether the person is a registered person. Can do. If the person shown in the device front image G4 photographed at time t = 4 is a registered player (the woman on the left corresponds to that in the figure), the past play linked to the player registration data is performed. Information on a favorite genre of the person is acquired from history information or the like, and a song to be automatically played in the attraction mode is selected from songs belonging to the genre. That is, if the registered player approaches, it is possible to make an appeal that easily attracts the interest of the person.

  Since the registered player is a person who has already been interested in the game once, a high solicitation effect can be expected. Therefore, when there are a plurality of persons in the vicinity, a priority customer group person based on the customer group is selected, whether the priority customer group person is a registered player is checked, and if it is a registered player, the attraction is based on related registration information. It is effective to switch the mode contents. Of course, when there are a plurality of persons in the vicinity and a registered player is included, the registered player is given priority over selecting a priority customer group person by comparing each customer group with the non-player-registered persons. It is good also as a structure which gives priority to the control which switches the production content of the attraction mode based on the registration information.

  Furthermore, the arcade game apparatus 1300 of this embodiment can execute “customer group combination-specific control” in which the control content is optimized for a combination of customer groups of a plurality of people in the control of the attraction mode. In the present embodiment, when there are a plurality of persons in the vicinity, according to the combination of the customer segments, the presentation display pattern data prepared for each customer segment combination is selected in advance, and the game screen rendering is performed based on the selected data. The display content of the display unit 47 is switched and controlled.

  The kind of combination of customer segments and the setting of the production pattern for the combination can be set as appropriate. In the example of FIG. 4, the effect display content for the young lover is selected from the combination of the first customer group “20s female” and the second customer group “20s male”, but this is not restrictive. For the combination of the first customer group “60s female” and the second customer group “60s male”, there are production display contents for elderly couples (contents with calm colors, slow motion, etc.) It is preferable if prepared. In addition, if the first customer group is “male under 10 years old” or “female under 10 years old” and the second customer group is male or female in their twenties or more, that is, a parent or child, it can be regarded as “with parents and children”. It would be preferable if the content displayed was suitable for emotional education.

  Next, as shown in FIG. 5, the arcade game apparatus 1300 according to the present embodiment performs “favorable reaction person detection control” by optimizing the control contents for a person interested in the game system in the control of the attraction mode. Can be executed. By the control at the time of detection of a favorable reaction person, the facial expression of the same person is compared at the timing when the device front image G4 is captured (t = 4) and the timing at which the next imaging is performed (t = 5). When detected, the person can be regarded as “interested” and the control content can be optimized for the person to further increase the appeal.

  Specifically, it is assumed that the facial expression recognition process is sequentially performed for each of the two persons shown in the apparatus front image G4. At the first timing (t = 4), as an effect in the attraction mode, the registered player is collated with respect to the person on the left side to select a song from a favorite genre or from a list of recommended songs according to customer demographics according to the result of customer demographic identification. Automatic play is performed (similar to FIG. 4). At the second timing (t = 5), it is detected that the facial expression of the person on the left has changed in a favorable direction at the next shooting timing (t = 5) or is a favorable expression. , Considered "interested". Therefore, based on the currently played automatic play song, the music preferred by the person is estimated and set as the next automatic play song.

The next song selection method is based on related information associated with each song in advance. For example, you may select from new songs of the same genre as the currently playing auto-play song, select songs from the same artist (singer, etc.), select songs with similar tempo, If the song being auto-played is associated with a specific title of other media (eg, a TV program, a game, a movie, etc.) Select from other associated songs.
Therefore, it is possible to make a further appeal to a person who is interested in the game system and to make a further push to invite to the game.

[2. Use of face recognition in play mode control]
6 to 8 are diagrams for explaining the control content of the play mode using face recognition.
As shown in FIG. 6, the arcade game device 1300 of the present embodiment is a portion in which the face of the player 2 is shown from the device front image G6 that is a photographed image photographed by the image sensor module 1326 in the control of the play mode. It is possible to separately extract (player's face image) and a portion (gallery face image) where the face of the gallery 4 is shown, and to control the game progress according to the number of the gallery 4. That is, the arcade game apparatus 1300 has a “gallery number determination function” for determining the number of persons other than the players included in the device front image G6, and controls the game effect using the gallery number determination result. "Reference control" can be executed.

  Specifically, regarding the “gallery number determination function”, the face feature value of the part (face image) where the face extracted from the device front image G6 is captured is the face for personal identification acquired at the time of player registration. Since it can be determined whether the face image of the player 2 is compared with the feature value, the player 2 and the gallery 4 can be separated.

If the player cannot be identified as a registered player (for example, the player 2 plays the game for the first time and the player registration is performed at the end of the game), the face image is extracted from the device front image G6, and the following condition is satisfied. Those satisfying (1) and condition (2) are regarded as the face images of the player 2.
Condition (1): Assuming that the gallery 4 is behind the player 2, the ratio of the area A1 of the extracted face image to the screen area A0 of the entire device front image G6 reaches a predetermined player face determination ratio. Yes.
Condition (2): Based on the assumption that the player 2 stands at a predetermined play position, the extracted face portion in the device front image G6 exists within the predetermined player face position prediction range 6. .
Instead of these conditions (1) and (2), or as a further condition (3), the distance measurement value using the distance sensor 1328 for each part of the extracted face is a predetermined player face determination. It can be added that it is less than a distance.

  Then, the arcade game apparatus 1300 of the present embodiment can change the effect display in the game screen by using the fact that the faces of the player 2 and the gallery 4 can be separated from the apparatus front image G6. Specifically, setting data for “standard effect” and special “multi-gallery effect” for effect display on the game screen effect display unit 47 (see FIG. 2) are prepared in advance. Then, when the game is started, a standard effect is displayed on the effect display unit 47 of the game screen, and if the number of galleries 4 determined during the progress of the game has reached the reference value for starting the special effect, a multi-gallery effect is displayed. Perform additional games to make the game even more exciting.

  The type of “multi-gallery effect” and its activation start reference value can be set as appropriate. Moreover, although it demonstrated as a structure which changes the content of production | presentation display according to the number of galleries determined based on the result of face recognition, it may replace or use together and control game progress according to the number of galleries. good. For example, when the number of galleries reaches a predetermined privilege provision reference value, the player gives an item that can be used to advance the game, or plays a song and then ties up with a mini game (for example, a TV commercial). It is possible to configure such that a song can be played one time in a commercial version, or one shooter of a completely different game genre can be played.

  In the case of a shooting game, the type of boss character or the type of stage to be moved may be selected according to the number of galleries 4. In the case of an action game, the type of effect such as an attack may be selected according to the number of galleries 4. In any case, the more the number of galleries 4 is, the more exciting options are selected.

  Next, as shown in FIG. 7, the arcade game apparatus 1300 of the present embodiment has a facial expression (referred to as “dominant facial expression”) of a player that satisfies a given appearance frequency condition during the game in the play mode control. The “appearance facial expression reference control” for controlling the game effect using can be performed.

  Specifically, the arcade game apparatus 1300 can perform facial expression recognition processing from the facial feature value of the player 2 during game play, and can collect statistics for each type of facial expression (statistics by facial expression). The types of facial expressions to be statistics can be set as appropriate. On the other hand, special effect data is prepared in advance corresponding to the facial expression type to be statistically processed. Then, as a result of the statistical processing for each facial expression, a facial expression (dominant facial expression) having a high appearance frequency that satisfies a given appearance frequency condition is determined, and special effect data corresponding to the determined dominant facial expression is executed. . In the example of FIG. 7, the standard effect is displayed on the effect display unit 47 (see FIG. 2) of the game screen when the game is started. The dominant facial expression is determined when a sufficient time has elapsed since the start of play. Special effects (such as “Special effects for pleasure”, “Special effects for stupidity”, “Special effects for mood”) in the figure are selected and executed to be added to the standard effects. The

The contents of the special effects can be set as appropriate, but the contents are preferably set so that the game experience of the player is more enjoyable and joyful. For example, in the case of “special effect for joy”, the effect may be the effect of petals flying behind the rabbit character 48 (see FIG. 2) so that the enjoyment is further increased. If it is a “special effect for stunning”, a sub-character that moves like a player can be added to give a sense of security. It can also be used to create a sub-character with a design that uses colors that make it easy to regain heart stability.
By selecting and executing these special effects according to the state of the mind estimated from the facial expression of the player, the state of the player's mind is improved through game play, and a kind of help is provided so that a more enjoyable time can be spent. .

  In addition, since this embodiment executes a music game, the game effect is controlled using the dominant expression, but the game progress may be controlled instead or in combination. For example, in the case of a game in which stages are continuous (shooting or the like), the result of statistical processing from the start of the game may be referred to at a predetermined stage switching timing, and the next stage may be switched according to the type of dominant facial expression. Alternatively, when the designated facial expression reaches a predetermined appearance frequency, a privilege such as an item or a bonus score can be given.

Next, as shown in FIG. 8, the arcade game apparatus 1300 of the present embodiment presents the designated facial expression to the player, and controls the progress of the game according to the suitability of the designated facial expression and the recognition result of the facial expression recognition process. It is possible to execute “designated facial expression suitability reference progress control”. That is, the player's facial expression can be added to the elements of the game rule.
Further, in relation to this, the arcade game device 1300 includes a “specific timing facial expression reference control” for controlling the play mode using the facial expression of the player at a given timing determined according to the progress of the game, “Facial expression change reference control” is executed to control the play mode using the difference between the facial expression of the player at the first timing and the facial expression of the player at the second timing after the first timing. .

  Specifically, the arcade game apparatus 1300 sets an order for the facial expression of the player in a portion where the play music is excited (a portion generally called “rust” corresponds to this). In the present embodiment, this is referred to as a “facial expression theme”, and the ordered facial expression is referred to as a “designated facial expression”. And while changing the game effect content according to the result of the facial expression recognition in the part where the play music swells, the game progress is variably controlled. As the game progress control, a privilege is given when the player can play with the facial expression as ordered.

More specifically, the arcade game device 1300 continues to recognize the facial expression of the player 2 from the start of the play, and the history of the facial expression recognition result is left, while the swelled portion of the song is “smileed” toward the player. "Facial expression theme" is issued (= order is placed). Then, as a result of facial expression recognition executed while playing the exciting part of the play song, if both of the following conditions (3) and (4) are satisfied, the “Facial expression theme” is cleared ( Succeeded).
Condition (3): The type of facial expression detected for a certain time (or a certain number of times) in the climax part (specific timing) is “smile”.
Condition (4): The first facial expression at the start of the game (first timing) was compared with the second facial expression at the climax part (second timing), resulting in a more “smile”.

  If it is determined that the “face expression theme” has been cleared (successful) or has failed, an effect display dedicated to success or dedicated to failure is executed. And in the former case, a privilege is further given. There is no conventional game rule execution based on the facial expression of the player, and a new game experience can be provided.

  Note that the “face expression theme” clear determination may be performed in any one of the conditions (3) and (4). In addition, when “the face expression theme” is cleared, it is possible to execute only one of the effect display and the privilege grant. Further, the privilege to be given can be set as appropriate. For example, bonus points may be given, or it may be set as appropriate according to the game content such as item grant, right to proceed to the next stage, prize lottery right.

[3. Use of face recognition in marketing]
FIG. 9 is a diagram for explaining the control contents regarding the collection of the sample survey data for marketing using the recognition result of the facial expression.
The arcade game apparatus 1300 of the present embodiment can collect sample survey data for estimating the degree of satisfaction of the player with the game by using a function that can capture the state of the player and recognize the facial expression. it can. That is, it is possible to collect information regarding marketing.

Specifically, a part (face image) in which the face of the player 2 (2a, 2b) is captured is extracted from the device front image G9, and a face feature value is obtained for each. A parameter value defining a customer segment such as gender and age is determined from the face feature value, and a customer segment of each player is determined.
On the other hand, data that designates a target customer for marketing is prepared in advance so that it can be referred to. Then, when the determined customer segment of the player corresponds to the target customer segment for marketing, the facial expression recognition result (or a numerical value such as satisfaction based on the recognition result) of the corresponding player is associated with the determination result of the customer segment. Accumulated as sample survey data.

  In the example of FIG. 9, it is determined that the customer group of the player 2 (2a) on the left side of the device front image G9 is “20s female” and the customer group of the player 2 (2b) on the right is “male 60s”. It falls under the target audience for marketing, and the latter is not considered. Therefore, the facial expression recognition result of the left player 2 (2a) and the customer segment determination result at the timing at which it is desired to investigate, such as during the game, after the game is over, or after the prize is paid out, are added to the sample survey data.

  Facial expression recognition is performed sequentially from the start of the game to a short time after the game ends, and a history of recognition results is stored. The facial expression recognition result added to the sample survey data includes a result of at least one timing among results at a specific timing such as the start of the game, the progress of the game, the end of the game, and the payout of the prize. In the present embodiment, results at at least two timings at the start of the game and at the end of the game are indispensable so that the player's expectation for the game and the satisfaction after the game is actually played can be estimated.

  In addition, in the case of multiplayer, if any one of the players playing together falls under the target audience for marketing, the recognition result of the facial expressions and facial expressions of all players even if the other players do not fall under the target audience for marketing May be added to the sample survey data. In this case, the sample survey data also serves as survey data during multiplayer.

[Description of functional block]
Next, a functional configuration will be described.
FIG. 10 is a functional block diagram illustrating an example of a functional configuration of the arcade game apparatus 1300 according to the present embodiment. As shown in the figure, the arcade game apparatus 1300 of the present embodiment includes an operation input unit 100, a photographing unit 102, an IC card reading unit 104, a consideration payment detection unit 106, a distance measurement unit 108, and a processing unit. 200, a sound output unit 350, an image display unit 360, a communication unit 370, a premium payout unit 400, and a storage unit 500.

  The operation input unit 100 outputs an operation input signal to the processing unit 200 in accordance with various operation inputs made by the player. For example, it can be realized not only by a button switch, a joystick, a touchpad, a trackball, etc., but also by an element that detects movement or posture, such as an acceleration sensor, angular velocity sensor, tilt sensor, geomagnetic sensor, etc. . Since the arcade game apparatus 1300 of the present embodiment executes a music game, it has a musical instrument type like the operation input apparatus 1306 of FIG. 1, but can be set as appropriate according to the game content. For example, when a gun shooting game is executed, a gun-type controller may be used.

  The photographing unit 102 is realized by an image sensor, a driver circuit thereof, and a storage medium (such as an IC memory) for storing image data. The photographing unit 102 photographs the front of the apparatus including the player (particularly the face) and processes the photographed image data. 200 can be output. In FIG. 1, the image sensor module 1326 corresponds to this.

  The IC card reading unit 104 can read information from the IC card and write information according to control by the processing unit 200. The IC card reader / writer 1330 in FIG. 1 corresponds to this. In this embodiment, the IC card reading unit 104 is configured to have an IC card 1332 issue function. Further, in the configuration using a wristwatch, a mobile phone, a portable game device, a portable information terminal device, or the like that supports the non-contact IC card technology instead of the IC card 1332, the IC card reading unit 104 uses the non-contact IC card technology. This can be realized with a corresponding receiving device.

  The consideration payment detection unit 106 performs detection and information transmission / reception related to the payment of the consideration for the game play. For example, the coin insertion device 1340 shown in FIG. In addition, it is configured with a receiving device that supports IC card technology, and accepts payment by electronic money stored in a wristwatch, mobile phone, portable game device, portable information terminal device, etc. that supports IC card technology. good. In addition, a known credit card reader may be used.

  The distance measuring unit 108 measures the distance to the person in front of the apparatus for each person, and outputs a measurement value signal to the processing unit 200. For example, the distance sensor 1328 corresponds to this in FIG. The distance measurement can be realized by appropriately applying known techniques. For example, it is possible to measure the time until reflection by irradiating ultrasonic waves, or to calculate the distance from the intensity of reflected light by irradiating infrared rays. Alternatively, if the photographing unit 102 is composed of two left and right image sensors, the distance may be determined by the principle of stereo photographing.

The processing unit 200 is realized by, for example, a microprocessor such as a CPU or GPU, or an electronic component such as an ASIC or IC memory, and inputs / outputs data to / from each function unit of the apparatus including the operation input unit 100 and the storage unit 500. Take control. Then, various arithmetic processes are executed based on a predetermined program and data, an operation input signal from the operation input unit 100, and the like, and the operation of the arcade game apparatus 1300 is controlled. In FIG. 1, the control unit 1350 corresponds to this.
The processing unit 200 includes a game control unit 202, a sound generation unit 250, an image generation unit 260, a communication control unit 270, and a payout control unit 280.

FIG. 11 is a block diagram illustrating a functional configuration example of the game control unit 202 in the present embodiment. The game control unit 202 executes various controls for realizing a video game in accordance with player operation inputs.
For example, since a music game is executed in the present embodiment, a process for displaying a game screen in accordance with the reproduction of the music selected by the player, a process for measuring the reproduction time of the music using a system clock, etc., and an operation input A process for evaluating the input timing and adding a score according to the process is performed. When the score at the end of the play of one song has reached a predetermined premium payment starting movement reference value, a lottery process is performed by an arithmetic process.
Depending on the game content, for example, various background objects are arranged in a virtual three-dimensional space to form a game space, and a player character or NPC (non-player character) object is arranged, or an operation from the operation input unit 100 Processing to control the player character in response to input, so-called AI control processing of the NPC, object hit determination processing, processing to automatically control shooting parameters such as the position and orientation of the virtual camera for shooting the player character, etc. It shall be executed as appropriate.
If necessary for the progress of the game, decoding of information received from an external device, development of texture, hit determination, flag setting, etc. can be executed.

  The game control unit 202 of the present embodiment includes a facial expression recognition unit 204, a player / gallery identification unit 205, a customer segment determination unit 206, a registered player detection unit 208, an attraction mode control unit 210, and a play mode control. Section 220, survey target determination section 246, survey data storage control section 248, and player registration management section 249.

The facial expression recognition unit 204
(1) processing for recognizing a portion (person image) in which a person is shown from a photographed image photographed by the photographing unit 102 (see the apparatus front image G1 in FIG. 3);
(2) processing for recognizing a part (face image) in which a person's face is reflected from a photographed image;
(3) processing for obtaining a facial feature value from a facial image;
(4) A process for determining the age and sex of a person based on the face feature value;
(5) processing for recognizing facial expressions based on facial feature values;
(6) Processing for storing the facial expression recognition result in the storage unit 500 in time series together with time data;
(7) Based on the time series data of the facial expression recognition result, statistical processing such as the appearance rate of the facial expression being played can be executed.

  Note that these processes and the functions realized thereby can be realized by known face recognition techniques, facial expression recognition techniques, and their peripheral techniques. In this embodiment, the face recognition chip 1356 (see FIG. 1) implements these functions with dedicated hardware. However, the CPU 1351 executes a known face recognition program or facial expression recognition program. It is also good. Alternatively, a configuration may be adopted in which an image photographed by the photographing unit 102 is transmitted to an external device via the communication line 1 and a facial feature value and a facial expression recognition result are acquired from the external device. In addition, in the present embodiment, the recognition result of facial expression is calculated as the degree of each predetermined emotional type such as joy, stunning, displeasedness, but other forms may be used depending on the known technique used. .

  The player / gallery identifying unit 205 detects a person at the play position, that is, a player (or a person close to a game device that is a player candidate) from among the people in the front image captured by the photographing unit 102. Realize a person location detection function that identifies a gallery. This function compares the arrangement position and area ratio of the face image shown in the front image of the apparatus on the entire screen with a predetermined reference value, and uses the distance measurement result by the distance measurement unit 108 for each face image. This can be realized (see FIG. 6). In addition, the identification unit can temporarily register the face feature value of the player-equivalent person, and thereafter identify the face image of the player (or a person close to the game device as a player candidate) from the face image of the device front image. To do.

  The customer segment determination unit 206 determines the age, sex, and the like from the face feature value for each person shown in the device front image captured by the imaging unit 102, and collates with predetermined customer segment definition data to determine the customer segment of the person Determine.

  The registered player detection unit 208 collates the feature data that can be authenticated based on the recognition result of the facial expression recognition unit 204 with player registration data stored for each registered player, and the registered player detects the captured image captured by the imaging unit 102. Detect that it is reflected.

The attraction mode control unit 210 controls the operation of the arcade game apparatus 1300 in the customer waiting state so-called attraction mode. For example, various effect displays and music playback for attracting customers are controlled, such as displaying a title screen and executing automatic play.
In this embodiment, the customer segment database creation unit 211, the date / time condition criterion control unit 212, the priority customer segment person selection unit 213, the registered player priority control unit 214, the customer segment combination-specific control unit 215, and the favorable reaction person detection unit 216 and a favorable response detection detection control unit 217.

  The customer segment database creation unit 211 creates a customer segment database in which the determination result by the customer segment determination unit 206 is tabulated for each date and time condition defined by day of the week, time zone, specific period, and the like (see FIG. 3).

  The date / time condition reference control unit 212 controls the attraction mode based on the customer segment database created by the customer segment database creation unit 211. Specifically, the main customer group is determined from the customer group totaling result of the date and time conditions that the current date and time match, and the control is optimized for the main customer group with reference to the control pattern data of the attraction mode corresponding to the determined main customer group ( (See FIG. 3).

  The priority customer segment person selection unit 213, when there are a plurality of persons shown in the photographed image by the photographing unit 102, based on the customer segment determination result for each person and a predetermined customer segment priority order, A person is selected as a reference for determining the mode control contents (for example, the contents of the game effect and the game progress control). The selected person becomes the “priority customer group person” and is the object of optimization of the control content (see FIG. 4).

  The registered player priority control unit 214 refers to the player registration data (personal information) for the person (registered player) detected by the registered player detection unit 208 in the image captured by the imaging unit 102. Then, the control contents of the attraction mode are switched and optimized for the detected registered player (see FIG. 4).

  The control unit 215 for each customer group combination uses the combination of customer groups determined by the customer group determination unit 206 to control the effect contents of the attraction mode, and realizes an effective appeal by the combination of the customer groups (see FIG. 4).

The likable reaction person detection unit 216 preferentially detects that a person who is interested in the game system appears in the captured image. Specifically, the facial expression is recognized from the facial feature value of a person in the vicinity of the game device, and the degree of the facial expression is “joy”, “fun”, “interest” or the like is greater than a predetermined threshold If it is recognized, the person is detected as a favorable reaction person (see FIG. 5).
Note that the detection method is not limited to a form using a captured image. For example, the distance measurement unit 108 measures the distance from the game device for each person shown in the photographed image, and determines that the person is interested when the distance changes to approach the play position. May be detected as a favorable reaction person. Of course, it may be used in combination with a form using a photographed image.

  When a sensation responder is detected, the control unit 217 at the time of detecting a sensation responder selects the content of the attraction mode currently being executed and other content that satisfies a predetermined relation condition, and at the given timing, The content of the attraction mode is optimized for the likable responder by switching to other content.

  The play mode control unit 220 controls the game play after the payment of the game play consideration is detected. The present embodiment includes several functional units that control the game effect using the facial expression of the player at a given timing determined according to the progress of the game based on the recognition result of the facial expression recognition unit 204. Specifically, it includes a gallery number reference control unit 221, an appearance expression reference control unit 222, a facial expression theme control unit 224, and a prize payout lottery unit 234.

  The gallery number reference control unit 221 calculates the number of galleries 4 (see FIG. 6) identified by the player / gallery identifying unit 205 based on the recognition result of the facial expression recognition unit 204, and according to the calculated number of galleries. To change the game progress and game production. In the present embodiment, a dedicated effect display corresponding to the number of galleries is executed, but instead of or in combination, the game progress may be controlled according to the number of galleries.

  The appearance facial expression reference control unit 222 controls the game effect using the facial expression of the player that satisfies a given appearance frequency condition during the game (see FIG. 7). Specifically, the history of the facial expression recognition result of the player 2 who is playing the game is stored in the storage unit 500, and the appearance rate for each facial expression is statistically processed. Then, as a result of the statistical processing for each facial expression, a facial expression (dominant facial expression) having a high appearance frequency that satisfies a given appearance frequency condition is determined, and a special effect corresponding to the determined dominant facial expression is executed. In addition, since this embodiment executes a music game, the game effect is controlled using the dominant expression, but the game progress may be controlled instead or in combination.

  The facial expression theme control unit 224 performs various controls related to the “facial expression theme”. In relation to this, a designated facial expression presentation control unit 226, a designated facial expression suitability reference control unit 228, a specific timing facial expression reference control unit 230, and a facial expression change reference control unit 232 are included.

  The designated facial expression presentation control unit 226 selects the designated facial expression from the types of facial expressions that can be recognized by the facial expression recognition unit 204 by random lottery processing, and performs control for presentation to the player. In the present embodiment, the type of the designated facial expression is presented by image display on the image display unit 360, but the sound for designating the type may be emitted by the sound output unit 350.

  The designated facial expression suitability criterion control unit 228 is presented by the facial expression recognition result and the designated facial expression presentation control unit 226 at a specific timing (here, “timing” includes not only a moment but also a time width). Appropriateness (clearance of facial expression theme / failure of facial expression theme) is determined with respect to the specified facial expression, and the game presentation and game progress are changed and controlled according to the determination result (see FIG. 8).

  In this embodiment, whether or not the designated facial expression is appropriate is determined for each facial expression recognition result at the start of the game (first timing) and while playing a so-called “rust” portion (second timing). Is used. Specifically, in order to determine that the “Facial Expression Theme” has been cleared (successful), the type of facial expression detected for a certain period of time (or a certain number of times) at the climax part (specific timing) is specified. Compared with the first facial expression at the beginning of the game (first timing) and the second facial expression at the climax part (second timing), the degree of the specified facial expression is higher. "Appropriate judgment".

  Therefore, the designated facial expression suitability criterion control unit 228 of this embodiment controls the game performance using the specific timing facial expression criterion control unit 230 (a player's facial expression at a given timing determined according to the progress of the game. ) And the facial expression change reference control unit 232 (the game effect is controlled using the difference between the facial expression of the player at the first timing and the facial expression of the player at the second timing after the first timing). ).

  The prize payout lottery unit 234 executes a lottery process by a calculation process when the game result satisfies a predetermined prize payout starting condition, and outputs a payout execution command to the payout control unit 280 when winning is made, and the prize control unit 280 receives the prize. The payout unit 400 executes payout of prizes. In the present embodiment, in the lottery process related to prize payout, the winning probability can be varied according to the appearance history of the facial expression of the player and the type of facial expression with a high appearance frequency.

  The survey target determination unit 246 determines whether the player falls under the survey target for marketing information collection. Specifically, when the customer segment determined for each player by the customer segment determining unit 206 matches a predetermined customer segment targeted for marketing, the customer segment is regarded as a survey target.

  The survey data storage control unit 248 accumulates and manages in the storage unit 500 as sample survey data by associating the customer segment determination result and the facial expression recognition result for the player whose target is identified by the survey target determination unit 246.

  The player registration management unit 249 executes processing related to player registration to acquire personal information of the player, and generates and manages player registration data in the storage unit 500. This corresponds to so-called user registration. The personal information includes a face feature value calculated by the facial expression recognizing unit 204 from the image of the player photographed by the photographing unit 102 and a face feature value for personal authentication. In addition, the age gender obtained by the facial expression recognition unit 204 from the facial feature value is included. When the player registration is completed, the IC card reading unit 104 issues a new IC card 1332.

  The sound generation unit 250 is realized by, for example, a digital signal processor (DSP), a processor such as a voice synthesis IC, an audio codec that can play back an audio file, and the like, based on the processing result by the game control unit 202, BGM and sound signals of various operation sounds are generated and output to the sound output unit 350.

  The sound output unit 350 is realized by a device that outputs sound effects, BGM, and the like based on the sound signal input from the sound generation unit 250. In FIG. 1, the speaker 1324 corresponds to this.

  The image generating unit 260 is, for example, a processor such as a GPU (Graphics Processing Unit) or a digital signal processor (DSP), a program such as a video signal IC or a video codec, an IC memory for drawing frames such as a frame buffer, and for developing texture data. This is realized by an IC memory or the like used for the above. The image generation unit 260 generates one game screen in one frame time (for example, 1/60 seconds) based on the processing result by the game control unit 202, and outputs the generated image signal of the game screen to the image display unit 360. To do.

  The image display unit 360 displays various game images based on the image signal input from the image generation unit 260. For example, it can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head mounted display. In the present embodiment, this corresponds to the video monitor 1322 of FIG.

  The communication control unit 270 executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 370.

  The communication unit 370 is connected to the communication line 1 to realize communication. For example, a wireless communication device, a modem, a TA (terminal adapter), a wired communication cable jack, a control circuit, and the like are realized, and the communication device 1353 in FIG. 1 corresponds to this.

  The storage unit 500 stores a system program for realizing various functions for causing the processing unit 200 to control the arcade game device 1300 in an integrated manner, a game program necessary for executing the game, various data, and the like. . Further, it is used as a work area of the processing unit 200, and temporarily stores calculation results executed by the processing unit 200 according to various programs, input data input from the operation input unit 100, and the like. Such a function is realized by, for example, an IC memory such as a RAM or a ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In FIG. 1, the IC memory 1352 mounted on the control unit 1350 corresponds to this.

The storage unit 500 of this embodiment stores a system program 501 and a game program 502 as shown in FIG.
The system program 501 is a program for realizing the basic functions of the arcade game apparatus 1300 as a computer.
The game program 502 is application software for realizing the function as the game control unit 202 by being read and executed by the processing unit 200, but may be configured as a part of the system program 501.

  It is to be noted that a video game is received from a specific website to receive data necessary for game screen display and game progress, and the game screen display and game progress, and the game progress according to the operation input made on the operation input unit 100. It can also be realized as a so-called “web game” or “browser game” where control is performed or a request corresponding to an operation input is sent back to the website and information required for further game screens and game progress is provided. . In this case, the game program 502 is not configured as dedicated application software, but may be configured with a web browser program or a plug-in for realizing interactive display on the web browser by script control.

In addition, in the storage unit 500, as customer prepared data, customer segment setting data 510, attraction mode data 512, a music library 520, facial expression theme setting data 544, play mode effect content setting data 546, Remember.
In addition, player registration data 530, attraction mode control data 550, play data 560, and sample survey data 580 are stored as data to be generated and updated as needed. In addition, data necessary for executing various processes (for example, compressed / decompressed texture data, elapsed time, various timer values, counters, flags) and the like are also stored as appropriate.

  The customer segment setting data 510 is data for defining a customer segment to be determined based on the face feature value and defining a marketing target customer segment. For example, as shown in FIG. 13, for each customer segment type 510a, a customer segment priority order 510b, a survey target identification value 510c, a corresponding age 510d, a corresponding sex 510e, and a corresponding face feature value 510f are stored in association with each other.

The customer segment type 510a can be provided as appropriate.
The customer segment priority order 510b is referred to when the priority customer segment person selection unit 213 or the like prioritizes among a plurality of players based on the customer segment determination result.
The survey target identification value 510c is a flag indicating a marketing information collection target. In the example of FIG. 13, “0” indicates a non-survey target, and “1” indicates a survey target.
The corresponding age 510d and the corresponding gender 510e are criteria for determining the customer segment by collating with the age and gender determined by the facial expression recognition unit 204.
The corresponding face feature value 510f is data defining a range of face feature values calculated by the facial expression recognition unit 204, and is a reference for determining a customer segment from the face feature values.

  The attraction mode data 512 is data that defines a control pattern in the attraction mode. For example, as shown in FIG. 14, a plurality of customer segment-specific pattern sets 514 prepared for each customer segment type defined in the customer segment setting data 510 are stored. In this embodiment, since a music game is executed, each customer segment pattern set 514 introduces titles and how to play that are tailored to the taste of the corresponding customer segment, automatic play timing control, and various types associated with automatic play. It contains information for realizing the production. Although the detailed data configuration for realizing the effect depends on the configuration of the game device, for example, data for displaying on the screen, lighting patterns such as lighting, voice strength and playback timing, and the like can be appropriately included.

  Further, the attraction mode data 512 of this embodiment includes a customer group combination-specific pattern set 515, a power saving pattern set 516, and a registered player priority pattern set 518.

  The customer group combination-specific pattern set 515 is data defining the contents of effects applied when a plurality of persons are shown in a photographed image (device front image) by the photographing unit 102. Production contents that are prepared for each combination of customer segments determined by the customer segment determination unit 206 (first customer segment and second customer segment in the figure) and that are added to the production contents of the customer segment pattern set 514 that has already been selected and executed. Stores various data to be executed.

  The power saving pattern set 516 stores data for executing control for appealing the presence while suppressing power consumption more than in normal attraction mode control (during control by the customer segment-specific pattern set 514). For example, a control pattern is set such that the calculation processing is reduced in the screen display control.

  The registered player priority pattern set 518 defines a control pattern to be applied when a registered player is included in a person shown in a photographed image (device front image) taken by the photographing unit 102. It is appealing content that gives you a sense of familiarity. For example, an invitation phrase including the account name of the registered player may be displayed as an image.

  The music library 520 stores information related to music that can be played in the music game. In this embodiment, since automatic play is performed in the attraction mode, it can be said that a part of the data relating to the contents of the effect in the attraction mode is configured. For example, as shown in FIG. 15, the music library 520 includes a new song list 522, a genre-specific sub-library 524, a customer demographic sub-library 526, and a facial expression-specific sub-library 528.

  The new song list 522 is a list of songs that can be newly played on the arcade game device 1300, and associates information such as genre, artist name, timing guide data, chorus part timing, song data, etc. by song name. Store.

The genre and the artist name serve as classification information used in the control at the time of detecting a favorable reaction person when the music library 520 is regarded as data related to the effect contents of the attraction mode.
The song data is music data that can be decoded and reproduced by the sound generator 250.
The timing guide data is data for displaying the timing guide 40 on the game screen.
The chorus part timing is information for determining a so-called “rust” part in which a song is excited, and is defined as a playback time range, for example.

The genre sub-library 524 stores a plurality of lists organized by genre of music.
The customer segment sub-library 526 stores a list of popular songs for each customer segment defined by the customer segment setting data 510 in terms of age and gender of the customer segment.
The expression-specific sub-library 528 stores a list of songs that improve the mental state of the facial expression for each facial expression and make the mood more enjoyable. The list included in the sub-library is referred to according to the facial expression of the player analyzed at the time of music selection.
Each list stored in these sub-libraries has the same data structure as the new song list 522.

  The player registration data 530 stores personal information registered by a user through a predetermined procedure before starting the game or at the end of the first game. As shown in FIG. 16, for example, one player registration data 530 includes a uniquely issued player ID 532, age and gender information 533, personal authentication face feature value 534, play history data 536, and preference analysis data 538. Including. Of course, other information can be included as appropriate.

The personal authentication face feature value 534 stores a face feature value for specifying an individual. The registered player detection unit 208 can perform personal authentication using face recognition by collating the facial feature value obtained by the facial expression recognition unit 204 with the facial feature value 534 for personal authentication.
The play history data 536 stores the date and time of play, the selected song, the score, and the like. The type of data to be stored can be set as appropriate according to the game content.
The preference analysis data 538 stores the selection frequency for each genre of music obtained from the statistical processing of the genre accumulated in the play history data 536. By referring to this data, it is possible to know which genre of music the player likes to enjoy the game.
It is assumed that the play history data 536 and the preference analysis data 538 are updated by the computer managing the player registration data 530 so that the latest play result is determined after the game ends.

  The facial expression theme setting data 544 presents the designated facial expression to the player as one of the game rules using the facial expression of the player, and advances the game depending on whether the player has given the designated facial expression after the presentation. Information for realizing the “facial expression theme” is stored (see FIG. 8). For example, as shown in FIG. 17, presentation text data 544 b displayed on the game screen to present a “face expression theme” for each designated face expression 544 a and a privilege granted when the theme is cleared are defined. The privilege setting 544c is stored in association with each other. The content of the privilege setting 544c can be appropriately set according to the game content. If it is a stage clear type game, it is preferable to include in the setting contents the stage to be moved and the right to play the special stage.

  The facial expression theme setting data 544 includes the theme success effect data 544d that defines the effect content to be additionally executed when it is determined that the “face expression theme” is cleared / successful, and when the failure is determined. The theme failure effect data 544e defining the effect content to be additionally executed is included.

  The play mode effect content setting data 546 is data defining effect content in the play mode, and in this embodiment, data for effect display on the effect display unit 47 (see FIG. 2) of the game screen during game play. Is stored. For example, as shown in FIG. 18, standard effect data 547, special effect setting data library 548, and multi-gallery special effect data 549 are stored.

  The standard effect data 547 is data for realizing effect contents that are equally applied to any player. In this embodiment, the basic effect display displayed on the effect display part 47 (refer FIG. 2) from the beginning of a game play is implement | achieved.

  Special effect setting data library 548 includes effect setting data associated with each type of facial expression recognized by facial expression recognition unit 204. Specifically, special effect setting data 548b is stored for each dominant facial expression type 548a. The appearance expression reference control unit 222 determines an expression that has reached a predetermined appearance frequency among the facial expressions of the player recognized during the game play as a dominant expression, and the special effect setting data 548b corresponding to the determined type of the dominant expression. The special effect display added to the standard effect is realized according to (see FIG. 7).

  The multi-gallery special effect data 549 is data for realizing an additional effect that the gallery number reference control unit 221 executes according to the number of galleries (see FIG. 6).

  The attraction mode control data 550 stores various parameter values necessary for executing control in the attraction mode. For example, as shown in FIG. 12, it includes a customer segment database 551, optimization target person identification data 553, optimization target person facial expression 554, and automatic play song name history 555.

  The customer segment database 551 includes date / time condition-specific customer segment data 552 prepared for a plurality of date / time conditions defined by combinations of days of the week, time zones, specific periods, and the like. One date-and-time condition visitor demographic data 552 includes statistical data obtained by statistically processing a customer demographic determined for each person that was reflected in the device front image under the date-time condition. The customer segment database 551 is generated and updated by the customer segment database creation unit 211.

In this embodiment, the optimization target person identification data 553 is data for identifying a target person to be used as a reference for controlling the content of the effect in the attraction mode from among the captured images (device front images) captured by the capturing unit 102. Is stored. The initialization state is “NULL” which means that no one is set.
In the present embodiment, when a plurality of persons are captured in the apparatus front image, the priority customer layer person selection unit 213 selects one person based on the customer group for each of the plurality of persons, and the facial features of the selected person Stores a value. However, if the registered player detection unit 208 detects that there are registered players among a plurality of persons shown in the front image of the apparatus, the face feature value of the registered player is preferentially stored. . Furthermore, when the favorable reaction person detection unit 216 detects a positive reaction person, the facial feature value of the person is preferentially stored. Incidentally, the coordinates in the image coordinate system of the representative point of the face image of the corresponding person may be stored in association with the face feature value.

  The optimization target person facial expression 554 stores the facial expression recognition result obtained from the facial feature values stored in the optimization target person identification data 553.

  The auto-play song name history 555 is managed by the attraction mode control unit 210, and each time auto-play is executed, the auto-play song name is stored and updated in time series.

  The play data 560 stores various data related to control in the play mode. For example, as shown in FIG. 19, a recommended song list 561, a play song name 562, a reproduction time counter 563, a gallery number 564, an application effect ID 565, a midway leaver verification data 566, a leave return flag 567, Stores player-specific data 570 prepared for each player.

The recommended music list 561 is generated in the course of the music selection process. In the present embodiment, based on the new song list 522 (see FIG. 15), songs in the recommended song list corresponding to the customer demographic, taste, facial expression, etc. of the player are added.
The play song name 562 is a song name finally selected in the course of the music selection process and indicates a song name to be played.
The reproduction time counter 563 stores the elapsed time from the start of reproduction of the music to be played.
The applied effect ID 565 stores identification information and ID of effect setting data currently applied / executed among a plurality of types of effects defined by the play mode effect content setting data 546.
The halfway leaver collation data 566 is created when a halfway withdrawal operation is performed after playing one song, temporarily stores the player's face feature value, and is used for identity verification when returning midway.
The leaving return flag 567 stores “1” when the player who has left the seat returns correctly, and stores “0” when the player who has left the seat does not return within the time limit and in the initial state.

  The player-specific data 570 includes, for example, a play position 571 indicating the player's play position, a score 572, a designated facial expression point 573, a designated facial expression type 574, a player customer layer 575, and facial expression recognition history data 576. Including. In the present embodiment, up to two players can be played simultaneously, so two such data are shown. However, when the number of players who can play simultaneously is other than two, it is created according to the number of players.

The designated facial expression point 573 is a point added in accordance with the number of times or a time at which a facial expression that can be regarded as the designated facial expression is detected by the facial expression recognition unit 204 during the game play along with the execution of the “facial expression theme”. is there. The initial value at the start of one play is “0”.
The designated facial expression type 574 stores the designated facial expression type selected and presented by the designated facial expression presentation control unit 226. The initial value is “NULL” meaning that no facial expression is set.
The player customer layer 575 indicates a customer layer determined by the facial expression recognizing unit 204 from the face feature value of the player.

  The facial expression recognition history data 576 is a facial expression history recognized by the facial expression recognition unit 204, and is generated and updated by the facial expression recognition unit 204. For example, the facial expression recognition time-series data 577 stores the facial expression recognition results from the detection of payment of the play consideration until the predetermined time after the end of the play in association with the time point. Further, the result of statistical processing of the facial expression stored in the time series data is stored in the facial expression statistical data 578.

  The sample survey data 580 includes a customer segment determination result and a facial expression when the customer segment determined based on the facial feature value of the person shown in the device front image corresponds to a predetermined customer segment targeted for marketing. The recognition result and the date and time are stored and stored in association with each other. The data structure can be appropriately set according to the usage form of the survey data.

[Description of process flow]
Next, the flow of various processes in this embodiment will be described.
FIG. 20 is a flowchart for explaining the main processing flow in the arcade game apparatus 1300. A series of processing flow described here is realized by the processing unit 200 of the arcade game machine 1300 reading and executing the system program 501 and then reading and executing the game program 502.

  The processing unit 200 of the arcade game device 1300 executes an attraction mode control process until coin insertion is detected (steps S2 to S4).

[Attraction Mode Processing Flow]
FIG. 21 is a flowchart for explaining the flow of the attraction mode control process. By this process, the control pattern in the attraction mode is switched variously toward the person in front of the apparatus, and the game can be more effectively appealed to the consumer.

  Specifically, the processing unit 200 determines whether or not the attraction mode control pattern can be switched (step S10). For example, it is preferable to set the timing at which the control pattern that is already being executed, the timing at which the auto-play music is ended, etc., can be appropriately switched.

  If the timing is switchable (YES in step S10), the processing unit 200 captures a front image of the apparatus by the image capturing unit 102 (step S12), and extracts a portion in which a person is captured in the captured image. It is then determined whether there is a person in front of the device (step S14).

  If it is determined that no person is shown in the front image of the apparatus (NO in step S14), the processing unit 200 initializes the optimization target person identification data 553 of the attraction mode control data 550 (step S14). S16; see FIG. Next, referring to the power saving pattern set 516 from the attraction mode data 512 (see FIG. 14), control of the attraction mode for power saving is started according to the pattern set (step S18).

If it is determined that there is a person in the front image of the apparatus (YES in step S14), the processing unit 200 will initialize the optimization target person identification data 553 (YES in step S22). ), The processing unit 200 determines the distance from the game device for each person in the image (step S24).
For example, when the size of the face image for each person in front of the apparatus exceeds a predetermined proximity determination reference ratio with respect to the screen size, or when the distance sensor 1328 is used, the person obtained from the detection signal When the distance reaches the predetermined proximity determination reference distance, the processing unit 200 determines that there is a close person approaching to the vicinity of the play position.

  When it is determined that there is no near person (NO in step S26), the processing unit 200 executes the date / time condition reference control process, and is regarded as the main in the place where the arcade game apparatus 1300 is installed and the date / time condition at that time. Control with the optimum content for the customer base is started (step S28; see FIG. 3).

  If it is determined that there is an approaching person (YES in step S26), the approaching person reference control process is executed to start control with appropriate contents for the person approaching the arcade game apparatus 1300 (step S26). S30; see FIG.

  In the first place, when someone's face feature value is set in the optimization target person identification data 553 (NO in step S22), the processing unit 200 executes a favorable reaction person reference control process for the positive reaction person. Control with optimum contents is started (step S32; see FIG. 5).

Here, each control process executed in the attraction mode control process will be described.
FIG. 22 is a flowchart for explaining the flow of the date / time condition reference control process.
In this process, first, the processing unit 200 determines a customer segment for each person shown in the apparatus front image (step S40). Specifically, a face feature value (face image) is extracted to calculate a facial feature value, and each gender and age is obtained from the facial feature value. Then, with reference to the customer segment setting data 510, the customer segment corresponding to the obtained facial feature value, sex, and age is determined.

  If the customer segment is determined, the processing unit 200 updates the customer segment data 552 classified by date and time conditions that match the current date and time (step S42; see FIG. 12), and determines the main customer segment from the result (step S44).

Next, the processing unit 200 selects a customer demographic pattern set 514 corresponding to any of the main customer demographics determined from the attraction mode data 512 (step S46; see FIG. 14), and further subclass 526 by customer demographic of the music library 520 (FIG. 15), a recommended song list corresponding to one of the main customer segments is referred to, and a song to be automatically played is selected from the list (step S48).
Then, the control of the attraction 2 mode is started so as to automatically play the music selected in step S48 in accordance with the customer group-specific pattern set selected in step S46 (step S50).

FIG. 23 is a flowchart for explaining the flow of the neighbor reference control process.
In this process, the processing unit 200 first calculates a face feature value for each person regarded as a close person, and compares the face feature value with the personal authentication face feature value 534 (see FIG. 16) of the player registration data 530. It is then determined whether the person is a registered player (step S70).

As a result, if none of the neighbors corresponds to the registered player (NO in step S72), the processing unit 200 determines the customer base for each neighbor (step S74), and corresponds to the current date, day of the week, and time. The customer base data 552 classified by date and time conditions to which the time frame is assigned is updated (step S76).
Next, a priority customer group subject to control optimization is selected from the neighbors based on the priority by customer segment indicated by the customer segment priority order 510b of the customer segment setting data 510 (step S78; see FIG. 13), and the optimum The target person identification data 553 is updated to the face feature value of the person designated as the priority customer layer person (step S80; see FIG. 12), and the facial expression recognition result based on this face feature value is used as the optimization target person face expression 554. Store (step S82).

Next, the processing unit 200 selects a customer segment pattern set 514 corresponding to the customer segment of the priority customer segment person from the attraction mode data 512 (step S84; see FIG. 14), and from the customer segment sub-library 526 of the music library 520. The recommended song list corresponding to the customer segment of the priority customer segment is referred to, and a song to be automatically played is selected from the list (step S86; see FIG. 15).
Then, the processing unit 200 starts controlling the attraction mode so as to automatically play the music selected in step S84 in accordance with the customer layer-specific pattern set selected in step S82 (step S88).

On the other hand, if there are registered players among the persons who are close (YES in step S72), and there are a plurality of registered players (YES in step S90), the processing unit 200 stores the player registration data 530 (see FIG. 16). Based on the personal information about the player (for example, age and sex information 533), one of the neighbors is selected as a priority customer group person (step S92). Then, the optimization target person identification data 553 is updated with the facial feature value of the priority customer layer person (step S94), and the recognition result of the facial expression based on the facial feature value is stored as the optimization target person facial expression 554 (step S94). S96).
When there is only one registered player among the neighbors, the registered player is regarded as a priority customer group person. When selecting a priority customer group person, the lower the age, the higher the priority, and if the age is the same, it is preferable to select the sex so that the priority is higher for women than for men.

Next, the processing unit 200 refers to the genre sub-library 524 of the music library 520, and selects a song to be automatically played from a list corresponding to the favorite genre of the priority customer group person (step S98). The favorite genre of the priority customer group person can be determined by referring to the preference analysis data 538 of the player registration data 530.
Then, in accordance with the registered player priority pattern set 518 (see FIG. 14), the processing unit 200 starts controlling the attraction mode so as to automatically play the music selected in step S96 (step S100).
That is, “registered player priority control” for further optimizing the control content for the registered player is performed in steps S90 to S100.

FIG. 24 is a flowchart for explaining the flow of the favorable responder reference control process.
In this process, the processing unit 200 first captures a front image of the apparatus by the image capturing unit 102 (step S110), and calculates a face feature value for each person shown in the captured image (step S112). Then, the facial feature value for each person in the image is compared and verified with the optimization target person identification data 553 (step S114).

  If it is determined as a result of the collation that the same person as the person to be optimized is not captured in the captured image (NO in step S116), the processing unit 200 determines the person to be optimized identification data 553 and the object to be optimized. The person facial expression 554 is initialized (step S118), and the favorable reaction person reference control process is terminated.

  On the other hand, when it is determined that the same person as the person to be optimized is captured in the captured image (YES in step S116), the processing unit 200 determines the face feature value obtained in step S112 and the object to be optimized. The human facial expression 554 is compared (step S120). As a result, if it can be determined that the latest facial expression of the same person is more enjoyable, joyful, full of surprises, or curiosity, a positive response Considered to be shown.

  And when it determines with having shown a favorable response (YES of step S122), the process part 200 showed the music autoplayed immediately before, ie, a favorable response, with reference to the auto play music title log | history 555 and the music library 520. A search is made for another song having the same attribute as the song considered to be the subject (step S124). The “attribute” referred to here is classification information of effect contents, and corresponds to an artist name in this embodiment (see FIG. 15). Of course, the attribute is not limited to the artist name. For example, if it falls under the theme song or insert song of a game, movie, video work, or song used as BGM, there should be information such as the title of the affiliated work. This may be an attribute. If the player registration data 530 includes a game title purchased by the player or a purchase history of a video clip, it is more preferable to consider the affiliated work title as an attribute element because the degree of appeal can be further increased.

If there is another song with the same attribute as the song that was automatically played immediately before (YES in step S126), the processing unit 200 automatically selects one of the other songs without changing the control pattern of the current attraction mode. A song to be played is set (step S128).
Therefore, it is possible to effectively carry out further appeal toward a person who is in front of the apparatus and shows a favorable reaction by looking at the control in the attraction mode, particularly the state of automatic play.

Returning to FIG. 21, if any one of the date / time condition reference control process, the neighbor reference control process, and the sensation responder reference control process is executed, the processing unit 200 then has a plurality of persons in front of the apparatus (step S130). YES), the customer base is determined for each person (step S132), the customer group combination-specific pattern set 515 that matches the determined customer base combination is selected, and the effect display according to the contents of the selected pattern set is started. In step S134, the attraction mode control process is terminated.
In the present embodiment, the customer group combination pattern set 515 is treated as one rank lower in priority than the customer demographic pattern set 514 and defines additional production contents, but is equivalent to the customer demographic pattern set 514. In the case of handling as described above, steps S130 to S134 may be moved before step S22.

[Play mode processing flow]
Returning to FIG. 20, when coin insertion is detected while the attraction mode control is being executed (YES in step S <b> 4), the processing unit 200 interrupts the attraction mode control and is initialized in the storage unit 500. Play data 560 is generated and a play mode control process is executed (step S140).

  FIG. 25 is a flowchart for explaining the flow of the play mode control process. In the process, first, the processing unit 200 executes a play music selection process (step S142).

  FIG. 26 is a flowchart for explaining the flow of the play song selection process. In this process, the processing unit 200 first clears the recommended song list 561 (step S150; see FIG. 19), and determines whether the IC card 1332 is inserted in the IC card reader / writer 1330 (step S152).

  If the IC card 1332 is not inserted (NO in step S152), the processing unit 200 images the player with the image capturing unit 102 (step S160), calculates the player's face feature value, and calculates the calculated face feature value. Based on the above, personal authentication processing as a registered player is executed (step S162).

  Here, if any player cannot be personally authenticated, that is, if any player is not a registered player (NO in step S164), the processing unit 200 determines for each player from the face feature value obtained in step S162. The gender and age are obtained, and the customer base for each player is determined from the obtained information (step S166). If there are a plurality of players, the priority customer group person is selected (YES in step S168 → S170), and the customer group of the player regarded as the priority customer group person (see FIG. 15) from the customer class sub-library 526 of the music library 520 (see FIG. 15). Or, when there is a single player, the recommended song list for each customer segment corresponding to that player is read and added to the recommended song list 561 (step S172).

  If it is determined in step S164 that the registered player has been authenticated as a result of the personal authentication process based on the face feature value (YES in step S164), the processing unit 200 determines the player registration data 530 for the authenticated player. (Step S180; see FIG. 16). If it is detected in step S152 that the IC card 1332 is inserted (YES in step S152), the processing unit 200 registers the player registration data 530 associated with the information stored in the IC card. Refer to

  Next, the processing unit 200 determines a genre that the player likes from the preference analysis data 538 of the player registration data 530. Then, the recommended song list corresponding to the genre preferred by the player is added to the recommended song list 561 from the genre sub-library 524 (see FIG. 15) of the song library 520 (step S182). Further, the processing unit 200 searches the new song list 522 for a new song of a genre that the player likes, and adds the corresponding new song to the recommended song list 561 (step S184).

  Next, the processing unit 200 captures a player image (step S190) and recognizes the facial expression of the player in a state before the game is started (step S192). The recognition result is added to the facial expression recognition time series data 577 of the facial expression recognition history data 576 included in the player-specific data 570 of the play data 560. Further, the processing unit 200 updates the facial expression-specific statistical data 578 accordingly (see FIG. 19).

  Next, the processing unit 200 searches the recommended song list corresponding to the facial expression recognized in step S192 from the facial expression sub-library 528, and if there is a corresponding recommended song list (YES in step S194), the corresponding recommended song list. Is added to the recommended song list 561 (step S196).

  The processing flow up to this point has created a “recommended song list” suitable for the current mental situation inferred from the customer demographics, preferences, and facial expressions of the player. The “list” is displayed on the music selection screen, and the player is prompted to select the music to be played this time (step S220).

  When a predetermined genre change operation is detected in a state where the music selection list is displayed (YES in step S222), the processing unit 200 recommends another genre-specific sub-library 524 from the music library 520 according to the operation. A song list or a new song list 522 is displayed as a song selection list (step S224). If a predetermined music selection determination operation is detected (YES in step S226), the music title to be selected in the list displayed in the music selection list is stored in the play music name 562 of the play data 560 (step S228). The song selection process ends.

  Returning to the flowchart of FIG. 25, the processing unit 200 starts the game (step S240). That is, playback of the play song is started and sound is emitted from the speaker 1324. In addition, the video monitor 1322 displays the timing guide 40 in synchronization with the playback of the play song, and the display of the game screen including the effect based on the standard effect data 547 (see FIG. 18) is started in the effect display unit 47. . The reproduction time is also started with the start of the game and stored in the reproduction time counter 563 of the play data 560 (see FIG. 19). At this time, the application effect ID 565 stores information indicating the standard effect data 547.

If the game is started, the processing unit 200 updates the score for each player according to the operation input detected by the operation input unit 100 (step S242).
If a predetermined facial expression recognition cycle (for example, every 20 seconds) has arrived since the game started (YES in step S244), the player's facial expression recognition and recognition result storage are performed (step S246). Specifically, the imaging unit 102 captures a front image of the apparatus, and extracts a portion where a person's face is captured from the captured image. Next, for each portion where the extracted face is shown, the position in the screen, the ratio of the area of the portion to the screen area, and the face of the player or the gallery are identified. At this time, a distance measurement result for each portion in which the face image extracted by the distance sensor 1328 is captured may be used for identification. Then, the face feature value is calculated for each portion (face image) in which the player's face is shown, and the facial expression recognition history data 576 of the player-specific data 570 is updated. Note that it can be determined from the relative position of the face image in the screen where the player's face (face image) belongs to which player position.

  Further, the processing unit 200 counts the number of galleries and updates the number of galleries 564 using the fact that the player's face and the gallery's face are identified from the captured image (step S248). Then, the game progress is controlled using the facial expression recognition result of the player and the number of galleries as parameters. Since the present embodiment is a music game, the processing unit 200 executes an effect change process and changes the display of the effect display unit 47 on the game screen (step S250).

  FIG. 27 is a flowchart for explaining the flow of the effect changing process in the present embodiment. In the process, the processing unit 200 first determines whether a predetermined time has elapsed from the game start time (step S260). The predetermined time mentioned here refers to a time corresponding to the fact that the facial expression recognition cycle in step S224 has been repeated and the recognition results are sufficiently accumulated.

  If the predetermined time has not elapsed (NO in step S260), the processing unit 200 refers to the facial expression recognition time series data 577 of the facial expression recognition history data 576, and regards the pre-game start as a specific timing. Then, the facial expression recognized at that time is regarded as the dominant facial expression (step S262), and the effect displayed on the effect display unit 47 is left as it is, and the effect change process is terminated.

If the predetermined time has elapsed (YES in step S260), the processing unit 200 refers to the facial expression-specific statistical data 578 of the facial expression recognition history data 576, and the most appearance rate from the statistical results up to now. A high facial expression is defined as “dominant facial expression” (step S266).
When the frequency of the dominant facial expression reaches a predetermined effect switching reference value (YES in step S268), the processing unit 200 determines that the predetermined appearance frequency condition is satisfied, and the special effect setting data library 548 (FIG. 18). The special effect setting data corresponding to the dominant facial expression determined in step S266 is selected and added to the currently applied standard effect as the content to be displayed on the effect display unit 47 (see step S270; see FIG. 7). That is, the effect display unit 47 additionally displays effect elements according to the selected special effect setting data. In the applied effect ID 565, in addition to the identification information of the standard effect data 547, the identification information of the special effect setting data selected in step S270 is stored.

Furthermore, when the gallery number 564 has reached a predetermined reference value (YES in step S272), the processing unit 200 refers to the multi-gallery special effect data 549 as the content to be displayed on the effect display unit 47. Further, a special effect is added (step S274; see FIG. 6), and the effect change process is terminated.
If multiple types of multi-gallery special effect data 549 are prepared according to the number of galleries, it is preferable to select data according to the number of galleries in step S272.

Returning to FIG. 25, the processing unit 200 next determines whether or not the play music has ended.
Play is still in progress (NO in step S300), and the playback time counter 563 matches the start time of the chorus part (the chorus part timing of the corresponding song in the music library 520 (see FIG. 15)) and matches the predetermined time. (YES in step S302), the processing unit 200 resets the designated facial expression type 574 (step S304; see FIG. 19).

  Specifically, the designated facial expression type 574 is initialized to clear the existing setting, and then a lottery process using random number generation is executed to set a new designated facial expression type. Next, the processing unit 200 refers to the presentation text data 544b corresponding to the type of the designated facial expression newly set in step S304 from the facial expression theme setting data 544 (see FIG. 17), and displays “Facial expression” on the game screen. Presentation of “theme” is started (step S306).

  After the presentation of the facial expression theme, when the climax part is played (YES in step S310), the processing unit 200 captures the player and recognizes the facial expression of the player (step S312). It is determined whether or not is cleared. Specifically, the facial expression recognized in step S312 corresponds to the designated facial expression, and the facial expression recognized at the start of the game (referable from facial expression facial expression recognition time series data 577) is recognized in step S312. Compared with the facial expression, if the latter has a higher degree of designated facial expression than the former, it is determined that the “facial expression theme” has been cleared and succeeded (see FIG. 8). Instead of comparing the degrees, it may be determined whether the “face expression theme” has been cleared based on the degree of the facial expression recognized in step S312.

If it is determined that the game has been cleared (YES in step S318), the processing unit 200 adds a predetermined value to the designated facial expression point 573 of the corresponding player and affects the progress of the game (step S320; FIG. 19). Reference), a special effect display that praises the success with reference to the theme success effect data 544d is added (step S322). On the other hand, when it is determined that the process has failed (NO in step S318), the processing unit 200 refers to the theme failure effect data 544e and adds an effect display dedicated to failure (step S324). When the chorus part is finished (YES in step S326), the presentation of “face expression theme” is finished (step S328).
In this embodiment, steps S318 to S324 are executed only once during one song play, but when the execution time of the theme success effect data 544d and the theme failure effect data 544e is short (for example, In the case of several seconds), it may be configured to be executed a plurality of times until the end of the chorus part.

  If it is determined in step S300 that the play of one song has been completed (YES in step S300), the processing unit 200 calculates bonus points using a predetermined function according to the number of designated facial expression points 573 ( In step S330, an effect display in which bonus points calculated on the game screen are added to the score is executed (step S332). The addition may be performed on the score 572 of the player-specific data 570, that is, on a player-by-player basis, or in the case of cooperative play, bonus points may be added to the total value of the score 572 of players who have played at the same time. .

  When the total score 572 of the players after the bonus points are added reaches the predetermined prize payout lottery activation reference value for the first time from the start of the game (YES in step S334), the processing unit 200 executes the prize payout process (step S336).

  FIG. 28 is a flowchart for explaining the flow of a prize payout process. In this process, the processing unit 200 first refers to the facial expression-specific statistical data 578 to determine whether the frequency of a predetermined facial expression type (for example, joy, fun, etc.) exceeds a reference value (step S340; (See FIG. 19). When there are a plurality of players, the customer base is determined for each player, one of the players is selected according to a predetermined customer base priority, and the facial expression-specific statistical data 578 of the player is referred to.

  If it does not exceed the reference value (NO in step S340), the winning probability applied to the current lottery is set to the standard value (step S342), and if it exceeds the reference value (YES in step S340) ), The winning probability is set to be higher than the standard value, that is, the winning probability is set to be easy (step S344). Then, the processing unit 200 executes a lottery process with the applied winning probability (step S346), and if a winning is made (YES in step S348), the prize payout control is performed (step S350).

  Next, the processing unit 200 captures the state of the player (step S352), calculates a facial feature value for each player, and determines a customer segment in light of the customer segment setting data 510 (step S354). If the determined customer segment of the player matches the target customer segment for marketing (YES in step S356), the player is photographed after the paid out prize is taken out (step S358). The facial expression of the player who has received the prize is recognized (step S360), and the customer base of the player, the facial expression recognition result, and the date and time are associated with each other and added / updated to the sample survey data 580 (step S362). Those pieces of information accumulated in the sample survey data 580 can be used for the satisfaction survey for the prepared premium.

  If the sample survey data 580 is updated, the process returns to the flowchart of FIG. 25 and the play mode control process is terminated.

  Returning to FIG. 20, when the play mode control process is completed, the processing unit 200 determines whether or not the play continuation condition is satisfied (step S380). For example, if the rule allows another song to be played when the score exceeds a predetermined continuation permission reference value, an affirmative determination is made when the continuation permission reference value is exceeded. Further, even when the coin input amount corresponds to a consideration for a plurality of times, an affirmative determination may be made and other appropriate settings may be made.

  If it is determined that the play continuation condition is satisfied (YES in step S380), the processing unit 200 displays on the video monitor 1322 a selection screen that asks the player whether to leave the table (step S382). If a selection operation for leaving the seat is detected (YES in step S384), the processing unit 200 further performs a leave processing on the way (step S386).

FIG. 29 is a flowchart for explaining the flow of the withdrawal process on the way.
In this process, the processing unit 200 first shoots the player, calculates the player's facial feature value, and stores the facial feature value in the halfway away person collation data 566 of the play data 560 (step S400; see FIG. 19). . Then, the operation input is set to a hold state, and a temporary operation input is impossible (step S402). In the hold state, it should be well-known by displaying text on the video monitor 1322 to that effect.

  If the hold state is started, the processing unit 200 starts counting down the hold state holding timer (step S404). The timer is realized by a timekeeping function using the system clock of the processing unit 200, and counts down for about 3 minutes, for example.

  If the hold state holding timer has not reached “0” (NO in step S406), the processing unit 200 captures a front image of the apparatus (step S408), and whether a person is captured at the play position in the captured image. Is determined (step S410). If a person is shown in the play position (YES in step S410), the processing unit 200 calculates a facial feature value of the person considered to be in the play position, and collates with the halfway away person collation data 566. (Step S412). As a result of the collation, if it is recognized that the person who is considered to be in the play position is the same person as the player who left the seat (YES in step S414), the leave return flag 567 (see FIG. 19) is set to “1 (normal return)”. (Step S416), the hold state of the operation input is released (step S420), and the midway withdrawal process is terminated.

  On the other hand, when the hold state holding timer has reached “0” (YES in step S406), the processing unit 200 sets the leaving return flag 567 to “0 (no return)” (step S418). The input hold state is released (step S420), and the midway leaving process is terminated.

Referring back to the flowchart of FIG. 20, when the leaving return flag 567 is “1”, the processing unit 200 regards that the player who has left the way has returned (YES in step S440), and follows the recommended song list 561. Next, a music selection screen for selecting a song to be played is displayed (step S442).
When a predetermined genre change operation is detected in a state where the music selection screen is displayed (YES in step S446), the processing unit 200 selects another genre-specific sub-library 524 from the music library 520 according to the operation. Or a new song list 522 is displayed on the song selection screen (step S448).
If a predetermined music selection operation is detected (YES in step S450), the music title to be selected in the list displayed on the music selection screen is stored in the play music name 562 of the play data 560 (step S452). The song selection process ends. Then, the process proceeds to step S140.

  If the leaving return flag 567 is “0” (NO in step S440), the processing unit 200 considers that the player who has left the seat does not return and proceeds to step S2.

  If it is determined in step S380 that the play continuation condition is not satisfied (NO in step S380), the processing unit 200 captures the state of the player (step S470), calculates a facial feature value for each player, and The customer base is determined in light of the setting data 510 (step S472; see FIG. 13).

  If the determined customer segment matches the target customer segment for marketing (YES in step S474), the player is photographed immediately after the game ends (step S476), and the facial expression of the player at the end of the play is displayed. Recognize (step S478), and add / update to the sample survey data 580 by associating the customer segment of the player that matches the marketing target customer segment, the facial expression before the start of the game, the facial expression recognized in step S478, and the date and time. (Step S480). These pieces of information accumulated in the sample survey data 580 can be used for a satisfaction survey for the game.

  Note that the information on the face recognition result added to the sample survey data 580 in step S480 can appropriately include the recognition result during the game, specifically, facial expression recognition time series data 577. In addition, in step S474, if any one of the players who play together in multi-play corresponds to the marketing target customer segment, an affirmative determination is made, and even if other players do not correspond to the marketing target customer segment, step S480 is determined. The customer base and facial expression recognition results of all players may be collected and added to the sample survey data.

  Next, the processing unit 200 determines whether or not the player who has played this time is registered as a player regardless of whether or not it matches the target customer group for marketing. Then, for a player that is not registered as a player (NO in step S482), a predetermined player registration process is performed and a new player is registered (step S484).

  Next, the processing unit 200 updates the player registration data 530 of each player to reflect the current game play result (step S486), and proceeds to step S2.

[effect]
As described above, according to the present embodiment, the following effects can be obtained regarding the control of the attraction mode. That is, a person in front of the apparatus including the play position can be photographed by the image sensor module 1326, the face feature value of the person can be obtained, and the customer base of the person can be determined from the face feature value. And since the control of the attraction mode which raised the appeal degree for the customer layer of the person who is ahead of the arcade game apparatus 1300 can be realized, the effect of attracting customers can be enhanced as compared with the prior art.

  More specifically, since the tendency of the customer base for each date and time condition in the environment where the arcade game apparatus 1300 is set can be grasped and changed to the contents for the main customer base, the effect of attracting customers can be enhanced.

  In addition, when a person close to the arcade game device 1300 is detected, it is possible to realize the effect contents for the close person (proximity person), so that the effect of attracting customers can be further enhanced. In addition, when there are a plurality of neighbors, each customer segment is determined from the facial feature values of the neighbors, a priority customer segment person is selected based on a predetermined customer segment priority order, and the priority customer segment person's interest is easily attracted. The contents of the production can be changed to achieve a more effective appeal.

  Further, it is possible to recognize whether or not the person is a registered player from the facial feature value, and if the player is a registered player, the content of the presentation can be easily attracted by the person based on the personal information.

  In addition, the facial expression of each person within the range photographed by the image sensor module 1326 can be recognized, and the person who shows a favorable reaction by seeing the effect in the attraction mode can be detected from the change. Then, when a person who has made a positive response can be detected, other appeals related to the current content can be executed in succession, thereby further appealing to the person who has made a positive reaction.

Regarding the play mode control, the following effects can be obtained.
That is, the player in the play position can be photographed, the facial expression of the player can be recognized, and the game progress and / or game effect can be controlled according to the recognition result. Reflecting the recognition result of the facial expression of the player in the progress of the game and the control of the performance, it is possible to add an interesting new game.

  More specifically, it is possible to use the “face expression theme” rule to control what kind of facial expression the player is making at the timing when the climax part of the play piece is being played. Such fun was not found in conventional games.

  Furthermore, in relation to the success / failure determination of the “Facial Expression Theme”, the facial expressions of players recognized at different timings before and during rust are compared, and how the facial expressions change. By performing the determination process according to the game, change control of the game effect using the change of the facial expression can be performed. Of course, the form of using the facial expression change is not limited to the “facial expression theme”. For example, in a role playing game or an action game, the facial expression before the start of a specific event and during or after the event ends. It is also possible to adopt a form that utilizes the change of the above.

  Further, according to the present embodiment, it is possible to control the game effect according to the type of facial expression that satisfies the appearance frequency condition. Therefore, it is possible to use such as selecting an effect according to the main facial expression of the player through game play (the player's emotions with respect to the game often appear). Depending on the setting of the content to be selected at that time, it may be possible to soften an unpleasant player.

  Further, since the number of persons other than the player, that is, the number of so-called galleries can be determined and the game effect can be changed according to the number of galleries, the game can be further increased.

The following effects can be obtained with respect to marketing information collection.
That is, the state of the player is photographed, the customer segment of the player is determined from the photographed image, the facial expression of the player is recognized, and the determination result of the customer segment and the recognition result of the facial expression are stored internally as sample survey data or a server It can be sent to the system and stored externally. By appropriately analyzing the accumulated sample survey data, various marketing surveys such as determination of customer satisfaction with respect to games for each customer segment can be performed.

In addition, it is possible to selectively sample the facial expression recognition result of the player corresponding to the customer group to be targeted for marketing research, and the accumulated facial expressions are at least before the game starts, during the game, and at the end of the game. Since the facial expression of the player at any two timings is included, it is possible to perform sampling suitable for a game satisfaction survey.
However, in the case of multi-play, it is possible to adopt a configuration in which players are handled as a survey target instead of separately, and in that case, survey data in a single play and survey data in a multi-play can be obtained.

[Modification]
As described above, the embodiment to which the present invention is applied has been described. However, the applicable embodiment of the present invention is not limited to the above-described embodiment, and additions, omissions, and modifications of components can be appropriately made. .

For example, in the above-described embodiment, an example in which the present invention is realized by the arcade game apparatus 1300 that functions stand-alone is illustrated, but the present invention is not limited thereto.
For example, as shown in FIG. 30, the present invention is realized as a game system 1390 in which a plurality of arcade game apparatuses 1300 (1300a, 1300b,..., 1300n) are connected to a server system 1100 via a communication line 1. It is good also as composition to do. In this case, each of the arcade game devices 1300 is caused to execute dedicated client software instead of the game program 502, and the arcade game device 1300 is caused to generate a game screen. On the other hand, the player registration data 530 and the sample survey data 580 are managed by the server system 1100, and the server system 1100 is appropriately used for processing that requires registration player detection, player personal information acquisition, and sample survey data 580 update. It is good also as a structure which accesses data and communicates required information.

  In the configuration of the game system 1390, the function of the facial expression recognition unit 204 may be realized by using the server system 1100 rather than by mounting a dedicated chip for each arcade game device 1300. For example, the arcade game device 1300 does not include the face authentication chip 1356, but transmits the device front image and the player image captured by the image sensor module 1326 to the server system 1100, and the face recognition chip mounted on the server system 1100 It may be configured such that a face feature value is calculated or a facial expression is recognized by a face recognition program, and the results are received from the server system 1100 and used.

  Further, the form of the game device itself is not limited to the business game device 1300 for business purposes. For example, it may be realized as a stationary home game device or a portable game device. Furthermore, not only electronic devices (computers) that are regarded as “game devices”, but also electronic devices such as mobile phones (smartphones) that can execute application software, information terminal devices, compact digital cameras, music players, personal computers, and car navigation systems. Since a computer that can execute the program is built in or can be said to be a computer itself, a game device can be obtained.

  Moreover, although the example which performs a music game was shown in the said embodiment, not only a music game but a game genre may be other genres, such as a shooting game, a fighting game, and an action game. Furthermore, the present invention is not limited to video games, and can be used for other games such as medal games and pachinko games.

DESCRIPTION OF SYMBOLS 2 ... Player 4 ... Gallery 40 ... Timing guide 47 ... Effect display part 100 ... Operation input part 102 ... Image pick-up part 104 ... IC card reading part 106 ... Consideration payment detection part 108 ... Distance measurement part 200 ... Processing part 202 ... Game control part 204 ... Facial expression recognition unit 205 ... Player / gallery identification unit 206 ... Customer segment determination unit 208 ... Registered player detection unit 210 ... Attraction mode control unit 211 ... Customer segment database creation unit 212 ... Date condition criteria control unit 213 ... Priority customer segment person selection Reference numeral 214: Registered player priority control unit 215: Control according to customer group combination 216 ... Preferable reaction person detection unit 217 ... Preferable reaction person detection control unit 220: Play mode control unit 221: Gallery number reference control unit 222 ... Appearance expression reference control Part 224 ... Facial expression theme control part 226 ... Designated facial expression Indication control unit 228 ... Designated facial expression suitability criterion control unit 230 ... Specific timing facial expression reference control unit 232 ... Facial expression change reference control unit 234 ... Premiums payout lottery unit 246 ... Investigation target determination unit 248 ... Investigation data storage control unit 249 ... Player registration management unit 400... Prize giving unit 500... Storage unit 501. System program 502... Game program 510 .. customer segment setting data 512 .. attraction mode data 514 ... customer segment-specific pattern set 515 ... customer segment combination-specific pattern set 516. 518 ... Registered player priority pattern set set 520 ... Music library 526 ... Sub-library by customer segment 528 ... Sub library by facial expression 530 ... Player registration data 532 ... Player ID
533 ... Age-sex information 534 ... Face feature value for personal authentication 536 ... Play history data 538 ... Preference analysis data 544 ... Theme setting data 546 ... Play mode effect content setting data 547 ... Standard effect data 548 ... Special effect setting data library 549 ... Special production data for multiple galleries 550 ... Attraction mode control data 551 ... Customer demographic database 552 ... Customer demographic data by date and time conditions 553 ... Optimization subject identification data 554 ... Optimization subject facial expression 560 ... Play data 561 ... Recommended Song list 565 ... Application effect ID
566 ... Awayee collation data 570 ... Player-specific data 572 ... Score 573 ... Designated facial expression point 574 ... Designated facial expression type 575 ... Player customer recognition 576 ... Facial expression recognition history data 577 ... Facial expression recognition time series data 578 ... Facial expression Statistical data 580 ... Sample survey data 1300 ... Commercial game device 1301 ... Game device main body 1304 ... Operation table 1306 ... Operation input device 1322 ... Video monitor 1326 ... Image sensor module 1328 ... Distance sensor 1342 ... Gift dispensing device 1350 ... Control unit 1351 ... CPU
1352 ... IC memory 1353 ... Communication device 1356 ... Face recognition chip

Claims (9)

A shooting unit arranged with the shooting direction facing the front of the apparatus so that at least a person in the play position is included in the shooting range;
A recognizing unit for recognizing a person image included in a photographed image photographed by the photographing unit;
A customer segment determination unit that determines a customer segment including at least the sex and age group of the person shown in the captured image using the recognition result of the recognition unit;
Using the determination result by the customer layer determination unit, an attraction mode control unit that controls the effect content of the attraction mode,
A game system with The recognizing unit includes a facial expression recognizing unit for recognizing a facial expression of a person shown in the captured image;
Based on the recognition result of the facial expression recognition unit, it detects that a person interested in the game system appears in the photographed image (a favorable reaction person detection unit that performs)
An attraction mode data storage unit that stores data relating to the contents of the effect in the attraction mode in association with the classification information of the contents of the effect;
With
The attraction mode control unit, when there is a detection by the likable reaction person detection unit, the data related to the content of the attraction that the classification information is currently being executed and the content of the effect satisfying a predetermined relation condition. Select from the storage unit, having a favorable reaction person detection time control means for switching the production contents at a given timing,
The game system according to claim 1. The recognizing unit recognizes a person image of each of the plurality of persons when a plurality of persons are reflected in the captured image;
The customer segment determination unit determines each customer segment in the photographed image using the recognition result of the recognition unit,
The attraction mode control unit determines the contents of the attraction mode from the person based on the customer layer of each person in the captured image determined by the customer group determination unit and a predetermined customer group priority order. Having a priority customer layer person selecting means for selecting a person as a reference;
The game system according to claim 1 or 2. The recognizing unit recognizes a person image of each of the plurality of persons when a plurality of persons are reflected in the captured image;
The customer segment determination unit determines each customer segment in the photographed image using the recognition result of the recognition unit,
The attraction mode control unit has a customer group combination-specific control means for controlling the effect content of the attraction mode using the combination of customer groups determined by the customer group determination unit.
The game system according to claim 1 or 2. Based on the recognition result of the recognizing unit, the registered player refers to the stored data of the registered player data storage unit that stores, for each registered player, feature data that can be authenticated based on the recognition result of the recognizing unit. A registered player detection unit that detects that the image is captured;
The attraction mode control unit refers to the stored data of the registered player information storage unit that stores the personal information for each registered player when the registration player detection unit detects the attraction of the detected registered player. Having registered player priority control means for switching the contents of the attraction mode based on the personal information;
The game system as described in any one of Claims 1-4. A person location detecting unit for detecting that a person is in the play position;
The registered player detection unit determines whether or not the registered player is included in the photographed image when the person location detection unit detects.
The game system according to claim 5. Using the determination result by the customer segment determination unit, comprising a customer segment database creation unit for creating a customer segment database by day of the week and / or by time of day,
The attraction mode control unit has a date / time reference control means for controlling the contents of the attraction mode with reference to the customer base database.
The game system as described in any one of Claims 1-6. A computer system that includes a photographing unit arranged so that a photographing direction is directed to the front of the apparatus so that at least a person in a play position is included in a photographing range, and configured to execute a predetermined game,
A recognizing unit for recognizing a human image included in a photographed image photographed by the photographing unit;
A customer segment determination unit that determines a customer segment including at least the gender and age group of the person shown in the captured image using the recognition result of the recognition unit;
An attraction mode control unit that controls the content of the attraction mode using the determination result by the customer layer determination unit,
Program to function as.   A computer-readable information storage medium storing the program according to claim 8.

Images