JP2016123517A - Program and computer system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a new technology to utilize a monitor for displaying a game screen as illumination.SOLUTION: When a still image is to be taken, a residual time 32 until an image taking timing is displayed on an image taking preparation screen W10 of a display 1306 while a real time player image 34 taken with a color camera part is displayed for a background image 33 so that a player can visually recognize his or her pose. When an image is taken, a real time silhouette 35 is displayed in place of the real time player image, and while the visual recognition of the pose is maintained, a change range 36 for a light source other than the silhouette of a display region of the display is display-changed to high brightness (e.g., white color) for illumination.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a program for causing a computer system including a photographing unit and a display unit to control display of a game image using an image of a subject.

  2. Description of the Related Art Conventionally, some video game apparatuses for business use have a shooting function of a player and make an image shot by the player appear in the game. For example, in Patent Document 1, a monitor for displaying a game screen is displayed in white at the moment of shooting so that an image with a good S / N ratio can be taken even if the lighting environment of a store or the like where the game apparatus is installed is not appropriate. Technology for use as lighting is disclosed.

JP 11-149111 A

  In recent years, not only the player's face but also the upper body and whole body images have come to be used with technological progress. At the same time, the technology of “ranging device” that can record not only a color image but also the distance to the subject as an image has been developed, and the “distance image” that can be photographed using it is also used as input information by the player. Has come to be able to. For example, a technique has been realized in which the movement of the player's skeleton is discriminated based on the distance image and used as a motion capture.

Then, when the operation of the whole body of the player or a part of the player (such as the upper body) is used for the game, the technique as described in Patent Document 1 causes several problems.
For example, in Patent Document 1, since the monitor is displayed in white at the moment of shooting, the player cannot recognize his / her pose.

In addition, the illuminance of the ambient light at the place where the game device is set is not always constant, and may be insufficient, or excessively illuminating if the monitor is uniformly displayed in white.
In addition, ambient light and white display are not always suitable colors for illumination, and there are cases in which color cast occurs in a captured image.

  Also, the amount of illumination around the game device (hereinafter referred to as “in-environment illumination light”) and the positional relationship between the illumination direction of the in-environment illumination light and the player are not necessarily appropriate for illumination. For this reason, there may be a case where the environment illumination light hits only from one of the faces and the shadow of the face appears dark, or conversely, the environment illumination light hits directly from the front and the shadow disappears.

  Such a problem can be solved by providing a private room that shields the outside environment with a shielding curtain or the like, such as a photo booth device, and photographing the player in the private room with a dedicated lighting device. However, one of the features of an arcade game apparatus having a function of photographing a player and a function of displaying a photographed player image is that the state of game play can be visually recognized together with the photographed player image. Many.

  The present invention has been devised for the purpose of providing a new technique for effectively utilizing a recently developed technique such as the distance measuring apparatus described above and utilizing a monitor for displaying a game screen as illumination.

A first invention for solving the above-described problem is a computer system including a photographing unit (for example, the color camera unit 1310 in FIG. 1) and a display unit (for example, the display 1306 with a touch panel in FIG. 1).
Subject range determining means for determining a subject range among images being captured by the capturing unit (for example, the processing unit 200, the subject range determining unit 204 in FIG. 9, step S4 in FIG. 11),
Display control means for controlling display of a game image using the image of the subject range on the display unit (for example, the processing unit 200 in FIG. 9, the game image display control unit 210, and step S22 in FIG. 11);
Timing notification means (for example, the processing unit 200 in FIG. 9, the timing notification control unit 220, step S80 in FIG. 12, step S48 in FIG. 13) for notifying the timing for acquiring a still image,
In accordance with the timing, the display image of the display unit is changed to display a part or all of the display image other than the subject range (hereinafter collectively referred to as “light source change range”) as a light source, and is stationary. This is a program for functioning as a still image acquisition control means (for example, the processing unit 200 in FIG. 9, the still image acquisition control unit 230, or step S84 in FIGS. 12 to 13) for acquiring an image.

  According to the first aspect of the invention, the player can visually recognize his / her pose immediately before and at the moment of shooting while using the light source change range as the light source at the moment of shooting. The player can adjust the pose to the end, and shooting that is more satisfying for the player is possible.

  In the second invention, the still image acquisition control means sets the display color of the light source change range using the color information of the subject range (for example, step S58 in FIG. 12). It is a program.

  According to the second invention, the display color is adjusted with reference to color information (for example, RGB value, hue, saturation, etc.) of the subject range, and the environment of the place where the computer system is installed is further adjusted. Even if the light is not a color suitable for illumination, the quality of the captured image can be improved.

According to a third aspect of the invention, the subject range determination unit identifies a predetermined portion of the subject range using data measured by a distance measurement unit that measures a distance to the subject.
The still image acquisition control means is the program according to the first aspect of the invention, wherein the display color of the light source change range is set using color information in the predetermined portion of the subject range.

  According to a fourth aspect of the invention, the subject range determination unit recognizes a face portion of the subject from the image portion of the subject range in the captured image, and the still image acquisition control unit includes the subject range determination unit of the subject range. The program according to the first aspect of the invention sets a display color of the light source change range using color information of the face portion.

  According to the third or fourth invention, it is possible to identify the portion of the subject and set the display color of the light source change range based on the color information of the portion. That is, it is possible to correct the influence of the color temperature of the ambient light and improve the appearance of the subject.

  In a fifth invention, the still image acquisition control means sets the display color by dividing the light source change range into a plurality of regions (for example, step S56 in FIG. 12), and any one of the second to fourth inventions It is a program.

  According to the fifth aspect, the light source change range can be divided into a plurality of regions, and the display color can be adjusted respectively. That is, the light source position can be optimized. As a result, for example, the environment illumination light hits only one of the player's faces and the shadow of the face is too dark, or conversely the environment illumination light hits from the front and the shadow disappears. You can prevent the situation of being reflected.

  In a sixth aspect of the present invention, the display control unit changes the size of the image of the subject range so that the size of the change range for the light source satisfies a predetermined condition at least for a given time including the timing. The program according to any one of the first to fifth aspects of the invention controls the display of the display unit (for example, step S66 in FIG. 12 and step S70 in FIG. 13).

  According to the sixth aspect of the present invention, it is possible to secure an area to emit light as a light source while allowing the player to visually recognize his / her pose immediately before and immediately after shooting.

  In a seventh aspect of the invention, the display section has a plurality of display screens, and the still image acquisition control means is a display screen on which no image of the subject range is displayed among the plurality of display screens, or The display screen in which the proportion of the image of the subject range is relatively small is set as the light source change range (for example, display change of the right front panel 1306R and the left front panel 1306L in FIG. 16), and any one of the first to fifth It is a program of the invention.

  According to the seventh aspect, the game image can be kept displayed even at the moment of shooting. For example, even when shooting during game play, the game screen is displayed without any interruption. Therefore, it is particularly effective for a game such as an action game, a shooting game, or a race game in which a slight delay in operation input affects the play result.

  According to an eighth aspect of the present invention, a shooting unit, a display unit, subject range determination means for determining a subject range among images being shot by the shooting unit, and a game image using the image of the subject range are displayed on the display unit. Display control means for controlling display, timing notification means for notifying the timing for acquiring a still image, and part or all of the display image of the display unit other than the subject range (hereinafter comprehensively) in accordance with the timing. The computer system includes a still image acquisition control unit that changes a display of “change range for light source” to use as a light source and acquires a still image.

  According to the eighth aspect, the same effect as in the first aspect can be obtained.

The figure which shows an example of a structure of a game system. The figure for demonstrating the example of gesture input. The figure which shows the example of a game screen. The figure which shows the example of a synthesis | combination of the player and player character which appear on a game screen. The figure for demonstrating the still image photography other than during the game play. The figure for demonstrating the still image photography in game play. The figure for demonstrating the division | segmentation and display control of the change range for light sources. The figure which shows the example of a change of the display size of a real-time player image and a real-time silhouette. The functional block diagram which shows the function structural example of a game device for business use. The figure which shows the example of the program and data which a memory | storage part memorize | stores. The flowchart for demonstrating the flow of a process by the arcade game device. The flowchart for demonstrating the flow of a 1st still image imaging | photography process. The flowchart for demonstrating the flow of a 2nd still image imaging process. The figure which shows the modification of the computer system to which invention is applied. The figure which shows the modification of a display of the change range for light sources. The figure which shows the modification of a display of the change range for light sources.

[First Embodiment]
FIG. 1 is a diagram illustrating an example of a configuration of a game system in the present embodiment.
The game system according to the present embodiment includes an arcade game device 1300 and a server system 1100 that receives and stores data such as captured images from the arcade game device 1300 via the communication line 9 so as to be distributable. Including.
The communication line 9 means a communication path capable of data communication. That is, the communication line 9 includes a communication network such as a telephone communication network, a cable network, and the Internet in addition to a dedicated line (dedicated cable) for direct connection and a LAN (Local Area Network) using Ethernet (registered trademark). This means that the communication method may be wired or wireless.

  The server system 1100 is a computer system that includes one or more server devices, storage devices, and the like. For example, a main device 1101, a keyboard 1106, a display 1108, and a storage 1140 are provided. A control board 1150 is mounted on the main body device 1101. The control board 1150 includes a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), various microprocessors such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), various ICs such as a VRAM, a RAM, and a ROM. A memory 1152 and a communication device 1153 are installed.

  In the example of FIG. 1, the server system 1100 is described as a single unit, but the server system 1100 may have a configuration in which a plurality of blade servers are mounted and connected to each other via an internal bus so that data communication is possible. . Alternatively, the server system 1100 may be configured to function as a whole by performing data communication with a plurality of independent servers installed at remote locations via the communication line 9.

  The arcade game device 1300 includes a case 1301, a play consideration payment device 1302, a display 1306 with a touch panel, a speaker 1308, a color camera unit 1310, a distance measuring device 1320, a non-contact reading device 1330, and a printing device. The computer system includes 1332 and a control board 1350. Of course, other components such as a power supply unit (not shown) are included as appropriate.

  The play consideration payment apparatus 1302 is an apparatus that can insert payment media such as cash as play consideration and medals used in a store. A predetermined detection signal can be output to the control board 1350 every time the input cash or payment medium is detected.

  A display 1306 with a touch panel displays various operation guidance and game screen images to the player 2. In this example, the member denoted by reference numeral 1306 is a display with a touch panel, and is a device that also serves as an operation reception for receiving various operation inputs by a touch operation. Various screens are displayed based on the image signal received from the control board 1350, and touch position coordinate data can be output to the control board 1350 when a touch operation is detected. Of course, the display portion may not have a touch panel, and input may be performed by various buttons or other methods, or all input may be performed by gesture input.

  The color camera unit 1310 is a photographing unit that photographs the player 2 at a predetermined play position in front of the apparatus. For example, the color camera unit 1310 includes an optical system component such as a lens and a filter, a color image sensor, and an image captured by the sensor. An image processing IC for generating and outputting image data. The color camera unit 1310 can output captured still image data and moving image data to the control board 1350.

  The distance measuring device 1320 is a device that measures the distance to an object existing in front of the device. For example, in the present embodiment, a device that measures distance using infrared reflection is used. Therefore, the distance measuring device 1320 is set within the photographing range by analyzing the infrared image and the infrared camera 1324 for photographing the infrared ray reflected on the object, the infrared ray irradiating device 1322 that radiates infrared rays toward the front of the device. A distance measurement controller IC 1326 that outputs distance measurement result data for each of the plurality of measurement points to the control board 1350; Of course, the distance measuring method employed is not limited to the infrared method, but may be a method in which images taken by a plurality of cameras are analyzed to match pixel positions, and the distance is calculated based on the result based on the triangulation method. Moreover, as a method using infrared rays, a pattern light projection method (a method of calculating a distance from a distortion of pattern light when projecting pattern light such as a mesh and photographing it with an infrared camera at a slightly shifted position) , Time of Flight method (a method of detecting a time difference from emission to acquisition by an infrared camera for each emission infrared ray and obtaining a distance to a target point based on the time difference). The ranging controller IC 1326 can be omitted in the configuration in which the control board 1350 assumes the function.

  The non-contact reading device 1330 is a wearable computer such as an information carrying medium such as an IC memory card 91 possessed by the player 2 or a portable electronic device (for example, a mobile phone, a smart phone, a tablet computer, a wristwatch type or the like incorporating a short-range wireless device). , A portable game device) and the like. Data read from the IC memory card 91 or the like (for example, player ID, play history, prepaid point, e-mail address, online storage URL, access password, etc.) is output to the control board 1350, and conversely from the control board 1350. Data can be written based on the write instruction signal.

  A digital image controlled by the printing device 1332 and the control board 1350 and generated by the control board 1350 can be printed on the printing medium 92 and output. This can be realized by a printer device.

The control board 1350 includes various microprocessors such as a CPU 1351, a GPU, and a DSP, an IC memory 1352, a communication module 1353 for connecting to the communication line 9, and a driver circuit 1354 for a display 1306 with a touch panel. In addition, an interface IC 1355 for controlling signal input / output with the color camera unit 1310, the distance measuring device 1320, the non-contact reading device 1330, the printing device 1332, and the like is mounted. Of course, other electronic and electrical elements can be mounted as appropriate. Each element mounted on the control board 1350 is electrically connected via a bus circuit or the like so that data can be read and written and signals can be transmitted and received.
The control board 1350 performs integrated processing on the arcade game device 1300 by performing arithmetic processing according to a program stored in the IC memory 1352. Note that part or all of the control board 1350 may be realized by an ASIC or FPGA.

  In the example of FIG. 1, each element constituting the arcade game device 1300 is integrally provided in the housing 1301, but it may be arranged and configured as a separate unit connected by a communication cable or near field radio. Good. Even if each element is separate, it remains a computer system as a whole.

[Description of game contents]
Next, a game executed on the arcade game apparatus 1300 of this embodiment will be described.
The video game executed on the arcade game apparatus 1300 includes a touch operation input to the display 1306 with a touch panel and an input based on an analysis result of the gesture and pose of the player 2 based on a distance measurement result by the distance measurement apparatus 1320 (hereinafter referred to as “gesture”). Play).

A known technique can be appropriately used for the gesture input.
For example, as shown in FIG. 2, the distance measurement result W2 (or the image captured by the color camera unit 1310) by the distance measuring device 1320 is analyzed by the control board 1350 to separate and identify the human body and the background, and the player 2 That is, the player image 3 is separated and identified (FIG. 2 (1)). The identified player image 3 is checked against the silhouette database of the human body, and a silhouette pattern 5 that matches the current posture of the player 2 is selected. Then, the bone model pattern 4 corresponding to the silhouette pattern is determined with reference to the bone model database. Here, the determined bone model pattern 4 is applied to the 3DCG model of the player character 6 arranged in the game space which is a virtual three-dimensional space. As a result, the player character 6 in the game image is controlled to imitate the posture of the player 2.

FIG. 3 is a diagram showing an example of a game screen in the present embodiment.
FIG. 4 is a diagram illustrating a composition example of the player 2 and the player character 6 appearing on the game screen in the present embodiment.

The game according to the present embodiment is an action game in which the player 2 becomes a player character, and the enemy characters 8 gathered are defeated with a weapon (for example, a sword).
As shown in the game screen example W4 in FIG. 3, at the beginning of the game, a part of the player image 3 image-recognized and cut out from the image captured by the color camera unit 1310 becomes a part of the player character 6. The replaced character composite image 7 is displayed. This corresponds to the state shown in FIG.

  More specifically, in the character composite image 7 in the state of FIG. 4A, some parts of the player character 6 (in the example shown, parts of the arm 6a and the trunk 6b) are combined on the player image 3. Displayed. As described above, the player character 6 is arranged in the game space and is controlled so as to imitate the posture of the player 2, so the parts synthesized on the player image 3 are matched with the current posture of the player image 3. It is displayed where it should be. That is, the parts of the arm 6a are always combined with the position of the arm of the player image 3, and the parts of the body 6b are always combined with the position of the body of the player image 3. As a result, the game screen is displayed as if the player 2 was fighting in a state before completely transforming.

  When the game progresses and the predetermined transformation condition is satisfied, the head 6h and the leg 6L of the player character 6 are added to the composition target as shown in FIG. As a result, the whole body of the player image 3 is covered with the parts of the player character 6, and the replacement is completed. Accordingly, it is as if only the player character 6 is acting in the game screen. It can be said that the game screen is displayed as if the player 2 has completely transformed and is fighting.

  The initial state of the character composite image 7 has been described with reference to FIG. 4A. However, the original state (the player image 3) that has not been replaced with the parts of the player character 6 may be the initial state.

[Explanation about still image shooting]
Next, the still image shooting function in the arcade game apparatus 1300 of this embodiment will be described.
In the game of this embodiment, as one of the services, the player 2 takes a still image in color at a shooting timing during play or after the end of play. Then, the photographed still image or the provided image synthesized using the still image as a material is printed on the printing medium 92 (for example, a sticker) by the printing device 1332 or the IC of the player 2 via the non-contact reading device 1330. Image data can be written to the memory card 91 or a portable computer. Further, it can be transmitted to a mail address designated by the player 2 or uploaded to a designated online storage via the server system 1100.

  Then, the arcade game device 1300 according to the present embodiment uses a display 1306 with a touch panel for displaying a game screen as illumination for illuminating the player 2 for shooting. Since the function used as lighting is a function on the display side rather than the touch panel side, reference numeral 1306 is simply referred to as “display” below.

In the still image shooting, the player 2 can freely change the pose and desire for shooting.
There are two types of still image shooting: shooting during game play and shooting during game play.
FIG. 5 is a diagram for explaining still image shooting other than during game play, and is an example of commemorative shooting immediately after game play. The display 1306 displays a shooting preparation screen W10 for guiding commemorative shooting. For example, a real-time player image 34 of the player 2 is synthesized and displayed together with a commemorative shooting title 30, shooting guidance text 31, a remaining time 32 for displaying a countdown until shooting timing, a background image 33, and the like.

  As the real-time player image 34, the player image 3 (or its silhouette or outline) is displayed in real time. In other words, the player 2 can adjust his / her favorite pose until the last time the shooting is performed with reference to the real-time player image 34 on the shooting preparation screen W10.

  Then, when a predetermined time before the shooting timing (for example, 0.5 seconds before), the arcade game device 1300 replaces the real-time player image 34 with a real-time silhouette 35 that is a silhouette (see the post-display change screen W12) ( Alternatively, a part or all of the display screen of the display 1306 other than the real-time player image 34 (subject range) is temporarily changed so as to be painted in white or substantially white. This range in which the display is changed is referred to as a “light source change range”. The light source change range 36 emits light and functions as illumination. At the shooting timing, the arcade game apparatus 1300 shoots a still image with the color camera unit 1310 using the light source change range 36 as illumination. After the shooting timing has elapsed, the original screen is restored.

FIG. 6 is a diagram for describing still image shooting during game play.
As shown in the game screen example W16, a game image using the character composite image 7 is displayed on the display 1306 during game play. When a predetermined time before the shooting timing (for example, 0.5 seconds before), the arcade game apparatus 1300 performs a given effect display 38 in the light source change range 36 to notify the shooting timing.

  The example of FIG. 6 shows an effect display 38 in which the enemy character 8 gradually shines and finally shines bright enough to be used as illumination. In this example, the effect display 38 is gradually brightened and enlarged, and the light source change range 36 functions as illumination as in the game screen example W18. Then, the arcade game apparatus 1300 captures a still image with the color camera unit 1310.

  As shown in FIGS. 5 and 6, the arcade game apparatus 1300 is an illumination apparatus for pose monitor and photographing that allows the player 1 to check the pose of the player 2 in real time until the moment when the player 2 shoots a still image. As a temporary combination. For this reason, it becomes possible for the player 2 to take a still image with a satisfactory pose even under ambient light conditions where the amount of light is insufficient.

  It should be noted that the contents of the effect display 38 can be set so as not to cause a sudden or uncomfortable feeling as much as possible according to the game contents, the intention of the effect, the setting of the shooting timing, and the like. For example, an expression of explosion, flame, or sunlight reflection may be used with a higher brightness than usual. Other examples include, for example, a cut-in display (for example, insertion of a short-time scene (cut), from the edge of the screen, etc.) It can also be realized by the appearance of a strip-shaped display body that pops out and retracts.

  Now, in order to make the display 1306 function as an illuminating device, some ideas are made in this embodiment.

  The first contrivance is that the arcade game device 1300 adjusts the display color of the light source change range 36 so as to correct the color tone of the still image to be shot. Specifically, the color information of the skin portion of the player image 3 captured by the color camera unit 1310, that is, the skin color, is extracted using a known face recognition algorithm. Then, the skin color is compared with a predetermined RGB balance range (for example, an RGB balance range that realizes a skin color reminiscent of health).

As a result of the comparison, if the skin color of the player image 3 is within the color range, the light source change range 36 has a uniform RGB balance, and the brightness of the skin color portion photographed by the color camera unit 1310 is within a predetermined reference range. It is determined by feedback control so that it falls within the range.
If the color information of the skin portion of the player image 3 is out of the RGB balance range, the RGB balance is adjusted to include a color component that corrects the skin tone of the player image 3 to be within the color range. It is almost white. For example, when the lighting in the game center is biased to a cold color system, the face color of the player 2 appears bluish-white, so the RGB balance is changed so that a warm color component is added, and the luminance is the skin color part of the player image 3. It is determined by feedback control so that the lightness falls within a predetermined reference range.

Secondly, the arcade game device 1300 divides the light source change range 36 into a plurality of areas and sets the display color to adjust the player 2 according to how the ambient illumination light hits the player 2. is there.
More specifically, a face part of the player image 3 is extracted using a known face recognition algorithm, and a skin color area is extracted from the face part. Then, the extracted skin color area is divided into a plurality of areas (for example, up and down, left and right, left and right, up and down, etc.), and the brightness difference between the areas is calculated. And the display color with respect to each area | region is adjusted so that a brightness difference may be settled in a predetermined brightness difference appropriate range.

  More specifically, for example, as shown in FIG. 7 (1), when there is a brightness difference exceeding the upper limit value of the brightness difference appropriate range on the left and right sides of the face 40 of the player 2 so that it can be regarded as excessive contrast, As shown in FIG. 7 (2), when the brightness difference is less than the lower limit value of the appropriate brightness difference range so that the contrast can be regarded as insufficient on the left and right, the light source change range 36 is divided into left and right areas. Then, one of the left and right sides of the area is displayed in white or substantially white, and the other is displayed in gray (or black).

  In the example of FIG. 7 (1), the left side of the face 40 is excessively shadowed toward the player 2, so that the left area of the display 1306 is white or substantially white as shown in FIG. 7 (3). The right area is displayed in gray or black. That is, the light source position can be adjusted so that the light is applied to the shadow side of the face 40 of the player 2 and the shadow density of the subject can be corrected appropriately. In the example of FIG. 7 (2), the light source position is adjusted, so that an appropriate shade is added, and the face 40 of the player 2 can be captured in a three-dimensional manner and still images can be taken.

  In the case of a single panel type in which only one display 1306 is mounted on the arcade game device 1300, a configuration in which the display range of the panel is divided into left and right as shown in FIG. The division of the left and right areas is set so that the illuminance can be obtained as much as possible. In other words, the area displayed in white or substantially white is set to be equal to or larger than the reference value. If the arcade game device 1300 is equipped with a plurality of displays 1306, the relative position and range for displaying the display area for the plurality of units as one as shown in FIG. Can be adjusted. Alternatively, it is only necessary to adjust whether the right front panel 1306R and the left front panel 1306L are displayed in white or substantially white, gray or black.

  If the contrast is excessive or insufficient above and below the face 40, the light source change range 36 may be formed by dividing the image display range into upper and lower regions. Further, the number of light source changing ranges 36 and the relative positional relationship are not limited to three examples as shown in FIG. Two or four or more may be used. The plurality of displays 1306 may be arranged not only on the left and right but also on the top and bottom or in a matrix.

Thirdly, the arcade game device 1300 adjusts the shadow density of the subject appropriately, and then secures the position and area of the light source change range 36 by using the real-time player image 34 and the real-time silhouette 35. It is to adjust the display size.
Specifically, when the display 1306 is caused to function as a lighting device, the real-time player image 34 remains displayed. That is, this portion cannot be used as the light source change range 36. Therefore, if the area of the light source change range 36 does not reach a predetermined reference value, the display size of the real-time player image 34 or the real-time silhouette 35 is reduced until the area of the light source change range 36 reaches a predetermined reference value. To display.

For example, as shown in FIG. 8, in the case of shooting a still image other than during the game play, the display size of the title 30 and the background image 33 is set to the real-time player image 34 so as not to destroy the final image of the commemorative shooting. Or the same size as the real-time silhouette 35 (shooting preparation screen W20, display-changed screen W22).
If a still image is shot during game play, the position and shooting angle of the virtual camera that shoots the game space so that the character composite image 7 is reduced and displayed as much as the real-time player image 34 and the real-time silhouette 35. The parameters may be changed temporarily.

  When a plurality of players and player characters appear in one screen or when the players are large, the ratio of the real-time player image 34 and the real-time silhouette 35 to the screen increases, and the light source change range 36 area can be reduced anyway. Such a display size adjustment is effective because it is difficult to ensure.

[Description of functional configuration]
Next, a functional configuration example for realizing the present embodiment will be described.
FIG. 9 is a functional block diagram showing a functional configuration example of the arcade game apparatus 1300 in the present embodiment.
The arcade game device 1300 according to the present embodiment includes an operation input unit 100, a photographing unit 102, a distance measuring unit 104, a play consideration payment unit 106, a non-contact reading unit 108, a processing unit 200, and a sound output unit. 390, an image display unit 392, a communication unit 394, a printing unit 396, and a storage unit 500.

  The operation input unit 100 is a means for inputting various operations. In the example of FIG. 1, a display 1306 with a touch panel corresponds.

  The photographing unit 102 photographs the player 2 (the subject in the present embodiment), and outputs captured image data to the processing unit 200. In the example of FIG. 1, the color camera unit 1310 corresponds.

  The distance measuring unit 104 measures the distance to the object in front of the apparatus and outputs the distance measurement result data to the processing unit 200. In the example of FIG. 1, the distance measuring device 1320 corresponds to this.

  The play consideration payment unit 106 outputs a predetermined payment completion signal to the processing unit 200 when receiving the payment of the play consideration. For example, it is realized by a known payment device (coin insertion machine, cash payment machine, prepaid card reader, cash card reader, etc.). When supporting payment by a cash card, hardware resources for connecting to a predetermined billing server and performing billing processing can be included as appropriate. In the example of FIG. 1, the play consideration payment device 1302 corresponds.

  The non-contact reading unit 108 reads data from and writes data to an information carrier medium such as an IC memory card 91 or a portable computer. In the example of FIG. 1, the non-contact reading device 1330 corresponds. In the case where the remaining number of prepaid points is stored in the IC memory card 91 and the payment for the play is paid with the points, the play price payment unit 106 may also be used.

  The processing unit 200 is realized by electronic components such as a microprocessor such as a CPU and a GPU, an ASIC (Application Specific Integrated Circuit), an FPGA, and an IC memory, and includes each function unit including the operation input unit 100 and the storage unit 500. Data input / output control between Then, various arithmetic processes are executed based on a predetermined program and data, an operation input signal from the operation input unit 100, and the operation of the arcade game apparatus 1300 is integratedly controlled. In the example of FIG. 1, the control board 1350 corresponds.

  Then, the processing unit 200, the game calculation unit 202, the subject range determination unit 204, the game image display control unit 210, the timing notification control unit 220, the still image acquisition control unit 230, the provided image synthesis unit 240, and the provision The image output control unit 242, the sound generation unit 290, the image generation unit 292, the communication control unit 294, and the print control unit 296 are included.

The game calculation unit 202 executes various calculation processes necessary for executing the video game.
For example,
1) Arrange objects in a virtual three-dimensional space to form a game space, and a player character 6 and an enemy character 8 are arranged there.
2) Control the position, posture, angle of view, etc. of the virtual camera in the game space.
3) Appearance control and automatic control of enemy character 8,
4) Gesture input control,
5) Battle damage determination and damage reflection processing,
6) Time elapsed since the game started,
7) A game end determination process can be executed. Of course, depending on the content of the game, other controls and processes can be included as appropriate.

  The subject range determination unit 204 identifies the subject range (the portion in which the player 2 is shown in the present embodiment, the player image 3) from the images photographed by the photographing unit 102 (see FIG. 2). In the present embodiment, the background and the subject can be separately recognized based on the distance measurement result by the distance measurement unit 104. Further, it has a face part recognition unit 206, and can identify a part where a human body is captured by image processing, particularly a face part of the subject, from the image part of the subject range. For identifying the face part, for example, the subject part separated and identified from the distance measurement result by the distance measuring unit 104 is compared with a silhouette database of the human body, and the silhouette model for each moment is determined. Then, the head range in which the head is reflected is identified from the bone model corresponding to the determined silhouette model, and feature shapes such as eyes, mouth, and nose are extracted from the head range in the image captured by the imaging unit 102. Recognition of the face is possible. As described above, since only the head range needs to be face-recognized in the photographed image, it is possible to identify the portion where the face is reflected at high speed and low load.

  The game image display control unit 210 controls the image display unit 392 to display a game image using the image of the subject range determined by the subject range determination unit 204. In the present embodiment, a game screen including the character composite image 7 is displayed (see FIG. 3).

The game image display control unit 210 according to the present embodiment includes a subject display size adjustment unit 212.
When the still image shooting timing is during game play, the subject display size adjustment unit 212 has a size of the light source change range 36 (specifically, at least for a given time including the still image shooting timing). The display of the image display unit 392 is controlled so that the size of the character composite image 7 (image of the subject range) is changed so that the area, the number of display dots, and the like satisfy predetermined conditions. Specifically, the player image 3 is reduced and displayed, and the position of the virtual camera that captures the player character 6 in the game space is moved away from the virtual subject in synchronization with the reduction of the player image 3. Of course, the position of the virtual camera is returned to the original position when the shooting of the still image is completed.

The timing notification control unit 220 determines the timing for acquiring a still image and performs control for notifying the timing for acquiring a still image. In the present embodiment, for example, the remaining time 32 is displayed on the screen (see FIG. 5). The speaker 1308 may be used to notify by voice.
It is assumed that conditions for shooting timing during game play are set in advance. For example, when the player character 6 activates a special technique and the technique is decided, when the enemy boss character is defeated, when the game is decided to be cleared, or when the player is registered before starting the game, the game results satisfy predetermined praise conditions. It is good to set according to the game content. Then, the timing is notified by the effect display 38 (see FIG. 6).

  The still image acquisition control unit 230 executes control related to still image shooting. In the present embodiment, in accordance with the photographing timing, the display of the light source change range 36 is changed to be a light source, and control for acquiring an image photographed by the photographing unit 102 as a still image is performed (see FIG. 5). ).

  In addition, the still image acquisition control unit 230 of the present embodiment includes a light source display color setting unit 232, a range division control unit 234, a silhouette size change unit 236, and a light source effect display control unit 238.

  The light source display color setting unit 232 displays the light source change range by using brightness information and color information (for example, hue information and saturation information) of a portion (subject range) in which the player 2 is captured immediately before shooting. Set the color. Of course, the display color may be set by only one of the brightness information and the color information.

  The range division control unit 234 performs control to divide the light source change range 36 into a plurality of regions and set the respective display colors. In the present embodiment, an area to be displayed in white or substantially white and an area to be displayed in gray can be set according to the shadow density of the face of the player 2 and the difference in contrast between the top, bottom, left and right of the face (see FIG. 7).

  The silhouette size changing unit 236 determines the size of the light source change range 36 (specifically, at least for a given time including the still image shooting timing when the still image shooting timing is before or after game play). Is controlled to change the size of the real-time player image 34 and the real-time silhouette 35 so that the area, the number of display dots, etc.) satisfy predetermined conditions (see FIG. 8). Specifically, the real-time player image 34, the commemorative photo title 30 and the background image 33 are reduced and displayed at the same magnification.

  When the shooting timing is during game play, the light source effect display control unit 238 performs display control for providing a light source by performing a given effect display 38 in the light source change range 36 in accordance with the timing. (See FIG. 5).

  The provided image synthesizing unit 240 generates a synthesized image (provided image) using the photographed still image and stores it in the storage unit 500.

  The provided image output control unit 242 performs control for providing the saved composite image to the player 2. For example, printing is performed by the printing unit 396, image data is transmitted to the information carrier medium or the portable computer by the non-contact reading unit 108, an email address specified via the communication unit 394, online storage, cloud service, etc. Image data can be transmitted to Such output control can be realized by appropriately utilizing known techniques.

  The sound generation unit 290 is realized by, for example, a digital signal processor (DSP), a processor such as a speech synthesis IC, an audio codec that can reproduce an audio file, and the sound of sound effects, BGM, and various operation sounds as the game progresses. A signal is generated and output to the sound output unit 390.

  The sound output unit 390 is realized by a device that outputs sound such as sound effects and BGM based on the sound signal input from the sound generation unit 290. In FIG. 1, the speaker 1308 corresponds to this.

  The image generation unit 292 is realized by, for example, a processor such as a GPU or a digital signal processor (DSP), a program such as a video signal IC or a video codec, an IC memory for a drawing frame such as a frame buffer, or the like. The image generation unit 292 generates an image of one game screen in one frame time (for example, 1/60 seconds) according to the progress of the game, and outputs the generated image signal of the game screen to the image display unit 392.

  The image display unit 392 displays various game images based on the image signal input from the image generation unit 292. For example, it can be realized by an image display device such as a flat panel or curved panel display (liquid crystal display, plasma display, organic EL display, LED display, etc.), cathode ray tube (CRT), projector. In the present embodiment, the display 1306 with a touch panel in FIG. 1 corresponds to this.

  The communication control unit 294 executes data processing related to data communication, and realizes data exchange with an external device via the communication unit 394. The communication unit 394 is realized by a device that communicates with the communication line 9 (see FIG. 1), for example, a wireless communication device, a modem, a TA (terminal adapter), a wired communication cable jack, a control circuit, or the like. Is done. The communication module 1353 in FIG. 1 corresponds to this.

  The printing unit 396 prints and outputs a composite image using a still image on a predetermined print medium. In the example of FIG. 1, the printing device 1332 corresponds to this. The print control unit 296 controls the print unit 396.

  The storage unit 500 stores programs, various data, and the like for realizing various functions for causing the processing unit 200 to control the arcade game device 1300 in an integrated manner. Further, it is used as a work area of the processing unit 200, and temporarily stores a calculation result executed by the processing unit 200, data such as an image shot by the shooting unit 102, and the like. This function is realized by, for example, an IC memory such as a RAM and a ROM, a magnetic disk such as a hard disk, and an optical disk such as a CD-ROM and DVD. In the example of FIG. 1, the IC memory 1352 corresponds to this.

FIG. 10 is a diagram illustrating an example of programs and data stored in the storage unit 500.
The storage unit 500 of this embodiment stores a control program 501, play data 510, captured image data 512, subject range identification data 514, subject range image data 516, and photographing timing definition data 518. . In addition, the display control data for light source 520, the captured still image data 540, the background data 542, the provided image data 544, the silhouette database 600, and the bone model database 602 are stored. In addition to other image data, information such as timers, counters, and various flags can be stored as appropriate.

  The control program 501 is read and executed by the processing unit 200 to realize basic input / output functions necessary as a computer. The game calculation unit 202 to the provided image output control unit 242 and the sound generation unit 290 to the print control unit 296 are implemented. , Realize the function as.

  The play data 510 stores various data describing the game progress status. For example, the game space set in the virtual three-dimensional space, various data of the object of the player character 6 and the enemy character 8 that are placed and controlled there, control data of the virtual camera, image data of the character composite image 7, motion The display size of the composite image is included.

  The photographed image data 512 is image data photographed by the photographing unit 102. Both moving image data and still image data can be included.

  The subject range identification data 514 is data necessary for recognizing and identifying a portion of the photographed image data 512 in which the player 2 as the main subject is captured. In the present embodiment, distance measurement result data by the distance measuring unit 104 corresponds to this.

  The subject range image data 516 is an image of a portion of the photographed image data 512 in which the player 2 as the main subject is shown, that is, the player image 3 (see FIG. 2).

  The shooting timing definition data 518 is reference data for determining the shooting timing of still image shooting. Judgment conditions are defined.

  The light source display control data 520 stores various data relating to display control of the light source change range 36. For example, it includes real-time silhouette data 521, effect display control data 522, subject brightness data 523, subject color data 524, region setting data 525, region-specific display color setting data 526, remaining time counter 527, and the like. Of course, other data can be stored as appropriate.

  The real-time silhouette data 521 is data for displaying the real-time silhouette 35 (see FIGS. 5 and 6). For example, it includes image data of the silhouette itself and data defining the silhouette outline. Moreover, those display position coordinates are included.

  The effect display control data 522 is display control data of the effect display 38 (see FIG. 6).

  The subject brightness data 523 is brightness information of the whole or a part of the subject range image (the image of the part in which the player 2 is captured). In the present embodiment, the darkness of the skin part of the face of the player image 3 and which side of the face the shadow is on are included in various data prepared for obtaining them.

  The subject color data 524 is color information of all or part of the subject range image. In the present embodiment, information on the skin color included in the player image 3 and various data prepared for obtaining it are included.

  The area setting data 525 defines an area set in the light source change range 36. For example, a function that describes the coordinates and shape of the boundary line can be set as appropriate.

  The display color setting data for each region 526 stores display color data for each region set in the light source change range.

  The remaining time counter 527 is a counter for displaying the remaining time until the photographing timing.

  The shot still image data 540 is still image data shot at the shooting timing.

  The background data 542 stores data defining a background at each shooting timing, such as the title 30 and the background image 33 (see FIG. 5).

  The provided image data 544 is image data provided to the player 2. In the present embodiment, it is an image obtained by combining the photographed still image data 540 with the background defined by the background data 542. In the example of FIG. 5, image data that does not include the shooting guidance text 31 and the remaining time 32 in the shooting preparation screen W10 corresponds to this. When the image to be provided is the captured still image data 540 as it is, the provided image data 544 can be omitted as appropriate.

[Description of operation]
Next, the operation of the arcade game apparatus 1300 will be described.
FIG. 11 is a flowchart for explaining the flow of processing by the arcade game apparatus 1300. The processing flow described here is implemented by the processing unit 200 executing the control program 501. It is assumed that the payment of the play price and the designation of the output method of the provided image by the player 2 have been completed.

  First, the processing unit 200 of the arcade game apparatus 1300 starts photographing the device front by the color camera unit 1310 and measuring the distance to the object in front of the device by the distance measuring device 1320 (step S2). Thereafter, data of the captured image captured by the color camera unit 1310 and distance measurement result data by the distance measuring device 1320 are transmitted to the control board 1350 one by one and stored as captured image data 512 and subject range identification data 514, respectively. (See FIG. 10).

  Next, the arcade game apparatus 1300 refers to the subject range identification data 514 and starts identifying the subject range in which the player 2 is captured from the photographed image data 512 (step S4), and the player 2 uses the player 2 for gesture input. Analysis of poses and gestures is started (step S6; see FIG. 2). Known techniques are used as appropriate for subject range identification and gesture analysis.

Next, game progress control is started (step S8).
When the game is started, the arcade game device 1300 starts to sequentially extract the subject image, that is, the player image 3 from the image captured by the color camera unit 1310 (step S20), and the player image is converted into the image of the game space. The composite display is started (step S22). In the present embodiment, display of the character composite image 7 is started (see FIGS. 3 and 4).

When the progress control of the game is started, the arcade game apparatus 1300 repeatedly executes steps S24 to S26 in a predetermined cycle until the game end condition is satisfied.
Specifically, if the condition defined in the shooting timing definition data 518 (see FIG. 10) is satisfied during game play, it is determined that the shooting timing has arrived (YES in step S24), and the first still image An imaging process is executed (step S26).

FIG. 12 is a flowchart for explaining the flow of the first still image shooting process.
In the process, the processing unit 200 of the arcade game apparatus 1300 analyzes the brightness information of the player image 3 (step S50). Specifically, a range in which the head of the player is estimated is determined from the subject range identification data 514, and the image within the range is subjected to face recognition processing from the subject range image 516, whereby the player image 3 The part in which the face of the player 2 is shown is identified. Then, the brightness difference between the upper, lower, left and right parts of the face is obtained. The analysis result is stored as the subject brightness data 523 of the light source display control data 520 of the storage unit 500 (see FIG. 10).

  Next, the color information of the player image 3 is analyzed (step S54). Specifically, the skin color of the player 2 in the player image 3 is sampled. The analysis result is stored as subject color data 524 (see FIG. 10).

  Next, the arcade game apparatus 1300 sets an area of the light source change range 36 (step S56). As a result of the lightness analysis, when there is a lightness difference exceeding the upper limit value of the predetermined lightness difference allowable range, or when there is only a lightness difference that does not satisfy the lower limit value of the lightness difference allowable range, the light source change range 36 is set to the bright side and dark side of the face. Each region is set to face the side. If the brightness difference is within the allowable range, the number of areas is one. That is, the area is not divided. At this stage, the light source change range 36 may be simply set roughly in an area such as vertically or horizontally divided into two. The division boundary may pass through a range where the face of the player 2 is shown. The setting result is stored as area setting data 525 (see FIG. 10).

  Next, the arcade game apparatus 1300 sets a display color for each set region of the light source change range 36 (step S58). Specifically, if the skin color of player 2 falls within a predetermined reference range based on the result of color analysis, the display color of the area facing the dark side of the face of player 2 is set to white, and the area facing the bright side Is set to a predetermined color (for example, gray). If the skin color is out of the reference range, set the display color of the area facing the dark side to a color that includes a color component that corrects the skin color to fall within the reference range (for example, approximately white) and face the bright side The display color of the area to be set is set to a predetermined color (for example, gray).

  Next, the arcade game apparatus 1300 determines whether or not a sufficient amount of light can be secured by setting the area allocation and display color of the current light source change range 36 (step S60). For example, if the number of dots in the area displayed in white or substantially white has reached a predetermined number of required dots calculated in advance from the screen size and screen brightness, it is determined to be affirmative, and if not, it is determined to be negative Also good. In the case of substantially white, the amount of light is naturally lower than that of white.

  If the amount of light cannot be secured (NO in step S60), the commercial game device 1300 determines whether or not the distribution of the light source change range 36 is within an allowable range (step S62). The “allowable range” here refers to the lower limit of the area of the area where the display color is set to gray as the predetermined lower limit when the brightness difference of the face of the player 2 is greater than or equal to the reference value. If it is within the allowable range (YES in step S62), the setting of the region is changed so as to increase the area of the region in which the white or substantially white display color is set in the light source change range 36. (Step S64), the process returns to step S60.

  If the area where the display color is set to gray is made smaller than this, if the brightness difference of the face shadow remains large and correction cannot be performed (NO in step S62), the arcade game apparatus 1300 will display the character composite image 7. The shooting position of the virtual camera is changed so that the ratio of occupies the entire screen area becomes smaller (step S66), and the process returns to step S60.

If it is determined in step S60 that the amount of light can be secured (YES in step S60), the arcade game apparatus 1300 starts displaying the effect display 38 to notify the shooting timing (step S82; FIG. 6). (See game screen example W18).
At the shooting timing, the display color of the light source change range 36 is changed in accordance with the end of the effect display 38, and the character composite image 7 is changed to the real-time silhouette 35 (see game screen example W18 in FIG. 6). Then, the color camera unit 1310 captures a still image and stores it as captured still image data 540 (step S84; see FIG. 10).

  If the shooting is completed, the arcade game apparatus 1300 ends the display change of the light source change range 36 and returns it to the original state (step S86). Of course, when the position of the virtual camera is changed in step S66, this is also restored. The real-time silhouette 35 is also returned to the display of the character composite image 7.

  The provided still image data 540 just taken and the background image at the time of shooting are combined to generate a provided image, which is stored as provided image data 544 (step S88; see FIG. 10), and the first still image is captured. End the process.

Returning to the flowchart of FIG. 11, the arcade game apparatus 1300 repeats steps S24 to S26 until the game end condition is satisfied (NO in step S100).
If the game end condition is satisfied (YES in step S100), the game is ended, and if it is determined that the still image shooting timing has come (YES in step S102), the second still image shooting process is executed (step S102). S104).

FIG. 13 is a flowchart for explaining the flow of the second still image shooting process.
The same steps as those in the first still image shooting process are denoted by the same reference numerals, and differences from the first still image shooting process will be described.

  In the second still image shooting process, prior to step S50, the arcade game apparatus 1300 selects a background according to the type of shooting timing (step S46), and starts displaying the shooting preparation screen W10 on the display 1306 ( Step S48; see FIG. That is, the generation and display of the real-time player image 34 is started, and the remaining time until the shooting timing is displayed to notify the timing for acquiring the still image.

  If it is determined that the amount of light is not sufficiently secured even after adjusting the area distribution of the light source change range 36 (NO in step S62), the arcade game device 1300 has a display size of the shooting preparation screen W10. The amount of light is secured by adjustment, that is, by reducing the display size of the real-time player image 34 (step S70; see FIG. 5).

  Then, since the game play is not being performed and the effect display 38 is not performed and the shooting timing is reached (YES in step S72), the display color of the light source change range 36 is changed and the real-time player image 34 is displayed in real-time silhouette. The display is changed to the display 35, and the generation and storage of the provided image are executed (steps S82 to S88).

  Returning to the flowchart of FIG. 11, if the provisional image data 544 that has not been provided remains in the arcade game device 1300 (YES in step S110), they are printed, transferred to the IC memory card 91, and attached to an e-mail. Then, the data is output and erased by a method such as transmission to the designated online storage or the like (step S112), and the series of processing is terminated.

As described above, according to the present embodiment, the player 2 can recognize his / her pose until the moment when the still image is captured, and the player 2 can perform satisfactory shooting.
Further, the display color of the light source change range 36 can be controlled. For this reason, even if the illuminance of the ambient light at the place where the arcade game apparatus 1300 is set is not always constant or insufficient, more appropriate illumination can be realized. In addition, since the display color can be adjusted so that the skin color of the face of the player 2 falls within the reference range, even if the ambient light is not necessarily a color suitable for illumination, it is possible to suppress the color cast of the photographed image.

  In addition, since the light source change range 36 can be divided into a plurality of areas and the display can be adjusted to the bright area and the dark area, the illumination light in the environment hits only from one of the faces of the player 2 and the shadow of the face is too dark. Or, conversely, it is possible to compensate for excess or deficiency of contrast, such as taking a picture of a face with shadows disappearing due to excessive illumination from the environment.

[Modification]
Note that the application form of the present invention is not limited to the above, and it is possible to add, omit, or change the components as appropriate.

  For example, the computer system to which the present invention is applied is not limited to the arcade game device 1300. For example, as shown in FIG. 14, a form as a stationary home game apparatus 1200 may be taken. In other words, the game device main body 1201 of the stationary home game device 1200 is connected to a television monitor 1210 equipped with a flat panel display 1212 and a speaker 1214 to display a game screen on the television monitor 1210 and to release game sounds. Let it sound. A sensor unit 1240 equipped with a color camera 1206 (corresponding to the color camera unit 1310 of the first embodiment) and a distance measuring device 1230 (corresponding to the distance measuring device 1320 of the first embodiment) is mounted on the television monitor 1210. It is configured to be mounted and connected to the game apparatus main body 1201 and to output the photographed image data and distance measurement result data to the game apparatus main body 1201. The player 2 may have a game controller 1205. The game apparatus main body 1201 incorporates a control board 1250 (corresponding to the control board 1350 of the first embodiment), and can perform still image shooting and generation / storage of provided images in the same manner as in the above-described embodiment. The provided image is output by storing it as image data.

  Further, the game genre and game content can be set as appropriate. Thereby, the usage form of the image taken by the player 2 can be changed as appropriate. For example, in order to show which player is using which character in a multiplayer race game or role playing game, a still image of the face of the player 2 is placed around the character in the game image (for example, immediately above). The displayed marker may be displayed as an accompanying display.

  Moreover, in the said embodiment, although the area | region of the change range 36 for light sources was set as the 2 step | paragraph structure of the high illumination intensity area | region displayed by white or substantially white, and the low illumination intensity area | region displayed by gray, it is not restricted to this. For example, as shown in FIG. 15, it is configured in three stages: a high illuminance area displayed in white or substantially white, a medium illuminance area displayed in gray, and a low illuminance area displayed in deep gray or black. You can also Furthermore, the boundary portion of each region may be gradation.

  In the above embodiment, the entire display area of the display 1306 except for the real-time player image 34 is used as the light source change range 36 at the time of shooting, not limited to the number of constituent panels. For example, as shown in FIG. 16, a plurality of display panels or a panel having a wide display area corresponding to a plurality of panels (for example, a horizontally wide curved panel spreading in the lateral direction in front of the player 2) There is also a configuration in which other panels and display areas are used as the light source change range 36 while maintaining the display of the game screen and the shooting preparation screen W10 in the display area corresponding to the front panel or the single panel in front of the player 2. Is possible. A display screen in which the ratio of the image in the subject range is small may be used as the light source change range 36. In the example of FIG. 16, the front right panel 1306R is displayed in gray and the left front panel 1306L is displayed in white or substantially white while the game screen is displayed on the front panel 1306F.

  Further, in the above embodiment, as an example of the still image shooting timing, the time during play and after the end of play are shown, but the timing of player registration before the start of play can be included as appropriate. In that case, the second still image shooting process may be executed in the process of player registration.

Moreover, in the said embodiment, although it was set as the structure which implement | achieves the function of the game calculating part 202-the provision image output control part 242 in the arcade game device 1300, it is not restricted to this.
For example, the server system 1100 and the arcade game device 1300 constitute a client server system, the functions of the game calculation unit 202 to the provided image output control unit 242 are realized by the server system 1100, and the arcade game device 1300 is operated and input. It is also possible to employ a terminal device for outputting several screen displays and provided images.

  Further, in the above embodiment, the silhouette of the player 2 is obtained by dividing the player area and the background area by the distance by the distance measuring device 1320. However, the silhouette may be obtained by another method without using the distance measuring device. good. For example, it may be cut out by chroma key method by installing color screen such as green or blue in the background, or by optical flow method to calculate the vector field of the moving part by taking the difference from the previous frame, The moving part may be regarded as a player and cut out. The present invention is not limited to this, and any method may be used as long as the player area can be recognized separately from the background by some image recognition technique.

2 ... Player 3 ... Player image 6 ... Player character 7 ... Character composite image 31 ... Shooting guidance text 32 ... Remaining time 33 ... Background image 34 ... Real-time player image 35 ... Real-time silhouette 36 ... Light source change range 38 ... Effect display 102 ... Shooting unit 104 ... Distance measuring unit 200 ... Processing unit 202 ... Game operation unit 204 ... Subject range determination unit 210 ... Game image display control unit 212 ... Subject display size adjustment unit 220 ... Timing notification control unit 230 ... Still image acquisition control unit 232 ... Light source display color setting unit 234 ... Range division control unit 236 ... Silhouette size changing unit 238 ... Light source effect display control unit 240 ... Provided image synthesis unit 242 ... Provided image output control unit 500 ... Storage unit 501 ... Control program 510 ... Play data 512 ... shot image data 51 ... Subject range identification data 516 ... Subject range image data 518 ... Shooting timing definition data 520 ... Light source display control data 521 ... Real time silhouette data 522 ... Production display control data 523 ... Subject brightness data 524 ... Subject color data 525 ... Area setting Data 526 ... Display color setting data by region 527 ... Remaining time counter 540 ... Captured still image data 542 ... Background data 544 ... Provided image data 1100 ... Server system 1300 ... Commercial game device 1306 ... Display with touch panel 1306F ... Front panel 1306L ... Left front panel 1306R ... Right front panel 1310 ... Color camera unit 1320 ... Ranging device 1350 ... Control board

Claims (8)

A computer system having an imaging unit and a display unit,
Subject range determination means for determining a subject range among images being captured by the photographing unit;
Display control means for controlling display of a game image using the image of the subject range on the display unit;
Timing notifying means for notifying the timing for acquiring a still image;
In accordance with the timing, the display image of the display unit is changed to display a part or all of the display image other than the subject range (hereinafter collectively referred to as “light source change range”) as a light source, and is stationary. Still image acquisition control means for acquiring an image,
Program to function as. The still image acquisition control means sets a display color of the light source change range using color information of the subject range.
The program according to claim 1. The subject range determining means identifies a predetermined portion of the subject range using data measured by a distance measuring means for measuring a distance to the subject;
The still image acquisition control means sets the display color of the light source change range using color information in the predetermined part of the subject range.
The program according to claim 1. The subject range determination means recognizes the face portion of the subject from the image portion of the subject range in the image being shot;
The still image acquisition control means sets the display color of the light source change range using color information of the face portion of the subject range.
The program according to claim 1. The still image acquisition control unit sets the display color by dividing the light source change range into a plurality of regions.
The program as described in any one of Claims 2-4. The display controller is configured to change the size of the image of the subject range so that the size of the change range for the light source satisfies a predetermined condition for a given time including at least the timing. Control the display of
The program as described in any one of Claims 1-5. The display unit has a plurality of display screens,
The still image acquisition control means uses, for the light source, a display screen in which the image of the subject range is not displayed among the plurality of display screens, or a display screen in which the proportion of the image of the subject range is relatively small. The scope of change,
The program as described in any one of Claims 1-5. A shooting section;
A display unit;
Subject range determination means for determining a subject range among images being captured by the photographing unit;
Display control means for controlling display of a game image using the image of the subject range on the display unit;
Timing notifying means for notifying the timing for acquiring a still image;
In accordance with the timing, the display image of the display unit is changed to display a part or all of the display image other than the subject range (hereinafter collectively referred to as “light source change range”) as a light source, and is stationary. A still image acquisition control means for acquiring an image;
Computer system with

Images