JP2014211745A - Movement detection device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which when movement of a subject is detected based on the size of the subject in an image captured by an imaging unit, the movement of the subject may not be detected accurately.SOLUTION: A movement detection device comprises: a subject specifying unit that specifies a subject included in each of a plurality of images consecutively captured by an imaging unit; and a movement detection unit that detects movement of the subject along a first direction perpendicular to an imaging surface of the imaging unit on the basis of the area and luminance of the subject in the plurality of images. The movement detection unit may detect movement of the subject along the first direction on the basis of an amount of change in the area and an amount of change in the luminance.

Description

  The present invention relates to a movement detection device and a program.

Patent Document 1 discloses that a human body is specified by extracting an individual shape of a moving object from image information captured by an imaging unit.
Japanese Patent Application Laid-Open No. 2006-145456

  By the way, when detecting the motion of the subject based on the size of the subject in the image captured by the imaging unit, the motion of the subject may not be detected with high accuracy.

  The movement detection device according to the present embodiment includes a subject identification unit that identifies subjects included in each of a plurality of images continuously captured by the imaging unit, and an imaging unit based on the area and luminance of the subject in the plurality of images. A movement detection unit that detects movement of the subject along a first direction perpendicular to the imaging surface.

  The movement detection device further includes an area change amount deriving unit for deriving a change amount of the area of the subject in the plurality of images, and a luminance change amount deriving unit for deriving a change amount of the luminance of the subject in the plurality of images. The detection unit may detect the movement of the subject along the first direction based on the area change amount and the luminance change amount.

  The movement detection device further includes a first movement change amount deriving unit for deriving a change amount of movement along a second direction parallel to the imaging surface of the subject specified by the subject specifying unit in the plurality of images. The unit detects the movement of the subject along the second direction based on the change amount of the movement along the second direction when the change amount of the movement along the second direction is equal to or greater than the first reference amount. When the change amount of movement along the two directions is smaller than the first reference amount and greater than or equal to the second reference amount smaller than the first reference amount, the change along the first direction is based on the change amount of the area and the change amount of the luminance. The movement of the subject may be detected.

  The movement detection device includes a second movement change amount deriving unit that derives a change amount of movement along a third direction parallel to an imaging surface different from the second direction of the subject specified by the subject specifying unit in a plurality of images. The movement detection unit further includes a movement detection unit configured to move the object along the third direction based on the movement change along the third direction when the movement change along the third direction is equal to or greater than the third reference amount. The amount of change in movement along the second direction is smaller than the first reference amount and greater than or equal to the second reference amount, and the amount of change in movement along the third direction is smaller than the third reference amount. If the amount is equal to or larger than the fourth reference amount smaller than the third reference amount, the movement of the subject along the first direction may be detected based on the area change amount and the luminance change amount.

  In the movement detection device, the imaging unit may continuously capture a plurality of images according to the amount of reflected light of the light having a specific wavelength irradiated toward the detection target region for detecting the movement of the subject. Good.

  The movement detection unit detects that the subject has moved in the direction approaching the imaging unit along the first direction when the subject area changes in a direction in which the area of the subject decreases and the luminance of the subject changes in a direction in which the luminance increases. The movement detection apparatus according to claim 5.

  The movement detection unit detects that the subject has moved in the direction away from the imaging unit along the first direction when the subject area changes in a direction in which the area of the subject increases and the luminance of the subject changes in a direction in which the luminance decreases. The movement detection apparatus according to claim 5 or 6.

  The program according to the present embodiment is a program for causing a computer to function as a movement detection device.

  It should be noted that the above summary of the invention does not enumerate all the necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.

It is a figure which shows an example of the schematic front view of a game machine provided with the movement detection apparatus which concerns on this embodiment. It is a figure which shows an example of the external appearance perspective view of the movement detection apparatus which concerns on this embodiment. It is a figure which shows an example of a motion of the hand of a detection target. It is a figure which shows an example of the image at the time of moving a hand to a Z-axis negative direction on the wrist. It is a figure which shows an example of the functional block of the game machine which concerns on this embodiment. It is a figure which shows an example of the functional block of the movement detection apparatus which concerns on this embodiment. It is a figure for demonstrating a labeling process. It is a figure for demonstrating a labeling process. It is a flowchart which shows an example of the process sequence of an image analysis part. It is a flowchart which shows an example of the procedure of the movement detection process which detects the movement of the to-be-photographed object of a movement detection part. It is a flowchart which shows an example of the procedure of the movement detection process which detects the movement of the to-be-photographed object of a movement detection part. It is a flowchart which shows an example of the procedure of the movement detection process which detects the movement of the to-be-photographed object of a movement detection part. It is a flowchart which shows an example of the process sequence of a game machine when a game ball wins. It is a figure which shows an example of the production | presentation screen displayed when winning a prize. It is a figure which shows an example of the production | presentation screen displayed when winning a prize. It is a figure which shows an example of the production | presentation screen displayed when winning a prize.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows an example of a schematic front view of a gaming machine 10 including a movement detection device 100 according to the present embodiment. The gaming machine 10 includes a housing 12, a display device 14, a handle switch 16, and a movement detection device 100. In the present embodiment, an example in which the gaming machine 10 includes the movement detection device 100 will be described. However, the movement detection device 100 may be provided in a device other than the gaming machine 10.

  The display device 14 is disposed in the game area of the housing 12. The display device 14 displays various images for effects. The display device 14 includes a display screen such as a liquid crystal display, and displays, for example, a decorative symbol for notifying the player of the symbol lottery result as the game progresses by the player, or the appearance of a character or the appearance of an item. Display effect images. The handle switch 16 is operated by the player when a game ball is fired through the ball launcher. The movement detection device 100 detects the movement of a subject such as a player's hand in the detection target area. The gaming machine 10 performs effects such as displaying an image on the display device 14 in accordance with the movement detection result of the subject by the movement detection device 100.

  FIG. 2 shows an example of an external perspective view of the movement detection device 100. The movement detection apparatus 100 includes an imaging unit 102 and an infrared light emitting unit 104. The infrared light emitting unit 104 irradiates infrared rays to the detection target area of the subject. The imaging unit continuously captures a plurality of images according to the amount of reflected light of the light having a specific wavelength irradiated toward the detection target region for detecting the movement of the subject. The imaging unit 102 includes a visible light cut filter, an imaging element, and an image generation unit. The visible light cut filter filters visible light out of the reflected light reflected by the subject and transmits infrared light. The image sensor photoelectrically converts the infrared light that has passed through the visible light cut filter and outputs an image signal. The image generation unit generates an image by performing image processing on the image signal output from the image sensor.

  For example, the movement detection device 100 detects movement along the X-axis direction, the Y-axis direction, and the Z-axis direction of the player's hand using the player's hand as a subject. The first direction perpendicular to the imaging surface of the imaging unit 102, that is, the light receiving surface of the imaging element, is the Z-axis direction, the second direction parallel to the imaging surface is the X-axis direction, and is parallel to the imaging surface and in the second direction. A vertical third direction is defined as a Y-axis direction.

  Here, when the subject is moving away from the imaging unit 102 along the Z-axis direction, that is, when the subject is moving in the Z-axis direction, the area of the subject may be gradually reduced. In addition, when the subject is approaching the imaging unit 102 along the Z-axis direction, that is, when the subject is moving in the Z-axis + direction, the area of the subject may gradually increase. Therefore, it is conceivable that the movement detection device 100 detects the movement of the subject along the Z-axis direction based on the change in the area of the subject included in the image captured by the imaging unit 102.

  Further, the movement detection device 100 detects the movement of the subject along the X-axis direction or the Y-axis direction parallel to the imaging surface based on the change in the center-of-gravity coordinates of the subject included in the image captured by the imaging unit 102. It is possible.

  However, as shown in FIG. 3, when the player moves his / her hand in the Z-axis direction from the state of reference numeral 300 to the state of reference numeral 302 with the wrist as a base point, for example, the change in the area of the subject in the image, Alternatively, when the movement of the subject is detected based only on the change in the barycentric coordinates, the movement of the subject may not be detected accurately.

  FIG. 4 illustrates an example of an image output from the imaging unit 102 when the hand is moved in the Z-axis direction with the wrist as a base point. For example, when moving in the Z-axis direction with the wrist as the base point, the area from the wrist to the fingertip is always included in the image as the subject, so the change in the area of the subject is small. Further, when moving in the Z-axis direction with the wrist as a base point, the orientation of the hand included in the image changes, and the area of the subject increases as the distance from the imaging unit 102 increases without decreasing the area of the subject. In addition, when the wrist is moved in the Z-axis direction as a base point, the center-of-gravity coordinates of the subject are also moved in the X-axis direction and the Y-axis direction. Therefore, depending on the movement of the subject, when the movement of the subject along the X-axis direction, the Y-axis direction, and the Z-axis direction is detected based only on the barycentric coordinates or area of the subject, the movement of the subject cannot be accurately detected. There is a case.

  Therefore, the movement detection apparatus 100 according to the present embodiment detects the movement of the subject based on the change in the luminance of the subject in addition to the change in the center of gravity coordinates and the change in the area of the subject.

  Here, as the distance between the subject and the imaging unit 102 is longer, the infrared light reflected by the subject is diffused. Accordingly, the amount of infrared light incident on the imaging unit 102 decreases as the distance between the subject and the imaging unit 102 increases. That is, the luminance of the subject included in the image becomes darker as the distance between the subject and the imaging unit 102 is longer. Therefore, when the brightness of the subject changes in the direction of darkening, the subject may have moved in the Z-axis-direction. Further, when the luminance of the subject changes in the direction of increasing, there is a possibility that the subject has changed in the Z axis + direction.

  On the other hand, even when the subject moves in the X-axis direction or the Y-axis direction, the luminance of the subject may change. Therefore, there is a case where the movement of the subject cannot be detected accurately only by detecting the movement of the subject only by the change in the luminance of the subject. In addition, as described above, even when the wrist is moved in the Z-axis direction as a base point, the gravity center coordinates of the subject may move in the X-axis direction and the Y-axis direction. However, the change amount of the center-of-gravity coordinates due to the movement of the hand in the Z-axis direction with the wrist as the base point is likely to be smaller than the change amount of the center-of-gravity coordinates due to the movement in the X-axis direction or the Y-axis direction of the hand.

  Therefore, the movement detection apparatus 100 detects the movement of the subject in the X-axis direction or the Y-axis direction based on the change in the center-of-gravity coordinates when the amount of change in the center-of-gravity coordinates of the subject is equal to or greater than a predetermined threshold A. On the other hand, when the change amount of the centroid coordinate of the subject is smaller than the threshold A and the change amount of the centroid coordinate of the subject is greater than or equal to the threshold B smaller than the threshold A, the movement detection device 100 changes the area and brightness of the subject. Based on this, the movement of the subject in the Z-axis direction is detected.

  As described above, the movement detection apparatus 100 according to the present embodiment determines whether the movement detection is performed using any of the parameters of the change in the center-of-gravity coordinates of the subject, the change in the area of the subject, and the change in the luminance of the subject. The movement of the subject is detected with higher accuracy.

  FIG. 5 is an example of functional blocks of the gaming machine 10 according to the present embodiment. In the present embodiment, the gaming machine 10 is a pachinko machine. However, the gaming machine 10 may be another gaming machine such as a pachislot base.

  The gaming machine 10 includes a display device 14, a handle switch 16, a winning sensor 18, a ball launching device 20, an acoustic device 22, a control unit 30, an effect control unit 40, and a movement detection device 100.

  The display device 14 displays an image corresponding to an effect executed as the game progresses by the player. The handle switch 16 fires a game ball via the ball launching device 20 in accordance with an operation by the player. The winning sensor 18 detects that a game ball has won a predetermined winning opening on the game board, and outputs a winning signal. The ball launcher 20 launches a game ball according to the amount of operation of the handle switch 16. The acoustic device 22 outputs a sound corresponding to an effect executed as the game progresses by the player.

  The control unit 30 controls the entire gaming machine 10. The control unit 30 includes an input signal control unit 32, a gaming machine control unit 34, a big hit lottery unit 36, and a data transmission unit 38. The input signal control unit 32 detects the input of a winning signal from the winning sensor 18 and notifies the gaming machine control unit 34 of a lottery signal. When the gaming machine control unit 34 detects the lottery signal from the input signal control unit 32, it notifies the big hit lottery unit 36 and receives the lottery result from the big hit lottery unit 36. Further, the gaming machine control unit 34 outputs an effect command corresponding to the lottery result to the effect control unit 40 via the data transmission unit 38. The jackpot lottery unit 36 performs a jackpot lottery in response to a lottery signal from the gaming machine control unit 34 and notifies the gaming machine control unit 34 of the lottery result. The data transmission unit 38 transmits the production command from the gaming machine control unit 34 to the production control unit 40.

  The effect control unit 40 includes a data transmission / reception unit 42, an instruction unit 44, and an effect execution unit 50. The effect execution unit 50 includes a display device control unit 52 and an audio device control unit 54. The data transmitting / receiving unit 42 receives the effect command from the control unit 30 and the movement detection result from the movement detection device 100 and outputs an effect execution command to the instruction unit 44 and the effect execution unit 50 according to the movement detection result.

  The instruction unit 44 instructs the player to move his / her hand in the movement direction corresponding to the game condition when a predetermined game condition is satisfied. The instruction unit 44 instructs the player to move the hand in the first direction (Z-axis direction), for example, in the up-down direction or the down-up direction with respect to the gaming machine, when the predetermined first game condition is satisfied. Functions as a first instruction unit. When the predetermined second game condition is satisfied, the instruction unit 44 instructs the player to move the hand in the second direction (X-axis direction), for example, in the left-right direction or the right-left direction with respect to the gaming machine. It functions as a second instruction unit. When the third game condition is determined in advance, the instructing unit 44 causes the player to move in the third direction (Y-axis direction), for example, from the front to the back or from the back to the front with respect to the gaming machine. It functions as a third instruction unit to support. Here, the game condition is a condition determined based on the result of the big hit lottery, for example. In response to the effect execution command, the instruction unit 44 instructs the player to move the hand in the case of an effect executed in response to, for example, moving the hand. The instruction unit 44 may cause the display device 14 to display a prompting screen that prompts the player to move his / her hand.

  The effect execution unit 50 executes an effect according to the effect execution command. In the case of an effect executed in response to the player moving his / her hand in a specific movement direction, the effect execution unit 50 executes the effect based on the movement detection result from the movement detection device 100. The display device control unit 52 causes the display device 14 to display an effect screen corresponding to the effect execution command. The sound device control unit 54 causes the sound device 22 to output effect sound corresponding to the effect execution command. In response to the instruction unit 44 instructing the player to move the hand in a specific movement direction, the performance execution unit 50 indicates that the movement detection result has detected the movement of the hand along the specific movement direction. When shown, an effect corresponding to a specific movement direction may be executed.

  FIG. 6 shows an example of functional blocks of the movement detection apparatus 100. The movement detection apparatus 100 includes an imaging unit 102, an infrared light emitting unit 104, an image analysis unit 110, and a transmission / reception unit 106.

  The infrared light emitting unit 104 emits pulsed infrared rays toward a predetermined detection target region. The imaging unit 102 outputs an image according to the amount of received infrared light reflected from the subject existing in the detection target region. The image analysis unit 110 analyzes the image output from the imaging unit 102, derives image parameters for detecting the movement of the subject, and detects the movement of the subject based on the image parameter. The transmission / reception unit 106 receives a movement detection command from the effect control unit 40 and transmits a movement detection result to the effect control unit 40 as a response to the movement detection command.

  The image analysis unit 110 includes an image acquisition unit 112, a binarization conversion unit 114, a labeling processing unit 116, a subject specifying unit 118, a luminance deriving unit 120, a luminance change amount deriving unit 122, an area deriving unit 124, and an area change amount deriving unit. 125, a first position information deriving unit 126, a first movement change amount deriving unit 128, a second position information deriving unit 130, a second movement change amount deriving unit 132, a movement detecting unit 134, and a detection result holding unit 136.

  The image acquisition unit 112 acquires a plurality of images continuously captured by the imaging unit 102 and provides them to the binarization conversion unit 114 and the luminance derivation unit 120. The image output from the imaging unit 102 may be, for example, an 8-bit grayscale image showing a monochrome image in which each pixel constituting the image has 256 gradations. The binarization conversion unit 114 performs binarization processing on each of the provided images and outputs a binarized image. The binarization conversion unit 114 is a binarized image in which, among the pixels constituting the 8-bit grayscale image, a pixel whose luminance is equal to or higher than a predetermined threshold luminance is a white pixel, and a pixel whose luminance is lower than the threshold luminance is a black pixel. Is output.

  The labeling processing unit 116 groups white pixels that are subject candidates by attaching the same label to the connected white pixels among the pixels constituting the binarized image. The labeling processing unit 116 may add the same label to white pixels that are adjacent in eight directions including left, right, up, down, and diagonal directions. For example, the labeling processing unit 116 performs a labeling process on the binarized image as illustrated in FIG. 7A and labels each white pixel as illustrated in FIG. 7B. Accordingly, the labeling processing unit 116 groups white pixels that are subject candidates.

  The subject specifying unit 118 specifies a subject based on the binarized image that has been subjected to the labeling process. The subject specifying unit 118 specifies a white pixel group having the largest number of pixels with the same label as a subject. The subject specifying unit 118 specifies, for example, a white pixel group labeled “3” as a subject in the binarized image subjected to the labeling process as shown in FIG. 7B.

  The luminance deriving unit 120 derives the average luminance of the subject for each of the plurality of pixels. The luminance deriving unit 120 extracts each pixel corresponding to the position of the white pixel group constituting the subject identified by the subject identifying unit 118 from among the pixels constituting the 8-bit grayscale image. The luminance deriving unit 120 may derive the average luminance of the extracted pixels (tone values) as the luminance of the subject.

  The luminance change amount deriving unit 122 derives the luminance change amount by deriving the luminance difference between the subjects of the preceding and following images. The luminance change amount deriving unit 122 calculates the difference between the luminance E1 of the subject included in the latest image and the luminance E2 of the subject included in the image immediately before the latest image as the luminance change amount H1 (E1-E2). ). In addition, the luminance change amount deriving unit 122 calculates the difference between the luminance E2 of the subject included in the image one image before the latest image and the luminance E3 of the subject included in the image two images before the latest image. Derived as a change amount H2 (E2-E3).

  The area deriving unit 124 derives the area of each subject in the plurality of images. The area deriving unit 124 may derive the area of each subject of a plurality of pixels by deriving the number of white pixel groups constituting the subject specified by the subject specifying unit 118.

  The area change amount deriving unit 125 derives the area change amount by deriving the difference in the area of each subject in the preceding and following images. The area change amount deriving unit 125 calculates the difference between the area S1 of the subject included in the latest image and the area S2 of the subject included in the image immediately before the latest image as the area change amount J1 (S1−S2). ). Further, the area change amount deriving unit 125 calculates the difference between the area S2 of the subject included in the image one image before the latest image and the area S3 of the subject included in the image two images before the latest image as the area. The change amount J2 (S2-S3) is derived.

  The first position information deriving unit 126 derives the X coordinate of the center of gravity of each subject of the plurality of images as first position information. The first movement change amount deriving unit 128 derives the change amount of the X coordinate of the center of gravity of each subject in the preceding and following images as the change amount of movement of the subject along the X-axis direction. The first movement change amount deriving unit 128 calculates the difference between the X coordinate x1 of the center of gravity of the subject included in the latest image and the X coordinate x2 of the center of gravity of the subject included in the image immediately before the latest image, as X It is derived as a change amount X1 (x1-x2) of movement along the axial direction. The first movement change amount deriving unit 128 also includes the X coordinate x2 of the center of gravity of the subject included in the image one image before the latest image and the X of the center of gravity of the subject included in the image two images before the latest image. The difference from the coordinate x2 is derived as a movement change amount X2 (x2-x3) along the X-axis direction.

  The second position information deriving unit 130 derives the Y coordinate of the center of gravity of each subject of the plurality of images as second position information. The second movement change amount deriving unit 132 derives the change amount of the Y coordinate of the center of gravity of each subject in the preceding and following images as the change amount of movement of the subject along the Y-axis direction. The second movement change amount deriving unit 132 calculates the difference between the Y coordinate y1 of the center of gravity of the subject included in the latest image and the Y coordinate y2 of the center of gravity of the subject included in the image immediately before the latest image, as Y Derived as a change amount Y1 (= y1-y2) of movement along the axial direction. The second movement change amount deriving unit 132 also includes the Y coordinate y2 of the center of gravity of the subject included in the image immediately before the latest image and the Y of the center of gravity of the subject included in the image two images before the latest image. The difference from the coordinate y2 is derived as the movement change amount Y2 (= y2-y3) along the Y-axis direction.

  The movement detection unit 134 detects the movement of the subject based on the luminance change amount, the area change amount of the subject, the movement change amount of the subject along the X-axis direction and the Y-axis direction, and the movement detection result is a detection result holding unit. 136 is registered.

  When the magnitude (absolute value) of the movement change amount of the subject along the X-axis direction is greater than or equal to the first reference amount, the movement detection unit 134 determines the X direction based on the movement change amount of the subject along the X-axis direction. The movement of the subject along the line may be detected. The movement detection unit 134 may detect movement of the subject along the X direction when the amount of change in movement of the subject along the X-axis direction is equal to or greater than a predetermined threshold A or equal to or less than the threshold −A. Good.

  When the magnitude (absolute value) of the movement change amount of the subject along the X-axis direction is smaller than the first reference amount and equal to or larger than the second reference amount that is smaller than the first reference amount, the movement detection unit 134 The movement of the subject along the Z-axis direction may be detected based on the change amount and the luminance change amount. When the movement change amount of the subject along the X-axis direction is smaller than the threshold A and greater than or equal to the predetermined threshold B, the movement detection unit 134 moves in the Z-axis direction based on the subject area change amount and the luminance change amount. The movement of the subject along may be detected. When the movement change amount of the subject along the X-axis direction is larger than the threshold value -A and less than or equal to a predetermined threshold value -B, the movement detection unit 134 performs the Z-axis operation based on the subject area change amount and the luminance change amount. The movement of the subject along the direction may be detected.

  When the magnitude (absolute value) of the movement change amount of the subject along the Y-axis direction is greater than or equal to the third reference amount, the movement detection unit 134 determines the Y-axis based on the movement change amount of the subject along the Y-axis direction. The movement of the subject along the direction may be detected. The movement detection unit 134 may detect the movement of the subject along the Y direction when the amount of movement change of the subject along the Y-axis direction is equal to or greater than the threshold A or equal to or less than the threshold −A.

  When the magnitude of the movement change amount of the subject along the Y-axis direction is smaller than the third reference amount and greater than or equal to the fourth reference amount smaller than the third reference amount, the movement detection unit 134 The movement of the subject along the Z-axis direction may be detected based on the luminance change amount. The movement detection unit 134 has a magnitude of the movement change amount of the subject along the X-axis direction that is smaller than the first reference amount and greater than or equal to the second reference amount, and a magnitude of the movement change amount of the subject along the Y-axis direction. Is smaller than the third reference amount and equal to or larger than the fourth reference amount smaller than the third reference amount, the movement of the subject along the Z-axis direction is detected based on the subject area change amount and the luminance change amount. May be.

  When the movement change amount of the subject along the Y-axis direction is smaller than the threshold A and greater than or equal to the threshold B, the movement detection unit 134 determines whether the subject along the Z-axis direction is based on the area change amount and the luminance change amount of the subject. Movement may be detected. The movement detection unit 134 moves along the Z-axis direction based on the area change amount and the luminance change amount of the subject when the movement change amount of the subject along the Y-axis direction is larger than the threshold −A and equal to or smaller than the threshold −B. The movement of the subject may be detected.

  When the movement change amount of the subject along the X-axis direction is smaller than the threshold A and greater than or equal to the threshold B, and the movement change amount of the subject along the Y-axis direction is smaller than the threshold A and greater than or equal to the threshold B, the movement detection unit 134 The movement of the subject along the Z-axis direction may be detected based on the subject area change amount and the luminance change amount. The movement detection unit 134 has a movement change amount of the subject along the X-axis direction that is greater than the threshold value -A and less than or equal to the threshold value -B, and a movement change amount of the subject along the Y-axis direction is greater than the threshold value -A and less than or equal to the threshold value -B. In this case, the movement of the subject along the Z-axis direction may be detected based on the area change amount and the luminance change amount of the subject.

  The transmission / reception unit 106 outputs the movement detection result registered in the detection result holding unit 136 to the effect control unit 40 in response to a request from the effect control unit 40. The effect control unit 40 detects the movement detection result of the subject along the moving direction in order to determine whether the subject, for example, the player's hand has moved along the moving direction corresponding to the executable effect. Request to device 100. In response to the request, the transmission / reception unit 106 refers to the movement detection result registered in the detection result holding unit 136 and follows the designated movement direction (X-axis direction, Y-axis direction, or Z-axis direction). A movement detection result indicating whether or not the subject has moved is transmitted to the effect control unit 40.

  In addition, the production control unit 40 or the control unit 30 of the gaming machine 10 may have some functions included in the movement detection device 100. For example, the effect control unit 40 may include a movement detection unit 134 and a detection result holding unit 136. Further, the effect control unit 40 may include a luminance change amount deriving unit 122, an area change amount deriving unit 125, a first movement change amount deriving unit 128, and a second movement change amount deriving unit 132.

  FIG. 8 is a flowchart illustrating an example of a processing procedure of the image analysis unit 110. The image analysis unit 110 periodically repeats this processing procedure. First, the image acquisition unit 112 acquires an 8-bit grayscale image output from the imaging unit 102 (S100). Next, the binarization conversion unit 114 converts the 8-bit grayscale image into a binarized image (S102). Next, the labeling processing unit 116 performs a labeling process on the binarized image (S104). The luminance change amount deriving unit 122, the area change amount deriving unit 125, the first movement change amount deriving unit 128, and the second movement change amount deriving unit 132 are the luminance change amount, the area change amount, the X axis direction, and the Y axis direction. The amount of movement change is derived. The movement detection unit 134 detects the movement of the subject based on the luminance change amount, the area change amount, and the change amount of the movement in the X-axis direction and the Y-axis direction (S106). The movement detection unit 134 registers the movement detection result of the subject in the detection result holding unit 136 (S108).

  With the above processing procedure, the image analysis unit 110 updates the movement detection result of the subject every time an image is acquired.

  9A, 9B, and 9C are flowcharts illustrating an example of a procedure of movement detection processing for detecting movement of the subject of the movement detection unit 134. FIG. The movement detection unit 134 performs a movement detection process every time the image acquisition unit 112 acquires an image.

  In FIG. 9A, the movement detection unit 134 acquires the area of the subject (S200), and determines whether the area of the subject is equal to or greater than the threshold value St (S202). When the area of the subject is equal to or smaller than the threshold value St, the movement detection unit 134 sets the number of retained images to 0 (S204), determines that no movement of the subject has been detected (S268 (FIG. 9C)), and performs movement detection processing. finish. On the other hand, when the area of the subject is equal to or larger than the threshold value St, the movement detection unit 134 increments the number of retained images (S206). The movement detection unit 134 stores the barycentric coordinates in association with the image (S208).

  Next, the movement detection unit 134 determines whether there are three or more held images (S210). If the number of retained images is less than 3, the movement detection process is terminated. When the number of held images is three or more, the movement detection unit 134 changes the amount of change X1 (= x1-x2), X2 (= x2-) of the movement of the subject in the center-of-gravity coordinates in the XY axis direction for the three held images. x3), Y1 (= y1-y2), and Y2 (y2-y3) are acquired (S212). Here, x1 and y1 indicate the center-of-gravity coordinates of the subject of the latest image I1. x2 and y2 indicate the barycentric coordinates of the subject of the image I2 immediately before the latest image. x3 and y3 indicate the barycentric coordinates of the subject of the image I3 two images before the latest image.

  The movement detection unit 134 determines whether or not the change amount X1 is greater than or equal to the threshold A (S214). That is, the movement detection unit 134 determines whether or not the subject has moved in the X axis + direction between the image I2 and the image I1. If the amount of change X1 is greater than or equal to the threshold A, the movement detector 134 further determines whether or not the amount of change X2 is greater than or equal to the threshold A (S216). When the change amount X2 is equal to or greater than the threshold value A, there is a high possibility that the subject has moved in the X axis + direction between the image I3 and the image I1, and therefore the movement detection unit 134 causes the subject to move in the X axis + direction. The movement is detected (S218), and the movement detection process is terminated. On the other hand, when the change amount X2 is smaller than the threshold value A, since there is a low possibility that the subject has moved in the X axis + direction from the image I3 to the image I1, the movement detection unit 134 moves in the X axis + direction of the subject. It is determined that there is no movement, and the process proceeds to the next process (the process shown in FIG. 9B).

  When the change amount X1 is smaller than the threshold value A, the movement detection unit 134 determines whether or not the change amount X1 is equal to or less than the threshold value -A (S220). That is, the movement detection unit 134 determines whether or not the subject has moved in the X-axis direction between the image I2 and the image I1. When the change amount X1 is equal to or less than the threshold −A, the movement detection unit 134 determines whether or not the change amount X2 is equal to or less than the threshold −A (S222). When the change amount X2 is equal to or smaller than the threshold −A, there is a high possibility that the subject has moved in the X-axis direction between the image I3 and the image I1, and therefore the movement detection unit 134 causes the subject to move in the X-axis direction. Is detected (S224), and the movement detection process is terminated.

  When the amount of change X1 or X2 is larger than the threshold −A, the movement detection unit 134 determines that the subject does not move in the X-axis direction, and proceeds to the next process (the process illustrated in FIG. 9B). .

  In FIG. 9B, the movement detection unit 134 determines whether or not the amount of change Y1 is greater than or equal to the threshold A (S226). That is, the movement detection unit 134 determines whether or not the subject has moved in the Y axis + direction between the image I2 and the image I1. If the change amount Y1 is greater than or equal to the threshold A, the movement detection unit 134 further determines whether or not the change amount Y2 is greater than or equal to the threshold A (S228). When the amount of change Y2 is greater than or equal to the threshold value A, there is a high possibility that the subject has moved in the Y axis + direction between the image I3 and the image I1, and therefore the movement detection unit 134 causes the subject to move in the Y axis + direction. The movement is detected (S230), and the movement detection process is terminated. On the other hand, when the change amount Y2 is smaller than the threshold value A, since there is a low possibility that the subject has moved in the Y axis + direction from the image I3 to the image I1, the movement detection unit 134 moves in the Y axis + direction of the subject. Therefore, the process proceeds to the next process (S238).

  When the change amount Y1 is smaller than the threshold value A, the movement detection unit 134 determines whether or not the change amount Y1 is equal to or less than the threshold value -A (S232). That is, the movement detection unit 134 determines whether or not the subject has moved in the Y-axis direction between the image I2 and the image I1. When the change amount Y1 is equal to or smaller than the threshold −A, the movement detection unit 134 determines whether or not the change amount Y2 is equal to or smaller than the threshold −A (S234). When the change amount Y2 is equal to or smaller than the threshold −A, there is a high possibility that the subject has moved in the Y-axis direction between the image I3 and the image I1, and therefore the movement detection unit 134 causes the subject to move in the Y-axis direction. Is detected (S236), and the movement detection process is terminated.

  If the change amount Y1 or Y2 is larger than the threshold −A, the movement detection unit 134 determines that the subject does not move in the Y-axis direction, and proceeds to the next process (S238).

  When the movement detection unit 134 determines that the subject does not move along the X-axis direction and the Y-axis direction, the change amount X1 is smaller than the threshold A to determine the possibility of the subject moving in the Z-axis direction. It is determined whether or not it is equal to or greater than the threshold B (S238). When the change amount X1 is equal to or greater than the threshold value B, the movement detection unit 134 further determines whether or not the change amount X2 is equal to or greater than the threshold value B (S240). If the amount of change X2 is equal to or greater than the threshold value B, there is a possibility that the subject may move in the Z-axis direction, so the next process for determining whether or not the subject has moved in the Z-axis direction (the process shown in FIG. 9C). Migrate to When the change amount X1 or X2 does not satisfy the condition of the threshold value B, the movement detection unit 134 determines that the movement of the subject has not been detected (S268 (FIG. 9C)), and ends the movement detection process.

  In FIG. 9C, the movement detection unit 134 changes the subject brightness changes H1 (= E1-E2) and H2 (= E2-E3), the subject area change amount J1 (= S1-S2), and the change amount J2. (= S2-S3) is acquired (S250). Here, E1 and S1 indicate the luminance and area of the subject of the image I1. E2 and S2 indicate the luminance and area of the subject of the image I2. E3 and S3 indicate the luminance and area of the subject of the image I3.

  The movement detection unit 134 determines whether or not the luminance change amount H1 is greater than or equal to the threshold value C (S252). That is, the movement detection unit 134 determines whether the subject has become brighter between the image I2 and the image I1. When the luminance change amount H1 is greater than or equal to the threshold C, the movement detection unit 134 further determines whether or not the luminance change amount H2 is greater than or equal to the threshold C (S254). When the luminance change amount H2 is equal to or greater than the threshold C, the movement detection unit 134 determines whether the area change amounts J1 and J2 are smaller than 0 (S256). That is, the movement detection unit 134 determines whether or not the area of the subject gradually decreases between the image I3 and the image I1.

  When the area change amounts J1 and J2 are smaller than 0, the movement detection unit 134 detects that the subject has moved in the Z-axis + direction (S258), and ends the movement detection process. When the change amount H2 is smaller than the threshold C, or when at least one of the area change amounts J1 and J2 is 0 or more, the movement detecting unit 134 determines that the movement of the subject has not been detected (S268), and detects the movement. The process ends.

  If the luminance change amount H1 is not equal to or greater than the threshold C, the movement detection unit 134 determines whether the luminance change amount H1 is equal to or greater than the threshold −C (S260). That is, the movement detection unit 134 determines whether or not the subject has become dark between the image I2 and the image I1. When the luminance change amount H1 is equal to or less than the threshold −C, the movement detection unit 134 further determines whether the luminance change amount H2 is equal to or less than the threshold −C (S262). When the luminance change amount H2 is equal to or smaller than the threshold −C, the movement detection unit 134 determines whether or not the area change amounts J1 and J2 are larger than 0 (S264). That is, the movement detection unit 134 determines whether or not the area of the subject gradually increases between the image I3 and the image I1.

  When the area changes J1 and J2 are larger than 0, the movement detection unit 134 detects that the subject has moved in the Z-axis-direction (S266), and ends the movement detection process. If the change amount H1 or the change amount H2 is greater than the threshold −C, or if at least one of the area change amounts J1 and J2 is 0 or less, the movement detection unit 134 determines that the movement of the subject has not been detected ( S268), the movement detection process is terminated.

  As described above, the movement detection unit 134 determines whether or not there is a possibility of movement in the Z-axis direction according to the amount of change in movement of the subject along the XY axis. Then, when the movement detection unit 134 determines that there is a possibility of movement of the subject in the Z-axis direction, the movement detection unit 134 detects movement of the subject in the Z-axis direction based on the area of the subject and the amount of change in luminance. . Thereby, for example, the movement detection unit 134 can detect the movement of the player's hand moving along the Z-axis direction with the wrist as a base point with higher accuracy.

  FIG. 10 is a flowchart showing an example of a processing procedure of the gaming machine 10 when a game ball is won.

  When the input signal control unit 32 receives a winning signal from the winning sensor 18 (S300), the jackpot lottery unit 36 executes a jackpot lottery (S302). The gaming machine control unit 34 receives the result of the jackpot lottery, and executes the gaming machine presentation lottery to determine the contents of the gaming machine presentation (S304). The gaming machine control unit 34 transmits to the effect control unit 40 via the data transmission unit 38 an effect command indicating the content of the effect determined as a result of the gaming machine effect lottery.

  The effect control unit 40 determines whether it is necessary to detect the movement of the subject in order to execute the effect indicated by the effect command (S306). When it is necessary to detect the movement of the moving body, for example, the movement of the player's hand in a specific movement direction, the instruction unit 44 displays a prompting screen that prompts the player to move the hand in a specific direction. It is displayed on the device 14. For example, the instruction unit 44 causes the display device 14 to display a screen as shown in the screen 310 in FIG. 11A, the screen 320 in FIG. 11B, or the screen 330 in FIG. 11C, and moves the player's hand in a specific movement direction. Remind you.

  Further, the production control unit 40 instructs the movement detection device 100 about the movement direction of the detection target to request the movement detection device 100 to detect the movement of the subject in the specific movement direction (S308), and starts the production timer. (S310).

  Next, the effect control unit 40 acquires the movement detection result of the subject with respect to the movement direction of the detection target from the movement detection device 100 (S312). The effect execution unit 50 determines whether the movement of the subject in the movement direction of the detection target is detected based on the movement detection result (S314). When the movement of the subject in the movement direction of the detection target is detected, the effect execution unit 50 executes an effect for movement detection corresponding to the movement direction of the detection target as the movement effect (S316). For example, the display device control unit 52 displays an image in which the character moves in the moving direction of the detection target, and the sound device control unit 54 causes the sound device 22 to output sound according to the image. The display device control unit 52 shows, for example, the screen 312 in FIG. 11A as an example of the first effect, the screen 322 in FIG. 11B as an example of the second effect, or the screen 332 in FIG. 11C as an example of the third effect. A screen corresponding to the moving direction is displayed on the display device 14.

  After the execution of the movement effect according to the movement direction of the detection target, the effect execution unit 50 executes an effect for the lottery result for notifying the result of the jackpot lottery as the result effect (S318). The display device control unit 52 causes the display device 14 to display a lottery result screen indicating the result of the big hit lottery. For example, the display device control unit 52 causes the display device 14 to display a lottery result screen as shown on the screen 314 in FIG. 11A, the screen 324 in FIG. 11B, or the screen 334 in FIG. 11C.

  When the movement of the subject in the movement direction of the detection target is not detected, the effect control unit 40 determines whether or not the effect timer has timed out (S320). If the production timer has not timed out, the production control unit 40 acquires the movement detection result of the subject from the movement detection device 100 again. When the effect timer has timed out, the effect executing unit 50 executes the effect for the lottery result for notifying the result of the jackpot lottery as the result effect without executing the effect for detecting the movement as the movement effect. (S318).

  When it is not necessary to detect the movement of the moving body, the effect control unit 40 determines whether it is necessary to execute the moving effect before the result effect (S322). When it is necessary to execute the movement effect, the effect execution unit 50 displays the screen on which the character moves as the movement effect before notifying the lottery result, similarly to the case where the movement of the subject is detected. Is executed (S312). When it is not necessary to execute the movement effect, the effect execution unit 50 executes an effect for the lottery result as a result effect (S318).

  As described above, according to the gaming machine 10 according to the present embodiment, an effect can be executed according to the detection result of the movement of the subject in the X, Y, and Z axis directions by the movement detection device 100.

  Each unit included in the movement detection apparatus 100 according to the present embodiment is stored in a computer-readable recording medium, and a program for performing various processes related to the movement detection of the subject is installed, and the program is executed by the computer. It may be configured. That is, the movement detection apparatus 100 may be configured by causing a computer to function as each unit included in the movement detection apparatus 100 by causing a computer to execute a program for performing various processes related to movement detection of a subject.

  The computer has various memories such as a CPU, ROM, RAM, and EEPROM (registered trademark), a communication bus, and an interface. The CPU reads a processing program stored in advance in the ROM as firmware and sequentially executes the movement detection device. It functions as 100.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 Game machine 12 Case 14 Display apparatus 16 Handle switch 18 Prize sensor 20 Ball launcher 22 Sound apparatus 30 Control part 32 Input signal control part 34 Game machine control part 36 Big hit lottery part 38 Data transmission part 40 Production control part 42 Data transmission / reception Unit 44 instruction unit 50 effect execution unit 52 display device control unit 54 acoustic device control unit 100 movement detection device 102 imaging unit 104 infrared light emitting unit 106 transmission / reception unit 110 image analysis unit 112 image acquisition unit 114 binarization conversion unit 116 labeling processing unit 118 Subject Identification Unit 120 Luminance Deriving Unit 122 Brightness Change Deriving Unit 124 Area Deriving Unit 125 Area Change Deriving Unit 126 First Position Information Deriving Unit 128 First Movement Change Deriving Unit 130 Second Position Information Deriving Unit 132 Second Movement Change derivation unit 134 Movement detection unit 136 Detection result holding unit

Claims (8)

A subject identifying unit that identifies a subject included in each of a plurality of images continuously captured by the imaging unit;
A movement detection apparatus comprising: a movement detection unit configured to detect movement of the subject along a first direction perpendicular to an imaging surface of the imaging unit based on an area and luminance of the subject in the plurality of images. An area change amount deriving unit for deriving an amount of change in the area of the subject in the plurality of images;
A luminance change amount deriving unit for deriving the amount of change in luminance of the subject in the plurality of images;
The movement detection apparatus according to claim 1, wherein the movement detection unit detects movement of the subject along the first direction based on the change amount of the area and the change amount of the luminance. A first movement change amount deriving unit that derives a change amount of movement of the subject specified by the subject specifying unit along a second direction parallel to the imaging surface in the plurality of images;
The movement detector is
When the change amount of the movement along the second direction is equal to or larger than the first reference amount, the movement of the subject along the second direction is detected based on the change amount of the movement along the second direction. And
When the change amount of the movement along the second direction is smaller than the first reference amount and equal to or larger than a second reference amount smaller than the first reference amount, based on the change amount of the area and the change amount of the luminance. The movement detection device according to claim 2, wherein the movement of the subject along the first direction is detected. A second movement change amount deriving unit for deriving a movement change amount along a third direction parallel to the imaging surface different from the second direction of the subject specified by the subject specifying unit in the plurality of images; In addition,
The movement detector is
When the change amount of the movement along the third direction is equal to or greater than a third reference amount, the movement of the subject along the third direction is detected based on the change amount of the movement along the third direction. And
The amount of change in movement along the second direction is smaller than the first reference amount and greater than or equal to the second reference amount, and the amount of change in movement along the third direction is the third reference amount. The movement of the subject along the first direction is detected based on the amount of change in the area and the amount of change in the brightness when the amount is smaller and the fourth reference amount is smaller than the third reference amount. Item 4. The movement detection device according to Item 3.   The imaging unit continuously captures the plurality of images according to the amount of reflected light of a specific wavelength of light irradiated toward a detection target region for detecting movement of the subject. The movement detection apparatus according to claim 1.   When the movement detection unit changes in a direction in which the area of the subject decreases and the luminance of the subject changes in a direction in which the luminance increases, the direction in which the subject approaches the imaging unit along the first direction The movement detection apparatus according to claim 1, wherein the movement detection apparatus detects that the movement is performed.   The movement detection unit is a direction in which the subject moves away from the imaging unit along the first direction when the area of the subject changes in a direction in which the area increases and the luminance of the subject changes in a direction in which the luminance decreases. The movement detection apparatus according to claim 1, wherein the movement detection apparatus detects that the movement is performed.   The program for functioning a computer as a movement detection apparatus as described in any one of Claims 1-7.