JP2010022673A - Finger input device and game device using finger input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a non-contact type input device of a portable (or compact) game device. <P>SOLUTION: The finger input device of the game device (1) includes a case part (10) including a finger input space (15) in which a finger can move, a finger position determination means (12) for determining the guiding position of the finger (F) from outside to the finger input space, a two-dimensional sensor part (40) provided in the case part for detecting one after another the finger tip position in the finger input space, and a two-dimensional display part (20) provided in the case part (10) visually recognizably from outside and capable of displaying at least the finger movement and a game image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a finger input device that enables an instruction operation to a game device using a finger, and a game input device using the finger input device.

In a video game device that displays an image, a so-called controller is used to perform an input operation. An operation amount is input by pressing a lever or a button provided on the controller. In such a game device, there are problems that the input operation cannot be varied, and the input device is easily damaged due to touch. Therefore, the invention described in Patent Document 1 proposes an input device or a game device that inputs a command to the game device by the movement of the player's body.
JP 2001-137543 A

  However, the input device of the game device described in Patent Document 1 is large and is premised on installation in a place such as an amusement center. It is difficult to use in a portable game device or a small game device that a player can carry and enjoy.

  Accordingly, one object of the present invention is to provide a non-contact input device for a portable (or small) game device. Moreover, it is providing the input device which can perform non-contact input operation with a motion of a fingertip. Furthermore, it is an object of the present invention to provide a game device that can perform an input operation with the movement of a fingertip.

  In order to achieve the above object, a finger input device according to the present invention includes a case unit including a finger input space in which a finger can be moved and a finger input from the outside to the finger input space. A finger position determining means for determining an introduction position; a two-dimensional sensor unit provided in the case unit for sequentially detecting the position of the fingertip in the finger input space; and provided in the case unit so as to be visible from the outside, A two-dimensional display unit capable of displaying at least one of finger movements and game images.

  With this configuration, an input operation can be performed by the movement of a finger in the finger input space. Further, the movement of the finger can be known by displaying the internal invisible finger movement on the two-dimensional display unit as a pseudo image. Also, since the finger movement (how to bend) constrained by the joint is limited by determining the introduction position of the finger to be placed in the case as a specific position, the amount of data processing required to detect finger movement and fingertip position Is less.

  It is desirable that the finger position determining means is a ring body or the like that can regulate a finger insertion hole or a finger position into the finger input space provided in the case portion. Thereby, the movement of the finger is restricted by the edge of the insertion hole of the case part or the ring body, and the introduction position of the finger can be determined with a simple configuration.

  The two-dimensional sensor unit includes a light source unit and a plurality of light receiving elements arranged two-dimensionally in a matrix, facing each other through the finger input space, and outputs an array position of the matrix as the position of the fingertip. It is desirable. Thereby, the position of the finger (or fingertip) can be detected two-dimensionally without contact. Note that the output of the matrix array position need not be a matrix address display (a combination of vertical and horizontal numbers and codes) itself, but continuous or discontinuous as long as it is associated with the matrix array position. The number or code may be sufficient as long as it can be identified by the processing by the CPU.

  It is desirable that the position of the insertion hole is set so as to correspond to a diagonal position of a matrix arrangement by the plurality of light receiving elements. Thereby, it is possible to set a large movement range of the fingertip.

  The fingertip of the finger inserted into the finger input space through the insertion hole can move in an arc shape around the insertion hole, and the matrix arrangement of the plurality of light receiving elements is It is desirable that the position is corrected corresponding to the arc-shaped trajectory. Thereby, it becomes a detector arrangement corresponding to the movement of the finger constrained by the joint, and it is possible to detect the position according to the movement of the finger.

  In addition, a game apparatus according to the present invention includes the input device having the above-described configuration, a storage unit that stores in advance a plurality of images corresponding to positions of a plurality of fingertips in the finger input space, and the two-dimensional sensor. First image forming means for reading an image corresponding to the position of the fingertip detected based on the output of the unit from the storage unit and outputting the image to the two-dimensional display unit.

  With this configuration, a non-contact type finger input game device can be obtained.

  In addition, the game device of the present invention includes the finger input device having the above-described configuration, and between the fingertip position and the diagonal position on the matrix arrangement detected based on the output of the two-dimensional sensor unit. And a second image forming means for forming an image of a finger and outputting it to the two-dimensional display unit.

  With this configuration, an image from the base of the finger to the fingertip is displayed on the two-dimensional display.

  According to another aspect of the present invention, there is provided a game device including the input device configured as described above, and a motion determination unit that determines a moving speed of the fingertip based on an output of at least two fingertip positions of the two-dimensional sensor unit. A storage unit that stores in advance a plurality of images respectively corresponding to the positions of the plurality of fingertips in the finger input space and a plurality of complementary images respectively corresponding between the positions of two adjacent fingertips; When the moving speed of the fingertip is faster than a reference value, an image corresponding to the position of the fingertip detected based on the output of the two-dimensional sensor unit is read from the storage unit and output to the two-dimensional display unit. When the speed is slower than the reference value, the complementary image corresponding to the position between the two fingertips is also associated with the delay between the outputs of the two fingertip positions of the two-dimensional sensor unit. And a third image forming means for outputting to the two-dimensional display section above reads the number.

  By adopting such a configuration, even when the finger moves slowly, the display image changes smoothly, and the problem that the image changes rapidly can be solved.

  The game device of the present invention includes the input device configured as described above, and corresponds to the gesture storage unit that stores in advance a gesture that is a position change pattern of a certain range of the fingertip in the finger input space, and the gesture. Next, it is determined whether or not a gesture image storage unit that stores an image to be displayed on the two-dimensional display unit in advance and a series of fingertip movements detected by the two-dimensional sensor unit correspond to the gesture stored in advance. And a fourth image forming unit that reads an image corresponding to the gesture from the gesture image storage unit and outputs the image to the two-dimensional display unit when the movement of the fingertip corresponds to the gesture. Is provided.

  With this configuration, a specific finger display in the finger input space, for example, a specific image display such as an animation (moving image) on the game device by making a gesture such as poke, repel, press, strok It is possible to display still images, game images, and the like.

  The game device of the present invention includes the input device configured as described above, and corresponds to the gesture storage unit that stores in advance a gesture that is a position change pattern of a certain range of the fingertip in the finger input space, and the gesture. A gesture program storage unit that stores a game program to be executed in advance, and a gesture determination unit that determines whether a series of fingertip movements detected by the two-dimensional sensor unit corresponds to the gesture stored in advance. When the movement of the fingertip corresponds to the gesture, a fifth image forming unit that reads out and executes a game program corresponding to the gesture from the gesture program storage unit and outputs the result to the two-dimensional display unit; .

  With this configuration, it is possible to cause the game device to execute a specific program by making a gesture of a specific finger in the finger input space, for example, a gesture such as poke, repel, press, strok, and sway. .

  Note that the above-described finger input device may be an input device using a rod-like body such as a pencil or a ballpoint pen instead of a finger. That is, an input device of a game apparatus, which includes a case portion including an input space capable of moving a rod-shaped body, position determining means for determining an introduction position of the rod-shaped body from the outside to the input space, and the case A two-dimensional sensor unit provided in the unit for sequentially detecting the position of the tip of the rod-shaped body in the input space, and provided at the case unit so as to be visible from the outside, at least one of the movement of the rod-shaped body and a game image May be provided.

  In such a configuration, it is possible to configure an input device for a smaller game device. Conversely, when the input device is configured in a large size, the arm is made to correspond to the rod-shaped body, and the input to the game device can be performed by the movement of the arm.

  Embodiments of the present invention will be described below with reference to the drawings.

  First, the outline of the configuration of a game device provided with the finger input device of the present invention will be described with reference to FIGS. Corresponding parts are denoted by the same reference numerals in the drawings.

  FIG. 1 is a perspective view of a game apparatus provided with the finger input device of the present invention. The game apparatus 1 includes a hexahedral case portion 10 having an overall shape of a quadrangular prism. The case part 10 is produced by molding plastic (synthetic resin), and an LCD display 20 as a two-dimensional display part for visually displaying an image is provided on the front panel. On the lower right of the front panel, there is provided a switch 11 for instructing a later-described CPU to turn on / off the power and special modes.

  An insertion hole 12 for inserting a finger of a hand (for example, an index finger) into a finger input space 15 described later provided in the case portion 10 is provided on the upper portion of the right side panel of the case portion 10 (see FIG. 3). ). The insertion hole 12 functions as a finger position determining unit that determines the position where the finger is introduced into the finger input space 15 and determines the relative position of the finger base with respect to a matrix of a two-dimensional sensor described later. An annular ring body that functions similarly instead of the insertion hole 12 may be arranged on the right side surface of the case portion 10.

  FIG. 2 is a perspective view showing an example in which the case portion 10 is cut in the front-rear direction (front-rear direction) at the substantially center portion of the front panel. As shown in the figure, in the case unit 10, in addition to the LCD display 20 described above, a two-dimensional sensor unit for detecting the position of the fingertip and the movement of the finger in the finger input space is provided. The two-dimensional sensor unit includes a light source unit 30, a sensor array unit 40, a sensor interface 42 and a shift register unit 44, which will be described later. The light source unit 30 and the sensor array unit 40 are arranged to face each other via the finger input space 15. The light source unit 30 includes, for example, an LED 32 whose light emission angle range is set to a wide angle, an LED and a diffusion plate that use the emitted light of the LED as a surface light source, a surface emitting (organic / inorganic) EL, and the like. Composed. The sensor array unit 40 is configured by arranging phototransistors as light receiving elements in a matrix on a substrate, for example. In addition, it is possible to prevent the influence of external visible light by making the light source part 30 and the sensor array part 40 into an infrared light emitting element and an infrared light receiving element. A microcomputer system to be described later is provided on the same substrate as this substrate or on another substrate. The sensor interface 42 and the shift register unit 44 described above are realized by a microcomputer system 50 described later.

  As shown in FIG. 2, a speaker 57 and a power source 58 are provided on the back side of the case unit 10. Known speakers can be used and are not particularly limited. For example, it is desirable to use a piezo speaker with low power consumption. The power source 58 is a power source for the finger input device and the game device, and a primary battery or a secondary battery can be used. In the illustrated example, 4.5 volts are obtained by three batteries, but it is not limited to a specific power source as long as required power can be obtained.

  3 and 4 are explanatory diagrams for explaining the outline of the operation of the finger input device of the present application.

  As shown in FIG. 3, the space defined by the left and right side panels of the case unit 10, the substrate of the light source unit 30, and the substrate of the sensor array unit 40 forms a finger input space 15. The finger F is inserted into the finger input space 15 through the insertion hole 12. The finger F may be any finger on the left and right hands, but an index finger is preferred. As described above, a rod-like body such as a pencil or a ballpoint pen can be used instead of the finger. In such a case, a smaller input device can be configured.

  As shown in FIG. 4A, when the finger F is inserted into the finger input space 15, the finger F blocks a part of the radiated light from the light source unit 30, and as shown in FIG. The shadow of the finger F is made on the array unit 40. Each output of each phototransistor of the sensor matrix of the sensor array unit 40 is amplified through an amplifier (not shown) if necessary, and is input to each data latch of the sensor interface 42. Each data latch latches each output of the sensor array unit 40 at a sampling timing predetermined by a control program (not shown), and each sensor output data in a matrix form corresponding to each sensor arrangement (array) position of the sensor array Get a group (matrix output).

  From the matrix output, for example, the position of the fingertip is detected by data processing by a microcomputer. For example, as will be described later, the position of the fingertip can be determined from the matrix output as the fingertip position from the leftmost and lowermost data arrangement position in the matrix arrangement (see FIG. 8).

  Next, as shown in FIG. 4C, a plurality of finger images corresponding to each position of the matrix arrangement are stored in advance in a plurality of storage units, and a finger image corresponding to the detected fingertip position is read from the storage unit. The image data is displayed on the LCD display 20. Thereby, the movement of the finger in the finger input space 15 that cannot be seen from the outside is displayed (see FIG. 9).

  The fingertip position is detected at a predetermined sampling timing (game screen display update interval), for example, at intervals of 0.1 to 0.2 seconds, and the LCD display image of the finger is updated. As a result, when the finger F is moved, the finger displayed on the LCD display 20 is updated following the movement of the finger F and is displayed as a moving image.

  As will be described later, in addition to the image of the player's finger movement, an image corresponding to the finger position is displayed by displaying an image of a game character or the like, corresponding to the movement of the finger position (finger movement). In this way, a game image in which the image changes sequentially and a game image in which the game progress is developed by the movement of the finger are displayed, so that an interesting image effect can be obtained.

  The fingertip position is stored in time series in a storage unit such as a shift register described later. The speed of movement of the fingertip is determined based on the position change amount of the fingertip position in unit time. For example, it is possible to complement the screen image corresponding to this speed and make it appear as a natural moving image. Further, a predetermined fingertip action (gesture) is determined by comparing the position change pattern of the fingertip position with the position change pattern of the fingertip position stored in advance. For example, finger movements such as “poke”, “flick”, “press”, “stroking”, “make go” are discriminated. Game development can be performed in response to such a gesture.

  FIG. 5 is an explanatory diagram for explaining a control system of a game device including the finger input device of the present application. In the figure, parts corresponding to those in FIGS. 1 to 3 are denoted by the same reference numerals, and description thereof will be omitted.

  As shown in FIG. 5, many of the functions of the game apparatus 1 are realized by using a known microcomputer system 50 configured by one IC chip or a plurality of IC chips.

  The microcomputer system 50 includes a CPU 51, a ROM 52, a RAM 53, an image memory unit 54, an image output unit 55, a sound source unit 56, a power supply unit 58, a switch interface 59, and the like. The sensor interface 42 and the shift register 44 described above are also provided.

  The CPU 51 controls the game device by executing a game program and a control program for each unit. It has functions equivalent to a so-called video game, and has functions such as control and movement of a game character (robot) arranged in a virtual game space developed in the RAM 53, determination of game win / loss, and formation of a game image. A ROM 52 corresponding to the storage unit stores various programs, image data, and the like. The RAM 53 stores an execution program, data processing data, game space formation, game parameters, game flags, and the like. The image memory 54 forms an image to be displayed on the LCD display 20 by holding the read image, combining it with the game image, and the like. The image output unit 55 outputs the image formed in the image memory 54 to the LCD display 20 as an image signal.

  The CPU 51, the image memory 54, the image output unit 55, and the control program constitute the first to fifth image forming units described above.

  The sound source unit 56 converts the audio data sent from the CPU 51 into an audio signal according to the game scene, power-amplifies it, and supplies it to the speaker 57. In the present application, for example, when a specific gesture is detected on a specific game screen, it is possible to generate a sound associated with the gesture in advance.

  The power supply unit 58 supplies necessary power to the LCD display 20, the light source unit 30, the sensor array unit 40, the microcomputer 50, and the like.

  The switch interface 59 turns on and off the power according to the operation of the switch 11 by the player. If no input operation is performed on the game device even after a predetermined time has elapsed (timeout), the game device (CPU) is instructed to end the game, the power supply is cut off, or the game mode is switched to the clock mode. The operation of the game device is switched to the display or calendar display mode. In addition, an interrupt signal can be generated to the CPU in response to an operation of a reset switch R provided on the back surface of the case unit 10 to instruct to stop or end the execution program.

  As described above, the sensor interface 42 includes a plurality of data latches that hold the outputs of the sensor array unit 40. Each data latch takes in each output of the sensor array section 40 at a predetermined sampling cycle, and obtains a data group (matrix output) of each sensor output arranged in a matrix. For example, these data groups are sent to a predetermined area of the RAM 53 and are subjected to data processing by a microcomputer. The position of the fingertip is detected by this process. The detected fingertip position is sent to a shift register 44 that stores a series of fingertip positions.

  In place of the shift register 44, the RAM 53 can be used as a shift register. Further, the sensor interface 42 itself may have a function of detecting the position of the fingertip.

  Next, an example of fingertip position detection and image display will be described with reference to FIGS. FIG. 6 shows an arrangement example of each sensor of the sensor array unit 40. In FIG. 6A, nine sensors (indicated by circles in the figure) are arranged in three columns (1, 1). 2, 3) and 3 rows (A, B, C) horizontally arranged in a matrix (3 × 3). The diagonal position that is the upper right position (A, 1) of the matrix position corresponds to the insertion hole 12 portion of the finger F.

  The formation position of the insertion hole 12 may be, for example, other diagonal positions (A, 3), (C3), (C, 1). In the case of the position (A, 3), it is suitable for the case of left-hand insertion with an insertion hole provided on the left side surface. In the case of the positions (C, 3) and (C, 1), the condition is good in the case of the left hand finger upward insertion and the right hand finger upward insertion, respectively.

  By determining the introduction position of the finger to be inserted into the case to a specific position (in the embodiment, a diagonal position) by the insertion hole 12, the movement of the finger constrained by the joint (how to bend) is limited. There is an advantage that the amount of data processing required to detect the movement and fingertip position can be reduced.

  FIG. 6B shows another arrangement example of each sensor in the sensor array unit 40. As described above, in the sensor arrangement example of FIG. 6A, nine sensors are arranged in a matrix at regular intervals in the vertical direction and the horizontal direction. On the other hand, in the example shown in FIG. 6B, the matrix sensor arrangement position is corrected corresponding to the actual fingertip movement by the first to third joints of the finger. That is, the first to third joints cause the finger to bend only from the open state to the inside of the hand, and the base of the finger exists at the position of the insertion hole 12, with this part as the first center, The sensor arrangement position is corrected in consideration of the movement of the fingertip having the joints at the second and third centers along an arcuate locus.

  A matrix arrangement of a plurality of light receiving elements is corrected in correspondence with the arcuate trajectory of the fingertip, so that a detector arrangement corresponding to the actual finger movement restricted by the joint is obtained. This makes it possible to detect the position accordingly.

  FIG. 7 is an explanatory diagram illustrating an example of a display screen displayed on the screen according to the position of the fingertip of the finger inserted into the finger input space. The figure shows an example of a finger image displayed on the LCD display 20 when a fingertip exists at each position (A, 1) to (C, 3) in the matrix in which nine sensors of FIG. 6 are arranged. Is shown. When the finger moves in the row direction (left-right direction, 1 → 3 direction in the figure), an image in which the finger is extended is obtained. Further, when the finger moves in the column direction (vertical direction in the figure, A → C direction), an image in which the finger is bent is obtained.

  Next, various data processing by the CPU will be described. The CPU has various functions as a finger input device and a game device.

  FIG. 8 is a flowchart for explaining the procedure by which the CPU 51 determines the fingertip position from the output of the interface 42.

  As described above, the finger F is inserted into the finger input space 15, and the output of each sensor of the sensor array unit 40 is input to each data latch of the sensor interface 42 (see FIGS. 3 and 4). Each data latch latches each output of the sensor array section 40 at a predetermined sampling timing, and obtains a data group (matrix output) of each sensor output in a matrix corresponding to each sensor arrangement (array) position of the sensor array. . These sensor output data groups are transferred from the sensor interface 42 to a predetermined area of the RAM 53 at a predetermined timing (DMA operation). When the data group is taken into the RAM 53, the sensor interface 42 sets a sensor flag of a flag register (not shown) to ON. The flag register can also be realized by using a predetermined area of the RAM 53.

  If the CPU 51 determines that the sensor flag is set to ON by the interrupt command or the flag register check routine during execution of the main program (step S12; YES), the CPU 51 executes this routine.

  First, the CPU 51 reads the output of each sensor arranged in a matrix (step S14) and determines the fingertip position (step S16). The fingertip arrangement is determined by, for example, determining the leftmost and lowermost data arrangement position in the matrix arrangement in the output data group indicating the presence of the finger as the fingertip position. Of course, the fingertip position may be determined using another determination algorithm.

  When the fingertip position is determined, data indicating the fingertip position, for example, the matrix array element number (address) is written to a predetermined fingertip position register (or a predetermined area of the RAM 53), and the fingertip position output flag of the flag register is set to ON. (Step S18). Thereafter, the CPU 51 returns to the main program.

  In this way, the movement of the finger is taken into the sensor interface 42 every predetermined sampling period, and this routine is executed each time the fingertip position is continuously detected. This fingertip position is also sent to the shift register 44 described above, and a predetermined number of fingertip position data is held in time series, and the fingertip trajectory is held. This data is used for finger movement speed determination and gesture determination, which will be described later.

  FIG. 9 is a flowchart illustrating an example in which the CPU 51 displays an image corresponding to the fingertip position.

  When the CPU 51 determines that the fingertip position output flag indicating that the fingertip position has been detected is turned on, the CPU 51 executes this routine (step S22).

  First, the CPU 51 reads the position of the fingertip from the fingertip position register. For example, as shown in FIG. 7, the position (A, 1) is read. The CPU 51 reads out image data corresponding to the position (A, 1) from the ROM 52 with reference to an address conversion table stored in advance (step S26). The bitmap data of the image is transferred to the image memory 54, and an operation is commanded to the image output unit 55 (step S28). Thereby, an image signal is sent to the LCD display 20, and an image of a finger indicated by 20 in FIG. 7 is displayed. Thereafter, the CPU 51 returns to the main program. In this example, the CPU 51, the image memory 54, the image output unit 55, and the control program correspond to the first image forming unit described above.

  As described above, the fingertip position is detected in time series, and an image of the finger corresponding to the position of the fingertip at that time is displayed on the LCD display 20, whereby the finger in the finger input space 15 in the case unit 10 is displayed. Can be seen.

  In the above example, the image corresponding to the fingertip position is read from the storage unit (ROM 52) and displayed on the LCD display 20, but the finger base position (diagonal position) held in the RAM 53 is displayed. And the detected fingertip position may be drawn by CPU processing to form a pseudo finger and displayed on the LCD display 20. In this case, the image holding amount is reduced and the condition is good. In this example, the CPU 51, the image memory 54, the image output unit 55, and the control program correspond to the second image forming unit described above.

  FIG. 10 is a flowchart for explaining an example in which the CPU 51 detects the moving speed of the fingertip. As will be described later, when the player's finger moves slowly in the finger input space, the finger display image tends to change drastically. In such a case, it is desirable to smooth the movement of the image by complementing the intermediate image between the display images corresponding to the fingertip arrangement. As a premise for performing such processing, it is necessary to detect the speed of movement of the fingertip (moving speed).

  When the CPU 51 determines that the fingertip position output flag indicating that the fingertip position has been detected is turned on, the CPU 51 executes this routine (step S30).

  First, the CPU 51 reads the position of the fingertip from the shift register 44 that stores the position of the fingertip in time series (step S32). For example, the difference between the previous fingertip position and the current fingertip position (for example, the vector distance) is obtained (step S34). It may be the difference between the previous position and the current position. The position difference is divided by the time difference between the two data to obtain the fingertip speed. If data sampling is performed at regular intervals, the difference value may be treated as a speed (step S36). The detected fingertip speed is written to the fingertip speed detection register. The fingertip speed detection register may be assigned a predetermined area in the RAM 53 (step S38). Thereafter, the CPU 51 returns to the main program.

  As will be described later, when the speed of the fingertip position is detected, the number of complementary images can be determined according to the speed of the fingertip position, and the movement of the display image can be made as smooth as possible (see FIG. 13). .

  In this way, information on the finger position and the speed of finger movement in the finger input space is output from the finger input device to the game device.

  Next, a game device that uses the above-described finger input device will be described with reference to FIGS. FIG. 11 is a flowchart for explaining the overall operation using the finger input device.

  As shown in FIG. 11, the cell is turned on by the switch 11 and the CPU 51 executes an initial program to initialize each part and read the game program (step S40). Next, a predetermined opening program is executed to display an opening screen displaying a game title, a logo, and the like (step S42). Thereafter, the CPU 51 reads a standby screen for waiting for the player's input from the ROM 52 and displays it on the LCD display 20.

  When determining that the finger has been inserted into the finger input space based on the output of the sensor interface 42, the CPU 51 displays a menu selection screen for selecting a game from among a plurality of games on the LCD display 20 (step S46). When a game is selected by a finger operation, the corresponding game is executed. Various games are possible. For example, in the present application, a game in which the character performs various actions in response to the movement of the fingertip is developed (step S48). When the game ends, it returns to the standby state.

  As shown in FIG. 12, in the game device, the CPU 51 sets a flag register during the game execution (step S48, step S52) at every game screen update interval, for example, every 0.1 second to 0.2 second. It is judged whether or not the interrupt processing can be performed (S54). If it is good (step S54; YES), the CPU 51 determines that the above-described fingertip position output flag indicating that the fingertip position has been detected is turned on (step S56; YES).

  First, the CPU 51 reads the position of the fingertip from the fingertip position register. Further, the type and scene of the current game are determined, and the game screen corresponding to the fingertip position is read from the ROM 52 using the corresponding address conversion table and displayed on the LCD display 20 via the image memory 54 and the image output unit 55. (Step S58). Thereafter, the process returns to the game (step S48).

  FIG. 13 is a flowchart for explaining an example in which the number of display screens per unit time is changed according to the speed of fingertip movement. 14 and 15 are diagrams illustrating an example of image complementation.

  The CPU 51 executes this routine at a predetermined timing when the complement output of the flag register is turned on during execution of the main program. The CPU 51 reads the detected fingertip speed from the fingertip speed detection register described above (step S62).

  The CPU 51 compares the detected fingertip speed with a predetermined discrimination reference value to determine the speed. For example, a distinction is made between two levels of high and low and three levels of high, medium and low. In this embodiment, the determination is made in three stages (step S64).

  In addition, since the fingertip position is recorded in the shift register 44 in time series, for example, when the same fingertip position continues three times, the speed is low, when it is twice, the medium speed, once In this case, the speed may be determined such as high speed. In this case, the calculation burden is small (see steps S34-36).

  When the CPU 51 determines that the movement of the fingertip is high speed (step S64; high speed), there is no need to interpolate the image, so that the fingertip position output is output from the above described fingertip position register or shift register 44 as shown in FIG. Reading (step S66), an image corresponding to this position is read from the ROM and sent to the image memory 54 (step S68).

  When the CPU 51 determines that the fingertip movement is medium speed (step S64; medium speed), it is desirable to interpolate the image, so the fingertip position output is read from the fingertip position register or the shift register 44 (step S70), and the current game In the scene, a series of image groups 1 (for example, two images) corresponding to this position are read from the ROM 52 stored in advance and sent to the image memory 54 (step S72).

  When the CPU 51 determines that the movement of the fingertip is low speed (step S64; low speed), it is necessary to interpolate an image, so the fingertip position output is read from the fingertip position register or the shift register 44 (step S74), and this position is reached. A corresponding series of image groups 2 (for example, 3 sheets) is read from the ROM 52 stored in advance and sent to the image memory 54 (step S76).

  Note that the number of complementary images at medium speed and low speed is not limited to the above number, and is set to a number that can provide an appropriate visual effect.

  The image stored in the image memory 54 is output to the LCD display 20 as a video signal by the image output unit 55. When the fingertip moves at a high speed, the image is sent out at a normal frame rate. In the case of medium speed, the image is transmitted with the frame rate increased by the complementary image. In the case of the low speed, the image is transmitted with the frame rate further increased by the complementary image (step S78). Thereafter, the CPU 21 returns to the main program.

  FIG. 14 is an explanatory diagram for explaining image complementation. This figure shows that complementary images are inserted between position (A, 2) and position (A, 3) and between position (A, 3) and position (B, 3), respectively. Yes. As described above, the number of complementary images is set to an appropriate number based on an appropriate series of images.

  FIG. 15 shows an image example when one interpolation image is arranged between the detection positions in the case of finger position detection by the 3 × 3 sensor arrangement shown in FIG. 7. In FIG. 7, the horizontal positions “1”, “2”, and “3” in FIG. 7 correspond to “10”, “20”, and “30”, respectively. The vertical positions “A”, “B”, and “C” correspond to “A0”, “B0”, and “C0”, respectively.

  In this way, it is possible to smoothly change the game image by complementing the image according to the speed of finger movement. In this example, the CPU 51, the image memory 54, the image output unit 55, and the control program constitute the third image forming means described above.

  Next, the gesture will be described with reference to FIGS. In this game device, a player moves a specific finger on a predetermined screen of the game, for example, “poke”, “flick”, “push”, “crush”, “make”, “rub”, “ When “tickling” is performed, the game screen changes or the game development changes accordingly. For this purpose, the movement of a specific finger is detected and the corresponding game image is selected or the corresponding game is developed.

  FIG. 16 is a flowchart illustrating an example of detecting whether or not a specific action (gesture) is performed with the fingertip. As shown in the figure, the CPU 51 determines whether or not a specific gesture has been made during the execution of the game (for example, step S48).

  First, gesture information (fingertip position change pattern) allowed on the screen of the currently executed game is read from the ROM 52 (step S82). Here, the ROM 52 corresponds to a gesture storage unit. Next, a series of movements of the fingertip position held in the shift register 44 is read (step S84). It is determined whether or not the fingertip movement at the predetermined position corresponds to a specific gesture defined in advance (step S86).

  For example, as shown in images 1 and 2 in FIG. 18, when a face image is displayed, the position of the fingertip is continuously moved five times or more between the position (B, 1) and the position (C, 1). Then, based on the gesture information obtained from the ROM 52, the CPU 51 determines that the “rubbing (earring) operation” (gesture) has been performed in relation to the face image (step S86). A number (code) corresponding to this gesture is written in a gesture register (not shown) (step S88). Also, the gesture flag is set to ON in the flag register. The predetermined area of the RAM 53 may be a gesture register. The CPU 51 returns to the original program after writing the gesture number or determining that there is no gesture (step S86; NO).

  Next, as shown in FIG. 17, when the gesture flag is set in the flag register, the CPU 51 displays a moving image such as an animation and develops a corresponding game. When detecting the gesture (step S92; YES), the CPU 51 reads the gesture number from the gesture register (step S94). The CPU 51 reads a series of images (animation) or game program corresponding to the gesture number from the ROM 52 (step S96). Here, the ROM 52 corresponds to a gesture image storage unit or a gesture program storage unit. The CPU 51 sends the read image data to the image memory 54. The image output unit 55 supplies a series of images to the LCD display 20 to display a laughing face animation (moving image) as shown in image 3 in FIG. Then, after the laughing face is repeated several times, an angry face as shown in the image 4 is displayed. The CPU 51, the image memory 54, the image output unit 55, and the control program in this example correspond to a fourth image forming unit.

  When the game program is read from the ROM 52, the game is executed, and the game development corresponding to the gesture is performed. In the game development, an image may be formed by a game program and the face image as described above may be switched to another image. Further, the game development state may be changed in a virtual game space formed in the computer system like a video game. The CPU 51, the image memory 54, the image output unit 55, and the control program in this example correspond to a fifth image forming unit.

  The CPU 51 ends the routine and returns to the original program after performing image display or the like or when no gesture is detected (step S92; NO).

  In the above-described example, the CPU 51 performs processing of the interface portion of the finger input device (position detection, speed detection, gesture detection, etc.) and processing of the game device, but the CPU is divided into the finger input device and the game device. It is good also as a structure provided separately. Thereby, faster and more complex operation is possible.

  As described above, according to the finger input device of the embodiment of the present invention, when the player moves his / her finger in the finger input space, the position of the finger, the speed of movement, and a command based on a predetermined operation of the finger are not contacted. Can be output to the game device. In addition, a game device using the finger input device of the present application can provide a game that can be enjoyed by a non-contact finger movement.

It is a perspective view of the game device provided with the finger input device of the present invention. It is a perspective view which shows the cut model of the game device provided with the finger input device of this invention. It is explanatory drawing explaining the finger input device of this invention. It is explanatory drawing explaining the screen display of the finger | toe inserted in finger input space and the finger in the finger input device of this invention. It is a block diagram explaining the control system of the game device provided with the finger input device of this invention. It is explanatory drawing explaining a two-dimensional sensor part. It is explanatory drawing explaining the example of the display screen displayed on a screen according to the position of the fingertip of the finger inserted in finger input space. It is a flowchart explaining operation | movement of the interface which discriminate | determines a fingertip position. It is a flowchart explaining the example which displays the image corresponding to a fingertip position. It is a flowchart explaining the example which detects the moving speed of a fingertip. It is a flowchart explaining the whole operation | movement of the game device which uses a finger input device. It is a flowchart explaining the game part which uses a finger input. It is a flowchart explaining the example which changes the number of screens according to the speed of a fingertip's movement. It is a figure explaining the example of an image complement. It is explanatory drawing explaining the example which displays a complementary image corresponding to the position between sensors when the two-dimensional sensor of the number of 3x3 sensors is used. It is a flowchart explaining the example which detects the case where a specific operation | movement (gesture) is performed with a fingertip. It is a flowchart explaining the example which displays an animation on a display based on a specific gesture. It is a flowchart explaining the example of the animation which generate | occur | produces when performing a specific gesture in a specific screen.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Game device, 10 Case part, 12 Insertion hole, 15 Finger input space, 20 LCD display, 30 Light source part, 40 Sensor array part, 50 Microcomputer system

Claims (10)

A finger input device for a game device,
A case part including a finger input space capable of moving a finger;
Finger position determination means for determining a position of introduction of a finger from the outside to the finger input space;
A two-dimensional sensor unit that is provided in the case unit and sequentially detects the position of the fingertip in the finger input space;
A finger input device comprising: a two-dimensional display unit provided on the case unit so as to be visible from the outside and capable of displaying at least one of the finger movement and the game image.   The finger input device according to claim 1, wherein the finger position determining means is a finger insertion hole into the finger input space provided in the case portion.   The two-dimensional sensor unit includes a light source unit and a plurality of light receiving elements arranged two-dimensionally in a matrix, facing each other through the finger input space, and outputs an array position of the matrix as the position of the fingertip. The finger input device according to claim 1 or 2.   The finger input device according to claim 3, wherein the position of the insertion hole is set so as to correspond to a diagonal position of a matrix arrangement by the plurality of light receiving elements.   The fingertip of the finger inserted into the finger input space through the insertion hole can move in an arc shape around the insertion hole, and the matrix arrangement of the plurality of light receiving elements is The finger input device according to any one of claims 2 to 4, wherein the position is corrected in correspondence with an arcuate trajectory. A game device including the finger input device according to claim 1,
A storage unit that stores in advance a plurality of images corresponding to positions of a plurality of fingertips in the finger input space;
A first image forming unit that reads an image corresponding to the position of the fingertip detected based on the output of the two-dimensional sensor unit from the storage unit and outputs the image to the two-dimensional display unit;
A game device comprising: A game device including the finger input device according to claim 1,
Second image forming means for forming an image of a finger between a position of a fingertip on a matrix-like array and a diagonal position detected based on an output of the two-dimensional sensor unit and outputting the image to the two-dimensional display unit; A game device comprising: A game device including the finger input device according to claim 1,
Movement discriminating means for discriminating a moving speed of the fingertip based on an output of at least two fingertip positions of the two-dimensional sensor unit;
A storage unit that stores in advance a plurality of images respectively corresponding to the positions of a plurality of fingertips in the finger input space, and a plurality of complementary images respectively corresponding between the positions of two adjacent fingertips;
When the moving speed of the fingertip is faster than a reference value, an image corresponding to the position of the fingertip detected based on the output of the two-dimensional sensor unit is read from the storage unit and output to the two-dimensional display unit, and the fingertip When the movement speed of the two-dimensional sensor unit is slower than the reference value, the complementary image corresponding to the position between the two fingertips is also associated with the delay between the outputs of the two fingertip positions of the two-dimensional sensor unit. And a third image forming means for reading out and outputting to the two-dimensional display unit. A game device including the finger input device according to claim 1,
A gesture storage unit that stores in advance a gesture that is a position change pattern of a certain range of a fingertip in the finger input space;
A gesture image storage unit that stores in advance an image to be displayed on the two-dimensional display unit in association with the gesture;
Gesture discriminating means for discriminating whether a series of movements of the fingertip detected by the two-dimensional sensor unit correspond to the gesture stored in advance;
And a fourth image forming unit that reads an image corresponding to the gesture from the gesture image storage unit and outputs the image to the two-dimensional display unit when the movement of the fingertip corresponds to the gesture. A game device including the finger input device according to claim 1,
A gesture storage unit that stores in advance a gesture that is a position change pattern of a certain range of a fingertip in the finger input space;
A gesture program storage unit that stores in advance a game program to be executed in response to the gesture;
Gesture discriminating means for discriminating whether or not a series of fingertip movements detected by the two-dimensional sensor unit corresponds to the gesture stored in advance;
When the movement of the fingertip corresponds to the gesture, a fifth image forming unit that reads out and executes a game program corresponding to the gesture from the gesture program storage unit, and outputs the result to the two-dimensional display unit; A game device comprising:

Images