JP2006084324A - Operating state measuring apparatus of device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a measuring apparatus capable of detecting various operating states of a device without using a component such as a gyroscope sensor. <P>SOLUTION: A game controller GC comprises a handle 1, a color palette 21, and a controller 4. A CCD 13 disposed in the handle 1 images the color palette 21 in various operating states of the handle 1. The controller 4 analyzes the operating state of the handle 1 by analyzing an image of the color palette 21 imaged by the CCD 13. For example, vertical and lateral turning amounts of the handle 1, the rotation angle of the handle 1, a longitudinal moving amount of the handle 1, and the like are measured. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for measuring an operation state of a device that performs operations such as rotation.

  There are various techniques for detecting the rotational position of a device. In the following Patent Document 1 and Patent Document 2, a color filter is provided on a rotating member, light emitted from a light source is passed through the color filter, and the rotation position of the rotating member is analyzed by analyzing the color of the light that has passed. I try to detect it.

JP 2003-294491 A JP 2000-131041 A

  Some game controllers used in game devices have a tilt detection function. This game controller includes a gyro sensor, detects the tilt of the game controller by the gyro sensor, and sends the tilt signal of the game controller to the game device.

  By using the technique disclosed in Patent Document 1 or Patent Document 2, it is possible to detect the rotational position of the member, but the detectable operation is limited to rotation. Other complex operating states cannot be detected. In addition, since a light source is required to detect the rotational position, there is a problem that the number of parts of the detection means is large.

  Also, in a game controller having a gyro sensor, the gyro sensor is used only for the purpose of detecting the tilt of the device. For example, in order to realize a game controller having a camera function and a tilt detection function, And a gyro sensor are required, which increases the number of parts and increases the cost.

  In view of the above problems, an object of the present invention is to provide a technique capable of detecting a complicated operation of a device without requiring a complicated mechanism or apparatus.

  In order to solve the above-mentioned problem, the invention according to claim 1 is provided in a color palette substantially fixed with respect to a reference system and a device operable in a predetermined direction with respect to the reference system, and the color palette And an analysis unit that analyzes an operation state of the device with respect to the reference system by analyzing an image of the color palette imaged by the imaging device.

  According to a second aspect of the present invention, in the device operating state measuring apparatus according to the first aspect, the analyzing unit calculates a vertical movement amount of the imaging region on the color palette by the imaging device, Means for analyzing the vertical operating state of the device.

  According to a third aspect of the present invention, in the device operating state measuring apparatus according to the first aspect, the analyzing means calculates a movement amount in the left-right direction of the imaging region by the imaging device on the color palette. Means for analyzing a lateral operation state of the device.

  According to a fourth aspect of the present invention, in the device operation state measuring apparatus according to the first aspect, the analyzing means calculates the enlargement / reduction ratio of the imaging region on the color palette by the imaging device, thereby the device. Means for analyzing the operating state in the perspective direction with respect to the color palette.

  According to a fifth aspect of the present invention, in the device operating state measuring apparatus according to the first aspect, the analysis unit calculates a rotation angle of the imaging region on the color palette by the imaging device, thereby Means for analyzing the operating state in the rotational direction.

  According to a sixth aspect of the present invention, in the device operating state measuring device according to the first aspect, the analyzing means calculates the amount of vertical movement of the imaging region by the imaging device on the color palette. Means for analyzing the vertical operating state of the device, means for analyzing the horizontal operating state of the device by calculating a horizontal movement amount of the imaging region on the color palette by the imaging device, Means for analyzing an operating state of the device in the perspective direction with respect to the color palette by calculating an enlargement / reduction ratio of the imaging region on the color palette by the imaging device; and rotation of the imaging region on the color palette by the imaging device Means for analyzing the operating state of the device in the rotational direction by calculating an angle; Of comprises at least two means, characterized by analyzing the complex operational state of the device.

  According to a seventh aspect of the present invention, in the device operating state measuring apparatus according to any one of the first to sixth aspects, the device includes a game controller.

  In the present invention, a color palette is imaged by an imaging device, and the operation of the device is analyzed based on the captured image. Thereby, it is possible to analyze various operations of the device with a simple configuration without using a gyro sensor or a light source.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an overall overview diagram of a game controller GC according to an embodiment of the present invention. The game controller GC includes a handle 1, a color palette fixing base 2, and a member 3. The color pallet fixing base 2 is fixed to a member 3 serving as a reference system. The handle 1 includes a handle grip portion 11 and a handle shaft portion 12, and the handle grip portion 11 is rotatable about the axis of the handle shaft portion 12, and is used as a driving operation controller for a car racing game or the like. . The handle 1 is attached on the member 3 via a mechanism (not shown), and can perform various operations with respect to the reference system.

  2 to 6 are diagrams showing the configuration of the handle 1 and the operation of the handle 1. FIG. 2 is a front view of the handle 1. The handle 1 is capable of rotating along the rotation direction RD about the axis of the handle shaft 12.

  FIG. 3 is a rear view of the handle 1. A CCD 13 is attached to the rear end portion of the handle shaft portion 12 (the end portion opposite to the handle grip portion 11). The color pallet fixing base 2 is disposed on an extension line of the shaft center of the handle shaft portion 12, and the CCD 13 can image the color pallet 21 mounted on the color pallet fixing base 2. In this embodiment, a CCD is used as the imaging device, but a CMOS sensor or the like may be used in addition.

  FIG. 4 is a side view of the handle 1. As described above, the handle 1 is attached on the member 3 via a mechanism (not shown), and is rotatable in the vertical direction YD around the rotation center 121. FIG. 5 is a plan view of the handle 1. The handle 1 can be rotated in the left-right direction XD around a rotation center 122 by a mechanism (not shown). FIG. 6 is a side view of the handle 1. The handle 1 can be advanced and retracted in the front-rear direction DD, that is, in a direction far and away from the color palette 21 by a mechanism (not shown). As described above, the handle 1 according to the present embodiment can be operated in the four directions of the rotation direction RD, the up-down direction YD, the left-right direction XD, and the front-rear direction DD with respect to the member 3 that is a reference system.

  As shown in FIG. 7, the game controller GC includes a control unit 4. The control unit 4 includes an image analysis unit 41 and a memory 42. The memory 42 stores pattern data PD that records the color pattern of the color palette 21. The control unit 4 is a circuit group including a CPU, a digital circuit, and the like, and is provided in the member 3 or the handle 1.

  FIG. 8 is a diagram showing a color pattern of the color palette 21. Each color included in the color palette 21 is called a cell 22. In this figure, the color pattern is represented by a gray scale, but actually, it is a color pattern composed of multicolor cells 22 in which RGB color components are mixed at a predetermined ratio. In addition, the color of the cell 22 is expressed by (R, G, B). However, R, G, and B represent red, green, and blue components, respectively, and are represented by integers from 0 to 255, respectively.

  The color palette 21 in the present embodiment is a color palette composed of 127 colors. The cells 22 of the respective colors are arranged on the radiation with regularity, with the cell 22W located at the center of the color palette as the center. The cell 22W is a white cell and is represented by (255, 255, 255). The cell 22B is a complete blue cell and is represented by (0, 0, 255). The cell 22G is a complete green cell and is represented by (0, 255, 0). The cell 22R is a complete red cell (255, 0, 0), and the cell 22P is a purple cell and is represented by (255, 0, 255).

  In the direction from the cell 22W toward the cell 22B, the color of the cell 22 changes so that the B component gradually increases. For example, the R component and the G component gradually become smaller as (255, 255, 255) → (254,254,255) → (253,253,255). Similarly, in the direction from the cell 22W to the cell 22G, the color of the cell 22 changes so that the G component gradually increases. In the direction from the cell 22W toward the cell 22R, the color of the cell 22 changes so that the R component gradually increases. Then, in the direction from the cell 22W toward the cell 22P, the color of the cell 22 changes so that the B component and the R component gradually increase.

  Further, for each cell 22 that is not on the line connecting the cell 22W to the cells 22R, 22G, 22B, and 22P, the ratio of R, G, and B is determined according to the position of the cell, and a color corresponding to the ratio is assigned. ing. That is, the color component ratio can be determined from the positions of the cells 22 for all the cells 22 on the color palette 21 due to the regularity of the color palette 21.

  The color palette 21 in the present embodiment has a color pattern based on the above rules, but this is merely an example, and the regularity is not particularly limited. The pattern data PD stored in the memory 42 is obtained by converting the regularity of the color arrangement of the color palette 21 as described above into data.

  In the above configuration, the CCD 13 images the color palette 21. As described above, the handle 1 can be operated in the rotation direction RD, the vertical direction YD, the horizontal direction XD, and the front-rear direction DD, and the imaging region by the CCD 13 changes with this operation.

  FIG. 9 is a diagram showing a region of an image captured by the CCD 13 when the handle 1 operates in the vertical direction YD or the horizontal direction XD. Here, the imaging area 100 is an area in which the CCD 13 images the color palette 21 when the handle 1 is in the reference operation state. Here, the reference operation state is a state in which the handle 1 is positioned so that the CCD 13 captures an image near the approximate center of the color palette 21. That is, the handle 1 does not rotate in the up-down direction YD or the left-right direction XD, and is in the center position with respect to the rotation direction RD or the front-rear direction DD. However, for the reference operation state, it is only necessary to determine one operation state of the handle 1 as a reference, and the position may be set freely.

  On the other hand, the imaging areas 103 and 104 are areas that are imaged in a state in which the handle 1 is rotated in the vertical direction YD from the reference operation state. Specifically, the imaging area 103 is an area captured with the handle 1 rotated downward, and the imaging area 104 is an area captured with the handle 1 rotated upward. The imaging areas 101 and 102 are areas that are imaged in a state where the handle 1 is rotated in the left-right direction XD from the reference operation state. Specifically, the imaging area 101 is an area captured with the handle 1 rotated to the left, and the imaging area 102 is an area captured with the handle 1 rotated to the right. .

  When the CCD 13 images the color palette 21 in the imaging areas 101 to 104 as shown in FIG. 9, the captured image data is transferred to the image analysis unit 41. The image analysis unit 41 detects the amount of rotation of the handle 1 in the vertical direction YD or the horizontal direction XD by analyzing the image data.

  The contents of the image analysis processing by the image analysis unit 41 will be described. A reference point BP for detecting the amount of rotation in the vertical direction YD or the horizontal direction XD is set, and the image analysis unit 41 calculates the movement amount of the reference point GP. Here, as shown in the figure, the upper left point of the imaging region is set as the reference point BP.

  As described above, in the color palette 21, the ratio of the blue component increases toward the cell 22B, and the ratio of the red component increases toward the cell 22R. And the change of the ratio has regularity. Therefore, the image analysis unit 41 calculates the change amount of the color component between the reference point P in the imaging region 103 or 104 and the reference point P in the imaging region 100, and refers to the regularity recorded in the pattern data PD. By doing so, the amount of movement of the imaging region in the vertical direction YD is calculated.

  Similarly, in the color palette 21, the ratio of the green component increases toward the cell 22G, and the ratio of the purple component increases toward the cell 22P. And the change of the ratio has regularity. Therefore, the image analysis unit 41 calculates the change amount of the color component between the reference point BP in the imaging region 101 or 102 and the reference point BP in the imaging region 100, and refers to the regularity recorded in the pattern data PD. By doing so, the amount of movement of the imaging region in the left-right direction XD is calculated.

  The image analysis unit 41 calculates the amount of rotation of the handle 1 based on the amount of movement of the imaging region in the vertical direction YD or the horizontal direction XD. The relationship between the amount of movement of the imaging region and the amount of rotation of the handle 1 may be obtained by calculation, or may be previously stored in the memory 42 as a table. In this way, the amount of rotation of the handle 1 in the vertical direction YD or the horizontal direction XD is obtained.

  As described above, the image analysis unit 41 analyzes the movement in the vertical and horizontal directions based on the regularity of the change in the color component. The operation may be analyzed.

  FIG. 10 is a diagram illustrating a region of an image captured by the CCD 13 when the handle 1 operates in the rotation direction RD. Similar to FIG. 9, the imaging region 100 is a region where the CCD 13 images the color palette 21 when the handle 1 is in the reference operation state. On the other hand, the imaging area 105 is an area where the CCD 13 images the color palette 21 in a state where the handle 1 is rotated in the rotation direction RD.

  When the CCD 13 images the color palette 21 in the imaging area 105 as shown in FIG. 10, the captured image data is transferred to the image analysis unit 41. The image analysis unit 41 detects the rotation angle related to the rotation direction RD of the handle 1 by analyzing the image data.

  The contents of the image analysis processing by the image analysis unit 41 will be described. As shown in FIG. 11, a reference line BL1 for detecting a rotation angle with respect to the rotation direction RD is set, and the image analysis unit 41 calculates the rotation angle of the reference line BL1. Here, as shown in the figure, a vertical line that passes through the center of the imaging region and bisects the imaging region is defined as a reference line BL1. As described above, the color palette 21 has a rule that the ratio of the color components changes radially around the central cell 22W. Therefore, the image analysis unit 41 calculates the amount of change in the color component of the cell 22 existing on the reference line BL1, and refers to the regularity recorded in the pattern data PD, whereby the imaging region 100 of the imaging region 105 is obtained. The rotation angle α with respect to is obtained. Then, the image analysis unit 41 calculates the rotation angle α of the imaging region as the rotation angle of the handle 1.

  Here, when the rotation angle α is calculated based on the change amount of the color component of the cell 22 existing on the reference line BL1, a plurality of angles are calculated as the rotation angle α. That is, 2π ± θ is calculated as a candidate for the rotation angle θ. Therefore, the rotation angle may be limited depending on the characteristics of the operating device. For example, when the device is the handle 1 of the game controller GC as in the present embodiment, if the CCD 13 has a performance of 30 fps, it is not possible to perform a handle operation of 180 degrees or more in 1/30 seconds. Is possible. Therefore, if the rotation angle range is set to −180 degrees to 180 degrees, the rotation angle can be uniquely determined.

  FIG. 12 is a diagram illustrating a region of an image captured by the CCD 13 when the handle 1 operates in the front-rear direction DD. Similar to FIG. 9, the imaging region 100 is a region where the CCD 13 images the color palette 21 when the handle 1 is in the reference operation state. On the other hand, the imaging area 106 is an area that is imaged in a state in which the handle 1 is moved in the forward direction, that is, in a direction away from the color palette 21, and the imaging area 107 is in the backward direction, that is, in the color state. This is an area imaged in a state of operating in a direction approaching the pallet 21.

  When the CCD 13 images the color palette 21 in the imaging area 106 or the imaging area 107 as shown in FIG. 12, this captured image data is transferred to the image analysis unit 41. The image analysis unit 41 detects the amount of movement of the handle 1 in the front-rear direction DD by analyzing the image data.

  The contents of the image analysis processing by the image analysis unit 41 will be described. As shown in FIG. 13, a reference line BL2 for detecting a movement amount in the front-rear direction DD is set, and the image analysis unit 41 calculates the number of cells 22 existing on the reference line BL2. Here, the diagonal line of the imaging region is used as the reference line BL2. The color palette 21 has a color arrangement so that the area and shape of each cell are the same. Therefore, the enlargement / reduction ratio of the imaging region 106 or the imaging region 107 with respect to the imaging region 100 can be calculated from the number of cells 22 present on the reference line. Then, the image analysis unit 41 calculates the movement direction and movement amount of the handle 1 with respect to the front-rear direction DD from the enlargement / reduction ratio of the imaging region. Note that the movement direction or movement amount may be calculated from the enlargement / reduction ratio of the imaging area by calculation, but the relationship between the enlargement / reduction ratio of the imaging area, the movement direction, and the movement amount is tabulated in advance and stored in the memory 42. You may make it leave. In this way, the operation state of the handle 1 in the front-rear direction DD is obtained.

  As described above, the image analysis unit 41 analyzes the image data input from the CCD 13 to detect an operation state related to the rotation direction RD, the vertical direction YD, the horizontal direction XD, and the front-rear direction DD of the handle 1 with respect to the reference system. Is possible.

  In the above-described embodiment, the case has been described in which the operations related to the rotation direction RD, the vertical direction YD, the horizontal direction XD, and the front-rear direction DD are performed independently. Next, an image analysis method when the operations in these directions are performed in combination will be described.

  FIG. 14 is a diagram illustrating a region of an image captured by the CCD 13 when the handle 1 operates in a complex manner with respect to the rotation direction RD, the vertical direction YD, the horizontal direction XD, and the front-rear direction DD. Similar to FIG. 9, the imaging region 100 is a region where the CCD 13 images the color palette 21 when the handle 1 is in the reference operation state. On the other hand, the imaging area 110 is an area that is imaged in a state where the handle 1 is operated in a complex manner.

  When the CCD 13 images the color palette 21 in the imaging area 110 as shown in FIG. 14, the captured image data is transferred to the image analysis unit 41. The image analysis unit 41 detects the combined operation state of the handle 1 by analyzing the captured image data.

  The contents of the image analysis processing by the image analysis unit 41 will be described. First, the enlargement / reduction ratio of the imaging area 110 with respect to the imaging area 100 can be calculated from the number of cells 22 existing on the diagonal line of the imaging area, as in the above-described embodiment. Also, the rotation angle of the imaging region 110 with respect to the imaging region 100 can be calculated from the rotation angle of the reference line BL1 passing through the center, as in the case shown in FIG. However, since the handle 1 operates in a complex manner, the reference line BL1 of the imaging region 110 does not pass through the central cell 22W, and therefore, it is necessary to perform a calculation method different from the embodiment shown in FIG.

  As the movement amount in the vertical direction YD and the horizontal direction XD, the movement amount of the point CP at the center of the imaging region is calculated. As described above, since the ratio of the color components regularly changes in the color palette 21, it is possible to calculate how much the center point CP has moved in the vertical direction YD and the horizontal direction XD. .

  When the image analysis unit 41 executes the above processing, it is possible to detect a complex operation state of the handle 1. As described above, according to the present invention, it is possible to measure the operating state of a device that performs various operations by using the imaging apparatus and the color palette. Further, even when the device is operated in various directions, the operation state can be measured.

  When the operation state of the handle 1 is measured by the image analysis unit 41, the control unit 4 sends a signal indicating the operation state of the handle 1 to a game device (not shown). The game device controls the game according to the operating state of the handle 1. By using the game controller GC in the present embodiment, it is possible to configure a game apparatus that can execute more various operations. In addition, the imaging device provided in the game controller can be used not only for motion detection but also for other images. Thus, by providing one image pickup device, it is possible to configure a game controller having a camera function and an operation detection function, and it is possible to reduce power consumption and the number of systems. .

  Also, compared with normal image analysis processing, there is no need to perform processing such as inter-frame comparison, and only by comparing the color palette information stored in the memory of the controller with the color information of a specific point of the captured image. The operation state of the device can be measured, and an operation with a high degree of freedom can be measured with a small DSP power.

  Furthermore, since a physical sensor such as a gyro sensor is not required, it is possible to reduce the system failure probability.

  In the above embodiment, the cells 22 arranged in the color palette 21 are arranged with regularity. However, it is not essential that the color arrangement of the color palette 21 has regularity. Even if the color arrangement of the color palette 21 is not regular, if the color arrangement of the color palette 21 is recorded as data, the movement of the device can be detected by referring to this data. Is possible. For example, if coordinate information and color information on the color pallet 21 are stored by a look-up table method, it is convenient for performing image analysis processing.

<Modification>
In the embodiment described above, the image in each operation state is compared with the image when the handle 1 is in the reference operation state, and the operation state is measured. As another method, a method may be used in which the immediately previous operation state is set as a reference operation state, the amount of change from the immediately previous operation state is obtained, and the current operation state of the handle 1 is obtained.

  The game controller GC in the above embodiment can freely customize the operation state signal for the game device by replacing one of the color palette 21 and the pattern data PD. For example, by adjusting the amount of movement and rotation, it is possible to change the sensation of steering wheel operations such as racing handles and passenger car handles. Further, by reversing the direction of rotation, it can be applied to a reverse rotation handle for a penalty game. It is also possible to simulate the “play” of the handle in a pseudo manner by applying an arbitrary delay to the determination time of the image analysis processing.

  In the above embodiment, the color pallet fixing base 2 is fixed to the reference member 3 and the CCD 13 is attached to the handle 1 for performing various operations. However, this may be reversed. Good. That is, the imaging device may be fixed to the member 3 serving as the reference system, and the color pallet may be attached to the handle 1 side.

It is a general-view figure of a game controller. It is a front view of a handle. It is a rear view of a handle. It is a side view of the handle showing the operation of the handle in the vertical direction. It is a top view of a handle showing operation of a handle in the left-right direction. It is a side view of the handle showing the operation of the handle in the front-rear direction. It is a block diagram of a game controller. It is a figure which shows the arrangement | sequence of a color palette. It is a figure which shows the area | region of the color pallet imaged by CCD in the state which the handle | steering-wheel operated to the up-down direction or the left-right direction. It is a figure which shows the area | region of the color palette imaged with CCD in the state which the handle | steering_wheel operated in the rotation direction. It is a figure which shows the reference line at the time of calculating a rotation angle. It is a figure which shows the area | region of the color pallet imaged with CCD in the state which the handle | steering-wheel operated in the front-back direction. It is a figure which shows the reference line at the time of calculating | requiring an enlargement / reduction rate. It is a figure which shows the area | region of the color pallet imaged with CCD in the state in which the handle | steering_wheel operated compoundly.

Explanation of symbols

1 Handle 2 Color Pallet Fixing Section 3 Member 4 Control Section 13 CCD
21 Color palette 22 Cell 41 Image analysis part DD Front-back direction RD Rotation direction XD Left-right direction YD Up-down direction

Claims (7)

A color palette substantially fixed relative to the reference system;
An imaging device provided in a device operable in a predetermined direction with respect to the reference system, and imaging the color palette;
Analyzing means for analyzing an operation state of the device with respect to the reference system by analyzing an image of the color palette imaged by the imaging device;
An apparatus for measuring an operating state of a device, comprising: The device operating state measuring apparatus according to claim 1,
The analysis means includes
Means for analyzing the vertical movement state of the device by calculating the vertical movement amount of the imaging area on the color palette by the imaging device;
An apparatus for measuring an operating state of a device, comprising: The device operating state measuring apparatus according to claim 1,
The analysis means includes
Means for analyzing an operation state of the device in the left-right direction by calculating the amount of movement in the left-right direction of the image pickup area on the color palette by the image pickup device;
An apparatus for measuring an operating state of a device, comprising: The device operating state measuring apparatus according to claim 1,
The analysis means includes
Means for analyzing an operation state of the device in the perspective direction with respect to the color palette by calculating an enlargement / reduction ratio of the imaging area on the color palette by the imaging device;
An apparatus for measuring an operating state of a device, comprising: The device operating state measuring apparatus according to claim 1,
The analysis means includes
Means for analyzing an operation state in a rotation direction of the device by calculating a rotation angle of the imaging region on the color palette by the imaging device;
An apparatus for measuring an operating state of a device, comprising: The device operating state measuring apparatus according to claim 1,
The analysis means includes
Means for analyzing the vertical movement state of the device by calculating the vertical movement amount of the imaging area on the color palette by the imaging device;
Means for analyzing a lateral operation state of the device by calculating a lateral movement amount of the imaging region on the color palette by the imaging device;
Means for analyzing an operating state of the device in the perspective direction with respect to the color palette by calculating an enlargement / reduction ratio of the imaging area on the color palette by the imaging device;
Means for analyzing an operation state in a rotation direction of the device by calculating a rotation angle of the imaging region on the color palette by the imaging device;
At least two means,
And a device operating state measuring apparatus for analyzing a composite operating state of the device. The device operating state measuring apparatus according to any one of claims 1 to 6,
The device operating state measuring apparatus, wherein the device includes a game controller.