JP2010158389A - Direction identifying device and direction identifying method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To specify which direction an incident light enters from. <P>SOLUTION: A data display/sensor device 100 includes: a light detecting part having a light receiving surface and adapted to detect incident light received by the light receiving surface; and a direction identifying part 122, which specifies the incident direction of the light based on the result of comparison between a contour in the light receiving surface of the light detected by the light detecting part when the light emitted from a light emitting device enters the light receiving surface and a predetermined contour of the part of light emitted by the emitting device. Thus, it is possible to specify which direction the incident light to the data display/sensor device 100 enters from. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a direction specifying device and a direction specifying method for specifying the direction of incident light.

  Conventionally, there is a shooting game in which a muzzle of a game gun is directed at a screen of a display device using a CRT (cathode-ray tube) to shoot a target on the screen. This is because the game machine main body, the display device, and the game gun are connected, and when the game gun trigger is pulled, the position on the screen where the muzzle of the game gun is opposed is specified. If the target is displayed at the position specified here, it is determined as hit.

  Then, the position on the screen where the muzzle of the game gun is facing is specified as follows.

  First, a description will be given of a method for specifying a position on a screen where a muzzle faces using a dot sequential scanning light emission type display device.

  That is, a light receiving sensor for receiving light from the light spot of the scanning line on the screen of the display device is arranged at the muzzle of the game gun. Then, the game gun outputs a trigger signal to the game machine body when the trigger (trigger) is pulled. When the game machine main body acquires a trigger signal from the game gun (when the game gun trigger is pulled), the game machine main body changes the next one-frame image to a light-emitting image in which all pixels are white. At this time, a light receiving sensor arranged at the muzzle of the game gun detects light from the light spot of the scanning line when the pixel on the screen facing the muzzle is scanned.

  On the other hand, a display device using a CRT displays an image by moving sequentially in the vertical direction while scanning an electron beam in a horizontal direction by a method called a raster scan method (dot sequential scanning light emission method).

  The game machine main body starts counting clock pulses from the start of electron beam scanning at the upper left of the screen, and the clock pulses from the start of counting to the time when the game gun detects light from the light spot of the scanning line. Is determined, the electron beam irradiation position corresponding to the count value is specified, and the position on the screen where the muzzle of the game gun is facing is specified (for example, Patent Documents 1 and 2) .

  Further, in display devices that do not use the dot sequential scanning light emission method such as LCD (liquid crystal display) and PDP (plasma display panel), which have become the mainstream in recent years, the muzzle is on the screen facing the screen. The position is specified as follows.

  For example, Patent Document 3 describes a configuration for specifying a position on a screen where a muzzle of a game gun is opposed to a display device such as an LCD or a PDP that does not use a dot sequential scanning light emission method.

  In the configuration described in Patent Document 3, a transparent EL panel is arranged in front of a display screen of a display device. And in patent document 3, a transparent glass substrate is provided in the said transparent EL panel, an electrode wire is arrange | positioned on this transparent glass substrate at a grid | lattice form, and a horizontal synchronizing signal and a vertical synchronizing signal are output with respect to this electrode wire. Infrared light is emitted at the intersection of the electrode wires. Then, by detecting the infrared light on the gun side, the position on the screen where the muzzle faces is specified using the same method as in the case of the dot sequential scanning light emission method described above.

  Patent Document 4 describes a configuration in which the position of the muzzle facing the screen is specified by emitting infrared rays from a game gun toward the screen and shooting the screen with an infrared camera or the like. Yes.

JP-A-8-117437 (published May 14, 1996) JP 2000-102671 A (released on April 11, 2000) JP 2003-320166 A (published on November 11, 2003) JP 2001-224856 A (released on August 21, 2001)

  The above-described conventional configuration specifies the position on the screen where the muzzle is directed, and refers to the direction in which the game gun (input device) is present when viewed from the screen. Not done.

  That is, in the above conventional configuration, when light is emitted from the game gun, it is possible to recognize the position on the screen where the emitted light is incident, but the light emitted from the game gun is From which direction the light is incident on the screen cannot be recognized.

  In the first place, in the above-described conventional configuration, the direction from which the light emitted from the game gun is incident on the screen is not a problem, and there is no need to solve this point.

  The present invention solves the problem of recognizing from which direction the incident light on the screen is incident on the screen, which has not been considered as a problem in the past. It is to realize a direction specifying device or the like that specifies whether the light is incident from the light source.

  In order to solve the above-mentioned problems, a direction specifying device according to the present invention is a direction specifying device that specifies an incident direction of incident light. The direction specifying device has a light receiving surface and detects light incident on the light receiving surface. And a contour of the light detected by the light detection unit when the light emitted from the light emitting device is incident on the light receiving surface, and a predetermined contour of a cross section of the light emitted from the light emitting device And a direction specifying means for specifying the incident direction of the light based on the comparison result.

  Further, the control method of the direction specifying device according to the present invention is a direction specifying method for specifying the incident direction of the incident light, and a light detecting step for detecting the light emitted from the emitting device received by the light receiving surface; A direction specifying step for specifying the incident direction of the light based on a comparison result between the contour of the light detected in the light detecting step on the light receiving surface and a predetermined contour of a cross section of the light emitted from the emitting device. It is characterized by including.

  According to the above-described configuration and method, the light detection unit has a light receiving surface, and includes a light detection unit that detects incident light received by the light receiving surface, and when the light emitted from the emitting device is incident on the light receiving surface, The incident direction of the light is specified based on a comparison result between the contour of the light detected by the light detection unit on the light receiving surface and a predetermined contour of a cross section of the light emitted from the light emitting device.

  More specifically, when the incident light does not diffuse with the distance, when the incident light enters from the direction perpendicular to the light receiving surface, the contour shape of the incident light on the light receiving surface and a predetermined cross section of the incident light The outline has the same shape. On the other hand, when incident light is incident from a direction other than the direction perpendicular to the light receiving surface, the shape of the contour of the incident light on the light receiving surface is different from the predetermined contour of the cross section of the incident light. Therefore, when the incident light is incident on the light receiving surface at what angle, the contour of the cross section of light having a predetermined cross section emitted from the emitting device is obtained as the shape of the contour. The obtained angle corresponds to the light incident direction. Even when light diffuses with distance, the angle can be obtained in consideration of diffusion. That is, the light may or may not diffuse with distance. In addition, the predetermined cross section may be a symmetric figure or an asymmetric figure.

  Thus, when light having a predetermined cross-sectional contour enters the light receiving surface, the incident direction of the light with respect to the light receiving surface can be specified.

  Furthermore, according to the above configuration and method, it is possible to perform processing according to the incident direction of light. For example, when light enters the light receiving surface from the right side, the power of the apparatus can be turned off, and when light enters the light receiving surface from the left side, the apparatus can be set to the sleep mode.

  In the direction specifying device according to the present invention, the light detection unit includes a plurality of photosensors arranged in a matrix in the display region, with the display region of the planar member that performs display serving as the light receiving surface. And a position specifying means for specifying an incident position of the incident light received in the display area of the planar member in the display area by a position in the matrix of the photosensor that detects the light. preferable.

  According to said structure, the said photon detection part consists of the several photosensor arranged in the matrix form in the display area of the planar member which performs a display. Then, the position specifying means specifies the incident position of the incident light received in the display area of the planar member in the display area depending on the position in the matrix where the light sensor that detects the light is arranged. The direction specifying means uses the contour of the shape in which the plurality of light sensors that detect light are arranged as the contour on the incident surface of the light incident on the planar member, and based on this, the direction of the incident light Specify the incident direction.

  As a result, display can be performed, and the incident direction of the light incident on the planar member and the incident position where the light hits the planar member can be specified. Can be identified.

  Furthermore, according to the above configuration, it is possible to perform processing in which display, an incident position of light, and an incident direction of light are combined.

  For example, consider a game device in which the emitting device is a light gun that emits light, displays a target on a display screen, and shoots the target with the light gun. When the target is displayed on the display screen, the incident position and the incident direction of the incident light can be specified, so whether or not the light emitted from the light gun hit the target displayed on the display screen, It can be determined from the position where the light emitted from the light gun hits the display screen and the target position displayed. In addition, since the direction in which the light emitting device is present can be specified from the direction of the incident light, the defense wall is displayed next to the target displayed on the display screen, and the defense wall is displayed. When a light gun is emitted from a certain direction, it can be determined that the light gun is not hit because it is protected by a defense wall.

  The direction specifying device according to the present invention may include a color discriminating unit that discriminates the color of light detected by the light detection unit.

  According to said structure, a color discrimination means discriminate | determines the color of the light detected by the photon detection part. Thereby, it can be recognized from which direction the light of which color is incident. That is, it is possible to recognize the light color and the light incident direction in association with each other.

  Moreover, a plurality of lights can be used simultaneously by changing the color of light. That is, when a plurality of lights having different colors are incident at the same time, the incident direction of the light for each color can be recognized.

  In addition, when the display is performed and the incident position of the light can be specified, the incident direction and the incident position of the light for each color can be specified in combination with the display.

  Furthermore, according to said structure, it becomes possible to perform the process according to the incident direction and color of light. For example, when red light is incident from the right direction, the power of the apparatus is turned off, and when blue light is incident from the left direction, the apparatus can be said to be in the sleep state.

  Further, when display is performed and the incident position of light can be specified, it is possible to perform processing according to the display, the incident position of light, and the color of light. For example, in a game device in which there are a plurality of light guns that are light emitting devices, each of which emits different light and is hit on the display screen, the light emitted from the light gun is displayed on the display screen. When hitting, it can be determined which light gun has hit the target.

  Thereby, a plurality of users can compete for which user's light gun has hit the target by emitting light to the target with the light gun.

  The direction specifying device according to the present invention includes a light receiving pattern discriminating means for discriminating a temporal pattern defined by a combination of a period during which light is received on the light receiving surface of the light detection unit and a period during which light is not received. It may be.

  According to said structure, a light reception pattern discrimination means discriminate | determines the temporal pattern prescribed | regulated by the combination of the period which is light-receiving on the light-receiving surface of a photon detection part, and the period which is not light-receiving. As a result, it is possible to recognize from what direction the temporal pattern of light is incident. That is, the temporal pattern and the incident direction of light can be recognized in association with each other.

  Further, a plurality of lights can be used by making the temporal patterns of light different. That is, when a plurality of lights having different temporal patterns are simultaneously incident, the incident direction of the light for each temporal pattern can be recognized.

  In addition, when the display is performed and the incident position of the light can be specified, the incident direction and the incident position of the light for each temporal pattern can be specified in combination with the display.

  Furthermore, according to said structure, it becomes possible to perform the process according to the incident direction and temporal pattern of light. For example, when light of a certain temporal pattern enters from the right direction, the power of the apparatus is turned off, and when light of another temporal pattern enters from the left direction, the apparatus can be said to be in a sleep state. .

  In addition, when the display is performed and the light incident position can be specified, it is possible to perform processing according to the display, the light incident position, and the temporal pattern. For example, in a game device in which there are a plurality of light guns that are emission devices, each emitting light in a different temporal pattern and being hit on the display screen, the light emitted from the light gun is displayed on the display screen. When the displayed hit is successful, it can be determined which light gun has emitted the light.

  Thereby, a plurality of users can compete for which user's light gun has hit the target by emitting light to the target with the light gun.

  In the direction specifying device according to the present invention, the diffusivity indicating how much the light detected by the light detection unit diffuses per unit distance and the size of the cross section of the light at a predetermined point after emission are shown. A storage unit that stores a reference representative value that is a representative value, a representative value that indicates a size of a cross section of the light detection surface of the light detected by the light detection unit, and the storage unit that stores the reference value A distance calculating means for calculating the distance between the light emitting device and the device itself may be provided based on the diffusivity and the reference representative value.

  According to the above configuration, the diffusion rate indicating how much light detected by the light detection unit diffuses per unit distance in the storage unit, and the size of the cross section of the light at a predetermined point after emission. And a reference representative value that is a representative value indicating. And the distance calculation means, by the representative value indicating the size of the cross section of the light receiving surface of the light detected by the light detection unit, the diffusivity and the reference representative value stored in the storage unit, The distance between the light emitting device and the device itself is calculated.

  More specifically, from the difference between the representative value indicating the size of the cross section on the light receiving surface and the reference representative value that is the representative value indicating the size of the cross section of the light at a predetermined point after emission, the predetermined value is obtained. It is determined how much the light is diffused between the point and the light receiving surface. Then, the distance that the light is diffused is calculated using the diffusivity. Thereby, the distance from the said predetermined point to the said light-receiving surface (self apparatus) is computable.

  Then, the distance between the emission device and the own device is calculated from the predetermined distance between the predetermined point and the emission device, and the distance between the predetermined point obtained above and the own device.

  If the predetermined point is a point immediately after the emission, the distance between the predetermined point and the own apparatus is the distance between the emission apparatus and the own apparatus.

  In addition, representative values indicating the size of the cross section include, for example, values such as a diameter and a radius if the cross section is a circle, and values such as the length of a diagonal line and the length of one side if the cross section is a square. it can.

  Thereby, the distance between the emitting device that has emitted the light detected by the light detection unit and the device itself can be calculated.

  In addition, when the display is performed and the incident position of the light can be specified, the incident direction and the incident position of the light can be specified in combination with the display, and the distance between the emission device and the own device can be calculated. .

  Furthermore, according to the above configuration, it is possible to perform processing in consideration of the distance between the light emitting device and the device itself. For example, when the distance between the light emitting device incident from the right direction and the own device is equal to or greater than a predetermined value, the power of the own device is turned off, and the distance between the light emitting device incident from the left direction and the own device is If it is smaller than the predetermined value, it can be said that the device itself is in a sleep state.

  In addition, when the display is performed and the incident position of the light can be specified, it is possible to perform processing according to the display, the incident position of the light, and the distance between the light emitting device and the device itself. For example, in a game device in which the light emitting device is a light gun that emits light and the target displayed on the display screen is shot with the light gun, if the light gun and the device itself are at a predetermined distance or more, the target is hit It can be determined not to. As a result, it is possible to cope with a case where the actual gun is far away from reaching the bullet, and a more realistic game device can be provided.

  In the direction specifying device according to the present invention, the direction specifying unit may output information indicating the specified direction to the outside.

  According to said structure, a direction specific | specification means outputs the specified direction to the exterior.

  Therefore, an external device that has acquired the direction specified by the direction specifying unit can recognize the direction specified by the direction specifying unit. For example, if the external device is a display device and can change the direction of the display screen of the display device together with the light receiving surface of the direction specifying device, the direction specifying is performed in association with the acquired direction specified by the direction specifying means. By changing the direction of the display screen of the display device together with the light receiving surface of the device, the display screen can be directed in the incident direction of the light.

  As described above, the direction specifying device according to the present invention has a light receiving surface, a light detection unit that detects incident light received by the light receiving surface, and light emitted from the emitting device is incident on the light receiving surface. Direction of specifying the incident direction of the light based on a comparison result between the contour of the light detected by the light detection unit on the light receiving surface and the predetermined contour of the cross section of the light emitted by the emitting device And a specifying means.

  Further, the method for controlling the direction specifying device according to the present invention includes a light detection step for detecting light emitted from the light emitting surface received by the light receiving surface, and a contour of the light detected in the light detection step on the light receiving surface. And a direction specifying step of specifying an incident direction of the light based on a comparison result with a predetermined contour of a cross section of the light emitted from the emitting device.

  Thus, when light having a predetermined cross-sectional shape is incident on the light receiving surface, the incident direction of the light with respect to the light receiving surface can be specified.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates an embodiment of the present invention, and is a block diagram illustrating a main configuration of a main control unit of a data display / sensor device and data stored in a storage unit. It is a figure which shows typically the cross section of the liquid crystal panel with a built-in sensor which concerns on the said embodiment. FIG. 3A is a schematic diagram showing a state in which a position touched by the user is detected by detecting a reflected image on the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment. FIG. 3B is a schematic diagram showing a state in which a position touched by the user is detected by detecting a shadow image with the sensor built-in liquid crystal panel included in the data display / sensor device according to the embodiment. It is a block diagram which shows the principal part structure of the data display / sensor apparatus which concerns on the said embodiment. It is a figure which shows typically an example of the frame structure of the command used with the data display / sensor apparatus which concerns on the said embodiment. It is a figure explaining an example of the value which can be specified to each field contained in the command shown in FIG. 5, and its outline. FIG. 7A shows image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel when the object is not placed on the sensor-equipped liquid crystal panel in the data display / sensor device according to the embodiment. It is. FIG. 7B shows image data obtained as a result of scanning when the user touches the sensor built-in liquid crystal panel with a finger in the data display / sensor device according to the embodiment. It is a block diagram which shows the structure of the liquid crystal panel with a sensor with which the data display / sensor apparatus which concerns on the said embodiment is equipped, and the structure of a peripheral circuit. It is explanatory drawing which shows the outline | summary of the whole said embodiment. In the said embodiment, it is explanatory drawing of the principle which a data display / sensor apparatus recognizes the position and shape of the light which injects into a liquid crystal panel with a built-in sensor. It is explanatory drawing which shows the relationship between the shape which the light which injected into the liquid crystal panel with a built-in sensor at the time of using the light diffused with distance in the said embodiment, and the incident direction. FIG. 11A is a diagram illustrating a shape indicated by incident light that has hit the liquid crystal panel with a sensor when light is incident on the liquid crystal panel with a sensor from a direction of 90 degrees. FIG. 11B is a top view of the light emitted from the light gun entering the sensor built-in liquid crystal panel from a direction of 90 degrees. FIG. 11C is a diagram showing the shape indicated by the incident light striking the sensor built-in liquid crystal panel when light is incident on the sensor built-in liquid crystal panel from the right side at an angle α. FIG. 11D is a view of the light emitted from the light gun as seen from above, viewed from above, from the right side with respect to the sensor built-in liquid crystal panel at an angle α. In the said embodiment, when the light which is not diffused is used, it is explanatory drawing which shows the relationship between the shape which the light which injected into the liquid crystal panel with a built-in sensor shows, and the incident direction. FIG. 12A is a diagram illustrating a shape indicated by incident light that has impinged on the sensor built-in liquid crystal panel when light is incident on the sensor built-in liquid crystal panel from a direction of 90 degrees. FIG. 12B is a top view of the light emitted from the light gun entering the sensor built-in liquid crystal panel from a direction of 90 degrees. FIG. 12C is a diagram showing the shape indicated by the incident light striking the sensor built-in liquid crystal panel when light is incident on the sensor built-in liquid crystal panel from the right side at an angle α. FIG. 12 (d) is a view of the light emitted from the light gun as seen from above, viewed from above, from the right side with respect to the sensor built-in liquid crystal panel at an angle α. FIG. 12E is a diagram showing the shape indicated by the incident light striking the sensor built-in liquid crystal panel when light is incident on the sensor built-in liquid crystal panel from the left side at an angle α with respect to the sensor built-in liquid crystal panel. FIG. 12 (f) is a view of the state where the light emitted from the light gun is incident from the left side at an angle α with respect to the sensor built-in liquid crystal panel as viewed from above. It is a flowchart which shows the flow of a process in which the data display / sensor apparatus based on the said embodiment judges whether the incident light hit successfully. FIG. 10 is a block diagram of a main control unit in a case where light incident on a liquid crystal panel with a built-in sensor of a data display / sensor device is discriminated, showing another embodiment of the present invention. FIG. 15A is a diagram illustrating an example of a correspondence table stored in an incident light data storage unit in the other embodiment, and FIG. 15A illustrates a case where the colors of light emitted from a plurality of light guns are different from each other. FIG. 15B is a diagram showing the correspondence table when the cross-sectional shapes of the light emitted from the plurality of light guns are different from each other. FIG. 15C is a diagram showing the correspondence table. It is a figure which shows a corresponding | compatible table when the emission patterns of the light which a gun radiate | emits differ, respectively. In the other embodiment, it is a diagram schematically showing a cross section of a sensor built-in liquid crystal panel in the case of determining the color of incident light. FIG. 17A is a diagram showing a relationship between a scan execution period and a light emission pattern of light incident on the sensor built-in liquid crystal panel in the sensor built-in liquid crystal panel according to the other embodiment. FIG. FIG. 17B is a diagram illustrating a case where the emission pattern is “111000”, and FIG. 17C is a diagram illustrating a case where the emission pattern is “1110”. It is. It is a flowchart which shows the flow of a process in which the data display / sensor apparatus which concerns on the said other embodiment judges whether the incident light hit successfully. FIG. 16 is a diagram illustrating still another embodiment of the present invention, and is an explanatory diagram illustrating a case where a light incident direction is a light incident direction when a light is incident on a sensor built-in liquid crystal panel. is there.

[Embodiment 1]
One embodiment of the present invention will be described below with reference to FIGS.

(Overall overview and overview of data display / sensor device functions)
First, with reference to FIG. 9, an overview of the entire embodiment of the present invention and an overview of the functions of the data display / sensor device (direction specifying device) 100 will be described. FIG. 9 is an explanatory diagram showing an overall outline of the present embodiment.

  As shown in FIG. 9, in the present embodiment, the target 101 displayed on the data display / sensor device 100 is shot using a light gun (outgoing device) 111 that emits light. It is to judge whether or not it hits.

  More specifically, the data display / sensor device 100 includes a sensor built-in liquid crystal panel (planar member) 301 and recognizes the position of light incident on the sensor built-in liquid crystal panel 301 and the direction of the incident light. Then, from the position of the incident light and the target position displayed, it is determined whether or not the incident light has hit the target.

  Moreover, since the data display / sensor device 100 can recognize the direction of the incident light, it can also make the following determination. That is, the data display / sensor device 100 displays the defense wall 102 on one side of the target 101 together with the target 101, and when light enters from the direction in which the defense wall 102 exists when viewed from the target 101, the light is incident. Even if the position matches the display position of the target 101, it may be determined that the target 101 is not hit.

  In the present embodiment, it is assumed that the light emitted from the light gun 111 diffuses (expands as the distance increases).

  Next, the sensor built-in liquid crystal panel 301 included in the data display / sensor device 100 will be described below.

(Outline of LCD panel with built-in sensor)
The sensor built-in liquid crystal panel 301 provided in the data display / sensor device 100 is a liquid crystal panel capable of detecting an image of an object in addition to displaying data. Here, the image detection of the object is, for example, detection of a position pointed (touched) by the user with a finger or a pen, or reading (scanning) of an image of a printed material. The device used for display is not limited to a liquid crystal panel, and may be an organic EL (Electro Luminescence) panel or the like.

  The structure of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 2 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301. The sensor built-in liquid crystal panel 301 described here is an example, and any structure can be used as long as the display surface and the reading surface are shared.

  As shown in the figure, the sensor built-in liquid crystal panel 301 includes an active matrix substrate 51A disposed on the back surface side and a counter substrate 51B disposed on the front surface side, and has a structure in which a liquid crystal layer 52 is sandwiched between these substrates. is doing. The active matrix substrate 51A is provided with a pixel electrode 56, a data signal line 57, an optical sensor circuit 32 (not shown), an alignment film 58, a polarizing plate 59, and the like. The counter substrate 51B is provided with color filters 53r (red), 53g (green), 53b (blue), a light shielding film 54, a counter electrode 55, an alignment film 58, a polarizing plate 59, and the like. In addition, a backlight 307 is provided on the back surface of the sensor built-in liquid crystal panel 301.

  The photodiode 6 included in the photosensor circuit 32 is provided in the vicinity of the pixel electrode 56 provided with the blue color filter 53b, but is not limited to this configuration. It may be provided in the vicinity of the pixel electrode 56 provided with the red color filter 53r, or may be provided in the vicinity of the pixel electrode 56 provided with the green color filter 53g.

  Next, with reference to FIGS. 3A and 3B, two types of methods for detecting the position where the user touches the sensor built-in liquid crystal panel 301 with a finger or a pen will be described.

  FIG. 3A is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a reflected image. When the light 63 is emitted from the backlight 307, the optical sensor circuit 32 including the photodiode 6 detects the light 63 reflected by the object 64 such as a finger. Thereby, the reflected image of the target object 64 can be detected. Thus, the sensor built-in liquid crystal panel 301 can detect the touched position by detecting the reflected image.

  FIG. 3B is a schematic diagram illustrating a state in which a position touched by the user is detected by detecting a shadow image. As shown in FIG. 3B, the optical sensor circuit 32 including the photodiode 6 detects external light 61 transmitted through the counter substrate 51B and the like. However, when there is an object 62 such as a pen, the incident of the external light 61 is hindered, so that the amount of light detected by the optical sensor circuit 32 is reduced. Thereby, a shadow image of the object 62 can be detected. Thus, the sensor built-in liquid crystal panel 301 can also detect a touched position by detecting a shadow image.

  As described above, the photodiode 6 may detect reflected light (shadow image) of the light emitted from the backlight 307 or may detect a shadow image caused by external light. Further, the two types of detection methods may be used in combination to detect both a shadow image and a reflected image at the same time.

(Data display / sensor configuration)
Next, with reference to FIG. 4, the configuration of the main part of the data display / sensor device 100 will be described. FIG. 4 is a block diagram showing a main configuration of the data display / sensor device 100. As shown in FIG. As illustrated, the data display / sensor device 100 includes one or more display / light sensor units 300, a circuit control unit 600, a data processing unit 700, a main control unit 800, a storage unit 901, a primary storage unit 902, and an operation unit. 903, an external communication unit 907, an audio output unit 908, and an audio input unit 909. Here, although the data display / sensor device 100 is described as including a single display / light sensor unit 300, a plurality of data display / sensor devices 100 may be included.

  The display / light sensor unit 300 is a so-called liquid crystal display device with a built-in light sensor. The display / light sensor unit 300 includes a sensor built-in liquid crystal panel 301, a backlight 307, and a peripheral circuit 309 for driving them.

  The sensor built-in liquid crystal panel 301 includes a plurality of pixel circuits 31 and photosensor circuits 32 arranged in a matrix. The detailed configuration of the sensor built-in liquid crystal panel 301 will be described later.

  The peripheral circuit 309 includes a liquid crystal panel drive circuit 304, an optical sensor drive circuit 305, a signal conversion circuit 306, and a backlight drive circuit 308.

  The liquid crystal panel driving circuit 304 outputs a control signal (G) and a data signal (S) in accordance with the timing control signal (TC1) and the data signal (D) from the display control unit 601 of the circuit control unit 600, and the pixel circuit 31. It is a circuit which drives. Details of the driving method of the pixel circuit 31 will be described later.

  The optical sensor driving circuit 305 is a circuit that drives the optical sensor circuit 32 by applying a voltage to the signal line (R) in accordance with a timing control signal (TC2) from the sensor control unit 602 of the circuit control unit 600. Details of the driving method of the optical sensor circuit 32 will be described later.

  The signal conversion circuit 306 is a circuit that converts the sensor output signal (SS) output from the optical sensor circuit 32 into a digital signal (DS) and transmits the converted signal to the sensor control unit 602.

  The backlight 307 includes a plurality of white LEDs (Light Emitting Diodes) and is disposed on the back surface of the sensor built-in liquid crystal panel 301. When a power supply voltage is applied from the backlight drive circuit 308, the backlight 307 is turned on and irradiates the sensor built-in liquid crystal panel 301 with light. Note that the backlight 307 is not limited to white LEDs, and may include LEDs of other colors. The backlight 307 may include, for example, a cold cathode fluorescent lamp (CCFL) instead of the LED.

  The backlight driving circuit 308 applies a power supply voltage to the backlight 307 when the control signal (BK) from the backlight control unit 603 of the circuit control unit 600 is at a high level, and conversely, the backlight control unit 603. When the control signal from is at a low level, no power supply voltage is applied to the backlight 307.

  Next, the circuit control unit 600 will be described. The circuit control unit 600 has a function as a device driver that controls the peripheral circuit 309 of the display / light sensor unit 300. The circuit control unit 600 includes a display control unit 601, a sensor control unit 602, a backlight control unit 603, and a display data storage unit 604.

  The display control unit 601 receives display data from the display data processing unit 701 of the data processing unit 700, and performs timing control on the liquid crystal panel driving circuit 304 of the display / light sensor unit 300 in accordance with an instruction from the display data processing unit 701. A signal (TC1) and a data signal (D) are transmitted, and the received display data is displayed on the sensor built-in liquid crystal panel 301.

  The display control unit 601 temporarily stores the display data received from the display data processing unit 701 in the display data storage unit 604. Then, a data signal (D) is generated based on the primary stored display data. The display data storage unit 604 is, for example, a video random access memory (VRAM).

  The sensor control unit 602 transmits a timing control signal (TC2) to the optical sensor driving circuit 305 of the display / optical sensor unit 300 in accordance with an instruction from the sensor data processing unit 703 of the data processing unit 700, and the sensor built-in liquid crystal panel 301. Run the scan with.

  In addition, the sensor control unit 602 receives a digital signal (DS) from the signal conversion circuit 306. Then, image data is generated based on the digital signal (DS) corresponding to the sensor output signal (SS) output from all the optical sensor circuits 32 included in the sensor built-in liquid crystal panel 301. That is, the image data read in the entire reading area of the sensor built-in liquid crystal panel 301 is generated. Then, the generated image data is transmitted to the sensor data processing unit 703.

  The backlight control unit 603 transmits a control signal (BK) to the backlight drive circuit 308 of the display / light sensor unit 300 in accordance with instructions from the display data processing unit 701 and the sensor data processing unit 703 to drive the backlight 307. Let

  When the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display control unit 601 determines which display / light sensor unit 300 displays the display data from the data processing unit 700. When an instruction is received, the liquid crystal panel drive circuit 304 of the display / light sensor unit 300 is controlled according to the instruction. When the sensor control unit 602 receives an instruction from the data processing unit 700 as to which display / light sensor unit 300 is to scan the object, The sensor drive circuit 305 is controlled and a digital signal (DS) is received from the signal conversion circuit 306 of the display / light sensor unit 300 according to the instruction.

  Next, the data processing unit 700 will be described. The data processing unit 700 has a function as middleware that gives an instruction to the circuit control unit 600 based on a “command” received from the main control unit 800. Details of the command will be described later.

  The data processing unit 700 includes a display data processing unit 701 and a sensor data processing unit 703. When the data processing unit 700 receives a command from the main control unit 800, at least one of the display data processing unit 701 and the sensor data processing unit 703 depends on the value of each field (described later) included in the received command. One works.

  The display data processing unit 701 receives display data from the main control unit 800, and gives instructions to the display control unit 601 and the backlight control unit 603 according to the command received by the data processing unit 700, and displays the received display data. The image is displayed on the sensor built-in liquid crystal panel 301. The operation of the display data processing unit 701 according to the command will be described later.

  The sensor data processing unit 703 gives an instruction to the sensor control unit 602 and the backlight control unit 603 according to the command received by the data processing unit 700.

  The sensor data processing unit 703 receives image data from the sensor control unit 602 and stores the image data in the image data buffer 704 as it is. Then, in accordance with the command received by the data processing unit 700, the sensor data processing unit 703 performs “whole image data”, “partial image data (partial image coordinate data) based on the image data stored in the image data buffer 704. At least one of “including coordinate data” and “coordinate data” is transmitted to the main control unit 800. The whole image data, partial image data, and coordinate data will be described later. The operation of the sensor data processing unit 703 according to the command will be described later.

  Next, the main control unit 800 executes an application program. The main control unit 800 reads the program stored in the storage unit 901 into a primary storage unit 902 configured by, for example, a RAM (Random Access Memory) and executes the program.

  An application program executed by the main control unit 800 causes the data processing unit 700 to display display data on the sensor built-in liquid crystal panel 301 or to scan an object on the sensor built-in liquid crystal panel 301. Send commands and display data. When “data type” is designated as a command, at least one of whole image data, partial image data, and coordinate data is received from the data processing unit 700 as a response to the command.

  The circuit control unit 600, the data processing unit 700, and the main control unit 800 can be configured by a CPU (Central Processing Unit), a memory, and the like, respectively. The data processing unit 700 may be configured by a circuit such as an ASIC (application specific integrate circuit).

  Next, the storage unit 901 stores programs and data executed by the main control unit 800 as shown in the figure. The program executed by the main control unit 800 may be separated into an application-specific program and a general-purpose program that can be shared by each application.

  Next, the operation unit 903 receives an input operation of the user of the data display / sensor device 100. The operation unit 903 includes input devices such as a switch, a remote controller, a mouse, and a keyboard, for example. Then, the operation unit 903 generates a control signal corresponding to the user's input operation of the data display / sensor device 100, and transmits the generated control signal to the main control unit 800.

  As an example of the switch, a hinge switch 904 that is provided at the hinge portion of the housing and detects the open / closed state of the housing, a power switch 905 that switches power on and off, and a predetermined function are assigned in advance. A hardware switch such as a user switch 906 is assumed.

  In addition, the data display / sensor device 100 includes an external communication unit 907 for communicating with an external device by wireless / wired communication, an audio output unit 908 such as a speaker for outputting audio, and a microphone for inputting an audio signal. A voice input unit 909 such as the above may be provided as appropriate.

(Command details)
Next, details of commands transmitted from the main control unit 800 to the data processing unit 700 will be described with reference to FIGS. 5 and 6. FIG. 5 is a diagram schematically illustrating an example of a command frame structure. FIG. 6 is a diagram for explaining an example of values that can be specified for each field included in the command and an outline thereof.

  As shown in FIG. 5, the commands are “header”, “data acquisition timing”, “data type”, “scan method”, “scan image gradation”, “scan resolution”, “scan panel”, “display panel”. "And" Reserve "fields. In each field, for example, values shown in FIG. 6 can be designated.

  The “header” field is a field indicating the start of a frame. As long as it is possible to identify the “header” field, the value of the “header” field may be any value.

  Next, the “data acquisition timing” field is a field for designating a timing at which data should be transmitted to the main control unit 800. In the “data acquisition timing” field, for example, values “00” (sense), “01” (event), and “10” (all) can be specified.

  Here, “sense” designates that the latest data is transmitted immediately. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “sense”, the latest data specified in the “data type” field is immediately updated to the main control unit 800. Send to.

  The “event” designates transmission at a timing when a change occurs in the image data received from the sensor control unit 602. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “event”, the image that receives the data specified in the “data type” field from the sensor control unit 602. The data is transmitted to the main control unit 800 at a timing when a change larger than a predetermined threshold occurs.

  “All” designates data transmission at a predetermined cycle. Therefore, when the sensor data processing unit 703 receives a command whose value in the “data acquisition timing” field is “all”, the data designated in the “data type” field is transferred to the main control unit 800 at a predetermined cycle. Send to. The predetermined period coincides with the period in which the optical sensor circuit 32 performs scanning.

  Next, the “data type” field is a field for designating the type of data acquired from the sensor data processing unit 703. In the “data type” field, for example, values of “001” (coordinates), “010” (partial image), and “100” (entire image) can be specified. Furthermore, by adding these values, “coordinates” and “partial image” / “whole image” can be specified simultaneously. For example, when “coordinate” and “partial image” are specified at the same time, “011” can be specified.

  When the sensor data processing unit 703 receives a command whose value of the “data type” field is “whole image”, the sensor data processing unit 703 transmits the image data itself stored in the image data buffer 704 to the main control unit 800. The image data itself stored in the image data buffer 704 is referred to as “whole image data”.

  In addition, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 selects a portion where a change larger than a predetermined threshold has occurred from the image data received from the sensor control unit 602. A region to be included is extracted, and image data of the extracted region is transmitted to the main control unit 800. Here, the image data is referred to as “partial image data”. When a plurality of partial image data are extracted, the sensor data processing unit 703 transmits each extracted partial image data to the main control unit 800.

  Further, when the sensor data processing unit 703 receives a command whose value of the “data type” field is “partial image”, the sensor data processing unit 703 detects representative coordinates in the partial image data and indicates the position of the representative coordinates in the partial image data. The coordinate data is transmitted to the main control unit 800. The representative coordinates include, for example, the coordinates of the center of the partial image data, the coordinates of the center of gravity of the partial image data, and the like.

  Next, when receiving a command whose value of the “data type” field is “coordinate”, the sensor data processing unit 703 transmits coordinate data indicating the position of the representative coordinate in the entire image data to the main control unit 800. When a plurality of partial image data are extracted, the sensor data processing unit 703 detects representative coordinates in the entire image data of the extracted partial image data, and the coordinate data indicating the representative coordinates is detected. Each is transmitted to the main control unit 800 (multi-point detection).

  Specific examples of the whole image data, the partial image data, and the coordinate data will be described later with reference to schematic diagrams.

  Next, the “scan method” field is a field for designating whether or not the backlight 307 is turned on at the time of executing the scan. In the “scan method” field, for example, values of “00” (reflection), “01” (transmission), and “10” (reflection / transmission) can be designated.

  “Reflection” designates that scanning is performed with the backlight 307 turned on. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “reflection”, the sensor data processing unit 703 performs sensor control so that the optical sensor driving circuit 305 and the backlight driving circuit 308 operate in synchronization. An instruction is given to the unit 602 and the backlight control unit 603.

  “Transmission” specifies that scanning is performed with the backlight 307 turned off. Therefore, when the sensor data processing unit 703 receives a command whose “scan method” field value is “transparent”, the sensor control unit 602 operates the optical sensor driving circuit 305 and does not operate the backlight driving circuit 308. Instructions to the backlight control unit 603. Note that “reflection / transmission” specifies that scanning is performed using both “reflection” and “transmission”.

  Next, the “scanned image gradation” field is a field for designating gradations of the partial image data and the entire image data. In the “scanned image gradation” field, for example, values of “00” (binary) and “01” (multivalue) can be designated.

  When the sensor data processing unit 703 receives a command whose “scan image gradation” field value is “binary”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as monochrome data. .

  When the sensor data processing unit 703 receives a command whose “scanned image gradation” field value is “multivalued”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 as multitone data. To do.

  Next, the “scan resolution” field is a field for designating the resolution of the partial image data and the entire image data. In the “scan resolution” field, for example, values of “0” (high) and “1” (low) can be designated.

  Here, “high” designates a high resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “high”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 with high resolution. For example, it is desirable to designate “high” for image data (image data such as a fingerprint) to be subjected to image processing such as image recognition.

  “Low” designates a low resolution. Therefore, when the sensor data processing unit 703 receives a command whose “scan resolution” field value is “low”, the sensor data processing unit 703 transmits the partial image data and the entire image data to the main control unit 800 at a low resolution. For example, it is desirable to designate “low” for image data (such as touched finger or hand image data) that only needs to be recognized.

  Next, in the “scan panel” field, when the data display / sensor device 100 includes a plurality of display / light sensor units 300, the display / light sensor unit 300 specifies which object to scan. It is a field to be. In the “scan panel” field, for example, values of “001” (first display / light sensor unit 300) and “010” (second display / light sensor unit 300) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300” and “second display / light sensor unit 300” are simultaneously specified, “011” can be specified.

  Here, when the sensor data processing unit 703 receives a command whose value of the “scan panel” field is “first display / photosensor unit 300”, the photosensor drive circuit of the first display / photosensor unit 300 An instruction is given to the sensor control unit 602 and the backlight control unit 603 so as to control the 305 and the backlight drive circuit 308.

  Next, the “display panel” field specifies which display / light sensor unit 300 displays the display data when the data display / sensor device 100 includes a plurality of display / light sensor units 300. It is a field. In the “display panel” field, for example, values of “001” (first display / light sensor unit 300) and “010” (second display / light sensor unit 300) can be designated. By adding these values, a plurality of display / light sensor units 300 can be specified at the same time. For example, when “first display / light sensor unit 300” and “second display / light sensor unit 300” are simultaneously specified, “011” can be specified.

  Here, for example, when the display data processing unit 701 receives a command whose value of the “display panel” field is “first display / light sensor unit 300”, the display data processing unit 701 displays the display data in the first display / light sensor unit 300. Is displayed, the display control unit 601 and the backlight control unit 603 are instructed to control the liquid crystal panel driving circuit 304 and the backlight driving circuit 308 of the first display / light sensor unit 300.

  Next, the “reserved” field is a field that is appropriately specified when it is necessary to further specify information other than information that can be specified in the above-described fields.

  Note that an application executed by the main control unit 800 does not need to use all the above-described fields when transmitting a command, and an invalid value (such as a NULL value) may be set for a field that is not used. .

  When the user wants to acquire coordinate data of a position touched with a finger or pen, a command specifying “coordinate” in the “data type” field is transmitted to the data processing unit 700. Therefore, it is desirable to specify “all” in the “data acquisition timing” field of the command to acquire coordinate data. Further, since it is only necessary to acquire coordinate data of the touched position, the scanning accuracy may not be high. Therefore, “low” may be specified as the value of the “scan resolution” field of the above command.

  Further, when “coordinate” is specified in the “data type” field of the command, for example, when the user touches the sensor built-in liquid crystal panel 301 with a plurality of fingers or pens at the same time, the coordinate data of the touched position is used. Can be acquired (multi-point detection).

  When acquiring image data of an object such as a document, a command specifying “whole image” in the “data type” field is transmitted to the data processing unit 700. Since it is common to perform a scan in a stationary state, it is not necessary to periodically perform the scan. Therefore, in this case, it is desirable to designate “sense” or “event” in the “data acquisition timing” field. When scanning an object such as a document, it is desirable that the scanning accuracy is high so that the user can easily read the characters. Therefore, it is desirable to designate “high” in the “scan resolution” field.

(Whole image data / Partial image data / Coordinate data)
Next, the whole image data, the partial image data, and the coordinate data will be described with reference to FIG. The image data shown in FIG. 7A is image data obtained as a result of scanning the entire sensor built-in liquid crystal panel 301 when the object is not placed on the sensor built-in liquid crystal panel 301. The image data shown in FIG. 7B is image data obtained as a result of scanning the entire sensor-equipped liquid crystal panel 301 when the user touches the sensor-equipped liquid crystal panel 301 with a finger.

  When the user touches the sensor built-in liquid crystal panel 301 with a finger, the amount of light received by the photosensor circuit 32 in the vicinity of the touch changes, so that the voltage output from the photosensor circuit 32 changes, and as a result, In the image data generated by the sensor control unit 602, the brightness of the pixel value of the portion touched by the user changes.

  In the image data shown in FIG. 7B, the brightness of the pixel value of the portion corresponding to the user's finger is higher than that in the image data shown in FIG. In the image data shown in FIG. 7B, the smallest rectangular area (area PP) that includes all pixel values whose lightness changes more than a predetermined threshold is “partial image data”.

  The image data indicated by the area AP is “whole image data”.

  Also, the coordinate data in the whole image data (area AP) of the representative coordinates Z of the partial image data (area PP) is (Xa, Ya), and the coordinate data in the partial image data (area PP) is (Xp, Yp). It is.

(Configuration of sensor built-in liquid crystal panel)
Next, the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309 of the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 8 is a block diagram showing the main part of the display / light sensor unit 300, particularly the configuration of the sensor built-in liquid crystal panel 301 and the configuration of the peripheral circuit 309.

  The sensor built-in liquid crystal panel 301 includes a pixel circuit 31 for setting light transmittance (brightness) and an optical sensor circuit 32 that outputs a voltage corresponding to the intensity of light received by the sensor. The pixel circuit 31 is used as a general term for the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b corresponding to the red, green, and blue color filters, respectively.

  The pixel circuits 31 are arranged on the sensor built-in liquid crystal panel 301 in the column direction (vertical direction) and 3n in the row direction (horizontal direction). A set of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b is continuously arranged in the row direction (lateral direction). This set forms one pixel.

  In order to set the light transmittance of the pixel circuit 31, first, the high level voltage (TFT 33 is turned on) to the scanning signal line Gi connected to the gate terminal of the TFT (Thin Film Transistor) 33 included in the pixel circuit 31. Voltage). Thereafter, a predetermined voltage is applied to the data signal line SRj connected to the source terminal of the TFT 33 of the R pixel circuit 31r. Similarly, the light transmittance is also set for the G pixel circuit 31g and the B pixel circuit 31b. Then, by setting these light transmittances, an image is displayed on the sensor built-in liquid crystal panel 301.

  Next, the photosensor circuit 32 is arranged for each pixel. One pixel may be arranged in the vicinity of each of the R pixel circuit 31r, the G pixel circuit 31g, and the B pixel circuit 31b.

  In order for the optical sensor circuit 32 to output a voltage corresponding to the light intensity, first, the sensor readout line RWi connected to one electrode of the capacitor 35 and the anode terminal of the photodiode 36 are connected. A predetermined voltage is applied to the sensor reset line RSi. In this state, when light is incident on the photodiode 36, a current corresponding to the amount of incident light flows through the photodiode 36. Then, according to the current, the voltage at the connection point (hereinafter referred to as connection node V) between the other electrode of the capacitor 35 and the cathode terminal of the photodiode 36 decreases. When the power supply voltage VDD is applied to the voltage application line SDj connected to the drain terminal of the sensor preamplifier 37, the voltage at the connection node V is amplified and output from the source terminal of the sensor preamplifier 37 to the sensing data output line SPj. Based on the output voltage, the amount of light received by the optical sensor circuit 32 can be calculated.

  Next, the liquid crystal panel drive circuit 304, the optical sensor drive circuit 305, and the sensor output amplifier 44, which are peripheral circuits of the sensor built-in liquid crystal panel 301, will be described.

  The liquid crystal panel drive circuit 304 is a circuit for driving the pixel circuit 31, and includes a scanning signal line drive circuit 3041 and a data signal line drive circuit 3042.

  The scanning signal line driving circuit 3041 sequentially selects one scanning signal line from the scanning signal lines G1 to Gm for each line time based on the timing control signal TC1 received from the display control unit 601, and A high level voltage is applied to the selected scanning signal line, and a low level voltage is applied to the other scanning signal lines.

  Based on the display data D (DR, DG, and DB) received from the display controller 601, the data signal line driver circuit 3042 generates a predetermined voltage corresponding to the display data for one row for each line time. The data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn are applied (line sequential method). Note that the data signal line driver circuit 3042 may be driven by a dot sequential method.

  The optical sensor driving circuit 305 is a circuit for driving the optical sensor circuit 32. Based on the timing control signal TC2 received from the sensor control unit 602, the optical sensor driving circuit 305 selects a predetermined sensor readout signal line from the sensor readout signal lines RW1 to RWm for each line time. A read voltage is applied, and a voltage other than a predetermined read voltage is applied to the other sensor read signal lines. Similarly, based on the timing control signal TC2, a predetermined reset voltage is applied to the sensor reset signal line selected from the sensor reset signal lines RS1 to RSm for each line time, and the others. A voltage other than a predetermined reset voltage is applied to the sensor reset signal line.

  The sensing data output signal lines SP1 to SPn are grouped into p groups (p is an integer of 1 to n), and the sensing data output signal lines belonging to each group are connected via a switch 47 that is sequentially turned on in time division. And connected to the sensor output amplifier 44. The sensor output amplifier 44 amplifies the voltage from the group of sensing data output signal lines connected by the switch 47 and outputs the amplified voltage to the signal conversion circuit 306 as sensor output signals SS (SS1 to SSp).

(Configuration of main control unit and data stored in storage unit)
Next, the configuration of the main control unit 800 of the data display / sensor device 100 and the data stored in the storage unit 901 will be described with reference to FIG. FIG. 1 is a block diagram showing the main configuration of main controller 800 of data display / sensor device 100 according to the present embodiment and the data stored in storage unit 901.

  Here, in order to make the description easy to understand, the description of the operations of the data processing unit 700 and the circuit control unit 600 located between the main control unit 800 and the display / light sensor unit 300 is omitted. However, to be precise, when displaying data and scanning an object, each unit of the main control unit 800 transmits a command to the data processing unit 700, and the data processing unit 700 sets the circuit control unit 600 based on the command. Then, the circuit control unit 600 transmits a signal to the display / light sensor unit 300. Further, the main control unit 800 acquires the entire image data, the partial image data, and the coordinate data from the data processing unit 700 as a response to the command transmitted to the data processing unit 700.

  As illustrated in FIG. 1, the storage unit 901 includes an image data storage unit 21, an incident light data storage unit 22, a scan processing data storage unit 23, and a scan data storage unit 24.

  The image data storage unit 21 stores image data that the image display processing unit 11 displays on the sensor built-in liquid crystal panel 301. As an example of the image indicated by the image data, a defense wall or the like that protects the target target from the gun can be cited.

  In the incident light data storage unit 22, the direction specifying unit (direction specifying unit) 122 specifies the direction of light incident on the sensor built-in liquid crystal panel 301, and the distance calculating unit (distance calculating unit) 123 is used in the sensor built-in liquid crystal panel 301. And data used for calculating the distance between the light gun 111 and the light gun 111 is stored. Specifically, the ratio at which the light emitted from the light gun 111 diffuses (the ratio at which the light diffuses per unit distance) and the diameter of the cross section of the light emitted from the light gun 111 are stored. How to specify the direction of the incident light and calculate the distance between the light gun 111 and the sensor built-in liquid crystal panel 301 will be described later using the diffusion ratio and the diameter of the cross section of the light.

  The scan processing data storage unit 23 stores various types of information that the scan processing unit 14 uses for scanning in the sensor-equipped liquid crystal panel 301. Here, the various types of information are information for determining, for example, the timing at which scanned data is acquired, the scanning method, the gradation of the scanned image, the scanning resolution, and the like.

  The scan data storage unit 24 stores coordinate data, whole image data, and partial image data, which are data when scanning is performed in the sensor built-in liquid crystal panel 301.

  Next, the main control unit 800 will be described. As shown in FIG. 9, the main control unit 800 includes an image display processing unit 11, an incident light recognition unit 12, a hit determination unit 13, and a scan processing unit 14. The incident light recognition unit 12 includes a position specifying unit (position specifying unit) 121, a direction specifying unit 122, and a distance calculating unit 123.

  The image display processing unit 11 displays the image data stored in the image data storage unit 21 on the sensor built-in liquid crystal panel 301. The image display processing unit 11 transmits image data displayed on the sensor built-in liquid crystal panel 301 to the hit determination unit 13. Further, the image display processing unit 11 causes the sensor built-in liquid crystal panel 301 to display the content indicated by the result data, which is data indicating whether or not the hit has been obtained, from the hit determination unit 13.

  The incident light recognizing unit 12 identifies the position of the light incident on the sensor-embedded liquid crystal panel 301 on the sensor-embedded liquid crystal panel 301 and the direction of the incident light, and the emitting device and the data display / sensor device that emitted the incident light The distance to 100 is calculated.

  More specifically, as described above, the incident light recognition unit 12 includes the position specifying unit 121, the direction specifying unit 122, and the distance calculating unit 123.

  The position specifying unit 121 acquires coordinate data from the scan data storage unit 24 and specifies the position of light incident on the sensor built-in liquid crystal panel 301. Then, the position data indicating the position of the specified incident light is transmitted to the hit determination unit 13.

  The direction specifying unit 122 acquires the entire image data or the partial image data from the scan data storage unit 24, and uses the image data and the ratio of the incident light stored in the incident light data storage unit 22 to diffuse, The direction of light incident on the sensor built-in liquid crystal panel 301 is specified. Then, direction data indicating the direction of the specified incident light is transmitted to the hit determination unit 13. The direction of the incident light is specified by the following method.

  First, the principle of recognizing the position and shape of light received by the sensor built-in liquid crystal panel 301 in the data display / sensor device 100 will be described with reference to FIG. FIG. 10 is an explanatory diagram when the sensor built-in liquid crystal panel 301 receives light.

  As shown in FIG. 10, when light enters the sensor built-in liquid crystal panel 301, the light sensor (light detection unit) 312 arranged for each unit pixel 311 constituting the sensor built-in liquid crystal panel 301 detects the light. Then, by recognizing the position on the sensor built-in liquid crystal panel 301 of the unit pixel 311 where the light sensor 312 that detects the light is arranged, the position of the light incident on the sensor built-in liquid crystal panel 301 can be recognized. .

  In addition, by recognizing the shape formed as a whole by each unit pixel 311 in which the light sensor 312 that detects the light is arranged, the light incident on the sensor built-in liquid crystal panel 301 hits the sensor built-in liquid crystal panel 301. The shape of the cross section can be recognized.

  Next, a method in which the direction specifying unit 122 specifies the direction of light incident on the sensor built-in liquid crystal panel 301 will be described with reference to FIG. FIG. 11 is an explanatory diagram showing the relationship between the shape indicated by the light incident on the sensor built-in liquid crystal panel 301 and the incident direction when light diffusing with distance is used. Here, the right side and the left side refer to the right side and the left side of the sensor built-in liquid crystal panel 301 when viewed from the light gun 111.

  FIG. 11A is a diagram illustrating a shape indicated by incident light that has impinged on the sensor built-in liquid crystal panel 301 when light is incident on the sensor built-in liquid crystal panel 301 from a direction of 90 degrees. FIG. 11B is a top view of the light emitted from the light gun 111 entering the sensor built-in liquid crystal panel 301 from a direction of 90 degrees. FIG. 11C is a diagram showing a shape indicated by incident light striking the sensor built-in liquid crystal panel 301 when light enters the sensor built-in liquid crystal panel 301 from the right side at an angle α with respect to the sensor built-in liquid crystal panel 301. . FIG. 11D is a view of the state where the light emitted from the light gun 111 is incident on the sensor built-in liquid crystal panel 301 from the right side at an angle α as viewed from above.

  As shown in FIG. 11A, when the shape of the light hitting the sensor built-in liquid crystal panel 301 is a perfect circle, the incident light to the sensor built-in liquid crystal panel 301 is at an angle of 90 degrees with respect to the sensor built-in liquid crystal panel 301. It is incident from.

  On the other hand, as shown in FIG. 11C, when the shape of the light hitting the sensor built-in liquid crystal panel 301 is a flat ellipse, the incident light to the sensor built-in liquid crystal panel 301 is 90% with respect to the sensor built-in liquid crystal panel 301. It is incident from an angle other than degrees. In a flat ellipse, there are a large diameter side and a small side. The angle α between the sensor built-in liquid crystal panel 301 and the incident light is determined by the ratio of the large-side diameter R1 and the small-side diameter R2 and the ratio of diffusion of incident light (a ratio indicating how much diffused per unit distance). Can be requested.

  Then, the direction specifying unit 122 obtains the ratio of the diameter R1 and the diameter R2 from the whole image data or the partial image data acquired from the scan data storage unit 24, and calculates the incident light stored in the incident light data storage unit 22. The angle α between the sensor built-in liquid crystal panel 301 and the incident light is obtained using the diffusion ratio. And the direction specific | specification part 122 specifies the direction of the light which injected into the sensor built-in liquid crystal panel 301 from the calculated | required angle (alpha).

  In addition, when the whole image data or the partial image data acquired from the scan data storage unit 24 is a perfect circle, the direction specifying unit 122 transmits light incident on the sensor built-in liquid crystal panel 301 to the sensor built-in liquid crystal panel 301. It is specified that the light enters from the direction of 90 degrees.

  The direction specifying unit 122 may output the specified light incident direction to the outside. Accordingly, an external device can change the direction of the data display / sensor device 100 and the external device in the light incident direction.

  In the present embodiment, light incident on the sensor built-in liquid crystal panel 301 (light emitted from the light gun 111) is light that diffuses with distance. The adverse effects of using non-diffusing light will be described below with reference to FIG.

  FIG. 12 is an explanatory diagram showing a relationship between the shape indicated by the light incident on the sensor built-in liquid crystal panel 301 and the incident direction when non-diffusing light is used. Here, the right side and the left side refer to the right side and the left side of the sensor built-in liquid crystal panel 301 when viewed from the light gun 111.

  FIG. 12A is a diagram illustrating a shape indicated by incident light that has impinged on the sensor built-in liquid crystal panel 301 when light is incident on the sensor built-in liquid crystal panel 301 from a direction of 90 degrees. FIG. 12B is a top view of the light emitted from the light gun 111 entering the sensor built-in liquid crystal panel 301 from a direction of 90 degrees. FIG. 12C is a diagram showing the shape indicated by the incident light striking the sensor built-in liquid crystal panel 301 when light enters the sensor built-in liquid crystal panel 301 from the right side at an angle α with respect to the sensor built-in liquid crystal panel 301. . FIG. 12D is a top view of the light emitted from the light gun 111 entering from the right side at an angle α with respect to the sensor built-in liquid crystal panel 301 as viewed from above. FIG. 12E is a diagram showing the shape indicated by the incident light striking the sensor built-in liquid crystal panel 301 when light enters the sensor built-in liquid crystal panel 301 from the left side at an angle α with respect to the sensor built-in liquid crystal panel 301 as viewed from above. . FIG. 12 (f) is a view of the light emitted from the light gun 111 entering from the left side at an angle α with respect to the sensor built-in liquid crystal panel 301 as viewed from above.

  As shown in FIG. 12B, when light is incident on the sensor built-in liquid crystal panel 301 at an angle of 90 degrees, the shape of the light hitting the sensor built-in liquid crystal panel 301 is as shown in FIG. It becomes a perfect circle. On the other hand, as shown in FIGS. 12D and 12F, when light is incident on the sensor built-in liquid crystal panel 301 at an angle α, the sensor built-in liquid crystal may be viewed from the right side or the left side. The shape of light hitting the panel 301 is the same ellipse as shown in FIGS.

  Therefore, in the case of non-diffusing light, the direction of the light incident on the sensor built-in liquid crystal panel 301 can be specified up to two directions, but it cannot be specified which one of them. Therefore, in this embodiment, light that does not diffuse is not used.

  If the cross-sectional shape of the light is a star shape, an H shape, a well shape, or the like, it is possible to specify the direction of incidence on the sensor built-in liquid crystal panel 301 even if the light does not diffuse. Therefore, if the cross-sectional shape of light is a star shape, an H shape, a well shape, or the like, light that does not diffuse can be used.

  The distance calculation unit 123 acquires the whole image data or the partial image data from the scan data storage unit 24, and the ratio of the incident light stored in the incident light data storage unit 22 is diffused and the light is emitted from the light gun 111. The distance between the light gun 111 that has emitted the light incident on the sensor built-in liquid crystal panel 301 and the data display / sensor device 100 is calculated using the diameter of the cross section of the light at that time. Then, distance data indicating the calculated distance is transmitted to the hit determination unit 13. Calculation of the distance between the light gun 111 and the data display / sensor device 100 is performed as follows.

  The distance calculation unit 123 obtains the diameter R (representative value) of a perfect circle or the diameter R1 (representative value) of a flat ellipse from the entire image data or the partial image data acquired from the scan data storage unit 24. Then, the cross section of the incident light has a diameter R using the diameter (reference representative value) of the cross section of the light emitted from the light gun 111 stored in the incident light data storage unit 22 and the ratio of the diffusion of the incident light. Or, the distance that becomes the diameter R1 of the flat ellipse is calculated. Thereby, the distance between the data display / sensor device 100 and the light gun 111 is calculated.

  When the light cross section is not a circle, for example, in the case of a square, the distance can be calculated by using the length of a diagonal line, the length of one side, or the like as a representative value indicating the size of the cross section.

  The hit determination unit 13 uses the position data acquired from the position specifying unit 121, the direction data acquired from the direction specifying unit 122, the distance data acquired from the distance calculating unit 123, and the image data acquired from the image display processing unit 11. It is determined whether or not the light emitted from the light gun 111 is hit as it is displayed on the sensor built-in liquid crystal panel 301. Then, result data indicating the determined result is transmitted to the image display processing unit 11.

  Whether the light emitted from the light gun 111 hits the target 101 displayed on the sensor built-in liquid crystal panel 301 is determined as follows.

  That is, the hit determination unit 13 recognizes the position where the target 101 is displayed on the sensor built-in liquid crystal panel 301 from the image data acquired from the image display processing unit 11, and the position data acquired from the position specifying unit 121. Is coincident with the position indicated by, it is determined that the light emitted from the light gun 111 is hitting the target 101 displayed on the sensor built-in liquid crystal panel 301.

  When not only the target 101 but also the defensive wall 102 is displayed on the sensor built-in liquid crystal panel 301, the hit determination unit 13 determines the direction in which the defensive wall 102 is displayed with respect to the target 101 and the direction specifying unit 122. It is determined whether or not the direction of incident light indicated by the acquired direction data matches. If they match, even if the position where the target 101 is displayed on the sensor built-in liquid crystal panel 301 matches the position indicated by the position data acquired from the position specifying unit 121, the light is emitted from the light gun 111. It is determined that the received light does not hit the target 101 displayed on the sensor built-in liquid crystal panel 301.

  Thereby, it can be said that the target 101 cannot be attacked from the direction in which the defense wall 102 exists when viewed from the target 101.

  Further, the hit determination unit 13, when the distance indicated by the distance data acquired from the distance calculation unit 123 is larger than a predetermined value, the position at which the target 101 is displayed on the sensor built-in liquid crystal panel 301 and the position specifying unit 121. It may be determined that the light emitted from the light gun 111 does not hit the target 101 displayed on the sensor built-in liquid crystal panel 301 even if the position indicated by the position data acquired from the image data matches. .

  Accordingly, when the distance between the data display / sensor device 100 and the light gun 111 is larger than a predetermined value, it can be determined that the target 101 is not hit. Therefore, if it is shot from too far, it can be determined that the target 101 is not hit.

  The scan processing unit 14 causes the sensor built-in liquid crystal panel 301 to execute scan processing, acquires the result of the scan performed by the sensor built-in liquid crystal panel 301, and stores the result in the scan data storage unit 24.

  More specifically, the scan processing unit 14 includes a scan execution instruction unit 141 and a scan data storage unit 142.

  The scan execution instructing unit 141 causes the sensor built-in liquid crystal panel 301 to execute a scan based on various types of information stored in the scan processing data storage unit 23 for executing the scan.

  The scan data storage unit 142 acquires coordinate data, whole image data, and partial image data, which are the results of scanning performed by the sensor built-in liquid crystal panel 301, from the data processing unit 700 and stores them in the scan data storage unit 24. is there.

  Note that the scan may be executed after the image display processing unit 11 displays the target 101 or the like on the sensor built-in liquid crystal panel 301. This makes it possible to detect the light emitted from the light gun 111 after displaying the target 101.

(Relationship between various commands and data display / sensor device operation)
Next, the relationship between various commands in the data display / sensor device 100 and the operation of the data display / sensor device 100 will be described.

  In the present embodiment, the various commands will be described as being stored in advance in the scan processing data storage unit 23. The various commands may be set by a scan attribute information setting unit (not shown) upon receiving a user instruction.

  First, in the present embodiment, the value of the “data acquisition timing” field is set to “01” (event).

  This is because if the scanned image data is transmitted to the data processing unit 700 when light is incident on the sensor built-in liquid crystal panel 301, it can be recognized that the light is incident.

  Accordingly, when there is a change in the data scanned at a predetermined cycle, the sensor data processing unit 703 of the data processing unit 700 acquires image data that is a result of the scan.

  Next, the value of the “data type” field is set to “011” (coordinates, partial image). This is because the position of the incident light and the shape of the incident light can be recognized if there are coordinates and partial image data.

  As a result, the main control unit 800 acquires coordinate data and partial image data from the data processing unit 700. The entire data may be acquired by setting the value of the “data type” field to “101” or “111”.

  Next, the value of the “scan method” field is set to “01” (transparent). This is because it is difficult to detect incident light when the backlight is turned on. As a result, the display / light sensor unit 300 performs scanning with the backlight turned off.

  Next, the value of the “scanned image gradation” field is set to “00” (binary). This is because it is sufficient to determine whether or not light is incident. Thereby, the data processing unit 700 acquires monochrome image data. Note that “01” (multi-value) may be set.

  Finally, the value of the “scan resolution” field is set to “1” (low). This is because it is only necessary to determine whether or not light is incident, similar to the scan image gradation. Thereby, the data processing unit 700 acquires image data having a low resolution. It may be set to ““ 0 ”(high)”.

(Data display / sensor operation)
Next, the flow of processing for determining whether or not the incident light hits the target 101 in the data display / sensor device 100 will be described with reference to FIG. FIG. 13 is a flowchart showing a flow of processing in which the data display / sensor device 100 determines whether or not the incident light hits the target 101.

  As shown in FIG. 13, the data display / sensor device 100 first displays the target 101 and the defense wall 102 on the sensor built-in liquid crystal panel 301 (S1301). Next, the incident light recognition unit 12 determines whether or not light has entered the sensor built-in liquid crystal panel 301 (S1302). If there is incident light on the sensor built-in liquid crystal panel 301 (YES in S1302), the position specifying unit 121 determines whether or not the incident position of the incident light matches the display position of the target 101 (S1303).

  If the incident position of the incident light coincides with the display position of the target 101 (YES in S1303), the direction specifying unit 122 matches the direction in which the incident light is incident with the direction of the defense wall 102 viewed from the target 101. It is determined whether or not it has been done (S1304). If the direction of the incident light does not match the direction of the defense wall 102 viewed from the target 101 (NO in S1304), the hit determination unit 13 determines that the incident light has hit the target 101. (S1305).

  On the other hand, when the incident position of the incident light and the display position of the target 101 do not match (NO in S1303), the direction in which the incident light enters and the direction of the defense wall 102 viewed from the target 101 match. In the case (YES in S1304), the hit determination unit 13 determines that the incident light does not hit the target 101 (S1306). Thus, the process ends.

  In the determination of whether or not a hit has occurred, if the distance between the data display / sensor device 100 calculated by the distance calculation unit 123 and the light gun 111 is equal to or greater than a predetermined value, it is determined that a hit has not occurred. May be.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those shown in the first embodiment are given the same reference numerals, and explanation thereof is omitted.

  The present embodiment is different from the first embodiment in that a plurality of light guns 111 exist and light emitted from the plurality of light guns 111 is discriminated. More specifically, the plurality of light guns 111 emit light of different colors. Then, the data display / sensor device 100 determines the color of the light incident on the sensor built-in liquid crystal panel 301 and determines which light gun 111 out of the plurality of light guns 111 is the light.

  Further, the plurality of light guns 111 may emit light having different cross-sectional shapes when cut perpendicular to the traveling direction, instead of light of different colors. It may be different for each 111. Here, the light emission pattern refers to a pattern when light emission and non-emission are repeated regularly. For example, when the emission is “1”, the non-emission is “0”, and the emission pattern is “1100”, the emission is performed twice as long as the unit time, and then is not emitted as long as twice the unit time. Repeat the pattern. Such a pattern is called a light emission pattern.

  When the light gun 111 emits light having a different cross-sectional shape, or emits light having a different emission pattern, the data display / sensor device 100 is configured so that the cross-sectional shape of incident light or The emission pattern is determined.

  This will be specifically described with reference to FIG. FIG. 14 is a block diagram of the main control unit 800 when discriminating light incident on the sensor built-in liquid crystal panel. In FIG. 14, the difference from the first embodiment is that the incident light recognition unit 12 is provided with an incident light determination unit (color determination unit, light reception pattern determination unit) 124.

  The incident light data storage unit 22 stores a correspondence table that associates the color of the incident light with the light gun 111. An example of the correspondence table is shown in FIG. FIG. 15 is a diagram illustrating an example of a correspondence table stored in the incident light data storage unit 22. FIG. 15A is a diagram showing a correspondence table when the colors of light emitted from the plurality of light guns 111 are different from each other. FIG. 15B is a diagram showing a correspondence table when the cross-sectional shapes of the light emitted from the plurality of light guns 111 are different from each other. FIG. 15C is a diagram showing a correspondence table when the emission patterns of the light emitted from the plurality of light guns 111 are different from each other.

  In the example of FIG. 15A, the light gun 111A is associated with red light, the light gun 111B is associated with blue light, and the light gun 111C is associated with green light.

  In the example of FIG. 15B, the light gun 111A is associated with a triangular cross-sectional shape, the light gun 111B is associated with a square cross-sectional shape, and the light gun 111C is associated with a star-shaped cross-sectional shape.

  In the example of FIG. 15C, the pattern “1100” is associated with the light gun 111A, the pattern “111000” is associated with the light gun 111B, and the pattern “1110” is associated with the light gun 111C. Note that “1” in the pattern indicates that light is emitted, and “0” indicates that light is not emitted. In addition, it is assumed that the period of the emission patterns “1” and “0” coincides with the period in which the sensor built-in liquid crystal panel 301 performs scanning.

  The incident light determination unit 15 determines light incident on the sensor built-in liquid crystal panel 301 from the image data stored in the scan data storage unit 24. Then, by using the light determination result and the correspondence table stored in the incident light data storage unit 22, it is determined from which light gun 111 the incident light is emitted, and the result is determined to be hit To the unit 13.

  A method for determining the incident light will be specifically described below.

  First, a case where the color of incident light is determined will be described. The structure of the sensor built-in liquid crystal panel 301 for determining the color will be described with reference to FIG. FIG. 16 is a diagram schematically showing a cross section of the sensor built-in liquid crystal panel 301 when the color of incident light is discriminated.

  16 differs from FIG. 2 of the first embodiment in that the photodiode 6 is provided not only near the blue color filter 53b but also near each of the red color filter 53r and the green color filter 53g. This is the point. Thereby, since three colors of red, green, and blue can be detected, any color can be detected. Different colors can be recognized.

  In the command stored in the scan processing data storage unit 23, the value of the “scanned image gradation” field is set to “01” (multivalue). Thereby, image data reflecting the color of incident light is transmitted to the data processing unit 700.

  The incident light discriminating unit 124 discriminates the color of the incident light from the image data stored in the scan data storage unit 24 and discriminates from which light gun 111 the light is emitted.

  Next, a method for determining the light emission pattern of incident light will be described. When determining the emission pattern, the value of the “data acquisition timing” field is set to “10” (all) in the command stored in the scan processing data storage unit 23. As a result, the image data as a result of scanning is transmitted to the data processing unit 700 at a predetermined cycle. As described above, the predetermined cycle in which the image data is transmitted coincides with the cycle in which scanning is executed in the sensor built-in liquid crystal panel 301.

  The incident light discriminating unit 124 discriminates an emission pattern of incident light from image data for each predetermined period stored in the scan data storage unit 24. This point will be described with reference to FIG.

  FIG. 17 is a diagram illustrating a relationship between a scan execution period in the sensor-equipped liquid crystal panel 301 and an emission pattern of light incident on the sensor-equipped liquid crystal panel 301. FIG. 17A shows a case where the emission pattern is “1100”. FIG. 17B is a diagram illustrating a case where the emission pattern is “111000”. FIG. 17C is a diagram illustrating a case where the emission pattern is “1110”.

  As shown in FIG. 17A, when the emission pattern is “1100”, the light is detected twice after detecting the light twice regardless of the relationship between the scanning timing and the timing of the emission pattern of the incident light. The state of non-detection times continues. Therefore, the incident light determination unit 124 recognizes the case where the image in which the incident light exists and the image in which the incident light does not exist are consecutive twice in the image data stored in the scan data storage unit 24. Thus, it is possible to discriminate incident light whose emission pattern is “1100”.

  Also, as shown in FIG. 17B, when the emission pattern is “111000”, the light is detected three times regardless of the relationship between the scan timing and the incident light emission pattern timing. The state of non-detection three times continues. Therefore, the incident light determination unit 124 recognizes a case where the image in which the incident light exists and the image in which the incident light does not exist are consecutive three times in the image data stored in the scan data storage unit 24. Thus, it is possible to discriminate incident light whose emission pattern is “111000”.

  Further, as shown in FIG. 17C, when the emission pattern is “1110”, the light is detected three times regardless of the relationship between the timing of the scan and the timing of the emission pattern of the incident light. The state of non-detection once continues. Therefore, the incident light discriminating unit 124 has a pattern in which the image in which the incident light exists is three times and the image in which the incident light does not exist is one time in the image data stored in the scan data storage unit 24. By recognizing the case, it is possible to determine the incident light whose emission pattern is “1110”.

  Finally, a method for determining the cross-sectional shape of incident light will be described. Since the scan data storage unit 24 stores image data as a result of scanning, the incident light determination unit 124 recognizes the shape when incident light is incident on the sensor built-in liquid crystal panel 301 from the image data. be able to. Thereby, the incident light is discriminated by the shape, and it is discriminated from which light gun 111 the light is emitted.

  Next, the flow of processing for determining whether or not the incident light has hit the target 101 will be described with reference to FIG. FIG. 18 is a flowchart showing a flow of processing in which the data display / sensor device 100 determines whether or not the incident light hits the target 101.

  As shown in FIG. 18, the data display / sensor device 100 first displays the target 101 and the defense wall 102 on the sensor built-in liquid crystal panel 301 (S1801). The target 101 and the defense wall 102 to be displayed are not limited to one. Next, the incident light recognition unit 12 determines whether or not light has entered the sensor built-in liquid crystal panel 301 (S1802). If there is incident light on the sensor built-in liquid crystal panel 301 (YES in S1802), the position specifying unit 121 determines whether the incident position of the incident light matches the display position of the target 101 (S1803). If there are a plurality of incident lights and target 101, it is determined whether or not the incident light incident position and target display position match for each incident light and target 101.

  If the incident position of the incident light coincides with the display position of the target 101 (YES in S1803), the direction specifying unit 122 determines the direction in which the incident light is incident and the direction of the defense wall 102 viewed from the target 101. Are determined to match (S1804). When there are a plurality of incident lights and the target 101, the incident light incident direction where the incident light incident position and the target 101 display position coincide with the direction of the defense wall 102 viewed from the target 101. Judge whether or not.

  If the direction in which the incident light is incident does not match the direction of the defense wall 102 viewed from the target 101 (NO in S1804), the incident light determination unit 124 determines that the display position and the incident position of the target 101 are the same. It is determined which incident light beam 111 corresponds to which incident light beam (S1805). The hit determination unit 13 determines that the target 101 is hit by the light emitted from the light gun 111 determined by the incident light determination unit 124 (S1806).

  On the other hand, when the incident position of the incident light does not match the display position of the target 101 (NO in S1803), the direction in which the incident light is incident matches the direction of the defense wall 102 viewed from the target 101. In the case (YES in S1804), the hit determination unit 13 determines that the incident light does not hit the target 101 (S1807). Thus, the process ends.

  In the determination of whether or not a hit has occurred, if the distance between the data display / sensor device 100 calculated by the distance calculation unit 123 and the light gun 111 is equal to or greater than a predetermined value, it is determined that a hit has not occurred. May be.

  In addition, when the target 101 and the defense wall 102 are displayed at a predetermined distance or more, even if the direction in which the defense wall 102 exists when viewed from the target 101 matches the incident direction of the incident light, It may be determined that the incident light hits the target 101.

  According to the above configuration, when there are a plurality of light guns 111, it is possible to determine which light gun 111 emits light hitting the target 101. Therefore, a plurality of users can compete with each other using the light gun 111, and can compete for which one has shot the target 101.

  The following configuration is also possible.

  For example, a drive device (not shown) that acquires the direction of light incident on the data display / sensor device 100 and changes the direction of the sensor built-in liquid crystal panel 301 of the data display / sensor device 100 based on the acquired direction. is there. The driving device includes a driving device control unit (not shown) that controls the direction of the sensor built-in liquid crystal panel 301. When the direction of light incident on the sensor built-in liquid crystal panel 301 is acquired, the drive device control unit drives the drive so that the direction in which the sensor built-in liquid crystal panel 301 faces becomes the light incident direction. Control the device.

  This will be described with reference to FIG. FIG. 19 shows a change in the direction of the sensor-equipped liquid crystal panel 301 so that when the light is incident on the sensor-equipped liquid crystal panel 301, the image display surface of the sensor-equipped liquid crystal panel 301 and the light incident direction are perpendicular to each other. It is explanatory drawing which shows the example to do. FIG. 19 shows a state in which the sensor built-in liquid crystal panel 301 is viewed from above.

  As shown in FIG. 19, when light is incident on the sensor built-in liquid crystal panel 301, the driving device makes the direction in which the sensor built-in liquid crystal panel 301 faces become the light incident direction (the light incident direction and the sensor The direction of the sensor built-in liquid crystal panel 301 is changed so that the image display surface of the built-in liquid crystal panel 301 is vertical.

  Thus, when the light emitting device 1801 is present near the user, such as when the user has the light emitting device 1801, the sensor built-in liquid crystal panel 301 faces the user. The built-in liquid crystal panel 301 is easily seen.

  Further, when the sensor built-in liquid crystal panel 301 is capable of dual view (displaying different contents simultaneously when viewed from the right side and when viewed from the left side of the display screen), the sensor built-in liquid crystal panel 301 is displayed. A configuration in which subsequent processing is different depending on the incident direction of light is also possible.

  That is, for the sensor built-in liquid crystal panel 301, the processing corresponding to the display viewed from the right side is applied to the light incident from the right side, and the display viewed from the left side is applied to the light incident from the left side. Perform the process.

  Thereby, the processing corresponding to the display seen from each direction can be performed, and two contents (for example, a game etc.) can be implemented with one sensor built-in liquid crystal panel 301. FIG.

  In addition, it is possible to perform dual view in the sensor built-in liquid crystal panel 301 by combining a known dual view liquid crystal configuration with the sensor built-in liquid crystal panel 301.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments can be obtained by appropriately combining technical means disclosed in different embodiments. The form is also included in the technical scope of the present invention.

  Finally, each block of the data display / sensor device 100, in particular, the circuit control unit 600, the data processing unit 700, and the main control unit 800 may be configured by hardware logic, or a CPU (central processing) as follows. unit), and may be realized by software.

  That is, the data display / sensor device 100 includes a CPU that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, a RAM (random access memory) that expands the program, and the program And a storage device (recording medium) such as a memory for storing various data. An object of the present invention is a record in which a program code (execution format program, intermediate code program, source program) of a control program of the data display / sensor device 100, which is software that realizes the above-described functions, is recorded in a computer-readable manner This can also be achieved by supplying the medium to the data display / sensor device 100 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU (microprocessor unit)).

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, a CD-ROM (compact disc read-only memory) / MO (magneto-optical) / Disk systems including optical disks such as MD (Mini Disc) / DVD (digital versatile disk) / CD-R (CD Recordable), card systems such as IC cards (including memory cards) / optical cards, or mask ROM / EPROM ( An erasable programmable read-only memory) / EEPROM (electrically erasable and programmable read-only memory) / semiconductor memory system such as a flash ROM can be used.

  The data display / sensor device 100 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN (local area network), ISDN (integrated services digital network), VAN (value-added network), CATV (community antenna television) communication. A network, a virtual private network, a telephone line network, a mobile communication network, a satellite communication network, etc. can be used. In addition, the transmission medium constituting the communication network is not particularly limited. For example, IEEE (institute of electrical and electronic engineers) 1394, USB, power line carrier, cable TV line, telephone line, ADSL (asynchronous digital subscriber loop) line Wireless such as IrDA (infrared data association) and remote control such as remote control, Bluetooth (registered trademark), 802.11 wireless, HDR (high data rate), mobile phone network, satellite line, terrestrial digital network, etc. But it is available. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  Since the position and direction of light incident on the display screen can be determined, the present invention is suitable for a shooting game in which a target displayed on the display screen is shot with a device that emits light.

DESCRIPTION OF SYMBOLS 11 Image display processing part 12 Incident light recognition part 13 Hit determination part 14 Scan processing part 21 Image data storage part 22 Incident light data storage part 23 Scan processing data storage part 24 Scan data storage part 100 Data display / sensor apparatus (direction identification apparatus) )
111 Beam gun (outgoing device)
121 Position specifying unit (position specifying means)
122 direction specifying part (direction specifying means)
123 Distance calculation unit (distance calculation means)
124 Incident light discrimination unit (color discrimination means, light reception pattern discrimination means)
301 Liquid crystal panel with built-in sensor (planar member)
312 Light sensor (light detector)
901 Memory unit

Claims (7)

In the direction specifying device that specifies the incident direction of the incident light,
A light detection unit that has a light receiving surface and detects incident light received by the light receiving surface;
Comparison of the contour of the light detected by the light detection unit on the light receiving surface when the light emitted from the light emitting device is incident on the light receiving surface, and a predetermined contour of the cross section of the light emitted from the light emitting device A direction specifying device, comprising: direction specifying means for specifying the incident direction of the light based on the result. The light detection unit is composed of a plurality of photosensors arranged in a matrix in the display region, with the display region of a planar member that performs display serving as the light receiving surface.
A position specifying means for specifying an incident position of the incident light received in the display area of the planar member in the display area by a position in the matrix of the photosensor that detects the light is provided. Item 4. The direction specifying device according to Item 1.   The direction specifying device according to claim 1, further comprising a color discriminating unit that discriminates a color of light detected by the light detection unit.   4. A light receiving pattern discriminating means for discriminating a temporal pattern defined by a combination of a period in which light is received on a light receiving surface of the light detection unit and a period in which light is not received. The direction specifying device according to any one of the above. A diffusivity indicating how much light detected by the light detection unit diffuses per unit distance, and a reference representative value that is a representative value indicating the size of the cross section of the light at a predetermined point after emission. Memorizing storage unit;
Based on the representative value indicating the cross-sectional size of the light detected by the light detection unit on the light receiving surface and the diffusivity and the reference representative value stored in the storage unit, The direction specifying device according to any one of claims 1 to 4, further comprising distance calculating means for calculating a distance to the device.   6. The direction specifying device according to claim 1, wherein the direction specifying unit outputs information indicating the specified direction to the outside. A direction specifying method for specifying an incident direction of incident light,
A light detecting step for detecting light emitted from the emitting device received by the light receiving surface;
A direction specifying step for specifying an incident direction of the light based on a comparison result between a contour of the light detected in the light detecting step on the light receiving surface and a predetermined contour of a cross section of the light emitted by the emitting device; The direction specifying method characterized by including.

Images