JP2007018146A - Position coordinate input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a position coordinate input device for regularly displaying original image by using the display screen of a display means, and for inputting position coordinates with a simple configuration. <P>SOLUTION: An information control part 5 generates an altered image frame altered so that pixel patterns 60 are different in all unit regions 20 for an arbitrary normal image frame. Also, a plurality of image frames including the altered image frame are successively displayed on the display screen of a display device 2. An image pickup element 42 in a touch pen 4 images a unit region 20 in the altered image frame, and a coordinate position specifying part 43 decides the position of the unit region 20 based on the pixel pattern 60 of the imaged altered image frame, and specifies an input object coordinate position 21. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a position coordinate input device that inputs position coordinates using a display surface of a display means.

  Conventionally, a technique for inputting position coordinates using a display surface of a display device is known. Among them, a representative example is a display device having a touch panel function. This is a configuration in which a touch panel sheet is mainly mounted on a display panel, and the position coordinates are input by specifying the coordinate position of an object in contact with the touch panel sheet. However, in such a display device with an external touch panel function, a touch panel sheet is a necessary item, which increases the number of parts of the device and is not easy to attach.

  Recently, a display device having a touch panel function built in the display panel has been developed. In this case, an element for specifying the coordinate position as described above is arranged in each pixel. However, in such a display device with a built-in touch panel function, it is necessary to develop such a display panel individually for each product, so that the development cost increases and the touch panel function fails. However, there is a problem that the entire display device needs to be repaired.

  Thus, conventionally, in order to input the position coordinates using the display surface of the display device, the configuration becomes complicated, and it has been necessary to realize it with a dedicated display device.

  Therefore, some proposals have been made to solve such problems. For example, Patent Document 1 displays a dedicated coordinate pattern for specifying the coordinate position separately from the original image display pattern, and reads the pattern with the optical pen, and is instructed on the screen with the optical pen. A technique for specifying the position is disclosed.

JP 7-141104 A

  According to the technique disclosed in Patent Document 1, there is a possibility that the position coordinates can be input without complicating the configuration and without selecting a display unit.

  However, in the technique of Patent Document 1, since it is necessary to display a dedicated coordinate pattern on the entire display surface, original normal image display is hindered. Patent Document 1 also describes a technique for canceling such a coordinate pattern display by using a reverse pattern display. However, even in such a configuration, the original image display cannot be performed while the dedicated coordinate pattern and its reverse pattern are displayed.

  As described above, in the conventional technique requiring a dedicated member or a display pattern, it is difficult to input position coordinates with a simple configuration while constantly performing original image display.

  The present invention has been made in view of such problems, and the object thereof is to input position coordinates with a simple configuration while constantly performing original image display using the display surface of the display means. It is to provide a position coordinate input device.

  The position coordinate input device of the present invention is a device for inputting an arbitrary position coordinate using the display surface of the display means, and a unit of a predetermined size by modifying a picture of an arbitrary image frame Frame generating means for generating different modified image frames among all unit regions in which pixel patterns in the region are cut out from arbitrary image frames, and a plurality of image frames including the modified image frames are sequentially displayed in time series A display control means to be displayed on the display surface, and an image capturing unit that captures an image of a unit area including the input target coordinate position in the modified image frame displayed on the display surface while being positioned at an arbitrary input target coordinate position on the display surface And the pixel pattern of the unit area based on the imaging result of the imaging unit, and the imaging hand based on the identification result By determining the position of the imaged unit region by, in which a coordinate position specifying means for specifying an input target coordinate position.

  Here, the “predetermined size” is a concept including not only the literal size (number of pixels) but also the shape (how to arrange the pixels). In addition, “all unit regions to be cut out” means, for example, when an m × n pixel region (m, n: natural number) is used as a unit region, m × n with respect to the arrangement of all pixels constituting the image frame. It means all areas cut out by the m × n pixel frame when the pixel frame is shifted one pixel at a time in the vertical and horizontal directions.

  In the position coordinate input device of the present invention, a modified image frame is generated by modifying a design of an arbitrary image frame, and a plurality of image frames including the modified image frame are displayed in time series. Are displayed in sequence. At this time, when the input target coordinate position is positioned on the display surface, an image of the unit region including the position is captured in the modified image frame. When the pixel pattern of the unit region is identified by such imaging, the pixel pattern is different between all the unit regions in the modified image frame, and the position of the unit region is determined based on the identification result. Thus, the input target coordinate position is specified.

  According to the position coordinate input device of the present invention, a modified image frame is generated by modifying a given image frame so that pixel patterns are different between all unit regions, and a plurality of image frames including the modified image frame are generated. Since the image frames are sequentially displayed on the display surface, the position of the unit area is determined by imaging the unit area in the modified image frame, and thereby the input target coordinate position is specified. It is possible to input the position coordinates with a simple configuration while performing constantly.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[First Embodiment]
FIG. 1 shows the overall configuration of a position coordinate input system according to the first embodiment of the present invention. This position coordinate input system uses the display surface of the display device 2 to identify the position touched by the touch pen 4 on the display surface and displays it as the position coordinate 21. The position coordinate input device 1, The display apparatus 2 is comprised. The position coordinate input device 1 includes a display control unit 3, a touch pen 4, and an information control unit 5. Of these, the display control unit 3 and the information control unit 5 are configured by, for example, a personal computer (PC).

  The display device 2 includes, for example, an organic or inorganic EL (ElectroLuminescence) display or LCD (Liquid Crystal Display) in which a plurality of pixels (pixels 6 to be described later) are arranged in a matrix over the entire surface. Yes. The display device 2 constitutes a normal image frame by performing a line-sequential display operation based on the normal image frame data DV supplied from the display control unit 3, and displays a normal image such as a predetermined figure or character. It is. In addition to the normal image frame data DV, the display device 2 is supplied with modified image frame data DF from the display control unit 3. Based on the modified image frame data DF, the display device 2 also has a function of displaying modified image frames configured so that pixel patterns in unit areas of a predetermined size on the display surface are different between all unit areas. . In this way, on the display surface of the display device 2, in addition to the normal image frame based on the normal image frame data DV, the modified image frame based on the modified image frame data DF is sequentially displayed in time series, thereby displaying the display surface. The position touched with the touch pen 4 is identified and displayed as position coordinates 21.

  As described above, the display control unit 3 supplies the normal image frame data DV and the modified image frame data DF to the display device 2 and controls the display device 2 to perform a sequential display operation in time series. is there.

  Here, the details of the modified image frame based on the modified image frame data DF will be described with reference to FIGS.

  FIG. 2 schematically shows the modified image frame displayed on the display device 2. As can be seen from this figure, the modified image frame displayed on the display device 2 is composed of a plurality of unit areas 20, and this unit area 20 has a plurality of pixels 6 (for example, 6 pixels in the horizontal direction × 6 pixels in the vertical direction). 36 pixels in total). Each pixel 6 includes three subpixels (a red subpixel 6R, a green subpixel 6G, and a blue subpixel 6B) for emitting each primary color light for color display.

With such a configuration, the combination of the display states of each pixel 6 is shown at the right end of FIG. 2 in consideration of the white display state (lighted state) and black display state (off state) of each subpixel 6R, 6G, 6B. as becomes a are 2 ³ = 8, a combination of display state in the further one unit region 20 (the number of pixel patterns 60) is a huge number of (2 ^{3) 36/36>} 10 ^32. Here, for example, when the resolution of the display surface of the display device 2 is SXGA (Super eXtended Graphics Array), the horizontal direction is 1280 pixels and the vertical direction is 1024 pixels, so the number of unit areas 20 included in the display surface is Is (1280/6) × (1024/6) = about 36600. Therefore, since the number of pixel patterns 60 in one unit region 20 (about 10 ³² )> the number of unit patterns included in the display surface (about 36600), the pixel pattern 60 of each unit region 20 on the display surface is It is possible to make them different from each other.

For example, FIG. 3 shows an example of pixel patterns (pixel patterns 60A to 60D) in a plurality of unit areas in the modified image frame. Here, each pixel pattern includes only red sub-pixels 6R, that is, green sub-pixels. The pixel 6G and the blue sub-pixel 6B always show a black display state (light-off state). In these pixel patterns 60A to 60D, as an example, out of 6 × 6 = 36 pixels, 5 or less pixels are in a light-off state (black display state). The number is given by the following equation (1).
_{36 C 0 + 36 C 1 +} 36 C 2 + 36 C 3 + 36 C 4 + 36 C 5 = 443704 ... (1)

  Therefore, since the resolution of the display surface is larger than the number of unit patterns (about 36600) in the case of SXGA, the pixel patterns 60 of each unit region 20 are configured to be different from each other as described above. Further, not only each unit area 20 but also arbitrary areas as indicated by reference numeral 20A, for example, have different pixel patterns. Since the pixel pattern 60 on the display surface is configured in this way, the position coordinate 21 with which the touch pen 4 is in contact is specified, as will be described later. Note that the creation of the modified image frame based on the normal image frame is performed by the information processing unit 5 described later. In addition, here, the case where the resolution of the display surface of the display device 2 is SXGA has been described, but the configuration can be made in any other resolution.

  However, in the pixel pattern 60 configured by the white display state (lit state) and the black display state (off state) of each of the sub-pixels 6R, 6G, and 6B, a video image based on the normal image frame and a video image based on the modified image frame are remarkably generated. Since it will be different, it may appear as flicker on the display surface. That is, since it is necessary to display the modified image frame on the entire display surface in order to specify the position coordinate 21 with which the touch pen 4 is in contact, the original normal image display (display of the original normal image frame) ) Will be hindered.

  Therefore, in the modified image frame of the present embodiment, the pixel patterns 60A to 60D of each unit region 20 are only displayed in the white display state (lighted state) and the black display state (off state) of each subpixel 6R, 6G, 6B. Instead, it is expressed using a plurality of luminance levels (gradation levels). Specifically, for example, as shown in FIG. 4A, in the sub-pixel representing the lighting state (in the case of FIG. 3, the red sub-pixel 6R), for example, the luminance level is Rn to R (n-1). In the red sub-pixel 6R representing the off state, the luminance region Ron1 is expressed by using, for example, the luminance region Roff1 having luminance levels R0 to R2, respectively. Further, the luminance level and color information of the pixel pattern 60 in each unit area 20 are detected for each unit area from the original normal pixel frame data DV. Thus, since the pixel patterns 60A to 60D of each unit region 20 are expressed using a plurality of luminance levels of the sub-pixels 6R, 6G, and 6B, the modified image frame is displayed on the entire display surface. Even if it is, the original normal image display (display of the normal image frame) is not hindered. As shown in FIG. 4B, the luminance region (luminance region Ron2) of the sub-pixel indicating the lighting state and the luminance region (luminance region Roff2) of the sub-pixel indicating the non-lighting state are set as wide as possible. Is preferred. This is because more colorful colors can be expressed and the original normal image frame can be displayed without being disturbed (more naturally).

  FIG. 5 schematically shows processing when creating a modified image frame. As described above, the pixel patterns (for example, the pixel patterns 601 and 602) of each unit region (for example, the unit regions 201 and 202) in the modified image frame are different from each other in all the unit regions and arbitrary regions. Are assigned from the basic pixel pattern 600 configured as shown in FIG. Specifically, such a pixel pattern is stored, for example, in a storage unit (not shown) in the information control unit 5, and when a modified image frame is created from a normal image frame, the normal image Unit areas (for example, unit areas 201 and 202) of the frame are cut out, and pixel patterns (for example, pixel patterns 601 and 602) at corresponding positions in the basic pixel pattern 600 are read out, and these cut out unit areas 201 are read out. , 202. At this time, a predetermined parameter is derived based on the luminance level and color information of the cut unit areas 201 and 202, and the parameter is added to the pixel patterns 601 and 602, thereby, as described above. The pixel pattern 60 of each unit area is expressed using a plurality of luminance levels of the sub-pixels 6R, 6G, and 6B.

  The basic pixel pattern 600 is preferably configured so that it can be applied to a display surface with the assumed maximum resolution. This is because if it can be applied to the display surface with the maximum resolution, it can be applied by using a partial region of the basic pixel pattern 600 in the case of a lower resolution. If one such basic pixel pattern 600 is prepared, it can be used in common for the pixel patterns formed by the sub-pixels 6R, 6G, and 6B.

  Returning to the description of FIG. 1, the touch pen 4 inputs an arbitrary position coordinate 21 on the display surface by instructing and contacting an arbitrary position on the display surface of the display device 2 at the tip thereof as described above. For this purpose, a contact monitoring unit 41, an image sensor 42, and a coordinate position specifying unit 43 are provided. In addition, the touch pen 4 may include, for example, a calculation unit (not shown) that performs a predetermined calculation.

  The contact monitoring unit 41 is a part that constantly monitors whether or not the tip of the touch pen 4 is in contact with the display surface of the display device 2 and includes, for example, a piezoelectric element. Specifically, for example, as illustrated in FIGS. 6A and 6B, the tip portion 410 of the touch pen 4 touches the display surface of the display device 2 to be in an on state, thereby making contact. It comes to judge. Thus, the determination (contact notification signals ST1 and ST2) of whether or not the tip portion 410 of the touch pen 4 is in contact is notified to the image sensor 42 and the information control unit 5, respectively.

  The image sensor 42 is disposed at the tip of the touch pen 4, and images a predetermined area (image pickup area 22) around the tip in time series. The image sensor 42 is constituted by, for example, a CCD (Charge Coupled Device). Here, the imaging region 22 is configured to include each unit region 20 in the modified image frame, for example, as shown in FIG. In consideration of the case of imaging from an oblique direction, it is desirable that the imaging area 22 has a certain degree of margin. Further, the imaging signal SI obtained in this way is output to the coordinate position specifying unit 43.

  The image sensor 42 also specifies each pixel 6 of the normal image frame at high speed and continuously after the position coordinate 21 with which the touch pen 4 is in contact is specified (initial specification) based on the pixel pattern 60 of the modified image frame. It also has a function for imaging. Specifically, as shown in FIG. 8A, for example, based on the pixel pattern 60 of the modified image frame, for example, the position coordinate with which the touch pen 4 is in contact is initially specified as the position of the position coordinate 21A. Then, when the position coordinate with which the touch pen 4 is in contact is specified as the position coordinate 21B again based on the pixel pattern 60 of the modified image frame, the touch pen 4 comes into contact between the position coordinates 21A and 21B. It is impossible to specify whether the trajectory was the route r1 or the route r2. This is because the frame interval of each image frame including the normal image frame and the modified image frame is about several tens of ms, whereas the speed at which a human draws a line with the touch pen 4 or the like on the display surface is 2 cm / ms or more. This is because even if each image frame is composed of modified image frames, the trajectory at the frame interval cannot be detected. In view of this, the image sensor 42 of the present embodiment is configured to image each pixel 6 of the normal image frame at high speed and continuously as shown in FIG. 8B, for example. In this manner, the continuous imaging result of each pixel 6 is also supplied as the imaging signal SI to the coordinate position specifying unit 43, whereby the trajectory information of the touch pen 4 is sequentially detected, and the position coordinate 21 after the initial specification is specified. It has become so.

  The coordinate position specifying unit 43 is a part that specifies the position coordinate 21 with which the touch pen 4 is in contact based on the imaging signal SI from the imaging element 42. Specifically, when the position coordinates 21 are initially specified, the pixel pattern 60 of the unit region 20 in the modified image frame is identified based on the imaging signal SI, and the unit region 20 captured based on the identification result is identified. By determining the position, the position coordinate 21 with which the touch pen 4 is in contact is specified. Further, after the initial specification, the trajectory information of the touch pen 4 is sequentially detected based on the imaging signal SI based on a change in the shape and position of each pixel 6 in the normal image frame, and thereby the position coordinates 21 after the initial specification are obtained. It has come to identify. Information on the position coordinates 21 thus identified (coordinate position information SF) is output to the information control unit 5.

  The information control unit 5 displays either the normal image frame or the modified image frame on the display device 2 based on the contact notification signal ST2 from the contact monitoring unit 41 and the coordinate position information SF from the coordinate position specifying unit 43. It has a function to display on the display surface of the display device 2 by determining whether or not it should be performed and outputting the coordinate position information SF to the display control unit 3. The information control unit 5 also has a function of creating a modified image frame based on the normal image frame as described above.

  Specifically, regarding the function of determining which image frame should be displayed, the information control unit 5 first determines that the tip of the touch pen 4 is in contact with the contact notification signal ST2. When it is determined that the modified image frame is to be displayed, and after that, it is determined that the first coordinate position information SF (information of the position coordinates 21 at the time of initial specification) is input while the tip of the touch pen 4 is in contact, The control signal SC and the coordinate position information SF to that effect are output to the display control unit 3 as needed.

  As for the function of creating a modified image frame, the information control unit 5 converts the modified image frame data DF based on the normal image frame data DV output from the display control unit 3 into, for example, the basic pixel pattern 600 as described above. And is output to the display control unit 5 again.

  Note that the signal transmission (transmission of the contact notification signal ST2 and the detection notification signal SL2) from the contact monitoring unit 41 and the line image detection unit 43 of the touch pen 4 to the information control unit 5 is performed, for example, via a USB (Universal Serial Bus) interface. Either a wired one or a wireless one via a wireless local area network (LAN) may be used.

  Here, the display device 2 corresponds to a specific example of “display means” in the present invention, and the display control unit 3 corresponds to a specific example of “display control means” in the present invention. The image sensor 42 and the contact monitoring unit 41 correspond to a specific example of “imaging unit” in the present invention, and the coordinate position specifying unit 43 corresponds to a specific example of “coordinate position specifying unit” in the present invention. . The information processing section 5 corresponds to a specific example of “frame generation means” in the present invention.

  Next, with reference to FIG. 9 and FIG. 10 to FIG. 14, processing for inputting position coordinates in the position coordinate input system configured as described above will be described. Here, FIG. 9 is a flowchart illustrating an example of the process of inputting the position coordinates, and FIGS. 10 to 14 illustrate the operation status of each apparatus in this process.

  First, the contact monitoring unit 41 determines whether or not the tip of the touch pen 4 is in contact with the display surface of the display device 2 (step S101). If it is determined that they are not touching (step S101: N), the operation of step S101 is repeated until it is determined that they are touching. If it is determined that they are in contact (step S101: Y), then, as shown in FIG. 10, the information control unit 5 outputs the normal image frame data DV at that time to the display control unit 3. A control signal SC for instructing to do so is output, and normal image frame data DV at that time is obtained. Next, the information control unit 5 creates the modified image frame data DF based on the normal image frame data DV (step S102), and also displays the modified image on the display control unit 3 as shown in FIG. A control signal SC for instructing to display the frame data DF and the modified image frame is output. Then, in accordance with the modified image frame data DF and the control signal SC, the display control unit 3 displays the modified image frame on the display device 2 (step S103).

  At this time, the image sensor 42 also captures the vicinity of the touch point (imaging region 22) of the touch pen 4 by receiving a notification (contact notification signal ST1) that the image sensor 42 is in contact with the contact monitoring unit 41 (step S104). ). Then, based on the imaging signal SI from the imaging element 42, the coordinate position specifying unit 43 identifies the pixel pattern 60 of the unit region 20 in the modified image frame, and the unit region 20 captured based on the identification result. By determining the position, the position coordinate 21 (position coordinate at the time of initial specification) with which the touch pen 4 is in contact is specified (step S104).

  Next, the coordinate position specifying unit 43 outputs information on the position coordinates 21 (coordinate position information SF) at the time of initial specification to the information control unit 5. The information control unit 5 thereby determines that the first coordinate position information SF has been input, and outputs a control signal SC and coordinate position information SF for instructing to display a normal image frame to the display control unit 3. To do. In this way, as shown in FIG. 12, the display of the modified image frame is completed (step S106), and the position coordinate 21 where the touch pen 4 is in contact with the normal image frame is displayed by the display control unit 3. (Step S107).

  Next, for example, as illustrated in FIG. 13, when the contact point of the touch pen 4 moves along the path r <b> 3 (step S <b> 108), the contact monitoring unit 41 again causes the tip of the touch pen 4 to come to the display surface of the display device 2. It is determined whether or not it is still in contact (step S109). If it is determined that the image is still in contact (step S109: Y), the image sensor 42 follows the notification from the contact monitoring unit 41 (contact notification signal ST1) around the contact point of the touch pen 4 in the normal image frame ( Each pixel 6 in the imaging region 22) is imaged at high speed and continuously (step S111). Then, the coordinate position detection unit 43 sequentially detects the trajectory information of the touch pen 4 based on the change in the shape and position of each pixel 6 in the normal image frame based on the continuous imaging signal SI. The position coordinate 21 is specified (step S112). The information of the specified position coordinate 21 (coordinate position information SF) is similarly output to the information control unit 5, and as shown in FIG. 13, the position coordinate 21 when the touch pen 4 is moved is displayed together with the normal image frame. The display control unit 3 displays the route r4 as needed (step S113). When the contact point of the touch pen 4 moves as shown in FIG. 13, the trajectory information of the touch pen 4 is stored in a storage unit (not shown) as needed. For example, the display surface of the display device 2 is displayed using the touch pen 4. When drawing a picture on the top, the trajectory information (route r4) may be displayed.

  On the other hand, when it is determined in step S109 that the touch pen 4 is no longer in contact with the display surface (step S109: N), as shown in FIG. 14, the display of the position coordinates 21 is ended (step S110). The process returns to step S101. Specifically, the contact monitoring unit 41 notifies the image sensor 42 and the information control unit 5 of the contact notification signals ST1 and ST2 indicating that the image sensor 42 and the information control unit 5 are not in contact with each other. The control unit 5 outputs a control signal SC for instructing the display control unit 3 to end the display of the position coordinates 21. In this way, the operation of step S101 is repeated until it is determined that the tip of the touch pen 4 is in contact again.

  Finally, after step S113, the information control unit 5 determines whether or not to end such position coordinate input processing based on, for example, a user instruction (step S114). If it is determined that the process is not finished yet (step S114: N), the processes of steps S108 to S113 are repeated. If it is determined that the process is finished (step S114: Y), the process of inputting position coordinates is performed. Ends.

  As described above, according to the present embodiment, the modified image frame is generated by modifying the arbitrary normal image frame so that the pixel patterns 60 are different from each other between all the unit regions 20. A plurality of image frames including the frame are sequentially displayed on the display surface of the display device 2, and the position of the unit region 20 is determined by imaging the unit region 20 in the modified image frame, thereby specifying the input target coordinate position. As a result, it is possible to input position coordinates with a simple configuration while constantly performing original image display.

  In addition, since a predetermined parameter is derived for each unit region 20 and a modified image frame is created based on the parameter and the basic pixel pattern 600, different pixel patterns can be prepared in advance, and the image can be quickly displayed. A modified image frame can be created by a simple method.

  Furthermore, after the input target coordinate position is initially specified, the image sensor 42 continuously captures the input target coordinate position after the touch pen 4 has moved, and the input coordinate position based on the trajectory information detected thereby. Therefore, it is not necessary to display the modified image frame after the initial specification, and it is possible to specify while displaying the normal image frame.

  In the position coordinate input system according to the present embodiment, each pixel pattern 60 in the unit region 20 may be composed of only the green sub-pixel 6G and the blue sub-pixel 6B. For example, as shown in FIG. In addition, each pixel pattern (each pixel pattern 60E to 60H) may be configured to display in black and white using all the subpixels of the red subpixel 6R, the green subpixel 6G, and the blue subpixel 6B. In addition, when the black and white display is configured using all the sub-pixels as described above, for example, as shown in FIG. 16, the number of lighting pixels per unit area 20 is set to black with the white display areas W1, W2, etc. It is desirable to set in advance so that the display areas B1, B2, etc. can be distinguished.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. The configuration of the position coordinate input system of the present embodiment is basically the same as that of the first embodiment. The difference from the first embodiment is the configuration of each pixel pattern 60 in the unit region 20, and all the subpixels of the red subpixel 6R, the green subpixel 6G, and the blue subpixel 6B are independent of each other. In other words, a color display configuration is employed. Therefore, the description of the overall configuration of the position coordinate input system (corresponding to FIG. 1 in the first embodiment) is omitted.

  FIG. 17 illustrates an example of a pixel pattern in a plurality of unit regions in the modified image frame according to the present embodiment, and corresponds to FIG. 3 in the first embodiment. In these drawings, the same components as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  In FIG. 17, as described above, in each of the pixel patterns 60I to 60L, the red subpixel 6R, the green subpixel 6G, and the blue subpixel 6B operate independently. Specifically, in the unit region 60I, the red unit region is configured by operating only the red subpixel 6R, and in the unit region 60J, the blue unit region is configured by operating only the blue subpixel 6B. In the region 60K, the red subpixel 6R and the green subpixel 6G operate independently to form a yellow unit region. In the unit region 60L, the green subpixel 6G and the blue subpixel 6B operate independently. This constitutes the purple unit region. In this way, each sub-pixel operates independently, thereby enabling various color expressions.

  In addition, instead of color (in addition to color), it may be configured to distinguish by luminance. Further, only one or two of RGB may be changed. However, in this case, the image sensor 42 in the touch pen 4 needs to be configured so that such colors and luminances can be distinguished.

  FIG. 18 is a photograph showing a comparison image between the modified image frame and the original normal image frame. FIG. 18A shows a video image of the original normal image frame, and FIG. Each picture of the modified image frame is shown.

  As shown in FIG. 18B, in the video photograph of the modified image frame, as shown in FIG. 18A, the number of pixels constituting the unit area 20 is larger than that of the original normal image frame video photograph. Although the resolution is reduced by this amount, it can be seen that an image close to the original normal image frame is formed. Further, when such a modified image frame is actually displayed in the normal image frame on the display surface of the display device 2, it is considered that the user hardly understands the difference with the naked eye. In this manner, it can be seen that a modified image frame close to the original normal image frame can be created in the position coordinate input system of the present embodiment.

  As described above, according to the present embodiment, all the subpixels of the red subpixel 6R, the green subpixel 6G, and the blue subpixel 6B operate independently in each pixel pattern 60 of the unit region 20. In other words, since the color display configuration is adopted, in addition to the effects of the first embodiment, a modified image frame closer to the original normal image frame image can be created.

  Although the present invention has been described with reference to the first and second embodiments, the present invention is not limited to these embodiments, and various modifications can be made. For example, in the above embodiment, the configuration of the position coordinate input system has been specifically described, but the configuration is not limited to this configuration. Specifically, for example, the coordinate position specifying unit 43 may be provided not in the touch pen 4 but in the PC or the like in the same manner as the information control unit 5 or the like. 4 may be provided.

  In the above-described embodiment, the case where one unit region 20 is configured by one pixel pattern 60 has been described. However, for example, as shown in FIG. Etc.) may be configured. Specifically, for example, as shown in FIG. 19A, one unit region 20 may be composed of two pixel patterns each having a white unit region 20W and a black unit region 20B and having different luminance. For example, as shown in FIG. 19B, one unit area 20 is made up of four pixels having different colors, each consisting of a red unit area 20R, a purple unit area 20P, a green unit area 20G, and a yellow unit area 20Y. You may comprise from a pattern. When configured in this way, it is possible to suppress a reduction in the resolution of the video due to the resolution from the original normal image frame to the modified image frame, and to create a modified image frame closer to the original normal image frame video Can do. In addition, you may make it combine the difference in the pixel pattern by a color and a brightness | luminance.

  In the above embodiment, as shown in FIG. 9, the modified image frame is displayed only once at the time of initial identification. However, the modified image frame is displayed only once for the first time. Instead, the modified image frame may be displayed every time the normal image frame is displayed one or more times. When configured in this way, initial identification can be performed more reliably. In addition, since the image is periodically specified using the modified image frame even after the initial specification, the position can be specified with higher accuracy.

  In the above embodiment, as shown in FIG. 5, the case where the modified image frame is created uniformly by the basic pixel pattern 600 has been described. However, the creation method is not limited to this. The modified image frame may be created each time by the program.

  In the above-described embodiment, the imaging element 42 is described as performing imaging using display light from the display device 2. However, for example, like an optical mouse, the imaging element 42 emits light from the tip of the touch pen 4. Alternatively, imaging may be performed using the reflected light. When configured in this manner, for example, even when the entire display surface of the display device 2 is dark (for example, when the entire display device is black), it is possible to reliably capture an image and to specify the position more reliably.

  Further, in this position coordinate input device 1, for example, the shape and size (pixel information) of each pixel 6 on the display surface of the display device 2 is stored in advance in the coordinate position specifying unit 43, and based on this pixel information. Thus, the imaging area 22 by the imaging element 42 may be initially set. When configured in this manner, the image pickup element 42 can recognize the optimum image pickup region 22 in advance, and the pixel pattern 60 of the unit region 20 in the modified image frame can be identified more reliably and more reliably. The position can be specified.

It is a functional block diagram showing the whole structure of the position coordinate input system which concerns on the 1st Embodiment of this invention. It is a schematic diagram for demonstrating the pixel pattern in the unit area | region of a modification image frame. It is a top view showing an example of the modification image frame comprised only from the red subpixel. It is a schematic diagram for demonstrating the gradation area | region of the red light to be used. It is a schematic diagram for demonstrating the relationship between a basic pixel pattern and a modification image frame. It is sectional drawing for demonstrating the relationship between the contact condition of a touch pen, and imaging operation. It is a top view for demonstrating the relationship between the imaging area by a touch pen, and the unit area | region of a modification image frame. It is a top view for demonstrating the specific method of the position coordinate by the detection of locus | trajectory information. It is a flowchart showing the input process of a position coordinate. It is a functional block diagram showing the situation of input processing of position coordinates. It is another functional block diagram showing the situation of input processing of position coordinates. It is another functional block diagram showing the situation of input processing of position coordinates. It is another functional block diagram showing the situation of input processing of position coordinates. It is another functional block diagram showing the situation of input processing of position coordinates. It is a schematic diagram showing an example of the modified image frame comprised from all the subpixels of three primary colors. It is a schematic diagram for demonstrating the number of lighting pixels per unit area. It is a top view showing an example of the modification image frame concerning a 2nd embodiment of the present invention. It is a photograph showing the comparison image | video of the modified image frame which concerns on 2nd Embodiment, and a normal image frame. It is a schematic diagram for demonstrating the pixel pattern in the unit area | region which concerns on the modification of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Position coordinate input device, 2 ... Display apparatus, 20, 20A ... Unit area | region, 20R ... Red unit area | region, 20G ... Green unit area | region, 20B ... Blue unit area | region, 20P ... Purple unit area | region, 20Y ... Yellow unit area | region, 20W ... white unit area, 21, 21A, 21B ... position coordinates, 22 ... imaging area, 3 ... display control unit, 4 ... touch pen, 41 ... contact monitoring part, 410 ... tip part, 42 ... imaging element, 43 ... coordinate position specification , 5 ... Information control unit, 6 ... Pixel, 6R ... Red subpixel, 6G ... Green subpixel, 6B ... Blue subpixel, 60, 60A-60L ... Pixel pattern, 600 ... Basic pixel pattern, 601, 602 ... Unit Pattern, DI ... Imaging data, SI ... Imaging signal, ST1, ST2 ... Contact notification signal, SF ... Coordinate position information, SC ... Control signal, DV ... Normal image frame data, D ... modified image frame data, R0 to Rn ... red luminance level (gradation level) of, Ron1, Ron2 ... luminance area to be used for red light lighting state, the luminance area used for Roff1, Roff2 ... red light turned off.

Claims (8)

An apparatus for inputting arbitrary position coordinates using the display surface of the display means,
Frame generating means for generating a modified image frame in which a pixel pattern in a unit area of a predetermined size is different from each other in all unit areas cut out from the arbitrary image frame by modifying the design of the arbitrary image frame; ,
Display control means for sequentially displaying a plurality of image frames including the modified image frame on the display surface in time series;
Imaging means for capturing an image of a unit region including the input target coordinate position in the modified image frame displayed on the display surface in a state where the input target coordinate position is positioned on the display surface;
The input target coordinate position is specified by identifying the pixel pattern of the unit region based on the imaging result by the imaging unit and determining the position of the unit region imaged by the imaging unit based on the identification result A position coordinate input device comprising: a coordinate position specifying means. The frame generation means includes
Pattern storage means for storing a plurality of pixel patterns each having the same size as the unit region and different patterns;
A cutting means for cutting out all unit areas existing from the arbitrary image frame;
Parameter deriving means for deriving a predetermined parameter according to the luminance or color of the unit area for each unit area cut by the cutting means;
A reading unit that selects and reads out a corresponding pixel pattern for each unit region from the plurality of pixel patterns stored in the pattern storage unit;
An adding unit that adds the parameter derived by the parameter deriving unit to the pixel pattern read by the reading unit for each unit region;
The position coordinate input device according to claim 1, further comprising: a replacing unit that replaces the pixel pattern of the unit area cut by the cutting unit with the pixel pattern to which the parameter is added by the adding unit. The parameter derivation means derives the predetermined parameter for each unit area according to the luminance of one primary color light among the primary color lights for color display in the unit area. The position coordinate input device described in 1. 3. The position coordinates according to claim 2, wherein the parameter derivation unit derives the predetermined parameter for each unit region in accordance with each luminance of each primary color light for color display in the unit region. Input device. After the input target coordinate position is initially specified by the coordinate position specifying means, the display control means sequentially selects normal image frames that are not the modified image frames from the plurality of image frames in time series. Display on the display surface,
The imaging unit continuously displays, in a time series, an image of a region including a post-specification input target coordinate position after being initially specified by the coordinate position specifying unit in the normal image frame displayed on the display surface. Image
The coordinate position specifying unit detects the post-specification input target coordinate position trajectory sequentially based on each successive imaging result by the imaging unit, thereby intermittently specifying the post-specification input target coordinate position along a time series. The position coordinate input device according to claim 1, wherein the position coordinate input device is specified. The position coordinate input device according to claim 5, wherein the display control unit displays the modified image frame every time the normal image frame is displayed one or more times. The position coordinate input device according to claim 1, wherein one unit region includes a plurality of pixel patterns having different patterns. Pixel information storage means for storing in advance pixel information including the shape and size of each pixel on the display surface;
The position coordinate input device according to claim 1, further comprising: initial setting means for performing initial setting of an imaging region by the imaging means based on pixel information stored by the pixel information.

Images