JP2013149155A - Display device, input device and display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display technique that enables a colorful display.SOLUTION: A display device includes plural display elements arranged in proper alignment on a two dimensional plane. The display element includes an x wavelength invisible light receiver having a light receiving bandwidth in an invisible light x wavelength, a y wavelength invisible light receiver having a light receiving bandwidth in an invisible light y wavelength different from the x wavelength, and a first control unit that performs first display of visible light in A wavelength according to light reception of the x wavelength invisible light receiver, and second display of visible light in B wavelength different from the A wavelength according to light reception of the y wavelength invisible light receiver.

Description

  The present invention relates to a display device, an input device, and a display system.

  Conventionally, there is a scanner-integrated flat panel display using visible light as in Patent Document 1.

  A touch panel to which this technology is applied is also conventionally known. When any operation is performed using the touch panel, so-called multi-touch detection for detecting a touch at a plurality of different locations is usually performed. Accordingly, the user can perform various information processing operations including the touch panel by multi-touch.

  Further, Patent Document 2 discloses a display device that includes a display panel and detects an image through the display screen of the display panel in order to prevent black floating when detecting an image and to prevent flickering of the screen when the detection speed decreases. ing. In this display device, a visible light irradiating unit that irradiates visible light to the outside from the display screen, an invisible light irradiating unit that irradiates invisible light to the outside from the display screen, and a plurality of pixels that constitute the display panel. And an invisible light receiving portion that receives the reflected light of the invisible light that is formed.

JP-A-6-186585 Japanese Patent No. 4457163

  In the display device described in Patent Document 2, since light is emitted and received only with respect to invisible light having a single wavelength, it is difficult to input a variety of information. At best, information can be input only by an intensity difference of one wavelength. I could only do it.

  An object of the present invention is to provide a display technology that enables color display by various information inputs by making it possible to input various information by a plurality of wavelengths. It is another object of the present invention to provide an input device that can perform drawing using this display technology.

  According to an aspect of the present invention, there is provided a display device having a plurality of display elements aligned on a two-dimensional plane, wherein the display element has an x-wavelength invisible light receiving unit having a light-receiving region at invisible light x wavelength. A y-wavelength invisible light receiving portion having a light-receiving band at invisible light y-wavelength different from the x-wavelength, a first display of visible light of A wavelength according to light reception of the x-wavelength invisible light portion, and the y There is provided a display device comprising: a first control unit that performs a second display of visible light having a B wavelength different from the A wavelength according to light reception by the wavelength invisible light unit.

  The first display is a display by a first light emitting unit that emits visible light of the A wavelength in response to light reception by the x wavelength invisible light receiving unit, and the second display is the y wavelength invisible light. A display by a second light emitting unit that emits visible light having the B wavelength in response to light reception by the light receiving unit is preferable.

In general, visible light is emitted, and three primary wavelength bands such as RGB or cyan, magenta,
It can be selected from a complementary wavelength system such as yellow. Visible light has two or more wavelengths, generally three or four wavelengths, but is not limited by the number of wavelengths as long as it is a plurality of wavelengths. Since the associated pixel unit (light emitting unit) emits light based on the reception of invisible light, stable detection of invisible light is possible even when the luminance of the visible light emitted from the pixel unit (light emitting unit) is low. become. Therefore, occurrence of black float can be suppressed. Even when the detection speed is reduced, the invisible light that is not used for the screen display is used for the detection, so that the occurrence of screen flickering can be suppressed.

  The first display of the visible light of the A wavelength and the second display of the visible light of the B wavelength transmit the backlight unit and the visible color light of the A wavelength irradiated on the backlight unit. It is performed by a first transmission part and a second transmission part that transmits visible light having the B wavelength.

  It is preferable to have a storage unit that stores a position on the two-dimensional plane of the display element received by at least one of the x-wavelength invisible light receiving unit and the y-wavelength invisible light receiving unit.

  A color image on a two-dimensional plane can be displayed based on the correspondence between the pixel arrangement position and the emission color of the pixel.

  In addition, the present invention is an input device that inputs to the display device according to any one of the above, wherein an x-wavelength invisible light emitting unit that emits invisible light having the x wavelength and a light that emits invisible light having the y wavelength are emitted. An input device comprising: a y-wavelength invisible light emitting unit that performs a second control unit that controls light emission of the invisible light.

  For example, control is performed such as whether to emit invisible light of x wavelength or invisible light of y wavelength. The invisible light can be further increased to 3 or more in accordance with the number of emission colors.

  Furthermore, it is preferable that the second control unit adjusts light emission intensities of the x wavelength invisible light emitting unit and the y wavelength invisible light emitting unit.

  For example, the emission intensity of invisible light of x wavelength and invisible light of y wavelength can be adjusted to an arbitrary value between 0 and 1. Thereby, it can control to adjust the light emission intensity | strength of a corresponding color.

  Further, the present invention may be a display system including any one of the display devices described above and the input device described above.

  According to another aspect of the present invention, there is provided a display method using a display device having a plurality of display elements arranged in alignment on a two-dimensional plane, wherein the display element has a light receiving region at invisible light x wavelength. an x-wavelength invisible light receiving portion, and a y-wavelength invisible light receiving portion having a light-receiving band at invisible light y-wavelength different from the x-wavelength, and A wavelength visible in response to light reception by the x-wavelength invisible light portion A step of performing a first display of light, and a step of performing a second display of visible light having a B wavelength different from the A wavelength in accordance with reception of the y-wavelength invisible light portion. A display method is provided.

  The present invention may be a program for causing a computer to execute the display method described above, or may be a content-readable recording medium storing the program.

  ADVANTAGE OF THE INVENTION According to this invention, the display technique which can input various information by multiple wavelengths can be provided. In addition, a display system capable of various drawing using this display technology can be provided.

1 is an external view illustrating a configuration example of a display system capable of drawing using a display device according to a first embodiment of the present invention. It is sectional drawing which shows the internal structural example of a display element. FIG. 3A is a perspective view of a pen P, and FIG. 3B is a cut along a position in a length direction at a case portion of the pen P. FIG. It is a functional block diagram which shows the principal part structure of the display apparatus by this Embodiment. It is a functional block diagram which shows one structural example of a pen. It is a flowchart figure which shows a flow in the drawing process by this Embodiment. It is a figure which shows the structure of the pixel in the display system which can be drawn using the display apparatus by the 2nd form of this invention, and is a figure corresponding to FIG. 2 in 1st Embodiment. The configuration of FIG. 1 and the like is the same as that of the first embodiment. FIGS. 8A and 8B are other examples of pixel arrangements, and exemplarily show three primary color arrangements in which a half pixel is shifted for each line in a triangular tile arrangement or a hexagonal tile arrangement. It is.

  Hereinafter, a display device and a display system according to a first embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is an external view showing a configuration example of a display system capable of drawing using the display device according to the present embodiment. As shown in FIG. 1, the display system according to the present embodiment includes a display device A and an input device, for example, a drawing pen P. The display device A includes a control unit (controller) 3, a substrate (display panel) 5, and a power source 7. The display panel 5, X-Y2 many are aligned in a matrix on dimensional flat display elements _{(pixels) 1 (x1, y1) ~1} m, n (x m, y n) is made of. Necessary wiring and the like are provided, and the control signal from the control unit 3 is provided to the display element 1 based on the power from the power source 7.

  FIG. 4 is a functional block diagram showing a main configuration of the display device A according to the present embodiment. As shown in this figure, the display device A includes a control unit (CPU: information processing unit) 3 and a display panel 5 including a display pixel group 17 and an invisible light receiving unit group 15 on a substrate.

  The control unit 3 includes, for example, a storage unit (memory) 30, an invisible light reception signal detection unit 31, a color selection unit 33, a color intensity setting unit 35, a drawing processing unit 37, and an input / output unit 41. Alternatively, a pen pressure sensing unit may be provided on the surface of the display unit as in a conventional touch panel, or the pen pressure may be sensed based on a signal detected from the invisible light signal by the invisible light reception signal detection unit 31. Alternatively, the writing pressure and the distance may be detected by a change in the area of the detected invisible light signal.

  The display panel 5 is a panel that can display information such as characters and images on the screen, and is, for example, an electronic paper, a liquid crystal display panel, an organic EL panel, a plasma display, or an FED (field emission display). . A detailed internal configuration of the display panel 5 will be described later. The display panel 5 has an image detection function, and in the display device A, the invisible light reception signal detection unit 31 controls detection of an image depending on the emission wavelength on the screen of the display panel 5. In this example, the invisible light reception signal detection unit 31 can independently detect the x wavelength, the y wavelength, and the z wavelength.

  On the other hand, the drawing processing unit 37 performs processing for controlling information display and drawing processing on the screen of the display panel 5. Although other configurations will be described later, these drawing processing units 37 constitute a predetermined driver circuit. The input / output unit 41 performs input / output for input to the display information A, output of detection information, and control, and further, the display panel 5 surface corresponding to the writing pressure of the general pen P and the pen P The invisible light signal detection unit 31 has a writing pressure sensing function for sensing the magnitude of the light emission intensity from the pen P depending on the distance from the pen tip.

  FIG. 2 is a cross-sectional view showing an example of the internal configuration of the display element 1. As shown in FIG. 2, the display panel 5 includes a plurality of display elements (pixels) 1 that are arranged in a matrix and are a basic unit of display. Each display element 1 includes, for example, an R pixel portion (light emitting portion) 17a and an x wavelength invisible light receiving portion 15a, a G pixel portion (light emitting portion) 17b, a y wavelength invisible light receiving portion 15b, and a B pixel portion (light emitting portion). 17c and a z-wavelength invisible light receiving portion 15c are provided. Here, x, y, and z are merely examples, and different wavelength bands may be used. However, invisible light receiving parts having basically the same number of different light receiving wavelength bands are provided depending on the number of colors of the light emitting parts. . The visible light emission (or reflected light) wavelengths by R, G, B, etc. are referred to as A wavelength, B wavelength, C wavelength, and the like.

  In general, the wavelength of visible light is 380 nm to 750 nm. Invisible light refers to light having a wavelength outside visible light, and specifically includes infrared light, far-infrared light, or ultraviolet light. More specifically, as invisible light, infrared light is about 0.75 μm to 1 mm, and ultraviolet light is about 10 nm to 380 nm. Infrared light includes near infrared light having a wavelength of 0.75 μm to 2.5 μm, mid infrared light having a wavelength of 2.5 μm to 4 μm, and far infrared light having a wavelength of 4 μm to 1000 μm. There are near-ultraviolet light of 380 nm to 200 nm, far-ultraviolet light with a wavelength of 10 nm to 200 nm, extreme-ultraviolet light with a wavelength of 10 nm or less, and the like. The invisible light may be arbitrarily selected from these, or may be arbitrarily selected from invisible light having different wavelength bands. These emission wavelengths can be adjusted by the band gap of a material such as a semiconductor.

  The invisible light receiving portions 15a to 15c are, for example, invisible light receiving elements such as photodiodes and phototransistors, and receive light wavelength bands (sensing wavelengths) at x, y, and z wavelengths, which are invisible light wavelengths, respectively. Belt). These invisible light receiving portions 15a to 15c sense invisible light of a corresponding wavelength incident on the display panel 5.

  The pixel portions 17a to 17c are, for example, light emitting elements that emit RGB colors, and emit R, G, and B visible light to the outside of the display device A, for example, upward in FIG. . The R pixel portion (light emitting portion) 17a is, for example, an R light emitting element, and emits red light. The G pixel portion (light emitting portion) 17b is, for example, a G light emitting element, and emits green light. The B pixel portion (light emitting portion) 17c is, for example, a B light emitting element, and emits blue light. A full color can be displayed by the light emitting portions of these three primary colors. Of course, the pixel portion may emit other primary colors or complementary colors. In the display panel 5, the invisible light receiving portions 15 a to 15 c are all arranged at locations where the black matrix (BM) 11 is formed in the conventional display device. Also in the present embodiment, the invisible light receiving portions 15a to 15c are provided in the black matrix 11 other than the regions of the pixel portions 17a to 17c different from the black matrix.

  Thus, the display panel 5 is configured to include invisible light receiving portions 15a to 15c having three different types of invisible light wavelength sensing bands in addition to the three primary color pixel portions (light emitting portions). A light emitting unit that emits a color having a different wavelength is associated with an invisible light receiving unit that receives invisible light having a different wavelength. Therefore, the emission color can be changed depending on the wavelength of invisible light.

  In the display panel 5, invisible light is irradiated from the outside of the display panel 5 to be described later by an input mechanism such as a pen P having the invisible light emitting unit 23, and x, y are respectively received by the invisible light receiving units 15a to 15c. , Z invisible light intensity at each wavelength is detected.

  FIG. 3 is a diagram illustrating an external configuration example of the pen P. As illustrated in FIG. 3A is a perspective view of the pen P, and FIG. 3B is a cross-sectional view taken along a position in the length direction at the case portion of the pen P. FIG. FIG. 5 is a functional block diagram illustrating a configuration example of the pen P. As illustrated in FIG. 5 and 3A, the pen P includes, for example, a cylindrical case (housing) 21, a plurality of invisible light emitters 23 provided on one end side thereof, and, for example, the other end side. The invisible light wavelength changeover switch 27 and a power source 25 such as a built-in battery are provided. The shape of the pen P, the arrangement of each part, etc. are arbitrary. As shown in FIG. 3B, the plurality of invisible light emitters 23 in the case 21 of the pen P are, for example, an x-wavelength invisible light emitter 23a, a y-wavelength invisible light emitter 23b, z at the tip of the case 21. A wavelength invisible light emitter 23c is arranged. These invisible light emitting units can emit any one or a combination thereof by the changeover switch 27. In addition, it is preferable that the respective emission intensities can be arbitrarily adjusted, for example, between a minimum intensity 0 that does not emit light and a maximum intensity 1. Further, not only point light emission but also surface light emission in a shape like a blackboard eraser may be used.

  By touching or approaching the light emitting part side (pen tip) of the pen P toward the display panel 5, the x wavelength invisible light emitting part 23a, the y wavelength invisible light emitting part 23b, and the z wavelength invisible light emitting part 23c. The display panel can be irradiated with any combination of the light emission from.

  Note that one pixel region of the display panel 5 is preferably formed sufficiently fine with respect to the emission width (region). The light receiving intensity on the display panel 5 side based on the light emission from the tip of the pen P becomes higher as the tip of the pen P approaches the display panel 5, so just as a general pen is strongly pressed against paper or the like to write characters. Drawing closer to the display panel 5 so that the character becomes thicker enables thicker drawing. Also, the thickness of the drawing can be changed by adjusting the light emission intensity on the pen P side. In this case, it is possible to devise such as changing the optical focus adjustment function by pressure.

  As described above, the display device A can detect invisible light for each wavelength on the screen of the display panel 5. Therefore, stable detection of invisible light from the pen P is possible even when the luminance of visible light emitted from the pixel portions (light emitting portions) 17a to 17c is low. Therefore, it is possible to avoid the black float that has occurred in the prior art. Further, even when the detection speed is lowered, since the invisible light that is not used for the screen display is used for the detection, the screen does not flicker.

  Further, as the invisible light receiving unit, a plurality of types of light receiving units having sensing bands in a plurality of different wavelength bands are used, and these different light receiving units are associated with light emission from the light emitting units 17a to 17c having different wavelengths such as RGB. Therefore, the user can draw a desired color with a desired thickness or the like by adjusting the emission intensity of xyz corresponding to RGB by switching / adjusting the pen P, etc. It can be used as a color electronic blackboard.

  At this time, the visible color multicolor light emitting part such as a multicolor light emitting diode (see reference numeral 29 in FIG. 3) installed in the housing 21 in accordance with the drawing color is used to display the same color as the drawing color. The body color may be changed, or the light may be emitted in the same color as the drawing color only in the pen tip portion or the case tail portion. By changing the housing color or the like, the user can check the current drawing color.

  FIG. 6 is a flowchart showing the flow of the drawing process according to the present embodiment. Below, it demonstrates as a process in the control part 3 of the display apparatus A. FIG.

  First, in step S1, when the user starts a drawing operation by emitting a predetermined wavelength, for example, x wavelength invisible light, and irradiating the display panel 5 with the pen P (start), the display device A The brightness of the x-wavelength invisible light that has entered the R pixel portion 17a is detected by the x-wavelength invisible light detector 15a disposed in each pixel 1 (step S2). Thus, the invisible light receiving unit functions as the invisible light receiving signal detecting unit 31 for detecting the invisible light emission wavelength, and the invisible light wavelength detected by the invisible light receiving signal detecting unit 31 is associated with the invisible light receiving signal detecting unit 31. The light emission color used for display is selected according to the light emission color of the pixel unit, and this functions as the color selection unit 33. Further, the light reception intensity of invisible light in the invisible light receiving unit depends on the intensity of light emission of invisible light when drawing on the display panel P with the pen P. Each received light intensity and the corresponding light emission intensity are set in the color intensity setting unit 35. This set value is stored in the storage unit 30, but can be changed by the color intensity setting unit 35.

  As light emission from the pen P, light emission by a combination of invisible lights such as three wavelengths of x, y, and z can be used.

  Here, since the x-wavelength invisible light receiving unit 15a corresponds to the R image unit 17a in the example of FIG. 2, the R color is selected, and the light intensity is also detected (step S3). A series of these processes is detected by the invisible light reception signal detection unit 31 via the input / output unit 41 and functions as the color selection unit 33 of the drawing processing unit 37.

  The position on the display panel 5 currently receiving invisible light, that is, the position on the two-dimensional plane of the display element 1 in FIG. 1 is the touch position on the screen of the display panel 5. The type of emission wavelength in the light emitting unit 23 depending on the wavelength of the received invisible light and the display position that changes in time series can be stored in the storage unit 30. From the relationship between the type of light emission color, the display position that changes in time series, and each light reception intensity set in the color intensity setting unit 35 and the corresponding light emission intensity, the light emission color and light emission intensity in the light emission unit are I want. As described above, based on the data stored in the storage unit 30, the control unit 3 can display characters or figures drawn with the pen P within a certain time on the display panel 5 with a predetermined color and intensity. it can.

  As described above, according to the present embodiment, a display device capable of color drawing can be realized with a simple mechanism. At that time, the display device A detects an image or the like by receiving invisible light on the screen of the display panel 5. Therefore, it is possible to detect invisible light for stable drawing even when the luminance of visible light in the light emitting portion of the display panel is low, and thus it is possible to avoid the influence of black floating that has occurred in the prior art. In addition, even when the detection speed is lowered, since the invisible light that is not used for the screen display is used for detection, there is an advantage that the screen does not flicker.

  Note that the user can draw on the display device A using not only the dedicated pen described above but also another type of operation device. For example, an image can be drawn on the display device A using an operation device that can be moved to an arbitrary position on the display panel 5 and has a function of emitting invisible light. This operation device may have a mechanism that can move to an arbitrary position on a two-dimensional plane on the display device A, for example. The other invisible light adjusting mechanism may be the same as that of the pen P. Further, the user interface may be realized by using a globe or the like with a material that emits invisible light attached to a fingertip. Further, the invisible light emission image printed on the card or the like is constituted by a barcode (including two-dimensional), a stiganograph, etc., and via a separately provided communication line based on the URL embedded in the image. You may be able to access websites and electronic books.

  More specifically, a plurality of dial-like operation devices can be placed on the screen of the display panel 5 for operation, or a plurality of card-like operation devices can be placed on the screen for operation. Even if the user performs a plurality of complicated dial operations or card operations at the same time, the display device A can perform pattern detection using the invisible light described above for each operation device, so that a plurality of devices performing the operation can be distinguished. . In the case where display is performed by forming a pattern by invisible light emission on the surface of the operation device, the pattern can be formed as an arbitrary figure. For example, it may be a geometric pattern such as a two-dimensional code, a general barcode, or a radial concentric barcode. By displaying these patterns and storing the pattern pattern in the storage unit 30, it is read as a two-dimensional code including the URL of the access destination on the basis of the pattern pattern, and via the Internet from a communication unit provided arbitrarily Thus, the URL may be accessed.

  Further, as an input device, characters, symbols, pictures, codes, etc. drawn on a medium such as paper with x-wavelength invisible light, y-wavelength invisible light, z-wavelength invisible light, etc. are displayed on the display device according to the present embodiment. It is possible to perform color display such as RGB corresponding to x-wavelength invisible light, y-wavelength invisible light, and z-wavelength invisible light. In this way, a color image or the like can be displayed based on a medium that reflects invisible light that cannot be seen, and for example, functions such as a kind of decryption and watermarking can be exhibited.

  Further, when the display device A is used for a display unit such as a smartphone, a mobile phone, or a tablet PC, color drawing with the pen P is possible. Further, by using the communication function of these devices, it is also possible to use the content for distribution based on color drawing, the remote drawing function for color drawing to a large display device, or the like.

  The operation device operated by the user is not limited to the above-described pen P, dial-like operation device, or card-like operation device, but may be a mouse shape, a trackball shape, an eraser shape, or a cleaner shape. If a predetermined operation unit is provided in these operation devices, display can be performed by transmitting the invisible light emission state changed based on the operation to the display device A as information. In the present embodiment, the description is limited to three wavelengths. However, it is possible to extend to four or more wavelengths and to perform operations other than colors, for example, button operations. .

  FIG. 7 is a diagram illustrating a pixel structure in a display system capable of drawing using the display device according to the second embodiment of the present invention, and corresponds to FIG. 2 in the first embodiment. The arrangement example of FIG. 1 and the like may be the same as that of the first embodiment.

  As shown in FIG. 7, the display panel 105 according to the present embodiment includes a plurality of display elements (pixels) 101 which are basic units of display, arranged in a matrix. Each display element 101 includes, for example, an R pixel part (transmission part) 117a and an x wavelength invisible light receiving part 115a, a G pixel part (transmission part) 117b, a y wavelength invisible light receiving part 115b, and a B pixel part (transmission part). 117c and a z-wavelength invisible light receiving portion 115c are provided. x, y, and z are merely examples, and different wavelength bands may be used. However, depending on the number of colors of the light emitting part, invisible light receiving parts having basically the same number of different light receiving wavelength bands are provided. The invisible light receiving part may be arranged in the black matrix, and therefore, the boundary line with the black matrix is not clearly shown in the drawing.

  The invisible light receiving units 115a to 115c are, for example, invisible light receiving elements such as photodiodes and phototransistors, and receive light wavelength bands (sensing wavelengths) at x, y, and z wavelengths, which are invisible light wavelengths, respectively. Belt). These invisible light receiving portions 115 a to 115 c sense invisible light having a corresponding wavelength incident on the display element 101 of the display panel 105. Invisible light refers to light having a wavelength outside visible light, and specifically includes infrared light, far-infrared light, or ultraviolet light.

  The pixel units (transmission units) 117a to 117c are, for example, transmission elements that transmit RGB light. The display panel 105 is further provided with a backlight unit 121 that emits visible light (red light, green light, and blue light). Among the visible light, specific light is transmitted through the R pixel part (transmission part) 117a, the G pixel part (transmission part) 117b, or the B pixel part (transmission part) 117c and emitted toward the outside of the screen. Other configurations are the same as those of the first embodiment. Even in the reflective display system, BK may be applied if YCM by subtractive color mixing is necessary.

  Similar to the first embodiment, the invisible light is formed on the display panel 105 in any pattern using the pen P that emits invisible light having an arbitrary wavelength among the invisible lights having the x, y, and z wavelengths. , The invisible light intensities 115a to 115c detect the invisible light intensities of x, y, and z, respectively.

  And the RGB pixel part (transmission part) matched with each of invisible light light-receiving part 115a-115c will be in a permeation | transmission state or a shielding state, The desired color of the irradiation lights from the backlight 121 is obtained. Visible light is emitted on the display panel 105 and a color pattern or the like is displayed, so that it can be used as a display system such as an electronic blackboard.

  As described above, according to the present embodiment, a display device capable of color drawing can be realized with a simple mechanism. At that time, the display device A detects an image or the like by receiving invisible light on the screen of the display panel 105. Therefore, it is possible to detect invisible light for stable drawing even if the luminance of the transmitted light of the visible light in the transmissive part of the display panel is low, so that the influence of black floating that has occurred in the prior art is avoided. Can do. In addition, even when the detection speed is lowered, since the invisible light that is not used for the screen display is used for detection, there is an advantage that the screen does not flicker.

  In this embodiment, the example in which the light to be transmitted from the backlight or the like is transmitted through the transmission unit in a lump has been described. However, the backlight unit is divided into an R light source, a B light source, and a G light source. May be.

  Moreover, it may be applied not only to a display device using a transmissive backlight, but also to a self-luminous display device such as organic EL or plasma. You may design in the form superimposed on a display apparatus.

  The present invention is not limited to the above-described embodiments. Those skilled in the art can make various modifications to the present invention within the scope of the claims. That is, a new embodiment can be obtained by combining appropriately changed technical means within the scope of the claims.

(Summary and notes)
As described above, the present invention is configured such that a plurality of types of light receiving wavelengths of the invisible light receiving unit are provided on the display device side in which a large number of display elements are arranged and arranged. Then, the display color is specified on the information processing device side attached to the display device such as a computer or a smartphone based on the wavelength of the received invisible light. The color selected by the information processing unit is drawn in accordance with a trajectory detected by any of a number of display elements in the display device. The image drawn at this time may be recognized and displayed like an electronic blackboard on the apparatus body, or may be launched and stored on the cloud via a communication line, for example. The image may be shared, the image may be recognized by the apparatus, or the image may be configured to be searchable by the apparatus.

  For specifying the display color, if the invisible light receiving unit is compatible with sensing of three wavelengths, eight colors can be expressed by detecting on / off of light of each wavelength. In addition, if the light of each wavelength is captured not by turning on and off but by changing the amount of analog, arbitrary multicolor gradation expression is possible.

  As a display color of visible light, generally, in the case of an additive color mixing method in a light emitting display device, a primary color system such as RGB or the like, or in a subtractive color mixing method in a reflective display device such as electronic paper, cyan. , Magenta, yellow, and the like, which are complementary color systems, can be selected. Since the associated pixel unit (light emitting unit) emits light based on the reception of invisible light, stable detection of invisible light is possible even when the luminance of the visible light emitted from the pixel unit (light emitting unit) is low. become. Therefore, occurrence of black float can be suppressed. Even when the detection speed is reduced, the invisible light that is not used for the screen display is used for the detection, so that the occurrence of screen flickering can be suppressed.

  A description will be given of the writing device (pen) side for describing an image or a character on the display device. One of the simplest configurations includes a light emitting unit such as a battery, an invisible light emitting diode, and a case. With this configuration, as with writing with a pen on a general paper medium, when a locus is drawn while irradiating the invisible light (spot light) on the display device, the invisible light receiving element corresponding to the wavelength of the invisible light reacts. The coordinates on the screen are specified. Based on the specified coordinates, color display based on pixels of a color corresponding to a specific invisible light wavelength is performed on the elementary display device.

  At this time, the writing device may be multicolored by simultaneously illuminating a plurality of light emitting diodes or the like that match the color of the tip portion to be written. Further, only when the display screen is touched, the invisible light receiving unit may detect the color light emission by causing the color pixel to emit light.

  Next, another application example will be described. For example, a multi-button pen device may be realized by inputting a plurality of wavelengths. In addition, it may be designed so that the light emission color of the light emitting diode (Fig. 3-29) added to the pen tip etc. changes when the dial with the rotary switch is turned, and the invisible light emitted from the pen is changed to a specific frequency. The light receiving state may be improved by using a filter circuit using an electronic circuit (for example, FIG. 4-31) after receiving light modulation by modulating (for example, 1 KHz), as a subcarrier for the main signal emitted by the invisible light emitting unit. A signal subjected to quadrature amplitude modulation or quadrature balanced modulation can be received in units of pixels, and the pen-side invisible light emitting unit (for example, FIG. 5-23) has a plurality of different frequencies (for example, frequencies that are relatively prime). Invisible light that is arbitrarily modulated by, for example, may be emitted. In this case, a single invisible light receiving unit can receive a plurality of information by separating the arbitrary modulation. It may be. More specifically, the same configuration as the luminance signal and color signal using the main signal and subcarrier in NTSC is provided on the invisible light emitting side and the light receiving side so that a plurality of signals can be received for each light receiving element. Is also possible. The modulation frequency is desirably a frequency that has a low influence on the power supply frequency of lighting or the like.

  8A and 8B, a triangular tile arrangement, a hexagonal tile arrangement, a square tile arrangement with a half pixel shift for each line, a checkered pattern arrangement, and a strip-shaped three primary color arrangement. Arbitrary arrangement configurations such as these are conceivable, and it is conceivable that the drawing accuracy is improved by the arrangement. Thus, the arrangement of the images to be tiled is arbitrary, and the recognition rate of the images can be improved by using an appropriate arrangement.

  Also, three types of invisible light emitting elements are prepared with wavelengths that match the light receiving elements of the display device, and the emission color is switched by switching the switch provided on the pen (writing side case) or the contact switch on the display panel side. In addition, by configuring the emission wavelength of invisible light to be switched, it may be configured to allow multicolor expression according to the number of wavelengths, such as 8 colors for 3 wavelengths and 16 colors for 4 wavelengths. These invisible lights may be arbitrarily combined with infrared light and ultraviolet light.

  Also, for example, a rotary switch or slider volume can be provided on the pen to configure a plurality of resistance distributions so that the light emission amount of each of the three wavelengths can be controlled. The values may be switched to enable multicolor display. For example, if each wavelength can be controlled in 256 stages, it is possible to express about 16.77 million colors. At this time, it may be configured so that the writing instrument side case or pen tip light emission by visible light wavelength according to the combination of invisible light wavelengths can be realized. In the case of frequency modulation, the value and intensity of the modulation frequency can be changed. Alternatively, the intensity of the modulated light may be changed.

  The light emitting part may be a visible light transmitting part and an invisible light transmitting part having the same wavelength. In this case, the invisible light part may be configured as a black matrix.

  Moreover, the structure etc. which were described in drawing are an example to the last, Arrangement | positioning of a pixel part and an invisible light light-receiving part is arbitrary, and you may form in right and left, a lower part, and four corners.

  Further, it may be used in combination with a writing instrument by a magnetic sensor using an induction coil or the like, or may be configured in one apparatus. In this case, it is possible to realize battery-less by electromagnetic power feeding. In this case, gradation expression is possible even with a single element.

  In the above-described embodiment, the configuration and the like illustrated in the accompanying drawings are not limited to these, and can be changed as appropriate within the scope of the effects of the present invention. In addition, the present invention can be appropriately modified and implemented without departing from the scope of the object of the present invention, and can be configured in combination with a plurality of past patents.

  In addition, a program for realizing the functions described in the present embodiment is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed to execute processing of each unit. May be performed. The “computer system” here includes an OS and hardware such as peripheral devices.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. Further, the program is for realizing a part of the functions described above, and may be combined. Further, the program may be realized by a program already recorded in the computer system.

  The present invention can be used as a display device.

P ... Pen for drawing, A ... Display device, 1 ... Display element (pixel of minimum display unit), 15 ... Invisible light receiving part (representing each wavelength by accompanying x, y, z), 17 ... Pixel part (Each color is indicated by the accompanying a, b, and c.) 3... Controller (controller), 5... Substrate (display panel), 21... Case (housing), 23. Wavelength invisible light emitting unit, 23b ... y wavelength invisible light emitting unit, 23c ... z wavelength invisible light emitting unit, 25 ... power source, 27 ... switch, 29 ... visible multicolor light emitting unit, 30 ... memory unit, 31 ... invisible Light receiving signal detection unit, 33 ... color selection unit, 35 ... color intensity setting unit, 37 ... drawing display unit, 41 ... input / output unit, 101 ... display element, 115a ... x wavelength invisible light receiving unit, 115b ... y wavelength invisible Light receiving part, 115c ... z wavelength invisible light receiving part, 117 ... R pixel portion (transmission portion) 117b ... G pixel portion (transmission portion) 117c ... B pixel portion (transmission portion), 121 ... backlight unit.

Claims (13)

A display device having a plurality of display elements arranged in a two-dimensional plane,
The display element includes an x-wavelength invisible light receiving unit having a light-receiving region at invisible light x wavelength, a y-wavelength invisible light receiving unit having a light-receiving band at invisible light y wavelength different from the x wavelength,
A first display of visible light of A wavelength according to the reception of the x-wavelength invisible light part and a second display of visible light of B wavelength different from the A wavelength according to the reception of the y-wavelength invisible light part And a first control unit for performing
A display device comprising: The first display is a display by a first light emitting unit that emits visible light of the A wavelength in response to light reception of the x wavelength invisible light receiving unit,
2. The display device according to claim 1, wherein the second display is a display by a second light emitting unit that emits visible light having the B wavelength in response to light reception by the y wavelength invisible light receiving unit. . The first display of visible light of the A wavelength and the second display of visible light of the B wavelength are:
A backlight unit; a first transmission unit that transmits visible light of the A wavelength irradiated on the backlight unit; and a second transmission unit that transmits visible light of the B wavelength. The display device according to claim 1 or 2.   The storage unit stores a position on the two-dimensional plane of the display element received by at least one of the x-wavelength invisible light receiving unit and the y-wavelength invisible light receiving unit. The display device according to 1 or 2. An input device for inputting into the display device according to any one of claims 1 to 4,
An x-wavelength invisible light emitter that emits invisible light of the x wavelength, a y-wavelength invisible light emitter that emits the invisible light of the y wavelength, and a second controller that controls the emission of the invisible light. An input device comprising:   The input device according to claim 5, wherein the second control unit adjusts light emission intensities of the x wavelength invisible light emitting unit and the y wavelength invisible light emitting unit.   A display system comprising: the display device according to any one of claims 1 to 4; and the input device according to claim 5 or 6. A display method using a display device having a plurality of display elements arranged in a two-dimensional plane, wherein the display element includes an x-wavelength invisible light receiving unit having a light-receiving region at invisible light x wavelength, and the x A y-wavelength invisible light receiving portion having a light-receiving band at the invisible light y-wavelength different from the wavelength,
Performing a first display of visible light having an A wavelength in response to reception of the x-wavelength invisible light portion;
And performing a second display of visible light having a B wavelength different from the A wavelength in response to reception of the y-wavelength invisible light portion.
  A program for causing a computer to execute the display method according to claim 8.   A display device having a plurality of display elements arranged and arranged on a two-dimensional plane, wherein the display device receives invisible light modulated by an invisible light receiving unit and changes a display state.   A control device for transmitting a signal to a display using a display device having a plurality of display elements arranged in alignment on a two-dimensional plane, wherein the display device emits invisible light modulated in an invisible light emitting section. A control device characterized by transmitting a signal to.   A display system comprising the device according to claim 10 and claim 11, wherein the display state of the display device according to claim 10 is changed by obtaining a signal transmitted from the control device according to claim 11. Display system characterized by letting A program for causing a computer to function as the display system according to claim 12.

Images