JP4599819B2 - Display device, light receiving device, communication method, program, and communication system - Google Patents

Description

The present invention relates to a display device, a light receiving device, a communication method, a program, and a communication system, and in particular, a display that can process more complicated and more information in a unit time more accurately. The present invention relates to a device, a light receiving device, a communication method, a program, and a communication system.

  Conventionally, in an image display device that displays an image, each pixel constituting the display of the image display device is based on image data (luminance data) allocated and supplied to each pixel, as shown in FIG. The light emitting element emits light.

  In FIG. 1, the display unit 20 operates under the control of the display control unit 10. The display control unit 10 includes an image data output unit 11 and a switch control unit 12, and the image data output unit 11 is synchronized with a clock supplied from the outside of the display control unit 10. A switch included in the display unit 20 can process image data supplied from the outside and supply the processed image data to the display unit 20 and control the switch control unit 12 so that the image data can be allocated and supplied to each pixel. A control signal for controlling the circuit is supplied to the display unit 20.

  The display unit 20 has pixels arranged in a matrix of 100 rows and 100 columns (matrix shape). For example, in the i-th column, the pixel 21-1 in the first row, the pixel 21-2 in the second row, .., J-th row pixel 21-j, (j + 1) -th row pixel 21- (j + 1),..., 100-th row pixel 21-100, and so on. .

  For example, the pixel 21-j in the j-th row and the i-th column includes a capacitor P (i, j) for storing the supplied image data and a switch for controlling the supply of the supplied image data to the capacitor P (i, j). The circuit SW (i, j) and the light emitting element EL (i, j) that outputs the image data stored in the capacitor P (i, j) as light are configured. The switch circuit SW (i, j) is controlled by the control data G (j) for each row supplied from the switch control unit 12 through the signal line 23-j, and from the image data output unit 11 through the signal line 22. Then, a portion for the pixel 21-j is extracted from the image data D (i) supplied to the i-th column pixel and supplied to the capacitor P (i, j). The capacitor P (i, j) stores the image data as electric charge, and then supplies the electric charge to the light emitting element EL (i, j). The light emitting element EL (i, j) emits light by the electric charge.

  The display unit 20 displays the image corresponding to the image data by operating similarly in each pixel. The control data G (j) for each row supplied from the switch control unit 12 to the switch circuit of each pixel is synchronized with the vertical synchronization signal Vsync of the image data as shown in FIG. That is, in the vertical period V (a period from the rising timing of the pulse portion 31A of the waveform 31 to the rising timing of the pulse portion 31B) that is one cycle of the vertical synchronization signal Vsync, the control data G (1) to G (100) (Waveform 32 to Waveform 36) have pulse portions (32A to 36A) one by one at different timings, and the switch circuit SW of each pixel is turned on only during the period of the pulse portion. . In other words, since the image data D (i) includes image data corresponding to each pixel in the i column in order, the control data G (1) to G (100) are controlled by each switch circuit. (By pulse portions 32A to 36A), only a necessary portion is extracted from the image data D (i).

  In this way, charges are accumulated in the capacitors P (i, 1) to P (i, 100) once during the vertical period V as shown by the waveforms 42 to 46 (pulse portions 42A to 42A). 46A). Due to this accumulated charge, the light emitting element EL of each pixel also emits light once during the vertical period V in synchronization with the vertical synchronization signal Vsync of the image data. That is, data displayed by a certain pixel is constant and remains unchanged until scanning of one screen is completed and the next information is sent. That is, assuming that the time from when G (1) is turned on until one screen is drawn after G (1) is turned on again is 1V, the data is rewritten at an interval of 1V (image). It is synchronized with the vertical sync signal Vsync of the data). The actual light emission time is shorter than 1V (pulse portions 42A to 46A), but in any case, the information displayed by each pixel does not change during 1V.

  That is, the amount of data output in each pixel is limited by the time interval of vertical synchronization of image data. In order to increase the amount of data displayed on the screen, it is necessary to narrow the interval of vertical synchronization, but it is difficult to greatly improve the current situation due to the response characteristics of the pixels and the frequency characteristics of the system.

  In contrast, in a display device using an LED, the first information is provided by causing the LED to emit light, and the LED is blinked at a high speed that cannot be determined by the human eye, thereby causing the entire screen to blink. There is a method of performing communication and transmitting second information (see, for example, Patent Document 1).

JP 2002-202741 A

  However, in the case of the display device of the above method, the second information is output by blinking the entire screen, and a plurality of information is simultaneously output from a plurality of locations in the screen as the second information. There was a problem that we could not do it. For example, in Patent Document 1, “70” indicating the speed limit is displayed as the first information, and the entire display of “70” is blinked at high speed, whereby frame data including audio data is displayed in the second information. An example of a road sign that is output as information is described. In this case, in order to output a plurality of information as the second information, the plurality of information has only to be output as a single data. .

  In addition, such a display device simply outputs the second information. For example, the display position of the second information has a meaning in the screen, and the first information is output according to the output position. There is a problem that complicated output processing such as associating with information output as the information of the above cannot be performed.

  Furthermore, for example, when the second information output from such a display device is received by a CCD (Charge Coupled Device) that performs photoelectric conversion by line-sequential operation, the light reception timing differs for each pixel, and the entire CCD is The obtained information is different from the information output from the display device, and there is a problem that the second information may not be detected accurately.

  The present invention has been made in view of such circumstances, and makes it possible to more accurately process a larger amount of information in a unit time.

  In the display device of the present invention, image data output means for outputting image data to be displayed on each pixel of the display unit for displaying an image, and some of a plurality of pixels constituting the display unit as a unit. Output different modulation data to each of the plurality of units at different positions, and at the same timing, the image data is converted to the same modulation data in each pixel constituting the same unit. Modulation data output means for modulating each pixel according to the modulation data, and in each pixel supplied with the modulated image data modulated by the modulation data, a light emitting element is provided according to the modulated image data. Light is emitted.

  The units to which the different modulation data are supplied can be composed of adjacent n × n pixels.

  The modulation data output means converts the value 1 of the modulation data into +1 and the value 0 into −1, and stores the modulation data so that the cumulative addition result of the converted values is close to a predetermined value. By controlling the value, the average value of the pattern of the modulation data can be adjusted so that the amount of light reduced by the modulation is uniform between the pixels, and the modulated data after adjustment can be output.

The first communication method of the present invention outputs image data to be displayed on each pixel of a display unit that displays an image, and differs in units of a plurality of pixels that are part of the entire pixels that constitute the display unit. Different modulation data is output to each of the plurality of units at a position, and the image data is converted to the modulation data so that modulation is performed with the same modulation data in each pixel constituting the same unit at the same timing. And the step of causing each light-emitting element to emit light in accordance with the image data after modulation in each pixel supplied with the modulated image data modulated by the modulation data.

The first program of the present invention outputs image data to be displayed on each pixel of a display unit for displaying an image, and a plurality of pixels in a part of the whole pixels constituting the display unit, and different positions Output different modulation data to each of the plurality of units at the same time, and at the same timing, the image data is converted by the modulation data so as to be modulated by the same modulation data in each pixel constituting the same unit. A process including a step of causing the computer to emit light in accordance with the modulated image data in each pixel that is modulated in each pixel and supplied with the modulated image data modulated by the modulation data Let it run.

The light receiving device of the present invention outputs image data to be displayed on each pixel of a display unit that displays an image, and is in a different position with a plurality of pixels as a unit of all the pixels constituting the display unit. Different image data is output to each of a plurality of the units, and at the same timing, each pixel constituting the same unit is modulated by the same modulation data so that the image data is converted to each pixel by the modulation data. In each photodiode , the light emitted from the light emitting element is emitted in accordance with the modulated image data in each pixel to which the modulated image data modulated by the modulated data is supplied. received light, a light receiving means for outputting an electrical signal by photoelectric conversion, each of the electrical output from each photodiode of the light receiving means Comprising extracting means for extracting the modulated data from the items, and a combining means for combining a plurality of the modulated data extracted by the extraction unit to generate one of the modulated data.

The second communication method of the present invention outputs image data to be displayed on each pixel of a display unit that displays an image, and is different in units of a plurality of pixels that are part of the entire pixels constituting the display unit. Different modulation data is output to each of the plurality of units at a position, and the image data is converted to the modulation data so that modulation is performed with the same modulation data in each pixel constituting the same unit at the same timing. And receiving light emitted from a display device that emits light from a light emitting element in accordance with the modulated image data in each pixel to which the modulated image data modulated by the modulation data is supplied. received at each photodiode means, outputs an electric signal by photoelectric conversion, each output from each photodiode of the light receiving means Extracting the modulated data from the electrical signal, and synthesizes the extracted plurality of the modulated data, comprising the step of generating one of said modulated data.

The second program of the present invention outputs image data to be displayed on each pixel of a display unit that displays an image, and a plurality of pixels in a part of the entire pixels constituting the display unit, and different positions Output different modulation data to each of the plurality of units at the same time, and at the same timing, the image data is converted by the modulation data so that modulation is performed by the same modulation data in each pixel constituting the same unit. Light receiving means that emits light from a display device that emits light from a light emitting element according to the modulated image data in each pixel that is modulated in each pixel and is supplied with the modulated image data modulated by the modulation data respectively received in the respective photodiodes, and outputs an electrical signal through photoelectric conversion, output from each photodiode of the light receiving means Extracting the modulated data from the electrical signal, extracting a plurality of combining the modulated data, to execute a process including the step of generating one of the modulated data to the computer.

The communication system according to the present invention is a communication system including a display device and a light receiving device, wherein the display device includes image data output means for outputting image data to be displayed on each pixel of the display unit for displaying an image, and the display unit. A plurality of pixels in a part of all the constituent pixels are used as a unit, and different modulation data is output to each of the plurality of units at different positions, and the same in each pixel constituting the same unit at the same timing. Modulation data output means for modulating the image data in each pixel with the modulation data so that the modulation data is modulated, and each of the image data after the modulation modulated by the modulation data is supplied In the pixel, the light emitting element emits light according to the modulated image data, and the light receiving device emits light from the display device. Was received at the photodiodes, light receiving means for outputting an electrical signal through photoelectric conversion, and extraction means for extracting the modulated data from each of the electrical signals output from each photodiode of the light receiving means, said extracting means Combining a plurality of the modulation data extracted by the step of generating one modulation data.

  In the display device, the first communication method, and the first program of the present invention, image data to be displayed on each pixel of the display unit that displays an image is output, and one of all the pixels that constitute the display unit. Different modulation data is output to each of the plurality of units at different positions, with the plurality of pixels in the unit being a unit, and modulation is performed by the same modulation data in each pixel constituting the same unit at the same timing In addition, the image data is modulated in each pixel by the modulation data. In each pixel supplied with the modulated image data modulated by the modulation data, the light emitting element emits light according to the modulated image data.

In the light receiving device, the second communication method, and the second program of the present invention, the light emitted from the display device is received by each photodiode of the light receiving means, photoelectrically converted to output an electrical signal, and each of the light receiving means is output. The modulation data is extracted from each electrical signal output from the photodiode . Further, the plurality of extracted modulation data are combined to generate one modulation data.

In the display device of the communication system of the present invention, image data to be displayed on each pixel of the display unit for displaying an image is output, and a part of a plurality of pixels constituting the display unit as a unit, The modulation data is output to each of a plurality of the units at different positions, and the image data is converted to the modulation data so that modulation is performed by the same modulation data in each pixel constituting the same unit at the same timing. Thus, modulation is performed in each pixel. In each pixel supplied with the modulated image data modulated by the modulation data, the light emitting element emits light according to the modulated image data. In the light receiving device, light emitted from the display device is received by each photodiode of the light receiving means, photoelectrically converted to output an electrical signal, and modulated from each electrical signal output from each photodiode of the light receiving means. Data is extracted. Further, the plurality of extracted modulation data are combined to generate one modulation data.

  According to the present invention, information can be output. In particular, more complicated and larger amount of information can be processed more accurately per unit time.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 3 is a block diagram illustrating a configuration example of an image display device to which the present invention is applied.

  In FIG. 3, the image display device 50 displays an image corresponding to the image data supplied from the outside on the display, and modulates the image data with the modulation data supplied from the outside, whereby the image displayed on the display is displayed. It is a device that outputs other information.

  In FIG. 3, a CPU (Central Processing Unit) 61 of the image display device 50 is loaded into a RAM (Random Access Memory) 63 from a program or data stored in a ROM (Read Only Memory) 62 or from a storage unit 73. Various processes are executed in accordance with programs and data, and the entire image display device 50 is controlled.

  The CPU 61, ROM 62, and RAM 63 are connected to each other via a bus 64. An input / output interface 70 is also connected to the bus 64.

  The input / output interface 70 includes a keyboard, a mouse, and the like, and includes an input unit 71 that receives input from a user, a speaker, and the like, an output unit 72 that outputs audio data included in image data, and a hard disk. A storage unit 73 that stores programs executed by the CPU 61 and the like, data, and the like is connected.

  The input / output interface 70 is connected to a communication control unit 74 that receives input of image data and modulation data supplied from the outside of the image display device 50. The communication control unit 74 includes a modulation data input unit 81 that receives modulation data, and an image data input unit 82 that receives image data. The modulation data input unit 81 includes a buffer memory and the like, accumulates the supplied modulation data, and supplies the modulation data to the display control unit 76 for each predetermined data amount such as a frame unit. Similarly, the image data input unit 82 has a buffer memory or the like, accumulates the supplied image data, and supplies the image data to the display control unit 76 for each predetermined data amount, for example, in units of frames. . In addition, when the supplied image data includes audio data or the like, the communication control unit 74 extracts the data and supplies it to the output unit 72 via the input / output interface 70.

  The input / output interface 70 further includes an operation timing control unit 75 that controls the operation timing of the display control unit 76, a display control unit 76 that controls the operation of the display unit 77, and a display unit including an LCD (Liquid Crystal Display). 77 is connected.

  The operation timing control unit 75 includes a crystal resonator, a PLL (Phase Locked Loop) circuit, and the like, and is controlled by the CPU 61 via the input / output interface 70, and a clock signal having a predetermined frequency such as a horizontal synchronization signal and a vertical synchronization signal. And the clock signal is supplied to the display control unit 76.

  The display control unit 76 has a modulation data output unit 91 in addition to the image data output unit 11 and the switch control unit 12. When acquiring the image data supplied from the image data input unit 82 of the communication control unit 74, the image data output unit 11 processes the image data so that the image data can be supplied to each pixel of the display unit 77, as will be described later. Then, the processed image data is supplied to the display unit 77 in synchronization with the vertical synchronization signal supplied from the operation timing control unit 75. The switch control unit 12 is controlled by the image data output unit 11, and the switch included in the display unit 77 in synchronization with the horizontal synchronization signal of the image data so that the display unit 77 can distribute the image data to each pixel. A control signal for controlling the circuit is supplied to the display unit 77. When the modulation data output unit 91 acquires the modulation data from the modulation data input unit 81 of the communication control unit 74, the modulation data output unit 91 processes the modulation data so that the image data can be modulated in each pixel of the display unit 77, as will be described later. Then, the processed modulation data is supplied to the display unit 77 in synchronization with the clock signal supplied from the operation timing control unit 75.

  A detailed configuration example of the display unit 77 will be described later with reference to FIG.

  A drive 78 is connected to the input / output interface 70 as necessary, and a removable medium 79 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted, and a computer program read from them is It is installed in the storage unit 73 as necessary.

  FIG. 4 is a diagram showing a detailed configuration example of the display unit 77 in FIG.

  Each pixel of the LCD constituting the display unit 77 is arranged in a matrix of 100 rows and 100 columns (matrix shape). FIG. 4 shows some of these pixels. That is, in FIG. 4, the first row of pixels 101-1, the second row of pixels 101-2, the j th row of pixels 101-j, The pixel 101- (j + 1) in the j + 1) th row and the pixel 101-100 in the 100th row are shown.

  Since each pixel has basically the same configuration, only the pixel 101-j in the j-th row and the i-th column will be described below if not necessary. As for other pixels, only different portions will be described as necessary.

  The pixel 101-j includes a switch circuit SW (i, j), a capacitor P (i, j), and a light emitting element EL (i, j) similar to those of a conventional LCD pixel, as well as a capacitor P (i, j). ) And a modulation switch circuit SWm (i, j) for modulating image data.

  The switch circuit SW (i, j) is controlled by control data G (j) supplied from the switch control unit 12 of the display control unit 76, and from image data D (i) supplied from the image data output unit 11, This is a switch circuit that selects image data corresponding to the pixel 101-j and supplies it to the capacitor P (i, j).

  The control data G (j) is a signal for controlling the operation of the switch circuit SW of the pixel in the jth row in units of rows. The switch control unit 12 of the display control unit 76 uses the signal lines 103-1 to 103-100 for the pixel matrix of the display unit 77 based on the clock signal supplied from the operation timing control unit 75. Thus, 100 control data G (1) to G (100) for the first to 100th rows are supplied, and the switch circuit SW of each pixel is controlled for each row. For example, the switch control unit 12 controls the control data of the switch circuit SW of the pixels in the first to 100th columns of the jth row of the display unit 77 via the signal line 103-j. Supply G (j).

  The image data D (i) is image data supplied to the switch circuit SW of the pixel in the i-th column. Based on the clock signal supplied from the operation timing control unit 75, the image data output unit 11 of the display control unit 76 applies to each of the first to 100th columns with respect to the pixel matrix of the display unit 77. 100 pieces of image data D (1) to D (100) are supplied using different signal lines. For example, the image data output unit 11 includes the switch circuits SW (i, 1) to SW (i, 1) of the pixels 101-1 to 101-100 in the first row to the 100th row of the i-th column of the display unit 77. The image data D (i) is supplied to the input terminal 100) via the signal line 102.

  In the image data D (i), 100 pieces of image data from image data supplied to the pixel 101-1 in the first row to image data supplied to the pixel 101-100 in the 100th row are in a predetermined order. The images are sequentially supplied to the display unit 77 in a state of being arranged in series. The control data G (1) to G (100) are supplied to the display unit 77 in the order corresponding to the order of the image data. The switch circuits SW (1) to SW (100) in each row of the i-th column are controlled and supplied in a predetermined order corresponding to the arrangement of the image data by the control data G (1) to G (100), respectively. The image data D (i) is turned ON in the portion corresponding to the row, the image data of the portion is extracted and supplied to the capacitors P (1) to P (100), and in the other portions. Is turned off, and the supply of image data to the capacitors P (1) to P (100) is stopped.

  That is, the image data output unit 11 supplies the image data D (i) to each column of the matrix of the display unit 77 in order for each row in synchronization with the horizontal synchronization signal. At this time, the time during which the image data output unit 11 supplies the image data for all the rows is one cycle of the vertical synchronization signal. Further, the switch control unit 12 supplies the control data G for controlling the switch circuits SW of all the columns to each row of the matrix of the display unit 77 one by one in order in synchronization with the horizontal synchronization signal. At this time, the time during which the switch control unit 12 supplies the control data G for all the rows is one cycle of the vertical synchronization signal.

  The capacitor P (i, j) stores the image data selected in the switch circuit SW (i, j) as a charge as described above. The electric charge stored in the capacitor P (i, j) is supplied to the input terminal of the modulation switch circuit SWm (i, j).

  The modulation switch circuit SWm (i, j) is a switch circuit for modulating the charge supplied from the capacitor P (i, j), that is, the image data of the pixel 101-j. The modulation switch circuit SWm (i, j) is turned on or off based on the control signal Vmod (i) supplied to the control terminal from the modulation data output unit 91 of the display control unit 76 via the signal line 111. By switching the state, the image data supplied to the input terminal is modulated, and the modulated image data is supplied from the output terminal to the light emitting element EL (i, j) to emit light.

  The control signal Vmod is supplied to the display unit 77 as 100 control signals for each of the first to 100th columns. That is, the modulation data output unit 91 supplies the same control signal Vmod (i) to the pixels 101-1 to 101-100 in the i-th column. However, since the charge accumulation timing is usually different in the capacitors P (i, j) in each row, the entire waveform of the modulated image data (that is, the entire waveform of the signal supplied to the light emitting element EL) is Although different in each row, the output waveforms at the same timing are the same between the modulation switch circuits SWm that modulate and output the electric charges accumulated in the capacitors P (i, j). Note that the waveforms of the 100 control signals Vmod output by the modulation data output unit 91 for each column are independent from each other, and some or all of the control signals Vmod have the same waveform. Alternatively, all of them may have different waveforms.

  The operation timing of each element will be described with reference to FIG.

  The display control unit 76 is supplied with a vertical synchronization signal Vsync indicating a vertical period such as a signal 131 from the operation timing control unit 75. The vertical synchronization signal Vsync is a signal indicating the vertical period of image drawing by the display unit 77, and the start timing is indicated by the pulse unit 131A. That is, the period from the pulse part 131A to the pulse part 131B represents one cycle (vertical period V).

  The image data output unit 11, the switch control unit 12, and the modulation data output unit 91 of the display control unit 76 operate in synchronization with the vertical synchronization signal Vsync. As described above, in the image data D output from the image data output unit 11, the image data corresponding to the pixels in the first to 100th rows of the column are arranged in order. That is, the image data D is a signal in which image data corresponding to the pixels of the first row to the 100th row are sequentially arranged in one period of the vertical synchronization signal Vsync shown in FIG. Therefore, the switch control unit 12 has a pulse part (for example, pulse parts 132A to 136A) indicating the timing of extracting the image data of the pixel from the supplied image data D, as indicated by signals 132 to 136 in FIG. The control data G (1) to G (100) whose timings are shifted from each other are output to each row.

  By the timing of the pulse portion of the control data G, only the portion corresponding to the pixel in the supplied image data D is stored in the capacitor P of each pixel. As indicated by signals 142 to 146 in FIG. 5, the capacitor P of each pixel accumulates the accumulated image data (charges) for a predetermined period with the vertical period V as one cycle. For example, as indicated by a signal 142 in FIG. 5, the capacitor P (i, 1) accumulates electric charge in accordance with the timing of the pulse portion 132A of the control data G (1), and stores it for a predetermined period 142A. The charge is output according to the switching operation of a modulation switch circuit SWm described later. The capacitor P (i, 1) accumulates and holds charges in accordance with the timing of the pulse part 132A of the next control data G (1).

  Modulation data Vmod as shown by signal 150 in FIG. 5 is supplied to modulation switch circuit SWm. The modulation switch circuit SWm modulates the image data (charge) accumulated in the capacitor P based on the modulation data Vmod, and supplies it to the light emitting element EL. That is, the output Pm of the modulated capacitor P supplied to the light emitting element EL has a waveform like the signals 162 to 166 in FIG. 5, and the pulse portions 142A to 146A of the signals 142 to 146 are modulated by the signal 150, respectively. Thus, pulse portions 162A to 166A are obtained. For example, the modulated output Pm (i, 1) of the capacitor P is modulated by the portion 152 corresponding to the pulse portion 142A in the portion 151 corresponding to the vertical period V of the modulation data Vmod. That is, the output of the capacitor P of each pixel is modulated by different parts of the modulation data Vmod for each row, but is modulated by the same modulation data at the same timing, and all these outputs are synthesized. Thus, the original modulation data Vmod can be extracted.

  With reference to the flowchart of FIG. 6, the display control processing by the image display device 50 of FIG. 3 will be described.

  First, in the communication control unit 74 of the image display device 50, the image data input unit 82 accepts image data supplied from the outside of the image display device 50 in step S 1, and sends the acquired image data to the display control unit 76. The image data output unit 11 is supplied. In step S <b> 2, the modulation data input unit 81 of the communication control unit 74 receives modulation data supplied from the outside of the image display device 50 and supplies the acquired modulation data to the modulation data output unit 91 of the display control unit 76. To do.

  In step S3, the image data output unit 11 determines whether or not image data has been input based on the image data supplied from the image data input unit 82. If it is determined that the image data has been input, the process proceeds to step S4. The image data is output to each pixel of the display unit 77 at a timing based on the synchronization signal supplied from the operation timing control unit 75. In step S <b> 5, the switch control unit 12 is controlled by the image data output unit 11 and is synchronized with the output timing of the image data by the image data output unit 11 based on the synchronization signal supplied from the operation timing control unit 75. Then, the switch circuit of each pixel is controlled, and the image data is stored as electric charges in the capacitor of each pixel.

  In step S6, the modulation data output unit 91 determines whether or not modulation data has been input based on the modulation data supplied from the modulation data input unit 81. If it is determined that the modulation data has been input, the process proceeds to step S7. The modulation data is supplied to the modulation switch circuit of each pixel at the timing based on the synchronization signal supplied from the operation timing control unit 75, and the operation of the modulation switch circuit is controlled by the modulation data. Control and modulate the image data (charge) stored in the capacitor.

  In step S <b> 8, the display unit 77 supplies the modulated image data that is the output of the switch circuit to the light emitting elements of the respective pixels to emit light. Thus, the light emitting element outputs an image corresponding to the modulated image data (that is, both the image and the content of the modulated data). The display unit 77 that has caused the light emitting element to emit light proceeds to step S10.

  If it is determined in step S6 that no modulation data has been input, the display unit 77 supplies the image data stored in the capacitor to the light emitting element to emit light. In this case, the light emitting element outputs an image corresponding to the image data (that is, only an image corresponding to the image data not including the modulation data). The display unit 77 that has caused the light emitting element to emit light proceeds to step S10.

  Furthermore, if it is determined in step S3 that no image data has been input, the CPU 61 advances the process to step S10.

  In step S10, the CPU 61 determines whether or not to end the display control process. If it is determined that the display control process is not ended, the CPU 61 returns the process to step S1 and repeats the subsequent processes. If it is determined in step S10 that the display control process is to be ended, the CPU 61 ends the display control process after performing the end process in step S11.

  As described above, after the image data is stored in the capacitor of each pixel as a charge, when modulation data is present when the charge is supplied to the light emitting element, the image data (charge) stored in the capacitor is present. Then, the display unit 77 can output not only an image corresponding to the image data but also information on the contents included in the modulation data. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  Of course, a switch circuit for controlling the output of each pixel may be provided separately from the modulation switch circuit SWm on the output side of the capacitor P. With such a switch circuit, for example, the image display device 50 controls the time for supplying the image data (or modulated image data) to the light emitting element EL by grounding the output terminal of the capacitor P at a predetermined timing. Thus, the light emission times of the light emitting elements EL can be made uniform among the pixels, and unevenness in brightness can be suppressed. In addition, by making it possible to control the time during which the light emitting element EL emits light in this manner, the image display device 50 conversely increases the light emitting time of the light emitting element EL and shortens the non-light emitting time, thereby reducing the time in one pixel. It is also possible to increase the amount of modulation data output per unit time. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  In the above description, the modulation data output unit 91 has been described so as to control the modulation switch of each pixel for each column (vertical direction). However, the present invention is not limited to this. For example, as shown in FIG. You may make it control for every (direction).

  In FIG. 7, some of the pixels included in the display unit 77 (pixels 201 to 206) are shown. In the display unit 77, each pixel is arranged in a matrix as described above, and the pixel 202 indicates a pixel in the jth row and the ith column. As in the case of FIG. 4, the pixel 202 includes a switch circuit SW (i, j), a capacitor P (i, j), a modulation switch circuit SWm (i, j), and a light emitting element EL (i, j). Is done. The modulation switch circuit SWm (i, j) and the light emitting element EL (i, j) are connected through a point Pm (i, j). The configuration of the other pixels (for example, the pixel 201 and the pixels 203 to 206) is the same, and the description thereof is omitted.

  As in the case of FIG. 4, the switch circuit SW (i, j) of the pixel 202 is turned on based on the control data G (j) for each row supplied from the switch control unit 12 via the signal line 221. An off operation is performed, and a portion corresponding to the pixel 202 is extracted from the image data D (i) for each column supplied from the image data output unit 11 via the signal line 212, and is extracted to the capacitor P (i, j). Accumulate as a charge.

  The modulation switch circuit SWm (i, j) of the pixel 202 performs an on operation and an off operation based on the modulation data Hmod (j) for each row supplied from the modulation data output unit 91 via the signal line 231. The image data (charge) stored in the capacitor P (i, j) is modulated, and the modulated image data is supplied to the light emitting element EL (i, j) via the point Pm (i, j) to emit light. The element EL (i, j) is caused to emit light.

  The other pixels are the same as the pixel 202. For example, the modulation switch circuit SWm (i-1, j) of the pixel 201 is supplied from the modulation data output unit 91 via the signal line 231. Based on the modulation data Hmod (j) for each row, the ON operation and the OFF operation are performed, the image data (charge) accumulated in the capacitor P (i−1, j) is modulated, and the modulation switch circuit SWm of the pixel 203 (I + 1, j) performs an on operation and an off operation based on the modulation data Hmod (j) for each row supplied from the modulation data output unit 91 via the signal line 231, and supplies the capacitor P (i + 1, j). The stored image data (charge) is modulated, and the modulation switch circuit SWm (i−1, j + 1) of the pixel 204 is supplied for each row supplied from the modulation data output unit 91 via the signal line 232. Based on the tone data Hmod (j + 1), the ON operation and the OFF operation are performed, the image data (charge) accumulated in the capacitor P (i−1, j + 1) is modulated, and the modulation switch circuit SWm (i, i, j + 1) is turned on and off based on the modulation data Hmod (j + 1) for each row supplied from the modulation data output unit 91 via the signal line 232, and is stored in the capacitor P (i, j + 1). The modulation switch circuit SWm (i + 1, j + 1) of the pixel 206 modulates the image data (charge), and is based on the modulation data Hmod (j + 1) for each row supplied from the modulation data output unit 91 via the signal line 232. Then, the on operation and the off operation are performed to modulate the image data (charge) accumulated in the capacitor P (i + 1, j + 1).

  That is, in the case of FIG. 7, the modulation data output unit 91 supplies the modulation data Hmod for each row to the modulation switch circuit SWm of each pixel and controls it for each row. Thereby, the same modulation data can be output from the pixels in the same row of the display unit 77 (modulation data different for each row can be output). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. Note that the waveforms of the control signals Hmod output by the modulation data output unit 91 for each row are independent of each other, and some or all of the control signals Hmod may have the same waveform, The waveforms may all be different from each other.

  Of course, as shown in FIG. 8, different modulation data may be supplied for each pixel. In the case of FIG. 8, for example, the modulation data output unit 91 supplies the pixel 302 to the modulation switch circuit SWm (i, j) of the pixel 302 in the j-th row and i-th column via the signal line 332 dedicated to the pixel 302. For example, the modulation data M (i, j) is supplied to the modulation switch circuit SWm of each pixel, and the modulation data M that is different for each pixel is supplied and controlled for each pixel. Accordingly, different modulation data can be output from each pixel of the display unit 77 (different modulation data can be output for each row). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  Further, in addition to the above, the modulation data output unit 91 may include a plurality of different rows and columns such as adjacent n pixels × n pixels (for example, 2 pixels × 4 pixels). Modulation data may be supplied in units of pixels. In this case, it is a matter of course that the pixels supplied with the same modulation data may be located at positions separated from each other.

  As described above, when the image display device 50 modulates and outputs image data, it modulates the luminance signal (charge accumulated in the capacitor) given to each pixel. Therefore, the display unit 77 may output an image different from the image corresponding to the image data. That is, if the amount of light reduced by the modulation is not uniform among the pixels, the relationship between the pixels of the amount of light output from each pixel is different from that specified by the image data, so that the image data is modulated. As a result, not only the image becomes dark, but the content of the image itself may change.

  In order to suppress such a phenomenon, as shown in FIG. 9, the modulation data output unit 360 includes an average value adjustment unit 361, and the modulation data pattern output from the modulation data output unit 360 is changed to You may make it adjust so that the average value may become uniform.

  The image display device 350 shown in FIG. 9 has basically the same configuration as the image display device 50. However, in the case of the image display device 350, as described above, the modulation data output unit 360 includes the average value adjustment unit 361, and the modulation data adjusted so that the average value of the signal level is constant between the pixels. Is output to the display unit 77.

  The average value adjustment unit 361 has a duty ratio indicating a ratio between a pulse width having a value of “1” (or “0”) and a pulse repetition period in the modulation data including the periodic pulse train supplied from the modulation data input unit 81. By adjusting the cycle (duty ratio), the modulation data is adjusted so that the average value of the modulation data becomes a constant pattern between the pixels.

  For example, the average value adjustment unit 361 performs DSV (Digital Sum Value) control on the supplied modulation data, converts the value “1” of the modulation data to “+1”, and converts the value “0” to “ -1 ", and the value of the modulation data is controlled so that a value obtained by cumulatively adding the converted values is close to a predetermined value (a value based on the set value of the duty cycle). . At that time, the average value adjustment unit 361 performs DSV control as described above by adding DSV control bits including a plurality of bits to the modulation data and adjusting the values. For example, when the calculated cumulative addition value is smaller than the target value, the average value adjustment unit 361 adds a DSV control bit having a value of “1” to the modulation data, and the calculated cumulative addition value is greater than the target value. If larger, the DSV control bit having a value of “0” is added to the modulation data to bring the cumulative added value closer to the target value. The average value adjustment unit 361 repeats the above DSV control at a predetermined interval. For example, the interval may be synchronized with a synchronization signal supplied to the operation timing control unit 75 or may be synchronized with a period of modulation data. Of course, the average value adjustment unit 361 may perform the above-described DSV control for a plurality of pulses of modulation data, and adjust the average value of the duty cycle of the plurality of pulses.

  The modulation data output unit 360 outputs the modulation data whose average value (duty cycle) is adjusted to the display unit 77 as described above.

  For example, when the average value adjustment unit 361 is set to adjust the input modulation data so that its duty cycle is 50%, the average value adjustment unit 361 Then, the DSV control described above is performed, and modulation data Hmod (i) having a duty cycle value of 50% as indicated by a signal 370 in FIG. 10 is output.

  Image data P (i, 1) including a pulse having a signal level (height) “p1” as indicated by signal 371 in FIG. 10 is modulated by modulation data Hmod (i) as indicated by signal 370. Then, the modulated image data Pm (i, 1) as shown by the signal 372 in FIG. 10 is obtained. At this time, the average value of the modulated image data Pm (i, 1) is “p1 / 2” which is half of the image data P (i, 1). As the image data, the signal 373 (Ave (Pm ( The signal is equivalent to i, 1))).

  Similarly, in other pixels, image data P (i, 2) including a pulse having a signal level (height) “p2” as indicated by a signal 381 in FIG. When modulated by the modulation data Hmod (i), it becomes modulated image data Pm (i, 2) as shown by a signal 382 in FIG. At this time, the average value of the modulated image data Pm (i, 2) is “p2 / 2”, which is half of the image data P (i, 2). As the image data, the signal 383 (Ave (Pm ( The signal is equivalent to i, 2))). Accordingly, the ratio of the amount of light reduction in each pixel is constant, and the relationship between the pixels is maintained, so that changes in the image content itself can be suppressed.

  With reference to the flowchart of FIG. 11, the display control process in the case of calculating the duty cycle of the modulation data as described above will be described.

  Also in this case, each part of the image display device 50 performs display control processing basically in the same manner as described with reference to the flowchart of FIG. That is, the image data input unit 82 accepts image data supplied from the outside in step S31 as in step S1, supplies it to the image data output unit 11, and the modulation data input unit 81 In S32, the modulation data supplied from the outside is received and supplied to the modulation data output unit 360 as in the case of Step S2.

  Unlike the case described with reference to the flowchart of FIG. 6, the modulation data output unit 360 relates to the set value of the average value (duty cycle) of the modulation data, for example, by controlling the input unit 71 in step S33. Accept input.

  In step S34, as in step S3, the image data output unit 11 determines whether or not image data has been input. If it is determined that the image data has been input, the process proceeds to step S35, and in the case of step S4. Similarly, image data is output to each pixel of the display unit 77. In step S <b> 36, the switch control unit 12 is controlled by the image data output unit 11 as in step S <b> 5, and the image by the image data output unit 11 is based on the synchronization signal supplied from the operation timing control unit 75. The switch circuit of each pixel is controlled in accordance with the data output timing, and the image data is stored as electric charges in the capacitor of each pixel.

  In step S37, the modulation data output unit 360 determines whether or not modulation data has been input, as in step S6. If it is determined that the modulation data has been input, the process proceeds to step S38. In step S38, unlike the case described with reference to the flowchart of FIG. 6, the average value adjustment unit 361 of the modulation data output unit 360 receives an input related to the average value by the process of step S33, and the average value ( (Duty cycle) is determined. If it is determined that the average value is specified, the process proceeds to step S39, the duty cycle of the modulation data is adjusted to the specified value, and the process proceeds to step S40. . In Step S38, when it is determined that the average value is not designated, the average value adjustment unit 361 skips Step S39 and proceeds to Step S40.

  In step S40, as in step S7, the modulation data output unit 360 supplies the modulation data to each pixel of the display unit 77 to the modulation switch circuit of each pixel, and the modulation data is operated by the modulation data. Is controlled to modulate the image data (charge) stored in the capacitor. In step S41, as in step S8, the display unit 77 supplies the modulated image data, which is the output of the switch circuit, to the light emitting elements of the respective pixels to emit light. Thus, the light emitting element outputs an image corresponding to the modulated image data (that is, both the image and the content of the modulated data). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. The display unit 77 that has caused the light emitting element to emit light proceeds to step S43.

  If it is determined in step S37 that no modulation data is input, the modulation data output unit 360 proceeds to step S42, and supplies the modulated image data, which is the output of the switch circuit, to the light emitting elements of each pixel. In the same manner as in the case of FIG. The display unit 77 that has caused the light emitting element to emit light proceeds to step S43.

  Furthermore, when it is determined in step S34 that no image data has been input, the CPU 61 advances the process to step S43.

  In step S34, the CPU 61 determines whether or not to end the display control process. If it is determined that the display control process is not ended, the CPU 61 returns the process to step S31 and repeats the subsequent processes. If it is determined in step S43 that the display control process is to be terminated, the CPU 61 terminates the display control process after performing the termination process in step S44.

  As described above, after the image data is stored in the capacitor of each pixel as a charge, when modulation data is present when the charge is supplied to the light emitting element, the image data (charge) stored in the capacitor is present. Then, the display unit 77 can output not only an image corresponding to the image data but also information on the contents included in the modulation data.

  At that time, the average value of the modulation data is adjusted so as to have a preset duty cycle.

  Note that the duty level described above may not be 50% described above, and the ratio may be any number. For example, as shown in FIG. 12, the duty cycle of the modulation data may be 2/3 (Duty 66.6%).

  In FIG. 12, a signal 391 having a pulse portion having a height p1 input to the capacitor P (i, 1) is indicated by the signal 390 in the modulation switch circuit SWm, and the duty cycle is 66.6% (Duty66 .6%) of the modulated data Vmod, the output Pm (i, 1) of the modulated capacitor P becomes a signal 392, and its average value Ave (Pm (i, 1)) is As shown in the signal 393, the height is two-thirds of the height p1 (p1 × 2/3).

  In the above description, the image data has been described so that the amplitude of the modulated portion of the image data is the same as the amplitude of the image data before the modulation. However, the present invention is not limited to this. The amplitude of the adjusted portion may be modulated so as to be different from the amplitude of the image data before modulation.

  FIG. 13 is a diagram illustrating a configuration example of some pixels included in the display unit 77 in such a case.

  In FIG. 13, among the pixels arranged in a matrix on the display unit 77, the pixel 401 at the (j−1) th row and the ith column, the pixel 402 at the jth row and the ith column, and the pixel 403 at the (j + 1) th row and the ith column. It is shown. The pixel 402 includes a switch circuit SW (i, j) for acquiring image data for the pixel 402, a switch circuit SWm (i, j) for modulating the image data, and Although the light emitting element EL (i, j) is included, two capacitors P1 (i, j) and P2 (i, j) are provided in place of the above-described capacitor P (i, j). Two resistors R1 (i, j) and R2 (i, j) each having a predetermined resistance value are provided. The switch circuit SWm (i, j) is composed of a switch circuit with two inputs and one output, and outputs one of the two inputs based on a control signal supplied to the control terminal.

  Similarly to the capacitor P, the capacitor P1 (i, j) is connected to the switch circuit SW (i, j) and the modulation switch circuit SWm (i, j), and the switch circuit SW (i, j). The image data (charge) supplied from the storage unit is accumulated and supplied to the modulation switch circuit SWm (i, j). One terminal of the resistor R1 (i, j) is connected to the output terminal of the switch circuit SW (i, j). One terminal of the resistor R2 (i, j) is connected to the other terminal of the resistor R1 (i, j), and the other terminal is installed on the ground.

  Further, a terminal on the side where the resistors R1 (i, j) and R2 (i, j) are connected to each other of the resistors R1 (i, j) and R2 (i, j), and the modulation switch circuit SWm A capacitor P2 (i, j) is connected between (i, j).

  That is, according to the output of the switch circuit SW (i, j), electric charges are accumulated in the capacitor P1 (i, j), and also accumulated in the capacitor P2 (i, j) in the capacitor P1 (i, j). A predetermined percentage of the charge is accumulated. That is, for example, when the resistance value of the resistor R1 (i, j) is r1, and the resistance value of the resistor R2 (i, j) is r2, the capacitor P1 (i, j) is output by the output of the switch circuit SW (i, j). ) Is charged with the voltage V, the capacitor P2 (i, j) is charged with the voltage V × r2 / (r1 + r2).

  The modulation switch circuit SWm (i, j) is based on the control data supplied to the control terminal, and the charge accumulated in the capacitor P1 (i, j) or the charge accumulated in the capacitor P2 (i, j). Is selected and supplied to the power generation element EL (i, j).

  That is, the switch circuit SW (i, j) performs an ON operation and an OFF operation based on the control data G (j) supplied via the signal line 103-j, and supplies the pixel 402 via the signal line 102. The image data for the pixel 402 is extracted from the obtained image data D (i) and supplied to the capacitor P1 (i, j), and the charge of the voltage indicated by the height p1 of the signal 441 shown in FIG. 14 is accumulated. Let If the resistance values of the resistor R1 (i, j) and the resistor R2 (i, j) are both r, then the voltage indicated by the height p1 / 2 is applied to the capacitor P2 (i, j). (That is, half the charge accumulated in the capacitor P1 (i, j)) is accumulated.

  The modulation switch circuit SWm (i, j) is connected to the capacitor based on the modulation data Vmod (i) having a duty cycle of 50% as shown by the signal 440 in FIG. The charge accumulated in P1 (i, j) or P2 (i, j) is output. Therefore, the image data is modulated between the voltage indicated by the height p1 and the voltage indicated by the height p1 / 2 by the switching of the modulation switch circuit SWm (i, j), and the signal 442 in FIG. The modulated image data Pm (i, j) has a waveform as shown in FIG. That is, the average value Ave (Pm (i, j)) of the pulse portion of the signal 442 is three-quarters of the average value of the pulse portion of the signal 441 as indicated by the signal 443.

  Since the pixel 401 and the pixel 403 have the same configuration as that of the pixel 402, description thereof is omitted. Note that the pixels other than the pixels 401 to 403 of the display portion 77 have the same configuration.

  By doing so, it is possible to adjust the amplitude of the modulation signal more freely, and the influence of the display unit 77 on the light amount of the image can be reduced by outputting the modulation data. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  In the above description, the image display apparatus outputs the modulation data in synchronization with the vertical synchronization signal Vsync. However, the present invention is not limited to this. For example, if the response speed of the pixel is sufficiently high, the horizontal synchronization signal The modulation data may be output in synchronization with Hsync.

  For example, as shown by a signal 531 in FIG. 15, when one period of the vertical synchronization signal Vsync is a vertical period V from the pulse portion 531A to the pulse portion 531B, the operation of the switch circuit SW of each pixel in this vertical period V In the control data G (1) to control data G (100) for controlling each row, the pulse portions 532A to 536A are arranged in order at different timings as indicated by signals 532 to 536.

  For example, when the pulse portion 532A of the signal 532 indicating the waveform of the control data G (1) ends, the pulse portion 533A of the signal 533 indicating the waveform of the control data G (2) starts, and when the pulse portion 533A ends, the control is performed. The pulse part of the signal of data G (3) is started. That is, the pulse portions 532A to 536A are synchronized with the horizontal synchronization signal Hsync, and their length indicates one cycle of the horizontal synchronization signal Hsync.

  Therefore, the timing at which charges are accumulated in the capacitors P (i, 1) to P (i, 100) is 1 for the horizontal synchronization signal Hsync as in the pulse portions 542A to 546A of the signals 542 to 546, respectively. It will shift by the period.

  By using the logical product of the above-mentioned modulation data Vmod as shown by the signal 550 and the control data G as a control signal for the modulation switch circuit SWm, the capacitors 562 to 566 are used as shown in FIG. Of the P output (pulse portions 542A to 546A), only a portion (sections 562A to 566A) is modulated. For example, in the case of FIG. 15, the pulse portion 542A that is the output of the capacitor P (i, j) is modulated by a section 552 that is a part of the section 552A that is a period of the modulation data Vmod. ing. That is, as shown in FIG. 16, the signal 562 is modulated only in the section 562 </ b> A that is the horizontal period H.

  By doing in this way, the image display apparatus is not limited to the pixel column unit but also the pixel line unit (row unit) or pixel unit even when the configuration of each pixel of the display unit 77 is as shown in FIG. Different modulation data can be output for each. In addition, since the period during which the image data is modulated in each pixel can be shortened, the image display apparatus can output the modulated data without further affecting the luminance of the image output simultaneously with the modulated data. (The amount of reduction in luminance of the image can be reduced). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. This method can also be applied when the configuration of the display unit 77 is as shown in FIG. 7, FIG. 8, or FIG.

  As described above, in the image display device 50 and the image display device 350, the display unit 77 displays the modulation data as well as the image corresponding to the image data in the vertical direction common to the display screen, common in the horizontal direction, each pixel, or plural An arbitrary pixel such as every pixel can be output as a unit. Further, when the image display devices 50 and 350 output different modulation data in units of these pixels, the modulation is performed by observing the light emission waveform of the display unit 77 using a sensor capable of detecting the change in the luminance of light. The data light receiving device can specify the position of the pixel to which the received modulation data is output based on the received modulation data.

  In the above description, the display unit 77 has been described so as to modulate and output image data (an image corresponding to the image data) using the modulation data. However, the display unit 77 is not limited thereto, and for example, in a pixel that outputs the modulation data. May not output an image.

  For example, as illustrated in FIG. 17, the image display device 50 and the image display device 350 output modulation data from predetermined pixels 611 to 614 on a screen 600 displayed on the display unit 77, and the pixels In 611 to 614, not the image (conventional image) corresponding to the image data supplied to the display unit 77, for example, light is emitted so that the luminance of the pixel is maximized (light is emitted in white), and the light receiving device However, the modulation data may be easily extracted. In the case of FIG. 17, the four pixels 611 to 614 are set to emit white light (maximum light emission) as a light receiving window, and the pixels 611 to 614 have signals Vmod (11) or The modulation data (Vmod (1) to Vmod (10) supplied to the other pixels is supplied with Vmod (12), and the modulation data Vmod (11) has a different waveform from the modulation data V (13) to Vmod (19). Alternatively, Vmod (12) is output from each pixel.

  By doing so, the image display device 50 (or the image display device 350) can express the modulation data values “1” and “0” by maximum light emission and non-light emission, and is thus received by the light receiving device. The S / N ratio of the signal can be improved. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. In addition, by providing a light receiving window that emits light so that the luminance is maximized in a state where modulation data is not output, and by allowing the modulation data to be output from the light receiving window, the user can receive the light receiving device. The sensor unit (the light receiving unit capable of receiving the output modulation data) can be more accurately aligned with the modulation data output position.

  Further, when the image data (image corresponding to the image data) acquired by the image display device 50 is modulated using the modulation data and output, the threshold value (threshold) between the value “1” and the value “0” in the modulation data is output. (Hold voltage) differs depending on the image to be modulated (usually, the value of each pixel in an image for one screen is different from each other, so that the threshold value varies depending on the pixel), so the light receiving device must perform control based on that information. (It must be controlled to change the threshold when analyzing the received modulation data in accordance with the image.) By providing the light receiving window as described above, the modulation data output by the light receiving window The threshold values “1” and “0” can be made constant. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  The light receiving window as described above may change the position on the image according to the time as shown in FIG. 18, for example. In FIG. 18, the light receiving window is provided at a position 621 indicated by “A” in the image 600A displayed on the display unit 77, and when the image 600B is displayed after a lapse of time, “ When the image 600C is displayed after a further time has elapsed and the image 600C is displayed, it moves to a position 623 indicated by “C” in the drawing. In this manner, the position of the light receiving window can be changed along the time axis. At that time, as described above, the pixels of the light receiving window modulate and output the white light with the maximum luminance by the modulation data, so that the user can easily identify the position even if the position of the light receiving window is changed. The sensor unit of the light receiving device (the light receiving unit capable of receiving the output modulation data) can be more accurately aligned with the output position of the modulation data.

  The timing of changing the position of the light receiving window may be any timing, for example, it may be periodic such as every predetermined time interval, or may be changed aperiodically. Also good. Of course, a plurality of light receiving windows may be displayed simultaneously as shown in FIG. In the image 600 displayed on the display unit 77 in FIG. 19, the light receiving windows are displayed at three positions: a position 631 indicated by “A”, a position 632 indicated by “B”, and a position 633 indicated by “C”. Has been.

  Next, the light receiving device side that receives the modulated data output as described above will be described.

  FIG. 20 is a diagram illustrating a configuration example of a communication system to which the present invention is applied.

  In FIG. 20, a communication system 650 is a communication system including the image display device 50 described above and a light receiving device 660 that receives light output from the display unit 77 of the image display device 50.

  The light receiving device 660 includes a lens unit 661, a photoelectric conversion unit 662 including a photoelectric conversion element such as a photodiode, and an amplification circuit 663 that amplifies an electric signal output from the photoelectric conversion unit 662, and the image display device 50. This is a device that receives light output from the display unit 77 and acquires modulation data.

  The photoelectric conversion unit 662 includes, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) sensor, and the like. The photoelectric conversion unit 662 photoelectrically converts incident light in a group of photodiodes arranged in a matrix, and according to the amount of incident light. The electric signal is output and supplied to the amplifier circuit 663. The amplifier circuit 663 amplifies and outputs the electrical signal (the electrical signal including information output from the image display device 50) supplied from the photoelectric conversion unit 662. That is, the signal output from the amplifier circuit 663 includes a signal including image data and modulation data output from the image display device 50.

  In FIG. 20, the image display device 50 displays an image 600 on the display unit 77 and uses some pixels 611 to 614 as light receiving windows, and outputs modulation data from these pixels. The user operates the light receiving device 660 to bring the light receiving device 660 close to the light receiving window (pixels 611 to 614). The light receiving device 660 receives the light output from the light receiving window, photoelectrically converts the incident light into an electrical signal, amplifies it, and outputs it.

  In the communication system 650 of FIG. 20, the switch control unit 12 of the image display device 50 controls the switch circuit SW of the display unit 77 by the control data as shown in the signals 671 to 673 as shown in FIG. When the modulation data output unit 91 outputs the modulation data as indicated by the signal 680 to the column of the light receiving window pixels 611 and 613, the light receiving window pixel 611 indicated by the number “1” indicates the signal 691. A signal having such a waveform is output, and a signal having a waveform as indicated by a signal 692 is output from the pixel 613 of the light receiving window indicated by the number “3”. As shown in FIG. 21, in the signal 691 output from the pixel 611, the portion 691A where the image data is output is modulated by the modulation data, and in the signal 692 output from the pixel 613, the image data is The output portion 692A is modulated by the modulation data.

  When the lens unit 661 that is the light receiving unit of the light receiving device 660 is brought close to the pixel 611 of such a light receiving window, the light output from the pixel 611 enters the photoelectric conversion unit 662 via the lens unit 661. The photoelectric conversion unit 662 converts incident light into an electrical signal and supplies the converted electrical signal to the amplifier circuit 663. The amplifier circuit 663 amplifies the electric signal and outputs an electric signal (input data) having a waveform as indicated by a signal 693 in FIG. The signal 693 corresponds to the signal 691 output from the pixel 611, and a portion 693A where the image data is output is modulated by the modulation data.

  As described above, each pixel of the display unit 77 has a time during which no light is emitted in the vertical period V (for example, the period 691B in the signal 691), and the image display device 50 and the light receiving device 660 of the communication system 650 are in this time. Data cannot be exchanged. The image display device 50 controls the output time of the capacitor P as described above, and controls to shorten this time (that is, to increase the ratio of the light emission time in the vertical period V). More modulation data can be supplied to the light receiving device per time.

  Note that the number of photodiodes (number of pixels) in the photoelectric conversion unit 662 may be any number, one, or a plurality. Further, the photoelectric conversion unit 662 may be configured to simultaneously extract charges accumulated in all the pixels (photodiodes thereof), or may be configured so that the charge extraction timing is different for each pixel (for example, the vertical direction or the horizontal direction). Alternatively, line-sequential operation may be performed. Further, the scanning method may be a progressive method in which charges of all pixels are read out in one reading process, or may be an interlace method in which reading is performed every other line. However, when the photoelectric conversion unit 662 performs an operation different from the line-sequential operation in the display unit 77, the synthesis process of the modulation data read out in each pixel may be complicated. Therefore, it is desirable that the operation in the photoelectric conversion unit 662 is the same system as that of the display unit 77 of the image display device 50 in order to simplify the processing related to data transmission.

  The light receiving device 660 may not only convert the incident light into an electric signal and amplify it, but also extract the modulation data contained in the amplified electric signal and output the extracted modulation data. FIG. 22 shows a configuration example of the light receiving device in that case.

  In the light receiving device 700 in FIG. 22, a CPU (Central Processing Unit) 711 executes various processes in accordance with programs stored in the ROM 712. A RAM (Random Access Memory) 713 appropriately stores data and programs necessary for the CPU 711 to execute various processes.

  The CPU 711, the ROM 712, and the RAM 713 are connected to each other via a bus 714. An input / output interface 720 is also connected to the bus 714.

  The input / output interface 720 is connected to an input unit 721 including a keyboard and a mouse, and outputs a signal input to the input unit 721 to the CPU 711. The input / output interface 720 is also connected to an output unit 712 that includes a display, a speaker, and the like.

  Further, the input / output interface 720 includes a storage unit 723 configured from a hard disk, a communication unit 724 that performs data communication with other devices via a network such as the Internet, and the lens unit 661 and the photoelectric conversion unit described above. An operation control unit 725 for controlling the operation of 662 is also connected.

  The operation control unit 725 is controlled by the CPU 711 and controls the lens unit 661 to adjust the focal position, and controls the photoelectric conversion unit 662 to adjust the timing of the photoelectric conversion process.

  The drive 726 connected to the input / output interface 720 is used when data is read from or written to a removable medium 727 formed of a recording medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory. .

  The photoelectric conversion unit 662 is controlled by the operation control unit 725, converts incident light incident through the lens unit 661 into an electric signal, and supplies the electric signal to the amplification circuit 663. The amplifier circuit 663 amplifies the supplied electric signal with a predetermined amplification degree, and supplies the amplified electric signal (input data) to the CPU 711 via the input / output interface 720. The CPU 711 demodulates the supplied input data to obtain target modulation data. Since the image data included in the input data is a signal having a predetermined frequency, the CPU 711 acquires modulation data by removing information on the frequency from the input data. At that time, the CPU 711 performs various signal processing such as correction processing and error correction processing as necessary.

  Note that the position of the light receiving device may be adjusted by the user confirming the position of the light receiving window, or a mechanism for adjusting the position of the light receiving device may be provided. You may make it adjust based on the positional information etc. of the light-receiving window to be adjusted.

  With reference to the flowchart of FIG. 23, the light reception control process by the light receiving device 700 will be described. First, in step S61, the CPU 711 controls the operation control unit 725 to control the light receiving operation of the photoelectric conversion unit 662, for example, to synchronize the timing of the light receiving process with the image display timing in the image display device. Adjust the processing timing.

  In step S 62, the photoelectric conversion unit 662 whose timing is adjusted operates under the control of the operation control unit 725, and outputs an electric signal obtained by photoelectrically converting incident light to the amplification circuit 663. When the amplification circuit 663 acquires the electrical signal, the amplification circuit 663 amplifies the electrical signal in step S63 and supplies the amplified electrical signal (input data) to the CPU 711 via the input / output interface 720. Upon obtaining the input data, the CPU 711 demodulates the input data and extracts modulation data in step S64, and in step S65, synthesizes the modulation data obtained in each pixel, performs correction processing, etc., and displays an image. Modulation data before being output in the device 50 is generated. The generated modulation data is analyzed by the CPU 711, used for other processing, stored in the storage unit 723, or supplied to other devices via the communication unit 724.

  In step S66, the CPU 711 determines whether or not to end the light reception control process. If it is determined to end, the CPU 711 returns the process to step S61 and repeats the subsequent processes. If it is determined in step S66 that the light reception control process is to be terminated, the CPU 711 advances the process to step S67, performs the termination process, and then terminates the light reception control process.

  As described above, for example, when the light receiving device 700 is aligned with the light receiving window displayed on the image display device 50 by the user, the user can set the pixel of the photoelectric conversion unit 662 of the light receiving device 700 to the pixel of the display unit 77. It is difficult to accurately arrange the. Further, even if they can be positioned so as to face each other accurately, light other than the light output from the pixels of the image display device 50 is included in the incident light incident on the photoelectric conversion unit 662 of the light receiving device 700. Therefore, an unnecessary noise component may be included in the electrical signal obtained by the photoelectric conversion process by the photoelectric conversion unit 662.

  Therefore, the size of one pixel in the display unit 77 of the image display device 50 is set to a size corresponding to a plurality of the size of one pixel in the photoelectric conversion unit 662 of the light receiving device 700, and from one pixel of the display unit 77 The output light may be received by a plurality of pixels of the photoelectric conversion unit 662, photoelectrically converted, and demodulated. In this manner, in the light receiving device 700, the vicinity of the center of the plurality of pixels that receive the light output from one pixel of the display unit 77 is the light output from the pixel adjacent to the display unit 77, and the like. Therefore, the modulation data to be transferred can be accurately received. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately. In order to determine whether or not the data content is correct or to correct it, error detection / correction bits are placed in the modulated data, and the data content is inspected using these bits during demodulation. It may be corrected as necessary.

  Further, as described above, for example, a plurality of pixels of the image display device 50 are used to modulate one data without considering the pixel size of the image display device 50 and the pixel size of the light receiving device 700. Of course. That is, by controlling the plurality of pixels of the display unit 77 as one pixel with respect to the modulation data and causing each of these pixels to output the same modulation data, the light receiving device 700 as described above. The same modulation data can be received by a plurality of pixels. By doing so, in the light receiving device 700, the light output from the pixel adjacent to the display unit 77 is near the center of the plurality of pixels that receive the same modulation data output from the plurality of pixels of the display unit 77. For example, since the rate of receiving other light can be reduced, the modulation data to be transferred can be accurately received. Further, if error detection or error correction is performed using the error detection / correction bit in the same manner as described above, even if a slight misalignment occurs between the display device and the light receiver, the light receiving device 700 Correct data can be acquired.

  That is, the light receiving device 700 can acquire a plurality of (more) information from the image display device 50 by processing the modulation data obtained in each pixel of the photoelectric conversion unit 662 as different from each other. However, one modulation data is generated using the modulation data obtained in a plurality of pixels so that more accurate data transmission can be performed between the image display device 50 and the light receiving device 700. It is also possible to do.

  The light receiving device 700 operates in synchronization with the image display device 50, thereby specifying the output position of the modulated data in the display unit 77 from the timing of receiving the modulated light in the photoelectric conversion unit 662. You can also. For example, in the image display device 50, different modulation data is output between the pixels in the horizontal direction, and the same modulation data is output between the pixels in the vertical direction (that is, for each column of pixels, each other). When different modulation data is output), the CPU 711 of the light receiving device 700 can specify the position in the vertical direction based on the light reception timing based on the synchronization signal of the modulation data, and the received modulation data (contents thereof) ) Can specify the position in the horizontal direction.

  24, the size of the photoelectric conversion unit 662 of the light receiving device is made the same as the size of the display unit 77, and each pixel (light emitting element) of the display unit 77 is connected to each pixel (photograph) of the photoelectric conversion unit 662. The light-emitting side panel of the display unit 77 and the light-receiving side panel of the photoelectric conversion unit 662 may be installed so that the diodes correspond to each other (positioned at opposite positions).

  FIG. 25 shows part of a configuration example of the pixel (photodiode) of the photoelectric conversion unit 662 and the display unit 77 in this case.

  In FIG. 25, pixels 761-1 to 761-100 indicate pixels in the s-th column of the photoelectric conversion unit 662. For example, the pixel 761-j in the jth row and the sth column includes a photodiode PD (s, j) and a switching circuit SWd (s, j). The photodiode PD (s, j) is placed close to the pixel 101-j in the i-th row and j-th column of the display unit 77, and converts the light output from the light-emitting element EL (i, j) into an electrical signal. To do. The switching circuit SWd (s, j) is controlled by the control data Gd (j) supplied from the operation control unit 725 to perform a switching operation, and the output of the photodiode PD (s, j) is sent to the amplifier circuit 663. Control the supply.

  Note that the other pixels have the same structure as that of the pixel 761-j. Each of the pixels receives light emitted from the corresponding pixel of the display unit 77, converts the light into an electric signal, and outputs the electric signal to the amplifier circuit 663. Since the operation is similar, the description thereof is omitted.

  FIG. 26 shows an example of signal waveforms in each part of the communication system of FIG. In FIG. 26, the pixel of the display unit 77 uses, for example, the modulation data Vmod indicated by the signal 810 based on the timing of the pulse portions 81A to 803A of the control data G as indicated by the signals 801 to 803. Data is modulated and information as shown in signals 811 to 813 is output as light. The pixels of the light receiving device that face the pixels are controlled by control data Gd that is synchronized with the control data G, and receive part of the pulse portions 811A to 813A of the signals 811 to 813, respectively. To a signal having a waveform like signal 823.

  The signal output from each pixel is amplified by the amplification circuit 663, and then the modulation data is extracted by the CPU 711. The extracted modulation data of each pixel is combined to generate desired modulation data. The signal 824 is a signal obtained by combining the signals 821 to 823, and the pulse portion 824A is a signal obtained by combining the pulse portions 821A to 823A.

  In this manner, the modulation data of all the pixels modulated by the same modulation data in the image display device is synthesized, and a signal 825 corresponding to the signal 810 is generated.

  Note that, as described above, in the photoelectric conversion unit 662 of the light receiving device, the light reception start timing of the photodiode PD may be aligned with the light emission start timing of the light emitting element EL of the display unit 77, or in FIG. Of course, as shown in the signals 831 to 833, light reception of the photodiode PD may be started at a timing different from the light emission start timing of the light emitting element EL of the display unit 77. At this time, as shown in the parts 831A to 833A of the signals 831 to 833, intermediate parts of the pulse parts 811A to 813A are extracted, and when they are combined, a waveform as shown in the signal 834 is obtained. When all the pixels are combined in this way, modulation data as indicated by the signal 825 can be acquired.

  For example, in the communication system shown in FIG. 24, when target modulation data is output from some pixels of the display unit 77, the light receiving device 700 is modulated by the modulation data of the photoelectric conversion unit 662. By specifying the pixel that has received the received light, the output position of the modulation data on the display unit 77 can be easily specified.

  As described above, the light receiving device to which the present invention is applied can be easily used even when the data output device (image display device 50) changes the position (pixel) while outputting data by line sequential operation. Data output from the pixels can be acquired and restored. Thereby, the light receiving device can receive the image and the modulation data from the image display device and acquire the data.

  That is, for example, each pixel of the light receiving device as described above is provided in each pixel of the display unit of the image display device having a function of modulating and outputting the image (image data) to be displayed as described above with the modulation data. Thus (by providing a photoelectric conversion function so that each pixel can receive light), such an image display device and a light receiving device are configured as one device, and a plurality of such devices are arranged to face each other. Thus, a communication system that performs bidirectional communication can also be realized. By doing in this way, each apparatus of a communication system can process more complicated and more information in a unit time more correctly.

  In the above, the rewriting frequency in the display unit 77 of the image display device 50 and the screen reading frequency in the photoelectric conversion unit 662 of the light receiving device 700 are matched, and the screen display start timing and the photoelectric conversion unit in the display unit 77 are matched. The line sequential start timing 662 may have a fixed relationship (the operation of the image display device 50 and the operation of the light receiving device 700 may be synchronized), or the rewriting frequency and the screen reading frequency. May be different from each other, or there may be no correlation between the vertical synchronization signals of the display unit 77 and the photoelectric conversion unit 662 (the operation of the image display device 50 and the operation of the light receiving device 700 are asynchronous). Also good).

  However, in the case of non-synchronization or depending on the timing relationship of the vertical synchronization signal even if it is synchronous, the photoelectric conversion unit 662 is a section in which a signal with a value “0” is output from the display unit 77 (no light is emitted). (Interval) may be read. Therefore, for example, the light receiving device 700 may have a mechanism that can change the vertical synchronization frequency and the position of the synchronization start. For example, in the initial state, when the vertical synchronization frequencies of the image display device 50 and the light receiving device 700 are set to be different from each other, and the reading process in the light receiving device 700 is performed in line sequence, the pixels of the display unit 77 emit light. In some cases, light is received in a section that is not. However, since the frequencies of the synchronization signals are different from each other, the light receiving device 700 receives light in a section where modulation data can be obtained thereafter, and then receives light in a non-light emitting section again. By measuring the time during this period, the CPU 711 determines the vertical synchronization frequency of the image display device 50 (since the vertical synchronization frequency of the light receiving device 700 is known), and the operating frequency of the light receiving device 700 based on that frequency. In addition, it is possible to perform control so that line-sequential reading operation is performed at a timing that does not overlap when light is not emitted. By controlling in this way, the light receiving device 700 can always read the signal of the image display device 50. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately.

  Further, the light receiving device 700 may have a mechanism that can vary the start position of the synchronization start. When the electric charges are read line-sequentially in the photoelectric conversion unit 662 of the light receiving device 700, as described above, the light receiving device 700 receives light in the section where the light emitting element EL of the display unit 77 does not emit light. A period occurs. At this time, the CPU 711 of the light receiving device 700 performs control so as to shift the vertical synchronization start position in the light receiving device 700 so that the light receiving device 700 reads the section where the light emitting element EL of the display unit 77 emits light again. can do. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately.

  In the case of such control, there is a possibility that the light receiving device 700 may not be able to acquire part of the information output from the image display device 50. For this reason, the image display apparatus 50 transmits the same data multiple times, for example, by transmitting the same data a plurality of times in advance, assuming that the data is missing, and the light receiving apparatus 700 joins the data obtained by reception. Correct data may be demodulated.

  Furthermore, as another method, the vertical synchronization frequency of the light receiving device 700 may be set to be twice or more higher than the vertical synchronization frequency of the image display device 50. By doing so, the light receiving device 700 surely reads the section where the pixels of the display unit 77 emit light, so the light receiving device 700 does not have a mechanism that can vary the start position of the synchronization start. Also good. However, in this case, since the photoelectric conversion unit 662 performs the charge reading process during the light emission of the pixels of the display unit 77, the information output from the image display device 50 is always partially missing. Since it is supplied to the light receiving device 700 (the light receiving device 700 cannot acquire all of the information output from the image display device 50), the image display device 50 multiplexes by transmitting the same data a plurality of times in advance assuming a lack. It is necessary for the light receiving device 700 to demodulate correct data by connecting the data obtained by reception.

  The present invention can also be applied to an information processing apparatus having a function other than the functions described above. Therefore, the above-described image display device 50, image display device 350, light receiving device 660, and light receiving device 700 may of course have functions other than those described above.

  The series of processes described above can be executed by hardware, or can be executed by software as described above. When a series of processing is executed by software, various functions can be executed by installing a computer in which the programs that make up the software are installed in dedicated hardware, or by installing various programs. For example, it is installed from a recording medium or the like into a general-purpose personal computer or the like.

  The recording medium is, for example, as shown in FIG. 3 or FIG. 22, separately from a personal computer, distributed to provide a program to a user, a magnetic disk (including a flexible disk) on which the program is recorded, Package media consisting of optical disks (including compact disc-read only memory (CD-ROM), DVD (digital versatile disc)), magneto-optical disks (including MD (mini-disc) (registered trademark)), or semiconductor memory In addition to a removable medium 79 or 727 including a hard disk including a ROM 62 or 712 storing a program or a storage unit 73 or 723 provided to a user in a state of being preinstalled in a computer. Composed.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structural example of the pixel of the conventional display. It is a schematic diagram for demonstrating the operation timing of each element in the display shown by FIG. It is a block diagram which shows the structural example of the image display apparatus to which this invention is applied. It is a figure which shows the structural example of each pixel of the display part of FIG. It is a schematic diagram for demonstrating the operation timing of the display part of FIG. It is a flowchart explaining a display control process. It is a figure which shows the other structural example of each pixel of the display part of FIG. It is a figure which shows the further another structural example of each pixel of the display part of FIG. It is a figure which shows the other structural example of the image display apparatus to which this invention is applied. It is a figure which shows the example of a mode that image data is modulated. It is a flowchart explaining the other example of a display control process. It is a figure which shows the other example of a mode that image data is modulated. It is a figure which shows the further another structural example of each pixel of the display part of FIG. It is a figure which shows the further another example of a mode that image data is modulated. It is a schematic diagram for demonstrating the other example of the operation timing of the display part of FIG. FIG. 16 is a schematic diagram for explaining details of operation timing of the display unit in FIG. 15. It is a figure for demonstrating the example of a light-receiving window. It is a figure for demonstrating the other example of a light-receiving window. It is a figure for demonstrating the further another example of a light-receiving window. It is a block diagram which shows the example of the communication system to which this invention is applied. It is a schematic diagram explaining the example of the operation timing in the light-receiving device of FIG. It is a block diagram which shows the other structural example of a light-receiving device. It is a flowchart explaining a light reception control process. It is a schematic diagram explaining the other example of the communication system of FIG. It is a figure which shows the structural example of the pixel of each apparatus in the communication system of FIG. FIG. 26 is a schematic diagram illustrating the operation timing of each unit illustrated in FIG. 25.

Explanation of symbols

  11 image data output unit, 12 switch control unit, 50 image display device, 61 CPU, 62 ROM, 63 RAM, 64 bus, 70 input / output interface, 71 input unit, 72 output unit, 73 storage unit, 74 communication control unit, 75 operation timing control unit, 76 display control unit, 77 display unit, 78 drive, 79 removable media, 81 modulation data input unit, 82 image data input unit, 91 modulation data output unit, 350 image display device, 360 modulation data output unit , 361 average value adjustment unit, 650 communication system, 660 light receiving device, 661 lens unit, 662 photoelectric conversion unit, 663 amplifier circuit, 700 light receiving device, 711 CPU, 712 ROM, 713 RAM, 714 bus, 720 input / output interface, 721Power unit, 722 output unit, 723 storage unit, 724 communication unit, 725 operation control unit, 726 drive, 727 a removable media

Claims (9)

Image data output means for outputting image data to be displayed on each pixel of the display unit for displaying an image;
A plurality of pixels in a part of the entire pixels constituting the display unit are used as a unit, and different modulation data is output to each of the plurality of units at different positions, and the same unit is formed at the same timing. Modulation data output means for modulating the image data in each pixel with the modulation data so that the modulation is performed with the same modulation data in each pixel;
In each pixel to which the modulated image data modulated by the modulation data is supplied, a light emitting element emits light according to the modulated image data. The display device according to claim 1, wherein the unit to which the different modulation data is supplied is configured by adjacent n × n pixels. The modulation data output means converts the modulation data value 1 to +1 and the value 0 to −1, and sets the value of the modulation data so that the cumulative addition result of the converted values is close to a predetermined value. 2. The display device according to claim 1, wherein an average value of the pattern of the modulation data is adjusted so that an amount of light reduced by the modulation is uniform between the pixels, and the modulated data after adjustment is output. . Output the image data to be displayed on each pixel of the display unit that displays the image,
A plurality of pixels in a part of the entire pixels constituting the display unit are used as a unit, and different modulation data is output to each of the plurality of units at different positions, and the same unit is formed at the same timing. The image data is modulated at each pixel by the modulation data so that the modulation is performed by the same modulation data at each pixel,
A communication method including a step of causing a light emitting element to emit light in accordance with the image data after modulation in each pixel to which the image data after modulation modulated by the modulation data is supplied. Output the image data to be displayed on each pixel of the display unit that displays the image,
A plurality of pixels in a part of the entire pixels constituting the display unit are used as a unit, and different modulation data is output to each of the plurality of units at different positions, and the same unit is formed at the same timing. The image data is modulated at each pixel by the modulation data so that the modulation is performed by the same modulation data at each pixel,
A program for causing a computer to execute a process including a step of causing a light emitting element to emit light in accordance with the image data after modulation in each pixel to which the image data after modulation modulated by the modulation data is supplied. Image data to be displayed on each pixel of the display unit for displaying an image is output, and some of the entire pixels constituting the display unit are used as units, and each of the units at different positions is used as a unit. Different modulation data is output, and the image data is modulated in each pixel by the modulation data so that the modulation is performed by the same modulation data in each pixel constituting the same unit at the same timing, and the modulation data In each pixel supplied with the modulated image data modulated in accordance with the above, the light emitted from the display device that causes the light emitting element to emit light according to the modulated image data is received by each photodiode , and photoelectrically converted. A light receiving means for outputting an electrical signal;
Extraction means for extracting the modulation data from each electrical signal output from each photodiode of the light receiving means;
A light receiving device comprising: combining means for combining the plurality of modulation data extracted by the extraction means to generate one modulation data. Image data to be displayed on each pixel of the display unit for displaying an image is output, and some of the entire pixels constituting the display unit are used as units, and each of the units at different positions is used as a unit. Different modulation data is output, and the image data is modulated in each pixel by the modulation data so that the modulation is performed by the same modulation data in each pixel constituting the same unit at the same timing, and the modulation data In each pixel supplied with the modulated image data modulated in accordance with the above, the light emitted by the display device that causes the light emitting element to emit light in accordance with the modulated image data is received by each photodiode of the light receiving means, Convert and output electrical signals,
Extracting the modulation data from each electrical signal output from each photodiode of the light receiving means;
A communication method including a step of combining a plurality of extracted modulation data to generate one modulation data. Image data to be displayed on each pixel of the display unit for displaying an image is output, and some of the entire pixels constituting the display unit are used as units, and each of the units at different positions is used as a unit. Different modulation data is output, and the image data is modulated in each pixel by the modulation data so that the modulation is performed by the same modulation data in each pixel constituting the same unit at the same timing, and the modulation data In each pixel supplied with the modulated image data modulated in accordance with the above, the light emitted by the display device that causes the light emitting element to emit light in accordance with the modulated image data is received by each photodiode of the light receiving means, Convert and output electrical signals,
Extracting the modulation data from each electrical signal output from each photodiode of the light receiving means;
A program that causes a computer to execute a process including a step of combining a plurality of extracted modulation data to generate one modulation data. In a communication system consisting of a display device and a light receiving device,
The display device
Image data output means for outputting image data to be displayed on each pixel of the display unit for displaying an image;
A plurality of pixels in a part of the entire pixels constituting the display unit are used as a unit, and different modulation data is output to each of the plurality of units at different positions, and the same unit is formed at the same timing. Modulation data output means for modulating the image data in each pixel with the modulation data so that the modulation is performed with the same modulation data in each pixel;
In each pixel supplied with the modulated image data modulated by the modulated data, the light emitting element emits light according to the modulated image data,
The light receiving device is:
Light receiving means for receiving light emitted by the display device in each photodiode , photoelectrically converting and outputting an electrical signal;
Extraction means for extracting the modulation data from each electrical signal output from each photodiode of the light receiving means;
A communication system comprising: combining means for combining the plurality of modulation data extracted by the extraction means to generate one modulation data.

Images