JP5126897B2 - Electronic device, communication system, display control method, and program - Google Patents

Description

  The present invention relates to an electronic device in which an optical sensor is incorporated in a display panel, a communication system including the electronic device, a data update method in the electronic device, a display control method in the electronic device, and a program for executing the method.

Conventionally, a liquid crystal panel with a built-in optical sensor is known.
Patent Document 1 discloses a configuration in which data is divided into a plurality of graphic codes and encoded, and the plurality of graphic codes are repeatedly displayed. Further, this document discloses a configuration in which each figure code is photographed and each photographed figure code is decoded.

Patent Document 2 also discloses the same content as Patent Document 1.
Patent Document 3 discloses a configuration in which when information is transmitted, the information is converted into a data string, a moving image is created from the data string, and this is displayed on a display. In the same document, when information is received, an image displayed on the display of the other party's mobile phone that is the transmission source is photographed with a camera, a data string is extracted from the photographed image, and information is further extracted from the data string. A configuration for extraction is disclosed.

  Patent Document 4 discloses a configuration for determining whether or not the entire code image of a captured QR (Quick Response) code is within the range of the captured image defined by the light receiving surface of the area sensor. Further, in this document, when it is determined that the entire code image is not within the range of the captured image, a guide direction for guiding the entire QR code to be within the range of the captured image is calculated. The structure which displays the content of instruction | indication by this on a liquid crystal display part is disclosed.

  Patent Document 5 discloses a configuration in which stored information is read from an IC (Integrated Circuit) card as a wireless communication medium via an antenna, and a two-dimensional code representing the read stored information is created and displayed on a display. Yes.

JP 2005-284836 A JP 2005-309756 A JP 2006-148776 A JP 2007-207085 A JP 2007-207095 A

  However, none of the patent documents disclose a configuration in which data is transmitted and received between electronic devices including a display panel with a built-in optical sensor. Therefore, none of the patent documents discloses a technique for reducing a communication error when data is transmitted and received between the electronic devices.

  The present invention has been made in view of the above-described problems, and its purpose is to reduce communication errors when data is transmitted and received between electronic devices having a display panel with a built-in optical sensor. An object is to provide a possible electronic device, communication system, data update method, display control method, and program.

  According to one aspect of the present invention, an electronic device is an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface, and is an electronic device that is a communication partner with the own device. If an electronic device having a display panel with a built-in optical sensor along the display surface is a counterpart device, and the display surface of the counterpart device and the display surface of the self device are opposed to each other, When transmitting data to the device, display control means for displaying the data as an image on the display surface of the display panel of the own device, and the data displayed as an image on the display surface of the display panel of the counterpart device in the opposite state, Receiving means for receiving through the optical sensor of the own device, a frame buffer for storing data to be transmitted to the counterpart device, scanning means for scanning the data stored in the frame buffer, and vertical scanning results And a updating means for updating the data stored in the frame buffer period.

Further, it is preferable that the updating means performs updating once in one vertical blanking period.
According to another aspect of the present invention, the electronic device is an electronic device including a display panel in which a plurality of optical sensors are incorporated along a display surface, and the electronic device is a communication partner with the own device. If the electronic device having a display panel with a built-in optical sensor along the display surface is the counterpart device, and the display surface of the counterpart device and the display surface of the self device face each other, When transmitting data to the other device, display control means for displaying the data as an image on the display surface of the display panel of the own device, and data displayed as an image on the display surface of the display device of the opposite device in the opposite state Receiving means for receiving via the optical sensor of the own device, and the display control means divides the data to be transmitted into a plurality of frames and displays it as an image on the display surface of the display panel of the own device. If the data included in each frame is a data signal, a plurality of reference signals for synchronizing with the counterpart device when the data signal is transmitted are displayed as images on the display panel of the display panel of the device. Further, in each frame, a plurality of reference signals are displayed in the same display mode, and in at least two consecutive frames of the plurality of frames, the reference signal is displayed differently for each frame. The reference signal is displayed on the display surface of the device in this order.

  The display control means preferably switches the display mode of the reference signal between the first mode and the second mode for each frame.

  According to still another aspect of the present invention, the electronic device is an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface, and is an electronic device that is a communication partner with the own device. When an electronic device having a display panel incorporating a plurality of optical sensors along a display surface is used as a counterpart device, and the state where the display surface of the counterpart device and the display surface of the self device are opposed to each other, When transmitting data to a certain partner device, the display control means for displaying the data as an image on the display surface of the display panel of the own device and the partner device in the opposite state are divided into a plurality of frames and the display panel of the partner device When the data displayed as an image on the display surface is received via the optical sensor of the device itself, and the data included in each frame is a data signal, the same data as the device itself is transmitted when the data signal is transmitted. And receiving means for receiving a plurality of reference signals displayed by the counterpart device together with the data signal through the optical sensor of the own device in order to obtain a plurality of reference signals in the same display mode in each frame, In at least two consecutive frames of the plurality of frames, the reference signal is displayed differently for each frame, and the reference signal, the data signal, and the reference signal of each frame are displayed in this order. Determining means for determining whether or not the reference signals before and after the data signal are in the same display mode in the data, and the invalidating means for invalidating the received data signal when the determining means determines that the reference signal is not in the same display mode Are further provided.

  According to still another aspect of the present invention, the communication system is a communication system including a first electronic device and a second electronic device each provided with a liquid crystal panel including a plurality of photosensors along a display surface. When the state in which the display surface of the first electronic device and the display surface of the second electronic device face each other is set to the facing state, the first electronic device transmits the data to the second electronic device in the facing state, First display control means for displaying data as an image on the display surface of the display panel of the first electronic device, and data displayed as an image on the display surface of the display panel of the second electronic device in an opposing state First receiving means for receiving via an optical sensor of the device, and the first display control means divides the data to be transmitted into a plurality of frames and displays them as an image on the display surface of the display panel of the first electronic device. , Send If the data included in each frame is a data signal, a plurality of reference signals for synchronizing with the second electronic device when the data signal is transmitted are displayed on the display surface of the display panel of the first electronic device. The reference signal of each frame is displayed as an image, and a plurality of reference signals are displayed in the same display mode in each frame, and in at least two consecutive frames of the plurality of frames, the reference signal is displayed differently for each frame. When the second electronic device transmits data to the first electronic device in the opposite state, the data signal and the reference signal are displayed on the display surface of the own device in this order, and the data is displayed on the display panel of the second electronic device. The second display control means for displaying as an image on the display surface of the first electronic device and the second electronic control unit when the data signal is transmitted from the first electronic device in the opposed state. The second receiving means for receiving a reference signal for synchronizing with the device, and determining whether or not the reference signals before and after the data signal are in the same display mode in the data for one frame received by the second receiving means And a disabling unit for invalidating the received data signal when the determining unit determines that the display mode is not the same.

  According to still another aspect of the present invention, a data update method is a data update method in an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface, and is a communication partner with the own device. An electronic device having a display panel in which a plurality of optical sensors are incorporated along a display surface is a counterpart device, and a state in which the display surface of the counterpart device and the display surface of the self device face each other is referred to as a facing state. Then, when transmitting data to the counterpart device in the opposite state, a display control step for displaying the data as an image on the display surface of the display panel of the own device and an image on the display surface of the display panel of the opposite device in the opposite state A reception step for receiving the data displayed as an optical sensor of the device itself, a storage step for storing data to be transmitted to the counterpart device in a frame buffer, and a frame buffer To include a scanning step of scanning the stored data, and updating step of updating the data stored in the frame buffer during a vertical blanking period of the scanning.

  According to still another aspect of the present invention, a display control method is a display control method in an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface, and is a communication partner with the own device. An electronic device having a display panel in which a plurality of optical sensors are incorporated along a display surface is a counterpart device, and a state in which the display surface of the counterpart device and the display surface of the self device face each other is referred to as a facing state. Then, when transmitting data to the counterpart device in the opposite state, a display control step for displaying the data as an image on the display surface of the display panel of the own device and an image on the display surface of the display panel of the opposite device in the opposite state Receiving the received data via the optical sensor of the own device, and the display control step divides the data to be transmitted into a plurality of frames and displays the display panel of the own device. When the data included in each frame among the data to be transmitted is used as a data signal, a plurality of reference signals for synchronizing with the counterpart device are transmitted when the data signal is transmitted. Display as an image on the display surface of the display panel. Further, each frame has a plurality of reference signals in the same display mode, and at least two consecutive frames out of the plurality of frames have different reference signals for each frame. The reference signal, the data signal, and the reference signal of each frame are displayed on the display surface of the own device in this order.

  According to still another aspect of the present invention, a display control method is a display control method in an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface, and is a communication partner with the own device. An electronic device having a display panel in which a plurality of optical sensors are incorporated along a display surface is a counterpart device, and a state in which the display surface of the counterpart device and the display surface of the self device face each other is referred to as a facing state. Then, when data is transmitted to the counterpart device in the opposite state, the display control step for displaying the data as an image on the display surface of the display panel of the own device, and the counterpart device in the opposite state is divided into a plurality of frames. When data displayed as an image on the display surface of the display panel of the device is received via the optical sensor of the device itself, and the data included in each frame is a data signal, the data Receiving a plurality of reference signals displayed by the counterpart device together with the data signal in order to synchronize with the device at the time of signal transmission via the optical sensor of the device, and each frame includes a plurality of reference signals. The reference signal is displayed in the same display mode, and the reference signal, the data signal, and the reference signal of each frame are displayed in this order so that the reference signal is different for each frame in at least two consecutive frames of the plurality of frames. The determination step for determining whether or not the reference signal before and after the data signal is in the same display mode in the data for one frame received in the reception step, and if the determination step determines that the reference display mode is not the same display mode And a disabling step of disabling the processed data signal.

  When the further another situation of this invention is followed, a program is a program for making a computer perform said method.

It is the figure which showed the structure of the communication system. It is a block diagram showing the hardware constitutions of the electronic device contained in a communication system. It is the figure which showed the structure of the liquid crystal panel of an electronic device, and the peripheral circuit of the said liquid crystal panel. It is sectional drawing of a liquid crystal panel and a backlight. It is the figure which showed the timing chart at the time of operating an optical sensor circuit. It is sectional drawing of a liquid crystal panel and a backlight, Comprising: It is the figure which showed the structure which a photodiode receives the light from a backlight in the case of a scan. It is the figure which showed schematic structure of the sensing command. It is the figure which showed the value of the data in each area | region of a sensing command, and the meaning content which the said value shows. It is the figure which showed schematic structure of the response data. It is the figure which showed the image obtained by scanning a finger | toe. It is a circuit diagram of another liquid crystal panel with a built-in photosensor. It is sectional drawing which showed the structure which a photodiode receives external light in the case of a scan. It is a block diagram showing the hardware constitutions of the other electronic device contained in a communication system. FIG. 2 is a diagram illustrating details of a hardware configuration of an image processing engine and peripheral blocks of the image processing engine. It is the functional block diagram which showed the functional block of the electronic device. It is the functional block diagram which showed the functional block of the other electronic device. It is the transition figure which showed the transition of the content displayed on the liquid crystal panel of an electronic device at the time of authentication. It is the transition diagram which showed the transition of the content displayed on the liquid crystal panel of another electronic device at the time of authentication. It is a figure for demonstrating the data flow at the time of transmitting / receiving data by making the display surface of the liquid crystal panel of an electronic device oppose the display surface of the liquid crystal panel 240 of another electronic device. It is the figure which showed the structure which displays a reference signal on the upper side of a data signal. It is the figure which showed the pattern about the combination of a reference signal and a data signal. The electronic device on the receiving side when the display surface of the electronic device on the transmitting side is rotated 90 degrees from a predetermined position with the display surface of the electronic device on the transmitting side facing the display surface of the electronic device on the receiving side It is the figure which showed the arrangement | sequence of the two signals which 1 receives. It is the figure which showed the reference signal and data signal when the magnitude | size of the area | region which displays a reference signal is made larger than the magnitude | size of the area | region which displays a data signal. It is the figure which showed the reference signal and the data signal when the shape of the area | region which displays a reference signal is made into a rectangle, and the shape of the area | region which displays a data signal is made into a circle. It is the figure which showed the reference signal and the data signal when the gradation of the area | region which displays a reference signal is made higher than the gradation of the area | region which displays a data signal. It is the figure which showed the reference signal and data signal when the color of the area | region which displays a reference signal is red, and the color of the area | region which displays a data signal is blue. It is a timing chart which showed the output timing of a reference signal and a data signal. It is a flowchart of communication between an electronic device and another electronic device. It is the figure which showed the display content of the display surface of the liquid crystal panel of an electronic device after the authentication start key of an electronic device was pressed. It is the figure which showed the display content of the display surface of the liquid crystal panel of the said other electronic device after another electronic device transmitted the READY signal, Comprising: The display surface of an electronic device is the display surface of the said other electronic device. It is the figure which showed the state made to oppose. It is the figure which showed the display content of the display surface of an electronic device at the time of transmitting an authentication request signal. It is the figure which showed the display content of the display surface of the liquid crystal panel of the said other electronic device after another electronic device receives authentication information (or after transmitting an authentication preparation completion signal), and the electronic device It is the figure which showed the state which made this display surface oppose the display surface of the said other electronic device. It is the figure which showed the content displayed on the display surface of the liquid crystal panel of an electronic device when authentication succeeds. It is the figure which showed the content displayed on the display surface of the liquid crystal panel of the other electronic device when authentication succeeds. It is the figure which showed the screen structure of the display surface of an electronic device. It is the figure which showed the screen structure of the display surface of an electronic device. It is the figure which showed the format of the data for communication. It is the figure which showed the code written in the data area which shows the command of FIG. 37, and the meaning which the said each code shows. It is the figure which showed the screen structure of the display surface of an electronic device at the time of initial stage communication. It is the figure which showed the screen structure of the display surface of an electronic device at the time of initial stage communication. It is the figure which showed the screen structure of the display surface of an electronic device at the time of this communication. It is the figure which showed the pixel block for eight data signals shown in FIG. It is the figure which showed the screen structure of the display surface of another electronic device at the time of this communication. It is the figure which showed the pixel block for eight data signals shown in FIG. It is the figure which showed device information. It is the figure which showed the communication parameter. It is a figure for demonstrating the specification of the communication area | region of the electronic device in initial stage communication. It is a figure for demonstrating the specification of the communication area | region of the electronic device in this communication. When performing authentication, it is the figure which showed the state which made the display surface of the liquid crystal panel of an electronic device and the display surface of the liquid crystal panel of another electronic device face each other. It is the figure which showed the content displayed on the display surface of the liquid crystal panel of another electronic device when this communication is performed in the state shown in FIG. It is the figure which showed the case where the position of the display surface of the liquid crystal panel of an electronic device changed during authentication. FIG. 52 is a diagram illustrating display contents on a display surface of a liquid crystal panel of another electronic device when the electronic device moves as illustrated in FIG. 51. It is the figure which showed the display surface of the electronic device at the time of data transmission. FIG. 57 is a diagram schematically showing a state in which another electronic device has received the reference signal and the data signal shown in FIG. 53 output by the electronic device in a state where the electronic device and the other electronic device face each other. It is the figure which showed the area | region of the extracted data signal. It is the figure after correct | amending the arrangement | sequence of a data signal. It is the figure which showed the result of having analyzed the pattern of the received data signal. It is the flowchart which showed the flow of the first half of the process of the electronic device at the time of authentication. It is the flowchart which showed the flow of the latter half of the process of the electronic device at the time of authentication. It is the flowchart which showed the flow of the first half of the process of the other electronic device at the time of authentication. It is the flowchart which showed the flow of the second half of the process of the other electronic device at the time of authentication. It is the flowchart which showed the transmission flow of the data of the electronic device at the time of initial communication. FIG. 63 is a flowchart showing a detailed flow of processing in step S203 and step S208 of FIG. 62. FIG. It is the flowchart which showed the reception flow of the data of the other electronic device at the time of initial communication. It is the flowchart which showed the transmission flow of the data of the electronic device at the time of this communication. FIG. 66 is a flowchart showing a detailed flow of processing in step S503 and step S508 in FIG. 65. FIG. It is the flowchart which showed the first half of the data reception flow of the other electronic device at the time of this communication. It is the flowchart which showed the second half of the data reception flow of the other electronic device at the time of this communication. It is the figure which showed the content displayed on the display surface of an electronic device, and the content displayed on the display surface of another electronic device before performing an accounting process. It is the figure which showed the content displayed on the display surface of an electronic device after charging processing, and the content displayed on the display surface of an electronic device. It is the figure which showed typically the area | region of VRAM in the driver control part shown in FIG. It is the figure which showed the order which scans the data memorize | stored in VRAM. It is a figure for demonstrating the relationship between a scanning period and a vertical blanking period. 74 is a diagram for describing a frame Fb obtained when data is updated at time t11 and time t12 in FIG. 73. FIG. FIG. 74 is a diagram for describing a case where VRAM data is updated at a timing different from the timing illustrated in FIG. 73. It is the figure which showed two frames. It is the figure which showed the frame at the time of changing the number of the data signals which can be transmitted in one frame from one to multiple. It is the figure which showed the reception data when another electronic device receives the flame | frame which an electronic device displays continuously at three different timings. It is the figure which showed the data signal which an electronic device transmits. It is the figure which showed the other flame | frame. It is the figure which showed other frames. It is the figure which showed other frames. It is the figure which showed the reception data when the other electronic device 200 received the flame | frame which an electronic device displays continuously at five different timings.

  An embodiment of a communication system according to the present invention will be described below with reference to FIGS.

<System configuration>
FIG. 1 is a diagram showing a configuration of a communication system 1 according to the present embodiment. Referring to FIG. 1, communication system 1 includes a card-type electronic device 100 and a stationary electronic device 200.

  Each of the electronic device 100 and the electronic device 200 includes a liquid crystal panel with a built-in optical sensor. The electronic device 100 and the electronic device 200 communicate with each other using the optical sensor built-in liquid crystal panel. A specific communication method will be described later.

  Electronic device 100 and electronic device 200 are used for authentication, for example. In this case, the electronic device 100 operates as a device to be authenticated, and the electronic device 200 operates as a device on the authentication side. The electronic device 100 is configured as a portable device having a display function such as a PDA (Personal Digital Assistant) or a portable phone. The electronic device 200 is configured as a device having a display function such as a monitor or a television connected to a computer.

<About hardware configuration-1>
Next, an aspect of a specific configuration of the electronic device 100 will be described. FIG. 2 is a block diagram illustrating a hardware configuration of electronic device 100. Referring to FIG. 2, electronic device 100 includes a main device 101 and a display device 102 as main components.

  The main unit 101 includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 171, a ROM (Read-Only Memory) 172, a memory card reader / writer 173, a communication unit 174, a microphone 175, and a speaker. 176 and operation keys 177 are included. Each component is connected to each other by a data bus DB1. A memory card 1731 is attached to the memory card reader / writer 173.

  CPU 110 executes a program. The operation key 177 receives an instruction input from the user of the electronic device 100. The RAM 171 stores data generated by the execution of the program by the CPU 110 or data input via the operation keys 177 in a volatile manner. The ROM 172 stores data in a nonvolatile manner. The ROM 172 is a ROM capable of writing and erasing, such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory. The communication unit 174 performs wireless communication with other electronic devices (not shown). Although not illustrated in FIG. 2, the electronic device 100 may include an interface (IF) for connecting to another electronic device by wire.

  The display device 102 includes a driver 130, an optical sensor built-in liquid crystal panel 140 (hereinafter referred to as a liquid crystal panel 140), an internal IF 178, a backlight 179, and an image processing engine 180.

  The driver 130 is a drive circuit for driving the liquid crystal panel 140 and the backlight 179. Various drive circuits included in the driver 130 will be described later.

  The liquid crystal panel 140 is a device having a liquid crystal display function and a photosensor function. That is, the liquid crystal panel 140 can perform image display using liquid crystal and sensing using an optical sensor. Details of the liquid crystal panel 140 will be described later.

  An internal IF (Interface) 178 mediates exchange of data between the main device 101 and the display device 102.

  The backlight 179 is a light source disposed on the back surface of the liquid crystal panel 140. The backlight 179 irradiates the back surface with uniform light.

  The image processing engine 180 controls the operation of the liquid crystal panel 140 via the driver 130. Here, the control is performed based on various data sent from the main apparatus 101 via the internal IF 178. Note that the various data includes commands to be described later. Further, the image processing engine 180 processes data output from the liquid crystal panel 140 and sends the processed data to the main apparatus 101 via the internal IF 178. Further, the image processing engine 180 includes a driver control unit 181, a timer 182, and a signal processing unit 183.

  The driver control unit 181 controls the operation of the driver 130 by sending a control signal to the driver 130. In addition, the driver control unit 181 analyzes a command transmitted from the main device 101. Then, the driver control unit 181 sends a control signal based on the analysis result to the driver 130. Details of the operation of the driver 130 will be described later.

The timer 182 generates time information and sends the time information to the signal processing unit 183.
The signal processing unit 183 receives data output from the optical sensor. Here, since the data output from the optical sensor is analog data, the signal processing unit 183 first converts the analog data into digital data. Further, the signal processing unit 183 performs data processing on the digital data in accordance with the content of the command sent from the main device 101. Then, the signal processing unit 183 sends data (hereinafter referred to as response data) including data after the above data processing and time information acquired from the timer 182 to the main unit 101. The signal processing unit 183 includes a RAM (not shown) that can store a plurality of scan data, which will be described later, continuously.

  The command includes a sensing command for instructing sensing by the optical sensor. Details of the sensing command and the response data will be described later (FIGS. 7 to 9).

  Note that the timer 182 is not necessarily provided in the image processing engine 180. For example, the timer 182 may be provided outside the image processing engine 180 in the display device 102. Alternatively, the timer 182 may be provided in the main body device 101. Further, the microphone 175 and the speaker 176 are not always provided in the electronic device 100, and may be configured so as not to include either or both of the microphone 175 and the speaker 176 depending on the embodiment of the electronic device 100.

  Here, the display device 102 includes a system liquid crystal. The system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 140 on the glass substrate of the liquid crystal panel 140. In the present embodiment, the driver 130 (excluding the circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are integrally formed on the glass substrate of the liquid crystal panel 140. Note that the display device 102 is not necessarily configured using the system liquid crystal, and the driver 130 (excluding a circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are included in the glass substrate. Other substrates may be configured.

  By the way, the processing in the electronic device 100 is realized by each hardware and software executed by the CPU 110. Such software may be stored in the ROM 172 in advance. The software may be stored in a memory card 1731 or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the memory card reader / writer 173 or other reading device, or downloaded via the communication unit 174 or communication IF (not shown), and then temporarily stored in the ROM 172. The The software is read from the ROM 172 by the CPU 110 and stored in the RAM 171 in the form of an executable program. CPU 110 executes the program.

  Each component constituting the main device 101 of the electronic device 100 shown in FIG. 2 is a general one. Therefore, it can be said that the essential part of the present invention is the software stored in the RAM 171, the ROM 172, the memory card 1731 and other storage media, or the software downloadable via the network. Since the hardware operation of main device 101 of electronic device 100 is well known, detailed description will not be repeated.

  The storage medium is not limited to a memory card, but is a CD-ROM, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile). Disc)), IC (Integrated Circuit) cards (excluding memory cards), optical cards, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), flash ROM, and other semiconductor memories, etc. It may be a medium to be used.

  The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<Configuration and drive of liquid crystal panel with built-in optical sensor>
Next, the configuration of the liquid crystal panel 140 and the configuration of peripheral circuits of the liquid crystal panel 140 will be described. FIG. 3 is a diagram showing a configuration of the liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140.

  Referring to FIG. 3, the liquid crystal panel 140 includes a pixel circuit 141, an optical sensor circuit 144, a scanning signal line Gi, a data signal line SRj, a data signal line SGj, a data signal line SBj, and a sensor signal line. SSj, sensor signal line SDj, read signal line RWi, and reset signal line RSi are included. Note that i is a natural number satisfying 1 ≦ i ≦ m, and j is a natural number satisfying 1 ≦ j ≦ n.

  2 includes a scanning signal line driving circuit 131, a data signal line driving circuit 132, an optical sensor driving circuit 133, a switch 134, as peripheral circuits of the liquid crystal panel 140. And an amplifier 135.

  The scanning signal line drive circuit 131 receives the control signal TC1 from the driver control unit 181 shown in FIG. The scanning signal line drive circuit 131 applies a predetermined voltage in order from the scanning signal line G1 to each scanning signal line (G1 to Gm) based on the control signal TC1. More specifically, the scanning signal line driving circuit 131 sequentially selects one scanning signal line from the scanning signal lines (G1 to Gm) per unit time, and a TFT (to be described later) with respect to the selected scanning signal line. A voltage capable of turning on the gate of the thin film transistor 142 is applied (hereinafter referred to as a high level voltage). Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.

  The data signal line driving circuit 132 receives image data (DR, DG, DB) from the driver control unit 181 shown in FIG. The data signal line driving circuit 132 applies a voltage corresponding to one row of image data to the 3n data signal lines (SR1 to SRn, SG1 to SGn, SB1 to SBn) for each unit time. Apply sequentially.

  Note that although a driving method called a so-called line-sequential method has been described here, the driving method is not limited to this.

  The pixel circuit 141 is a circuit for setting the luminance (transmittance) of one pixel. Further, m × n pixel circuits 141 are arranged in a matrix. More specifically, m pixel circuits 141 are arranged in the vertical direction in FIG. 3 and n pixel circuits in the horizontal direction.

  The pixel circuit 141 includes an R subpixel circuit 141r, a G subpixel circuit 141g, and a B subpixel circuit 141b. Each of these three circuits (141r, 141g, 141b) includes a TFT 142, a pair of electrode pairs 143 including a pixel electrode and a counter electrode, and a capacitor (not shown).

  In addition, CMOS (Complementary Metal Oxide Semiconductor) capable of forming n-type transistors and p-type transistors can be realized, and the movement speed of carriers (electrons or holes) is several hundreds compared to amorphous silicon thin film transistors (a-Si TFTs). For example, a polycrystalline silicon thin film transistor (p-Si TFT) is used as the TFT 142 in the display device 102 because it is twice as fast. Note that the TFT 142 will be described as an n-channel field effect transistor. However, the TFT 142 may be a p-type channel field effect transistor.

  The source of the TFT 142 in the R subpixel circuit 141r is connected to the data signal line SRj. The gate of the TFT 142 is connected to the scanning signal line Gi. Further, the drain of the TFT 142 is connected to the pixel electrode of the electrode pair 143. A liquid crystal is disposed between the pixel electrode and the counter electrode. The G sub-pixel circuit 141g and the B sub-pixel circuit 141b have the same configuration as the R sub-pixel circuit 141r except that the data signal line to which the source of each TFT 142 is connected is different. Therefore, description of these two circuits (141g, 141b) will not be repeated.

  Here, setting of luminance in the pixel circuit 141 will be described. First, the high level voltage is applied to the scanning signal line Gi. By the application of the high level voltage, the gate of the TFT 142 is turned on. In this manner, with the gate of the TFT 142 turned on, a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line (SRj, SGj, SBj). Thereby, a voltage based on the designated voltage is applied to the pixel electrode. As a result, a potential difference is generated between the pixel electrode and the counter electrode. Based on this potential difference, the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. Note that the potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.

  The optical sensor drive circuit 133 receives the control signal TC2 from the driver control unit 181 shown in FIG.

  Then, the optical sensor drive circuit 133 sequentially selects one signal line from the reset signal lines (RS1 to RSm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, the voltage VDDR that is higher than usual is applied. Note that a voltage VSSR lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line. For example, the voltage VDDR may be set to 0V and the voltage VSSR may be set to −5V.

  Further, the optical sensor driving circuit 133 sequentially selects one signal line from the readout signal lines (RW1 to RWm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, a voltage VDD higher than usual is applied. Note that the voltage VSSR is applied to the read signal line that is not selected. For example, the value of VDD may be set to 8V.

  The timing for applying the voltage VDDR and the timing for applying the voltage VDD will be described later.

  The optical sensor circuit 144 includes a photodiode 145, a capacitor 146, and a TFT 147. In the following description, it is assumed that the TFT 147 is an n-type channel field effect transistor. However, the TFT 147 may be a p-type channel field effect transistor.

  The anode of the photodiode 145 is connected to the reset signal line RSi. On the other hand, the cathode of the photodiode 145 is connected to one electrode of the capacitor 146. The other electrode of the capacitor 146 is connected to the read signal line RWi. Hereinafter, a connection point between the photodiode 145 and the capacitor 146 is referred to as a node N.

  The gate of the TFT 147 is connected to the node N. The drain of the TFT 147 is connected to the sensor signal line SDj. Further, the source of the TFT 147 is connected to the sensor signal line SSj. Details of sensing using the optical sensor circuit 144 will be described later.

  The switch 134 is a switch provided to switch whether or not to apply a predetermined voltage to the sensor signal lines (SD1 to SDn). The switching operation of the switch 134 is performed by the optical sensor driving circuit 133. Note that the voltage applied to the sensor signal lines (SD1 to SDn) when the switch 134 is turned on will be described later.

  The amplifier 135 amplifies the voltage output from each sensor signal line (SS1 to SSn). The amplified voltage is sent to the signal processing unit 183 shown in FIG.

  The image processing engine 180 controls the timing for displaying an image on the liquid crystal panel 140 using the pixel circuit 141 and the timing for sensing using the optical sensor circuit 144.

  FIG. 4 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179. Referring to FIG. 4, liquid crystal panel 140 includes an active matrix substrate 151A, a counter substrate 151B, and a liquid crystal layer 152. The counter substrate 151B is disposed to face the active matrix substrate 151A. The liquid crystal layer 152 is sandwiched between the active matrix substrate 151A and the counter substrate 151B. The backlight 179 is disposed on the opposite side of the liquid crystal layer 152 with respect to the active matrix substrate 151A.

  The active matrix substrate 151 </ b> A includes a polarizing filter 161, a glass substrate 162, a pixel electrode 143 a that constitutes the electrode pair 143, a photodiode 145, a data signal line 157, and an alignment film 164. Further, although not shown in FIG. 4, the active matrix substrate 151A includes the capacitor 146, the TFT 147, the TFT 142, and the scanning signal line Gi shown in FIG.

  In the active matrix substrate 151A, the polarizing filter 161, the glass substrate 162, the pixel electrode 143a, and the alignment film 164 are arranged in this order from the backlight 179 side. The photodiode 145 and the data signal line 157 are formed on the liquid crystal layer 152 side of the glass substrate 162.

  The counter substrate 151B includes a polarizing filter 161, a glass substrate 162, a light shielding film 163, color filters (153r, 153g, 153b), a counter electrode 143b constituting the electrode pair 143, and an alignment film 164.

  In the counter substrate 151B, the alignment film 164, the counter electrode 143b, the color filters (153r, 153g, 153b), the glass substrate 162, and the polarizing filter 161 are arranged in this order from the liquid crystal layer 152 side. The light shielding film 163 is formed in the same layer as the color filters (153r, 153g, 153b).

  The color filter 153r is a filter that transmits light having a red wavelength. The color filter 153g is a filter that transmits light having a green wavelength. The color filter 153b is a filter that transmits light having a blue wavelength. Here, the photodiode 145 is arranged at a position facing the color filter 153b.

  The liquid crystal panel 140 displays an image by blocking external light or light emitted from a light source such as a backlight 179 or transmitting the light. Specifically, the liquid crystal panel 140 changes the direction of liquid crystal molecules in the liquid crystal layer 152 by applying a voltage between the pixel electrode 143a and the counter electrode 143b, thereby blocking or transmitting the light. However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 161 that transmits only light having a specific polarization direction is provided.

  Note that the position of the photodiode 145 is not limited to the above position, and may be provided at a position facing the color filter 153r or a position facing the color filter 153g.

  Here, the operation of the optical sensor circuit 144 will be described. FIG. 5 is a diagram showing a timing chart when the optical sensor circuit 144 is operated. In FIG. 5, a voltage VINT indicates a potential at the node N in the photosensor circuit 144. A voltage VPIX is an output voltage from the sensor signal line SSj shown in FIG. 3 and is a voltage before being amplified by the amplifier 135.

  The following description will be divided into a reset period for resetting the optical sensor circuit 144, a sensing period for sensing light using the optical sensor circuit 144, and a readout period for reading the sensed result.

  First, the reset period will be described. In the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDDR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR). As described above, by applying the high-level voltage to the reset signal line RSi, a current starts to flow in the forward direction (from the anode side to the cathode side) of the photodiode 145. As a result, the voltage VINT which is the potential of the node N has a value represented by the following expression (1). In Equation (1), the forward voltage drop amount in the photodiode 145 is Vf.

VINT = VSSR + | VDDR−VSSR | −Vf (1)
Therefore, the potential of the node N is a value smaller by Vf than the voltage VDDR as shown in FIG.

  Here, since the voltage VINT is not more than the threshold value for turning on the gate of the TFT 147, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change. Further, a difference corresponding to the voltage VINT occurs between the electrodes of the capacitor 146. For this reason, the capacitor 146 accumulates charges corresponding to the difference.

  Next, the sensing period will be described. In the sensing period following the reset period, the voltage applied to the reset signal line RSi instantaneously switches from the high level (voltage VDDR) to the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).

  Thus, by changing the voltage applied to the reset signal line RSi to the low level, the potential of the node N becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi. For this reason, in the photodiode 145, the voltage on the cathode side becomes higher than the voltage on the anode side. That is, the photodiode 145 is in a reverse bias state. In such a reverse bias state, when the photodiode 145 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 145. As a result, as shown in FIG. 5, the potential of the node N (that is, the voltage VINT) becomes lower with the passage of time.

  Since the voltage VINT continues to decrease in this way, the gate of the TFT 147 does not turn on. Therefore, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change.

  Next, the reading period will be described. In the readout period following the sensing period, the voltage applied to the reset signal line RSi is kept at the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDD). Here, the voltage VDD is higher than the voltage VDDR.

  Thus, by applying a high level voltage instantaneously to the read signal line RWi, the potential of the node N is raised through the capacitor 146 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi. Here, since the potential of the node N (that is, the voltage VINT) is raised to a threshold value that turns on the gate of the TFT 147, the gate of the TFT 147 is turned on.

  At this time, if a constant voltage is applied in advance to the sensor signal line SDj (see FIG. 3) connected to the drain side of the TFT 147, the sensor signal line SSj connected to the source side of the TFT 147 will cause the VPIX in FIG. As shown in the graph, a voltage corresponding to the potential of the node N is output.

  Here, when the amount of light received by the photodiode 145 (hereinafter referred to as the amount of received light) is small, the slope of the straight line shown in the VINT graph of FIG. 5 becomes gentle. As a result, the voltage VPIX is higher than when the amount of received light is large. As described above, the optical sensor circuit 144 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 145.

  By the way, in the above, the operation | movement was demonstrated paying attention to one optical sensor circuit 144 among the m * n optical sensor circuits which exist. Below, operation | movement of each photosensor circuit in the liquid crystal panel 140 is demonstrated.

  First, the optical sensor drive circuit 133 applies a predetermined voltage to all n sensor signal lines (SD1 to SDn). Next, the photosensor drive circuit 133 applies a voltage VDDR that is higher than normal to the reset signal line RS1. The other reset signal lines (RS2 to RSm) and read signal lines (RW1 to RWm) are kept in a state where a low level voltage is applied. As a result, the n photosensor circuits in the first row in FIG. 3 enter the reset period described above. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.

  Note that the timing at which a predetermined voltage is applied to all n sensor signal lines (SD1 to SDn) is not limited to the above timing, and may be any timing that is applied at least before the readout period. .

  When the readout period of the n photosensor circuits in the first row is completed, the photosensor drive circuit 133 applies a voltage VDDR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.

  Thereafter, the processing described above is sequentially performed on the n photosensor circuits in the third row, the n photosensor circuits in the fourth row,..., The n photosensor circuits in the m row. As a result, the sensing result of the first row, the sensing result of the second row,..., The sensing result of the m-th row are output in this order from the sensor signal lines (SS1 to SSn).

  In the display device 102, sensing is performed for each row as described above, and a sensing result is output from the liquid crystal panel 140 for each row. For this reason, hereinafter, the data after the signal processing unit 183 performs the above-described data processing on the data regarding the voltage for m rows from the first row to the m-th row output from the liquid crystal panel 140, This is called “scan data”. That is, scan data refers to image data obtained by scanning a scan target (for example, a user's finger). An image displayed based on the scan data is referred to as a “scanned image”. Further, in the following, sensing is referred to as “scan”.

  Moreover, in the above, although the structure which scans using all the m * n photosensor circuits was mentioned as an example, it is not limited to this. Scanning may be performed on a partial region of the surface of the liquid crystal panel 140 using a photosensor circuit selected in advance.

  In the following, it is assumed that the electronic device 100 can take either of the two configurations. Further, switching between the components is assumed to be performed by a command sent from the main device 101 based on an input via the operation key 177 or the like. Note that when scanning is performed on a partial area on the surface of the liquid crystal panel 140, the image processing engine 180 sets a scan target area. The setting of the area may be configured to be specified by the user via the operation key 177.

  As described above, when scanning is performed on a partial region of the surface of the liquid crystal panel 140, there are the following modes of use for displaying an image. The first is a mode in which an image is displayed in a surface area other than the partial area (hereinafter referred to as a scan area). The second is a mode in which no image is displayed in the surface area other than the scan area. Which mode is used is based on a command sent from the main apparatus 101 to the image processing engine 180.

  FIG. 6 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179, showing a configuration in which the photodiode 145 receives light from the backlight 179 during scanning.

  Referring to FIG. 6, when the user's finger 900 is in contact with the surface of the liquid crystal panel 140, a part of the light emitted from the backlight 179 is part of the user's finger 900 (abbreviated in the contacted area). Reflected on the plane). The photodiode 145 receives the reflected light.

  Even in a region where the finger 900 is not in contact, part of the light emitted from the backlight 179 is reflected by the user's finger 900. Even in this case, the photodiode 145 receives the reflected light. However, since the finger 900 is not in contact with the surface of the liquid crystal panel 140 in the region, the amount of light received by the photodiode 145 is smaller than the region in which the finger 900 is in contact. Note that the photodiode 145 cannot receive most of the light emitted from the backlight 179 that does not reach the user's finger 900.

  Here, by turning on the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the amount of light reflected by the user's finger 900 from the sensor signal line SSj. it can. In this manner, by controlling turning on and off of the backlight 179, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

  As described above, the display device 102 can scan an image (hereinafter, also referred to as a reflected image) obtained by reflecting light with the finger 900.

Note that examples of the scan object other than the finger 900 include a stylus.
By the way, in the present embodiment, a liquid crystal panel is described as an example of the display device of electronic device 100, but another panel such as an organic EL (Electro-Luminescence) panel is used instead of the liquid crystal panel. Also good.

<About data>
Next, the sensing command will be described. In the display device 102, the image processing engine 180 analyzes the content of the sensing command and sends back data (that is, response data) according to the analysis result to the main body device 101.

  FIG. 7 is a diagram showing a schematic configuration of a sensing command. Referring to FIG. 7, the sensing command includes a header data area DA01, a timing data area DA02, a data type data area DA03, a reading method data area DA04, and image gradation data. An area DA05, a data area DA06 indicating resolution, and a spare data area DA07 are included.

  FIG. 8 is a diagram showing data values in each area of the sensing command and the meaning contents indicated by the values.

  Referring to FIG. 8, the sensing command in which “00” is set in the data area indicating the timing requests image processing engine 180 to transmit scan data at that time. That is, the sensing command requests transmission of scan data obtained by scanning using the optical sensor circuit 144 after the image processing engine 180 receives the sensing command. A sensing command in which “01” is set in the data area indicating the timing requests transmission of scan data when the scan result has changed. Furthermore, a sensing command in which “10” is set in the data area indicating the timing requests transmission of scan data at regular intervals.

  A sensing command in which “001” is set in the data area indicating the data type requests transmission of the coordinate value of the center coordinate in the partial image. In addition, a sensing command in which “010” is set in the data area indicating the data type requests transmission of only a partial image whose scan result has changed. Note that the change in the scan result indicates that the previous scan result is different from the current scan result. Further, a sensing command in which “100” is set in the data area indicating the data type requests transmission of the entire image.

  Here, the “entire image” is an image generated by the image processing engine 180 based on the voltage output from each photosensor circuit when scanning using m × n photosensor circuits. . The “partial image” is a part of the entire image. The reason why the partial image is requested to transmit only the partial image whose scan result has changed will be described later.

  The coordinate value and the partial image or the entire image may be requested at the same time. Further, in the case of a configuration in which scanning is performed on a partial area on the surface of the liquid crystal panel 140, the entire image is an image corresponding to the area to be scanned.

  A sensing command in which “00” is set in the data area indicating the reading method requests to scan with the backlight 179 on. A sensing command in which “01” is set in the data area indicating the reading method requests scanning with the backlight 179 off. A configuration for scanning with the backlight 179 off is described later (FIG. 12). Furthermore, a sensing command in which “10” is set in the data area indicating the reading method requests scanning using both reflection and transmission. Note that the combined use of reflection and transmission refers to scanning a scan object by switching between a method in which the backlight 179 is turned on for scanning and a method in which the backlight is turned off for scanning.

  A sensing command in which “00” is set in the data area indicating the image gradation requests monochrome image data of black and white. A sensing command in which “01” is set in the data area indicating the image gradation requests multi-gradation image data. Furthermore, a sensing command in which “10” is set in the data area indicating the image gradation requests RGB color image data.

  A sensing command in which “0” is set in the data area indicating the resolution requests image data with a high resolution. A sensing command in which “1” is set in the data area indicating the resolution requests image data with a low resolution.

  In addition to the data shown in FIG. 7 and FIG. 8, the sensing command includes designation of an area to be scanned (area of pixels that drive the optical sensor circuit 144), timing to perform scanning, and timing to turn on the backlight 179. Etc. are described.

  FIG. 9 is a diagram showing a schematic configuration of response data. The response data is data corresponding to the content of the sensing command, and is data that the image processing engine 180 of the display device 102 transmits to the main body device 101.

  Referring to FIG. 9, the response data includes a header data area DA11, a coordinate data area DA12, a time data area DA13, and an image data area DA14. Here, the value of the center coordinates of the partial image is written in the data area DA12 indicating the coordinates. In addition, time information acquired from the timer 182 of the image processing engine 180 is written in the data area indicating the time. Further, image data (that is, scan data) after being processed by the image processing engine 180 is written in the data area indicating the image.

  FIG. 10 is a diagram illustrating an image obtained by scanning the finger 900 (that is, a scanned image). Referring to FIG. 10, the image of area W1 surrounded by a thick solid line is the entire image, and the image of area P1 surrounded by the broken line is a partial image. The center point C1 of the cross indicated by a thick line is the center coordinate.

  In the present embodiment, a pixel (that is, a predetermined gradation or a pixel having a photosensor circuit which is a rectangular region and whose output voltage from the sensor signal line SSj is equal to or higher than a predetermined value). An area including all of the pixels having a luminance equal to or higher than a predetermined luminance is set as a partial image area.

  The center coordinates are coordinates determined in consideration of the gradation of each pixel in the partial image area. Specifically, for each pixel in the partial image, the center coordinate is determined by performing a weighting process based on the gradation of the pixel and the distance between the pixel and the rectangular center point (that is, the centroid). Is done. That is, the center coordinates do not necessarily match the centroid of the partial image.

  However, the position of the center coordinates is not necessarily limited to the above, and the center coordinates may be the coordinates of the centroid or the coordinates near the centroid.

  When “001” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate. In this case, the image processing engine 180 does not write image data in the data area DA14 indicating an image. After writing the value of the center coordinate, the image processing engine 180 sends response data including the value of the center coordinate to the main body device 101. As described above, when “001” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate without requesting the output of the image data.

  Further, when “010” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the image data of the partial image whose scan result has changed in the data area DA14 indicating the image. . In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. The image processing engine 180 writes the image data of the partial image whose scan result has changed, and then sends response data including the image data of the partial image to the main body device 101. As described above, when “010” is set in the data area indicating the data type, the sensing command does not request the output of the value of the center coordinate, and the image data of the partial image whose scan result has changed. Request output.

  As described above, the reason for requesting transmission of only the partial image whose scan result has changed is that the scan data of the partial image area of the scan data is more important than the scan data of the other area. This is because the data is high, and the scan data in the region corresponding to the region of the partial image in the scan data is likely to change due to the contact state with the scan object such as the finger 900.

  When “011” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. The image data of the partial image whose scan result has changed is written in DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the partial image to the main body device 101. As described above, when “011” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the partial image whose scan result has changed. To do.

  If “100” is set in the data area indicating the data type of the sensing command, the image processing engine 180 displays the image of the entire image in the data area DA14 indicating the image of the response data shown in FIG. Write data. In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. After writing the image data of the entire image, the image processing engine 180 sends response data including the image data of the entire image to the main body device 101. As described above, when “100” is set in the data area indicating the data type, the sensing command requests the output of the image data of the entire image without requesting the output of the value of the center coordinate.

  When “101” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. Write the image data of the entire image to DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the entire image to the main body device 101. As described above, when “101” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the entire image.

<About modification>
By the way, the structure of the liquid crystal panel 140 is not limited to the structure shown in FIG. Hereinafter, a liquid crystal panel having a mode different from that in FIG. 3 will be described.

  FIG. 11 is a circuit diagram of a photosensor built-in liquid crystal panel 140A according to the different embodiment. Referring to FIG. 11, photosensor built-in liquid crystal panel 140A (hereinafter referred to as liquid crystal panel 140A) includes three photosensor circuits (144r, 144g, 144b) in one pixel. Thus, the liquid crystal panel 140A is different from the liquid crystal panel 140 including one photosensor circuit in one pixel in that the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, and 144b) in one pixel. The configuration of the optical sensor circuit 144 is the same as that of each of the three optical sensor circuits (144r, 144g, 144b).

  Further, the three photodiodes (145r, 145g, 145b) in one pixel are arranged at positions facing the color filter 153r, the color filter 153g, and the color filter 153b, respectively. Therefore, the photodiode 145r receives red light, the photodiode 145g receives green light, and the photodiode 145b receives blue light.

  In addition, since the liquid crystal panel 140 includes only one photosensor circuit 144 in one pixel, two data signal lines for the TFT 147 disposed in one pixel are a sensor signal line SSj and a sensor signal line SDj. Met. However, since the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, 144b) in one pixel, there are six data signal lines for TFTs (147r, 147g, 147b) arranged in one pixel. It becomes.

  Specifically, the sensor signal line SSRj and the sensor signal line SDRj are arranged corresponding to the TFT 147r connected to the cathode of the photodiode 145r arranged at a position facing the color filter 153r. A sensor signal line SSGj and a sensor signal line SDGj are arranged corresponding to the TFT 147g connected to the cathode of the photodiode 145g arranged at a position facing the color filter 153g. Further, a sensor signal line SSBj and a sensor signal line SDBj are disposed corresponding to the TFT 147b connected to the cathode of the photodiode 145b disposed at a position facing the color filter 153b.

  In such a liquid crystal panel 140A, the white light emitted from the backlight 179 passes through the three color filters (153r, 153g, 153b), and red, green, and blue are displayed on the surface of the liquid crystal panel 140A. It mixes and becomes white light. Here, when white light is reflected by the scan object, a part of the white light is absorbed by the pigment on the surface of the scan object, and a part is reflected. And the reflected light permeate | transmits three color filters (153r, 153g, 153b) again.

  At this time, the color filter 153r transmits light having a red wavelength, and the photodiode 145r receives light having the red wavelength. The color filter 153g transmits light having a green wavelength, and the photodiode 145g receives light having the green wavelength. The color filter 153b transmits light having a blue wavelength, and the photodiode 145b receives light having the blue wavelength. That is, the light reflected by the scan object is separated into three primary colors (R, G, B) by three color filters (153r, 153g, 153b), and each photodiode (145r, 145g, 145b) The light of the color corresponding to is received.

  When a part of white light is absorbed by the pigment on the surface of the scan target, the amount of light received by each photodiode (145r, 145g, 145b) is different for each photodiode (145r, 145g, 145b). For this reason, the output voltages of the sensor signal line SSRj, the sensor signal line SSGj, and the sensor signal line SSBj are different from each other.

  Therefore, the image processing engine 180 determines the R gradation, the G gradation, and the B gradation according to each output voltage, so that the image processing engine 180 sends the RGB color image to the main body device 101. Can send.

  As described above, when the electronic apparatus 100 includes the liquid crystal panel 140A, the scan target can be scanned in color.

  Next, a scanning method different from the scanning method described with reference to FIG. 6 (that is, the method of scanning the reflected image) will be described with reference to FIG.

  FIG. 12 is a cross-sectional view showing a configuration in which a photodiode receives external light during scanning. Referring to FIG. 12, part of the external light is blocked by finger 900. Therefore, the photodiode disposed under the surface region of the liquid crystal panel 140 that is in contact with the finger 900 can hardly receive external light. In addition, although the photodiodes disposed under the surface area where the shadow of the finger 900 is formed can receive a certain amount of external light, the amount of external light received is small compared to the surface area where no shadow is formed.

  Here, by turning off the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the position of the finger 900 with respect to the surface of the liquid crystal panel 140 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140. The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

  As described above, the display device 102 can scan an image (hereinafter also referred to as a shadow image) obtained by blocking external light with the finger 900.

  Further, the display device 102 may be configured to perform scanning by turning on the backlight 179 and then performing scanning again by turning off the backlight 179. Alternatively, the display device 102 may be configured to perform scanning by turning off the backlight 179 and then performing scanning again by turning on the backlight 179.

  In this case, since two scanning methods are used together, two scan data can be obtained. Therefore, it is possible to obtain a highly accurate result as compared with the case of scanning using only one scanning method.

<About hardware configuration-2>
Next, an aspect of a specific configuration of the electronic device 200 will be described. FIG. 13 is a block diagram illustrating a hardware configuration of electronic device 200. Referring to FIG. 13, electronic device 200 includes a main device 201 and a display device 202 as main components.

  The main body device 201 includes a CPU 210, a RAM 271, a ROM 272, a CD-ROM drive device 273, a communication IF 274, a microphone 275, a speaker 276, an operation key 277, and an HDD (Hard disk drive) 299. Each component is connected to each other by a data bus DB2. A CD-ROM 2731 is attached to the CD-ROM drive 273.

  The CPU 210 executes a program. The operation key 277 receives an instruction input from the user of the electronic device 200. The RAM 271 volatilely stores data generated by execution of a program by the CPU 210 or data input via the operation keys 277. The ROM 272 stores data in a nonvolatile manner. The communication IF 274 is an interface for connecting to another electronic device by wire. For example, the electronic device 200 can perform wireless communication by connecting a wireless communication device to the communication IF 274. HDD 299 stores the program and data generated by execution of the program by CPU 210 in a nonvolatile manner.

  The display device 202 includes a driver 230, an optical sensor built-in liquid crystal panel 240, an internal IF 278, a backlight 279, and an image processing engine 280. Further, the image processing engine 280 includes a driver control unit 281, a timer 282, and a signal processing unit 283.

  The display device 202 has substantially the same configuration as the display device 102 of the electronic device 100 except that the number of pixels, the number of scanning signal lines and data signal lines, the size of the backlight, and the like in the liquid crystal panel with a built-in optical sensor are different. Have.

  That is, the driver 230, the optical sensor built-in liquid crystal panel 240, the internal IF 278, the backlight 279, and the image processing engine 280 are the same as the driver 130, the liquid crystal panel 140, the internal IF 178, the backlight 179, and the image processing engine 180 in the display device 102. Each has a configuration. The driver control unit 281, the timer 282, and the signal processing unit 283 have the same configurations as the driver control unit 181, the timer 182, and the signal processing unit 183 in the display device 102, respectively.

  Therefore, description of each functional block included in display device 202 will not be repeated.

  By the way, the processing in the electronic device 200 is realized by each hardware and software executed by the CPU 210. Such software may be stored in advance in the ROM 272 or the HDD 299. The software may be stored in a CD-ROM 2731 or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the CD-ROM drive 273 or other reading device, or downloaded via the communication IF 274 or a communication unit (not shown), and then temporarily stored in the ROM 272 or the HDD 299. . The software is read from the ROM 272 or the HDD 299 by the CPU 210 and stored in the RAM 271 in the form of an executable program. CPU 210 executes the program.

  Each component constituting the main device 201 of the electronic device 200 shown in FIG. 13 is a general one. Therefore, it can be said that the essential part of the present invention is the software stored in the RAM 271, the ROM 272, the HDD 299, the CD-ROM 2731 and other storage media, or the software that can be downloaded via the network. Since the hardware operation of main device 201 of electronic device 200 is well known, detailed description will not be repeated.

  The recording medium is not limited to a CD-ROM, but is a memory card, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile). Disc)), IC (Integrated Circuit) cards (excluding memory cards), optical cards, mask ROM, EPROM (Electronically Programmable Read-Only Memory), EEPROM (Electronically Erasable Programmable Read-Only Memory), flash ROM, and other semiconductor memories A medium for storing the program in a fixed manner may be used.

  The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

  In this embodiment, a liquid crystal panel is described as an example of the display device of electronic device 200, but another panel such as an organic EL panel may be used instead of the liquid crystal panel.

<Details of hardware configuration>
Next, details of the hardware configuration of the image processing engine 180 of the electronic device 100 will be described. FIG. 14 is a diagram illustrating details of the hardware configuration of the image processing engine 180 and peripheral blocks of the image processing engine 180. In FIG. 14, only the CPU 110 is shown in each block of the main device 101, and other members are not shown. In FIG. 14, the internal IF 178 and the backlight 179 in the display device 102 are not shown.

  Referring to FIG. 14, the driver control unit 181 of the image processing engine 180 includes a transmission controller 1811, a VRAM (Video RAM) 1812, and a ROM 1813.

  The VRAM 1812 is a frame buffer. That is, the VRAM 1812 stores image data for one frame to be displayed on the liquid crystal panel 140. Specifically, the VRAM 1812 stores image data sent from the CPU 110. The transmission controller 1811 transmits the image data stored in the VRAM 1812 to the driver 130. As described above, an image can be displayed on the liquid crystal panel 140. The ROM 1813 stores in advance information necessary for bidirectional communication such as device information described later.

  The signal processing unit 183 includes an A / D converter 1831, a reception controller 1832, and a VRAM 1833.

  The A / D converter 1831 converts data (analog data) output from the optical sensor circuit 144 into digital data. Then, the digital data is sequentially stored in the VRAM 1833 which is a frame buffer by the reception controller 1832. The image data (scan data) stored in the VRAM 1833 is sent to the CPU 110 by the signal processing unit 183.

Note that the VRAM 1812 and the VRAM 1833 may be configured by one VRAM.
Also, the image processing engine 280 of the electronic device 200 has the same configuration as the image processing engine 180 of the electronic device 100. Therefore, description of image processing engine 280 will not be repeated.

<Functional Block of Card Type Electronic Device 100>
Next, functional blocks of the electronic device 100 will be described. FIG. 15 is a functional block diagram showing functional blocks of the electronic device 100.

  Referring to FIG. 15, electronic device 100 includes a liquid crystal panel 140, a control unit 10, a storage device 49, and operation keys 177. The storage device 49 corresponds to the RAM 171 and the ROM 172 shown in FIG. In FIG. 15, the CPU 110, the memory card reader / writer 173, the communication unit 174, the microphone 175, and the speaker 176 are not shown for convenience of explanation.

  The control unit 10 controls various operations in the electronic device 100. The control unit 10 includes a display control unit 11, a reception unit 12, a setting unit 13, a determination unit 14, and an invalidation unit 15. The display control unit 11 includes a VRAM update unit 11A and a VRAM scanning unit 11B. Note that the processing by the control unit 10 and each functional block in the control unit 10 is realized by software executed by the CPU 110 as described above.

Here, each functional block of the control unit 10 will be described.
The display control unit 11 displays an image on the display surface of the liquid crystal panel 140 in accordance with an instruction from the user via the operation key 177, an instruction from the reception unit 12, or the like. The display control unit 11 causes the liquid crystal panel 140 to roughly display a communication image used for communication with the electronic device 200 and a non-communication image (hereinafter referred to as “display image”). Hereinafter, a state in which the display surface of the electronic device 100 and the display surface of the electronic device 200 face each other is referred to as an “opposing state”.

  When transmitting data to the electronic device 200 in the facing state, the display control unit 11 displays the data on the display surface of the liquid crystal panel 140 of the device 100 as an image. In this case, the electronic device 200 receives data displayed as an image on the display surface of the liquid crystal panel 140 of the electronic device 100 via the optical sensor of the own device 200.

  Specifically, when the display control unit 11 receives a predetermined input via the operation key 177 or the like or receives a predetermined input via the liquid crystal panel 140, the information stored in the storage device 49 (for example, Then, communication data (for example, data including a communication request signal and device information described later) is generated based on a communication data format described later. Then, the display control unit 11 displays the read communication data on the liquid crystal panel 140 as an image.

  When the receiving unit 12 receives the first data transmitted from the electronic device 200, the display control unit 11 reads device information from the storage device 49. Then, the display control unit 11 displays the data including the read device information as an image on the display surface of the own device. The device information includes at least size information of the display surface of the own device 100 and position information about a communication area of the own device 100 used for transmission / reception of the data on the display surface. Details of the device information will be described later.

  In addition, when the receiving unit 12 receives the second data from the electronic device 200, the display control unit 11 displays region information indicating a region where the data can be transmitted and received from the storage device 49 on the display surface of the own device 100. read out. Then, the display control unit 11 displays the data including the read area information as an image on the display surface of the own device. The area information will be described later.

  Further, the display control unit 11 reads the reference signal and the data signal stored in the storage device 49, and causes the liquid crystal panel 140 to display the read reference signal and data signal as an image.

  In addition, the display control unit 11 divides the data to be transmitted into a plurality of frames and displays the data on the display surface of the liquid crystal panel 140 of the electronic device 100 as an image. At this time, the display control unit 11 displays a plurality of reference signals for synchronizing with the electronic device 200 as an image on the display surface of the liquid crystal panel 140 of the device 100 when transmitting the data signal. Further, the display control unit 11 sets the plurality of reference signals to the same display mode in each frame, and sets the reference signal to a different display mode for each frame in at least two consecutive frames of the plurality of frames. The frame reference signal, the data signal, and the reference signal are displayed on the display surface of the electronic device 100 in this order.

  Note that details of display contents displayed on the liquid crystal panel 140 by the display control unit 11 will be described later.

  The VRAM update unit 11 </ b> A updates the data stored in the VRAM 1812. The update timing will be described later.

  The VRAM scanning unit 11B scans data stored in the VRAM 1812. This scanning will also be described later.

  The display control unit 11 does not necessarily include the VRAM update unit 11A and the VRAM scanning unit 11B, and the control unit 10 may include the VRAM update unit 11A and the VRAM scanning unit 11B.

  The receiving unit 12 receives the data displayed as an image on the display surface of the liquid crystal panel 240 of the electronic device 200 in the facing state via the photosensor circuit 144 of the own device 100. Specifically, the receiving unit 12 performs communication control (for example, described later) output from the electronic device 200 by controlling the optical sensor circuit 144 to sense an image displayed on the liquid crystal panel 240 by the electronic device 200. Communication parameters). When the receiving unit 12 receives communication data from the electronic device 200, the control unit 10 performs processing based on the received data.

  Further, the receiving unit 12 analyzes data received from the electronic device 200 via the liquid crystal panel 140.

  More specifically, data to be transmitted by the electronic device 200 in the opposite state is divided into a plurality of frames. The electronic device 200 displays the data divided into frames as an image on the display surface of the liquid crystal panel 240. The receiving unit 12 receives the data via the optical sensor of the electronic device 100. The electronic device 200 displays a reference signal together with the data signal in order to synchronize with the electronic device 100 when transmitting the data signal. The receiving unit 12 receives the reference signal via the optical sensor of the electronic device 100.

  Here, the region of the display surface of the electronic device 100 that faces the display surface of the electronic device 200 when transmitting and receiving data is referred to as a “first region S1”. The setting unit 13 sets a communication area used for data transmission / reception in the first area S1. A specific example regarding the setting of the range of the communication area will be described later.

  As described above, the electronic device 100 displays the image displayed by the electronic device 200 with the display surface of the liquid crystal panel 240 of the electronic device 200 and the display surface of the liquid crystal panel 140 of the electronic device 100 facing each other. And receiving the image via the optical sensor circuit 144 via the optical sensor circuit 144, and detecting the image displayed by the display control unit 11 using the optical sensor circuit 144 of the electronic device 200, thereby bidirectional communication with the electronic device 200. I do.

  Hereinafter, the fact that the display control unit 11 of the electronic device 100 displays an image on the display surface of the liquid crystal panel 140 for communication with the electronic device 200 is also referred to as “data transmission”.

  The determination unit 14 determines whether or not the reference signals before and after the data signal are in the same display mode in the data for one frame received by the reception unit 12.

  When the determination unit 14 determines that the display mode is not the same, the invalidation unit 15 invalidates the received data signal.

<Functional Block of Stationary Electronic Device 200>
Next, functional blocks of the electronic device 200 will be described. FIG. 16 is a functional block diagram showing functional blocks of the electronic device 200.

  Referring to FIG. 16, electronic device 200 includes a liquid crystal panel 240, a control unit 50, a storage device 99, and operation keys 277. The storage device 99 corresponds to the RAM 271, ROM 272, and HDD 299 shown in FIG. In FIG. 16, the CPU 210, the CD_ROM drive device 273, the communication IF 274, the microphone 275, and the speaker 276 are not shown for convenience of explanation.

  The control unit 50 controls various operations in the electronic device 200. Further, the control unit 50 includes a display control unit 51, a reception unit 52, a first determination unit 53, a setting unit 54, an authentication unit 55, a parameter determination unit 56, a second determination unit 57, and an invalidation. Part 58. The display control unit 51 includes a VRAM updating unit 51A and a VRAM scanning unit 51B. The first determination unit 53 includes a detection unit 53A and a position information update unit 53B. Note that the control unit 50 and the processing by the functional blocks in the control unit 50 are realized by software executed by the CPU 210 as described above.

Here, each functional block of the control unit 50 will be described.
The display control unit 51 displays an image on the display surface of the liquid crystal panel 240 in accordance with an instruction from the user via the operation key 277, an instruction from the reception unit 52, or the like. The display control unit 51 causes the liquid crystal panel 240 to roughly display a communication image used for bidirectional communication with the electronic device 100 and a display image.

  When transmitting data to the electronic device 100 in the facing state, the display control unit 51 displays the data on the display surface of the liquid crystal panel 240 of the device 200 as an image. In this case, the electronic device 100 receives the data displayed as an image on the display surface of the liquid crystal panel 240 of the electronic device 200 via the optical sensor of the own device 100.

  Further, the display control unit 51 reads the reference signal and the data signal stored in the storage device 99, and causes the liquid crystal panel 240 to display the read reference signal and the data signal as an image.

  In addition, the display control unit 51 divides data to be transmitted into a plurality of frames and displays the data on the display surface of the liquid crystal panel 240 of the electronic device 200 as an image. At this time, the display control unit 51 displays a plurality of reference signals for synchronization with the electronic device 100 as images on the display surface of the liquid crystal panel 240 of the electronic device 200 when transmitting the data signal. Furthermore, the display control unit 51 sets the plurality of reference signals to the same display mode in each frame, and sets the reference signal to a different display mode for each frame in at least two consecutive frames of the plurality of frames. The frame reference signal, the data signal, and the reference signal are displayed on the display surface of the electronic device 200 in this order.

  The details of the display contents that the display control unit 51 displays on the liquid crystal panel 240 will be described later.

  The VRAM update unit 51A updates data stored in a VRAM (not shown) of the driver control unit 281. That is, the VRAM update unit 51A has the same function as the VRAM update unit 11A of the electronic device 100.

  The VRAM scanning unit 51B scans data stored in the VRAM of the driver control unit 281. That is, the VRAM scanning unit 51B has the same function as the VRAM scanning unit 11B of the electronic device 100.

  Note that the display control unit 51 does not necessarily include the VRAM update unit 51A and the VRAM scanning unit 51B, and the control unit 50 may include the VRAM update unit 51A and the VRAM scanning unit 51B.

  The receiving unit 52 receives data displayed as an image on the display surface of the liquid crystal panel 140 of the electronic device 100 in an opposing state via the optical sensor of the own device 200. Specifically, the receiving unit 52 receives communication data output from the electronic device 100 by performing control that causes the optical sensor circuit to sense an image displayed on the liquid crystal panel 140 by the electronic device 100. When the receiving unit 52 receives communication data from the electronic device 100, the control unit 50 performs processing based on the received data.

The receiving unit 52 analyzes data received via the liquid crystal panel 240.
More specifically, the data to be transmitted by the electronic device 100 in the opposite state is divided into a plurality of frames. The electronic device 100 displays the data divided into frames as an image on the display surface of the liquid crystal panel 140. The receiving unit 52 receives the data via the optical sensor of the electronic device 200. The electronic device 100 displays a reference signal together with the data signal in order to synchronize with the electronic device 200 when transmitting the data signal. The receiving unit 52 receives the reference signal via the optical sensor of the electronic device 200.

  Here, the area of the display surface of the device 200 that faces the display surface of the electronic device 100 when data is transmitted and received is referred to as a “first region L1” of the electronic device 200. In addition, an area different from the first area L1 on the display surface of the device 200 is referred to as a “second area L2”. The first determination unit 53 indicates the position of the received device information (specifically, size information described later) and the communication area of the own device 200 used for receiving the data on the display surface of the own device 200. Based on the information, the position of the second region L2 is determined. The position information will be described later.

  53 A of detection parts detect the change of the position of the area | region used for reception of the said data among the display surfaces of the own apparatus 200. FIG.

  The position information update unit 53B updates the position information indicating the position of the second region L2 based on the detection result of the detection unit 53A.

  By performing detection and update in this way, even if the first determination unit 53 once determines the position of the second region L2, the position of the display surface of the electronic device 100 relative to the display surface of the electronic device 200 is determined. When the change occurs, the first determination unit 53 can determine the position of the second region L2 again.

The timing for updating the position information will be described later (FIG. 61).
The setting unit 54 sets a communication area used for bidirectional communication in the first area L1. A specific example regarding the setting of the range of the communication area will be described later.

  The authentication unit 55 performs authentication based on communication data (authentication data) received from the electronic device 100. If the authentication is successful, the electronic device 200 controls the operation of another device (not shown). For example, a building gate is changed from a closed state to an open state. When the authentication is successful, the receiving unit 52 transmits an authentication result indicating that the authentication is successful to the electronic device 100 via the liquid crystal panel 240. On the other hand, if the authentication fails, an authentication result indicating that the authentication has failed is transmitted to the electronic device 100 via the liquid crystal panel 240.

  The parameter determination unit 56 determines communication parameters used for transmission / reception of the data based on the device information received from the electronic device 100. Specifically, the parameter determination unit 56 determines communication parameters at the time of main communication, which will be described later. Details of the communication parameters will be described later (FIG. 46).

  As described above, the electronic device 200 displays the image displayed by the electronic device 100 with the display surface of the liquid crystal panel 140 of the electronic device 100 facing the display surface of the liquid crystal panel 240 of the own device 200. The image data received by the receiving unit 52 via the optical sensor and the image displayed by the display control unit 51 is detected by the optical sensor circuit 144 of the electronic device 100, thereby performing bidirectional communication with the electronic device 100. .

  Hereinafter, the display control unit 51 of the electronic device 200 displaying an image on the display surface of the liquid crystal panel 240 for communication with the electronic device 100 is also referred to as “data transmission”.

  The second determination unit 57 determines whether or not the reference signals before and after the data signal are in the same display mode in the data for one frame received by the reception unit 52. That is, the second determination unit 57 has the same function as the determination unit 14 of the electronic device 100.

  When the second determination unit 57 determines that the display modes are not the same, the invalidation unit 58 invalidates the received data signal. That is, the invalidation unit 58 has the same function as the invalidation unit 15 of the electronic device 100.

  The specific processing content in the second determination unit 57 and the specific processing content in the invalidation unit 58 will be described later.

<Outline of certification>
Here, an outline of authentication in the communication system 1 will be described. Authentication in the communication system 1 is performed in a facing state. Specifically, the authentication is performed by performing bidirectional communication (data transmission / reception) between the electronic device 100 and the electronic device 200. Here, it is preferable that the display surfaces of the electronic device 100 and the electronic device 200 are in close contact with each other so that external light does not enter the display surfaces in the facing regions. Data transmitted and received by bidirectional communication will be described later.

FIG. 17 is a transition diagram showing a transition of contents displayed on the liquid crystal panel 140 at the time of authentication.
First, when the authentication start button is pressed by the user of the electronic device 100, the control unit 10 initializes the system of the own device 100, and then the liquid crystal panel 140 displays that the authentication is started as shown in FIG. . For example, as shown in FIG. 17, the liquid crystal panel 140 displays “Authenticate”.

  Thereafter, when the authentication is successful, the display control unit 11 displays on the liquid crystal panel 140 that the authentication is successful. On the other hand, if the authentication fails, the display control unit 11 causes the liquid crystal panel 140 to display that the authentication has failed. If a communication error occurs during communication with the electronic device 200 during authentication, the display control unit 11 displays on the liquid crystal panel 140 that a communication error has occurred.

FIG. 18 is a transition diagram showing a transition of contents displayed on the liquid crystal panel 240 at the time of authentication.
First, in a state where the electronic device 200 is waiting to receive a communication request signal from the electronic device 100, when the electronic device 200 detects a human approach with a sensor (illustrated) or the like, a display indicating that authentication is started is displayed. For example, as shown in FIG. 18, the liquid crystal panel 240 displays “Authentication is performed.

  Thereafter, when the electronic device 200 receives a communication request signal from the electronic device 100, the liquid crystal panel 240 displays a message indicating that the authentication is being executed. When the authentication is successful, the liquid crystal panel 240 displays that the process to be executed with the successful authentication is started. For example, as shown in FIG. 18, the liquid crystal panel 240 displays “door opens”. On the other hand, if the authentication fails, the liquid crystal panel 240 displays a message indicating that the authentication has failed. If a communication error occurs during communication with the electronic device 100 during authentication, the liquid crystal panel 240 displays that a communication error has occurred.

  Thus, electronic device 100 and electronic device 200 display a message for the user on the display surface of each liquid crystal panel (140, 240) during authentication. Details of the position where the liquid crystal panel 240 of the electronic device 200 displays the message will be described later.

  As described above, the user of the electronic device 100 can check the authentication status on the liquid crystal panel 240 of the electronic device 200 and the liquid crystal panel 140 of the electronic device 100. Further, the authentication status is displayed in characters or the like as shown in FIGS. Therefore, the user can easily visually recognize the authentication status as compared with the communication system configured to simply indicate the authentication status by color. In addition, since a sensor (that is, an optical sensor) used for authentication is built in a liquid crystal panel that is a display device, the user can easily view the authentication status as compared to a communication system in which the sensor and the display device are separate. Further, since authentication is performed in the facing state, it is possible to prevent others from eavesdropping. Furthermore, for the same reason, the communication system 1 is less likely to cause communication failures.

<Outline of data transmission / reception>
FIG. 19 is a diagram for explaining a data flow when data is transmitted / received in a state where the display surface of the liquid crystal panel 140 of the electronic device 100 and the display surface of the liquid crystal panel 240 of the electronic device 200 face each other. It is.

  Referring to FIG. 19, in electronic device 100, first, image data stored in storage device 49 (specifically, VRAM 1812 shown in FIG. 14) is displayed on liquid crystal panel 140. In this state, the user of the electronic device 100 causes the display surface of the electronic device 100 and the display surface of the electronic device 200 to face each other. The electronic device 200 performs the sensing described above. Since the electronic device 200 is configured to include the optical sensor circuit 144 for each pixel (unit pixel), the optical sensor circuit 144 can detect the amount of light received through the color filter 153b for each pixel. Therefore, the storage device 99 (specifically, the VRAM 1833 shown in FIG. 14) of the electronic device 200 stores image data of an image that is substantially the same as the image displayed on the display surface by the electronic device 100.

  Here, when data (hereinafter referred to as a data signal) is transmitted from one electronic device (for example, electronic device 100) to the other electronic device (for example, electronic device 200), the electronic device on the transmission side and the electronic device on the reception side It is preferable to use a signal (hereinafter referred to as a “reference signal”) for synchronizing with 200.

  The reason for this is as follows. Even if the reference signal is not used, data transmission / reception can be performed by fixing the data transmission / reception timing. However, there arises a problem that the communication speed is determined. Further, when electronic devices having various communication speeds are mixed in the communication system 1, there arises a compatibility problem that data cannot be transmitted / received between the electronic devices. The reason for using the reference signal in addition to the data signal is to prevent such a problem.

  For this reason, the electronic device 100 and the electronic device 200 perform bidirectional communication using the reference signal and the data signal.

  By the way, when the reference signal and the data signal are used, the receiving-side electronic device needs to distinguish between the two signals. As an example of the distinction method, for example, an arrangement for displaying the reference signal on the upper side of the data signal may be performed in advance between the electronic device 100 and the electronic device 200. FIG. 20 is a diagram illustrating a configuration in which the reference signal is displayed on the upper side of the data signal. By making such an arrangement, the electronic device 100 and the electronic device 200 can distinguish between two signals sent from the transmission-side electronic device, regardless of which is the reception-side electronic device. .

  FIG. 21 is a diagram showing a pattern of combinations of the reference signal and the data signal when the above arrangement is made. Referring to FIG. 21, when the reference signal is not displayed (left column), the data signal is not displayed (upper column), and the data signal is displayed (lower column). There is. Similarly, when the reference signal is displayed (right column), there are a case where the data signal is not displayed (upper column) and a case where the data signal is displayed (lower column). That is, there are four display combinations of the reference signal and the data signal.

  However, when the arrangement for displaying the reference signal above the data signal is performed as described above, the following problems occur. FIG. 22 shows a state where the display surface of the transmission-side electronic device (here, the electronic device 100) is opposed to the display surface of the reception-side electronic device 90 from a predetermined position. It is the figure which showed the arrangement | sequence of the said 2 signal which the electronic device (here electronic device 200) of the receiving side in the case of making it rotate degree.

  Referring to FIG. 22, in electronic device 200 on the receiving side, when the sensing is performed, a reference signal and a data signal are detected side by side in the horizontal direction. For this reason, the electronic device 200 cannot distinguish between the reference signal and the data signal even if the arrangement for displaying the reference signal on the upper side of the data signal is performed as described above.

In order to solve such problems, the following methods can be employed.
The first method is a method in which the size of the area for displaying the reference signal is different from the size of the area for displaying the data signal. FIG. 23 is a diagram illustrating the reference signal and the data signal when the size of the region for displaying the reference signal is larger than the size of the region for displaying the data signal. Note that FIG. 23 shows a configuration in which the reference signal is displayed on the upper side of the data signal. However, in this method, the reference signal and the data signal can be distinguished in the electronic device on the receiving side. The positional relationship with the signal is not limited to this. The positional relationship is not limited, and the same applies to other methods described below.

  The second method is a method in which the shape of the area for displaying the reference signal is different from the shape of the area for displaying the data signal. FIG. 24 is a diagram illustrating the reference signal and the data signal when the area for displaying the reference signal is rectangular and the area for displaying the data signal is circular.

  The third method is a method of making the gradation of the area displaying the reference signal different from the gradation of the area displaying the data signal. FIG. 25 is a diagram illustrating the reference signal and the data signal when the gray level of the region displaying the reference signal is higher than the gray level of the region displaying the data signal.

  The fourth method is a method of making the color (luminance) of the region displaying the reference signal different from the color (luminance) of the region displaying the data signal. FIG. 26 is a diagram showing the reference signal and the data signal when the color of the area for displaying the reference signal is red and the color of the area for displaying the data signal is blue.

  By using the four methods described above, it is possible to accurately distinguish the reference signal and the data signal in the electronic device on the receiving side.

<Data transmission / reception timing>
Next, data transmission / reception timing when performing bidirectional communication between the electronic device 100 and the electronic device 200 will be described. Hereinafter, for convenience of explanation, the data transmission side is described as the electronic device 100 and the data reception side is described as the electronic device 200. Since the same applies to the case where the data transmission side is the electronic device 200 and the data reception side is the electronic device 100, the description will not be repeated.

  First, the operation of the electronic device 100 on the transmission side will be described. FIG. 27 is a timing chart showing the output timing of the reference signal and the data signal. Specifically, FIG. 27 is a timing chart in the case of transmitting a binary number “10101100” (C9 in hexadecimal notation). In this case, the display control unit 11 causes the liquid crystal panel 140 to display the reference signal and the data signal as an image in synchronization with the timing shown in FIG. The data signal to be transmitted is an example, and is not limited to “10101100”.

  In transmitting the data signal “10101100”, the display control unit 11 sets the output of the reference signal and the data signal to the high level “1” until the time 2t1 elapses after the reference signal is set to the high level “1”. When the time 2t1 has elapsed, the display control unit 11 sets the output of the reference signal to the low level “0” for the time t2. Thereafter, the display control unit 11 switches the output of the reference signal between the high level and the low level at an interval of time t2.

  The display control unit 11 outputs a data signal to be transmitted in synchronization with switching of the output level of the reference signal. For example, when the output of the reference signal is switched to a low level after the time 2t1 has elapsed, the display control unit 11 outputs the first “1” of “10101100”. Thereafter, the display control unit 11 sequentially outputs “0”, “1”, “0”, “1”, “1”, “0”, “0” at intervals of time t2.

  By outputting the reference signal and the data signal, a 9-digit signal “110101100” including the data signal “1” until the time 2t1 elapses and the 8-digit data signal “10101100” to be transmitted. An image based on the above is displayed on the liquid crystal panel 140.

  Next, the operation of the receiving-side electronic device 200 will be described. First, the electronic device 200 stands by until the reference signal and the data signal displayed on the liquid crystal panel 140 of the electric device 100 become high level “1”. When the receiving unit 52 detects that both the reference signal and the data signal are at the high level “1” by sensing the liquid crystal panel 240, the receiving unit 52 determines the reference signal and the data signal. Since this determination method follows the description based on FIGS. 20 and 23 to 26, the description will not be repeated here.

  When the receiving unit 52 detects that both the reference signal and the data signal are not at the high level “1” after the time t1 has elapsed since it has been detected that both the reference signal and the data signal have become the high level “1”, The electronic device 200 stands by until the reference signal and the data signal become high level “1”.

  When the receiving unit 52 detects that the reference signal has been switched from the high level “1” to the low level “0”, the receiving unit 52 stores the data signal immediately after detecting the switching in the storage device 99. Remember. In the case of FIG. 27, the data signal “1” at the first time t2 is stored. Thereafter, each time the receiving unit 52 detects the switching of the output of the reference signal, the data signal immediately after the switching is detected is stored in the storage device 99.

  When the reception unit 52 performs such processing, the storage device 99 of the electronic device 200 stores 8-digit data such as “10101100”. Thereby, transmission / reception of data between the electronic device 100 and the electronic device 200 can be performed.

  Here, sampling of the reference signal and the data signal by the receiving unit 52 in the receiving-side electronic device 200 will be described. Sampling of the reference signal and the data signal by the receiving unit 52 is performed at a predetermined interval. This sampling interval is not limited to t2 described above, and may be an interval shorter than t2.

  In this case, for example, the data signal may be sampled a plurality of times during the period in which the reference signal maintains the low level “0”. In this case, the receiving unit 52 detects signals such as “0, 1” and “0, 1” as a set of the reference signal and the data signal. In such a case, since the reference signal is not switched, the reception unit 52 invalidates the second sampling result “0, 1” and validates only the first sampling result “0, 1”. To do. Then, the receiving unit 52 stores the data signal in the storage device 99 among the set of the valid reference signal and data signal.

  With such a configuration, accurate data transmission / reception can be performed between the electronic device 100 and the electronic device 200.

<Flowchart of communication system>
Next, a communication flow between the electronic device 100 and the electronic device 200 will be described. FIG. 28 is a flowchart of communication between the electronic device 100 and the electronic device 200.

  First, when a key for starting authentication (hereinafter referred to as an authentication start key) among the operation keys 177 of the electronic device 100 is pressed, the electronic device 100 displays the communication request signal on the liquid crystal panel 140, thereby A communication request signal is transmitted to the electronic device 200 (S1). After step S1, when the electronic device 200 receives a communication request signal via the liquid crystal panel 240, the electronic device 200 transmits a READY signal to the electronic device 100 via the liquid crystal panel 240 (S2). After step S2, when the electronic device 100 receives the READY signal, the electronic device 100 transmits data including the device information of the own device 100 to the electronic device 200 (S3). When the electronic device 200 receives the device information, the electronic device 200 transmits data including communication parameters generated based on the device information to the electronic device 100 (S4). Hereinafter, transmission / reception of data from step S1 to step S4 is referred to as “initial communication”.

  After step S5, the electronic device 100 and the electronic device 200 perform communication based on the communication parameters. First, the electronic device 100 transmits an authentication request signal to the electronic device 200 (S5). When the electronic device 200 receives the authentication request signal, the electronic device 200 performs processing necessary for authentication. When the electronic device 200 is ready for authentication, the electronic device 200 transmits to the electronic device 100 an authentication preparation completion signal indicating that preparation for authentication has been completed (S6).

  When the electronic device 100 receives the authentication preparation completion signal, the electronic device 100 transmits data including authentication information to the electronic device 200 (S7). When the electronic device 200 receives the data including the authentication information, the electronic device 200 performs authentication using the authentication information. When the authentication is completed, the electronic device 200 transmits an authentication result to the electronic device 100 (S8). Thus, a series of processing ends.

<Display contents in initial communication and this communication>
Next, the display content of the display surface of the electronic device 100 and the display content of the display surface of the electronic device 200 during the initial communication and the main communication in the flowchart shown in FIG. 28 will be described.

  FIG. 29 is a diagram illustrating display contents on the display surface of the liquid crystal panel 140 of the electronic device 100 after the authentication start key of the electronic device 100 is pressed. Referring to FIG. 29, electronic device 100 displays on the display surface of liquid crystal panel 140 a display for starting authentication, a reference signal, and a data signal.

  FIG. 30 is a diagram showing the display contents of the display surface of the liquid crystal panel 240 of the electronic device 200 after the electronic device 200 transmits the READY signal, and the display surface of the electronic device 100 is displayed on the display of the electronic device 200. It is the figure which showed the state made to oppose the surface. Referring to FIG. 30, electronic device 200 displays content for guiding the user of electronic device 100 on the display surface of liquid crystal panel 240.

  FIG. 31 is a diagram showing display contents on the display surface of electronic device 100 when an authentication request signal is transmitted. Referring to FIG. 31, the reference signal and the data signal are displayed on the upper side of the display surface. A data input area is formed by the control unit 10 below the display surface.

  In the initial communication, one data signal is displayed on the liquid crystal panel 140, but in the main communication, one or more data signals are displayed on the liquid crystal panel. Note that the number of data signals during the communication will be described later. The number of reference signals during initial communication and main communication will also be described later.

  FIG. 32 is a diagram showing display contents on the display surface of the liquid crystal panel 240 of the electronic device 200 after the electronic device 200 receives the authentication information (or after transmitting the authentication preparation completion signal), and 2 is a diagram showing a state in which a display surface of electronic device 100 is opposed to a display surface of electronic device 200. FIG. Referring to FIG. 32, electronic device 200 displays on the display surface of liquid crystal panel 240 that authentication is being performed.

  FIG. 33 is a diagram showing the contents displayed on the display surface of the liquid crystal panel 140 of the electronic device 100 when the authentication is successful. Referring to FIG. 33, electronic device 100 displays content indicating that the authentication has been successful on the display surface.

  FIG. 34 is a diagram showing contents displayed on the display surface of the liquid crystal panel 240 of the electronic device 200 when the authentication is successful. Referring to FIG. 34, electronic device 200 displays on the display surface the contents indicating the operation performed when authentication is successful.

<Screen configuration>
Next, the screen configuration of the display surface of the electronic device 100 and the screen configuration of the display surface of the electronic device 200 will be described. Hereinafter, for convenience of explanation, it is assumed that one pixel has a square shape of 1 mm × 1 mm.

  FIG. 35 is a diagram showing a screen configuration of the display surface of electronic device 100. Referring to FIG. 35, the size of an area of electronic device 100 (hereinafter referred to as a communicable region) that can be used for communication with electronic device 200 is a vertical size (dLY) of 100 mm, and a horizontal size ( dLX) is 150 mm. The resolution of the communicable area is 100 pixels in the vertical size (dH) and 150 pixels in the horizontal size (dW).

  FIG. 36 is a diagram illustrating a screen configuration of the display surface of the electronic device 200. Referring to FIG. 36, the size of the communicable area of electronic device 200 that can be used for communication with electronic device 100 is 300 mm in the vertical size and 400 mm in the horizontal size. The resolution of the communicable area is 300 pixels in the vertical size and 400 pixels in the horizontal size.

  Each size shown in FIG. 35 and FIG. 36 is an exemplification, and is not limited to the size.

  Next, a format of communication data transmitted / received between the electronic device 100 and the electronic device 200 will be described.

  FIG. 37 is a diagram showing a format of communication data. Referring to FIG. 37, the communication data includes a data area DA21 indicating a command, a spare data area DA22, a parity bit DA23, and a data area DA24 indicating data.

  FIG. 38 is a diagram showing codes written in the data area DA21 indicating the commands of FIG. 37 and the meanings indicated by the respective codes. As shown in FIG. 38, for example, communication data in which “0010” is set in the data area DA21 is interpreted as a signal indicating device information in the electronic device on the receiving side.

(Screen configuration during initial communication)
Next, the screen configuration of the display surface of the electronic device 100 and the screen configuration of the display surface of the electronic device 200 during initial communication will be described.

  FIG. 39 is a diagram showing a screen configuration of the display surface of electronic device 100 during initial communication. Referring to FIG. 39, the display surface of electronic device 100 includes a display area and a communication area. In the communication area, a reference signal and a data signal are displayed. The communication area is included in the above-described communicable area.

  During initial communication, one data signal is displayed on the display surface per unit time. In the initial communication, two reference signals are displayed on the display surface. This is an example, and the numbers of data signals and reference signals are not limited to the above numbers.

  The communication area of the electronic device 100 includes three pixel areas (hereinafter referred to as “pixel blocks”) configured by 25 pixels vertically × 25 pixels horizontally. Of the three pixel blocks, the uppermost pixel block BL_A1 and the lowermost pixel block BL_A2 are used for outputting a reference signal. The middle pixel block BL_A3 is used for outputting a data signal. Further, the positions of these three pixel blocks are predetermined in the electronic device 100. Note that the size of one pixel block is not limited to 25 pixels × 25 pixels.

  In the following, in the electronic device 100, the reference signal output using the top pixel block is referred to as “reference signal S_A1”, and the reference signal output using the bottom pixel block is referred to as “reference signal”. This is referred to as signal S_A2. Furthermore, a data signal output using the middle pixel block BL_A3 is referred to as a “data signal D_A1”.

  Further, a region (25 pixels wide × 75 pixels high) obtained by combining the regions of the pixel blocks (BL_A1 to BL_A3) is referred to as a “first communication region SV”.

  FIG. 40 is a diagram showing a screen configuration of the display surface of electronic device 200 at the time of initial communication. Referring to FIG. 40, the display surface of electronic device 200 includes a display area and a communication area. In the communication area, a reference signal and a data signal are displayed. The communication area is included in the above-described communicable area.

  The communication area of the electronic device 200 has the same size as the communication area of the electronic device 100. That is, the communication area of the electronic device 200 includes three pixel blocks (a pixel area composed of 25 pixels vertically × 25 pixels horizontally). Of the three pixel blocks, the uppermost pixel block BL_B1 and the lowermost pixel block BL_B2 are used for outputting a reference signal. The middle pixel block BL_B3 is used for outputting a data signal.

  In such a communication system 1, the reference signal and the data signal output from the electronic device 100 using the communication region of the own device 100 are used, and the optical sensor in the pixel included in the communication region of the own device 200 is used by the electronic device 200. Receive using a circuit. Further, the electronic device 100 receives the reference signal and the data signal output from the electronic device 200 using the communication area of the own device 200 using the photosensor circuit in the pixel included in the communication region of the own device 100.

  Hereinafter, in the electronic device 200, the reference signal output using the uppermost pixel block BL_B1 is referred to as “reference signal S_B1”, and the reference signal output using the lowermost pixel block BL_B2 is referred to as “reference signal S_B1”. This is referred to as “reference signal S_B2.” Further, a data signal output using the middle pixel block BL_B3 is referred to as a “data signal D_B1”.

  Further, a region (25 pixels wide × 75 pixels high) obtained by combining the regions of the pixel blocks (BL_B1 to BL_B3) is referred to as a “first communication region LV”.

(Screen configuration during this communication)
Next, the screen configuration of the display surface of the electronic device 100 and the screen configuration of the display surface of the electronic device 200 during the communication will be described.

  FIG. 41 is a diagram showing a screen configuration of the display surface of electronic device 100 at the time of this communication. Referring to FIG. 41, the display surface of electronic device 100 includes a display area and a communication area.

  The communication area includes eight data signal pixel blocks of 2 rows and 4 columns in the center of the communicable area. That is, at the time of this communication, 8-bit data communication is performed. Therefore, at the time of this communication, the electronic device 100 can transmit eight times as much data per unit time to the electronic device 200 as compared to the time of initial communication.

  The communication area includes five reference signal pixel blocks (BL_C1 to BL_C5). Of the five reference signal pixel blocks (BL_C1 to BL_C5), four reference signal pixel blocks (BL_C1, BL_C2, BL_C3, and BL_C5) are set at four corners of the communicable region, respectively. The remaining one reference signal pixel block BL_C4 is set at a position adjacent to any one of the four reference signals. In FIG. 41, the remaining one reference signal pixel block BL_C4 is set at a position adjacent to the reference signal pixel block BL_C5 arranged in the lower left corner.

  In the following, reference signals output using the reference signal pixel blocks (BL_C1 to BL_C5) are referred to as “reference signal S_C1”, “reference signal S_C2”, “reference” in order from the pixel block BL_C1 to the pixel block BL_C5. These are referred to as “signal S_C3”, “reference signal S_C4”, and “reference signal S_C5”.

  The pixel block BL_C6 (25 pixel × 25 pixel region) adjacent to the reference signal pixel block BL_C3 arranged in the lower right corner of the communicable region is used as a region for receiving the reference signal output from the electronic device 200. .

  As described above, five reference signals are used during the communication. However, the number of reference signals is not limited to five. For example, this communication is possible even when fewer than five reference signals such as one reference signal or two reference signals are used.

The display area is composed of four areas on the top, bottom, left and right of the eight data signal pixel blocks.
The display control unit 11 determines the position and size of the pixel block in the electronic device 100 based on the communication parameter.

  FIG. 42 is a diagram showing the eight data signal pixel blocks shown in FIG. Referring to FIG. 42, pixel block BL_C11, pixel block BL_C12, pixel block BL_C13, and pixel block BL_C14 are arranged from left to right in the upper row. Also, the pixel block BL_C15, the pixel block BL_C16, the pixel block BL_C17, and the pixel block BL_C18 are arranged from the left to the right in the lower stage.

  In the following description, data signals output using the pixel blocks (BL_C11 to BL_C18) are “data signal D_C1”, “data signal D_C2”, “data signal D_C3” in order from the pixel block BL_C11 to the pixel block BL_C18. They are referred to as “data signal D_C4”, “data signal D_C5”, “data signal D_C6”, “data signal D_C7”, and “data signal D_C8”. In addition, a region obtained by combining the regions of the pixel blocks (BL_C1 to BL_C6, BL_C11 to BL_C18) is referred to as a “second communication region SW”.

  FIG. 43 is a diagram illustrating a screen configuration of the display surface of the electronic device 200 during the communication. Referring to FIG. 43, the display surface of electronic device 200 includes a display area and a communication area.

  The communication area includes pixel blocks for 8 data signals in 2 rows and 4 columns. These eight data signal pixel blocks are set at positions facing the eight data signal pixel blocks of the electronic apparatus 100. Therefore, at the time of this communication, the electronic device 200 can transmit eight times the data per unit time to the electronic device 100 as compared with the time of the initial communication.

  The communication area includes five reference signal pixel blocks (BL_D1 to BL_D5). Of the five reference signal pixel blocks (BL_D1 to BL_D5), four reference signal pixel blocks (BL_D1, BL_D2, BL_D3, and BL_D5) are data blocks for reference signals at four corners of the electronic device 100. It is set to the position facing each other. The remaining one reference signal pixel block BL_D4 is set at a position adjacent to the reference signal pixel block BL_D5 arranged in the lower left corner, as in the electronic apparatus 100. In the following, reference signals output using the reference signal pixel blocks (BL_D1 to BL_D5) are referred to as “reference signal S_D1”, “reference signal S_D2”, “reference” in order from the pixel block BL_D1 to the pixel block BL_D5. These are referred to as “signal S_D3”, “reference signal S_D4”, and “reference signal S_D5”.

  A pixel block BL_D6 (25 pixel × 25 pixel region) adjacent to the reference signal pixel block BL_D3 arranged in the lower right is used as a region for receiving the reference signal output from the pixel block BL_C4 of the electronic device 100. .

  Further, in the communicable area of the electronic device 200, an area excluding the eight data signal pixel blocks, the reference signal pixel blocks (BL_D1 to BL_D5), and the pixel block BL_D6 is a display area.

  Note that the display control unit 51 determines the position and size of the pixel block in the electronic device 200 based on the communication parameters.

  FIG. 44 is a diagram showing the pixel blocks for the eight data signals shown in FIG. Referring to FIG. 44, pixel block BL_D11, pixel block BL_D12, pixel block BL_D13, and pixel block BL_D14 are arranged from left to right in the upper stage. Also, the pixel block BL_D15, the pixel block BL_D16, the pixel block BL_D17, and the pixel block BL_D18 are arranged from the left to the right in the lower stage.

  In the following description, data signals output using the pixel blocks (BL_D11 to BL_D18) are “data signal D_D1”, “data signal D_D2”, “data signal D_D3” in order from the pixel block BL_D11 to the pixel block BL_D18. These are referred to as “data signal D_D4”, “data signal D_D5”, “data signal D_D6”, “data signal D_D7”, and “data signal D_D8”. Further, a region obtained by combining the regions of the pixel blocks (BL_D1 to BL_D6, BL_D11 to BL_D18) used as the communication region is referred to as a “second communication region LW”.

  When the setting unit 54 makes the second communication region LW face the display surface of the electronic device 100 and the display surface of the own device 200, the setting unit 54 sets the second communication region LW to the data of the display surface of the electronic device 100. It is set so as to be included in an area where transmission / reception is possible (that is, a rectangular area of 150 mm wide × 100 mm long).

  By setting the second communication area LW in this way, the electronic device 100 and the electronic device 200 can communicate using communication areas having the same width.

  At least the arrangement of reference signals (FIGS. 39 to 41, 43) is determined in advance between the electronic device 100 and the electronic device 200. Or it is good also as a structure which transmits / receives the signal which determines the said agreement between the electronic device 100 and the electronic device 200 during authentication.

<Details of device information>
Next, device information of the device 100 stored in the electronic device 100 will be described. FIG. 45 is a diagram showing device information. Referring to FIG. 45, the device information includes a communicable area horizontal size (dLX), a communicable area vertical size (dLY), a communicable area horizontal resolution (dW), and a communicable area vertical resolution (dH). , Refresh rate (dRR), color liquid crystal flag (dCFLG), receivable area desired horizontal offset (rROX), receivable area desired vertical offset (rROY), desired communication speed (rSPD), and device identification ID (UID), display screen horizontal size (dDLX), display screen vertical size (dDLY), display screen horizontal resolution (dDW), display screen vertical resolution (dDH), and communicable area horizontal position (dPX) , And a communicable region vertical position (dPY).

  Since the communicable area horizontal size (dLX), the communicable area vertical size (dLY), the communicable area horizontal resolution (dW), and the communicable area vertical resolution (dH) have been described based on FIG. The description here will not be repeated.

  The refresh rate (dRR) is a vertical synchronization frequency. That is, the refresh rate (dRR) is an index representing how many times the screen is rewritten per unit time. The color liquid crystal flag (dCFLG) is a flag indicating whether the liquid crystal panel 140 of the electronic device 100 is a color liquid crystal or a monochrome liquid crystal.

  The reception area desired lateral offset (rROX) is a lateral offset value in the communicable area of the electronic device 100 that is desired for the electronic device 200 when performing communication with the electronic device 200. That is, the reception area desired lateral offset (rROX) is a value that defines a lateral shift between the transmission area and the reception area within the communicable area of the electronic device 100.

  The reception area desired vertical offset (rROY) is a value of the vertical offset in the communicable area of the electronic device 100 that is desired for the electronic device 200 when performing communication with the electronic device 200. That is, the reception area desired vertical offset (rROY) is a value that defines a vertical shift between the transmission area and the reception area in the communicable area of the electronic device 100.

  In this way, by designating the reception area desired horizontal offset (rROX) and the reception area desired vertical offset (rROY), the electronic device 100 transmits to the electronic device 200 when communicating with the electronic device 200. It is possible to request that the area and the reception area be completely overlapped, or that the transmission area and the reception area be different.

  The desired communication speed (rSPD) is a transmission speed at the time of data transmission by the electronic device 200 that the electronic device 100 desires to the electronic device 200.

The device identification ID is a device identification ID of the electronic device 100.
The display surface horizontal size (dDLX) is the horizontal size of the display surface of the liquid crystal panel 140. The display surface vertical size (dDLY) is the horizontal size of the display surface of the liquid crystal panel 140. The display surface horizontal resolution (dDW) is the resolution in the horizontal direction of the display surface of the liquid crystal panel 140. The display surface vertical resolution (dDH) is the resolution in the vertical direction of the display surface of the liquid crystal panel 140. The communicable area lateral position (dPX) indicates the lateral position of the communicable area on the display surface of the liquid crystal panel 140 (the X coordinate of a vertex PA in FIG. 48 described later). The communicable area vertical position (dPY) indicates the vertical position of the communicable area on the display surface of the liquid crystal panel 140 (Y coordinate of vertex PA in FIG. 48 described later).

  FIG. 45 shows a case where the size of the display surface matches the size of the communicable area (dLX, dLY). That is, FIG. 45 shows a case where electronic device 100 is configured to be able to perform bidirectional communication using the entire display surface of liquid crystal panel 140. For example, in a configuration in which bidirectional communication can be performed only by using a part of the liquid crystal panel 140, the size (dLX, dLY) of the communicable region is smaller than the size of the display surface. Become.

  Note that the information on the display surface horizontal size (dDLX) and the display surface vertical size (dDLY), which is information indicating the size of the display surface of the electronic device 100, is referred to as “size information”. Further, information on the communicable area horizontal size (dLX) and the communicable area vertical size (dLY) corresponds to the area information.

<Details of communication parameters>
Next, communication parameters will be described. The communication parameter is a parameter that defines a communication condition during the main communication. At the time of this communication, the electronic device 100 and the electronic device 200 perform bidirectional communication based on the communication parameter. That is, the communication parameter is used for bidirectional communication between the electronic device 100 and the electronic device 200 in a manner different from the initial communication, such as setting of the pixel block for the reference signal and the pixel block for the data signal.

  FIG. 46 is a diagram showing communication parameters. Note that the parameter values for the setting items of the communication parameters shown in FIG. 46 are values when the main communication in the mode shown in FIGS. 41 and 43 is performed.

  Referring to FIG. 46, the communication parameters are: communication area horizontal size (cAW), communication area vertical size (cAH), horizontal data number (cAXN), vertical data number (cAYN), and reception area horizontal. Direction offset (rXO), reception area vertical offset (rYO), follow-up flag (fLW), communication speed (fRQ), signal area horizontal size (sAW), signal area vertical size (sAH), signal Image offset (sAO), signal image horizontal size (sCW), signal image vertical size (sCH), reference signal shape (sCBSF), data signal shape (sCDSF), reference signal size (sCBS), A reference signal image color (sCBFC), a data signal image color (sCDFC), and a signal image background color (sCBC) are included.

  The communication area horizontal size (cAW) is the horizontal size of the communication area used in the main communication. The communication area vertical size (cAH) is the vertical size of the communication area used in the main communication.

  The horizontal data number (cAXN) is the number of pixel blocks of the data signal in the horizontal direction. The vertical data number (cAYN) is the number of pixel blocks of the data signal in the vertical direction.

  The reception area lateral offset (rXO) is the value of the lateral offset in the communicable area. That is, the reception area lateral offset (rXO) is a value that defines a lateral displacement between the transmission area and the reception area within the communicable area.

  The reception area vertical offset (rYO) is the value of the vertical offset in the communicable area. That is, the reception area vertical offset (rYO) is a value that defines the vertical shift between the transmission area and the reception area within the communicable area.

  The follow flag (fLW) is a flag indicating which of the electronic device 100 and the electronic device 200 that determines the communication parameter performs the follow operation. Here, the follow-up operation refers to the change of the position when the position of the display surface of the other electronic device (for example, the electronic device 100) is changed with respect to the display surface of the one electronic device (for example, the electronic device 200). On the other hand, this is an operation of following the positions of the pixel block for the reference signal and the pixel block for the data signal of the electronic device.

  The communication speed (fRQ) is a communication speed between the electronic device 100 and the electronic device 200. The signal area horizontal size (sAW) is the horizontal size of one pixel block. The signal area vertical size (sAH) is the vertical size of one pixel block.

  Other items (sAO, sCW, sCH, sCBSF, sCDSF, sCBS, sCBFC, sCDFC, sCBC) will be described later (FIG. 48).

<Communication area specifications (at initial communication)>
Next, the specification of the communication area at the time of initial communication will be described. FIG. 47 is a diagram for describing the specifications of the communication area of the electronic device 100 in the initial communication. Specifically, FIG. 47 is a diagram illustrating details of the pixel block for the reference signal and the pixel block for the data signal in the state illustrated in FIGS. 39 and 40.

  Referring to FIG. 47, the pixel block BL_A1 outputs a reference signal S_A1 using an internal area (area of 15 pixels × 15 pixels). The pixel block BL_A2 outputs a reference signal S_A2 using an internal area (area of 15 pixels × 15 pixels). The pixel block BL_A3 outputs a data signal D_A1 using an internal area (area of 15 pixels × 15 pixels).

  In this embodiment, the reference signal and the data signal are output through a gap corresponding to 10 pixels. The reason for providing such a gap is to make it easier for the receiving-side electronic device to distinguish between two adjacent signals.

  Note that the specification of the communication area of the electronic device 200 in the initial communication is the same as the specification of the electronic device 100 in the initial communication, and thus description thereof will not be repeated here.

<Communication area specifications (during this communication)>
Next, the specification of the communication area at the time of this communication will be described. FIG. 48 is a diagram for describing the specifications of the communication area of the electronic device 100 in this communication. Specifically, FIG. 48 is a diagram showing details of the reference signal pixel blocks (BL_C1 to BL_C5) and the data signal pixel blocks (BL_C11 to BL_C18) in the state shown in FIGS. It is.

  Referring to FIG. 48, the pixel block BL_C1 outputs a reference signal S_C1 using an internal area (area of 15 pixels × 15 pixels). Electronic device 100 also outputs other reference signals (S_C2 to S_C5) in the same manner as reference signal S_C1.

  Here, details of the specifications of the pixel blocks (BL_C1 to BL_C5) will be described using the pixel block BL_C1 as an example. The pixel block BL_C1 includes a communication area horizontal size (cAW), a communication area vertical size (cAH), a signal image offset (sAO), and a signal image horizontal size (sCW) in the communication parameters illustrated in FIG. , Defined by a signal image vertical size (sCH), a reference signal shape (sCBSF), a reference signal size (sCBS), a reference signal image color (sCBFC), and a signal image background color (sCBC).

  The distance between the outer periphery of the pixel block BL_C1 and the outer periphery of the reference signal S_C1 is defined by a signal image offset (sAO). The horizontal size of the reference signal S_C1 is defined by the signal image horizontal size (sCW). The vertical size of the reference signal S_C1 is defined by the signal image vertical size (sCH). The shape of the reference signal S_C1 is defined by the reference signal shape (sCBSF). The magnitude of the reference signal S_C1 is defined by the reference signal magnitude (sCBS). The color of the reference signal S_C1 is defined by the reference signal image color (sCBFC). The color of the background area (that is, the offset area) of the reference signal S_C1 is defined by the signal image background color (sCBC).

  Here, the reference signal size (sCBS) indicates the size of a region for displaying the reference signal (specifically, vertical and horizontal of the signal image). For example, in the standard case, the area is 15 pixels × 15 pixels.

  Note that the pixel blocks (BL_C2 to BL_C5) are the same as the pixel block BL_C1, and therefore description thereof will not be repeated.

  Next, details of the specifications of the pixel blocks (BL_C11 to BL_C18) will be described by taking the pixel block BL_C11 as an example. The pixel block BL_C11 includes a communication area horizontal size (cAW), a communication area vertical size (cAH), a signal image offset (sAO), and a signal image horizontal size (sCW) in the communication parameters illustrated in FIG. The signal image vertical size (sCH), the data signal shape (sCDSF), the reference signal size (sCBS), the data signal image color (sCDFC), and the signal image background color (sCBC).

  The distance between the outer periphery of the pixel block BL_C11 and the outer periphery of the data signal D_C1 is defined by a signal image offset (sAO). The horizontal size of the data signal D_C1 is defined by the signal image horizontal size (sCW). The vertical size of the data signal D_C1 is defined by the signal image vertical size (sCH). The shape of the data signal D_C1 is defined by the data signal shape (sCDSF). The color of the data signal D_C1 is defined by the data signal image color (sCDFC). The color of the background region (that is, the offset region) of the data signal D_C1 is defined by the signal image background color (sCBC).

  Since the pixel blocks (BL_C12 to BL_C18) are the same as the pixel block BL_C11, the description thereof will not be repeated.

  In addition, the specification of the communication area of the electronic device 200 in the main communication is the same as the specification of the electronic device 100 in the main communication, so the description will not be repeated here.

<About following>
Next, processing in the electronic device 200 when the position of the display surface of the liquid crystal panel 140 of the electronic device 100 is changed with respect to the display surface of the liquid crystal panel 240 of the electronic device 200 in the initial communication and the main communication will be described.

  FIG. 49 is a diagram illustrating a state in which the display surface of the liquid crystal panel 140 of the electronic device 100 and the display surface of the liquid crystal panel 240 of the electronic device 200 face each other when performing authentication. In FIG. 49, the back surface of the electronic device 100 is shown.

  FIG. 50 is a diagram illustrating contents displayed on the display surface of the liquid crystal panel 240 of the electronic device 200 when the main communication is performed in the state illustrated in FIG. 49.

  Referring to FIG. 50, a reference signal and a data signal are displayed on the display surface of liquid crystal panel 240, and a pre-designated message is displayed (in FIG. 50, a display indicating that authentication is in progress). Is made. At this time, the display control unit 51 displays the previously designated message in the second area described above.

  Thus, by displaying a message in a region (second region L2) different from the region (first region L1) of the display surface of electronic device 200 facing the display surface of electronic device 100, the user can It is possible to confirm that authentication has been performed.

  Moreover, it is preferable that the display control part 51 displays the said message in the position except the boundary vicinity of the said 1st area | region L1 among the said 2nd area | region L2. This is because there is a casing portion such as an edge that supports the display surface around the display surface of the electronic device 100, so that if the message is displayed near the boundary of the first region, the user cannot confirm a part of the message. This is because there is a fear.

  Here, the position information will be described. In the present embodiment, the position information is coordinates on the display surface of electronic device 200 corresponding to the coordinates of each vertex (PA to PD) shown in FIG. Specifically, the coordinates of the vertices (PA 'to PD') shown in FIG.

  FIG. 51 is a diagram illustrating a case where the position of the display surface of the liquid crystal panel 140 of the electronic device 100 changes during authentication. In FIG. 51, the electronic device 100 is moving leftward.

  FIG. 52 is a diagram showing display contents on the display surface of the liquid crystal panel 240 of the electronic device 200 when the electronic device 100 moves as shown in FIG. Referring to FIG. 52, display control unit 51 communicates with electronic device 100 using first region L1 after the position has changed. That is, the display control unit 51 performs control to change the position of the pixel block that outputs the reference signal and the data signal following the movement of the position of the electronic device 100. Moreover, the display control part 51 displays the said message on the 2nd area | region L2 regarding the 1st area | region L1 after the said position changed. The positions of the first region L1 and the second region L2 are determined by the detection result by the detection unit 53A.

  By performing such processing, the electronic device 200 can continue to display the message at a position where the user can visually recognize even when the position of the electronic device 100 changes during authentication. The follow-up timing will be described later (FIG. 61).

The follow-up can also be applied during initial communication.
<Reception signal analysis>
Next, analysis processing in the electronic device 200 will be described for signals received by the electronic device 200 from the electronic device 100.

  FIG. 53 is a diagram showing a display surface of electronic device 100 during data transmission. Specifically, FIG. 53 is a diagram illustrating a state in which the electronic device 100 is transmitting the data signal “01111101”.

  54 is a diagram schematically illustrating a state in which the electronic device 200 has received the reference signal and the data signal illustrated in FIG. 53 output from the electronic device 100 in a state where the electronic device 100 and the electronic device 200 face each other. . Referring to FIG. 54, receiving unit 52 of electronic device 200 detects vertex coordinates of the entire received signal based on the received signal. That is, the receiving unit 52 detects coordinates on the liquid crystal panel 240 of the electronic device 200 corresponding to each vertex (PA, PB, PC, PD) in FIG.

  Further, the receiving unit 52 corrects the inclination of the rectangle specified by each vertex coordinate based on the detected coordinates of each vertex. Specifically, the receiving unit 52 sets the inclination of the rectangle to 0. Further, after correcting the inclination, the receiving unit 52 extracts a data signal region (that is, a region corresponding to the pixel blocks (BL_C11 to BL_C18) of the electronic device 100) from the first region. FIG. 55 is a diagram showing a region of the extracted data signal.

  Thereafter, the receiving unit 52 corrects the arrangement of the received data signals based on the positional relationship between the five received reference signals (S_C1 to S_C5). FIG. 56 is a diagram after correcting the arrangement of the data signals. Referring to FIG. 56, the receiving unit 52 arranges the received data signals in order from the left in the upper stage to the data signal D_C1, the data signal D_C2, the data signal D_C3, and the data signal D_C4. Correction is performed so that the signal D_C5, the data signal D_C6, the data signal D_C7, and the data signal D_C8 are obtained.

  Then, the receiving unit 52 performs pattern analysis on the received data signal. FIG. 57 shows the result of pattern analysis of the received data signal. At this time, the receiving unit 52 sequentially outputs “0” or “1” in the predetermined order as the output of the analysis result. In this case, the electronic device 200 can obtain “01111101” as the received data. Here, in the present embodiment, the predetermined order is the order from left to right in the upper part of FIG. 57 and then from left to right in the lower part.

  Note that the analysis of the received signal when the electronic device 100 receives the signal output from the electronic device 200 is the same as in the case of the electronic device 200, and thus description thereof will not be repeated here.

<Flowchart of Electronic Device 100>
Next, a processing flow of the electronic device 100 at the time of authentication will be described. FIG. 58 is a flowchart showing the first half of the process of electronic device 100 during authentication. FIG. 59 is a flowchart showing the latter half of the processing of electronic device 100 during authentication.

  Referring to FIG. 58, control unit 10 initializes the system of electronic device 100 (S11). After step S11, the display control unit 11 displays “Authenticate” on the liquid crystal panel 140 (S12). After step S12, the display control unit 11 determines the display positions of the reference signal and the data signal at the time of initial communication (S13). After step S13, the display control unit 11 generates a communication request signal (S14). The procedure for generating the communication request signal is as follows. First, the transmission buffer (SUBF) is set to 0 and the contents of the buffer are erased. Next, “0000” is set in the data area DA21 of FIG. Further, the parity bit is calculated, and the calculated value is set in the parity bit DA23.

  After step S14, the display control unit 11 transmits a communication request signal to the electronic device 200 via the liquid crystal panel 140 (S15). After step S15, the receiving unit 12 receives a signal from the electronic device 200 (S16). If reception of the READY signal has failed n times, the control unit 10 may perform processing from step S26 described later.

  After step S16, the receiving unit 12 determines whether a READY signal is received from the electronic device 200 (S17). When it is determined in step S17 that the READY signal has been received (in the case of Yes), the display control unit 11 generates transmission data including device information (S18). On the other hand, when it is determined in step S17 that the READY signal has not been received (in the case of No), the control unit 10 returns to step S15. For example, when the display surface of the electronic device 100 and the display surface of the electronic device 200 are separated during communication, the process returns to step S15. The procedure for generating the READY signal is as follows. First, the display control unit 11 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 11 sets “0010” in the data area DA21. Further, the display control unit 11 sets the device information shown in FIG. 45 in the data area DA24. The display control unit 11 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S18, the display control unit 11 transmits data including device information to the electronic device 200 (S19). After step S19, a signal from the electronic device 200 is received (S20). After step S20, the receiving unit 12 determines whether a communication parameter has been received from the electronic device 200 (S21). When it is determined in step S21 that the communication parameter has been received (in the case of Yes), the display control unit 11 determines the display position of the reference signal and the data signal during the main communication (S22). On the other hand, when it is determined in step S21 that the communication parameter has not been received (No), the display control unit 11 displays a communication error on the liquid crystal panel 140 with reference to FIG. 59 (S36). In step S22, (X, Y) = (0, 0) may be set.

  After the receiving unit 12 receives the communication parameter in step S11, this communication is performed. That is, data transmission / reception using 8 bits is performed between the electronic device 100 and the electronic device 200.

  After step S22, the display control unit 11 generates an authentication request signal (S23). The generation of the authentication request signal is as follows. First, the transmission buffer (SUBF) is set to 0 and the contents of the buffer are erased. Next, “0100” is set in the data area DA21. Further, the parity bit is calculated, and the calculated value is set in the parity bit DA23.

  After step S23, the display control unit 11 transmits an authentication request signal to the electronic device 200 (S24). After step S24, a signal from the electronic device 200 is received (S25). After step S25, with reference to FIG. 59, the receiving unit 12 determines whether or not a timeout has occurred regarding the reception of the signal from the electronic device 200 (S26). That is, the receiving unit 12 determines whether or not a signal has been received from the electronic device 200 within a predetermined time in step S26. If it is determined in step S26 that a timeout has occurred (in the case of Yes), the display control unit 11 displays a communication error on the liquid crystal panel 140 (S36). On the other hand, when it is determined in step S26 that the processing time is not timed out (in the case of No), the receiving unit 12 determines whether or not an authentication preparation completion signal has been received from the electronic device 200 (S27).

  When it is determined in step S27 that the authentication preparation completion signal has been received (in the case of Yes), the display control unit 11 generates data including authentication information (S28). The data generation procedure is as follows. First, the display control unit 11 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 11 sets “0110” in the data area DA21. Further, the display control unit 11 sets information related to authentication in the data area DA24. The display control unit 11 calculates a parity bit and sets the calculated value in the parity bit DA23. On the other hand, if it is not determined in step S27 that the authentication preparation completion signal has been received (in the case of No), a communication error is displayed on the display control unit 11 and the liquid crystal panel 140 (S36).

  After step S28, the display control unit 11 transmits data including authentication information to the electronic device 200 (S29). After step S29, the receiving unit 12 receives a signal from the electronic device 200 (S30). After step S30, the receiving unit 12 determines whether or not a timeout has occurred regarding the reception of the signal from the electronic device 200 (S31). When it is determined in step S31 that the processing time has timed out (in the case of Yes), the receiving unit 12 causes the display control unit 11 to display a communication error (S36). On the other hand, if it is determined in step S31 that the timeout has not occurred (in the case of No), the receiving unit 12 determines whether or not a signal indicating that the authentication has failed has been received (S32).

  If it is determined in step S32 that a signal indicating that the authentication has failed is received (in the case of Yes), the display control unit 11 causes the liquid crystal panel 140 to display that the authentication has failed (S33). On the other hand, when it is determined in step S32 that the signal indicating that the authentication has failed is not received (in the case of No), the receiving unit 12 determines whether or not the signal indicating that the authentication is successful is received. (S34).

  If it is determined in step S34 that a signal indicating that authentication has succeeded has been received (in the case of Yes), the display control unit 11 causes the liquid crystal panel 140 to display that authentication has succeeded (S35). On the other hand, if it is not determined in step S34 that a signal indicating that the authentication has succeeded has been received (in the case of No), the display control unit 11 displays a communication error on the liquid crystal panel 140 (S36).

  After step S33, step S35, and step S36, the control unit 10 places the electronic device 100 in a standby state without turning off the power for a predetermined time (for example, 1 minute) (S37). After step S37, the control unit 10 turns off the power (S38). Thus, a series of processing ends.

<Flowchart of Electronic Device 200>
Next, a processing flow of the electronic device 200 at the time of authentication will be described. FIG. 60 is a flowchart showing the first half of the processing of the electronic device 200 at the time of authentication. FIG. 61 is a flowchart showing the latter half of the processing of electronic device 200 during authentication.

  Referring to FIG. 60, control unit 50 initializes the system of electronic device 200 (S101). After step S101, the display control unit 51 causes the liquid crystal panel 240 to display “Perform authentication” (S102). After step S102, the receiving unit 52 receives a signal from the electronic device 100 (S103).

  After step S103, the receiving unit 52 determines whether or not a timeout has occurred regarding the reception of the signal from the electronic device 100 (S104). If it is determined in step S104 that the processing time has timed out (Yes), the process returns to step S103. On the other hand, when it is determined in step S104 that the timeout has not occurred (in the case of No), the receiving unit 52 determines whether a communication request signal has been received from the electronic device 100 (S105).

  If it is determined in step S105 that the communication request signal has been received (in the case of Yes), the display positions of the reference signal and the data signal during the initial communication are determined (S106). The display position is determined from the position where the communication request signal is received. If it is not determined in step S105 that the communication request signal has been received (in the case of No), the process returns to step S103.

  After step S106, the display control unit 51 generates a READY signal (S107). The READY signal generation procedure is as follows. First, the display control unit 51 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 51 sets “0001” in the data area DA21. Further, the display control unit 51 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S107, the display control unit 51 transmits a READY signal to the electronic device 100 via the liquid crystal panel 240 (S108). After step S108, the receiving unit 52 receives a signal from the electronic device 100 (S109). If the device information has failed to be received n times, the processing after step S137 may be performed.

  After step S109, the receiving unit 52 determines whether or not a timeout has occurred (S110). When it is determined in step S110 that a timeout has occurred (in the case of Yes), the process returns to step S103 again. On the other hand, when it is determined in step S110 that the timeout has not occurred (in the case of No), the receiving unit 52 determines whether or not device information has been received from the electronic device 100 (S111).

  When it is determined in step S111 that data including device information has been received (in the case of Yes), the display control unit 51 generates data including communication parameters (S112). On the other hand, when it is not determined in step S111 that data including device information has been received (in the case of No), the process returns to step S109. The procedure for generating data including the communication parameter is as follows. First, the display control unit 51 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 51 sets “0011” in the data area DA21. Further, the display control unit 51 sets the communication parameters shown in FIG. 46 in the data area DA24. The display control unit 51 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S112, the display control unit 51 transmits data including communication parameters (S113). The communication is performed after the communication parameter is transmitted in step S113. That is, data transmission / reception using 8 bits is performed between the electronic device 100 and the electronic device 200. After step S113, the signal from the electronic device 100 is received (S114).

  After step S114, the receiving unit 52 determines whether or not a timeout has occurred (S115). When it is determined in step S115 that a timeout has occurred (in the case of Yes), the receiving unit 52 stores the device identification ID of the electronic device 100 in the storage device 99 (S134). On the other hand, when it is determined in step S115 that the timeout has not occurred (in the case of No), the receiving unit 52 determines whether or not an authentication request signal has been received (S116).

  If it is not determined in step S116 that the authentication request signal has been received (No), the process returns to step S114. On the other hand, when it is determined in step S116 that the authentication request signal has been received (in the case of Yes), with reference to FIG. 61, display control unit 51 determines the display positions of the reference signal and the data signal during the communication. (S117). The display position is determined from the position where the authentication request signal is received. After step S117, the display control unit 51 causes the liquid crystal panel 240 to display that authentication is in progress (S118). In addition, the display control part 51 performs the display which shows that it is authenticating in the said 2nd area | region L2.

  After step S118, the display control unit 51 generates an authentication preparation completion signal (S119). Note that the procedure for generating the authentication preparation consideration signal is as follows. First, the transmission buffer (SUBF) is set to 0 and the contents of the buffer are erased. Next, “0101” is set in the data area DA21. Further, the parity bit is calculated, and the calculated value is set in the parity bit DA23.

  After step S119, the display control unit 51 transmits the generated authentication preparation completion signal to the electronic device 100 (S120). After step S120, the electronic device 200 receives a signal from the electronic device 100 (S121). After step S121, the receiving unit 52 determines whether or not a timeout has occurred (S122). If it is determined in step S122 that a timeout has occurred (in the case of Yes), the receiving unit 52 stores the device identification ID of the electronic device 100 in the storage device 99 (S134). On the other hand, when it is determined in step S122 that the timeout has not occurred (in the case of No), the receiving unit 52 determines whether or not data including authentication information has been received (S123).

  When it is determined in step S123 that data including authentication information has been received (in the case of Yes), the authentication unit 55 executes an authentication process (S124). On the other hand, when it is determined in step S123 that data including authentication information has not been received (in the case of No), the receiving unit 52 stores the device identification ID of the electronic device 100 in the storage device 99 (S134). After step S124, the display control unit 51 resets the display positions of the reference signal and the data signal (S125). The display position is determined from the reception position of data including authentication information. With this determination, the electronic device 200 can continue to display the message at a position where the user can visually recognize it even when the position of the electronic device 100 changes during authentication.

  After step S125, the display control unit 51 determines whether the authentication by the authentication unit 55 is successful (S126). When it is determined in step S126 that the authentication is successful (in the case of Yes), the display control unit 51 generates a signal indicating that the authentication is successful (S127). The signal generation procedure is as follows. First, the display control unit 51 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 51 sets “0111” in the data area DA21. Further, the display control unit 51 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S127, the display control unit 51 transmits a signal indicating that the authentication is successful to the electronic device 100 (S128). After step S128, the display control unit 51 displays a display indicating that the authentication is successful on the display surface of the liquid crystal panel 240 of the device 200 (S129). After step S129, the display control unit 51 deletes the device identification ID stored in the storage device 99 (S130).

  On the other hand, when it is not determined in step S126 that the authentication has succeeded (in the case of No), the display control unit 51 generates a signal indicating that the authentication has failed (S131). The signal generation procedure is as follows. First, the display control unit 51 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 51 sets “1000” in the data area DA21. Further, the display control unit 51 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S131, the display control unit 51 transmits a signal indicating that the authentication has failed to the electronic device 100 (S132). After step S132, the display control unit 51 displays a display indicating that the authentication has failed on the display surface of the liquid crystal panel 240 of the device 200 (S133). After step S133, the display control unit 51 deletes the device identification ID stored in the storage device 99 (S130).

  After step S134, the display control unit 51 generates data indicating an error (S135). The data generation procedure is as follows. First, the display control unit 51 sets the transmission buffer (SUBF) to 0 and erases the contents of the buffer. Next, the display control unit 51 sets “1111” in the data area DA21. Further, the display control unit 51 calculates a parity bit and sets the calculated value in the parity bit DA23.

  After step S135, the display control unit 51 transmits data indicating an error to the electronic device 100 (S136). After step S136, the display control unit 51 displays a display indicating a communication error on the liquid crystal panel 240 (S137).

  After step S130 and step S137, electronic device 200 places electronic device 200 in a standby state without turning off the power for a predetermined time (for example, 15 seconds) (S138). After step S138, the control unit 50 determines whether or not the power of the own device 200 is OFF (S139). If the power is turned off in step S139, the series of processing ends. On the other hand, if it is not determined in step S139 that the power is off, the process returns to step S102.

  In step S130, the control unit 50 deletes the stored device identification ID. In this case, when it is necessary to store the device identification ID up to the upper limit of the memory area assigned to the device identification ID in the storage device 99 and newly store the device identification ID in the memory area, first, The stored device identification ID may be erased. Alternatively, regarding the authentication of the electronic device 100, the device identification ID of the electronic device 100 may be deleted only when the difference between the number of successful authentications and the number of failed authentications exceeds a threshold value.

<Flow chart for initial communication>
Next, a data transmission flow of electronic device 100 during initial communication will be described. FIG. 62 is a flowchart showing a data transmission flow of electronic device 100 during initial communication.

  Referring to FIG. 62, display control unit 11 sets reference signals (S_A1, S_A2) to high level “1” (S201). After step S201, the display control unit 11 sets the data signal D_A1 to high level “1” (S202). After step S202, the display control unit 11 draws an image to be transmitted to the electronic device 200 on the VRAM 1812 (S203). After step S203, the display control unit 11 waits for an interrupt of the vertical synchronization signal (VSYNC) (S204). The steps so far are steps for drawing a synchronization signal for starting transmission in the VRAM 1812. The subsequent steps are steps for drawing 128-bit data in the VRAM 1812. In the following, i is a natural number from 1 to 128.

  The display control unit 11 sets the value of the variable SA_i representing the number of transmitted bits to 0 (S205). After step S205, the display control unit 11 sets the output level of the reference signal (S_A1, S_A2) to a value corresponding to the remainder obtained when the variable SA_i is divided by 2 (S206). If the value of the variable SA_i is 0 or an even number, the remainder is 0. Therefore, the display control unit 11 sets the reference signals (S_A1, S_A2) to the low level “0”. On the other hand, if the value of the variable SA_i is an odd number, the remainder is 1, and the display control unit 11 sets the reference signals (S_A1, S_A2) to the high level “1”.

  After step S206, the display control unit 11 sequentially reads 1-bit data out of 128-bit data from the storage device 49 (S207). After step S207, the display control unit 11 draws an image to be transmitted to the electronic device 200 on the VRAM 1812 (S208). After step S208, 1 is added to the variable SA_i (S209). After step S209, the display control unit 11 determines whether the variable SA_i is smaller than 128 (S210). If it is determined in step S210 that it is small (in the case of Yes), the process returns to step S206. On the other hand, when it is not determined that the value is small in Step S210 (in the case of No), the process ends.

Note that the above series of processing ends within the vertical blanking period.
Next, details of the processing in steps S203 and S208 of FIG. 62 will be described. FIG. 63 is a flowchart showing a detailed flow of processing in step S203 and step S208 of FIG.

  Referring to FIG. 63, display control unit 11 waits for a vertical synchronization signal interrupt (S301). After step S301, the display controller 11 displays the reference signal pixel blocks (BL_A1, BL_A2) and the data signal pixel block BL_A3 in black (S302). After step S302, the display control unit 11 determines whether or not the reference signals (S_A1, S_A2) are at a high level (S303).

  When it is determined in step S303 that the level is high (in the case of Yes), the display control unit 11 draws the reference signal (S_A1) in the VRAM 1812 (S304). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_A1 to blue. After step S304, the display control unit 11 draws the reference signal S_A2 on the VRAM 1812 (S305). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_A2 to blue.

  When it is determined in step S303 that the level is not high (in the case of No) and after step S305, the display control unit 11 determines whether or not the data signal D_A1 is high (S306). If it is determined in step S306 that the level is high (in the case of Yes), the display control unit 11 draws the data signal D_A1 in the VRAM 1812 (S307). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_A3 to blue. On the other hand, if it is determined in step S306 that the level is not high (in the case of No), the process ends.

Next, a data reception flow of the electronic device 200 during initial communication will be described. FIG. 64 is a flowchart showing a data reception flow of electronic device 200 during initial communication.

  Referring to FIG. 64, receiving unit 52 sets the value of the number RA_r of attempts to synchronize data reception to 60 (S401). After step S401, the receiving unit 52 analyzes the received signals (S_A1, S_A2, D_A1) (S402). After step S402, the receiving unit 52 determines whether each reference signal (S_A1, S_A2) and the data signal D_A1 are all at a high level (S403).

  When it is determined in step S403 that the level is high (in the case of Yes), the control unit 50 sets the state of the electronic device 200 in a standby state for a time 4t (S404). Here, the time t is a sufficiently short time with respect to the period of the vertical synchronizing signal. In the present embodiment, for example, time t is set to ¼ of the period of the vertical synchronization signal. After step S404, the receiving unit 52 analyzes the received signals (S_A1, S_A2, D_A1) (S405). After step S405, the receiving unit 52 determines whether each reference signal (S_A1, S_A2) and the data signal D_A1 are all at a high level (S406).

  If it is determined in step S406 that the level is high (in the case of Yes), the reception unit 52 sets the value of the variable RA_i representing the number of stored bits to 0 (S407). After step S407, the receiving unit 52 sets the value of the variable RA_B to 1 (S408). After step S408, the control unit 50 sets the state of the electronic device 200 to a standby state for a time t (S409). After step S409, the receiving unit 52 analyzes the received signal (S410).

  After step S410, the receiving unit 52 determines whether or not the reference signal S_A1 and the reference signal S_A2 are in the same state (S411). When it is determined in step S411 that they are the same (in the case of Yes), the reception unit 52 determines whether or not the output level (1 or 0) of the reference signal S_C2 is different from the variable RA_B (S412). . On the other hand, when it is determined that they are not the same in step S411 (in the case of No), the process returns to step S409.

  When it is determined in step S412 that they are different (in the case of Yes), the receiving unit 52 sets the value of the variable RA_B to the output level of the reference signal S_C2 (S413). That is, the receiving unit 52 stores the current state of the reference signal in the storage device 99 as the variable RA_B. On the other hand, when it is determined in step S412 that there is no difference (in the case of No), the control unit 50 returns to step S409. After step S413, the receiving unit 52 stores the 1-bit data signal D_A1 in the storage device 99 (specifically, a buffer memory) (S414).

  After step S414, the receiving unit 52 adds 1 to the variable RA_i (S415). After step S415, the receiving unit 52 determines whether or not storage for 128 bits has been completed (S416). If it is determined in step S416 that the process is not completed (Yes), the process returns to step S409 again. On the other hand, if it is determined in step S416 that the process has been completed (in the case of No), the receiving unit 52 determines that there is no error (S417), and the display control unit 51 ends the series of processes without displaying an error. To do.

  By the way, when it is not determined that it is a high level in Step S403 (in the case of No), and when it is not determined that it is a high level in Step S406 (in the case of No), the receiving unit 52 synchronizes data reception. 1 is subtracted from the number RA_r of attempts (S418). After step S418, the receiving unit 52 determines whether or not the number of times RA_r is 0 (S419). If it is determined in step S419 that the value is 0 (in the case of Yes), the display control unit 51 causes the liquid crystal panel 240 to display a timeout (S420). On the other hand, when it is not determined that the value is 0 in step S419 (in the case of No), the control unit 50 sets the state of the electronic device 200 in a standby state for a time 4t (S421). After step S421, the process returns to step S402 again.

<Flowchart during this communication>
Next, a data transmission flow of the electronic device 100 during the communication will be described. FIG. 65 is a flowchart showing a data transmission flow of electronic device 100 during the communication.

  Referring to FIG. 65, display control unit 11 sets reference signals (S_C1 to S_C5) to high level “1” (S501). After step S501, the display control unit 11 sets the data signals (D_C1 to D_C8) to the high level “1” (S502). After step S502, the display control unit 11 draws an image to be transmitted to the electronic device 200 on the VRAM 1812 (S503). After step S503, the display control unit 11 waits for an interrupt of a vertical synchronization signal (S504).

  After step S504, the display control unit 11 sets the data signals (D_C1 to D_C8) to low level “0” (S505). After step S505, the display control unit 11 sets the value of the variable SB_j indicating the number of transmitted frames to 0 (S506). Note that j is a natural number of 1 or more. Further, in this embodiment, 8-bit data can be transmitted in one frame.

  After step S506, the display control unit 11 sets the output level of the reference signals (S_C1 to S_C5) to a value corresponding to the remainder obtained when the variable SB_j is divided by 2 (S507). If the value of the variable SB_j is 0 or an even number, the remainder is 0. Therefore, the display control unit 11 sets the reference signals (S_C1 to S_C5) to the low level “0”. On the other hand, if the value of the variable SB_j is an odd number, the remainder is 1, and the display control unit 11 sets the reference signals (S_C1 to S_C5) to the high level “1”.

  After step S507, the display control unit 11 draws an image to be transmitted to the electronic device 200 on the VRAM 1812 (S508). After step S508, the display control unit 11 adds 1 to the variable SB_j (S509). After step S509, the display control unit 11 determines whether or not frames corresponding to the number of frames necessary to transmit 128-bit data are transmitted (S510). For example, in the present embodiment, the display control unit 11 determines whether 16 (128 bits / 8 bits) frames have been transmitted.

  If it is determined in step S510 that transmission has not been performed (in the case of Yes), the process returns to step S507 again. On the other hand, if it is determined in step S510 that transmission is in progress (No), the process is terminated.

  Next, details of the processing in steps S503 and S508 of FIG. 65 will be described. FIG. 66 is a flowchart showing a detailed flow of processing in step S503 and step S508 of FIG.

  Referring to FIG. 66, display control unit 11 detects an interrupt of the vertical synchronization signal (S601). After step S601, the display control unit 11 displays the reference signal pixel blocks (BL_C1 to BL_C5) and the data signal pixel blocks (BL_C11 to BL_C18) in black (S602). After step S602, the display control unit 11 determines whether or not the reference signals (S_C1 to S_C5) are at a high level (S603).

  When it is determined in step S603 that the level is high (in the case of Yes), the display control unit 11 displays the reference signal (S_C1) on the display surface of the liquid crystal panel 140 (S604). Specifically, the display control unit 11 changes the 15 × 15 pixel area inside the pixel block BL_C1 to blue. On the other hand, when it is determined in step S603 that the level is not high (in the case of No), the display control unit 11 sets the value of the variable k to 0 (S609).

  After step S604, the display control unit 11 draws the reference signal S_C2 on the VRAM 1812 (S605). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_C2 to blue.

  After step S605, the display control unit 11 draws the reference signal S_C3 on the VRAM 1812 (S606). Specifically, the display control unit 11 changes the region in the VRAM 1812 corresponding to the 15 × 15 pixel region inside the pixel block BL_C3 to blue.

  After step S606, the display control unit 11 draws the reference signal S_C4 on the VRAM 1812 (S607). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_C4 to blue.

  After step S607, the display control unit 11 draws the reference signal S_C5 on the VRAM 1812 (S608). Specifically, the display control unit 11 changes the area in the VRAM 1812 corresponding to the 15 × 15 pixel area inside the pixel block BL_C5 to blue.

  After step S608, the process proceeds to step S609. After step S609, the display control unit 11 determines whether or not the data signal to be transmitted is at a high level (S610). When it is determined in step S610 that the level is not high (in the case of No), the display control unit 11 extracts 1-bit data from the 8-bit data signal (S611). On the other hand, when it is determined in step S610 that the level is high (in the case of Yes), the process proceeds to step S613. After step S611, the display control unit 11 determines whether or not the extracted data signal is at a high level “1” (S612).

  If it is determined in step S610 that the level is high (in the case of Yes) and if it is determined in step S612 that the level is high (in the case of Yes), the display control unit 11 stores the extracted data in the VRAM 1812. Drawing is performed (S613). After step S613, the display control unit 11 adds 1 to the value of the variable k (S614). On the other hand, if it is not determined that the level is high in step S612 (No), the process proceeds to step S614.

  After step S614, the display control unit 11 determines whether all the data signals that can be displayed in one frame are not displayed on the display surface of the liquid crystal panel 140 (S615). When it is determined in step S615 that no image is displayed (in the case of Yes), the process returns to step S610 again. On the other hand, if it is determined in step S615 that the image is displayed (No), the process is terminated.

  Next, a data reception flow of the electronic device 200 during the communication will be described. FIG. 67 is a flowchart showing the first half of the data reception flow of electronic device 200 during this communication. FIG. 68 is a flowchart showing the second half of the data reception flow of electronic device 200 during this communication.

  Referring to FIG. 67, reception unit 52 sets the value of the number of times RB_r to attempt data reception synchronization to 60 (S701). After step S701, the receiving unit 52 analyzes the received signals (S_C1 to S_C5, D_C11 to D_C18) (S702). After step S702, the receiving unit 52 determines whether all the reference signals (S_C1 to S_C5) are at a high level (S703).

  If it is determined in step S703 that the level is high (in the case of Yes), the control unit 50 sets the state of the electronic device 200 in a standby state for a time 4t (S704). After step S704, the receiving unit 52 analyzes the received signals (S_C1 to S_C5, D_C11 to D_C18) (S705). After step S705, the receiving unit 52 determines whether all the reference signals (S_C1 to S_C5) are at a high level (S706).

  If it is determined in step S706 that the level is high (in the case of Yes), the reception unit 52 sets the value of the variable RB_j representing the number of stored bits to 0 (S707). After step S707, the reception unit 52 sets the value of the variable RB_B to the output level (1 or 0) of the reference signal S_C3 (S708). After step S708, referring to FIG. 68, control unit 50 places electronic device 200 in a standby state for time t (S709). After step S709, the receiving unit 52 analyzes the received signals (S_C1 to S_C3, D_C11 to D_C18) (S710). In step S710, the receiving unit 52 does not analyze the reference signals (S_C4, S_C5).

  After step S710, the receiving unit 52 determines whether or not the output levels of the reference signals (S_C1 to S_C5) are the same (S711). When it is determined in step S711 that they are the same (in the case of Yes), the reception unit 52 determines whether the value of the variable RB_B is not the same as the output level (1 or 0) of the reference signal S_C2 (S712). . Step S712 is a step of determining whether or not the reference signal S_C2 has been updated. That is, if it is determined that the value of the variable RB_B and the output level of the reference signal S_C2 are not the same (in the case of Yes), the reference signal S_C2 is updated. On the other hand, if it is not determined in step S711 that they are the same (No), the process returns to step S709.

  If it is determined in step S712 that they are not the same (in the case of Yes), the receiving unit 52 sets the value of the variable RB_B to the output level (1 or 0) of the reference signal S_C3 (S713). That is, the receiving unit 52 stores the current state of the reference signal S_C3. On the other hand, when it is determined in step S712 that they are the same (in the case of No), the process returns to step S709.

  After step S713, the receiving unit 52 sets the value of the variable k to 0 (S714). After step S714, the receiving unit 52 stores a 1-bit data signal of the data signals (D_C11 to D_C18) in the storage device 99 (specifically, a buffer memory) (S715). Note that the storing order is the order from the data signal D_C11 to the data signal D_C18.

  After step S715, the receiving unit 52 adds 1 to the value of the variable k (S716). After step S716, the receiving unit 52 determines whether all the data signals (D_C11 to D_C18) in one frame have been read and stored in the storage device 99 (S717). If it is not determined that the data is stored in step S717 (Yes), the process returns to step S715. On the other hand, when it is determined in step S717 that the data signals (D_C11 to D_C18) are stored (in the case of No), the reception unit 52 adds 1 to the value of the variable RB_j (S718).

  After step S718, the receiving unit 52 determines whether or not storage for 128 bits has been completed (S719). If it is determined in step S719 that the processing has not been completed (Yes), the process returns to step S709. On the other hand, if it is determined in step S719 that the process has been completed (in the case of No), the receiving unit 52 terminates the process without displaying an error (S720).

  By the way, when it is not determined to be high level in step S703 and when it is not determined to be high level in step S706, referring to FIG. 67, 1 is subtracted from the number RB_r of attempts to synchronize data reception. (S721). After step S721, the reception unit 52 determines whether or not the number of times RB_r is 0 (S722). If it is determined in step S722 that the value is 0 (in the case of Yes), the display control unit 51 causes the liquid crystal panel 240 to display a timeout (S723). On the other hand, if it is determined in step S722 that it is not 0 (in the case of No), the control unit 50 sets the state of the electronic device 200 in a standby state for a time 4t (S724). After step S723, the process returns to step S702 again.

<VRAM update timing>
Next, the update timing of the reference signal and the data signal in the VRAM 1812 will be described.

  71 is a diagram schematically showing an area of the VRAM 1812 (a part of the storage device 49 shown in FIG. 15) shown in FIG. Referring to FIG. 71, VRAM 1812 stores m × n pieces of data constituting one still image. In the electronic device 100, the rewriting of the m × n data is performed at predetermined intervals by the VRAM update unit 11A.

  Here, a method for scanning the m × n data stored in the VRAM 1812 will be described. FIG. 72 is a diagram showing the order in which data stored in the VRAM 1812 is scanned.

  Referring to FIG. 72, VRAM scanning unit 11B first scans from the left end to the right end of the top line. With this scanning, DA (1,1) to DA (m, 1) shown in FIG. 71 are scanned. Thereafter, after the horizontal blanking period H_Bk, the VRAM scanning unit 11B performs scanning from the left end to the right end of the line immediately below the relevant line. With this scanning, DA (1,2) to DA (m, 2) shown in FIG. 71 are scanned. Thereafter, the VRAM scanning unit 11B sequentially scans after each horizontal blanking period H_Bk. Then, the VRAM scanning unit 11B finally scans the lowermost line (the nth line). With this scanning, DA (1, n) to DA (m, n) shown in FIG. 71 are scanned.

  Thus, in the electronic device 100, the scanning of the m × n pieces of data stored in the VRAM 1812 is completed. When the scanning of the lowermost line (the nth line) is completed, after the vertical blanking period V_Bk, the VRAM scanning unit 11B scans again from the left end to the right end of the uppermost line. .

  Incidentally, when the VRAM 1812 is rewritten during the scanning from the first row to the n-th row shown in FIG. 72 or during the horizontal blanking period, the following problems occur.

  FIG. 73 is a diagram for explaining the relationship between the scanning period and the vertical blanking period V_Bk. In FIG. 73, the horizontal blanking period H_Bk is omitted for convenience of explanation.

  Here, referring to FIG. 73, a frame obtained by scanning from time ta to time ta ′ is referred to as “frame Fa”. Also, a frame obtained by scanning between time tb and time tb ′ is referred to as “frame Fb”. Further, a frame obtained by scanning between time tc and time tc ′ is referred to as “frame Fc”.

  Note that the period from time ta 'to time tb, the period from time tb' to time tc, and the period from time tc 'to time td are vertical blanking periods V_Bk, respectively. A frame refers to image data obtained by scanning from the first row to the n-th row of the VRAM 1812.

  Thereafter, the VRAM update unit 11A updates the data in the VRAM 1812 to data indicating a black circle (●) at the timing of time t11 shown in FIG. The case of updating to the data shown will be described. FIG. 74 is a diagram for explaining a frame Fb obtained when the above-described data update is performed at time t11 and time t12.

  Referring to FIG. 74, since black circles are stored in VRAM 1812 between time tb and time t12, VRAM scanning unit 11B sequentially scans the upper part of the black circles themselves. On the other hand, between time t12 and time tb ', since the VRAM 1812 is updated at time t12, the VRAM scanning unit 11B sequentially scans the lower part of the white circle itself.

  As a result, the frame Fb is a figure in which a part of a black circle and a part of a white circle are combined. In other words, electronic device 100 cannot display at least black circles that should have been originally displayed on display panel 140. Therefore, the electronic device 100 cannot transmit a correct data signal to the electronic device 200. For this reason, the problem that a communication error arises arises.

  In order to prevent the problem from occurring, the VRAM update unit 11A of the electronic device 100 updates data to be transmitted to the electronic device 200 during the vertical blanking period. By updating the data in the VRAM 1812 at such timing, it is possible to prevent the data to be continuously transmitted from being combined.

  The VRAM update unit 11A of the electronic device 100 preferably updates data to be transmitted to the electronic device 200 once in one vertical blanking period. Hereinafter, the reason will be described.

  FIG. 75 is a diagram for explaining a case where data in VRAM 1812 is updated at a timing different from the timing shown in FIG. Referring to FIG. 75, VRAM update unit 11A updates the data in VRAM 1812 to data indicating a black circle at time t21. Also, the VRAM update unit 11A updates the data in the VRAM 1812 to data indicating a white circle at the timing of time t22. Further, the VRAM update unit 11A updates the data in the VRAM 1812 to data indicating a black circle at time t23.

  FIG. 76 is a diagram showing the frame Fb and the frame Fc. Referring to FIG. 76, when the above update is performed, the white circle updated at the timing of time t22 is not displayed in frame C. This is because the data in the VRAM 1812 is updated twice during the vertical blanking period immediately before displaying the frame Fc.

  Therefore, even when the data update of the VRAM 1812 is performed a plurality of times during the vertical blanking period, the problem that “the electronic device 200 cannot receive all data signals transmitted from the electronic device 100 without omission”. Occurs. For this reason, it is preferable that the electronic device 100 updates the data to be transmitted to the electronic device 200 once in one vertical blanking period.

  For the electronic device 200, the VRAM is updated at the same timing as the update timing by the electronic device 100.

<About data parallelization>
Next, a method for increasing the number of data signals that can be transmitted in one frame will be described.

  FIG. 77 is a diagram showing a frame when the number of data signals that can be transmitted in one frame is changed from one to a plurality. Referring to FIG. 77, display control unit 11 displays n ′ × m ′ data signals on the display surface of liquid crystal panel 140 in one frame. Therefore, the number of data that can be transmitted in one frame can be increased by an amount corresponding to the increase in the number of data signals.

<Reference signal display mode>
Next, a display mode of a reference signal for reducing communication errors will be described.

  As described above, the liquid crystal panel 140 of the electronic device 100 is driven using a driving method called a line sequential method. Therefore, even if the VRAM scanning unit 11B is configured such that, as described above, the VRAM updating unit 11A updates the data only once in one vertical blanking period, the following problem occurs in the electronic device 200 on the receiving side. there is a possibility.

  FIG. 78 is a diagram illustrating received data when the electronic device 200 receives frames displayed continuously by the electronic device 100 at three different timings.

  Referring to FIG. 78, electronic device 100 displays frame Fa of black circle 501 on the display surface of liquid crystal panel 140. More specifically, the display control unit 11 displays data indicating a black circle 501 on the display surface of the liquid crystal panel 140 as a video output during a period from time te to time te ′. The liquid crystal panel 140 sequentially updates the display contents on the display surface in a line sequential manner during the period from the time te to the time te ′ so as to display the black circle 501 on the display surface.

  When the display of the black circle 501 ends, the electronic device 100 displays the frame Fb of the white circle 502 on the display surface of the liquid crystal panel 140 after the vertical blanking period (the period from time te ′ to time tf) has elapsed. More specifically, the display control unit 11 displays data indicating a white circle 502 on the display surface of the liquid crystal panel 140 as a video output during a period from time tf to time tf ′. The liquid crystal panel 140 sequentially updates the display content on the display surface in a line sequential manner during the period from time tf to time tf ′ in order to display white circles 502 on the display surface.

  In this way, when the electronic device 100 sequentially displays the black circle 501 and the white circle 502, it is assumed that the electronic device 200 performs scanning at time t31, time t32, and time t33. Here, the time t31 is a time between the time te ′ and the time tf (that is, a time within the vertical blanking period). The time t32 is a time between the time tf and the time tf ′. That is, it is a time during which the electronic device 100 is sequentially updating the display content on the display surface. Furthermore, the time t33 is a time between the time tf ′ and the time tg (that is, a time within the vertical blanking period).

  When the electronic device 200 scans at time t31, the electronic device 200 can acquire data indicating a black circle 601 in the same mode as the black circle 501. In addition, when the electronic device 200 also scans at time t <b> 33, the electronic device 200 can acquire data indicating a white circle 603 in the same manner as the white circle 502. However, when the electronic device 200 scans at time t32, the electronic device 200 acquires data indicating the figure 602 in a form in which a part of the black circle 501 and a part of the white circle 502 are combined. become. That is, if the electronic device 200 performs a scan while updating the display content of the display surface of the liquid crystal panel 140, the electronic device 200 cannot acquire correct data.

  Further, the electronic device 200 cannot determine whether the acquired data is correct data or incorrect data.

  As a result, there is a possibility that a communication error is likely to occur in communication between the electronic device 100 and the electronic device 200.

  On the other hand, if the electronic device 200 has a configuration for determining the vertical blanking period of the electronic device 100, the electronic device 200 can always acquire correct data by performing scanning during the vertical blanking period. However, in this case, the electronic device 200 needs to have a configuration for determining the vertical blanking period of the electronic device 100. However, when the electronic device 200 includes the configuration, the electronic device 200 can have a complicated configuration.

Therefore, a method for dealing with such a problem will be described below.
FIG. 79 is a diagram illustrating a data signal transmitted by the electronic device 100. Referring to FIG. 79, display control unit 11 of electronic device 100 first causes liquid crystal panel 140 to display frame Fa ′ including black circles 510 indicating data signals. Next, the display control unit 11 causes the liquid crystal panel 140 to display a frame Fb ′ including a white circle 520 indicating a data signal. Finally, the frame Fc ′ including the white circle 530 indicating the data signal is displayed on the liquid crystal panel 140 again.

  Here, the display control unit 11 sets the reference signal, the data signal, and the reference signal of each frame in this order in the order in which the reference signal is displayed differently for each frame in at least two consecutive frames of the plurality of frames. Is displayed on the display screen. Specifically, it is as follows.

  FIG. 80 shows the frame Fa ′. Referring to FIG. 80, the data signal indicated by black circle 510 is arranged at a position sandwiched between the reference signal indicated by black diamond 511 and the reference signal indicated by black diamond 512. That is, the drawing of the data signal in the VRAM 1812 is started after the drawing of the first reference signal in the VRAM 1812 is completed, and is finished before the drawing of the second reference signal in the VRAM 1812 is started.

  FIG. 81 is a diagram showing the frame Fb ′. Referring to FIG. 81, the data signal indicated by white circle 520 is arranged at a position sandwiched between the reference signal indicated by white rhombus 521 and the reference signal indicated by white rhombus 522. That is, as in FIG. 80, the drawing of the data signal to the VRAM 1812 is started after the drawing of the first reference signal to the VRAM 1812 is completed and before the drawing of the second reference signal to the VRAM 1812 is started. To finish.

  Here, the VRAM update unit 11A of the display control unit 11 updates the data in the VRAM 1812 so that the display mode of the reference signal in the frame Fb ′ is different from the display mode of the reference signal in the frame Fa ′.

  FIG. 82 shows the frame Fc ′. Referring to FIG. 82, the data signal indicated by white circle 530 is arranged at a position sandwiched between the reference signal indicated by black diamond 531 and the reference signal indicated by black diamond 532. That is, as in FIG. 80 and FIG. 81, the drawing of the data signal to the VRAM 1812 is started after the drawing of the first reference signal to the VRAM 1812 is completed, and the drawing of the second reference signal to the VRAM 1812 is started. Exit before it starts.

  Here, the VRAM update unit 11A of the display control unit 11 updates the data in the VRAM 1812 so that the display mode of the reference signal in the frame Fc ′ is different from the display mode of the reference signal in the frame Fb ′.

  FIG. 83 is a diagram illustrating received data when the electronic device 200 receives frames displayed continuously by the electronic device 100 at five different timings. FIG. 83 is also a diagram showing the received data by the electronic device 200 when the frame Fa ′, the frame Fb ′, and the frame Fc ′ are displayed on the electronic device 100 in this order.

  Referring to FIG. 83, display control unit 11 of electronic device 100 displays frame Fa ′ as a video output on the display surface of liquid crystal panel 140 during a period from time te to time te ′. The liquid crystal panel 140 sequentially updates the display content on the display surface in a line sequential manner during the period from the time te to the time te ′ in order to display the frame Fa ′ on the display surface.

  When the display of the frame Fa ′ is completed, the display control unit 11 displays the frame Fb ′ on the display surface of the liquid crystal panel 140 after the vertical blanking period (the period from the time te ′ to the time tf) has elapsed. More specifically, the display control unit 11 displays the frame Fb ′ on the display surface of the liquid crystal panel 140 as a video output during the period from time tf to time tf ′. The liquid crystal panel 140 sequentially updates the display content on the display surface in a line sequential manner during the period from the time tf to the time tf ′ in order to display the frame Fb ′ on the display surface.

  When the display of the frame Fb ′ is completed, the display control unit 11 displays the frame Fc ′ on the display surface of the liquid crystal panel 140 after the vertical blanking period (the period from the time tf ′ to the time tg) has elapsed. More specifically, the display control unit 11 displays the frame Fc ′ on the display surface of the liquid crystal panel 140 as a video output during a period from time tg to time tg ′. The liquid crystal panel 140 sequentially updates the display content on the display surface in a line sequential manner from the time tg to the time tg ′ in order to display the frame Fc ′ on the display surface.

  Here, it is assumed that electronic device 200 scans at time t41, time t42, time t43, time t44, and time t45. Here, the time t41 is a time between the time te ′ and the time tf (time in the vertical blanking period). The time t42 is a time between the time tf and the time tf ′. That is, the time t42 is a time during which the electronic device 100 is sequentially updating the display content on the display surface. Furthermore, the time t43 is a time between the time tf ′ and the time tg (time within the vertical blanking period). Time t44 is a time between time tg and time tg '. That is, the time t44 is a time during which the electronic device 100 is sequentially updating the display content on the display surface. Furthermore, the time t45 is a time between the time tg ′ and the time th (time within the vertical blanking period).

  When the electronic device 200 scans at time t41, the electronic device 200 can acquire data D41 similar to the frame Fa ′. Further, when the electronic device 200 scans at time t43, the electronic device 200 can acquire data D43 similar to the frame Fb '. Further, when the electronic device 200 scans at time t45, the electronic device 200 can acquire data D45 similar to that of the frame Fc ′.

  However, when the electronic device 200 scans at time t42, the electronic device 200 uses data D42 in which a part of the frame Fa ′ (lower part) and a part of the frame Fb ′ (upper part) are combined. get. Further, when the electronic device 200 scans at time t44, the electronic device 200 receives data D44 in which a part of the frame Fb ′ (lower part) and a part of the frame Fb ′ (upper part) are combined. get.

  As described above, the second determination unit 57 determines whether or not the reference signals before and after the data signal are in the same display mode in the received data for one frame.

  For example, for the data D41, the data signal indicated by the black circle 610 is sandwiched between the reference signal indicated by the black diamond 611 and the reference signal indicated by the black diamond 612. In this case, the second determination unit 57 determines that the reference signals before and after the data signal are in the same display mode.

  For the data D42, the data signal indicated by the graphic 620 is sandwiched between the reference signal indicated by the white diamond 621 and the reference signal indicated by the black diamond 622. In this case, the second determination unit 57 determines that the reference signals before and after the data signal are not in the same display mode.

  For the data D43, the data signal indicated by the white circle 630 is sandwiched between the reference signal indicated by the white diamond 631 and the reference signal indicated by the white diamond 632. In this case, the second determination unit 57 determines that the reference signals before and after the data signal are in the same display mode.

  Regarding the data D44, the data signal indicated by the white circle 640 is sandwiched between the reference signal indicated by the black diamond 641 and the reference signal indicated by the white diamond 642. In this case, the second determination unit 57 determines that the reference signals before and after the data signal are not in the same display mode.

  Regarding the data D45, the data signal indicated by the white circle 650 is sandwiched between the reference signal indicated by the black diamond 651 and the reference signal indicated by the black diamond 652. In this case, the second determination unit 57 determines that the reference signals before and after the data signal are in the same display mode.

  As described above, the invalidation unit 58 invalidates the received data signal when the second determination unit 57 determines that the display mode is not the same.

  That is, the invalidation unit 58 invalidates the data signal indicated by the graphic 620 of the data D42. The invalidation unit 58 invalidates the data signal indicated by the white circle 640.

  As a result, the electronic device 200 sets the data signal indicated by the black circle 610, the data signal indicated by the white circle 630, and the data signal indicated by the white circle 650 as valid data signals.

  By performing such processing by the electronic device 200, it is possible to reduce communication errors without the electronic device 200 having a configuration for determining the vertical blanking period of the electronic device 100.

  By the way, in the above, the display mode of a reference signal is a mode in which a data signal is sandwiched between reference signals indicated by black diamonds (first mode) and a mode in which a data signal is sandwiched between reference signals indicated by white diamonds (Second mode) was switched for each frame. In the above description, each frame includes two reference signals.

  However, switching of the display mode of the reference signal is not limited to a configuration in which switching is performed for each frame between the first mode and the second mode. Further, the number of reference signals included in each frame is not limited to two.

  To the last, the display control unit 11 sets the plurality of reference signals to the same display mode in each frame, and sets the reference signal to a different display mode for each frame in at least two consecutive frames of the plurality of frames. Any configuration may be used as long as the reference signal, the data signal, and the reference signal are displayed on the display surface of the electronic device 100 in this order.

  The electronic device 100 performs the same communication error reduction process as the electronic device 200. For this reason, the description of the communication error reduction processing in electronic device 100 will not be repeated.

<Summary-1>
(About the electronic device 100 and the electronic device 200)
In the electronic devices 100 and 200, the VRAM update units 11A and 51A update data stored in the VRAM 1812 during the vertical blanking period of scanning by the VRAM scanning units 11B and 51B.

  Therefore, in electronic devices 100 and 200, it is possible to prevent data (data signals) to be continuously transmitted from being combined.

  Further, the VRAM update units 11A and 51A perform the update once in the vertical blanking period.

  Therefore, one electronic device can receive all data signals transmitted from the other electronic device without omission.

<Summary-2>
(About electronic equipment on the sending side)
When the electronic device 100 is operating as a transmission-side device, the display control unit 11 of the electronic device 100 sets the plurality of reference signals to the same display mode in each frame, and at least two consecutive frames among the plurality of frames. In one frame, the reference signal is displayed differently for each frame, and the reference signal, the data signal, and the reference signal of each frame are displayed on the display surface of the electronic device 100 in this order.

  Therefore, the electronic device 100 can reduce communication errors caused by communication with the electronic device 200.

  Further, the display control unit 11 switches the display mode of the reference signal for each frame between the first mode and the second mode. For this reason, only two reference signal display modes are required.

  Therefore, the configuration of the electronic device 100 can be simplified as compared with the case where the number of reference signal display modes is three or more.

  On the other hand, when the electronic device 200 is operating as a transmission-side device, the display control unit 51 of the electronic device 200 sets the plurality of reference signals to the same display mode in each frame and at least continuously among the plurality of frames. In the two frames, the reference signal is displayed differently for each frame, and the reference signal, the data signal, and the reference signal of each frame are displayed on the display surface of the electronic device 200 in this order. Further, the display control unit 51 switches the reference signal display mode between the first mode and the second mode for each frame. Also in this case, the electronic device 200 has an effect similar to the effect described regarding the electronic device 100.

(About the receiving electronic device)
When the electronic device 100 is operating as a transmission-side device, the determination unit 14 determines whether or not the reference signals before and after the data signal are in the same display mode in the received data for one frame. When the determination unit 14 determines that the display modes are not the same, the invalidation unit 15 invalidates the received data signal.

  Therefore, the electronic device 200 can reduce communication errors caused by communication with the electronic device 100.

  On the other hand, when the electronic device 200 is operating as a transmission-side device, the electronic device 200 has a display mode in which the second determination unit 57 displays the same reference signal before and after the data signal in the received data for one frame. If the second determination unit 57 determines that the display mode is not the same, the invalidation unit 58 invalidates the received data signal. Also in this case, the electronic device 200 has an effect similar to the effect described regarding the electronic device 100.

<Modification>
(1) FIG. 14 shows a configuration in which the transmission controller 1811 and the reception controller 1832 are provided in the image processing engine 180. However, the transmission controller 1811 and the reception controller 1832 may be provided in the driver 130. Alternatively, the CPU 110 may be configured to execute the functions of the transmission controller 1811 and the reception controller 1832.

  (2) In the above description, the configuration has been described in which the authentication-side electronic device 200 performs control to open the gate after successful authentication. However, the control performed by electronic device 200 is not limited to the control for opening the gate. For example, the electronic device 200 may perform billing processing when the display surface of the electronic device 100 (for example, a portable telephone) is opposed to the display surface of the electronic device 200 (for example, a register).

  FIG. 69 is a diagram showing the content displayed on the display surface of electronic device 100 and the content displayed on the display surface of electronic device 200 before performing the billing process. FIG. 70 is a diagram showing the content displayed on the display surface of electronic device 100 and the content displayed on the display surface of electronic device 200 after the accounting process is performed.

  Referring to FIG. 69, before performing the billing process, display control unit 11 of electronic device 100 displays a display indicating that authentication is started on the display surface of the own device. On the other hand, the display control unit 51 of the electronic device 200 displays a display on the display surface of its own device to guide the user of the electronic device 100 to make the display surface of the electronic device 100 face the display surface of the electronic device 200. Let

  Referring to FIG. 70, after the authentication is completed and the accounting process is completed, display control unit 11 of electronic device 100 displays the details of the accounting (for example, the content displayed as a receipt) on electronic device 100. Display on the screen. On the other hand, the display control unit 51 of the electronic device 200 displays the contents to be displayed on the display surface of the electronic device 200 when the charging ends.

  With this configuration, the electronic device 100 allows the user to check the details of the billing. Therefore, the electronic device 100 is more convenient than an electronic device configured so that the details of the billing cannot be displayed on the electronic device 100. .

  Further, authentication and billing processing can be performed regardless of the position within the communicable area of electronic device 200 with the display surface of electronic device 100 facing. In the case of using communication such as an LED, the arrangement of devices on the authentication side is limited. However, in the present invention, the arrangement of the electronic device 100 is not limited as much as communication using LEDs.

  Further, the communication system 1 has an effect of preventing eavesdropping. Furthermore, in the communication system 1, since communication is performed in the opposite state, the occurrence of communication failures is small.

  (3) The electronic device 100 and the electronic device 200 may be configured to exchange data such as an address book. Further, in a case where the electronic device 200 is a device capable of displaying a television broadcast, the electronic device 200 is made to have a part of the display surface of the electronic device 200 facing the display surface of the electronic device 100. The data output from the area may be read by the electronic device 100. Examples of the data include program related information and premium content billing information.

  (4) When the dot pitch between the liquid crystal panel 140 of the electronic device 100 and the liquid crystal panel 240 of the electronic device 200 is different, the data transmission / reception area is set in consideration of the difference in dot pitch when transmitting / receiving data. Just decide.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  DESCRIPTION OF SYMBOLS 1 Communication system, 10 Control part, 11 Display control part, 11A VRAM update part, 11B VRAM scanning part, 12 Reception part, 13 Setting part, 14 Judgment part, 15 Invalidation part, 49 Memory | storage device, 50 Control part, 51 Display Control unit, 51A VRAM update unit, 51B VRAM scanning unit, 52 reception unit, 53 first determination unit, 53A detection unit, 53B position information update unit, 54 setting unit, 55 authentication unit, 56 parameter determination unit, 57 second determination Part, 58 invalidation part, 99 storage device, 100 electronic device, 140 liquid crystal panel with built-in optical sensor, 140A liquid crystal panel with built-in optical sensor, 144 optical sensor circuit, 145 photodiode, 177 operation key, 179 backlight, 180 image processing engine 181 Driver control unit 183 Signal processing unit 200 Electronic device 20 DESCRIPTION OF SYMBOLS 1 Main body apparatus, 202 Display apparatus, 230 driver, 240 Optical sensor built-in liquid crystal panel, 277 Operation key, 279 Backlight, 280 Image processing engine, 281 Driver control part, 283 Signal processing part, 1811 Transmission controller, 1812 VRAM, 1831 A / D converter, 1832 reception controller, 1833 VRAM.

Claims (7)

An electronic device including a display panel in which a plurality of optical sensors are built in along a display surface,
An electronic device that is a communication partner with the own device and that has a display panel with a plurality of optical sensors built in along the display surface is the counterpart device, and the display surface of the counterpart device and the display surface of the own device If the state of facing is the facing state,
When transmitting data to the counterpart device in the facing state, display control means for displaying the data as an image on the display surface of the display panel of the device,
Receiving means for receiving data displayed as an image on the display surface of the display panel of the counterpart device in the facing state via the optical sensor of the own device;
The display control means includes
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the device, and the data included in each frame of the data to be transmitted is a data signal. When displaying a plurality of reference signals for synchronizing with the counterpart device as an image on the display surface of the display panel of the device,
Further, in each of the frames, the plurality of reference signals have the same form, and in at least two consecutive frames of the plurality of frames, the reference signal is formed in a form different for each frame, An electronic device that displays a data signal and the reference signal in this order on the display surface of the device itself. An electronic device including a display panel in which a plurality of optical sensors are built in along a display surface,
An electronic device that is a communication partner with the own device and that has a display panel with a plurality of optical sensors built in along the display surface is the counterpart device, and the display surface of the counterpart device and the display surface of the own device If the state of facing is the facing state,
When transmitting data to the counterpart device in the facing state, display control means for displaying the data as an image on the display surface of the display panel of the device,
Receiving means for receiving data displayed as an image on the display surface of the display panel of the counterpart device in the facing state via the optical sensor of the own device;
The display control means includes
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the device, and the data included in each frame of the data to be transmitted is a data signal. When displaying a plurality of reference signals for synchronizing with the counterpart device as an image on the display surface of the display panel of the device,
Further, in each frame, the plurality of reference signals have the same magnitude, and in at least two consecutive frames of the plurality of frames, the reference signals have different magnitudes for each frame, and the reference signals of each frame And the data signal and the reference signal are displayed in this order on the display surface of the device. A communication system including a first electronic device and a second electronic device each including a liquid crystal panel including a plurality of optical sensors along a display surface,
When the state where the display surface of the first electronic device and the display surface of the second electronic device are opposed to each other,
The first electronic device
When transmitting data to the second electronic device in the facing state, first display control means for displaying the data as an image on the display surface of the display panel of the first electronic device;
First receiving means for receiving data displayed as an image on the display surface of the display panel of the second electronic device in the opposed state via the optical sensor of the first electronic device;
The first display control means includes
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the first electronic device, and the data included in each frame of the data to be transmitted is a data signal. A plurality of reference signals for synchronizing with the second electronic device at the time of transmission are displayed as images on the display surface of the display panel of the first electronic device,
Further, in each of the frames, the plurality of reference signals have the same form, and in at least two consecutive frames of the plurality of frames, the reference signal is formed in a form different for each frame, Display the data signal and the reference signal in this order on the display surface of the device,
The second electronic device
A second display control means for displaying data as an image on the display surface of the display panel of the second electronic device when transmitting data to the first electronic device in the facing state;
Second receiving means for receiving the data signal and the reference signal for synchronizing with the second electronic device when transmitting the data signal from the first electronic device in the facing state;
A determination unit before and after the reference signal of the data signal in one frame of data to which the second reception unit receives is equal to or the same shape,
A communication system comprising: invalidating means for invalidating the received data signal when the judging means judges that they are not in the same form . A communication system including a first electronic device and a second electronic device each including a liquid crystal panel including a plurality of optical sensors along a display surface,
When the state where the display surface of the first electronic device and the display surface of the second electronic device are opposed to each other,
The first electronic device
When transmitting data to the second electronic device in the facing state, first display control means for displaying the data as an image on the display surface of the display panel of the first electronic device;
First receiving means for receiving data displayed as an image on the display surface of the display panel of the second electronic device in the opposed state via the optical sensor of the first electronic device;
The first display control means includes
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the first electronic device, and the data included in each frame of the data to be transmitted is a data signal. A plurality of reference signals for synchronizing with the second electronic device at the time of transmission are displayed as images on the display surface of the display panel of the first electronic device,
Further, in each frame, the plurality of reference signals have the same magnitude, and in at least two consecutive frames of the plurality of frames, the reference signals have different magnitudes for each frame, and the reference signals of each frame And the data signal and the reference signal are displayed in this order on the display surface of the device,
The second electronic device
A second display control means for displaying data as an image on the display surface of the display panel of the second electronic device when transmitting data to the first electronic device in the facing state;
Second receiving means for receiving the data signal and the reference signal for synchronizing with the second electronic device when transmitting the data signal from the first electronic device in the facing state;
Determining means for determining whether or not the reference signals before and after the data signal have the same magnitude in one frame of data received by the second receiving means;
A communication system comprising invalidating means for invalidating the received data signal when the judging means judges that the sizes are not the same. A display control method in an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface,
An electronic device that is a communication partner with the own device and that has a display panel with a plurality of optical sensors built in along the display surface is the counterpart device, and the display surface of the counterpart device and the display surface of the own device If the state of facing is the facing state,
When transmitting data to the counterpart device in the facing state, a display control step of displaying the data as an image on the display surface of the display panel of the own device;
Receiving the data displayed as an image on the display surface of the display panel of the counterpart device in the facing state via the optical sensor of the own device,
The display control step includes:
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the device, and the data included in each frame of the data to be transmitted is a data signal. When displaying a plurality of reference signals for synchronizing with the counterpart device as an image on the display surface of the display panel of the device,
Further, in each of the frames, the plurality of reference signals have the same form, and in at least two consecutive frames of the plurality of frames, the reference signal is formed in a form different for each frame, A display control method for displaying a data signal and the reference signal in this order on the display surface of the device. A display control method in an electronic device including a display panel in which a plurality of optical sensors are built in along a display surface,
An electronic device that is a communication partner with the own device and that has a display panel with a plurality of optical sensors built in along the display surface is the counterpart device, and the display surface of the counterpart device and the display surface of the own device If the state of facing is the facing state,
When transmitting data to the counterpart device in the facing state, a display control step of displaying the data as an image on the display surface of the display panel of the own device;
Receiving the data displayed as an image on the display surface of the display panel of the counterpart device in the facing state via the optical sensor of the own device,
The display control step includes:
The data to be transmitted is divided into a plurality of frames and displayed as an image on the display surface of the display panel of the device, and the data included in each frame of the data to be transmitted is a data signal. When displaying a plurality of reference signals for synchronizing with the counterpart device as an image on the display surface of the display panel of the device,
Further, in each frame, the plurality of reference signals have the same magnitude, and in at least two consecutive frames of the plurality of frames, the reference signals have different magnitudes for each frame, and the reference signals of each frame And the data signal and the reference signal are displayed on the display surface of the device in this order. The program for making a computer perform the method of Claim 5 or 6 .

Images