JP2010152696A - Electronic apparatus, screen switching method and screen switching program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing apparatus that can implement handwriting recognition while effectively using a plurality of screens. <P>SOLUTION: An electronic apparatus 100 includes a liquid crystal panel 140 functioning as a first display part, and a liquid crystal panel 240 functioning as a second display part. The liquid crystal panel 140 and liquid crystal panel 240 each have a built-in optical sensor and can receive an external input. When the liquid crystal panel 240 receives a trigger input for the creation of an input area for receiving a pattern input, the electronic apparatus 100 creates an input area on the liquid crystal panel 240. The electronic apparatus 100 also displays a screen displayed on the liquid crystal panel 240 at the trigger input on the liquid crystal panel 140. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an electronic device, a screen switching method for the electronic device, and a screen switching program.

  Currently, various information processing apparatuses are widespread. As typical information processing apparatuses, there are personal information terminals such as personal computers, mobile phones, and PDAs (Personal Digital Assistants).

  In recent years, information processing apparatuses having a plurality of display screens have been developed. An information processing apparatus having an input device (display integrated input device) combined with a display screen has also been developed. For example, some recent electronic dictionaries have a sub-screen for handwriting recognition in addition to a normal screen.

Patent Document 1 (International Publication No. 2005/091117 pamphlet) includes an information processing device including a first display area, a second display area, and an input device (for example, a touch panel) provided in the second display area. An apparatus is disclosed. The information processing apparatus disclosed in Patent Literature 1 displays a plurality of tabs respectively associated with a plurality of windows displayed in the first display area in the second display area. When the information processing apparatus determines that a predetermined input has been made on the tab, the information processing apparatus displays a window associated with the tab in the second display area.
International Publication No. 2005/091117 Pamphlet

  A conventional information processing apparatus including a plurality of display screens and a display-integrated input device has the following problems in performing handwriting recognition. The information processing apparatus described in Patent Literature 1 cannot perform handwriting recognition. This information processing apparatus uses the second display area combined with the input device for window display, and does not use it for handwriting recognition. On the other hand, information processing devices that use one screen for handwriting recognition, such as an electronic dictionary, have not been able to fully utilize the sub-screen as a display area.

  The present invention has been made to solve the above problems, and an object thereof is to provide an information processing apparatus capable of performing handwriting recognition while effectively using a plurality of screens.

  According to one aspect of the present invention, an electronic device is a display that displays a first screen, a display-integrated tablet that displays a second screen and can accept input from the outside, and a display And a control means for controlling the operation of the display-integrated tablet. When the control-integrated tablet receives a trigger input that instructs creation of an input area that accepts an external pattern input, the display-integrated tablet And an area creation means for creating an input area and a screen switching means for displaying a second screen at the time of trigger input on the display in response to the trigger input.

  Preferably, when the screen switching unit receives an instruction to end pattern input to the input area, the screen switching unit displays the second screen at the time of trigger input on the display-integrated tablet.

  More preferably, when receiving the end instruction, the screen switching means displays the second screen and the input area at the time of trigger input on the display-integrated tablet.

  More preferably, when receiving the end instruction, the screen switching means superimposes the input area on the second screen at the time of trigger input and displays it on the display-integrated tablet.

  More preferably, when receiving the end instruction, the screen switching means displays the second screen at the time of trigger input on the display-integrated tablet so as to go around the input area.

  More preferably, when the screen switching means receives the end instruction, the screen switching means displays the first screen at the time of trigger input on the display.

  More preferably, the screen switching means displays a menu screen including a menu for performing an operation utilizing pattern input on the display when receiving the end instruction.

  More preferably, when the display-integrated tablet displays a menu screen including a menu for performing an operation using pattern input when a trigger is input, the screen switching means displays the menu screen on the display when an end instruction is received. To do.

  Preferably, after the input area is created, the area creating means creates a new input area when an area of the display-integrated tablet excluding the input area receives an input.

Preferably, the display-integrated tablet is a liquid crystal panel with a built-in optical sensor.
According to another aspect of the present invention, an electronic device having a display that displays a first screen, a display-integrated tablet that displays a second screen, and can accept an input from the outside, and a control unit. When the display integrated method receives a trigger input instructing creation of an input area that accepts pattern input from the outside, the control unit creates an input area in the display integrated tablet, and triggers. In response to the input, the control unit includes a step of displaying on the display a second screen when the trigger is input.

  According to still another aspect of the present invention, an electronic apparatus having a display that displays a first screen, a display-integrated tablet that displays a second screen and can accept an input from the outside, and a control unit. Is a screen switching program that allows the display unit to perform screen switching, and when the display-integrated tablet receives a trigger input instructing creation of an input area that accepts an external pattern input, the control unit inputs the display-integrated tablet A step of creating an area, and a step of causing the control unit to display a second screen at the time of trigger input on a display in response to the trigger input.

  An electronic apparatus according to the present invention includes a display that functions as a first display unit and a display-integrated tablet that functions as a second display unit. When the display-integrated tablet receives a trigger input that instructs the creation of an input area that accepts pattern input, the electronic device creates an input area on the display-integrated tablet and the display-integrated tablet displays the trigger input. Display the screen on the display. As a result, according to the present invention, handwriting recognition can be performed while effectively using a plurality of screens.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

[First Embodiment]
<Appearance of electronic equipment>
FIG. 1 is a diagram illustrating an appearance of an electronic device 100 according to the first embodiment. Referring to FIG. 1, electronic device 100 includes a first housing 100A and a second housing 100B. The first casing 100A and the second casing 100B are connected to each other so as to be foldable by a hinge. However, the electronic device 100 is not necessarily limited to the folding type. For example, the electronic device 100 may be a sliding device configured such that the first housing 100A slides with respect to the second housing 100B. Alternatively, the positional relationship between the first housing 100A and the second housing 100B may be fixed.

  The first housing 100A includes a liquid crystal panel 140 with a built-in optical sensor. The second housing 100B includes an optical sensor built-in liquid crystal panel 240. As described above, the electronic device 100 includes two optical sensor built-in liquid crystal panels.

  The electronic device 100 is configured as a portable device having a display function such as a PDA (Personal Digital Assistant), a notebook personal computer, or an electronic dictionary.

<About hardware configuration>
Next, an aspect of a specific configuration of the electronic device 100 will be described with reference to FIG. FIG. 2 is a block diagram illustrating a hardware configuration of electronic device 100. The electronic device 100 includes a main body device 101, a display device 102, and a display device 103 as main components.

  The first housing 100A includes a display device 102. The second housing 100B includes a main body device 101 and a display device 103. Note that the electronic device 100 may include the main body device 101 in the first housing 100A instead of the second housing 100B.

  The main unit 101 includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 171, a ROM (Read-Only Memory) 172, a memory card reader / writer 173, a communication unit 174, a microphone 175, and a speaker. 176 and operation keys 177 are included. Each component is connected to each other by a data bus DB1. A memory card 1731 is attached to the memory card reader / writer 173.

  CPU 110 executes a program. The operation key 177 receives an instruction input from the user of the electronic device 100. The RAM 171 stores data generated by the execution of the program by the CPU 110 or data input via the operation keys 177 in a volatile manner. The ROM 172 stores data in a nonvolatile manner. The ROM 172 is a ROM capable of writing and erasing data such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory. The communication unit 174 performs wireless communication with other electronic devices (not shown). Although not illustrated in FIG. 2, the electronic device 100 may include an interface (IF) for connecting to another electronic device by wire.

  The display device 102 includes a driver 130, an optical sensor built-in liquid crystal panel 140 (hereinafter referred to as a liquid crystal panel 140), an internal IF 178, a backlight 179, and an image processing engine 180.

  The driver 130 is a drive circuit for driving the liquid crystal panel 140 and the backlight 179. Various drive circuits included in the driver 130 will be described later.

  The liquid crystal panel 140 is a device having a liquid crystal display function and a photosensor function. That is, the liquid crystal panel 140 can perform image display using liquid crystal and sensing using an optical sensor. Details of the liquid crystal panel 140 will be described later.

  An internal IF (Interface) 178 mediates exchange of data between the main device 101 and the display device 102.

  The backlight 179 is a light source disposed on the back surface of the liquid crystal panel 140. The backlight 179 irradiates the back surface with uniform light.

  The image processing engine 180 controls the operation of the liquid crystal panel 140 via the driver 130. Here, the control is performed based on various data sent from the main apparatus 101 via the internal IF 178. Note that the various data includes commands to be described later. Further, the image processing engine 180 processes data output from the liquid crystal panel 140 and sends the processed data to the main apparatus 101 via the internal IF 178. Further, the image processing engine 180 includes a driver control unit 181, a timer 182, and a signal processing unit 183.

  The driver control unit 181 controls the operation of the driver 130 by sending a control signal to the driver 130. In addition, the driver control unit 181 analyzes a command transmitted from the main device 101. Then, the driver control unit 181 sends a control signal based on the analysis result to the driver 130. Details of the operation of the driver 130 will be described later.

The timer 182 generates time information and sends the time information to the signal processing unit 183.
The signal processing unit 183 receives data output from the optical sensor. Here, since the data output from the optical sensor is analog data, the signal processing unit 183 first converts the analog data into digital data. Further, the signal processing unit 183 performs data processing on the digital data in accordance with the content of the command sent from the main device 101. Then, the signal processing unit 183 sends data (hereinafter referred to as response data) including data after the above data processing and time information acquired from the timer 182 to the main unit 101. The signal processing unit 183 includes a RAM (not shown) that can store a plurality of scan data, which will be described later, continuously.

  The command includes a sensing command for instructing sensing by the optical sensor. Details of the sensing command and the response data will be described later (FIGS. 7 to 9).

  Note that the timer 182 is not necessarily provided in the image processing engine 180. For example, the timer 182 may be provided outside the image processing engine 180 in the display device 102. Alternatively, the timer 182 may be provided in the main body device 101. Further, the microphone 175 and the speaker 176 are not always provided in the electronic device 100, and may be configured so as not to include either or both of the microphone 175 and the speaker 176 depending on the embodiment of the electronic device 100.

  Here, the display device 102 includes a system liquid crystal. The system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 140 on the glass substrate of the liquid crystal panel 140. In the present embodiment, the driver 130 (excluding the circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are integrally formed on the glass substrate of the liquid crystal panel 140. Note that the display device 102 is not necessarily configured using a system liquid crystal, and the driver 130 (excluding a circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are included in the glass substrate. Other substrates may be configured.

  The display device 103 includes a driver 230, an optical sensor built-in liquid crystal panel 240 (hereinafter referred to as “liquid crystal panel 240”), an internal IF 278, a backlight 279, and an image processing engine 280. The image processing engine 280 includes a driver control unit 281, a timer 282, and a signal processing unit 283.

  The display device 103 has the same configuration as the display device 102. That is, the driver 230, the liquid crystal panel 240, the internal IF 278, the backlight 279, and the image processing engine 280 have the same configuration as the driver 130, the liquid crystal panel 140, the internal IF 178, the backlight 179, and the image processing engine 180 in the display device 102. Have each. The driver control unit 281, the timer 282, and the signal processing unit 283 have the same configurations as the driver control unit 181, the timer 182, and the signal processing unit 183 in the display device 102. Therefore, description of each functional block included in display device 103 will not be repeated.

  By the way, the processing in the electronic device 100 is realized by each hardware and software executed by the CPU 110. Such software may be stored in the ROM 172 in advance. The software may be stored in a memory card 1731 or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the memory card reader / writer 173 or other reading device, or downloaded via the communication unit 174 or communication IF (not shown), and then temporarily stored in the ROM 172. The The software is read from the ROM 172 by the CPU 110 and stored in the RAM 171 in the form of an executable program. CPU 110 executes the program.

  Each component constituting the main device 101 of the electronic device 100 shown in FIG. 2 is a general one. Therefore, it can be said that the essential part of the present invention is the software stored in the RAM 171, the ROM 172, the memory card 1731 and other storage media, or the software downloadable via the network. Since the hardware operation of main device 101 of electronic device 100 is well known, detailed description will not be repeated.

  The storage medium is not limited to a memory card, but is a CD-ROM, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile). Disc)), IC (Integrated Circuit) cards (excluding memory cards), optical cards, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), flash ROM, and other semiconductor memories, etc. It may be a medium to be used.

  The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<Configuration and drive of liquid crystal panel with built-in optical sensor>
Next, the configuration of the liquid crystal panel 140 and the configuration of peripheral circuits of the liquid crystal panel 140 will be described. FIG. 3 is a diagram showing a configuration of the liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140.

  Referring to FIG. 3, the liquid crystal panel 140 includes a pixel circuit 141, an optical sensor circuit 144, a scanning signal line Gi, a data signal line SRj, a data signal line SGj, a data signal line SBj, and a sensor signal line. SSj, sensor signal line SDj, read signal line RWi, and reset signal line RSi are included. Note that i is a natural number satisfying 1 ≦ i ≦ m, and j is a natural number satisfying 1 ≦ j ≦ n.

  2 includes a scanning signal line driving circuit 131, a data signal line driving circuit 132, an optical sensor driving circuit 133, a switch 134, as peripheral circuits of the liquid crystal panel 140. And an amplifier 135.

  The scanning signal line drive circuit 131 receives the control signal TC1 from the driver control unit 181 shown in FIG. The scanning signal line drive circuit 131 applies a predetermined voltage in order from the scanning signal line G1 to each scanning signal line (G1 to Gm) based on the control signal TC1. More specifically, the scanning signal line driving circuit 131 sequentially selects one scanning signal line from the scanning signal lines (G1 to Gm) per unit time, and a TFT (to be described later) with respect to the selected scanning signal line. A voltage capable of turning on the gate of the thin film transistor 142 is applied (hereinafter referred to as a high level voltage). Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.

  The data signal line driving circuit 132 receives image data (DR, DG, DB) from the driver control unit 181 shown in FIG. The data signal line driving circuit 132 applies a voltage corresponding to one row of image data to the 3n data signal lines (SR1 to SRn, SG1 to SGn, SB1 to SBn) for each unit time. Apply sequentially.

  Note that although a driving method called a so-called line-sequential method has been described here, the driving method is not limited to this.

  The pixel circuit 141 is a circuit for setting the luminance (transmittance) of one pixel. Further, m × n pixel circuits 141 are arranged in a matrix. More specifically, m pixel circuits 141 are arranged in the vertical direction in FIG. 3 and n pixel circuits in the horizontal direction.

  The pixel circuit 141 includes an R subpixel circuit 141r, a G subpixel circuit 141g, and a B subpixel circuit 141b. Each of these three circuits (141r, 141g, 141b) includes a TFT 142, a pair of electrode pairs 143 including a pixel electrode and a counter electrode, and a capacitor (not shown).

  In addition, CMOS (Complementary Metal Oxide Semiconductor) capable of forming n-type transistors and p-type transistors can be realized, and the movement speed of carriers (electrons or holes) is several hundreds compared to amorphous silicon thin film transistors (a-Si TFTs). For example, a polycrystalline silicon thin film transistor (p-Si TFT) is used as the TFT 142 in the display device 102 because it is twice as fast. Note that the TFT 142 will be described as an n-channel field effect transistor. However, the TFT 142 may be a p-type channel field effect transistor.

  The source of the TFT 142 in the R subpixel circuit 141r is connected to the data signal line SRj. The gate of the TFT 142 is connected to the scanning signal line Gi. Further, the drain of the TFT 142 is connected to the pixel electrode of the electrode pair 143. A liquid crystal is disposed between the pixel electrode and the counter electrode. The G sub-pixel circuit 141g and the B sub-pixel circuit 141b have the same configuration as the R sub-pixel circuit 141r except that the data signal line to which the source of each TFT 142 is connected is different. Therefore, description of these two circuits (141g, 141b) will not be repeated.

  Here, setting of luminance in the pixel circuit 141 will be described. First, the high level voltage is applied to the scanning signal line Gi. By the application of the high level voltage, the gate of the TFT 142 is turned on. In this manner, with the gate of the TFT 142 turned on, a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line (SRj, SGj, SBj). Thereby, a voltage based on the designated voltage is applied to the pixel electrode. As a result, a potential difference is generated between the pixel electrode and the counter electrode. Based on this potential difference, the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. Note that the potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.

  The optical sensor drive circuit 133 receives the control signal TC2 from the driver control unit 181 shown in FIG.

  Then, the optical sensor drive circuit 133 sequentially selects one signal line from the reset signal lines (RS1 to RSm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, the voltage VDDR that is higher than usual is applied. Note that a voltage VSSR lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line. For example, the voltage VDDR may be set to 0V and the voltage VSSR may be set to −5V.

  Further, the optical sensor driving circuit 133 sequentially selects one signal line from the readout signal lines (RW1 to RWm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, a voltage VDD higher than usual is applied. Note that the voltage VSSR is applied to the read signal line that is not selected. For example, the value of VDD may be set to 8V.

  The timing for applying the voltage VDDR and the timing for applying the voltage VDD will be described later.

  The optical sensor circuit 144 includes a photodiode 145, a capacitor 146, and a TFT 147. In the following description, it is assumed that the TFT 147 is an n-type channel field effect transistor. However, the TFT 147 may be a p-type channel field effect transistor.

  The anode of the photodiode 145 is connected to the reset signal line RSi. On the other hand, the cathode of the photodiode 145 is connected to one electrode of the capacitor 146. The other electrode of the capacitor 146 is connected to the read signal line RWi. Hereinafter, a connection point between the photodiode 145 and the capacitor 146 is referred to as a node N.

  The gate of the TFT 147 is connected to the node N. The drain of the TFT 147 is connected to the sensor signal line SDj. Further, the source of the TFT 147 is connected to the sensor signal line SSj. Details of sensing using the optical sensor circuit 144 will be described later.

  The switch 134 is a switch provided to switch whether or not to apply a predetermined voltage to the sensor signal lines (SD1 to SDn). The switching operation of the switch 134 is performed by the optical sensor driving circuit 133. Note that the voltage applied to the sensor signal lines (SD1 to SDn) when the switch 134 is turned on will be described later.

  The amplifier 135 amplifies the voltage output from each sensor signal line (SS1 to SSn). The amplified voltage is sent to the signal processing unit 183 shown in FIG.

  The image processing engine 180 controls the timing for displaying an image on the liquid crystal panel 140 using the pixel circuit 141 and the timing for sensing using the optical sensor circuit 144.

  FIG. 4 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179. Referring to FIG. 4, liquid crystal panel 140 includes an active matrix substrate 151A, a counter substrate 151B, and a liquid crystal layer 152. The counter substrate 151B is disposed to face the active matrix substrate 151A. The liquid crystal layer 152 is sandwiched between the active matrix substrate 151A and the counter substrate 151B. The backlight 179 is disposed on the opposite side of the liquid crystal layer 152 with respect to the active matrix substrate 151A.

  The active matrix substrate 151 </ b> A includes a polarizing filter 161, a glass substrate 162, a pixel electrode 143 a that constitutes the electrode pair 143, a photodiode 145, a data signal line 157, and an alignment film 164. Further, although not shown in FIG. 4, the active matrix substrate 151A includes the capacitor 146, the TFT 147, the TFT 142, and the scanning signal line Gi shown in FIG.

  In the active matrix substrate 151A, the polarizing filter 161, the glass substrate 162, the pixel electrode 143a, and the alignment film 164 are arranged in this order from the backlight 179 side. The photodiode 145 and the data signal line 157 are formed on the liquid crystal layer 152 side of the glass substrate 162.

  The counter substrate 151B includes a polarizing filter 161, a glass substrate 162, a light shielding film 163, color filters (153r, 153g, 153b), a counter electrode 143b constituting the electrode pair 143, and an alignment film 164.

  In the counter substrate 151B, the alignment film 164, the counter electrode 143b, the color filters (153r, 153g, 153b), the glass substrate 162, and the polarizing filter 161 are arranged in this order from the liquid crystal layer 152 side. The light shielding film 163 is formed in the same layer as the color filters (153r, 153g, 153b).

  The color filter 153r is a filter that transmits light having a red wavelength. The color filter 153g is a filter that transmits light having a green wavelength. The color filter 153b is a filter that transmits light having a blue wavelength. Here, the photodiode 145 is arranged at a position facing the color filter 153b.

  The liquid crystal panel 140 displays an image by blocking external light or light emitted from a light source such as a backlight 179 or transmitting the light. Specifically, the liquid crystal panel 140 changes the direction of liquid crystal molecules in the liquid crystal layer 152 by applying a voltage between the pixel electrode 143a and the counter electrode 143b, thereby blocking or transmitting the light. However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 161 that transmits only light having a specific polarization direction is provided.

  Note that the position of the photodiode 145 is not limited to the above position, and may be provided at a position facing the color filter 153r or a position facing the color filter 153g.

  Here, the operation of the optical sensor circuit 144 will be described. FIG. 5 is a diagram showing a timing chart when the optical sensor circuit 144 is operated. In FIG. 5, a voltage VINT indicates a potential at the node N in the photosensor circuit 144. A voltage VPIX is an output voltage from the sensor signal line SSj shown in FIG. 3 and is a voltage before being amplified by the amplifier 135.

  The following description will be divided into a reset period for resetting the optical sensor circuit 144, a sensing period for sensing light using the optical sensor circuit 144, and a readout period for reading the sensed result.

  First, the reset period will be described. In the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDDR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR). As described above, by applying the high-level voltage to the reset signal line RSi, a current starts to flow in the forward direction (from the anode side to the cathode side) of the photodiode 145. As a result, the voltage VINT which is the potential of the node N has a value represented by the following expression (1). In Equation (1), the forward voltage drop amount in the photodiode 145 is Vf.

VINT = VSSR + | VDDR−VSSR | −Vf (1)
Therefore, the potential of the node N is a value smaller by Vf than the voltage VDDR as shown in FIG.

  Here, since the voltage VINT is not more than the threshold value for turning on the gate of the TFT 147, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change. Further, a difference corresponding to the voltage VINT occurs between the electrodes of the capacitor 146. For this reason, the capacitor 146 accumulates charges corresponding to the difference.

  Next, the sensing period will be described. In the sensing period following the reset period, the voltage applied to the reset signal line RSi instantaneously switches from the high level (voltage VDDR) to the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).

  Thus, by changing the voltage applied to the reset signal line RSi to the low level, the potential of the node N becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi. For this reason, in the photodiode 145, the voltage on the cathode side becomes higher than the voltage on the anode side. That is, the photodiode 145 is in a reverse bias state. In such a reverse bias state, when the photodiode 145 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 145. As a result, as shown in FIG. 5, the potential of the node N (that is, the voltage VINT) becomes lower with the passage of time.

  Since the voltage VINT continues to decrease in this way, the gate of the TFT 147 does not turn on. Therefore, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change.

  Next, the reading period will be described. In the readout period following the sensing period, the voltage applied to the reset signal line RSi is kept at the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDD). Here, the voltage VDD is higher than the voltage VDDR.

  Thus, by applying a high level voltage instantaneously to the read signal line RWi, the potential of the node N is raised through the capacitor 146 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi. Here, since the potential of the node N (that is, the voltage VINT) is raised to a threshold value that turns on the gate of the TFT 147, the gate of the TFT 147 is turned on.

  At this time, if a constant voltage is applied in advance to the sensor signal line SDj (see FIG. 3) connected to the drain side of the TFT 147, the sensor signal line SSj connected to the source side of the TFT 147 will cause the VPIX in FIG. As shown in the graph, a voltage corresponding to the potential of the node N is output.

  Here, when the amount of light received by the photodiode 145 (hereinafter referred to as the amount of received light) is small, the slope of the straight line shown in the VINT graph of FIG. 5 becomes gentle. As a result, the voltage VPIX is higher than when the amount of received light is large. As described above, the optical sensor circuit 144 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 145.

  By the way, in the above, the operation | movement was demonstrated paying attention to one optical sensor circuit 144 among the m * n optical sensor circuits which exist. Below, operation | movement of each photosensor circuit in the liquid crystal panel 140 is demonstrated.

  First, the optical sensor drive circuit 133 applies a predetermined voltage to all n sensor signal lines (SD1 to SDn). Next, the photosensor drive circuit 133 applies a voltage VDDR that is higher than normal to the reset signal line RS1. The other reset signal lines (RS2 to RSm) and read signal lines (RW1 to RWm) are kept in a state where a low level voltage is applied. As a result, the n photosensor circuits in the first row in FIG. 3 enter the reset period described above. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.

  Note that the timing at which a predetermined voltage is applied to all n sensor signal lines (SD1 to SDn) is not limited to the above timing, and may be any timing that is applied at least before the readout period. .

  When the readout period of the n photosensor circuits in the first row is completed, the photosensor drive circuit 133 applies a voltage VDDR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.

  Thereafter, the processing described above is sequentially performed on the n photosensor circuits in the third row, the n photosensor circuits in the fourth row,..., The n photosensor circuits in the m row. As a result, the sensing result of the first row, the sensing result of the second row,..., The sensing result of the m-th row are output in this order from the sensor signal lines (SS1 to SSn).

  In the display device 102, sensing is performed for each row as described above, and a sensing result is output from the liquid crystal panel 140 for each row. For this reason, hereinafter, the data after the signal processing unit 183 performs the above-described data processing on the data regarding the voltage for m rows from the first row to the m-th row output from the liquid crystal panel 140, This is called “scan data”. That is, scan data refers to image data obtained by scanning a scan target (for example, a user's finger). An image displayed based on the scan data is referred to as a “scanned image”. Further, in the following, sensing is referred to as “scan”.

  Moreover, in the above, although the structure which scans using all the m * n photosensor circuits was mentioned as an example, it is not limited to this. Scanning may be performed on a partial region of the surface of the liquid crystal panel 140 using a photosensor circuit selected in advance.

  In the following, it is assumed that the electronic device 100 can take either of the two configurations. Further, switching between the components is assumed to be performed by a command sent from the main device 101 based on an input via the operation key 177 or the like. Note that when scanning is performed on a partial area on the surface of the liquid crystal panel 140, the image processing engine 180 sets a scan target area. The setting of the area may be configured to be specified by the user via the operation key 177.

  As described above, when scanning is performed on a partial region of the surface of the liquid crystal panel 140, there are the following modes of use for displaying an image. The first is a mode in which an image is displayed in a surface area other than the partial area (hereinafter referred to as a scan area). The second is a mode in which no image is displayed in the surface area other than the scan area. Which mode is used is based on a command sent from the main apparatus 101 to the image processing engine 180.

  FIG. 6 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179, showing a configuration in which the photodiode 145 receives light from the backlight 179 during scanning.

  Referring to FIG. 6, when the user's finger 900 is in contact with the surface of the liquid crystal panel 140, a part of the light emitted from the backlight 179 is part of the user's finger 900 (abbreviated in the contacted area). Reflected on the plane). The photodiode 145 receives the reflected light.

  Even in a region where the finger 900 is not in contact, part of the light emitted from the backlight 179 is reflected by the user's finger 900. Even in this case, the photodiode 145 receives the reflected light. However, since the finger 900 is not in contact with the surface of the liquid crystal panel 140 in the region, the amount of light received by the photodiode 145 is smaller than the region in which the finger 900 is in contact. Note that the photodiode 145 cannot receive most of the light emitted from the backlight 179 that does not reach the user's finger 900.

  Here, by turning on the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the amount of light reflected by the user's finger 900 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

  As described above, the display device 102 can scan an image (hereinafter, also referred to as a reflected image) obtained by reflecting light with the finger 900.

Note that examples of the scan object other than the finger 900 include a stylus.
By the way, in the present embodiment, a liquid crystal panel is described as an example of the display device of electronic device 100, but another panel such as an organic EL (Electro-Luminescence) panel is used instead of the liquid crystal panel. Also good.

<About data>
Next, the sensing command will be described. In the display device 102, the image processing engine 180 analyzes the content of the sensing command and sends back data (that is, response data) according to the analysis result to the main body device 101.

  FIG. 7 is a diagram showing a schematic configuration of a sensing command. Referring to FIG. 7, the sensing command includes a header data area DA01, a timing data area DA02, a data type data area DA03, a reading method data area DA04, and image gradation data. An area DA05, a data area DA06 indicating resolution, and a spare data area DA07 are included.

  FIG. 8 is a diagram showing data values in each area of the sensing command and the meaning contents indicated by the values.

  Referring to FIG. 8, the sensing command in which “00” is set in the data area indicating the timing requests image processing engine 180 to transmit scan data at that time. That is, the sensing command requests transmission of scan data obtained by scanning using the optical sensor circuit 144 after the image processing engine 180 receives the sensing command. A sensing command in which “01” is set in the data area indicating the timing requests transmission of scan data when the scan result has changed. Furthermore, a sensing command in which “10” is set in the data area indicating the timing requests transmission of scan data at regular intervals.

  A sensing command in which “001” is set in the data area indicating the data type requests transmission of the coordinate value of the center coordinate in the partial image. In addition, a sensing command in which “010” is set in the data area indicating the data type requests transmission of only a partial image whose scan result has changed. Note that the change in the scan result indicates that the previous scan result is different from the current scan result. Further, a sensing command in which “100” is set in the data area indicating the data type requests transmission of the entire image.

  Here, the “entire image” is an image generated by the image processing engine 180 based on the voltage output from each photosensor circuit when scanning using m × n photosensor circuits. . The “partial image” is a part of the entire image. The reason why the partial image is requested to transmit only the partial image whose scan result has changed will be described later.

  The coordinate value and the partial image or the entire image may be requested at the same time. Further, in the case of a configuration in which scanning is performed on a partial area on the surface of the liquid crystal panel 140, the entire image is an image corresponding to the area to be scanned.

  A sensing command in which “00” is set in the data area indicating the reading method requests to scan with the backlight 179 on. A sensing command in which “01” is set in the data area indicating the reading method requests scanning with the backlight 179 off. A configuration for scanning with the backlight 179 off is described later (FIG. 12). Furthermore, a sensing command in which “10” is set in the data area indicating the reading method requests scanning using both reflection and transmission. Note that the combined use of reflection and transmission refers to scanning a scan object by switching between a method in which the backlight 179 is turned on for scanning and a method in which the backlight is turned off for scanning.

  A sensing command in which “00” is set in the data area indicating the image gradation requests monochrome image data of black and white. A sensing command in which “01” is set in the data area indicating the image gradation requests multi-gradation image data. Furthermore, a sensing command in which “10” is set in the data area indicating the image gradation requests RGB color image data.

  A sensing command in which “0” is set in the data area indicating the resolution requests image data with a high resolution. A sensing command in which “1” is set in the data area indicating the resolution requests image data with a low resolution.

  In addition to the data shown in FIG. 7 and FIG. 8, the sensing command includes designation of an area to be scanned (area of pixels that drive the optical sensor circuit 144), timing to perform scanning, and timing to turn on the backlight 179. Etc. are described.

  FIG. 9 is a diagram showing a schematic configuration of response data. The response data is data corresponding to the content of the sensing command, and is data that the image processing engine 180 of the display device 102 transmits to the main body device 101.

  Referring to FIG. 9, the response data includes a header data area DA11, a coordinate data area DA12, a time data area DA13, and an image data area DA14. Here, the value of the center coordinates of the partial image is written in the data area DA12 indicating the coordinates. In addition, time information acquired from the timer 182 of the image processing engine 180 is written in the data area indicating the time. Further, image data (that is, scan data) after being processed by the image processing engine 180 is written in the data area indicating the image.

  FIG. 10 is a diagram illustrating an image obtained by scanning the finger 900 (that is, a scanned image). Referring to FIG. 10, an image of a region W1 surrounded by a thick solid line is an entire image, and an image of a region P1 surrounded by a broken line is a partial image. The center point C1 of the cross indicated by a thick line is the center coordinate.

  In the present embodiment, a pixel (that is, a predetermined gradation or a pixel having a photosensor circuit which is a rectangular region and whose output voltage from the sensor signal line SSj is equal to or higher than a predetermined value). An area including all of the pixels having a luminance equal to or higher than a predetermined luminance is set as a partial image area.

  The center coordinates are coordinates determined in consideration of the gradation of each pixel in the partial image area. Specifically, for each pixel in the partial image, the center coordinate is determined by performing a weighting process based on the gradation of the pixel and the distance between the pixel and the rectangular center point (that is, the centroid). Is done. That is, the center coordinates do not necessarily match the centroid of the partial image.

  However, the position of the center coordinates is not necessarily limited to the above, and the center coordinates may be the coordinates of the centroid or the coordinates near the centroid.

  When “001” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate. In this case, the image processing engine 180 does not write image data in the data area DA14 indicating an image. After writing the value of the center coordinate, the image processing engine 180 sends response data including the value of the center coordinate to the main body device 101. As described above, when “001” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate without requesting the output of the image data.

  Further, when “010” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the image data of the partial image whose scan result has changed in the data area DA14 indicating the image. . In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. The image processing engine 180 writes the image data of the partial image whose scan result has changed, and then sends response data including the image data of the partial image to the main body device 101. As described above, when “010” is set in the data area indicating the data type, the sensing command does not request the output of the value of the center coordinate, and the image data of the partial image whose scan result has changed. Request output.

  As described above, the reason for requesting transmission of only the partial image whose scan result has changed is that the scan data of the partial image area of the scan data is more important than the scan data of the other area. This is because the data is high, and the scan data in the region corresponding to the region of the partial image in the scan data is likely to change due to the contact state with the scan object such as the finger 900.

  When “011” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. The image data of the partial image whose scan result has changed is written in DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the partial image to the main body device 101. As described above, when “011” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the partial image whose scan result has changed. To do.

  If “100” is set in the data area indicating the data type of the sensing command, the image processing engine 180 displays the image of the entire image in the data area DA14 indicating the image of the response data shown in FIG. Write data. In this case, the image processing engine 180 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. After writing the image data of the entire image, the image processing engine 180 sends response data including the image data of the entire image to the main body device 101. As described above, when “100” is set in the data area indicating the data type, the sensing command requests the output of the image data of the entire image without requesting the output of the value of the center coordinate.

  When “101” is set in the data area indicating the data type of the sensing command, the image processing engine 180 writes the value of the central coordinate in the data area DA12 indicating the coordinate and also displays the data area indicating the image. Write the image data of the entire image to DA14. Thereafter, the image processing engine 180 sends response data including the value of the center coordinate and the image data of the entire image to the main body device 101. As described above, when “101” is set in the data area indicating the data type, the sensing command requests the output of the value of the center coordinate and the output of the image data of the entire image.

<Regarding First Modification of Configuration>
By the way, the structure of the liquid crystal panel 140 is not limited to the structure shown in FIG. Hereinafter, a liquid crystal panel having a mode different from that in FIG. 3 will be described.

  FIG. 11 is a circuit diagram of a photosensor built-in liquid crystal panel 140A according to the different embodiment. Referring to FIG. 11, photosensor built-in liquid crystal panel 140A (hereinafter referred to as liquid crystal panel 140A) includes three photosensor circuits (144r, 144g, 144b) in one pixel. Thus, the liquid crystal panel 140A is different from the liquid crystal panel 140 including one photosensor circuit in one pixel in that the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, and 144b) in one pixel. The configuration of the optical sensor circuit 144 is the same as that of each of the three optical sensor circuits (144r, 144g, 144b).

  Further, the three photodiodes (145r, 145g, 145b) in one pixel are arranged at positions facing the color filter 153r, the color filter 153g, and the color filter 153b, respectively. Therefore, the photodiode 145r receives red light, the photodiode 145g receives green light, and the photodiode 145b receives blue light.

  In addition, since the liquid crystal panel 140 includes only one photosensor circuit 144 in one pixel, two data signal lines for the TFT 147 disposed in one pixel are a sensor signal line SSj and a sensor signal line SDj. Met. However, since the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, 144b) in one pixel, there are six data signal lines for TFTs (147r, 147g, 147b) arranged in one pixel. It becomes.

  Specifically, the sensor signal line SSRj and the sensor signal line SDRj are arranged corresponding to the TFT 147r connected to the cathode of the photodiode 145r arranged at a position facing the color filter 153r. A sensor signal line SSGj and a sensor signal line SDGj are arranged corresponding to the TFT 147g connected to the cathode of the photodiode 145g arranged at a position facing the color filter 153g. Further, a sensor signal line SSBj and a sensor signal line SDBj are disposed corresponding to the TFT 147b connected to the cathode of the photodiode 145b disposed at a position facing the color filter 153b.

  In such a liquid crystal panel 140A, the white light emitted from the backlight 179 passes through the three color filters (153r, 153g, 153b), and red, green, and blue are displayed on the surface of the liquid crystal panel 140A. It mixes and becomes white light. Here, when white light is reflected by the scan object, a part of the white light is absorbed by the pigment on the surface of the scan object, and a part is reflected. And the reflected light permeate | transmits three color filters (153r, 153g, 153b) again.

  At this time, the color filter 153r transmits light having a red wavelength, and the photodiode 145r receives light having the red wavelength. The color filter 153g transmits light having a green wavelength, and the photodiode 145g receives light having the green wavelength. The color filter 153b transmits light having a blue wavelength, and the photodiode 145b receives light having the blue wavelength. That is, the light reflected by the scan object is separated into three primary colors (R, G, B) by three color filters (153r, 153g, 153b), and each photodiode (145r, 145g, 145b) The light of the color corresponding to is received.

  When a part of white light is absorbed by the pigment on the surface of the scan target, the amount of light received by each photodiode (145r, 145g, 145b) is different for each photodiode (145r, 145g, 145b). For this reason, the output voltages of the sensor signal line SSRj, the sensor signal line SSGj, and the sensor signal line SSBj are different from each other.

  Therefore, the image processing engine 180 determines the R gradation, the G gradation, and the B gradation according to each output voltage, so that the image processing engine 180 sends the RGB color image to the main body device 101. Can send.

  As described above, when the electronic apparatus 100 includes the liquid crystal panel 140A, the scan target can be scanned in color.

  Next, a scanning method different from the above-described scanning method (that is, the method of scanning the reflected image in FIG. 6) will be described with reference to FIG.

  FIG. 12 is a cross-sectional view showing a configuration in which a photodiode receives external light during scanning. As shown in FIG. 12, part of the outside light is blocked by the finger 900. Therefore, the photodiode disposed under the surface region of the liquid crystal panel 140 that is in contact with the finger 900 can hardly receive external light. In addition, although the photodiodes disposed under the surface area where the shadow of the finger 900 is formed can receive a certain amount of external light, the amount of external light received is small compared to the surface area where no shadow is formed.

  Here, by turning off the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the position of the finger 900 with respect to the surface of the liquid crystal panel 140 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140. The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

  As described above, the display device 102 can scan an image (hereinafter also referred to as a shadow image) obtained by blocking external light with the finger 900.

  Further, the display device 102 may be configured to perform scanning by turning on the backlight 179 and then performing scanning again by turning off the backlight 179. Alternatively, the display device 102 may be configured to perform scanning by turning off the backlight 179 and then performing scanning again by turning on the backlight 179.

  In this case, since two scanning methods are used together, two scan data can be obtained. Therefore, it is possible to obtain a highly accurate result as compared with the case of scanning using only one scanning method.

<About display devices>
The operation of the display device 103 is controlled in accordance with a command (for example, a sensing command) from the main body device 101 as in the operation of the display device 102. The display device 103 has the same configuration as the display device 102. Therefore, when the display device 103 receives the same command as the display device 102 from the main body device 101, the display device 103 performs the same operation as the display device 102. For this reason, description of the configuration and operation of the display device 103 will not be repeated.

  Note that the main device 101 can send commands having different commands to the display device 102 and the display device 103. In this case, the display device 102 and the display device 103 perform different operations. Further, the main device 101 may send a command to either the display device 102 or the display device 103. In this case, only one display device performs an operation according to the command. Further, the main device 101 may send a command having the same command to the display device 102 and the display device 103. In this case, the display device 102 and the display device 103 perform the same operation.

  Note that the size of the liquid crystal panel 140 of the display device 102 and the size of the liquid crystal panel 240 of the display device 103 may be the same or different. Further, the resolution of the liquid crystal panel 140 and the resolution of the liquid crystal panel 240 may be the same or different.

<Modification of hardware configuration>
In the present embodiment, a configuration in which electronic device 100 includes a liquid crystal panel with a built-in optical sensor such as liquid crystal panel 140 and liquid crystal panel 240 will be described. However, only one liquid crystal panel has a built-in photosensor. It may be.

  Further, the second casing 100B may include a combination of a resistive film type or capacitive type touch panel and a display, for example, instead of the liquid crystal panel 240 incorporating the optical sensor. The second casing 100B only needs to include a device (referred to as a display-integrated tablet) that can accept pattern input and has a display function.

  In this embodiment, the display device 102 includes the timer 182 and the display device 103 includes the timer 282. However, the display device 102 and the display device 103 may share one timer. .

<Functional configuration>
A functional configuration of the electronic apparatus 100 will be described with reference to FIG. FIG. 13 is a diagram illustrating a functional configuration of the electronic device 100 in a block diagram format. Referring to FIG. 13, electronic device 100 includes a first display unit 310, a second display unit 320, an input processing unit 330, a storage unit 340, a control unit 350, and an application execution unit 360. Prepare.

  The first display unit 310 displays information inside the electronic device 100 to the outside. In the present embodiment, the display device 102 installed on the first housing 100 </ b> A side corresponds to the first display unit 310.

  The second display unit 320 displays information inside the electronic device 100 to the outside. In this embodiment, the display device 103 installed on the second housing 100B side corresponds to the second display unit 320. Therefore, the second display unit 320 includes the liquid crystal panel 240 and the backlight 279. Since the second display unit 320 includes the liquid crystal panel 140, the second display unit 320 also functions as an input unit that receives an instruction from the outside.

  Based on the scan data obtained by the liquid crystal panel 140, the input processing unit 330 outputs coordinates (instruction coordinates) that are considered to have been instructed from the outside. For example, the input processing unit 330 outputs the center coordinates already described as instruction coordinates.

  Further, the input processing unit 330 determines whether or not the designated coordinates are within a handwriting input area described later. When the designated coordinates are outside the handwriting input area, the input processing unit 330 gives the designated coordinates to the control unit 350. On the other hand, the input processing unit 330 creates an input pattern 344 based on the designated coordinates in the handwriting input area.

  The storage unit 340 stores various information such as display data 342 and an input pattern 344. Display data 342 includes menu screen data 343. The menu screen data 343 is display data for a menu screen that displays an application in a selectable manner. Here, the application performs an operation using the input pattern. Examples of applications include a dictionary application and a search application that use input characters.

  The control unit 350 controls the operation of the entire electronic device 100 based on an instruction from the outside. The control unit 350 includes a display control unit 352, an input area creation unit 356, and a pattern recognition unit 358.

  The display control unit 352 controls the first display unit 310 and the second display unit 320 based on the designated coordinates, the display data 342, and the like, and displays a screen on the first display unit 310 and the second display unit 320. Display.

  The display control unit 352 includes a screen switching unit 354. The screen switching unit 354 updates the screens displayed by the first display unit 310 and the second display unit 320 in response to receiving the designated coordinates. Details of the operation of the display control unit 352 will be described later.

  The input area creation unit 356 controls the display control unit 352 so that the liquid crystal panel 140 displays an input area (handwriting input area) for receiving pattern input in response to receiving the designated coordinates. The input area creation unit 356 gives an instruction to switch the input reception mode of the input processing unit 330. In the input acceptance mode after switching (handwriting acceptance mode), the input processing unit 330 creates an input pattern 344 based on the designated coordinates to the input area.

  The pattern recognition unit 358 compares the input pattern 344 with a plurality of predetermined basic patterns, and determines that the input pattern 344 is one of the basic patterns. Specifically, for example, the pattern recognition unit 358 recognizes characters in the input pattern 344. The pattern recognition unit 358 gives the recognition result to the application execution unit 360.

  The application execution unit 360 activates an application such as a dictionary and a search, and operates the application based on the recognition result. In the present embodiment, the application execution unit 360 displays the execution result of the application on the first display unit 310. For example, the application execution unit 360 activates the dictionary application and causes the first display unit 310 to display a detailed display corresponding to the recognized character (s).

<Operation>
The operation of electronic device 100 according to the present embodiment will be described with reference to FIG. FIG. 14 is a diagram illustrating an example of the operation of the electronic device 100 according to the first embodiment.

  FIG. 14A is a diagram showing a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 while the dictionary application is activated. The liquid crystal panel 140 displays a menu screen. On the menu screen, a plurality of applications are shown to be selectable. Here, a Japanese language dictionary, an English-Japanese dictionary, and a Japanese-English dictionary are shown as applications. The liquid crystal panel 240 displays a screen created by the application. Here, the active application is a national language dictionary, and the liquid crystal panel 240 displays a screen (hereinafter referred to as a detailed screen) showing an explanation of a headword. Here, the headword is “Lake Caldera”.

  When the stylus 1000 touches the liquid crystal panel 240 in the state shown in FIG. 14A, the control unit 350 controls the liquid crystal panel 140 and the liquid crystal panel 240 to switch between these display screens. In particular, the control unit 350 causes the liquid crystal panel 240 to create an input area. That is, the control unit 350 regards the touch input to the liquid crystal panel 240 when the input area is not displayed as a trigger input that instructs creation of the input area. The touch input may be performed by an external object other than the stylus 1000, for example, a user's finger 900.

  FIG. 14B shows the screen after switching. FIG. 14B is a diagram illustrating a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 after the liquid crystal panel 240 is touched. Referring to FIG. 14B, liquid crystal panel 140 displays a screen that was displayed on liquid crystal panel 240 before the touch. That is, the screen switching unit 354 sets the display screen of the liquid crystal panel 240 before touching as the display screen of the liquid crystal panel 140 after touching. The liquid crystal panel 240 displays a screen including the input area 400. That is, the input area creation unit 356 displays the input area 400 on the liquid crystal panel 240.

  Thus, during display of the input area 400, the detailed screen displayed on the liquid crystal panel 240 at the time of trigger input is displayed on the liquid crystal panel 140. The detailed screen displayed on the liquid crystal panel 140 has no portion hidden by the input area 400. Therefore, the user can perform handwriting input while looking at the details screen. For example, the user can input handwritten characters in the detail screen that cannot be read or words whose meaning is unknown to the liquid crystal panel 240.

  In addition, the electronic device 100 displays the input area 400 on the liquid crystal panel 240 touched by the stylus 1000. Therefore, the user can perform handwriting input without greatly moving the position of the stylus 1000 after performing the operation of displaying the input area 400 on the liquid crystal panel 240.

  Further, in the present embodiment, input area creation unit 356 creates input area 400 around the designated coordinates. Specifically, the input area creation unit 356 creates an input area 400 having a predetermined size centered on the designated coordinates. Therefore, after displaying the input area 400 on the liquid crystal panel 240, the user can perform handwriting input with little movement of the position of the stylus 1000. However, the creation position of the input area 400 is not limited to this.

  Electronic device 100 may display input area 400 on liquid crystal panel 140 instead of liquid crystal panel 240. However, the display unit for creating the input area 400 needs to be a display-integrated tablet. Moreover, it is preferable that the display part which displays the input area 400 is arrange | positioned at the housing | casing in which a user is easy to perform handwritten input. For example, the display unit that displays the input area 400 is preferably disposed in a housing that is assumed to be placed on a desk or the like or a housing that is assumed to be held by the user.

  When receiving a pattern input completion instruction to the input area 400, the control unit 350 controls the liquid crystal panel 140 and the liquid crystal panel 240 to switch between these display screens. For example, pressing of an input end button or no pattern input being performed for a predetermined time or longer is regarded as a pattern input completion instruction by control unit 350. FIG. 14C shows the screen after switching. FIG. 14C is a diagram showing a screen displayed on liquid crystal panel 140 and liquid crystal panel 240 after the pattern input is completed.

  Referring to FIG. 14C, liquid crystal panel 240 displays the screen displayed on liquid crystal panel 240 before the touch again. Therefore, according to electronic device 100 according to the present embodiment, the user can view the detailed screen before, during, and after creation of the input area.

  In particular, the display control unit 352 displays on the liquid crystal panel 240 a screen in which the input area 400 is superimposed on the screen displayed on the liquid crystal panel 240 before the touch. Therefore, the user can also check the characters entered at the same time as the detail screen.

  Alternatively, the display control unit 352 may display the screen displayed on the liquid crystal panel 240 before the touch on the liquid crystal panel 240 so as to go around the input area 400. For example, the display control unit 352 edits the display data of the screen displayed on the liquid crystal panel 240 based on the input area 400 display area, and displays the screen based on the edited display data on the liquid crystal panel 240.

  Further, the screen switching unit 354 sets the display screen of the liquid crystal panel 140 before touching (during trigger input) as the display screen of the liquid crystal panel 140 after completion of pattern input. Therefore, since the screen state after the creation of the input area is the same as that before the creation of the input area (except for the display of the input area 400), the user can display the same information as before the creation of the input area. I can confirm. Therefore, the creation of the input area does not hinder the consistency of operation.

  When the user selects one of the applications on the menu screen in this state, the application execution unit 360 activates the selected application. Further, the pattern recognition unit 358 recognizes the pattern input in the input area 400 and gives the recognition result to the activated application. Here, it is assumed that the pattern recognition unit 358 performs character recognition and gives the recognition result “desk” to the application. The application displays an output screen based on the recognition result on the liquid crystal panel 140 or the liquid crystal panel 240.

<Process flow>
A flow of processing performed by control unit 350 of electronic device 100 according to the present embodiment will be described with reference to FIG. FIG. 15 is a diagram illustrating a flow of processing performed by the control unit 350 of the electronic device 100 according to the first embodiment in a flowchart format.

  In step S <b> 101, the control unit 350 determines whether the instruction coordinates corresponding to the input to the liquid crystal panel 240 have been received from the input processing unit 330. Since the liquid crystal panel 240 is installed in the second casing 100B, the liquid crystal panel 240 is represented as a second panel in the drawing. Similarly, in the drawing, the liquid crystal panel 140 is represented as a first panel.

  In step S103, the screen switching unit 354 included in the control unit 350 causes the liquid crystal panel 240 to display the screen displayed on the liquid crystal panel 140. Hereinafter, this process is referred to as screen saving. Details of the screen saving will be described later.

  In step S105, the input area creation unit 356 included in the control unit 350 controls the display control unit 352 so that the liquid crystal panel 240 displays the input area. Here, the input area creation unit 356 determines the display position of the input area based on the designated coordinates from the input processing unit 330. The input area creation unit 356 controls the input processing unit 330 so as to create an input pattern based on the designated coordinates in the input area.

  In step S107, control unit 350 determines whether or not input to the input area has been completed. As described above, the control unit 350 determines that the pattern input is completed, for example, when the input end button is pressed or when the pattern input is not performed for a predetermined time or more.

  In step S109, the screen switching unit 354 causes the liquid crystal panel 140 and the liquid crystal panel 240 to display a screen before the screen is saved. Hereinafter, this processing is called screen restoration. Details of the screen restoration will be described later.

(Screen evacuation)
Processing performed by the screen switching unit 354 when the screen is saved will be described with reference to FIG. FIG. 16 is a flowchart showing the flow of processing performed when the screen switching unit 354 saves the screen.

  In step S <b> 201, the screen switching unit 354 stores display data (first screen data) displayed on the liquid crystal panel 140 when the stylus 1000 touches the liquid crystal panel 240 in the buffer memory. Here, a memory area for temporarily storing screen data is called a buffer memory.

  In step S203, the screen switching unit 354 uses the display data (second screen data) displayed on the liquid crystal panel 240 at the time of touching the liquid crystal panel 240 by the stylus 1000 as new first screen data. . At this time, the screen switching unit 354 deletes the second screen data from the storage unit 340, and changes the predetermined screen data (monochromatic background or the like) to new second screen data.

  In step S <b> 205, the screen switching unit 354 controls the display control unit 352 to display an image based on the display data 342 stored in the storage unit 340 on the liquid crystal panel 140 and the liquid crystal panel 240. Therefore, the liquid crystal panel 140 displays the screen that was displayed on the liquid crystal panel 240 when the stylus 1000 touched the liquid crystal panel 240. The liquid crystal panel 240 displays a predetermined screen unrelated to the screen when the stylus 1000 touches the liquid crystal panel 240.

  In step S207, the screen switching unit 354 changes the input reception mode of the input processing unit 330 to the handwriting reception mode.

(Screen return)
Processing performed by the screen switching unit 354 when the screen is restored will be described with reference to FIG. FIG. 17 is a flowchart showing the flow of processing performed by the screen switching unit 354 when the screen is restored.

  In step S <b> 301, the screen switching unit 354 changes the first screen data to display data of the liquid crystal panel 240.

  In step S303, the screen switching unit 354 converts the data stored in the buffer memory into display data for the liquid crystal panel 140.

  In step S305, the screen switching unit 354 controls the display control unit 352 to cause the liquid crystal panel 140 and the liquid crystal panel 240 to display an image based on the display data 342 stored in the storage unit 340. Therefore, the liquid crystal panel 140 displays the screen that was displayed on the liquid crystal panel 140 when the stylus 1000 touched the liquid crystal panel 240. In addition, the liquid crystal panel 240 displays a screen displayed on the liquid crystal panel 240 when the stylus 1000 touches the liquid crystal panel 240.

  In the present embodiment, screen switching unit 354 displays the input area so as to be superimposed on the screen displayed on liquid crystal panel 240. However, the display form of the input area when the screen is restored is not limited to this. For example, the screen switching unit 354 may change the display of the screen (original screen) displayed on the liquid crystal panel 240 so as to go around the input area, that is, avoid the input area. This can prevent the original screen from becoming invisible in the input area. Specifically, for example, the screen switching unit 354 acquires position data of the input area, and arranges characters, objects, and the like included in the original screen in an area that does not overlap the input area based on the acquired position data. Display data is created and a screen based on the created display data is displayed. Note that the screen switching unit 354 may not superimpose the original screen and the input area at all, or may allow such superposition so that the user can confirm the screen displayed on the liquid crystal panel 240. Alternatively, the screen switching unit 354 may not display the input area on the liquid crystal panel 240. Conversely, the screen switching unit 354 may display only the input area on the liquid crystal panel 240 without displaying the screen before the input area is created.

  In step S307, the screen switching unit 354 changes the input reception mode of the input processing unit 330 from the handwriting reception mode to the normal mode. In the normal mode, when receiving the designated coordinates, the input processing unit 330 gives the designated coordinates to the control unit 350 regardless of the position of the designated coordinates.

<Re-create input area>
The input area creation unit 356 recreates the input area when there is an input to an area other than the input area in the liquid crystal panel 240 in the handwriting acceptance mode. That is, the input area creation unit 356 stops displaying the input area on the liquid crystal panel 240 at that time. Also, the input area creation unit 356 deletes the input pattern 344 from the storage unit 340. Furthermore, the input area creation unit 356 creates a new input area.

  The re-creation of the input area will be described with reference to FIG. FIG. 18 is a diagram for explaining the re-creation of the input area.

  FIG. 18A is a diagram illustrating a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 after the liquid crystal panel 240 is touched. Here, it is assumed that the user has made an incorrect input in the input area 400.

  When the user touches the area of the liquid crystal panel 240 excluding the input area 400 with the stylus 1000, the input area creation unit 356 recreates the input area. FIG. 18B shows a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 after the input area is recreated. Nothing is displayed in the newly created input area 400 #. The input area creation unit 356 clears the input pattern so far. The input area creation unit 356 creates a new input pattern 344 based on the input to the input area 400 #, and stores the created input pattern 344 in the storage unit 340.

  As described above, when the user makes an incorrect input in the input area, the user can input again by touching an area other than the input area.

[Second Embodiment]
In the first embodiment, electronic device 100 displays the screen before the creation of the input area on each of liquid crystal panels 140 and 240 when the screen is restored. On the other hand, electronic device 100 according to the second embodiment always displays a menu screen on liquid crystal panel 140 when the screen is restored.

  Since the hardware configuration and functional configuration of electronic device 100 according to the second embodiment are substantially the same as those of the first embodiment, they will not be repeated. However, as will be described below, the processing performed by the screen switching unit 354 is different from that of the first embodiment.

  The operation of electronic device 100 according to the present embodiment will be described with reference to FIG. FIG. 19 is a diagram illustrating an example of the operation of the electronic device 100 according to the second embodiment.

  FIG. 19A is a diagram showing a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 while the dictionary application is activated. The liquid crystal panel 140 displays a detailed screen for the headword “caldera”. The liquid crystal panel 240 displays a detailed screen for the headword “Lake Caldera”.

  When the stylus 1000 touches the liquid crystal panel 240 in the state shown in FIG. 19A, the control unit 350 causes the liquid crystal panel 140 and the liquid crystal panel 240 to display the screen shown in FIG. FIG. 19B is a diagram illustrating a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 after the liquid crystal panel 240 is touched.

  Referring to FIG. 19B, control unit 350 causes liquid crystal panel 140 to display the screen displayed on liquid crystal panel 240 before the touch. In addition, the control unit 350 displays a screen including the input area 400 on the liquid crystal panel 240. As in the first embodiment, the input area 400 is created around the designated coordinates.

  When accepting a pattern input completion instruction to input area 400, control unit 350 causes liquid crystal panel 140 and liquid crystal panel 240 to display the screen shown in FIG. FIG. 19C is a diagram showing a screen displayed on liquid crystal panel 140 and liquid crystal panel 240 after pattern input is completed.

  Referring to FIG. 19C, liquid crystal panel 240 displays a screen in which input area 400 is superimposed on the screen displayed on liquid crystal panel 240 before the touch, as in the first embodiment. On the other hand, unlike the first embodiment, the liquid crystal panel 140 displays a menu screen regardless of the screen displayed on the liquid crystal panel 140 before the touch.

  As in the first embodiment, when the user selects one of the applications in the menu screen, the application execution unit 360 activates the selected application. Further, the pattern recognition unit 358 recognizes the pattern input in the input area 400 and gives the recognition result to the activated application. The application displays an output screen based on the recognition result on the liquid crystal panel 140 or the liquid crystal panel 240.

  According to the present embodiment, the menu screen is always displayed when the user completes the handwriting input. Therefore, the user can immediately select an application from the menu screen and cause the desired application to perform an operation based on handwritten input.

  The basic flow of processing performed by the control unit 350 is the same as that described with reference to FIG. 15 in the first embodiment. However, the processing for returning the screen is different from that of the first embodiment. Processing performed by the screen switching unit 354 according to the second embodiment when the screen is restored will be described with reference to FIG. FIG. 20 is a flowchart showing the flow of processing performed by the screen switching unit 354 according to the second embodiment when the screen is restored.

  In step S <b> 401, the screen switching unit 354 changes the first screen data to display data of the liquid crystal panel 240.

  In step S <b> 403, the screen switching unit 354 uses the menu screen data 343 stored in advance in the storage unit 340 as display data for the liquid crystal panel 140.

  In step S405, the screen switching unit 354 controls the display control unit 352 to display an image based on the display data 342 stored in the storage unit 340 on the liquid crystal panel 140 and the liquid crystal panel 240. Therefore, the liquid crystal panel 140 displays a menu screen. In addition, the liquid crystal panel 240 displays a screen displayed on the liquid crystal panel 240 when the stylus 1000 touches the liquid crystal panel 240.

  In the present embodiment, screen switching unit 354 displays the input area so as to be superimposed on the screen displayed on liquid crystal panel 240. However, as in the first embodiment, the display form of the input area when the screen is restored is not limited to this.

  In step S407, the screen switching unit 354 changes the input reception mode of the input processing unit 330 from the handwriting reception mode to the normal mode.

[Third Embodiment]
In the second embodiment, the electronic device 100 always displays the menu screen on the liquid crystal panel 140 when the screen is restored. On the other hand, when the liquid crystal panel 240 displays the menu screen before the input area is created, the electronic device 100 according to the third embodiment displays the menu screen on the liquid crystal panel 140 when the screen is restored.

  Since the hardware configuration and functional configuration of electronic device 100 according to the third embodiment are substantially the same as those of the first embodiment and the second embodiment, they will not be repeated. However, as will be described below, the processing performed by the screen switching unit 354 is different from the first embodiment and the second embodiment.

  The operation of electronic device 100 according to the present embodiment will be described with reference to FIG. FIG. 21 is a diagram illustrating an example of the operation of the electronic device 100 according to the third embodiment.

  FIG. 21A shows a screen displayed on liquid crystal panel 140 and liquid crystal panel 240 while the dictionary application is activated. The liquid crystal panel 140 displays a detailed screen for the headword “Lake Caldera”. The liquid crystal panel 240 displays a menu screen.

  When stylus 1000 touches liquid crystal panel 240 in the state shown in FIG. 21A, control unit 350 causes liquid crystal panel 140 and liquid crystal panel 240 to display the screen shown in FIG. FIG. 21B is a diagram illustrating a screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 after the liquid crystal panel 240 is touched.

  Referring to FIG. 21B, control unit 350 causes liquid crystal panel 140 to display the screen displayed on liquid crystal panel 240 before the touch. In addition, the control unit 350 displays a screen including the input area 400 on the liquid crystal panel 240. As in the first embodiment, the input area 400 is created around the designated coordinates.

  When receiving a pattern input completion instruction to input area 400, control unit 350 causes liquid crystal panel 140 and liquid crystal panel 240 to display the screen shown in FIG. FIG. 21C is a diagram showing a screen displayed on liquid crystal panel 140 and liquid crystal panel 240 after the pattern input is completed.

  Referring to FIG. 21C, liquid crystal panel 140 displays a menu screen displayed on liquid crystal panel 140 before the touch. That is, the liquid crystal panel 140 continues to display the menu screen even when the pattern input is completed. On the other hand, the liquid crystal panel 240 displays a screen in which the input area 400 is superimposed on the screen displayed on the liquid crystal panel 140 before the touch.

  However, when the screen displayed on the liquid crystal panel 140 before the touch is not a menu screen, the liquid crystal panel 140 and the liquid crystal panel 240 display the screen before the input area creation after the pattern input is completed.

  As in the first embodiment, when the user selects one of the applications in the menu screen, the application execution unit 360 activates the selected application. Further, the pattern recognition unit 358 recognizes the pattern input in the input area 400 and gives the recognition result to the activated application. The application displays an output screen based on the recognition result on the liquid crystal panel 140 or the liquid crystal panel 240.

  According to the present embodiment, when the menu screen is displayed on the liquid crystal panel 240 or the liquid crystal panel 140 before the input area is created, the liquid crystal panel in which the input area is not created when the user completes the handwriting input. A menu screen is displayed at 140. Therefore, the user can select an application from the menu screen and cause the desired application to perform an operation based on handwritten input.

  In the second embodiment, when the menu screen is displayed on the liquid crystal panel 240 before the input area is created, the electronic device 100 is displayed on both the liquid crystal panel 140 and the liquid crystal panel 240 after the completion of the handwriting input. A menu screen will be created. On the other hand, in the present embodiment, when the screen displayed on the liquid crystal panel 140 before the input area is created is not a menu screen, the user is displayed on the liquid crystal panel 140 before the input area is created after the handwriting input is completed. You can refer to the screen that you had.

  The basic flow of processing performed by the control unit 350 is the same as that described with reference to FIG. 15 in the first embodiment. However, the processing for returning the screen is different from that of the first embodiment. Processing performed by the screen switching unit 354 according to the third embodiment when the screen is restored will be described with reference to FIG. FIG. 22 is a flowchart showing the flow of processing performed when the screen switching unit 354 according to the third embodiment performs screen restoration.

  In step S501, the screen switching unit 354 determines whether the first screen data stored in the storage unit 340, that is, the first screen data being displayed in the input area is a menu screen.

  When the first screen data being displayed in the input area is a menu screen (YES in step S501), the screen switching unit 354, in step S503, stores the data stored in the buffer memory, that is, the first when the input area is created. 1 is used as display data of the liquid crystal panel 240.

  On the other hand, when the first screen data is not a menu screen (NO in step S501), in step S505, the screen switching unit 354 generates the first screen data during creation of the input area, that is, the second screen when creating the input area. The screen data is displayed on the liquid crystal panel 240. In step S507, the screen switching unit 354 uses the data stored in the buffer memory, that is, the first screen data at the time of creating the input area as display data of the liquid crystal panel 140.

  In step S509, the screen switching unit 354 controls the display control unit 352 to cause the liquid crystal panel 140 and the liquid crystal panel 240 to display an image based on the display data 342 stored in the storage unit 340.

  Therefore, when the liquid crystal panel 240 displays the menu screen before the input area is created, the liquid crystal panel 140 displays the menu screen. In addition, the liquid crystal panel 240 displays a screen displayed on the liquid crystal panel 140 when the stylus 1000 touches the liquid crystal panel 240. On the other hand, when the liquid crystal panel 240 does not display the menu screen before the input area is created, the liquid crystal panel 140 and the liquid crystal panel 240 touch the liquid crystal panel 240 with the stylus 1000 as in the first embodiment. The screen displayed on the liquid crystal panel 140 and the liquid crystal panel 240 at the time is displayed.

  In the present embodiment, screen switching unit 354 displays the input area superimposed on the screen after switching on liquid crystal panel 240 after the input to the input area is completed. However, as in the first embodiment, the display form of the input area when the screen is restored is not limited to this.

  In step S511, the screen switching unit 354 changes the input reception mode of the input processing unit 330 from the handwriting reception mode to the normal mode.

[Others]
The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is the figure which showed the external appearance of the electronic device 100 which concerns on 1st Embodiment. 2 is a block diagram illustrating a hardware configuration of electronic device 100. FIG. 2 is a diagram showing a configuration of a liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140. FIG. 4 is a cross-sectional view of a liquid crystal panel 140 and a backlight 179. FIG. 6 is a timing chart when operating the optical sensor circuit 144. FIG. FIG. 10 is a diagram showing a configuration in which a photodiode 145 receives light from a backlight 179 during scanning. It is the figure which showed schematic structure of the sensing command. It is the figure which showed the value of the data in each area | region of a sensing command, and the meaning content which the said value shows. It is the figure which showed schematic structure of the response data. It is the figure which showed the scan image. It is a circuit diagram of liquid crystal panel 140A with a built-in optical sensor. It is sectional drawing which showed the structure which a photodiode receives external light in the case of a scan. It is a figure which shows the functional structure of the electronic device 100 in a block diagram format. It is a figure which shows an example of operation | movement of the electronic device 100 which concerns on 1st Embodiment. It is a figure which shows the flow of the process which the control part 350 of the electronic device 100 which concerns on 1st Embodiment performs in a flowchart format. It is a figure which shows the flow of the process which the screen switch part 354 performs at the time of screen saving in a flowchart format. It is a figure which shows the flow of the process which the screen switching part 354 performs at the time of a screen return in a flowchart format. It is a figure for demonstrating re-creation of an input area. It is a figure which shows an example of operation | movement of the electronic device 100 which concerns on 2nd Embodiment. It is a figure which shows the flow of the process which the screen switching part 354 which concerns on 2nd Embodiment performs at the time of a screen return in a flowchart format. It is a figure which shows an example of operation | movement of the electronic device 100 which concerns on 3rd Embodiment. It is a figure which shows the flow of the process which the screen switching part 354 which concerns on 3rd Embodiment performs at the time of a screen return in a flowchart format.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Electronic device, 100A 1st housing | casing, 100B 2nd housing | casing, 101 main body apparatus, 102 display apparatus, 103 display apparatus, 130 driver, 131 scanning signal line drive circuit, 132 data signal line drive circuit, 133 optical sensor Drive circuit, 134 switch, 135 amplifier, 140 photosensor built-in liquid crystal panel, 140A photosensor built-in liquid crystal panel, 141 pixel circuit, 141b subpixel circuit, 141g subpixel circuit, 141r subpixel circuit, 143 electrode pair, 143a pixel electrode, 143b counter electrode, 144 sensor circuit, 145 photodiode, 145b photodiode, 145g photodiode, 145r photodiode, 146 capacitor, 151A active matrix substrate, 151B counter substrate, 15 2 liquid crystal layer, 153b color filter, 153g color filter, 153r color filter, 157 data signal line, 161 polarizing filter, 162 glass substrate, 163 light shielding film, 164 alignment film, 173 memory card reader / writer, 174 communication unit, 175 microphone, 176 Speakers, 177 operation keys, 179 backlight, 180 image processing engine, 181 driver control unit, 182 timer, 183 signal processing unit, 230 driver, 240 light sensor built-in liquid crystal panel, 279 backlight, 280 image processing engine, 281 driver Control unit, 282 timer, 283 signal processing unit, 310 first display unit, 320 second display unit, 330 input processing unit, 340 storage unit, 342 display data, 343 menu screen data, 344 Input pattern, 350 control unit, 352 display control unit, 354 screen switching unit, 356 input area creation unit, 358 pattern recognition unit, 360 application execution unit, 400 input area, 900 fingers, 1000 stylus.

Claims (12)

Electronic equipment,
A display for displaying the first screen;
A display-integrated tablet capable of displaying a second screen and receiving external input;
Control means for controlling the operation of the display and the display-integrated tablet,
The control means includes
When the display-integrated tablet receives a trigger input for instructing creation of an input area that accepts pattern input from the outside, an area creating unit that causes the display-integrated tablet to create the input area;
Electronic equipment comprising: screen switching means for displaying the second screen at the time of the trigger input on the display in response to the trigger input.   The electronic device according to claim 1, wherein the screen switching unit displays the second screen at the time of the trigger input on the display-integrated tablet when receiving an instruction to end the pattern input to the input area.   The electronic device according to claim 2, wherein the screen switching unit displays the second screen and the input area when the trigger is input on the display-integrated tablet when the end instruction is received.   4. The electronic device according to claim 3, wherein, when receiving the end instruction, the screen switching unit superimposes the input area on the second screen when the trigger is input and displays the input area on the display-integrated tablet.   4. The electronic device according to claim 3, wherein, when receiving the end instruction, the screen switching unit displays the second screen at the time of the trigger input on the display-integrated tablet so as to avoid the input area.   The electronic device according to claim 2, wherein the screen switching unit displays the first screen at the time of the trigger input on the display when receiving the end instruction.   The electronic device according to claim 2, wherein the screen switching unit displays a menu screen including a menu for performing an operation using the pattern input on the display when the end instruction is received.   If the display-integrated tablet displays a menu screen including a menu for performing an operation using the pattern input when the trigger is input, the screen switching means receives the end instruction and displays the menu on the display. The electronic device of any one of Claim 2 to 5 which displays a screen.   The area creation means creates the input area anew when the area of the display-integrated tablet excluding the input area receives the input after the input area is created. The electronic device according to item.   The electronic apparatus according to claim 1, wherein the display-integrated tablet is a liquid crystal panel with a built-in optical sensor. A screen switching method for an electronic device having a display that displays a first screen, a second screen, and a display-integrated tablet capable of accepting external input and a control unit,
When the display-integrated tablet receives a trigger input instructing creation of an input area that accepts an external pattern input, the control unit creates the input area in the display-integrated tablet;
And a step of displaying, on the display, the second screen when the trigger is input, in response to the trigger input. Screen switching for causing an electronic device having a display that displays a first screen, a second screen, and a display-integrated tablet capable of accepting external input and a control unit to perform screen switching A program,
When the display-integrated tablet receives a trigger input instructing creation of an input area that accepts an external pattern input, the control unit creates the input area in the display-integrated tablet;
A screen switching program comprising: the control unit displaying the second screen at the time of the trigger input on the display in response to the trigger input.

Images