JP5767525B2 - Input device - Google Patents

Description

  The embodiment of the present invention relates to an input device that enables a mode change and an operation corresponding to this mode by a touch panel operation of a series of liquid crystal panels.

  2. Description of the Related Art Conventionally, by performing multi-touch on a liquid crystal panel, a relative positional relationship between touch locations is determined, and a display scale change, a rotation operation, and the like are performed.

JP 2011-65654 A

  For example, display of map data or the like in a car navigation system (car navigation system) can be performed not only in two dimensions (plane) but also in three dimensions (solid). When changing the angle from the front to the back or from the back to the front using the conventional technique in the three-dimensional display, it is necessary to repeat the touch operation many times, and there is an inconvenience that the operability is poor.

  In this embodiment, while changing a mode by a series of touch panel operations, an input device that enables an operation corresponding to the changed mode is provided.

According to the embodiment, after detecting that a multi-touch is performed on the liquid crystal panel having a touch sensor function and the multi-touch on the liquid crystal panel, it is determined that the mode change request is at least when the multi-touch state is changed or a predetermined time has elapsed. And, when the other mode is an angle mode for changing the angle of the display content, the mode transition means is a touch of the multi-touch on the liquid crystal panel. The display shifts to an angle display where the display of the liquid crystal panel is tilted to the larger area .

1 is a schematic system configuration diagram of a car navigation system as a first embodiment related to an input device. FIG. It is the figure which showed the structure of the liquid crystal panel of a car navigation, and the peripheral circuit of a liquid crystal panel. It is sectional drawing of a liquid crystal panel and a backlight. 3 is a timing chart for explaining the operation of FIG. 2. It is explanatory drawing for demonstrating operation of a touch panel. It is explanatory drawing for demonstrating a relationship to the touch of a finger | toe and a liquid crystal panel. It is explanatory drawing for demonstrating the example of a screen angle change. It is explanatory drawing for demonstrating correction | amendment of the touch operation of a liquid crystal panel. It is a flowchart for demonstrating 1st Embodiment regarding an input device. 10 is a flowchart for explaining a more specific example of a part of the flowchart of FIG. 9. FIG. 10 is an auxiliary explanatory diagram of the description of FIG. 9. FIG. 10 is an auxiliary explanatory diagram of the description of FIG. 9. FIG. 10 is an auxiliary explanatory diagram of the description of FIG. 9. FIG. 10 is an auxiliary explanatory diagram of the description of FIG. 9. It is explanatory drawing for demonstrating the display change of a two-dimensional and a three-dimensional display. It is explanatory drawing for demonstrating 3rd Embodiment regarding an input device.

  Hereinafter, embodiments will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a schematic system configuration diagram of a car navigation system 1000 as a first embodiment relating to an input device, and shows a specific configuration example of a main body device 100 and a display device 200 as main components of the car navigation system 1000.

  The main unit 100 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a ROM (Read-Only Memory) 13, a memory card reader / writer 14, a speaker 15, and operation keys 16. Is done. Each component is mutually connected by a data bus DB. A memory card MC is attached to the memory card reader / writer 14.

  The CPU 11 executes a program. The operation key 16 receives an instruction input from the user of the car navigation system 1000. The RAM 12 volatilely stores data generated by executing a program by the CPU 11 or data input via the operation keys 16. The ROM 13 stores data in a nonvolatile manner. The ROM 13 is a ROM capable of writing and erasing, such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory. Although not shown in FIG. 1, the car navigation system 1000 may be configured to include an interface (IF) for connecting to another car navigation system by wire, or wireless communication with a car navigation system provided with a communication unit. May be performed.

  The display device 200 includes a driver 21, a liquid crystal panel 22 with a built-in optical sensor, an internal IF (Interface) 23, a backlight 24, and an image processing engine 25.

  The driver 21 is a drive circuit for driving the liquid crystal panel 22 and the backlight 24. The liquid crystal panel 22 is a device having a liquid crystal display function and an optical sensor function. That is, the liquid crystal panel 22 can perform image display using liquid crystal and sensing using an optical sensor. The internal IF 23 mediates data exchange between the main body device 100 and the display device 200. The backlight 24 is a light source disposed on the back surface of the liquid crystal panel 22. The backlight 24 irradiates the back surface of the liquid crystal panel 22 with uniform light.

  The image processing engine 25 controls the operation of the liquid crystal panel 22 via the driver 21. This control is performed based on various data sent from the main device 100 via the internal IF 23. Various data includes commands. Further, the image processing engine 25 processes the data output from the liquid crystal panel 22 and sends the processed data to the main body device 100 via the internal IF 23. Further, the image processing engine 25 includes a driver control unit 251, a timer 252, and a signal processing unit 253.

  The driver control unit 251 controls the operation of the driver 21 by sending a control signal to the driver 21. In addition, the driver control unit 251 analyzes a command sent from the main device 100. Then, the driver control unit 251 sends a control signal based on the analysis result to the driver 21.

  The timer 252 generates time information and sends the time information to the signal processing unit 253.

  The signal processing unit 253 receives data output from an optical sensor built in the liquid crystal panel 22. Since the data output from the optical sensor is analog data, the signal processing unit 253 first converts the analog data into digital data. Further, the signal processing unit 253 performs data processing on the digital data in accordance with the content of the command sent from the main device 100.

  Then, the signal processing unit 253 performs data processing according to the content of the command sent from the main device 100, data including time information acquired from the timer 252 (hereinafter, response data), Is sent to the main device 100. Further, the signal processing unit 253 includes a RAM (not shown) that can store a plurality of scan data continuously. The scan data is data after the signal processing unit 253 performs data processing on data relating to voltages for m rows from the first row to the m-th row output from the liquid crystal panel 22. The scan data refers to image data that is an object to be scanned, for example, obtained by scanning a user's finger.

  Note that the timer 252 is not necessarily provided in the image processing engine 25. For example, the timer 252 may be provided outside the image processing engine 25 in the display device 200, or the timer 252 may be provided in the main body device 100.

  Here, the display device 200 includes a system liquid crystal. The system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 22 on a glass substrate constituting the liquid crystal panel 22. Here, the driver 21 excluding the circuit that drives the backlight 24, the internal IF 23, and the image processing engine 25 are integrally formed on the glass substrate of the liquid crystal panel 22.

  The display device 200 is not necessarily configured using a system liquid crystal, and the driver 21, the internal IF 23, and the image processing engine 25 excluding the circuit that drives the backlight 24 are other than the glass substrate of the liquid crystal panel. It may be configured on the substrate.

  The processing in the car navigation system 1000 is realized by each hardware and software executed by the CPU 11. The software may be stored in advance in the ROM 13. The software may be stored in a memory card MC or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet.

  Such software is read from the storage medium by the memory card reader / writer 14 or other reading device or downloaded via a communication IF (not shown) and then temporarily stored in the ROM 13. The software is read from the ROM 13 by the CPU 11 and stored in the RAM 12 in an executable program format. The CPU 11 executes the program.

  Each component which comprises the main body apparatus 100 of the car navigation system 1000 shown by FIG. 1 is a general thing. Therefore, it can be said that the essential part of this embodiment is software stored in the RAM 12, the ROM 13, the memory card MC, or other storage medium, or software that can be downloaded via a network. Since the hardware operation of main device 100 of car navigation system 1000 is well known, detailed description will not be repeated.

  Storage media are not limited to memory cards, but are CD-ROM, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc) ), An IC (Integrated Circuit) card excluding a memory card, an optical card, a mask ROM, an EPROM, an EEPROM (Electronically Erasable Programmable Read-Only Memory), a semiconductor memory such as a flash ROM, or a medium that stores a fixed program. .

  FIG. 2 is a diagram for explaining the configuration of the liquid crystal panel 22 and the configuration of peripheral circuits of the liquid crystal panel 22.

  The liquid crystal panel 22 includes a pixel circuit 221, an optical sensor circuit 224, a scanning signal line Gi, data signal lines SRj, SGj, and SBj, sensor signal lines SSj and SDj, a readout signal line RWi, and a reset signal line RSi. It consists of. Note that i is a natural number satisfying 1 ≦ i ≦ m, and j is a natural number satisfying 1 ≦ j ≦ n.

  1 includes a scanning signal line drive circuit 26, a data signal line drive circuit 27, an optical sensor drive circuit 28, a switch SW, as peripheral circuits of the liquid crystal panel 22. It comprises amplifiers A1 to An.

  The scanning signal line drive circuit 26 receives a control signal TC1 from the driver control unit 251 shown in FIG. The scanning signal line driving circuit 26 applies a predetermined voltage in order from the scanning signal line G1 to each of the scanning signal lines G1 to Gm based on the control signal TC1. Specifically, the scanning signal line driving circuit 26 sequentially selects one scanning signal line from the scanning signal lines G1 to Gm for each unit time, and a TFT (Thin Film Transistor) is selected for the selected scanning signal line. A voltage that can turn on the gate 222 (hereinafter referred to as a high level voltage) is applied. Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.

  The data signal line drive circuit 27 receives image data DR, DG, DB from the driver control unit 251 shown in FIG. The data signal line drive circuit 27 sequentially applies voltages corresponding to the image data for one row to the 3n data signal lines SR1 to SRn, SG1 to SGn, and SB1 to SBn for each unit time. To do.

  Here, a driving method called a so-called line sequential method has been described, but the driving method is not limited to this.

  The pixel circuit 221 is a circuit for setting the luminance (transmittance) of one pixel. Further, m × n pixel circuits 221 are arranged in a matrix. More specifically, m pixel circuits 221 are arranged in the vertical direction in FIG. 2 and n pixel circuits in the horizontal direction.

  The pixel circuit 221 includes an R subpixel circuit 221r, a G subpixel circuit 221g, and a B subpixel circuit 221b. Each of these three subpixel circuits 221r, 221g, and 221b includes a TFT 222, a pair of electrode pairs 223 including a pixel electrode and a counter electrode, and a capacitor (not shown).

  It should be noted that a CMOS (Complementary Metal Oxide Semiconductor) capable of forming an n-type transistor and a p-type transistor can be realized, and the moving speed of carriers (electrons or holes) is several hundreds as compared with an amorphous silicon thin film transistor (a-Si TFT). For example, in the display device 200, a polycrystalline silicon thin film transistor (p-Si TFT) is used as the TFT 222. The TFT 222 will be described as an n-type channel field effect transistor. However, the TFT 222 may be a p-type channel field effect transistor.

  The source of the TFT 222 in the R subpixel circuit 221r is connected to the data signal line SRj. The gate of the TFT 222 is connected to the scanning signal line Gi. The drain of the TFT 222 is connected to the pixel electrode of the electrode pair 223. A liquid crystal is disposed between the pixel electrode and the counter electrode. The G subpixel circuit 221g and the B subpixel circuit 221b have the same configuration as the pixel circuit 221r except that the data signal line to which the source of each TFT 222 is connected is different. Therefore, description of these two subpixel circuits 221g and 221b will not be repeated.

  Here, setting of luminance in the pixel circuit 221 will be described. First, a high level voltage is applied to the scanning signal line Gi. By applying this high level voltage, the gate of the TFT 222 is turned on. In this manner, with the gate of the TFT 222 turned on, a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line SRj, SGj, SBj. Thereby, a voltage based on the designated voltage is applied to the pixel electrode. As a result, a potential difference is generated between the pixel electrode and the counter electrode. Based on this potential difference, the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. This potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.

  The optical sensor drive circuit 28 receives a control signal TC2 from the driver control unit 251 shown in FIG.

Then, the optical sensor driving circuit 28 sequentially selects one signal line from the reset signal lines RS1 to RSm for each unit time based on the control signal TC2, and is predetermined for the selected signal line. A voltage VddR that is higher than usual is applied at the timing. Note that a voltage V ddS lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line. For example, the voltage VddR may be set to 0V, and the voltage VddS may be set to −5V.

Further, the optical sensor drive circuit 28 sequentially selects one signal line from the read signal lines RW1 to RWm for each unit time based on the control signal TC2, and is predetermined for the selected signal line. A voltage Vdd R having a higher level than usual is applied at the timing. Note that the voltage V ddS is kept applied to the read signal line that is not selected. For example, the value of Vdd may be set to 8V.

  The optical sensor circuit 224 includes a photodiode 225, a capacitor 226, and a TFT 227. In the following description, it is assumed that the TFT 227 is an n-type channel field effect transistor. However, the TFT 227 may be a p-type channel field effect transistor.

  The anode of the photodiode 225 is connected to the reset signal line RSi. On the other hand, the cathode of the photodiode 225 is connected to one electrode of the capacitor 226. The other electrode of the capacitor 226 is connected to the read signal line RWi. Hereinafter, a connection point between the photodiode 225 and the capacitor 226 is referred to as a node N.

  The gate of the TFT 227 is connected to the node N. The drain of the TFT 227 is connected to the sensor signal line SDj. Further, the source of the TFT 227 is connected to the sensor signal line SSj.

  The switch SW is a switch provided for switching whether or not to apply a predetermined voltage to the sensor signal lines SD1 to SDn. The switching operation of the switch SW is performed by the optical sensor driving circuit 28.

  The amplifiers A1 to An amplify the voltages output from the sensor signal lines SS1 to SSn. The amplified voltage is sent to the signal processing unit 253 shown in FIG.

  Note that the image processing engine 25 controls the timing for displaying an image on the liquid crystal panel 22 using the pixel circuit 221 and the timing for sensing using the optical sensor circuit 224.

  FIG. 3 is a cross-sectional view of the liquid crystal panel 22 and the backlight 24. The liquid crystal panel 22 includes an active matrix substrate 31A, a counter substrate 31B, and a liquid crystal layer 32. The counter substrate 31B is disposed to face the active matrix substrate 31A. The liquid crystal layer 32 is sandwiched between the active matrix substrate 31A and the counter substrate 31B. The backlight 24 is disposed on the side opposite to the liquid crystal layer 32 with respect to the active matrix substrate 31A.

  The active matrix substrate 31 </ b> A includes a polarizing filter 33, a glass substrate 34, a pixel electrode 223 a that constitutes an electrode pair 223, a photodiode 225, a data signal line 35, and an alignment film 36. Further, although not shown in FIG. 3, the active matrix substrate 31A includes the capacitor 226, the TFT 227, the TFT 222, and the scanning signal line Gi shown in FIG.

  In the active matrix substrate 31A, the polarizing filter 33, the glass substrate 34, the pixel electrode 223a, and the alignment film 36 are arranged in this order from the backlight 24 side. The photodiode 225 and the data signal line 35 are formed on the liquid crystal layer 32 side of the glass substrate 34.

  The counter substrate 31B includes a polarizing filter 33, a glass substrate 34, a light shielding film 37, color filters 38r, 38g, and 38b, a counter electrode 223b that forms an electrode pair 223, and an alignment film 36.

  In the counter substrate 31B, the alignment film 36, the counter electrode 223b, the color filters 38r, 38g, and 38b, the glass substrate 34, and the polarizing filter 33 are arranged in this order from the liquid crystal layer 32 side. The light shielding film 37 is formed in the same layer as the color filters 38r, 38g, and 38b.

  The color filter 38r is a filter that transmits light having a red wavelength. The color filter 38g is a filter that transmits light having a green wavelength. The color filter 38b is a filter that transmits light having a blue wavelength. Here, the photodiode 225 is disposed at a position facing the color filter 38b.

  The liquid crystal panel 22 displays an image by blocking or transmitting light emitted by a light source such as external light or a backlight 24. Specifically, the liquid crystal panel 22 changes the direction of the liquid crystal molecules of the liquid crystal layer 32 by applying a voltage between the pixel electrode 223a and the counter electrode 223b, thereby blocking or transmitting the light. . However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 33 that transmits only light having a specific polarization direction is disposed.

  Note that the position of the photodiode 225 is not limited to the above position, and may be provided at a position facing the color filter 38r or a position facing the color filter 38g.

  Here, the operation of the optical sensor circuit 224 will be described. FIG. 4 is a timing chart when the optical sensor circuit 224 is operated. In FIG. 4, the voltage Vint indicates the potential at the node N in the photosensor circuit 224. A voltage Vpix is an output voltage from the sensor signal line SSj shown in FIG. 2 and is a voltage before being amplified by the amplifiers A1 to An.

  The following description will be divided into a reset period for resetting the optical sensor circuit 224, a sensing period for sensing light using the optical sensor circuit 224, and a readout period for reading the sensed result.

First, the reset period will be described. In the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage V ddS ) to the high level (voltage VddR). On the other hand, the voltage applied to the read signal line RWi remains at the low level (voltage V ddS ). Thus, by applying the high level voltage to the reset signal line RSi, a current starts to flow in the forward direction of the photodiode 225.

As a result, the voltage Vint, which is the potential of the node N, has a value represented by the equation V ddS + | VddR−V ddS | −Vf. As can be seen from this equation, the forward voltage drop amount in the photodiode 225 is Vf. Therefore, as shown in FIG. 4, the potential of the node N is a value smaller by Vf than the voltage VddR.

  Here, since the voltage Vint is equal to or lower than the threshold value for turning on the gate of the TFT 227, there is no output from the sensor signal line SSj. For this reason, the voltage Vpix does not change. Further, a difference corresponding to the voltage Vint occurs between the electrodes of the capacitor 226. The capacitor 226 accumulates charges corresponding to this difference.

Next, the sensing period will be described. In the sensing period following the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the high level (voltage VddR) to the low level (voltage V ddS ). On the other hand, the voltage applied to the read signal line RWi remains at the low level (voltage V ddS ).

  As described above, by changing the voltage applied to the reset signal line RSi to the low level, the potential of the node N (that is, the voltage Vint) becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi. . Therefore, the photodiode 225 is in a reverse bias state in which the cathode side voltage is higher than the anode side voltage. In such a reverse bias state, when the photodiode 225 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 225. As a result, as illustrated in FIG. 4, the potential of the node N (voltage Vint) decreases with time.

  Since the voltage Vint continues to decrease in this way, the gate of the TFT 227 does not turn on and there is no output from the sensor signal line SSj. For this reason, the voltage Vpix does not change.

Next, the reading period will be described. In the reading period following the sensing period, the voltage applied to the reset signal line RSi is kept at the low level (voltage V ddS ). On the other hand, the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage V ddS ) to the high level (voltage Vdd R ). Here, the voltage Vdd is higher than the voltage VddR.

  In this way, by instantaneously applying a high level voltage to the read signal line RWi, the potential of the node N is raised through the capacitor 226 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi. Here, since the potential of the node N (voltage Vint) is raised to a threshold value or higher that turns on the gate of the TFT 227, the gate of the TFT 227 is turned on.

  At this time, if a constant voltage is applied in advance to the sensor signal line SDj (see FIG. 2) connected to the drain side of the TFT 227, the sensor signal line SSj connected to the source side of the TFT 227 will be subjected to Vpix in FIG. As shown in the graph, a voltage corresponding to the potential of the node N is output.

  Here, when the amount of light received by the photodiode 225 (the amount of received light) is small, the slope of the straight line shown in the Vint graph of FIG. 4 becomes gentle. As a result, the voltage Vpix is higher than when the amount of received light is large. As described above, the optical sensor circuit 224 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 225.

  By the way, in the above, the operation | movement was demonstrated paying attention to one optical sensor circuit 224 among the m * n optical sensor circuits which exist. Below, operation | movement of each photosensor circuit in the liquid crystal panel 22 is demonstrated.

  First, the photosensor drive circuit 28 applies a predetermined voltage to all n sensor signal lines SD1 to SDn. Next, the photosensor drive circuit 28 applies a voltage VddR that is higher than usual to the reset signal line RS1. The other reset signal lines RS2 to RSm and read signal lines RW1 to RWm are kept in a state where a low level voltage is applied. As a result, the n photosensor circuits in the first row in FIG. 2 enter the reset period. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.

  Note that the timing at which a predetermined voltage is applied to all of the n sensor signal lines SD1 to SDn is not limited to the above timing, and may be any timing that is applied at least before the readout period.

  When the reading period of the n photosensor circuits in the first row ends, the photosensor drive circuit 28 applies a voltage VddR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.

  Thereafter, the above-described processing is sequentially performed on n photosensor circuits on the third row, n photosensor circuits on the fourth row,... N photosensor circuits on the mth row. As a result, the sensing result of the first row, the sensing result of the second row,..., The sensing result of the m-th row are output in this order from the sensor signal lines SS1 to SSn.

  In the display device 200, sensing is performed for each row as described above, and a sensing result is output from the liquid crystal panel 22 for each row.

  As shown in FIG. 3, when the user's finger 30 touches the surface of the liquid crystal panel 22, a part of the light emitted from the backlight 24 is reflected by the user's finger 30, and this reflected light Is received by the photodiode 225.

  Even in the non-touch area of the liquid crystal panel 22 that is not touched by the finger 30, a part of the light emitted from the backlight 24 is reflected by the user's finger 30. Even in this non-touch portion, the photodiode 225 receives the reflected light. However, since the finger 30 does not touch the surface of the liquid crystal panel 22 in the non-touch region, the amount of light received by the photodiode 225 is smaller than the region where the finger 30 is touching. Note that the photodiode 225 cannot receive most of the light emitted from the backlight 24 that does not reach the user's finger 30.

  Here, by turning on the backlight 24 at least during the sensing period, the photosensor circuit 224 can output a voltage corresponding to the amount of light reflected by the user's finger 30 from the sensor signal line SSj. it can. Thus, by controlling the lighting of the backlight 24, the liquid crystal panel 22 controls the sensor according to the touch position of the finger 30, the range touched by the finger 30, the direction of the finger 30 with respect to the surface of the liquid crystal panel 22, and the like. The voltage output from the signal lines SS1 to SSn changes.

  FIG. 5 shows the relationship between the strength of touching the finger on the surface of the liquid crystal panel 22 and the touch area. As a matter of course, the touch area gradually increases as the strength of the touch increases.

  FIG. 6 shows a state where a plurality of fingers, for example, the index finger 301 and the thumb 302 touch the liquid crystal panel 22 at the same time. The relationship between the touch area at the point A of the index finger 301 located on the upper side of the liquid crystal panel 22 and the touch area at the point B of the thumb 302 located on the lower side is A> B.

  The relationship between the areas where the index finger 301 and the thumb 302 touch the liquid crystal panel 22 is A> B, and information when this touch state has passed a preset time is transmitted via the sensor signal lines SS1 to SSn. The signal is supplied from the liquid crystal panel 22 to the signal processing unit 253. Based on this information, the signal processing unit 253 determines that an angle adjustment command has been issued, and shows the angle of the image displayed on the liquid crystal panel 22 from the state shown in FIG. 7A to FIG. 7B. It is possible to shift to an operation that changes to a state.

  Hereinafter, referring to FIG. 9 to FIG. 14, from the so-called pinch-out mode in which two fingers are multi-touched on the liquid crystal panel 22, the interval between the fingers is widened, and the display is enlarged, the angle change mode is performed by multi-touch. The function of changing the angle from 2D display to 3D display and from 3D display to 2D display will be described in more detail. Before that, with reference to FIG. 8, the relationship between the area where the index finger 301 and the thumb 302 touch the liquid crystal panel 22 will be described.

  Generally, it is quite difficult for the index finger to have a larger touch area than the thumb with respect to the liquid crystal panel 22 as compared to the thumb. Therefore, as shown in FIG. 8, a relationship that satisfies the condition of area difference≈pressure difference is provided. That is, the corresponding output at the touch area at point B is ΔB (−), and the corresponding output at the touch area at point A is ΔA (+). That is, not only the area difference between the touched points A and B but also the amount of change in the area in the elapsed time for each touched place is compared and added to the determination.

  This makes it possible to change the angle from the two-dimensional display to the three-dimensional display image and vice versa by adjusting the index finger, thereby improving operability. The time from the start of touching to the angle change is about 1 second at most.

  9 and 10 show a state in which the display projected on the liquid crystal panel 22 of the car navigation system 1000 shown in FIG. 1 is multi-touched to expand the display, and the liquid crystal panel 22 is changed to the angle change mode by multi-touch. It is a flowchart which shows the flow of the process which is made to transfer, and changes the angle | corner of an image gradually from 2D to 3D display and vice versa. Hereinafter, the flowcharts of FIGS. 9 and 10 will be described together with related display examples of the liquid crystal panels of FIGS.

  First, in step S01 of FIG. 9, the liquid crystal panel 22 is in a pinch-out mode state, and the display can be controlled to be pinched out by multi-touch. After the pinch-out operation has been performed, it is determined in step S02 whether the multi-touch state has been reached. If it is in the multi-touch state, the process returns to step S11 to continue the pinch-out possible state, and if not in the multi-touch state, the pinch-out mode state is canceled (S03).

  When the index finger 301 and the thumb 302 are multi-touched on the screen of the liquid crystal panel 22 of FIG. 11 as shown in FIG. 12, the signal processing unit 253 touches the touch position of the index finger 301 located at the top of the screen and the bottom of the screen. The measurement of the touch position of the thumb 302 located at the position is performed.

  In step S2, it is determined whether or not the multi-touch of the index finger 301 and the thumb 302 has been performed as a result of measuring the touch position in step S1. If only one of the fingers is touched or if neither finger is touched, the process ends. If both fingers are touched, it is determined in step S3 whether the multi-touch state has changed. If the multi-touch state is changed, the process ends. If not, the state shown in FIG. 12 is continued and the process proceeds to step S4, and the touch areas of the index finger 301 and the thumb 302 are measured. The measured touch areas are compared in step S5.

  In step S6, it is determined whether the difference in touch area between the index finger 301 and the thumb 302 measured in step S5 is equal to or greater than a predetermined threshold. If it is equal to or less than the threshold value, the process is terminated. If it is equal to or greater than the threshold value, it is determined in step S7 whether the timer 252 of the image processing engine 25 is activated, and if it is activated, the process proceeds to step S8. to decide. If the timer 252 is not activated in step S7, the timer 252 is activated in step S9, and the process proceeds to step S8.

  In step S8, it is determined whether the continuation of the multi-touch state in FIG. 12 has elapsed. If it has not elapsed, the process returns to step S1, and if it has elapsed, the characters “angle setting” are displayed on the upper left of the liquid crystal panel 22. Projection and notification of transition to the angle change mode are notified (S10), and in the next step S11, the processing of the flowchart shown in FIG. 10 is performed. The notification in step S10 may be notified by voice at the same time.

  The process of FIG. 10 is a flowchart showing an example of a process for controlling the display by changing the angle of the image to a two-dimensional display / three-dimensional display after shifting to the angle change mode in multi-touch with the index finger 301 and the thumb 302.

  In step 101 of FIG. 10, the touch area measurement of the index finger 301 and the thumb 302 is performed. The respective measurement areas are compared in step S102. In the next step S103, it is determined whether the area difference based on step S102 is greater than or equal to a predetermined threshold value. If it is equal to or greater than the threshold, an angle change rate based on a value equal to or greater than the threshold is determined in step S104.

  In step S105, the relationship between the touch position area on the upper side> the touch position area on the lower side is determined. In step S105, when the touch position area on the upper side is large, the angle change direction of the three-dimensional display is changed to the three-dimensional display direction.

  If the difference between the touch areas of the index finger 301 and the thumb 302 is equal to or less than the threshold value in step S103, the process proceeds to steps S107 and S108, and the process proceeds to step S110 without changing the angle.

  In step S105, when the touch position area on the lower side is large, the angle display in the two-dimensional display direction is performed, and the process proceeds to step S110.

  In step S110, drawing as shown in FIG. 14 is performed on the liquid crystal panel 22 on the display screen with the angle determined in any of steps S106, S108, and S109.

  After the drawing shown in FIG. 14 is performed, it is determined in step S12 in FIG. If it is in the multi-touch state, the process returns to step S11 to continue the angle change state. If it is determined that the multi-touch state is not established, the angle change mode state is canceled.

  FIG. 15 schematically shows the state after the angle setting transition with the index finger 301 and the thumb 302. The reciprocation from the two-dimensional display of FIG. 15A to the three-dimensional display of FIG. 302 shows an angle change.

  In this way, the state in which the touch area of the upper part of the screen is larger than the lower part in multi-touch is shifted to the angle setting mode by holding for a predetermined time, and then the upper part of the screen is larger or smaller than the lower touch area. Through a series of operations based on the above, it becomes possible to draw an angle change on a three-dimensional display or change an angle on a two-dimensional display.

  In this embodiment, after detecting that multi-touch has been performed on the liquid crystal panel, it is possible to shift to another mode at least after the multi-touch state has passed for a predetermined time, thereby reducing troublesome operations. . In addition, by a series of touch operations on the liquid crystal panel, not only two-dimensional or three-dimensional display but also an angle change of these displays can be performed, so that troublesome operation can be reduced.

  Note that the transition to other modes by multi-touch is not only after the multi-touch state has elapsed for a predetermined time, but also when the multi-touch state is changed, for example, by reversing the touch area difference of multi-touch many times. Can be migrated.

(Second Embodiment)
In this embodiment, when [angle setting] is displayed on the screen of the liquid crystal panel 22 in step S8 of FIG. 9, the index finger 301 or the thumb 302 is operated from the multi-touch state so far. The angle can be changed. For example, when the touch of the thumb 302 is stopped and the touch operation only with the index finger 301 is continued, the angle changes in the direction from (a) to (c) in FIG. 15, and the touch operation with only the thumb 302 is stopped this time. Then, on the contrary, an operation of changing the angle in the two-dimensional display direction can be performed.

  When either the index finger 301 or the thumb 302 is operated and an image of a desired angle is obtained, when any touch operation of the index finger 301 or the thumb 302 is stopped, the image is fixed at the stopped angle. From this state, when it is desired to change the angle again, regardless of the operation of the index finger 301 or thumb 302, the upper side of the liquid crystal panel 22 is operated in the three-dimensional direction, and the lower side is operated in the two-dimensional direction. Design to change.

  The angle change mode can be canceled by, for example, multi-touching again, and the next mode can be shifted by operating the multi-touch for a predetermined time after canceling the angle change mode.

  In this embodiment, the multi-touch operation is performed for a predetermined time and the transition set to the angle change mode can improve the operability by enabling the angle change with a single touch.

(Third embodiment)
In this embodiment, after the index finger 301 is multi-touched for a predetermined time in the screen area 16A shown in FIG. 16 and the thumb 302 is shown in the area 16B shown in FIG. 16, [angle setting] is displayed on the screen of the liquid crystal panel 22. The screen area 16A is operated with the index finger 301 to change the angle in the direction of FIG. 15C, and the screen area 16B is operated with the index finger 301 to change the angle in the direction of FIG. 15A. In addition, when the screen area 16C is operated with the index finger 301, the left screen is angle-changed to the back and the right side is changed to the near side, and when the screen area 16D is operated with the index finger 301, the right screen is set to the back and the left side is set to the front. Changed the angle.

  In this embodiment, the multi-touch is operated for a predetermined time, and after shifting to the angle change mode, the angle change of up / down / left / right can be performed by touching each of the screen areas 16A to 16D. The touch operation after shifting to the angle change mode has been exemplified with the index finger, but an angle change corresponding to the screen regions 16A to 16D can be performed regardless of which finger is touched.

  It is not limited to the above-described embodiments. Although the example in which the angle change between the two-dimensional display and the three-dimensional display is performed has been shown, the present invention is not limited to this, and for example, an angle change type that simply tilts the two-dimensional display may be used. Further, the liquid crystal panel can be used as a volume in the same manner as an angle change for image display. In addition, the same concept can be applied to scrolling up and down the list in the scroll command conversion of the list display.

In addition, it is also possible to switch to a mode such as display angle change → volume → screen scrolling by multi-touching the liquid crystal panel and holding it for a predetermined time without moving the finger in this state. When the mode is switched to the desired mode, if the multi-touch is stopped, the mode at the time of the stop is fixed. If the volume mode is selected, the up / down is scrolled. Operation can be realized. The mode change is displayed on the liquid crystal panel. Furthermore, the liquid crystal panel having the touch sensor function has been described with the example of the optical sensor, but the present invention is not limited to this. It doesn't matter. The resistive film type has a structure in which a minute spacer of several microns is placed between the transparent conductive films facing each other, and a film is pasted on it. Each transparent conductive film is in the form of a strip, and these are orthogonal to each other. By applying a pressure while touching the film, the conductive films are brought into contact with each other, and the current generated at this time is measured to detect the touched position from the matrix. The capacitance method has a structure in which glass or the like is pasted on the transparent conductive film, and is divided into a plurality of vertical and horizontal axes in the same manner as the resistive film method, and touches the glass on the transparent conductive film. In the same principle as a capacitor, when the dielectric (finger) approaches, the capacitance of the transparent conductive film that increases due to the high-frequency current flowing due to this capacitance is measured to detect the touched position from the matrix. Is.

  Moreover, although the liquid crystal panel has been described as an example of the display device of the car navigation system 1000, other panels such as an organic EL (Electro-Luminescence) panel may be used instead of the liquid crystal panel. In the case of a self-luminous type such as an organic EL panel or a launch type liquid crystal panel, a backlight is not necessary.

  Although several embodiments have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, combinations, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

1000 Car navigation system 100 Main unit 200 Display device 22 Liquid crystal panel 25 Image processing engine 253 Signal processing unit

Claims (2)

LCD panel with touch sensor function,
After detecting that the multi-touch on the liquid crystal panel has been detected, at least when the state of the multi-touch has changed or after a predetermined time has passed, a mode change request is determined, and mode transition means for shifting to another mode, and
When the other mode is an angle mode in which the angle of the display content is changed, the mode shifting means shifts to an angle display that tilts the display of the liquid crystal panel to the side with the larger touch area among the multi-touches to the liquid crystal panel. to, input device.   The input device according to claim 1, wherein the mode shift unit shifts to another mode when a difference in touch area of the multi-touch exceeds a threshold value.