JP2012256147A - Display input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display input device capable of reducing operation procedures to reach a desired option in the case where options are displayed hierarchy-by-hierarchy.SOLUTION: A display input device 1 comprising hierarchies S1, S2, S3 ... each having a plurality of optional images includes: a storage unit on a microcomputer 20 for storing display image information 260 in which coordinates of each of the hierarchies S1, S2, S3 ... are mapped to coordinates of each adjacent hierarchy; a touch sensor 12 as an operation unit for detecting operation contents to output a detection signal; a display unit 14 for displaying a display image; and a display image generation unit 26 in which a display region A1, showing a region of a display image displayed on the display unit 14 out of the display image information 260 stored in the storage unit, is coordinately moved on the hierarchy on the basis of the detection signal output by the touch sensor 12 or is moved to an adjacent hierarchy within the same coordinate and, on the basis of the display region as a result of the movement, a display image to be displayed on the display unit 14 is generated.

Description

  The present invention relates to a display input device.

  As a conventional technique, there is a display input device that displays lower hierarchy options belonging to a displayed option even if a user's decision is not input (see, for example, Patent Document 1).

  This display input device displays a display device, contact position detection means for detecting a contact position of a user's finger or the like arranged on the display device, and a higher-level option among a plurality of options having a tree structure. Display control means for displaying lower-layer options belonging to upper-layer options corresponding to the contact position, and a sensor for detecting that the user's finger or the like has approached the space in front of the contact position detection means When the sensor detects that a finger or the like is close to an option on the upper layer displayed on the display device, the display control means displays the option on the lower layer of the option on the display device.

  According to this display input device, in order to display the lower hierarchy even if the decision by the user is not input, the contents of the lower hierarchy are confirmed before inputting the decision, and the desired lower hierarchy option is selected. Can be determined.

JP 2010-19643 A

  However, the display input device shown in Patent Document 1 returns to the display form that lists the upper hierarchy again in order to reach the alternatives other than the option while displaying the lower hierarchy options belonging to the determined upper hierarchy, It was necessary to select the appropriate upper-layer option.

  Therefore, an object of the present invention is to provide a display input device that can reduce an operation procedure for reaching a desired option when the option is displayed for each layer.

  One embodiment of the present invention has a plurality of hierarchies having a plurality of option images, a storage unit that stores display image information associated with the coordinates of adjacent hierarchies, and the operation content is detected. An operation unit that outputs at least a first detection signal and a second detection signal, a display unit that displays a display image, and a display image displayed on the display unit among the display image information stored in the storage unit The display area indicating the area is moved on the hierarchy on the basis of the first detection signal output by the operation unit, or moved to the adjacent hierarchy on the same coordinate based on the second detection signal, Provided is a display input device including a display image generation unit that generates a display image to be displayed on the display unit based on the display area as a result of the movement.

  The operation unit of the display input device detects the operation content and outputs a third detection signal, and the display input device displays on the display unit based on the third detection signal output by the operation unit. You may further have a control part which outputs the control signal linked | related with the choice image contained in the displayed image.

  The operation unit of the display input device detects an operation content and outputs a fourth detection signal, and the display image generation unit enlarges the display area based on the fourth detection signal output by the operation unit. Or you may reduce.

  ADVANTAGE OF THE INVENTION According to this invention, when the choice is displayed for every hierarchy, the operation procedure for reaching a desired choice can be reduced.

FIG. 1 is a schematic diagram illustrating an example of a configuration inside a vehicle in which the display input device according to the embodiment is mounted. FIG. 2 is a block diagram illustrating an example of the configuration of the display input device according to the embodiment. FIG. 3 is a schematic diagram illustrating an example of a configuration of display image information according to the embodiment. 4A to 4C are schematic diagrams illustrating a typical operation example with respect to the touch sensor unit in the embodiment. FIG. 5A is a schematic diagram for explaining an example of the operation of the display input device based on the relationship between the display image displayed on the display screen, the display image information, the display area, and the operation content determined by the determination unit. . FIG. 5B is a schematic diagram for explaining an example of the operation of the display input device based on the relationship between the display image displayed on the display screen, the display image information, the display area, and the operation content determined by the determination unit. .

(Configuration of display input device)
FIG. 1 is a schematic diagram illustrating an example of a configuration inside a vehicle in which the display input device according to the embodiment is mounted.

  The display input device 1 can operate electronic devices such as a seat position adjustment device, an air conditioning device, a navigation device, an audio device, a view securing device, and a driving support device mounted on the vehicle 6, and input characters and the like. It can be done.

  For example, as shown in FIG. 1, the display unit 14 a of the display input device 1 is disposed between a driver seat and a passenger seat, and is disposed on a center console 60 provided in a vertical direction. The touch sensor unit 12a corresponding to the display unit 14a is disposed in the vicinity of the shift lever 64.

  The display unit 14 b of the display input device 1 is arranged as a sub monitor such as the meter panel 62, and the touch sensor unit 12 b corresponding to the display unit 14 b is arranged on the steering wheel 63.

  FIG. 2 is a block diagram illustrating an example of the configuration of the display input device according to the embodiment.

  The display input device 1 corresponds to the display units 14a and 14b (hereinafter referred to as the display unit 14) for displaying images, characters, and the like, and the display units 14a and 14b, and detects detection signals based on the operations performed. Touch sensor units 12a and 12b (hereinafter referred to as touch sensor unit 12) as detection units to be output, and a determination unit 24 that determines an operation performed based on a detection signal output from the touch sensor unit 12, Based on the display image information 260 stored in the storage unit on the microcomputer 20, the arrangement of at least one of the plurality of images is changed based on the determination of the operation for changing the arrangement of the images performed by the determination unit 24. The display image generation unit 26 that generates a display image to be displayed on the display unit 14 and the function assigned to the display image based on the control information 320 are executed. A control unit 32, comprises a are schematic configuration that.

(Configuration of touch sensor unit 12)
The touch sensor unit 12 is, for example, a touch sensor that detects a position on the touched detection surface 121 when the detection surface 121 of the cover 120 is touched with a part of the operator's body (for example, a finger). For example, the operator can operate and input the connected electronic device by operating the detection surface 121. As the touch sensor unit 12, for example, a well-known resistive film type, infrared type, SAW type, capacitance type touch panel, or the like can be used.

  For example, the touch sensor unit 12 according to the present embodiment uses, as a detection signal, a change in current that is inversely proportional to the distance between the first electrode 122 and the second electrode 123 and the finger due to the finger approaching the detection surface 121. It is a capacitive touch sensor that outputs.

  For example, as shown in FIG. 2, the touch sensor unit 12 includes a cover 120, and a first electrode 122 and a second electrode 123.

  The cover 120 is formed in a plate shape using, for example, PET (Polyethylene terephthalate) or glass.

  The first electrode 122 and the second electrode 123 are formed on the cover 120 using, for example, ITO (Indium Tin Oxide).

  For example, as shown in FIG. 2, the first electrode 122 and the second electrode 123 are arranged along the vertical direction and the horizontal direction of the paper surface. In the present embodiment, the horizontal direction in FIG. 2 is the x axis, the vertical direction is the y axis, and the upper left of the touch sensor unit 12 is the origin.

  In the x-axis direction, for example, m second electrodes 123 are arranged at equal intervals. This m is, for example, a positive integer. For example, the second electrode 123 is connected to the touch detection unit 125, and the touch detection unit 125 sequentially connects to the second electrode 123 according to the clock signal and reads the capacitance.

  In the y-axis direction, for example, n first electrodes 122 are arranged at equal intervals. This n is, for example, a positive integer. The first electrode 122 is connected to, for example, the drive unit 124, and the drive unit 124 supplies a voltage in order according to the clock signal generated by the clock signal generation unit 36. For example, as shown in FIG. 2, this voltage is supplied from the power source of the vehicle 6 or adjusted to a voltage necessary for the operation of the display input device 1.

  For example, the second electrodes 123 arranged in parallel to the y-axis are formed in a layer closer to the detection surface 121 than the first electrodes 122 arranged in parallel to the x-axis. Further, the first electrode 122 is electrically insulated from the second electrode 123, for example.

Here, the coordinates of the x-axis are indicated by x ₁ to x _m from the left to the right, with subscript numbers ( _{1 to m} ) added to x. The coordinates of the y-axis is denoted by the subscript numbers (1 to n) to y, from top to bottom and indicates the _y 1 ~y _n.

Specifically, the drive unit 124 is, for example, supplies a voltage in the order of _y 1 ~y _n of the first electrode 122. In addition, the touch detection unit 125 is configured to read out the capacitance in the order of x ₁ to x _m of the second electrode 123, for example.

The touch detection unit 125, for example, on the basis of the read value of the capacitance of each of the second electrode 123 (capacitance value), the coordinate values (capacitance value of x _m, the capacitance value of y _n , T) is generated and output to the sensor controller 34 as a detection signal. The time t indicates, for example, the time when the clock signal is output.

(Configuration of display unit 14)
The display unit 14 is a known liquid crystal display such as a TFT (Thin Film Transistor) type. For example, the display unit 14 is connected to the display controller 22 of the microcomputer 20 and displays an image on the display screen 140 based on a display signal output from the display controller 22.

(Configuration of microcomputer 20)
The microcomputer 20 includes, for example, a CPU that performs operations and processing on acquired data according to a program, a RAM (Random Access Memory) that is a semiconductor memory, a ROM (Read Only Memory), and the like. For example, a program for operating the CPU is stored in the ROM. For example, the RAM is used as a storage area for temporarily storing calculation results and the like.

  For example, as shown in FIG. 2, the microcomputer 20 includes a display controller 22, a determination unit 24, a display image generation unit 26, a control unit 32, a sensor controller 34, and a clock signal generation unit 36. It is roughly structured.

  For example, the display controller 22 is configured to generate a display signal based on the display image information 260 output from the display image generation unit 26 and display an image based on the display signal on the display unit 14.

  The determination unit 24 calculates, for example, the coordinates at which the finger touches or approaches from the coordinate value based on the detection signal acquired from the touch detection unit 125 of the touch sensor unit 12. As the calculation method of the coordinates, for example, a known method such as a method using a weighted average is used. Then, the determination unit 24 determines operations such as a drag operation, a pinch-out operation, a pinch-in operation, a touch operation, a tap operation, and a long press operation from the calculated time change of at least one coordinate.

  The display image generation unit 26 is configured to generate a display image to be displayed on the display unit 14 based on the operation determined by the determination unit 24, for example. For example, the display image generation unit 26 generates display image information 260 that is information of a display image to be displayed on the display unit 14 and outputs the display image information 260 to the display controller 22. The display image information 260 includes, for example, background image information displayed on the entire display screen 140.

  The control unit 32 includes a seat position adjustment device mounted on the vehicle 6 based on the operation determined by the determination unit 24 and the control information 320 that defines the function assigned to the display image displayed on the display unit 14. It controls electronic devices such as air conditioners, navigation devices, audio devices, visibility securing devices, and driving support devices. Moreover, the control part 32 controls each part of the microcomputer 20, for example.

  For example, the sensor controller 34 controls the touch sensor unit 12. Specifically, it is configured to control the voltage to be supplied, control the supply time, control the readout timing of the capacitance, and the like.

  The clock signal generator 36 generates, for example, a clock signal necessary for the operation of the display input device 1 and supplies the clock signal to each unit.

  The memory 38 is a semiconductor memory, for example. The memory 38 stores connected device information 380. The connected device information 380 is information on an electronic device to which the display input device 1 is connected. The information on the electronic device is, for example, information on an image to be displayed on the display screen 140, information on a function assigned to the image, and the like. The memory 38 may be configured using a memory such as a ROM of the microcomputer 20, for example. When the function list displayed by the long press operation is common without depending on the electronic device, common information regarding the function list is stored.

  The communication unit 40 is configured to be able to communicate with a connected electronic device, for example. The connected device information 380 is stored in the memory 38 via the communication unit 40, for example. The communication unit 40 is connected to the electronic device by, for example, wired or wireless.

  FIG. 3 is a schematic diagram illustrating an example of a configuration of display image information according to the embodiment.

  The display image information 260 includes a plurality of hierarchies S1, S2, S3,. The hierarchy S1 has options s11, s12, s13, s14, and s15. Further, the hierarchy S2 has options s21, s22, s23..., And the hierarchy S3 has options s31, s32, s33.

  The hierarchies S1, S2, S3,... Are related to each other like a tree structure. For example, in the hierarchy S2, options s21, s22, s23, s24, s25, s26 are provided in an area corresponding to the option s11 of the hierarchy S1. It is arranged so as to belong to s11. In the hierarchy S3, s31 and s32 are arranged in an area corresponding to the selection s21 of the hierarchy S2.

  Further, among the options arranged in the same area of each hierarchy S1, S2, S3..., Control information 320 is assigned to the option arranged in the hierarchy having the largest value. For example, in the hierarchy S2, the options s21, s22, s23, s24, s25, and s26 are arranged in the area corresponding to the option s11 in the hierarchy S1, but the option in the area corresponding to the option s21 in the hierarchy S2 is arranged in the hierarchy S3. Since s31 and s32 are further arranged and there is no higher hierarchy, control information 320 for sliding the sheet in the “+” direction and the “−” direction is assigned to the options s31 and s32, respectively.

  Of each hierarchy S1, S2, S3..., A portion of the display area A1 is displayed on the display screen 140. The display area A1 can be moved by a drag operation described later, and the size can be changed by a pinch-in and pinch-out operation. Further, the display area A1 moves between the layers S1, S2, S3... By pinching in and out beyond the lower limit and upper limit of the size of the display area A1. Details will be described in the item of operation described later.

  4A to 4C are schematic diagrams illustrating a typical operation example with respect to the touch sensor unit in the embodiment.

  The operation shown in FIG. 4A is an operation called “drag”, for example, an operation of moving an arbitrary finger of the user's hand H1 while being in contact with the detection surface 121.

  The operation shown in FIG. 4B is an operation called “pinch out”, and shows an operation of moving any two fingers of the user's hand H1 away from each other while being in contact with the detection surface 121. .

  The operation shown in FIG. 4C is an operation called pinch-in, and shows an operation of moving any two fingers of the user's hand H1 toward each other while keeping the detection surface 121 in contact.

  In addition, although not shown, a touch operation, a tap operation, and a long press operation can also be used.

  The touch operation refers to an operation of touching the detection surface 121 with a finger, for example. The tap operation indicates an operation of touching the detection surface 121 in a shorter time than the touch operation, in other words, an operation of hitting the detection surface 121. Further, by repeating the tap operation a plurality of times within a predetermined time, different functions corresponding to the number of times can be executed. For example, one tap operation corresponds to a click performed with a mouse. In addition, for example, two consecutive tap operations (double tap operations) correspond to double clicks performed with a mouse.

  The long press operation is an operation in which the detection surface 121 is kept in contact for a longer time than a predetermined time. This determination of the long press operation is performed, for example, by comparing the threshold value related to the operation time stored in the microcomputer 20 or the memory 38 with the time during which the long press operation continues. For example, when the operation is performed on the icon and the time for which the operation continues exceeds a threshold value, the determination unit 24 determines that the long press operation is performed.

(Operation)
First, when the voltage V is input from the power source of the vehicle 6, power is supplied to each unit such as the microcomputer 20, the touch sensor unit 12, and the display unit 14.

  Next, the display image generation unit 26 of the microcomputer 20 outputs the display image information 260 so that the display area A1 is the entire hierarchy S1 of the display image information 260 as an initial setting.

  Next, the display controller 22 generates a display signal based on the display image information 260 output from the display image generation unit 26 and causes the display unit 14 to display an image based on the display signal.

  In addition, the sensor controller 34 performs control of voltage supplied to the touch sensor unit 12, control of supply time, control of timing of readout of capacitance, and the like.

  The determination unit 24 calculates the coordinates at which the finger touches or approaches from the coordinate value based on the detection signal acquired from the touch detection unit 125 of the touch sensor unit 12, and performs a drag operation, a pinch-out operation, a pinch-in operation, and a touch operation. The operation such as the tap operation and the long press operation is determined.

  Next, the display image generation unit 26 generates a display image to be displayed on the display unit 14 based on the operation determined by the determination unit 24. An example of the specific operation is shown below.

  5A and 5B are examples of the operation of the display input device 1 based on the relationship between the display image A2 displayed on the display screen 140, the display image information 260, the display area A1, and the operation content determined by the determination unit 24. It is the schematic for demonstrating.

  FIG. 5A (a) is a display image A2 displayed on the display screen 140 as an initial setting. In this case, the display image generation unit 26 of the microcomputer 20 outputs the display image information 260 so that the display area A1 is the entire hierarchy S1 of the display image information 260.

  When the display image A2 is being displayed, if the drag operation described in FIG. 4A with respect to the touch sensor unit 12 moves to the lower right with respect to the detection surface 121, the determination is made. The unit 24 determines that the drag operation moves to the lower right based on the detection signal acquired from the touch detection unit 125 of the touch sensor unit 12.

  Next, as shown in FIG. 5A (b), the display image generation unit 26 displays the display image information 260 as display image information to be displayed on the display unit 14 based on the drag operation determined by the determination unit 24. The display image information 260 corresponding to the state moved to the upper left of the hierarchy S1 is output. As a result, the display image A2 in which the option s11 indicating “sheet” is located at the center is displayed on the display screen 140.

  Next, when the pinch-out operation described in FIG. 4B is performed on the touch sensor unit 12 in the state where the display image A2 illustrated in FIG. It is determined that the operation is a pinch-out operation based on the detection signal acquired from the touch detection unit 125 of the sensor unit 12.

  Next, as shown in FIG. 5A (c), the display image generation unit 26 displays the display region A1 in FIG. 5A (FIG. 5A) as display image information to be displayed on the display unit 14 based on the pinch-out operation determined by the determination unit 24. The display image information 260 corresponding to a reduced state is output as compared with that in b). As a result, the option s11 indicating “sheet” is located at the center, and the display image A2 enlarged as compared with that in FIG. 5A (b) is displayed on the display screen 140.

  Next, in the state where the display image A2 shown in FIG. 5A (c) is displayed, when a further pinch-out operation is performed on the touch sensor unit 12, the determination unit 24 causes the touch detection unit of the touch sensor unit 12 to Based on the detection signal acquired from 125, it is determined that the operation is a pinch-out operation.

  Next, the display image generation unit 26 tries to further reduce A1 as display image information to be displayed on the display unit 14 based on the pinch-out operation determined by the determination unit 24, but the size of A1 reaches the lower limit value. Then, as shown in FIG. 5B (a), display image information 260 corresponding to the state in which the display area A1 has moved to the hierarchy S2 is output. As a result, the display image A2 on which the options s21 to s26 such as “slide”, “reclining”, “vertical”, “lumbar support”, “side support”, and “sheet memory” related to “seat” are displayed is displayed on the display screen 140. .

  Next, in the state where the display image A2 shown in FIG. 5B (a) is displayed, if the touch sensor unit 12 is a drag operation and moves to the left with respect to the detection surface 121, the determination is made. The unit 24 determines that the operation is a drag operation based on the detection signal acquired from the touch detection unit 125 of the touch sensor unit 12.

  Next, as shown in FIG. 5B (b), the display image generation unit 26 displays the display area A1 on the hierarchy S2 as display image information to be displayed on the display unit 14 based on the drag operation determined by the determination unit 24. Display image information 260 corresponding to the state moved to the right is output. As a result, the display image A2 on which the options s27 to s212 such as “temperature”, “air volume”, “air outlet”, “seat heater”, “A / C”, “AUTO”, etc. of the hierarchy S2 related to the “air conditioner” of the hierarchy S1 are displayed. Is displayed on the display screen 140.

  Next, in a state where the display image A2 shown in FIG. 5B (b) is displayed, when a pinch-in operation is performed on the touch sensor unit 12, the determination unit 24 starts from the touch detection unit 125 of the touch sensor unit 12. It is determined that the operation is a pinch-in operation based on the acquired detection signal.

  Next, the display image generation unit 26 tries to enlarge A1 as display image information to be displayed on the display unit 14 based on the pinch-in operation determined by the determination unit 24. When the size of A1 reaches the upper limit value, As shown in FIG. 5B (c), display image information 260 corresponding to the state in which the display area A1 has moved to the hierarchy S1 is output. As a result, the option “s12” of the “air conditioner” of the hierarchy S1 related to the options s27 to s212 such as “temperature”, “air flow”, “air outlet”, “seat heater”, “A / C”, and “AUTO” of the hierarchy S2 is displayed. The display image A2 is displayed on the display screen 140.

  In addition, when the determination unit 24 determines that a pinch-out operation has been performed in a state where an option that does not have the next hierarchy is displayed, the control unit 32 includes control information 320 that defines a function assigned to the option. Based on the above, electronic devices such as a seat position adjusting device, an air conditioner, a navigation device, an audio device, a view securing device, and a driving support device mounted on the vehicle 6 are controlled. Moreover, the control part 32 controls each part of the microcomputer 20, for example. For example, when a pinch out is performed in a state in which the options s31 and s32 indicating “+” and “−” in the hierarchy S3 corresponding to the option s11 indicating “slide” in the hierarchy S2 are displayed, the control unit 32 causes the sheet to be displayed. The position adjustment device is instructed to slide the sheet in the “+” direction and the “−” direction.

(Effect of embodiment)
According to the above-described embodiment, the options (for example, s21 to s26) of the lower layer S2 corresponding to the options (for example, s11) of the layer S1 of the display image information 260 are arranged in the region corresponding to the touch sensor unit 12. Since the display area A1 moves between the hierarchies S1 and S2 in accordance with an operation on the display area and is freely movable on each hierarchy, a lower option belonging to an option different from the option selected in the upper hierarchy is searched. In this case, it is possible to arrive without returning to the upper hierarchy. That is, the operation procedure for reaching the desired option when the option is displayed for each layer can be reduced.

  Also, in the hierarchy S2, the user can arrange the option indicating “seat heater” or the like whose category is ambiguous at a position corresponding to the region near the boundary between the “seat” and “air conditioner” that are the options in the upper hierarchy. It is possible to reduce the operating procedure required to reach the desired option.

  The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from or adjusting the technical idea of the present invention. For example, the operation determined by the determination unit 24 is not limited to a drag operation, a pinch-out operation, a pinch-in operation, and the like, and any type can be used as long as the operation can be input to the touch sensor unit 12. Further, the association between the determination of the determination unit 24 described in the embodiment and the movement, enlargement / reduction, and the like of the display area A1 is an example, and the association can be arbitrarily changed. Further, instead of the touch sensor unit 12, a cross key, a determination button, or the like may be used.

DESCRIPTION OF SYMBOLS 1 ... Display input device, 6 ... Vehicle, 12 ... Touch sensor part, 14 ... Display part, 20 ... Microcomputer, 22 ... Display controller, 24 ... Determination part, 26 ... Display image generation part, 32 ... Control part, 34 ... Sensor controller 36 ... Clock signal generation unit 38 ... Memory 40 ... Communication unit 60 ... Center console 62 ... Meter panel 63 ... Steering wheel 64 ... Shift lever 120 ... Cover 121 ... Detection surface 122 ... 1st electrode, 123 ... 2nd electrode, 124 ... drive part, 125 ... touch detection part, 140 ... display screen, 260 ... display image information, 320 ... control information, 380 ... connected device information

Claims (3)

A storage unit that stores a plurality of layers having a plurality of option images, and stores display image information associated with coordinates of adjacent layers in which coordinates of each layer are adjacent;
An operation unit for detecting operation content and outputting at least a first detection signal and a second detection signal;
A display unit for displaying a display image;
The display area indicating the area of the display image displayed on the display section of the display image information stored in the storage section is moved on the hierarchy based on the first detection signal output by the operation section. Or a display image generation unit that generates a display image to be displayed on the display unit based on the display area as a result of the movement to an adjacent hierarchy at the same coordinates based on the second detection signal. A display input device. The operation unit detects an operation content and outputs a third detection signal,
The control unit according to claim 1, further comprising: a control unit that outputs a control signal associated with an option image included in a display image displayed on the display unit based on the third detection signal output from the operation unit. Display input device. The operation unit detects an operation content and outputs a fourth detection signal,
The display input device according to claim 1, wherein the display image generation unit enlarges or reduces the display area based on the fourth detection signal output from the operation unit.

Images