WO2018123320A1

WO2018123320A1 - User interface device and electronic apparatus

Info

Publication number: WO2018123320A1
Application number: PCT/JP2017/041151
Authority: WO
Inventors: 佐藤　克則; 兼平　浩紀; 赤間　博; 優子千田; 森田　修身; 佳共; 光春菅原
Original assignee: デクセリアルズ株式会社
Priority date: 2016-12-27
Filing date: 2017-11-15
Publication date: 2018-07-05
Also published as: JP2018106434A

Abstract

A control unit provided to this user interface device determines a touch operation on the basis of coordinate detection information, which a coordinate detection unit detects and outputs. Furthermore, the control unit determines a pressing operation on the basis of pressure sensitive detection information, which a pressure sensitive detection unit outputs when the pressure sensitive detection unit detects that the pressing operation has been performed. Then, on the basis of a gesture operation comprising the combination of the touch operation and the pressing operation, the control unit outputs, to a display control unit, control information for changing the display mode of an object.

Description

User interface device and electronic device

The present invention relates to a user interface device and an electronic device.

In recent years, touch panels that can be easily and sensibly operated with a finger or the like have become widespread, and various studies and developments have been made on downsizing, thinning, lightening, power saving, and cost reduction of touch panels. . As a method for detecting a position where an instruction medium such as a finger touches the touch panel (referred to as “touch position”), a resistance film type that detects a change in electrical resistance, a surface acoustic wave method that uses ultrasonic waves, an electrostatic A capacitance method for detecting a change in capacitance is known. In particular, a capacitive touch panel is attracting attention in that it can detect a plurality of touch positions.

The capacitive touch panel includes a transparent electrode that generates a capacitance and an external circuit that detects a change in the capacitance. In recent years, a touch panel including a pressure-sensitive sensor capable of detecting a pressing force when the touch panel is pressed with a stylus pen, a finger, or the like is being provided.

For example, in Patent Document 1, input determination by pressing on the input operation surface is performed based on a change in capacitance of the upper electrode and lower electrode of the pressure-sensitive sensor displaced by the top plate and the touch panel moving in the pressing direction. A technique for determining that an operation has been performed is disclosed.

Patent Document 2 discloses a sensor device including a pressure-sensitive sensor that does not use an elastic member.

JP 2011-134000 A Japanese Unexamined Patent Publication No. 2011-100364

Touch panels are used in various electronic devices. As an electronic device using a touch panel, for example, there is a navigation device that is mounted on a car and displays a map, directions, and the like from the current position of the vehicle to a destination on a display panel. A navigation device requires a simple operation. However, the touch panel attached to the conventional navigation device has only a function of detecting the XY coordinates of the touch position, and it is inconvenient because a complicated operation must be performed by the user to obtain a desired result. .

Moreover, in the touch panel provided with the pressure sensitive sensor disclosed in

Patent Documents

1 and 2, the pressure sensitive sensor is merely used in an auxiliary manner in order to reliably detect that a finger or the like has touched the touch panel. For this reason, even if it is the touch panel which applied the technique disclosed by

patent document

1 and 2, operation itself is the same as that of the touch panel which does not have a conventional pressure-sensitive function, and the inconvenience of operation was not eliminated. . Moreover, since the operation using an external input device etc. is requested | required in the touchscreen which is not provided with a pressure sensor, it took time until the user became familiar with operation.

The present invention has been made in view of such a situation, and an object thereof is to make it possible to easily obtain a result requested by a user.

A user interface device according to the present invention includes a display panel that displays an object, a display control unit that performs control to display an object on the display panel according to control information, a touch panel that performs a touch operation using an instruction medium, and a touch operation that is performed. A coordinate detector that detects the coordinates of the touch position of the touch panel and outputs coordinate detection information; a pressure sensor that outputs a sensor value that changes according to the pressing force applied to the touch panel by the pointing medium; and a sensor value , A pressure sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure sensitive detection information, a touch operation determined based on the coordinate detection information, and pressure sensitive Based on the gesture operation that combines the push operation determined based on the detection information, And a control unit, the outputs of the control information for changing the display form on the display control unit.
An electronic apparatus according to the present invention includes the above-described user interface device and an electronic apparatus main body. The electronic device main body performs a predetermined process based on content instructed by a touch operation or a gesture operation input from the control unit, and outputs an object on which the predetermined process has been performed to the control unit of the user interface device.

According to the present invention, the user can easily obtain the result requested by the user by performing an intuitive gesture operation that combines the touch operation and the push-in operation.
Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

It is explanatory drawing which shows a state when the driver's seat and front passenger seat of the vehicle by which the navigation apparatus which concerns on the 1st Embodiment of this invention is mounted are seen toward the front from the back of the advancing direction. It is a block diagram which shows the internal structural example of the user interface apparatus which concerns on the 1st Embodiment of this invention. 1 is a schematic configuration diagram of a user interface device according to a first embodiment of the present invention. It is explanatory drawing of the operation principle of the pressure-sensitive sensor which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of the conventional expansion or reduction operation. It is a flowchart which shows the example of expansion or reduction operation which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of expansion or reduction operation which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the example of expansion or reduction operation which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the example of the switching operation of the conventional character type. It is a flowchart which shows the example of switching operation of the character type which concerns on the 4th Embodiment of this invention. It is a flowchart which shows the example of the conventional menu selection operation. It is a flowchart which shows the example of menu selection operation which concerns on the 5th Embodiment of this invention. It is a flowchart which shows the example of the conventional cancellation operation. It is a flowchart which shows the example of cancellation operation which concerns on the 6th Embodiment of this invention. It is explanatory drawing which shows the example of installation of the conventional user interface apparatus. It is a flowchart which shows the example of operation of the conventional navigation apparatus. It is explanatory drawing which shows the structural example of the navigation apparatus which concerns on the 7th Embodiment of this invention. It is a flowchart which shows the operation example of the navigation apparatus which concerns on the 7th Embodiment of this invention.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same function or configuration are denoted by the same reference numerals, and redundant description is omitted.

[First Embodiment]
FIG. 1 is an explanatory diagram showing a state when a driver seat and a passenger seat of a vehicle on which the navigation device 1 is mounted are viewed from the rear in the traveling direction toward the front.
The navigation device 1 (an example of an electronic device) is installed at a position sandwiched between the dashboard 5 and the meter panel 6 and visible to a user who holds the steering wheel 7. A shift lever 8 is provided below the navigation device 1.

The navigation device 1 includes a navigation device body 2 that performs processing necessary for navigation, and a user interface device 3. The navigation device body 2 is fitted in a recess formed in the dashboard 5 and cannot be directly recognized by the user. The user interface device 3 is disposed at a position where the user can visually recognize, and outputs an instruction input by the user to the navigation device main body 2 and indicates a processing result by the navigation device main body 2 to the user.

The user interface device 3 is configured to have a sense of unity with the interior shape from the dashboard 5, the meter panel 6 and the shift lever 8 to the base of the windshield 4. The user interface device 3 displays information (a map, various icons, etc.) necessary for navigation processing and the like output from the navigation device body 2. The user touches an instruction medium such as a user's finger or stylus pen on the touch panel 20 (see FIG. 2 to be described later) to move an icon displayed on the user interface device 3 or to enlarge or reduce a map or the like. It is possible to perform gesture operations.

In the following description, it is assumed that the instruction medium touching the touch panel 20 is a user's finger. In addition, an operation performed by the user moving his / her finger while touching the touch panel 20 is referred to as a “touch operation”, and an operation in which the user presses the touch panel 20 with a finger is referred to as a “pressing operation”. An operation performed by combining the touch operation and the pressing operation is referred to as a “gesture operation”. Note that the conventional gesture operation is performed only by a touch operation.

FIG. 2 is a block diagram illustrating an internal configuration example of the user interface device 3.
Before describing the internal configuration of the user interface device 3, the operation of the navigation device body 2 will be described. The navigation device main body 2 (an example of the electronic device main body) performs predetermined processing based on the instructed content by a touch operation or a gesture operation input from the control unit 10 of the user interface device 3. Then, the navigation device body 2 outputs the object after performing the predetermined processing based on the instruction to the control unit 10 of the user interface device 3. Further, the control unit 10 determines a touch operation (finger moving direction, touch position, etc.) performed on the object.

Objects that are output from the navigation device body 2 to the user interface device 3 include, for example, maps, character strings, icons, images, and the like. The navigation device body 2 performs navigation processing based on the gesture operation performed on the user interface device 3, outputs a map for display by the user interface device 3, and receives a character string input from the user interface device 3. Edit it.

The user interface device 3 includes a control unit 10, a storage medium control unit 14, a storage medium 15, a communication control unit 16, a coordinate detection unit 17, a pressure sensitive detection unit 18, and a display control unit 19 connected by a bus B. The user interface device 3 also includes a touch panel 20 connected to the coordinate detection unit 17, a pressure sensor 30 connected to the pressure detection unit 18, and a display panel 40 connected to the display control unit 19.

The control unit 10 controls the operation of each unit in the user interface device 3. The control unit 10 determines that a touch operation has been performed based on the coordinate detection information input from the coordinate detection unit 17, and outputs information input from the touch position to the navigation device body 2. Further, the control unit 10 determines that the pressing operation in which the touch panel 20 is pressed with a finger is performed based on the pressure-sensitive detection information input from the pressure-sensitive detection unit 18. In addition, the control unit 10 outputs control information for causing the display panel 40 to display the object output from the navigation device body 2 to the user interface device 3 to the display control unit 19. Then, the control unit 10 outputs control information for changing the display form of the object displayed on the display panel 40 to the display control unit 19 based on a gesture operation that combines the touch operation and the push-in operation. In the first to third embodiments, changing the display form of an object means, for example, displaying a map on an enlarged or reduced scale.

The control unit 10 includes a CPU 11, a RAM 12, and a ROM 13, and the CPU 11, the RAM 12, and the ROM 13 work together to realize the function of the control unit 10.
The CPU (Central Processing Unit) 11 is an example of a computer that controls the operation of each unit in the user interface device 3. For example, the CPU 11 executes a program read from the ROM 13 and performs processing related to the gesture operation according to the present embodiment.
A RAM (Random Access Memory) 12 stores temporary data such as a program executed by the CPU 11.

ROM (Read Only Memory) 13 stores a program read by the CPU 11 and the like. The ROM 13 is used as an example of a computer-readable non-transitory recording medium that stores a program executed by the CPU 11. For this reason, this program is permanently stored in the ROM 13. Note that the computer-readable non-transitory recording medium storing the program executed by the CPU 11 may be a recording medium such as a CD-ROM or a DVD-ROM.

The storage medium control unit 14 controls the storage medium 15. For example, the storage medium control unit 14 writes data input from the control unit 10 to the storage medium 15, or reads data stored in the storage medium 15 according to an instruction from the control unit 10 and outputs the data to the control unit 10. .
For example, the storage medium 15 is inserted into a slot or the like provided in the user interface device 3 and stores data written by the storage medium control unit 14 or data is read by the storage medium control unit 14. For example, the storage medium 15 stores a navigation program that operates in the navigation apparatus main body 2, upgrade data of a character editing program, and the like.
The communication control unit 16 controls data communication processing performed through the network N between the navigation device body 2 and the user interface device 3.

The coordinate detection unit 17 detects the coordinates of the touch position of the touch panel 20 where the touch operation is performed. The touch panel 20 is formed in a planar rectangular shape, and the position of the intersection of the X electrode and the Y electrode that intersect each other is coordinate information, and a value corresponding to the change in capacitance at this position is given to the coordinate detection unit 17. Is output. The coordinate detection unit 17 detects the coordinate of the location where the coordinate information input from the touch panel 20 has changed as a finger touch position, and outputs coordinate detection information including the coordinate of the touch position to the control unit 10.

The pressure sensitive detection unit 18 detects that the touch panel 20 is pressed with a finger and the pressure sensitive sensor 30 senses pressure. The pressure-sensitive sensor 30 is provided on the back surface of the touch panel 20 and outputs a sensor value that changes according to the pressing force applied to the touch panel 20 by a finger to the pressure-sensitive detection unit 18. Based on the sensor value input from the pressure-sensitive sensor 30, the pressure-sensitive detection unit 18 detects that a pressing operation for pressing the touch panel 20 with a finger is performed, and outputs pressure-sensitive detection information to the control unit 10. To do.

The display control unit 19 performs control to display objects such as icons and maps necessary for navigation on the display panel 40 formed in a planar rectangular shape according to the control information input from the control unit 10.

FIG. 3 is a schematic configuration diagram of the user interface device 3.
In FIG. 3, the position of the pressure-sensitive sensor 30 installed on the touch panel 20 as viewed from above and the position of the frame of the housing 55 are indicated by broken lines. Six pressure-sensitive sensors 30 are provided on the back surface of the touch panel 20 on the frame of the housing 55 of the user interface device 3 including the touch panel 20. For this reason, the user does not see the pressure sensor 30 directly. As shown in FIG. 3, a plurality of pressure-sensitive sensors 30 are usually provided, but a plurality of pressure-sensitive sensors 30 are not necessarily provided, and may be one.

A cross-sectional view of the touch panel 20 and the pressure sensor 30 is shown below FIG.
The top plate 50 protects the surface of the touch panel 20. A transparent glass substrate, a film, or the like is used for the top plate 50. The surface of the top plate 50 is an input operation surface 51 on which a user touches a finger for performing a touch operation.

The touch panel 20 is configured, for example, by laminating a transparent X electrode substrate 21, an adhesive layer 22, and a Y electrode substrate 23 in this order. The top plate 50 and the X electrode substrate 21 are bonded and fixed by an adhesive layer 52. Each of the X electrode substrate 21 and the Y electrode substrate 23 has a rectangular shape. The X electrode substrate 21 and the Y electrode substrate 23 are bonded by the adhesive layer 22. An area where the X direction detection electrode (not shown) formed on the X electrode substrate 21 and the Y direction detection electrode (not shown) formed on the Y electrode substrate 23 overlap each other in a plane is a coordinate detection area on the XY plane. Become. The pressure sensitive sensor 30 is disposed in a peripheral area (frame) outside the coordinate detection area on the XY plane of the touch panel 20.

The pressure-sensitive sensor 30 includes an elastic body 33 made of a dielectric material disposed between the touch panel 20 and the housing 55, and an upper electrode 31 and a lower electrode 35 that are disposed so as to sandwich the elastic body 33 and form a capacitor. Is provided. The pressure-sensitive sensor 30 further includes an adhesive layer 32 that bonds and fixes the elastic body 33 and the upper electrode 31, and an adhesive layer 34 that bonds and fixes the elastic body 33 and the lower electrode 35. In the present embodiment, the elastic bodies constituting the six pressure-sensitive sensors 30 are connected to form one frame-shaped elastic body 33, and the six pressure-sensitive sensors 30 form one elastic body 33. Sharing. By providing the elastic body 33 in a ring shape, it is possible to prevent foreign dust or the like from entering the gap 41 between the touch panel 20 and the housing 55, that is, between the touch panel 20 and the display panel 40. Further, the lower electrodes 35 constituting the six pressure sensors 30 are connected to constitute one frame-like lower electrode 35, and the six pressure sensors 30 share one lower electrode 35. The upper electrode 31 may also be formed in a frame shape like the lower electrode 35.

For the elastic body 33, for example, a material having a small residual strain and a high restoration rate (restoration speed) is used. Examples of the material used for the elastic body 33 include silicone rubber and urethane rubber. The elastic body 33 may be displaced about 10% at the maximum with respect to the height of the original elastic body 33, for example. For example, the elastic body 33 having a thickness of 0.5 mm used for the pressure-sensitive sensor 30 may be displaced by about 10 μm.

When the input operation surface 51 is pressed with a finger in a pressing direction (z-axis direction) perpendicular to the input operation surface 51, the elastic body 33 of the pressure sensor 30 is distorted so that the pressure sensor 30 is bonded and fixed. The top plate 50 and the touch panel 20 are moved in the pressing direction. Thus, when the pressure sensor 30 is pressed, its thickness is displaced in the pressing direction. Then, the back surface of the touch panel 20 approaches the front surface of the display panel 40 by the amount of displacement of the pressure sensor 30, so that a gap 41 is provided between the touch panel 20 and the display panel 40 in consideration of the movement of the touch panel 20. ing. However, the gap 41 is not provided when the touch panel 20 and the display panel 40 are bonded. The pressure-sensitive sensor 30 outputs a sensor value corresponding to the capacitance of the capacitor formed by the upper electrode 31 and the lower electrode 35 to the pressure-sensitive detection unit 18.

FIG. 4 is a diagram for explaining the operating principle of the pressure-sensitive sensor 30. Here, the description of the touch panel 20 is omitted.
An example of the pressure-sensitive sensor 30 that is not pressed with a finger is shown in the upper left of FIG. 4, and an example of the pressure-sensitive sensor 30 that is pressed with a finger is shown in the upper right of FIG.

As described above, when the touch panel 20 is pressed with a finger and a pressing force is applied to the pressure sensor 30, the elastic body 33 is distorted so that the thickness decreases. And the electrostatic capacitance of the pressure sensor 30 changes because the thickness of the pressed pressure sensor 30 changes with respect to the thickness of the pressure sensor 30 which is not pressed. For example, when the pressure sensor 30 is pressed with a finger and the thickness of the elastic body 33 is reduced by the displacement d, the capacitance between the upper electrode 31 and the lower electrode 35 changes. For this reason, the pressure-sensitive detection unit 18 uses the capacitance change rate between the upper electrode 31 and the lower electrode 35 due to the displacement d of the elastic body 33, the touch panel 20 is pressed, and the pressure-sensitive sensor 30 senses pressure. (Hereinafter referred to as “pressure detection”). The capacitance change rate is obtained based on sensor values output from the upper electrode 31 and the lower electrode 35 by the pressure-sensitive detection unit 18. Here, the sensor value is a voltage determined by the capacitance between the upper electrode 31 and the lower electrode 35. That is, the rate of change in capacitance is the static between the upper electrode 31 and the lower electrode 35 of the pressed pressure sensor 30 with respect to the capacitance between the upper electrode 31 and the lower electrode 35 of the pressure sensor 30 that is not pressed. It is obtained as a percentage of electric capacity.

4 is a graph showing the relationship between the capacitance change rate of the pressure sensor 30 and the pressing force applied to the pressure sensor 30. The lower graph in FIG. From this graph, it can be seen that the capacitance change rate of the pressure sensor 30 has a linear characteristic that is substantially proportional to the pressing force applied to the pressure sensor 30. The pressure-sensitive detection unit 18 according to the present embodiment obtains a change in capacitance between the upper electrode 31 and the lower electrode 35 based on a sensor value input from the pressure-sensitive sensor 30, that is, obtains a rate of change in capacitance. Is possible.

The pressure-sensitive detection unit 18 detects the sensor value detected by each pressure-sensitive sensor 30 disposed on the back surface of the touch panel 20 based on the graph showing the relationship between the pressing force at the bottom of FIG. It is converted into a pressing force when the touch panel 20 is pressed. Then, when the pressing force exceeds the pressing threshold, the pressure-sensitive detection unit 18 determines that the user has consciously pressed the touch panel 20 and outputs pressure-sensitive detection information to the control unit 10.

Note that the pressure-sensitive detection unit 18 may obtain the pressing force based on the total value of the respective capacitance change rates detected by the pressure-sensitive sensors 30. Thereby, it is possible to detect the pressing force with high accuracy without depending on only the touch position on the input operation surface 51. Note that the pressure-sensitive detection unit 18 may obtain the pressing force from an average value obtained by dividing the total value of the capacitance change rates by the number of the pressure-sensitive sensors 30, for example.

Further, the pressure-sensitive detection unit 18 may output pressure-sensitive detection information that varies depending on the magnitude of the pressing force to the control unit 10. For example, in the lower graph of FIG. 4, the pressing force at which the capacitance change rate is 2.0% is defined as a threshold th1 (an example of the first pressing threshold value), and the pressing force at which the capacitance change rate is 6.0%. Let the pressure be a threshold th2 (an example of a second pressing threshold). If the pressing force is less than the threshold th <b> 1, it is considered that the capacitance has only changed due to vibration applied to the user interface device 3 through the housing 55. That is, it is assumed that the user does not intentionally press the finger into the touch panel 20. In this case, the pressure-sensitive detection unit 18 does not determine that the user has pressed the finger into the touch panel 20, and therefore does not output pressure-sensitive detection information. However, if the pressing force is equal to or greater than the threshold th1, the pressure-sensitive detection unit 18 determines that the user has pressed the finger into the touch panel 20, and outputs first pressure-sensitive detection information. Furthermore, if the pressing force is greater than or equal to the threshold th2, the pressure-sensitive detection unit 18 determines that the user has pressed the finger strongly into the touch panel 20, and outputs second pressure-sensitive detection information.

As described above, the pressure-sensitive detection unit 18 uses the first pressure-sensitive detection information or the second pressure-sensitive information based on the pressing force obtained from the capacitance change rate that changes according to the pressing amount of the user pushing the finger into the touch panel 20. Detection information can be output to the control unit 10. As a result, the control unit 10 can perform different processes according to the first pressure detection information or the second pressure detection information input from the pressure detection unit 18. Note that the pressure-sensitive detection information may be only one of the first pressure-sensitive detection information and the second pressure-sensitive detection information. When the first pressure detection information or the second pressure detection information is not distinguished, it is referred to as “pressure detection information”.

The control unit 10 determines that the finger has been pushed into the touch panel 20 and the determination operation by the user has been performed when the pressure-sensitive detection information is input from the pressure-sensitive detection unit 18. At this time, the control unit 10 vibrates the housing 55 or displays a message on the display panel 40 in order to inform the user that it is in the pressed state. Further, a voice guide may be emitted from a speaker (not shown). Or the control part 10 can also display icons, such as a circle and a square, in the pressed touch position. In this case, the icon may be blinked, or the icon display color may be changed. The housing 55 can also generate a click sound or change the touch of the finger when the touch panel 20 is pushed.

Hereinafter, an operation example using the conventional user interface device 100 and an operation example using the user interface device 3 according to the first embodiment will be described with reference to FIGS. 5 and 6.
Each step of the conventional flowchart shown in FIG. 5 and the flowchart according to the first embodiment of the present invention shown in FIG. 6 includes

user interface devices

3 and 100 in order to explain specific contents of the gesture operation. A display example of the screen displayed on the display panel is shown. In this display example, the position of the user's finger on the touch panel is added.
The screen added to the steps of FIG. 5 and FIG. 6 includes a map screen of the

user interface device

3, 100 at a certain moment, a front view of the finger, a bottom view, and a left side view within a rectangular broken line range. They are displayed at the same time. A thin white arrow in the screen indicates the direction of finger movement.

<Problems of conventional enlargement or reduction operations>
When the user enlarges or reduces the map displayed on the display panel using a conventional touch panel that can only detect the XY coordinates of the touch position as shown in FIG. The operation of expanding or narrowing the distance between the coordinates of the two touch positions called. Thus, the user must use two fingers because it is necessary to perform an operation of widening or narrowing the distance between the coordinates of the two touch positions. In addition, there is a method in which the user can enlarge or reduce the map by double-tapping one finger, but this operation can only be changed to a preset magnification, and can be changed to an arbitrary magnification. I could not. In addition, there is an example in which enlargement or reduction is realized with one finger by a method of double-tapping and then panning (dragging) without releasing the finger. However, such a touch operation is a combination of two gestures, “double tap” and “drag”, which not only makes the touch operation complicated, but also makes it difficult for the user to operate intuitively. there were.

<Conventional gesture operation>
Prior to describing the first embodiment of the present invention shown in FIG. 6, an example of a conventional enlargement or reduction operation will be described with reference to FIG.
FIG. 5 is a flowchart showing an example of a conventional enlargement or reduction operation.
First, a control unit (not shown) provided in the conventional user interface device 100 detects that a finger touches the touch panel provided in the user interface device 100 (S1). Hereinafter, the control unit of the conventional user interface device 100 is simply referred to as a “control unit” without reference numeral. Next, the user selects an operation that changes depending on the number of fingers on the touch panel (S2). Here, an operation performed with one finger (swipe) or an operation performed with two fingers (pinch-in, pinch-out) is selected.

The control unit detects the number of touches of the finger touching the touch panel (S3). When the number of finger touches is one (one in S3), the control unit displays control information (not shown) that displays the control information by moving the map in accordance with the direction in which the finger touching the touch panel moves the touch panel. (S4). Hereinafter, the display control unit of the conventional user interface device 100 is simply referred to as a “display control unit” without reference numerals. On the screen added in step S4, the user moves the map from the lower left to the upper right while touching the screen with one finger, and the map is moved and displayed in accordance with the moving direction of the one finger. The situation is shown.

On the other hand, when the number of finger touches is two (two in S3), the control unit determines whether the distance between the two touch positions is enlarged or reduced (S5). The screen added in step S5 shows a state in which the user touches the vicinity of the center of the screen with two fingers.

When a pinch-out that increases the distance between touch positions is performed (enlargement in S5), the control unit outputs control information for enlarging the map to the display control unit (S6). The screen added in step S6 shows a state in which the user enlarges the map by widening the interval between the two fingers (pinch out) while touching the two fingers on the screen.

On the other hand, when a pinch-in that reduces the distance between touch positions is performed in step S5 (reduction in S5), the control unit outputs control information for reducing the map to the display control unit (S7). The screen added in step S7 shows how the map is reduced and displayed by narrowing the interval between the two fingers (pinch in) while the user touches the screen with two fingers. After any of Steps S4, S6, and S7, the display control unit displays the screen requested by the user on the display panel in accordance with the control information input from the control unit (S8), and ends this process.

Thus, conventionally, the map has been enlarged or reduced using “touch panel touch detection” and “XY coordinate movement detection”. In order to enlarge or reduce the map, the user can only pinch out and pinch in with two fingers, combine two different gestures, or press the display magnification change button. There wasn't.

<Gesture operation of the first embodiment>
FIG. 6 is a flowchart illustrating an example of the enlargement or reduction operation according to the first embodiment. In the first embodiment, the map is enlarged or reduced by a simple operation using one finger. That is, the control unit 10 according to the first embodiment provides the display control unit 19 with control information for enlarging or reducing the map in accordance with the direction in which the finger moves while the touch panel 20 is pressed by the finger. It is possible to output. In the first embodiment, the gesture operation is, for example, an operation of moving a finger pressed by the user into the touch panel 20 upward or downward.

First, when the user's finger touches the touch panel 20 provided in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S11), and detects the coordinates of the touch position. The screen added in step S11 shows a state in which the user touches the lower left of the screen with one finger.

Next, the user selects an operation of pushing a finger into the touch panel 20 (S12). The screen added in step S <b> 12 shows a state in which the user touches the upper left of the screen with one finger and further presses the touch panel 20. That the touch panel 20 is pushed by a finger is indicated by the movement direction of the finger represented by a downward arrow with respect to the touch panel 20.

Next, based on the sensor value output from the pressure sensor 30, the pressure sensor detector 18 determines whether or not the pressure sensor 30 has detected pressure (S13). When the pressure-sensitive detection unit 18 determines that pressure is not detected based on the sensor value (NO in S13), the control unit 10 moves the map in accordance with the direction in which the finger touching the touch panel 20 moves. The control information to be displayed is output to the display control unit 19 (S14). On the screen added in step S14, the map is moved and displayed in accordance with the moving direction of one finger moved from the lower left to the upper right of the screen while the user touches the finger as usual. The state of being done is shown.

On the other hand, when the pressure-sensitive detection unit 18 determines that pressure is detected based on the sensor value (YES in S13), the touch operation is performed with the finger pressed. For this reason, the control unit 10 determines, based on the coordinate detection information input from the coordinate detection unit 17, whether the moving direction of the finger moving in a state where the finger is pressed is up or down with respect to the touch panel 20. (S15).

The control unit 10 enlarges the map displayed on the display panel 40 when the direction in which the touch panel 20 is moved by the finger is upward (an example of the first direction) (above S15). Is output to the display control unit 19 (S16). This map continuously expands as the moving distance of the map pushed into the touch panel 20 increases. The screen added in step S16 shows a state in which the map is enlarged by the user moving his / her finger up while pressing the finger on the touch panel 20.

On the other hand, the control unit 10 reduces the map displayed on the display panel 40 when the direction in which the touch panel 20 is moved by the finger is down (an example of the second direction) (below S15). The control information is output to the display control unit 19 (S17). This map is continuously reduced as the moving distance of the map pushed into the touch panel 20 becomes longer. The screen added in step S <b> 17 shows a state where the map is reduced by the user moving the finger down while pressing the finger on the touch panel 20.

After any of Steps S14, S16, and S17, the display control unit 19 displays the screen requested by the user on the display panel 40 in accordance with the control information input from the control unit 10 (S18), and ends this process.

In the user interface device 3 according to the first embodiment described above, a map displayed on the display panel 40 can be enlarged or reduced at an arbitrary magnification by a simple gesture operation using one finger. It becomes. For this reason, it is possible to simplify an operation method that is conventionally realized by combining two fingers or a plurality of gestures.

For example, when a map is displayed on the display panel 40 by the navigation device 1, the user can automatically move from a location search mode (an operation to move a finger in the XY direction after designating one coordinate) that involves changing the coordinates of the map. There is a case of changing to a magnification change mode (operation for enlarging a map) for confirming the detailed position of the car. At this time, after the user presses the finger touching the touch panel 20 and shifts to the magnification change mode, the user simply zooms in or out of the map by moving the finger pressed down on the touch panel 20 up or down. It becomes possible to reduce. For this reason, the user can realize the intended function with only one finger. In addition, the user can continuously perform an operation for moving and displaying a map such as a map or a photo with one finger and an operation for changing the display magnification of the map. Operation can be realized.

In addition, while the user touches the user interface device 3 with his / her finger, the finger is difficult to move from the touch position even if the running vehicle is shaking. Therefore, it can be operated more accurately than a conventional user interface device using a proximity touch panel. The navigation device body 2 may output control information to the user interface device 3 so that the user cannot operate using the user interface device 3 while the vehicle is traveling. Conversely, control information that allows the user to operate using the user interface device 3 while the vehicle is stopped may be output to the user interface device 3.

Also, the map may be set to be reduced when the direction of movement of the finger pressed by the user is up and to be enlarged when the direction of movement of the finger is down. Also, for example, the map may be enlarged when the direction of the finger pressed by the user is right, and the map may be reduced when the finger is left, or conversely, when the direction of finger movement is left You may zoom in on the map and shrink the map when you are on the right.

In addition, when a map that has been enlarged or reduced is returned to its original magnification and displayed, for example, an operation of immediately releasing the finger that the user has pressed into the touch panel 20 or any mark (circle, square, etc.) is displayed on the touch panel 20. An operation of drawing with a finger may be performed as a reset operation.

Also, in image editing software, image browsing software, and the like, image enlargement or reduction may be realized using the user interface device 3 according to the first embodiment.

[Second Embodiment]
Next, an example of a gesture operation of the user interface device 3 according to the second embodiment of the present invention will be described with reference to FIG. The gesture operation according to the second embodiment is also a gesture operation performed to enlarge or reduce the map.

<Problems of conventional enlargement or reduction operations>
In a conventional user interface device having a touch panel that can detect only the XY coordinates of the touch position, the map is enlarged or reduced by operations called pinch out and pinch in as described above. Pinch-out and pinch-in require gesture operations that increase or decrease the distance between two fingers that touch the screen. Conventionally, a display magnification change button for instructing enlargement or reduction may be displayed at a predetermined position in the screen. However, in order to enlarge or reduce the map, the user must always check the position where the display magnification change button is displayed.

<Gesture operation of the second embodiment>
FIG. 7 is a flowchart illustrating an example of an enlargement or reduction operation according to the second embodiment. In the second embodiment shown in FIG. 7, it is possible not only to enlarge the map but also to reduce the map by a simple operation using one finger. That is, the control unit 10 according to the second embodiment outputs control information for enlarging or reducing the map to the display control unit 19 according to the time during which the state in which the touch panel 20 is pressed by the finger continues. . In the second embodiment, the gesture operation is, for example, an operation in which the user pushes the touch panel 20 with one finger.

First, when the user's finger touches the touch panel 20 provided in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S21), and detects the coordinates of the touch position. On the screen added in step S21, after the user touches the lower left of the screen with one finger, the map moves and displays in accordance with the moving direction of the one finger moved from the lower left to the upper right of the screen. The state of being done is shown.

Next, the user selects an operation of pushing a finger into the touch panel 20 (S22). The screen added in step S22 shows a state in which the user touches the left side of the screen with one finger and further presses the touch panel 20.

Next, the pressure-sensitive detection unit 18 determines whether or not the pressure-sensitive sensor 30 has detected pressure based on the sensor value output from the pressure-sensitive sensor 30 (S23). When the pressure-sensitive detection unit 18 determines that the pressure is detected based on the sensor value (YES in S23), the touch operation is performed with the finger pressed.

And the control part 10 determines whether the pressure-sensitive state is maintained (S24). In the following description, the state in which the pressure-sensitive detection unit 18 continues to output pressure-sensitive detection information to the control unit 10 when the touch panel 20 is pushed with a finger is expressed as “the pressure-sensitive state is maintained”. To do. For example, the control unit 10 determines whether or not the pressure-sensitive state is maintained based on the time that the pressure-sensitive detection information output from the pressure-sensitive detection unit 18 continues. At this time, the control unit 10 determines whether or not the time during which the state in which the touch panel 20 is pressed by the finger continues is equal to or longer than a predetermined time (for example, 1 second).

And the control part 10 determines with the pressure-sensitive state being maintained, if the time for which the state in which the touch panel 20 was pushed in with the finger continues is a predetermined time or more (YES in S24). Furthermore, the control unit 10 determines whether or not a determination time (for example, 2 seconds) has elapsed while the pressure-sensitive state is maintained (S25). The determination in step S25 is performed by the control unit 10 every determination time.

If the determination time has passed with the pressure-sensitive state maintained (YES in S25), the control unit 10 outputs control information for enlarging the map displayed on the display panel 40 to the display control unit 19 (S26). ). The screen added in step S26 shows a state where the map is enlarged and displayed as the display magnification increases as the time when the user presses the finger on the touch panel 20 becomes longer. After step S26, the display control unit 19 displays the screen requested by the user on the display panel 40 in accordance with the control information input from the control unit 10 (S27). After step S27, the control unit 10 returns to step S25 and continues processing. As described above, since the process of steps S25 to S27 is repeated while the user continues to press the finger on the touch panel 20, the map is gradually enlarged and displayed every determination time (for example, 2 seconds).

On the other hand, if the determination time has not elapsed while the pressure-sensitive state is maintained in step S25 (NO in S25), the control unit 10 ends this process. For this reason, when the control part 10 passes step S26, S27, it displays in the state in which the map was expanded.

In step S24, the control unit 10 determines that the pressure-sensitive state is not maintained if the time during which the state in which the touch panel 20 is pressed by the finger continues is less than the predetermined time (NO in S24), and the display panel 40. The control information for reducing the map displayed on the screen is output to the display control unit 19 (S28). The screen added to step S28 shows a state where the map is reduced and displayed at a reduced display magnification.

In Step S23, when it is determined that the pressure-sensitive detection unit 18 does not detect pressure based on the sensor value (NO in S23), the control unit 10 moves the finger touching the touch panel 20 in the moving direction. In addition, control information for moving and displaying the map is output to the display control unit 19 (S29). After one of steps S28 and S29, the display control unit 19 displays the screen requested by the user on the display panel 40 in accordance with the control information input from the control unit 10 (S30), and ends this process.

In the user interface device 3 according to the second embodiment described above, the map is enlarged and displayed when the touch panel 20 is pushed with a finger, and the finger pushed into the touch panel 20 immediately leaves the touch panel 20. Sometimes the map is reduced and displayed. For example, in order to display the map displayed on the display panel 40 in detail or in a wide area, if you press and hold a point on the screen for a long time, the map is enlarged and displayed at a predetermined magnification every 2 seconds. The map is reduced and displayed at a predetermined magnification by pressing a point on the screen and releasing it immediately. Since this gesture operation is performed with one finger, the conventional gesture operation using two fingers becomes unnecessary.

Further, the pressure-sensitive detection unit 18 can detect that the touch panel 20 has been pushed at any position on the touch panel 20. Therefore, the user does not need to search for a conventional magnification change button, and can easily enlarge or reduce the map.

Note that the map may be reduced and displayed when the touch panel 20 is pressed with a finger and the pressure-sensitive state is maintained. When the finger is released from the touch panel 20 immediately after the touch panel 20 is pressed, the map is enlarged. May be displayed.
Further, when the user moves the finger pressed into the touch panel 20 in the same direction, the map may be moved and displayed in accordance with the moving direction of the finger while enlarging or reducing the map.
Further, for example, in the processing of the image editing software, when the pressure sensitive state is maintained and the touch panel 20 is pressed for 2 seconds or more, a plurality of layers may be switched and displayed.

[Third Embodiment]
Next, an example of gesture operation of the user interface device 3 according to the third embodiment of the present invention will be described with reference to FIG. The gesture operation according to the third embodiment is performed in order to enlarge or reduce the map according to the number of fingers that perform the touch operation with the finger pressed.

<Problems of conventional enlargement or reduction operations>
In the conventional user interface device, the map has to be enlarged or reduced by a gesture operation generally called pinch-out or pinch-in that widens or narrows the interval between two fingers touching the screen. On the other hand, in the third embodiment, the map is enlarged or reduced without performing pinch-out and pinch-in operations with two fingers.

<Gesture operation of the third embodiment>
FIG. 8 is a flowchart illustrating an example of the enlargement or reduction operation according to the third embodiment. In the third embodiment shown in FIG. 8, the map can be enlarged or reduced by a simple operation using one or two fingers. That is, the control unit 10 according to the third embodiment outputs control information for enlarging or reducing the map to the display control unit 19 in accordance with the number of fingers that press the touch panel 20. In the third embodiment, the gesture operation is, for example, an operation in which the user pushes the touch panel 20 with one or two fingers.
Note that the processing in steps S31 to S34 in FIG. 8 is the same as the processing in steps S21 to S23 and S29 in FIG. 7 in the second embodiment described above, and detailed description thereof is omitted.

When it is determined in step S33 that the pressure-sensitive detection unit 18 has detected pressure based on the sensor value output from the pressure-sensitive sensor 30 (YES in S33), the control unit 10 detects the coordinates detected from the coordinate detection unit 17. Based on the information, the number of touches of the finger touching the touch panel 20 is detected (S35). When it is determined that the number of touches of the finger pushing the touch panel 20 is one (an example of the first number) (one of S35), the control unit 10 controls to enlarge the map displayed on the display panel 40. Information is output to the display control unit 19 (S36). The screen added in step S36 shows a state where the map is enlarged by the user pressing the touch panel 20 with one finger.

On the other hand, when it is determined in step S35 that the number of touches of the finger pressing the touch panel 20 is two (an example of the second number) (two of S35), the control unit 10 is displayed on the display panel 40. The control information for reducing the map is output to the display control unit 19 (S37). The screen added in step S37 shows a state where the map is enlarged by the user pressing the touch panel 20 with two fingers.

After any of Steps S34, S36, and S37, the display control unit 19 displays the screen requested by the user on the display panel 40 in accordance with the control information input from the control unit 10 (S38), and ends this process.

In the user interface device 3 in the third embodiment described above, the map can be enlarged or reduced according to the number of fingers that have pressed the touch panel 20, and a more intuitive and intuitive operation than before can be realized. can do. This eliminates the need for a gesture operation for expanding or narrowing two fingers using “touch panel touch detection” and “XY coordinate movement detection”, which has been conventionally performed.

It should be noted that the map may be reduced when the number of touches of the finger pressing the touch panel 20 is one, and the map may be enlarged when the number of finger touches is two. Further, even when the number of touched fingers is three or more, various operations may be selected according to the number of touched fingers. For this reason, for example, the first number may be the number of touches of two fingers, and the second number may be the number of touches of one or three fingers. Further, when the user moves the finger pressed into the touch panel 20 in the same direction, the map may be moved and displayed in accordance with the moving direction of the finger while enlarging or reducing the map.

Alternatively, the volume of the speaker may be increased when the number of finger touches that press the touch panel 20 is 1, and the volume of the speaker may be decreased when the number of finger touches is two. Conversely, the speaker volume may be decreased when the number of finger touches is one and the speaker volume may be increased when the number of finger touches is two. Further, the contrast of the screen may be increased or decreased by a gesture operation in the third embodiment. Further, the head-up (displaying the traveling direction upward) or the north-up (displaying north upward) of the own vehicle icon displayed during car navigation may be switched.

[Fourth Embodiment]
Next, an example of a gesture operation of the user interface device 3 according to the fourth embodiment of the present invention will be described with reference to FIG. The gesture operation according to the fourth embodiment is performed to switch the character type.

<Problems of conventional character type switching operation>
As will be described later with reference to FIG. 9, the user can input characters from the software keyboard displayed on the display panel using a conventional touch panel. Here, the conventional touch panel is a touch panel that can detect only the XY coordinates of the touch position. However, with the conventional touch panel, when the user enters characters by changing from lowercase letters to uppercase letters, it is necessary to input characters after switching the character type by pressing the shift key or character type switching key displayed on the software keyboard. It was. For this reason, it is sometimes necessary to frequently switch the character type, and the shift key and the character type switching key have to be pressed many times, resulting in poor operability.

<Conventional gesture operation>
Prior to describing the fourth embodiment of the present invention shown in FIG. 10, an example of a conventional character type switching operation will be described with reference to FIG.
FIG. 9 is a flowchart showing an example of a conventional character type switching operation. Here, an example will be described in which a user inputs a lowercase or uppercase alphabet using a software keyboard displayed on a conventional display panel.

First, the user selects the character type of the software keyboard displayed on the display panel of the conventional user interface device 100 (S41). Since the input mode of a character input key (hereinafter abbreviated as “key”) provided in the software keyboard is a lowercase input mode, lowercase characters are displayed on the key. Therefore, in this state, the user can input a lowercase letter by touching the displayed key. Next, the user selects either uppercase or lowercase character types (S42).

If the character type selected by the user is not an upper case character (lower case in S42), when the user touches the key of the character to be input without switching the character type (S43), the lower case character of the key is input. When the user lifts his / her finger from the touch panel, the lower case letter of the touch position is determined (S44). Then, the fixed lowercase letter is displayed on the display panel, and the present process ends.

On the other hand, if the character type selected by the user in step S42 is uppercase (uppercase in S42), the user touches the shift key on the software keyboard (S45). The screen added in step S45 shows a state in which the user touches the shift key (key represented by the upward arrow) at the lower left of the software keyboard.

Then, the user removes his / her finger from the shift key to determine the capital letter input mode (S46). The screen added in step S46 shows a state where the user lifts his / her finger from the shift key of the software keyboard. At this time, the key input mode is changed from the lowercase input mode to the uppercase input mode. Uppercase letters are displayed on the keys, and the user can input uppercase letters.

Then, when the user touches the key of the character to be input (S47), the capital letter of the key is input. The screen added to step S47 shows a state in which the user touches a key on the software keyboard.

When the user removes his / her finger from the key, the capital letter at the touch position is confirmed (S48). The screen added in step S48 shows a state where the user lifts his / her finger from the software keyboard. Then, this fixed uppercase letter is displayed on the display panel, and the present process ends.

In this way, in the conventional character input, unless the user presses the shift key or character type switching key displayed on the software keyboard, the character type does not change, and therefore the key input mode cannot be changed. For this reason, for example, when inputting an English sentence in which capital letters must be input at the beginning of the sentence, the shift key and the character type switching key must be frequently pressed, which is inconvenient.

<Gesture operation of the fourth embodiment>
FIG. 10 is a flowchart illustrating an example of a character type switching operation according to the fourth embodiment. In the fourth embodiment shown in FIG. 10, the character type can be switched by a simple operation using one finger.
That is, the control unit 10 according to the fourth embodiment is input from a key when the touch panel 20 is pressed at a position where a key (an example of an object) of the software keyboard displayed on the display panel 40 is displayed. Control information for changing the input mode that defines the character type of the character to be output is output to the display control unit 19. In the fourth embodiment, the gesture operation is an operation in which the user presses the finger on the touch panel 20 to switch the key input mode and releases the finger to confirm the character. Changing the object display form is, for example, The key to change the input mode is to display.

First, the user selects the character type of the software keyboard displayed on the display panel 40 provided in the user interface device 3 (S51). At this time, the key input mode is a lowercase input mode in which the key characters can be input in lowercase letters (an example of the first character type), and lowercase letters are displayed on the keys of the software keyboard. Then, the user touches the key (S52). The screen added to step S52 shows a state in which the user touches a key on the software keyboard.

Next, the pressure sensitive detector 18 detects pressure based on the sensor value input from the pressure sensor 30 (S53). When the pressure sensitive detection unit 18 does not detect the pressure sensitive (NO in S53), the pressure sensitive detection information is not output to the control unit 10. For this reason, when the user removes his / her finger from the key, the lowercase letter of the key touched by the user is determined and displayed on the display panel 40 (S54), and this process ends.

On the other hand, when the pressure-sensitive detector 18 detects pressure (YES in S53), pressure-sensitive detection information is output to the controller 10. At this time, when the touch panel 20 is pressed at the position where the key is displayed, the control unit 10 changes the key character from the input mode in which lowercase characters can be input to the input mode in which uppercase characters can be input (S55). As a result, the key input mode is changed to a capital letter input mode in which a key character can be input in capital letters (an example of the second character type), and capital letters are displayed on the keys of the software keyboard. The screen added to step S55 shows a state in which the uppercase key on the software keyboard displayed by switching the key to the uppercase input mode is touched.

Then, when the user lifts his / her finger from the key, the capital letter of the key touched by the user is fixed and displayed on the display panel 40 (S56), and this process is terminated. The screen added in step S56 shows how the capital letter is fixed and displayed when the user lifts his / her finger from the software keyboard. Thereafter, the control unit 10 returns the key input mode from the uppercase input mode to the lowercase input mode.

In the user interface device 3 according to the fourth embodiment described above, the character type of the character to be input can be easily switched by simply pressing the finger on the touch panel 20 when inputting the character with the software keyboard. For this reason, conventionally, it has been necessary to move the finger to the shift key and touch the shift key to switch the character type. However, in the gesture operation in the fourth embodiment, the user places the finger at the key position to be input by the user. You can change the character type from lower case to upper case while touching. For this reason, the user can easily switch the character type by an intuitive gesture operation.

First, the key input mode is set to the upper case input mode, and when the pressure sensitive detection unit 18 detects the pressure, the mode is temporarily switched to the lower case input mode, and after the lower case is fixed and inputted, You may return to uppercase input mode.

First, the key input mode is set to Hiragana input mode, and when the pressure-sensitive detector 18 detects pressure, the mode is temporarily switched to Katakana input mode, and the Katakana character is confirmed and input. After that, you may return to hiragana input mode. Alternatively, the first input mode may be the katakana input mode, and the input mode that is switched when pressure is detected may be the hiragana input mode. Alternatively, the key input mode may be switched from the full-width input mode to the half-width input mode, or from the half-width input mode to the full-width input mode. Further, the control unit 10 may maintain the switched input mode in the next character input, and may return to the original input mode when the user presses the finger on the touch panel 20 again.

When the key input mode is the hiragana input mode or the katakana input mode, if the pressure-sensitive detection unit 18 detects pressure, the muddy sound corresponding to the character at the position touched by the user's finger ( Gi, Gu, etc.), semi-turbid sound (Pa, Pi, Pu, etc.), sound (tsu), small letters (nya, yu, yo, ai, ぅ, etc.), symbols (+,-, x, ÷, etc.) ), Umlauts or the like may be input.

[Fifth Embodiment]
Next, an example of gesture operation of the user interface device 3 according to the fifth embodiment of the present invention will be described with reference to FIG. The gesture operation according to the fifth embodiment is performed in order to select an edit item (an example of a menu item) at a position where a certain operation is performed.

<Problems of conventional menu selection operations>
Conventionally, when a user creates and edits a document using document editing software, a mouse and a keyboard are mainly used. Using a mouse, right-clicking a selected area (for example, a character string) displays a list of edit items such as copy, paste, and cut, and allows you to select any edit item. Met. However, a function for displaying a list of edit items by right-clicking using only a conventional touch panel cannot be realized.

<Conventional gesture operation>
Before explaining the fifth embodiment of the present invention shown in FIG. 12, an example of a conventional menu selection operation will be described with reference to FIG.
FIG. 11 is a flowchart showing an example of a conventional menu selection operation.
First, the control unit included in the conventional user interface apparatus 100 detects the position indicated by the black arrow instruction icon by operating the mouse or the like (S61). The screen added to step S61 shows a state in which the instruction icon indicates the character string in the screen. When the user operates the instruction icon and selects an arbitrary character string from the character strings on the screen, the selected character string is highlighted in bold.

Next, the user selects a menu by moving the instruction icon (S62). When the user does not select the menu (NO in S62), the instruction icon moves according to the locus of the mouse moved by the user (S63), and this process ends.

In step S62, when the user selects a menu (YES in S62), for example, edit items in the edit menu are displayed (S64). Thereafter, when the user selects an edit menu from the menu bar at the top of the screen, edit items (copy, paste, cut, etc.) included in the edit menu are displayed in a list. In the screen added to step 64, the character string selected by the user is indicated by a dashed ellipse, and a list of edit menus and edit items is indicated in the menu bar on the upper side of the screen.

Next, the user selects an edit item (S65) and ends this process. As a result, the selected character string can be edited. FIG. 11 shows an example in which the user clicks the edit menu on the menu bar. However, for example, when the user selects an arbitrary character string, for example, when the user right-clicks the mouse as an external input device. Edit items similar to the edit menu are displayed in a list, and the edit items can be selected.

As described above, conventionally, in order to perform an editing operation on a character string selected by the user, the instruction icon must be moved to the menu bar, or a list of editing items can be displayed by right-clicking the mouse, and the editing item must be selected. I must. However, if a mouse is not connected to the conventional user interface device 100, it is difficult to perform these operations. On the other hand, in the fifth embodiment, it is possible to display an edit menu and select an edit item by performing a push operation.

<Gesture operation of the fifth embodiment>
FIG. 12 is a flowchart illustrating an example of a menu selection operation according to the fifth embodiment.
In the fifth embodiment shown in FIG. 12, it is possible to edit a character string by a simple operation using one finger. That is, when the touch panel 20 is pressed while an object in a predetermined area is selected, the control unit 10 according to the fifth embodiment displays a menu item related to the object at the position where the touch panel 20 is pressed. Control information for output to the display control unit 19. In the fifth embodiment, the gesture operation is an operation in which the user presses a finger on the touch panel 20 to select an edit item from an edit menu. Changing the object display form is, for example, an edit menu. Displaying the edited character string through the edit item.

First, when the user's finger touches the touch panel 20 included in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S71), and detects the coordinates of the touch position.

Next, the user selects a character string (an example of an object) in a predetermined area by a touch operation, and selects an operation of pushing a finger into the touch panel 20 (S72). Next, the pressure-sensitive detection unit 18 determines whether or not the pressure-sensitive sensor 30 has detected pressure based on the sensor value output from the pressure-sensitive sensor 30 (S73). When the pressure-sensitive detection unit 18 determines that pressure is not detected based on the sensor value (NO in S73), the control unit 10 moves the instruction icon in accordance with the direction in which the finger touching the touch panel 20 moves. Are displayed (S74), and this process is terminated.

On the other hand, if it is determined in step S73 that the pressure-sensitive detection unit 18 has detected pressure sensitivity based on the sensor value (YES in S73), the touch panel 20 is pressed in a state where an object in a predetermined area is selected. At this time, the control unit 10 outputs control information for displaying the edit item of the edit menu at the position where the touch panel 20 is pressed to the display control unit 19. The edit item of the edit menu is an example of a menu item related to the character string when the object is a character string.

Then, the display control unit 19 displays the edit items of the edit menu on the display panel 40 (S75). On the screen added in step S75, a region (for example, a character string) selected by the user is indicated by a dashed ellipse and a list of edit items is indicated. Then, the user selects an arbitrary edit item from the displayed edit items (S76), and ends this process.

In the user interface device 3 according to the fifth embodiment described above, when the touch panel 20 is pressed, the edit items of the edit menu for the area selected through the touch panel 20 are displayed. In this way, the user can select an edit item without moving his / her finger largely, since the edit item is displayed in the same manner as a right-click operation with a conventional mouse while a predetermined area is selected.

In addition to the edit menu, the menu bar includes a file menu, a display menu, a help menu, and the like. For this reason, the menu displayed when the touch panel 20 is pressed may be a menu other than the edit menu. Further, the menu may be switched and displayed according to the pressing amount of the touch panel 20. For example, if the pressing amount is small (the pressing force is greater than or equal to the threshold th1 and less than the threshold th2), the editing menu edit item is displayed. If the pressing amount is large (the pressing force is the threshold th2 or more), the display menu item is displayed. May be.

Further, the menu may be switched and displayed every 2 seconds, for example, according to the time during which the pressure-sensitive detector 18 is detecting pressure. Thereby, the user can select an item from a menu other than the edit menu.

[Sixth Embodiment]
Next, with reference to FIG. 14, an example of gesture operation of the user interface device 3 according to the sixth embodiment of the present invention will be described. The gesture operation according to the sixth embodiment is performed for a cancel operation for canceling the operation performed immediately before.

<Problems of conventional cancellation operations>
In order to cancel the operation performed immediately before using a user interface device having a conventional touch panel that can detect only the XY coordinates of the touch position, it is necessary to click a cancel icon displayed on the display panel. If the cancel icon is not displayed, the cancel operation must be performed using an external input device such as a keyboard connected to the user interface device. However, the installation space of the vehicle is limited, and it is difficult to enlarge the touch panel and the display panel, and there is no space for installing the external input device. In addition, since the area that can be displayed on the display panel included in the navigation device is small, there is no space for displaying the cancel icon. For this reason, it has not been possible to intuitively and simply perform an operation of returning to the previous operation or an operation of canceling an input using a conventional user interface device.

<Conventional gesture operation>
Before explaining the sixth embodiment of the present invention shown in FIG. 14, an example of a conventional cancel operation will be described with reference to FIG.
FIG. 13 is a flowchart showing an example of a conventional cancel operation.
The control unit included in the conventional user interface device 100 detects that a finger has touched the touch panel included in the user interface device 100 (S81). The screen added in step S81 shows a state in which the user touches the lower left of the screen with one finger.

And the user inputs a character string using a software keyboard (not shown). Next, the user determines whether or not the input character string is accurate (S82). The screen added in step S82 shows a state in which a character string input by the user is displayed.

If the user determines in step S82 that the character input is correct (YES in S82), the process is terminated. On the other hand, when it is determined that the character input is inaccurate (NO in S82), the user performs a character input cancel operation. This canceling operation is performed by either an input operation (S83) performed through an external input device or a touch operation (S84) for a cancel icon displayed at the lower right of the screen. Here, the operations in steps S83 and S84 are both called cancel operations. Then, after performing the canceling operation, the user returns to step S82 and performs character input again to determine whether or not the character input is accurate.

Thus, conventionally, since the cancel operation was realized by using an external input device or touching a cancel icon, it was difficult to perform the cancel operation in an application where installation space is limited. On the other hand, in the sixth embodiment, the previous operation can be canceled by the pushing operation.

<Gesture operation of the sixth embodiment>
FIG. 14 is a flowchart illustrating an example of a cancel operation according to the sixth embodiment. In the sixth embodiment shown in FIG. 14, the canceling operation can be performed by a simple operation using one finger. That is, the control unit 10 according to the sixth embodiment provides control information for performing an editing operation on the operation performed immediately before, according to the direction in which the finger moves in a state where the touch panel 20 is pressed by the finger. The data is output to the display control unit 19. In the sixth embodiment, the gesture operation is an operation of moving the finger in a direction opposite to the direction in which the character string is input in a state where the user presses the finger on the touch panel 20, and the object display form is changed. To change is to display the edited character string, for example.

First, when the user's finger touches the touch panel 20 provided in the user interface device 3, the coordinate detection unit 17 detects that the touch has been made (S91), and detects the coordinates of the touch position. The screen added in step S91 shows a state where the user touches the lower left of the screen with one finger.

And the user inputs a character string using a software keyboard (not shown). Next, the user determines whether or not the input character string is accurate (S92). The screen added in step S92 shows a state in which a character string input by the user is displayed.

If the user determines in step S92 that the character input is correct (YES in S92), the process is terminated. On the other hand, if it is determined that the character input is inaccurate (NO in S92), the user performs a character input cancel operation. In this canceling operation, first, the user performs an operation of pushing a finger into the touch panel 20 (S93). The screen added in step S93 shows a state where the user presses the touch panel 20.

Next, the user performs an operation of moving the finger in the left direction while pushing the finger into the touch panel 20 (S94). At this time, the control unit 10 performs an editing operation for canceling or redoing the operation performed immediately before depending on the direction in which the finger moves (for example, the left direction) while the touch panel 20 is pressed by the finger. The control information is output to the display control unit 19. As a result, the previous operation is canceled by the amount of movement of the finger, and the input character string is deleted. The screen added in step S94 shows how all the input operations for the character string input immediately before are canceled. Here, a series of operations performed in the order of steps S93 and S94 is referred to as a cancel operation. Then, after performing the cancel operation, the user returns to step S92 to input the character again, determines whether or not the character input is correct, and ends the process when determining that it is correct.

In the user interface device 3 according to the sixth embodiment described above, since the last operation can be canceled by combining the pressing operation and the touch operation that moves the finger in one direction, the user can cancel the cancel operation. Intuitive and simple implementation. For this reason, conventionally, an icon is displayed on the display panel or an external input device is provided to perform the cancel operation. In the present embodiment, there are no restrictions on the installation space and the corresponding application. . As described above, the user can easily perform the cancel operation by using the user interface device 3, and thus can be applied not only to the navigation device 1 but also to devices for various purposes.

In the case of character input, a plurality of operations may be canceled together according to the amount of pressing when the finger pressed into the touch panel 20 moves in the pressing direction. In addition, when the user performs a canceling operation by moving the finger pressed into the touch panel 20, the moving direction of the finger is not limited to the left direction but may be another direction.

In addition, when the finger is moved to the right after moving the finger pushed into the touch panel 20 by the user and moving the finger to the right, the character string may be redisplayed as the re-operation. Alternatively, the operation may be repeated when the moving direction of the finger is upward. Also, other operations may be assigned to gesture operations performed using the user interface device 3.

In the navigation device 1, when a user specifies a place and inputs a destination, and then specifies another place and inputs a destination, the user presses the finger into the touch panel 20 and moves it to the left. May display the location where the destination input was previously performed.

Further, in the image editing software, the user interface device 3 according to the sixth embodiment may be used in order to cancel or redo an operation on an image. Further, the user may perform a plurality of cancel operations by changing the moving direction of the pressed finger halfway. For example, when the finger moving direction is changed from left to top, the operation may be an operation for canceling two consecutive input operations performed immediately before.

[Seventh Embodiment]
Next, an example of a gesture operation of the user interface device 3 according to the seventh embodiment of the present invention will be described with reference to FIGS. 17 and 18. The gesture operation according to the present embodiment is performed using the user interface device 3 arranged at a location away from the navigation device.

<Problems of conventional navigation devices>
First, before explaining an example of the gesture operation of the user interface device 3 according to the seventh embodiment of the present invention with reference to FIGS. 17 and 18, the conventional gesture operation will be described with reference to FIGS. 15 and 16. FIG. 15 is an explanatory diagram showing an installation example of the conventional user interface device 110.
In recent years, a user interface device 110 that does not have a touch panel has been used in a navigation device mounted on a vehicle in order to allow a user to operate the navigation device at hand. This navigation device includes a navigation device body and a user interface device 110 that can display only a navigation screen. The display panel 111 (an example of the second display panel) provided in the user interface device 110 is not provided with a touch panel. For this reason, the user cannot perform a touch operation through the user interface device 110.

An external input device is installed in the vehicle so that the user can operate the navigation device. Examples of the external input device include a button 101 and a joystick 102 that are installed on a center console in a vehicle and connected to a navigation device. Also, a knob type controller may be installed instead of the joystick 102.

However, when the navigation device is operated using an external input device, the selection operation needs to be performed using the joystick 102, and the determination operation needs to be performed using the button 101. For this reason, the operation of the navigation device itself becomes very complicated, and a long-term skill is required to get used to the operation. In addition, the center console has a limited space where an external input device can be installed, and the use of the external input device is limited to a selection operation and a determination operation. For this reason, in order to open a function that the user wants to use, selection and determination must be repeated using an external input device, which takes time and effort.

<Conventional gesture operation>
FIG. 16 is a flowchart showing an operation example of a conventional navigation device. Here, an example in which a navigation operation is performed using a joystick 102 and a button 101 as an external input device will be described.

First, the control unit (not shown) of the navigation device detects the operation of the joystick 102 (S101). The screen added in step S101 shows a state in which the instruction icon is displayed on the display panel 111 of the user interface device 110.

Next, the user operates the joystick 102 to input predetermined information (S102). The screen added in step S <b> 102 shows how the instruction icon moves as the user moves the joystick 102. The destination instruction icon is represented by a white arrow in the screen.

Next, the user moves the instruction icon onto the button icon, and determines the input information by pressing the button icon (S103). The screen added to step S103 shows how the information input by the user is determined when the user presses the button 101.

Thus, conventionally, the selection operation must be performed by the joystick 102 and the determination operation must be performed by the button 101. However, since the joystick 102 and the button 101 are arranged at different positions, an erroneous operation may occur. Further, it is impossible to assign operation functions other than the selection operation and the determination operation to the joystick 102 and the button 101.

<Configuration and Operation of Navigation Device of Seventh Embodiment>
FIG. 17 is an explanatory diagram showing a configuration example of a navigation device 1A according to the seventh embodiment. In the seventh embodiment shown in FIG. 17, it is possible to determine information that is input by using a pressing operation together.
That is, the navigation device 1A includes another user interface device 110 in addition to the navigation device body 2 and the user interface device 3 as shown in FIG.

The user interface device 110 is a conventional user interface device and does not include the touch panel 20. Only objects used for navigation can be displayed on the display panel 111. On the display panel 111, the navigation apparatus body 2 performs a predetermined process based on the content instructed by the gesture operation input from the control unit 10, and an object whose display form has been changed by performing the predetermined process is displayed. .

The navigation device body 2 and the user interface device 3 can communicate with each other wirelessly or by wire. Further, an object output from the navigation device body 2 is displayed on the display panel 111 of the user interface device 110. In the following description, the user interface device 3 is called a “pressure-sensitive controller” and is distinguished from the conventional user interface device 110.

For example, FIG. 17 (1) shows a state in which the navigation device body 2 including the user interface device 110 is installed on the instrument panel of the vehicle and the pressure-sensitive controller is installed on the center console of the vehicle. . A map is displayed on the user interface device 110, and objects of three types of command icons (for example, current location, AV (Audio Visual), menu) are displayed on the display panel 40 (an example of the first display panel) of the pressure-sensitive controller. Is done. For this reason, the user can intuitively select a required command by pressing a command icon through the pressure-sensitive controller. Note that by pressing a switch button (not shown) displayed in a predetermined area of the display panel 40, command icons (for example, setting and adjustment) can be switched and displayed. For this reason, the user can intuitively and easily select a command icon to be switched from a large number of command icons.

As shown in (2) of FIG. 17, when the user presses the touch panel 20 of the pressure-sensitive controller with a finger, an instruction icon is displayed on the user interface device 110. Then, as shown in FIG. 17 (3), when the user moves the finger, the instruction icon is moved and displayed in accordance with the moving direction of the finger. While the user moves the finger, it is not necessary to push the finger into the touch panel 20.

Then, as shown in (4) of FIG. 17, the user operates the touch panel 20 of the pressure-sensitive controller to select an enlarged icon displayed on the user interface device 110 with an instruction icon. Thereafter, when the user presses the touch panel 20 of the pressure-sensitive controller with a finger, selection of the enlarged icon is determined. For this reason, the map is enlarged and displayed on the user interface device 110.

<Gesture operation of the seventh embodiment>
FIG. 18 is a flowchart illustrating an operation example of the navigation device 1 according to the seventh embodiment. In the seventh embodiment shown in FIG. 18, a desired object can be displayed on the user interface device 110 by a simple operation using one finger. That is, the control unit 10 according to the seventh embodiment displays an instruction icon for instructing selection of a menu icon displayed on the display panel 111 of the user interface device 110 when the touch panel 20 is pushed by a finger. Control information to be displayed on the user interface device 110 is output to the navigation device body 2. Then, the control unit 10 displays control information for determining selection of the instruction icon when the touch panel 20 is pressed again with a finger in a state where the instruction icon is displayed superimposed on the menu icon. Output to the main body 2. The navigation device body 2 performs a predetermined process based on the content instructed by the touch operation or the gesture operation input from the control unit 10, changes the display form of the object that has performed the predetermined process, and displays the display panel 111. Display the object.

In the seventh embodiment, the gesture operation means, for example, that a user pushes a finger into the touch panel 20 to display an instruction icon on the user interface device 110, move the instruction icon in accordance with the direction in which the finger is moved, and then the user again Is an operation of determining a selection icon displayed on the user interface device 110 by pushing a finger into the touch panel 20. Moreover, changing the display form of the object in the seventh embodiment means, for example, displaying the map in an enlarged or reduced manner.

First, the control unit 10 detects that a user's finger has touched the touch panel 20 of the pressure-sensitive controller (S111). The screen added in step S111 shows a state in which a user's finger touches the touch panel 20 of the pressure-sensitive controller and a state in which a map is displayed on the display panel 111 of the user interface device 110.

Next, the user presses the touch panel 20 with a finger (S112). At this time, the control unit 10 determines that the touch panel 20 has been pressed with a finger based on the pressure-sensitive detection information that the pressure-sensitive detection unit 18 detects and outputs a pressure-sensitive value based on the sensor value. The control unit 10 transmits control information for displaying an instruction icon for selecting a menu icon displayed on the display panel 111 of the user interface device 110 when the touch panel 20 is pushed by a finger through the navigation device body 2. The data is output to the display control unit of the user interface device 110. As a result, an instruction icon is displayed on the display panel 111 of the user interface device 110. The screen added in step S112 shows that the selection icon is displayed on the display panel 40 and the instruction icon is displayed on the user interface device 110 when the user presses the touch panel 20 with a finger. ing.

Next, the user moves the finger touching the touch panel 20 and inputs information (S113). At this time, the control unit 10 moves the instruction information displayed on the display panel 111 of the user interface device 110 in accordance with the direction in which the finger touching the touch panel 20 moves, and displays control information through the navigation device body 2. Output to the interface device 110. Then, the display control unit of the user interface device 110 moves and displays the instruction icon displayed on the display panel 111 according to the operation of the pressure-sensitive controller. On the screen added in step S113, the user moves his / her finger on the touch panel 20 and inputs information, and the instruction icon displayed on the user interface device 110 moves according to the movement of the user's finger. It is shown. A moving instruction icon is represented by a white arrow in the screen.

Next, the user selects a selection icon displayed on the display panel 40 of the pressure-sensitive controller, and presses this selection icon to determine the selection icon (S114). At this time, the instruction icon displayed on the display panel 111 of the user interface device 110 is displayed superimposed on the menu icon. In this state, when the touch panel 20 of the pressure-sensitive controller is pushed again with a finger, the pressure-sensitive detection unit 18 outputs pressure-sensitive detection information when pressure is detected based on the sensor value. Then, the control unit 10 can determine that the touch panel 20 has been pressed with a finger based on the pressure-sensitive detection information input from the pressure-sensitive detection unit 18, and can determine the menu icon selected by the instruction icon. The screen added in step S114 shows a state in which the user presses the touch panel 20 with a finger.

And the control part 10 changes the control information for changing and displaying the map displayed on the display panel 111 of the user interface apparatus 110 based on the information determined with the instruction | indication icon through the navigation apparatus main body 2, and a user. The data is output to the display control unit of the interface device 110. As a result, a map that is an operation result of the operation performed by the user through the pressure-sensitive controller is displayed on the display panel 111 of the user interface device 110.

The user interface device 3 according to the seventh embodiment described above is used as a pressure-sensitive controller that allows the user to perform navigation operations at hand. The user can perform the selection operation and the determination operation with one finger, and can perform the determination operation for the instruction icon at the position where the instruction icon is selected. For this reason, the movement of the finger can be minimized, and the operation can be performed simply and intuitively. Moreover, since the pressure-sensitive controller is disposed at a position away from the navigation apparatus body 2, the user can easily operate it at hand.

Further, various command icons (for example, volume buttons) can be displayed on the display panel 40 of the pressure-sensitive controller, and the display magnification can be arbitrarily changed. For this reason, conventionally, a joystick 102 or the like is used to perform a complicated and time-consuming selection operation or determination operation, but in the pressure-sensitive controller according to the seventh embodiment, the user operates the pressure-sensitive controller. Quickly select menus and make decisions. Even if the number of command icons that can be displayed on one screen is limited, it is possible to display and select many command icons by switching the screens. The command icon may be displayed by dividing the display panel 40 of the user interface device 3 into cells divided into four columns in two vertical columns and two horizontal columns, for example. This can prevent a user from making a mistake in pressing.

In addition, you may use the portable terminal etc. which the user possesses as a pressure sensitive controller. Even if the conventional user interface device 110 does not have a function of detecting the coordinates of the touch position, the user interface device 110 performs ad hoc communication with the pressure-sensitive controller, so that the user can use the mobile terminal as a pressure-sensitive controller. The interface device 110 can be operated.
Further, the pressure-sensitive controller and the personal computer device may be connected wirelessly or by wire. It is also possible to cause the personal computer device to execute a predetermined function by operating the pressure sensitive controller at a location away from the personal computer device.

[Modification]
The user interface device 3 according to each embodiment described above may be applied to devices other than the navigation device. For example, operability can be improved by applying the user interface device 3 to a touch panel portion of a mobile terminal, a tablet terminal, or the like. In this way, the user interface device 3 according to the present embodiment can be combined with various electronic devices that require a touch panel.

In the block diagram shown in FIG. 2, the user interface device 3 includes the control unit 10, but the navigation device body 2 may include the control unit 10.
The touch panel 20 may be configured to detect a touch operation by a method other than the electrostatic capacitance method. Further, the pressure sensor 30 may detect that the touch panel 20 is pushed in by a press switch or the like provided below the touch panel 20.

In addition to the car navigation, the operation combined with the pressure sensitive function in the user interface device 3 may be used for, for example, navigation of a person or a bicycle. Further, the user interface device 3 may be used for the operation of the image editing software as described above, or may be used for the operation of other application software.

In each embodiment described above, the navigation device body 2 and the user interface device 3 are combined. However, since the user interface device 3 itself has a navigation function, only the user interface device 3 may be used as the navigation device.

Further, the pressure-sensitive sensor 30 may be configured not to include the elastic body 33. For example, even if the elastic body 33 is removed from the pressure sensor 30, if a pressing force is applied to the pressure sensor 30 in a state where the upper electrode 31 and the lower electrode 35 are separated from each other with a constant distance, the upper electrode 31 is applied. The lower electrode 35 approaches and the electrostatic capacity between the upper electrode 31 and the lower electrode 35 decreases. For this reason, the pressure sensitive detection unit 18 can obtain the capacitance change rate based on the sensor values output from the upper electrode 31 and the lower electrode 35.

The present invention is not limited to the embodiment described above, and various other application examples and modifications can of course be taken without departing from the gist of the present invention described in the claims.
For example, in the above-described embodiment, the configuration of the apparatus is described in detail and specifically in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the configuration including all the configurations described. In addition, a part of the configuration of the embodiment described here can be replaced with the configuration of the other embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Is possible. Moreover, it is also possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.
Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 1 ... Navigation apparatus, 2 ... Navigation apparatus main body, 3 ... User interface apparatus, 10 ... Control part, 17 ... Coordinate detection part, 18 ... Pressure detection part, 19 ... Display control part, 20 ... Touch panel, 30 ... Pressure sensor 40 ... Display panel

Claims

A display panel that displays objects,
A display control unit that performs control to display the object on the display panel according to control information;
A touch panel on which a touch operation is performed by an instruction medium;
A coordinate detection unit that detects the coordinates of the touch position of the touch panel on which the touch operation has been performed and outputs coordinate detection information;
A pressure-sensitive sensor that outputs a sensor value that changes according to a pressing force applied to the touch panel by the indicating medium;
Based on the sensor value, a pressure-sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure-sensitive detection information;
The control information for changing the display form of the object based on a gesture operation that combines the touch operation determined based on the coordinate detection information and the push operation determined based on the pressure-sensitive detection information. And a control unit that outputs to the display control unit.
The control unit outputs the control information for enlarging or reducing the object to the display control unit according to a direction in which the instruction medium moves in a state where the touch panel is pushed by the instruction medium. The user interface device according to 1.
The control unit enlarges the object when the direction in which the touch panel is pushed by the pointing medium is the first direction, and the direction in which the touch panel moves in the state pushed by the pointing medium is The user interface device according to claim 2, wherein the control information for reducing the object in the second direction is output to the display control unit.
The control unit outputs the control information for enlarging or reducing the object to the display control unit according to a time during which the state where the touch panel is pushed by the instruction medium continues. The user interface device according to any one of the above.
The control unit enlarges the object when the time for which the touch panel is pressed by the pointing medium continues for a predetermined time or longer, and the time for which the touch panel is pressed by the pointing medium continues 5. The user interface device according to claim 4, wherein when the time is less than the predetermined time, the control information for reducing the object is output to the display control unit.
The control unit outputs the control information for enlarging or reducing the object to the display control unit according to the number of touches of the instruction medium that pushes the touch panel. The user interface device according to.
The control unit enlarges the object when the number of touches of the pointing medium that presses the touch panel is the first number, and when the number of touches of the pointing medium that presses the touch panel is the second number, The user interface device according to claim 6, wherein the control information for reducing an object is output to the display control unit.
The control unit is configured to change an input mode that defines a character type of a character input from the key when the touch panel is pressed at a position where the key of the software keyboard displayed on the display panel is displayed. The user interface device according to claim 1, wherein information is output to the display control unit.
In the input mode in which the character of the key can be input in the first character type, and the touch panel is pressed at the position where the key is displayed, the control unit sets the character of the key in the second character type. The user interface device according to claim 8, wherein the input mode is changed to the input mode in which input is possible.
The control unit displays the control information for displaying a menu item related to the object at a position where the touch panel is pressed when the touch panel is pressed in a state where the object in a predetermined area is selected. The user interface device according to claim 1, wherein the user interface device is output to a display control unit.
The user according to claim 10, wherein when the object is a character string, the control unit outputs the control information for displaying an edit item for editing the character string as the menu item to the display control unit. Interface device.
The control unit provides the display control unit with the control information for performing an editing operation on the operation performed immediately before according to a direction in which the instruction medium moves in a state where the touch panel is pushed by the instruction medium. The user interface device according to any one of claims 1, 8 to 10.
The control unit is configured to perform the editing operation to cancel or redo the operation performed immediately before depending on a direction in which the pointing medium moves in a state where the touch panel is pushed by the pointing medium. The user interface device according to claim 12, wherein: is output to the display control unit.
A user interface device and an electronic device body,
The user interface device includes:
A display panel that displays objects,
A display control unit that performs control to display the object on the display panel according to control information;
A touch panel on which a touch operation is performed by an instruction medium;
A coordinate detection unit that detects the coordinates of the touch position of the touch panel on which the touch operation has been performed and outputs coordinate detection information;
A pressure-sensitive sensor that outputs a sensor value that changes according to a pressing force applied to the touch panel by the indicating medium;
Based on the sensor value, a pressure-sensitive detection unit that detects that a push-in operation in which the touch panel is pushed by the instruction medium is performed and outputs pressure-sensitive detection information;
The control information for changing the display form of the object based on a gesture operation that combines the touch operation determined based on the coordinate detection information and the push operation determined based on the pressure-sensitive detection information. A control unit that outputs to the display control unit,
The electronic device body is
An electronic device that performs a predetermined process based on content instructed by the touch operation or the gesture operation input from the control unit, and outputs the object subjected to the predetermined process to the control unit.
A user interface device and an electronic device body,
The user interface device includes:
A first display panel for displaying objects;
A display control unit that performs control to display the object on the first display panel according to control information;
A touch panel on which a touch operation is performed by an instruction medium;
A coordinate detection unit that detects coordinates of a touch position of the touch panel on which the touch operation is performed;
A pressure-sensitive sensor that outputs a sensor value that changes according to a pressing force applied to the touch panel by the indicating medium;
Based on the sensor value, a pressure-sensitive detection unit that detects that a pressing operation in which the touch panel is pressed by the pointing medium is performed;
A control unit that outputs the control information for changing the display form of the object to the display control unit and the electronic device main body based on a gesture operation that combines the touch operation and the push-in operation,
The electronic device body is
A second display panel that displays the object whose display form has been changed based on the control information input from the control unit of the user interface device;
A predetermined process is performed based on contents instructed by the touch operation or the gesture operation input from the control unit, and the display form of the object subjected to the predetermined process is changed to the second display panel. Electronic equipment to display.
The control unit outputs the control information for displaying an instruction icon for instructing selection of a menu icon displayed on the display panel to the electronic device body when the touch panel is pushed by the instruction medium. When the touch panel is pushed again by the instruction medium in a state where the instruction icon is displayed superimposed on the menu icon, the control information for determining selection of the instruction icon is output to the electronic device main body. The electronic device according to claim 15.