JP2005092472A - Display device equipped with touch panel - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To simplify the visual and tactile recognition of the touch or operation of a desired touch operation area on a display picture equipped with a touch panel. <P>SOLUTION: In the transition of a state that a region where any touch operation member is not displayed is touched by an instructing means to a state that a region where a touch operation member is displayed is touched by the instructing means, a display picture is moved to a predetermined first height, and when pressurizing power P is not less than a predetermined value in a state that the region where the touch operation member is displayed is touched by the instructing means, the display picture is moved to a predetermined second height, and the function of the touch operation member is executed. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display device provided with a touch panel used in a stationary or portable terminal device.

  In recent years, terminal devices have been widely used in various industries. For example, ATMs (Automatic Tellers Machines) are installed at banks, and ticket machines and map guides are installed at stations, etc., so that a part of business such as banks and stations can be covered by terminal devices. I have to. Also, in stores such as fast food restaurants, terminal devices may be used for merchandise order processing, and terminal devices that receive content distribution using a communication network such as the Internet or web browsing (browsing). ) Terminal devices and the like have also been realized or proposed.

  By the way, in such a terminal device, a display device is provided, and various operations as described above can be performed by operating input means such as a keyboard while viewing information such as messages displayed on the display screen. The display screen has a function as an input means, and various operations can be performed by operating the screen according to messages and menus displayed on the display screen. Display devices having a touch panel have been used.

  According to such a display device equipped with a touch panel, since the operation is performed by directly touching the display screen with a fingertip, it is easy to operate and there are few operational errors. In addition, the operation unit such as the keyboard can reduce the number of operation buttons, so the terminal device itself can be downsized, the installation area can be reduced, and the degree of freedom of installation location in the store or on the premises Benefits such as increased will also be obtained.

Japanese Patent Laid-Open No. 5-216587

  However, in a display device equipped with a conventional touch panel, an image of an input unit made of a touch operation member such as an operation button (touch button) is displayed on the display screen, so that the input unit is recognized visually by a customer or a user. Then, based on this recognition, the operation is performed by touching the place where the image of the input means is desired to be operated, and the following problems arise.

First, since the touch operation area of the touch operation member for the user to perform a touch operation is displayed on the display screen, the touch operation area is on the same plane as the part other than the touch operation area. Differently, the feeling of touching the touch operation area is the same as the feeling of touching the other parts. For this reason, even if the position touched with the fingertip deviates from a desired touch operation area, it may not be noticed.

  In particular, when several operation buttons are displayed as a touch operation member with a guidance message, etc., these operation buttons may be displayed around the display screen, and the operation buttons displayed in this way are operated. In this case, the touch position of the fingertip may deviate from the desired display position of the operation button. Even if such a deviation is slight, this operation button is not touched and does not function. However, the user intends to touch the operation button, and may not notice that the operation button is not touched. For this reason, the same operation switch will be touched again. For this purpose, it is necessary to recognize that the touch switch has not been touched, but this recognition will require a certain amount of time. There was a problem.

  In addition, many operation buttons may be displayed close to each other on the display screen at the same time. In such a case, each operation button is displayed in a relatively small size, so that the touch position of the fingertip is desired. If the display position of the operation button slightly deviates, the adjacent operation button may be touched. A display device having a conventional touch panel is configured to function immediately when a displayed operation button is touched, so that when the touch position is shifted and the adjacent operation button is touched, this adjacent operation button is displayed. Functioned, and there was a problem that this function had to be stopped and then operated again.

  An object of the present invention is to solve such a problem and easily recognize that a touch operation member such as an operation button displayed on a display screen is touched with a fingertip or the like, and further, easily operate the touch operation member. It is another object of the present invention to provide a display device including a touch panel that can be reliably recognized.

  In order to achieve the above object, according to the present invention, a touch panel for detecting the touch position of the instruction means is provided on the display screen of the display panel, and the touch operation member displayed on the display screen can be touched and operated. A display device including a touch panel, wherein a detection unit that detects a pressing force P by the instruction unit when the touch operation member is touch-operated, and the instruction unit touches an area where the touch operation member is not displayed. When the area where the touch operation member is displayed is touched, the display screen is moved to a predetermined first height, and the instruction means displays the touch operation member. When the pressing force P is equal to or greater than a predetermined value while the touched area is touched, the touch operation is performed while the display screen is moved to a predetermined second height. In which a control unit for executing the function of the wood.

  The first height is a height that is relatively higher than the height immediately before the display screen, and the second height is a height that is relatively lower than the height immediately before the display screen. That's what it is.

  As described above, according to the present invention, it is possible to easily and surely confirm that the desired touch operation member has been pushed in.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a first embodiment of a display device having a touch panel according to the present invention. FIG. 1 (a) is an external perspective view, FIG. 1 (b) is a side view, and FIG. Is a housing, 1a is an opening, 2 is a display screen, 3 is a mounting portion, 4 is a stand, 5 is a rotating shaft, 6 is a pin hole, 7 is a pin, 8 is a display panel, and 8a is a display panel. Display surface, 9 is a touch panel, 10, 10a and 10b are support members, 11 is a drive motor, 12 is a rotating gear, 13 is a spur gear, 14 is a link mechanism, 14a and 14b are links, 14c and 14d are support members, 15 , 16 are tension springs.

  In the figure, a rectangular opening 1a is formed on the front surface of a box-shaped housing 1, and a display screen 2 is provided in the opening 1a. Although not shown in the figure, a member (hereinafter referred to as a touch operation member) such as an operation button or a message is displayed on the display screen 2, and the display device according to this embodiment is operated by touching the touch operation member. Can be operated (for example, an ATM or a ticket vending machine described later).

  An attachment portion 3 is integrally provided on the back side opposite to the opening 1 a of the housing 1, and the attachment portion 3 is attached to the stand 4 via the rotation shaft 5. Accordingly, the mounting portion 3 can rotate the housing 1 around the rotation shaft 5 with respect to the stand 4, and by rotating the housing 1 in this manner, You can change the direction of the direction.

  Although the orientation of the display screen 2 may be changed continuously, it can be changed stepwise here. For this purpose, as shown in FIG. 1 (b), a plurality of pin holes 6 are provided on the side surface of the mounting portion 3 around the rotating shaft 5, and one point on the array line of these pin holes 6 is opposed. A pin 7 fitted into the pin hole 6 is provided so as to be pushed into the stand 4. When the housing 1 is rotated about the rotation shaft 5 and the display screen 2 is set in a predetermined direction, the pin 7 can be fitted into the pin hole 6 close thereto, and the display screen 2 is almost in this predetermined direction. Stabilize.

  Thus, the pin hole 6 and the pin 7 constitute a means for adjusting the orientation (angle) of the display screen, and the orientation of the display screen 2 can be changed by the number of the pin holes 6.

  As shown in FIG. 1 (c), the housing 1 incorporates display means including a display panel 8 that forms display means and a touch panel 9, and the display surface 8 a of the display panel 8 and the touch panel 9. And the display screen 2 is formed. The touch panel 9 faces the display portion 8a, and the peripheral portion thereof is supported by the display panel 8 by the support member 10.

  The housing 1 is also provided with a moving mechanism for moving the display screen 2 back and forth with respect to the opening 1a of the housing 1, and the display screen 2 is opened according to the pressing force by a fingertip or the like on the touch panel 9. It can be withdrawn from 1a.

  In FIG. 1 (c), this moving mechanism is configured using the drive motor 11, the link mechanism 14, and the like, and is disposed behind the display panel 8 in the housing 1.

  As a specific configuration example of the moving mechanism, a rotating gear 12 is fixed to a rotating shaft of the drive motor 11, and a spur gear 13 is engaged with the rotating gear. A link mechanism 14 is attached to one end of the spur gear 13. The link mechanism 14 includes two links 14a and 14b that are arranged in substantially opposite directions and whose one ends are rotatably attached to the spur gear 13, and a support member 14c that supports a substantially central portion of the link 14a. The link 14b includes a support member 14a that rotatably supports the link 14b, and supports the link 14b. The other end of the link 14a supports the support member 10a on one side of the display panel 8, and the link 14b. The other end of the display panel is rotatably linked to the support member 10b on the other side of the display panel 8.

  Further, the other end of the spur gear 13 is pulled in the counterclockwise direction around the rotating gear 12 in the drawing by a tension spring 15, whereby the spur gear 13 is pressed against the rotating gear 12. Furthermore, a tension spring 16 is also provided to keep the link mechanism 14 in a good balance state at all times.

  The display means including the display panel 8 and the touch panel 9 is supported by the link mechanism 14 so that the touch panel 9 is positioned in the vicinity of the opening 1 a of the housing 1.

  FIG. 2 is a view showing the operation of the moving mechanism, and the same reference numerals are given to portions corresponding to FIG.

  FIG. 2 (a) shows the initial state of the display screen 2, where the spur gear 13 is moved to the farthest side, that is, the spur gear 13 is a rotating gear at the end of its link 14a, 14b side. 12 is engaged. In this state, the spur gear 13 side ends of the links 14a and 14b are pulled by the spur gear 13, the link 14a is rotated in the clockwise direction around the support member 14c, and the link 14b is counteracted around the support member 14d. The support members 10a and 10b are lifted by the links 14a and 14b, and the touch panel 9 of the display screen is in contact with the opening 1a or arranged close to the opening 1a. ing.

  When the drive motor 11 rotates in the clockwise direction by a predetermined rotation amount, the spur gear 13 moves to the display panel 8 side as shown in FIG. 2B, and the ends of the links 14a and 14b are moved by the spur gear 13. It is pushed to the display panel 8 side. As a result, the link 14a rotates counterclockwise around the support member 14c, and the link 14b rotates clockwise around the support member 14d, and the display panel 8 moves in the direction of arrow A to display The screen 2 is retracted (drawn) from the opening 1a.

  When the drive motor 11 rotates to the maximum in the clockwise direction, the spur gear 13 is engaged with the rotating gear 12 at the end on the tension spring 15 side, as shown in FIG. In this state, the links 14a and 14b rotate to the maximum in the above direction, and as a result, the display panel 8 has moved to the maximum in the direction of the arrow A, and the display screen 2 is retracted to the maximum from the opening 1a. It becomes.

  When the drive motor 11 rotates counterclockwise from the state shown in FIGS. 2B and 2C, it finally returns to the initial state shown in FIG. Here, the drive motor 11 is provided with an angle sensor, and can always detect its own rotation angle and control the rotation angle.

  Here, although a gear mechanism is used as the driving means of the link mechanism 14, other mechanisms such as a cam may be used.

  FIG. 3 is a sectional view schematically showing another specific example of the display means having the moving mechanism in the housing 1 in FIG. FIG. 3A shows that only the touch panel unit can be moved without moving the display device, and the display device 8 is a cathode ray tube, a liquid crystal panel, or a plasma display panel. FIG. 3B shows a projector such as a liquid crystal projector, and the display panel 8 is a liquid crystal panel or a cathode ray tube. Here, 17 is a projection device, 18 is a mirror, and parts corresponding to those in the previous drawings are given the same reference numerals.

  3A, in the housing 1, the display panel 8 is supported by the support member 10, and the touch panel 9 is supported by the link mechanism 14, and is movable as described in FIG. .

  The touch panel 9 has a configuration in which a transparent film that covers the entire display surface 8a is provided, and detects that the user has touched with a fingertip or the like (touch detection: this indicates that the fingertip has touched the touch panel 9). The touch position is detected (position detection: this is the same function as the conventional touch panel that detects the position where the fingertip touches the touch panel 9). However, this specific example also has a function of detecting the pressure when touched (for pressure detection). As a method for providing this pressure detection function, a pressure sensor is provided on the touch panel 9 itself so as to detect the pressure. Such a pressure sensor is used to apply a pressing force such as a mounting portion of the link mechanism 14 on the touch panel 9. It may be attached to any position as long as it can be detected. In this embodiment, since the part to be moved is light, the moving mechanism is small. It is effective if the positional relationship between the touch panel 9 and the display panel 8 is used within a range where the influence of parallax is small.

  In the specific example shown in FIG. 3B, a projector including a projection device 17 including a liquid crystal panel that generates an image, a cathode ray tube, a mirror 18 and a screen (not shown) is provided in the housing 1. In addition, a touch panel 9 is integrally provided on the outside of the screen. The screen and the touch panel 9 are supported in the vicinity of the opening 1 a of the housing 1 by the link mechanism 14.

  The projection device 17 is provided with a projection lens (not shown), and the image from the projection device 17 is projected onto the screen via the mirror 18. The projection lens magnifies the image projected onto the screen. ing. When the projection device 17 is provided directly opposite the screen, the mirror 18 can be omitted.

This specific example also has a function of detecting the pressure when the touch panel 9 is touched (pressure detection) in addition to the touch detection and touch position detection on the touch panel 9. As a method of providing this pressure detection function, the touch panel 9 is provided with functions of touch detection, detection of the position of the touch position and detection of pressure at the touch position, or the link mechanism 14 and the touch panel 9. A pressure sensor may be provided between the two so as to detect pressure.

  However, when the touch position of the fingertip is detected on the touch panel 9, it may be determined that the fingertip is touched on the touch panel 9. In this embodiment, the moving mechanism is also small and has no parallax. Since the screen itself moves, it is effective if it is used within a range where there is little change in the position and size after projection.

  FIG. 4 is a diagram showing a state of a fingertip with respect to the touch panel 9 in the first embodiment. FIG. 4A shows a state in which the fingertip 19 is not touching the touch panel 9, and FIG. 4B and FIG. The state where the fingertip 19 touches the touch panel 9 is shown. FIG. 5B shows a state in which the fingertip 19 touches the touch panel 9 lightly, and FIG. 5C shows a state in which the fingertip 19 touches the touch panel 9 strongly. Hereinafter, the fingertip is described as an example of the instruction means, but other input means such as a pen or a pen-type input device may be used.

  FIG. 5 is a diagram showing determination of the state of the fingertip 19 shown in FIG. 4 with respect to the pressure detected by the pressure sensor (this determination is made by a control unit described later), and the horizontal axis is applied to the touch panel 9. The pressure (force for pressing the touch panel 9: hereinafter referred to as a pressing force) P is shown, and the determination result for the pressing force P is shown on the vertical axis.

  In FIG. 5, when the value of the weak pressure P1 and the value of the strong pressure P2 are set in advance, and the pressure P to the touch panel 9 is 0 ≦ P <P1, no pressure is applied to the touch panel 9 (no reaction: If P1 ≦ P <P2, it is determined that the touch panel 9 has been touched (the above “touch detection”), and the touch position is detected. Further, when the pressing force P is P2 ≦ P, it is determined that a strong pressing force is applied to the touch panel 9 so that the touch panel 9 is pressed (the “pressure detection” described above).

  The state shown in FIG. 4A indicates a state of 0 ≦ P <P1 in FIG. 5, and in this state, it is determined that the touch panel 9 is not touched. FIG. 4B shows a state in which the fingertip 19 has touched the touch panel 9. At this time, if 0 ≦ P <P1, it is determined from FIG. 5 that the touch panel 9 has not been touched. If P1 ≦ P <P2, it is determined that the touch panel 9 has only been touched and has not been pressed. FIG. 4C shows a state in which the touch panel 9 is touched with the fingertip 19 and is in a state of P2 ≦ P in FIG. At this time, it is determined that the touch panel 9 is pushed.

  As described above, in this embodiment, two-stage detection based on the pressure of the touch panel 9 is possible.

  The pressure P1 (> 0) is set to prevent an erroneous determination that the touch panel 9 is touched when an inappropriate pressure is applied to the touch panel 9 due to vibration or the like.

  FIG. 6 is a block diagram showing a main part of a specific example of the circuit configuration in the first embodiment, in which 20 is a control unit, 21 is a speaker, 22 is a storage unit, and 23 is a vibration unit. , Parts corresponding to those in FIG.

  In FIG. 6, the touch panel 9 includes a touch sensor and a pressure sensor, and a detection output of the touch sensor and a detection pressure P of the pressure sensor are supplied to the control unit 20. The control unit 20 detects the touch position of the fingertip on the touch panel 9 based on the detection output of the touch sensor, performs the determination described in FIG. 5 based on the detected pressure P, and stores the storage unit according to the determination result. Based on the data stored in 22, the display panel 8 and the projection device 17 are controlled as will be described later, and a predetermined sound reproduction is performed by the speaker 21.

  The control unit 20 determines whether the detected pressure P of the pressure sensor is P <P1 (not touched) or P1 ≦ P <P2 (touched) with respect to the preset pressure values P1 and P2. : “Touch detection”) or P2 ≦ P (whether pushed in: “Pressure detection”) or not, and the drive motor 11 is controlled based on this determination.

  The drive amount of the display screen 2 by the drive motor 11 will be described with reference to FIG. 7. This FIG. 7 is based on the position of the display screen 2 in the state shown in FIG. The driving amount from the position is shown.

  In FIG. 7A, when it is determined that P <P1, the control unit 20 sets the display screen 2 to the state shown in FIG. 2A by setting the driving amount of the display screen 2 by the drive motor 11 to zero. Therefore, for example, in the state shown in FIG. 2B or FIG. 2C, when the control unit 20 determines that P <P1, the control unit 20 reacts with the drive motor 11 based on the detection output of the angle sensor. The rotation is controlled in the clockwise direction, and the vibration unit 23 such as the link mechanism 14 is driven to the state shown in FIG. In addition, when it is determined that P1 ≦ P <P2, the control unit 20 controls the rotation of the drive motor 11 to be in the state shown in FIG. 2B (this is referred to as drive 1), and determines that P2 ≦ P. In some cases, the drive motor 11 is rotationally controlled in the same manner as shown in FIG. 2C (this is referred to as drive 2).

  In FIG. 7A, the driving amount of driving 1 is set to 0, and driving 2 can be executed only when P2 ≦ P. When the pressing force P by the fingertip is P1 ≦ P <P2, the screen display is changed and voice guidance is performed, and driving is performed only when P2 ≦ P, the operator can be sure that the determination operation has been executed. Can be recognized, and the drive control can be simplified.

  FIG. 7B is an example in which the drive amount is continuously changed with respect to the increase in pressure. When the pressing force P by the fingertip becomes P2 ≦ P, the change in the driving force due to the pressure change increases rapidly. This is similar to a sudden pressing of a button at the pressing position when a physical key is pressed, and a tactile sensation as if the physical key was pressed is obtained even though it is a touch panel.

  FIG. 7C shows that when the pressing force P by the fingertip is P1 ≦ P <P2, the driving amount continuously increases in the pressing direction according to the increase of the pressing force, and the pressing force P is P1 ≦ P <P2. This is an example of driving in the direction opposite to the pressing force. According to this example, when the pushing operation is performed, the driving is performed in the direction completely opposite to the touch state, so that the determination operation can be clearly recognized.

  FIG. 8 is a flowchart showing a first specific example of the function control of the control unit 20. In the following, as shown in FIG. 5, the process by the control unit 20 when the pressure P is 0 ≦ P <P1 is A, and the process by the control unit 20 when P1 ≦ P <P2 is B, Let C be the process performed by the control unit 20 when P2 ≦ P. Although these processes will be described later, as a matter of course, the process A is a process when the touch operation on the touch panel 9 is not performed.

  In the figure, when a power supply (not shown) is turned on, the control unit 20 performs a process A to put the apparatus into an operation start state (step 100). First, it is determined whether or not an operation end condition is set by turning off the power (step 101). If not set, the detected pressure P is taken from the pressure sensor in FIG. It is determined whether P ≧ P1 (step 102). When P <P1, it is determined that the touch operation on the touch panel 9 has not been performed, the process returns to step 100, and a series of operations of steps 100 to 102 is repeated until the touch operation is performed, and the process A is executed during that time. The screen by the process A displayed on the display screen 2 (FIG. 1) at this time is defined as (i).

Next, as shown in FIG. 4 (b) or (c), when a touch operation on the touch panel 9 is performed, P ≧ P1 (this includes P ≧ P2) (step 102). 4 (b) or 4 (c), the position touched with the fingertip 19 (touch position) on the touch panel 9 is the position where the processes B and C of the touch operation member such as the operation button should be executed. Whether or not (step 103). Here, the touch position of the fingertip 19 is detected by the touch sensor (FIG. 6), and this is compared with the data in the storage unit 22 (FIG. 6). This touch position requires execution of the processes B and C. When a position, for example, a touch operation member is used as an operation button, it is determined whether or not it is within the operation button display area (hereinafter referred to as an operation button area). The process B is executed (step 104), and the drive motor 11 (FIG. 6) is controlled to operate the vibration unit 23, that is, the link mechanism 14, and the display screen 2 is driven 1 (FIG. 7). (Step 105) When the touch position is not within the operation button area, as long as P ≧ P1, the execution of the process A is continued in Step 103, and then P <P1. The fingertip 19 is released from the touch panel 9). Although not shown, the process returns to step 100, and when the fingertip 19 moves and the touch position enters the operation button area, it is determined that this is touched and processing B and driving are performed. 1 is executed (steps 104 and 105). The screen by this process B displayed on the display screen 2 (FIG. 1) at this time is defined as (ii).

  When the drive 1 is executed, taking the configuration of FIG. 1 as an example, the state shown in FIG. 2B is obtained, and the display screen 2 is slightly retracted from the opening 1a of the housing 1 and retracted. As described above, when any area of the operation buttons is touched, the instantaneous display screen 2 is suddenly small or slowly retracted. Since there is no change, it can be recognized by touch that the area of the operation button has been touched. For example, even when parallax occurs when the display screen 2 is viewed obliquely, it is easy to know whether or not the operation button has been touched, and even a visually impaired person can accurately touch the operation button. .

  Then, the detected pressure P is taken in from the pressure sensor for determination. When P <P1 (step 106), the process B is ended (step 107) and the process returns to step 100, but when P1 ≦ P (step 106). 106) Further, it is determined whether or not P2 ≦ P (step 108). If the result of this determination is that P1 ≦ P <P2, the process returns to step 103, and as long as P1 ≦ P <P2, the processing is continued. B and drive 1 are continuously executed. When P2 ≦ P (step 108), when the touch position is within the area of the operation button, the process C is executed (step 108) and the drive 2 (FIG. 7) is executed (step 110). The screen by the process C displayed on the display screen 2 (FIG. 1) at this time is defined as (iii).

  This process C is equivalent to, for example, the determination process for the operation button as in the first embodiment, and the drive 2 that is executed at this time uses the display screen 2 as a rattling. It pushes much further. Therefore, if the operation button displayed on the display screen 2 is used to execute the operation, the display screen 2 is operated to be pushed in at the same time. Therefore, it feels the same as if the hardware configuration switch was pushed in. Even if this operation button determination operation is performed with a large parallax, it is possible to accurately determine whether or not such an operation has been performed. By executing the drive 2 following the execution of 1, it is possible to reliably know that the determination operation has been executed.

  Note that, as shown in FIG. 7C, the drive 2 may be moved in a direction to return the display screen to the original direction (the direction opposite to the pressing direction by the fingertip). If the movement of drive 2 is discontinuous with drive 1, it can be recognized by the finger that it has been depressed, and it can be known that the decision operation has been executed.

  When the fingertip 19 is released from the touch panel 9 after executing the process C and the drive 2, P <P2 is satisfied (step 111), the process C is ended (step 112), and the process returns to the process 103. If P <P1, the process returns to the process 100.

  In this way, if P1 ≦ P <P2 with the fingertip 19 touching the operation button area on the touch panel 9 as shown in FIG. 4B, the process B and the drive 1 are performed. When the fingertip 19 touches the operation button on the touch panel 9 as shown in 4 (c), P2 ≦ P is established, and the process C and the drive 2 are executed after the process B is executed.

  Next, a specific example of the screen on the display screen 2 by such an operation will be described.

  FIG. 9 is a diagram showing a specific example of such a screen using the touch operation member as an operation button.

  FIG. 9A shows a specific example in which the operation button 24 is displayed on the display screen 2 and when the operation button 24 is touched, the display color changes in processes A, B, and C. In the operations of Steps 100 to 102 in FIG. 8, the process A is performed and the screen (i) is displayed. In this screen (i), the operation button 24 is now displayed in the first color. To do.

When the area of the operation button 24 is touched with the fingertip 19 in such a display state, when the pressure P against the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6). ), The touch position of the fingertip 19 at this time is detected, and this touch position is within the area of the operation button 24 based on the data in the storage unit 22 (FIG. 6) (that is, the touch position is identical to the operation button position) (Step 103), the process B is executed (Step 104 in FIG. 8), and the screen (ii) in which the operation button 24 is changed to the second color is displayed. At the same time, drive 1 in FIG. 7 is executed (step 105 in FIG. 8), and the state shown in FIG. 2 (a) shifts to the state shown in FIG. 2 (b), and the display screen 2 is steadily small or slowly. And go backwards small. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

  Further, the operation button 24 is pushed by the fingertip 19 so that P2 ≦ P. In this case, too, if the touch position matches the position of the operation button 24, the operation button 24 changes to the third color. The changed screen (iii) is displayed, and at the same time, the drive 2 shown in FIG. 7 is executed, and the state shown in FIG. 2 (b) is rapidly changed to the state shown in FIG. 2 (c). It moves backward to the back and back (in the case of FIG. 7C, it moves forward in reverse). As a result, it is possible to recognize visually and tactilely that a function operation such as an execution operation has been performed with this operation button 24 (that is, the operation button 24 has been definitely operated). . Therefore, when an erroneous operation is performed, this can be easily known, the touch operation can be easily performed again, and the prevention of erroneous operations is improved. When the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  FIG. 9B shows a specific example when the operation button 24 is touch-operated on the display screen 2 and its shape changes in processes A, B, and C. Also in this specific example, in the operations of Steps 100 to 102 in FIG. 8, the process A is performed and the screen (i) is displayed. On this screen (i), for example, the operation buttons 24 are displayed in a rectangular shape. Shall.

When the position (area) of the operation button 24 is touched with the fingertip 19 in such a display state, when the pressure P against the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6), the touch position of the fingertip 19 at this time is detected, and it is determined that this touch position matches the position of the operation button 24 based on the data in the storage unit 22 (FIG. 6). (Fig. 8
Step 103), the process B is executed (Step 104 in FIG. 8), and the screen (ii) in which the shape of the operation button 24 is changed from the rectangular shape to another shape is displayed. At the same time, the driving 1 in FIG. 7 is executed (step 105 in FIG. 8), and the state shown in FIG. 2 (a) is shifted to the state shown in FIG. 2 (b). Move backwards small. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

Further, when the operation button 24 is pushed by the fingertip 19 and P2 ≦ P is satisfied, in this case as well, if the touch position coincides with the position of the operation button 24, the operation button 24 has a third shape (screen ( The screen (iii) changed to the original shape in i) is displayed. In this case, the color of the operation button 24 may also be changed. At the same time, the driving 2 in FIG. 7 is executed, and the state shown in FIG. 2B is rapidly changed to the state shown in FIG. 2C, and the display screen 2 is moved back to the far side. In the case of FIG. 7 (c), it moves forward in reverse). As a result, the fact that the operation operation such as the execution operation has been performed with the operation button 24 (that is, the operation button 24 is definitely operated) can be recognized both visually and tactilely. The same effect as described above can be obtained. When the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  FIG. 9C shows a specific example in the case where the size of the operation button 24 is changed in the processes A, B, and C when the operation button 24 is touched on the display screen 2. Also in this specific example, in the operations of Steps 100 to 102 in FIG. 8, the process A is performed and the screen (i) is displayed. On this screen (i), for example, the operation buttons 24 are displayed in a rectangular shape. Shall.

  When the position (area) of the operation button 24 is touched with the fingertip 19 in such a display state, when the pressure P against the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6), the touch position of the fingertip 19 at this time is detected, and it is determined that this touch position matches the position of the operation button 24 based on the data in the storage unit 22 (FIG. 6). Then (step 103 in FIG. 8), the process B is executed (step 104 in FIG. 8), and a screen (ii) in which the size of the operation button 24 is greatly changed is displayed, for example. At the same time, the driving 1 in FIG. 7 is executed (step 105 in FIG. 8), and the state shown in FIG. 2 (a) is shifted to the state shown in FIG. 2 (b). Move backwards small. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

  Further, when the operation button 24 is pushed in with the fingertip 19 and P2 ≦ P, in this case, if it is determined that the touch position and the position of the operation button 24 coincide with each other, the size of the operation button 24 is changed to the previous size. The screen (iii) changed to be different (may be the original size on the screen (i)) is displayed. In this case, the color of the operation button 24 may also be changed. At the same time, the driving 2 in FIG. 7 is executed, and the state shown in FIG. 2B is rapidly changed to the state shown in FIG. 2C. As a result, the display screen 2 moves backward greatly toward the back. (However, in the case of FIG. 7 (c), it moves forward in reverse). As a result, the fact that the operation operation such as the execution operation has been performed with the operation button 24 (that is, the operation button 24 is definitely operated) can be recognized both visually and tactilely. The same effect as described above can be obtained. Next, when the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  In the processing related to the operation button operation described above, the process B can be an operation button selection process, and the process C can be a determination process for determining a function by the operation button.

  9 (a) to 9 (c), shadows 25 are displayed on two adjacent sides of the screen (iii) so that the screen (iii) is depressed and depressed. May be.

  FIG. 10 is a diagram showing another specific example of the screen on the display screen 2 associated with the operation shown in FIG.

  First, in FIG. 10A, a touch operation member is used as an operation button, which has the same function as mouse over on a personal computer.

  An operation button 24 is displayed on the display screen 2 and a specific example in which additional information is displayed when the operation button 24 is touched is shown. In the operations of Steps 100 to 102 in FIG. 8, it is assumed that the screen (i) on which the operation button 24 appears by performing the process A is displayed.

  When the area of the operation button 24 is touched with the fingertip 19 in such a display state, when the pressure P against the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6). ), The touch position of the fingertip 19 at this time is detected, and it is determined that the touch position matches the position of the operation button 24 based on the data in the storage unit 22 (FIG. 6) ( Step 103 in FIG. 8) and the process B is executed (Step 104 in FIG. 8). For example, a guidance message such as “Press this button to go to the next screen” (that is, the function of the operation button 24). A screen (ii) on which a balloon 26 representing is displayed is displayed. At the same time, the driving 1 of FIG. 7 is executed (step 105 of FIG. 8), the state shown in FIG. 2A is changed to the state shown in FIG. 2B, and the display screen 2 is steadily small. Or slowly retreat back to the back. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

  Next, when the operation button 24 is further pushed by the fingertip 19 and P2 ≦ P, it is determined that the touch position matches the operation button position in this case, for example, the color of the operation button 24 is The changed screen (iii) is displayed. At the same time, the driving 2 in FIG. 7 is executed, and the state shown in FIG. 2 (b) is rapidly changed to the state shown in FIG. 2 (c), and the display screen 2 moves back to the far side (however, In the case of FIG. 7 (c), it moves forward in reverse). As a result, the fact that the operation operation such as the execution operation has been performed with the operation button 24 (that is, the operation button 24 is definitely operated) can be recognized both visually and tactilely. The same effects as described above can be obtained. When the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  Also in this specific example, the process B can be an operation button selection process, and the process C can be a determination process for determining a function by the operation button.

  Alternatively, the shadow 25 may be displayed on two adjacent sides of the screen (iii) to visually indicate that the screen (iii) has been depressed.

  The above function corresponds to so-called “mouse over”, in which when a mouse such as a personal computer is moved and matched with a predetermined display element, the display element is changed. The mouse over function is applied to the display device equipped with the touch panel by dividing the state of P1 ≦ P <P2 and the state of push-in P2 ≦ P and performing the processing B and the processing C respectively. Is possible.

  Here, the function of the operation button 24 is described with the balloon 26, but a voice message may be output from the speaker 21 (FIG. 6), or the voice message and the balloon 26 may be combined. It may be.

  FIG. 10B shows a touch operation member as a message, and when the part of the display area of the message displayed on the display screen 2 is touched, the part can be enlarged and displayed. Is shown.

  Also in this specific example, in the operations of Steps 100 to 102 in FIG. 8, the process A is performed and the screen (i) is displayed. On this screen (i), for example, a guidance message 27 such as “I welcome you” is displayed. Assume that it is displayed.

  When the display area of the guidance message 27 is touched with the fingertip 19 in such a display state, when the pressure P against the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6), the touch position of the fingertip 19 at this time is detected, and it is determined that this touch position matches the display area of the guidance message 27 based on the data in the storage unit 22 (FIG. 6). Then, process B is executed (step 104 in FIG. 8), and a predetermined area centered on the touch position of the fingertip 19 is enlarged and displayed in the enlarged display area 28 including the predetermined area. Accordingly, a part of the guidance message 27 can be enlarged and displayed, and the enlarged display area 28 can be moved (dragged) by moving the fingertip 19 along the guidance message 27 in the same touch state. Therefore, by dragging in this way, the guidance message 27 can be enlarged so that the text is enlarged and read with a magnifying glass. At the same time, the driving 1 of FIG. 7 is executed (step 105 of FIG. 8), the state shown in FIG. 2A is changed to the state shown in FIG. 2B, and the display screen 2 is steadily small. Or slowly retreat back to the back. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

  Next, when the display area of the guidance message 27 is pushed in with the fingertip 19 and P2 ≦ P, the match between the touch position and the display area of the guidance message 27 is determined in this case, and the “decision” process or the like is performed. Process C is performed and the screen (iii) is displayed. When this determination process is completed, the process proceeds to the subsequent process. At the same time, the drive 2 of FIG. 7 is executed, and the state shown in FIG. 2B is rapidly changed to the state shown in FIG. 2C, and the display screen 2 is moved back to the far side. (However, in the case of FIG. 7 (c), it moves forward in reverse). As a result, it is possible to recognize visually and tactilely that a function operation has been performed on the guidance message 27 (that is, the display area of the guidance message 27 is definitely touched). The same effects as described above can be obtained. At this time, the shadow 25 may be displayed on two adjacent sides of the screen (iii) to visually indicate that the screen (iii) is depressed. When the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  FIG. 10C shows the touch operation member as a menu screen and a cursor. When a touch operation is performed on the touch panel 9 on the display screen 2, a menu column is displayed so that a desired menu can be selected and determined. An example is given.

  In this specific example as well, in the operations of steps 100 to 102 in FIG. 8, the process A is performed and the screen (i) is displayed. In this screen (i), nothing other than the background pattern (not shown) is displayed. It is assumed that it is not displayed.

  When an arbitrary position on the screen (i) is touched with the fingertip 19, the detected pressure P for the touch panel 9 at this time is P1 ≦ P <P2 (step 102 in FIG. 8), at this time, the touch sensor (FIG. 6). ), The touch position of the fingertip 19 at this time is detected, and when this touch position is determined to be a position in the screen (i) based on the data in the storage unit 22 (FIG. 6), the process B is performed. When executed (step 104 in FIG. 8), a screen (ii) on which a menu column 29 composed of a plurality of menus is displayed is displayed. At the same time, the driving 1 of FIG. 7 is executed (step 105 of FIG. 8), the state shown in FIG. 2A is changed to the state shown in FIG. 2B, and the display screen 2 is steadily small. Or slowly move backward. By the above process B and drive 1, it can be recognized visually and tactilely that the fingertip 19 has touched the operation button 24.

  Further, by processing B, the cursor 30 is also displayed on the menu including the touch position of the fingertip 19 in the menu column 29 on the screen (ii). If the fingertip 19 is moved while maintaining the same touch state, the cursor 30 is also displayed. A desired menu can be selected by sticking to the fingertip 19 and dragging. After the cursor 30 matches the desired menu (at this time, the touch position of the fingertip 19 also matches the desired menu), the menu is pushed by the fingertip 19 and P2 ≦ P. Then (step 108), also in this case, the match between the touch position and the menu position is determined, the process C is executed (step 109), and the screen (iii) for determining this desired menu is displayed. In this case, the color of the cursor 30 may be changed. At the same time, the drive 2 of FIG. 7 is executed, and the state shown in FIG. 2B is rapidly changed to the state shown in FIG. 2C, and the display screen 2 is moved back to the far side. (However, in the case of FIG. 7 (c), it moves forward in reverse). As a result, it is possible to recognize visually and tactilely that a function operation has been performed on the guidance message 27 (that is, the display area of the guidance message 27 is definitely touched). The same effects as described above can be obtained. At this time, the shadow 25 may be displayed on two adjacent sides of the screen (iii) to visually indicate that the screen (iii) is depressed. When the fingertip 19 is released from the touch panel 9, the screen returns to the screen (i).

  As described above, the specific examples shown in FIGS. 10B and 10C have the functions of dragging and deciding with the mouse that moves the points such as the enlarged display area 28 and the cursor 30 and decides at the selected position. It is

  In the first specific example described above, the pressing pressure (= P2) for executing the process C according to the type of the touch operation member (that is, the operation button 24, the guidance message 27, the cursor 29, etc.). May be different. For example, an operation button 24 that requires attention to an operation such as a “delete” button is prevented from functioning (ie, executing process C) unless pressed more strongly than other touch operation members. Can do. This makes it difficult to function even if the wrong operation is performed.

  FIG. 11 is a diagram showing a screen when the display device provided with the touch panel according to the present invention is an ATM (Automatic Tellers Machine) display device, and the above first specific example is used for this. Parts corresponding to those in the previous drawings are given the same reference numerals. Here, the screen changes shown in FIGS. 9A and 9C and FIGS. 10A and 10B are used.

  Now, it is assumed that the initial screen (i) shown in FIG. 11 (a) is displayed on the display screen 2 having the configuration shown in FIG. 3 (b) of the ATM having the circuit configuration shown in FIG. (Step 100 in FIG. 8). In this initial screen (i), a selection button 24 that allows the customer to select an action to be performed on the bank, such as a “withdrawal” button, a “deposit” button,... Now, when the customer lightly touches the “withdrawal” button 24 with the fingertip 19 to withdraw the deposit, the control unit 20 (FIG. 6) determines that the detected pressure P at this time is P1 ≦ P. Sometimes (steps 102 and 103 in FIG. 8), a guidance screen (ii) as shown in FIG. 11B is displayed on the ATM display screen (step 104 in FIG. 8). In this guidance screen (ii), as in the screen (ii) shown in FIG. 9C, the “drawer” button 24 touched with the fingertip 19 is enlarged, and the screen shown in FIG. As shown in Fig. 10 (a), as shown in Fig. 10 (a), for example, "You can withdraw cash from your deposit account. A guidance for withdrawing a deposit such as “necessary” is displayed by a balloon 26 from the “withdrawal” button 24. In this case, this guidance may be output by voice from a speaker (not shown). In this case, the driving 1 in FIG. 7 is executed (step 105 in FIG. 8).

  In this guidance screen (ii), when the “drawer” button 24 is pushed with the fingertip 19 and the detected pressure P is P2 ≦ P (step 108 in FIG. 8), this “drawer” button The selection of 24 is decided, and it moves to the next screen (not shown) so that an operation for deposit withdrawal can be performed (step 109 in FIG. 8). In this case, the driving 2 in FIG. 7 is executed (step 110 in FIG. 8).

  Further, on the initial screen (i) shown in FIG. 11A, when the display portion of the guidance message 27 is touched with the fingertip 19 so that the detected pressure P satisfies P1 ≦ P, the screen (ii) in FIG. As shown in FIG. 11C, the enlarged display area 28 is displayed, and the guide screen (ii) shown in FIG. 11C is displayed to enlarge and display a portion of a predetermined range including the touch position in the enlarged display area 28. it can. In this case, when the fingertip 19 is moved along the guide message 27 in such a touch state, a series of character strings of the guide message 27 is sequentially enlarged, and thus the guide message 27 can be enlarged.

  FIG. 12 is a diagram showing a screen when the display device provided with the touch panel according to the present invention is used as a ticket vending machine display device, and the first specific example is used for the display device. The same reference numerals are given. Here, the screen change shown in FIG. 10B is used.

  6 having the circuit shown in FIG. 6 and displaying the initial screen (i) shown in FIG. 10 (a) on the display screen 2 of the ticket vending machine configured as shown in FIG. 1 or FIG. And In this initial screen (i), routes and main stations are displayed, and no other stations are displayed (step 100 in FIG. 8).

  When purchasing a ticket to the station desired by the customer (of course, you may be able to purchase a limited express ticket or designated ticket), if this desired station is displayed on the initial screen (i), the display When the position is strongly pressed with the fingertip 19, steps 102 to 106 and 108 in FIG. 8 are performed, and a purchase screen (iii) as shown in FIG. 12C is displayed. A ticket can be purchased (step 109 in FIG. 8). In this case, of course, other tickets such as limited express tickets and designated tickets may be purchased.

  When the station desired by the customer is not displayed on the initial screen (i), the displayed route is touched with a fingertip. When the control unit 20 (FIG. 6) determines that P1 ≦ P by this touch (step 102 in FIG. 8), when the touch position matches the display position of a hidden station without being displayed (step 103 in FIG. 8), The control unit 20 detects this and displays a guidance screen (ii) as shown in FIG. 12B (step 104 in FIG. 8). In this guidance screen (ii), as shown in screens (ii) and (iii) of FIG. 10B, an enlarged display area 28 is provided at the touch position of the fingertip 19, and this station is indicated by the station name or the like. Enlarge and display something. When the station displayed in an enlarged manner is a station not desired by the customer, the fingertip is moved along the route. Thus, every time the touch position of the fingertip 19 matches the position of the station, the enlarged display area 28 in which the station name and the like are enlarged is displayed, and the customer can search for the desired station. When the desired station is found and pressed with the fingertip 19 so as to push in the portion of the station name (in this case, the above drive 2 is executed), the station has been selected and determined as shown in FIG. A purchase screen (iii) as shown is displayed (step 109 in FIG. 8), and a ticket to the desired station can be purchased.

  In this way, the ticket vending machine can simultaneously display routes in a wide range on the display screen, and tickets to stations not displayed there can be purchased with a simple operation.

  In addition, as this ticket vending machine, although the case of the railroad was taken as an example, it cannot be overemphasized that a bus route, a ship, an air route, etc. may be sufficient.

In addition, in the guidance screen (ii) shown in FIG. 12 (b), the route of the entire range for selling tickets may be displayed at the same time. However, a part of this range is displayed, and the fingertip 19 is displayed on the screen (ii) When the end portion is reached, the display of the subsequent portion may be switched. Of course, in this case, the touch position on the previously displayed route is made clear in the newly displayed route. Thereby, the route range which sells tickets can be expanded.

  Next, a second embodiment of a display device provided with a touch panel according to the present invention will be described. However, the second embodiment also has the same configuration as that of the first embodiment shown in FIGS. 1 to 6 and performs the operations shown in FIGS.

  FIG. 13 is a diagram showing a specific example of a screen displayed on the display screen 2 by the control operation shown in FIG. 8 of the second embodiment.

  In this figure, it is assumed that the operation buttons 24 a to 24 c are displayed on the display screen 2 and the display screen 2 is touched with the fingertip 19. If the pressure P detected by the pressure sensor (FIG. 6) by the touch of the fingertip 19 becomes P1 ≦ P (step 102), the control unit 20 determines the fingertip 19 from the detection result of the touch sensor (FIG. 6). The touch position is detected and compared with the data in the storage unit 22 (FIG. 6), and the touch position is within the area where the predetermined function (ie, processing B and C) is to be executed (in this case, the operation button). It is determined whether it is in any of the areas 24a to 24c) (step 103). Here, if the touch position is within the area of the operation button 24b, for example, the control unit 20 first executes the process B (step 104), and controls the drive motor 11 (FIG. 6) to control the vibration unit. 23, that is, the link mechanism 14 is operated and the driving 1 of FIG. 7 is executed (step 105). However, if there is no touch position in any of the areas of the operation buttons 24a to 24c, that is, these operation buttons 24a. When no touch is made on any of 24 to 24c, as long as P ≧ P1, execution of processing A is continued in step 103, and then P <P1 (if the fingertip 19 is moved from the touch panel 9). When the fingertip 19 moves and the touch position enters any one of the operation buttons 24a to 24c, this is not shown, but this is not shown. As a result, the process B is executed (step 104), the drive motor 11 (FIG. 6) is controlled to operate the vibration unit 23, that is, the link mechanism 14, and the drive 1 of FIG. Step 105).

  When the drive 1 is executed, taking the configuration of FIG. 1 as an example, the state shown in FIG. 2B is obtained, and the display screen 2 is slightly retracted from the opening 1a of the housing 1 and retracted. As described above, when one of the operation buttons 24a to 24c is touched, the instantaneous display screen 2 is suddenly small or slowly retracted small, and even if a portion other than these operation buttons 24a to 24c is touched, the display screen 2 Then, since there is no change, it can be recognized by tactile sense that the operation buttons 24a to 24c have been touched. For example, whether or not the operation buttons are touched even when parallax occurs when the display screen 2 is viewed obliquely. It's easy to see, and even people who are blind can touch the operation buttons accurately.

  In this specific example, the process B is not necessarily required, and at least the drive 1 may be executed.

  Then, the detected pressure P is taken from the pressure sensor and determined. When P <P1 (step 106), the execution of the process B and the drive 1 is finished (step 107), and the process returns to step 100. If P1 ≦ P (step 106), it is further determined whether or not P2 ≦ P (step 108). If P1 ≦ P <P2 as a result of this determination, the process returns to step 103. As long as P1 ≦ P <P2, the process B and the drive 1 are continuously executed as they are. When P2 ≦ P (step 108), when the touch position of the fingertip 19 coincides with any area of the operation buttons 24a to 24c, the process C is executed (step 109), and the driving shown in FIG. 2 is executed (step 110).

  This process C corresponds to the determination process for the operation buttons 24a to 24c, as in the previous specific example, and the drive 2 executed at this time further pushes the display screen 2. is there. Therefore, if the operation operation is performed with the operation buttons 24a to 24c displayed on the display screen 2, the display screen 2 is operated at the same time, so that it is the same as when the hardware switch is pressed. You can get the feel of this, even if you decide the operation button with a large parallax, you can accurately determine whether you have done such an operation, The execution of the drive 2 following the execution of the drive 1 described above (retreat or advance of the display screen 2) makes it possible to reliably know that the determination operation has been executed.

  If the fingertip 19 is released from the touch panel 9 during the execution of the process C and the drive 2, P <P2 is satisfied (step 111), the process C is terminated (step 112), and the process returns to the step 103. If <P1, return to Step 100. Here, the process C is the same process as the process C in the previous specific example, but in this specific example, it is not always necessary, and at least the drive 2 may be executed.

  As an application example of this specific example, the case of application to ATM will be described with reference to FIG.

  FIG. 5A shows that a desired operation button 24 of a group of buttons 24 on the display screen 2 of the ATM 31 is touched with the fingertip 19 and the detected pressure P is P1 ≦ P <P2. It shows a certain time. By displaying the shadow 32 on the outline of the button group, the button group is displayed so as to be lifted up. In this case, the operation button 24 touched with the fingertip 19 on the display screen 2 at Step 104 in FIG. 8 performs processing B such as a color change, and at Step 105 in FIG. The drive 1 shown in FIG. 7 is executed in which the screen 8 sinks in the back at the opening of the casing 1 of the ATM 31.

  Further, for the determination operation, an operation to push in the operation button 24 is performed. When P2 ≦ P is satisfied, the operation is performed by step 109 in FIG. 8 as shown in FIG. 14B. Processing C is performed so that the shadow portion 33 appears so that the operation button 24 is pushed into the two sides of the operation button 24, and the display screen 8 is displayed on the housing of the ATM 31 in step 110 of FIG. The drive 2 shown in FIG. 7 is further submerged or floated at the opening of the body 1.

  As described above, when the operation button 24 displayed on the flat display screen 2 is touch-operated, it is the same as when the hardware button is operated sensuously by executing the driving 1 and 2. In addition, visually, the operation button is recognized as being pushed in, and a good operation feeling is obtained. Further, by displaying the width and darkness of the shadow portion 33 so as to correspond to the amount of movement of the display screen, a better operation can be considered.

  As another application example, a case where this is also applied to ATM will be described with reference to FIG.

  In FIG. 5A, a desired operation button 24 in a group of buttons in which a plurality of operation buttons 24 on the display screen 2 of the ATM 31 are individually separated is touched with the fingertip 19, and the detected pressure P is P1. It indicates when ≦ P <P2. Each of these operation buttons 24 is displayed so that these operation buttons 24 are lifted up by displaying a shadow 32 on the outline thereof. In this case, the operation button 24 touched with the fingertip 19 on the display screen 2 at Step 104 in FIG. 8 performs processing B such as a color change, and at Step 105 in FIG. The drive 1 shown in FIG. 7 is executed in which the screen 8 sinks in the back at the opening of the casing 1 of the ATM 31.

  Further, for the determination operation, an operation to push in the operation button 24 is performed. When P2 ≦ P, as shown in FIG. 15B, the operation is performed in this way by step 109 in FIG. In the operation button 24, the process C for removing the shadow portion is executed so that the operation button 24 can be pushed in, and the display screen 2 is further opened at the opening of the casing 1 of the ATM 31 by step 110 in FIG. The drive 2 shown in FIG. 7 is performed, which sinks or rises.

  As described above, in this application example, as in the previous application example, when the operation button 24 displayed on the flat display screen 2 is touch-operated, the drive 1 and 2 are executed, so This is the same as when a hard button is operated, and also visually, the operation button is recognized as being pushed in, and a good operational feeling is obtained.

  Also in this application example, a better operation can be considered by displaying the width and darkness of the shadow portion that disappears when pressed in such a way as to correspond to the amount of movement of the display screen.

Next, a third embodiment of a display device including a touch panel according to the present invention will be described.
The third embodiment also has the same configuration as shown in FIGS. 1 to 6 as the first and second embodiments, and the display screen 2 can take an arbitrary driving amount. Is.

  FIG. 16 is a flowchart showing the control operation of the control unit 20 (FIG. 6) of the third embodiment. Hereinafter, this operation will be described with a display example of a screen.

  FIG. 17 shows an example of a screen displayed on the display screen 2 in this control operation. Here, the initial position of the display screen 2 is the position in the state shown in FIG. The position is intermediate between the positions shown in (c).

  In the figure, when a power supply (not shown) is turned on, the control unit 20 puts the display device into an operation start state as in FIG. 8 for the first embodiment (step 200). On the display screen 2, for example, as shown in FIG. 17A, it is assumed that images showing protrusions (hereinafter referred to as protrusions) 34a to 34c are displayed. First, it is determined whether or not an operation end condition has been set by turning off the power (step 201). If not set, the detected pressure P is taken from the pressure sensor in FIG. It is determined whether P ≧ P1 (step 202). When P <P1, it is determined that no touch operation has been performed on the touch panel 9 (FIGS. 1 to 3), and the process returns to step 200 and the series of operations in steps 200 to 202 are repeated until the touch operation is performed. It is assumed that screen 2 remains set at the initial position.

  Now, on the display screen 2, as shown in FIG. 17A, a point S in an area 35 (hereinafter referred to as a background area) 35 other than the protrusions 34a to 34c is touched with the fingertip 19, and the fingertip 19 is left touched. When the fingertip 19 touches the point S, the control unit 20 detects that the detected pressure P of the pressure sensor satisfies P1 ≦ P. This touch is detected (step 202), and the control unit 20 determines that the touch position is in the background area 35 based on the touch position detected by the touch sensor and the data in the storage unit 22 (FIG. 6). Detect and wait in the above initial state (step 203). When the fingertip 19 is moved away from the touch panel 9, P <P1, so that the process returns to step 200 and a series of operations of steps 200 to 202 are repeated.

  Next, when the fingertip 19 is moved in the arrow Y direction while touching the touch panel 9, the fingertip 19 reaches the protrusion 34a, but the control unit 20 detects the fingertip 19 from the detected pressure P of the pressure sensor (FIG. 6). Detects that the touch position is touching the touch panel 9, and detects that the touch position is within the area of the protrusion 34a from the touch position detected by the touch sensor and the data in the storage unit 22, and the drive motor 11 ( The link mechanism 14 is driven by controlling the rotation of FIGS. 1, 2 and 3 to bring the display screen 2 into the state shown in FIG. 2A (step 204). As a result, the display screen 2 is lifted from the initial position.

  When the fingertip 19 moves in the arrow Y direction and the touch is continued (step 205), the process returns to step 203. Hereinafter, as long as the fingertip 19 is touching the touch panel 9, a series of operations of steps 203 to 205 are performed. As the fingertip 19 moves in the arrow Y direction, when the touch position of the fingertip 19 enters the background area 35 between the protrusions 34a and 34b, the control unit 20 detects this and detects the drive motor 11. Is rotated in the reverse direction, and the link mechanism 14 is driven to return the display screen 2 to the initial position. Then, when the touch position of the fingertip 19 enters the area of the next protrusion 34b, the control unit 20 detects this, and similarly moves the display screen 2 to the position shown in FIG. The display screen 2 is lifted.

  In this way, each time the touch position of the fingertip 19 moves from the background area 34 to the areas of the protrusions 34a to 34c, the display screen 2 changes from the initial position to the state shown in FIG. Conversely, every time the touch position of the fingertip 19 moves from the area of the protrusions 34a to 34c to the background area 35, the display screen 2 is moved from the state of FIG. Become. Accordingly, when the fingertip 19 is touched and moved in the arrow Y direction on the display screen 2 shown in FIG. 17A, the display screen 2 is lifted for each of the protrusions 34a, 34b, 34c, and these protrusions 34a, 34b, 34c. Feels like protruding from the screen.

  Note that when the projections 34a to 34c represent recessed portions, the display screen 2 is moved from the initial position to the position shown in FIG. 2C in step 204 of FIG.

  FIG. 17B shows another display example on the display screen 2, and the protrusion 36 displayed here represents a bowl-shaped protrusion. The operation shown in FIG. 16 in this display example will be described.

In the display screen 2 shown in FIG. 17B, when the fingertip 19 is moved from the position S in the background area 35 in the arrow Y direction while touching the touch panel 9 so as to cross the protrusion 36, the fingertip 19 is touched. Before the operation, a series of operations in steps 200 to 202 are repeated. When the fingertip 19 touches the touch panel 9 and pressure P1 ≦ P is detected (step 202), the process proceeds to step 203 and the display screen 2 is displayed as shown in FIG. c)
The initial state shown in FIG.

  When the touch position of the fingertip 19 enters the protrusion 36, the control unit 20 detects this in the same manner as described above, and controls the rotation of the drive motor 11 to drive the link mechanism 14 (step 204). . Here, for the protrusion 36 whose height changes according to such a position, data indicating the relationship between the position and the height is stored in the storage unit 22 (FIG. 6), and the control unit 20 Reads the height data corresponding to the detected touch position from the storage unit 22, and controls the rotation of the drive motor 11 (FIG. 6) according to the height data, so that the drive amount according to the height data is The link mechanism 14 is driven. As a result, as shown in FIG. 17B, the display screen 2 is driven with, for example, a driving amount that changes in an arc shape, and the touch position of the fingertip 19 moves from the peripheral portion of the protrusion 36 toward the central portion. As the display screen 2 at the initial position continuously moves in the direction opposite to the arrow A direction, the display screen 2 is gradually lifted to a state as shown in FIG. 2A, and then the touch position of the fingertip 19 is changed. As it goes from the center to the periphery of the protrusion 36, it continuously moves from the state shown in FIG. 2A in the direction of arrow A, and is gradually lowered to return to the original initial position.

  Since the display screen 2 is continuously driven in accordance with the change in the touch position, the planar display is performed on the protrusions whose height is continuously changed in this way. The protrusions displayed on the screen 2 can also be recognized as protruding sensuously. In this way, it is possible to reliably recognize that the protrusion is touched, and it is possible to reliably know that the user has touched the protrusion but has not actually touched it. It is easy to confirm whether or not the touch is on.

  If it represents a hollow portion recessed in the bowl shape instead of the projection 36, the display screen 2 is moved from the initial state to the state shown in FIG. 2C in step 204 of FIG. Like that. In this case, the same effect as that of the protrusion 36 can be obtained.

  Here, the projection 36 represents a bowl shape, but the height or depth may be arbitrarily changed. For example, the projection 36 may be a map. Even if it is displayed two-dimensionally on the display screen 2, by moving the display screen 2 as described above according to the height of the ground surface, the height can be recognized sensuously. It can be recognized as a three-dimensionally displayed map.

  FIG. 17C shows still another display example on the display screen 2, and the projected portion 37 displayed here represents a flat projection having a large area. The operation shown in FIG. 16 in this display example will be described.

  In the display screen 2 shown in FIG. 17C, when the fingertip 19 is moved from the position S in the background area 35 in the direction of arrow Y while touching the touch panel 9 so as to cross the protrusion 37, the fingertip 19 is touched. 16 is repeated, and when the fingertip 19 touches the touch panel 9 and pressure P1 ≦ P is detected (step 202), the process proceeds to step 203 and the display screen 2 is displayed. Keep the initial position.

  When the touch position of the fingertip 19 enters the protrusion 37, the control unit 20 detects this in the same manner as described above, and controls the rotation of the drive motor 11 to drive the link mechanism 14 (step 204). . Here, for such a large and flat protrusion 37, the storage unit 22 (FIG. 6) moves the display screen 2 from the initial position to the position shown in FIG. When the control unit 20 detects that the touch position of the fingertip 19 is within the area of the projection 37, the control unit 20 reads the data from the storage unit 22 and causes the drive motor 11 to move. Control reciprocating rotation. As a result, the drive motor 11 moves from the initial position in the direction of the position shown in FIG. 2A and then reverses the rotation direction in small increments, thereby driving as shown in FIG. 17C. As the amount changes, the display screen 2 vibrates.

  Of course, when the touch position of the fingertip 19 moves from the background area 35 to the area of the protrusion 37, the display screen 2 is moved from the initial position in the direction of the position shown in FIG. In the case of a wide and flat protrusion 37 as shown in FIG. 2), there is a possibility that the touch position is long in the protrusion 37. In such a case, the protrusion 37 is touched with time. However, it is possible to always recognize that the projection 37 is touched by vibrating the display screen 2 as described above.

  Here, the flat protrusion 37 is taken as an example. However, when the flat protrusion 37 is formed, the display screen 2 is moved from the initial position to the position shown in FIG. To do.

Next, a fourth embodiment of a display device including a touch panel according to the present invention will be described.
In the fourth embodiment, the projection is an operation button in the third embodiment, and an operation for executing the function of these operation buttons is added to the operation of the third embodiment. Is.

  FIG. 18 is a flowchart showing the control operation of the fourth embodiment, and steps 200 to 206 are the same as the operation shown in FIG. 16 of the third embodiment. Here, the protrusions 34a to 34c, 36, and 37 shown in FIG.

  FIG. 19 is a diagram showing the action (reaction) on the display screen with respect to the pressure P in the fourth embodiment.

  In the same figure, a series of operations in steps 200 to 206 are the same as the operations described in FIG. However, although the operation buttons as shown in FIGS. 17A to 17C are displayed on the same display screen 2 here, the operation buttons having different shapes and sizes have different functions and uses.

  As shown in FIG. 16, when the fingertip 19 touches the operation button and the pressure P is P1 ≦ P <P2, the display screen 2 is driven as shown in FIG. ), (B), and (c) operation buttons 34a to 34c, 36, and 37 have different driving methods for the display screen 2 (step 204), and thus the functions and applications of the operation buttons are different. This makes it possible to sensuously recognize that the desired operation button has been touched.

  When the operation button touched with the fingertip 19 is pushed in the above state and the detected pressure P of the pressure sensor at that time becomes P2 ≦ P (step 301), the control unit 20 When the touch position of the fingertip 19 is within the operation button area (step 302), as shown in FIG. 19, the function of this operation button (for example, determination) is executed (step 303). When the pressing of the operation button is finished (step 304), the process returns to step 203 to wait for the next operation.

  In this way, in the fourth embodiment, since the display screen 2 is driven differently depending on the operation button, it can be known by touching which operation button has been touched.

Next, a fifth embodiment of a display device provided with the touch panel according to the present invention will be described.
FIG. 20 is a block diagram showing a fifth embodiment of a display device provided with a touch panel according to the present invention. FIG. 20 (a) is a sectional view, FIG. 20 (b) is a plan view, and 401 is an infrared ray. An optical scanning touch panel, 401a is an infrared light receiving / emitting unit, 402 is a pressure sensor, 403 is a driving device, 404 is a liquid crystal display surface, 405 is a liquid crystal display housing, and 406 is an outer housing.

  In the figure, an infrared light scanning touch panel 401 is provided in a rectangular opening on the upper surface of the outer casing 406. Pressure sensors 402 are disposed at the lower four corners of the touch panel 402, and a driving device is disposed further below the pressure sensor 402. Further, below the touch panel 402, a liquid crystal display 405 is arranged in a direction with the liquid crystal display screen 404 as an upper surface. The user confirms and operates the content displayed on the liquid crystal display screen 404 via the touch panel 402.

The infrared light scanning touch panel 401 has a structure in which an infrared light receiving and emitting unit 401a is disposed around a rectangular touch panel as shown in FIG. In this embodiment, the indication position is detected by an infrared scanning touch panel, and the pressure is detected by a pressure sensor 402.
The pressure sensors 402 are arranged at the four corners below the touch panel and detect in real time the force with which a pointing member such as a finger presses the panel surface. When the pressure detected by each sensor when the finger is not touched is a0, b0, c0, d0, and the pressure detected during operation with the finger is a, b, c, d, the pointing member such as a finger The force P that presses the panel surface can be obtained from the following equation regardless of the indicated position.
P = (a + b + c + d) − (a0 + b0 + c0 + d0)
The driving device 403 is provided further below the pressure sensor 402. In this embodiment, the main purpose is to obtain a feeling of pressing a button, and a driving means with good responsiveness such as a solenoid coil or a voice coil is employed. If the driving range is about 2 mm, the feeling of pressing a button can be obtained. In addition, if the configuration as shown in FIG. 20 is used, the liquid crystal display 405 is fixed and only the touch panel 401 is driven, so that the mass of the driving unit can be reduced and the response of driving is improved. Can do. If the driving range is about 2 mm, the parallax of the content displayed on the liquid crystal display screen is not a problem.
By adopting an infrared light scanning touch panel as the pointing position detection means, the user can cause the touch panel to detect the position by sliding a pointing member such as a finger on the surface of the touch panel 402 without applying force. It is possible to detect the indicated position more easily and accurately. In addition to the infrared light scanning method, the same effect can be obtained by adopting a capacitive touch panel.

  The operation of the display device including the touch panel according to this embodiment will be described with reference to FIGS. FIG. 21 shows an example of a display screen when this apparatus is applied to ATM, and FIG. 22 shows the height of the panel surface of the touch panel 401. 23 to 25 are flowcharts showing the operation of this apparatus.

  In FIG. 23, when the power of this apparatus is turned on and no finger is touched, that is, when the pointing position is not detected by the touch panel 401, a standby state is entered (step 501), and the height of the panel surface is shown in FIG. The height B is controlled (step 503). FIG. 22 shows the height of the panel surface of the touch panel 401 controlled by the driving device 403. In this example, the height L is the upper limit height, 0 is the lower limit height, and these two heights are further increased. It is possible to control the height between three levels A to C. Here, it is determined by the infrared light scanning touch panel 401 whether or not an indicator member such as a finger has touched the panel (step 505). If not touched, the process returns to step 502, and if touched, the indicator member touched. It is determined whether or not the place is on the displayed operation button (step 507). If the touched location is not on the operation button, the process proceeds to (2) shown in FIG. 4. If the touched location is on the operation button, the function of the button is read out by voice (step 509). In this state, it is determined whether or not the pointing member such as a finger has moved on the touch panel 401 and moved out of the operation button area (step 511). Control is made to a low height C (step 513), and the process proceeds to (3) shown in FIG. 25, and if it does not come off, it is determined whether or not the pressing force P by the indicating member is a predetermined value or more (step 515). . In step 513, when the indicated position deviates from the operation button, the operator feels that the position indicated by the operator is not the operation button by controlling the height of the panel surface one step lower. Can do. For this reason, it is possible to easily and surely grasp that the pointing position is out of the operation button even for a visually impaired person or a user who is unfamiliar with the operation. If the pressing force P is not equal to or greater than the predetermined value in step 515, it is determined whether or not the finger is released from the touch panel 401 (step 517). If not, the process returns to step 511. Return to standby. If the pressing force P is greater than or equal to the predetermined value in step 515, the panel surface of the touch panel 401 is controlled to the height C (step 519) and the function of the operation button is executed (step 521). Here, when the function of the operation button is executed, the height of the panel surface is set to a height C that is one step lower, so that the user can feel as if the operation button has been pressed, and the operation has been executed. Can be grasped as a tactile sense. Thereafter, it is determined whether or not the pressing force P has become a predetermined value or less (step 523). If the pressing force P has become a predetermined value or less, the panel surface is controlled to the original height, that is, the height B (step 525). Return to 505.

  Next, the operation flow (2) shown in FIG. 24 will be described. In the above-described step 507, if the pointing position by the pointing member such as a finger is not on the operation button, it is determined whether or not the finger has moved on the panel and entered the operation button (step 527). If it does not enter the operation button, it is determined whether or not a finger or the like has been removed from the panel (step 529). If it has left, the process returns to the standby state of step 501, and if not, the process returns to step 527. Here, when the designated position is not on the operation button, it is possible that the user is visually impaired or is extremely unfamiliar with the operation. For example, as shown in FIG. 21, when the operation button group is part of the display screen, when the area 601 to 603 away from the operation button is indicated, It is also effective to guide the indicated position onto the operation button group by reading out a voice guidance such as “ As a result, a visually handicapped person or a user unfamiliar with the operation can search for an operation button more quickly and easily. The areas 601 to 603 do not have a function as an operation button, but when the area is designated, guidance and advice regarding the operation are read out by voice. Also, instead of voice guidance, when this area is designated, the panel can be vibrated in small increments to notify that the user is away from the operation button. Returning to step 527, when a finger or the like moves on the panel and enters the operation button, the height of the panel surface of the touch panel 401 is controlled to a height A higher than before (step 531). The button function is read aloud (step 533). Thereafter, it is determined whether or not a finger or the like has moved on the panel and removed from the operation button (step 535). If the finger or the like has been removed, the height of the panel surface of the touch panel 401 is controlled to the original height B. (Step 537) Return to step 527. If the finger or the like cannot be removed from the operation button, it is determined whether or not the pressing force P is greater than or equal to a predetermined value (step 539), and if it is not greater than or equal to the predetermined value, it is determined whether or not the finger is released from the panel. (Step 541), if not leaving, return to Step 535, otherwise return to the standby state of Step 501. If the pressing force P is greater than or equal to the predetermined value in step 539, the height of the panel surface of the touch panel 401 is controlled to B lower by one level (step 543) and the function of the operation button is executed (step 545). Here, when the function of the operation button is executed, the height of the panel surface is set to a height B that is one step lower, so that the user can feel as if the operation button has been pressed, and the operation has been executed. Can be grasped as a tactile sense. As a result, it is possible to easily notify the visually impaired person or the user unfamiliar with the operation of the touch panel who has a high probability of following the progress of the operation flow (2) that the operation has been executed. Thereafter, it is determined whether or not the pressing force P has become a predetermined value or less (step 547). If the pressing force P has become a predetermined value or less, the panel surface is controlled to the original height, that is, the height A (step 549). Return to 533.

  Next, the operation flow (3) shown in FIG. 25 will be described. In the above-described step 511, when the pointing position by the pointing member such as a finger moves on the panel and comes off the operation button, the panel surface is controlled to the original height C (step 513) and the finger or the like moves on the panel. It is determined whether it has moved and entered the operation button (step 551). If it does not enter the operation button, it is determined whether or not a finger or the like has been removed from the panel (step 553). If it has left, the process returns to the standby state of step 501, and if not, the process returns to step 551. In step 551, when a finger or the like moves on the operation button and enters the operation button, the height of the panel surface of the touch panel 401 is controlled to a height A higher than before (step 555). Is read out by voice (step 557). Thereafter, it is determined whether or not a finger or the like has moved on the panel and removed from the operation button (step 559). If the finger or the like has been removed, the height of the panel surface of the touch panel 401 is controlled to the original height B. (Step 561) Return to step 527. If the finger or the like cannot be removed from the operation button, it is determined whether or not the pressing force P is greater than or equal to a predetermined value (step 563), and if it is not greater than or equal to the predetermined value, it is determined whether or not the finger is released from the panel. (Step 565), if not leaving, return to Step 559, otherwise return to the standby state of Step 501. If the pressing force P is greater than or equal to the predetermined value in step 563, the height of the panel surface of the touch panel 401 is controlled to B that is one step lower than before (step 567) and the function of the operation button is executed (step 569). Here, when the function of the operation button is executed, the height of the panel surface is set to a height B that is one step lower, so that the user can feel as if the operation button has been pressed, and the operation has been executed. Can be grasped as a tactile sense. As a result, it is possible to easily notify a visually impaired person or a user unfamiliar with the operation of the touch panel who has a high probability of following the progress of the operation flow (3) that the operation has been executed. Thereafter, it is determined whether or not the pressing force P has become a predetermined value or less (step 570). If the pressing force P has become a predetermined value or less, the panel surface is controlled to the original height, that is, the height A (step 581). Return to 557.

In the description of the operation flow described above, it has been explained that the height of the panel surface of the touch panel 401 is controlled in three stages of A, B, and C. This is based on the assumption that the operation buttons are all at the same height. This is an example of driving. In this case, at least three steps of height setting are required. In addition, it is possible to change the assumption of the height depending on the type of the operation button. For example, the decision button is made higher than the number buttons. When a plurality of heights are assumed, control of the panel surface requires four or more steps.
If the control of the height of the panel surface is relative, it is possible to express the position of the operation button and the execution of the function. Therefore, for example, when the panel surface is controlled to the height A indicating that the operation button has been touched in step 531, the function is executed and the panel surface is controlled to a low position (step 543). It is not necessary to control the height B, and the height can be set to an arbitrary height lower than the height A and up to the height 0 of the lowest limit of the height control.

  In this embodiment, when the touch panel is first touched, the panel surface is controlled to the same height (height B) regardless of whether the indicated position is on the operation button or other place. (Step 503). That is, if the operation button is instructed from the beginning and executed as it is, the touch of the panel can be controlled to a position lower than the initial height, and the touch can be obtained. If you point on the button, the panel surface is controlled to a position higher than the initial height, and you can feel as if the operation button is protruding. In this way, the height of the panel surface is controlled based on the position touched first, so that the panel surface is not controlled to a high position as soon as the operation button is first touched. The panel surface height can be controlled with little discomfort for the user.

  Furthermore, when there is a pointing member such as a finger on the operation button, the function is executed by applying a pressing force of a predetermined value or more. However, the predetermined value of the pressing force can be changed depending on the type of the operation button. Is possible. For example, when the enter button is pressed, the predetermined value is made larger than when the number button is pressed, and only when the button is pressed more strongly, it is executed.

  According to the embodiment described above, for example, it is possible to realize an operation of a touch panel that does not depend on vision by a visually impaired person or the like.

  When the visually impaired person operates the touch panel, for example, the surface of the touch panel is touched with one finger, and the finger is slid over the entire screen so as to scan the touch panel surface with the finger. According to the present embodiment, the driving device works at the moment when the finger gets on the operation button from the area without the operation button, the height of the entire screen becomes a predetermined height (step 531), and the function of the operation button Is read out by voice (step 533). When the operation button is released, the original height is instantaneously restored (step 537). In this way, while searching for a desired operation button, that is, only touching the screen, the function of the operation button is not executed. When the panel surface is pressed with a pressing force equal to or greater than a predetermined value while the finger is placed on the operation button, the drive device operates, the height of the entire screen is lowered to a predetermined height (step 543), and the operation button The function is executed (step 545). At this time, it may be notified by voice that the function has been executed. After the execution, when the finger is removed, the driving device returns the panel surface to the original height (step 549).

  As described above, the position of the operation button and the function thereof are guided by the driving of the screen and the voice, so that the touch panel operation that does not depend on the sight can be realized.

  When a visually handicapped person or a user unfamiliar with touch panel operation operates, it is conceivable that a plurality of locations are instructed at the same time. If a touch panel that can recognize that there are multiple instructions, such as infrared scanning and ultrasonic, is used, for example, “Please operate with one finger.” Can provide voice guidance. Further, when instructions at a plurality of locations continue, it is possible to take a countermeasure such as making the explanation by voice more easy to understand.

  Also, if you do not want others to hear the voice you read out, such as touching an operation button that represents a number when entering a PIN or amount, the screen will be reduced by the number of times instead of reading it out. It is possible to take a method such as vibrating.

It is a block diagram which shows 1st Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows operation | movement of the moving mechanism in FIG. It is a figure which shows roughly the other specific example of the display means which has a moving mechanism in 1st Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows the state of the fingertip with respect to the touch panel in FIG. It is a figure which shows determination of the state of the fingertip shown in FIG. 4 with respect to the pressure which a pressure sensor detects. It is a block diagram which shows the principal part of the specific example of the circuit structure in embodiment shown in FIG. It is a figure which shows the drive amount of the display screen with respect to the detection pressure of the pressure sensor in 1st Embodiment shown in FIG. It is a flowchart which shows the 1st specific example of the function control of the control part in FIG. It is a figure which shows the specific example of the screen displayed on the display surface in FIG. 1 by the operation | movement shown in FIG. It is a figure which shows the other specific example of the screen displayed on the display surface in FIG. 1 by the operation | movement shown in FIG. It is a figure which shows a screen when the 1st Embodiment of this invention is used as the display apparatus of ATM, and the example of a screen shown in FIG.9 and FIG.10 is used for this. It is a figure which shows another screen when the 1st Embodiment of this invention is used as the display apparatus of ATM, and the example of a screen shown in FIG.9 and FIG.10 is used for this. It is a figure which shows the display screen of 2nd Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows one specific example of the operation | movement and screen of ATM using the 2nd Embodiment of this invention. It is a figure which shows the other example of the operation | movement of ATM using the 2nd Embodiment of this invention, and a screen. It is a flowchart which shows the control operation of 3rd Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows the example of a screen in the display screen in the operation | movement shown in FIG. It is a flowchart which shows the control operation of 4th Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows the effect | action (operation | movement) with respect to the display screen with respect to the detected pressure in the operation | movement shown in FIG. It is a block diagram which shows 5th Embodiment of the display apparatus provided with the touchscreen by this invention. It is a figure which shows the example of a display screen when the apparatus shown in 5th Embodiment is applied to ATM. It is a figure which shows the height of the panel surface of the touchscreen shown in 5th Embodiment. It is a flowchart which shows operation | movement of the apparatus shown in 5th Embodiment. It is a flowchart which shows operation | movement of the apparatus shown in 5th Embodiment. It is a flowchart which shows operation | movement of the apparatus shown in 5th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Case 1a Opening 2 Display screen 8 Display panel 8a Display surface 9 Touch panel 10, 10a, 10b Support member 11 Drive motor 12 Rotating gear 13 Spur gear 14 Link mechanism 14a, 14b Link 14c, 14d Support member 15, 16 Tension spring 17 Projection device 18 Mirror 19 Fingertip 20 Control unit 21 Speaker 22 Storage unit 23 Vibrating unit 24, 24a-24c Operation button 25 Shadow unit 26 Balloon 27 Guidance message 28 Enlarged display area 29 Menu column 30 Cursor 31 ATM
32,33 Shadow part 34a-34c Protrusion part 35 Background area 36,37 Protrusion part.

Claims (5)

  In a display device provided with a touch panel provided with a touch panel for detecting a touch position of an instruction unit on a display screen of a display panel, and capable of touching and operating a touch operation member displayed on the display screen, the touch operation member Detecting means for detecting a pressing force P by the instruction means when touching the touch panel, and an area where the touch operation member is displayed from a state where the instruction means touches an area where the touch operation member is not displayed. When the touched state is reached, the display screen is moved to a predetermined first height, and the pressing force P is determined in a state where the instruction means touches the area where the touch operation member is displayed. A control unit that performs a process of moving the display screen to a predetermined second height and executes the function of the touch operation member when the value is equal to or greater than the value. Display device having a touch panel, characterized in that.   The first height is a height relatively higher than a height immediately before the display screen, and the second height is relatively higher than a height immediately before the display screen. The display device having a touch panel according to claim 1, wherein the display device has a low height.   The control unit displays the display screen in a predetermined state when the instruction unit has changed from a state where the touch operation member is displayed to a state where the touch operation member is not displayed. 3. The process according to claim 1, wherein the third height is relatively lower than a height immediately before the display screen. A display device with a touch panel.   The said control part performs the process which emits the sound showing the function of the said touch operation member, when the said instruction | indication means is the state which touched the area | region where the said touch operation member is displayed. A display device comprising the touch panel according to claim 3. The control unit performs a process of generating sound or vibration for informing a location of the touch operation member when the instruction unit is in a state of touching a predetermined area other than the area where the touch operation member is displayed. A display device comprising the touch panel according to claim 1.

Images