JP2013134722A - Operation input system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation input system that enables operation input more reliable than before without gazing at a display screen.SOLUTION: An operation input system comprises: a touch pad 10 that detects a detection object D in contact with or in proximity to an operation surface 11a to receive an input corresponding to the detection position; protrusion members 20 that are provided to be each independently protrudable from the operation surface 11a; a protrusion control unit that controls the protrusion height of each of the protrusion members 20; and a display device 40 that displays an image on a display screen 41. The protrusion control unit forms a frame-shaped protrusion part 25 with a plurality of protruding tip parts at a coordinate on the operation surface 41 corresponding to the coordinate of an operation mark 44 displayed on the display screen 41, and sets the protrusion height of each of protrusion members 20f composing the frame-shaped protrusion part 25 and an in-frame protrusion member 20i positioned in an in-frame region I in accordance with the content of the operation mark 44.

Description

  The present invention relates to an operation input system including a touch pad as a pointing device.

  For example, in a notebook personal computer or the like, a device equipped with an operation input system having a touch pad as a pointing device as a standard is used. An operation cursor displayed on a display screen connected to the touch pad so as to be able to transmit information by sliding the fingertip or the stylus pen tip on the operation surface provided on the touch pad surface. Move. Further, for example, by performing a predetermined operation on the operation surface with the operation cursor displayed on the display screen over an operation mark (for example, an operation button or an operation icon), the function associated with the operation mark is displayed. make it happen. The operation input system provided with such a touchpad can also be used for performing predetermined operation input to an in-vehicle terminal device (hereinafter also referred to as “navigation device”) in the navigation system.

  By the way, the navigation device is often operated by the driver of the vehicle. In such a case, since the user (vehicle driver) operates the navigation device between driving, it is difficult to perform the operation while paying attention to the display screen, and to perform the desired operation accurately. May not be possible. In view of such a point, an operation input system has been proposed in which operation input can be performed without using a tactile sensation (tactile sensation) without gazing at a display screen. For example, in Japanese Patent Laid-Open No. 2006-268068 (Patent Document 1), the entire operation surface is covered with fiber hairs, and fiber hairs located on the operation surface corresponding to the position of the operation mark displayed on the display device are raised. Techniques for making them disclosed are disclosed.

  However, in the system of Patent Document 1, the entire operation surface is covered with fiber hairs, and ambiguity remains in the tactile discrimination between fiber hairs that are raised and fiber fibers that are not. In this respect, the conventional operation input system has room for improvement.

JP 2006-268068 A

  Therefore, it is desired to realize an operation input system that can perform more reliable operation input than before without paying attention to the display screen.

  The feature configuration of the operation input system according to the present invention includes an operation plate having an operation surface formed on the front surface, detects an object to be detected that is in contact with or close to the operation surface, and receives an input corresponding to the detection position. A touch pad, a plurality of projecting members arranged in a predetermined rule along the operation surface, and penetrating the operation plate so as to protrude independently from the operation surface, and the operation surface A protrusion control unit that controls the protrusion height of each of the protrusion members, and a display device that has a display screen and displays an image on the display screen, the protrusion control unit including the coordinates of the display screen and the display screen When a specific operation mark is displayed on the display screen in association with the coordinates of the operation surface, a plurality of protrusions protruding from the operation surface to the coordinates on the operation surface corresponding to the coordinates of the operation mark The protrusion A frame-shaped frame-like protruding portion is formed by a protruding tip portion group consisting of the protruding tip portions, and a plurality of protruding members constituting the frame-shaped protruding portion and an in-frame region surrounded by the frame-like protruding portions The in-frame protruding member, which is the positioned protruding member, is protruded according to the contents of the operation mark.

  According to this characteristic configuration, it is possible to input a predetermined operation to another device connected so as to be able to transmit information in accordance with the detection position of an object to be detected that is in contact with or close to the operation surface of the touchpad. At this time, a plurality of projecting members arranged in accordance with a predetermined rule along the operation surface are provided so as to be able to project from the operation surface through the operation plate on the front surface of the touch pad. Are controlled independently. When the height of the tip is less than or equal to the operation surface, the peripheral part of the operation surface is flat, whereas when the height of the tip is higher than the operation surface, the tip is at the user's fingertip, etc. Can directly recognize tactile sensation. Therefore, the protrusion control unit associates the coordinates of the display screen with the coordinates of the operation surface, and the coordinates on the operation surface corresponding to the coordinates of the operation mark displayed on the display device are changed to the frame shape by the protrusion tip group. A frame-like protrusion is formed. As a result, the user can easily associate the position of the operation mark on the display screen with the position of the frame-like protrusion on the operation surface recognized by tactile sense, and easily select the desired operation mark. Can do. In addition, since each of the projecting members constituting the frame-shaped projecting portion and the projecting members in the frame is projected according to the contents of the operation mark, it is desired from this point also based on information perceived about these projecting modes. The operation mark can be easily selected. Therefore, it is possible to provide an operation input system capable of performing more reliable operation input than in the past without paying attention to the display screen.

  Here, the protrusion control part is formed by a plurality of protrusion members constituting the frame-like protrusion part, protrusion heights of the in-frame protrusion members, and protrusion tip parts of the plurality of in-frame protrusion members. It is preferable to set the shape according to the contents of the operation mark.

  According to this configuration, the projection height of each of the projecting member and the in-frame projecting member constituting the frame-shaped projecting portion is set according to the contents of the operation mark. Based on this, a desired operation mark can be easily selected. In addition, since the shape formed at the protruding tip of the in-frame protruding member is also set according to the contents of the operation mark, it is easy to select the desired operation mark based on the sensed information about the shape. be able to. Furthermore, a desired operation mark can be easily selected based on a combination of information sensed about them. Therefore, more reliable operation input can be performed.

  In addition, it is preferable that the protrusion control unit makes the protrusion height of the frame-shaped protrusion different from the protrusion height of the in-frame protrusion member.

  According to this structure, these can be easily distinguished based on the difference of each protrusion height of a frame-shaped protrusion part and an in-frame protrusion member. Therefore, the boundary of the operation area (in-frame area) on the operation surface corresponding to the operation mark displayed on the display screen can be easily distinguished from the portion represented by the in-frame protruding member.

  The protrusion control unit can set a plurality of types of combinations of protrusion heights of the frame-shaped protrusion and one or more in-frame protruding members according to the contents of the plurality of types of operation marks. Is preferable.

  According to this configuration, different patterns are assigned to all specific operation marks displayed on the display screen with respect to combinations of the protruding heights of the frame-shaped protruding portions and the protruding heights of the in-frame protruding members. Can do. Therefore, the user can select the desired operation mark even when the number of operation marks is large, based on the combination of the protrusion height of the frame-like protrusion that is recognized by tactile sense and the protrusion height of each protrusion member in the frame. Easy to choose. In addition, since the three-dimensionally different shapes can be represented on the operation surface by making the protrusion heights different from each other, even if the number of protruding members arranged along the operation surface is relatively small, Different patterns can be assigned to operation marks.

  Further, when an input is received by the touchpad in the in-frame area in accordance with a pressing operation in which the protruding member protruding from the operation surface is pushed into the operation surface side, the position corresponds to the position of the in-frame area. A selection operation determination unit that determines that the operation mark selection operation has been performed, and the selection operation determination unit pushes in a case where input is received by the touchpad in a plurality of different in-frame regions. It is preferable to determine that there has been an operation for selecting the operation mark corresponding to the position of the in-frame region with the larger number of operated protruding members.

According to this configuration, there is an operation mark selection operation corresponding to the position of the in-frame area based on the input of the touch pad in the in-frame area using the function of the touch pad. Can be determined appropriately.
By the way, when the input with a touchpad is received in the area | region in a frame, possibility that a protrusion member will be pushed in with it is high. In this case, for the sake of convenience, it is considered that the large number of protruding members that are pushed in reflects the user's willingness to select an operation mark corresponding to the in-frame region. Can do. According to the above configuration, even when input is received by the touchpad in a plurality of different frame areas, one operation mark that is considered to be suitable for the user's intention is specified. be able to.

  In addition, when the number of the protruding members that have been pushed in a plurality of the in-frame regions is equal, the selection operation determining unit determines whether the detection position of the detected object is relative to a reference point in the in-frame region. It is preferable to determine that there has been an operation for selecting the operation mark corresponding to the position of the closer area in the frame.

  The degree of proximity between the detection position of the object to be detected and the reference point of the in-frame area when input from the touch pad is accepted is the strength of the user's intention to select an operation mark corresponding to the in-frame area It can be thought that it reflects. According to said structure, even if it is a case where the number of the protrusion members in which the pushing operation was made in several in-frame area | regions is equal, the operation mark considered to be suitable for a user's intention is specified as one. can do.

It is a schematic diagram which shows the mounting state to the vehicle of the operation input system. It is a block diagram which shows schematic structure of a navigation apparatus. It is a block diagram which shows schematic structure of an operation input system. It is a perspective view of the touchpad with which an operation input device is equipped. It is sectional drawing which shows the structure of a drive mechanism. It is a figure which shows an example of the operation input using an operation input system. It is a figure which shows an example of the operation input using an operation input system. It is a figure which shows an example of the operation input using an operation input system. It is a figure which shows an example of the operation input using an operation input system. It is a flowchart which shows the whole process sequence of an operation input reception process. It is a flowchart which shows the process sequence of a 1st protrusion height determination process. It is a flowchart which shows the process sequence of a 1st input determination process. It is a flowchart which shows the process sequence of an operation mark specific process. It is a flowchart which shows the process sequence of a 2nd protrusion height determination process. It is a flowchart which shows the process sequence of a 2nd input determination process. It is a figure which shows another Example of the operation input using an operation input system. It is a figure which shows another Example of the operation input using an operation input system.

  An embodiment of an operation input system according to the present invention will be described with reference to the drawings. In the present embodiment, an operation input system 3 for performing a predetermined (predetermined) operation input to the navigation system (in this example, the vehicle-mounted navigation device 1) will be described as an example. The operation input system 3 includes a display input device 40 and an operation input device 4 which are connected to the navigation device 1 so as to be able to transmit information. Hereinafter, the schematic configuration of the navigation device 1, the schematic configuration of the operation input device 4, the configuration of the operation input system 3, and the procedure of the operation input reception process will be described in this order.

1. Schematic Configuration of Navigation Device A schematic configuration of the navigation device 1 will be described with reference to FIG. 1 and FIG. The navigation device 1 is configured to be able to realize basic functions such as display of a vehicle position, route search from a departure place to a destination, route guidance, and destination search. Therefore, the navigation apparatus 1 is provided with the control calculating part 6 as shown in FIG. The control arithmetic unit 6 includes an arithmetic processing unit such as a CPU as a core member, and is implemented by hardware and / or software (program) or both as a functional unit for performing various processes on input data. It is configured. The control calculation unit 6 includes a navigation calculation unit 70. The control calculation unit 6 is connected to the GPS receiver 81, the direction sensor 82, the distance sensor 83, the map database 85, the display input device 40, the touch pad 10, the voice input device 87, and the voice output device 88 so as to be able to transmit information. Has been.

  The GPS receiver 81 receives a GPS signal from a GPS (Global Positioning System) satellite. The direction sensor 82 detects the traveling direction of the host vehicle or its change. The distance sensor 83 detects the vehicle speed and travel distance of the host vehicle. As is well known, the navigation calculation unit 70 is based on information obtained from the GPS receiver 81, the azimuth sensor 82, and the distance sensor 83, and further based on known map matching. Can be derived.

  The map database 85 stores map data divided for each predetermined section. The map data includes road network data configured by a connection relationship between a plurality of nodes corresponding to intersections and a plurality of links corresponding to roads connecting the nodes. Each node has position information on the map expressed by latitude and longitude. Each link has information such as road type, link length, and road width as attribute information. The map database 85 is referred to by the navigation computing unit 70 when executing processing such as map display, route search, and map matching. The map database 85 is provided by being stored in a storage medium such as a hard disk drive, a flash memory, or a DVD-ROM.

  The display input device 40 is a combination of a display device such as a liquid crystal display device and an input device such as a touch panel. The display input device 40 has a display screen 41 and displays an image such as a map around the vehicle position and an operation mark 44 (see FIG. 6) associated with a predetermined function on the display screen 41. In the present embodiment, the display input device 40 corresponds to the “display device” in the present invention. Here, the operation mark 44 is operated by the touch panel or the touch pad 10, and when the operation input is transmitted to the navigation device 1 to realize a specific function, the user (here, a vehicle occupant) performs the function. It is a mark displayed on the display screen 41 so that it can be easily perceived. Such an operation mark 44 includes, for example, operation icons, operation buttons, character keys and the like drawn by an illustration or the like. The display input device 40 detects an object to be detected that is in contact with or close to the touch panel and receives an input corresponding to the detection position. For example, the user selects and associates the operation mark 44 with the fingertip or the stylus pen tip as an object to be detected displayed on the display screen 41 so as to contact or approach the operation mark 44. Functions can be realized. In addition, the user can perform, for example, point selection on a map by bringing the detected object into contact with or approaching a position other than the operation mark 44 displayed on the display screen 41.

  As shown in FIG. 1, the touch pad 10 is provided separately from the display input device 40. The touch pad 10 has an operation surface 11a composed of a single plane, detects an object D (see FIG. 6) that is in contact with or close to the operation surface 11a, and receives an input corresponding to the detected position. An operation cursor 45 (see FIG. 6) is displayed on the display screen 41 in correspondence with the detection position detected by the touch pad 10 as a pointing device. The user moves the operation cursor 45 on the display screen 41 by sliding a fingertip or the like as the detected object D in contact with or close to the operation surface 11a. Then, by performing a predetermined operation on the operation surface 11a in a state where the operation cursor 45 coincides with the operation mark 44, it is possible to select the operation mark 44 and realize a function associated therewith. In addition, the user can perform, for example, point selection on a map by performing a predetermined operation on the operation surface 11a in a state where the operation cursor 45 is at a position other than the operation mark 44 displayed on the display screen 41.

  It should be noted that the display input device 40 is disposed at a position where it can be seen without greatly changing the line-of-sight direction during driving so that it can be easily seen by the user (in particular, the driver of the vehicle here). In the example shown in FIG. 1, the display input device 40 is arranged at the center of the upper surface of the dashboard, but may be arranged at the position of the instrument panel or the like. On the other hand, the touch pad 10 is disposed at a position close to the user's hand so that the user can easily operate. That is, the touch pad 10 is disposed at a position closer to the user's hand than the display input device 40 and far from the line-of-sight direction. In the example shown in FIG. 1, the touch pad 10 is disposed in the center console portion, but may be disposed in the center portion of the upper surface of the dashboard, the spoke portion of the steering wheel, the door panel, or the like.

  The voice input device 87 receives voice input from the user. The voice input device 87 includes a microphone and the like. Based on the voice received by the voice input device 87, the navigation calculation unit 70 can realize functions such as destination search by voice recognition and hands-free calling. The audio output device 88 includes a speaker and the like. The navigation calculation unit 70 can realize a function such as voice guidance via the voice output device 88.

2. Configuration of Operation Input Device As shown in FIGS. 3 to 5, the operation input device 4 includes a touch pad 10, a protruding member 20, and a drive mechanism 30. In general, the operation input device 4 is configured such that the protruding member 20 driven by the driving mechanism 30 can protrude from the surface of the touch pad 10 (can be moved in and out).

  As shown in FIGS. 4 and 5, the touch pad 10 has an operation plate 11, and an operation surface 11 a is formed on the front surface of the operation plate 11. As such a touch pad 10, various types such as a resistance film type and a capacitance type can be used. In this example, a capacitance type is adopted. A substrate and an electrode layer are provided on the back side of the operation surface 11a. The touch pad 10 detects a fingertip or the like as the detected object D that is in contact with or close to the operation surface 11a and receives an input corresponding to the detected position.

  The operation plate 11 is provided with a hole 12 that penetrates the operation plate 11. In the present embodiment, a plurality (a large number) of such hole portions 12 are provided. The plurality of holes 12 are arranged according to a predetermined rule along the operation surface 11a. In this example, the plurality of hole portions 12 are regularly arranged at regular intervals vertically and horizontally across the entire operation surface 11a, and are arranged in a matrix (orthogonal lattice shape) as a whole. Each hole 12 is formed in a circular shape when viewed from the front of the operation plate 11.

  Projecting members 20 are inserted into the respective holes 12. Therefore, in this example, a plurality (a large number) of projecting members 20 are also provided, and specifically, the same number of projecting members 20 as the hole portions 12 are provided. The plurality of projecting members 20 are arranged in a predetermined rule along the operation surface 11a. In this example, the plurality of protruding members 20 are regularly arranged at regular intervals in the vertical and horizontal directions over the entire operation surface 11a, and are arranged in a matrix as a whole.

  As shown in FIG. 5, the protruding member 20 includes an elongated columnar (pin-shaped) pin member 21 and a cylindrical member 22 that is generally cylindrical. The outer diameter of the pin member 21 is slightly smaller than the inner diameter of the hole 12. The pin member 21 is locked to the cylindrical member 22 at its lower end. In this example, the tip end (upper end) of the pin member 21 is inserted into each hole 12. In the reference state where the protruding member 20 is not driven by the drive mechanism 30 (the state on the left side in FIG. 5), the tip portion (tip surface) of the flatly formed pin member 21 matches the level of the operation surface 11a. Yes.

  As shown in FIG. 5, a drive mechanism 30 is provided on the back side of the operation plate 11. The drive mechanism 30 is a mechanism for moving the protruding member 20 forward and backward along a direction intersecting (orthogonal in this example) with respect to the operation surface 11a (referred to as a “projection direction Z”). The drive mechanism 30 includes a piezoelectric element 31.

  The piezoelectric element 31 is a passive element using a piezoelectric effect, and converts a voltage applied to the piezoelectric body into a force, or converts an external force applied to the piezoelectric body into a voltage. The piezoelectric element 31 is provided so as to vibrate in the protruding direction Z. A connecting member 33 is connected to the piezoelectric element 31, and the connecting member 33 vibrates integrally with the piezoelectric element 31. The connecting member 33 is formed in an elongated cylindrical shape (pin shape). The distal end portion of the connecting member 33 opposite to the side connected to the piezoelectric element 31 is inserted into the space inside the cylindrical member 22. The outer diameter of the connecting member 33 is substantially equal to the inner diameter of the cylindrical member 22, and the outer peripheral surface of the connecting member 33 and the inner peripheral surface of the cylindrical member 22 are in contact with each other.

  A spring member 34 is provided so as to surround the tubular member 22 from the outer peripheral side at a contact position where the connecting member 33 and the tubular member 22 come into contact with each other. The spring member 34 provides a preload having a predetermined size toward the inner peripheral side, and generates a predetermined frictional force between the connecting member 33 and the cylindrical member 22 constituting the protruding member 20. The preload applied by the spring member 34 is set so that the static frictional force between the connecting member 33 and the cylindrical member 22 is at least greater than the component force in the protruding direction Z of gravity acting on the protruding member 20. Further, the preload is set so that these can slide in a state in which a dynamic friction force is generated between the connecting member 33 and the cylindrical member 22 due to the vibration of the piezoelectric element 31.

  In the present embodiment, the magnitude relationship between the vibration speed to one side and the vibration speed to the other side along the protrusion direction Z of the piezoelectric element 31 is the protrusion control unit 53 (included in the operation input calculation unit 50 described later). (See FIG. 3). More specifically, the vibration speed toward the projecting direction side (front side from the operation surface 11a) is made smaller than the vibration speed toward the buried direction side (back side from the operation surface 11a), which is the anti-projection direction side. Thus, the protruding member 20 moves to the protruding direction side based on the difference between the static friction and the dynamic friction generated between the connecting member 33 and the cylindrical member 22. Thereby, the front-end | tip part of the protrusion member 20 (pin member 21) protrudes to the front side rather than the operation surface 11a. In other words, the protruding member 20 can be in a state (protruding state) where the tip end portion penetrates the operation plate 11 and protrudes to the front side from the operation surface 11a. This protruding state is a state in which the height of the tip portion of the protruding member 20 along the protruding direction Z is higher than that of the operation surface 11a. In the following, the leading end portion of the projecting member 20 in the projecting state on the projecting direction side is referred to as a “projecting tip portion 23”.

  On the other hand, the protrusion member 20 moves to the burying direction side by making the vibration speed in the burying direction side smaller than the vibration speed in the protrusion direction side. That is, the protruding member 20 can be in a state where the tip end is buried on the back side from the operation surface 11a (an embedded state). The “embedded state” includes a state in which the tip of the pin member 21 of the projecting member 20 matches the level of the operation surface 11a. This buried state is a state in which the height of the tip of the protruding member 20 along the protruding direction Z is equal to or less than the operation surface 11a.

  In the present embodiment, the drive mechanism 30 can cause each projecting member 20 to project at an arbitrary projecting height (projection amount). The drive mechanism 30 is configured to be able to change the protruding height of the protruding member 20 in a stepwise manner. Such a configuration can be realized, for example, by including a movement restricting mechanism (not shown) that restricts the movement of the protruding member 20 toward the protruding direction at an arbitrary position among a plurality of different positions.

  As described above, the plurality of projecting members 20 can be independently moved between the projecting state and the buried state by the drive mechanism 30. And the unevenness | corrugation of arbitrary shapes can be expressed with many protrusion members 20 provided in the whole operation surface 11a so that it can protrude and retract.

3. Configuration of Operation Input System As shown in FIG. 3, the operation input system 3 includes the above-described operation input device 4, a display input device 40, and an operation input calculation unit 50 interposed therebetween. In this embodiment, the operation input calculating part 50 is incorporated and mounted in the control calculating part 6 which comprises the navigation apparatus 1 (refer FIG. 2). However, the present invention is not limited to this configuration, and the operation input calculation unit 50 may be provided independently of the control calculation unit 6. The operation input device 4 and the display input device 40 are connected via an operation input calculation unit 50 so that information can be transmitted.

  The operation input calculation unit 50 includes a drawing control unit 51, a status determination unit 52, a protrusion control unit 53, a position detection unit 54, a state detection unit 55, and an operation determination unit 56.

  The drawing control unit 51 performs drawing control of a display image on the display screen 41. The drawing control unit 51 generates a plurality of layers including image images such as backgrounds, roads, and names around the vehicle position. In addition, the drawing control unit 51 includes a layer that includes an image of the vehicle position mark that represents the current position of the host vehicle, and a layer that includes an image of a guide route to the destination when the destination is set. Generate. Further, the drawing control unit 51 generates a layer including an image image of the predetermined operation mark 44 and a layer including an image image of the predetermined operation cursor 45. Then, the drawing control unit 51 superimposes these layers to generate one display image image, and displays it on the display screen 41 (see FIGS. 6 to 8).

  Here, the drawing control unit 51 displays the operation mark 44 on the display screen 41 in accordance with a request from the user, a traveling state of the vehicle, or the like. The drawing control unit 51 appropriately switches display / non-display of various operation marks 44 according to the situation. FIG. 6 shows an example in which operation buttons (in the illustrated example, a wide area button and a detail button) for specifying a change in the scale of the map image are displayed as such an operation mark 44. . FIG. 7 shows an example in which an operation slider for specifying a change in the scale of a map image is displayed as a kind of operation mark 44. The drawing control unit 51 can redraw the map image by regenerating the layer including the road image image according to the scale designated by the operation buttons, the operation slider, and the like. Thereby, the display input device 40 can switch the display of the map image according to the designated scale.

  In addition, the drawing control unit 51 switches display / non-display of the operation cursor 45 as appropriate according to a request from the user. In the present embodiment, the drawing control unit 51 hides the operation cursor 45 when the contact or proximity of the detected object D to the operation surface 11a is not detected. On the other hand, when the contact or proximity of the detected object D to the operation surface 11a is detected, the drawing control unit 51 has a position on the display screen 41 corresponding to the detection position on the operation surface 11a. In this example, a circular operation cursor 45 is displayed. In this example, the operation cursor 45 is displayed so that the detection position matches the center position of the operation cursor 45. When the detection object D slides in a state where it is in contact with or close to the operation surface 11a and the detection position also slides, the displayed operation cursor 45 moves on the display screen 41 in synchronization therewith.

  The status determination unit 52 determines a protrusion status representing a protruding state for each of the protruding members 20 according to the image content displayed on the display screen 41. The protrusion status is arbitrarily set between the “minimum displacement state” and the “maximum displacement state”. The “minimum displacement state” is a state in which the protruding member 20 has moved to the back side of the operating surface 11a most within the movable range in the protruding direction Z (a state where the tip of the pin member 21 matches the level of the operating surface 11a). It is. The “maximum displacement state” is a state in which the protruding member 20 has moved most to the front side of the operation surface 11a within the movable range in the protruding direction Z. In the present embodiment, the protrusion status is set stepwise between the minimum displacement state and the maximum displacement state in a plurality of steps such as 4 steps, 8 steps, 16 steps, and the like. As an example, in the case of being divided into 16 stages, the status determination unit 52 makes each protrusion as represented by any natural number between “0” representing the minimum displacement state and “15” representing the maximum displacement state. The protrusion status of the member 20 is determined. Note that the protruding member 20 with the protruding status “0” is in the buried state, and the protruding member 20 with the protruding statuses “1” to “15” is in the protruding state with the protruding height corresponding to each protruding status.

  Here, as described above, an image or the like of the operation mark 44 (here, the operation button in FIG. 6) associated with the predetermined function can be displayed on the display screen 41. In such a case, the status determination unit 52 associates the coordinates on the display screen 41 with the coordinates on the operation surface 11a, and coordinates on the operation surface 11a corresponding to the coordinates on the display screen 41 of the displayed operation mark 44. For the plurality of projecting members 20 located at, the projecting status is determined to be “1” or more. In the present embodiment, for a plurality of projecting members 20 that can express a rectangular frame shape by their array shape, the projecting status is determined to be, for example, “11” to “15” representing a relatively large displacement state. In this example, “15” representing the maximum displacement state is determined.

  Moreover, the status determination part 52 is about the in-frame protrusion member 20i which is the 1 or 2 or more protrusion member 20 located in the area | region I inside the frame enclosed by the some protrusion member 20 arranged in frame shape as mentioned above. Also, the protrusion status is determined to be “1” or more. In the present embodiment, the one or more in-frame protruding members 20i that can express shapes (for example, ◯, Δ, □, +, −, etc.) according to the contents of the operation mark 44 by their arrangement shapes, The protrusion status is determined to be, for example, “5” to “10” representing an intermediate displacement state between the minimum displacement state and the maximum displacement state. In this case, when a plurality of operation marks 44 are displayed on the display screen 41, the in-frame protruding members 20i corresponding to the operation marks 44 differ depending on the contents of the operation marks 44. The protrusion status may be determined.

  The status determination unit 52 determines the protrusion status of the in-frame protruding member 20i that does not contribute to expressing the predetermined shape according to the contents of the operation mark 44 to “0” indicating the minimum displacement state. The status determination unit 52 also sets the protrusion status of the protrusion member 20 positioned at the coordinates on the operation surface 11a corresponding to the coordinates on the display screen 41 in the area where the operation mark 44 is not displayed to “0”. To decide.

  In the present embodiment, an image of an operation slider as shown in FIG. 7 may be displayed as a kind of operation mark 44 associated with a predetermined function. Here, the operation slider in this example is for accepting designation of the scale of the map image. Such a scale is a target whose size (amount) is adjusted based on designation from the user, and is a kind of “adjustment amount” in the present invention. Further, the navigation device 1 to which such a scale setting value as an adjustment amount is input is a kind of “adjustment object” in the present invention and a “specific adjustment object” in this example. The “adjustment target” includes an in-vehicle audio system and an air conditioner in addition to the navigation device 1. For example, when the “adjustment target” is an audio system, the volume can be “adjustment amount”, and when the “adjustment target” is an air conditioner, the temperature and air volume can be “adjustment amount”.

  For example, when the received image indicating that the adjustment amount instruction input is received is displayed on the display screen 41, such as the image of the operation slider, the status determination unit 52 determines the coordinates of the display screen 41 and the operation surface. A plurality of coordinates located in the setting region R (see FIG. 7) on the operation surface 11a corresponding to the region on the display screen 41 of the operation mark 44 (operation slider) included in the received image in association with the coordinates of 11a. The protruding status of the protruding member 20 is determined to be “1” or more. In the present embodiment, each of the plurality of protruding members 20 arranged in the setting region R is increased regularly and stepwise along a predetermined reference direction C set along the operation surface 11a. Determine the protrusion status. That is, for each of the plurality of projecting members 20 arranged in the setting region R, each projecting status is determined so that the projecting status of the plurality of projecting members 20 increases stepwise according to the position along the reference direction C. To do. However, the status determination unit 52 sets the protrusion status to “0” for the current value corresponding protrusion member 20n corresponding to the current value of the adjustment amount (scale) among the plurality of protrusion members 20 arranged in the setting region R. To decide.

  The protrusion control unit 53 controls the position of the protrusion member 20 in the protrusion direction Z with respect to the operation surface 11a. The protrusion control unit 53 controls the drive mechanism 30 based on the information received from the status determination unit 52. In the present embodiment, the protrusion control unit 53 controls the state of the movement restricting mechanism for each protrusion member 20 according to the protrusion status, and applies a pulsed voltage to vibrate the piezoelectric element 31. In that case, the protrusion control part 53 is comprised so that the magnitude relationship of the vibration speed to the one side along the protrusion direction Z and the vibration speed to the other side can be adjusted. Such a configuration can be realized by changing the duty ratio according to the vibration direction of the piezoelectric element 31. The protrusion control part 53 moves the protrusion member 20 to the protrusion direction side by making the vibration speed to the protrusion direction side smaller than the vibration speed to the burying direction side. On the other hand, the protrusion control part 53 moves the protrusion member 20 to the burying direction side by making the vibration speed to the burying direction side smaller than the vibration speed to the protrusion direction side.

  As described above, the determination result by the status determination unit 52 is based on whether or not the predetermined operation mark 44 is displayed on the display screen 41 and the contents of the displayed operation mark 44. Therefore, by controlling the drive mechanism 30 based on the determination result, the protrusion control unit 53 associates the coordinates of the display screen 41 with the coordinates of the operation surface 11a, and a specific operation mark 44 is displayed on the display screen 41. When displayed, as shown in FIG. 6, the coordinates of the plurality of projecting members 20 (frame forming projecting members 20 f) are projected to the coordinates on the operation surface 11 a corresponding to the coordinates of the operation mark 44. A frame-shaped frame-shaped protruding portion 25 is formed by the protruding tip end group 23g. In addition, the protrusion control unit 53 is operated by the protruding tip end group 23g including the protruding tip end portions 23 of the one or more in-frame protruding members 20i located in the in-frame region I surrounded by the frame-like protruding portion 25. The in-frame protruding portion 26 having a shape corresponding to the contents of the chapter 44 is formed. At that time, the protrusion control part 53 has a protrusion height of each of the frame forming protrusion member 20 f constituting the frame-like protrusion part 25 and the in-frame protrusion member 20 i constituting the in-frame protrusion part 26 located in the in-frame region I. Is set according to the contents of the operation mark 44. In FIG. 6, only the frame forming protruding member 20 f and the in-frame protruding member 20 i that are in the protruding state are illustrated, and the protruding member 20 that is in the embedded state is not illustrated.

  In the present embodiment, the protrusion control unit 53 makes the protrusion height of the frame forming protrusion member 20f different from the protrusion height of the in-frame protrusion member 20i. More specifically, the projection height of all the frame forming projection members 20f is set to the maximum projection height, and the projection height of the in-frame projection member 20i is set to the intermediate projection height according to the contents of the operation mark 44. Or “0”. In this example, the protruding height of the in-frame protruding member 20i set to the intermediate protruding height is uniform. In addition, an identification symbol of a predetermined shape (for example, ◯, Δ, □, +, −, etc.) is expressed by a protruding tip end group 23g composed of the protruding tip end portion 23 of the in-frame protruding member 20i set to the intermediate protruding height. Is done. These shapes can correspond to the contents of the operation mark 44. Note that the shape expressed by the protruding tip end group 23g corresponds to the contents of the operation mark 44. Specifically, when the operation mark 44 is displayed on the display screen 41, the operation mark is displayed. A file related to the chapter 44 is read out, and the contents of the operation mark 44 are acquired with reference to attribute information included in the file.

  As an example, FIG. 6 shows an example in which two operation buttons as operation marks 44 are displayed on the display screen 41. Corresponding to this, two rectangular frame-like protrusions 25 are formed on the operation surface 11a, and a frame area I surrounded by the frame-like protrusions 25 corresponds to a wide area button and a detail button. Further, in-frame protruding portions 26 expressing “+” mark and “−” mark are respectively formed.

  In addition, when the reception image (such as the image of the operation slider in FIG. 7) indicating that the protrusion control unit 53 receives an instruction to input the adjustment amount (scale) is displayed on the display screen 41, the status determination unit 52. The protrusion height adjustment control is performed according to the determination result obtained by. In the protrusion height adjustment control, the plurality of protrusion members 20 (adjustment protrusion members 20d) arranged in the setting region R set on the operation surface 11a are adjusted according to the positions along the reference direction C. This is control for projecting so that the projecting height of the projecting member 20d varies stepwise. In FIG. 7, only the adjustment projecting member 20 d is illustrated, and illustration of the projecting member 20 to be buried is omitted. In the present embodiment, the respective projecting heights of the adjustment projecting members 20d arranged so as to regularly change in this way are set as the “reference height Hs” for the respective adjustment projecting members 20d. . Accordingly, the reference height Hs is different for each of the plurality of adjustment projecting members 20d in the setting region R.

  In the present embodiment, the setting area R is set at a position on the operation surface 11 a corresponding to the position of the image of the operation slider on the display screen 41. Further, the setting region R is set to be horizontally long when viewed from the front of the touch pad 10, and extends from one end (upper left in FIG. 7) to the other side (lower right in FIG. 7) along the reference direction C. The projecting height of each adjustment projecting member 20d is set to increase stepwise as it goes. Thus, the height of the protruding height of each adjustment protruding member 20d arranged so that the protruding height varies stepwise along the reference direction C corresponds to the scale value as the adjustment amount. It will be a thing. Each adjustment projecting member 20d can function as a medium for receiving an instruction input of an adjustment amount value (scale setting value).

  The protrusion control unit 53 sets the protrusion height of the current value corresponding protrusion member 20n corresponding to the current value of the adjustment amount (current scale value) among the plurality of adjustment protrusion members 20d arranged in the setting region R, Different from the reference height Hs (see FIG. 9) according to the current value of the adjustment amount. In the present embodiment, the protrusion control unit 53 sets the protrusion height of the current value corresponding protrusion member 20n to the minimum protrusion height (that is, “0”) regardless of the reference height Hs corresponding to the current value of the adjustment amount. And As a result, the protrusion heights of the plurality of adjustment protrusion members 20d arranged in the setting region R change regularly along the reference direction C as a whole, and are irregular at the position of the current value corresponding protrusion member 20n. To change. By making tactile recognition of such irregular changes, the user can recognize the current value of the adjustment amount without gazing at the display screen 41.

  Note that the protrusion control unit 53 performs the protrusion height adjustment control only while the reception image indicating that the adjustment amount instruction input is received is displayed on the display screen 41. When the received image is not displayed, the protrusion status of all the adjustment protrusion members 20d arranged in the setting region R is “0”, and the protrusion height is also “0” which is the minimum protrusion height. The

  In the configuration including the movement restriction mechanism as in the present embodiment, the protrusion control unit 53 has a predetermined length longer than the time required to switch the protrusion height of the protrusion member 20 between the minimum protrusion height and the maximum protrusion height. The piezoelectric element 31 is vibrated for the time, and thereafter the vibration is stopped. That is, a voltage is applied to the piezoelectric element 31 for the predetermined time, and thereafter the voltage application is stopped. Even after the voltage application is stopped, the protruding member 20 maintains the position in the protruding direction Z due to the static friction between the connecting member 33 and the cylindrical member 22.

  The position detection unit 54 acquires the detection position of the detection object D on the operation surface 11 a of the touch pad 10. The position detection unit 54 determines the position of the electrode that the detected object D is closest to based on the change in capacitance between the electrodes that occurs when a fingertip or the like as the detected object D contacts or approaches the operation surface 11a. Identify. And the position detection part 54 acquires the position of the specified electrode as a detection position on the operation surface 11a. With such a function of the position detection unit 54, the touch pad 10 can accept an input corresponding to a detection position on the operation surface 11a. The position detection unit 54 outputs the acquired detection position information to the drawing control unit 51 and the operation determination unit 56.

  The state detection unit 55 detects the protruding state and the buried state of the protruding member 20 in a distinguishable manner. The state detection unit 55 is configured to be able to acquire information from, for example, a position sensor (not shown). The state detection part 55 detects whether the actual protrusion status of each protrusion member 20 is a protrusion state or an embedded state based on the acquired information on the position of each protrusion member 20 in the protrusion direction Z. The state detection unit 55 outputs information on the detection result to the operation determination unit 56.

  The operation determination unit 56 determines a predetermined operation input to the navigation device 1 or the like by the user based on at least a predetermined operation on the operation surface 11a. In the present embodiment, the “predetermined operation” that is a determination criterion includes, for example, an operation (touch operation) for bringing the detected object D that is not in contact with the operation surface 11a into contact with the operation surface 11a, and a contact with the operation surface 11a. For example, an operation in which the detected object D is lifted from the operation surface 11a and then brought into contact again (tap operation), an operation in which the tap operation is repeated twice within a predetermined time (double tap operation), and the like are included. In the present embodiment, such a “predetermined operation” includes a pushing operation on the protruding member 20. The pushing operation is an operation of pushing the protruding member 20 in the protruding state toward the operation surface 11a.

  The operation determination unit 56 determines a predetermined operation input to the navigation device 1 or the like by the user based on the position of the operation surface 11a where the predetermined operation has been performed. As an operation input to the navigation device 1 by the user, for example, selection of a specific point in the map displayed on the display screen 41 or selection of a specific function associated with the operation mark 44 displayed on the display screen 41 is selected. Etc. When the above-described predetermined operation is performed in an area of the operation surface 11a corresponding to an area other than the operation mark 44 on the display screen 41 (referred to as “non-mark area”), the operation determination unit 56 detects the detected position. It is determined that a point on the display screen 41 corresponding to is selected. In this case, the operation determination unit 56 outputs information indicating that to the drawing control unit 51, and causes the map image to be scrolled around the selected point.

  When the predetermined operation is performed at the position of the operation surface 11a corresponding to the position of the operation mark 44 on the display screen 41, the operation determination unit 56 determines that the function associated with the operation mark 44 has been selected. judge. By the way, in the present embodiment, the protruding member 20 (the frame forming protruding member 20f and the in-frame protruding member 20i) has a predetermined protruding height at the position of the operation surface 11a corresponding to the position of the operation mark 44 on the display screen 41. Now, it protrudes from the operation surface 11a. Therefore, the operation determination unit 56 touches the in-frame region I in accordance with the pressing operation in which the protruding members 20 (the frame forming protruding member 20f and the in-frame protruding member 20i) protruding from the operation surface 11a are pushed into the operation surface 11a side. When an input is received by the pad 10, it is determined that there has been an operation for selecting the operation mark 44 corresponding to the position of the in-frame region I. In the present embodiment, the operation determination unit 56 corresponds to the “selection operation determination unit” in the present embodiment.

  As an example, in FIG. 6, when the protruding member 20 corresponding to the operation mark 44 as a wide area button is pushed in and an input is accepted as it is in the in-frame area I, the map image displayed The scale is changed so as to increase (see FIG. 8).

  Incidentally, a plurality of operation marks 44 may be displayed on the display screen 41, and the protruding members 20 corresponding to the plurality of operation marks 44 may be close to each other. Alternatively, the user may operate a plurality of locations at the same time. In these cases, there is a possibility that an input may be received by the touch pad 10 in a plurality of different frame regions I. In such a case, the operation determination unit 56 determines that there has been an operation for selecting the operation mark 44 corresponding to the position of the in-frame region I having the larger number of protruding members 20 that have been pushed. In the present embodiment, the total value of the number of frame forming protruding members 20f that have been pushed in and the number of in-frame protruding members 20i that have been pushed in are compared, and the operation mark 44 corresponding to the larger one is selected. It is determined that there has been an operation.

  As a result of comparing the numbers of the protruding members 20 that have been pushed in, the number may be the same in some cases. In such a case, the operation determination unit 56 determines the selected operation mark 44 based on the reference point of the in-frame region I and the detection position of the detected object D. Here, the reference point of the in-frame region I is a representative point set at a position representing the in-frame region I, such as a center point or a center of gravity point. In the present embodiment, the operation determination unit 56 performs a selection operation of the operation mark 44 corresponding to the position of the in-frame region I whose detection position of the detected object D is closer to the reference point of the in-frame region I. It is determined that

  By the way, the scale change by the operation button selection operation as described above can be performed only one step at a time. This is not particularly inconvenient during normal driving, but for example, when a destination is set relatively far and a guide route to the destination is set, the overall image of the guide route can be confirmed. In some cases, a large scale change is desired for confirmation of a detailed map around the destination. In such a case, it is more convenient for the user to change the scale using an operation slider as shown in FIG. 7 than using an operation button. Therefore, in consideration of such points, in the present embodiment, in a state where the guide route is set by the navigation calculation unit 70, an input for changing the scale is accepted using the operation slider.

  Correspondingly, in the present embodiment, the operation determination unit 56 includes an instruction reception unit 58. The instruction receiving unit 58 receives an instruction input of an adjustment amount value for a specific adjustment target selected from a plurality of types of adjustment targets. In this example, an instruction input of a set value of a scale as an adjustment amount is accepted for the navigation device 1 as a specific adjustment target. In the present embodiment, as a result of the protrusion height adjustment control, the instruction receiving unit 58 has a plurality of protrusion members 20 (for adjustment) arranged so that the protrusion heights differ stepwise along the reference direction C in the setting region R. The projecting member 20d) is used as a medium, and an instruction input of an adjustment amount value is received. In this example, the scale of the map display is set as the adjustment amount, and the scale value corresponding thereto is set to increase as the protrusion height of each adjustment protrusion member 20d increases. Here, a large scale value means that the denominator of the reduction ratio with respect to the actual size is large, or that the distance on the map corresponding to the unit length on the display screen 41 is long.

  Then, the instruction receiving unit 58 sets the protruding height set for the pushed adjustment protruding member 20d when a part of the adjustment protruding member 20d in the setting region R is pushed to the operation surface 11a side. The instruction input of the value of the adjustment amount according to the is accepted. That is, as the protruding height of the pushed adjustment projecting member 20d is higher, an instruction input of a larger scale setting value is accepted, and as the protruding height of the pushed adjustment projecting member 20d is lower, the smaller scale is set. An instruction input of the set value is accepted. Whether or not the adjustment projecting member 20d has been pushed into the operation surface 11a side is determined based on input reception on the touch pad 10 in the setting region R. That is, when a predetermined operation such as a touch operation is detected in the setting region R, it is determined that the adjustment protruding member 20d has been pushed into the operation surface 11a side.

  When an input of a new scale setting value is received by the instruction receiving unit 58, the map is re-displayed on the display screen 41 at a scale corresponding to the setting value. At that time, as shown in FIG. 9, the protrusion control unit 53 adjusts the protrusion height of the adjustment protrusion member 20d (current value corresponding protrusion member 20n before change) corresponding to the value of the adjustment amount so far. A reference height Hs corresponding to the value of the quantity is used. That is, it is set to the original protruding height at a position along the reference direction C in the setting region R. In addition, the protrusion control unit 53 sets the protrusion height of the adjustment protrusion member 20d (the changed current value corresponding protrusion member 20n) corresponding to the new adjustment amount value as a reference corresponding to the new adjustment amount value. Different from the height Hs, it is set to “0”.

4). Processing Procedure of Operation Input Acceptance Processing A processing procedure of operation input acceptance processing by the operation input system 3 according to the present embodiment will be described with reference to FIGS. The procedure of the operation input reception process described below is executed by hardware and / or software (program) or both constituting each function unit of the operation input calculation unit 50. When each of the above functional units is configured by a program, the arithmetic processing device included in the control arithmetic unit 6 including the operation input arithmetic unit 50 operates as a computer that executes the program configuring each functional unit.

  As shown in FIG. 10, in the operation input reception process, first, various preparation processes are executed (step # 01). This preparation process includes, for example, preparation of a work area for creating a display image. Next, a display image is actually created (step # 02). Then, it is determined whether or not the created display image image includes a reception image indicating that the adjustment amount instruction input is received (step # 03). If not included (step # 03: No), the processing of step # 04 to step # 07 is executed.

  In step # 04, a first protrusion height determination process is executed. In this first protruding height determination process, as shown in FIG. 11, the protruding member 20 (frame forming protruding member 20f) capable of expressing the frame shape at a position corresponding to the position of the operation mark 44 on the display screen 41. The protrusion height is set to H1, which is the maximum protrusion height (step # 21). The process of step # 21 is equivalent to setting the protrusion status described above as being divided into 16 stages to the maximum value “15”. Next, the protruding members 20 (in-frame protruding members 20i) that can express a predetermined shape according to the contents of the operation mark 44 are extracted in the respective in-frame regions I (step # 22). And the protrusion height of the extracted in-frame protrusion member 20i is set to H2 lower than the maximum protrusion height (step # 23). The process of step # 23 is equivalent to setting the protrusion status to a value not less than “1” and less than “15”. Finally, the protruding heights of the remaining in-frame protruding members 20i are set to “0”. The process of step # 24 is equivalent to setting the protrusion status to “0”. Above, the 1st protrusion height determination process is complete | finished.

  When the first protrusion height determination process is completed, the process returns to FIG. 10, and the display screen 41 is displayed based on the display image image created in step # 02 and the protrusion height (protrusion status) determined in step # 04. An image is displayed, and the projecting member 20 is driven back and forth by the drive mechanism 30 (step # 05). Thereby, the protruding member 20 corresponding to the specific operation mark 44 displayed on the display screen 41 is set in the protruding state. In this state, the first input determination process is executed (step # 06).

  As shown in FIG. 12, in the first input determination process, the detection position of the detection object D on the operation surface 11a is acquired (step # 31). The operation cursor 45 is displayed at a position on the display screen 41 corresponding to the acquired detection position (step # 32). Note that when the detection position of the detection object D on the operation surface 11a moves, the displayed operation cursor 45 also moves on the display screen 41 accordingly. Thereafter, it is determined whether or not there is a pushing operation of pushing the protruding member 20 (the frame forming protruding member 20f, the in-frame protruding member 20i) in the protruding state into the operation surface 11a side (step # 33). If it is determined that the push operation has been performed (step # 33: Yes), it is determined whether or not the operation mark 44 corresponding to the protruding member 20 on which the push operation has been performed exists (step # 34). When such an operation mark 44 exists (step # 34: Yes), an operation mark specifying process is executed (step # 35).

  As shown in FIG. 13, in the operation mark specifying process, it is determined whether or not a pressing operation has been performed only in one in-frame region I (step # 51). When there is only one in-frame area I (step # 51: Yes), the operation mark 44 corresponding to the in-frame area I is specified (step # 52). If there is a pressing operation in a plurality of in-frame regions I (step # 51: No), the number of protruding members 20 that have been pressed is acquired for each in-frame region I (step # 53). Then, it is determined whether or not the in-frame region I having the maximum number of pushing operations can be specified as one (step # 54). If it can be specified (step # 54: Yes), the operation mark 44 corresponding to the in-frame region I is specified (step # 55). If it cannot be specified (step # 54: No), the distance between the predetermined reference point and the detected position of the detected object is acquired for each in-frame region I (step # 56). Then, the operation mark 44 corresponding to the in-frame region I having the smallest separation distance is specified (step # 57). This is the end of the operation mark specifying process.

  Returning to FIG. 12, if it is determined in step # 33 that there is no pushing operation (step # 33: No), it is determined whether or not there is a touch operation (including a tap operation and a double tap operation) on the operation surface 11a. (Step # 36). When a touch operation is detected (step # 36: Yes), the detection position of the touch operation is within the area (operation mark allocation area) of the operation surface 11a corresponding to the operation mark 44 on the display screen 41. Is determined (step # 37). When it is determined that it is within the operation mark assignment area (step # 37: Yes), the operation mark 44 corresponding to the operation mark assignment area is specified (step # 38). Then, the operation mark 44 specified in step # 35 or step # 38 is selected, and various functions (for example, a map image scale changing function) associated therewith are realized (step # 39). Thereafter, the first input determination process is terminated.

  On the other hand, if it is determined in step # 34 that the corresponding operation mark 44 does not exist (step # 34: No), or if it is determined in step # 37 that it is outside the operation mark allocation area (step # 34) # 37: No), selection processing is performed in an area other than the operation mark allocation area (non-mark area) (step # 40). For example, a process of scrolling the map image with the detection position of the touch operation as the center of the display screen 41 is executed. Thereafter, the first input determination process is terminated. In addition, also when it determines with there being no touch operation in step # 36 (step # 36: No), a 1st input determination process is complete | finished.

  According to such first input determination processing, the protruding member 20 (the frame forming protruding member 20f and the in-frame protruding member 20i) corresponding to the specific operation mark 44 displayed on the display screen 41 is set to the protruding state. The In the state where the protruding tip 23 is buried on the back side from the operation surface 11a, the peripheral portion of the operation surface 11a is flat, whereas in the state where the protruding tip 23 protrudes from the operation surface 11a to the front side, the protruding tip 23 is The tactile recognition can be directly recognized by the fingertip or the like. In addition, the user can easily associate the position of the protruding member 20 recognized by tactile sense on the operation surface 11a with the position of the operation mark 44 displayed on the display screen 41 in a conscious manner. Further, the user can perform a touch operation or the like on the operation surface 11a at the position by relying on the protruding member 20 that is tactile-recognized at the desired position on the operation surface 11a. Therefore, the user can easily select the desired operation mark 44 without seeing not only the touchpad 10 provided near the hand but also the display input device 40 provided at a position close to the line of sight during driving. be able to. Therefore, according to the operation input system 3 according to the present embodiment, it is possible to perform more reliable operation input than in the related art without gazing at the display screen 41.

  Moreover, in this embodiment, these can be easily distinguished based on the difference in each protrusion height of the frame formation protrusion member 20f and the in-frame protrusion member 20i. Therefore, the user can easily identify the boundary of the operation area on the operation surface 11 a corresponding to the operation mark 44 displayed on the display screen 41 and the mark portion representing the content of the operation mark 44. it can.

  Returning to FIG. 10, when the received image indicating that the adjustment amount instruction input is received is included in the display image (step # 03: Yes), the processing of step # 14 to step # 17 is executed. In step # 14, a second protrusion height determination process is executed.

  As shown in FIG. 14, in the second protrusion height determination process, a plurality of protrusion members 20 (adjustment protrusion members 20d) arranged in a predetermined setting region R are extracted (step # 61). Among the extracted protruding members 20, the protruding member 20 located at one end along the reference direction C is selected (step # 62). Then, the protrusion height of the selected protrusion member 20 is set to H3 which is higher by one step than “0” which is the minimum protrusion height (step # 63). Note that the process of step # 63 is equivalent to setting the protrusion status described as being divided into 16 stages to “1”. Next, the protruding member 20 adjacent to the other side in the reference direction C in the setting region R is selected (step # 64). Then, the protrusion height of the selected protrusion member 20 is set to be higher by H4 corresponding to a predetermined step than the protrusion height of the protrusion member 20 adjacent to one side in the reference direction C (step #). 65).

  The processes of Step # 64 to Step # 66 are repeatedly executed while the unselected protruding member 20 exists in the setting region R (Step # 66: No). The processing from step # 64 to step # 66 is equivalent to increasing the protrusion status by a predetermined number. When all the projecting members 20 in the setting region R are selected (step # 66: Yes), the projecting height of the current value corresponding projecting member 20n is set to “0” which is the minimum projecting height (step). # 67). The process of step # 67 is equivalent to setting the protrusion status to “0”. Above, the 2nd protrusion height determination process is complete | finished.

  When the second protrusion height determination process is completed, the process returns to FIG. 10 and the display screen 41 is displayed based on the display image image created in step # 02 and the protrusion height (protrusion status) determined in step # 14. An image is displayed, and the projecting member 20 is driven back and forth by the drive mechanism 30 (step # 15). Thereby, the protruding member 20 corresponding to the reception image indicating that the instruction input of the adjustment amount is received is brought into the protruding state. In this state, the second input determination process is executed (step # 16).

  The process of step # 71 to step # 73 in the second input determination process shown in FIG. 15 is the same as the process of step # 31 to step # 33 (see FIG. 12) in the first input determination process. When it is determined that the push operation has been performed (step # 73: Yes), the protruding member 20 (adjustment protruding member 20d) on which the push operation has been performed is specified (step # 74). At this time, for example, when a pushing operation is performed on the plurality of projecting members 20, the projecting member 20 closest to the detected position is specified based on the detected position of the detected object D on the operation surface 11a. The Or the protrusion member 20 with the largest pushing amount may be specified based on each pushing amount. When it is determined in step # 73 that there is no pushing operation (step # 73: No), it is determined whether or not there is a touch operation (including a tap operation and a double tap operation) in the setting region R (step # 73). 75). When the touch operation is detected (step # 75: Yes), the protruding member 20 corresponding to the detected position is specified among the protruding members 20 in the setting region R based on the detected position of the touch operation. (Step # 76). Then, it is determined whether or not the protruding member 20 specified in step # 74 or step # 76 is the current value corresponding protruding member 20n at that time (step # 77).

  If it is not the current value corresponding protruding member 20n (step # 77: No), the input of the value of the adjustment amount (the set value of the scale in this example) according to the protruding height of the specified protruding member 20 is accepted (step). # 78). On the other hand, in the case of the current value corresponding protruding member 20n (step # 77: Yes), the current value corresponding protruding member 20n is set instead of the current height corresponding protruding member 20n. The input of the value of the adjustment amount according to the reference height Hs is received (step # 79). In this case, the value of the adjustment amount is not changed. Thereafter, in this example, a map image corresponding to the changed scale setting value is displayed on the display screen 41.

  Thus, when the value of adjustment amount is changed (step # 78, step # 79), or when neither pushing operation nor touch operation is detected (step # 73: No, step # 75: No) ), It is determined whether or not acceptance of the adjustment amount instruction input has been completed (step # 80). If not completed (step # 80: No), if completed (step # 80: Yes), all the protruding members 20 are buried and the protruding height is set to “0” ( Step # 81). Above, a 2nd input determination process is complete | finished.

  According to such a second input determination process, when some of the protruding members 20 in the setting region R are pushed, an adjustment amount corresponding to the protruding height set for the pushed protruding member 20 is obtained. A value instruction input is accepted. Therefore, the user can input an instruction for the value of the adjustment amount by an intuitive operation of pushing the protruding member 20 having a protrusion height that can be intuitively felt to correspond to the value of the desired adjustment amount into the operation surface 11a side. Can do. Similarly to the case of the first input determination process described above, the user can input an instruction for the value of the adjustment amount without paying attention to the display screen 41 by relying on the protruding member 20 protruding from the operation surface 11a. .

  Returning to FIG. 10, when the first input determination process and the second input determination process are completed, it is determined whether or not the display image on the display screen 41 is changed (step # 07, step # 17). If neither the push operation nor the touch operation is detected in the first input determination process or the second input determination process, there is a high possibility that there is no screen transition. In such a case (step # 07: No, step # 17: No), the first input determination process or the second input determination process is executed again. On the other hand, when a specific operation mark 44 is selected as a result of each input determination process or when an instruction input of a new adjustment amount value is received, screen transition can be accompanied. In such a case (step # 07: Yes, step # 17: Yes), the operation input reception process is terminated. Note that the processing from step # 01 is executed again on the display image after the change. The above processing is repeatedly executed repeatedly.

5. Other Embodiments Finally, other embodiments of the operation input system according to the present invention will be described. Note that the configurations disclosed in the following embodiments can be applied in combination with the configurations disclosed in other embodiments as long as no contradiction arises.

(1) In the above embodiment, two operation buttons as the operation mark 44 are displayed on the display screen 41, and a frame-shaped protruding portion 25 and an in-frame protruding portion having a predetermined shape on the operation surface 11a corresponding to these buttons. The configuration in which 26 is formed is described as an example. However, the embodiment of the present invention is not limited to this. That is, even when an operation mark 44 other than this is displayed on the display screen 41, the frame-like protruding portion 25 and the in-frame protruding portion 26 can be formed. Such an operation mark 44 includes operation icons associated with various functions such as destination search, audio setting, and air conditioner setting. A plurality of types of operation marks 44 are provided corresponding to these various functions.

In consideration of such points, the protrusion control unit 53 projects each of the frame forming protrusion member 20f constituting the frame-like protrusion 25 and one or more in-frame protrusion members 20i constituting the in-frame protrusion 26. It is preferable that a plurality of combinations of heights can be set according to the contents of the plurality of types of operation marks 44. The protrusion control unit 53 forms a three-dimensional shape (expression shape) as a whole of the frame-like protrusion 25 and the in-frame protrusion 26 by combining one or more of the pointers A to C shown below. can do.
<Guideline A> The projection height of the frame forming projecting member 20f is switched in a plurality of stages. <Guideline B> The arrangement pattern of the in-frame projecting member 20i in the projecting state is changed. Switching the protrusion height of the member 20i in multiple stages

  FIG. 16 shows an example in which all of the pointers A to C are combined. In this example, the protruding height of the frame forming protruding member 20f is switched between two levels. Further, the frame-shaped projecting member 20i is formed by the frame-forming projecting member 20f in which four frame-shaped projecting portions 25 are arranged per side, and the projecting state of the four in-frame projecting members 20i surrounded by the frame-shaped projecting members 20i. Three types of arrangement patterns are prepared (corresponding to each column). Further, the projecting height of the in-frame projecting member 20i in the projecting state is switched between two levels. For each of the three types of arrangement patterns of the in-frame protruding member 20i in the protruding state, three types of combinations of the protruding height of the frame forming protruding member 20f and the protruding height of the in-frame protruding member 20i in the protruding state are applied. (Corresponding to each line). In addition, it is good also as a combination from which the protrusion height of the frame formation protrusion member 20f and the protrusion height of the in-frame protrusion member 20i made into a protrusion state become the same like the upper stage (1st line). Or it is good also as a combination from which they differ, like a middle stage (2nd line) and a lower stage (3rd line). In addition, it is good also as combinations of protrusion height other than the example of illustration.

  FIG. 17 shows an example in which the pointer A and the pointer C are combined. In this example, the frame-shaped projecting portion 25 is formed by the frame-forming projecting member 20f in which three frame-shaped projecting portions 25 are arranged per side, and only one projecting member 20 surrounded by them is used as the in-frame projecting member 20i. The projecting height of the frame forming projecting member 20f and the projecting height of the in-frame projecting member 20i are each switched to three levels. In the illustrated example, only the projection height of the frame forming projection member 20f and the projection height of the in-frame projection member 20i are different, but a combination in which they are the same may be used. Moreover, it is good also as a combination of protrusion heights other than the example of illustration.

  Furthermore, in these examples, the arrangement of the frame-forming protruding members 20f constituting the frame-like protruding portion 25 can be changed as appropriate, and the arrangement patterns of the in-frame protruding members 20i that are brought into a protruding state are also varied accordingly. Ready. Further, the number of protruding heights that can be switched for the frame forming protruding member 20f may be different from the number of protruding heights that can be switched for the in-frame protruding member 20i. Further, when there are a plurality of in-frame protruding members 20 i that are in a protruding state in one in-frame region I, their protruding heights may be different from each other. Furthermore, as long as it can be distinguished from the in-frame protruding member 20i, the protruding heights of the frame forming protruding members 20f constituting the frame-shaped protruding portion 25 may be different from each other.

(2) In the above-described embodiment, when input is received by the touchpad 10 in the plurality of in-frame regions I, the number of the frame forming protruding members 20f that have been pressed and the in-frame protruding members that have been pressed. The configuration in which it is determined that there has been a selection operation of the operation mark 44 corresponding to the one having the larger total value with the number of 20i has been described as an example. However, the embodiment of the present invention is not limited to this. That is, a configuration may be adopted in which the number of in-frame protruding members 20i that have been pushed in is compared, and it is determined that there has been an operation mark 44 selection operation corresponding to the larger one. Further, regardless of the number of projecting members 20 that have been pushed in, an operation mark corresponding to the position of the in-frame region I that is closer to the detection position of the detected object D with respect to the reference point of the in-frame region I. It may be configured to determine that 44 selection operations have been performed.

(3) In the above-described embodiment, the configuration in which the protruding height of the protruding member 20 can be changed stepwise has been described as an example. However, the embodiment of the present invention is not limited to this. That is, for example, the projecting height of the projecting member 20 may be changed steplessly (linearly) by controlling the time during which the piezoelectric element 31 is vibrated. In this case, it can be set as the structure which is not provided with the movement control mechanism demonstrated by said embodiment.

(4) In the above-described embodiment, the configuration in which the input of the scale change is received using the operation slider while the guidance route is set has been described as an example. However, the embodiment of the present invention is not limited to this. For example, a configuration may be adopted in which an input of a scale change is received using an operation slider while traveling on a highway. That is, it is possible to adopt a configuration in which an input of a scale change is received selectively using either an operation button or an operation slider in accordance with the execution mode of the navigation device 1 or the traveling state of the vehicle. Further, the scale change input acceptance by the operation button and the scale change input acceptance by the operation slider may be performed in combination instead of alternatively. Further, when there are a plurality of “specific adjustment targets”, the input reception by the operation button and the input reception by the operation slider may be mixed for each “specific adjustment target”.

(5) In the above-described embodiment, a configuration in which the plurality of projecting members 20 are regularly arranged at regular intervals in the vertical and horizontal directions over the entire operation surface 11a, and arranged in a matrix (orthogonal lattice) as an example. As explained. However, the embodiment of the present invention is not limited to this. In other words, the plurality of projecting members 20 may be arranged at least along the operation surface 11a according to a predetermined rule, and may be arranged, for example, in a honeycomb shape (hexagonal lattice shape) over the entire operation surface 11a. In these cases, the plurality of protruding members 20 may be arranged not on the entire operation surface 11a but on only a part thereof.

(6) In the above embodiment, the configuration in which the drive mechanism 30 includes the piezoelectric element 31 has been described as an example. However, the embodiment of the present invention is not limited to this. That is, the specific configuration of the drive mechanism 30 is arbitrary as long as the protruding member 20 can be moved back and forth along the protruding direction Z to move the protruding member 20 between the protruding state and the buried state. It is. For example, a drive mechanism 30 that uses fluid pressure such as liquid pressure or atmospheric pressure, or a drive mechanism 30 that uses electromagnetic force such as an electromagnet may be used.

(7) In the above-described embodiment, the configuration in which the protruding member 20 is driven back and forth along the protruding direction Z set in a direction orthogonal to the operation surface 11a has been described as an example. However, the embodiment of the present invention is not limited to this. That is, the protruding direction Z may be set in a direction that is inclined without being orthogonal to the operation surface 11a. In this case, for example, when the touch pad 10 is disposed substantially horizontally on the center console portion as in the above-described embodiment, the protruding direction Z may be set to be inclined to the driver's seat side.

(8) In the above embodiment, the configuration using the capacitive touch pad 10 capable of detecting the detection object D that is in contact with or close to the operation surface 11a has been described as an example. However, the embodiment of the present invention is not limited to this. That is, the resistive touch pad 10 may be used instead of the capacitive touch pad 10. Moreover, you may utilize the pressure sensitive touchpad 10 which can detect the to-be-detected object D which contacts the operation surface 11a.

(9) In the above embodiment, the configuration in which the operation input device 4 is connected to the display input device 40 in which the display device and the input device such as the touch panel are integrated is described as an example. However, the embodiment of the present invention is not limited to this. That is, it is not essential to include a touch panel, and the operation input device 4 may be connected to a display device (display device) having at least a display screen.

(10) In the above embodiment, the configuration in which the state detection unit 55 detects the actual protrusion status of each protrusion member 20 based on the information acquired from the position sensor has been described as an example. However, the embodiment of the present invention is not limited to this. For example, the state detection unit 55 can be configured using the characteristics of the piezoelectric element 31 provided in the drive mechanism 30 and using the piezoelectric element 31 as a sensor element. As described above, when the protrusion control unit 53 drives the protrusion member 20 to advance and retract, the voltage application is stopped after a predetermined time has elapsed. For this reason, an external force (pushing force by the user) applied to the piezoelectric element 31 via the protruding member 20 and the connecting member 33 can be detected as an electrical signal, so that the user can perform an operation (pushing operation) on the protruding member. A detectable configuration can be realized. And based on the detected pushing operation and the protruding status of each protruding member 20 determined by the status determining unit 52, a configuration is realized in which the state detecting unit 55 detects the actual protruding status of each protruding member 20. Can do. That is, when an electric signal from the piezoelectric element 31 corresponding to the protruding member 20 in the protruding state is detected, the state detection unit 55 determines that the protruding member 20 has been buried. In addition, when the piezoelectric element 31 corresponding to the projecting member 20 in the buried state is vibrated and the elapse of a predetermined time is determined by a timer or the like, the state detection unit 55 determines that the projecting member 20 is in the projecting state. .

(11) In the above embodiment, the configuration in which the operation input calculation unit 50 includes the function units 51 to 58 has been described as an example. However, the embodiment of the present invention is not limited to this. That is, the assignment of the function units described in the above embodiment is merely an example, and a plurality of function units can be combined or one function unit can be further divided.

(12) Regarding other configurations as well, the embodiments disclosed herein are illustrative in all respects, and the embodiments of the present invention are not limited thereto. In other words, configurations that are not described in the claims of the present application can be modified as appropriate without departing from the object of the present invention.

  The present invention can be suitably used for an operation input system provided with a touch pad as a pointing device.

3 Operation Input System 10 Touch Pad 11 Operation Plate 11a Operation Surface 20 Projection Member 20f Frame Forming Projection Member 20i In-Frame Projection Member 23 Projection Tip 23g Projection Tip Group 25 Frame Projection 40 Display Input Device (Display Device)
41 Display Screen 44 Operation Mark 53 Projection Control Unit 56 Operation Determination Unit (Selection Operation Determination Unit)
D Object to be detected I Frame area

Claims (6)

A touch pad having an operation surface formed with an operation surface on a front surface, detecting an object to be detected that is in contact with or close to the operation surface, and receiving an input according to the detection position;
A plurality of projecting members arranged along the operation surface according to a predetermined rule and provided so as to be able to project independently from the operation surface through the operation plate;
A protrusion control unit that controls the protrusion height of each of the protrusion members with respect to the operation surface;
A display device having a display screen and displaying an image on the display screen,
The protrusion control unit associates the coordinates of the display screen with the coordinates of the operation surface, and when the specific operation mark is displayed on the display screen, the operation corresponding to the coordinates of the operation mark A frame-shaped frame-like protruding portion is formed by a protruding tip portion group consisting of protruding tip portions of the plurality of protruding members protruding from the operation surface at coordinates on the surface, and a plurality of the above-mentioned frame-shaped protruding portions are formed. An operation input system for projecting an in-frame projecting member, which is the projecting member located in an in-frame region surrounded by a projecting member and the frame-shaped projecting portion, according to the contents of the operation mark.   The protrusion control part has a shape formed by a plurality of protrusion members constituting the frame-like protrusion part, protrusion heights of the in-frame protrusion members, and protrusion tip parts of the plurality of in-frame protrusion members, The operation input system according to claim 1, wherein the operation input system is set according to contents of the operation mark.   The operation input system according to claim 1, wherein the protrusion control unit makes the protrusion height of the frame-shaped protrusion different from the protrusion height of the in-frame protrusion member.   The protrusion control unit can set a plurality of types of combinations of protrusion heights of the frame-shaped protrusion and one or more in-frame protruding members according to the contents of the plurality of types of operation marks. The operation input system according to any one of claims 1 to 3. The input corresponding to the position of the in-frame region when the input is received by the touch pad in the in-frame region in accordance with the pressing operation in which the protruding member protruding from the operation surface is pushed into the operation surface side. A selection operation determination unit that determines that there has been an operation mark selection operation,
When an input is received by the touchpad in a plurality of different in-frame areas, the selection operation determination unit is positioned at the position in the in-frame area where the number of the protruding members subjected to the push operation is larger. The operation input system according to any one of claims 1 to 4, wherein it is determined that a corresponding operation mark selection operation has been performed. When the number of the protruding members that have been pushed in a plurality of the in-frame regions is equal, the selection operation determination unit is closer to the detection position of the detected object than the reference point of the in-frame region The operation input system according to claim 5, wherein it is determined that the operation mark selection operation corresponding to the position of the in-frame region has been performed.

Images