JP2009129251A - Operation input apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation input apparatus capable of preventing the continuation of an unintended operation input and the application of an excessive load to an operation panel faced reversely to a gravity direction. <P>SOLUTION: The operation input apparatus provided with an operation panel 12a in which a touch operation surface 12a1 is arranged on the upper surface detects a depression energizing force level to the touch operation surface 12a1 due to touch input by a pressure sensor 20, and when the depression energizing force level exceeds a prescribed threshold level and when the input continuation time of the touch input to the touch operation surface 12 counted by a control circuit 18 exceeds threshold time, recognizes the state as an abnormal input state and outputs an alarm by a buzzer 30. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an operation input device having a touch operation surface.

Japanese Patent Laid-Open No. 05-189151

  Conventionally, as a touch-type operation input device, there is one using a resistive film type touch panel provided with a vertical transparent electrode and a horizontal transparent electrode (Patent Document 1). In addition to the resistive film method, there are various types of touch panels such as a capacitance method and a vibration detection method. In addition, in the vertical and horizontal directions, infrared diodes (LEDs) and phototransistors that receive the light are arranged in pairs to emit light sequentially, and the position is detected by blocking the light with an operating finger or the like. There is also an optical type (infrared blocking detection method).

  In recent years, as a touch-type operation input device that employs an operation method different from a method of directly operating a touch panel, there is an operation device that remotely operates a device such as a prompter method. A prompter type operation device is an operation information input unit for extracting an operator's hand image (sub-screen) and detecting an operator's manual operation separately from a display device that displays an operation screen (main screen). The hand image and the hand operation obtained by the operation information input unit are reflected on the operation screen (main screen) of the display device, and display control is performed as if the touch panel is directly operated.

  By the way, the touch operation surface of the touch panel can be provided in a shape facing the direction opposite to the direction of gravity, that is, a shape facing the upper side. In particular, the touch operation surface of the operator in the prompter type operation device is provided in the vicinity of the operator, and for example, in a form facing upward at the peripheral position of the operator's hand so that the operator can easily operate. May be provided. Furthermore, if it is provided in the passenger compartment, it may be provided in such a way that the driver faces the driver's seat so that the driver can operate it while driving.

  However, since the touch operation surface has a relatively large area so that a selection operation to a plurality of positions is possible, if it is arranged in a shape facing upward, a hand or an object can easily touch in an unintended manner, Touch input may be made. If this is instantaneous, it is not a big problem. For example, when a hand or an object keeps touching for a long time, unnecessary signal input continues on the control device side, which is unnecessary for the control device. It will give a load. Even if a signal is not transmitted to the control system in the form of an operation input, the touch operation surface may be damaged by applying an excessive load.

  In particular, when the touch operation surface is provided on the vehicle, there are many scenes that should be avoided, such as when the seat occupant moves his / her body, he / she touches his / her hand to support his / her body, or children play around Can be assumed.

  The subject of this invention is providing the operation input apparatus which can prevent the continuation of the unintended operation input and the application of an excessive load with respect to the operation panel which faces opposite to the gravity direction.

Means for Solving the Problems and Effects of the Invention

In order to solve the above problems, the first of the operation input device of the present invention is:
An operation panel having a touch operation surface disposed on the upper surface;
Touch input detection means for detecting a touch input on the touch operation surface;
A pressing biasing force level detecting means for detecting a pressing biasing force level to the touch operation surface in accordance with the detected touch input;
An abnormal input state alarm output means for specifying an abnormal input state when the detected pressing biasing force level exceeds a predetermined threshold level, and outputting an alarm;
It is characterized by providing.

Moreover, in order to solve the said subject, 2nd of the operation input device of this invention is:
An operation panel having a touch operation surface disposed on the upper surface;
Touch input detection means for detecting a touch input on the touch operation surface;
An input time timing means for timing the input duration of the detected touch input;
When the detected input duration exceeds a predetermined threshold time, an abnormal input state is identified and an abnormal input state alarm output means for outputting an alarm;
It is characterized by providing.

  According to the first configuration of the present invention, since an alarm is output when an abnormal input state in which an excessive load is applied to the touch operation surface is detected, damage to the operation panel due to an excessive load can be prevented. On the other hand, according to the second configuration of the present invention, an alarm is detected when an abnormal input state is detected in which a touch input longer than necessary is made on the touch operation surface and an input signal is continuously output to the control device side. Since the output is performed, it is possible to reduce the processing load on the signal output unit and the control device side.

  In the first and second configurations of the present invention described above, the touch input detection means is disposed on the back side of the operation panel so as to be interposed between the operation panel and the panel support that supports the operation panel. It can be configured as a pressure sensor that outputs a signal corresponding to the pressure applied with the input energization of. According to this configuration, it is possible to detect the pressure biasing force level on the touch operation surface with a simple configuration in which the pressure sensor is provided on the back side of the operation panel. In the first configuration of the present invention, this pressure sensor can also be used as a pressing force level detecting means.

  When a pressure sensor is used as the touch input detection means, touch input position specification is performed in which the touch input to the touch operation surface is detected by specifying the input position on the touch operation surface where the touch input is made. And a control means for outputting a control signal for executing the control content corresponding to the specified input position, thereby enabling control based on touch input.

  On the other hand, in the first and second configurations of the present invention, the touch input detecting means detects the touch input to the touch operation surface, and specifies the input position on the touch operation surface where the touch input is made. It can be configured as a touch input position specifying means performed in the above. In this case, a control means for outputting a control signal for executing the control content corresponding to the specified input position can be provided. The operation input device is provided with control means for executing control corresponding to the input position, and means for specifying the input position is required. The above configuration is an efficient configuration in which the means for specifying the input position is also used as the touch input detection means.

  By the way, the operation input device of the present invention can be a prompter type operation input device. Specifically, the display screen is provided at a position different from the operation panel, and the operation icon can be displayed on the display screen, while the display screen and the touch operation surface of the operation panel are supported. The display unit is configured to include a display unit in which the relationship is predetermined and the other in-plane position corresponding to the one in-plane position can be uniquely specified. The control means responds to the operation icon when the input position on the touch operation surface specified by the touch input position specifying means is a position corresponding to the display position of the operation icon displayed on the display screen. It is configured to output a control signal for executing the control content. In such prompter-type operation input devices, the operation panel is often provided with the touch operation surface facing upward at a position close to the user's hand in consideration of user operability. Therefore, unintentional continuous input energization to the touch operation surface and application of more load than necessary are likely to occur, and alarms can be output for these, thereby allowing the user to recognize and avoid these situations Can do.

  Further, in such a prompter type operation input device, it is possible to display at which position on the operation panel the operator's hand is located from the viewpoint of improving operability. Specifically, hand image photographing means for photographing a hand image of an operator who operates the touch operation surface, and hand image composition display control means for compositing and displaying the photographed hand image at a corresponding position on the display screen; , And can be configured. Thereby, touch operation becomes still easier.

  In addition, when such a prompter type operation input device is applied to a vehicle, the display screen can be provided at a position that can be seen by a passenger of the seat, and the operation panel is provided in the vehicle interior. It can be provided adjacent to the seat of the seat so that it can be operated by a passenger in a predetermined seat. Since the operation panel is disposed at a position adjacent to the seat portion of the seat, that is, at a position close to the hand of the passenger sitting on the seat, the operation is facilitated. Moreover, it can be set as the operation input device for both seats by providing in the position which can be operated from both the right and left adjacent seats in a vehicle interior.

  In the present invention, the abnormal input state alarm output means is configured to stop the alarm output when the abnormal input state is no longer specified in the state where the alarm is output, and performs useless alarm output. I can not. Further, by configuring the abnormal input state alarm output means with a buzzer, it can be realized at low cost. In the case of using a buzzer, the cost can be further increased by using the buzzer provided in a device already mounted as an in-vehicle electronic device. For example, if a navigation device is installed in the passenger compartment, a buzzer installed in the navigation device can be used.

  Hereinafter, an embodiment of an operation input device of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of a vehicle navigation device using the operation input device of the present invention. In the present embodiment, as the operation input device 1, a prompter system in which a display unit 15 that displays an operation switch image (operation icon) and an operation panel 12 that performs operation input on the switch image are provided at different positions. The operation input device is adopted. However, the operation target of the operation input device according to the present embodiment is not limited to the navigation function, but can include the device functions of other in-vehicle electronic devices connected via the in-vehicle LAN 50.

  The navigation device 10 includes a position detector 11 that detects the current position of the vehicle, an operation information input unit 12 for inputting various instructions from an operator such as a driver, and an external that records map data and various information. A map data input device 14 for inputting map data and the like from a recording medium, a display unit 15 for performing various displays such as a map display screen and a TV (Television) screen, and outputting various guide voices, etc. A voice input / output device 16 for inputting the voice of the operator, a hard disk storage device 17 for storing various data such as vehicle information, and a vehicle I / F (for transmitting and receiving vehicle information) Interface) unit 19, a wireless communication device 13 for performing short-range wireless communication with another communication device 13 a, a buzzer 30, and a control circuit 18 connected to these 11 to 19 and 30.

  The position detector 11 receives a radio wave transmitted from an artificial satellite for GPS (Global Positioning System) via a GPS antenna and is added to the vehicle and a GPS receiver 11a that detects the position, direction, speed, and the like of the vehicle. A gyroscope 11b that detects the magnitude of the rotational motion, a distance sensor 11c that detects the distance traveled from the longitudinal acceleration of the vehicle, and the like, and a geomagnetic sensor 11d that detects the traveling direction from the geomagnetism. Each of the sensors 11a to 11d has an error of a different property, and is configured to be used while complementing each other. Depending on the accuracy, some of the sensors described above may be used, or a steering rotation sensor, a wheel sensor for each rolling wheel, or the like (not shown) may be used.

  As shown in FIG. 3, the operation information input unit 12 has a light source 12c that emits light in a predetermined wavelength band, and a light transmission that is arranged so that the light emitted from the light source 12c is transmitted toward the surface side. An operation panel 12a having a characteristic, a camera (approaching object photographing means) 12b for photographing from the back surface 12a2 side of the operation panel 12a so as to include the operation panel 12a in a photographing range, and a pressure sensor 20.

  Note that the operation information input unit 12 of the present embodiment is provided adjacent to the seat portion of the seat so that the operation information input portion 12 can be operated by a passenger in a predetermined seat in the vehicle interior. Specifically, as shown in FIG. 2, the vehicle is installed at a position below the lower edge of the vehicle windshield FG and operable from both the right and left seats, such as the center console portion C of the vehicle. ing. Furthermore, it is arranged below the display unit 15 and on the front side between both seats of the adjacent left and right seats so that each seat occupant can operate it at hand. Note that the left and right adjacent seats in this embodiment are the driver's seat 2D and the passenger seat 2P, but may be applied to the left and right rear seats.

  The light source 12c is an infrared light source, and as shown in FIG. 3, is an LED mounted on a substrate 12f located on the rear side of the back surface of the operation panel 12a. The light source 12c of this embodiment irradiates light in such a manner that the operation panel 12a is transmitted from the back surface 12a2 to the front surface 12a1. Note that the light source of the present invention is not limited to a light source that emits infrared light, but by using an infrared light source, photographing in a dark place is also good.

  The operation panel 12a is fitted into the front end opening of the hollow casing 12f. The housing 12e is fixedly disposed at a predetermined position in the vehicle interior, and the camera 12b and the light source 12c are disposed in a space within the housing 12e. A cylindrical wall portion 122e is provided from the outer edge of the housing front end portion 121e forming the front end opening toward the rear, and the rear end portion is fixed to the substrate 12f. Incidentally, both the inner and outer spaces sandwiching the operation panel surface 12a are normal spaces filled with air.

  In addition, the operation panel 12a of the present embodiment is configured to have translucency at least in the panel thickness direction, and as shown in FIG. 3, light (irradiation light) from the light source 12c is touch operation surface 12a1. As long as there is no approaching object (such as a hand) H located on the upper side, the object passes through the touch operation surface 12a1, but approaches the touch operation surface 12a1. When there is an approaching object H, it is reflected by the approaching object H, and a part of the light (reflected light) returns to the back surface 12a2 side and is captured by the camera 12b. When a touch switch (touch sensor) on the touch panel 12a is pressed by the touch operation on the touch panel 12a, the coordinates are input to the control circuit 18. In the case of the present embodiment, the operation panel 12a may be capable of transmitting only infrared light.

  The operation panel 12a of the present embodiment is, for example, a resistive touch panel, and the upper surface 12a1 forms a touch operation surface. The touch panel 12a uses a resistive touch switch (touch sensor) in which a resistive film is opposed to upper and lower substrates (glass). When the upper glass surface is touched, the electrodes of the upper substrate (upper glass) and lower substrate (lower glass) come into contact with each other by the pressure, and at that time, the transparent electrodes (resistive films) on the upper glass and lower glass respectively. The pressed position is detected by measuring the voltage division ratio due to the resistance, and functions as a switch (touch input position specifying means).

  Further, a signal corresponding to the pressure applied in response to the input bias of the operation panel is output to the back surface 12a2 side of the operation panel 12a in a form interposed between the operation panel 12a1 and the panel support 12e that supports the operation panel 12a1. A pressure sensor 20 is disposed. As the pressure sensor 20, a known semiconductor pressure sensor or the like can be used. Since the touch operation surface 12a1 is disposed so as to face the direction opposite to the gravitational direction, when a pressing force in the gravitational direction is applied to the touch operation surface 12a1 of the touch panel 12a, pressure is applied to the pressure sensor 20. Then, a signal corresponding to the pressure is output to the control circuit 18. That is, the pressure sensor 20 functions as a pressing biasing force level detection unit. In the present embodiment, the touch switch of the touch panel 12a functions as a touch input detection unit, and the pressure sensor 20 functions as a pressing force level detection unit. However, the pressure sensor 20 also functions as a touch input detection unit. Can function as.

  The camera 12b captures the approaching object H from the back surface 12a2 side of the operation panel 12a in such a manner that the light emitted from the light source 12c captures the reflected light reflected by the approaching object H. Furthermore, the camera 12b is configured to capture an approaching object image (for example, a hand image) that is transmitted through the touch panel 12a and reflected by the reflecting device 12r, and the vehicle body side is configured to capture a predetermined imaging range. It is fixed. By adopting a configuration for capturing a reflected video, image processing for horizontally reversing the image captured by the camera 12b becomes unnecessary.

  The camera 12b of the present embodiment is an infrared camera suitable for shooting in a dark place (including an infrared filter (not shown) that shuts out visible light and performs shooting), and an infrared light source Photographing is performed in such a manner that the light (infrared rays) irradiated from 12c captures the reflected light reflected by the approaching object H. It is fixedly arranged on the board 12f fixed on the vehicle body side, and a range including the touch operation surface 12a1 (operation panel 12a) is set as a photographing range. Note that if the operation panel 12a is made of a material having translucency only with respect to the light from the light source, the infrared filter in the camera 12b is not necessary. In the present invention, an infrared camera is used in consideration of the ease of data processing. However, the present invention is not limited to the infrared camera.

  Returning to FIG. 1, the display unit 15 is provided at a position where the display screen is visible from the passenger in the seat. In the present embodiment, the display device is installed in front of the driver's seat, and any of a liquid crystal display, a plasma display, an organic EL display, and the like may be used. The display screen of the display unit 15 includes a mark indicating the current location identified from the current position of the vehicle detected by the position detector 11 and the map data input from the map data input device 14, a guidance route to the destination, a name, Additional data such as landmarks and marks of various facilities can be displayed in an overlapping manner. Also, facility guides can be displayed. The display unit 15 corresponds to the display unit of the present invention.

  Further, as described above, the display unit 15 has a display coordinate system that has an unambiguous correspondence with the operation system coordinates for indicating the input position on the touch operation surface 12a1 of the operation panel 12a. A switch image (operation icon) 201 is displayed at a predetermined position on the display coordinate system. When a touch input is made at the corresponding operation input position on the touch operation surface 12a1, the switch image 201 is displayed. The corresponding control content is executed. That is, in the present embodiment, there is a unique correspondence between the two-dimensional coordinate system defined on the display screen of the display unit 15 and the two-dimensional coordinate system defined on the touch operation surface 12a1 of the operation panel 12a. Since the relationship is predetermined and the other in-plane position corresponding to the one in-plane position can be uniquely specified, based on the correspondence, by touch input to the touch operation surface 12a1, A corresponding switch image 201 displayed on the display screen can be touch-operated.

  The display unit 15 is not limited to the one disposed in the center console C as shown in FIG. 2, and may be installed above the lower edge of the windshield FG, for example. Specifically, a head-up display (HUD) or the like for displaying the above-mentioned image / data can be exemplified on the windshield FG of the vehicle.

  Returning to FIG. 1, the map data input device 14 is road data as network data, map data such as so-called map matching data for improving the accuracy of position specification, mark data indicating facilities, guidance image and audio data. It is a device for inputting various data including the like. A CD-ROM, DVD-ROM, hard disk, memory, memory card, or the like can be used as a recording medium for these data.

  The voice input / output device 16 can output facility guides and various guidance voices input from the map data input unit 14, and read-out voices of information acquired via the I / F 19. The voice input / output device 16 includes a microphone (not shown) and a known voice recognition unit, and can input voice of an operator such as a driver to the control circuit 18 as a command or the like.

  The wireless communication device 13 is for performing narrowband communication with other communication devices 13a. For example, DSRC (Dedicated Short Range Communications), Bluetooth (registered trademark), wireless LAN (Local Area Network), UWB (Ultra Wideband). ) Etc. are used.

  The LAN I / F 19 is an interface circuit for exchanging data with other in-vehicle electronic devices and sensors via the in-vehicle LAN 50. Further, for example, data from another ECU (for example, the ECU 100 in FIG. 1) may be taken in via the LAN I / F 19.

  The buzzer 30 outputs a buzzer sound due to vibration as an alarm, and is a function also used as an abnormal input state alarm output means of the present invention.

  The control circuit 18 is mainly composed of a well-known microcomputer including a well-known CPU, ROM, RAM, I / O (Input / Output) (not shown) and a bus line connecting these components. Based on each detection signal from the position detector 11 based on a program stored in the storage unit, the current position of the vehicle is calculated as a set of coordinates and traveling directions, and the vicinity of the current position read via the map data input device 14 A map display process for displaying on the display unit 15 a main image (including a moving image and a still image) 200B as a main image (including moving images and still images) 200B, and a map data input unit 14 Based on the stored point data, the destination facility is selected according to the operation of the operation information input unit 12, and the optimum route from the current position to the destination is automatically selected. A route guidance process of performing route guidance performs route calculation for obtaining the. A technique such as the Dijkstra method is known as a technique for automatically setting an optimum route in this way.

  Further, the control circuit 18 includes a switch image (operation icon) 201 and a processed image 200H based on the approaching object image 150H acquired from the operation information input unit 12 based on a program stored in a storage unit such as a ROM. Both of them are sub-images, and an image composition unit 18a for superimposing them on the main image 200B (map operation image or the like) is provided, and the generated composite video 200 is displayed on the display screen of the display unit 15. (Hand image composition display control means). FIG. 4 is an example of a video 150 photographed by the camera 12b. On the other hand, FIG. 5 is a semi-transparent composite of the processed image 200H based on the hand image 150H of FIG. 4 with the main image 200B (map operation image or the like). FIG. Reference numeral 150a is an area where the operation panel 12a is shown, but since the operation panel 12a is transparent and there is no opposing object on the surface 12a1 side, nothing is shown or the area where the distant view is shown. It has become.

  The processed image 200H based on the approaching object image 150H is the approaching object outline reflecting image 200H that has been processed and generated so that the outer shape of the approaching object image 150H is reflected. By synthesizing this image 200H, when an operator such as a driver moves a finger or the like of the hand so as to face the touch operation surface 12a1 of the operation panel 12a, for example, the display unit The processed image 200H reflecting the hand shape is moved and displayed on the display screen 15, and the operation can be performed as if the operation panel 12a is present on the display screen of the display unit 15.

  Note that image information of a plurality of switch images (operation icons) 201 that can be superimposed on the main image 200 is stored in the storage unit of the control circuit 18. Operation content information in which control content executed by operation input (touch input to a corresponding touch switch) is associated is also stored. The control circuit 18 displays a switch image (operation icon) 201 on the main image (including moving images and still images) 200 based on the image information, and corresponds to the display position of the switch image 201 on the display output unit. Then, the position of the touch switch on the touch panel 12a is set as an operation input reception range (operation input position) (operation input position setting means). And the control content corresponding to the touch switch of the operation input reception range on the touch panel 12a corresponding to the display position of the switch image 201 displayed on the display output unit of the display unit 15 based on the operation content information. Assign. Thereby, when an operation is performed on the touch switch in the operation input reception range on the touch panel 12a, an operation input having contents corresponding to the switch image 201 is received based on the operation (touch input reception unit). ). That is, the switch image 201 displayed on the main image 200, the operation input acceptance range of the touch switch on the touch panel 12a, and the control content to be executed based on the operation input are associated with each other. When the operation input acceptance range is pressed, the control circuit 18 determines that the corresponding switch image 201 on the main image 200 has been pressed, and uses this to input an operation input for executing the control content corresponding to the switch image 201. Accept as.

  The CPU of the control circuit 18 is configured to receive an input signal from the pressure sensor 20 or an input signal from the touch switch of the touch panel 12a. Based on these input signals, the touch operation surface Since the presence or absence of the touch input to 12a is determined, it functions as the touch input position specifying means of the present invention together with the transmission source of the input signal. Further, since the pressure biasing force level to the touch operation surface associated with the touch input is specifically specified based on the signal input from the pressure sensor 20, the pressure biasing force level detecting means of the present invention can be used together with the pressure sensor 20. It is functioning. Moreover, since it has the function to make a buzzer mentioned later perform warning output, it functions also as the abnormal input state warning output means of this invention with the said buzzer. It also functions as an input time measuring means, control means, and hand image composition display control means of the present invention. The image composition unit 18a has a part of the function as the hand image composition display control means, and the buzzer 18b and the counter 18c also function as the input time measuring means.

  Here, the touch input reception processing by the control circuit 18 will be described with reference to the flowchart of FIG. This touch input acceptance process is repeatedly executed even after the process of FIG.

  In S1, the control circuit 18 monitors whether there is a touch input on the touch panel 12a. The presence / absence of touch input can be monitored based on whether or not the pressure sensor 20 detects a pressure exceeding a predetermined pressing force level, but in the present embodiment, the resistance film of the touch panel 12a. In the touch switch, it is monitored whether the electrodes of the upper substrate (upper glass) and the lower substrate (lower glass) are in contact with each other.

  In S2, the control circuit 18 determines whether or not there is a touch input on the touch operation surface (touch input detection means). In the present embodiment, electricity flows when the electrodes of the upper substrate (upper glass) and the lower substrate (lower glass) come into contact. Therefore, when receiving the current input, it is determined that there is a touch input, and the process proceeds to S3. If there is no input, the process returns to S1.

  In S3, the position on the touch operation surface 12a1 where the current touch input is made is specified (touch input position specifying means). In this embodiment, electricity flows when the electrodes of the upper substrate (upper glass) and the lower substrate (lower glass) are in contact, and the resistance of each transparent electrode (resistive film) of the upper glass and lower glass at that time. The pressed position can be detected by measuring the partial pressure ratio. In the present embodiment, the control circuit 18 detects the touch input to the touch operation surface (S2) based on a signal received when the electrodes of the upper substrate (upper glass) and the lower substrate (lower glass) are in contact with each other, The input position on the touch operation surface 12a1 where the touch input has been made can be simultaneously performed (S3). That is, since the input position can be specified, that is, there is a touch input, S2 and S3 which are separate steps can be processed in the same step. That is, in this embodiment, the touch input detection unit and the touch input position specifying unit are configured to function simultaneously. However, the configuration may be such that the input position is identified by receiving an input signal from the touch switch of the touch panel 12a, and the detection result of the pressure sensor may be acquired using the input signal as a trigger. .

  In S4, it is determined whether or not the specified input position is an area for receiving an input. Specifically, the control circuit 18 displays a switch image (operation icon) 201 on a main image (including moving images and still images) 200, while a switch on the display output unit is displayed on the touch panel 12a. Since the position of the touch operation surface 12a1 corresponding to the display position of the image 201 is set as the operation input reception range (operation input position) (operation input position setting means), in S4, the specified input position is the operation input. It is determined whether it is within the input reception range. That is, it is determined whether or not the specified input position is a position corresponding to the switch image (operation icon) 201 displayed on the display unit 15.

  In S5, the control content corresponding to the specified input position is specified. More specifically, the control circuit 18 controls the control circuit 18 for each operation input reception range on the touch panel 12a corresponding to the display position of the switch image 201 displayed on the display output unit of the display unit 15. Since the control content is assigned based on the operation content information stored in the storage unit (control content assignment means), the assigned control content is specified. In S6, a control signal for executing the specified control content is output (control means).

  Next, hand image superimposition display processing by the control circuit 18 will be described using the flowchart of FIG. This touch input acceptance process is repeatedly executed even after the process of FIG.

  Since the camera 12b is photographing the approaching object (for example, the operator's hand such as a driver) H approaching the touch operation surface (front surface) 12a1 side from the back surface 12a2 side of the touch panel 12a via the operation panel 12a. When the approaching object H enters the position facing the touch operation surface 12a1, the approaching object H is naturally photographed and a photographed image 150 is obtained.

  In S11, an image (the hand image in the case of FIG. 4) 150H of the approaching object H is extracted from the captured video 150. In the present embodiment, the control circuit 18 analyzes the captured image using a known image analysis method, and based on the difference in color between the operation panel 12a and the approach object H of the operator, the approach The object image 150H is extracted.

  In the present embodiment, the light source 12c is arranged, and the camera 12b performs imaging in a manner that captures the reflected light of the light source 12c. Reflected light intensity is reflected in the gradation of the color appearing in the photographed image 150, and the higher the reflected light intensity, the higher the gradation level. That is, since the captured video 150 captured by the camera 12b of the present embodiment is a multi-gradation captured image (monochrome captured image in the present embodiment), in S2, this is used using a predetermined gradation threshold. Then, the gradation level of each pixel is binarized, and an area exceeding the gradation threshold is extracted as the approaching object image 150H. Then, after processing the extracted approaching object image 150H to be in a semi-transparent state, the image composition unit 18a composes it on the main image 200B (here, the map operation image), and FIG. A composite video 200 as shown is displayed. This hand image superimposed display process is repeatedly performed at a predetermined cycle.

  In addition, by performing the above-described hand image superimposing display process, the captured approaching object image 200H functions as an approaching object image composition display unit that compositely displays the captured approaching object image 200H at a corresponding position on the display screen. Since the hand image is synthesized and displayed when the approaching object is the hand of the operator, it can be said that it also functions as the hand image synthesis display control means of the present invention. In addition, the camera 12b of the present embodiment that forms the approaching object photographing unit also captures a hand image when the approaching object is an operator's hand, and thus functions as the hand image capturing unit of the present invention. It can be said that.

  Further, as the hand image superimposing display process, it is determined whether or not the image 150H is a human hand image from the shape of the captured approaching object image 150H, and only when it is the human hand image 150. The image 150H may be processed and translucently combined with the main image 200B. As a technique for extracting a human hand image, any known technique (see, for example, JP-A-2003-346162) can be used.

  Further, the processing / compositing display of the approaching object image 150H on the main image 200B is not limited to the above-described semi-transparent composite display, and various modifications can be considered.

  By the way, the operation input device of the present invention is characterized in that an alarm is output for a predetermined abnormal input state. The abnormal input state is a state where a load of a level that is not made by normal operation is applied to the operation input device. First, there is a load (pressing force) that cannot be normal operation on the touch operation surface 12a1. In the second case, the second is a case where there is a continuous input for a long time that cannot be a normal operation on the touch operation surface 12a1. The former may cause physical damage of the operation panel 12a1, and the latter may output an alarm in each situation because the control system may be overloaded.

  FIG. 8 is a flowchart showing a flow of processing for outputting an alarm for the first abnormal input state in the vehicle input device of the present embodiment. In S101, the control circuit 18 monitors whether or not there is a touch input on the touch panel 12a. In S102, the control circuit 18 determines whether or not there is a touch input on the touch operation surface (touch input detection means). The method of monitoring and determining the presence or absence of touch input is the same as S1 and S2 in FIG.

  In subsequent S103, the input duration of the detected touch input is counted (input time counting means). Specifically, when the control circuit 18 receives a signal output from the touch panel 12a when the electrodes of the upper substrate (upper glass) and the lower substrate (lower glass) are in contact with each other at S1, the control circuit 18 uses the signal as a trigger. Then, the timer 18b provided for itself is started, and the count value of the counter 18c provided for itself is increased to start counting the duration of the touch input. Then, in S104, it is determined whether or not the duration exceeds a predetermined threshold time, and if it exceeds, it is determined as an abnormal input state, and the process proceeds to S105 to output an alarm output for notifying the abnormal input state. Do. On the other hand, if not exceeded, the process proceeds to S108, where it is determined whether or not the touch operation is still continued, and if continued, the process returns to S104, and if not continued, the process proceeds to S106.

  In S106, it is determined whether or not the touch operation is still continued in the alarm output state. If it continues, S106 is repeated in order to continue the alarm output, and when the touch operation is completed, the alarm output is stopped in S107 and this process is terminated. This alarm output may be configured to be continuously output as long as the touch input continues even after the ignition is turned off. This process is repeatedly executed even after the process is completed.

  FIG. 9 is a flowchart showing a flow of processing for outputting an alarm for the first abnormal input state in the vehicle input device of the present embodiment. In S111, the control circuit 18 monitors whether there is a touch input on the touch panel 12a, and in S112, the control circuit 18 determines whether there is a touch input on the touch operation surface (touch input detection means). The method of monitoring and determining the presence or absence of touch input is the same as S1 and S2 in FIG.

  In subsequent S113, the level of the pressing force applied to the touch operation surface 12a1 associated with the detected touch input, that is, the magnitude of the pressing force applied to the touch operation surface 12a1 is detected (pressing force level detecting means). Specifically, the control circuit 18 detects the pressing force level based on the detection signal received from the pressure sensor 20. In subsequent S114, it is determined whether or not the detected pressing force level exceeds a predetermined threshold level. If it has exceeded, it is determined as an abnormal input state, and the process proceeds to S115, where an alarm output for notifying the abnormal input state is output (abnormal input state alarm output means). On the other hand, when it does not exceed, it progresses to S116.

  In S116, it is determined whether or not the detected pressing force level does not exceed the threshold level. If the detected pressing force level does not exceed the threshold level, S116 is repeated in order to continue the alarm output. To stop alarm output and end this process. This alarm output may be configured to be continuously output until the detected pressing force level does not exceed the threshold level even after the ignition is turned off. This process is also repeatedly executed after the process ends.

  In the present embodiment, the alarm output for notifying the abnormal input state in S105 and S115 is a buzzer sound. The buzzer is incorporated in the navigation device 10 in advance, and is performed using this. In the present embodiment, as a result of emphasizing the cost, the buzzer is used. However, the alarm output is output from the voice output unit using the function of the navigation device 10 in the same manner. It is also possible to warn by displaying a warning text on the display device. Since these are easier to understand what the alarm output is, the problem situation can be avoided more quickly. In these cases, the respective warning voice data and warning display data may be stored in advance in the storage unit of the control circuit 18 and read out and used as necessary.

  In the first and second abnormal input state alarm output processes, the presence / absence of touch input (S101, S102 and S111, S112) is received from the pressure sensor 20 at predetermined intervals, and based on the results. You may go. In particular, in the second abnormal input state alarm output process, S111 and S112 are omitted, suddenly the detection result of the pressure sensor 20 is acquired (S113), and the detected pressing force level is compared with the threshold level. You may go (S114). If it is determined as an abnormal input state as a result of the comparison, it means that there has been at least a touch input exceeding the normal pressing force level, so that S111 and S112 were performed in the processing of S113 and S114. Become.

  Although one embodiment of the present invention has been described above, this is merely an example, and the present invention is not limited to this, and the knowledge of those skilled in the art can be used without departing from the spirit of the claims. Various modifications based on this are possible.

  For example, the above-described alarm output processing in the first and second abnormal input states may employ only one of them instead of both.

  Moreover, in the said embodiment, although comprised as an operation input device of a navigation apparatus, it may naturally be an operation input device of other vehicle-mounted electronic devices, and does not need to be an operation input device of vehicle-mounted electronic devices. For example, it can be applied to other household appliances.

  The operation input device of the present invention is not limited to the prompter type operation device provided separately from the display surface and the operation surface, and at least the surface (upper surface) facing the direction opposite to the gravitational direction is used as the touch operation surface. Any device having a device configuration can be applied to a touch panel in which a display surface is formed on the touch operation surface 12a1, as shown in FIG.

  In the above embodiment, a resistive touch panel is used as the operation panel as a touch panel. However, other types of touch panels may be used, and at least a surface (upper surface) facing the direction opposite to the gravitational direction is defined as a touch operation surface. The present invention can be applied as long as it has an apparatus configuration.

  In addition, the camera 12b is a camera that captures a fixed area in the vehicle interior that faces the touch operation surface 12a1 of the touch panel 12a, and is not limited to the configuration that captures images from the back surface 12a2 side of the touch panel 12a as in the above embodiment. For example, as shown in FIG. 10, the surface of the touch panel 12a is attached to the center console portion C of the vehicle so as to be photographed obliquely from above, and an approaching object approaching the touch operation surface 12a1 of the touch panel 12a is You may make it photograph. However, when a specific image (for example, a hand image) in the photographed image is extracted and displayed on the display unit 15, processing for reversing the image to the left and right is necessary.

The block diagram which shows one Embodiment of the navigation apparatus for vehicles which employ | adopted the operation input device of the vehicle prompter system which makes the operation input device of this invention. The principal part perspective view in a vehicle interior for demonstrating the outline | summary of the prompter system operation apparatus for vehicles. Sectional drawing which shows the structure of an operation information input part. The figure which illustrates the picked-up image of a camera. The figure which illustrates the translucent synthesis | combination of the hand image with respect to the main image of a display apparatus. The flowchart which shows a touch input process. The flowchart which shows a hand image superimposition display process. The flowchart which shows the 1st of an abnormal input state alarm output process. The flowchart which shows the 2nd of an abnormal input state alarm output process. FIG. 4 is a perspective view of a main part of a vehicle interior for explaining an outline of a vehicle prompter type operation device different from those in FIGS.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Vehicle navigation apparatus 12 Operation information input part 12a Operation panel (touch input detection means, touch input position specification means)
12b Camera (approaching object photographing means, hand image photographing means)
12c Light source 15 Display section (display means)
18 Control circuit (input time counting means, abnormal input state alarm output means, touch input position specifying means, control means, hand image composition display control means)
18a Image composition unit (hand image composition display control means)
20 Pressure sensor (touch input detection means, pressing force level detection means)
30 Buzzer (Abnormal input status alarm output means)
50 In-vehicle LAN
150 Captured image 200B Main image 201 Switch image (operation icon)
200H approaching object image H approaching object

Claims (12)

An operation panel having a touch operation surface disposed on the upper surface;
Touch input detection means for detecting a touch input on the touch operation surface;
A pressing biasing force level detecting means for detecting a pressing biasing force level on the touch operation surface according to the detected touch input;
An abnormal input state alarm output means for specifying an abnormal input state when the detected pressing biasing force level exceeds a predetermined threshold level, and outputting an alarm;
An operation input device comprising: An operation panel having a touch operation surface disposed on the upper surface;
Touch input detection means for detecting a touch input on the touch operation surface;
An input time timing means for timing the input duration of the detected touch input;
When the detected input duration exceeds a predetermined threshold time, the abnormal input state is identified and an abnormal input state alarm output means for outputting an alarm;
An operation input device comprising:   The pressure urging force level detection means is arranged on the back side of the operation panel and interposed between the operation support panel and a panel support that supports the operation panel, and is applied with input urging of the operation panel. The operation input device according to claim 1, wherein the operation input device is configured as a pressure sensor that outputs a signal corresponding to the pressure. The touch input detection unit is a touch input position specifying unit that performs detection of the touch input to the touch operation surface in a form that specifies an input position on the touch operation surface on which the touch input is performed,
The operation input device according to any one of claims 1 to 3, further comprising a control unit that outputs a control signal for executing control content corresponding to the specified input position.   The touch input detection means is disposed on the back side of the operation panel and interposed between the touch panel support and the panel support that supports the operation panel, and according to the pressure applied in response to the input bias of the operation panel. The operation input device according to any one of claims 1 to 3, wherein the operation input device is configured as a pressure sensor that outputs a signal. Touch input position specifying means for detecting the touch input to the touch operation surface in a form of specifying an input position on the touch operation surface on which the touch input is made;
Control means for outputting a control signal for executing the control content corresponding to the specified input position;
The operation input device according to claim 5. A display screen is provided at a position different from the operation panel, and an operation icon can be displayed on the display screen. On the other hand, there is a correspondence between the display screen and the touch operation surface of the operation panel. Provided with a display means that can be uniquely specified, the other in-plane position corresponding to the one in-plane position,
When the input position on the touch operation surface specified by the touch input position specifying means is a position corresponding to a display position of the operation icon displayed on the display screen, the control means performs the operation. The operation input device according to claim 4 or 6, which outputs a control signal for executing control contents corresponding to an icon. Hand image photographing means for photographing a hand image of an operator who operates the touch operation surface;
Hand image composition display control means for compositing and displaying the photographed hand image at a corresponding position on the display screen;
The operation input device according to claim 7. The operation panel is provided adjacent to a seat portion of the seat so that the operation panel can be operated from a passenger in a predetermined seat in the vehicle interior,
The operation input device according to claim 7 or 8, wherein the display screen is provided at a position that is visible to a passenger of the seat.   The abnormal input state alarm output means stops the alarm output when the abnormal input state is no longer specified in the state in which the alarm is output. Operation input device.   The operation input device according to any one of claims 1 to 10, wherein the abnormal input state alarm output means is configured as a buzzer. Comprising the requirements of claim 9;
The operation input device according to claim 11, wherein a navigation device is mounted in the vehicle interior, and the buzzer is mounted on the navigation device.