JP2008310795A - Operation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation device that receives operations, executed to switches, without having a contact for detecting the operations executed to switches and a circuit board, mounted with the contact, with almost no restriction on design and an arrangement place or the like. <P>SOLUTION: A camera 1, a light source 2, and a photosensor 3 or the like are arranged on the rear-face side of a control panel 5 provided with push switches 6-8. The push switches 6-8 are imaged by the camera 1 from the rear-face side. An ECU 10 detects operations executed to the push switches 6-8 on the basis of the images acquired by the imaging. The photosensor 3 detects the brightness so as to turn on/off the light source 2 corresponding to the brightness. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an operating device that includes one or a plurality of switches for operating an electric device, and that receives and processes operations such as a pressing operation, a contact operation, and a rotating operation on the switch.

  2. Description of the Related Art Conventionally, various switches such as a push switch, a rotation switch, or a slide switch have been used to accept a user operation on an electric device. A plurality of various switches are provided on the operation panel, so that a wide variety of operations from the user can be received, and the electric device can be operated according to the operation. In such an operation device, a circuit board on which a plurality of electrical contacts are mounted is arranged on the back side of the operation panel, and the electrical contact is switched between on and off in conjunction with the operation on the switch. Detects and accepts user operations on.

  A touch panel type operation device is also used instead of such a contact type. A touch panel type operation device accepts a user's touch operation on a menu or icon displayed on the display by combining a display that displays a menu or icon and a touch sensor disposed on the surface of the display. Can do. Since a menu or an icon displayed on the display can be changed according to the situation, it is suitable for operation of a multifunctional electric device.

  In Patent Document 1, when an operator tries to press the push button with a finger, it is detected that the finger blocks the light emitted from the light emitting means, and it is visually or audibly that the finger has approached the switch. There has been proposed a switch device that transmits information to an operator as message information. This switch device has an advantage that the operator can confirm whether or not the switch is a desired switch before operating the switch, so that the switch operation can be reliably performed without erroneous operation.

In Patent Document 2, a finger interface having a surface on which a finger can be pressed, a light source that irradiates the finger pressed on the surface, an optical image sensor that captures an image of reflected light and transmits an image signal, And a method and system for optically detecting clicks by analyzing an image signal and determining whether the image signal represents a finger click action.
JP 2000-181602 A JP 2004-348739 A

  In the case of a conventional contact type operation device, it is necessary to arrange a circuit board on which electrical contacts are mounted on the back side of the operation panel on which the switch is disposed. Since the circuit board has a plate shape, the shape of the operation panel on which the switch is disposed needs to be a flat shape or a shape close to this. For this reason, there is a problem that the design of the operation panel is restricted. Further, since a space for arranging the circuit board is required, there is a problem that the arrangement position of the switch is restricted. In the case of a touch panel type operation device, since it is necessary to dispose a display, there are more restrictions on the design and the disposition position.

  For example, various electric devices such as an audio device and a car navigation device are mounted on the vehicle, and various switches for operating these devices are arranged on the instrument panel of the vehicle. In recent vehicles, not only the function but also the design of the interior is regarded as important, and the design including the curved surface as well as the plane is sometimes preferred for the instrument panel. As described above, since it is not easy to dispose switches on the curved surface portion in the contact type operation device, the design of the instrument panel is limited as the number of switches disposed is large. In addition, it is not easy to dispose the switch in a portion other than the instrument panel in the vehicle, such as a handle or a door.

  The switch device described in Patent Document 1 requires a large number of components such as a light emitting unit, a light receiving unit, a membrane switch, a display, and a touch panel in addition to a push button, and thus the size of the device may increase. Have the same problems as described above. The method and system for optically detecting a click described in Patent Document 2 are configured to analyze a finger image pressed against a finger interface to determine whether or not a click operation is represented. It is necessary to irradiate the finger with light from a light source provided in the apparatus through the interface, and a sensor in the apparatus receives the reflected light. Therefore, since the finger interface needs to transmit light, it must be made of transparent glass or the like, and selection of the material constituting the finger interface is greatly limited. In addition, the shape of the finger interface is also restricted in order to increase the detection accuracy of the sensor. Furthermore, it is not easy to determine whether or not a click operation is represented from a finger image.

  The present invention has been made in view of such circumstances, and an object of the present invention is to take an image of a displacement portion such as a push switch that is displaced according to an operation with a camera or the like, and to displace based on the taken image. Operation that can accept an operation on a displacement part without providing a contact for detecting the operation on the displacement part and a circuit board on which the contact is mounted, by detecting the displacement of the part. To provide an apparatus.

  Another object of the present invention is to provide a configuration in which the displacement portion is imaged from the back side of the operation panel on which the displacement portion is disposed, so that the imaging means is reliably imaged without being exposed to the outside. An object of the present invention is to provide an operating device that can be used to accept operations.

  Further, another object of the present invention is to provide a space for mounting the imaging means in the inside by imaging the displacement part from the surface side of the operation panel provided with the displacement part. There is no operating device to provide.

  Another object of the present invention is to obtain ambient information related to the brightness around the displacement part and irradiate light to the displacement part according to the ambient information, so that the surroundings such as at night can be obtained. An object of the present invention is to provide an operating device that can pick up an image of a displacement portion even in a dark situation and can reliably accept an operation.

  Another object of the present invention is to irradiate light that is invisible to the user by irradiating infrared light to the displacement portion and receiving the infrared light by the imaging means. Thus, an object of the present invention is to provide an operating device that can take an image and accept an operation.

  Another object of the present invention is to provide an infrared light cut filter that cuts infrared light, and receives light including infrared light according to ambient information related to the brightness around the displacement portion. Infrared light incident on the image pickup means that picks up the image is cut with an infrared light cut filter. An object of the present invention is to provide an operating device that can perform imaging with light other than infrared light in a bright situation and can reliably accept an operation.

  Another object of the present invention is to compare the images of a plurality of displacement parts captured at different times by the imaging means and detect the displacement of the displacement part based on the change that has occurred in the images. Accordingly, an object of the present invention is to provide an operating device that can easily and reliably detect an operation on a displacement portion by image processing.

  Another object of the present invention is to provide a concealment part that is exposed to the image pickup means by the displacement of the displacement part, and whether or not the concealment part is reflected in an image acquired by the image pickup means. Accordingly, an object of the present invention is to provide an operating device capable of easily and accurately performing detection by image processing by adopting a configuration for detecting the displacement of the displacement portion accordingly.

  Another object of the present invention is that the rocking body is swung by the pressing operation body protruding from the operation panel, the moving body causes the displacement portion having the concealed portion to protrude from the operation panel, and the imaging means takes an image. By providing a configuration that detects the displacement of the displacement portion depending on whether or not the concealed portion is reflected in the acquired image, an operation device that can perform detection by image processing easily and accurately is provided. There is.

  Another object of the present invention is to provide a concealed portion in a displacement portion that is displaced by swinging, and when the displacement portion is swung to one side, the concealed portion is concealed and swung to the other. Image processing by adopting a configuration in which the concealed portion is exposed when the image is captured, and the displacement of the displacement portion is detected depending on whether or not the concealed portion is reflected in the image acquired by the imaging unit. It is an object of the present invention to provide an operating device capable of easily and accurately performing detection based on the above.

  Another object of the present invention is to provide a concealed part in the displacement part that appears and disappears in the operation panel, conceal the concealed part by immersing the displacement part, and conceal the image acquired by the imaging means. An object of the present invention is to provide an operating device capable of easily and accurately performing detection by image processing, by detecting the displacement of the displacement portion depending on whether or not the portion is projected.

  Another object of the present invention is that the elastic body is interposed between the displacement portion and the operation panel, so that the displacement portion can be urged away from the operation panel, and An object of the present invention is to provide an operating device capable of giving an operational feeling to a user.

  Another object of the present invention is to make the displacement part and the operation panel integrally formed of an elastic body, thereby facilitating the manufacture of the displacement part and the operation panel, and for the user. An object of the present invention is to provide an operating device capable of giving a feeling of operation to it.

  Another object of the present invention is that when a plurality of displacement portions are provided, any concealment portion associated with each displacement portion is made to have a different size and / or a different shape. It is an object of the present invention to provide an operating device that can easily determine whether or not the position of the device is displaced.

  Another object of the present invention is to accurately determine the presence / absence of a concealed part by image processing by reflecting the light emitted from the irradiating means by a reflecting part provided in the concealed part. An object of the present invention is to provide an operating device that can perform the operation.

  Another object of the present invention is that the imaging unit captures infrared light reflected by the reflection unit provided in the concealed unit by the irradiation unit irradiating infrared light, so that the user can It is an object of the present invention to provide an operating device that can perform imaging by irradiating invisible light.

  An operating device according to a first aspect of the present invention is a displacement unit that is displaced according to an operation, an imaging unit that images the displacement unit, and a detection unit that detects a displacement of the displacement unit based on an image captured by the imaging unit. When the detection means detects a displacement, an operation for the displacement portion is received.

  In the present invention, a displacement portion that is displaced in accordance with an operation such as a switch pressed down by a pressing operation or a switch rotated by a rotating operation is imaged by an imaging means such as a camera. It is possible to detect by image processing whether or not the displacement portion has been displaced based on the captured image by constantly imaging the displacement portion by the imaging means. Since it is not necessary to provide the contact and the circuit board on which the contact is mounted in the vicinity of the displacement portion, a configuration such as disposing the displacement portion on a curved surface can be easily realized. A circuit board on which an IC for performing image processing is mounted is necessary. However, if only the image pickup means is provided in the vicinity of the displacement portion, the circuit board does not need to be provided in the vicinity of the displacement portion. Can be connected with a cable or the like, so that the disposition position of the displacement portion and the design of the operation panel are not restricted. Since recent imaging means can be sufficiently downsized, the imaging means is not a limitation.

  According to a second aspect of the present invention, there is provided an operation device including an operation panel provided with the displacement portion, wherein the imaging means images the displacement portion from the back side of the operation panel. To do.

  In the present invention, an imaging means is provided on the back side of the operation panel provided with the displacement part, and the displacement part is imaged from the back side. Since the back side of the operation panel is a portion that is not exposed to the outside, the imaging of the displacement portion by the imaging means is not hindered, and imaging can be performed reliably. Since recent imaging means are sufficiently small, there is no need for a large space for mounting the imaging means on the back side of the operation panel.

  According to a third aspect of the present invention, there is provided an operating device including an operation panel provided with the displacement portion, wherein the imaging unit images the displacement portion from the surface side of the operation panel. To do.

  In the present invention, imaging means is provided on the surface side of the operation panel provided with the displacement portion, and the displacement portion is imaged from the surface side. Even in a space that is so limited that a sufficiently small image pickup means cannot be mounted on the back side of the operation panel, the displacement portion can be disposed.

  According to a fourth aspect of the present invention, there is provided an operating device for acquiring ambient information relating to brightness around the displacement unit, and irradiating the displacement unit with light according to the ambient information acquired by the acquisition unit. And an irradiating means.

  In the present invention, ambient information related to the brightness around the displacement unit is acquired. For example, information related to brightness can be directly obtained using a sensor that senses light. In addition, when the operation device is mounted on a vehicle, it is possible to determine whether it is nighttime or not based on whether the headlamp or the room lamp is lit or not, so information on brightness is indirectly acquired. be able to. It is good also as a structure which judges brightness based on the image which the imaging means imaged. Based on the acquired information on the brightness, the displacement part is irradiated with light. In a dark situation such as at night, the image captured by the imaging means becomes dark and it is not easy to detect an operation based on the image, but the operation can be detected by irradiating the displacement part with light. .

  In the operating device according to the fifth aspect of the invention, the irradiating unit irradiates infrared light, and the imaging unit receives light including the infrared light and performs imaging. It is characterized by that.

  In this invention, it is set as the structure which irradiates infrared light to a displacement part, and an imaging means receives infrared light and images. Since infrared light is invisible to human eyes, even if the displacement part is always irradiated with infrared light, there is little influence on surrounding people. For example, when the operating device is mounted on a vehicle, irradiation with visible light may hinder the driving of the driver, but infrared light is not visible to the driver and thus does not hinder driving.

  According to a sixth aspect of the present invention, there is provided an operating device in which the imaging unit is configured to receive an image including infrared light and perform imaging, and a red that cuts infrared light incident on the imaging unit. An external light cut filter, an acquisition means for acquiring ambient information related to the brightness around the displacement portion, and a switching means for switching the presence or absence of the infrared light cut filter according to the ambient information acquired by the acquisition means; It is characterized by providing.

  In the present invention, light including infrared light is received and the imaging means images the displacement part. As a result, even when the surroundings are dark, such as at night, the imaging unit can capture the displacement portion, and the operation on the displacement portion can be detected from the captured image. However, in situations where the surroundings are bright such as during the daytime, the amount of light received by the imaging means is excessive and there is a risk that whitening may occur, so imaging is performed through a filter that cuts off infrared light. The presence / absence of an infrared light cut filter is switched based on ambient information related to the brightness around the displacement portion.

  In the operating device according to a seventh aspect of the invention, the detecting means compares a plurality of images taken at different times by the imaging means, and detects the displacement of the displacement portion based on a change that has occurred in the images. It is characterized by being.

  In the present invention, the imaging means continuously captures the displacement part and acquires an image. Since the displacement part is displaced when the displacement part is operated, it is possible to determine whether or not the displacement part has been displaced by comparing a plurality of images taken at different time points and detecting a change occurring in the image. . Therefore, the operation on the displacement portion can be detected by simple image processing that only detects changes by comparing the images.

  The operating device according to an eighth aspect of the present invention is fixed so as not to change with the change of the displacement portion, is hidden from the imaging means by the displacement portion, and is exposed with the displacement of the displacement portion. A concealment unit is further provided, and the detection unit detects a displacement of the displacement unit according to whether or not the concealment unit is reflected in an image captured and acquired by the imaging unit. It is characterized by that.

  In the present invention, a concealed portion that is concealed from the imaging means by the displacement portion is provided on the operation panel. When the displacement part is displaced by a user operation, the concealed part is exposed. That is, the concealed part is concealed when the displacement part is not displaced, and the concealed part is exposed when the displacement part is displaced. The imaging means images the displacement part and the concealed part concealed by the displacement part. When the concealed part is reflected in the image acquired by the image pickup means, it can be determined that the displacement part has been displaced, and when the concealed part is not reflected, the displacement part is It can be determined that there is no displacement.

  An operating device according to a ninth aspect of the present invention is an operation panel provided with the displacement portion, and is provided in the displacement portion. The operation device protrudes and disappears from the operation panel along with the displacement of the displacement portion. A concealed part that is concealed from the imaging means when immersed, a pressing operation part that is arranged so as to be able to appear and retract on the operation panel, and swings as the pressing operation part appears and disappears And an oscillating body that exposes the concealed portion of the displacement portion from the operation panel when the pressing operation portion is immersed, and the detection means captures the captured image on the image acquired by the imaging means. The displacement of the displacement part is detected according to whether or not the concealing part is shown.

  In the present invention, the pressing operation body is provided in the operation panel so as to be able to appear and retract, the rocking body is swung by the pushing operation body, and the rocking body causes the displacement part to appear and disappear from the operation panel. The displacement part is provided with a concealed part that appears and disappears from the operation panel when the displacement part appears and disappears and is concealed from the imaging means when the displacement part is immersed. That is, the concealed portion is concealed when the pressing operation body is not operated, and the concealed portion is exposed when the pressing operation body is operated. When the concealed part is reflected in the image acquired by the imaging means that captures the displacement part, it can be determined that the displaced part has been displaced, and when the concealed part is not reflected Can be determined that the displacement portion is not displaced.

  An operating device according to a tenth aspect of the present invention is an operation panel disposed so that the displacement portion swings and displaces, and provided in the displacement portion, and the displacement portion is swung to one side. And a concealment part that is concealed with respect to the image pickup means and exposed when the image pickup means is swung to the other, and the detection means includes the concealment part in an image acquired by the image pickup means. The displacement of the displacement part is detected according to whether or not it is projected.

  In the present invention, the operation panel is provided with a displacement portion that is displaced by swinging. The displacement part is provided with a concealed part that is concealed when the displacement part is swung to one side and exposed when the displacement part is swung to the other side. That is, the concealed part is concealed when the displacement part is swung to one side, and the concealed part is exposed when the displacement part is swung to the other side. When the concealed part is reflected in the image acquired by the imaging means that captures the displacement part, it can be determined that the displaced part has been displaced, and when the concealed part is not reflected Can be determined that the displacement portion is not displaced.

  According to an eleventh aspect of the present invention, there is provided an operating device according to an eleventh aspect of the present invention, wherein an operating panel is provided so that the displacement portion protrudes and displaces and displaces, and the displacement portion is provided with respect to the imaging means by the immersion of the displacement portion. And a concealment part to be concealed, wherein the detection means detects the displacement of the displacement part according to whether or not the concealment part is reflected in an image captured and acquired by the imaging means. It is characterized by the above.

  In the present invention, the displacement portion is provided on the operation panel so as to be able to appear and disappear. The displacement part is provided with a concealed part that is concealed when immersed in the operation panel. That is, the concealed part is concealed when the displacement part is immersed and displaced, and the concealed part is exposed when the displacement part is not immersed and displaced. When the concealed part is not reflected in the image acquired by the imaging unit that captures the displacement part, it can be determined that the displaced part has been displaced, and when the concealed part is reflected Can be determined that the displacement portion is not displaced.

  The operation device according to a twelfth aspect of the present invention further includes an elastic body interposed between the displacement portion and the operation panel.

  In the present invention, an elastic body is interposed between the displacement portion and the operation panel. When the displacement portion is displaced in a direction approaching the operation panel, for example, by being pressed, the displacement portion is biased in a direction away from the operation panel by the elastic body. When the user's operation is released by the urging force of the elastic body, the displacement portion can be returned to the original position. Further, the user can obtain an operational feeling for the operation by the biasing force of the elastic body.

  The operating device according to a thirteenth aspect of the invention is characterized in that the displacement portion and the operation panel are integrally formed of an elastic body, and the displacement portion is displaced by deformation with respect to a pressing operation. To do.

  In the present invention, the displacement portion and the operation panel are integrally formed of an elastic body. Thereby, for example, a deformation such as a depression of the displacement portion of the elastic body can be caused by a pressing operation or the like, and this deformation is detected as a displacement of the displacement portion. Manufacturing is facilitated because the displacement portion and the operation panel are integrated. In addition, the user can obtain an operational feeling for the operation by the elastic force of the elastic body.

  In addition, the operating device according to the fourteenth aspect includes a plurality of the displacement portions and the concealed portions respectively associated with each other, and the concealed portions associated with the respective displacement portions have different sizes and / or different sizes. It is characterized by having a shape.

  In the present invention, the operating device includes a plurality of displacement units and concealed units respectively associated with each other. In addition, the concealed portion of each displacement portion has a different size and / or a different shape. Thereby, by examining the size and / or shape of the concealment part reflected in the image captured and acquired by the imaging means, it is possible to easily determine which concealment part is exposed, It can be easily determined which displacement part has been displaced. In addition, when only a part of the concealed part is imaged, it can be determined that there is a possibility that a foreign object exists between the imaging unit, the displacement part, and the concealed part, thereby preventing erroneous detection. be able to.

  The operating device according to the fifteenth aspect of the present invention is further characterized by further comprising: an irradiating unit that irradiates light; and a reflecting unit that is provided in the concealed portion and reflects the light irradiated by the irradiating unit.

  In the present invention, an irradiating means for irradiating light to the displacement part, the concealed part and the periphery thereof is provided. Further, the concealed portion is provided with a reflecting portion that reflects the light emitted by the irradiation means. Thereby, since the light is reflected when the concealed portion is exposed, it is possible to easily and accurately determine whether or not the concealed portion is reflected in the image acquired by the imaging unit. . In addition, it is difficult to determine whether or not the concealed part is reflected in the image captured and captured by the imaging unit, but this can be solved by irradiating the irradiation unit with light. .

  In the operating device according to a sixteenth aspect of the invention, the irradiating means irradiates infrared light, the reflecting portion reflects the infrared light, and the imaging means It is characterized in that imaging is performed by receiving infrared light.

  In the present invention, the irradiating means irradiates infrared light, the reflecting part provided in the concealed part reflects infrared light, and the imaging means images the infrared light reflected by the reflecting part. In the configuration in which the irradiating means emits visible light, the user may feel this light dazzling at night. Since infrared light is invisible to human eyes, such a problem does not occur.

  In the case of the first invention, the displacement part such as a switch that is displaced according to the operation is imaged, the displacement of the displacement part is detected based on the captured image, and the operation with respect to the displacement part is received. It is not necessary to provide a circuit board on which this is mounted in the vicinity of the displacement portion, and a configuration such as disposing the displacement portion on a curved surface can be easily realized. Therefore, restrictions on the disposition position of the displacement part can be reduced, and restrictions on the shape and design of the operation panel on which the displacement part is arranged can be reduced. Etc. can be enhanced.

  According to the second aspect of the present invention, the displacement part is imaged from the back side of the operation panel on which the displacement part is disposed, so that the imaging part is imaged without exposing the imaging means to the outside. Therefore, imaging can be performed reliably, and the reliability of operation detection by the operation device can be improved.

  Further, in the case of the third invention, since the displacement portion is imaged from the front surface side of the operation panel provided with the displacement portion, a small imaging means cannot be mounted on the back side of the operation panel. Since the displacement portion can be disposed even in a limited space, it is possible to further reduce the restriction of the disposition position of the displacement portion, such as the shape and design of the operation panel in which the displacement portion is disposed. Constraints can be further reduced.

  Further, in the case of the fourth invention, the ambient information related to the brightness around the displacement part is acquired and the displacement part is irradiated with light according to the ambient information, so that the surroundings are dark such as at night. Even if there is, it is possible to detect the operation on the displacement part by irradiating light to the displacement part. Therefore, it is possible to accept the operation on the displacement part regardless of day and night, and the operation device can more reliably detect the operation. Can be increased.

  According to the fifth aspect of the invention, the displacement portion is always irradiated with infrared light by irradiating the displacement portion with infrared light and receiving the infrared light with the imaging means to perform imaging. Even in this case, since infrared light is invisible to human eyes, it is possible to reliably perform imaging of the displacement portion, detection of an operation on the displacement portion, and the like without affecting surrounding people. Therefore, the reliability of the operation detection with respect to the displacement part can be improved without reducing the convenience of the operating device.

  Further, in the case of the sixth invention, the displacement part is picked up by the imaging means by receiving light including infrared light, and an infrared light cut filter for cutting infrared light is provided, and the periphery of the displacement part By adopting a configuration in which the presence or absence of an infrared light cut filter is switched according to the ambient information related to the brightness of the image, the displacement part can be reliably imaged both in the daytime and at night. Therefore, the reliability of the operation detection by the operation device can be further improved.

  Further, in the case of the seventh invention, the image is obtained by comparing the images of the plurality of displacement portions captured at different time points by the imaging means and detecting the displacement of the displacement portion based on the change generated in the image. Therefore, it is possible to detect an operation on the displacement unit by simple image processing that only detects a change, and the processing load of the operation device does not increase, so that an increase in cost of the operation device can be suppressed.

  According to the eighth aspect of the present invention, there is provided a concealed portion that is exposed by the displacement of the displacement portion, and the displacement is detected by detecting whether the concealed portion is reflected or not. The displacement of the portion can be easily and accurately performed by image processing, and the reliability of the operation detection by the operation device can be further increased.

  According to the ninth aspect of the invention, the oscillating body is oscillated by the appearance of the pressing operation body, the oscillating body causes the displacement part having the obscured part to appear, and the obscured part is included in the image acquired by the imaging means. By adopting a configuration that detects the displacement of the displacement portion according to whether or not it is reflected, the displacement of the displacement portion can be easily and accurately performed by image processing, and the operation detection by the operation device is more reliable. Can be increased.

  According to the tenth aspect of the present invention, the concealed part that is concealed from the imaging unit along with the swing is provided in the displacement part that is displaced by the swing, and the concealed part is reflected in the image acquired by the image capturing unit. By detecting the displacement of the displacement portion according to whether or not the displacement is detected, the displacement of the displacement portion can be easily and accurately performed by image processing, and the reliability of the operation detection by the operation device is further improved. Can do.

  According to the eleventh aspect of the invention, the concealed part is concealed by immersing the displacement part into the operation panel, and the displaceable part is determined depending on whether or not the concealed part is reflected in the image acquired by the imaging means. With this configuration, the displacement of the displacement portion can be easily and accurately performed by image processing, and the reliability of the operation detection by the operation device can be further improved.

  According to the twelfth aspect of the invention, an elastic body is interposed between the displacement section and the operation panel, so that the displacement section can be returned to the original position by the urging force of the elastic body. Therefore, the operability of the operating device can be improved.

  According to the thirteenth aspect of the present invention, since the displacement portion and the operation panel are integrally formed of an elastic body, manufacturing of the displacement portion and the operation panel can be facilitated. Can be In addition, since the operation feeling can be given to the user by the elastic force of the elastic body, the operability of the operating device can be improved.

  Further, in the case of the fourteenth invention, a plurality of displacement portions and concealed portions are provided, and the concealed portions associated with the respective displacement portions are displayed in an image by having different sizes and / or different shapes. By examining the size and / or shape of the concealed part, it is possible to easily determine which concealed part is exposed and easily determine which displacement part is displaced. Therefore, it is possible to further improve the reliability of the operation detection by the operation device including a plurality of displacement units.

  According to the fifteenth aspect of the invention, the reflection unit provided in the concealed part reflects the light emitted from the irradiation unit, so that the image acquired by the imaging unit can be obtained even at night. Since it is possible to easily and accurately determine whether or not the concealment portion is reflected, the reliability of the operation detection by the operation device can be further increased.

  According to the sixteenth aspect of the invention, the irradiating means irradiates the infrared light, and the irradiating means irradiates the infrared light reflected by the reflecting portion provided in the concealed portion. Since the user can take an image with the imaging means without causing the user to feel dazzling at night or the like, the displacement of the displacement portion can be accurately detected. The reliability of detection can be further increased.

(Embodiment 1)
Hereinafter, the present invention will be specifically described with reference to the drawings showing embodiments thereof. FIG. 1 is a schematic diagram showing a configuration of an operating device according to Embodiment 1 of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows a operated state. is there. As an example, the operating device according to the present embodiment is an operating device that accepts an operation on an audio device mounted on a vehicle, but is not limited thereto.

  In the figure, reference numeral 5 denotes a part of an instrument panel in a vehicle (not shown), which also serves as an operation panel in which a plurality of switches of the operation device according to the present embodiment is disposed (hereinafter referred to as operation panel 5 and To describe). The operation panel 5 is formed of, for example, a synthetic resin and has a curved plate shape. On the surface of the operation panel 5, three push switches 6 to 8 are arranged in parallel along the bending direction of the operation panel 5.

  The push switches 6 to 8 have a substantially rectangular parallelepiped shape, and are inserted into the operation panel 5 when pressed by the user, and to the front side of the operation panel 5 when not pressed. It is urged by a member such as a spring (not shown) so that a part thereof protrudes. In addition, when the pressure switch is pressed and immersed in the operation panel 5, a part of the push switches 6 to 8 protrudes (i.e., displaces) to the back side of the operation panel 5, and this part is hereinafter referred to as a displacement part 6a. ˜8a (see FIG. 2). The user can perform mode switching, music selection, volume adjustment, and the like of the audio device mounted on the vehicle by pressing the push switches 6 to 8.

  On the back side of the operation panel 5, that is, inside the instrument panel of the vehicle, a space for accommodating the camera 1, the light source 2, and the optical sensor 3 is provided. The camera 1, the light source 2, and the optical sensor 3 are provided at appropriate positions of the vehicle. It is connected to an ECU (Electronic Control Unit) 10 mounted on the vehicle using a cable or the like.

  The camera 1 includes an imaging device such as a CCD (Charge Coupled Device) inside, and can capture images with a frequency of several to several tens of times per second, and outputs the captured images to the ECU 10. To give. The camera 1 is mounted at a position where the back surface of the operation panel 5, specifically, the back surface of the portion where the push switches 6 to 8 are disposed, can be imaged, and the displacement portions 6 a to 6 of each push switch 6 to 8. The displacement 8a can be imaged.

  The light source 2 is controlled to be turned on and off by the ECU 10, and radiates visible light to the back surface of the operation panel 5. The irradiation range by the light source 2 is wider than the imaging range of the camera 1. In addition, when the light source 2 mounts the light source for backlight of an instrument panel, the light source for illumination lamps, etc. in the vehicle, the structure which combines these light sources may be sufficient. The optical sensor 3 detects brightness by a light receiving element and outputs a voltage corresponding to the brightness, and the detection result is given to the ECU 10 as ambient information. The optical sensor 3 is preferably disposed in the vicinity of the push switches 6 to 8 on the back surface of the operation panel 5, whereby the ECU 10 can acquire information relating to the imaging range of the camera 1 and the surrounding brightness. .

  FIG. 2 is a schematic diagram showing a rear view of the operation panel 5 of the operating device according to the first embodiment of the present invention. In FIG. 2, (a) shows a state where the operating device is not operated, and (b) shows a state where the operating device is operated. This corresponds to (a) and (b) in FIG. Is. 2 is equivalent to an image picked up by the camera 1. When the push switches 6 to 8 are not pressed, the push switches 6 to 8 protrude to the front surface side of the operation panel 5 without being immersed in the operation panel 5. The image captured by the camera 1 at this time is an image in a state where the displacement portions 6a to 8a of the push switches 6 to 8 do not protrude as shown in FIG.

  On the other hand, for example, when the push switch 8 is pressed, the push switch 8 is immersed in the operation panel 5 and the displacement portion 8a protrudes to the back side of the operation panel 5. At this time, as shown in FIG. 2B, the image captured by the camera 1 does not project the displacement portions 6a and 7a of the push switches 6 and 7, and only the displacement portion 8a of the push switch 8 projects. It is an image of a state.

  The ECU 10 sequentially acquires images continuously captured by the camera 1 and sequentially compares the images. At this time, the ECU 10 can calculate the difference by comparing the pixel values of two images taken at different times, for example, and can determine that a change has occurred when the difference exceeds a threshold value. As a result of the comparison, when a change has occurred in the image, the ECU 10 can further determine which of the displacement portions 6a to 8a has been displaced by specifying the location where the change has occurred in the image. It can be determined which push switch 6-8 has been operated.

  FIG. 3 is a block diagram showing a configuration of ECU 10 of the operating device according to Embodiment 1 of the present invention. The ECU 10 includes three I / F (interface) units 11 to 13, an image processing unit 14, an image memory 15, a control unit 16, a ROM 17, a RAM 18, a communication unit 19, and the like. The three I / F units 11 to 13 each have a connection terminal for connecting a cable. The camera 1 is connected to the I / F unit 11 via the cable, and the light source 2 is connected to the I / F 12. The optical sensor 3 is connected to the I / F unit 13. An image captured by the camera 1 is provided as an image signal from the camera 1 to the I / F unit 11, converted into digital image data by the I / F unit 11, and provided to the image processing unit 14. is there.

  The image processing unit 14 sequentially acquires the images captured by the camera 1 as described above under the control of the control unit 16 and performs processing for detecting changes by comparing the images. The control unit 16 is notified. Further, the image processing unit 14 can store the acquired image temporarily in the image memory 15 and the data generated in the comparison process. The image memory 15 is composed of a data rewritable memory element such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory).

  Specifically, the control unit 16 is configured by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like, and reads out and executes a program and data stored in advance in the ROM 17 to thereby execute each unit of the controller device. The control process and various arithmetic processes are performed. The ROM 17 is configured by a nonvolatile memory element such as a mask ROM, an EEPROM (Electrically Erasable Programmable ROM), or a flash memory, and various software programs necessary for the operation of the ECU 10 are stored in advance. The RAM 18 stores temporary data generated when the control unit 16 performs control processing, arithmetic processing, or the like, and includes a rewritable memory element such as SRAM (Static RAM) or DRAM (Dynamic RAM). It is.

  The detection result of ambient brightness by the optical sensor 3 is given as ambient information from the I / F unit 13 to the control unit 16, and the control unit 16 generates a light source according to the detection result of the given optical sensor 3. 2 is controlled to turn on / off. At this time, the control unit 16 transmits a turn-on command or a turn-off command to the light source 2 via the I / F unit 12. When the brightness of the light source 2 can be adjusted in multiple stages, the control unit 16 may be configured to adjust the brightness of the light source 2 according to the detection result of the optical sensor 3. In the case of the present embodiment, the operation panel 5 is made of synthetic resin, and light from the front side is transmitted to the back side of the operation panel 5, so that the camera 1 is not turned on during the daytime. In the case where the operation panel 5 is made of a material that does not transmit light such as metal, the light source may be constantly turned on without providing the optical sensor 3.

  The communication unit 19 is connected to a network NW such as a CAN (Controller Area Network) or LAN (Local Area Network) mounted on the vehicle, and communicates with other devices mounted on the vehicle. . In the operating device according to the present embodiment, when it is detected that the push switches 6 to 8 are operated, the control unit 16 operates the audio device 50 by the communication unit 19 (that is, the pushed push switches 6 to 6 are pressed). A message notifying 8) is transmitted. Thereby, the audio apparatus 50 can perform processing such as music selection or volume adjustment according to the operation content.

  FIG. 4 is a flowchart showing a procedure of a switch operation detection process performed by the operating device according to the first embodiment of the present invention, and shows a process performed by the control unit 16 of the ECU 10. First, the control unit 16 acquires an image captured by the camera 1 in the image processing unit 14 (step S1), stores this image in the image memory 15 (step S2), and stores it before (immediately before). The image is read from the image memory (step S3). Next, the control unit 16 compares the two images, the image acquired in step S1 and the image read in step S3, in the image processing unit 14 (step S4), and the two images change. Whether it is present is checked (step S5).

  If there is a change in the two images (S5: YES), the control unit 16 acquires the position where the change has occurred in the image (step S6), and the displacement portion of each push switch 6-8 stored in advance. Based on the correspondence between the positions 6a to 8a and the imaging positions in these images, switch determination is performed to determine which push switch 6 to 8 has been operated (step S7). Next, the control unit 16 notifies the operation content obtained as a result of the switch determination from the communication unit 19 to the audio device 50 as a message (step S8). After notifying the audio device 50 of the operation content or when no change has occurred in the two images in step S5 (S5: NO), the process proceeds to step S9.

  The operating device according to the present embodiment is mounted on a vehicle. For example, when the ignition switch of the vehicle is turned off, the network NW is notified from another device that the acceptance of the operation to the push switches 6 to 8 is terminated. Is given as an end command via. The control unit 16 checks whether or not the end command is given by the communication unit 19 (step S9). When the end command is given (S9: YES), the operation of the camera 1 is stopped and the light source 2 is turned off. A termination process such as turning off is performed (step S10), and the switch operation detection process is terminated. When the end command is not given (S9: NO), the process returns to step S1, and the above-described processing of S1 to S9 is repeated until the end command is given, and the switch operation detection process is continuously performed. .

  FIG. 5 is a flowchart showing a procedure of a light source control process performed by the operating device according to the first embodiment of the present invention, and shows a process performed by the control unit 16 of the ECU 10. First, the control unit 16 acquires the ambient brightness detected by the optical sensor 3 as ambient information (step S21), and checks whether the ambient brightness exceeds a predetermined threshold (step S22). . When the ambient brightness exceeds the threshold (S22: YES), the control unit 16 turns off the light source 2 (step S23), and when the ambient brightness does not exceed the threshold (S22: NO), the light source 2 is turned on (step S24).

  Next, the control unit 16 checks whether or not an end command is given from another device in the communication unit 19 (step S25). If no end command is given (S25: NO), the process goes to step S21. Returning, the light source 2 is continuously turned on / off. When the end command is given (S25: YES), the light source 2 is turned off (step S26), and the control process of the light source 2 is ended.

  In the operating device having the above configuration, the push switches 6 to 8 are imaged by the camera 1, and the operations on the push switches 6 to 8 are detected by detecting the variation of the displacement portions 6a to 8a of the push switches 6 to 8 by image processing. Since it is not necessary to provide a contact point for detecting an operation on the push switches 6 to 8 and a circuit board on which the push switch 6 to 8 is mounted on the back side of the operation panel 5, the arrangement of the push switches 6 to 8 can be achieved. The installation location is not restricted, and the shape and design of the operation panel 5 are not restricted. Therefore, as shown in FIG. 1, the push switches 6 to 8 can be easily disposed on the curved operation panel 5. In addition, by providing the light source 2 and the optical sensor 3 on the back side of the operation panel 5 and irradiating light according to the ambient brightness, the image processing unit 14 can be used based on the image captured by the camera 1. The accuracy of the change detection to be performed can be increased.

  In the present embodiment, the push switches 6 to 8 mounted on the vehicle have been described as examples. However, the present invention is not limited to this, and the same configuration is applied to switches mounted on other electric devices. May be. In addition, the operation device is configured to receive an operation on the audio device of the vehicle. However, the configuration is not limited thereto, and the operation device may be configured to receive an operation on another device. Moreover, although it was set as the structure which an operation device receives operation with respect to push switch 6-8, it is not restricted to this, Similarly, even if it is a switch of other structures, such as a rotation switch or a slide switch, a switch is imaged with a camera. It can be determined whether or not an operation has been performed on the switch based on the acquired image. Further, the shape of the push switches 6 to 8 and the shape of the operation panel 5 are not limited to those illustrated.

  In addition, the operation device directly detects ambient brightness with the optical sensor 3 to acquire ambient information, and controls turning on / off of the light source 2. However, the present invention is not limited to this. It is possible to indirectly determine whether it is daytime or nighttime depending on whether or not the headlight or room lamp is turned on. It is good also as a structure which acquires as information and controls lighting / light extinction of the light source 2 according to this. In addition, the image processing unit 14 checks the brightness of an image captured and acquired by the camera 1 (for example, the brightness of each pixel of the image), thereby acquiring ambient information related to the ambient brightness. The light source 2 may be turned on / off. Of course, you may use these several methods together.

(Modification)
FIG. 6 is a block diagram showing a configuration of an operating device according to a modification of the first embodiment of the present invention. The operation device according to the modification is configured not to include the optical sensor 3 but to include an infrared light source 102 that emits infrared light instead of the light source 2 that emits visible light. The infrared light source 102 is configured to irradiate the back side of the operation panel 5 with near infrared light having a wavelength that cannot be seen by human eyes. In addition, the camera 101 included in the operation device according to the modification is a camera that can capture an image by receiving not only visible light but also infrared light. Thus, by setting it as the structure which irradiates the near-infrared light which cannot be seen by human eyes, it can prevent that a driver | operator's driving | operation is prevented by unnecessary light leaking from the clearance gap of the operation panel 5 at night.

(Embodiment 2)
Although the operation device according to Embodiment 1 is configured to arrange the camera 1 on the back side of the operation panel 5, there may be a case where a space for arranging the camera 1 on the back side of the operation panel 5 cannot be secured. Therefore, the operating device according to the second embodiment has a configuration in which the camera 101 is disposed on the front surface side of the operating panel 5. FIG. 7 is a schematic diagram showing the configuration of the operating device according to the second embodiment of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows a operated state. is there. In the operating device according to the second embodiment, a camera 101, an infrared light source 102, and an optical sensor 3 are arranged on the surface side of the operation panel 5, and are connected to an ECU 10 mounted at a proper position of the vehicle via a cable. It is.

  The camera 101 is a camera that can receive not only visible light but also near-infrared light having a wavelength invisible to human eyes, and is arranged above the operation panel 5. The three push switches 6 to 8 provided in FIG. The camera 101 captures images at a frequency of several to several tens of times per second, and gives the ECU 10 an image acquired by the imaging. In addition, when other cameras (for example, a camera that images the driver) are mounted on the vehicle and the push switches 6 to 8 are arranged within the imaging range of the camera, It is good also as a structure which shares a camera.

  In addition, the infrared light source 102 irradiates near infrared light that cannot be seen by human eyes and can be received by the camera 101 to at least a portion on the operation panel 5 where the push switches 6 to 8 are provided. is there. The ECU 10 controls the turning on / off of the infrared light source 102 according to the ambient brightness detected by the optical sensor 3.

  FIG. 8 is a schematic diagram showing a surface view of the operation panel 5 of the operating device according to the second embodiment of the present invention. In FIG. 8, (a) shows a state where the operating device is not operated, and (b) shows a operated state. Further, the surface view shown in FIG. 8 is equivalent to an image captured by the camera 101. In the operation device according to the second embodiment, since the camera 101 captures an image from the front side of the operation panel 5, the displacement portions 6b to 8b of the push switches 6 to 8 viewed from the camera 101 are the push switches 6 to 8, respectively. The portion protrudes from the operation panel 5.

  When the push switches 6 to 8 are not pressed, the push switches 6 to 8 protrude to the front surface side of the operation panel 5 without being immersed in the operation panel 5. The image captured by the camera 101 at this time is an image in a state where the displacement portions 6b to 8b of the push switches 6 to 8 protrude from the operation panel 5, as shown in FIG.

  On the other hand, for example, when the push switch 8 is pressed, the push switch 8 is immersed in the operation panel 5, and the displacement portion 8 b is immersed in the operation panel 5. At this time, as shown in FIG. 8B, the image captured by the camera 1 is such that the displacement portions 6b and 7b of the push switches 6 and 7 protrude from the operation panel 5, and only the displacement portion 8b of the push switch 8 is present. It is an image in a state of being immersed in the operation panel 5.

  The ECU 10 sequentially acquires images continuously captured by the camera 101, sequentially compares the images, and whether or not a change has occurred in the displacement portions 6b to 8b of the push switches 6 to 8 captured in the images. Judgment is made. When any of the displacement portions 6b to 8b changes, the ECU 10 can determine that the corresponding push switch 6 to 8 has been operated, and notify the audio device 50 of the operation content at this time. It is. However, unlike the operation device according to the first embodiment, in the operation device according to the second embodiment, the user's finger pressing the push switches 6 to 8 is imaged by the camera 101. It is preferable that the image processing unit 14 performs processing such as detecting the displacement of the displacement portions 6b to 8b by excluding the finger portion.

  In the operation device having the above configuration, since it is not necessary to arrange the camera 101 on the back side of the operation panel 5, the push switch 6 can be used even in a place where a space for arranging the camera 101 cannot be secured on the back side of the operation panel 5. Since ~ 8 can be arranged, the degree of freedom of arrangement of push switches 6-8 increases more. For example, when a switch is provided on the handle of a vehicle, the switch cannot be provided in the central portion of the handle so that the operation of the airbag is not hindered, and it is necessary to provide a switch in the peripheral portion. However, in the configuration of the operating device shown in the second embodiment, a switch can be provided at the center portion of the handle, and even in this case, the operation of the airbag is not hindered.

  In addition, since the other structure of the operating device which concerns on Embodiment 2 is the same as that of the operating device which concerns on Embodiment 1, the same code | symbol is attached | subjected to a corresponding location and description is abbreviate | omitted.

(Modification)
FIG. 9 is a block diagram showing a configuration of an operating device according to a modification of the second embodiment of the present invention. The camera 101 included in the operation device according to the second embodiment illustrated in FIG. 7 is a camera that receives and captures light including infrared light, but the operation device according to the modification illustrated in FIG. A camera 201 is provided that can receive infrared light for sensitivity and perform imaging. Thereby, it is possible to perform imaging with the camera 201 without the infrared light source 102 even at night. However, in a bright situation such as daytime, there is a possibility that the captured image may be crushed or the like. Therefore, the operation device according to the modification includes an optical filter 202 having a function of cutting infrared light out of light incident on the camera 201. In addition, imaging is performed through the optical filter 202 in bright conditions such as daytime, and imaging is performed without passing through the optical filter 202 in dark conditions such as nighttime.

  In order to switch the presence or absence of the optical filter 202, the imaging apparatus according to the modification includes a switching mechanism 207 that moves the optical filter 202 by an actuator or a gear mechanism. The switching mechanism 207 is configured to operate under the control of the control unit 16 of the ECU 10, and a position where the optical filter 202 blocks light incident on the camera 201 (position 202 a in the drawing) or light where the optical filter 202 enters the camera 201. The optical filter 201 is moved to a position that does not block the light (a position 202b in the drawing). The control unit 16 gives a switching command to the switching mechanism 207 according to the ambient brightness detected by the optical sensor 3 to change the presence or absence of the optical filter 202.

  The operating devices according to the above-described first and second embodiments are arranged such that the displacements of the displacement portions 6a to 8a of the push switches 6 to 8 are performed by image processing that compares pixel values of two images continuously captured by the camera. Is detected, and operations on the push switches 6 to 8 are detected. Therefore, in order to detect operations on the push switches 6 to 8 with high accuracy, it is necessary to perform image processing for detecting displacement with high accuracy. In the following embodiments, a configuration of an operation device for improving the accuracy of displacement detection by image processing will be described.

(Embodiment 3)
FIG. 10 is a schematic plan view showing the configuration of the operating device according to the third embodiment of the present invention. FIG. 11 is a schematic cross-sectional view showing the configuration of the operating device according to Embodiment 3 of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows the operating device being operated. The state is shown. FIG. 11 is a cross section taken along line AA in FIG. In the following, for the sake of convenience, the vertical direction in FIG. 10 and the horizontal direction in FIG. 11 are defined as the longitudinal direction of the operating device, the horizontal direction in FIG. 10 is defined as the horizontal direction in the operating device, and the vertical direction in FIG. The direction is described. However, these directions may be appropriately changed depending on the installation location, the installation direction, the installation angle, and the like of the operating device.

  The operation device according to the third embodiment includes ten push switches 321 to 330 arranged on the operation panel 305. The three push switches 321 to 323 and the three push switches 328 to 330 are substantially rectangular in a plan view, and are switches for accepting a pressing (pressing) operation by the user. Further, the four push switches 324 to 327 are substantially trapezoidal in a plan view and are arranged so that the tapered portions face four different directions (front and rear, left and right), and accept a direction selection by a user's pressing operation. It is a switch for.

  Each of the push switches 321 to 330 is provided in such a manner that it is fitted in a recess formed in the operation panel 305 having a plate shape. In addition, an elastic body 309 such as rubber is provided at the bottom of each recess of the operation panel 305, and between each push switch 321 to 330 fitted in the recess and each recess of the operation panel 305. Is provided with an elastic body 309. The elastic body 309 in each recess has substantially the same shape as the push switches 321 to 330 in plan view.

  With this configuration, the push switches 321 to 330 are immersed in the concave portion of the operation panel 305 by the user's pressing operation, and are urged toward the outside of the concave portion by the elastic force of the elastic body 309 when the pressing operation is released. Is done. In other words, the push switches 321 to 330 are displaced by appearing and retracting in the recesses of the operation panel 305. Note that the push switches 321 to 330 are provided with a stopper using an engaging claw or the like (not shown) so that the push switches 321 to 330 do not fall out of the recess of the operation panel 305.

  Further, concealed portions 331 to 340 each having a substantially rectangular plate shape are erected on the bottom of each concave portion of the operation panel 305. The concealed parts 331 to 340 are fixedly fixed to the bottoms of the respective concave parts. For this reason, the push switches 321 to 330 and the elastic body 309 are formed with through holes through which the concealed portions 331 to 340 are inserted, and the push switches 321 to 330 and the elastic body 309 are concealed in the through holes. The parts 331 to 340 are inserted and fitted into the respective recesses.

  The concealed parts 331 to 340 are sized to protrude outward from the surface of the operation panel 305 in a state where the concealed parts 331 to 340 are erected in the respective recesses of the operation panel 305. Further, when the push switches 321 to 330 and the elastic body 309 are fitted in the recesses of the operation panel 305 and the push switches 321 to 330 are not pressed by the user, the through holes of the push switches 321 to 330 and the elastic body 309 are provided. The tip portions of the concealed portions 331 to 340 that pass through are not projected outward from the surfaces of the push switches 321 to 330. Therefore, when the push switches 321 to 330 are pressed and immersed in the recesses of the operation panel 305, the tip portions of the concealed parts 331 to 340 are exposed to the outside, and the push switches 321 to 330 are not pressed. In some cases, it is not exposed to the outside. That is, when the push switches 321 to 330 are not immersed in the recesses of the operation panel 305, the hidden parts 331 to 340 are hidden from the outside by the push switches 321 to 330.

  The operation device according to Embodiment 3 includes an infrared light source 302 that emits infrared light, and the infrared light source 302 emits infrared light onto the operation panel 305 (at least to the push switches 321 to 330). Irradiate. In addition, the operating device according to the third embodiment includes a camera 301 that receives at least light including infrared light and performs imaging, and the imaging range of the camera 301 (indicated by a broken line in FIG. 11) is all pushes. This range includes the switches 321 to 330. The infrared light source 302 and the camera 301 are installed at appropriate locations such as in a vehicle so that infrared light is irradiated and imaged from the diagonally upper front side of the operation panel 305 toward the operation panel 305. Further, the infrared light source 302 and the camera 301 are installed at close positions.

  Further, the concealed portions 331 to 340 having a plate shape are erected in the concave portion of the operation panel 305 so that the front and rear surfaces face front and rear. The camera 301 is installed at a position where the front surface of the hidden parts 331 to 340 can be imaged. However, in the state where the push switches 321 to 330 are not pressed, the concealed parts 331 to 340 are concealed without being exposed to the outside, so the camera 301 images the front surface of the concealed parts 331 to 340. I can't do it.

  Furthermore, reflectors 341 to 343 that reflect infrared light emitted from the infrared light source 302 are provided on the front surface of the concealed parts 331 to 340. The reflectors 341 to 343 are exposed when the push switches 321 to 330 are pressed, and are hidden from the camera 301 when the push switches are not pressed. The reflectors 341 to 343 are retroreflectors that reflect incident light in the incident direction, and can reflect light from the infrared light source 302 toward the infrared light source 302. Since the infrared light source 302 and the camera 301 are installed close to each other, the camera 301 can receive the infrared light reflected by the reflectors 341 to 343 provided in the concealed parts 331 to 340 to perform imaging. it can.

  Therefore, when the push switches 321 to 330 are not pressed by the user, the push switches 321 to 330 hide the reflectors 341 to 343 of the hidden portions 331 to 340 from the camera 301 and the infrared light source 302. The infrared light emitted from the infrared light source 302 is not reflected to the camera 301, and the camera 301 does not receive the light reflected from the reflectors 341 to 343. On the other hand, when the push switches 321 to 330 are pressed, the reflectors 341 to 343 of the concealed parts 331 to 340 are exposed to the outside, and the light irradiated from the infrared light source 302 is reflected by the reflector 341. Since .about.343 is reflected, the camera 301 can receive the reflected light.

  Whether or not the camera 301 can capture the concealed portions 331 to 340 by receiving the infrared light reflected by the reflectors 341 to 343 based on the image captured and acquired by the camera 301. That is, it is checked whether or not the concealed parts 331 to 340 are shown in the image. FIG. 12 is a schematic diagram illustrating an example of an image captured and acquired by the camera 301. However, the captured image illustrated in FIG. 12 is an image after the control unit of the imaging apparatus performs binarization processing with a predetermined threshold on the image obtained from the camera 301.

  For example, as illustrated in FIG. 12A, when the concealed parts 331 to 340 are not displayed in the image acquired by the camera 301, the control unit of the imaging apparatus presses the push switches 321 to 330. It can be determined that no operation has been performed. On the other hand, as illustrated in FIG. 12B, when the concealment unit 333 is displayed in an image captured and acquired by the camera 301, for example, the control unit of the image capturing apparatus displays the concealment unit 333. It can be determined that the push switch 323 has been pressed according to the determined position. The same applies to the case where the other push switches 321 to 330 are pressed.

  Furthermore, the control unit of the imaging apparatus can also detect an abnormality by examining the shape and / or size of the hidden parts 331 to 340 displayed in the image. For example, when the size of the concealed parts 331 to 340 shown in the image is smaller than the assumed size, the control unit of the imaging apparatus may cause a foreign object between the camera 301 and the operation panel 305. It can be determined that there is.

  In the operation device according to the third embodiment having the above-described configuration, the push switches 321 to 330 are provided in the recesses of the operation panel 305 so as to be able to appear and retract, and when the push switches 321 to 330 are not pressed, 340 is concealed from the camera 301, and when the push switches 321 to 330 are pressed, the concealed parts 331 to 340 are exposed, so that the camera 301 captures and acquires the image It is possible to easily determine whether or not there is an operation on the push switches 321 to 330 only by determining whether or not the concealed parts 331 to 340 are displayed.

  Further, by adopting a configuration in which the elastic body 309 is interposed between the push switches 321 to 330 and the operation panel 305, the push switches 321 to 330 whose pressing operation has been released are positioned based on the urging force of the elastic body 309. In addition, it is possible to give the user a feeling of operation with respect to the push switches 321-330.

  In addition, the infrared light emitted from the infrared light source 302 is reflected by the reflectors 341 to 343 provided in the concealed parts 331 to 340, and the reflected light is received by the camera 301 to perform imaging. It is possible to easily and accurately determine whether or not the concealed parts 331 to 340 are displayed by extracting only a part having a large amount of received infrared light by binarizing an image obtained by imaging. .

  In the present embodiment, the recursive reflectors 341 to 343 are provided in the concealed parts 331 to 340. However, the present invention is not limited to this, and a non-recursive reflector may be provided. In this case, the installation positions of the infrared light source 302 and the camera 301 may be adjusted as appropriate, for example, the camera 301 is installed at a reflection destination where the reflector reflects the light from the infrared light source 302. Moreover, although it was set as the structure which provided the reflectors 341-343 in the to-be-hiding parts 331-340, it is not restricted to this, The whole to-be-hiding parts 331-340 are made into a reflector, ie, a reflector is fixed and occluded The structure made into the parts 331-340 may be sufficient. Moreover, the structure which does not provide the reflectors 341-343 in the to-be-hiding parts 331-340 may be sufficient. In this case, for example, the surface of the operation panel 305 and the push switches 321 to 330 is painted black, and a part or the whole of the concealed parts 331 to 340 is painted white. Can be increased. Further, instead of the infrared light source 302, a configuration including a light source that emits visible light may be used, and the light source may be turned on only when the surroundings are dark.

(Modification)
FIG. 13 is a schematic plan view showing a configuration of an operating device according to a modification of the third embodiment of the present invention. In the operation device according to the modified example, when attention is paid to the three push switches 321 to 323 provided on the left side of the operation panel 305, the respective concealed parts 331 to 340 have different sizes (shapes). The concealed part 331 is the largest, and the concealed part 332 and the concealed part 333 are gradually reduced. Similarly, when attention is paid to the three push switches 338 to 340 provided on the right side of the operation panel 305, the concealed part 338 is the smallest, and the concealed part 339 and the concealed part 340 are gradually increased.

  When the masked parts 331 to 340 are large, the reflector provided on the front surface thereof is also large. On the contrary, when the to-be-hiding parts 331-340 are small, the reflector provided in the front surface is also small. Therefore, the control unit of the controller device checks the size of the concealed parts 331 to 340 displayed in the image captured and acquired by the camera 301, so that any one of the adjacent push switches 321 to 330 operates. It is possible to accurately determine whether or not

(Embodiment 4)
FIG. 14 is a schematic cross-sectional view showing the configuration of the operating device according to Embodiment 4 of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows the operating device being operated. The state is shown. The operation device according to the fourth embodiment has a configuration in which an operation panel 405 and a plurality of push switches 421 to 423 are integrally molded by an elastic body such as thin rubber and covered with a base portion 406.

  The push switches 421 to 423 are formed so as to protrude from the planar operation panel 405, and a gap is provided between the push switches 421 to 423 and the base portion 406. Thereby, when the user presses the push switches 421 to 423, the push switches 421 to 423 are deformed in a state where they are crushed. Moreover, since the push switches 421 to 423 are formed of an elastic body, when the user releases the pressing operation, the push switches 421 to 423 return to the original state (shape).

  In addition, plate-like concealed parts 331 to 333 are fixed to the base part 406 so as to protrude into the gaps between the push switches 421 to 423 and the base part 406. Further, each push switch 421 to 423 is formed with a through-hole through which the concealed parts 331 to 333 can be inserted, and when the push switches 421 to 423 are crushed by a pressing operation, the concealed parts 331 to 333 are formed. Reflectors 341 to 343 provided on one surface side (front surface side) in the vicinity of the protruding end are exposed. When the push switches 421 to 423 are not pressed, the reflectors 341 to 343 of the concealed parts 331 to 333 are not exposed to the outside and are concealed from the camera 301 and the infrared light source 302.

  Therefore, the operation device according to the fourth embodiment irradiates infrared light on the operation panel 405 from the infrared light source 302 and reflects the infrared light reflected by the reflectors 341 to 343 as in the case of the third embodiment. By receiving light with the camera 301 and taking an image, it is possible to determine whether or not a push operation on the push switches 421 to 423 has been performed based on an image acquired by the imaging.

  The operation measure according to the fourth embodiment having the above-described configuration is to manufacture the operation panel 405 and the push switches 421 to 423 by integrally forming the operation panel 405 and the push switches 421 to 423 with an elastic body. This can be easily performed, the number of parts of the operating device can be reduced, and the assembly process of the operating device can be simplified, so that the cost of the operating device can be reduced.

  In the present embodiment, the integrally formed operation panel 405 and push switches 421 to 423 are covered with the base portion 406, and the concealed portions 331 to 333 are fixed to the base portion 406. However, the present invention is not limited to this. For example, when the operation device is mounted on a vehicle, the operation panel formed integrally by fixing the concealed portions 331 to 333 to a part of the vehicle (such as an instrument panel). 405 and push switches 421 to 423 may be configured to cover a part of the vehicle. In other words, the base portion 406 may be a part of the vehicle.

  In addition, since the other structure of the operating device which concerns on Embodiment 4 is the same as that of the operating device which concerns on Embodiment 3, the same code | symbol is attached | subjected to the same location and detailed description is abbreviate | omitted.

(Embodiment 5)
FIG. 15 is a schematic plan view showing the configuration of the operating device according to the fifth embodiment of the present invention. FIG. 16 is a schematic cross-sectional view showing the configuration of the operating device according to the fifth embodiment of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows the operating device being operated. The state is shown. 16 is a cross section taken along line BB in FIG.

  The operating device according to the fifth embodiment includes six substantially rectangular push switches 521 to 523 and 528 to 530 and four substantially trapezoidal push switches 524 to 527. The push switches 521 to 530 are provided in such a manner that they are fitted in recesses formed in the plate-like operation panel 505. In the concave portion of the operation panel 505, an elastic body 509 such as rubber is interposed between the operation panel 505 and the push switches 521 to 530.

  Further, in the operation panel 505, through holes penetrating the front and back of the operation panel 505 are formed in the vicinity of the (rear side) of the recesses into which the push switches 521 to 530 are fitted, and a substantially rectangular slide plate 531 is formed in each through hole. ˜540 are slidably accommodated.

  In the recess for fitting the push switches 521 to 530, one end abuts against the back surface (lower surface) of the push switches 521 to 530 and the other end is inserted into an opening formed in the slide plates 531 to 540. 551-553 are provided. The oscillating bodies 551 to 553 are oscillated when the push switches 521 to 530 are pressed and immersed in the recesses so that the slide plates 531 to 533 protrude from the through holes to the front side of the operation panel 505. When the pressing operation to the push switches 521 to 530 is released, the push switches 521 to 530 are urged by the elastic body 509 to return to the original positions, and the slide plates 531 to 540 are immersed in the through holes by their own weight. To do.

  That is, the operating device according to the fifth embodiment includes the swinging bodies 551 to 553, so that when the push switches 521 to 530 are immersed in the recesses, the slide plates 531 to 540 are protruded from the through holes, and the push switch 521 When -530 protrudes from a recessed part, the slide plates 531-540 can be immersed in a through-hole.

  It is a part of the surface (front side) where the infrared light source 302 and the camera 301 of the slide plates 531 to 540 are provided, and protrudes when the push switches 521 to 530 are pressed, and the camera when not pressed Reflectors 541 to 543 that reflect infrared light emitted from the infrared light source 302 are provided in the portions concealed with respect to 301 (the concealed portions 531a to 533a).

  Therefore, when the push switches 521 to 530 are not pressed, the slide plates 531 to 540 are immersed in the through holes of the operation panel 505 so that the concealed portions 531a to 533a are concealed. Infrared light emitted from the reflector is not reflected by the camera 301, and the camera 301 does not receive the reflected light from the reflectors 541-543. On the other hand, when the push switches 521 to 530 are pressed, the push switches 521 to 530 are immersed in the recesses of the operation panel 505 to swing the rocking bodies 551 to 553, and the rocking bodies 551 to 553. In order to expose the slide plates 531 to 540 to the outside, the infrared light irradiated from the infrared light source 302 is reflected by the reflectors 541 to 543 provided in the concealed portions 531a to 533a of the slide plates 531 to 540. The camera 301 receives this reflected light. Thereby, the control part of an imaging device can determine whether each push switch 521-530 was pressed by the image based on the image which the camera 301 imaged and acquired.

  In the operating device according to the fifth embodiment having the above-described configuration, the camera 301 is configured such that the swinging body causes the slide plates 531 to 540 to appear and disappear from the operation panel 505 in response to pressing operations to the push switches 521 to 530. The presence or absence of an operation on the push switches 521 to 530 can be easily determined only by determining whether or not the concealed parts 531a to 533a are shown in the image acquired by imaging.

  In addition, since the other structure of the operating device which concerns on Embodiment 5 is the same as that of the operating device which concerns on Embodiment 3, the same code | symbol is attached | subjected to the same location and detailed description is abbreviate | omitted.

(Embodiment 6)
FIG. 17 is a schematic cross-sectional view showing the configuration of the operating device according to the sixth embodiment of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows the operating device being operated. The state is shown. In the operating device according to the sixth embodiment, push switches 621 to 623 each having a substantially rectangular plate shape are pivotally supported by a swing shaft 651 to 653 in a recess formed in the operation panel 605. It is a configuration.

  The push switches 621 to 623 are pivotally supported so as to swing in the front-rear direction of the operation panel 605 (the left-right direction in FIG. 17) (that is, the swing shafts 651 to 653 are provided in the left-right direction of the operation panel. ), The rear portion is immersed in the recess of the operation panel 605 by the swing, and the front portion is exposed from the recess. An elastic body 609 such as rubber is interposed between the operation panel 605 and the push switches 621 to 623 in the recess of the operation panel 605.

  Accordingly, when the user presses the rear portion of the push switches 621 to 623, the push switches 621 to 623 swing, and when the press operation is released, the push switches 621 to 623 are moved by the elastic body 609. It can be returned to the original position.

  The user does not press the push switches 621 to 623 on part (or all) of the side surfaces on the front side of the push switches 621 to 623 (the side where the infrared light source 302 and the camera 301 are provided, the left side in FIG. 17) In this case, the concealed parts 621 a to 623 a are immersed in the recesses of the operation panel 605 and concealed from the camera 301. When the push switches 621 to 623 are swung by the user's pressing operation, the hidden portions 621a to 623a are exposed to the outside from the recesses of the operation panel 605. Reflectors 641 to 643 that reflect infrared light emitted from the infrared light source 302 are provided in the concealed portions 621a to 623a of the push switches 621 to 623.

  Therefore, when the push switches 621 to 623 are not pressed, the concealed parts 621a to 623a are concealed in the recesses of the operation panel 605, so that the infrared light emitted from the infrared light source 302 is reflected by the camera 301. The camera 301 does not receive the reflected light from the reflectors 641 to 643. On the other hand, when the push switches 621 to 623 are pressed, the push switches 621 to 623 are swung and the concealed parts 621a to 623a are exposed to the outside. The reflected infrared light is reflected by the reflectors 641 to 643 provided in the concealed portions 621a to 623a, and the camera 301 receives the reflected light. As a result, the control unit of the image pickup apparatus determines whether the push switches 621 to 623 are based on whether or not the concealed parts 621a to 623a are displayed in the image based on the image acquired by the camera 301. It can be determined whether or not a pressing operation has been performed.

  In the operating device according to the sixth embodiment having the above-described configuration, the push switches 621 to 623 are swung according to the pressing operation, and the concealed portions 621a to 623a are projected and retracted from the recesses of the operation panel 605 by the swinging. Thus, it is possible to easily determine whether or not there is an operation on the push switches 621 to 623 only by determining whether or not the concealed parts 621a to 623a are reflected in the image captured and acquired by the camera 301. it can.

  In addition, since the other structure of the operating device which concerns on Embodiment 6 is the same as that of the operating device which concerns on Embodiment 3, the same code | symbol is attached | subjected to the same location and detailed description is abbreviate | omitted.

(Embodiment 7)
FIG. 18 is a schematic cross-sectional view showing the configuration of the operating device according to the seventh embodiment of the present invention, where (a) shows a state where the operating device is not operated, and (b) shows the operating device being operated. The state is shown. Similar to the operation device according to the first embodiment, the operation device according to the seventh embodiment is provided with push switches 721 to 723 each having a substantially rectangular plate shape so as to be able to appear and retract in a recess formed in the operation panel 705. It is a configuration. An elastic body 709 such as rubber is interposed between the operation panel 705 and the push switches 721 to 723 in the recess of the operation panel 705.

  Thereby, when the user presses the push switches 721 to 723, the push switches 721 to 723 are immersed in the recesses of the operation panel 705. When the pressing operation is released, the push switches 721 to 723 are returned to their original positions by the elastic body 709 and exposed outside the operation panel 705.

  When the user presses the push switches 721 to 723, a part (or all) of the side surfaces on the front side of the push switches 721 to 723 (the side on which the infrared light source 302 and the camera 301 are provided, the left side in FIG. 18). Concealed parts 721 a to 723 a that are immersed in the recesses of the operation panel 705 and concealed from the camera 301. When the user's pressing operation is released, the concealed parts 721a to 723a are exposed to the outside from the recesses of the operation panel 705. Reflectors 741 to 743 that reflect infrared light emitted from the infrared light source 302 are provided in the concealed portions 721a to 723a of the push switches 721 to 723.

  Therefore, when the push switches 721 to 723 are not pressed, the hidden portions 721a to 723a are exposed to the outside of the operation panel 705, so that the infrared light emitted from the infrared light source 302 is hidden. Are reflected by the reflectors 741 to 743 provided at 723a, and the camera 301 receives the reflected light. On the other hand, when the push switches 721 to 723 are pressed, the push switches 721 to 723 are immersed in the recesses of the operation panel 705, and the concealed parts 721a to 723a are concealed. The infrared light irradiated from 302 is not reflected to the camera 301, and the camera 301 does not receive the reflected light from the reflectors 741 to 743. As a result, the control unit of the image capturing apparatus determines whether the push switches 721 to 723 are based on whether or not the concealed units 721a to 723a are displayed in the image based on the image captured and acquired by the camera 301. It can be determined whether or not a pressing operation has been performed.

  In the operating device according to the seventh embodiment having the above-described configuration, the push switches 721 to 723 appear and disappear in the recesses of the operation panel 705 in response to the pressing operation, and accordingly the cover switches provided on the side surfaces of the push switches 721 to 723 are provided. By adopting a configuration in which the concealing units 721a to 723a appear and disappear, it is only necessary to determine whether or not the concealing units 721a to 723a are displayed in the image captured and acquired by the camera 301, and to the push switches 721 to 723. The presence or absence of an operation can be easily determined.

  In addition, since the other structure of the operating device which concerns on Embodiment 7 is the same as that of the operating device which concerns on Embodiment 3, the same code | symbol is attached | subjected to the same location and detailed description is abbreviate | omitted.

It is a schematic diagram which shows the structure of the operating device which concerns on Embodiment 1 of this invention. It is a schematic diagram which shows the back view of the operation panel of the operating device which concerns on Embodiment 1 of this invention. It is a block diagram which shows the structure of ECU of the operating device which concerns on Embodiment 1 of this invention. It is a flowchart which shows the procedure of the switch operation detection process which the operating device which concerns on Embodiment 1 of this invention performs. It is a flowchart which shows the procedure of the control process of the light source which the operating device which concerns on Embodiment 1 of this invention performs. It is a block diagram which shows the structure of the operating device which concerns on the modification of Embodiment 1 of this invention. It is a schematic diagram which shows the structure of the operating device which concerns on Embodiment 2 of this invention. It is a schematic diagram which shows the surface view of the operation panel of the operating device which concerns on Embodiment 2 of this invention. It is a block diagram which shows the structure of the operating device which concerns on the modification of Embodiment 2 of this invention. It is a schematic plan view which shows the structure of the operating device which concerns on Embodiment 3 of this invention. It is typical sectional drawing which shows the structure of the operating device which concerns on Embodiment 3 of this invention. It is a schematic diagram which shows an example of the image imaged and acquired by the camera. It is a typical top view which shows the structure of the operating device which concerns on the modification of Embodiment 3 of this invention. It is typical sectional drawing which shows the structure of the operating device which concerns on Embodiment 4 of this invention. It is a typical top view which shows the structure of the operating device which concerns on Embodiment 5 of this invention. It is typical sectional drawing which shows the structure of the operating device which concerns on Embodiment 5 of this invention. It is typical sectional drawing which shows the structure of the operating device which concerns on Embodiment 6 of this invention. It is typical sectional drawing which shows the structure of the operating device which concerns on Embodiment 7 of this invention.

Explanation of symbols

1 Camera (imaging means)
2 Light source (irradiation means)
3 Optical sensor (acquisition means)
5 Operation panel 6, 7, 8 Push switch (displacement part)
6a, 7a, 8a Displacement part 10 ECU
14 Image processing unit (detection means)
16 control unit 101 camera (imaging means)
102 Infrared light source (irradiation means)
201 Camera (imaging means)
202 Optical filter (infrared light cut filter)
207 switching mechanism (switching means)
301 camera (imaging means)
302 Infrared light source (irradiation means)
305 Operation panel 309 Elastic body 321-330 Push switch (displacement part)
331 to 340 Covered parts 341 to 343 Reflector (reflecting part)
405 Operation panel 406 Base part 421-423 Push switch (displacement part)
505 Operation panel 509 Elastic body 521-530 Push switch (press operation part)
531 to 540 Slide plate (displacement part)
531a to 533a Covered parts 541 to 543 Reflectors (reflecting parts)
551 to 553 Oscillating body 605 Operation panel 609 Elastic body 621 to 623 Push switch 621a to 623a Covered portion 641 to 643 Reflector (reflecting portion)
651 to 653 Oscillating shaft 705 Operation panel 709 Elastic body 721 to 723 Push switch 721a to 723a Covered part 741 to 743 Reflector (reflecting part)

Claims (16)

A displacement part that is displaced according to the operation;
Imaging means for imaging the displacement portion;
Detection means for detecting the displacement of the displacement portion based on the image captured by the imaging means,
An operation device characterized in that when the detection means detects a displacement, an operation for the displacement portion is accepted. An operation panel provided with the displacement portion;
The operation device according to claim 1, wherein the imaging unit is configured to image the displacement portion from a back side of the operation panel. An operation panel provided with the displacement portion;
The operation device according to claim 1, wherein the imaging unit is configured to image the displacement portion from a surface side of the operation panel. Obtaining means for obtaining ambient information relating to brightness around the displacement part;
The operating device according to any one of claims 1 to 3, further comprising: an irradiating unit that irradiates the displacement portion with light according to the surrounding information acquired by the acquiring unit. The irradiation means is adapted to irradiate infrared light,
The operating device according to claim 4, wherein the imaging unit receives the light including the infrared light and performs imaging. The imaging means is configured to receive light including infrared light and perform imaging.
An infrared light cut filter for cutting infrared light incident on the imaging means;
Obtaining means for obtaining ambient information relating to brightness around the displacement part;
4. The operating device according to claim 1, further comprising: a switching unit that switches presence / absence of the infrared light cut filter according to the surrounding information acquired by the acquiring unit. 5. The detection means compares a plurality of images picked up at different times by the image pickup means, and detects a displacement of the displacement portion based on a change generated in the images. The operating device according to claim 6. It is fixed so as not to change with the change of the displacement part, and further comprises a concealed part that is concealed from the imaging means by the displacement part and exposed with the displacement of the displacement part,
The detection unit is configured to detect a displacement of the displacement unit according to whether or not the concealment unit is reflected in an image captured and acquired by the imaging unit. The operating device according to any one of claims 1 to 7. An operation panel provided with the displacement portion;
A concealed part that is provided in the displacement part and that is concealed from the operation panel in accordance with the displacement of the displacement part and concealed from the imaging unit when the operation panel is immersed;
A pressing operation unit disposed in the operation panel so as to be able to appear and retract, and to be immersed by a pressing operation;
A swinging body that is swung as the pressing operation part moves in and out, and that exposes the concealed part of the displacement part from the operation panel when the pressing operation part is immersed;
The detection unit is configured to detect a displacement of the displacement unit according to whether or not the concealment unit is reflected in an image captured and acquired by the imaging unit. The operating device according to any one of claims 1 to 7. An operation panel disposed so that the displacement portion swings and displaces;
A concealed portion provided on the displacement portion, concealed from the imaging means when the displacement portion is swung to one side and exposed when swung to the other side.
The detection unit is configured to detect a displacement of the displacement unit according to whether or not the concealment unit is reflected in an image captured and acquired by the imaging unit. The operating device according to any one of claims 1 to 7. An operation panel arranged so that the displacement part appears and displaces; and
A concealed part that is provided in the displacement part and is concealed from the imaging means by immersing the displacement part;
The detection unit is configured to detect a displacement of the displacement unit according to whether or not the concealment unit is reflected in an image captured and acquired by the imaging unit. The operating device according to any one of claims 1 to 7. The operation device according to claim 8, further comprising an elastic body interposed between the displacement portion and the operation panel. The displacement part and the operation panel are integrally formed of an elastic body,
The operating device according to claim 8, wherein the displacement portion is displaced by deformation with respect to a pressing operation. A plurality of the displacement portions and the concealed portions respectively associated with each other,
The operating device according to any one of claims 8 to 13, wherein the concealed part associated with each displacement part has a different size and / or a different shape. Irradiating means for irradiating light;
The operating device according to any one of claims 8 to 14, further comprising: a reflection unit that is provided in the concealed unit and reflects light emitted by the irradiation unit. The irradiation means is adapted to irradiate infrared light,
The reflecting portion is configured to reflect the infrared light,
The operating device according to claim 15, wherein the imaging unit is configured to receive the infrared light to perform imaging.

Images