JP5240277B2 - In-vehicle remote control device - Google Patents

Description

  The present invention separately arranges an operation unit in which an operation switch is arranged and a display unit that displays an operation menu image corresponding to the operation switch in the operation unit at physically separated positions in a vehicle interior. Furthermore, the present invention relates to an in-vehicle remote control device including a composite display unit that composites and displays a hand image on an operation menu image.

  A multi-function switch operation plate that is arranged in a suitable position in the vehicle and that is arranged in a collective manner to arrange various types of switches for operating various in-vehicle devices, and is disposed in a suitable position in the vehicle in the visual field area that the operator can look forward. A display that displays an array image of the plurality of types of switches, and when the operator operates a target of the switch with a fingertip, the display is based on a detection signal that senses the target switch. A controller for controlling the operator to recognize an arrangement position and a function of an image of the target switch displayed on the screen, and the target switch is displayed on the display in a forward-viewed state by the operator The target switch on the multi-function switch operation plate can be operated in real time with a fingertip while viewing the image of the vehicle. Chi safe operation system is known (e.g., see Patent Document 1).

  In addition, in an in-vehicle switch operating device that is operated by a driver to control an electronic device of an automobile, a switch array that can be installed at a position where it can be easily operated by a driver in the vicinity of a driver's seat and is arranged with a plurality of switches A camera that can be installed in the vicinity of the driver's seat and sequentially captures the switch array and the operation state of the switch operation by the driver, and the function of each switch in the image captured by the camera is in the vicinity of each switch. A sign image data storage unit that stores sign image data for labeling, an image composition unit that synthesizes each image based on the image data of the captured image and the sign image data of the sign image data storage unit, A display unit that can be installed on or near the front panel and displays the synthesized image; There is known an in-vehicle switch operating device including a control unit that outputs a control signal for performing a control corresponding to a function marked in an image of the switch (for example, Patent Documents) 2, see Patent Documents 3 and 4 for similar techniques).

JP 2000-6687 A JP 2000-335330 A Japanese Patent Laid-Open No. 10-269012 JP 2004-26046 A

  By the way, in the above-described type of in-vehicle remote control device, the user can perform a desired operation on a hand (fingertip) that is actually operated on the operation unit while viewing the position of the hand on the operation menu image displayed on the display unit. It needs to be moved to the switch position. However, there is a problem that it is difficult to intuitively grasp the positional relationship between a desired operation switch and a fingertip simply by superimposing and displaying a hand image on the operation menu image.

  Therefore, an object of the present invention is to provide an in-vehicle remote control device that can effectively guide a user's hand (fingertip) to an operation switch.

In order to achieve the above object, according to one aspect of the present invention, there is provided an operation unit in which an operation switch is arranged, and a display unit that displays an operation menu image representing an arrangement position and a function of the operation switch in the operation unit. , Separately placed in physically separated locations in the passenger compartment,
Imaging means for photographing a user's hand operating the operation unit together with the operation unit;
In the vehicle-mounted remote control device, comprising: on the display unit, combined display means for combining the captured hand image with the operation menu image for display.
The operation unit includes a concave or convex operation guide unit provided so that a user can easily perceive a region to which the position of his / her fingertip belongs in the entire operation region of the operation unit,
The composite display means is an operation guide image that allows the user to easily grasp the region to which the position of his / her fingertip belongs in the entire region of the operation unit in addition to the image of the hand on the display unit , An operation guide image corresponding to the shape of the operation guide portion is combined with the operation menu image and displayed,
The in-vehicle remote control device is provided, wherein the operation guide image is displayed when the user's hand approaches or touches the operation unit.

  ADVANTAGE OF THE INVENTION According to this invention, the vehicle-mounted remote control apparatus which can guide a user's hand (fingertip) effectively to an operation switch is obtained.

It is a perspective view which shows an example of the vehicle mounting state of the vehicle-mounted remote control apparatus which concerns on this invention. FIG. 2 is a schematic cross-sectional view of the in-vehicle remote control device shown in FIG. 1 as viewed from the side. It is a functional block diagram of the vehicle-mounted system which concerns on a vehicle-mounted remote control apparatus. 3 is a plan view of an operation unit 20. FIG. 3 is a main cross-sectional view of an operation unit 20. FIG. It is a figure which shows an example of an operation menu image. It is a figure which shows a camera image. 4 is a diagram illustrating a display state of a composite image on the display unit 40. FIG. It is a figure which shows the other Example of the operation guide part. It is a perspective view which shows the other Example of the vehicle mounting state of the operating device for vehicles which concerns on this invention. FIG. 12 is a schematic cross-sectional view of the vehicle operating device shown in FIG. 11 as viewed from the side. It is a perspective view which shows the operating device for vehicles which concerns on the other Example. FIG. 10 is a diagram illustrating another arrangement method of the camera 50 in the concave space 90.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

  FIG. 1 is a perspective view showing a first embodiment of a vehicle-mounted remote control device according to the present invention mounted on a vehicle. FIG. 2 is a schematic cross-sectional view of the in-vehicle remote control device shown in FIG. 1 as viewed from the side, and FIG. 3 shows functional blocks of the in-vehicle system related to the in-vehicle remote control device. As shown in FIGS. 1 and 2, the in-vehicle remote control device of this embodiment includes an operation unit 20, a display unit 40, and a camera 50. The operation unit 20 and the display unit 40 are physically separated from each other in the vehicle interior. Placed separately in position. As shown in FIG. 3, the operation unit 20 and the display unit 40 are connected to a display control device 70 formed of, for example, a microcomputer, and the camera 50 is connected to a hand image synthesis circuit 72. The hand image synthesis circuit 72 is connected to an approach / contact sensing means 80 that can detect the approach of the user's hand to the operation unit 20. The approach / contact sensing unit 80 is connected to a light emission control unit 74 that controls the light emission unit 24 provided for the operation unit 20. Hereinafter, each configuration will be described in detail.

  FIG. 4 is a plan view of the operation unit 20. The operation unit 20 includes a transparent touch panel 22 on which a plurality of operation switches are arranged. In FIG. 4, the positions (pressure-sensitive regions) of a plurality of pressure-sensitive operation switches are virtually indicated by a one-dot difference line. The operation unit 20 is disposed at a position where the user can easily operate, preferably at a position where the driver can operate by simply reaching out. For example, the operation unit 20 may be disposed in the center console unit as illustrated in FIG. 1 or may be disposed in the instrument panel. The operation unit 20 is arranged such that its substantially flat operation surface is substantially horizontal.

  FIG. 5 is a cross-sectional view showing the main part of the operation unit 20. The operation unit 20 includes a transparent touch panel 22. The structure of the transparent touch panel 22 may be a general structure except that an operation guide unit 30 described later is formed. For example, as shown in FIG. 5, the transparent touch panel 22 has a thin film transparent electrode 22a (or a glass substrate) provided with a thin film transparent electrode 22c and a film substrate 22d provided with a thin film transparent electrode 22c. It has a laminated structure in which the transparent electrodes 22a and 22c are opposed to each other via a dot spacer 22e. An operation signal (operation position signal) on the transparent touch panel 22 is supplied to the display control device 70 (see FIG. 3) via an FPC (flexible printed circuit) (not shown) bonded to the side of the transparent touch panel 22. The display control device 70 controls various in-vehicle devices so as to realize a function (including switching of an operation menu image on the display unit 40 described later) according to an operation signal (operation position signal) on the transparent touch panel 22. .

  A light emitting means 24 is set on the side of the transparent touch panel 22. The light emitting means 24 is, for example, a light source such as an LED, and is disposed so that light is applied from the side to the acrylic substrate 22 b under the transparent touch panel 22. The light emitting unit 24 illuminates the entire transparent touch panel 22 (the entire operation unit 20) from the side of the transparent touch panel 22 under the control of the light emission control unit 74 (see FIG. 3) described in detail below. The light emitted from the light emitting means 24 is diffused by the acrylic light guide plate so that the entire operation region of the transparent touch panel 22 emits light substantially uniformly. Alternatively, the light emitting unit 24 may illuminate the entire transparent touch panel 22 (the entire operation unit 20) from behind the transparent touch panel 22. Similarly, the light emitted from the light emitting means 24 is emitted so that the entire operation unit 20 emits light with substantially uniform luminance, that is, the light is transmitted uniformly through the transparent touch panel 22 over the entire operation area of the transparent touch panel 22. Appropriate diffusion. The light emitting means 24 may have the same configuration as a backlight of a liquid crystal display (for example, a light guide plate type backlight including an acrylic light guide plate, a lamp, a lamp reflecting plate, etc.).

  In the present embodiment, an operation guide portion 30 is provided on the operation surface (panel surface) of the operation portion 20 as shown in FIG. The operation guide part 30 is implement | achieved by forming the recessed part or convex part which can be recognized by the tactile sense (feel) of a hand in an operation surface. The operation guide unit 30 may be formed integrally with the surface member (for example, the film substrate 22d) of the transparent touch panel 22 that provides the operation surface, or may be bonded to the surface member of the transparent touch panel 22 as a separate body.

  In the example illustrated in FIG. 5, the operation guide portion 30 is formed as a convex portion, extends linearly within the operation surface of the operation portion 20 in a plan view, and divides the operation area of the operation portion 20. In the example illustrated in FIG. 4, the operation guide unit 30 has a cross shape extending in the vertical direction and the horizontal direction of the operation unit 20 in a plan view and intersecting at a substantially central portion of the operation unit 20. That is, the operation guide unit 30 divides the operation region on the operation surface of the operation unit 20 into four. As a result, the user can determine which operation region (in this example, 4 in this example) the user's hand (fingertip) is partitioned by the operation guide unit 30 in the operation unit 20 based on the sense of the hand touching the operation guide unit 30, i. It is possible to easily grasp which area of the four quadrants is divided.

  The display unit 40 is configured by a liquid crystal display or the like, and is disposed at a position where the user can easily see, preferably at a position where the driver can see without greatly changing the visual field during driving. For example, as shown in FIG. 1, the display part 40 may be arrange | positioned in the center part of the instrument panel upper surface, and may be arrange | positioned in a meter.

  Image output or video output displayed on the display unit 40 is controlled by the display control device 70 (see FIG. 3). The display control device 70 may be, for example, a part of a navigation device (including a drawing processor). In this case, a map image or the like is supplied and displayed on the display unit 40 in addition to an operation menu image described later. .

  FIG. 6 is a diagram illustrating an example of the operation menu image. As shown in FIG. 6, an operation menu image that supports user operations on the operation unit 20 is displayed on the display unit 40 under the control of the display control device 70. The operation menu image represents the position of the operation switch in the operation unit 20 and its function. The operation menu image serves to notify the user of various functions implemented by operating the operation unit 20 and to inform the user of the position of each operation switch to be operated to implement the various functions.

In the example illustrated in FIG. 6, the operation menu image includes graphic images F <b> 1 to F <b> 8 simulating eight operation switches in the operation unit 20. The size and position of the graphic images F1 to F8 in the operation menu image correspond to the size and position of the operation area of the corresponding operation switch in the operation unit 20. The user who views the display unit 40 knows that the operation switches are arranged in two rows in the operation unit 20 and operates the operation switches by looking at the characters in the graphic images F1 to F8. You can know the functions that can be realized. For example, if a user wants to email, the user can enter “email”
It can be understood that the operation switch located at the position corresponding to the graphic image F3 including the character, that is, the third operation switch from the left in the front row of the operation unit 20 may be pressed. If the user wants to set a destination, the user
It can be understood that the operation switch at the position corresponding to the graphic image F1 including the character, that is, the first operation switch from the left in the front row in the operation unit 20 may be pressed.

  Various operation menu images may be prepared, and may be switched as appropriate in accordance with an operation state in the operation unit 20 or the like. In this case, the position and function of the operation switch in the operation unit 20 are changed in accordance with the switching of the operation menu image. With this configuration, operation switches for many in-vehicle devices can be realized in the operation unit 20, and the operation switches can be efficiently integrated. For example, although not shown in FIG. 6, the operation unit 20 includes various operations for various operations of the air conditioner and the audio device as well as the operation of the information communication system in-vehicle equipment such as e-mail, telephone, and peripheral facility guidance. An operation switch may be realized.

  The camera 50 (imaging means) is a small color camera having, for example, a CCD or CMOS as an image sensor, and is arranged so that the operation unit 20 (and the user's hand operating it) can be looked down on. That is, the camera 50 determines the position / angle relationship, the focal point, and the like with the operation unit 20 so as to capture the entire operation unit 20. Accordingly, the entire image of the operation unit 20 is included in substantially the entire image photographed by the camera 50 (hereinafter “camera image”).

  As shown in FIG. 7A, when the user's hand enters the imaging area of the camera 50 to operate the operation unit 20, the camera image includes a hand image as shown in FIG. 7B. become. The camera image including the hand image is supplied to the hand image synthesis circuit 72 (see FIG. 3). The hand image composition circuit 72 extracts a hand image (hereinafter referred to as “hand image”) from the camera image. The extraction and synthesis of the hand image may be realized by using a part other than the hand (the operation unit 20) included in the camera image and a chromaticity (saturation) difference or contrast difference of the hand.

  In the present embodiment, as described above, since the operation guide unit 30 is provided in the operation unit 20, as shown in FIG. 7B, the camera image includes an image of the operation guide unit 30 (hereinafter referred to as “the operation guide unit 30”). "Operation guide image") is included. In the hand image synthesis circuit 72, the operation guide image is extracted from the camera image as in the above-described hand image. That is, an image area other than the hand and the operation guide unit 30 is cut out from the camera image, and the operation guide image is extracted together with the hand image. The extraction of the operation guide image is realized by using a chromaticity (saturation) difference or a contrast difference between the operation guide unit 30 and the part (operation unit 20) other than the hand included in the camera image, as in the case of the hand image. It's okay.

  As a method for extracting the operation guide image and the hand image, a chroma key composition technique that is widely known per se is preferably used. This is a technique in which an image is shot against a background of a specific color (key color), and another image is superimposed on the key color for composition. A color generally used as a key color is blue. This is because blue is the most opposite to human skin color and is suitable for processing to extract human hands. The extraction method of the operation guide image and the hand image extraction method is, for example, luminance synthesis technology (designating a luminance signal of luminance signal (Luminance including luminance and contrast information of the image) and the signal below that. In the following, the case where the chroma key composition technique is mainly used will be described. In this case, the entire region of the operation unit 20 excluding the operation guide unit 30 is configured in a key color (for example, blue) (for example, coloring or light emission), and the operation guide unit 30 is configured in a color other than the skin color and the key color. . Therefore, in the hand image composition circuit 72, only the remaining hand image and the operation guide image are obtained by extracting the blue portion from the camera image with the chroma key.

  The hand image and the operation guide image extracted in this way are combined with the operation menu image supplied from the display control device 70 by the hand image combining circuit 72. That is, the hand image and the operation guide image are combined with the operation menu image (see FIG. 6) prepared as the background image. The image thus synthesized is supplied to the display unit 40 and displayed. Hereinafter, the operation menu image including the hand image and the operation guide image displayed on the display unit 40 in this manner is simply referred to as a “composite image”.

  In the hand image synthesis circuit 72, the hand image extracted as described above is preferably not synthesized as it is (without processing), but after being converted into an abstract image representing the hand as an abstract or pseudo. Synthesized. In this case, the hand abstract image is generated based on the hand outline of the hand image extracted from the camera image. An abstract image of a hand may be generated, for example, so that the outline is emphasized with a relatively thick line or strong luminance while cutting the inside of the outline and giving a translucent color to the inside of the outline (FIG. 8). reference). Thus, by not using the region inside the contour of the hand as a hand image in this way, it is possible to provide a stable hand image that is not easily affected by ambient light that is different day and night, and most of the hand It is possible to prevent a physiological discomfort that can be received by the user as described above due to real display.

  FIG. 8 shows a composite image obtained as described above. The combination position of the hand image, that is, the position in the operation menu image, is determined by the relative positional relationship between the actual hand position on the operation unit 20 and the position of each operation switch. It is determined so as to be accurately reproduced by the relative positional relationship between the position of the hand of the image and each of the graphic images F1 to F8. This composite position may be calculated based on the relative relationship (coordinate conversion formula) between the coordinate system in the camera image and the coordinate system in the operation menu image. At this time, an error or the like of the mounting position of the camera 50 may be appropriately corrected. Note that the operation guide image may be determined based on a relationship corresponding to the position where the hand image is combined (for example, it may be combined using the same coordinate conversion formula).

  In the example shown in FIG. 8, the hand of the hand image is shown at a position where the figure image F3 is operated. In this case, when the user performs the switch operation at the current hand position, the user can know that the function of the switch corresponding to the graphic image F3, that is, the mail function is realized. In this way, the user can operate a desired operation switch in the operation unit 20 while looking at the display unit 40 without directly viewing the operation unit 20. Therefore, when the user is a driver, a switch operation (so-called blind touch operation) can be performed with the operation unit 20 near the hand while looking at the display unit 40 in front of the field of view without greatly changing the driving posture or line of sight. Therefore, it is possible to realize a safe switch operation that does not interfere with driving.

  By the way, in the present embodiment, as described above, the hand image is superimposed and displayed on the operation menu image, so that the user can easily grasp the positional relationship between the position of his / her hand and the desired operation switch in the operation unit 20. Become. However, in practice, there is a problem that it is difficult to intuitively grasp the positional relationship between a desired operation switch and a fingertip simply by superimposing and displaying a hand image on the operation menu image. This is due to a human sensory shift in which the actual back-and-forth movement of the hand in the operation unit 20 is converted into the vertical movement of the hand image in the display unit 40. Also, this type of problem can be prominent when a large number of operation switches are arranged at a higher density.

  On the other hand, in this embodiment, as shown in FIG. 8, the operation guide image is displayed in addition to the hand image on the operation menu image. The region to which the fingertip position belongs can be easily grasped. For example, in the example illustrated in FIG. 8, the user places the position of his / her fingertip in an area corresponding to the first quadrant (or near the center of the first quadrant) among the four operation areas of the operation unit 20. Can be seen at a glance. For this reason, for example, the user who wants to set the destination can move his / her hand greatly intuitively from the first quadrant to the second quadrant having the graphic image F1 including the characters “destination”.

  As described above, according to the present embodiment, by displaying the operation guide image in addition to the hand image, the user can rely on the operation guide image and in which direction his / her hand with respect to the target operation switch. Since it can be grasped intuitively whether it should move to some extent, the operativity in the operation part 20 can further be improved.

  In the present embodiment, as described above, the operation guide image corresponds to the operation guide unit 30 provided in the operation unit 20. For this reason, the user synergistically uses the tactile sensation when the user's fingertip touches the operation guide unit 30 and the visual perception of the operation guide image on the display unit 40, so It becomes easier to perceive the area to which the position belongs.

  In the present embodiment, as described above, the operation guide image can be extracted from the camera image when the hand image is extracted. For this reason, this embodiment greatly changes the image processing method by providing the operation unit 20 with an operation guide unit 30 having a color different from that of the surrounding region, compared to the conventional configuration in which only the hand image is superimposed and displayed. It can be realized without doing. However, the operation guide image can also be prepared in advance as a background image in the same manner as the operation menu image described above. In this case, the operation guide unit 30 does not need to have a contrast difference or a chromaticity difference with respect to the surrounding area in the operation unit 20.

  In the present embodiment, since the operation unit 20 is not directly viewed by the user during the operation as described above, the operation unit 20 is required to be configured to easily extract the hand image and the operation guide image. . That is, as described above, the hand image is a contrast difference or chromaticity difference between the hand and the image of the portion other than the operation guide unit 30 (image of the operation unit 20 excluding the operation guide unit 30) in the camera image (see FIG. 7). Therefore, the operation unit 20 that can provide brightness or chromaticity in an image that increases the contrast difference or chromaticity difference is useful. Therefore, for example, when the chroma key composition technique is used in the hand image composition circuit 72, simple coloration may be used, but preferably, the operation unit 20 is displayed in a key color using the light emitting means 24 (see FIG. 3) such as an LED. Make it emit light. In this case, the operation guide portion 30 may be formed of a material having a low light transmittance so that light from the light emitting unit 24 is blocked only by the operation guide portion 30. Thereby, even when sunlight enters the operation unit 20, the hand image and the operation guide image can be reliably extracted.

  In this embodiment, since the operation guide image is superimposed on the operation menu image, the operation guide image may not interfere with the user's viewing of the operation menu image when there is no operation by the user. Useful. For this reason, preferably, the hand image composition circuit 72 is operable when detecting the approach or contact of the user's hand to the operation unit 20 (ie, a state in which a composite image is generated and output based on the camera image). It becomes. The approach or contact of the user's hand to the operation unit 20 is preferably detected by an approach / contact sensing means 80 (see FIGS. 1, 2 and 3) provided around the operation unit. The approach / contact sensing means 80 may be sensed by a method such as contact current, capacitance, infrared distance measurement, etc., as in the detection mode of the operation unit 20. The approach / contact sensing means 80 is preferably a peripheral part of the operating part (that is, a part that supports the periphery of the wrist of the operating hand) where the hand is placed when operating the operating part 20, that is, a part in front of the operating part 20. Provided. Further, in the configuration using the light emitting means 24 as described above, the light emission control unit 74 (see FIG. 3) may cause the light emitting means 24 to emit light when detecting the approach or contact of the user's hand to the operation unit 20. . Similarly, in the configuration in which the operation guide image is prepared in advance as a background image, the hand image synthesis circuit 72 superimposes the operation guide image prepared in advance when detecting the approach or contact of the user's hand to the operation unit 20. Show it.

  FIG. 9 is a diagram illustrating another example of the operation guide unit 30. The configuration of the operation guide unit 30 can vary widely. For example, as shown in FIG. 9A, the operation area of the operation unit 20 can be divided more finely. That is, the operation guide part 30 may be formed in a cross beam shape. Further, the operation guide unit 30 does not necessarily need to completely traverse the operation region of the operation unit 20, and may not be provided at the peripheral portion of the operation region of the operation unit 20. Further, as shown in FIG. 9A, the operation guide portion 30 may be formed in a cross shape, and a substantially central region (central region of the cross) in the operation region may be circular. Further, as shown in FIG. 9B, the operation guide unit 30 may be arranged at points having sufficient size that can be recognized by the fingertip sense (in this example, four points near the center of each quadrant). Good. Moreover, the operation guide part 30 does not necessarily need to be convex, and may be concave. In any case, the operation guide image is formed so as to substantially correspond to the shape of the operation guide portion 30.

  The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to the above-described embodiments, and various modifications and substitutions can be made to the above-described embodiments without departing from the scope of the present invention. Can be added.

  For example, in the above-described embodiment, the image of the operation guide unit 30 is extracted and used as it is as the operation guide image. However, as with the hand image, the extracted operation guide image can be processed and then combined. is there. It is also possible to extract only the feature portion of the operation guide unit 30 and generate an operation guide image based on the extracted position information of the feature portion.

  For example, as illustrated in FIGS. 10 and 11, the operation unit 20 may be disposed in a recess or a recess (hereinafter, referred to as a “concave space 90”) formed in the instrument panel. The entrance of the recessed space 90 has an appropriately sized opening so that the user can operate the recessed space 90 by placing his / her hand. As a result, the user can search the position of the operation unit 20 by hand and rely on the concave portion of the concave space 90 to operate the operation unit 20. In this case, as shown in FIGS. 10 and 11, the camera 50 is disposed in the concave space 90 and is disposed to face the operation unit 20. That is, the camera 50 is installed downward on the flange portion 94 that constitutes the recessed space 90. Thereby, since direct incidence of sunlight on the lens of the camera 50 and incidence via reflection at the operation unit 20 are prevented, halation can be prevented.

  For example, as illustrated in FIGS. 12 and 13, the operation unit 20 may be disposed in a recessed space 90 formed in the center console unit. In the example shown in FIGS. 12 and 13, the center console portion is provided with a side wall portion 92 and a flange portion 94, and a concave space 90 surrounded by these portions is formed, and the operation portion 20 is disposed therein. It is installed. Thereby, since the amount of sunlight incident on the operation unit 20 is reduced, similarly, the same camera image that is not affected by sunlight as described above can be stably obtained. In this case, the camera 50 is arranged in the vicinity of the operation unit 20 in the concave space 90 (in this example, the back side of the operation unit 20), and the mirror 52 is arranged on the flange 94 facing the operation unit 20. The mirror 52 is a total reflection type plane mirror or a micro-convex mirror. In this case, the camera 50 and the mirror 52 are arranged in such a relationship that the camera 50 can overlook the operation unit 20 (and the user's hand operating it) via the mirror 52. Thereby, a required optical path length can be ensured even in the limited concave space 90. Further, by using the mirror 52, the degree of freedom of the arrangement of the camera 50 can be increased.

  It is also possible to apply a nocturnal paint corresponding to the key color to the operation unit 20 to eliminate the light emission of the light emitting means 24 only at night or to reduce the issue luminance. In addition, the fluorescent acrylic material corresponding to the key color may be used to compensate for brightness by using excitation light from sunlight when sunlight is incident.

DESCRIPTION OF SYMBOLS 20 Operation part 22 Transparent touch panel 24 Light emission means 30 Operation guide part 40 Display part 50 Camera 72 Hand image composition circuit 74 Light emission control part 80 Approach / contact detection means 90 Recessed space 92 Side wall part 94 Gutter part

Claims (2)

An operation unit in which an operation switch is arranged, and a display unit that displays an operation menu image representing the position and function of the operation switch in the operation unit are separately arranged at physically separated positions in the vehicle interior,
Imaging means for photographing a user's hand operating the operation unit together with the operation unit;
In the vehicle-mounted remote control device, comprising: on the display unit, combined display means for combining the captured hand image with the operation menu image for display.
The operation unit includes a concave or convex operation guide unit provided so that a user can easily perceive a region to which the position of his / her fingertip belongs in the entire operation region of the operation unit,
The composite display means is an operation guide image that allows the user to easily grasp the region to which the position of his / her fingertip belongs in the entire region of the operation unit in addition to the image of the hand on the display unit , An operation guide image corresponding to the shape of the operation guide portion is combined with the operation menu image and displayed,
The vehicle-mounted remote control device, wherein the operation guide image is displayed when the user's hand approaches or touches the operation unit. When there is no operation of the operation section by the user, the display unit in the operation menu image image displayed by the operation guide image is not displayed, the operation guide image, an approach or contact of a user's hand with respect to the operating unit The in-vehicle remote control device according to claim 1, wherein the remote control device is displayed for the first time when it is sensed.

Images