US8049722B2 - Vehicular operating apparatus - Google Patents

Vehicular operating apparatus Download PDF

Info

Publication number
US8049722B2
US8049722B2 US12/065,811 US6581106A US8049722B2 US 8049722 B2 US8049722 B2 US 8049722B2 US 6581106 A US6581106 A US 6581106A US 8049722 B2 US8049722 B2 US 8049722B2
Authority
US
United States
Prior art keywords
hand
operating
image
operating portion
vehicular
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/065,811
Other languages
English (en)
Other versions
US20080211832A1 (en
Inventor
Hitoshi Kumon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Assigned to TOYOTA JIDOSHA KABUSHIKI KAISHA reassignment TOYOTA JIDOSHA KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KUMON, HITOSHI
Publication of US20080211832A1 publication Critical patent/US20080211832A1/en
Application granted granted Critical
Publication of US8049722B2 publication Critical patent/US8049722B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10—Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor
    • B60K35/21—Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor using visual output, e.g. blinking lights or matrix displays
    • B60K35/22—Display screens
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/50—Instruments characterised by their means of attachment to or integration in the vehicle
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/60—Instruments characterised by their location or relative disposition in or on vehicles
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/80—Arrangements for controlling instruments
    • B60K35/81—Arrangements for controlling instruments for controlling displays
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/90—Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00—Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/20—Optical features of instruments
    • B60K2360/21—Optical features of instruments using cameras

Definitions

  • the invention relates to a vehicular operating apparatus in which an operating portion on which operating switches are arranged is arranged in a vehicle cabin in a separate location that is physically distanced from a display portion that displays an operation menu image showing the positional arrangement and function of the operating switch of the operating portion.
  • Japanese Patent Application Publication No. JP-A-2000-6687 discloses a related on-board equipment switch safety operating system which includes a multi-functional switch operating plate arranged in a preferable position in a vehicle, in which a plurality of various switches for operating various on-board equipment are arranged together, a display which is arranged in a preferable position in the vehicle within an operators forward field of view and displays an image of the arrangement of the plurality of switches, and a controller which, when the operator operates a given switch with a fingertip, performs control to notify the operator of the positional arrangement and function in the image of the given switch shown on the display based on a detection signal that is output when operation of the given switch is detected.
  • This operating system is structured such that the given switch on the multi-functional switch operating plate can be operated in real time by a fingertip while the operator visually confirms the image of the given switch displayed on the display while looking ahead.
  • another related on-board switch operating apparatus which is operated by the driver and controls electronic equipment in a vehicle, includes a switch array which can be arranged in a position near the driver's seat, thus allowing easy operation by the driver, and in which a plurality of switches are arranged; a camera which can be arranged near the driver's seat and which consecutively captures images of the switch array and switch operations by the driver; an indicator image data storing portion which stores indicator image data for indicating near each switch the function of that switch on the image captured by the camera; an image combining portion which combines the images of the indicating image data in the indicator image data storing portion with the image data of the captured image; a display portion which can be arranged in or near a front panel and displays the combined image; and a control portion which receives a switch operating signal and outputs a control signal for performing control corresponding to the function indicated on the image of the switch (for example, Japanese Patent Application Publication No. JP-A-2000-335330; similar technology is also disclosed in Japanese Patent Application Publication No
  • Japanese Patent Application Publication No. JP-A-10-236243 discloses a blind touch controller for specifying a menu for vehicle information shown on a display, which has switch operating means for specifying the vehicle information menu.
  • Human detecting means is provided on the switch operating means. When an operating finger is extended to operate the switch operating means, this human detecting means detects an object approaching an access area in a range a predetermined distance from the switch operating means, recognizes that the detected object is the operating finger, and generates an access signal.
  • the operating portion can be arranged in a position that is physically distanced from the display portion by using a camera to capture an image of the hand of the user which is operating the operating portion and showing that image superimposed on the display portion that shows the operation menu image.
  • the operating portion is mounted in a vehicle, it is inevitably exposed to an environment in which sunlight will shine onto it.
  • sunlight enters the operating portion it may cause the color (saturation) and brightness of the operating portion in the image to change or cause shadows from objects to be cast onto the operating portion.
  • the contrast difference or the color (saturation) difference between the image of the portion of the hand and the image of the portion other than the hand in the image i.e., the image of the operating portion
  • the object of this invention is thus to enable the various vehicular operating apparatuses described above to be able to extract an image of a hand from an image captured by capturing means even in an environment which is unavoidable due to the capturing means being mounted in a vehicle.
  • a first aspect of the invention relates to a vehicular operating apparatus in which an operating portion on which operating switches are arranged may be arranged in a vehicle cabin in a separate location that is physically distanced from a display portion that displays an operation menu image showing the positional arrangement and function of the operating switches of the operating portion, which is characterized by including imaging means for capturing an image of a hand of a user which operates the operating portion; combining and displaying means for combining the captured image of the hand with the operation menu image and displaying the combined image on the display portion; and light emitting means for illuminating the operating portion.
  • the combining and displaying means may use chroma key combining technology, and the light emitting means may use illuminate the operating portion in a key color.
  • the light emitting means may adjust the luminance of the emitted light with at least the amount of sunlight as a parameter.
  • shielding means for blocking sunlight from shining onto the operating portion may be provided in an area around the operating portion.
  • the operating portion may be arranged within a concave space formed in an interior member of the vehicle.
  • the imaging means may be arranged within the concave space.
  • the combining and displaying means may perform the combining and displaying by converting the image of the hand to a graphic image of a hand, combining the graphic image of the hand with the operation menu image and displaying the combined image on the display portion.
  • an outline of the hand in the graphic image of the hand may be generated based on a silhouette of the hand that is extracted based on the image of the hand, and the outline may be generated such that the region of the hand that is surrounded by the outline is smaller than the same region that is surrounded by the silhouette of the extracted hand so that the hand appears smaller than it actually is.
  • the combining and displaying means becomes operable when the hand of the user is detected near or touching the operating portion.
  • the light emitting means may illuminate the operating portion while gradually increasing the luminance of the emitted light when the hand of the user is detected near or touching the operating portion.
  • proximity/contact detecting means for detecting the proximity of or contact (i.e., touching) by the hand of the user may be provided in an area near the operating portion.
  • proximity/contact detecting means for detecting the proximity of or contact (i.e., touching) by the hand of the user may be provided in an area near the operating portion on which the hand is placed when operating the operating portion.
  • the effect of the above aspects is that it enables an image of a hand to be extracted from an image captured by capturing means even in an environment which is unavoidable due to the capturing means being mounted in a vehicle, by providing light emitting means for illuminating an operating portion.
  • FIG. 1 is a perspective view of an in-vehicle arrangement of a vehicular operating apparatus according to a first example embodiment of the invention
  • FIG. 2 is a sectional view schematically showing the vehicular operating apparatus shown in FIG. 1 as it appears from the side;
  • FIG. 3 is a functional block diagram of an in-vehicle system related to the vehicular operating apparatus
  • FIG. 4 is a view of one example of an operation menu image
  • FIG. 5 is a view of a camera image which includes a hand image to be extracted
  • FIG. 6 is a sectional view showing a main portion of an operating portion
  • FIG. 7A to FIG. 7D are views of a plurality of examples of combined images
  • FIG. 8 is a view of an example of a preferred generated outline of a hand in a graphic image of a hand
  • FIG. 9 is a perspective view of an in-vehicle arrangement of a vehicular operating apparatus according to a second example embodiment of the invention.
  • FIG. 10 is a sectional view schematically showing the vehicular operating apparatus shown in FIG. 9 as it appears from the side;
  • FIG. 11 is a perspective view of a vehicular operating apparatus according to another example embodiment.
  • FIG. 12 is a view illustrating another method of arrangement of a camera in a concave space
  • FIG. 13 is a perspective view of a covered operating unit
  • FIG. 14 is a sectional view of the covered operating unit shown in FIG. 13 .
  • FIG. 1 is a perspective view of an in-vehicle arrangement of a vehicular operating apparatus according to a first example embodiment the invention.
  • FIG. 2 is a sectional view schematically showing the vehicular operating apparatus shown in FIG. 1 as it appears from the side.
  • FIG. 3 is a functional block diagram of an in-vehicle system related to the vehicular operating apparatus.
  • the vehicular operating apparatus according to this example embodiment includes an operating portion 20 , a display portion 40 , and a camera 50 , with the operating portion 20 and the display portion 40 arranged in physically separate locations in the vehicle cabin.
  • the operating portion 20 may be, for example, a touch panel on which a plurality of operating switches are arranged, and is arranged in a position that enables it to be easily operated by a user, preferably in a position in which a driver can operate it by simply extending his or her hand.
  • the operating portion 20 may be arranged in a center console portion, as shown in FIG. 1 , or in an instrument panel.
  • the operating portion 20 is arranged so that its generally flat operating portion is substantially horizontal.
  • the display portion 40 is formed with a liquid crystal display or the like and is arranged in a position that is easy for the user to see, preferably in a position in which the driver can see it without greatly changing his or her field of vision while driving.
  • the operating portion 40 may be arranged in a center portion of an upper surface of an instrument panel, as shown in FIG. 1 , or in a meter.
  • the image output or picture output displayed by the display portion 40 is controlled by a display control unit 70 (see FIG. 3 ).
  • This display control unit 70 may be part of a navigation system (i.e., including the imaging processor), for example, in which case map images and the like in addition to an operation menu image, which will be described later, are supplied to the display portion 40 and displayed.
  • an operation menu image that aids the user in operating the operating portion 20 is displayed on the display portion 40 , as shown in FIG. 4 .
  • the operation menu image shows the positional arrangement and function of operating switches of the operating portion 20 .
  • the operation menu image serves to inform the user of the various functions that are realized by operating the operating portion 20 and also shows the user the locations of the switches to be operated in order to realize each of those various functions.
  • the operation menu image includes graphic images F 1 to F 8 simulating eight operating switches of the operating portion 20 .
  • the term “he” will be used to refer to both male and female for simplicity
  • the user knows that the operating switches of the operating portion 20 are arranged in two rows, one in back of the other.
  • the characters in each of the graphic images F 1 to F 8 the user is able to know the function that can be realized by operating the various operating switches.
  • the operating switch that is in the location corresponding to the graphic image F 3 that includes the characters for “mail”, i.e., the third operating switch from the left in the front row of the operating portion 20 .
  • Various operation menu images may be prepared and interchanged appropriately according to the operating state and the like of the operating portion 20 .
  • the positional arrangement and the function of the operating switches in the operating portion 20 change when the operation menu image changes.
  • operating switches for a host of on-board equipment can be realized in the operating portion 20 , making it possible to efficiently consolidate the operating switches.
  • various operating switches for various operations of an air-conditioning system and an audio system may be realized in addition to operations of on-board equipment of an information communication system such as E-mail, phone, and nearby facility guidance and the like.
  • the camera 50 is a small color camera in which a CCD or a CMOS, for example, is used as an imaging device.
  • the camera 50 is arranged so that it can look down on the operating portion 20 (and the hand of the user that is operating it). That is, the focal point and position/angle relationship with the operating portion 20 and the like of the camera 50 are determined so that the camera 50 captures the entire operating portion 20 . Accordingly, the entire image of the operating portion 20 is included in substantially the entire image captured by the camera 50 (hereinafter referred to as “camera image”).
  • camera image substantially the entire image captured by the camera 50
  • the camera image which includes the image of this hand is then provided to a hand image combining circuit 72 (see FIG. 3 ).
  • the hand image combining circuit 72 only the image of the hand (hereinafter referred to as “hand image”) is extracted from the camera image, and that extracted hand image is combined with the operation menu image supplied by the display control unit 70 and displayed by the display portion 40 . That is, the hand image is combined with the operation menu image and this combined image is then displayed on the display portion 40 .
  • this operation menu image that includes the hand image, which is displayed on the display portion 40 in this manner will simply be referred to as “combined image”.
  • Chroma key combining technology which is itself widely known, is typically used. Chroma key combining technology is technology which combines separate images by capturing an image having a background of a specific color (i.e., a key color) and superimposing another image onto that key color. Blue is typically used as the key color because provides the most contrast to the color of human skin, which makes it suitable for extracting a human hand from an image.
  • the operating portion 20 is made in the key color (such as blue), which will be described later, so that when the blue portion in the camera image is keyed out (i.e., removed) by the chroma key, only the hand image remains.
  • This hand image is then combined with the operation menu image (see FIG. 4 ) prepared as the background image.
  • luminance combining technology i.e., a method of specifying a particular luminance signal from among luminance signals (i.e., Luminance) that include contrast information and image luminance, and removing all signals equal to or less than, or equal to or greater than, that signal.
  • luminance combining technology i.e., a method of specifying a particular luminance signal from among luminance signals (i.e., Luminance) that include contrast information and image luminance, and removing all signals equal to or less than, or equal to or greater than, that signal.
  • luminance combining technology i.e., a method of specifying a particular luminance signal from among luminance signals
  • FIG. 7 shows a plurality of examples of combined images.
  • the combining position of the hand image i.e., the position in which the hand image is combined with the operation menu image, is determined so that the correlative positional relationship between the position of the hand in the hand image in the display portion 40 (i.e., based on a combined image) and each graphic image F 1 to F 8 accurately reproduce the correlative positional relationship between the actual position of the hand on the operating portion 20 and the position of each operating switch.
  • This combining position may be computed based on the correlative relationship between a coordinate system of the camera image and a coordinate system of the operation menu image (i.e., the coordinate conversion method). Any error or the like in the on-board position of the camera 50 may be appropriately corrected at this time.
  • the hand in the hand image is shown in a position to operate the graphic image F 3 .
  • the user is able to know that the function of the switch corresponding to the graphic image F 3 , i.e., an E-mail function, would be realized if he were to operate the switch with his hand in the current position. In this way, even if the user does not look directly at the operating portion 20 , he is able to operate a desired operating switch of the operating portion 20 while viewing the display portion 40 .
  • the switch when the user is the driver, he can operate the switch with the operating portion 20 which is within easy reach while looking at the display portion 40 which is in his forward field of view without greatly changing his driving posture or line of sight (a so-called blind touch operation), thereby enabling a switch operation to be performed safely without impeding driving.
  • people typically tend to position the fingertip on the operating switch relying on the position of the tip end portion of the finger instead of the flat portion of the finger that is detected by a sensor.
  • the camera is therefore preferably arranged to capture the operating portion 20 from the front of the operating portion 20 at an angle, as shown in FIG. 2 .
  • the optical axis of the camera 50 is set at an angle that is inclined approximately 20 degrees with respect to the generally flat operating surface of the operating portion 20 .
  • the tip end portion of the finger is included in the hand image of the combined image, thus improving operability.
  • the hand image extracted from the camera image is preferably combined after being converted to a graphic image which shows the hand either abstractly or artificially, as shown in FIGS. 7A , 7 B, 7 C, and 7 D, in order to avoid the user feeling a physiologically strange sensation (i.e., a creepy or yucky feeling) as he may if an image of the user's own hand were to directly appear.
  • a physiologically strange sensation i.e., a creepy or yucky feeling
  • the graphic image of the hand is generated based on an outline of the hand in the hand image that is extracted from the camera image. Not using the region inside of the outline of the hand in this way makes it possible to provide a stable hand image that is not easily affected by ambient light which differs between day and night, as well as makes it possible to avoid the user from feeling a physiologically strange sensation that he may otherwise feel if a large portion of his hand were displayed in a real fashion, as described above.
  • the graphic image of the hand may be generated in one of several ways. For example, as shown in FIG. 7A , the region inside the outline may be removed and that region colored a predetermined color (a non-transparent color) such that a silhouette of the hand appears on the display portion 40 . Alternatively, as shown in FIG. 7B , a semi-transparent color may be applied to the region inside the outline. In this case, a portion of the operation menu image that is being hidden behind the hand may be shown to the user while being semi-transparent. Or, as shown in FIG. 7C , only the outline of the hand may be displayed. In this case as well, the user may be shown the portion of the operation menu image that is being hidden behind the hand.
  • a predetermined color a non-transparent color
  • the outline may be displayed in such a manner that it is emphasized by a relatively thick line or strong luminance, as shown in FIG. 7C .
  • a graphic image may be generated by combining FIGS. 7B and 7C . That is, the outline may be emphasized while a semi-transparent color is applied to the region inside the outline. As a result, the portion being hidden behind the hand can be shown to the user while being semi-transparent. Also, the position of the hand can be quickly recognized by the emphasized outline.
  • the various graphic images described above are generated by the hand image combining circuit 72 .
  • the structure may also be such that the user is able to select and/or change which of the foregoing various graphic images is generated at that time.
  • the graphic image of the hand is preferably produced so that the hand in the graphic image appears smaller than it actually is. That is, the graphic image of the hand is preferably produced so that the region of the hand surrounded by the outline of the hand in the graphic image is smaller than the same region that is surrounded by the outline of the hand in the hand image that is extracted from the camera image.
  • This may be achieved, for example, by generating the outline of the hand in the graphic image with a heavy line, making the outline of the hand in the hand image that is extracted from the camera image the outside border, and thickening the heavy line to the inside, as shown in FIG. 8 . That is, the outside border line of the outline (the heavy line) of the hand in the graphic image may be made to match the outline of the hand in the hand image that is extracted from the camera image (i.e., the outline of the hand after it has been enlarged or reduced to match the operation menu image).
  • the region of the hand surrounded by the outline of the hand in the graphic image i.e., the region surrounded by the inside border line of the outline
  • the region of the hand surrounded by the inside border line of the outline can be made to appear smaller by an amount corresponding to the thickness of the heavy line without changing the size of the contour of the hand in the graphic image (i.e., the outside position of the heavy line).
  • the portion of the hand in the image that is effective for performing an actual operation corresponds to the inside of the hand (such as the flat portion of a finger), which makes it easier to accurately point to a given operating switch and thereby improves operability.
  • the contour itself of the hand in the graphic image may also be made smaller than the contour of the hand in the hand image extracted from the camera image by setting the outside border line of the outline (i.e., the heavy line) of the hand in the graphic image farther to the inside than the outline of the hand in the hand image extracted from the camera image.
  • the contour of the graphic image becomes smaller so the portion hidden behind the hand in the graphic image becomes smaller, thereby improving visibility.
  • the graphic image of the hand in which the contour has been reduced in size may be generated using the hand image combining circuit 72 to appropriately adjust the scale factor of the camera image or the hand image that is extracted from that camera image.
  • the operating portion 20 is not directly visible by the user during operation, which obviates the need to apply a graphic display showing the position and function and the like of the operation switch as shown in FIG. 4 to the operating portion 20 . Rather, the operating portion 20 needs to have a structure that makes it easy to extract the hand image. That is, as described above, the hand image is extracted by relying on the contrast difference or color difference between it and the image of portions other than the hand (i.e., the image of the operating portion 20 ) in the camera image (see FIG. 5 ). Therefore, an operating portion 20 which can provide luminance or color in the image to increase the contrast difference or color difference is useful.
  • the operating portion 20 is exposed to an environment in which sunlight inevitably shines on it due to the fact that it is mounted in a vehicle.
  • sunlight shines on the operating portion 20 is causes the color (saturation) and brightness of the operating portion 20 in the image to change and results in shadows of objects (including the shadow of the hand) appearing on the operating portion 20 .
  • the contrast difference or the color (saturation) difference between hand image and the image of the background which is the portion other than the hand in the image i.e., the image of the operating portion
  • the characteristic structure provided in this example embodiment is light emitting means 24 for illuminating the operating portion 20 .
  • the structure of the operating portion 20 including the light emitting means 24 will be described in detail with reference to FIG. 6 .
  • FIG. 6 is a sectional view showing a main portion of the operating portion 20 .
  • the operating portion 20 has a transparent touch panel 22 .
  • the transparent touch panel 22 may have a typical structure.
  • the transparent touch panel 22 has a layered structure. In the layered structured, an acrylic substrate 22 b (or glass substrate or the like) is provided at the bottom, and a film substrate 22 d is provided on top.
  • a thin film transparent electrode 22 a is provided on the acrylic substrate 22 b .
  • a thin film transparent electrode 22 c is provided under the film substrate 22 d .
  • the thin film transparent electrodes 22 a and 22 c face one another across dot spacers 22 e .
  • An operating signal (operating position signal) on the transparent touch panel 22 is supplied to the display control unit 70 (see FIG.
  • the display control unit 70 controls various on-board equipment to realize functions (including switching the operation menu image of the display portion 40 described above) in response to the operating signal (operating position signal) on the transparent touch panel 22 .
  • the light emitting means 24 is set on the side portion of the transparent touch panel 22 .
  • the light emitting means 24 is a light source such as an LED which is arranged to shine light from the side portion onto the acrylic substrate 22 b which is the bottom layer of the transparent touch panel 22 .
  • the light emitting means 24 illuminates the entire transparent touch panel 22 (i.e., the entire operating portion 20 ) from the side portion of the transparent touch panel 22 under the control of a light emitting control portion 74 (see FIG. 3 ) described in detail below.
  • the light emitted by the light emitting means 24 diffuses to substantially evenly illuminate the entire region of the transparent touch panel 22 by an acrylic light guide plate.
  • the light emitting means 24 may illuminate the entire transparent touch panel 22 (i.e., the entire operating panel 20 ) from behind the transparent touch panel 22 .
  • light emitted by the light emitting means 24 diffuses appropriately to illuminate, with substantially even luminosity, the entire operating portion 20 , i.e., so that light passes through the transparent touch panel 22 evenly across the entire operating region of the transparent touch panel 22 .
  • This light emitting means 24 may have a structure similar to that of a backlight of a liquid crystal display (e.g., a light guide plate type backlight provided with an acrylic light guide plate, a lamp, a lamp reflector plate, and the like).
  • a filter may be provided which enables the wavelength of the light source to pass through to the camera 50 .
  • the camera responds only to the wavelength of the light source and so is not easily affected by sunlight.
  • light of a wavelength not included in sunlight may be used for the light source.
  • the camera 50 captures images using light in a wavelength band not included in sunlight. Therefore, even if sunlight enters the operating portion 20 , it is possible to both prevent that sunlight from changing the color (saturation) or brightness of the operating portion 20 in the image, as well as prevent the shadow of an object from being combined in the image.
  • the operating portion 20 itself is illuminated by the light emitting means 24 so even if sunlight enters the operating portion 20 , it is possible to counteract that sunlight, which make it possible to avoid problems such as the color (saturation) or brightness of the operating portion 20 in the image changing due to the sunlight and shadows of objects being cast on the operating portion 20 . Accordingly, the luminance or color of the image of the operating portion 20 is stable because it is not affected by sunlight. Therefore, even if sunlight suddenly enters the operating portion 20 due to, for example, a change in the positional relationship between nearby buildings and the vehicle while the vehicle is running, the hand image can still be accurately extracted from the camera image so in this case as well, the desired combined image can be stably generated. Also, according to the invention, the color difference and the like necessary to accurately extract the hand image is maintained at a high level without being affected by sunlight, as described above, which also obviates the need for the camera 50 to be a high resolution camera which is expensive.
  • the operating portion 20 is illuminated so even in an environment in which there is insufficient lighting such as at night, there is no need to illuminate the operating portion 20 with interior cabin lighting or the like.
  • the operating portion 20 which is in easy reach is illuminated, thus preventing the driver from being bothered as he might by the cabin interior lighting.
  • the light emitting means 24 illuminates the operating portion 20 in a key color.
  • the difference in color between the hand and portions other than the hand is large and stable so a desired combined image can be generated that is stable because it is not affected by sunlight or the like.
  • the light which is emitted onto the operating portion 20 in this key color may be realized by, for example, coloring the acrylic light guide plate in the key color (e.g., painting the back surface of the transparent touch panel 22 with a blue fluorescent agent), using a color filter, or using a light source of the key color (such as a blue LED when the key color is blue).
  • the structure may also be such that the user can select the key color using a color filter or a light source of a plurality of colors.
  • the ON/OFF state and the emitted luminance and the like of the light emitting means 24 is controlled by the light emitting control portion 74 (see FIG. 3 ).
  • the light emitting control portion 74 may adjust the emitted luminance (i.e., strength) of the light emitting means according to the time, such as day or night, (or weather information). In this case, during the day when sunlight is the strongest, the light emitting means 24 may emit light at a relatively large luminance and at night when sunlight is weak, the light emitting means 24 may emit light at a relatively low luminance, and in the morning and evening may emit light at a medium luminance.
  • the light emitting means 24 may adjust the luminance of the light emitted using the amount of sunlight (obtained by a sunlight sensor, for example) or the amount of outside light or the like as a parameter.
  • the amount of sunlight obtained by a sunlight sensor, for example
  • the amount of outside light or the like as a parameter.
  • the operating portion 20 is not illuminated with strong light when the lighting is poor such as at night so light can be emitted which will both save energy and not disturb the driver, also as described above.
  • the light emitting control portion 74 controls the light emitting means 24 to emit light preferably when the hand of the user is detected near or touching the operating portion 20 .
  • the light emitting means 24 may either emit a reduced amount of light in which case the emitted luminance is low, or be turned off in which case the emitted luminance is zero.
  • the light emitting means 24 is preferably controlled to gradually increase the emitted luminance up to a target luminance (either a fixed value or a variable value) (i.e., fade in), which gives a sense of warmth or luxury.
  • the light emitting means 24 When the hand of the user is no longer detected near or touching the operating portion 20 or when the operating portion 20 has not been operated for a predetermined period of time or longer, the light emitting means 24 returns to its original off or reduced lighting state. At this time, the light emitting means 24 is similarly preferably controlled so that the emitted luminance is gradually reduced (i.e., fade out), which also gives a sense of luxury or warmth. Fading in and out of the light emitted by the light emitting means 24 can easily be realized by performing duty control on the voltage (current) supplied to the light emitting means 24 .
  • the hand image combining circuit 72 when a hand of the user is detected near or touching the operating portion 20 , the hand image combining circuit 72 also becomes operable (i.e., generates and outputs a combined image based on the camera image). That is, the light emitting means 24 and the hand image combining circuit 72 are both controlled ON and OFF in response to a proximity/contact detection signal from proximity/contact detecting means 30 , which saves energy and makes it possible to prevent an image of an object other than a hand from being erroneously combined when that object is captured by the camera 50 .
  • the proximity or touching of the hand to the operating portion 20 is preferably detected by the proximity/contact detecting means 30 (see FIGS. 1 , 3 , 13 , and 14 ) provided near the operating portion.
  • the proximity/contact detecting means 30 may be structured to detect according to any one of various methods such as contact current, capacitance, infrared measuring, or the like, similar to the detection mode of the operating portion 20 .
  • the proximity/contact detecting means 30 is preferably provided at a portion near the operating portion where the hand is placed when operating the operating portion 20 (i.e., a portion that supports an area around the wrist of the operating hand), that is, at a portion in front of the operating portion 20 .
  • the light emitting means 24 and the hand image combining circuit 72 only becomes active when the user places his hand on the portion near the operating portion.
  • Setting the proximity/contact detecting means 30 in an area where the user naturally places his hand during an operation in this way enables the user to easily learn a suitable operating method, while also preventing unnecessary operation of the hand image combining circuit 72 and the like without losing operability.
  • reference numeral 30 shows the detection area of the proximity/contact detecting means with a dotted line. In actuality, however, the proximity/contact detecting means 30 may also be fit beneath the surface layer of the center console so that it does not diminish the design (see FIG. 13 ).
  • FIG. 9 is a perspective view of an in-vehicle arrangement of a vehicular operating apparatus according to a second example embodiment of the invention
  • FIG. 10 is a sectional view schematically showing the vehicular operating apparatus shown in FIG. 9 as it appears from the side.
  • the second example embodiment differs from the first example embodiment mainly with respect to the arrangement of the operating portion 20 and the camera 50 .
  • structural elements that are the same as those in the first example embodiment will be denoted by the same reference numerals and descriptions of those structural elements will be omitted.
  • the operating portion 20 is arranged in a concave space or depression (hereinafter referred to as “concave space 90 ”) formed in an instrument panel, as shown in FIGS. 9 and 10 .
  • the opening to this concave space 90 is of an appropriate size that enables the user to insert his hand into it and operate the operating portion 20 . Accordingly, the user is able to locate the operating portion 20 by searching with his hand relying on the concave portion of the concave space 90 , and thus operate the operating portion 20 .
  • the operating portion 20 is arranged in the concave portion 90 , as described above, so left and right side wall portions 92 defining the concave portion of the concave space 90 when viewed from above, together with the upper side of an eave portion 94 that defines the concave portion of the concave space 90 when viewed from the side, shield (i.e., blocking) the operating portion 20 from sunlight.
  • This shielding means i.e., the side wall portions 92 and the eave portion 94
  • the operating portion 20 is preferably entirely housed within the concave space 90 to the extent to which operability is not lost, though a portion of the operating portion 20 may also protrude from the concave space 90 (see FIG. 13 ).
  • the concave space 90 is integrally formed with the instrument panel by forming the concave portion in the instrument panel.
  • the concave portion 90 may also be defined by a covered operating unit (see FIG. 13 ), to be described later, which can be attached to the instrument panel.
  • part of the side wall portion 92 and/or the eave portion 94 which define the concave space 90 may protrude farther toward the side where the driver is seated (i.e., toward the rear of the vehicle) than the portion around the instrument panel. This enables the user (particularly the driver) to locate the operating portion 20 by searching with his hand, relying on the concave portion of the concave space 90 and the protruding portion around that concave portion.
  • the camera 50 is arranged in the concave space 90 opposite the operating portion 20 , as shown in FIGS. 9 and 10 . That is, the camera 50 is arranged facing downward on the eave portion 94 that defines the concave space 90 .
  • sunlight is prevented from directly entering the lens of the camera 50 and as well as from entering the lens of the camera 50 by being reflected by the operating portion 20 , thus enabling halation to be prevented.
  • FIG. 11 is a perspective view of a vehicular operating apparatus according to another example embodiment.
  • the operating portion 20 is arranged in the concave space 90 formed in the center console portion. More specifically, the side wall portions 92 and the eave portion 94 are formed upright on the center console portion such that the concave space 90 is formed surrounded by those portions with the operating portion 20 arranged inside it. As a result, the amount of sunlight that enters the operating portion 20 is reduced, similarly enabling the same camera image that is not affected by sunlight to be even more stably obtained, as described above.
  • the concave space 90 is defined by the side wall portions 92 and the eave portion 94 that are integrally formed with the center console portion.
  • the concave portion 90 may also be defined by a covered operating unit (see FIG. 13 ), to be described later, which can be attached to the instrument panel.
  • part of the side wall portion 92 and/or the eave portion 94 which define the concave space 90 may protrude farther toward the side where the driver is seated (i.e., higher) than the portion around the center console portion. This enables the user (particularly the driver) to locate the operating portion 20 by searching with his hand, relying on the protruding portion.
  • the camera 50 may be arranged in the concave space 90 opposite the operating portion 20 , as shown in FIG. 10 .
  • sunlight is prevented from directly entering the lens of the camera 50 and as well as from entering the lens of the camera 50 by being reflected by the operating portion 20 , thus enabling halation to be prevented.
  • FIG. 12 is view illustrating another method of arrangement of the camera 50 in the concave space 90 schematically shown in the sectional view from the side.
  • the camera 50 is arranged near the operating portion 20 in the concave space 90 (on the far side of the operating portion 20 in this example embodiment), and a mirror 52 is arranged on the eave portion 94 opposite the operating portion 20 .
  • This mirror 52 is an all reflective type flat mirror or slightly convex mirror.
  • the camera 50 and the mirror 52 are arranged in a relationship in which the camera 50 is able to look down on the operating portion 20 (and the user's hand that is operating the operating portion 20 ) via the mirror 52 . As a result, the necessary light path can be ensured even in the restricted concave space 90 .
  • the mirror 52 is arranged midway in the light path from the camera 50 to the operating portion 20 so when the mirror 52 is a flat mirror arranged substantially near the center of the light path, for example, the necessary distance on each side between the operating portion 20 and the eave portion 94 in the concave space 90 when viewed from the side is substantially one-half that when the mirror 52 is not used.
  • FIG. 13 is a perspective view of a covered operating unit
  • FIG. 14 is a sectional view taken along line XIV-XIV in FIG. 13
  • a covered operating unit 200 is structured so as to be incorporated into the center console portion.
  • the covered operating unit 200 is an integrated unit provided with an operating portion 20 , a camera 50 , a mirror 52 , and proximity/contact detecting means 30 , as shown in FIG. 14 .
  • the cover operating unit 200 also has a concave space 90 like that described above, in which the operating portion 20 (i.e., a portion thereof), the camera 50 , and the mirror 52 are arranged.
  • the main structural elements of the vehicular operating apparatus can also be unified in this way.
  • a decorative relief (engraving) 100 is added to the back surface of the acrylic substrate 22 b in order to enhance the design.
  • a proximity or contact detection type operation switch is provided in the operating portion 20 .
  • a pushbutton type mechanical switch may be provided.
  • a mechanical switch may be provided in an escutcheon portion (i.e., a frame portion around the transparent touch panel 22 ) of the operating portion 20 .
  • the operation menu image is output to the display portion 40 .
  • another image or picture such as various pictures from TV, or a DVD or the like that is playing, as well as map images from a navigation system, may also be displayed.
  • a small operation menu image can also be displayed superimposed on a TV picture or the like.
  • a small operation menu image showing the positions of operating switches for changing the channel or volume may be displayed at the bottom of the screen over a TV picture, for example.
  • the combined image that includes the image of the user's hand that is attempting to operate the channel switch, for example, is superimposed on the TV picture, which enables the user to change the channel or the like in the operating portion 20 while viewing the positional relationship between the hand in the hand image and the operation menu image in the same way as described above.
  • operations can be performed with the operating portion 20 so the display of the display portion 40 does not have to be a touch panel type, although it may be.
  • the operating portion 20 may be painted with a night paint which corresponds to the key color so that light emitted from the light emitting means 24 cannot be eliminated or its luminance reduced only at night.
  • the brightness may be supplemented by using excitation light from sunlight when sunlight enters using fluorescent acrylic material that corresponds to the key color.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • User Interface Of Digital Computer (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Input From Keyboards Or The Like (AREA)
  • Position Input By Displaying (AREA)
  • Push-Button Switches (AREA)
US12/065,811 2005-09-05 2006-09-04 Vehicular operating apparatus Expired - Fee Related US8049722B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2005-256926 2005-09-05
JP2005256926A JP4389855B2 (ja) 2005-09-05 2005-09-05 車両用操作装置
PCT/IB2006/002442 WO2007029095A1 (en) 2005-09-05 2006-09-04 Vehicular operating apparatus

Publications (2)

Publication Number Publication Date
US20080211832A1 US20080211832A1 (en) 2008-09-04
US8049722B2 true US8049722B2 (en) 2011-11-01

Family

ID=37492368

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/065,811 Expired - Fee Related US8049722B2 (en) 2005-09-05 2006-09-04 Vehicular operating apparatus

Country Status (5)

Country Link
US (1) US8049722B2 (ja)
EP (1) EP1922223B1 (ja)
JP (1) JP4389855B2 (ja)
CN (1) CN101258046B (ja)
WO (1) WO2007029095A1 (ja)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080231608A1 (en) * 2007-03-23 2008-09-25 Denso Corporation Operating input device for reducing input error
US20090195372A1 (en) * 2008-02-06 2009-08-06 Denso Corporation Apparatus for extracting operating object and apparatus for projecting operating hand
US20110060499A1 (en) * 2009-09-04 2011-03-10 Hyundai Motor Japan R&D Center, Inc. Operation system for vehicle
US20110204788A1 (en) * 2010-02-24 2011-08-25 Denso Corporation Illumination controlling device for vehicle
US9757985B2 (en) 2015-09-25 2017-09-12 Honda Motor Co., Ltd. System and method for providing a gear selection indication for a vehicle
US11072240B2 (en) * 2018-06-20 2021-07-27 Daimay North America Automotive, Inc. Touch-sensitive vehicle console assemblies
US20230038718A1 (en) * 2021-08-05 2023-02-09 Autosystems, A Division Of Magna Exteriors Inc. Ambient lighting system with projected image and method for controlling an ambient lighting system

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8008412B2 (en) 2002-09-20 2011-08-30 Exxonmobil Chemical Patents Inc. Polymer production at supersolution conditions
US8058371B2 (en) 2002-09-20 2011-11-15 Exxonmobil Chemical Patents Inc. Super-solution homogeneous propylene polymerization
US8242237B2 (en) 2006-12-20 2012-08-14 Exxonmobil Chemical Patents Inc. Phase separator and monomer recycle for supercritical polymerization process
JP4933406B2 (ja) * 2007-11-15 2012-05-16 キヤノン株式会社 画像処理装置、画像処理方法
US8318875B2 (en) 2008-01-18 2012-11-27 Exxonmobil Chemical Patents Inc. Super-solution homogeneous propylene polymerization and polypropylenes made therefrom
JP4771183B2 (ja) * 2009-01-30 2011-09-14 株式会社デンソー 操作装置
JP5364925B2 (ja) * 2009-02-27 2013-12-11 現代自動車株式会社 車載機器の入力装置
JP4840620B2 (ja) * 2009-04-30 2011-12-21 株式会社デンソー 車載用電子機器操作装置
US20100315376A1 (en) * 2009-06-10 2010-12-16 Dave Jaeyeong Choi Control interface assemblies and vehicles including same
EP2273353A1 (en) * 2009-07-07 2011-01-12 Ford Global Technologies Inc. Improved human machine interface
WO2012008168A1 (ja) 2010-07-13 2012-01-19 株式会社 翔栄 タッチパネルを用いた入力装置およびその入カ方法
WO2012017698A1 (ja) * 2010-08-06 2012-02-09 株式会社 翔栄 タッチパネルを用いた入力装置およびその入力方法
JP5158152B2 (ja) * 2010-08-20 2013-03-06 株式会社デンソー 操作入力装置
WO2012054063A1 (en) 2010-10-22 2012-04-26 Hewlett-Packard Development Company L.P. An augmented reality display system and method of display
US8854802B2 (en) 2010-10-22 2014-10-07 Hewlett-Packard Development Company, L.P. Display with rotatable display screen
US9489102B2 (en) * 2010-10-22 2016-11-08 Hewlett-Packard Development Company, L.P. System and method of modifying lighting in a display system
JP2012113563A (ja) * 2010-11-25 2012-06-14 Kyocera Corp 携帯電子機器
JP5652432B2 (ja) * 2011-06-29 2015-01-14 トヨタ自動車株式会社 車両用操作装置
DE102012000263A1 (de) * 2012-01-10 2013-07-11 Daimler Ag Verfahren und Vorrichtung zum Bedienen von Funktionen in einem Fahrzeug unter Verwendung von im dreidimensionalen Raum ausgeführten Gesten sowie betreffendes Computerprogrammprodukt
WO2013179390A1 (ja) * 2012-05-29 2013-12-05 本田技研工業株式会社 車両用表示装置
US8994495B2 (en) * 2012-07-11 2015-03-31 Ford Global Technologies Virtual vehicle entry keypad and method of use thereof
US9986225B2 (en) * 2014-02-14 2018-05-29 Autodesk, Inc. Techniques for cut-away stereo content in a stereoscopic display
US10621778B2 (en) * 2015-10-30 2020-04-14 Faraday & Future Inc. Methods and systems for generating dynamic user interface effects
CN107179826B (zh) 2016-03-11 2021-08-31 松下知识产权经营株式会社 姿势输入系统和姿势输入方法
CN107199888A (zh) * 2016-03-18 2017-09-26 松下知识产权经营株式会社 姿势输入系统和姿势输入方法
JP2018132824A (ja) * 2017-02-13 2018-08-23 株式会社Ｓｏｋｅｎ 操作装置
DE102017206312B4 (de) 2017-04-12 2024-08-01 Ford Global Technologies, Llc Unterstützung einer Handhabung eines innerhalb eines Fahrgastinnenraums befindlichen Gegenstands sowie Kraftfahrzeug
US20180338103A1 (en) * 2017-05-16 2018-11-22 Bell Helicopter Textron Inc. Software video combiner
JP7239132B2 (ja) * 2018-03-30 2023-03-14 Ｎｅｃソリューションイノベータ株式会社 モーション判定装置、モーション判定方法、及びプログラム
JP7144721B2 (ja) * 2018-05-25 2022-09-30 株式会社デンソー 車両用表示制御システム、車両用表示制御プログラム及び記憶媒体

Citations (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0346724A (ja) 1989-07-14 1991-02-28 Aisin Seiki Co Ltd スイッチ装置
JPH05150925A (ja) 1991-05-31 1993-06-18 Philips Gloeilampenfab:Nv 人間−マシンインタフエースを具えた装置
JPH06274270A (ja) 1993-03-10 1994-09-30 Roehm Properties Bv 仮想現実空間データ入力装置
JPH0764709A (ja) 1993-08-26 1995-03-10 Olympus Optical Co Ltd 指示処理装置
JPH09190278A (ja) 1996-01-09 1997-07-22 Mitsubishi Motors Corp 機器の操作系選択装置
DE19605427A1 (de) 1994-12-09 1997-08-21 Bayerische Motoren Werke Ag Bedienvorrichtung in Kraftfahrzeugen
JPH10207620A (ja) 1997-01-28 1998-08-07 Atr Chinou Eizo Tsushin Kenkyusho:Kk 立体インタラクション装置および立体インタラクション方法
JPH10236243A (ja) 1997-02-28 1998-09-08 Yazaki Corp ブラインドタッチコントローラ及びこれを用いた情報表示装置
JPH10269012A (ja) 1997-03-28 1998-10-09 Yazaki Corp タッチパネルコントローラ及びこれを用いた情報表示装置
JPH10333094A (ja) 1996-12-18 1998-12-18 Toyota Motor Corp 立体画像表示装置、立体画像表示方法及び記録媒体
JPH1115401A (ja) 1997-06-20 1999-01-22 Casio Comput Co Ltd 表示装置、電子装置、および電子装置の製造方法
JP2000066784A (ja) 1998-08-26 2000-03-03 Nissan Motor Co Ltd 自動車用表示・操作装置
JP2000075991A (ja) 1998-08-28 2000-03-14 Aqueous Research:Kk 情報入力装置
JP2000335330A (ja) 1999-05-27 2000-12-05 Clarion Co Ltd 車載用スイッチ操作装置
JP2001174268A (ja) 1999-12-16 2001-06-29 Nec Corp 車載用ナビゲーション装置
JP2001216069A (ja) 2000-02-01 2001-08-10 Toshiba Corp 操作入力装置および方向検出方法
JP2001282428A (ja) 2000-03-29 2001-10-12 Matsushita Electric Ind Co Ltd 情報処理装置
DE10039432C1 (de) 2000-08-11 2001-12-06 Siemens Ag Bedieneinrichtung
JP2002132487A (ja) 2000-10-25 2002-05-10 Oki Electric Ind Co Ltd 遠隔作業支援システム
JP2003005912A (ja) 2001-06-20 2003-01-10 Hitachi Ltd タッチパネル付きディスプレイ装置及び表示方法
JP2003104122A (ja) 2001-09-28 2003-04-09 Clarion Co Ltd 車載用情報機器
JP2003248434A (ja) 2002-02-25 2003-09-05 Sharp Corp 表示装置及び冷蔵庫
JP2004012626A (ja) 2002-06-04 2004-01-15 Honda Motor Co Ltd 立体映像表示装置及び立体映像表示方法
JP2004026078A (ja) 2002-06-27 2004-01-29 Clarion Co Ltd 表示切り替えおよび操作モード切り替え装置
JP2004026046A (ja) 2002-06-26 2004-01-29 Clarion Co Ltd 車載用情報機器の操作装置
JP2004198971A (ja) 2002-12-20 2004-07-15 Namco Ltd 立体視用表示装置及び立体視用表示方法
US20040141634A1 (en) * 2002-10-25 2004-07-22 Keiichi Yamamoto Hand pattern switch device
JP2004213038A (ja) 2004-02-24 2004-07-29 Hitachi Software Eng Co Ltd 合成画像プリント装置
JP2004258714A (ja) 2003-02-24 2004-09-16 Toshiba Corp 画像表示装置
JP2004325324A (ja) 2003-04-25 2004-11-18 Denso Corp 車両用表示装置
JP2004334590A (ja) 2003-05-08 2004-11-25 Denso Corp 操作入力装置
JP2004341388A (ja) 2003-05-19 2004-12-02 Ssi Corp キーボード打鍵練習装置、キーボード打鍵練習方法、およびキーボード打鍵練習用プログラム
US20050063564A1 (en) * 2003-08-11 2005-03-24 Keiichi Yamamoto Hand pattern switch device
JP2005141102A (ja) 2003-11-07 2005-06-02 Pioneer Electronic Corp 立体的二次元画像表示装置及び方法
JP2005189323A (ja) 2003-12-24 2005-07-14 Seiko Epson Corp プロジェクタ、およびプロジェクタの制御方法
JP2005196530A (ja) 2004-01-08 2005-07-21 Alpine Electronics Inc 空間入力装置及び空間入力方法
JP2005254851A (ja) 2004-03-09 2005-09-22 Nissan Motor Co Ltd コマンド入力装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000006687A (ja) * 1998-06-25 2000-01-11 Yazaki Corp 車載機器スイッチ安全操作システム
JP2001350576A (ja) * 2000-06-08 2001-12-21 Clarion Co Ltd ビジュアルインターフェイス

Patent Citations (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0346724A (ja) 1989-07-14 1991-02-28 Aisin Seiki Co Ltd スイッチ装置
JPH05150925A (ja) 1991-05-31 1993-06-18 Philips Gloeilampenfab:Nv 人間−マシンインタフエースを具えた装置
JPH06274270A (ja) 1993-03-10 1994-09-30 Roehm Properties Bv 仮想現実空間データ入力装置
JPH0764709A (ja) 1993-08-26 1995-03-10 Olympus Optical Co Ltd 指示処理装置
DE19605427A1 (de) 1994-12-09 1997-08-21 Bayerische Motoren Werke Ag Bedienvorrichtung in Kraftfahrzeugen
JPH09190278A (ja) 1996-01-09 1997-07-22 Mitsubishi Motors Corp 機器の操作系選択装置
JPH10333094A (ja) 1996-12-18 1998-12-18 Toyota Motor Corp 立体画像表示装置、立体画像表示方法及び記録媒体
JPH10207620A (ja) 1997-01-28 1998-08-07 Atr Chinou Eizo Tsushin Kenkyusho:Kk 立体インタラクション装置および立体インタラクション方法
JPH10236243A (ja) 1997-02-28 1998-09-08 Yazaki Corp ブラインドタッチコントローラ及びこれを用いた情報表示装置
JPH10269012A (ja) 1997-03-28 1998-10-09 Yazaki Corp タッチパネルコントローラ及びこれを用いた情報表示装置
JPH1115401A (ja) 1997-06-20 1999-01-22 Casio Comput Co Ltd 表示装置、電子装置、および電子装置の製造方法
JP2000066784A (ja) 1998-08-26 2000-03-03 Nissan Motor Co Ltd 自動車用表示・操作装置
JP2000075991A (ja) 1998-08-28 2000-03-14 Aqueous Research:Kk 情報入力装置
JP2000335330A (ja) 1999-05-27 2000-12-05 Clarion Co Ltd 車載用スイッチ操作装置
JP2001174268A (ja) 1999-12-16 2001-06-29 Nec Corp 車載用ナビゲーション装置
JP2001216069A (ja) 2000-02-01 2001-08-10 Toshiba Corp 操作入力装置および方向検出方法
JP2001282428A (ja) 2000-03-29 2001-10-12 Matsushita Electric Ind Co Ltd 情報処理装置
US20020041260A1 (en) * 2000-08-11 2002-04-11 Norbert Grassmann System and method of operator control
DE10039432C1 (de) 2000-08-11 2001-12-06 Siemens Ag Bedieneinrichtung
JP2002132487A (ja) 2000-10-25 2002-05-10 Oki Electric Ind Co Ltd 遠隔作業支援システム
JP2003005912A (ja) 2001-06-20 2003-01-10 Hitachi Ltd タッチパネル付きディスプレイ装置及び表示方法
JP2003104122A (ja) 2001-09-28 2003-04-09 Clarion Co Ltd 車載用情報機器
JP2003248434A (ja) 2002-02-25 2003-09-05 Sharp Corp 表示装置及び冷蔵庫
JP2004012626A (ja) 2002-06-04 2004-01-15 Honda Motor Co Ltd 立体映像表示装置及び立体映像表示方法
JP2004026046A (ja) 2002-06-26 2004-01-29 Clarion Co Ltd 車載用情報機器の操作装置
JP2004026078A (ja) 2002-06-27 2004-01-29 Clarion Co Ltd 表示切り替えおよび操作モード切り替え装置
US20040141634A1 (en) * 2002-10-25 2004-07-22 Keiichi Yamamoto Hand pattern switch device
JP2004198971A (ja) 2002-12-20 2004-07-15 Namco Ltd 立体視用表示装置及び立体視用表示方法
JP2004258714A (ja) 2003-02-24 2004-09-16 Toshiba Corp 画像表示装置
JP2004325324A (ja) 2003-04-25 2004-11-18 Denso Corp 車両用表示装置
JP2004334590A (ja) 2003-05-08 2004-11-25 Denso Corp 操作入力装置
JP2004341388A (ja) 2003-05-19 2004-12-02 Ssi Corp キーボード打鍵練習装置、キーボード打鍵練習方法、およびキーボード打鍵練習用プログラム
US20050063564A1 (en) * 2003-08-11 2005-03-24 Keiichi Yamamoto Hand pattern switch device
JP2005141102A (ja) 2003-11-07 2005-06-02 Pioneer Electronic Corp 立体的二次元画像表示装置及び方法
JP2005189323A (ja) 2003-12-24 2005-07-14 Seiko Epson Corp プロジェクタ、およびプロジェクタの制御方法
JP2005196530A (ja) 2004-01-08 2005-07-21 Alpine Electronics Inc 空間入力装置及び空間入力方法
JP2004213038A (ja) 2004-02-24 2004-07-29 Hitachi Software Eng Co Ltd 合成画像プリント装置
JP2005254851A (ja) 2004-03-09 2005-09-22 Nissan Motor Co Ltd コマンド入力装置

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080231608A1 (en) * 2007-03-23 2008-09-25 Denso Corporation Operating input device for reducing input error
US8363010B2 (en) * 2007-03-23 2013-01-29 Denso Corporation Operating input device for reducing input error
US20090195372A1 (en) * 2008-02-06 2009-08-06 Denso Corporation Apparatus for extracting operating object and apparatus for projecting operating hand
US8270669B2 (en) * 2008-02-06 2012-09-18 Denso Corporation Apparatus for extracting operating object and apparatus for projecting operating hand
US20110060499A1 (en) * 2009-09-04 2011-03-10 Hyundai Motor Japan R&D Center, Inc. Operation system for vehicle
US8849506B2 (en) * 2009-09-04 2014-09-30 Hyundai Motor Japan R&D Center, Inc. Operation system for vehicle
US8466633B2 (en) * 2010-02-24 2013-06-18 Denso Corporation Illumination controlling device for vehicle
US20110204788A1 (en) * 2010-02-24 2011-08-25 Denso Corporation Illumination controlling device for vehicle
US9757985B2 (en) 2015-09-25 2017-09-12 Honda Motor Co., Ltd. System and method for providing a gear selection indication for a vehicle
US11072240B2 (en) * 2018-06-20 2021-07-27 Daimay North America Automotive, Inc. Touch-sensitive vehicle console assemblies
US11491876B2 (en) 2018-06-20 2022-11-08 Daimay North America Automotive, Inc. Touch sensitive vehicle console assemblies
US20230038718A1 (en) * 2021-08-05 2023-02-09 Autosystems, A Division Of Magna Exteriors Inc. Ambient lighting system with projected image and method for controlling an ambient lighting system
US11702004B2 (en) * 2021-08-05 2023-07-18 Autosystems, A Division Of Magna Exteriors Inc. Ambient lighting system with projected image and method for controlling an ambient lighting system

Also Published As

Publication number Publication date
JP2007069676A (ja) 2007-03-22
EP1922223A1 (en) 2008-05-21
US20080211832A1 (en) 2008-09-04
CN101258046B (zh) 2013-07-24
JP4389855B2 (ja) 2009-12-24
WO2007029095A1 (en) 2007-03-15
EP1922223B1 (en) 2012-03-28
CN101258046A (zh) 2008-09-03

Similar Documents

Publication Publication Date Title
US8049722B2 (en) Vehicular operating apparatus
JP4747810B2 (ja) 車載遠隔操作装置
US8085243B2 (en) Input device and its method
US20220402431A1 (en) Interior trim part of motor vehicle with thin-film display device
JP4356763B2 (ja) 操作装置
KR20000062255A (ko) 1인 이상용 정보 디스플레이 시스템
US20080197996A1 (en) Operating device
JP2009192434A (ja) 表示装置
CN105121210A (zh) 车载显示装置
JP2008158675A (ja) 車両用操作装置
JP2007237986A (ja) 車両用入力装置
CN110809528B (zh) 车辆用显示装置、拍摄系统以及照明装置
JP2007156950A (ja) 車両用操作装置
JP5240277B2 (ja) 車載遠隔操作装置
JP2008116566A (ja) 表示装置
CN113227882B (zh) 平视显示装置及头盔
US20230055148A1 (en) System for illuminating the face of an occupant in a car
WO2018230526A1 (ja) 入力システム、および入力方法
JP2003156369A (ja) 車両用計器
WO2023062132A1 (en) Vehicular overhead console with light transmissive panel
JP2022028359A (ja) パネル装置
JP2008102448A (ja) 表示装置
US20220242313A1 (en) Interior rearview device with human machine interface and vehicle therewith
JP2020059388A (ja) 表示装置及び表示制御装置
JP2003247871A (ja) 車両用計器

Legal Events

Date Code Title Description
AS Assignment

Owner name: TOYOTA JIDOSHA KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KUMON, HITOSHI;REEL/FRAME:020604/0077

Effective date: 20080219

ZAAA Notice of allowance and fees due

Free format text: ORIGINAL CODE: NOA

ZAAB Notice of allowance mailed

Free format text: ORIGINAL CODE: MN/=.

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20231101